-- Logs begin at Thu 2022-10-27 02:28:17 UTC, end at Thu 2022-10-27 05:13:44 UTC. -- Oct 27 03:00:00.572185 n-d-862769-1 systemd[1]: Starting Devstack devstack@keystone.service... Oct 27 03:00:00.581345 n-d-862769-1 devstack@keystone.service[82167]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 27 03:00:00.583394 n-d-862769-1 devstack@keystone.service[82167]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 27 03:00:00 2022] *** Oct 27 03:00:00.583394 n-d-862769-1 devstack@keystone.service[82167]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 03:00:00.583394 n-d-862769-1 devstack@keystone.service[82167]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 03:00:00.583394 n-d-862769-1 devstack@keystone.service[82167]: nodename: n-d-862769-1 Oct 27 03:00:00.583394 n-d-862769-1 devstack@keystone.service[82167]: machine: x86_64 Oct 27 03:00:00.583394 n-d-862769-1 devstack@keystone.service[82167]: clock source: unix Oct 27 03:00:00.583394 n-d-862769-1 devstack@keystone.service[82167]: pcre jit disabled Oct 27 03:00:00.583394 n-d-862769-1 devstack@keystone.service[82167]: detected number of CPU cores: 4 Oct 27 03:00:00.583394 n-d-862769-1 devstack@keystone.service[82167]: current working directory: / Oct 27 03:00:00.583394 n-d-862769-1 devstack@keystone.service[82167]: detected binary path: /usr/bin/uwsgi-core Oct 27 03:00:00.584379 n-d-862769-1 devstack@keystone.service[82167]: your processes number limit is 47680 Oct 27 03:00:00.584379 n-d-862769-1 devstack@keystone.service[82167]: your memory page size is 4096 bytes Oct 27 03:00:00.584379 n-d-862769-1 devstack@keystone.service[82167]: detected max file descriptor number: 2048 Oct 27 03:00:00.584379 n-d-862769-1 devstack@keystone.service[82167]: lock engine: pthread robust mutexes Oct 27 03:00:00.584379 n-d-862769-1 devstack@keystone.service[82167]: thunder lock: enabled Oct 27 03:00:00.584379 n-d-862769-1 devstack@keystone.service[82167]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 27 03:00:00.584379 n-d-862769-1 devstack@keystone.service[82167]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 27 03:00:00.624868 n-d-862769-1 devstack@keystone.service[82167]: Python main interpreter initialized at 0x55727c0589c0 Oct 27 03:00:00.624868 n-d-862769-1 devstack@keystone.service[82167]: python threads support enabled Oct 27 03:00:00.624868 n-d-862769-1 devstack@keystone.service[82167]: your server socket listen backlog is limited to 100 connections Oct 27 03:00:00.624868 n-d-862769-1 devstack@keystone.service[82167]: your mercy for graceful operations on workers is 90 seconds Oct 27 03:00:00.625214 n-d-862769-1 devstack@keystone.service[82167]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 03:00:00.625290 n-d-862769-1 devstack@keystone.service[82167]: *** Operational MODE: preforking *** Oct 27 03:00:00.625552 n-d-862769-1 devstack@keystone.service[82167]: *** uWSGI is running in multiple interpreter mode *** Oct 27 03:00:00.625552 n-d-862769-1 devstack@keystone.service[82167]: spawned uWSGI master process (pid: 82167) Oct 27 03:00:00.625752 n-d-862769-1 systemd[1]: Started Devstack devstack@keystone.service. Oct 27 03:00:00.626834 n-d-862769-1 devstack@keystone.service[82167]: spawned uWSGI worker 1 (pid: 82179, cores: 1) Oct 27 03:00:00.626834 n-d-862769-1 devstack@keystone.service[82167]: spawned uWSGI worker 2 (pid: 82180, cores: 1) Oct 27 03:00:00.626834 n-d-862769-1 devstack@keystone.service[82167]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 03:00:04.974691 n-d-862769-1 devstack@keystone.service[82180]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 03:00:04.974691 n-d-862769-1 devstack@keystone.service[82180]: from cryptography.utils import int_from_bytes Oct 27 03:00:04.975489 n-d-862769-1 devstack@keystone.service[82179]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 03:00:04.975489 n-d-862769-1 devstack@keystone.service[82179]: from cryptography.utils import int_from_bytes Oct 27 03:00:04.975927 n-d-862769-1 devstack@keystone.service[82180]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 03:00:04.975927 n-d-862769-1 devstack@keystone.service[82180]: from cryptography.utils import int_from_bytes Oct 27 03:00:04.976050 n-d-862769-1 devstack@keystone.service[82179]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 03:00:04.976050 n-d-862769-1 devstack@keystone.service[82179]: from cryptography.utils import int_from_bytes Oct 27 03:00:05.025448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 03:00:05.025621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 03:00:05.025728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 03:00:05.025867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] command line args: [] {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 03:00:05.025947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 03:00:05.026102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 03:00:05.026192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] command line args: [] {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 03:00:05.026277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ================================================================================ {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 03:00:05.026388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 03:00:05.026577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] admin_token = **** {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.027169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ================================================================================ {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 03:00:05.027328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] config_dir = [] {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.027413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] admin_token = **** {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.027520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.027638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] config_dir = [] {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.027722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] config_source = [] {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.027826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.027909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] debug = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.028010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] config_source = [] {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.028086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.028305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] debug = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.028377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.028467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.028607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.028690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.028755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.028859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.029007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.029093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.029253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.029343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] list_limit = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.029468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] log_config_append = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.029554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] list_limit = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.029657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] log_config_append = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.029729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.029828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] log_dir = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.029898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.030001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] log_dir = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.030144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] log_file = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.030250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] log_file = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.030376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.030452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.030572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.030654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.030777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.030922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.031032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.031113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.031264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.031418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.031548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.031678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.031760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.031877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.031958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.032086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.032168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.032239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.032307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.032431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.032561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.032642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.032713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.032817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.032938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.033051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.033174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.033299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.033420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.033535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.033798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.033982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] publish_errors = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.034149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.034277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] publish_errors = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.034399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.034520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.034640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.034759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.034879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.034992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.035168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.035298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.035424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.035540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.035652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] standard_threads = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.035774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] standard_threads = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.035888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.036042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.036165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.036279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.036398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.036521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.036635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] use_journal = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.036748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] use_journal = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.036861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] use_json = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.036974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] use_json = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.037125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] use_stderr = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.037253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] use_stderr = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.037374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] use_syslog = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.037488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] use_syslog = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.037608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.037728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:00:05.037843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.037964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.038104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.038264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.038377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.038489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.038602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.038797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.038920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.039035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.039153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.039273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.039395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.039510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.039622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.039622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.039841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.039956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.040076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.040190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.040308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.040422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.040534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.040646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.040768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.040882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.040994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.041106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.041219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.041341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.041465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.041585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.041705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.041820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.041933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.042062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.042190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.042305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.042424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.042543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.042666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.042786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.042910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.042910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.043130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.043130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.043353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.043473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.043596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.043717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.043831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.043951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.044065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.044177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.044365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.044482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.044595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.044707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.044819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.044932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.045053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.045167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.045285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.045406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.045520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.045633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.045753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.045753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.045973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.045973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.046330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.046330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.046589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.046589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.046805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.046805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.047025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.047147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.047268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.047268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.047481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.047593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.047706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.047831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.047945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.048065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.048178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.048291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.048435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.048570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.048692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.048812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.048933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.049049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.049172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.049298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.049413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.049527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.049646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.049760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.049874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.049995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.050136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.050255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.050376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.050497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.050618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.050732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.050853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.050969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.051082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.051196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.051310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.051429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.051553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.051667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.051781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.051781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.051995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.052109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.052230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.052347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.052460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.052583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.052705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.052828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.052955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.053081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.053197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.053197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.053416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.053546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.053702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.053838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.053961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.053961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.054232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.054232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.054419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.054419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.054611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.054707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.054802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.054802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.054990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.055095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.055202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.055299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.055416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.055519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.055631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.055821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.055939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.056053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.056166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.056279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.056399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.056524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.056630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.056748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.056863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.056965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.057087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.057210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.057337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.057453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.057558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.057670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.057784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.057898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.058019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.058019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.058242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.058242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.058455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.058455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.058683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.058683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.058900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.059020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.059136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.059136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.059361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.059477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.059598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.059714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.059828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.059958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.060183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.060306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.060422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.060537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.060658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.060774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.060896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.061012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.061127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.061248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.061363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.061483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.061607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.061607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.061837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.061953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.062094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.062211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.062338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.062450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.062572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.062572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.062789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.062789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.063015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.063157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] auth.external = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.063285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.063402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.063516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] auth.external = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.063516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.063739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.063739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.063974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.064092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] auth.password = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.064213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.064329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] auth.token = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.064449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] auth.password = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.064565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.064688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] auth.token = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.064805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.064913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.064913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.065091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.065091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.065278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.065278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.065458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.065553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.065650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.065753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.065851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.065949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.066063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] credential.caching = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.066167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] credential.caching = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.066264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.066264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.070490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.070571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.070689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.070778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.070854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.070978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.071056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.071127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.071197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.071267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.071337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.071418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.071492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.071562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.071632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.071702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.071772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.071772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.071909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.071909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.072038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.072038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.072165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.072165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.072375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.072375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.072504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.072504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] federation.caching = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.072631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.072709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.072782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] federation.caching = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.072782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.072908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.072978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.073048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.073126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.073199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.073269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.073339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.074050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.074128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.074214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.074288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.074359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.074429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.074499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.074569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.074569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.074706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.074776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.074846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.074916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] identity.caching = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.074985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.075062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.075134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] identity.caching = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.075204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.075268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.075338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.075407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.075486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.075559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.075630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.075700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.075770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.075839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.075920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.075992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.076062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.076132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.076201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.076271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.076349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.076492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.076576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.076697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.076780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.076853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.076936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.077016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.077087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.077157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.077233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.077313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.077389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.077461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.077531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.077601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.077671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.077749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.077822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.077892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.077963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.078093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.078171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.078254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.078329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.078399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.078470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.078540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.078610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.078688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.078760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.078829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.078899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.078969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.079039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.079118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.079190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.079260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.079329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.079399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.079468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.079545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.079617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.079693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.079764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.079834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.079904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.079981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.080052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.080122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.080191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.080261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.080330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.080407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.080479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.080555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.080627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.080697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.080697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.080831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.080831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.080967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.081088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.081163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.081302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.081392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.081555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.081637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.081791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.081871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.082023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.082132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.082277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.082355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.082539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.082629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.082783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.082907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.083018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.083107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.083257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.083336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.083490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.user = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.083578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.083722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.user = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.083800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.083963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.084040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.084199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.084285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.084438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.084514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.084686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.084764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.084932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.085017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.085170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.085248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.085400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.085477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.085629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.085715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.085862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.085940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.086120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.086202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.086357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.086437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.086582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.086658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.086829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.086907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.087074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.087152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.087316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.087398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.087559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.087643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.087792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.087871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.088018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.088094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.088262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.088340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.088497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.088575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.088729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.088805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.088964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.089073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.089772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.089853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.090024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.090167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.090294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.090372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.090554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.090643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.090788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.090866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.091039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.091183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.091387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.091517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.091517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.091760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.091886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.092024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.092165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.092292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.092419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.092550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.092678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.092805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.092939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.093065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.093193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.093324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] resource.caching = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.093451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] resource.caching = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.093577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.093711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.093847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.093973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.094143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.094269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.094396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.094533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.094660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.094785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.094911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.095038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.095162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.095298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.095424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.095549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.095684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.095684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] role.caching = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.095922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.096061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] role.driver = sql {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.096188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] role.caching = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.096316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.096443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] role.driver = sql {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.096568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.096693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.096826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.096953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.097078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.097204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.097341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.097481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.097610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.097727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.097842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.097947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.098074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.098178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.098288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.098406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.098521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.098636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.098749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.098864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.098987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.099104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.099219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.099334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.099450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.099573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.099573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.099792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.099792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.100007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.100123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.100246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.100363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.100477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.100593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.100708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.100823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.100946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.101062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.101167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.101281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.101395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.101510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.101633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.101750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.101864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.101978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.102139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.102255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.102385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.102504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.102619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.102733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.102847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.102962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.103085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.103202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.103316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.103430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.103544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.103660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.103782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.103898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.104012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.104127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] token.caching = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.104247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.104353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.104459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] token.caching = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.104557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.104688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.104788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.104885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.104981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.105086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.105186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.105331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.105434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.105530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.105657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.105763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.105860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.105957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.106078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.106180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.113093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.113214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.113296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.113414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.113489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.113561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.113640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.113713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.113713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.113840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.113840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.113976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.114097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.114210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.114310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.114397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.114470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] database.connection = **** {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.114541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.114612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.114683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] database.connection = **** {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.114753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.114831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.114903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.114974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.115044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.115114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.115185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.115263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.115341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.115412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.115483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.115553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.115623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.115768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.115843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.115915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.115986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.116056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.116133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.116213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.116286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.116357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.116427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.116498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.116568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.116645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.116718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.116788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.116858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.116928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.116999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.117077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.117214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.117294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.117412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 03:00:05.117490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:00:05.117490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 03:00:05.141567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.141800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.142052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.142255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.142486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.142709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.150389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.151104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.179967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.180202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.181235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.181235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.234510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.234942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.285971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.286224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.286408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.286642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.458149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.458381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.458494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.458609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.458815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.458899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.459036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.459126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.459253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.459334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.459467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.459678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.483115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.483282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.483372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.483535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.483618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.483756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.483849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.483970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.484053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.484180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.484263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.484392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.484475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.484657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.495507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.495914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.519850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.519972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.520086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.520199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.520317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.520423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.520527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.520641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.520750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.520855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.520965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.521055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.521180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.521262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 03:00:05.538432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.538647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 03:00:05.539317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.539455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.539535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 03:00:05.539609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 03:00:05.539609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.539741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.539823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.539898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 03:00:05.540105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.540187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.540367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.540458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.540881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.541145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.550444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.550731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.551008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.551293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.551378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.551569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.551840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.552122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.558350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.559193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.561257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.561546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.561833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.562098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.562197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.562388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.562471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.562670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.562752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.562941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.563024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.563216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.563296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.563510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.563603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.563782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.563863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.564056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.564136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.564439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.564715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.564985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.586751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.587856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.588222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.588511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.589950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.590260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.595444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.595731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.596496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.596892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.597176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.597458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.602548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.602846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.604149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.604435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.607641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.607937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.608223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.608511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.608790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.609074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.609260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.609342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.609553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.609634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.609833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.610135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.610409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.610690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.610969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.611257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.625729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.626014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.627340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.627619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.629886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.631557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.633421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.633721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.635055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.635350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.638027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.639610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.641185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.642801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.644467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.644769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.645059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.645358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.645652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.647414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.647545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.647545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.647545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.647545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.647545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.647545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.662285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.662578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.662851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.663123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.664336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.664624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.664892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.665155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.670614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.672168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.672856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.673716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.674007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.674414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.676032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.676321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.676684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.676974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.677370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.677658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.677940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.679082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.679370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.679759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.680045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.680338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.689177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.689459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.689844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.690162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.690470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.690762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.691047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.691619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.691902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.692279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.692562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.692857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.693135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.693410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.706548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.709290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.709475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.712445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.712563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.713949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.715894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.716120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.716416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.716701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.717406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.719056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.719350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.719632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.723127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.724614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.726059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.727517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.727660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.727955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.728244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.728554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.731212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.731503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.731784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.732058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.739332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.739332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.739332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.740090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.740382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.740701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.745289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.745572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.745858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.746228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.746506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.746785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.747062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.747345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.747618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.747900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.748174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.748521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.748603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 03:00:05.748801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.748890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.749072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.749153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.749412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.749686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.749960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.750267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.750548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.750859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.751141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.751412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.751682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.751964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.752231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 03:00:05.783417 n-d-862769-1 devstack@keystone.service[82179]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55727c0589c0 pid: 82179 (default app) Oct 27 03:00:05.786713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea0588-a78b-493a-a892-3262614136cc None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:05.786973 n-d-862769-1 devstack@keystone.service[82180]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55727c0589c0 pid: 82180 (default app) Oct 27 03:00:05.787060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea0588-a78b-493a-a892-3262614136cc None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:05.787261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea0588-a78b-493a-a892-3262614136cc None None] PATH_INFO: `/v3` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:05.791411 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Thu Oct 27 03:00:05 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:13.363122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd74b25-d4ac-4b03-8d4f-1bfdfd8d4d41 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:13.363627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd74b25-d4ac-4b03-8d4f-1bfdfd8d4d41 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:13.363708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd74b25-d4ac-4b03-8d4f-1bfdfd8d4d41 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:13.367957 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:13.373478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c47ea9-ee2f-4841-baaa-e15d6f960792 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:13.373888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c47ea9-ee2f-4841-baaa-e15d6f960792 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:13.374058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c47ea9-ee2f-4841-baaa-e15d6f960792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:13.445741 n-d-862769-1 devstack@keystone.service[82179]: INFO dbcounter [None req-08c47ea9-ee2f-4841-baaa-e15d6f960792 None None] Registered counter for database keystone Oct 27 03:00:13.465786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG oslo_db.sqlalchemy.engines [None req-08c47ea9-ee2f-4841-baaa-e15d6f960792 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 03:00:13.472062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writer thread running {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 03:00:13.654296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG passlib.handlers.bcrypt [None req-08c47ea9-ee2f-4841-baaa-e15d6f960792 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82179) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 27 03:00:13.654687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG passlib.handlers.bcrypt [None req-08c47ea9-ee2f-4841-baaa-e15d6f960792 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82179) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 27 03:00:13.712339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-08c47ea9-ee2f-4841-baaa-e15d6f960792 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:13.714008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-08c47ea9-ee2f-4841-baaa-e15d6f960792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:13.840291 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 27 03:00:14.352748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd74b25-d4ac-4b03-8d4f-1bfdfd8d4d41 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:14.423975 n-d-862769-1 devstack@keystone.service[82180]: INFO dbcounter [None req-acd74b25-d4ac-4b03-8d4f-1bfdfd8d4d41 None None] Registered counter for database keystone Oct 27 03:00:14.444875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG oslo_db.sqlalchemy.engines [None req-acd74b25-d4ac-4b03-8d4f-1bfdfd8d4d41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 03:00:14.451188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writer thread running {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 03:00:14.571643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd74b25-d4ac-4b03-8d4f-1bfdfd8d4d41 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:14.576032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38a739-7c05-45c2-b5af-536a68dbf9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:14.576662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38a739-7c05-45c2-b5af-536a68dbf9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:14.576949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38a739-7c05-45c2-b5af-536a68dbf9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:14.577229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38a739-7c05-45c2-b5af-536a68dbf9f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:14.585351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38a739-7c05-45c2-b5af-536a68dbf9f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:14.636935 n-d-862769-1 devstack@keystone.service[82180]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ac38a739-7c05-45c2-b5af-536a68dbf9f7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 27 03:00:14.637293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38a739-7c05-45c2-b5af-536a68dbf9f7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:14.646686 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Thu Oct 27 03:00:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 03:00:14.653278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c47ea9-ee2f-4841-baaa-e15d6f960792 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:14.670422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c47ea9-ee2f-4841-baaa-e15d6f960792 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:14.674835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbad4d9-ee6a-4617-8dc6-d9344212e2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:14.675939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbad4d9-ee6a-4617-8dc6-d9344212e2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:14.676222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbad4d9-ee6a-4617-8dc6-d9344212e2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:14.676496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbad4d9-ee6a-4617-8dc6-d9344212e2f6 admin admin] PATH_INFO: `/v3/projects/5e8ac2ac85cf42df9e4584993def5b4a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:14.680231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbad4d9-ee6a-4617-8dc6-d9344212e2f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=5e8ac2ac85cf42df9e4584993def5b4a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:14.730617 n-d-862769-1 devstack@keystone.service[82179]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8bbad4d9-ee6a-4617-8dc6-d9344212e2f6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 27 03:00:14.731014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbad4d9-ee6a-4617-8dc6-d9344212e2f6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:14.736105 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Thu Oct 27 03:00:14 2022] GET /identity/v3/projects/5e8ac2ac85cf42df9e4584993def5b4a => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:16.856825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f0e77-a999-43e8-b910-b87a8fc4edf7 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:16.857399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f0e77-a999-43e8-b910-b87a8fc4edf7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:16.857399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f0e77-a999-43e8-b910-b87a8fc4edf7 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:16.861412 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:16.866733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c459957-6494-4a99-bb70-5961108442c2 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:16.867158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c459957-6494-4a99-bb70-5961108442c2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:16.867293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c459957-6494-4a99-bb70-5961108442c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:16.888306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6c459957-6494-4a99-bb70-5961108442c2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:16.889836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6c459957-6494-4a99-bb70-5961108442c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:16.897621 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 27 03:00:17.162545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f0e77-a999-43e8-b910-b87a8fc4edf7 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:17.174713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f0e77-a999-43e8-b910-b87a8fc4edf7 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:17.179019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75760c54-c53a-4e39-9d71-d150773c903e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:17.179654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75760c54-c53a-4e39-9d71-d150773c903e admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:17.179943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75760c54-c53a-4e39-9d71-d150773c903e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:17.180220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75760c54-c53a-4e39-9d71-d150773c903e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:17.188118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75760c54-c53a-4e39-9d71-d150773c903e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:17.189908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75760c54-c53a-4e39-9d71-d150773c903e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:17.199155 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Thu Oct 27 03:00:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:00:17.204730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c459957-6494-4a99-bb70-5961108442c2 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:17.214535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c459957-6494-4a99-bb70-5961108442c2 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:17.218991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cef03-4793-42d9-88dc-a73aceae162f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:17.219621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cef03-4793-42d9-88dc-a73aceae162f admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:17.219911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cef03-4793-42d9-88dc-a73aceae162f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:17.220193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cef03-4793-42d9-88dc-a73aceae162f admin admin] PATH_INFO: `/v3/users/7c4a354216e64f78803accba54466d59` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:17.221544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cef03-4793-42d9-88dc-a73aceae162f admin admin] RBAC: Authorizing `identity:get_user(user_id=7c4a354216e64f78803accba54466d59)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:17.223421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cef03-4793-42d9-88dc-a73aceae162f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:17.224947 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Thu Oct 27 03:00:17 2022] GET /identity/v3/users/7c4a354216e64f78803accba54466d59 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:19.408285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9a838-ac14-48b0-b8e6-52a5ab4eedc4 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:19.408895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9a838-ac14-48b0-b8e6-52a5ab4eedc4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:19.408895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9a838-ac14-48b0-b8e6-52a5ab4eedc4 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:19.410208 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:19.415480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7030c-a557-4f59-b6b8-04e433e87fb0 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:19.415896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7030c-a557-4f59-b6b8-04e433e87fb0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:19.416036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7030c-a557-4f59-b6b8-04e433e87fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:19.433591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f0d7030c-a557-4f59-b6b8-04e433e87fb0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:19.434828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f0d7030c-a557-4f59-b6b8-04e433e87fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:19.474027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de01616-3996-4055-b706-6369871bfb29 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:19.474351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de01616-3996-4055-b706-6369871bfb29 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:19.474636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de01616-3996-4055-b706-6369871bfb29 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:19.475956 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:00:19.481090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a271a77-ffc3-4e35-a4fc-2f8f1d0ea647 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:19.481448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a271a77-ffc3-4e35-a4fc-2f8f1d0ea647 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:19.481796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a271a77-ffc3-4e35-a4fc-2f8f1d0ea647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:19.516533 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 03:00:19.524805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG passlib.handlers.bcrypt [None req-3a271a77-ffc3-4e35-a4fc-2f8f1d0ea647 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82180) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 27 03:00:19.525200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG passlib.handlers.bcrypt [None req-3a271a77-ffc3-4e35-a4fc-2f8f1d0ea647 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82180) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 27 03:00:19.574668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3a271a77-ffc3-4e35-a4fc-2f8f1d0ea647 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:19.576244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3a271a77-ffc3-4e35-a4fc-2f8f1d0ea647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:19.675144 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 03:00:19.785708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7030c-a557-4f59-b6b8-04e433e87fb0 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:19.809358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:19.886553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7030c-a557-4f59-b6b8-04e433e87fb0 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:19.919096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab5436-79e7-477e-ba14-c43354cb4442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:19.919729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab5436-79e7-477e-ba14-c43354cb4442 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:19.920010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab5436-79e7-477e-ba14-c43354cb4442 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:19.920286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab5436-79e7-477e-ba14-c43354cb4442 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:19.931013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab5436-79e7-477e-ba14-c43354cb4442 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:00:19.940229 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-3eab5436-79e7-477e-ba14-c43354cb4442 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:00:19.940229 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:19.940229 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:00:19.940229 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:00:19.940229 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:00:19.940229 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:00:19.940229 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:00:19.940229 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:00:19.940229 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:00:19.940229 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:00:19.940229 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:00:19.940229 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:00:19.940229 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:00:19.940229 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:00:19.940229 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:00:19.940229 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:00:19.941290 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:00:19.941290 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:00:19.941290 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:00:19.941290 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:00:19.941290 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:19.941290 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:19.941290 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:00:19.941290 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:00:19.941290 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:00:19.941290 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:00:19.941290 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:00:19.941290 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:00:19.941290 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:00:19.941290 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:00:19.941290 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:00:19.941290 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:00:19.942192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:00:19.942192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:00:19.942192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:00:19.942192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:00:19.942192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:00:19.942192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:00:19.942192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:00:19.942192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:00:19.942192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:00:19.942192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:00:19.942192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:00:19.942192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:00:19.942192 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 27 03:00:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:00:19.946471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a271a77-ffc3-4e35-a4fc-2f8f1d0ea647 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:19.946875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab5436-79e7-477e-ba14-c43354cb4442 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:20.026336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:20.044127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab5436-79e7-477e-ba14-c43354cb4442 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:20.045343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a271a77-ffc3-4e35-a4fc-2f8f1d0ea647 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:20.047650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:20.078475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb2dda-b096-4c56-bbed-1808fa016c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:20.079084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb2dda-b096-4c56-bbed-1808fa016c2c None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:20.079371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb2dda-b096-4c56-bbed-1808fa016c2c None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:20.079651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb2dda-b096-4c56-bbed-1808fa016c2c None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:20.080327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb2dda-b096-4c56-bbed-1808fa016c2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:20.080635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb2dda-b096-4c56-bbed-1808fa016c2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:20.081639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c68327-a122-47fc-bfa1-bf0268303e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:20.082121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb2dda-b096-4c56-bbed-1808fa016c2c None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:20.082534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c68327-a122-47fc-bfa1-bf0268303e77 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:20.082868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c68327-a122-47fc-bfa1-bf0268303e77 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:20.083148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c68327-a122-47fc-bfa1-bf0268303e77 None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:20.084121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c68327-a122-47fc-bfa1-bf0268303e77 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:20.085548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c68327-a122-47fc-bfa1-bf0268303e77 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:20.093676 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:00:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:00:20.099216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb2dda-b096-4c56-bbed-1808fa016c2c None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:20.152130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.sql.core [None req-e1c68327-a122-47fc-bfa1-bf0268303e77 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 27 03:00:20.152130 n-d-862769-1 devstack@keystone.service[82180]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 03:00:20.152130 n-d-862769-1 devstack@keystone.service[82180]: [parameters: {'id': '7e411168b3e44cf8b8117b5a455326c0', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 27 03:00:20.152130 n-d-862769-1 devstack@keystone.service[82180]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82180) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 03:00:20.172262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-e1c68327-a122-47fc-bfa1-bf0268303e77 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 27 03:00:20.172262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:20.172262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 03:00:20.172262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 03:00:20.172262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 03:00:20.172262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 03:00:20.172262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 03:00:20.172262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 03:00:20.172262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 03:00:20.172262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application conn.query(q) Oct 27 03:00:20.172262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 03:00:20.172262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 03:00:20.172262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 03:00:20.172262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application result.read() Oct 27 03:00:20.173249 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 03:00:20.173249 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 03:00:20.173249 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 03:00:20.173249 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 03:00:20.173249 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 03:00:20.173249 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 03:00:20.173249 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 03:00:20.173249 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 03:00:20.173249 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 27 03:00:20.173249 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:00:20.173249 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 27 03:00:20.173249 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:00:20.173249 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:20.173249 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 27 03:00:20.173249 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 27 03:00:20.173249 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 27 03:00:20.173249 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 27 03:00:20.173249 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 03:00:20.174972 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application next(self.gen) Oct 27 03:00:20.174972 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 27 03:00:20.174972 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application yield resource Oct 27 03:00:20.174972 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 03:00:20.174972 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application next(self.gen) Oct 27 03:00:20.174972 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 27 03:00:20.174972 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.session.rollback() Oct 27 03:00:20.174972 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:00:20.174972 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.force_reraise() Oct 27 03:00:20.174972 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:00:20.174972 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise self.value Oct 27 03:00:20.174972 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 27 03:00:20.174972 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 27 03:00:20.174972 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 27 03:00:20.174972 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application session.commit() Oct 27 03:00:20.174972 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 27 03:00:20.174972 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 27 03:00:20.175964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 27 03:00:20.175964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._prepare_impl() Oct 27 03:00:20.175964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 27 03:00:20.175964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.session.flush() Oct 27 03:00:20.175964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 03:00:20.175964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._flush(objects) Oct 27 03:00:20.175964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 03:00:20.175964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 27 03:00:20.175964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 03:00:20.175964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application compat.raise_( Oct 27 03:00:20.175964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 03:00:20.175964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception Oct 27 03:00:20.175964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 03:00:20.175964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application flush_context.execute() Oct 27 03:00:20.175964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 03:00:20.175964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rec.execute(self) Oct 27 03:00:20.175964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 03:00:20.176821 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 27 03:00:20.176821 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 03:00:20.176821 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 27 03:00:20.176821 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 27 03:00:20.176821 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 27 03:00:20.176821 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 03:00:20.176821 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 03:00:20.176821 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 03:00:20.176821 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 27 03:00:20.176821 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 03:00:20.176821 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 27 03:00:20.176821 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 03:00:20.176821 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 27 03:00:20.176821 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 03:00:20.176821 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 03:00:20.177563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 03:00:20.177563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception Oct 27 03:00:20.177563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 03:00:20.177563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 03:00:20.177563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 03:00:20.177563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 03:00:20.177563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 03:00:20.177563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 03:00:20.177563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 03:00:20.177563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application conn.query(q) Oct 27 03:00:20.177563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 03:00:20.177563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 03:00:20.177563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 03:00:20.177563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application result.read() Oct 27 03:00:20.177563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 03:00:20.177563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 03:00:20.177563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 03:00:20.178416 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 03:00:20.178416 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 03:00:20.178416 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 03:00:20.178416 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 03:00:20.178416 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 03:00:20.178416 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 27 03:00:20.178416 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 03:00:20.178416 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [parameters: {'id': '7e411168b3e44cf8b8117b5a455326c0', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 27 03:00:20.178416 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 03:00:20.178416 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:00:20.178416 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:00:20.178416 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:00:20.178416 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:20.178416 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 27 03:00:20.178416 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 27 03:00:20.179285 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 27 03:00:20.179285 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 27 03:00:20.179285 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 27 03:00:20.179285 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:00:20.179285 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:00:20.179285 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:00:20.179285 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:20.179285 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:00:20.179285 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:00:20.179285 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:00:20.179285 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:00:20.179285 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:00:20.179285 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:00:20.179285 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:00:20.179285 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:00:20.179285 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:00:20.179285 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:00:20.180384 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 27 03:00:20.180384 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 27 03:00:20.180384 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:20.180384 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:20.180384 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 27 03:00:20.180384 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 27 03:00:20.180384 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:20.180384 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:20.180384 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 27 03:00:20.180384 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 27 03:00:20.180384 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 27 03:00:20.180384 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:00:20.180384 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 8/16] 10.222.0.20 () {60 vars in 1137 bytes} [Thu Oct 27 03:00:19 2022] POST /identity/v3/domains => generated 190 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:00:20.181986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c68327-a122-47fc-bfa1-bf0268303e77 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:20.202290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb2dda-b096-4c56-bbed-1808fa016c2c None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:20.237064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4e43d-9cb3-4e12-b440-f9dcaac4de04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:20.237710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4e43d-9cb3-4e12-b440-f9dcaac4de04 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:20.237993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4e43d-9cb3-4e12-b440-f9dcaac4de04 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:20.238302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4e43d-9cb3-4e12-b440-f9dcaac4de04 None admin] PATH_INFO: `/v3/users/7c4a354216e64f78803accba54466d59` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:20.239459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4e43d-9cb3-4e12-b440-f9dcaac4de04 None admin] RBAC: Authorizing `identity:get_user(user_id=7c4a354216e64f78803accba54466d59)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:20.240935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4e43d-9cb3-4e12-b440-f9dcaac4de04 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:20.242553 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:00:20 2022] GET /identity/v3/users/7c4a354216e64f78803accba54466d59 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:00:20.248452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4e43d-9cb3-4e12-b440-f9dcaac4de04 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:20.262548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:20.283087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c68327-a122-47fc-bfa1-bf0268303e77 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:20.317732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d2645-22b0-4a5f-8465-f64b680534f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:20.318556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d2645-22b0-4a5f-8465-f64b680534f9 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:20.318841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d2645-22b0-4a5f-8465-f64b680534f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:20.319117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d2645-22b0-4a5f-8465-f64b680534f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:20.336422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d2645-22b0-4a5f-8465-f64b680534f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:20.337881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d2645-22b0-4a5f-8465-f64b680534f9 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:20.346610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4e43d-9cb3-4e12-b440-f9dcaac4de04 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:20.356664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-748d2645-22b0-4a5f-8465-f64b680534f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:00:20.356664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:20.356664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:00:20.356664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:00:20.356664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:00:20.356664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:00:20.356664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:00:20.356664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:00:20.356664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:00:20.356664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:00:20.356664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:00:20.356664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:00:20.356664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:00:20.356664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:00:20.356664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:00:20.356664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:00:20.357574 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:20.357574 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:20.357574 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:00:20.357574 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:00:20.357574 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:00:20.357574 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:00:20.357574 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:00:20.357574 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:00:20.357574 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:00:20.357574 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:00:20.357574 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:00:20.357574 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:00:20.357574 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:00:20.357574 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:00:20.357574 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:00:20.357574 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:00:20.357574 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:00:20.358747 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:00:20.358747 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:00:20.358747 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:00:20.358747 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 9/18] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:00:20.363552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d2645-22b0-4a5f-8465-f64b680534f9 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:20.381101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729ab9f-263f-4b55-91fc-a37dd4840d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:20.381738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729ab9f-263f-4b55-91fc-a37dd4840d90 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:20.382014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729ab9f-263f-4b55-91fc-a37dd4840d90 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:20.382315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729ab9f-263f-4b55-91fc-a37dd4840d90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:20.383672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729ab9f-263f-4b55-91fc-a37dd4840d90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:20.385119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729ab9f-263f-4b55-91fc-a37dd4840d90 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:20.385609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:20.387092 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 10/19] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:00:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:00:20.392613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729ab9f-263f-4b55-91fc-a37dd4840d90 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:20.462001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d2645-22b0-4a5f-8465-f64b680534f9 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:20.471926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:20.490690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729ab9f-263f-4b55-91fc-a37dd4840d90 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:20.496832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d15296-dcc8-46f2-9737-232db094c403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:20.497447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d15296-dcc8-46f2-9737-232db094c403 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:20.497728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d15296-dcc8-46f2-9737-232db094c403 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:20.498004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d15296-dcc8-46f2-9737-232db094c403 None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:20.498706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d15296-dcc8-46f2-9737-232db094c403 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:20.499009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d15296-dcc8-46f2-9737-232db094c403 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:20.500399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d15296-dcc8-46f2-9737-232db094c403 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:20.517356 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 10/20] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:00:20.524591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dda696-0012-4c18-ac04-05c4acb8ab4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:20.525288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dda696-0012-4c18-ac04-05c4acb8ab4c None admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:20.525576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dda696-0012-4c18-ac04-05c4acb8ab4c None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:20.525859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dda696-0012-4c18-ac04-05c4acb8ab4c None admin] PATH_INFO: `/v3/domains/default/users/7c4a354216e64f78803accba54466d59/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:20.528480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dda696-0012-4c18-ac04-05c4acb8ab4c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7c4a354216e64f78803accba54466d59, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:20.529985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dda696-0012-4c18-ac04-05c4acb8ab4c None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:20.705122 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 11/21] 10.222.0.20 () {58 vars in 1361 bytes} [Thu Oct 27 03:00:20 2022] PUT /identity/v3/domains/default/users/7c4a354216e64f78803accba54466d59/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:00:23.038236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793e8b8-18c1-4ea0-94d3-8f529f856ea3 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:23.038765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793e8b8-18c1-4ea0-94d3-8f529f856ea3 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:23.038765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793e8b8-18c1-4ea0-94d3-8f529f856ea3 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:23.040508 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 11/22] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:23.046652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc8934-c79e-413c-b0d8-a8b6b1bca280 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:23.047462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc8934-c79e-413c-b0d8-a8b6b1bca280 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:23.047938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc8934-c79e-413c-b0d8-a8b6b1bca280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:23.079128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-17fc8934-c79e-413c-b0d8-a8b6b1bca280 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:23.081013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-17fc8934-c79e-413c-b0d8-a8b6b1bca280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:23.117205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b0ffb-b825-4f3a-8b5c-9e54f3591e2f None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:23.117826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b0ffb-b825-4f3a-8b5c-9e54f3591e2f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:23.118331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b0ffb-b825-4f3a-8b5c-9e54f3591e2f None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:23.120431 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 12/23] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:00:23.125870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa2503-c3ac-48bd-9ecf-e61e84907bdd None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:23.126446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa2503-c3ac-48bd-9ecf-e61e84907bdd None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:23.126931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa2503-c3ac-48bd-9ecf-e61e84907bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:23.153245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-02aa2503-c3ac-48bd-9ecf-e61e84907bdd None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:23.154826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-02aa2503-c3ac-48bd-9ecf-e61e84907bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:23.215358 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 12/24] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 03:00:23.277839 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 13/25] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:23.561741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08701ee1-e073-4369-ae07-96a066801484 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:23.562126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08701ee1-e073-4369-ae07-96a066801484 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:23.562340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08701ee1-e073-4369-ae07-96a066801484 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:23.566532 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 13/26] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:23.571956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1815f1-1ffd-49ec-8bbe-711ed743deb8 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:23.572248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1815f1-1ffd-49ec-8bbe-711ed743deb8 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:23.572529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1815f1-1ffd-49ec-8bbe-711ed743deb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:23.598075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1a1815f1-1ffd-49ec-8bbe-711ed743deb8 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:23.599287 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1a1815f1-1ffd-49ec-8bbe-711ed743deb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:23.602209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:23.679370 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 14/27] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:23.793951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08701ee1-e073-4369-ae07-96a066801484 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:23.808099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1815f1-1ffd-49ec-8bbe-711ed743deb8 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:23.951748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:24.027361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1815f1-1ffd-49ec-8bbe-711ed743deb8 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:24.042895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08701ee1-e073-4369-ae07-96a066801484 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:24.080053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00aceb8-bda9-4ec2-bd6c-57c50a118334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:24.081357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00aceb8-bda9-4ec2-bd6c-57c50a118334 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:24.081869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00aceb8-bda9-4ec2-bd6c-57c50a118334 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:24.082377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00aceb8-bda9-4ec2-bd6c-57c50a118334 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:24.083410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00aceb8-bda9-4ec2-bd6c-57c50a118334 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:24.085013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00aceb8-bda9-4ec2-bd6c-57c50a118334 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:24.121583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cda360-34f3-46fe-bec6-a3946c311f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:24.122930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cda360-34f3-46fe-bec6-a3946c311f16 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:24.123402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cda360-34f3-46fe-bec6-a3946c311f16 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:24.123856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cda360-34f3-46fe-bec6-a3946c311f16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:24.139120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cda360-34f3-46fe-bec6-a3946c311f16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:24.142158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cda360-34f3-46fe-bec6-a3946c311f16 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:24.158620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-54cda360-34f3-46fe-bec6-a3946c311f16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:00:24.158620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:24.158620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:00:24.158620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:00:24.158620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:00:24.158620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:00:24.158620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:00:24.158620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:00:24.158620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:00:24.158620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:00:24.158620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:00:24.158620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:00:24.158620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:00:24.158620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:00:24.158620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:00:24.158620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:00:24.159584 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:24.159584 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:24.159584 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:00:24.159584 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:00:24.159584 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:00:24.159584 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:00:24.159584 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:00:24.159584 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:00:24.159584 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:00:24.159584 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:00:24.159584 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:00:24.159584 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:00:24.159584 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:00:24.159584 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:00:24.159584 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:00:24.159584 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:00:24.159584 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:00:24.160391 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:00:24.160391 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:00:24.160391 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:00:24.162068 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 14/28] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:00:24.163664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45393c70-ed03-4233-9bd1-ef73b1d98c2b None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:24.170312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45393c70-ed03-4233-9bd1-ef73b1d98c2b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:24.170312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45393c70-ed03-4233-9bd1-ef73b1d98c2b None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:24.170312 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 15/29] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:24.170312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45393c70-ed03-4233-9bd1-ef73b1d98c2b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:24.198533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:24.346161 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 15/30] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Oct 27 03:00:23 2022] POST /identity/v3/roles => generated 219 bytes in 531 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:00:24.349826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00aceb8-bda9-4ec2-bd6c-57c50a118334 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:24.386813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45393c70-ed03-4233-9bd1-ef73b1d98c2b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:24.419188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:24.437045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bfb5e-97ef-4ef7-af1d-6545aa663b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:24.438432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bfb5e-97ef-4ef7-af1d-6545aa663b5c None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:24.438923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bfb5e-97ef-4ef7-af1d-6545aa663b5c None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:24.440401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bfb5e-97ef-4ef7-af1d-6545aa663b5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:24.455583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bfb5e-97ef-4ef7-af1d-6545aa663b5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:00:24.463113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-ee4bfb5e-97ef-4ef7-af1d-6545aa663b5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:00:24.463113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:24.463113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:00:24.463113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:00:24.463113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:00:24.463113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:00:24.463113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:00:24.463113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:00:24.463113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:00:24.463113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:00:24.463113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:00:24.463113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:00:24.463113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:00:24.463113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:00:24.463113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:00:24.463113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:00:24.464567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:00:24.464567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:00:24.464567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:00:24.464567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:00:24.464567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:24.464567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:24.464567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:00:24.464567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:00:24.464567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:00:24.464567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:00:24.464567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:00:24.464567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:00:24.464567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:00:24.464567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:00:24.464567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:00:24.464567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:00:24.465330 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:00:24.465330 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:00:24.465330 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:00:24.465330 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:00:24.465330 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:00:24.465330 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:00:24.465330 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:00:24.465330 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:00:24.465330 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:00:24.465330 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:00:24.465330 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:00:24.465330 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:00:24.473012 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 16/31] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 27 03:00:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:00:24.475458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d192fe-8fc5-4a7b-b875-bf6e02c00c88 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:24.475983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d192fe-8fc5-4a7b-b875-bf6e02c00c88 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:24.476538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d192fe-8fc5-4a7b-b875-bf6e02c00c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:24.502760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a3d192fe-8fc5-4a7b-b875-bf6e02c00c88 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:24.504429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a3d192fe-8fc5-4a7b-b875-bf6e02c00c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:24.543840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00aceb8-bda9-4ec2-bd6c-57c50a118334 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:24.585870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c41a61-75bf-4ea6-80f2-a01226abb076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:24.586837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c41a61-75bf-4ea6-80f2-a01226abb076 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:24.587115 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 17/32] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:24.587554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c41a61-75bf-4ea6-80f2-a01226abb076 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:24.588055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c41a61-75bf-4ea6-80f2-a01226abb076 None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:24.589118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0a20d-8379-45fe-a70d-2d6bfc531c88 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:24.589409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0a20d-8379-45fe-a70d-2d6bfc531c88 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:24.589685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0a20d-8379-45fe-a70d-2d6bfc531c88 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:24.590113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c41a61-75bf-4ea6-80f2-a01226abb076 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:24.590367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c41a61-75bf-4ea6-80f2-a01226abb076 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:24.591122 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 18/33] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:24.591740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0a20d-8379-45fe-a70d-2d6bfc531c88 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:24.591972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c41a61-75bf-4ea6-80f2-a01226abb076 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:24.605941 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 16/34] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:24.607658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397de25-bcf2-48d3-9056-9f10229ca494 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:24.607954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397de25-bcf2-48d3-9056-9f10229ca494 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:24.608231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397de25-bcf2-48d3-9056-9f10229ca494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:24.628753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0397de25-bcf2-48d3-9056-9f10229ca494 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:24.630763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0397de25-bcf2-48d3-9056-9f10229ca494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:24.700158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:24.712813 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 17/35] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:24.714315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397de25-bcf2-48d3-9056-9f10229ca494 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:24.721481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0a20d-8379-45fe-a70d-2d6bfc531c88 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:24.738283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:24.769490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028eda3-6016-4d3c-850e-145d7db55266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:24.770485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028eda3-6016-4d3c-850e-145d7db55266 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:24.771530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028eda3-6016-4d3c-850e-145d7db55266 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:24.772221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028eda3-6016-4d3c-850e-145d7db55266 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:24.773180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028eda3-6016-4d3c-850e-145d7db55266 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:24.773957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028eda3-6016-4d3c-850e-145d7db55266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:24.776895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028eda3-6016-4d3c-850e-145d7db55266 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:24.792685 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 19/36] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:00:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:24.795292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028eda3-6016-4d3c-850e-145d7db55266 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:24.828615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397de25-bcf2-48d3-9056-9f10229ca494 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:24.864908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a518b8-97bc-4ba7-9235-409c4f3ad8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:24.865591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a518b8-97bc-4ba7-9235-409c4f3ad8e4 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:24.865993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a518b8-97bc-4ba7-9235-409c4f3ad8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:24.866391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a518b8-97bc-4ba7-9235-409c4f3ad8e4 None admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:24.867141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a518b8-97bc-4ba7-9235-409c4f3ad8e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:24.868746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a518b8-97bc-4ba7-9235-409c4f3ad8e4 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:24.920619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028eda3-6016-4d3c-850e-145d7db55266 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:24.956112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb6e67-4b8b-4d20-bb45-c02b0c27236d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:24.956753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb6e67-4b8b-4d20-bb45-c02b0c27236d None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:24.957039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb6e67-4b8b-4d20-bb45-c02b0c27236d None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:24.957315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb6e67-4b8b-4d20-bb45-c02b0c27236d None admin] PATH_INFO: `/v3/users/7c4a354216e64f78803accba54466d59` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:24.958493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb6e67-4b8b-4d20-bb45-c02b0c27236d None admin] RBAC: Authorizing `identity:get_user(user_id=7c4a354216e64f78803accba54466d59)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:24.960000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb6e67-4b8b-4d20-bb45-c02b0c27236d None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:24.961725 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 20/37] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:00:24 2022] GET /identity/v3/users/7c4a354216e64f78803accba54466d59 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:24.965984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb6e67-4b8b-4d20-bb45-c02b0c27236d None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:24.982552 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 18/38] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 27 03:00:24 2022] POST /identity/v3/projects => generated 301 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:00:24.985402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a518b8-97bc-4ba7-9235-409c4f3ad8e4 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:25.043064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:25.095607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:25.111887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb6e67-4b8b-4d20-bb45-c02b0c27236d None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:25.162340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab625a9d-29a3-42ef-b53d-2593be0c3712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:25.163179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab625a9d-29a3-42ef-b53d-2593be0c3712 None admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:25.163467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab625a9d-29a3-42ef-b53d-2593be0c3712 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:25.163748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab625a9d-29a3-42ef-b53d-2593be0c3712 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:25.164525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab625a9d-29a3-42ef-b53d-2593be0c3712 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:25.164615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a518b8-97bc-4ba7-9235-409c4f3ad8e4 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:25.166019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab625a9d-29a3-42ef-b53d-2593be0c3712 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:25.203828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27343c88-0477-416c-b3bf-df568d15310c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:25.204474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27343c88-0477-416c-b3bf-df568d15310c None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:25.204761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27343c88-0477-416c-b3bf-df568d15310c None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:25.205045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27343c88-0477-416c-b3bf-df568d15310c None admin] PATH_INFO: `/v3/domains/default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:25.206246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27343c88-0477-416c-b3bf-df568d15310c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:25.207721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27343c88-0477-416c-b3bf-df568d15310c None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:25.209298 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 19/39] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:00:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:25.210154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27343c88-0477-416c-b3bf-df568d15310c None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:25.233747 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Oct 27 03:00:24 2022] POST /identity/v3/roles => generated 225 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:00:25.234978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37c6c2-5845-4585-9c28-835acec49558 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:25.235271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37c6c2-5845-4585-9c28-835acec49558 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:25.235950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37c6c2-5845-4585-9c28-835acec49558 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:25.237158 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 22/41] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:25.237780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37c6c2-5845-4585-9c28-835acec49558 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:25.343543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27343c88-0477-416c-b3bf-df568d15310c None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:25.356593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:25.385940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d37375-7fd2-496d-b199-a45012cf5f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:25.386680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d37375-7fd2-496d-b199-a45012cf5f27 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:25.386970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d37375-7fd2-496d-b199-a45012cf5f27 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:25.387245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d37375-7fd2-496d-b199-a45012cf5f27 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:25.387958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d37375-7fd2-496d-b199-a45012cf5f27 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:25.389411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d37375-7fd2-496d-b199-a45012cf5f27 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:25.475122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37c6c2-5845-4585-9c28-835acec49558 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:25.476657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:25.499259 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 20/42] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Oct 27 03:00:25 2022] POST /identity/v3/roles => generated 223 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:00:25.500596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff2295-7fc0-45f1-9319-e435e0c551fd None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:25.500899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff2295-7fc0-45f1-9319-e435e0c551fd None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:25.501183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff2295-7fc0-45f1-9319-e435e0c551fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:25.512051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c614e-200c-4a2c-aacb-72a19d588fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:25.512690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c614e-200c-4a2c-aacb-72a19d588fc7 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:25.512975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c614e-200c-4a2c-aacb-72a19d588fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:25.513248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c614e-200c-4a2c-aacb-72a19d588fc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:25.514013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c614e-200c-4a2c-aacb-72a19d588fc7 None admin] RBAC: Adding query filter params (role.id=6e91e7a416ac452b86ec238a2b81bc07, scope.domain.id=default, user.id=7c4a354216e64f78803accba54466d59) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:25.514454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c614e-200c-4a2c-aacb-72a19d588fc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:25.516020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c614e-200c-4a2c-aacb-72a19d588fc7 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:25.521462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0eff2295-7fc0-45f1-9319-e435e0c551fd None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:25.522769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0eff2295-7fc0-45f1-9319-e435e0c551fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:25.526290 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 23/43] 10.222.0.20 () {56 vars in 1322 bytes} [Thu Oct 27 03:00:25 2022] GET /identity/v3/role_assignments?user.id=7c4a354216e64f78803accba54466d59&scope.domain.id=default&role.id=6e91e7a416ac452b86ec238a2b81bc07 => generated 530 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:25.603747 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 21/44] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:25.872166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c614e-200c-4a2c-aacb-72a19d588fc7 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:25.969123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c614e-200c-4a2c-aacb-72a19d588fc7 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:26.001792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0c66e-9b96-40f6-bc7b-c599d3984775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:26.002448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0c66e-9b96-40f6-bc7b-c599d3984775 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:26.002738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0c66e-9b96-40f6-bc7b-c599d3984775 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:26.003021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0c66e-9b96-40f6-bc7b-c599d3984775 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:26.004138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0c66e-9b96-40f6-bc7b-c599d3984775 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:26.005593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0c66e-9b96-40f6-bc7b-c599d3984775 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:26.007184 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 24/45] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:00:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:26.013350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff2295-7fc0-45f1-9319-e435e0c551fd None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:26.105481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:26.108286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff2295-7fc0-45f1-9319-e435e0c551fd None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:26.140647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f16aa-c5e9-4fe1-bb6b-5e1a6ec90426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:26.141205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f16aa-c5e9-4fe1-bb6b-5e1a6ec90426 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:26.141495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f16aa-c5e9-4fe1-bb6b-5e1a6ec90426 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:26.141776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f16aa-c5e9-4fe1-bb6b-5e1a6ec90426 None admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:26.142464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f16aa-c5e9-4fe1-bb6b-5e1a6ec90426 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:26.143991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f16aa-c5e9-4fe1-bb6b-5e1a6ec90426 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:26.233078 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 22/46] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 27 03:00:26 2022] POST /identity/v3/projects => generated 312 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:00:28.366964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffc650-4aa2-4324-9b93-aec8075c84b3 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:28.367463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffc650-4aa2-4324-9b93-aec8075c84b3 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:28.367571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffc650-4aa2-4324-9b93-aec8075c84b3 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:28.368873 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 25/47] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:28.374113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd744fd-0417-4efd-9d45-854a96aca500 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:28.374508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd744fd-0417-4efd-9d45-854a96aca500 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:28.374687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd744fd-0417-4efd-9d45-854a96aca500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:28.393264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3dd744fd-0417-4efd-9d45-854a96aca500 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:28.394513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3dd744fd-0417-4efd-9d45-854a96aca500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:28.458220 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 23/48] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:28.729335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffc650-4aa2-4324-9b93-aec8075c84b3 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:28.764644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:28.828005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffc650-4aa2-4324-9b93-aec8075c84b3 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:28.859722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09347252-795d-48e8-8223-3353a944223e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:28.860347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09347252-795d-48e8-8223-3353a944223e None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:28.860634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09347252-795d-48e8-8223-3353a944223e None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:28.860912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09347252-795d-48e8-8223-3353a944223e None admin] PATH_INFO: `/v3/domains/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:28.862053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09347252-795d-48e8-8223-3353a944223e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:28.863508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09347252-795d-48e8-8223-3353a944223e None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:28.865062 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 26/49] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:00:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:28.870994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd744fd-0417-4efd-9d45-854a96aca500 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:28.946923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:28.964322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd744fd-0417-4efd-9d45-854a96aca500 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:28.996628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e19006-c6eb-4fc0-b2c0-2690fc8e5d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:28.997264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e19006-c6eb-4fc0-b2c0-2690fc8e5d40 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:28.997551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e19006-c6eb-4fc0-b2c0-2690fc8e5d40 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:28.997829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e19006-c6eb-4fc0-b2c0-2690fc8e5d40 None admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:28.998509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e19006-c6eb-4fc0-b2c0-2690fc8e5d40 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:28.999953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e19006-c6eb-4fc0-b2c0-2690fc8e5d40 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:29.083527 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 24/50] 10.222.0.20 () {60 vars in 1140 bytes} [Thu Oct 27 03:00:28 2022] POST /identity/v3/projects => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:00:31.232914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068faafc-048a-4885-875a-3e19b82be566 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:31.233379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068faafc-048a-4885-875a-3e19b82be566 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:31.233472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068faafc-048a-4885-875a-3e19b82be566 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:31.234838 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 27/51] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:31.240066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936319c-e732-46dc-b3bb-f4aa76ca79b6 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:31.240489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936319c-e732-46dc-b3bb-f4aa76ca79b6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:31.240627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936319c-e732-46dc-b3bb-f4aa76ca79b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:31.259253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9936319c-e732-46dc-b3bb-f4aa76ca79b6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:31.260962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9936319c-e732-46dc-b3bb-f4aa76ca79b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:31.426448 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 25/52] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:31.692031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068faafc-048a-4885-875a-3e19b82be566 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:31.794042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068faafc-048a-4885-875a-3e19b82be566 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:31.795537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:31.827028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13078508-5213-46ed-a687-98e0a5941b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:31.827651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13078508-5213-46ed-a687-98e0a5941b90 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:31.827934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13078508-5213-46ed-a687-98e0a5941b90 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:31.828209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13078508-5213-46ed-a687-98e0a5941b90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:31.829309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13078508-5213-46ed-a687-98e0a5941b90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:31.830778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13078508-5213-46ed-a687-98e0a5941b90 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:31.832339 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 28/53] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:00:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:31.838110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936319c-e732-46dc-b3bb-f4aa76ca79b6 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:31.897183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:31.932384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936319c-e732-46dc-b3bb-f4aa76ca79b6 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:31.965536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb515ec5-be74-400c-af01-5275ef40b0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:31.966179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb515ec5-be74-400c-af01-5275ef40b0de None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:31.966470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb515ec5-be74-400c-af01-5275ef40b0de None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:31.966749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb515ec5-be74-400c-af01-5275ef40b0de None admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:31.967407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb515ec5-be74-400c-af01-5275ef40b0de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:31.968854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb515ec5-be74-400c-af01-5275ef40b0de None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:32.068897 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 26/54] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 27 03:00:31 2022] POST /identity/v3/users => generated 275 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:00:35.121857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395161e-10be-4382-a751-ca9e80e9d579 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:35.122732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395161e-10be-4382-a751-ca9e80e9d579 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:35.123144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395161e-10be-4382-a751-ca9e80e9d579 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:35.124629 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 29/55] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:35.130024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bd590-2c8d-4481-97b8-ce9e57b3137a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:35.130833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bd590-2c8d-4481-97b8-ce9e57b3137a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:35.131247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bd590-2c8d-4481-97b8-ce9e57b3137a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:35.153776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c24bd590-2c8d-4481-97b8-ce9e57b3137a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:35.155205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c24bd590-2c8d-4481-97b8-ce9e57b3137a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:35.260365 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 27/56] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:35.393345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d2b36-5382-4a01-b921-73c502f570db None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:35.393833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d2b36-5382-4a01-b921-73c502f570db None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:35.394294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d2b36-5382-4a01-b921-73c502f570db None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:35.395779 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 30/57] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:35.401514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350225e2-6645-45d3-9d94-aa2229e41039 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:35.401951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350225e2-6645-45d3-9d94-aa2229e41039 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:35.402386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350225e2-6645-45d3-9d94-aa2229e41039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:35.431507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-350225e2-6645-45d3-9d94-aa2229e41039 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:35.432964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-350225e2-6645-45d3-9d94-aa2229e41039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:35.490211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:35.519637 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 28/58] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:35.710440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e59b7-9620-4466-91a6-7ce49b8320d6 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:35.711058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e59b7-9620-4466-91a6-7ce49b8320d6 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:35.711555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e59b7-9620-4466-91a6-7ce49b8320d6 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:35.713644 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 31/59] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:35.718860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350225e2-6645-45d3-9d94-aa2229e41039 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:35.719169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047f947-109f-4f90-82cf-c9d21f5bf413 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:35.719644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047f947-109f-4f90-82cf-c9d21f5bf413 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:35.720107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047f947-109f-4f90-82cf-c9d21f5bf413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:35.751013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c047f947-109f-4f90-82cf-c9d21f5bf413 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:35.752561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c047f947-109f-4f90-82cf-c9d21f5bf413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:35.870663 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 32/60] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:35.875701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350225e2-6645-45d3-9d94-aa2229e41039 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:35.916700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047f947-109f-4f90-82cf-c9d21f5bf413 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:35.938297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec84531-755c-43e4-b8de-e4984640041e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:35.938976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec84531-755c-43e4-b8de-e4984640041e None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:35.939258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec84531-755c-43e4-b8de-e4984640041e None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:35.939533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec84531-755c-43e4-b8de-e4984640041e None admin] PATH_INFO: `/v3/roles/member` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:35.953503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec84531-755c-43e4-b8de-e4984640041e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:00:35.959853 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-1ec84531-755c-43e4-b8de-e4984640041e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:00:35.959853 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:35.959853 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:00:35.959853 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:00:35.959853 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:00:35.959853 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:00:35.959853 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:00:35.959853 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:00:35.959853 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:00:35.959853 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:00:35.959853 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:00:35.959853 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:00:35.959853 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:00:35.959853 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:00:35.959853 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:00:35.959853 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:00:35.960793 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:00:35.960793 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:00:35.960793 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:00:35.960793 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:00:35.960793 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:35.960793 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:35.960793 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:00:35.960793 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:00:35.960793 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:00:35.960793 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:00:35.960793 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:00:35.960793 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:00:35.960793 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:00:35.960793 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:00:35.960793 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:00:35.960793 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:00:35.962004 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:00:35.962004 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:00:35.962004 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:00:35.962004 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:00:35.962004 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:00:35.962004 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:00:35.962004 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:00:35.962004 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:00:35.962004 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:00:35.962004 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:00:35.962004 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:00:35.962004 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:00:35.962004 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 29/61] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:00:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:00:35.962896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86b9a9-b9a3-4a3c-9470-ffdca93c8103 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:35.962896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86b9a9-b9a3-4a3c-9470-ffdca93c8103 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:35.962896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86b9a9-b9a3-4a3c-9470-ffdca93c8103 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:35.964272 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 30/62] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:35.969102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86b9a9-b9a3-4a3c-9470-ffdca93c8103 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:36.023122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:36.031688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:36.035024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047f947-109f-4f90-82cf-c9d21f5bf413 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:36.073587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acb0c2-046f-433f-9038-839491cd036b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:36.074302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acb0c2-046f-433f-9038-839491cd036b None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:36.074619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acb0c2-046f-433f-9038-839491cd036b None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:36.074905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acb0c2-046f-433f-9038-839491cd036b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:36.084911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acb0c2-046f-433f-9038-839491cd036b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:00:36.090074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-54acb0c2-046f-433f-9038-839491cd036b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:00:36.090074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:36.090074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:00:36.090074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:00:36.090074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:00:36.090074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:00:36.090074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:00:36.090074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:00:36.090074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:00:36.090074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:00:36.090074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:00:36.090074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:00:36.090074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:00:36.090074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:00:36.090074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:00:36.090074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:00:36.090894 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:00:36.090894 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:00:36.090894 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:00:36.090894 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:00:36.090894 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:36.090894 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:36.090894 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:00:36.090894 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:00:36.090894 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:00:36.090894 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:00:36.090894 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:00:36.090894 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:00:36.090894 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:00:36.090894 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:00:36.090894 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:00:36.090894 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:00:36.091657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:00:36.091657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:00:36.091657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:00:36.091657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:00:36.091657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:00:36.091657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:00:36.091657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:00:36.091657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:00:36.091657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:00:36.091657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:00:36.091657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:00:36.091657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:00:36.099058 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 33/63] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 27 03:00:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:00:36.099058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db669f9c-d4f8-4ef6-baf8-969c7ad8b766 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:36.099058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db669f9c-d4f8-4ef6-baf8-969c7ad8b766 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:36.099058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db669f9c-d4f8-4ef6-baf8-969c7ad8b766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:36.099428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86b9a9-b9a3-4a3c-9470-ffdca93c8103 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:36.114879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-db669f9c-d4f8-4ef6-baf8-969c7ad8b766 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:36.116074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-db669f9c-d4f8-4ef6-baf8-969c7ad8b766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:36.134793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21183e22-f1a1-42f0-b229-6a6a87cdf52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:36.135434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21183e22-f1a1-42f0-b229-6a6a87cdf52b None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:36.135723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21183e22-f1a1-42f0-b229-6a6a87cdf52b None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:36.135998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21183e22-f1a1-42f0-b229-6a6a87cdf52b None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:36.136659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21183e22-f1a1-42f0-b229-6a6a87cdf52b None admin] RBAC: Adding query filter params (name=member) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:36.136964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21183e22-f1a1-42f0-b229-6a6a87cdf52b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:36.138372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21183e22-f1a1-42f0-b229-6a6a87cdf52b None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:36.150946 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 31/64] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 27 03:00:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:36.152276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092b62a-7d24-4869-b3a1-665aaee0a9c5 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:36.152626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092b62a-7d24-4869-b3a1-665aaee0a9c5 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:36.152980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092b62a-7d24-4869-b3a1-665aaee0a9c5 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:36.154403 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 32/65] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:36.155975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092b62a-7d24-4869-b3a1-665aaee0a9c5 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:36.190520 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 34/66] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:36.191376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db669f9c-d4f8-4ef6-baf8-969c7ad8b766 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:36.278637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092b62a-7d24-4869-b3a1-665aaee0a9c5 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:36.280734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:36.288510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:36.298634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db669f9c-d4f8-4ef6-baf8-969c7ad8b766 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:36.316615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea551ab3-e98c-4ec5-96ab-b534ebd0ee49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:36.317241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea551ab3-e98c-4ec5-96ab-b534ebd0ee49 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:36.317550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea551ab3-e98c-4ec5-96ab-b534ebd0ee49 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:36.317852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea551ab3-e98c-4ec5-96ab-b534ebd0ee49 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:36.318541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea551ab3-e98c-4ec5-96ab-b534ebd0ee49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:36.319141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea551ab3-e98c-4ec5-96ab-b534ebd0ee49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:36.320360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea551ab3-e98c-4ec5-96ab-b534ebd0ee49 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:36.334224 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 33/67] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:00:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:36.334224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea551ab3-e98c-4ec5-96ab-b534ebd0ee49 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:36.334422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f919b-8dc8-42aa-b221-7ce98945f138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:36.334422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f919b-8dc8-42aa-b221-7ce98945f138 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:36.334422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f919b-8dc8-42aa-b221-7ce98945f138 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:36.334422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f919b-8dc8-42aa-b221-7ce98945f138 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:36.345443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f919b-8dc8-42aa-b221-7ce98945f138 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:00:36.350390 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-1c9f919b-8dc8-42aa-b221-7ce98945f138 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 03:00:36.350390 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:36.350390 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:00:36.350390 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:00:36.350390 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:00:36.350390 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:00:36.350390 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:00:36.350390 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:00:36.350390 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:00:36.350390 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:00:36.350390 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:00:36.350390 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:00:36.350390 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:00:36.350390 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:00:36.350390 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:00:36.350390 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:00:36.351256 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:00:36.351256 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:00:36.351256 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:00:36.351256 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:00:36.351256 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:36.351256 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:36.351256 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:00:36.351256 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:00:36.351256 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:00:36.351256 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:00:36.351256 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:00:36.351256 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:00:36.351256 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:00:36.351256 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:00:36.351256 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:00:36.351256 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:00:36.352082 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:00:36.352082 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:00:36.352082 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:00:36.352082 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:00:36.352082 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:00:36.352082 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:00:36.352082 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:00:36.352082 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:00:36.352082 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:00:36.352082 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:00:36.352082 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 03:00:36.352082 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:00:36.352082 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 35/68] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 27 03:00:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:00:36.353184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5359ba4-8ccd-4e5f-87f9-87a12fb00533 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:36.353184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5359ba4-8ccd-4e5f-87f9-87a12fb00533 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:36.353184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5359ba4-8ccd-4e5f-87f9-87a12fb00533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:36.371252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e5359ba4-8ccd-4e5f-87f9-87a12fb00533 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:36.372453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e5359ba4-8ccd-4e5f-87f9-87a12fb00533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:36.441344 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 36/69] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:36.442613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5359ba4-8ccd-4e5f-87f9-87a12fb00533 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:36.461487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea551ab3-e98c-4ec5-96ab-b534ebd0ee49 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:36.496585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54d83d-e6f4-4f7b-ab3c-b63550034e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:36.497220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54d83d-e6f4-4f7b-ab3c-b63550034e9b None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:36.497503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54d83d-e6f4-4f7b-ab3c-b63550034e9b None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:36.497784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54d83d-e6f4-4f7b-ab3c-b63550034e9b None admin] PATH_INFO: `/v3/users/424dced1baf54e1892a377e81493f665` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:36.514021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54d83d-e6f4-4f7b-ab3c-b63550034e9b None admin] RBAC: Authorizing `identity:get_user(user_id=424dced1baf54e1892a377e81493f665)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:36.515518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54d83d-e6f4-4f7b-ab3c-b63550034e9b None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:36.521503 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 34/70] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:00:36 2022] GET /identity/v3/users/424dced1baf54e1892a377e81493f665 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:36.521503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54d83d-e6f4-4f7b-ab3c-b63550034e9b None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:36.528876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:36.547745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:36.548270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5359ba4-8ccd-4e5f-87f9-87a12fb00533 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:36.585454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d7aee-6853-4889-8218-b0edc1d80697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:36.586329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d7aee-6853-4889-8218-b0edc1d80697 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:36.586788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d7aee-6853-4889-8218-b0edc1d80697 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:36.587203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d7aee-6853-4889-8218-b0edc1d80697 None admin] PATH_INFO: `/v3/users/7c4a354216e64f78803accba54466d59` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:36.589149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d7aee-6853-4889-8218-b0edc1d80697 None admin] RBAC: Authorizing `identity:get_user(user_id=7c4a354216e64f78803accba54466d59)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:36.590811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d7aee-6853-4889-8218-b0edc1d80697 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:36.592579 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 37/71] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:00:36 2022] GET /identity/v3/users/7c4a354216e64f78803accba54466d59 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:36.593483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d7aee-6853-4889-8218-b0edc1d80697 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:36.633352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54d83d-e6f4-4f7b-ab3c-b63550034e9b None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:36.671010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6a6ff-dbf0-4970-a37d-e42bdfdb4d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:36.671939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6a6ff-dbf0-4970-a37d-e42bdfdb4d47 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:36.672409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6a6ff-dbf0-4970-a37d-e42bdfdb4d47 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:36.672862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6a6ff-dbf0-4970-a37d-e42bdfdb4d47 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:36.673824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6a6ff-dbf0-4970-a37d-e42bdfdb4d47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:36.674735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6a6ff-dbf0-4970-a37d-e42bdfdb4d47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:36.676752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6a6ff-dbf0-4970-a37d-e42bdfdb4d47 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:36.687672 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 35/72] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:00:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:36.689000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6a6ff-dbf0-4970-a37d-e42bdfdb4d47 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:36.699823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d7aee-6853-4889-8218-b0edc1d80697 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:36.734712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4a096-f99c-454a-8b67-d721f0ae2a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:36.735348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4a096-f99c-454a-8b67-d721f0ae2a84 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:36.735633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4a096-f99c-454a-8b67-d721f0ae2a84 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:36.735909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4a096-f99c-454a-8b67-d721f0ae2a84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:36.737029 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4a096-f99c-454a-8b67-d721f0ae2a84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:36.738521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4a096-f99c-454a-8b67-d721f0ae2a84 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:36.740104 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 38/73] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:00:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:36.740983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4a096-f99c-454a-8b67-d721f0ae2a84 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:36.758150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:36.777037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:36.792064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6a6ff-dbf0-4970-a37d-e42bdfdb4d47 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:36.824460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912870b-af33-437f-98d7-39bc000bf472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:36.834819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912870b-af33-437f-98d7-39bc000bf472 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:36.834819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912870b-af33-437f-98d7-39bc000bf472 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:36.834819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912870b-af33-437f-98d7-39bc000bf472 None admin] PATH_INFO: `/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:36.834819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912870b-af33-437f-98d7-39bc000bf472 None admin] RBAC: Authorizing `identity:get_project(project_id=cc5fad8ef92f41c9bbde916bcccc5b92)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:36.834819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912870b-af33-437f-98d7-39bc000bf472 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:36.834819 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 36/74] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:00:36 2022] GET /identity/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:36.835256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912870b-af33-437f-98d7-39bc000bf472 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:36.839268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4a096-f99c-454a-8b67-d721f0ae2a84 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:36.872986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74409e-9039-4e03-823c-81425632571d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:36.873623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74409e-9039-4e03-823c-81425632571d None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:36.873912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74409e-9039-4e03-823c-81425632571d None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:36.874225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74409e-9039-4e03-823c-81425632571d None admin] PATH_INFO: `/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:36.875366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74409e-9039-4e03-823c-81425632571d None admin] RBAC: Authorizing `identity:get_project(project_id=cc5fad8ef92f41c9bbde916bcccc5b92)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:36.876816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74409e-9039-4e03-823c-81425632571d None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:36.878500 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 39/75] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:00:36 2022] GET /identity/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:36.879276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74409e-9039-4e03-823c-81425632571d None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:36.931086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912870b-af33-437f-98d7-39bc000bf472 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:36.961911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:36.965281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3e1cc-5c74-438d-b7c1-18ddc34d4bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:36.965923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3e1cc-5c74-438d-b7c1-18ddc34d4bf7 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:36.966242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3e1cc-5c74-438d-b7c1-18ddc34d4bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:36.966530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3e1cc-5c74-438d-b7c1-18ddc34d4bf7 None admin] PATH_INFO: `/v3/users/424dced1baf54e1892a377e81493f665` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:36.967697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3e1cc-5c74-438d-b7c1-18ddc34d4bf7 None admin] RBAC: Authorizing `identity:get_user(user_id=424dced1baf54e1892a377e81493f665)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:36.969152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3e1cc-5c74-438d-b7c1-18ddc34d4bf7 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:36.970846 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 37/76] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:00:36 2022] GET /identity/v3/users/424dced1baf54e1892a377e81493f665 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:36.975164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3e1cc-5c74-438d-b7c1-18ddc34d4bf7 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:36.978404 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74409e-9039-4e03-823c-81425632571d None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:36.992724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:37.014723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcea6b-e083-475c-b1f4-1ee9f07b5e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:37.015350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcea6b-e083-475c-b1f4-1ee9f07b5e9f None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:37.015647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcea6b-e083-475c-b1f4-1ee9f07b5e9f None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:37.015925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcea6b-e083-475c-b1f4-1ee9f07b5e9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:37.026026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcea6b-e083-475c-b1f4-1ee9f07b5e9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:00:37.030907 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-cfdcea6b-e083-475c-b1f4-1ee9f07b5e9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:00:37.030907 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:37.030907 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:00:37.030907 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:00:37.030907 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:00:37.030907 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:00:37.030907 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:00:37.030907 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:00:37.030907 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:00:37.030907 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:00:37.030907 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:00:37.030907 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:00:37.030907 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:00:37.030907 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:00:37.030907 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:00:37.030907 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:00:37.031748 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:00:37.031748 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:00:37.031748 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:00:37.031748 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:00:37.031748 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:37.031748 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:37.031748 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:00:37.031748 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:00:37.031748 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:00:37.031748 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:00:37.031748 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:00:37.031748 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:00:37.031748 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:00:37.031748 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:00:37.031748 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:00:37.031748 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:00:37.032705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:00:37.032705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:00:37.032705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:00:37.032705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:00:37.032705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:00:37.032705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:00:37.032705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:00:37.032705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:00:37.032705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:00:37.032705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:00:37.032705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:00:37.032705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:00:37.032705 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 40/77] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:00:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:00:37.033593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcea6b-e083-475c-b1f4-1ee9f07b5e9f None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:37.073136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3e1cc-5c74-438d-b7c1-18ddc34d4bf7 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:37.106818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d23de-8682-458f-b912-6caca0f5a316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:37.107427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d23de-8682-458f-b912-6caca0f5a316 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:37.107717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d23de-8682-458f-b912-6caca0f5a316 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:37.107998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d23de-8682-458f-b912-6caca0f5a316 None admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:37.108649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d23de-8682-458f-b912-6caca0f5a316 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:37.110125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d23de-8682-458f-b912-6caca0f5a316 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:37.131709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcea6b-e083-475c-b1f4-1ee9f07b5e9f None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:37.165028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe30da-6871-4d4f-9315-4a91502b8871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:37.165685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe30da-6871-4d4f-9315-4a91502b8871 None admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:37.165972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe30da-6871-4d4f-9315-4a91502b8871 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:37.166360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe30da-6871-4d4f-9315-4a91502b8871 None admin] PATH_INFO: `/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92/users/424dced1baf54e1892a377e81493f665/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:37.168318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe30da-6871-4d4f-9315-4a91502b8871 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc5fad8ef92f41c9bbde916bcccc5b92, user_id=424dced1baf54e1892a377e81493f665, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:37.169780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe30da-6871-4d4f-9315-4a91502b8871 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:37.175413 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 38/78] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 27 03:00:36 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:00:37.176285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d23de-8682-458f-b912-6caca0f5a316 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:37.243714 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 41/79] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:00:37 2022] PUT /identity/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92/users/424dced1baf54e1892a377e81493f665/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:00:37.245788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe30da-6871-4d4f-9315-4a91502b8871 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:37.255669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:37.278364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:37.307506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d23de-8682-458f-b912-6caca0f5a316 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:37.348627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dcade-d66a-422b-a5eb-8e8b1fd31ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:37.349258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dcade-d66a-422b-a5eb-8e8b1fd31ed7 None admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:37.349552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dcade-d66a-422b-a5eb-8e8b1fd31ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:37.349832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dcade-d66a-422b-a5eb-8e8b1fd31ed7 None admin] PATH_INFO: `/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92/users/7c4a354216e64f78803accba54466d59/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:37.352032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24dcade-d66a-422b-a5eb-8e8b1fd31ed7 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc5fad8ef92f41c9bbde916bcccc5b92, user_id=7c4a354216e64f78803accba54466d59, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:37.354082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24dcade-d66a-422b-a5eb-8e8b1fd31ed7 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:37.379864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe30da-6871-4d4f-9315-4a91502b8871 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:37.419353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3570aa5-ad6e-439b-b90e-9e30867de288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:37.420234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3570aa5-ad6e-439b-b90e-9e30867de288 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:37.420542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3570aa5-ad6e-439b-b90e-9e30867de288 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:37.420825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3570aa5-ad6e-439b-b90e-9e30867de288 None admin] PATH_INFO: `/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:37.422060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3570aa5-ad6e-439b-b90e-9e30867de288 None admin] RBAC: Authorizing `identity:get_project(project_id=cc5fad8ef92f41c9bbde916bcccc5b92)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:37.423564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3570aa5-ad6e-439b-b90e-9e30867de288 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:37.425340 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 42/80] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:00:37 2022] GET /identity/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:37.426203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3570aa5-ad6e-439b-b90e-9e30867de288 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:37.457226 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 39/81] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:00:37 2022] PUT /identity/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92/users/7c4a354216e64f78803accba54466d59/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:00:37.458327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dcade-d66a-422b-a5eb-8e8b1fd31ed7 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:37.520356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:37.573309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3570aa5-ad6e-439b-b90e-9e30867de288 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:37.648939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dcade-d66a-422b-a5eb-8e8b1fd31ed7 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:37.654202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff4ad0-a70b-4e40-8f88-cc915c7cae3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:37.654906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff4ad0-a70b-4e40-8f88-cc915c7cae3b None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:37.655198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff4ad0-a70b-4e40-8f88-cc915c7cae3b None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:37.655479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff4ad0-a70b-4e40-8f88-cc915c7cae3b None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:37.656272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff4ad0-a70b-4e40-8f88-cc915c7cae3b None admin] RBAC: Adding query filter params (name=member) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:37.656588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff4ad0-a70b-4e40-8f88-cc915c7cae3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:37.658065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff4ad0-a70b-4e40-8f88-cc915c7cae3b None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:37.674742 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 43/82] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 27 03:00:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:37.680759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff4ad0-a70b-4e40-8f88-cc915c7cae3b None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:37.711880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602c169-ff87-4634-b832-6a59689ef06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:37.712574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602c169-ff87-4634-b832-6a59689ef06d None admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:37.712865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602c169-ff87-4634-b832-6a59689ef06d None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:37.713685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602c169-ff87-4634-b832-6a59689ef06d None admin] PATH_INFO: `/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92/users/424dced1baf54e1892a377e81493f665/roles/31c2fac3eedc4006a84fcd0bee6d22e8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:37.716937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602c169-ff87-4634-b832-6a59689ef06d None admin] RBAC: Authorizing `identity:create_grant(project_id=cc5fad8ef92f41c9bbde916bcccc5b92, user_id=424dced1baf54e1892a377e81493f665, role_id=31c2fac3eedc4006a84fcd0bee6d22e8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:37.719348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602c169-ff87-4634-b832-6a59689ef06d None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:37.724555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:37.807186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff4ad0-a70b-4e40-8f88-cc915c7cae3b None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:37.817138 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 40/83] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:00:37 2022] PUT /identity/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92/users/424dced1baf54e1892a377e81493f665/roles/31c2fac3eedc4006a84fcd0bee6d22e8 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:00:37.867627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac8e99-f102-40d9-9e9b-e85626a09ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:37.868633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac8e99-f102-40d9-9e9b-e85626a09ef7 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:37.869124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac8e99-f102-40d9-9e9b-e85626a09ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:37.869809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac8e99-f102-40d9-9e9b-e85626a09ef7 None admin] PATH_INFO: `/v3/users/424dced1baf54e1892a377e81493f665` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:37.871335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac8e99-f102-40d9-9e9b-e85626a09ef7 None admin] RBAC: Authorizing `identity:get_user(user_id=424dced1baf54e1892a377e81493f665)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:37.873096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac8e99-f102-40d9-9e9b-e85626a09ef7 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:37.875575 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 44/84] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:00:37 2022] GET /identity/v3/users/424dced1baf54e1892a377e81493f665 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:37.880965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602c169-ff87-4634-b832-6a59689ef06d None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:38.026955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602c169-ff87-4634-b832-6a59689ef06d None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:38.076354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725e099-09dd-45ce-8637-30c513d90973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:38.077065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725e099-09dd-45ce-8637-30c513d90973 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:38.077359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725e099-09dd-45ce-8637-30c513d90973 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:38.077639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725e099-09dd-45ce-8637-30c513d90973 None admin] PATH_INFO: `/v3/projects/44d531dad0af48689a47b574f1a3bc3d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:38.078833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725e099-09dd-45ce-8637-30c513d90973 None admin] RBAC: Authorizing `identity:get_project(project_id=44d531dad0af48689a47b574f1a3bc3d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:38.080315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725e099-09dd-45ce-8637-30c513d90973 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:38.082353 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 41/85] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:00:37 2022] GET /identity/v3/projects/44d531dad0af48689a47b574f1a3bc3d => generated 312 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:38.091150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac8e99-f102-40d9-9e9b-e85626a09ef7 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:38.101143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:38.251850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac8e99-f102-40d9-9e9b-e85626a09ef7 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:38.291458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c29de5-2e22-4f01-ad6c-1aadc0ed8e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:38.292119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c29de5-2e22-4f01-ad6c-1aadc0ed8e17 None admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:38.292413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c29de5-2e22-4f01-ad6c-1aadc0ed8e17 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:38.292699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c29de5-2e22-4f01-ad6c-1aadc0ed8e17 None admin] PATH_INFO: `/v3/projects/44d531dad0af48689a47b574f1a3bc3d/users/424dced1baf54e1892a377e81493f665/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:38.294728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c29de5-2e22-4f01-ad6c-1aadc0ed8e17 None admin] RBAC: Authorizing `identity:create_grant(project_id=44d531dad0af48689a47b574f1a3bc3d, user_id=424dced1baf54e1892a377e81493f665, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:38.296323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c29de5-2e22-4f01-ad6c-1aadc0ed8e17 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:38.367409 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 45/86] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:00:38 2022] PUT /identity/v3/projects/44d531dad0af48689a47b574f1a3bc3d/users/424dced1baf54e1892a377e81493f665/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:00:40.113095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92635ac8-e294-48ed-afea-f495c85b20ee None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:40.113635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92635ac8-e294-48ed-afea-f495c85b20ee None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:40.113635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92635ac8-e294-48ed-afea-f495c85b20ee None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:40.115064 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 42/87] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:40.121080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42bb06-5557-48b0-808d-5f94d8c06a91 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:40.121484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42bb06-5557-48b0-808d-5f94d8c06a91 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:40.121672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42bb06-5557-48b0-808d-5f94d8c06a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:40.144806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-7f42bb06-5557-48b0-808d-5f94d8c06a91 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:40.146026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7f42bb06-5557-48b0-808d-5f94d8c06a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:40.215901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:40.227021 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 46/88] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:40.233484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcb09d-a149-4dce-bab8-fed92ad0c908 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:40.233842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcb09d-a149-4dce-bab8-fed92ad0c908 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:40.234083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcb09d-a149-4dce-bab8-fed92ad0c908 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:40.235437 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 43/89] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:40.243996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378acf05-7427-446b-9c6f-3a0dba22a0ff None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:40.244834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378acf05-7427-446b-9c6f-3a0dba22a0ff None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:40.245138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378acf05-7427-446b-9c6f-3a0dba22a0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:40.270656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-378acf05-7427-446b-9c6f-3a0dba22a0ff None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:40.271877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-378acf05-7427-446b-9c6f-3a0dba22a0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:40.364599 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 47/90] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:40.690401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a91341-cd3e-4a84-9519-d53af39db194 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:40.690730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a91341-cd3e-4a84-9519-d53af39db194 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:40.690898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a91341-cd3e-4a84-9519-d53af39db194 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:40.692432 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 44/91] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:40.698337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc5e0b-74b3-4fdd-9222-fba3d7f5f5cf None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:40.698635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc5e0b-74b3-4fdd-9222-fba3d7f5f5cf None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:40.698925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc5e0b-74b3-4fdd-9222-fba3d7f5f5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:40.723707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-befc5e0b-74b3-4fdd-9222-fba3d7f5f5cf None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:40.724954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-befc5e0b-74b3-4fdd-9222-fba3d7f5f5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:40.814704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c70a22-1392-4275-a8f6-d3fc87a4c688 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:40.815058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c70a22-1392-4275-a8f6-d3fc87a4c688 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:40.815346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c70a22-1392-4275-a8f6-d3fc87a4c688 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:40.816821 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 45/92] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:00:40.819771 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 48/93] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:40.822506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2f190-d2aa-4bee-b21c-33a20686c6f2 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:40.823003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2f190-d2aa-4bee-b21c-33a20686c6f2 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:40.823498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2f190-d2aa-4bee-b21c-33a20686c6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:40.841956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2ca2f190-d2aa-4bee-b21c-33a20686c6f2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:40.843469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2ca2f190-d2aa-4bee-b21c-33a20686c6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:40.875953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc5e0b-74b3-4fdd-9222-fba3d7f5f5cf None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:40.943258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:40.951103 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 46/94] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:40.952011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2f190-d2aa-4bee-b21c-33a20686c6f2 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:40.966410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:41.072726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc5e0b-74b3-4fdd-9222-fba3d7f5f5cf None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:41.083268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2f190-d2aa-4bee-b21c-33a20686c6f2 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:41.146163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bcb74-ae34-4115-85e4-ed7a267bf1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:41.146804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f713c1-23b0-4e83-a350-2bd1dfbd5ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:41.147229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bcb74-ae34-4115-85e4-ed7a267bf1f2 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:41.147229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bcb74-ae34-4115-85e4-ed7a267bf1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:41.147386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bcb74-ae34-4115-85e4-ed7a267bf1f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:41.148234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f713c1-23b0-4e83-a350-2bd1dfbd5ec3 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:41.148590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bcb74-ae34-4115-85e4-ed7a267bf1f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:41.148712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f713c1-23b0-4e83-a350-2bd1dfbd5ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:41.148956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f713c1-23b0-4e83-a350-2bd1dfbd5ec3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:41.151153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bcb74-ae34-4115-85e4-ed7a267bf1f2 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:41.152946 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 49/95] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:00:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:00:41.158955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bcb74-ae34-4115-85e4-ed7a267bf1f2 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:41.167103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f713c1-23b0-4e83-a350-2bd1dfbd5ec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:00:41.172323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-94f713c1-23b0-4e83-a350-2bd1dfbd5ec3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:00:41.172323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:41.172323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:00:41.172323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:00:41.172323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:00:41.172323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:00:41.172323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:00:41.172323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:00:41.172323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:00:41.172323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:00:41.172323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:00:41.172323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:00:41.172323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:00:41.172323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:00:41.172323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:00:41.172323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:00:41.173192 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:00:41.173192 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:00:41.173192 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:00:41.173192 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:00:41.173192 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:41.173192 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:41.173192 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:00:41.173192 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:00:41.173192 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:00:41.173192 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:00:41.173192 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:00:41.173192 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:00:41.173192 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:00:41.173192 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:00:41.173192 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:00:41.173192 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:00:41.173961 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:00:41.173961 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:00:41.173961 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:00:41.173961 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:00:41.173961 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:00:41.173961 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:00:41.173961 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:00:41.173961 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:00:41.173961 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:00:41.173961 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:00:41.173961 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:00:41.173961 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:00:41.181052 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 47/96] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 27 03:00:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:00:41.182621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f713c1-23b0-4e83-a350-2bd1dfbd5ec3 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:41.269792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:41.324773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f713c1-23b0-4e83-a350-2bd1dfbd5ec3 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:41.355431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bcb74-ae34-4115-85e4-ed7a267bf1f2 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:41.364206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38432a3-aabb-4784-960e-81e9b943c330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:41.365121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38432a3-aabb-4784-960e-81e9b943c330 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:41.365605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38432a3-aabb-4784-960e-81e9b943c330 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:41.366225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38432a3-aabb-4784-960e-81e9b943c330 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:41.367095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38432a3-aabb-4784-960e-81e9b943c330 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:41.367597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38432a3-aabb-4784-960e-81e9b943c330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:41.370697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38432a3-aabb-4784-960e-81e9b943c330 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:41.380742 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 48/97] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:00:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:00:41.386161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:41.387876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7d1b3-2cd7-4b05-996b-a0940903412a None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:41.388166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7d1b3-2cd7-4b05-996b-a0940903412a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:41.388475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7d1b3-2cd7-4b05-996b-a0940903412a None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:41.389849 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 49/98] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:41.390556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7d1b3-2cd7-4b05-996b-a0940903412a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:41.401263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e735d-abc4-4333-b73e-c36cbf50ab68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:41.401883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e735d-abc4-4333-b73e-c36cbf50ab68 None admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:41.409857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e735d-abc4-4333-b73e-c36cbf50ab68 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:41.409857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e735d-abc4-4333-b73e-c36cbf50ab68 None admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:41.409857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e735d-abc4-4333-b73e-c36cbf50ab68 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:41.409857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e735d-abc4-4333-b73e-c36cbf50ab68 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:41.485549 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 50/99] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 27 03:00:41 2022] POST /identity/v3/projects => generated 302 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:00:41.486421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e735d-abc4-4333-b73e-c36cbf50ab68 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:41.504526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7d1b3-2cd7-4b05-996b-a0940903412a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:41.533116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:41.562383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a5084-948d-4534-a7bc-4c71f868a51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:41.563769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a5084-948d-4534-a7bc-4c71f868a51f None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:41.564755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a5084-948d-4534-a7bc-4c71f868a51f None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:41.565608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a5084-948d-4534-a7bc-4c71f868a51f None admin] PATH_INFO: `/v3/roles/member` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:41.587189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a5084-948d-4534-a7bc-4c71f868a51f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:00:41.595105 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-001a5084-948d-4534-a7bc-4c71f868a51f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:00:41.595105 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:41.595105 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:00:41.595105 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:00:41.595105 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:00:41.595105 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:00:41.595105 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:00:41.595105 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:00:41.595105 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:00:41.595105 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:00:41.595105 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:00:41.595105 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:00:41.595105 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:00:41.595105 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:00:41.595105 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:00:41.595105 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:00:41.596091 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:00:41.596091 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:00:41.596091 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:00:41.596091 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:00:41.596091 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:41.596091 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:41.596091 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:00:41.596091 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:00:41.596091 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:00:41.596091 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:00:41.596091 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:00:41.596091 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:00:41.596091 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:00:41.596091 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:00:41.596091 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:00:41.596091 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:00:41.596849 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:00:41.596849 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:00:41.596849 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:00:41.596849 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:00:41.596849 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:00:41.596849 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:00:41.596849 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:00:41.596849 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:00:41.596849 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:00:41.596849 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:00:41.596849 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:00:41.596849 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:00:41.600164 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 50/100] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:00:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:00:41.603226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a5084-948d-4534-a7bc-4c71f868a51f None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:41.624105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e735d-abc4-4333-b73e-c36cbf50ab68 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:41.664818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c2d89-f8ee-4e95-a0d5-c0062115496d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:41.665464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c2d89-f8ee-4e95-a0d5-c0062115496d None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:41.665746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c2d89-f8ee-4e95-a0d5-c0062115496d None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:41.666858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c2d89-f8ee-4e95-a0d5-c0062115496d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:41.679068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c2d89-f8ee-4e95-a0d5-c0062115496d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:00:41.685503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-222c2d89-f8ee-4e95-a0d5-c0062115496d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 03:00:41.685503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:41.685503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:00:41.685503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:00:41.685503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:00:41.685503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:00:41.685503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:00:41.685503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:00:41.685503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:00:41.685503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:00:41.685503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:00:41.685503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:00:41.685503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:00:41.685503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:00:41.685503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:00:41.685503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:00:41.686684 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:00:41.686684 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:00:41.686684 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:00:41.686684 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:00:41.686684 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:41.686684 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:41.686684 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:00:41.686684 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:00:41.686684 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:00:41.686684 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:00:41.686684 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:00:41.686684 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:00:41.686684 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:00:41.686684 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:00:41.686684 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:00:41.686684 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:00:41.687505 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:00:41.687505 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:00:41.687505 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:00:41.687505 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:00:41.687505 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:00:41.687505 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:00:41.687505 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:00:41.687505 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:00:41.687505 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:00:41.687505 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:00:41.687505 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 03:00:41.687505 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:00:41.690267 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 51/101] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:00:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:00:41.692921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb44d5-a840-4b9b-b353-317769bc79ba None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:41.693707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb44d5-a840-4b9b-b353-317769bc79ba None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:41.694158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb44d5-a840-4b9b-b353-317769bc79ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:41.716471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f3cb44d5-a840-4b9b-b353-317769bc79ba None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:41.717913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f3cb44d5-a840-4b9b-b353-317769bc79ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:41.747260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:41.749986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a5084-948d-4534-a7bc-4c71f868a51f None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:41.794220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e468cd2-0ba7-4698-a1e0-40d87a207f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:41.795864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e468cd2-0ba7-4698-a1e0-40d87a207f43 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:41.796160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e468cd2-0ba7-4698-a1e0-40d87a207f43 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:41.796444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e468cd2-0ba7-4698-a1e0-40d87a207f43 None admin] PATH_INFO: `/v3/users/7c4a354216e64f78803accba54466d59` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:41.797630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e468cd2-0ba7-4698-a1e0-40d87a207f43 None admin] RBAC: Authorizing `identity:get_user(user_id=7c4a354216e64f78803accba54466d59)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:41.799349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e468cd2-0ba7-4698-a1e0-40d87a207f43 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:41.800156 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 52/102] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:41.801162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb44d5-a840-4b9b-b353-317769bc79ba None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:41.810949 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 51/103] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:00:41 2022] GET /identity/v3/users/7c4a354216e64f78803accba54466d59 => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:41.810949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e468cd2-0ba7-4698-a1e0-40d87a207f43 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:41.874856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:41.932270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb44d5-a840-4b9b-b353-317769bc79ba None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:41.949393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e468cd2-0ba7-4698-a1e0-40d87a207f43 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:41.969099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9917ad-f06d-48d1-82a7-00b140e98ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:41.970672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9917ad-f06d-48d1-82a7-00b140e98ad8 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:41.971248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9917ad-f06d-48d1-82a7-00b140e98ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:41.971713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9917ad-f06d-48d1-82a7-00b140e98ad8 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:41.972578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9917ad-f06d-48d1-82a7-00b140e98ad8 None admin] RBAC: Adding query filter params (name=member) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:41.973720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9917ad-f06d-48d1-82a7-00b140e98ad8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:41.975729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9917ad-f06d-48d1-82a7-00b140e98ad8 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:41.988478 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 53/104] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 27 03:00:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:41.989694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eddcd7-ecc0-4cd9-af49-429c2ed24268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:41.990346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eddcd7-ecc0-4cd9-af49-429c2ed24268 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:41.990468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2c096-48a2-46fe-9786-3eea56df7a84 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:41.990628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eddcd7-ecc0-4cd9-af49-429c2ed24268 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:41.990900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eddcd7-ecc0-4cd9-af49-429c2ed24268 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:41.991337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2c096-48a2-46fe-9786-3eea56df7a84 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:41.991575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eddcd7-ecc0-4cd9-af49-429c2ed24268 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:41.991882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eddcd7-ecc0-4cd9-af49-429c2ed24268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:41.992230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2c096-48a2-46fe-9786-3eea56df7a84 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:41.993540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eddcd7-ecc0-4cd9-af49-429c2ed24268 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:41.994719 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 54/105] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:41.995928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2c096-48a2-46fe-9786-3eea56df7a84 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:42.009556 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 52/106] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 27 03:00:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:42.014343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eddcd7-ecc0-4cd9-af49-429c2ed24268 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:42.034515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:42.128811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2c096-48a2-46fe-9786-3eea56df7a84 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:42.132369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eddcd7-ecc0-4cd9-af49-429c2ed24268 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:42.140645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:42.165108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37849357-96b3-4c1d-8cdd-9e6c52d064a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:42.165723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37849357-96b3-4c1d-8cdd-9e6c52d064a3 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:42.166049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37849357-96b3-4c1d-8cdd-9e6c52d064a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:42.166401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37849357-96b3-4c1d-8cdd-9e6c52d064a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:42.169702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd8338-f9e2-4aa0-b4e0-c023b961a048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:42.170383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd8338-f9e2-4aa0-b4e0-c023b961a048 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:42.170671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd8338-f9e2-4aa0-b4e0-c023b961a048 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:42.170957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd8338-f9e2-4aa0-b4e0-c023b961a048 None admin] PATH_INFO: `/v3/users/424dced1baf54e1892a377e81493f665` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:42.172092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd8338-f9e2-4aa0-b4e0-c023b961a048 None admin] RBAC: Authorizing `identity:get_user(user_id=424dced1baf54e1892a377e81493f665)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:42.173552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd8338-f9e2-4aa0-b4e0-c023b961a048 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:42.175170 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 53/107] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:00:42 2022] GET /identity/v3/users/424dced1baf54e1892a377e81493f665 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:42.182110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724c259-5cc0-423d-8a4e-a9ccaff0e7b2 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:42.182110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724c259-5cc0-423d-8a4e-a9ccaff0e7b2 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:42.182110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724c259-5cc0-423d-8a4e-a9ccaff0e7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:42.201776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4724c259-5cc0-423d-8a4e-a9ccaff0e7b2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:42.203032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4724c259-5cc0-423d-8a4e-a9ccaff0e7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:42.245329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37849357-96b3-4c1d-8cdd-9e6c52d064a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:42.246863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37849357-96b3-4c1d-8cdd-9e6c52d064a3 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:42.273171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:42.290307 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 54/108] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:42.290307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724c259-5cc0-423d-8a4e-a9ccaff0e7b2 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:42.382298 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 55/109] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:00:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 03:00:42.383370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37849357-96b3-4c1d-8cdd-9e6c52d064a3 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:42.394156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724c259-5cc0-423d-8a4e-a9ccaff0e7b2 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:42.396601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:42.429587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ae639-9b08-41e2-9b41-83ed05de5645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:42.430363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ae639-9b08-41e2-9b41-83ed05de5645 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:42.430759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ae639-9b08-41e2-9b41-83ed05de5645 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:42.431125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ae639-9b08-41e2-9b41-83ed05de5645 None admin] PATH_INFO: `/v3/users/06808c8588634e0390ee56bce456c785` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:42.446142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ae639-9b08-41e2-9b41-83ed05de5645 None admin] RBAC: Authorizing `identity:get_user(user_id=06808c8588634e0390ee56bce456c785)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:42.448446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ae639-9b08-41e2-9b41-83ed05de5645 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:42.455088 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 55/110] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:00:42 2022] GET /identity/v3/users/06808c8588634e0390ee56bce456c785 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:42.456225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ae639-9b08-41e2-9b41-83ed05de5645 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:42.490464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37849357-96b3-4c1d-8cdd-9e6c52d064a3 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:42.514974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:42.526759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7be377-ccb1-4df3-9b92-61f2aa50986c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:42.529922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7be377-ccb1-4df3-9b92-61f2aa50986c None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:42.529922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7be377-ccb1-4df3-9b92-61f2aa50986c None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:42.529922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7be377-ccb1-4df3-9b92-61f2aa50986c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:42.539148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7be377-ccb1-4df3-9b92-61f2aa50986c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:00:42.544760 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-8f7be377-ccb1-4df3-9b92-61f2aa50986c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 03:00:42.544760 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:42.544760 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:00:42.544760 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:00:42.544760 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:00:42.544760 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:00:42.544760 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:00:42.544760 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:00:42.544760 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:00:42.544760 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:00:42.544760 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:00:42.544760 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:00:42.544760 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:00:42.544760 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:00:42.544760 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:00:42.544760 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:00:42.545575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:00:42.545575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:00:42.545575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:00:42.545575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:00:42.545575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:42.545575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:42.545575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:00:42.545575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:00:42.545575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:00:42.545575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:00:42.545575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:00:42.545575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:00:42.545575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:00:42.545575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:00:42.545575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:00:42.545575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:00:42.546768 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:00:42.546768 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:00:42.546768 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:00:42.546768 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:00:42.546768 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:00:42.546768 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:00:42.546768 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:00:42.546768 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:00:42.546768 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:00:42.546768 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:00:42.546768 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 03:00:42.546768 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:00:42.549018 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 56/111] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 27 03:00:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:00:42.550151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7be377-ccb1-4df3-9b92-61f2aa50986c None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:42.560603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ae639-9b08-41e2-9b41-83ed05de5645 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:42.595202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b44339-baf1-47ba-9e8c-dc819c07d8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:42.595821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b44339-baf1-47ba-9e8c-dc819c07d8a6 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:42.596106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b44339-baf1-47ba-9e8c-dc819c07d8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:42.596382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b44339-baf1-47ba-9e8c-dc819c07d8a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:42.627764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:42.655723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7be377-ccb1-4df3-9b92-61f2aa50986c None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:42.665759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b44339-baf1-47ba-9e8c-dc819c07d8a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:42.667791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b44339-baf1-47ba-9e8c-dc819c07d8a6 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:42.693294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a266fcc-8926-4106-a509-e4c974f7a5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:42.693926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a266fcc-8926-4106-a509-e4c974f7a5fb None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:42.694237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a266fcc-8926-4106-a509-e4c974f7a5fb None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:42.694630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a266fcc-8926-4106-a509-e4c974f7a5fb None admin] PATH_INFO: `/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:42.695833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a266fcc-8926-4106-a509-e4c974f7a5fb None admin] RBAC: Authorizing `identity:get_project(project_id=cc5fad8ef92f41c9bbde916bcccc5b92)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:42.697522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a266fcc-8926-4106-a509-e4c974f7a5fb None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:42.704356 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 57/112] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:00:42 2022] GET /identity/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:42.704356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a266fcc-8926-4106-a509-e4c974f7a5fb None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:42.764172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:42.778595 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 56/113] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:00:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 03:00:42.783928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b44339-baf1-47ba-9e8c-dc819c07d8a6 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:42.815164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a266fcc-8926-4106-a509-e4c974f7a5fb None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:42.846641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:42.850217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0862a05-90f3-4b67-9874-d7c0683b33b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:42.850862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0862a05-90f3-4b67-9874-d7c0683b33b6 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:42.851150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0862a05-90f3-4b67-9874-d7c0683b33b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:42.851512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0862a05-90f3-4b67-9874-d7c0683b33b6 None admin] PATH_INFO: `/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:42.852635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0862a05-90f3-4b67-9874-d7c0683b33b6 None admin] RBAC: Authorizing `identity:get_project(project_id=cc5fad8ef92f41c9bbde916bcccc5b92)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:42.861188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0862a05-90f3-4b67-9874-d7c0683b33b6 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:42.861188 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 58/114] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:00:42 2022] GET /identity/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:42.861188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0862a05-90f3-4b67-9874-d7c0683b33b6 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:42.893265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b44339-baf1-47ba-9e8c-dc819c07d8a6 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:42.929540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa68a6a-f886-4821-9ac1-908b1751f848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:42.930144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa68a6a-f886-4821-9ac1-908b1751f848 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:42.930440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa68a6a-f886-4821-9ac1-908b1751f848 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:42.930716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa68a6a-f886-4821-9ac1-908b1751f848 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:42.931591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa68a6a-f886-4821-9ac1-908b1751f848 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:42.931894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa68a6a-f886-4821-9ac1-908b1751f848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:42.934070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa68a6a-f886-4821-9ac1-908b1751f848 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:42.943032 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 57/115] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:00:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:42.943032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa68a6a-f886-4821-9ac1-908b1751f848 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:42.969053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0862a05-90f3-4b67-9874-d7c0683b33b6 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:42.990423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:43.004896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7dc6f-4145-450c-bc19-ab3ed8bb69b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:43.005532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7dc6f-4145-450c-bc19-ab3ed8bb69b6 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:43.005814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7dc6f-4145-450c-bc19-ab3ed8bb69b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:43.006112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7dc6f-4145-450c-bc19-ab3ed8bb69b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:43.016547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7dc6f-4145-450c-bc19-ab3ed8bb69b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:00:43.021617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-54d7dc6f-4145-450c-bc19-ab3ed8bb69b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:00:43.021617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:43.021617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:00:43.021617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:00:43.021617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:00:43.021617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:00:43.021617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:00:43.021617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:00:43.021617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:00:43.021617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:00:43.021617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:00:43.021617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:00:43.021617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:00:43.021617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:00:43.021617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:00:43.021617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:00:43.022744 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:00:43.022744 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:00:43.022744 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:00:43.022744 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:00:43.022744 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:43.022744 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:43.022744 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:00:43.022744 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:00:43.022744 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:00:43.022744 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:00:43.022744 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:00:43.022744 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:00:43.022744 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:00:43.022744 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:00:43.022744 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:00:43.022744 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:00:43.023574 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:00:43.023574 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:00:43.023574 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:00:43.023574 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:00:43.023574 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:00:43.023574 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:00:43.023574 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:00:43.023574 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:00:43.023574 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:00:43.023574 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:00:43.023574 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:00:43.023574 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:00:43.023574 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 59/116] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:00:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:00:43.024407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7dc6f-4145-450c-bc19-ab3ed8bb69b6 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:43.057740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa68a6a-f886-4821-9ac1-908b1751f848 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:43.081650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:43.092905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a7354-6ced-4aec-9db8-c2e69aa90129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:43.093519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a7354-6ced-4aec-9db8-c2e69aa90129 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:43.093804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a7354-6ced-4aec-9db8-c2e69aa90129 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:43.094102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a7354-6ced-4aec-9db8-c2e69aa90129 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:43.094834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a7354-6ced-4aec-9db8-c2e69aa90129 None admin] RBAC: Adding query filter params (role.id=6e91e7a416ac452b86ec238a2b81bc07, scope.project.id=cc5fad8ef92f41c9bbde916bcccc5b92, user.id=7c4a354216e64f78803accba54466d59) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:43.095146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a7354-6ced-4aec-9db8-c2e69aa90129 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:43.096695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a7354-6ced-4aec-9db8-c2e69aa90129 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:43.105315 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 58/117] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:00:42 2022] GET /identity/v3/role_assignments?user.id=7c4a354216e64f78803accba54466d59&scope.project.id=cc5fad8ef92f41c9bbde916bcccc5b92&role.id=6e91e7a416ac452b86ec238a2b81bc07 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:43.106217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a7354-6ced-4aec-9db8-c2e69aa90129 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:43.152575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7dc6f-4145-450c-bc19-ab3ed8bb69b6 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:43.202780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8237e16-df19-488b-addd-3634ce36305e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:43.204982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8237e16-df19-488b-addd-3634ce36305e None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:43.205438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8237e16-df19-488b-addd-3634ce36305e None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:43.205917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8237e16-df19-488b-addd-3634ce36305e None admin] PATH_INFO: `/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:43.208375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8237e16-df19-488b-addd-3634ce36305e None admin] RBAC: Authorizing `identity:get_project(project_id=cc5fad8ef92f41c9bbde916bcccc5b92)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:43.210479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8237e16-df19-488b-addd-3634ce36305e None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:43.214463 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 60/118] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:00:43 2022] GET /identity/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:43.215603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8237e16-df19-488b-addd-3634ce36305e None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:43.238220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a7354-6ced-4aec-9db8-c2e69aa90129 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:43.281188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e9c0f-9d9d-4ca7-bc4b-5b2c86bc4bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:43.282074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e9c0f-9d9d-4ca7-bc4b-5b2c86bc4bed None admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:43.282471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e9c0f-9d9d-4ca7-bc4b-5b2c86bc4bed None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:43.282898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e9c0f-9d9d-4ca7-bc4b-5b2c86bc4bed None admin] PATH_INFO: `/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92/users/06808c8588634e0390ee56bce456c785/roles/e93dce408a514f8fb8a572d381e51045` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:43.284974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e9c0f-9d9d-4ca7-bc4b-5b2c86bc4bed None admin] RBAC: Authorizing `identity:create_grant(project_id=cc5fad8ef92f41c9bbde916bcccc5b92, user_id=06808c8588634e0390ee56bce456c785, role_id=e93dce408a514f8fb8a572d381e51045)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:43.286602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e9c0f-9d9d-4ca7-bc4b-5b2c86bc4bed None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:43.288321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:43.348416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8237e16-df19-488b-addd-3634ce36305e None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:43.358459 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 59/119] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:00:43 2022] PUT /identity/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92/users/06808c8588634e0390ee56bce456c785/roles/e93dce408a514f8fb8a572d381e51045 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:00:43.359707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e9c0f-9d9d-4ca7-bc4b-5b2c86bc4bed None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:43.390726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7696a8-8331-4ac4-a936-422b566ce729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:43.392510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7696a8-8331-4ac4-a936-422b566ce729 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:43.393259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7696a8-8331-4ac4-a936-422b566ce729 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:43.393746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7696a8-8331-4ac4-a936-422b566ce729 None admin] PATH_INFO: `/v3/users/424dced1baf54e1892a377e81493f665` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:43.395608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7696a8-8331-4ac4-a936-422b566ce729 None admin] RBAC: Authorizing `identity:get_user(user_id=424dced1baf54e1892a377e81493f665)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:43.398178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7696a8-8331-4ac4-a936-422b566ce729 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:43.401409 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 61/120] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:00:43 2022] GET /identity/v3/users/424dced1baf54e1892a377e81493f665 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:43.402598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7696a8-8331-4ac4-a936-422b566ce729 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:43.434431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:43.498594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e9c0f-9d9d-4ca7-bc4b-5b2c86bc4bed None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:43.546799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7696a8-8331-4ac4-a936-422b566ce729 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:43.547544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c045f9b-73a8-467c-bc3d-6b31c0d790f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:43.548177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c045f9b-73a8-467c-bc3d-6b31c0d790f3 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:43.548736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c045f9b-73a8-467c-bc3d-6b31c0d790f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:43.549022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c045f9b-73a8-467c-bc3d-6b31c0d790f3 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:43.550673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c045f9b-73a8-467c-bc3d-6b31c0d790f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:43.550996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c045f9b-73a8-467c-bc3d-6b31c0d790f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:43.552394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c045f9b-73a8-467c-bc3d-6b31c0d790f3 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:43.562244 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 60/121] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 27 03:00:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:43.566066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c045f9b-73a8-467c-bc3d-6b31c0d790f3 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:43.572495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:43.599858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8dec83-edb2-4f69-bd05-009a9cb23922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:43.600937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dec83-edb2-4f69-bd05-009a9cb23922 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:43.601358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dec83-edb2-4f69-bd05-009a9cb23922 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:43.601758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dec83-edb2-4f69-bd05-009a9cb23922 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:43.602560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8dec83-edb2-4f69-bd05-009a9cb23922 None admin] RBAC: Adding query filter params (role.id=17fff77450b94933a5d232fb3f3221b7, scope.project.id=cc5fad8ef92f41c9bbde916bcccc5b92, user.id=424dced1baf54e1892a377e81493f665) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:43.602879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8dec83-edb2-4f69-bd05-009a9cb23922 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:43.606046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8dec83-edb2-4f69-bd05-009a9cb23922 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:43.613478 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 62/122] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:00:43 2022] GET /identity/v3/role_assignments?user.id=424dced1baf54e1892a377e81493f665&scope.project.id=cc5fad8ef92f41c9bbde916bcccc5b92&role.id=17fff77450b94933a5d232fb3f3221b7 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:43.614539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8dec83-edb2-4f69-bd05-009a9cb23922 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:43.732430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c045f9b-73a8-467c-bc3d-6b31c0d790f3 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:43.754492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:43.764964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8dec83-edb2-4f69-bd05-009a9cb23922 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:43.801586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6791757-bc9f-421e-ac00-8457639cfdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:43.802251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6791757-bc9f-421e-ac00-8457639cfdd8 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:43.802543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6791757-bc9f-421e-ac00-8457639cfdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:43.802828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6791757-bc9f-421e-ac00-8457639cfdd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:43.803607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284e183-d2b2-413c-8e16-0f7e28061f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:43.804265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284e183-d2b2-413c-8e16-0f7e28061f99 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:43.804553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284e183-d2b2-413c-8e16-0f7e28061f99 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:43.804831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284e183-d2b2-413c-8e16-0f7e28061f99 None admin] PATH_INFO: `/v3/users/424dced1baf54e1892a377e81493f665` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:43.806063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284e183-d2b2-413c-8e16-0f7e28061f99 None admin] RBAC: Authorizing `identity:get_user(user_id=424dced1baf54e1892a377e81493f665)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:43.810150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284e183-d2b2-413c-8e16-0f7e28061f99 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:43.813386 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 63/123] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:00:43 2022] GET /identity/v3/users/424dced1baf54e1892a377e81493f665 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:43.818760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbaca77-2592-42bd-a1dc-6d8f24819478 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:43.819064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbaca77-2592-42bd-a1dc-6d8f24819478 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:43.819346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbaca77-2592-42bd-a1dc-6d8f24819478 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:43.820893 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 64/124] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:43.822670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbaca77-2592-42bd-a1dc-6d8f24819478 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:43.882639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:43.896105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6791757-bc9f-421e-ac00-8457639cfdd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:43.897733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6791757-bc9f-421e-ac00-8457639cfdd8 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:43.946399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbaca77-2592-42bd-a1dc-6d8f24819478 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:43.980272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c10d09-8a12-46c5-8fe4-c36674bb9048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:43.980863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c10d09-8a12-46c5-8fe4-c36674bb9048 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:43.981184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c10d09-8a12-46c5-8fe4-c36674bb9048 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:43.981473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c10d09-8a12-46c5-8fe4-c36674bb9048 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:44.017960 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 61/125] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:00:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 03:00:44.019248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c69852-1ef0-46cc-aee1-541c9914a3bd None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:44.019541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c69852-1ef0-46cc-aee1-541c9914a3bd None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:44.019820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c69852-1ef0-46cc-aee1-541c9914a3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:44.038517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-21c69852-1ef0-46cc-aee1-541c9914a3bd None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:44.039725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-21c69852-1ef0-46cc-aee1-541c9914a3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:44.043316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:44.055869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c10d09-8a12-46c5-8fe4-c36674bb9048 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:44.057386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c10d09-8a12-46c5-8fe4-c36674bb9048 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:44.108091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:44.109646 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 62/126] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:44.114704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c69852-1ef0-46cc-aee1-541c9914a3bd None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:44.181432 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 65/127] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:00:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 27 03:00:44.198059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c10d09-8a12-46c5-8fe4-c36674bb9048 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:44.232283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c69852-1ef0-46cc-aee1-541c9914a3bd None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:44.272352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad6f92-51f0-4b6c-9318-077d025a941e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:44.273081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad6f92-51f0-4b6c-9318-077d025a941e None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:44.273468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad6f92-51f0-4b6c-9318-077d025a941e None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:44.273847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad6f92-51f0-4b6c-9318-077d025a941e None admin] PATH_INFO: `/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:44.275247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad6f92-51f0-4b6c-9318-077d025a941e None admin] RBAC: Authorizing `identity:get_project(project_id=cc5fad8ef92f41c9bbde916bcccc5b92)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:44.277459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad6f92-51f0-4b6c-9318-077d025a941e None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:44.280104 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 63/128] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:00:44 2022] GET /identity/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:44.286691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad6f92-51f0-4b6c-9318-077d025a941e None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:44.301349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:44.324134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c10d09-8a12-46c5-8fe4-c36674bb9048 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:44.373902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1607362-ba12-4b6b-ba2b-3bc445a04c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:44.374606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1607362-ba12-4b6b-ba2b-3bc445a04c29 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:44.374893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1607362-ba12-4b6b-ba2b-3bc445a04c29 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:44.375174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1607362-ba12-4b6b-ba2b-3bc445a04c29 None admin] PATH_INFO: `/v3/projects/44d531dad0af48689a47b574f1a3bc3d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:44.376320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1607362-ba12-4b6b-ba2b-3bc445a04c29 None admin] RBAC: Authorizing `identity:get_project(project_id=44d531dad0af48689a47b574f1a3bc3d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:44.377810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1607362-ba12-4b6b-ba2b-3bc445a04c29 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:44.380119 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 66/129] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:00:44 2022] GET /identity/v3/projects/44d531dad0af48689a47b574f1a3bc3d => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:44.386725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1607362-ba12-4b6b-ba2b-3bc445a04c29 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:44.404733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:44.410334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad6f92-51f0-4b6c-9318-077d025a941e None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:44.446381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a95fd-82b9-4da6-a3bb-5cd563d8850c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:44.447961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a95fd-82b9-4da6-a3bb-5cd563d8850c None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:44.448251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a95fd-82b9-4da6-a3bb-5cd563d8850c None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:44.448801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a95fd-82b9-4da6-a3bb-5cd563d8850c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:44.449543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a95fd-82b9-4da6-a3bb-5cd563d8850c None admin] RBAC: Adding query filter params (role.id=31c2fac3eedc4006a84fcd0bee6d22e8, scope.project.id=cc5fad8ef92f41c9bbde916bcccc5b92, user.id=424dced1baf54e1892a377e81493f665) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:44.449968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a95fd-82b9-4da6-a3bb-5cd563d8850c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:44.451617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a95fd-82b9-4da6-a3bb-5cd563d8850c None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:44.466187 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 64/130] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:00:44 2022] GET /identity/v3/role_assignments?user.id=424dced1baf54e1892a377e81493f665&scope.project.id=cc5fad8ef92f41c9bbde916bcccc5b92&role.id=31c2fac3eedc4006a84fcd0bee6d22e8 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:00:44.466187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a95fd-82b9-4da6-a3bb-5cd563d8850c None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:44.503444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1607362-ba12-4b6b-ba2b-3bc445a04c29 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:44.545931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95483b3e-d500-43f8-a744-b1eed93f322f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:44.546513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95483b3e-d500-43f8-a744-b1eed93f322f None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:44.546800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95483b3e-d500-43f8-a744-b1eed93f322f None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:44.547081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95483b3e-d500-43f8-a744-b1eed93f322f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:44.547836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95483b3e-d500-43f8-a744-b1eed93f322f None admin] RBAC: Adding query filter params (role.id=17fff77450b94933a5d232fb3f3221b7, scope.project.id=44d531dad0af48689a47b574f1a3bc3d, user.id=424dced1baf54e1892a377e81493f665) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:44.548153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95483b3e-d500-43f8-a744-b1eed93f322f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:44.549667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95483b3e-d500-43f8-a744-b1eed93f322f None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:44.561502 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 67/131] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:00:44 2022] GET /identity/v3/role_assignments?user.id=424dced1baf54e1892a377e81493f665&scope.project.id=44d531dad0af48689a47b574f1a3bc3d&role.id=17fff77450b94933a5d232fb3f3221b7 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:44.586510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:44.600911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a95fd-82b9-4da6-a3bb-5cd563d8850c None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:44.644463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d4783-53e4-4796-a7f6-1a724b91bbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:44.645479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d4783-53e4-4796-a7f6-1a724b91bbe2 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:44.645943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d4783-53e4-4796-a7f6-1a724b91bbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:44.646584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d4783-53e4-4796-a7f6-1a724b91bbe2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:44.648090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d4783-53e4-4796-a7f6-1a724b91bbe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:44.649805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d4783-53e4-4796-a7f6-1a724b91bbe2 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:44.651898 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 65/132] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:00:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:44.658009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95483b3e-d500-43f8-a744-b1eed93f322f None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:44.750794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:44.771886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95483b3e-d500-43f8-a744-b1eed93f322f None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:44.808205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72329d-3ac7-4767-b4c6-0e5133f0d6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:44.808748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72329d-3ac7-4767-b4c6-0e5133f0d6af None admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:44.809030 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72329d-3ac7-4767-b4c6-0e5133f0d6af None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:44.809305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72329d-3ac7-4767-b4c6-0e5133f0d6af None admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:44.809957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72329d-3ac7-4767-b4c6-0e5133f0d6af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:44.811452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72329d-3ac7-4767-b4c6-0e5133f0d6af None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:44.902772 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 68/133] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 27 03:00:44 2022] POST /identity/v3/users => generated 283 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:00:45.641021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9ae05-9588-4a17-97b7-1983365f4ad0 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:45.641523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9ae05-9588-4a17-97b7-1983365f4ad0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:45.641619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9ae05-9588-4a17-97b7-1983365f4ad0 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:45.643173 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 66/134] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:45.648845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe82ca9-81c5-40b7-92e8-6fd627148de7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:45.649683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe82ca9-81c5-40b7-92e8-6fd627148de7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:45.650786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe82ca9-81c5-40b7-92e8-6fd627148de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:45.669843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-7fe82ca9-81c5-40b7-92e8-6fd627148de7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:45.671390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7fe82ca9-81c5-40b7-92e8-6fd627148de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:45.740110 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 69/135] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:46.016385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9ae05-9588-4a17-97b7-1983365f4ad0 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:46.123996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9ae05-9588-4a17-97b7-1983365f4ad0 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:46.158805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef68b3-d492-47d2-a56f-5bdc68f0a29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:46.159426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef68b3-d492-47d2-a56f-5bdc68f0a29f None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:46.159708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef68b3-d492-47d2-a56f-5bdc68f0a29f None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:46.159982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef68b3-d492-47d2-a56f-5bdc68f0a29f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:46.167758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:46.170645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef68b3-d492-47d2-a56f-5bdc68f0a29f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:00:46.175668 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-71ef68b3-d492-47d2-a56f-5bdc68f0a29f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 03:00:46.175668 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:46.175668 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:00:46.175668 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:00:46.175668 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:00:46.175668 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:00:46.175668 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:00:46.175668 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:00:46.175668 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:00:46.175668 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:00:46.175668 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:00:46.175668 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:00:46.175668 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:00:46.175668 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:00:46.175668 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:00:46.175668 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:00:46.176504 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:00:46.176504 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:00:46.176504 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:00:46.176504 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:00:46.176504 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:46.176504 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:46.176504 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:00:46.176504 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:00:46.176504 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:00:46.176504 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:00:46.176504 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:00:46.176504 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:00:46.176504 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:00:46.176504 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:00:46.176504 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:00:46.176504 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:00:46.177262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:00:46.177262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:00:46.177262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:00:46.177262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:00:46.177262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:00:46.177262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:00:46.177262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:00:46.177262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:00:46.177262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:00:46.177262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:00:46.177262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 03:00:46.177262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:00:46.177262 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 67/136] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:00:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:00:46.184622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe82ca9-81c5-40b7-92e8-6fd627148de7 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:46.253038 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:46.289618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe82ca9-81c5-40b7-92e8-6fd627148de7 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:46.332401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1fd4a-f3f8-4dea-b8af-24a03d8a76ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:46.333067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1fd4a-f3f8-4dea-b8af-24a03d8a76ea None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:46.333356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1fd4a-f3f8-4dea-b8af-24a03d8a76ea None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:46.333701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1fd4a-f3f8-4dea-b8af-24a03d8a76ea None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:46.334481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1fd4a-f3f8-4dea-b8af-24a03d8a76ea None admin] RBAC: Adding query filter params (name=reader) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:46.334791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1fd4a-f3f8-4dea-b8af-24a03d8a76ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:46.336195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1fd4a-f3f8-4dea-b8af-24a03d8a76ea None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:46.344723 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 70/137] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 27 03:00:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:46.350207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef68b3-d492-47d2-a56f-5bdc68f0a29f None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:46.453305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef68b3-d492-47d2-a56f-5bdc68f0a29f None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:46.487728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c658d55-4b59-4523-9f5e-c90ecda2237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:46.488370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c658d55-4b59-4523-9f5e-c90ecda2237e None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:46.488655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c658d55-4b59-4523-9f5e-c90ecda2237e None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:46.488933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c658d55-4b59-4523-9f5e-c90ecda2237e None admin] PATH_INFO: `/v3/users/06808c8588634e0390ee56bce456c785` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:46.490065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c658d55-4b59-4523-9f5e-c90ecda2237e None admin] RBAC: Authorizing `identity:get_user(user_id=06808c8588634e0390ee56bce456c785)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:46.491584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c658d55-4b59-4523-9f5e-c90ecda2237e None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:46.493155 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 68/138] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:00:46 2022] GET /identity/v3/users/06808c8588634e0390ee56bce456c785 => generated 289 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:46.499331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1fd4a-f3f8-4dea-b8af-24a03d8a76ea None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:46.601922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1fd4a-f3f8-4dea-b8af-24a03d8a76ea None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:46.629452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:46.637487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c19b40-a2dc-441d-8668-77b31c6413ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:46.638138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c19b40-a2dc-441d-8668-77b31c6413ab None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:46.638421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c19b40-a2dc-441d-8668-77b31c6413ab None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:46.638698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c19b40-a2dc-441d-8668-77b31c6413ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:46.707315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c19b40-a2dc-441d-8668-77b31c6413ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:46.708875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c19b40-a2dc-441d-8668-77b31c6413ab None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:46.812436 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 71/139] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:00:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 03:00:46.818151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c658d55-4b59-4523-9f5e-c90ecda2237e None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:46.886154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:46.921584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c658d55-4b59-4523-9f5e-c90ecda2237e None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:46.956299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89fbdd-0edb-42fe-9cb6-4d1d720771f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:46.956947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89fbdd-0edb-42fe-9cb6-4d1d720771f7 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:46.957231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89fbdd-0edb-42fe-9cb6-4d1d720771f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:46.957508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89fbdd-0edb-42fe-9cb6-4d1d720771f7 None admin] PATH_INFO: `/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:46.958705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89fbdd-0edb-42fe-9cb6-4d1d720771f7 None admin] RBAC: Authorizing `identity:get_project(project_id=cc5fad8ef92f41c9bbde916bcccc5b92)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:46.960161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89fbdd-0edb-42fe-9cb6-4d1d720771f7 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:46.962001 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 69/140] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:00:46 2022] GET /identity/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:46.968326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c19b40-a2dc-441d-8668-77b31c6413ab None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:46.997625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:47.075708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c19b40-a2dc-441d-8668-77b31c6413ab None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:47.114116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b42b2-a190-4b1d-abb2-1cf8708ba9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:47.114758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b42b2-a190-4b1d-abb2-1cf8708ba9ea None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:47.115044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b42b2-a190-4b1d-abb2-1cf8708ba9ea None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:47.115322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b42b2-a190-4b1d-abb2-1cf8708ba9ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:47.116059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b42b2-a190-4b1d-abb2-1cf8708ba9ea None admin] RBAC: Adding query filter params (role.id=e93dce408a514f8fb8a572d381e51045, scope.project.id=cc5fad8ef92f41c9bbde916bcccc5b92, user.id=06808c8588634e0390ee56bce456c785) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:47.116374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b42b2-a190-4b1d-abb2-1cf8708ba9ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:47.117832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b42b2-a190-4b1d-abb2-1cf8708ba9ea None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:47.124488 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 72/141] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:00:46 2022] GET /identity/v3/role_assignments?user.id=06808c8588634e0390ee56bce456c785&scope.project.id=cc5fad8ef92f41c9bbde916bcccc5b92&role.id=e93dce408a514f8fb8a572d381e51045 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:47.264610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05badccf-8dbb-457b-81cc-61232990f835 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:47.264937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05badccf-8dbb-457b-81cc-61232990f835 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:47.265191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05badccf-8dbb-457b-81cc-61232990f835 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:47.266971 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 70/142] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:47.272539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e340da-bfdf-4924-a8ae-560acff6ef5e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:47.272831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e340da-bfdf-4924-a8ae-560acff6ef5e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:47.273116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e340da-bfdf-4924-a8ae-560acff6ef5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:47.297590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f1e340da-bfdf-4924-a8ae-560acff6ef5e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:47.298865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f1e340da-bfdf-4924-a8ae-560acff6ef5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:47.329073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb0395-5a44-494c-a8f8-95fab214eea1 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:47.329368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb0395-5a44-494c-a8f8-95fab214eea1 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:47.329657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb0395-5a44-494c-a8f8-95fab214eea1 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:47.331379 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 71/143] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:47.338275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cae165-9362-4627-8e44-06dfc34d95b7 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:47.338884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cae165-9362-4627-8e44-06dfc34d95b7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:47.339361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cae165-9362-4627-8e44-06dfc34d95b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:47.363964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-23cae165-9362-4627-8e44-06dfc34d95b7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:47.365203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-23cae165-9362-4627-8e44-06dfc34d95b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:47.383119 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 73/144] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:47.432940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8f45e-bbce-44d9-a393-7a37cebaaa31 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:47.433241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8f45e-bbce-44d9-a393-7a37cebaaa31 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:47.433522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8f45e-bbce-44d9-a393-7a37cebaaa31 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:47.435080 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 74/145] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:00:47.439742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2e22f-b969-49a3-a1d6-9c7585685656 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:47.440029 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2e22f-b969-49a3-a1d6-9c7585685656 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:47.440302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2e22f-b969-49a3-a1d6-9c7585685656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:47.440969 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 72/146] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 03:00:47.458495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-51c2e22f-b969-49a3-a1d6-9c7585685656 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:47.459663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-51c2e22f-b969-49a3-a1d6-9c7585685656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:47.475726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:47.525283 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 75/147] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 03:00:47.653251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cae165-9362-4627-8e44-06dfc34d95b7 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:47.714577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2e22f-b969-49a3-a1d6-9c7585685656 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:47.716062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:47.751679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cae165-9362-4627-8e44-06dfc34d95b7 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:47.787209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873eb18-ec25-45e7-97a9-3518a69688b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:47.787856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873eb18-ec25-45e7-97a9-3518a69688b8 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:47.788146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873eb18-ec25-45e7-97a9-3518a69688b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:47.788426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873eb18-ec25-45e7-97a9-3518a69688b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:47.799470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873eb18-ec25-45e7-97a9-3518a69688b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:00:47.804874 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-9873eb18-ec25-45e7-97a9-3518a69688b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:00:47.804874 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:47.804874 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:00:47.804874 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:00:47.804874 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:00:47.804874 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:00:47.804874 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:00:47.804874 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:00:47.804874 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:00:47.804874 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:00:47.804874 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:00:47.804874 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:00:47.804874 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:00:47.804874 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:00:47.804874 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:00:47.804874 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:00:47.805956 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:00:47.805956 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:00:47.805956 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:00:47.805956 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:00:47.805956 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:47.805956 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:47.805956 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:00:47.805956 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:00:47.805956 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:00:47.805956 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:00:47.805956 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:00:47.805956 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:00:47.805956 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:00:47.805956 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:00:47.805956 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:00:47.805956 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:00:47.807423 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:00:47.807423 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:00:47.807423 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:00:47.807423 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:00:47.807423 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:00:47.807423 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:00:47.807423 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:00:47.807423 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:00:47.807423 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:00:47.807423 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:00:47.807423 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:00:47.807423 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:00:47.807423 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 73/148] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 27 03:00:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:00:47.807423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873eb18-ec25-45e7-97a9-3518a69688b8 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:47.823334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2e22f-b969-49a3-a1d6-9c7585685656 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:47.858285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd7131-0d31-42b3-96e5-ef6b00991e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:47.858921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd7131-0d31-42b3-96e5-ef6b00991e2d None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:47.859205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd7131-0d31-42b3-96e5-ef6b00991e2d None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:47.859476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd7131-0d31-42b3-96e5-ef6b00991e2d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:47.869850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd7131-0d31-42b3-96e5-ef6b00991e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:00:47.874654 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-4efd7131-0d31-42b3-96e5-ef6b00991e2d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 03:00:47.874654 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:47.874654 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:00:47.874654 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:00:47.874654 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:00:47.874654 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:00:47.874654 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:00:47.874654 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:00:47.874654 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:00:47.874654 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:00:47.874654 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:00:47.874654 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:00:47.874654 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:00:47.874654 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:00:47.874654 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:00:47.874654 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:00:47.875499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:00:47.875499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:00:47.875499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:00:47.875499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:00:47.875499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:47.875499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:47.875499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:00:47.875499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:00:47.875499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:00:47.875499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:00:47.875499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:00:47.875499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:00:47.875499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:00:47.875499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:00:47.875499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:00:47.875499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:00:47.876388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:00:47.876388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:00:47.876388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:00:47.876388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:00:47.876388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:00:47.876388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:00:47.876388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:00:47.876388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:00:47.876388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:00:47.876388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:00:47.876388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 03:00:47.876388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:00:47.876388 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 76/149] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 27 03:00:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:00:47.877028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd7131-0d31-42b3-96e5-ef6b00991e2d None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:47.892044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:47.912639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873eb18-ec25-45e7-97a9-3518a69688b8 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:47.937936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:47.945891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036525a-e22b-4c3c-b1e1-d9e6962ca4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:47.946563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036525a-e22b-4c3c-b1e1-d9e6962ca4b4 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:47.946854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036525a-e22b-4c3c-b1e1-d9e6962ca4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:47.947153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036525a-e22b-4c3c-b1e1-d9e6962ca4b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:47.956141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036525a-e22b-4c3c-b1e1-d9e6962ca4b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:47.956141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036525a-e22b-4c3c-b1e1-d9e6962ca4b4 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:47.956141 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 74/150] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:00:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:47.956141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036525a-e22b-4c3c-b1e1-d9e6962ca4b4 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:47.976641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd7131-0d31-42b3-96e5-ef6b00991e2d None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:48.010619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c219817-ab7f-42b9-b795-556a56580515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:48.011279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c219817-ab7f-42b9-b795-556a56580515 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:48.011557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c219817-ab7f-42b9-b795-556a56580515 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:48.011826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c219817-ab7f-42b9-b795-556a56580515 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:48.012517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c219817-ab7f-42b9-b795-556a56580515 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:48.012820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c219817-ab7f-42b9-b795-556a56580515 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:48.014243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c219817-ab7f-42b9-b795-556a56580515 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:48.022187 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 77/151] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:00:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:48.022951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c219817-ab7f-42b9-b795-556a56580515 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:48.049185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036525a-e22b-4c3c-b1e1-d9e6962ca4b4 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:48.081519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa58f0b-0beb-42e4-881f-1c5ba99bf1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:48.082148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa58f0b-0beb-42e4-881f-1c5ba99bf1fa None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:48.082429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa58f0b-0beb-42e4-881f-1c5ba99bf1fa None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:48.082697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa58f0b-0beb-42e4-881f-1c5ba99bf1fa None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:48.083366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa58f0b-0beb-42e4-881f-1c5ba99bf1fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:48.083666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa58f0b-0beb-42e4-881f-1c5ba99bf1fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:48.085022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa58f0b-0beb-42e4-881f-1c5ba99bf1fa None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:48.093238 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 75/152] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:00:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:48.094026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa58f0b-0beb-42e4-881f-1c5ba99bf1fa None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:48.097402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:48.121693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c219817-ab7f-42b9-b795-556a56580515 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:48.148571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:48.154863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c90065-9acf-459a-9a50-14463b294f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:48.155470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c90065-9acf-459a-9a50-14463b294f1d None admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:48.155751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c90065-9acf-459a-9a50-14463b294f1d None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:48.156022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c90065-9acf-459a-9a50-14463b294f1d None admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:48.156669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c90065-9acf-459a-9a50-14463b294f1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:48.158223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c90065-9acf-459a-9a50-14463b294f1d None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:48.191421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa58f0b-0beb-42e4-881f-1c5ba99bf1fa None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:48.223946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70263853-991e-442d-a958-96cbbe62924b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:48.224585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70263853-991e-442d-a958-96cbbe62924b None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:48.224869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70263853-991e-442d-a958-96cbbe62924b None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:48.225143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70263853-991e-442d-a958-96cbbe62924b None admin] PATH_INFO: `/v3/users/8767fd98864f4a538f21b966943404d1` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:48.238246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70263853-991e-442d-a958-96cbbe62924b None admin] RBAC: Authorizing `identity:get_user(user_id=8767fd98864f4a538f21b966943404d1)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:48.239650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70263853-991e-442d-a958-96cbbe62924b None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:48.241264 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 76/153] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:00:48 2022] GET /identity/v3/users/8767fd98864f4a538f21b966943404d1 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:48.242157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70263853-991e-442d-a958-96cbbe62924b None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:48.257439 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 78/154] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 27 03:00:48 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:00:48.258572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c90065-9acf-459a-9a50-14463b294f1d None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:48.371652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70263853-991e-442d-a958-96cbbe62924b None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:48.381470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c90065-9acf-459a-9a50-14463b294f1d None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:48.389277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:48.410627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960727ae-18ab-451f-bbfc-18efc415353a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:48.411352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960727ae-18ab-451f-bbfc-18efc415353a None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:48.411785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960727ae-18ab-451f-bbfc-18efc415353a None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:48.412068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960727ae-18ab-451f-bbfc-18efc415353a None admin] PATH_INFO: `/v3/users/8767fd98864f4a538f21b966943404d1` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:48.413259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960727ae-18ab-451f-bbfc-18efc415353a None admin] RBAC: Authorizing `identity:get_user(user_id=8767fd98864f4a538f21b966943404d1)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:48.414732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:48.414856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960727ae-18ab-451f-bbfc-18efc415353a None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:48.416445 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 77/155] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:00:48 2022] GET /identity/v3/users/8767fd98864f4a538f21b966943404d1 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:48.422169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960727ae-18ab-451f-bbfc-18efc415353a None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:48.423880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db20994-a376-434c-90bb-a451388543bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:48.424006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db20994-a376-434c-90bb-a451388543bf None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:48.424264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db20994-a376-434c-90bb-a451388543bf None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:48.424538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db20994-a376-434c-90bb-a451388543bf None admin] PATH_INFO: `/v3/projects/8b5c4caaad3540288517a0fd7eff738d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:48.425676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db20994-a376-434c-90bb-a451388543bf None admin] RBAC: Authorizing `identity:get_project(project_id=8b5c4caaad3540288517a0fd7eff738d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:48.427175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db20994-a376-434c-90bb-a451388543bf None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:48.429554 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 79/156] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:00:48 2022] GET /identity/v3/projects/8b5c4caaad3540288517a0fd7eff738d => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:48.435732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db20994-a376-434c-90bb-a451388543bf None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:48.551014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960727ae-18ab-451f-bbfc-18efc415353a None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:48.561231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db20994-a376-434c-90bb-a451388543bf None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:48.590835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73196c-96d3-4164-ab76-94410fd2109a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:48.591481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73196c-96d3-4164-ab76-94410fd2109a None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:48.591767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73196c-96d3-4164-ab76-94410fd2109a None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:48.592050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73196c-96d3-4164-ab76-94410fd2109a None admin] PATH_INFO: `/v3/projects/8b5c4caaad3540288517a0fd7eff738d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:48.593202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73196c-96d3-4164-ab76-94410fd2109a None admin] RBAC: Authorizing `identity:get_project(project_id=8b5c4caaad3540288517a0fd7eff738d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:48.594703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73196c-96d3-4164-ab76-94410fd2109a None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:48.600861 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 78/157] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:00:48 2022] GET /identity/v3/projects/8b5c4caaad3540288517a0fd7eff738d => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:48.602277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73196c-96d3-4164-ab76-94410fd2109a None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:48.605744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a76ad-1cd4-4dab-92c9-15e4342c582f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:48.606720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a76ad-1cd4-4dab-92c9-15e4342c582f None admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:48.607008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a76ad-1cd4-4dab-92c9-15e4342c582f None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:48.607288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a76ad-1cd4-4dab-92c9-15e4342c582f None admin] PATH_INFO: `/v3/projects/8b5c4caaad3540288517a0fd7eff738d/users/8767fd98864f4a538f21b966943404d1/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:48.609233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a76ad-1cd4-4dab-92c9-15e4342c582f None admin] RBAC: Authorizing `identity:create_grant(project_id=8b5c4caaad3540288517a0fd7eff738d, user_id=8767fd98864f4a538f21b966943404d1, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:48.610741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a76ad-1cd4-4dab-92c9-15e4342c582f None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:48.657200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:48.707222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73196c-96d3-4164-ab76-94410fd2109a None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:48.725138 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 80/158] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:00:48 2022] PUT /identity/v3/projects/8b5c4caaad3540288517a0fd7eff738d/users/8767fd98864f4a538f21b966943404d1/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:00:48.755293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390c96a-0f3b-4e39-a8e2-3647c7a454be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:48.755994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390c96a-0f3b-4e39-a8e2-3647c7a454be None admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:48.756284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390c96a-0f3b-4e39-a8e2-3647c7a454be None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:48.756563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390c96a-0f3b-4e39-a8e2-3647c7a454be None admin] PATH_INFO: `/v3/projects/8b5c4caaad3540288517a0fd7eff738d/users/8767fd98864f4a538f21b966943404d1/roles/31c2fac3eedc4006a84fcd0bee6d22e8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:48.759355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390c96a-0f3b-4e39-a8e2-3647c7a454be None admin] RBAC: Authorizing `identity:create_grant(project_id=8b5c4caaad3540288517a0fd7eff738d, user_id=8767fd98864f4a538f21b966943404d1, role_id=31c2fac3eedc4006a84fcd0bee6d22e8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:48.761047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390c96a-0f3b-4e39-a8e2-3647c7a454be None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:48.830525 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 79/159] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:00:48 2022] PUT /identity/v3/projects/8b5c4caaad3540288517a0fd7eff738d/users/8767fd98864f4a538f21b966943404d1/roles/31c2fac3eedc4006a84fcd0bee6d22e8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:00:50.580296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f91702-1aaf-418a-a4ae-a058c6327a3e None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:50.580872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f91702-1aaf-418a-a4ae-a058c6327a3e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:50.580872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f91702-1aaf-418a-a4ae-a058c6327a3e None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:50.582387 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 81/160] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:50.588031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d03f8b-ada6-493e-bdfd-a279a71806e9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:50.588449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d03f8b-ada6-493e-bdfd-a279a71806e9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:50.588626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d03f8b-ada6-493e-bdfd-a279a71806e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:50.607403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-18d03f8b-ada6-493e-bdfd-a279a71806e9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:50.608579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-18d03f8b-ada6-493e-bdfd-a279a71806e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:50.660966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffbf32-bca3-4c7c-afaf-72d0fbd713ec None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:50.661606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffbf32-bca3-4c7c-afaf-72d0fbd713ec None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:50.662154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffbf32-bca3-4c7c-afaf-72d0fbd713ec None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:50.663989 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 82/161] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:00:50.669725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e1371-254c-4dc3-b74e-da9e63eb03e8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:50.670286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e1371-254c-4dc3-b74e-da9e63eb03e8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:50.670786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e1371-254c-4dc3-b74e-da9e63eb03e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:50.678170 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 80/162] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:50.690142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-192e1371-254c-4dc3-b74e-da9e63eb03e8 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:50.691611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-192e1371-254c-4dc3-b74e-da9e63eb03e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:50.752842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:50.768189 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 83/163] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 03:00:50.926187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97d0f8-cffb-4342-92c6-3e9a717b5203 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:50.926860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97d0f8-cffb-4342-92c6-3e9a717b5203 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:50.927373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97d0f8-cffb-4342-92c6-3e9a717b5203 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:50.929006 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 81/164] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:50.934558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd7fe2-3356-4eb4-832e-c343d17125fb None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:50.934851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd7fe2-3356-4eb4-832e-c343d17125fb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:50.935136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd7fe2-3356-4eb4-832e-c343d17125fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:50.945457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97d0f8-cffb-4342-92c6-3e9a717b5203 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:50.954621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-01bd7fe2-3356-4eb4-832e-c343d17125fb None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:50.955925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-01bd7fe2-3356-4eb4-832e-c343d17125fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:50.990573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:51.033624 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 84/165] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:51.035000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f29f59-7b86-421c-83d1-cb25ee34ae0b None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:51.035294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f29f59-7b86-421c-83d1-cb25ee34ae0b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:51.035572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f29f59-7b86-421c-83d1-cb25ee34ae0b None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:51.036954 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 85/166] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:51.042679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6a96b-224f-4e9e-84fd-45ab3380275c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:51.042967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6a96b-224f-4e9e-84fd-45ab3380275c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:51.043245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6a96b-224f-4e9e-84fd-45ab3380275c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:51.058308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97d0f8-cffb-4342-92c6-3e9a717b5203 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:51.066927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-05e6a96b-224f-4e9e-84fd-45ab3380275c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:51.068134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-05e6a96b-224f-4e9e-84fd-45ab3380275c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:51.096660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b849cf-8d63-4c3b-839f-226f3036d49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:51.097288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b849cf-8d63-4c3b-839f-226f3036d49b None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:51.097568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b849cf-8d63-4c3b-839f-226f3036d49b None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:51.097839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b849cf-8d63-4c3b-839f-226f3036d49b None admin] PATH_INFO: `/v3/roles/member` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:51.108773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b849cf-8d63-4c3b-839f-226f3036d49b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:00:51.113554 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-b9b849cf-8d63-4c3b-839f-226f3036d49b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:00:51.113554 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:51.113554 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:00:51.113554 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:00:51.113554 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:00:51.113554 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:00:51.113554 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:00:51.113554 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:00:51.113554 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:00:51.113554 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:00:51.113554 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:00:51.113554 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:00:51.113554 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:00:51.113554 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:00:51.113554 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:00:51.113554 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:00:51.114521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:00:51.114521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:00:51.114521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:00:51.114521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:00:51.114521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:51.114521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:51.114521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:00:51.114521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:00:51.114521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:00:51.114521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:00:51.114521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:00:51.114521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:00:51.114521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:00:51.114521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:00:51.114521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:00:51.114521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:00:51.115430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:00:51.115430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:00:51.115430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:00:51.115430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:00:51.115430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:00:51.115430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:00:51.115430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:00:51.115430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:00:51.115430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:00:51.115430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:00:51.115430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:00:51.115430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:00:51.115430 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 82/167] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:00:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:00:51.119423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b849cf-8d63-4c3b-839f-226f3036d49b None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:51.141022 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 86/168] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 03:00:51.150919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6a96b-224f-4e9e-84fd-45ab3380275c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:51.216308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:51.242919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:51.247729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b849cf-8d63-4c3b-839f-226f3036d49b None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:51.284793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6a96b-224f-4e9e-84fd-45ab3380275c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:51.290813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a24b5f-bd9c-4bc7-8890-18917dbed1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:51.291684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a24b5f-bd9c-4bc7-8890-18917dbed1b9 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:51.292150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a24b5f-bd9c-4bc7-8890-18917dbed1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:51.292606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a24b5f-bd9c-4bc7-8890-18917dbed1b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:51.293888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a24b5f-bd9c-4bc7-8890-18917dbed1b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:51.295553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a24b5f-bd9c-4bc7-8890-18917dbed1b9 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:51.297385 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 83/169] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:00:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:51.302938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a24b5f-bd9c-4bc7-8890-18917dbed1b9 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:51.423994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135441a7-5031-4f3e-996a-57ac5966009d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:51.424607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135441a7-5031-4f3e-996a-57ac5966009d None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:51.424920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135441a7-5031-4f3e-996a-57ac5966009d None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:51.425191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135441a7-5031-4f3e-996a-57ac5966009d None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:51.425859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135441a7-5031-4f3e-996a-57ac5966009d None admin] RBAC: Adding query filter params (name=member) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:51.426197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135441a7-5031-4f3e-996a-57ac5966009d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:51.427572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135441a7-5031-4f3e-996a-57ac5966009d None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:51.436373 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 87/170] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 27 03:00:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:51.437336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135441a7-5031-4f3e-996a-57ac5966009d None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:51.487758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a24b5f-bd9c-4bc7-8890-18917dbed1b9 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:51.521631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d40d2-c70c-4198-becc-7edcb2391354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:51.522267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d40d2-c70c-4198-becc-7edcb2391354 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:51.522554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d40d2-c70c-4198-becc-7edcb2391354 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:51.522828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d40d2-c70c-4198-becc-7edcb2391354 None admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:51.523483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d40d2-c70c-4198-becc-7edcb2391354 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:51.524947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d40d2-c70c-4198-becc-7edcb2391354 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:51.535209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135441a7-5031-4f3e-996a-57ac5966009d None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:51.545916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:51.568584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbea02c-5696-4422-8ad4-99fb4037ff39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:51.569207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbea02c-5696-4422-8ad4-99fb4037ff39 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:51.569490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbea02c-5696-4422-8ad4-99fb4037ff39 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:51.569763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbea02c-5696-4422-8ad4-99fb4037ff39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:51.579955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbea02c-5696-4422-8ad4-99fb4037ff39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:00:51.584853 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-4cbea02c-5696-4422-8ad4-99fb4037ff39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:00:51.584853 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:51.584853 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:00:51.584853 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:00:51.584853 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:00:51.584853 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:00:51.584853 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:00:51.584853 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:00:51.584853 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:00:51.584853 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:00:51.584853 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:00:51.584853 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:00:51.584853 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:00:51.584853 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:00:51.584853 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:00:51.584853 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:00:51.586345 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:00:51.586345 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:00:51.586345 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:00:51.586345 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:00:51.586345 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:51.586345 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:51.586345 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:00:51.586345 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:00:51.586345 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:00:51.586345 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:00:51.586345 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:00:51.586345 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:00:51.586345 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:00:51.586345 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:00:51.586345 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:00:51.586345 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:00:51.587355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:00:51.587355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:00:51.587355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:00:51.587355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:00:51.587355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:00:51.587355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:00:51.587355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:00:51.587355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:00:51.587355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:00:51.587355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:00:51.587355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:00:51.587355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:00:51.587355 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 88/171] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 27 03:00:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:00:51.587355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbea02c-5696-4422-8ad4-99fb4037ff39 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:51.618063 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 84/172] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 27 03:00:51 2022] POST /identity/v3/users => generated 297 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:00:51.618063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d40d2-c70c-4198-becc-7edcb2391354 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:51.653203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:51.699058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbea02c-5696-4422-8ad4-99fb4037ff39 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:51.736857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b52ebb-1d4b-4e49-8ea8-856e40dfad8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:51.737522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b52ebb-1d4b-4e49-8ea8-856e40dfad8a None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:51.737858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b52ebb-1d4b-4e49-8ea8-856e40dfad8a None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:51.738107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b52ebb-1d4b-4e49-8ea8-856e40dfad8a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:51.741416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d40d2-c70c-4198-becc-7edcb2391354 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:51.750018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b52ebb-1d4b-4e49-8ea8-856e40dfad8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:00:51.755524 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-c9b52ebb-1d4b-4e49-8ea8-856e40dfad8a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 03:00:51.755524 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:51.755524 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:00:51.755524 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:00:51.755524 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:00:51.755524 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:00:51.755524 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:00:51.755524 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:00:51.755524 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:00:51.755524 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:00:51.755524 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:00:51.755524 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:00:51.755524 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:00:51.755524 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:00:51.755524 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:00:51.755524 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:00:51.756485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:00:51.756485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:00:51.756485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:00:51.756485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:00:51.756485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:51.756485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:51.756485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:00:51.756485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:00:51.756485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:00:51.756485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:00:51.756485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:00:51.756485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:00:51.756485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:00:51.756485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:00:51.756485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:00:51.756485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:00:51.757281 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:00:51.757281 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:00:51.757281 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:00:51.757281 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:00:51.757281 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:00:51.757281 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:00:51.757281 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:00:51.757281 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:00:51.757281 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:00:51.757281 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:00:51.757281 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 03:00:51.757281 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:00:51.757281 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 89/173] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 27 03:00:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:00:51.762821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b52ebb-1d4b-4e49-8ea8-856e40dfad8a None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:51.784157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7cc43-1b1e-4e33-aff9-b06e3bce3ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:51.785055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7cc43-1b1e-4e33-aff9-b06e3bce3ee3 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:51.785492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7cc43-1b1e-4e33-aff9-b06e3bce3ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:51.785910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7cc43-1b1e-4e33-aff9-b06e3bce3ee3 None admin] PATH_INFO: `/v3/users/cd5fcc7ed0404897a0c97eb9e94f4e24` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:51.797461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:51.802071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7cc43-1b1e-4e33-aff9-b06e3bce3ee3 None admin] RBAC: Authorizing `identity:get_user(user_id=cd5fcc7ed0404897a0c97eb9e94f4e24)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:51.803562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7cc43-1b1e-4e33-aff9-b06e3bce3ee3 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:51.805221 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 85/174] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:00:51 2022] GET /identity/v3/users/cd5fcc7ed0404897a0c97eb9e94f4e24 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:51.805992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7cc43-1b1e-4e33-aff9-b06e3bce3ee3 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:51.881408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b52ebb-1d4b-4e49-8ea8-856e40dfad8a None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:51.917714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:51.932741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b3a13-f03a-4389-b7ec-388ada46c113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:51.934372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b3a13-f03a-4389-b7ec-388ada46c113 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:51.934372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b3a13-f03a-4389-b7ec-388ada46c113 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:51.934372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b3a13-f03a-4389-b7ec-388ada46c113 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:51.934702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b3a13-f03a-4389-b7ec-388ada46c113 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:51.934973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b3a13-f03a-4389-b7ec-388ada46c113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:51.936355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b3a13-f03a-4389-b7ec-388ada46c113 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:51.942811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7cc43-1b1e-4e33-aff9-b06e3bce3ee3 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:51.946312 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 90/175] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:00:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:51.947524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b3a13-f03a-4389-b7ec-388ada46c113 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:51.985568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc4569-3681-4479-a6c9-f8a141fe2904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:51.986234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc4569-3681-4479-a6c9-f8a141fe2904 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:51.986517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc4569-3681-4479-a6c9-f8a141fe2904 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:51.986787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc4569-3681-4479-a6c9-f8a141fe2904 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:51.987459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc4569-3681-4479-a6c9-f8a141fe2904 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:51.987763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc4569-3681-4479-a6c9-f8a141fe2904 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:51.989205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc4569-3681-4479-a6c9-f8a141fe2904 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:51.999278 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 86/176] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:00:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:51.999944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc4569-3681-4479-a6c9-f8a141fe2904 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:52.064533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:52.073396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b3a13-f03a-4389-b7ec-388ada46c113 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:52.108724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981e2b7-ca7b-4117-bea3-db16b95322a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:52.109503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981e2b7-ca7b-4117-bea3-db16b95322a5 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:52.109877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981e2b7-ca7b-4117-bea3-db16b95322a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:52.110276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981e2b7-ca7b-4117-bea3-db16b95322a5 None admin] PATH_INFO: `/v3/projects/8b5c4caaad3540288517a0fd7eff738d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:52.111516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a981e2b7-ca7b-4117-bea3-db16b95322a5 None admin] RBAC: Authorizing `identity:get_project(project_id=8b5c4caaad3540288517a0fd7eff738d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:52.113056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a981e2b7-ca7b-4117-bea3-db16b95322a5 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:52.115111 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 91/177] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:00:51 2022] GET /identity/v3/projects/8b5c4caaad3540288517a0fd7eff738d => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:52.116084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981e2b7-ca7b-4117-bea3-db16b95322a5 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:52.120092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc4569-3681-4479-a6c9-f8a141fe2904 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:52.161346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb3c13-a4f9-488c-9ccb-b32e458163b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:52.162063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb3c13-a4f9-488c-9ccb-b32e458163b7 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:52.162361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb3c13-a4f9-488c-9ccb-b32e458163b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:52.162641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb3c13-a4f9-488c-9ccb-b32e458163b7 None admin] PATH_INFO: `/v3/users/8767fd98864f4a538f21b966943404d1` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:52.164070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb3c13-a4f9-488c-9ccb-b32e458163b7 None admin] RBAC: Authorizing `identity:get_user(user_id=8767fd98864f4a538f21b966943404d1)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:52.167077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb3c13-a4f9-488c-9ccb-b32e458163b7 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:52.169293 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 87/178] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:00:51 2022] GET /identity/v3/users/8767fd98864f4a538f21b966943404d1 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:52.170216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb3c13-a4f9-488c-9ccb-b32e458163b7 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:52.211535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:52.227447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981e2b7-ca7b-4117-bea3-db16b95322a5 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:52.264253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf19712-854b-4404-ae89-89ac0185e39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:52.265442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf19712-854b-4404-ae89-89ac0185e39f None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:52.265970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf19712-854b-4404-ae89-89ac0185e39f None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:52.266458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf19712-854b-4404-ae89-89ac0185e39f None admin] PATH_INFO: `/v3/users/8767fd98864f4a538f21b966943404d1` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:52.267896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf19712-854b-4404-ae89-89ac0185e39f None admin] RBAC: Authorizing `identity:get_user(user_id=8767fd98864f4a538f21b966943404d1)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:52.269686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf19712-854b-4404-ae89-89ac0185e39f None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:52.272098 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 92/179] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:00:52 2022] GET /identity/v3/users/8767fd98864f4a538f21b966943404d1 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:52.273162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf19712-854b-4404-ae89-89ac0185e39f None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:52.311278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:52.327569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb3c13-a4f9-488c-9ccb-b32e458163b7 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:52.376997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11628c5-83bc-41d7-9df9-f6c75ed23e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:52.377996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11628c5-83bc-41d7-9df9-f6c75ed23e85 None admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:52.378330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11628c5-83bc-41d7-9df9-f6c75ed23e85 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:52.378612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11628c5-83bc-41d7-9df9-f6c75ed23e85 None admin] PATH_INFO: `/v3/projects/8b5c4caaad3540288517a0fd7eff738d/users/cd5fcc7ed0404897a0c97eb9e94f4e24/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:52.381300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11628c5-83bc-41d7-9df9-f6c75ed23e85 None admin] RBAC: Authorizing `identity:create_grant(project_id=8b5c4caaad3540288517a0fd7eff738d, user_id=cd5fcc7ed0404897a0c97eb9e94f4e24, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:52.383642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11628c5-83bc-41d7-9df9-f6c75ed23e85 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:52.390386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf19712-854b-4404-ae89-89ac0185e39f None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:52.425538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f53a8b-97b2-423c-b0fc-d618f01f6d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:52.426244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f53a8b-97b2-423c-b0fc-d618f01f6d7c None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:52.426522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f53a8b-97b2-423c-b0fc-d618f01f6d7c None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:52.426790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f53a8b-97b2-423c-b0fc-d618f01f6d7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:52.460837 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 88/180] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:00:52 2022] PUT /identity/v3/projects/8b5c4caaad3540288517a0fd7eff738d/users/cd5fcc7ed0404897a0c97eb9e94f4e24/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:00:52.463083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11628c5-83bc-41d7-9df9-f6c75ed23e85 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:52.520132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f53a8b-97b2-423c-b0fc-d618f01f6d7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:52.521565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f53a8b-97b2-423c-b0fc-d618f01f6d7c None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:52.558181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:52.595609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:52.598303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11628c5-83bc-41d7-9df9-f6c75ed23e85 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:52.643583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30e4ab-84e8-45d6-817c-803ab6235ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:52.645391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30e4ab-84e8-45d6-817c-803ab6235ba8 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:52.645927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30e4ab-84e8-45d6-817c-803ab6235ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:52.646490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30e4ab-84e8-45d6-817c-803ab6235ba8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:52.728244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30e4ab-84e8-45d6-817c-803ab6235ba8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:52.730237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30e4ab-84e8-45d6-817c-803ab6235ba8 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:52.771208 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 93/181] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:00:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 03:00:52.776615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f53a8b-97b2-423c-b0fc-d618f01f6d7c None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:52.833861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:52.863505 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 89/182] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:00:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 03:00:52.870515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30e4ab-84e8-45d6-817c-803ab6235ba8 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:52.951660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f53a8b-97b2-423c-b0fc-d618f01f6d7c None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:53.007588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:53.017593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b7947-6430-4042-aca1-e38ad0e933cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:53.018575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b7947-6430-4042-aca1-e38ad0e933cf None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:53.019058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b7947-6430-4042-aca1-e38ad0e933cf None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:53.019532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b7947-6430-4042-aca1-e38ad0e933cf None admin] PATH_INFO: `/v3/projects/8b5c4caaad3540288517a0fd7eff738d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:53.020877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b7947-6430-4042-aca1-e38ad0e933cf None admin] RBAC: Authorizing `identity:get_project(project_id=8b5c4caaad3540288517a0fd7eff738d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:53.022635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b7947-6430-4042-aca1-e38ad0e933cf None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:53.024627 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 94/183] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:00:52 2022] GET /identity/v3/projects/8b5c4caaad3540288517a0fd7eff738d => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:00:53.032916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b7947-6430-4042-aca1-e38ad0e933cf None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:53.041765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30e4ab-84e8-45d6-817c-803ab6235ba8 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:53.136316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8642d3-71b6-4285-a24f-e04b819d6aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:53.136773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8642d3-71b6-4285-a24f-e04b819d6aef None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:53.137058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8642d3-71b6-4285-a24f-e04b819d6aef None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:53.137336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8642d3-71b6-4285-a24f-e04b819d6aef None admin] PATH_INFO: `/v3/projects/8b5c4caaad3540288517a0fd7eff738d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:53.138706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8642d3-71b6-4285-a24f-e04b819d6aef None admin] RBAC: Authorizing `identity:get_project(project_id=8b5c4caaad3540288517a0fd7eff738d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:53.140217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8642d3-71b6-4285-a24f-e04b819d6aef None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:53.146373 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 90/184] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:00:52 2022] GET /identity/v3/projects/8b5c4caaad3540288517a0fd7eff738d => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:53.150599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b7947-6430-4042-aca1-e38ad0e933cf None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:53.150978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8642d3-71b6-4285-a24f-e04b819d6aef None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:53.202055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20eeb5-5b64-471d-bb53-f2b6e38c7f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:53.204061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20eeb5-5b64-471d-bb53-f2b6e38c7f1f None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:53.204347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20eeb5-5b64-471d-bb53-f2b6e38c7f1f None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:53.204625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20eeb5-5b64-471d-bb53-f2b6e38c7f1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:53.205368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20eeb5-5b64-471d-bb53-f2b6e38c7f1f None admin] RBAC: Adding query filter params (role.id=6e91e7a416ac452b86ec238a2b81bc07, scope.project.id=8b5c4caaad3540288517a0fd7eff738d, user.id=8767fd98864f4a538f21b966943404d1) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:53.205685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20eeb5-5b64-471d-bb53-f2b6e38c7f1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:53.207171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20eeb5-5b64-471d-bb53-f2b6e38c7f1f None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:53.215986 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 95/185] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:00:53 2022] GET /identity/v3/role_assignments?user.id=8767fd98864f4a538f21b966943404d1&scope.project.id=8b5c4caaad3540288517a0fd7eff738d&role.id=6e91e7a416ac452b86ec238a2b81bc07 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:53.245111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:53.326084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8642d3-71b6-4285-a24f-e04b819d6aef None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:53.377745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd5339-405d-45eb-be5e-f34ca67a50e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:53.378404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd5339-405d-45eb-be5e-f34ca67a50e3 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:53.378685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd5339-405d-45eb-be5e-f34ca67a50e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:53.378956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd5339-405d-45eb-be5e-f34ca67a50e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:53.379709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd5339-405d-45eb-be5e-f34ca67a50e3 None admin] RBAC: Adding query filter params (role.id=31c2fac3eedc4006a84fcd0bee6d22e8, scope.project.id=8b5c4caaad3540288517a0fd7eff738d, user.id=8767fd98864f4a538f21b966943404d1) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:53.380014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd5339-405d-45eb-be5e-f34ca67a50e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:53.381560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd5339-405d-45eb-be5e-f34ca67a50e3 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:53.390937 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 91/186] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:00:53 2022] GET /identity/v3/role_assignments?user.id=8767fd98864f4a538f21b966943404d1&scope.project.id=8b5c4caaad3540288517a0fd7eff738d&role.id=31c2fac3eedc4006a84fcd0bee6d22e8 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:54.023349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a6261-1e9f-4a67-8d48-9d6c0e7dbe5a None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:54.023905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a6261-1e9f-4a67-8d48-9d6c0e7dbe5a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:54.023905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a6261-1e9f-4a67-8d48-9d6c0e7dbe5a None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:54.026057 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 96/187] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:54.031120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571ef33-f846-4644-9fdb-bf6a1d34d201 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:54.031506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571ef33-f846-4644-9fdb-bf6a1d34d201 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:54.031669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571ef33-f846-4644-9fdb-bf6a1d34d201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:54.049793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8571ef33-f846-4644-9fdb-bf6a1d34d201 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:54.051032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8571ef33-f846-4644-9fdb-bf6a1d34d201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:54.118476 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 92/188] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:54.223647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec8547-0bcc-4b36-9574-0cb24bc6ad45 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:54.223930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec8547-0bcc-4b36-9574-0cb24bc6ad45 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:54.224209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec8547-0bcc-4b36-9574-0cb24bc6ad45 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:54.225751 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 97/189] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:00:54.230832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83433114-3852-4408-883b-3e309c79d56a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:54.231125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83433114-3852-4408-883b-3e309c79d56a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:54.231404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83433114-3852-4408-883b-3e309c79d56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:54.249899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-83433114-3852-4408-883b-3e309c79d56a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:54.251093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-83433114-3852-4408-883b-3e309c79d56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:54.277610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:54.317804 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 93/190] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:54.388143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec8547-0bcc-4b36-9574-0cb24bc6ad45 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:54.448316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:54.490373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec8547-0bcc-4b36-9574-0cb24bc6ad45 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:54.524582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef89c83-7624-409c-b259-752239ccd714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:54.525270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef89c83-7624-409c-b259-752239ccd714 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:54.525551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef89c83-7624-409c-b259-752239ccd714 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:54.525822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef89c83-7624-409c-b259-752239ccd714 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:54.535911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef89c83-7624-409c-b259-752239ccd714 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:00:54.541617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-1ef89c83-7624-409c-b259-752239ccd714 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 03:00:54.541617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:54.541617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:00:54.541617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:00:54.541617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:00:54.541617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:00:54.541617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:00:54.541617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:00:54.541617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:00:54.541617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:00:54.541617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:00:54.541617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:00:54.541617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:00:54.541617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:00:54.541617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:00:54.541617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:00:54.542547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:00:54.542547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:00:54.542547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:00:54.542547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:00:54.542547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:54.542547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:54.542547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:00:54.542547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:00:54.542547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:00:54.542547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:00:54.542547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:00:54.542547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:00:54.542547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:00:54.542547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:00:54.542547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:00:54.542547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:00:54.543341 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:00:54.543341 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:00:54.543341 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:00:54.543341 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:00:54.543341 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:00:54.543341 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:00:54.543341 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:00:54.543341 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:00:54.543341 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:00:54.543341 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:00:54.543341 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 03:00:54.543341 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:00:54.546346 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 98/191] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:00:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:00:54.548664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83433114-3852-4408-883b-3e309c79d56a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:54.589130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef89c83-7624-409c-b259-752239ccd714 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:54.653751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83433114-3852-4408-883b-3e309c79d56a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:54.688672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe50a53-6b74-48e4-9e53-6a38486f7255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:54.689291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe50a53-6b74-48e4-9e53-6a38486f7255 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:54.689578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe50a53-6b74-48e4-9e53-6a38486f7255 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:54.689855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe50a53-6b74-48e4-9e53-6a38486f7255 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:54.690564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe50a53-6b74-48e4-9e53-6a38486f7255 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:54.690887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe50a53-6b74-48e4-9e53-6a38486f7255 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:54.692261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe50a53-6b74-48e4-9e53-6a38486f7255 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:54.693186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef89c83-7624-409c-b259-752239ccd714 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:54.701577 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 94/192] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 27 03:00:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:54.707114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe50a53-6b74-48e4-9e53-6a38486f7255 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:54.714411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:54.729227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017a709-4407-43c8-b91c-b61ab5fc76d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:54.729977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017a709-4407-43c8-b91c-b61ab5fc76d9 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:54.730288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017a709-4407-43c8-b91c-b61ab5fc76d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:54.730597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017a709-4407-43c8-b91c-b61ab5fc76d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:54.731754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017a709-4407-43c8-b91c-b61ab5fc76d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:54.733454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017a709-4407-43c8-b91c-b61ab5fc76d9 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:54.735113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:54.736138 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 99/193] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:00:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:00:54.741208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017a709-4407-43c8-b91c-b61ab5fc76d9 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:54.809963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe50a53-6b74-48e4-9e53-6a38486f7255 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:54.847630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fc568-8bb3-4d4d-aea9-8e567dd387a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:54.848275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fc568-8bb3-4d4d-aea9-8e567dd387a7 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:54.848563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fc568-8bb3-4d4d-aea9-8e567dd387a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:54.848841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fc568-8bb3-4d4d-aea9-8e567dd387a7 None admin] PATH_INFO: `/v3/users/cdf801c201fd4240ba1345a3a241d822` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:54.853743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017a709-4407-43c8-b91c-b61ab5fc76d9 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:54.864463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fc568-8bb3-4d4d-aea9-8e567dd387a7 None admin] RBAC: Authorizing `identity:get_user(user_id=cdf801c201fd4240ba1345a3a241d822)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:54.865940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fc568-8bb3-4d4d-aea9-8e567dd387a7 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:54.867769 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 95/194] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:00:54 2022] GET /identity/v3/users/cdf801c201fd4240ba1345a3a241d822 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:54.873679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fc568-8bb3-4d4d-aea9-8e567dd387a7 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:54.891364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b11ea0-0951-47cf-9b9a-3e091409df62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:54.892145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b11ea0-0951-47cf-9b9a-3e091409df62 None admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:54.892435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b11ea0-0951-47cf-9b9a-3e091409df62 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:54.893009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b11ea0-0951-47cf-9b9a-3e091409df62 None admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:54.893670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b11ea0-0951-47cf-9b9a-3e091409df62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:54.895173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b11ea0-0951-47cf-9b9a-3e091409df62 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:54.955445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:54.970758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fc568-8bb3-4d4d-aea9-8e567dd387a7 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:55.002548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f6844-35b3-4e86-a68c-39318e6b8d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:55.003170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f6844-35b3-4e86-a68c-39318e6b8d02 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:55.003451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f6844-35b3-4e86-a68c-39318e6b8d02 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:55.003725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f6844-35b3-4e86-a68c-39318e6b8d02 None admin] PATH_INFO: `/v3/projects/8b5c4caaad3540288517a0fd7eff738d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:55.004842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f6844-35b3-4e86-a68c-39318e6b8d02 None admin] RBAC: Authorizing `identity:get_project(project_id=8b5c4caaad3540288517a0fd7eff738d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:55.006290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f6844-35b3-4e86-a68c-39318e6b8d02 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:55.008181 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 96/195] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:00:54 2022] GET /identity/v3/projects/8b5c4caaad3540288517a0fd7eff738d => generated 302 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:00:55.009444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5ddab-8215-466d-9b5c-eb54260d099b None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:55.009718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5ddab-8215-466d-9b5c-eb54260d099b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:55.009995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5ddab-8215-466d-9b5c-eb54260d099b None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:55.011223 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 97/196] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:55.013705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5ddab-8215-466d-9b5c-eb54260d099b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:55.038065 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 100/197] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 27 03:00:54 2022] POST /identity/v3/users => generated 293 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:00:55.038065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e926f-e71e-40ea-83c2-19192dcc2c40 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:55.038065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e926f-e71e-40ea-83c2-19192dcc2c40 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:55.038065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e926f-e71e-40ea-83c2-19192dcc2c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:55.056684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d07e926f-e71e-40ea-83c2-19192dcc2c40 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:55.058053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d07e926f-e71e-40ea-83c2-19192dcc2c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:55.101850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:55.127476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5ddab-8215-466d-9b5c-eb54260d099b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:55.135157 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 101/198] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:55.167134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72394e-56e9-4fef-9312-8e27707f1e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:55.167825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72394e-56e9-4fef-9312-8e27707f1e31 None admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:55.168103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72394e-56e9-4fef-9312-8e27707f1e31 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:55.168385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72394e-56e9-4fef-9312-8e27707f1e31 None admin] PATH_INFO: `/v3/projects/8b5c4caaad3540288517a0fd7eff738d/users/cdf801c201fd4240ba1345a3a241d822/roles/e93dce408a514f8fb8a572d381e51045` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:55.170525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72394e-56e9-4fef-9312-8e27707f1e31 None admin] RBAC: Authorizing `identity:create_grant(project_id=8b5c4caaad3540288517a0fd7eff738d, user_id=cdf801c201fd4240ba1345a3a241d822, role_id=e93dce408a514f8fb8a572d381e51045)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:55.171987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72394e-56e9-4fef-9312-8e27707f1e31 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:55.251950 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 98/199] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:00:55 2022] PUT /identity/v3/projects/8b5c4caaad3540288517a0fd7eff738d/users/cdf801c201fd4240ba1345a3a241d822/roles/e93dce408a514f8fb8a572d381e51045 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:00:55.405161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e926f-e71e-40ea-83c2-19192dcc2c40 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:55.511032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e926f-e71e-40ea-83c2-19192dcc2c40 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:55.547691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f291e-90f9-4395-874b-fbefb259912f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:55.548329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f291e-90f9-4395-874b-fbefb259912f None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:55.548614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f291e-90f9-4395-874b-fbefb259912f None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:55.548890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f291e-90f9-4395-874b-fbefb259912f None admin] PATH_INFO: `/v3/roles/member` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:55.560251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f291e-90f9-4395-874b-fbefb259912f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:00:55.565130 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-e94f291e-90f9-4395-874b-fbefb259912f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:00:55.565130 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:55.565130 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:00:55.565130 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:00:55.565130 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:00:55.565130 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:00:55.565130 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:00:55.565130 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:00:55.565130 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:00:55.565130 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:00:55.565130 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:00:55.565130 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:00:55.565130 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:00:55.565130 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:00:55.565130 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:00:55.565130 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:00:55.566013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:00:55.566013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:00:55.566013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:00:55.566013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:00:55.566013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:55.566013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:55.566013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:00:55.566013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:00:55.566013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:00:55.566013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:00:55.566013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:00:55.566013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:00:55.566013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:00:55.566013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:00:55.566013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:00:55.566013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:00:55.567123 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:00:55.567123 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:00:55.567123 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:00:55.567123 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:00:55.567123 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:00:55.567123 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:00:55.567123 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:00:55.567123 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:00:55.567123 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:00:55.567123 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:00:55.567123 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:00:55.567123 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:00:55.567123 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 102/200] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:00:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:00:55.572120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72394e-56e9-4fef-9312-8e27707f1e31 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:55.587585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:55.676527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72394e-56e9-4fef-9312-8e27707f1e31 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:55.711285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31e1fd-a64d-455e-a0e9-bfd0d3045933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:55.712170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31e1fd-a64d-455e-a0e9-bfd0d3045933 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:55.713124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31e1fd-a64d-455e-a0e9-bfd0d3045933 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:55.713539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31e1fd-a64d-455e-a0e9-bfd0d3045933 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:55.714387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31e1fd-a64d-455e-a0e9-bfd0d3045933 None admin] RBAC: Adding query filter params (name=member) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:55.714701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31e1fd-a64d-455e-a0e9-bfd0d3045933 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:55.716082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31e1fd-a64d-455e-a0e9-bfd0d3045933 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:55.730422 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 99/201] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 27 03:00:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:00:55.736109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f291e-90f9-4395-874b-fbefb259912f None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:55.771495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:55.841247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f291e-90f9-4395-874b-fbefb259912f None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:55.878652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86c645-1893-4373-be9f-20a30cf9d6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:55.879657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86c645-1893-4373-be9f-20a30cf9d6f2 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:55.880159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86c645-1893-4373-be9f-20a30cf9d6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:55.880631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86c645-1893-4373-be9f-20a30cf9d6f2 None admin] PATH_INFO: `/v3/users/cd5fcc7ed0404897a0c97eb9e94f4e24` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:55.881977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86c645-1893-4373-be9f-20a30cf9d6f2 None admin] RBAC: Authorizing `identity:get_user(user_id=cd5fcc7ed0404897a0c97eb9e94f4e24)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:55.883933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86c645-1893-4373-be9f-20a30cf9d6f2 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:55.886100 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 103/202] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:00:55 2022] GET /identity/v3/users/cd5fcc7ed0404897a0c97eb9e94f4e24 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:55.891260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31e1fd-a64d-455e-a0e9-bfd0d3045933 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:55.972840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:55.999033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31e1fd-a64d-455e-a0e9-bfd0d3045933 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:56.034539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532db51f-fb74-4dae-9a45-2d4370a7408b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:56.035177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532db51f-fb74-4dae-9a45-2d4370a7408b None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:56.035461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532db51f-fb74-4dae-9a45-2d4370a7408b None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:56.035735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532db51f-fb74-4dae-9a45-2d4370a7408b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:56.106331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532db51f-fb74-4dae-9a45-2d4370a7408b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:56.107813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532db51f-fb74-4dae-9a45-2d4370a7408b None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:56.208290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:56.234501 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 100/203] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:00:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 27 03:00:56.239662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86c645-1893-4373-be9f-20a30cf9d6f2 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:56.343865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86c645-1893-4373-be9f-20a30cf9d6f2 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:56.345490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:56.379467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03700a-da71-4724-b37a-9238dbb3a90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:56.380149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03700a-da71-4724-b37a-9238dbb3a90a None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:56.380436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03700a-da71-4724-b37a-9238dbb3a90a None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:56.380713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03700a-da71-4724-b37a-9238dbb3a90a None admin] PATH_INFO: `/v3/projects/8b5c4caaad3540288517a0fd7eff738d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:56.381841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03700a-da71-4724-b37a-9238dbb3a90a None admin] RBAC: Authorizing `identity:get_project(project_id=8b5c4caaad3540288517a0fd7eff738d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:56.383648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03700a-da71-4724-b37a-9238dbb3a90a None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:56.390441 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 104/204] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:00:56 2022] GET /identity/v3/projects/8b5c4caaad3540288517a0fd7eff738d => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:56.391973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532db51f-fb74-4dae-9a45-2d4370a7408b None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:56.492402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532db51f-fb74-4dae-9a45-2d4370a7408b None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:56.528128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75676185-d1c0-4a9b-b91d-39bd41349029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:56.528743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75676185-d1c0-4a9b-b91d-39bd41349029 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:56.529026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75676185-d1c0-4a9b-b91d-39bd41349029 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:56.529301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75676185-d1c0-4a9b-b91d-39bd41349029 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:56.530048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75676185-d1c0-4a9b-b91d-39bd41349029 None admin] RBAC: Adding query filter params (role.id=17fff77450b94933a5d232fb3f3221b7, scope.project.id=8b5c4caaad3540288517a0fd7eff738d, user.id=cd5fcc7ed0404897a0c97eb9e94f4e24) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:56.530426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75676185-d1c0-4a9b-b91d-39bd41349029 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:56.531943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75676185-d1c0-4a9b-b91d-39bd41349029 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:56.538180 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 101/205] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:00:56 2022] GET /identity/v3/role_assignments?user.id=cd5fcc7ed0404897a0c97eb9e94f4e24&scope.project.id=8b5c4caaad3540288517a0fd7eff738d&role.id=17fff77450b94933a5d232fb3f3221b7 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:00:57.334024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edae15-315a-492c-9160-a805f2310abb None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:57.334024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edae15-315a-492c-9160-a805f2310abb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:57.334024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edae15-315a-492c-9160-a805f2310abb None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:57.337098 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 105/206] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:57.343147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaab5b5-f2ec-4792-a666-3af2ff92263d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:57.343649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaab5b5-f2ec-4792-a666-3af2ff92263d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:57.343743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaab5b5-f2ec-4792-a666-3af2ff92263d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:57.363305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-efaab5b5-f2ec-4792-a666-3af2ff92263d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:57.364580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-efaab5b5-f2ec-4792-a666-3af2ff92263d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:57.398534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:57.435085 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 102/207] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:57.458310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59686e1c-7574-43f8-9117-f0f6bb5a4173 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:57.458592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59686e1c-7574-43f8-9117-f0f6bb5a4173 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:57.458869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59686e1c-7574-43f8-9117-f0f6bb5a4173 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:57.460420 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 106/208] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:00:57.465417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c73ff-0922-42ae-99d4-6c770e78f1d2 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:57.465704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c73ff-0922-42ae-99d4-6c770e78f1d2 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:57.465974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c73ff-0922-42ae-99d4-6c770e78f1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:57.483642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8d4c73ff-0922-42ae-99d4-6c770e78f1d2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:57.484820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8d4c73ff-0922-42ae-99d4-6c770e78f1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:57.487445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67dac0-4e78-44b8-9b70-c3aa44885cc6 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:57.487743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67dac0-4e78-44b8-9b70-c3aa44885cc6 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:57.488025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67dac0-4e78-44b8-9b70-c3aa44885cc6 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:57.489368 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 107/209] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:00:57.494668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae43c1b-b519-421a-958d-d76548cbefa7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:57.494955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae43c1b-b519-421a-958d-d76548cbefa7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:57.495230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae43c1b-b519-421a-958d-d76548cbefa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:57.514666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-cae43c1b-b519-421a-958d-d76548cbefa7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:00:57.515864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cae43c1b-b519-421a-958d-d76548cbefa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:00:57.551275 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 103/210] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:00:57.582754 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 108/211] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 03:00:57.703573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c73ff-0922-42ae-99d4-6c770e78f1d2 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:57.798143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:57.802050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c73ff-0922-42ae-99d4-6c770e78f1d2 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:57.820041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae43c1b-b519-421a-958d-d76548cbefa7 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:57.840137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd86f3b-120b-46e9-a697-82b4b2e1987b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:57.840779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd86f3b-120b-46e9-a697-82b4b2e1987b None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:57.841064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd86f3b-120b-46e9-a697-82b4b2e1987b None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:57.841342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd86f3b-120b-46e9-a697-82b4b2e1987b None admin] PATH_INFO: `/v3/roles/member` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:57.852157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd86f3b-120b-46e9-a697-82b4b2e1987b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:00:57.857572 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-dfd86f3b-120b-46e9-a697-82b4b2e1987b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:00:57.857572 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:57.857572 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:00:57.857572 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:00:57.857572 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:00:57.857572 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:00:57.857572 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:00:57.857572 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:00:57.857572 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:00:57.857572 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:00:57.857572 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:00:57.857572 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:00:57.857572 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:00:57.857572 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:00:57.857572 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:00:57.857572 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:00:57.858551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:00:57.858551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:00:57.858551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:00:57.858551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:00:57.858551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:57.858551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:57.858551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:00:57.858551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:00:57.858551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:00:57.858551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:00:57.858551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:00:57.858551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:00:57.858551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:00:57.858551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:00:57.858551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:00:57.858551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:00:57.859327 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:00:57.859327 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:00:57.859327 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:00:57.859327 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:00:57.859327 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:00:57.859327 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:00:57.859327 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:00:57.859327 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:00:57.859327 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:00:57.859327 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:00:57.859327 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:00:57.859327 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:00:57.859327 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 104/212] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:00:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:00:57.862886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd86f3b-120b-46e9-a697-82b4b2e1987b None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:57.921643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:57.924447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae43c1b-b519-421a-958d-d76548cbefa7 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:57.957256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c235315-5895-4f60-84b9-029ad3bec35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:57.957880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c235315-5895-4f60-84b9-029ad3bec35c None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:57.958201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c235315-5895-4f60-84b9-029ad3bec35c None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:57.958476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c235315-5895-4f60-84b9-029ad3bec35c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:57.962997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd86f3b-120b-46e9-a697-82b4b2e1987b None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:57.968720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c235315-5895-4f60-84b9-029ad3bec35c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:00:57.973461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-4c235315-5895-4f60-84b9-029ad3bec35c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 03:00:57.973461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:00:57.973461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:00:57.973461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:00:57.973461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:00:57.973461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:00:57.973461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:00:57.973461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:00:57.973461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:00:57.973461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:00:57.973461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:00:57.973461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:00:57.973461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:00:57.973461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:00:57.973461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:00:57.973461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:00:57.974474 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:00:57.974474 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:00:57.974474 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:00:57.974474 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:00:57.974474 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:00:57.974474 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:00:57.974474 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:00:57.974474 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:00:57.974474 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:00:57.974474 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:00:57.974474 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:00:57.974474 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:00:57.974474 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:00:57.974474 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:00:57.974474 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:00:57.974474 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:00:57.975268 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:00:57.975268 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:00:57.975268 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:00:57.975268 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:00:57.975268 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:00:57.975268 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:00:57.975268 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:00:57.975268 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:00:57.975268 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:00:57.975268 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:00:57.975268 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 03:00:57.975268 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:00:57.975268 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 109/213] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:00:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:00:57.975934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c235315-5895-4f60-84b9-029ad3bec35c None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:58.001331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399ee2a-0f8c-4912-9d29-018e5285cd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:58.002247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399ee2a-0f8c-4912-9d29-018e5285cd8a None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:58.002529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399ee2a-0f8c-4912-9d29-018e5285cd8a None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:58.002807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399ee2a-0f8c-4912-9d29-018e5285cd8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:58.003943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399ee2a-0f8c-4912-9d29-018e5285cd8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:58.005385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399ee2a-0f8c-4912-9d29-018e5285cd8a None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:58.007087 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 105/214] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:00:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:58.008048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399ee2a-0f8c-4912-9d29-018e5285cd8a None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:58.035266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:58.079707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c235315-5895-4f60-84b9-029ad3bec35c None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:58.105633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399ee2a-0f8c-4912-9d29-018e5285cd8a None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:58.112802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb2a8d-91b9-4d67-95aa-ee07b01ab799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:58.113407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb2a8d-91b9-4d67-95aa-ee07b01ab799 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:58.113691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb2a8d-91b9-4d67-95aa-ee07b01ab799 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:58.113985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb2a8d-91b9-4d67-95aa-ee07b01ab799 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:58.114678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb2a8d-91b9-4d67-95aa-ee07b01ab799 None admin] RBAC: Adding query filter params (name=member) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:58.114981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb2a8d-91b9-4d67-95aa-ee07b01ab799 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:58.116425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb2a8d-91b9-4d67-95aa-ee07b01ab799 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:58.124233 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 110/215] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 27 03:00:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:58.126870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb2a8d-91b9-4d67-95aa-ee07b01ab799 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:58.138090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d16e0e-895b-4cee-9554-8b755f566941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:58.138704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d16e0e-895b-4cee-9554-8b755f566941 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:58.138989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d16e0e-895b-4cee-9554-8b755f566941 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:58.139268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d16e0e-895b-4cee-9554-8b755f566941 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:58.139936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d16e0e-895b-4cee-9554-8b755f566941 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:58.140245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d16e0e-895b-4cee-9554-8b755f566941 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:58.141613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d16e0e-895b-4cee-9554-8b755f566941 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:58.150614 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 106/216] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 27 03:00:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:58.151223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:58.151334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d16e0e-895b-4cee-9554-8b755f566941 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:58.227623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb2a8d-91b9-4d67-95aa-ee07b01ab799 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:58.240962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:58.252276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d16e0e-895b-4cee-9554-8b755f566941 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:58.261041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f54ec4-0ce8-4ada-8f43-3db5f181ca35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:58.261645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f54ec4-0ce8-4ada-8f43-3db5f181ca35 None admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:58.261945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f54ec4-0ce8-4ada-8f43-3db5f181ca35 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:58.262228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f54ec4-0ce8-4ada-8f43-3db5f181ca35 None admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:58.262869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f54ec4-0ce8-4ada-8f43-3db5f181ca35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:58.264306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f54ec4-0ce8-4ada-8f43-3db5f181ca35 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:58.286497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086dd57-dfaa-4092-a769-cbc60494438f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:58.287120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086dd57-dfaa-4092-a769-cbc60494438f None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:58.287399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086dd57-dfaa-4092-a769-cbc60494438f None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:58.287670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086dd57-dfaa-4092-a769-cbc60494438f None admin] PATH_INFO: `/v3/users/dbac280a83744ccf94fa8ee46d1e0ec8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:58.300376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086dd57-dfaa-4092-a769-cbc60494438f None admin] RBAC: Authorizing `identity:get_user(user_id=dbac280a83744ccf94fa8ee46d1e0ec8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:58.301804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086dd57-dfaa-4092-a769-cbc60494438f None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:58.303424 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 107/217] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:00:58 2022] GET /identity/v3/users/dbac280a83744ccf94fa8ee46d1e0ec8 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:58.304190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086dd57-dfaa-4092-a769-cbc60494438f None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:58.365449 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 111/218] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 27 03:00:58 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:00:58.366251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f54ec4-0ce8-4ada-8f43-3db5f181ca35 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:58.422926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086dd57-dfaa-4092-a769-cbc60494438f None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:58.452791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:58.464531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad04630-c76b-4e9a-97aa-e4bbafcc3b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:58.465338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad04630-c76b-4e9a-97aa-e4bbafcc3b34 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:58.465522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad04630-c76b-4e9a-97aa-e4bbafcc3b34 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:58.465797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad04630-c76b-4e9a-97aa-e4bbafcc3b34 None admin] PATH_INFO: `/v3/users/cdf801c201fd4240ba1345a3a241d822` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:58.467169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad04630-c76b-4e9a-97aa-e4bbafcc3b34 None admin] RBAC: Authorizing `identity:get_user(user_id=cdf801c201fd4240ba1345a3a241d822)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:58.468671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad04630-c76b-4e9a-97aa-e4bbafcc3b34 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:58.470345 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 108/219] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:00:58 2022] GET /identity/v3/users/cdf801c201fd4240ba1345a3a241d822 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:58.475940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad04630-c76b-4e9a-97aa-e4bbafcc3b34 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:58.481254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f54ec4-0ce8-4ada-8f43-3db5f181ca35 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:58.494105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:58.519348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e38de-4fe8-4fa9-8c94-eabc21f03973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:58.519975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e38de-4fe8-4fa9-8c94-eabc21f03973 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:58.520255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e38de-4fe8-4fa9-8c94-eabc21f03973 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:58.520526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e38de-4fe8-4fa9-8c94-eabc21f03973 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:58.521280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e38de-4fe8-4fa9-8c94-eabc21f03973 None admin] RBAC: Adding query filter params (role.id=17fff77450b94933a5d232fb3f3221b7, user.id=dbac280a83744ccf94fa8ee46d1e0ec8, scope.system=all) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:58.521588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e38de-4fe8-4fa9-8c94-eabc21f03973 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:58.523096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e38de-4fe8-4fa9-8c94-eabc21f03973 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:58.538281 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 112/220] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Oct 27 03:00:58 2022] GET /identity/v3/role_assignments?user.id=dbac280a83744ccf94fa8ee46d1e0ec8&scope.system=all&role.id=17fff77450b94933a5d232fb3f3221b7 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:58.590944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad04630-c76b-4e9a-97aa-e4bbafcc3b34 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:58.629699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0511d-3197-499a-982c-e5ff564e3ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:58.630278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0511d-3197-499a-982c-e5ff564e3ef8 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:58.630565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0511d-3197-499a-982c-e5ff564e3ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:58.630918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0511d-3197-499a-982c-e5ff564e3ef8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:58.711450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0511d-3197-499a-982c-e5ff564e3ef8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:58.713310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0511d-3197-499a-982c-e5ff564e3ef8 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:58.731975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:58.818098 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 109/221] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:00:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 03:00:58.824354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e38de-4fe8-4fa9-8c94-eabc21f03973 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:58.929228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e38de-4fe8-4fa9-8c94-eabc21f03973 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:58.968646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3628c1-dcd6-46e0-9298-9c2123df8b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:58.969298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3628c1-dcd6-46e0-9298-9c2123df8b21 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:58.969580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3628c1-dcd6-46e0-9298-9c2123df8b21 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:58.969854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3628c1-dcd6-46e0-9298-9c2123df8b21 None admin] PATH_INFO: `/v3/projects/8b5c4caaad3540288517a0fd7eff738d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:58.971177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3628c1-dcd6-46e0-9298-9c2123df8b21 None admin] RBAC: Authorizing `identity:get_project(project_id=8b5c4caaad3540288517a0fd7eff738d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:58.972636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3628c1-dcd6-46e0-9298-9c2123df8b21 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:58.974351 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 113/222] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:00:58 2022] GET /identity/v3/projects/8b5c4caaad3540288517a0fd7eff738d => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:00:58.980752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0511d-3197-499a-982c-e5ff564e3ef8 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:00:59.085766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0511d-3197-499a-982c-e5ff564e3ef8 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:00:59.099647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:00:59.120984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4f374-2f0e-4899-9117-968a14af9d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:00:59.121653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4f374-2f0e-4899-9117-968a14af9d96 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:00:59.121939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4f374-2f0e-4899-9117-968a14af9d96 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:00:59.122242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4f374-2f0e-4899-9117-968a14af9d96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:00:59.122993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4f374-2f0e-4899-9117-968a14af9d96 None admin] RBAC: Adding query filter params (role.id=e93dce408a514f8fb8a572d381e51045, scope.project.id=8b5c4caaad3540288517a0fd7eff738d, user.id=cdf801c201fd4240ba1345a3a241d822) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:00:59.123303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4f374-2f0e-4899-9117-968a14af9d96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:00:59.124828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4f374-2f0e-4899-9117-968a14af9d96 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:00:59.132477 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 110/223] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:00:58 2022] GET /identity/v3/role_assignments?user.id=cdf801c201fd4240ba1345a3a241d822&scope.project.id=8b5c4caaad3540288517a0fd7eff738d&role.id=e93dce408a514f8fb8a572d381e51045 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:00.710624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768221fd-d269-49ca-9cc2-282f5a125e95 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:00.711172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768221fd-d269-49ca-9cc2-282f5a125e95 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:00.711172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768221fd-d269-49ca-9cc2-282f5a125e95 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:00.712822 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 114/224] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:00.718620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f43b9-b55f-460c-a475-0159cc17225e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:00.719249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f43b9-b55f-460c-a475-0159cc17225e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:00.719249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f43b9-b55f-460c-a475-0159cc17225e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:00.725264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43846430-5986-4cc1-a60c-944c3706b791 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:00.725556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43846430-5986-4cc1-a60c-944c3706b791 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:00.725824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43846430-5986-4cc1-a60c-944c3706b791 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:00.727436 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 115/225] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:01:00.733604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afbffd-3f31-486f-98da-b24a011e3d19 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:00.733883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afbffd-3f31-486f-98da-b24a011e3d19 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:00.734217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afbffd-3f31-486f-98da-b24a011e3d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:00.740579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-012f43b9-b55f-460c-a475-0159cc17225e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:00.742075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-012f43b9-b55f-460c-a475-0159cc17225e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:00.753325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-45afbffd-3f31-486f-98da-b24a011e3d19 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:00.754605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-45afbffd-3f31-486f-98da-b24a011e3d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:00.758305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:00.810997 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 111/226] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:00.823255 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 116/227] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 03:01:00.837512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa18d8-3148-4b82-8c83-59da7a9c2839 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:00.837798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa18d8-3148-4b82-8c83-59da7a9c2839 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:00.838105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa18d8-3148-4b82-8c83-59da7a9c2839 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:00.839458 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 112/228] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:01:00.844537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ed5d6-ce07-4b2e-bf1d-12ab71619a1f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:00.844830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ed5d6-ce07-4b2e-bf1d-12ab71619a1f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:00.845112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ed5d6-ce07-4b2e-bf1d-12ab71619a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:00.863200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d91ed5d6-ce07-4b2e-bf1d-12ab71619a1f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:00.864383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d91ed5d6-ce07-4b2e-bf1d-12ab71619a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:00.929527 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 117/229] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:01.085437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa18d8-3148-4b82-8c83-59da7a9c2839 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:01.090710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ed5d6-ce07-4b2e-bf1d-12ab71619a1f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:01.160006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:01.192222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ed5d6-ce07-4b2e-bf1d-12ab71619a1f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:01.198325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa18d8-3148-4b82-8c83-59da7a9c2839 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:01.207972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:01.227222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4be216-8d34-41f2-b0f5-6af150d95ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:01.228488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4be216-8d34-41f2-b0f5-6af150d95ad8 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:01.228763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4be216-8d34-41f2-b0f5-6af150d95ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:01.229030 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4be216-8d34-41f2-b0f5-6af150d95ad8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:01.232816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac349aa-6138-4927-a81d-7235c90d6725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:01.233451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac349aa-6138-4927-a81d-7235c90d6725 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:01.233730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac349aa-6138-4927-a81d-7235c90d6725 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:01.234002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac349aa-6138-4927-a81d-7235c90d6725 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:01.239032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4be216-8d34-41f2-b0f5-6af150d95ad8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:01.244017 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-8c4be216-8d34-41f2-b0f5-6af150d95ad8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 03:01:01.244017 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:01.244017 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:01.244017 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:01.244017 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:01.244017 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:01.244017 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:01.244017 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:01.244017 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:01.244017 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:01.244017 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:01.244017 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:01.244017 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:01.244017 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:01.244017 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:01.244017 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:01.245014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:01.245014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:01.245014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:01.245014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:01.245014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:01.245014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:01.245014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:01.245014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:01.245014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:01.245014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:01.245014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:01.245014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:01.245014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:01.245014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:01.245014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:01.245014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:01.245800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:01.245800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:01.245800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:01.245800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:01.245800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:01.245800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:01.245800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:01.245800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:01.245800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:01.245800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:01.245800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 03:01:01.245800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:01.245800 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 118/230] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:01:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:01:01.246480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac349aa-6138-4927-a81d-7235c90d6725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:01.246548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4be216-8d34-41f2-b0f5-6af150d95ad8 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:01.250742 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-2ac349aa-6138-4927-a81d-7235c90d6725 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:01:01.250742 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:01.250742 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:01.250742 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:01.250742 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:01.250742 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:01.250742 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:01.250742 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:01.250742 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:01.250742 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:01.250742 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:01.250742 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:01.250742 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:01.250742 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:01.250742 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:01.250742 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:01.251776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:01.251776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:01.251776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:01.251776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:01.251776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:01.251776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:01.251776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:01.251776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:01.251776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:01.251776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:01.251776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:01.251776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:01.251776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:01.251776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:01.251776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:01.251776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:01.253563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:01.253563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:01.253563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:01.253563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:01.253563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:01.253563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:01.253563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:01.253563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:01.253563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:01.253563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:01.253563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:01:01.253563 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:01.253563 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 113/231] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:01:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:01.253563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac349aa-6138-4927-a81d-7235c90d6725 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:01.384954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac349aa-6138-4927-a81d-7235c90d6725 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:01.417296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc639ae-1038-4c6d-ab5b-d147095bb701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:01.417895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc639ae-1038-4c6d-ab5b-d147095bb701 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:01.418209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc639ae-1038-4c6d-ab5b-d147095bb701 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:01.418486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc639ae-1038-4c6d-ab5b-d147095bb701 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:01.419147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc639ae-1038-4c6d-ab5b-d147095bb701 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:01.419452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc639ae-1038-4c6d-ab5b-d147095bb701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:01.419950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4be216-8d34-41f2-b0f5-6af150d95ad8 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:01.420826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc639ae-1038-4c6d-ab5b-d147095bb701 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:01.428765 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 114/232] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 27 03:01:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:01.429456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc639ae-1038-4c6d-ab5b-d147095bb701 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:01.448330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:01.453601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad24aa9-ca86-4299-afe6-7f121e340c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:01.454263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad24aa9-ca86-4299-afe6-7f121e340c67 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:01.454545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad24aa9-ca86-4299-afe6-7f121e340c67 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:01.454901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad24aa9-ca86-4299-afe6-7f121e340c67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:01.455916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad24aa9-ca86-4299-afe6-7f121e340c67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:01.457396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad24aa9-ca86-4299-afe6-7f121e340c67 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:01.459023 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 119/233] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:01.459795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad24aa9-ca86-4299-afe6-7f121e340c67 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:01.460805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:01.530360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc639ae-1038-4c6d-ab5b-d147095bb701 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:01.558048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad24aa9-ca86-4299-afe6-7f121e340c67 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:01.563888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fc59c-65b6-4eac-8c39-e5d04f8b2b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:01.564492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fc59c-65b6-4eac-8c39-e5d04f8b2b6a None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:01.565167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fc59c-65b6-4eac-8c39-e5d04f8b2b6a None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:01.565446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fc59c-65b6-4eac-8c39-e5d04f8b2b6a None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:01.566140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fc59c-65b6-4eac-8c39-e5d04f8b2b6a None admin] RBAC: Adding query filter params (name=member) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:01.566453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fc59c-65b6-4eac-8c39-e5d04f8b2b6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:01.567824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fc59c-65b6-4eac-8c39-e5d04f8b2b6a None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:01.576355 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 115/234] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 27 03:01:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:01.577108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fc59c-65b6-4eac-8c39-e5d04f8b2b6a None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:01.595680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85888939-5e2c-43e6-a68b-e617092c9195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:01.596308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85888939-5e2c-43e6-a68b-e617092c9195 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:01.596589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85888939-5e2c-43e6-a68b-e617092c9195 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:01.596863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85888939-5e2c-43e6-a68b-e617092c9195 None admin] PATH_INFO: `/v3/users/a04bd32c022342498a693b563054488b` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:01.610214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85888939-5e2c-43e6-a68b-e617092c9195 None admin] RBAC: Authorizing `identity:get_user(user_id=a04bd32c022342498a693b563054488b)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:01.611667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85888939-5e2c-43e6-a68b-e617092c9195 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:01.613409 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 120/235] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:01:01 2022] GET /identity/v3/users/a04bd32c022342498a693b563054488b => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:01.614015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85888939-5e2c-43e6-a68b-e617092c9195 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:01.667453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:01.669049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:01.677425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fc59c-65b6-4eac-8c39-e5d04f8b2b6a None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:01.709446 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85888939-5e2c-43e6-a68b-e617092c9195 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:01.710846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b716fd6-e538-4cae-8b22-6103e9b2c9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:01.711364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b716fd6-e538-4cae-8b22-6103e9b2c9d8 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:01.711652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b716fd6-e538-4cae-8b22-6103e9b2c9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:01.711920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b716fd6-e538-4cae-8b22-6103e9b2c9d8 None admin] PATH_INFO: `/v3/groups` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:01.712569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b716fd6-e538-4cae-8b22-6103e9b2c9d8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:01.713990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b716fd6-e538-4cae-8b22-6103e9b2c9d8 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:01.741800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ec05a-3853-4ae1-aceb-a323a1b99428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:01.742458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ec05a-3853-4ae1-aceb-a323a1b99428 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:01.742739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ec05a-3853-4ae1-aceb-a323a1b99428 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:01.743013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ec05a-3853-4ae1-aceb-a323a1b99428 None admin] PATH_INFO: `/v3/users/dbac280a83744ccf94fa8ee46d1e0ec8` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:01.744718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ec05a-3853-4ae1-aceb-a323a1b99428 None admin] RBAC: Authorizing `identity:get_user(user_id=dbac280a83744ccf94fa8ee46d1e0ec8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:01.746184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ec05a-3853-4ae1-aceb-a323a1b99428 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:01.747749 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 121/236] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:01:01 2022] GET /identity/v3/users/dbac280a83744ccf94fa8ee46d1e0ec8 => generated 293 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:01.748506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ec05a-3853-4ae1-aceb-a323a1b99428 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:01.811385 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 116/237] 10.222.0.20 () {60 vars in 1134 bytes} [Thu Oct 27 03:01:01 2022] POST /identity/v3/groups => generated 229 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:01:01.812234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b716fd6-e538-4cae-8b22-6103e9b2c9d8 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:01.847422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ec05a-3853-4ae1-aceb-a323a1b99428 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:01.884002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cf59b-fa4a-4af5-9133-e579fe1edc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:01.885149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cf59b-fa4a-4af5-9133-e579fe1edc53 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:01.885432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cf59b-fa4a-4af5-9133-e579fe1edc53 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:01.885714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cf59b-fa4a-4af5-9133-e579fe1edc53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:01.886500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470cf59b-fa4a-4af5-9133-e579fe1edc53 None admin] RBAC: Adding query filter params (role.id=e93dce408a514f8fb8a572d381e51045, user.id=a04bd32c022342498a693b563054488b, scope.system=all) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:01.886813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470cf59b-fa4a-4af5-9133-e579fe1edc53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:01.888307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470cf59b-fa4a-4af5-9133-e579fe1edc53 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:01.893715 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 122/238] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Oct 27 03:01:01 2022] GET /identity/v3/role_assignments?user.id=a04bd32c022342498a693b563054488b&scope.system=all&role.id=e93dce408a514f8fb8a572d381e51045 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:01.894380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:01.934959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b716fd6-e538-4cae-8b22-6103e9b2c9d8 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:01.973661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a436f92-cd06-473e-b849-1bcb360a93d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:01.974380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a436f92-cd06-473e-b849-1bcb360a93d5 None admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:01.974663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a436f92-cd06-473e-b849-1bcb360a93d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:01.974987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a436f92-cd06-473e-b849-1bcb360a93d5 None admin] PATH_INFO: `/v3/system/users/dbac280a83744ccf94fa8ee46d1e0ec8/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:01.976619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a436f92-cd06-473e-b849-1bcb360a93d5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dbac280a83744ccf94fa8ee46d1e0ec8, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:01.978118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a436f92-cd06-473e-b849-1bcb360a93d5 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:02.104091 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 117/239] 10.222.0.20 () {58 vars in 1334 bytes} [Thu Oct 27 03:01:01 2022] PUT /identity/v3/system/users/dbac280a83744ccf94fa8ee46d1e0ec8/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:01:04.023001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2364fa-d4a6-47f5-9363-598274ee4218 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:04.023511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2364fa-d4a6-47f5-9363-598274ee4218 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:04.023584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2364fa-d4a6-47f5-9363-598274ee4218 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:04.025508 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 123/240] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:04.030660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf9540-3e12-4bc5-8624-8f30b59552cb None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:04.031038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf9540-3e12-4bc5-8624-8f30b59552cb None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:04.031221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf9540-3e12-4bc5-8624-8f30b59552cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:04.047045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c8f08-514e-4ebe-975b-25f8cbc15e0c None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:04.047337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c8f08-514e-4ebe-975b-25f8cbc15e0c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:04.047610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c8f08-514e-4ebe-975b-25f8cbc15e0c None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:04.048974 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 124/241] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:01:04.050185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f5bf9540-3e12-4bc5-8624-8f30b59552cb None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:04.051395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f5bf9540-3e12-4bc5-8624-8f30b59552cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:04.053865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93959384-082d-4df3-a154-6cacc4ece9d6 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:04.054196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93959384-082d-4df3-a154-6cacc4ece9d6 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:04.054475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93959384-082d-4df3-a154-6cacc4ece9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:04.062607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:04.074207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-93959384-082d-4df3-a154-6cacc4ece9d6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:04.075420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-93959384-082d-4df3-a154-6cacc4ece9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:04.122359 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 118/242] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:04.152944 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 125/243] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 03:01:04.233055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212839e-48af-4f27-b66a-7a3eccde6c0b None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:04.233339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212839e-48af-4f27-b66a-7a3eccde6c0b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:04.233616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212839e-48af-4f27-b66a-7a3eccde6c0b None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:04.235035 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 119/244] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:04.240385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a03554-1dd0-4eef-84c1-4b3344db787b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:04.240677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a03554-1dd0-4eef-84c1-4b3344db787b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:04.240957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a03554-1dd0-4eef-84c1-4b3344db787b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:04.260634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b3a03554-1dd0-4eef-84c1-4b3344db787b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:04.261838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b3a03554-1dd0-4eef-84c1-4b3344db787b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:04.330355 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 126/245] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:04.396839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212839e-48af-4f27-b66a-7a3eccde6c0b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:04.419801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a03554-1dd0-4eef-84c1-4b3344db787b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:04.469650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:04.509295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212839e-48af-4f27-b66a-7a3eccde6c0b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:04.521546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a03554-1dd0-4eef-84c1-4b3344db787b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:04.544470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c35f9-6072-46bc-a55c-49e812658a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:04.545218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c35f9-6072-46bc-a55c-49e812658a0e None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:04.545502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c35f9-6072-46bc-a55c-49e812658a0e None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:04.545892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c35f9-6072-46bc-a55c-49e812658a0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:04.547036 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c35f9-6072-46bc-a55c-49e812658a0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:04.548726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c35f9-6072-46bc-a55c-49e812658a0e None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:04.550352 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 120/246] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:04.555619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c35f9-6072-46bc-a55c-49e812658a0e None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:04.557598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53624add-b615-4c69-9c49-f4a088995ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:04.558258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53624add-b615-4c69-9c49-f4a088995ff5 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:04.558534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53624add-b615-4c69-9c49-f4a088995ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:04.558802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53624add-b615-4c69-9c49-f4a088995ff5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:04.568743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53624add-b615-4c69-9c49-f4a088995ff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:04.573662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:04.574664 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-53624add-b615-4c69-9c49-f4a088995ff5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 03:01:04.574664 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:04.574664 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:04.574664 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:04.574664 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:04.574664 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:04.574664 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:04.574664 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:04.574664 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:04.574664 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:04.574664 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:04.574664 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:04.574664 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:04.574664 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:04.574664 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:04.574664 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:04.575714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:04.575714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:04.575714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:04.575714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:04.575714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:04.575714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:04.575714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:04.575714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:04.575714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:04.575714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:04.575714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:04.575714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:04.575714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:04.575714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:04.575714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:04.575714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:04.576522 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:04.576522 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:04.576522 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:04.576522 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:04.576522 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:04.576522 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:04.576522 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:04.576522 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:04.576522 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:04.576522 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:04.576522 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 03:01:04.576522 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:04.576522 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 127/247] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:01:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:01:04.583675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53624add-b615-4c69-9c49-f4a088995ff5 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:04.663021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c35f9-6072-46bc-a55c-49e812658a0e None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:04.678908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53624add-b615-4c69-9c49-f4a088995ff5 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:04.688400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:04.695872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953e59c-ed9b-4065-a79b-10216bb7ab57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:04.697053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953e59c-ed9b-4065-a79b-10216bb7ab57 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:04.697339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953e59c-ed9b-4065-a79b-10216bb7ab57 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:04.698078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953e59c-ed9b-4065-a79b-10216bb7ab57 None admin] PATH_INFO: `/v3/groups` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:04.698261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953e59c-ed9b-4065-a79b-10216bb7ab57 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:04.699724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953e59c-ed9b-4065-a79b-10216bb7ab57 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:04.713014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456147d0-e544-41ca-9f6b-641183de2eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:04.713617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456147d0-e544-41ca-9f6b-641183de2eb7 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:04.713897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456147d0-e544-41ca-9f6b-641183de2eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:04.714207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456147d0-e544-41ca-9f6b-641183de2eb7 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:04.714873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456147d0-e544-41ca-9f6b-641183de2eb7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:04.715179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456147d0-e544-41ca-9f6b-641183de2eb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:04.716650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456147d0-e544-41ca-9f6b-641183de2eb7 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:04.725105 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 128/248] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 27 03:01:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:01:04.726000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456147d0-e544-41ca-9f6b-641183de2eb7 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:04.785006 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 121/249] 10.222.0.20 () {60 vars in 1134 bytes} [Thu Oct 27 03:01:04 2022] POST /identity/v3/groups => generated 226 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:01:04.785904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953e59c-ed9b-4065-a79b-10216bb7ab57 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:04.840036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456147d0-e544-41ca-9f6b-641183de2eb7 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:04.872878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:04.881589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d483788-40e4-4599-8df6-b0add9cd3930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:04.882351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d483788-40e4-4599-8df6-b0add9cd3930 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:04.882897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d483788-40e4-4599-8df6-b0add9cd3930 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:04.883161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d483788-40e4-4599-8df6-b0add9cd3930 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:04.895643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d483788-40e4-4599-8df6-b0add9cd3930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:04.901287 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-8d483788-40e4-4599-8df6-b0add9cd3930 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:01:04.901287 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:04.901287 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:04.901287 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:04.901287 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:04.901287 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:04.901287 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:04.901287 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:04.901287 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:04.901287 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:04.901287 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:04.901287 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:04.901287 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:04.901287 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:04.901287 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:04.901287 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:04.902461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:04.902461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:04.902461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:04.902461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:04.902461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:04.902461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:04.902461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:04.902461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:04.902461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:04.902461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:04.902461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:04.902461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:04.902461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:04.902461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:04.902461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:04.902461 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:04.903405 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:04.903405 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:04.903405 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:04.903405 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:04.903405 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:04.903405 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:04.903405 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:04.903405 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:04.903405 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:04.903405 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:04.903405 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:01:04.903405 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:04.903405 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 129/250] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:01:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:04.904725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953e59c-ed9b-4065-a79b-10216bb7ab57 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:04.908485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d483788-40e4-4599-8df6-b0add9cd3930 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:04.941932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:04.949283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c225a7d-5261-4762-98b8-efd047f2205a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:04.949936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c225a7d-5261-4762-98b8-efd047f2205a None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:04.950249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c225a7d-5261-4762-98b8-efd047f2205a None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:04.950524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c225a7d-5261-4762-98b8-efd047f2205a None admin] PATH_INFO: `/v3/users/a04bd32c022342498a693b563054488b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:04.951728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c225a7d-5261-4762-98b8-efd047f2205a None admin] RBAC: Authorizing `identity:get_user(user_id=a04bd32c022342498a693b563054488b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:04.953640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c225a7d-5261-4762-98b8-efd047f2205a None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:04.958226 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 122/251] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:01:04 2022] GET /identity/v3/users/a04bd32c022342498a693b563054488b => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:04.962224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c225a7d-5261-4762-98b8-efd047f2205a None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:05.020964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d483788-40e4-4599-8df6-b0add9cd3930 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:05.063925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7465c-1406-4afa-8837-2f319c7c9bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:05.063925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7465c-1406-4afa-8837-2f319c7c9bfa None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:05.063925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7465c-1406-4afa-8837-2f319c7c9bfa None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:05.064673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7465c-1406-4afa-8837-2f319c7c9bfa None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:05.064975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7465c-1406-4afa-8837-2f319c7c9bfa None admin] RBAC: Adding query filter params (name=member) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:05.065366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7465c-1406-4afa-8837-2f319c7c9bfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:05.066871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7465c-1406-4afa-8837-2f319c7c9bfa None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:05.075201 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 130/252] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 27 03:01:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:01:05.080876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7465c-1406-4afa-8837-2f319c7c9bfa None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:05.089831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c225a7d-5261-4762-98b8-efd047f2205a None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:05.138994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5f311-fa03-4deb-8b98-2443502047ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:05.139478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5f311-fa03-4deb-8b98-2443502047ad None admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:05.139758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5f311-fa03-4deb-8b98-2443502047ad None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:05.140031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5f311-fa03-4deb-8b98-2443502047ad None admin] PATH_INFO: `/v3/system/users/a04bd32c022342498a693b563054488b/roles/e93dce408a514f8fb8a572d381e51045` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:05.142262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5f311-fa03-4deb-8b98-2443502047ad None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a04bd32c022342498a693b563054488b, role_id=e93dce408a514f8fb8a572d381e51045)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:05.143859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5f311-fa03-4deb-8b98-2443502047ad None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:05.202711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:05.211623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7465c-1406-4afa-8837-2f319c7c9bfa None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:05.232382 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 123/253] 10.222.0.20 () {58 vars in 1334 bytes} [Thu Oct 27 03:01:04 2022] PUT /identity/v3/system/users/a04bd32c022342498a693b563054488b/roles/e93dce408a514f8fb8a572d381e51045 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:01:05.256366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18360075-a892-49bb-b5ae-16a44950e2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:05.257030 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18360075-a892-49bb-b5ae-16a44950e2d7 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:05.257310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18360075-a892-49bb-b5ae-16a44950e2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:05.257839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18360075-a892-49bb-b5ae-16a44950e2d7 None admin] PATH_INFO: `/v3/users/dbac280a83744ccf94fa8ee46d1e0ec8` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:05.259199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18360075-a892-49bb-b5ae-16a44950e2d7 None admin] RBAC: Authorizing `identity:get_user(user_id=dbac280a83744ccf94fa8ee46d1e0ec8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:05.260719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18360075-a892-49bb-b5ae-16a44950e2d7 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:05.263800 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 131/254] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:01:05 2022] GET /identity/v3/users/dbac280a83744ccf94fa8ee46d1e0ec8 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:01:05.268984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5f311-fa03-4deb-8b98-2443502047ad None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:05.285115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:05.402999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5f311-fa03-4deb-8b98-2443502047ad None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:05.441524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8937805-250b-4f29-9fc5-af3a5b1da1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:05.442185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8937805-250b-4f29-9fc5-af3a5b1da1e0 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:05.442469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8937805-250b-4f29-9fc5-af3a5b1da1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:05.442741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8937805-250b-4f29-9fc5-af3a5b1da1e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:05.443485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8937805-250b-4f29-9fc5-af3a5b1da1e0 None admin] RBAC: Adding query filter params (role.id=17fff77450b94933a5d232fb3f3221b7, user.id=dbac280a83744ccf94fa8ee46d1e0ec8, scope.system=all) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:05.443794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8937805-250b-4f29-9fc5-af3a5b1da1e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:05.445268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8937805-250b-4f29-9fc5-af3a5b1da1e0 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:05.459754 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 124/255] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Oct 27 03:01:05 2022] GET /identity/v3/role_assignments?user.id=dbac280a83744ccf94fa8ee46d1e0ec8&scope.system=all&role.id=17fff77450b94933a5d232fb3f3221b7 => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:07.489824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e32fde-6e91-4f53-9793-2e560ab75c5f None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:07.490391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e32fde-6e91-4f53-9793-2e560ab75c5f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:07.490466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e32fde-6e91-4f53-9793-2e560ab75c5f None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:07.492057 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 132/256] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:07.503707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00373bd7-f093-46c5-be1d-1f6a2d9f3d3c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:07.504178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00373bd7-f093-46c5-be1d-1f6a2d9f3d3c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:07.504274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00373bd7-f093-46c5-be1d-1f6a2d9f3d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:07.529104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-00373bd7-f093-46c5-be1d-1f6a2d9f3d3c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:07.530347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-00373bd7-f093-46c5-be1d-1f6a2d9f3d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:07.595983 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 125/257] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 27 03:01:07.661244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53694d10-7c7d-4e02-9553-2679e7e14e0f None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:07.661573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53694d10-7c7d-4e02-9553-2679e7e14e0f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:07.661810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53694d10-7c7d-4e02-9553-2679e7e14e0f None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:07.663502 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 133/258] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:07.669258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10799a-317a-4b67-a555-7f0ecbef6570 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:07.669561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10799a-317a-4b67-a555-7f0ecbef6570 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:07.669840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10799a-317a-4b67-a555-7f0ecbef6570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:07.691798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2b10799a-317a-4b67-a555-7f0ecbef6570 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:07.692999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2b10799a-317a-4b67-a555-7f0ecbef6570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:07.704534 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 126/259] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 27 03:01:07.760838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416277b-cc1f-497b-8133-a8ded9188c81 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:07.761132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416277b-cc1f-497b-8133-a8ded9188c81 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:07.761283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416277b-cc1f-497b-8133-a8ded9188c81 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:07.762957 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 134/260] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:07.767943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000af66-8026-4a31-ab66-c73192b892a0 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:07.768237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000af66-8026-4a31-ab66-c73192b892a0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:07.768519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000af66-8026-4a31-ab66-c73192b892a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:07.779396 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:07.795038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9000af66-8026-4a31-ab66-c73192b892a0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:07.796259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9000af66-8026-4a31-ab66-c73192b892a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:07.873990 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 127/261] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:07.937308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416277b-cc1f-497b-8133-a8ded9188c81 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:07.953889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416277b-cc1f-497b-8133-a8ded9188c81 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:07.958477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd9712-8ac8-466d-8ab9-4df6ee6b2747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:07.959144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd9712-8ac8-466d-8ab9-4df6ee6b2747 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:07.959432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd9712-8ac8-466d-8ab9-4df6ee6b2747 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:07.959704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd9712-8ac8-466d-8ab9-4df6ee6b2747 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:07.972150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd9712-8ac8-466d-8ab9-4df6ee6b2747 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:07.977116 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-85dd9712-8ac8-466d-8ab9-4df6ee6b2747 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 03:01:07.977116 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:07.977116 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:07.977116 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:07.977116 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:07.977116 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:07.977116 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:07.977116 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:07.977116 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:07.977116 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:07.977116 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:07.977116 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:07.977116 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:07.977116 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:07.977116 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:07.977116 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:07.978550 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:07.978550 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:07.978550 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:07.978550 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:07.978550 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:07.978550 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:07.978550 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:07.978550 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:07.978550 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:07.978550 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:07.978550 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:07.978550 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:07.978550 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:07.978550 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:07.978550 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:07.978550 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:07.979334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:07.979334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:07.979334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:07.979334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:07.979334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:07.979334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:07.979334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:07.979334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:07.979334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:07.979334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:07.979334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 03:01:07.979334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:07.979334 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 135/262] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Oct 27 03:01:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:07.984774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000af66-8026-4a31-ab66-c73192b892a0 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:07.995633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000af66-8026-4a31-ab66-c73192b892a0 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:08.000115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b118dc5-3ae2-4b2b-9e52-4166579374f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:08.000785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b118dc5-3ae2-4b2b-9e52-4166579374f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:08.001072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b118dc5-3ae2-4b2b-9e52-4166579374f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:08.001344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b118dc5-3ae2-4b2b-9e52-4166579374f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:08.002114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b118dc5-3ae2-4b2b-9e52-4166579374f5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:08.002425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b118dc5-3ae2-4b2b-9e52-4166579374f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:08.004323 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-8b118dc5-3ae2-4b2b-9e52-4166579374f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:01:08.004323 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:01:08.004323 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:01:08.005239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b118dc5-3ae2-4b2b-9e52-4166579374f5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:08.015425 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 128/263] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Oct 27 03:01:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:08.020921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd9712-8ac8-466d-8ab9-4df6ee6b2747 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:08.032014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd9712-8ac8-466d-8ab9-4df6ee6b2747 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:08.036645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f2917-9ffe-4395-9e82-3eee7febb202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:08.037288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f2917-9ffe-4395-9e82-3eee7febb202 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:08.037567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f2917-9ffe-4395-9e82-3eee7febb202 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:08.037900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f2917-9ffe-4395-9e82-3eee7febb202 admin admin] PATH_INFO: `/v3/groups/d7dbba4f593f4f1bbca3550fd1acf0f0` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:08.048708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f2917-9ffe-4395-9e82-3eee7febb202 admin admin] RBAC: Authorizing `identity:get_group(group_id=d7dbba4f593f4f1bbca3550fd1acf0f0)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:08.050663 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-950f2917-9ffe-4395-9e82-3eee7febb202 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:01:08.050663 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:01:08.050663 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:01:08.052037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f2917-9ffe-4395-9e82-3eee7febb202 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:08.053904 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 136/264] 10.222.0.20 () {56 vars in 1201 bytes} [Thu Oct 27 03:01:08 2022] GET /identity/v3/groups/d7dbba4f593f4f1bbca3550fd1acf0f0 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:08.059534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b118dc5-3ae2-4b2b-9e52-4166579374f5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:08.069868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b118dc5-3ae2-4b2b-9e52-4166579374f5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:08.078642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14370d20-ae9a-44c2-8a8b-a076dc7f778f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:08.079354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14370d20-ae9a-44c2-8a8b-a076dc7f778f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:08.079640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14370d20-ae9a-44c2-8a8b-a076dc7f778f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:08.079918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14370d20-ae9a-44c2-8a8b-a076dc7f778f admin admin] PATH_INFO: `/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:08.081083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14370d20-ae9a-44c2-8a8b-a076dc7f778f admin admin] RBAC: Authorizing `identity:get_project(project_id=cc5fad8ef92f41c9bbde916bcccc5b92)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:08.083315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14370d20-ae9a-44c2-8a8b-a076dc7f778f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:08.085311 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 129/265] 10.222.0.20 () {56 vars in 1207 bytes} [Thu Oct 27 03:01:08 2022] GET /identity/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:08.091753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f2917-9ffe-4395-9e82-3eee7febb202 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:08.103535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f2917-9ffe-4395-9e82-3eee7febb202 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:08.108172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10867545-ac8d-49c7-ab01-30a957a292f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:08.108901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10867545-ac8d-49c7-ab01-30a957a292f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:08.109189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10867545-ac8d-49c7-ab01-30a957a292f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:08.109465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10867545-ac8d-49c7-ab01-30a957a292f4 admin admin] PATH_INFO: `/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92/groups/d7dbba4f593f4f1bbca3550fd1acf0f0/roles/31c2fac3eedc4006a84fcd0bee6d22e8` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:08.111779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10867545-ac8d-49c7-ab01-30a957a292f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5fad8ef92f41c9bbde916bcccc5b92, group_id=d7dbba4f593f4f1bbca3550fd1acf0f0, role_id=31c2fac3eedc4006a84fcd0bee6d22e8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:08.112819 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-10867545-ac8d-49c7-ab01-30a957a292f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:01:08.112819 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:01:08.112819 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:01:08.114876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10867545-ac8d-49c7-ab01-30a957a292f4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:08.189488 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 137/266] 10.222.0.20 () {58 vars in 1463 bytes} [Thu Oct 27 03:01:08 2022] PUT /identity/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92/groups/d7dbba4f593f4f1bbca3550fd1acf0f0/roles/31c2fac3eedc4006a84fcd0bee6d22e8 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:01:08.379651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14370d20-ae9a-44c2-8a8b-a076dc7f778f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:08.390730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14370d20-ae9a-44c2-8a8b-a076dc7f778f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:08.425568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10867545-ac8d-49c7-ab01-30a957a292f4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:08.530403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5a2bd-8dd6-4c21-bb7f-40744712413f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:08.531114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5a2bd-8dd6-4c21-bb7f-40744712413f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:08.531404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5a2bd-8dd6-4c21-bb7f-40744712413f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:08.531681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5a2bd-8dd6-4c21-bb7f-40744712413f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:08.547647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5a2bd-8dd6-4c21-bb7f-40744712413f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:08.554044 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-6ce5a2bd-8dd6-4c21-bb7f-40744712413f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:01:08.554044 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:08.554044 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:08.554044 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:08.554044 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:08.554044 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:08.554044 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:08.554044 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:08.554044 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:08.554044 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:08.554044 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:08.554044 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:08.554044 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:08.554044 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:08.554044 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:08.554044 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:08.554920 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:08.554920 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:08.554920 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:08.554920 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:08.554920 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:08.554920 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:08.554920 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:08.554920 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:08.554920 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:08.554920 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:08.554920 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:08.554920 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:08.554920 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:08.554920 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:08.554920 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:08.554920 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:08.556230 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:08.556230 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:08.556230 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:08.556230 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:08.556230 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:08.556230 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:08.556230 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:08.556230 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:08.556230 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:08.556230 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:08.556230 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:01:08.556230 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:08.556230 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 130/267] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Oct 27 03:01:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:08.562913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdff8e-0e65-4445-ad53-2c015cfdd625 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:08.563201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdff8e-0e65-4445-ad53-2c015cfdd625 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:08.563483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdff8e-0e65-4445-ad53-2c015cfdd625 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:08.565144 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 131/268] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:08.566835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cdff8e-0e65-4445-ad53-2c015cfdd625 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:08.589379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cdff8e-0e65-4445-ad53-2c015cfdd625 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:08.594155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb335943-2436-4101-af22-40698e9124bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:08.594990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb335943-2436-4101-af22-40698e9124bb admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:08.595415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb335943-2436-4101-af22-40698e9124bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:08.595844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb335943-2436-4101-af22-40698e9124bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:08.596735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb335943-2436-4101-af22-40698e9124bb admin admin] RBAC: Adding query filter params (name=member) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:08.597181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb335943-2436-4101-af22-40698e9124bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:08.598990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb335943-2436-4101-af22-40698e9124bb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:08.609696 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 132/269] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Oct 27 03:01:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:08.611424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dd0aa-befa-46a2-b657-f0d8b2709776 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:08.611918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dd0aa-befa-46a2-b657-f0d8b2709776 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:08.612426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dd0aa-befa-46a2-b657-f0d8b2709776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:08.630647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10867545-ac8d-49c7-ab01-30a957a292f4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:08.635916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-861dd0aa-befa-46a2-b657-f0d8b2709776 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:08.637410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-861dd0aa-befa-46a2-b657-f0d8b2709776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:08.654319 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 133/270] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 27 03:01:08.656345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dd0aa-befa-46a2-b657-f0d8b2709776 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:08.673610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dd0aa-befa-46a2-b657-f0d8b2709776 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:08.681315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:08.686369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496faf37-f448-4306-8c67-3051a3abb415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:08.687610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496faf37-f448-4306-8c67-3051a3abb415 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:08.687896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496faf37-f448-4306-8c67-3051a3abb415 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:08.688174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496faf37-f448-4306-8c67-3051a3abb415 admin admin] PATH_INFO: `/v3/groups/d7dbba4f593f4f1bbca3550fd1acf0f0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:08.690059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496faf37-f448-4306-8c67-3051a3abb415 admin admin] RBAC: Authorizing `identity:get_group(group_id=d7dbba4f593f4f1bbca3550fd1acf0f0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:08.692580 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-496faf37-f448-4306-8c67-3051a3abb415 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:01:08.692580 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:01:08.692580 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:01:08.698247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496faf37-f448-4306-8c67-3051a3abb415 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:08.698316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee7e86-0e8e-4a45-b6cb-de72494d4954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:08.698316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee7e86-0e8e-4a45-b6cb-de72494d4954 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:08.698316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee7e86-0e8e-4a45-b6cb-de72494d4954 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:08.698518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee7e86-0e8e-4a45-b6cb-de72494d4954 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:08.700369 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 134/271] 10.222.0.20 () {56 vars in 1201 bytes} [Thu Oct 27 03:01:08 2022] GET /identity/v3/groups/d7dbba4f593f4f1bbca3550fd1acf0f0 => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:08.707083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496faf37-f448-4306-8c67-3051a3abb415 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:08.724504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee7e86-0e8e-4a45-b6cb-de72494d4954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:08.724734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496faf37-f448-4306-8c67-3051a3abb415 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:08.730086 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-46ee7e86-0e8e-4a45-b6cb-de72494d4954 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 03:01:08.730086 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:08.730086 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:08.730086 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:08.730086 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:08.730086 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:08.730086 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:08.730086 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:08.730086 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:08.730086 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:08.730086 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:08.730086 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:08.730086 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:08.730086 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:08.730086 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:08.730086 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:08.730937 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:08.730937 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:08.730937 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:08.730937 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:08.730937 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:08.730937 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:08.730937 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:08.730937 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:08.730937 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:08.730937 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:08.730937 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:08.730937 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:08.730937 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:08.730937 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:08.730937 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:08.730937 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:08.731729 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:08.731729 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:08.731729 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:08.731729 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:08.731729 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:08.731729 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:08.731729 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:08.731729 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:08.731729 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:08.731729 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:08.731729 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 03:01:08.731729 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:08.731729 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 138/272] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:01:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:08.739236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce81dfb-a2bf-4ad3-a938-451a00178897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:08.739759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee7e86-0e8e-4a45-b6cb-de72494d4954 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:08.739867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce81dfb-a2bf-4ad3-a938-451a00178897 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:08.740211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce81dfb-a2bf-4ad3-a938-451a00178897 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:08.740444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce81dfb-a2bf-4ad3-a938-451a00178897 admin admin] PATH_INFO: `/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:08.746761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce81dfb-a2bf-4ad3-a938-451a00178897 admin admin] RBAC: Authorizing `identity:get_project(project_id=cc5fad8ef92f41c9bbde916bcccc5b92)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:08.749294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce81dfb-a2bf-4ad3-a938-451a00178897 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:08.750973 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 135/273] 10.222.0.20 () {56 vars in 1207 bytes} [Thu Oct 27 03:01:08 2022] GET /identity/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:08.756782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce81dfb-a2bf-4ad3-a938-451a00178897 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:08.771404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce81dfb-a2bf-4ad3-a938-451a00178897 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:08.787774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779f749-9f74-4810-b231-9612a509d047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:08.788806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779f749-9f74-4810-b231-9612a509d047 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:08.789105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779f749-9f74-4810-b231-9612a509d047 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:08.789386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779f749-9f74-4810-b231-9612a509d047 admin admin] PATH_INFO: `/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92/groups/d7dbba4f593f4f1bbca3550fd1acf0f0/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:08.795923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779f749-9f74-4810-b231-9612a509d047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5fad8ef92f41c9bbde916bcccc5b92, group_id=d7dbba4f593f4f1bbca3550fd1acf0f0, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:08.796438 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-a779f749-9f74-4810-b231-9612a509d047 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:01:08.796438 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:01:08.796438 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:01:08.798443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779f749-9f74-4810-b231-9612a509d047 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:08.891149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee7e86-0e8e-4a45-b6cb-de72494d4954 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:08.901395 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 136/274] 10.222.0.20 () {58 vars in 1463 bytes} [Thu Oct 27 03:01:08 2022] PUT /identity/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92/groups/d7dbba4f593f4f1bbca3550fd1acf0f0/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:01:08.940462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46cfac-5b1a-4b02-aaa7-84026e6bdbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:08.941100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46cfac-5b1a-4b02-aaa7-84026e6bdbfe None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:08.941382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46cfac-5b1a-4b02-aaa7-84026e6bdbfe None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:08.941720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46cfac-5b1a-4b02-aaa7-84026e6bdbfe None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:08.942457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46cfac-5b1a-4b02-aaa7-84026e6bdbfe None admin] RBAC: Adding query filter params (name=reader) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:08.942814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46cfac-5b1a-4b02-aaa7-84026e6bdbfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:08.944285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46cfac-5b1a-4b02-aaa7-84026e6bdbfe None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:08.956399 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 139/275] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 27 03:01:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:01:08.962269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779f749-9f74-4810-b231-9612a509d047 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:08.992801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46cfac-5b1a-4b02-aaa7-84026e6bdbfe None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:09.004751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:09.129912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:09.144527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46cfac-5b1a-4b02-aaa7-84026e6bdbfe None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:09.147537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779f749-9f74-4810-b231-9612a509d047 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:09.158946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4db4ce-a7c2-49a7-aae0-e2b17dedb5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:09.159594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4db4ce-a7c2-49a7-aae0-e2b17dedb5eb admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:09.159873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4db4ce-a7c2-49a7-aae0-e2b17dedb5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:09.160142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4db4ce-a7c2-49a7-aae0-e2b17dedb5eb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:09.185129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4db4ce-a7c2-49a7-aae0-e2b17dedb5eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:09.194756 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-fa4db4ce-a7c2-49a7-aae0-e2b17dedb5eb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:01:09.194756 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:09.194756 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:09.194756 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:09.194756 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:09.194756 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:09.194756 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:09.194756 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:09.194756 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:09.194756 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:09.194756 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:09.194756 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:09.194756 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:09.194756 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:09.194756 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:09.194756 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:09.195670 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:09.195670 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:09.195670 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:09.195670 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:09.195670 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:09.195670 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:09.195670 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:09.195670 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:09.195670 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:09.195670 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:09.195670 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:09.195670 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:09.195670 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:09.195670 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:09.195670 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:09.195670 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:09.196618 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:09.196618 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:09.196618 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:09.196618 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:09.196618 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:09.196618 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:09.196618 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:09.196618 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:09.196618 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:09.196618 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:09.196618 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:01:09.196618 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:09.196618 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 140/276] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Oct 27 03:01:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:01:09.205254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4db4ce-a7c2-49a7-aae0-e2b17dedb5eb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:09.216697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50439d93-952c-441b-bffd-35bec5d52493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:09.217354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50439d93-952c-441b-bffd-35bec5d52493 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:09.217634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50439d93-952c-441b-bffd-35bec5d52493 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:09.217912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50439d93-952c-441b-bffd-35bec5d52493 None admin] PATH_INFO: `/v3/users/a04bd32c022342498a693b563054488b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:09.220083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50439d93-952c-441b-bffd-35bec5d52493 None admin] RBAC: Authorizing `identity:get_user(user_id=a04bd32c022342498a693b563054488b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:09.221544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50439d93-952c-441b-bffd-35bec5d52493 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:09.223194 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 137/277] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:01:08 2022] GET /identity/v3/users/a04bd32c022342498a693b563054488b => generated 293 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:09.226395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4db4ce-a7c2-49a7-aae0-e2b17dedb5eb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:09.229897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50439d93-952c-441b-bffd-35bec5d52493 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:09.239824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae5bd7-ecdd-432f-aa77-b346c80b25ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:09.240498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae5bd7-ecdd-432f-aa77-b346c80b25ee admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:09.240786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae5bd7-ecdd-432f-aa77-b346c80b25ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:09.241059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae5bd7-ecdd-432f-aa77-b346c80b25ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:09.241798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae5bd7-ecdd-432f-aa77-b346c80b25ee admin admin] RBAC: Adding query filter params (name=member) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:09.242197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae5bd7-ecdd-432f-aa77-b346c80b25ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:09.243905 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-4aae5bd7-ecdd-432f-aa77-b346c80b25ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:01:09.243905 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:01:09.243905 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:01:09.244895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae5bd7-ecdd-432f-aa77-b346c80b25ee admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:09.258067 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 141/278] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Oct 27 03:01:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:09.265020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae5bd7-ecdd-432f-aa77-b346c80b25ee admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:09.276382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae5bd7-ecdd-432f-aa77-b346c80b25ee admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:09.284621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc4ad4-29a2-445b-8078-2bc3b776656a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:09.285265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc4ad4-29a2-445b-8078-2bc3b776656a admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:09.285599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc4ad4-29a2-445b-8078-2bc3b776656a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:09.285879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc4ad4-29a2-445b-8078-2bc3b776656a admin admin] PATH_INFO: `/v3/groups/d7dbba4f593f4f1bbca3550fd1acf0f0` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:09.287616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc4ad4-29a2-445b-8078-2bc3b776656a admin admin] RBAC: Authorizing `identity:get_group(group_id=d7dbba4f593f4f1bbca3550fd1acf0f0)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:09.289687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc4ad4-29a2-445b-8078-2bc3b776656a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:09.297086 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 142/279] 10.222.0.20 () {56 vars in 1201 bytes} [Thu Oct 27 03:01:09 2022] GET /identity/v3/groups/d7dbba4f593f4f1bbca3550fd1acf0f0 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:09.311270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc4ad4-29a2-445b-8078-2bc3b776656a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:09.325917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc4ad4-29a2-445b-8078-2bc3b776656a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:09.334402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20e1eb-15b5-47f0-b7eb-1a794bda23f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:09.335034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20e1eb-15b5-47f0-b7eb-1a794bda23f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:09.335373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20e1eb-15b5-47f0-b7eb-1a794bda23f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:09.335649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20e1eb-15b5-47f0-b7eb-1a794bda23f5 admin admin] PATH_INFO: `/v3/projects/8b5c4caaad3540288517a0fd7eff738d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:09.337618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d20e1eb-15b5-47f0-b7eb-1a794bda23f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=8b5c4caaad3540288517a0fd7eff738d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:09.339848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d20e1eb-15b5-47f0-b7eb-1a794bda23f5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:09.346164 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 143/280] 10.222.0.20 () {56 vars in 1207 bytes} [Thu Oct 27 03:01:09 2022] GET /identity/v3/projects/8b5c4caaad3540288517a0fd7eff738d => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:09.360960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20e1eb-15b5-47f0-b7eb-1a794bda23f5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:09.378757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20e1eb-15b5-47f0-b7eb-1a794bda23f5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:09.390374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f297958-de8d-44cd-870d-b3b861666bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:09.391096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f297958-de8d-44cd-870d-b3b861666bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:09.391388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f297958-de8d-44cd-870d-b3b861666bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:09.391664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f297958-de8d-44cd-870d-b3b861666bdf admin admin] PATH_INFO: `/v3/projects/8b5c4caaad3540288517a0fd7eff738d/groups/d7dbba4f593f4f1bbca3550fd1acf0f0/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:09.393981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f297958-de8d-44cd-870d-b3b861666bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5c4caaad3540288517a0fd7eff738d, group_id=d7dbba4f593f4f1bbca3550fd1acf0f0, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:09.397231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f297958-de8d-44cd-870d-b3b861666bdf admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:09.403399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:09.415697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50439d93-952c-441b-bffd-35bec5d52493 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:09.464723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5569d9-36c7-47b0-af03-f98f9402e66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:09.465344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5569d9-36c7-47b0-af03-f98f9402e66e None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:09.465628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5569d9-36c7-47b0-af03-f98f9402e66e None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:09.465897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5569d9-36c7-47b0-af03-f98f9402e66e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:09.466661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5569d9-36c7-47b0-af03-f98f9402e66e None admin] RBAC: Adding query filter params (role.id=e93dce408a514f8fb8a572d381e51045, user.id=a04bd32c022342498a693b563054488b, scope.system=all) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:09.466971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5569d9-36c7-47b0-af03-f98f9402e66e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:09.468416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5569d9-36c7-47b0-af03-f98f9402e66e None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:09.485469 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 138/281] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Oct 27 03:01:09 2022] GET /identity/v3/role_assignments?user.id=a04bd32c022342498a693b563054488b&scope.system=all&role.id=e93dce408a514f8fb8a572d381e51045 => generated 510 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:09.534383 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 144/282] 10.222.0.20 () {58 vars in 1463 bytes} [Thu Oct 27 03:01:09 2022] PUT /identity/v3/projects/8b5c4caaad3540288517a0fd7eff738d/groups/d7dbba4f593f4f1bbca3550fd1acf0f0/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:01:09.550195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cdbdc-81ad-49ae-932a-672e2c8e7097 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:09.550860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cdbdc-81ad-49ae-932a-672e2c8e7097 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:09.550860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cdbdc-81ad-49ae-932a-672e2c8e7097 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:09.552087 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 139/283] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:09.557943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fda1c-7f2a-4d13-8f11-55ae27f91708 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:09.558261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fda1c-7f2a-4d13-8f11-55ae27f91708 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:09.558538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fda1c-7f2a-4d13-8f11-55ae27f91708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:09.587871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-784fda1c-7f2a-4d13-8f11-55ae27f91708 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:09.589124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-784fda1c-7f2a-4d13-8f11-55ae27f91708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:09.680912 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 145/284] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 27 03:01:09.964917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff830c3c-f285-4723-9f5d-02c9e90d5dbd None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:09.965302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff830c3c-f285-4723-9f5d-02c9e90d5dbd None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:09.965476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff830c3c-f285-4723-9f5d-02c9e90d5dbd None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:09.966840 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 140/285] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:09.972145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c902f9-e13c-4e05-b680-1e67fdc0d103 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:09.972431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c902f9-e13c-4e05-b680-1e67fdc0d103 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:09.972707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c902f9-e13c-4e05-b680-1e67fdc0d103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:09.999769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c3c902f9-e13c-4e05-b680-1e67fdc0d103 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:10.001322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c3c902f9-e13c-4e05-b680-1e67fdc0d103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:10.010525 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 146/286] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 27 03:01:10.100458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff830c3c-f285-4723-9f5d-02c9e90d5dbd None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:10.115943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff830c3c-f285-4723-9f5d-02c9e90d5dbd None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:10.123929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9362b3-a913-4bed-bc71-56f9da44eac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:10.124842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9362b3-a913-4bed-bc71-56f9da44eac8 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:10.125317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9362b3-a913-4bed-bc71-56f9da44eac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:10.125803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9362b3-a913-4bed-bc71-56f9da44eac8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:10.139184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9362b3-a913-4bed-bc71-56f9da44eac8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:10.144788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-0e9362b3-a913-4bed-bc71-56f9da44eac8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 03:01:10.144788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:10.144788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:10.144788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:10.144788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:10.144788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:10.144788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:10.144788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:10.144788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:10.144788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:10.144788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:10.144788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:10.144788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:10.144788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:10.144788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:10.144788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:10.145659 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:10.145659 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:10.145659 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:10.145659 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:10.145659 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:10.145659 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:10.145659 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:10.145659 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:10.145659 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:10.145659 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:10.145659 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:10.145659 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:10.145659 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:10.145659 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:10.145659 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:10.145659 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:10.165516 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:10.165516 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:10.165516 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:10.165516 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:10.165516 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:10.165516 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:10.165516 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:10.165516 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:10.165516 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:10.165516 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:10.165516 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 03:01:10.165516 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:10.165516 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 141/287] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Oct 27 03:01:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:10.166231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c902f9-e13c-4e05-b680-1e67fdc0d103 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:10.166231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c902f9-e13c-4e05-b680-1e67fdc0d103 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:10.171630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e688846-d4b4-48e4-89a0-416d77b8cf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:10.172403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e688846-d4b4-48e4-89a0-416d77b8cf3e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:10.172821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e688846-d4b4-48e4-89a0-416d77b8cf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:10.173245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e688846-d4b4-48e4-89a0-416d77b8cf3e admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:10.174080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e688846-d4b4-48e4-89a0-416d77b8cf3e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:10.174518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e688846-d4b4-48e4-89a0-416d77b8cf3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:10.176252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e688846-d4b4-48e4-89a0-416d77b8cf3e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:10.201626 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 147/288] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Oct 27 03:01:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:10.207175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9362b3-a913-4bed-bc71-56f9da44eac8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:10.218791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9362b3-a913-4bed-bc71-56f9da44eac8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:10.229164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c246ad2-68ca-450d-a35c-805ebcdc4155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:10.230216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c246ad2-68ca-450d-a35c-805ebcdc4155 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:10.230673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c246ad2-68ca-450d-a35c-805ebcdc4155 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:10.231159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c246ad2-68ca-450d-a35c-805ebcdc4155 admin admin] PATH_INFO: `/v3/groups/d7dbba4f593f4f1bbca3550fd1acf0f0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:10.232649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c246ad2-68ca-450d-a35c-805ebcdc4155 admin admin] RBAC: Authorizing `identity:get_group(group_id=d7dbba4f593f4f1bbca3550fd1acf0f0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:10.234922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c246ad2-68ca-450d-a35c-805ebcdc4155 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:10.236896 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 142/289] 10.222.0.20 () {56 vars in 1201 bytes} [Thu Oct 27 03:01:10 2022] GET /identity/v3/groups/d7dbba4f593f4f1bbca3550fd1acf0f0 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:10.242500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e688846-d4b4-48e4-89a0-416d77b8cf3e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:10.253695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e688846-d4b4-48e4-89a0-416d77b8cf3e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:10.260496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463e53f-a391-4a7d-9bd3-153f4708b2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:10.261181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463e53f-a391-4a7d-9bd3-153f4708b2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:10.261461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463e53f-a391-4a7d-9bd3-153f4708b2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:10.261732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463e53f-a391-4a7d-9bd3-153f4708b2c4 admin admin] PATH_INFO: `/v3/projects/8b5c4caaad3540288517a0fd7eff738d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:10.262933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463e53f-a391-4a7d-9bd3-153f4708b2c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=8b5c4caaad3540288517a0fd7eff738d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:10.265088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463e53f-a391-4a7d-9bd3-153f4708b2c4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:10.266832 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 148/290] 10.222.0.20 () {56 vars in 1207 bytes} [Thu Oct 27 03:01:10 2022] GET /identity/v3/projects/8b5c4caaad3540288517a0fd7eff738d => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:10.272498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c246ad2-68ca-450d-a35c-805ebcdc4155 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:10.283340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c246ad2-68ca-450d-a35c-805ebcdc4155 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:10.287935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e6e6b-eb2c-4bc9-9994-fc5d34353010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:10.288687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e6e6b-eb2c-4bc9-9994-fc5d34353010 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:10.288965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e6e6b-eb2c-4bc9-9994-fc5d34353010 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:10.289325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e6e6b-eb2c-4bc9-9994-fc5d34353010 admin admin] PATH_INFO: `/v3/projects/8b5c4caaad3540288517a0fd7eff738d/groups/d7dbba4f593f4f1bbca3550fd1acf0f0/roles/31c2fac3eedc4006a84fcd0bee6d22e8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:10.294235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e6e6b-eb2c-4bc9-9994-fc5d34353010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5c4caaad3540288517a0fd7eff738d, group_id=d7dbba4f593f4f1bbca3550fd1acf0f0, role_id=31c2fac3eedc4006a84fcd0bee6d22e8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:10.297097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e6e6b-eb2c-4bc9-9994-fc5d34353010 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:10.380319 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 143/291] 10.222.0.20 () {58 vars in 1463 bytes} [Thu Oct 27 03:01:10 2022] PUT /identity/v3/projects/8b5c4caaad3540288517a0fd7eff738d/groups/d7dbba4f593f4f1bbca3550fd1acf0f0/roles/31c2fac3eedc4006a84fcd0bee6d22e8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:01:10.394853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463e53f-a391-4a7d-9bd3-153f4708b2c4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:10.405579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463e53f-a391-4a7d-9bd3-153f4708b2c4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:10.474989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b102b7-f460-4b5b-bb72-2fa2eaabd9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:10.475602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b102b7-f460-4b5b-bb72-2fa2eaabd9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:10.475975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b102b7-f460-4b5b-bb72-2fa2eaabd9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:10.476322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b102b7-f460-4b5b-bb72-2fa2eaabd9e2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:10.489191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b102b7-f460-4b5b-bb72-2fa2eaabd9e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:10.495295 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-e8b102b7-f460-4b5b-bb72-2fa2eaabd9e2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:01:10.495295 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:10.495295 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:10.495295 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:10.495295 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:10.495295 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:10.495295 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:10.495295 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:10.495295 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:10.495295 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:10.495295 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:10.495295 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:10.495295 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:10.495295 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:10.495295 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:10.495295 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:10.496210 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:10.496210 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:10.496210 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:10.496210 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:10.496210 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:10.496210 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:10.496210 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:10.496210 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:10.496210 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:10.496210 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:10.496210 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:10.496210 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:10.496210 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:10.496210 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:10.496210 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:10.496210 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:10.497067 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:10.497067 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:10.497067 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:10.497067 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:10.497067 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:10.497067 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:10.497067 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:10.497067 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:10.497067 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:10.497067 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:10.497067 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:01:10.497067 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:10.497067 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 149/292] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Oct 27 03:01:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:10.503810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e6e6b-eb2c-4bc9-9994-fc5d34353010 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:10.518025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e6e6b-eb2c-4bc9-9994-fc5d34353010 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:10.523106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ee440-fbf1-493a-b2fb-7058bc614dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:10.523760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ee440-fbf1-493a-b2fb-7058bc614dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:10.524100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ee440-fbf1-493a-b2fb-7058bc614dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:10.524408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ee440-fbf1-493a-b2fb-7058bc614dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:10.525075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ee440-fbf1-493a-b2fb-7058bc614dc9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:10.525378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ee440-fbf1-493a-b2fb-7058bc614dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:10.527021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ee440-fbf1-493a-b2fb-7058bc614dc9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:10.543183 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 144/293] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Oct 27 03:01:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:10.549069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b102b7-f460-4b5b-bb72-2fa2eaabd9e2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:10.561989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b102b7-f460-4b5b-bb72-2fa2eaabd9e2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:10.567876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f8c1f-f8dd-4872-9af9-79e38defc342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:10.568579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f8c1f-f8dd-4872-9af9-79e38defc342 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:10.568853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f8c1f-f8dd-4872-9af9-79e38defc342 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:10.569160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f8c1f-f8dd-4872-9af9-79e38defc342 admin admin] PATH_INFO: `/v3/groups/eb04fed6f54a4b978044864e4f1a7a33` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:10.574874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f8c1f-f8dd-4872-9af9-79e38defc342 admin admin] RBAC: Authorizing `identity:get_group(group_id=eb04fed6f54a4b978044864e4f1a7a33)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:10.576809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f8c1f-f8dd-4872-9af9-79e38defc342 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:10.578570 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 150/294] 10.222.0.20 () {56 vars in 1201 bytes} [Thu Oct 27 03:01:10 2022] GET /identity/v3/groups/eb04fed6f54a4b978044864e4f1a7a33 => generated 229 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:10.584158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ee440-fbf1-493a-b2fb-7058bc614dc9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:10.595105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ee440-fbf1-493a-b2fb-7058bc614dc9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:10.600723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7c20d-eed0-43e9-be97-6d21b6ad384d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:10.601462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7c20d-eed0-43e9-be97-6d21b6ad384d admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:10.601744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7c20d-eed0-43e9-be97-6d21b6ad384d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:10.602014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7c20d-eed0-43e9-be97-6d21b6ad384d admin admin] PATH_INFO: `/v3/projects/5e8ac2ac85cf42df9e4584993def5b4a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:10.605318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7c20d-eed0-43e9-be97-6d21b6ad384d admin admin] RBAC: Authorizing `identity:get_project(project_id=5e8ac2ac85cf42df9e4584993def5b4a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:10.607266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7c20d-eed0-43e9-be97-6d21b6ad384d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:10.609120 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 145/295] 10.222.0.20 () {56 vars in 1207 bytes} [Thu Oct 27 03:01:10 2022] GET /identity/v3/projects/5e8ac2ac85cf42df9e4584993def5b4a => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:10.615005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f8c1f-f8dd-4872-9af9-79e38defc342 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:10.627925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f8c1f-f8dd-4872-9af9-79e38defc342 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:10.633780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9a380-48b0-4aaa-ba96-cf0c7e79177e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:10.634479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9a380-48b0-4aaa-ba96-cf0c7e79177e admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:10.634756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9a380-48b0-4aaa-ba96-cf0c7e79177e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:10.635132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9a380-48b0-4aaa-ba96-cf0c7e79177e admin admin] PATH_INFO: `/v3/projects/5e8ac2ac85cf42df9e4584993def5b4a/groups/eb04fed6f54a4b978044864e4f1a7a33/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:10.637285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9a380-48b0-4aaa-ba96-cf0c7e79177e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e8ac2ac85cf42df9e4584993def5b4a, group_id=eb04fed6f54a4b978044864e4f1a7a33, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:10.640128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9a380-48b0-4aaa-ba96-cf0c7e79177e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:10.715365 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 151/296] 10.222.0.20 () {58 vars in 1463 bytes} [Thu Oct 27 03:01:10 2022] PUT /identity/v3/projects/5e8ac2ac85cf42df9e4584993def5b4a/groups/eb04fed6f54a4b978044864e4f1a7a33/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:01:11.665027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367e0c4-9015-44a4-b186-3e5c7c0ac36e None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:11.665538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367e0c4-9015-44a4-b186-3e5c7c0ac36e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:11.665643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367e0c4-9015-44a4-b186-3e5c7c0ac36e None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:11.667290 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 146/297] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:11.672774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f665a-00d1-4184-8b1f-8016a7d85299 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:11.673062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f665a-00d1-4184-8b1f-8016a7d85299 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:11.673340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f665a-00d1-4184-8b1f-8016a7d85299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:11.687826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:11.699249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-cf4f665a-00d1-4184-8b1f-8016a7d85299 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:11.700468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cf4f665a-00d1-4184-8b1f-8016a7d85299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:11.790825 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 152/298] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:11.992486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5513ba3-f8c2-4b2c-b4a5-7e889c5bbed5 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:11.992933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5513ba3-f8c2-4b2c-b4a5-7e889c5bbed5 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:11.993667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5513ba3-f8c2-4b2c-b4a5-7e889c5bbed5 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:11.995285 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 147/299] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:12.006264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6231c2-ea78-44c8-b930-1c6dda483105 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:12.006593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6231c2-ea78-44c8-b930-1c6dda483105 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:12.006841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6231c2-ea78-44c8-b930-1c6dda483105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:12.035063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-3c6231c2-ea78-44c8-b930-1c6dda483105 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:12.036267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3c6231c2-ea78-44c8-b930-1c6dda483105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:12.116568 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 153/300] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:12.252955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5513ba3-f8c2-4b2c-b4a5-7e889c5bbed5 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:12.373331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5513ba3-f8c2-4b2c-b4a5-7e889c5bbed5 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:12.382903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:12.412425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e7902-b899-4c0f-a635-ec2629eae6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:12.413110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e7902-b899-4c0f-a635-ec2629eae6d9 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:12.413392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e7902-b899-4c0f-a635-ec2629eae6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:12.413661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e7902-b899-4c0f-a635-ec2629eae6d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:12.428256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e7902-b899-4c0f-a635-ec2629eae6d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:12.433637 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-cb4e7902-b899-4c0f-a635-ec2629eae6d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:01:12.433637 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:12.433637 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:12.433637 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:12.433637 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:12.433637 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:12.433637 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:12.433637 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:12.433637 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:12.433637 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:12.433637 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:12.433637 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:12.433637 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:12.433637 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:12.433637 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:12.433637 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:12.436369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:12.436369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:12.436369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:12.436369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:12.436369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:12.436369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:12.436369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:12.436369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:12.436369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:12.436369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:12.436369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:12.436369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:12.436369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:12.436369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:12.436369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:12.436369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:12.437158 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:12.437158 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:12.437158 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:12.437158 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:12.437158 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:12.437158 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:12.437158 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:12.437158 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:12.437158 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:12.437158 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:12.437158 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:01:12.437158 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:12.437158 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 148/301] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:01:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:12.443138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6231c2-ea78-44c8-b930-1c6dda483105 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:12.474935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e7902-b899-4c0f-a635-ec2629eae6d9 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:12.563626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:12.636410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e7902-b899-4c0f-a635-ec2629eae6d9 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:12.648199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6231c2-ea78-44c8-b930-1c6dda483105 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:12.681661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18d7c9-468f-439f-9fec-93c05a9182fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:12.682333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18d7c9-468f-439f-9fec-93c05a9182fb None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:12.682612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18d7c9-468f-439f-9fec-93c05a9182fb None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:12.682882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18d7c9-468f-439f-9fec-93c05a9182fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:12.706374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18d7c9-468f-439f-9fec-93c05a9182fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:12.711324 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-7f18d7c9-468f-439f-9fec-93c05a9182fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 03:01:12.711324 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:12.711324 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:12.711324 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:12.711324 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:12.711324 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:12.711324 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:12.711324 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:12.711324 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:12.711324 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:12.711324 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:12.711324 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:12.711324 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:12.711324 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:12.711324 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:12.711324 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:12.712260 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:12.712260 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:12.712260 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:12.712260 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:12.712260 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:12.712260 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:12.712260 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:12.712260 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:12.712260 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:12.712260 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:12.712260 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:12.712260 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:12.712260 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:12.712260 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:12.712260 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:12.712260 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:12.713698 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:12.713698 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:12.713698 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:12.713698 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:12.713698 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:12.713698 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:12.713698 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:12.713698 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:12.713698 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:12.713698 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:12.713698 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 03:01:12.713698 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:12.713698 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 149/302] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 27 03:01:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:12.714690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b669065-1c9f-47a5-b608-6fe77b7d0ae0 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:12.714690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b669065-1c9f-47a5-b608-6fe77b7d0ae0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:12.714690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b669065-1c9f-47a5-b608-6fe77b7d0ae0 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:12.715149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ca874-75a5-418f-a6ef-be7841a64054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:12.716038 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 150/303] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:12.716298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ca874-75a5-418f-a6ef-be7841a64054 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:12.716726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ca874-75a5-418f-a6ef-be7841a64054 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:12.717369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ca874-75a5-418f-a6ef-be7841a64054 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:12.718253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ca874-75a5-418f-a6ef-be7841a64054 None admin] RBAC: Adding query filter params (name=member) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:12.718705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ca874-75a5-418f-a6ef-be7841a64054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:12.719899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b669065-1c9f-47a5-b608-6fe77b7d0ae0 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:12.720416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ca874-75a5-418f-a6ef-be7841a64054 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:12.731617 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 154/304] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 27 03:01:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:12.732843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0e309-8b51-40a0-9a64-6a0795429950 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:12.733127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0e309-8b51-40a0-9a64-6a0795429950 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:12.733398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0e309-8b51-40a0-9a64-6a0795429950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:12.752835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-12f0e309-8b51-40a0-9a64-6a0795429950 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:12.753608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:12.754886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-12f0e309-8b51-40a0-9a64-6a0795429950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:12.829858 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 155/305] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:12.831341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0e309-8b51-40a0-9a64-6a0795429950 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:12.855620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b669065-1c9f-47a5-b608-6fe77b7d0ae0 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:12.895101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5591d8-f198-4516-8eee-447ed5da8084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:12.896289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5591d8-f198-4516-8eee-447ed5da8084 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:12.897811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5591d8-f198-4516-8eee-447ed5da8084 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:12.898310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5591d8-f198-4516-8eee-447ed5da8084 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:12.899926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5591d8-f198-4516-8eee-447ed5da8084 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:12.901083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5591d8-f198-4516-8eee-447ed5da8084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:12.902862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5591d8-f198-4516-8eee-447ed5da8084 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:12.920102 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 151/306] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:01:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:12.926859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5591d8-f198-4516-8eee-447ed5da8084 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:12.927484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:12.989805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0e309-8b51-40a0-9a64-6a0795429950 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:13.029213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:13.040666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5591d8-f198-4516-8eee-447ed5da8084 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:13.044827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2637e-d41e-4a44-9f58-35efe7ce70a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:13.045710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2637e-d41e-4a44-9f58-35efe7ce70a2 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:13.046202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2637e-d41e-4a44-9f58-35efe7ce70a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:13.049907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2637e-d41e-4a44-9f58-35efe7ce70a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:13.088753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b90e4a-71c4-4781-a397-4fb01427e0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:13.089398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b90e4a-71c4-4781-a397-4fb01427e0ef None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:13.089686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b90e4a-71c4-4781-a397-4fb01427e0ef None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:13.089960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b90e4a-71c4-4781-a397-4fb01427e0ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:13.130592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2637e-d41e-4a44-9f58-35efe7ce70a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:13.132452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2637e-d41e-4a44-9f58-35efe7ce70a2 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:13.200129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b90e4a-71c4-4781-a397-4fb01427e0ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:13.201614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b90e4a-71c4-4781-a397-4fb01427e0ef None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:13.238572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:13.267441 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 156/307] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:01:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 03:01:13.268845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321458f-62e5-4d08-8cca-b74e45036275 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:13.269277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321458f-62e5-4d08-8cca-b74e45036275 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:13.269647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321458f-62e5-4d08-8cca-b74e45036275 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:13.271417 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 157/308] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:13.272762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321458f-62e5-4d08-8cca-b74e45036275 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:13.325035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:13.338544 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 152/309] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:01:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 03:01:13.339941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c2843-6779-4397-8df2-2145e715ee7a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:13.340177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c2843-6779-4397-8df2-2145e715ee7a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:13.340451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c2843-6779-4397-8df2-2145e715ee7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:13.367200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8d5c2843-6779-4397-8df2-2145e715ee7a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:13.368475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8d5c2843-6779-4397-8df2-2145e715ee7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:13.395808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321458f-62e5-4d08-8cca-b74e45036275 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:13.438829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f32a6-9857-41e7-be12-c09367ec36cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:13.439798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f32a6-9857-41e7-be12-c09367ec36cc None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:13.440286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f32a6-9857-41e7-be12-c09367ec36cc None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:13.440566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f32a6-9857-41e7-be12-c09367ec36cc None admin] PATH_INFO: `/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:13.442076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f32a6-9857-41e7-be12-c09367ec36cc None admin] RBAC: Authorizing `identity:get_project(project_id=cc5fad8ef92f41c9bbde916bcccc5b92)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:13.443200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f32a6-9857-41e7-be12-c09367ec36cc None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:13.445120 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 158/310] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:01:13 2022] GET /identity/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:13.445764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f32a6-9857-41e7-be12-c09367ec36cc None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:13.462281 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 153/311] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:13.463051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c2843-6779-4397-8df2-2145e715ee7a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:13.477557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:13.558064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f32a6-9857-41e7-be12-c09367ec36cc None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:13.596540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c2843-6779-4397-8df2-2145e715ee7a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:13.607052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284f246-075c-4f36-9116-1623ded60f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:13.607737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284f246-075c-4f36-9116-1623ded60f27 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:13.608025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284f246-075c-4f36-9116-1623ded60f27 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:13.608306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284f246-075c-4f36-9116-1623ded60f27 None admin] PATH_INFO: `/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:13.610249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284f246-075c-4f36-9116-1623ded60f27 None admin] RBAC: Authorizing `identity:get_project(project_id=cc5fad8ef92f41c9bbde916bcccc5b92)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:13.612374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284f246-075c-4f36-9116-1623ded60f27 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:13.614924 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 159/312] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:01:13 2022] GET /identity/v3/projects/cc5fad8ef92f41c9bbde916bcccc5b92 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:13.615851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284f246-075c-4f36-9116-1623ded60f27 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:13.628794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:13.647898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8018c-1d1c-412f-9e19-0bae9b56bb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:13.649151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8018c-1d1c-412f-9e19-0bae9b56bb5e None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:13.649614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8018c-1d1c-412f-9e19-0bae9b56bb5e None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:13.650330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8018c-1d1c-412f-9e19-0bae9b56bb5e None admin] PATH_INFO: `/v3/roles/member` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:13.666520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8018c-1d1c-412f-9e19-0bae9b56bb5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:13.672311 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-3be8018c-1d1c-412f-9e19-0bae9b56bb5e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:01:13.672311 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:13.672311 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:13.672311 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:13.672311 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:13.672311 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:13.672311 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:13.672311 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:13.672311 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:13.672311 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:13.672311 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:13.672311 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:13.672311 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:13.672311 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:13.672311 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:13.672311 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:13.673210 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:13.673210 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:13.673210 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:13.673210 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:13.673210 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:13.673210 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:13.673210 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:13.673210 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:13.673210 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:13.673210 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:13.673210 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:13.673210 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:13.673210 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:13.673210 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:13.673210 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:13.673210 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:13.673998 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:13.673998 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:13.673998 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:13.673998 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:13.673998 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:13.673998 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:13.673998 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:13.673998 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:13.673998 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:13.673998 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:13.673998 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 03:01:13.673998 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:13.682358 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 154/313] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:01:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:13.682358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8018c-1d1c-412f-9e19-0bae9b56bb5e None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:13.740457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:13.747984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284f246-075c-4f36-9116-1623ded60f27 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:13.785851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de771918-0e5e-43b8-a5d1-940b07ea18d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:13.786534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de771918-0e5e-43b8-a5d1-940b07ea18d4 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:13.786817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de771918-0e5e-43b8-a5d1-940b07ea18d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:13.787130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de771918-0e5e-43b8-a5d1-940b07ea18d4 None admin] PATH_INFO: `/v3/groups/d7dbba4f593f4f1bbca3550fd1acf0f0` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:13.788186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de771918-0e5e-43b8-a5d1-940b07ea18d4 None admin] RBAC: Authorizing `identity:get_group(group_id=d7dbba4f593f4f1bbca3550fd1acf0f0)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:13.789678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de771918-0e5e-43b8-a5d1-940b07ea18d4 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:13.794560 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 160/314] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Oct 27 03:01:13 2022] GET /identity/v3/groups/d7dbba4f593f4f1bbca3550fd1acf0f0 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:13.794560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de771918-0e5e-43b8-a5d1-940b07ea18d4 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:13.809926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8018c-1d1c-412f-9e19-0bae9b56bb5e None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:13.850180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2713d-4ead-4699-8a9e-e24e700c5aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:13.850758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2713d-4ead-4699-8a9e-e24e700c5aa4 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:13.851042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2713d-4ead-4699-8a9e-e24e700c5aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:13.851320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2713d-4ead-4699-8a9e-e24e700c5aa4 None admin] PATH_INFO: `/v3/groups/d7dbba4f593f4f1bbca3550fd1acf0f0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:13.853522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2713d-4ead-4699-8a9e-e24e700c5aa4 None admin] RBAC: Authorizing `identity:get_group(group_id=d7dbba4f593f4f1bbca3550fd1acf0f0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:13.855041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2713d-4ead-4699-8a9e-e24e700c5aa4 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:13.856816 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 155/315] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Oct 27 03:01:13 2022] GET /identity/v3/groups/d7dbba4f593f4f1bbca3550fd1acf0f0 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:13.857829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a568cd-6af6-41fa-b6e7-1a08c105f240 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:13.858172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a568cd-6af6-41fa-b6e7-1a08c105f240 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:13.858415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a568cd-6af6-41fa-b6e7-1a08c105f240 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:13.859633 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 156/316] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:13.863228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a568cd-6af6-41fa-b6e7-1a08c105f240 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:13.914902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de771918-0e5e-43b8-a5d1-940b07ea18d4 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:13.921920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:13.956133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415fef6-3df6-44b0-b714-bf65e739d071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:13.956757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415fef6-3df6-44b0-b714-bf65e739d071 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:13.957036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415fef6-3df6-44b0-b714-bf65e739d071 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:13.957310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415fef6-3df6-44b0-b714-bf65e739d071 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:13.957980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415fef6-3df6-44b0-b714-bf65e739d071 None admin] RBAC: Adding query filter params (name=member) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:13.958315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415fef6-3df6-44b0-b714-bf65e739d071 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:13.959708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415fef6-3df6-44b0-b714-bf65e739d071 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:13.969100 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 161/317] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 27 03:01:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:13.969936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415fef6-3df6-44b0-b714-bf65e739d071 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:13.981803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a568cd-6af6-41fa-b6e7-1a08c105f240 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:13.996401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:14.025955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7d188-2e3d-4342-ac1c-d69b472b058c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:14.026755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7d188-2e3d-4342-ac1c-d69b472b058c None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:14.027045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7d188-2e3d-4342-ac1c-d69b472b058c None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:14.027318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7d188-2e3d-4342-ac1c-d69b472b058c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:14.028062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7d188-2e3d-4342-ac1c-d69b472b058c None admin] RBAC: Adding query filter params (group.id=d7dbba4f593f4f1bbca3550fd1acf0f0, role.id=17fff77450b94933a5d232fb3f3221b7, scope.project.id=cc5fad8ef92f41c9bbde916bcccc5b92) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:14.028367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7d188-2e3d-4342-ac1c-d69b472b058c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:14.029812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7d188-2e3d-4342-ac1c-d69b472b058c None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:14.037441 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 157/318] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Oct 27 03:01:13 2022] GET /identity/v3/role_assignments?group.id=d7dbba4f593f4f1bbca3550fd1acf0f0&scope.project.id=cc5fad8ef92f41c9bbde916bcccc5b92&role.id=17fff77450b94933a5d232fb3f3221b7 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:14.038530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7d188-2e3d-4342-ac1c-d69b472b058c None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:14.091231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415fef6-3df6-44b0-b714-bf65e739d071 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:14.140938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132e178-ae8d-47e5-ba10-69f15861a1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:14.141496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132e178-ae8d-47e5-ba10-69f15861a1fc None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:14.141774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132e178-ae8d-47e5-ba10-69f15861a1fc None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:14.142061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132e178-ae8d-47e5-ba10-69f15861a1fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:14.155363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132e178-ae8d-47e5-ba10-69f15861a1fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:14.160793 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-f132e178-ae8d-47e5-ba10-69f15861a1fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 03:01:14.160793 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:14.160793 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:14.160793 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:14.160793 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:14.160793 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:14.160793 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:14.160793 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:14.160793 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:14.160793 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:14.160793 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:14.160793 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:14.160793 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:14.160793 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:14.160793 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:14.160793 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:14.161774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:14.161774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:14.161774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:14.161774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:14.161774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:14.161774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:14.161774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:14.161774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:14.161774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:14.161774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:14.161774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:14.161774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:14.161774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:14.161774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:14.161774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:14.161774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:14.162726 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:14.162726 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:14.162726 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:14.162726 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:14.162726 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:14.162726 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:14.162726 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:14.162726 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:14.162726 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:14.162726 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:14.162726 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 03:01:14.162726 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:14.162726 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 162/319] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 27 03:01:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:14.166347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb0c12-a826-4af9-8e7d-7dd7f33ea753 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:14.166347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb0c12-a826-4af9-8e7d-7dd7f33ea753 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:14.166347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb0c12-a826-4af9-8e7d-7dd7f33ea753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:14.190876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7d188-2e3d-4342-ac1c-d69b472b058c None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:14.194125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-89eb0c12-a826-4af9-8e7d-7dd7f33ea753 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:14.195583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-89eb0c12-a826-4af9-8e7d-7dd7f33ea753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:14.210635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:14.245073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c268bde-4527-4a04-b797-9dc167534c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:14.245908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c268bde-4527-4a04-b797-9dc167534c62 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:14.248899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c268bde-4527-4a04-b797-9dc167534c62 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:14.250507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c268bde-4527-4a04-b797-9dc167534c62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:14.251202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c268bde-4527-4a04-b797-9dc167534c62 None admin] RBAC: Adding query filter params (group.id=d7dbba4f593f4f1bbca3550fd1acf0f0, role.id=31c2fac3eedc4006a84fcd0bee6d22e8, scope.project.id=cc5fad8ef92f41c9bbde916bcccc5b92) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:14.251519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c268bde-4527-4a04-b797-9dc167534c62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:14.253371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c268bde-4527-4a04-b797-9dc167534c62 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:14.261372 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 158/320] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Oct 27 03:01:14 2022] GET /identity/v3/role_assignments?group.id=d7dbba4f593f4f1bbca3550fd1acf0f0&scope.project.id=cc5fad8ef92f41c9bbde916bcccc5b92&role.id=31c2fac3eedc4006a84fcd0bee6d22e8 => generated 611 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:14.262420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c268bde-4527-4a04-b797-9dc167534c62 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:14.288629 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 163/321] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:14.290477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb0c12-a826-4af9-8e7d-7dd7f33ea753 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:14.312697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:14.410128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c268bde-4527-4a04-b797-9dc167534c62 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:14.436526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb0c12-a826-4af9-8e7d-7dd7f33ea753 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:14.458109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a45a0-cea4-4f66-9c0f-ddea78e0a204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:14.458918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a45a0-cea4-4f66-9c0f-ddea78e0a204 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:14.459290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a45a0-cea4-4f66-9c0f-ddea78e0a204 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:14.459574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a45a0-cea4-4f66-9c0f-ddea78e0a204 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:14.494838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d6607-7a9a-485b-ab3d-ab0d6b6cef72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:14.495794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d6607-7a9a-485b-ab3d-ab0d6b6cef72 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:14.496284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d6607-7a9a-485b-ab3d-ab0d6b6cef72 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:14.496674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d6607-7a9a-485b-ab3d-ab0d6b6cef72 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:14.497385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d6607-7a9a-485b-ab3d-ab0d6b6cef72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:14.497753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d6607-7a9a-485b-ab3d-ab0d6b6cef72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:14.499256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d6607-7a9a-485b-ab3d-ab0d6b6cef72 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:14.508894 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 164/322] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:01:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:14.514569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d6607-7a9a-485b-ab3d-ab0d6b6cef72 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:14.515207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:14.549491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a45a0-cea4-4f66-9c0f-ddea78e0a204 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:14.552935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a45a0-cea4-4f66-9c0f-ddea78e0a204 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:14.606894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:14.637195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d6607-7a9a-485b-ab3d-ab0d6b6cef72 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:14.674764 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 159/323] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:01:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 03:01:14.675927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a45a0-cea4-4f66-9c0f-ddea78e0a204 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:14.682475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501ae6a-7489-4a09-a9ea-82213180b319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:14.683099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501ae6a-7489-4a09-a9ea-82213180b319 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:14.683389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501ae6a-7489-4a09-a9ea-82213180b319 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:14.683791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501ae6a-7489-4a09-a9ea-82213180b319 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:14.765837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:14.770083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501ae6a-7489-4a09-a9ea-82213180b319 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:14.771554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501ae6a-7489-4a09-a9ea-82213180b319 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:14.797590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a45a0-cea4-4f66-9c0f-ddea78e0a204 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:14.841175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562d055-19f3-49bf-a118-758ac1e8892c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:14.841821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562d055-19f3-49bf-a118-758ac1e8892c None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:14.842136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562d055-19f3-49bf-a118-758ac1e8892c None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:14.842408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562d055-19f3-49bf-a118-758ac1e8892c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:14.854708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562d055-19f3-49bf-a118-758ac1e8892c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:14.858251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:14.861808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-b562d055-19f3-49bf-a118-758ac1e8892c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:01:14.861808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:14.861808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:14.861808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:14.861808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:14.861808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:14.861808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:14.861808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:14.861808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:14.861808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:14.861808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:14.861808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:14.861808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:14.861808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:14.861808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:14.861808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:14.863016 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:14.863016 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:14.863016 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:14.863016 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:14.863016 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:14.863016 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:14.863016 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:14.863016 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:14.863016 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:14.863016 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:14.863016 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:14.863016 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:14.863016 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:14.863016 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:14.863016 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:14.863016 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:14.863803 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:14.863803 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:14.863803 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:14.863803 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:14.863803 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:14.863803 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:14.863803 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:14.863803 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:14.863803 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:14.863803 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:14.863803 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:01:14.863803 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:14.863803 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 160/324] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 27 03:01:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:14.863803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562d055-19f3-49bf-a118-758ac1e8892c None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:14.889452 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 165/325] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:01:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 27 03:01:14.890335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501ae6a-7489-4a09-a9ea-82213180b319 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:14.977541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562d055-19f3-49bf-a118-758ac1e8892c None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:14.996759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501ae6a-7489-4a09-a9ea-82213180b319 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:15.021113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ae78b-7df5-4d83-b0ae-a132443110fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:15.021751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ae78b-7df5-4d83-b0ae-a132443110fa None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:15.022051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ae78b-7df5-4d83-b0ae-a132443110fa None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:15.022358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ae78b-7df5-4d83-b0ae-a132443110fa None admin] PATH_INFO: `/v3/projects/8b5c4caaad3540288517a0fd7eff738d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:15.023472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ae78b-7df5-4d83-b0ae-a132443110fa None admin] RBAC: Authorizing `identity:get_project(project_id=8b5c4caaad3540288517a0fd7eff738d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:15.025491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ae78b-7df5-4d83-b0ae-a132443110fa None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:15.027381 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 161/326] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:01:14 2022] GET /identity/v3/projects/8b5c4caaad3540288517a0fd7eff738d => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:15.028067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ae78b-7df5-4d83-b0ae-a132443110fa None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:15.031417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:15.037607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa38362-d833-43e6-a571-9f3993e9b6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:15.042214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa38362-d833-43e6-a571-9f3993e9b6c7 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:15.042214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa38362-d833-43e6-a571-9f3993e9b6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:15.042214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa38362-d833-43e6-a571-9f3993e9b6c7 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:15.042214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa38362-d833-43e6-a571-9f3993e9b6c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:15.042214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa38362-d833-43e6-a571-9f3993e9b6c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:15.042214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa38362-d833-43e6-a571-9f3993e9b6c7 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:15.049253 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 166/327] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:01:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:15.050054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa38362-d833-43e6-a571-9f3993e9b6c7 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:15.089888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:15.126332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ae78b-7df5-4d83-b0ae-a132443110fa None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:15.147367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa38362-d833-43e6-a571-9f3993e9b6c7 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:15.158645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd70c0-8317-42c6-9786-d3d69a97059f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:15.159267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd70c0-8317-42c6-9786-d3d69a97059f None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:15.159547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd70c0-8317-42c6-9786-d3d69a97059f None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:15.159818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd70c0-8317-42c6-9786-d3d69a97059f None admin] PATH_INFO: `/v3/projects/8b5c4caaad3540288517a0fd7eff738d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:15.160920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd70c0-8317-42c6-9786-d3d69a97059f None admin] RBAC: Authorizing `identity:get_project(project_id=8b5c4caaad3540288517a0fd7eff738d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:15.162375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd70c0-8317-42c6-9786-d3d69a97059f None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:15.163988 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 162/328] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:01:15 2022] GET /identity/v3/projects/8b5c4caaad3540288517a0fd7eff738d => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:15.164778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd70c0-8317-42c6-9786-d3d69a97059f None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:15.183331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2f1df-21b6-4737-b184-ff607bc5751a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:15.184003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2f1df-21b6-4737-b184-ff607bc5751a None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:15.184287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2f1df-21b6-4737-b184-ff607bc5751a None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:15.184565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2f1df-21b6-4737-b184-ff607bc5751a None admin] PATH_INFO: `/v3/groups/d7dbba4f593f4f1bbca3550fd1acf0f0` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:15.185686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2f1df-21b6-4737-b184-ff607bc5751a None admin] RBAC: Authorizing `identity:get_group(group_id=d7dbba4f593f4f1bbca3550fd1acf0f0)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:15.187243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2f1df-21b6-4737-b184-ff607bc5751a None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:15.188896 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 167/329] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Oct 27 03:01:15 2022] GET /identity/v3/groups/d7dbba4f593f4f1bbca3550fd1acf0f0 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:15.188896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2f1df-21b6-4737-b184-ff607bc5751a None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:15.236575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:15.266463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd70c0-8317-42c6-9786-d3d69a97059f None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:15.286370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2f1df-21b6-4737-b184-ff607bc5751a None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:15.292958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:15.299205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae058c3-96f3-4349-9ee3-84b8e8f0ba3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:15.299815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae058c3-96f3-4349-9ee3-84b8e8f0ba3d None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:15.300100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae058c3-96f3-4349-9ee3-84b8e8f0ba3d None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:15.305875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae058c3-96f3-4349-9ee3-84b8e8f0ba3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:15.319100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba34e19-1a2e-4dab-a50c-e906bff78b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:15.319728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba34e19-1a2e-4dab-a50c-e906bff78b8c None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:15.320008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba34e19-1a2e-4dab-a50c-e906bff78b8c None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:15.320280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba34e19-1a2e-4dab-a50c-e906bff78b8c None admin] PATH_INFO: `/v3/groups/d7dbba4f593f4f1bbca3550fd1acf0f0` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:15.321934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba34e19-1a2e-4dab-a50c-e906bff78b8c None admin] RBAC: Authorizing `identity:get_group(group_id=d7dbba4f593f4f1bbca3550fd1acf0f0)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:15.324208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba34e19-1a2e-4dab-a50c-e906bff78b8c None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:15.325821 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 168/330] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Oct 27 03:01:15 2022] GET /identity/v3/groups/d7dbba4f593f4f1bbca3550fd1acf0f0 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:15.326695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba34e19-1a2e-4dab-a50c-e906bff78b8c None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:15.366709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae058c3-96f3-4349-9ee3-84b8e8f0ba3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:15.368716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae058c3-96f3-4349-9ee3-84b8e8f0ba3d None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:15.422844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba34e19-1a2e-4dab-a50c-e906bff78b8c None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:15.434573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:15.455312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284d95e-7cc9-4f72-a0ca-6d79331cb7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:15.455900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284d95e-7cc9-4f72-a0ca-6d79331cb7ad None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:15.456175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284d95e-7cc9-4f72-a0ca-6d79331cb7ad None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:15.456443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284d95e-7cc9-4f72-a0ca-6d79331cb7ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:15.457161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284d95e-7cc9-4f72-a0ca-6d79331cb7ad None admin] RBAC: Adding query filter params (group.id=d7dbba4f593f4f1bbca3550fd1acf0f0, role.id=17fff77450b94933a5d232fb3f3221b7, scope.project.id=8b5c4caaad3540288517a0fd7eff738d) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:15.457494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284d95e-7cc9-4f72-a0ca-6d79331cb7ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:15.458949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284d95e-7cc9-4f72-a0ca-6d79331cb7ad None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:15.463566 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 163/331] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:01:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 03:01:15.464657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae058c3-96f3-4349-9ee3-84b8e8f0ba3d None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:15.464781 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 169/332] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Oct 27 03:01:15 2022] GET /identity/v3/role_assignments?group.id=d7dbba4f593f4f1bbca3550fd1acf0f0&scope.project.id=8b5c4caaad3540288517a0fd7eff738d&role.id=17fff77450b94933a5d232fb3f3221b7 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:15.469093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284d95e-7cc9-4f72-a0ca-6d79331cb7ad None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:15.526094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:15.580310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284d95e-7cc9-4f72-a0ca-6d79331cb7ad None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:15.581875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae058c3-96f3-4349-9ee3-84b8e8f0ba3d None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:15.617637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f522a6e-46ff-4546-a796-c8b4933859e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:15.618787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f522a6e-46ff-4546-a796-c8b4933859e7 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:15.619064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f522a6e-46ff-4546-a796-c8b4933859e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:15.619331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f522a6e-46ff-4546-a796-c8b4933859e7 None admin] PATH_INFO: `/v3/projects/5e8ac2ac85cf42df9e4584993def5b4a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:15.620501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f522a6e-46ff-4546-a796-c8b4933859e7 None admin] RBAC: Authorizing `identity:get_project(project_id=5e8ac2ac85cf42df9e4584993def5b4a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:15.621985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f522a6e-46ff-4546-a796-c8b4933859e7 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:15.623096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb6ade-a9c8-4475-8465-69b9663764fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:15.623715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb6ade-a9c8-4475-8465-69b9663764fa None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:15.623998 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 170/333] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:01:15 2022] GET /identity/v3/projects/5e8ac2ac85cf42df9e4584993def5b4a => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:01:15.624102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb6ade-a9c8-4475-8465-69b9663764fa None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:15.624268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb6ade-a9c8-4475-8465-69b9663764fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:15.625013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb6ade-a9c8-4475-8465-69b9663764fa None admin] RBAC: Adding query filter params (group.id=d7dbba4f593f4f1bbca3550fd1acf0f0, role.id=31c2fac3eedc4006a84fcd0bee6d22e8, scope.project.id=8b5c4caaad3540288517a0fd7eff738d) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:15.625325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb6ade-a9c8-4475-8465-69b9663764fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:15.626791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb6ade-a9c8-4475-8465-69b9663764fa None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:15.629153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f522a6e-46ff-4546-a796-c8b4933859e7 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:15.633945 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 164/334] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Oct 27 03:01:15 2022] GET /identity/v3/role_assignments?group.id=d7dbba4f593f4f1bbca3550fd1acf0f0&scope.project.id=8b5c4caaad3540288517a0fd7eff738d&role.id=31c2fac3eedc4006a84fcd0bee6d22e8 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:15.747175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f522a6e-46ff-4546-a796-c8b4933859e7 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:15.755000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:15.786488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d4057-a164-4fa3-9b9c-dff30fb6a825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:15.787056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d4057-a164-4fa3-9b9c-dff30fb6a825 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:15.787337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d4057-a164-4fa3-9b9c-dff30fb6a825 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:15.787606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d4057-a164-4fa3-9b9c-dff30fb6a825 None admin] PATH_INFO: `/v3/groups/eb04fed6f54a4b978044864e4f1a7a33` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:15.788762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d4057-a164-4fa3-9b9c-dff30fb6a825 None admin] RBAC: Authorizing `identity:get_group(group_id=eb04fed6f54a4b978044864e4f1a7a33)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:15.790415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d4057-a164-4fa3-9b9c-dff30fb6a825 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:15.797323 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 171/335] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Oct 27 03:01:15 2022] GET /identity/v3/groups/eb04fed6f54a4b978044864e4f1a7a33 => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:01:15.798750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb6ade-a9c8-4475-8465-69b9663764fa None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:15.839169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:15.905125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb6ade-a9c8-4475-8465-69b9663764fa None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:15.938679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddc07d-3e96-47bc-b796-ed797f2ca399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:15.939289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddc07d-3e96-47bc-b796-ed797f2ca399 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:15.939569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddc07d-3e96-47bc-b796-ed797f2ca399 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:15.939841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddc07d-3e96-47bc-b796-ed797f2ca399 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:15.940568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ddc07d-3e96-47bc-b796-ed797f2ca399 None admin] RBAC: Adding query filter params (group.id=eb04fed6f54a4b978044864e4f1a7a33, role.id=6e91e7a416ac452b86ec238a2b81bc07, scope.project.id=5e8ac2ac85cf42df9e4584993def5b4a) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:15.940874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ddc07d-3e96-47bc-b796-ed797f2ca399 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:15.942348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ddc07d-3e96-47bc-b796-ed797f2ca399 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:15.948619 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 165/336] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Oct 27 03:01:15 2022] GET /identity/v3/role_assignments?group.id=eb04fed6f54a4b978044864e4f1a7a33&scope.project.id=5e8ac2ac85cf42df9e4584993def5b4a&role.id=6e91e7a416ac452b86ec238a2b81bc07 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:18.477590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78083d74-68d9-42f5-9b62-3603dd05bb33 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:18.478485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78083d74-68d9-42f5-9b62-3603dd05bb33 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:18.478925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78083d74-68d9-42f5-9b62-3603dd05bb33 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:18.480434 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 172/337] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:18.485937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335986f-9fb6-4cdc-a055-8f07e9586808 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:18.486720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335986f-9fb6-4cdc-a055-8f07e9586808 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:18.487147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335986f-9fb6-4cdc-a055-8f07e9586808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:18.518732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a335986f-9fb6-4cdc-a055-8f07e9586808 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:18.520223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a335986f-9fb6-4cdc-a055-8f07e9586808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:18.614880 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 166/338] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:18.663234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac9ca1-25bb-4b39-96d4-3e4c27229d82 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:18.663891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac9ca1-25bb-4b39-96d4-3e4c27229d82 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:18.664382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac9ca1-25bb-4b39-96d4-3e4c27229d82 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:18.666252 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 173/339] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:18.671150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13877f-a121-4187-8c90-917b25c57df3 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:18.671442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13877f-a121-4187-8c90-917b25c57df3 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:18.671722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13877f-a121-4187-8c90-917b25c57df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:18.698965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7d13877f-a121-4187-8c90-917b25c57df3 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:18.700167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7d13877f-a121-4187-8c90-917b25c57df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:18.728991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:18.796577 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 167/340] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:18.909137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf650a2f-17a5-420a-88c9-3097770c2b0a None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:18.909645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf650a2f-17a5-420a-88c9-3097770c2b0a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:18.910119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf650a2f-17a5-420a-88c9-3097770c2b0a None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:18.911860 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 174/341] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:18.917081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3d4ff-eb01-4ca8-8e68-610f6d0ec1a4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:18.917367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3d4ff-eb01-4ca8-8e68-610f6d0ec1a4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:18.917643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3d4ff-eb01-4ca8-8e68-610f6d0ec1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:18.947241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-38b3d4ff-eb01-4ca8-8e68-610f6d0ec1a4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:18.948413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-38b3d4ff-eb01-4ca8-8e68-610f6d0ec1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:19.035714 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 168/342] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:19.072610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf650a2f-17a5-420a-88c9-3097770c2b0a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:19.182747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3d4ff-eb01-4ca8-8e68-610f6d0ec1a4 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:19.212278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf650a2f-17a5-420a-88c9-3097770c2b0a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:19.271560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a91317-ee36-48b2-811a-75f2a077da8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:19.272535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a91317-ee36-48b2-811a-75f2a077da8f None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:19.272955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a91317-ee36-48b2-811a-75f2a077da8f None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:19.273381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a91317-ee36-48b2-811a-75f2a077da8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:19.284728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a91317-ee36-48b2-811a-75f2a077da8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:19.286586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a91317-ee36-48b2-811a-75f2a077da8f None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:19.302384 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-77a91317-ee36-48b2-811a-75f2a077da8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:19.302384 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:19.302384 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:19.302384 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:19.302384 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:19.302384 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:19.302384 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:19.302384 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:19.302384 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:19.302384 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:19.302384 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:19.302384 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:19.302384 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:19.302384 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:19.302384 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:19.302384 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:19.303319 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:19.303319 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:19.303319 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:19.303319 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:19.303319 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:19.303319 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:19.303319 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:19.303319 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:19.303319 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:19.303319 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:19.303319 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:19.303319 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:19.303319 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:19.303319 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:19.303319 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:19.303319 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:19.303319 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:19.304163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:19.304163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:19.304163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:19.306512 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 175/343] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:19.313484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a91317-ee36-48b2-811a-75f2a077da8f None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:19.365238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:19.366473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:19.376991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3d4ff-eb01-4ca8-8e68-610f6d0ec1a4 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:19.414990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee7321-a5dd-4c96-b973-10f2f2130217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:19.415635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee7321-a5dd-4c96-b973-10f2f2130217 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:19.415918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee7321-a5dd-4c96-b973-10f2f2130217 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:19.416191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee7321-a5dd-4c96-b973-10f2f2130217 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:19.427817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee7321-a5dd-4c96-b973-10f2f2130217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:19.430801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee7321-a5dd-4c96-b973-10f2f2130217 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:19.447539 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-cbee7321-a5dd-4c96-b973-10f2f2130217 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:19.447539 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:19.447539 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:19.447539 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:19.447539 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:19.447539 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:19.447539 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:19.447539 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:19.447539 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:19.447539 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:19.447539 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:19.447539 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:19.447539 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:19.447539 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:19.447539 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:19.447539 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:19.448675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:19.448675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:19.448675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:19.448675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:19.448675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:19.448675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:19.448675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:19.448675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:19.448675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:19.448675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:19.448675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:19.448675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:19.448675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:19.448675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:19.448675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:19.448675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:19.448675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:19.449787 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:19.449787 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:19.449787 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:19.454116 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 169/344] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:19.455146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee7321-a5dd-4c96-b973-10f2f2130217 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:19.463561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a91317-ee36-48b2-811a-75f2a077da8f None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:19.512334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c2ca6-cde7-4437-ad6c-15fcf82ee47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:19.512963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c2ca6-cde7-4437-ad6c-15fcf82ee47b None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:19.513223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c2ca6-cde7-4437-ad6c-15fcf82ee47b None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:19.513516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c2ca6-cde7-4437-ad6c-15fcf82ee47b None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:19.514200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c2ca6-cde7-4437-ad6c-15fcf82ee47b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:19.514974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c2ca6-cde7-4437-ad6c-15fcf82ee47b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:19.516657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c2ca6-cde7-4437-ad6c-15fcf82ee47b None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:19.543075 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 176/345] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:19.543075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c2ca6-cde7-4437-ad6c-15fcf82ee47b None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:19.583896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee7321-a5dd-4c96-b973-10f2f2130217 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:19.624469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fe870-156e-4283-85be-4f7a3ff407fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:19.625109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fe870-156e-4283-85be-4f7a3ff407fb None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:19.625394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fe870-156e-4283-85be-4f7a3ff407fb None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:19.625672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fe870-156e-4283-85be-4f7a3ff407fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:19.637036 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2fe870-156e-4283-85be-4f7a3ff407fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:19.638569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2fe870-156e-4283-85be-4f7a3ff407fb None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:19.640480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:19.650610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:19.654280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-8c2fe870-156e-4283-85be-4f7a3ff407fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:19.654280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:19.654280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:19.654280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:19.654280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:19.654280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:19.654280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:19.654280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:19.654280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:19.654280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:19.654280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:19.654280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:19.654280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:19.654280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:19.654280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:19.654280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:19.658964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:19.658964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:19.658964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:19.658964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:19.658964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:19.658964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:19.658964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:19.658964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:19.658964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:19.658964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:19.658964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:19.658964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:19.658964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:19.658964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:19.658964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:19.658964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:19.658964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:19.660151 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:19.660151 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:19.660151 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:19.660151 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 170/346] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:19.660151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fe870-156e-4283-85be-4f7a3ff407fb None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:19.667075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c2ca6-cde7-4437-ad6c-15fcf82ee47b None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:19.700974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e503909-b1d5-4a66-be04-cdb8a2f2c49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:19.701721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e503909-b1d5-4a66-be04-cdb8a2f2c49d None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:19.702093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e503909-b1d5-4a66-be04-cdb8a2f2c49d None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:19.702440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e503909-b1d5-4a66-be04-cdb8a2f2c49d None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:19.703162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e503909-b1d5-4a66-be04-cdb8a2f2c49d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:19.703467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e503909-b1d5-4a66-be04-cdb8a2f2c49d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:19.704915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e503909-b1d5-4a66-be04-cdb8a2f2c49d None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:19.716631 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 177/347] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:19.716631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc4b12-1801-4d56-827b-03536a2414c2 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:19.716631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc4b12-1801-4d56-827b-03536a2414c2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:19.716631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc4b12-1801-4d56-827b-03536a2414c2 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:19.716631 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 178/348] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:19.724743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc4b12-1801-4d56-827b-03536a2414c2 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:19.769113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fe870-156e-4283-85be-4f7a3ff407fb None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:19.803551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c0a8c-d42a-48f1-9ac6-ec5e07ab0e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:19.804086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c0a8c-d42a-48f1-9ac6-ec5e07ab0e58 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:19.804371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c0a8c-d42a-48f1-9ac6-ec5e07ab0e58 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:19.804648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c0a8c-d42a-48f1-9ac6-ec5e07ab0e58 None admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:19.805325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c0a8c-d42a-48f1-9ac6-ec5e07ab0e58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:19.806802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c0a8c-d42a-48f1-9ac6-ec5e07ab0e58 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:19.828549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc4b12-1801-4d56-827b-03536a2414c2 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:19.862680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dd82c-7500-4f61-9092-404284cd5526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:19.863498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dd82c-7500-4f61-9092-404284cd5526 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:19.863780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dd82c-7500-4f61-9092-404284cd5526 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:19.864102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dd82c-7500-4f61-9092-404284cd5526 None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:19.864754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249dd82c-7500-4f61-9092-404284cd5526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:19.865059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249dd82c-7500-4f61-9092-404284cd5526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:19.866518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249dd82c-7500-4f61-9092-404284cd5526 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:19.878475 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 179/349] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:19.879288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dd82c-7500-4f61-9092-404284cd5526 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:19.888047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:19.910796 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 171/350] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 27 03:01:19 2022] POST /identity/v3/users => generated 246 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:01:19.912221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d778b32-1024-44a6-92ca-d94e0588ca8c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:19.912508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d778b32-1024-44a6-92ca-d94e0588ca8c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:19.916353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d778b32-1024-44a6-92ca-d94e0588ca8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:19.943912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7d778b32-1024-44a6-92ca-d94e0588ca8c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:19.945219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7d778b32-1024-44a6-92ca-d94e0588ca8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:20.008750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dd82c-7500-4f61-9092-404284cd5526 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:20.009391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:20.038127 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 172/351] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:20.039737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d778b32-1024-44a6-92ca-d94e0588ca8c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:20.052097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d40cad-4f39-4fa5-ad37-277f8e2f49b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:20.053916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d40cad-4f39-4fa5-ad37-277f8e2f49b1 None admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:20.053916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d40cad-4f39-4fa5-ad37-277f8e2f49b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:20.053916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d40cad-4f39-4fa5-ad37-277f8e2f49b1 None admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:20.054693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d40cad-4f39-4fa5-ad37-277f8e2f49b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:20.056532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d40cad-4f39-4fa5-ad37-277f8e2f49b1 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:20.142086 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 180/352] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 27 03:01:19 2022] POST /identity/v3/users => generated 248 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:01:20.146060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e550d-6dd9-4e95-9007-32204bdf327c None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:20.146060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e550d-6dd9-4e95-9007-32204bdf327c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:20.146060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e550d-6dd9-4e95-9007-32204bdf327c None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:20.146060 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 181/353] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:20.151605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f3ec0-7a34-42bd-a99e-3a76a27c682e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:20.151899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f3ec0-7a34-42bd-a99e-3a76a27c682e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:20.152229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f3ec0-7a34-42bd-a99e-3a76a27c682e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:20.173613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d778b32-1024-44a6-92ca-d94e0588ca8c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:20.173833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d61f3ec0-7a34-42bd-a99e-3a76a27c682e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:20.175210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d61f3ec0-7a34-42bd-a99e-3a76a27c682e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:20.224739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6d010-ed11-4983-ae25-1a8648df2d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:20.225929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6d010-ed11-4983-ae25-1a8648df2d89 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:20.226425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6d010-ed11-4983-ae25-1a8648df2d89 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:20.227907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6d010-ed11-4983-ae25-1a8648df2d89 None admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:20.228837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6d010-ed11-4983-ae25-1a8648df2d89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:20.230621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6d010-ed11-4983-ae25-1a8648df2d89 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:20.255095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:20.267043 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 182/354] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:20.333710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f3ec0-7a34-42bd-a99e-3a76a27c682e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:20.345144 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 173/355] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 27 03:01:20 2022] POST /identity/v3/users => generated 248 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:01:20.461082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f3ec0-7a34-42bd-a99e-3a76a27c682e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:20.515645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7fc0c-0cfa-4fe8-8d5d-6c6c2363de2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:20.516270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7fc0c-0cfa-4fe8-8d5d-6c6c2363de2f None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:20.516555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7fc0c-0cfa-4fe8-8d5d-6c6c2363de2f None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:20.516827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7fc0c-0cfa-4fe8-8d5d-6c6c2363de2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:20.528471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7fc0c-0cfa-4fe8-8d5d-6c6c2363de2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:20.529954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7fc0c-0cfa-4fe8-8d5d-6c6c2363de2f None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:20.545613 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-47f7fc0c-0cfa-4fe8-8d5d-6c6c2363de2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:20.545613 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:20.545613 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:20.545613 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:20.545613 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:20.545613 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:20.545613 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:20.545613 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:20.545613 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:20.545613 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:20.545613 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:20.545613 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:20.545613 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:20.545613 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:20.545613 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:20.545613 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:20.546607 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:20.546607 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:20.546607 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:20.546607 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:20.546607 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:20.546607 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:20.546607 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:20.546607 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:20.546607 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:20.546607 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:20.546607 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:20.546607 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:20.546607 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:20.546607 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:20.546607 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:20.546607 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:20.546607 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:20.547483 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:20.547483 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:20.547483 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:20.547483 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 183/356] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:01:20.552836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6d010-ed11-4983-ae25-1a8648df2d89 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:20.559197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7fc0c-0cfa-4fe8-8d5d-6c6c2363de2f None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:20.601567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:20.619659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:20.674499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6d010-ed11-4983-ae25-1a8648df2d89 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:20.691010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7fc0c-0cfa-4fe8-8d5d-6c6c2363de2f None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:20.718582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b390a65-7c1e-42dd-ba18-2053376ad7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:20.719228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b390a65-7c1e-42dd-ba18-2053376ad7c8 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:20.720045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b390a65-7c1e-42dd-ba18-2053376ad7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:20.720327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b390a65-7c1e-42dd-ba18-2053376ad7c8 None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:20.721898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b390a65-7c1e-42dd-ba18-2053376ad7c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:20.724459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b390a65-7c1e-42dd-ba18-2053376ad7c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:20.724459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b390a65-7c1e-42dd-ba18-2053376ad7c8 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:20.742882 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 174/357] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:20.744715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fff5cb-1773-406f-b69c-24232a9bf046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:20.745336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fff5cb-1773-406f-b69c-24232a9bf046 None admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:20.745616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fff5cb-1773-406f-b69c-24232a9bf046 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:20.745885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fff5cb-1773-406f-b69c-24232a9bf046 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:20.746684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fff5cb-1773-406f-b69c-24232a9bf046 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:20.748674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b390a65-7c1e-42dd-ba18-2053376ad7c8 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:20.749729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fff5cb-1773-406f-b69c-24232a9bf046 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:20.837292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.sql.core [None req-a7fff5cb-1773-406f-b69c-24232a9bf046 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 27 03:01:20.837292 n-d-862769-1 devstack@keystone.service[82179]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 27 03:01:20.837292 n-d-862769-1 devstack@keystone.service[82179]: [parameters: {'id': '0acabc10e2804ef0800155aea402feb0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 27 03:01:20.837292 n-d-862769-1 devstack@keystone.service[82179]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82179) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 03:01:20.853386 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-a7fff5cb-1773-406f-b69c-24232a9bf046 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 27 03:01:20.853386 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:20.853386 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 03:01:20.853386 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 03:01:20.853386 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 03:01:20.853386 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 03:01:20.853386 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 03:01:20.853386 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 03:01:20.853386 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 03:01:20.853386 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application conn.query(q) Oct 27 03:01:20.853386 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 03:01:20.853386 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 03:01:20.853386 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 03:01:20.853386 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application result.read() Oct 27 03:01:20.853386 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 03:01:20.854335 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 03:01:20.854335 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 03:01:20.854335 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 03:01:20.854335 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 03:01:20.854335 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 03:01:20.854335 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 03:01:20.854335 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 03:01:20.854335 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 27 03:01:20.854335 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:20.854335 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 27 03:01:20.854335 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:20.854335 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:20.854335 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 27 03:01:20.854335 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 27 03:01:20.854335 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 27 03:01:20.854335 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return ref.to_dict() Oct 27 03:01:20.854335 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 03:01:20.854335 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application next(self.gen) Oct 27 03:01:20.855275 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 27 03:01:20.855275 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application yield resource Oct 27 03:01:20.855275 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 03:01:20.855275 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application next(self.gen) Oct 27 03:01:20.855275 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 27 03:01:20.855275 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.session.rollback() Oct 27 03:01:20.855275 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:01:20.855275 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.force_reraise() Oct 27 03:01:20.855275 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:01:20.855275 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise self.value Oct 27 03:01:20.855275 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 27 03:01:20.855275 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 27 03:01:20.855275 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 27 03:01:20.855275 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application session.commit() Oct 27 03:01:20.855275 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 27 03:01:20.855275 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 27 03:01:20.855275 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 27 03:01:20.856153 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._prepare_impl() Oct 27 03:01:20.856153 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 27 03:01:20.856153 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.session.flush() Oct 27 03:01:20.856153 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 03:01:20.856153 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._flush(objects) Oct 27 03:01:20.856153 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 03:01:20.856153 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 27 03:01:20.856153 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 03:01:20.856153 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application compat.raise_( Oct 27 03:01:20.856153 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 03:01:20.856153 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception Oct 27 03:01:20.856153 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 03:01:20.856153 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application flush_context.execute() Oct 27 03:01:20.856153 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 03:01:20.856153 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rec.execute(self) Oct 27 03:01:20.856153 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 03:01:20.856153 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 27 03:01:20.857036 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 03:01:20.857036 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 27 03:01:20.857036 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 27 03:01:20.857036 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 27 03:01:20.857036 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 03:01:20.857036 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 03:01:20.857036 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 03:01:20.857036 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 27 03:01:20.857036 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 03:01:20.857036 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 27 03:01:20.857036 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 03:01:20.857036 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 27 03:01:20.857036 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 03:01:20.857036 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 03:01:20.857036 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 03:01:20.857036 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception Oct 27 03:01:20.857871 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 03:01:20.857871 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 03:01:20.857871 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 03:01:20.857871 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 03:01:20.857871 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 03:01:20.857871 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 03:01:20.857871 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 03:01:20.857871 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application conn.query(q) Oct 27 03:01:20.857871 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 03:01:20.857871 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 03:01:20.857871 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 03:01:20.857871 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application result.read() Oct 27 03:01:20.857871 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 03:01:20.857871 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 03:01:20.857871 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 03:01:20.857871 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 03:01:20.860536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 03:01:20.860536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 03:01:20.860536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 03:01:20.860536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 03:01:20.860536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 27 03:01:20.860536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 27 03:01:20.860536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [parameters: {'id': '0acabc10e2804ef0800155aea402feb0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 27 03:01:20.860536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 03:01:20.860536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:20.860536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:01:20.860536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:20.860536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:20.860536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:20.860536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:20.860536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:20.860536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:20.862567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:20.862567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:20.862567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:20.862567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:20.862567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:20.862567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:20.862567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 27 03:01:20.862567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 27 03:01:20.862567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:20.862567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:20.862567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 27 03:01:20.862567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 27 03:01:20.862567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 27 03:01:20.862567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 27 03:01:20.862567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 27 03:01:20.862567 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:20.870087 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 184/358] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Oct 27 03:01:20 2022] POST /identity/v3/roles => generated 144 bytes in 307 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:01:20.870750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:20.871755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fff5cb-1773-406f-b69c-24232a9bf046 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:20.886980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b390a65-7c1e-42dd-ba18-2053376ad7c8 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:20.951899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f84a28-b1d8-4573-af4e-b9abaf9394dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:20.952691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f84a28-b1d8-4573-af4e-b9abaf9394dd None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:20.953077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f84a28-b1d8-4573-af4e-b9abaf9394dd None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:20.953455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f84a28-b1d8-4573-af4e-b9abaf9394dd None admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:20.954380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f84a28-b1d8-4573-af4e-b9abaf9394dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:20.956059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f84a28-b1d8-4573-af4e-b9abaf9394dd None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:21.011533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fff5cb-1773-406f-b69c-24232a9bf046 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:21.021250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:21.053926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe06d33-f0e4-4b55-846b-e50a46627b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:21.054617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe06d33-f0e4-4b55-846b-e50a46627b4d None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:21.054908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe06d33-f0e4-4b55-846b-e50a46627b4d None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:21.055225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe06d33-f0e4-4b55-846b-e50a46627b4d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:21.074076 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 175/359] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 27 03:01:20 2022] POST /identity/v3/users => generated 249 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:01:21.074911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe06d33-f0e4-4b55-846b-e50a46627b4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:21.080232 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-0fe06d33-f0e4-4b55-846b-e50a46627b4d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 03:01:21.080232 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:21.080232 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:21.080232 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:21.080232 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:21.080232 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:21.080232 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:21.080232 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:21.080232 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:21.080232 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:21.080232 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:21.080232 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:21.080232 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:21.080232 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:21.080232 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:21.080232 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:21.081338 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:21.081338 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:21.081338 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:21.081338 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:21.081338 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:21.081338 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:21.081338 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:21.081338 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:21.081338 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:21.081338 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:21.081338 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:21.081338 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:21.081338 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:21.081338 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:21.081338 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:21.081338 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:21.082341 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:21.082341 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:21.082341 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:21.082341 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:21.082341 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:21.082341 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:21.082341 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:21.082341 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:21.082341 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:21.082341 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:21.082341 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 03:01:21.082341 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:21.082341 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 185/360] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 27 03:01:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:01:21.088129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f84a28-b1d8-4573-af4e-b9abaf9394dd None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:21.232868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f84a28-b1d8-4573-af4e-b9abaf9394dd None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:21.286705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28780b3-3822-4909-8ef6-e889dd9508f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:21.287651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28780b3-3822-4909-8ef6-e889dd9508f5 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:21.288113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28780b3-3822-4909-8ef6-e889dd9508f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:21.288563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28780b3-3822-4909-8ef6-e889dd9508f5 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:21.289475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28780b3-3822-4909-8ef6-e889dd9508f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:21.289959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28780b3-3822-4909-8ef6-e889dd9508f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:21.291606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28780b3-3822-4909-8ef6-e889dd9508f5 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:21.302154 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 176/361] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:01:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:22.487417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbb78a-c9e7-42ca-8571-f5194cc3d6fa None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:22.487946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbb78a-c9e7-42ca-8571-f5194cc3d6fa None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:22.487946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbb78a-c9e7-42ca-8571-f5194cc3d6fa None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:22.489319 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 186/362] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:22.494699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2dba1-c66b-48b8-8b05-420f31035869 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:22.495516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2dba1-c66b-48b8-8b05-420f31035869 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:22.495995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2dba1-c66b-48b8-8b05-420f31035869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:22.523408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-93f2dba1-c66b-48b8-8b05-420f31035869 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:22.525525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-93f2dba1-c66b-48b8-8b05-420f31035869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:22.548055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:22.618726 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 177/363] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:22.965219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbb78a-c9e7-42ca-8571-f5194cc3d6fa None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:23.031728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7207b2-ac23-45de-ac24-33d91a6af1a7 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:23.032089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7207b2-ac23-45de-ac24-33d91a6af1a7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:23.032282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7207b2-ac23-45de-ac24-33d91a6af1a7 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:23.033628 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 178/364] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:01:23.038697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916401b-9966-4621-b26b-1788ca9d4820 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:23.038990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916401b-9966-4621-b26b-1788ca9d4820 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:23.039274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916401b-9966-4621-b26b-1788ca9d4820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:23.071146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6916401b-9966-4621-b26b-1788ca9d4820 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:23.072670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6916401b-9966-4621-b26b-1788ca9d4820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:23.099421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbb78a-c9e7-42ca-8571-f5194cc3d6fa None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:23.143891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c41662-4afe-402f-a8bf-c7914d807141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:23.159496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c41662-4afe-402f-a8bf-c7914d807141 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:23.159496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c41662-4afe-402f-a8bf-c7914d807141 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:23.159496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c41662-4afe-402f-a8bf-c7914d807141 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:23.159731 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 179/365] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:23.159731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786044b-5f17-4d0e-96e5-3eb373dee471 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:23.159731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786044b-5f17-4d0e-96e5-3eb373dee471 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:23.159731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786044b-5f17-4d0e-96e5-3eb373dee471 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:23.159731 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 180/366] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:23.161658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0fcd7-7995-4863-99ee-f155cb10e1f1 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:23.161957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0fcd7-7995-4863-99ee-f155cb10e1f1 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:23.162299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0fcd7-7995-4863-99ee-f155cb10e1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:23.174697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c41662-4afe-402f-a8bf-c7914d807141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:23.184864 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-c1c41662-4afe-402f-a8bf-c7914d807141 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:01:23.184864 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:23.184864 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:23.184864 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:23.184864 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:23.184864 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:23.184864 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:23.184864 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:23.184864 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:23.184864 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:23.184864 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:23.184864 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:23.184864 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:23.184864 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:23.184864 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:23.184864 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:23.185839 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:23.185839 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:23.185839 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:23.185839 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:23.185839 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:23.185839 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:23.185839 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:23.185839 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:23.185839 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:23.185839 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:23.185839 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:23.185839 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:23.185839 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:23.185839 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:23.185839 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:23.185839 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:23.186741 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:23.186741 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:23.186741 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:23.186741 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:23.186741 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:23.186741 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:23.186741 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:23.186741 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:23.186741 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:23.186741 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:23.186741 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:01:23.186741 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:23.186741 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 187/367] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 27 03:01:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:23.194626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c41662-4afe-402f-a8bf-c7914d807141 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:23.198875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3dc0fcd7-7995-4863-99ee-f155cb10e1f1 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:23.200293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3dc0fcd7-7995-4863-99ee-f155cb10e1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:23.255032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:23.273278 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 181/368] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:23.367339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c41662-4afe-402f-a8bf-c7914d807141 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:23.406130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94367f4c-721c-487d-82f3-fb47de15e110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:23.406739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94367f4c-721c-487d-82f3-fb47de15e110 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:23.407017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94367f4c-721c-487d-82f3-fb47de15e110 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:23.407290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94367f4c-721c-487d-82f3-fb47de15e110 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:23.408015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94367f4c-721c-487d-82f3-fb47de15e110 None admin] RBAC: Adding query filter params (name=service) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:23.408322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94367f4c-721c-487d-82f3-fb47de15e110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:23.409720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94367f4c-721c-487d-82f3-fb47de15e110 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:23.418332 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 188/369] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 27 03:01:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:01:23.423580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0fcd7-7995-4863-99ee-f155cb10e1f1 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:23.427354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:23.486352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94367f4c-721c-487d-82f3-fb47de15e110 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:23.553941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0fcd7-7995-4863-99ee-f155cb10e1f1 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:23.625398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40cc8c-3cda-4488-9787-c43046a8d219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:23.626059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40cc8c-3cda-4488-9787-c43046a8d219 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:23.626358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40cc8c-3cda-4488-9787-c43046a8d219 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:23.626642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40cc8c-3cda-4488-9787-c43046a8d219 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:23.642905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40cc8c-3cda-4488-9787-c43046a8d219 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:23.644497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40cc8c-3cda-4488-9787-c43046a8d219 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:23.660392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:23.661293 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-1c40cc8c-3cda-4488-9787-c43046a8d219 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:23.661293 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:23.661293 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:23.661293 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:23.661293 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:23.661293 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:23.661293 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:23.661293 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:23.661293 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:23.661293 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:23.661293 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:23.661293 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:23.661293 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:23.661293 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:23.661293 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:23.661293 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:23.662220 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:23.662220 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:23.662220 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:23.662220 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:23.662220 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:23.662220 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:23.662220 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:23.662220 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:23.662220 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:23.662220 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:23.662220 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:23.662220 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:23.662220 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:23.662220 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:23.662220 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:23.662220 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:23.662220 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:23.663067 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:23.663067 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:23.663067 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:23.663357 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 182/370] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:23.664343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40cc8c-3cda-4488-9787-c43046a8d219 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:23.672172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94367f4c-721c-487d-82f3-fb47de15e110 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:23.717497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e49bd-e23d-49cc-87de-b8f70fb8f6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:23.718244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e49bd-e23d-49cc-87de-b8f70fb8f6ec None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:23.718550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e49bd-e23d-49cc-87de-b8f70fb8f6ec None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:23.718830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e49bd-e23d-49cc-87de-b8f70fb8f6ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:23.733583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:23.733783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e49bd-e23d-49cc-87de-b8f70fb8f6ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:23.740443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-590e49bd-e23d-49cc-87de-b8f70fb8f6ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:01:23.740443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:23.740443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:23.740443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:23.740443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:23.740443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:23.740443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:23.740443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:23.740443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:23.740443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:23.740443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:23.740443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:23.740443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:23.740443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:23.740443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:23.740443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:23.747943 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:23.747943 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:23.747943 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:23.747943 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:23.747943 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:23.747943 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:23.747943 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:23.747943 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:23.747943 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:23.747943 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:23.747943 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:23.747943 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:23.747943 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:23.747943 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:23.747943 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:23.747943 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:23.748764 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:23.748764 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:23.748764 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:23.748764 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:23.748764 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:23.748764 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:23.748764 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:23.748764 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:23.748764 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:23.748764 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:23.748764 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:01:23.748764 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:23.748764 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 189/371] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 27 03:01:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:01:23.748764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e49bd-e23d-49cc-87de-b8f70fb8f6ec None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:23.786325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40cc8c-3cda-4488-9787-c43046a8d219 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:23.835481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5132e04-a50e-48bf-92de-13770040d799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:23.836811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5132e04-a50e-48bf-92de-13770040d799 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:23.837112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5132e04-a50e-48bf-92de-13770040d799 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:23.837393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5132e04-a50e-48bf-92de-13770040d799 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:23.852614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5132e04-a50e-48bf-92de-13770040d799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:23.860382 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-b5132e04-a50e-48bf-92de-13770040d799 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:01:23.860382 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:23.860382 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:23.860382 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:23.860382 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:23.860382 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:23.860382 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:23.860382 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:23.860382 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:23.860382 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:23.860382 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:23.860382 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:23.860382 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:23.860382 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:23.860382 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:23.860382 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:23.861298 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:23.861298 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:23.861298 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:23.861298 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:23.861298 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:23.861298 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:23.861298 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:23.861298 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:23.861298 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:23.861298 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:23.861298 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:23.861298 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:23.861298 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:23.861298 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:23.861298 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:23.861298 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:23.862123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:23.862123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:23.862123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:23.862123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:23.862123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:23.862123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:23.862123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:23.862123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:23.862123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:23.862123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:23.862123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:01:23.862123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:23.866118 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 183/372] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 27 03:01:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:23.867221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5132e04-a50e-48bf-92de-13770040d799 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:23.871614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e49bd-e23d-49cc-87de-b8f70fb8f6ec None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:23.918630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8810ac8-0517-4bd4-9699-94d52dbeaeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:23.919640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8810ac8-0517-4bd4-9699-94d52dbeaeec None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:23.920143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8810ac8-0517-4bd4-9699-94d52dbeaeec None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:23.920637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8810ac8-0517-4bd4-9699-94d52dbeaeec None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:23.921489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8810ac8-0517-4bd4-9699-94d52dbeaeec None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:23.922003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8810ac8-0517-4bd4-9699-94d52dbeaeec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:23.923644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8810ac8-0517-4bd4-9699-94d52dbeaeec None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:23.936346 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 190/373] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:23.937553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8810ac8-0517-4bd4-9699-94d52dbeaeec None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:23.950727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:23.980920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5132e04-a50e-48bf-92de-13770040d799 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:23.998604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:24.017770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e617337-61cb-40cc-83be-e7a62f4e7120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:24.018740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e617337-61cb-40cc-83be-e7a62f4e7120 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:24.019197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e617337-61cb-40cc-83be-e7a62f4e7120 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:24.019810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e617337-61cb-40cc-83be-e7a62f4e7120 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:24.021061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e617337-61cb-40cc-83be-e7a62f4e7120 None admin] RBAC: Adding query filter params (name=service) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:24.021941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e617337-61cb-40cc-83be-e7a62f4e7120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:24.023857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e617337-61cb-40cc-83be-e7a62f4e7120 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:24.032998 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 184/374] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 27 03:01:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:24.034103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab56585-f425-46fb-b4a4-3bbbf2dfbcd7 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:24.034396 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab56585-f425-46fb-b4a4-3bbbf2dfbcd7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:24.034676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab56585-f425-46fb-b4a4-3bbbf2dfbcd7 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:24.035899 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 185/375] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:24.036573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab56585-f425-46fb-b4a4-3bbbf2dfbcd7 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:24.047266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8810ac8-0517-4bd4-9699-94d52dbeaeec None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:24.081757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a927e8-5a22-4290-a819-d012abd40316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:24.082461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a927e8-5a22-4290-a819-d012abd40316 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:24.082745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a927e8-5a22-4290-a819-d012abd40316 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:24.083028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a927e8-5a22-4290-a819-d012abd40316 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:24.083723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a927e8-5a22-4290-a819-d012abd40316 None admin] RBAC: Adding query filter params (name=service) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:24.084000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a927e8-5a22-4290-a819-d012abd40316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:24.085372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a927e8-5a22-4290-a819-d012abd40316 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:24.098322 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 191/376] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 27 03:01:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:24.098322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a927e8-5a22-4290-a819-d012abd40316 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:24.162619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab56585-f425-46fb-b4a4-3bbbf2dfbcd7 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:24.171732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:24.203740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09eb753-6e38-4a88-a786-f0a5a4542540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:24.204377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09eb753-6e38-4a88-a786-f0a5a4542540 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:24.204901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09eb753-6e38-4a88-a786-f0a5a4542540 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:24.205017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09eb753-6e38-4a88-a786-f0a5a4542540 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:24.207858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a927e8-5a22-4290-a819-d012abd40316 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:24.212702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09eb753-6e38-4a88-a786-f0a5a4542540 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:24.214179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09eb753-6e38-4a88-a786-f0a5a4542540 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:24.227739 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-a09eb753-6e38-4a88-a786-f0a5a4542540 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 03:01:24.227739 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:24.227739 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:24.227739 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:24.227739 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:24.227739 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:24.227739 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:24.227739 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:24.227739 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:24.227739 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:24.227739 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:24.227739 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:24.227739 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:01:24.227739 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:01:24.227739 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:01:24.227739 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:01:24.228670 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:24.228670 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:24.228670 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:01:24.228670 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:24.228670 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:01:24.228670 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:24.228670 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:24.228670 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:24.228670 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:24.228670 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:24.228670 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:24.228670 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:24.228670 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:24.228670 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:24.228670 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:24.228670 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:24.228670 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:24.228670 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:24.229608 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:24.229608 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:24.229608 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:01:24.229608 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:01:24.229608 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:01:24.229608 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:01:24.229608 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:01:24.229608 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:01:24.229608 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 27 03:01:24.229608 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:24.233436 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 186/377] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Oct 27 03:01:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:24.234718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0493d-f670-49ba-920e-eebd92289cb9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:24.234987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0493d-f670-49ba-920e-eebd92289cb9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:24.235263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0493d-f670-49ba-920e-eebd92289cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:24.245429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a3158-5508-4c38-856f-c0003cc23ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:24.246077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a3158-5508-4c38-856f-c0003cc23ba8 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:24.246365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a3158-5508-4c38-856f-c0003cc23ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:24.246642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a3158-5508-4c38-856f-c0003cc23ba8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:24.253454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-82f0493d-f670-49ba-920e-eebd92289cb9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:24.254684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-82f0493d-f670-49ba-920e-eebd92289cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:24.258245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a3158-5508-4c38-856f-c0003cc23ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:24.259845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a3158-5508-4c38-856f-c0003cc23ba8 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:24.274348 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-4c0a3158-5508-4c38-856f-c0003cc23ba8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:24.274348 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:24.274348 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:24.274348 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:24.274348 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:24.274348 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:24.274348 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:24.274348 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:24.274348 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:24.274348 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:24.274348 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:24.274348 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:24.274348 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:24.274348 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:24.274348 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:24.274348 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:24.275403 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:24.275403 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:24.275403 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:24.275403 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:24.275403 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:24.275403 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:24.275403 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:24.275403 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:24.275403 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:24.275403 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:24.275403 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:24.275403 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:24.275403 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:24.275403 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:24.275403 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:24.275403 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:24.275403 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:24.276255 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:24.276255 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:24.276255 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:24.276255 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 192/378] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:24.278913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a3158-5508-4c38-856f-c0003cc23ba8 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:24.286791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:24.324274 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 187/379] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:24.338222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0493d-f670-49ba-920e-eebd92289cb9 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:24.377787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a3158-5508-4c38-856f-c0003cc23ba8 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:24.402308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:24.413271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a9d83-4f0e-44e1-a925-52171083290b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:24.413907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a9d83-4f0e-44e1-a925-52171083290b None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:24.414243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a9d83-4f0e-44e1-a925-52171083290b None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:24.415057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a9d83-4f0e-44e1-a925-52171083290b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:24.425493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a9d83-4f0e-44e1-a925-52171083290b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:24.426997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a9d83-4f0e-44e1-a925-52171083290b None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:24.441253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-9f5a9d83-4f0e-44e1-a925-52171083290b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:24.441253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:24.441253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:24.441253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:24.441253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:24.441253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:24.441253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:24.441253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:24.441253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:24.441253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:24.441253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:24.441253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:24.441253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:24.441253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:24.441253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:24.441253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:24.442364 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:24.442364 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:24.442364 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:24.442364 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:24.442364 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:24.442364 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:24.442364 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:24.442364 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:24.442364 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:24.442364 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:24.442364 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:24.442364 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:24.442364 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:24.442364 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:24.442364 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:24.442364 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:24.442364 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:24.443240 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:24.443240 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:24.443240 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:24.443240 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 193/380] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:24.443777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f618a3-6fe0-4b23-8acd-78f684815dc8 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:24.443777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f618a3-6fe0-4b23-8acd-78f684815dc8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:24.444033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f618a3-6fe0-4b23-8acd-78f684815dc8 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:24.445439 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 194/381] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:24.448610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0493d-f670-49ba-920e-eebd92289cb9 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:24.449935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f618a3-6fe0-4b23-8acd-78f684815dc8 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:24.489780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a03d88-2eee-4d45-a69d-c2edbe9a996e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:24.491853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a03d88-2eee-4d45-a69d-c2edbe9a996e None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:24.491853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a03d88-2eee-4d45-a69d-c2edbe9a996e None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:24.491853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a03d88-2eee-4d45-a69d-c2edbe9a996e None admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:24.492214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a03d88-2eee-4d45-a69d-c2edbe9a996e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:24.492502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a03d88-2eee-4d45-a69d-c2edbe9a996e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:24.494905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a03d88-2eee-4d45-a69d-c2edbe9a996e None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:24.549586 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 188/382] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Oct 27 03:01:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:24.550309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a03d88-2eee-4d45-a69d-c2edbe9a996e None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:24.572001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f618a3-6fe0-4b23-8acd-78f684815dc8 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:24.585714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:24.615312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acf18b-dc7d-4234-a95e-d0e1dd72488b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:24.616361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acf18b-dc7d-4234-a95e-d0e1dd72488b None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:24.616868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acf18b-dc7d-4234-a95e-d0e1dd72488b None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:24.617812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acf18b-dc7d-4234-a95e-d0e1dd72488b None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:24.618981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41acf18b-dc7d-4234-a95e-d0e1dd72488b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:24.619462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41acf18b-dc7d-4234-a95e-d0e1dd72488b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:24.621504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41acf18b-dc7d-4234-a95e-d0e1dd72488b None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:24.634694 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 195/383] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:24.635866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4d6bb-c5b8-48e6-9b2c-056a358fa483 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:24.636156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4d6bb-c5b8-48e6-9b2c-056a358fa483 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:24.637108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4d6bb-c5b8-48e6-9b2c-056a358fa483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:24.655449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c4b4d6bb-c5b8-48e6-9b2c-056a358fa483 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:24.656682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c4b4d6bb-c5b8-48e6-9b2c-056a358fa483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:24.666530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a03d88-2eee-4d45-a69d-c2edbe9a996e None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:24.688154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:24.701486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8602e-8b34-427a-b45b-ee5c3dc8e8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:24.702146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8602e-8b34-427a-b45b-ee5c3dc8e8ab None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:24.702452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8602e-8b34-427a-b45b-ee5c3dc8e8ab None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:24.702687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8602e-8b34-427a-b45b-ee5c3dc8e8ab None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:24.703341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8602e-8b34-427a-b45b-ee5c3dc8e8ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:24.703829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8602e-8b34-427a-b45b-ee5c3dc8e8ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:24.705120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8602e-8b34-427a-b45b-ee5c3dc8e8ab None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:24.721707 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 189/384] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:24.721707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8602e-8b34-427a-b45b-ee5c3dc8e8ab None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:24.737165 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 196/385] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:24.738183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4d6bb-c5b8-48e6-9b2c-056a358fa483 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:24.820189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:24.835616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8602e-8b34-427a-b45b-ee5c3dc8e8ab None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:24.872853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2b3ce-024e-42ff-9d2f-289538bb9f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:24.873478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2b3ce-024e-42ff-9d2f-289538bb9f40 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:24.873580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4d6bb-c5b8-48e6-9b2c-056a358fa483 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:24.873761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2b3ce-024e-42ff-9d2f-289538bb9f40 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:24.874050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2b3ce-024e-42ff-9d2f-289538bb9f40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:24.886791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2b3ce-024e-42ff-9d2f-289538bb9f40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:24.888187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2b3ce-024e-42ff-9d2f-289538bb9f40 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:24.905413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-37a2b3ce-024e-42ff-9d2f-289538bb9f40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:24.905413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:24.905413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:24.905413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:24.905413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:24.905413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:24.905413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:24.905413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:24.905413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:24.905413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:24.905413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:24.905413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:24.905413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:24.905413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:24.905413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:24.905413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:24.906477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:24.906477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:24.906477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:24.906477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:24.906477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:24.906477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:24.906477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:24.906477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:24.906477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:24.906477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:24.906477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:24.906477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:24.906477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:24.906477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:24.906477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:24.906477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:24.906477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:24.907312 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:24.907312 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:24.907312 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:24.907312 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 190/386] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:24.910770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39984a88-c42b-4a50-a47d-288b6d30ecca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:24.911075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2b3ce-024e-42ff-9d2f-289538bb9f40 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:24.911544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39984a88-c42b-4a50-a47d-288b6d30ecca None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:24.911921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39984a88-c42b-4a50-a47d-288b6d30ecca None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:24.912203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39984a88-c42b-4a50-a47d-288b6d30ecca None admin] PATH_INFO: `/v3/roles/service` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:24.922717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39984a88-c42b-4a50-a47d-288b6d30ecca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:24.927539 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-39984a88-c42b-4a50-a47d-288b6d30ecca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:01:24.927539 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:24.927539 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:24.927539 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:24.927539 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:24.927539 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:24.927539 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:24.927539 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:24.927539 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:24.927539 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:24.927539 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:24.927539 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:24.927539 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:24.927539 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:24.927539 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:24.927539 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:24.928428 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:24.928428 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:24.928428 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:24.928428 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:24.928428 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:24.928428 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:24.928428 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:24.928428 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:24.928428 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:24.928428 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:24.928428 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:24.928428 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:24.928428 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:24.928428 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:24.928428 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:24.928428 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:24.929208 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:24.929208 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:24.929208 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:24.929208 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:24.929208 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:24.929208 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:24.929208 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:24.929208 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:24.929208 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:24.929208 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:24.929208 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:01:24.929208 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:24.933655 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 197/387] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 27 03:01:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:24.934557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39984a88-c42b-4a50-a47d-288b6d30ecca None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:24.965697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:25.019113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2b3ce-024e-42ff-9d2f-289538bb9f40 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:25.039889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39984a88-c42b-4a50-a47d-288b6d30ecca None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:25.052582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983949fd-cdb8-4f73-864f-f27a19271720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:25.053225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983949fd-cdb8-4f73-864f-f27a19271720 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:25.053512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983949fd-cdb8-4f73-864f-f27a19271720 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:25.053787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983949fd-cdb8-4f73-864f-f27a19271720 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:25.061346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983949fd-cdb8-4f73-864f-f27a19271720 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:25.062861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983949fd-cdb8-4f73-864f-f27a19271720 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:25.064712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:25.073710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a6716-41fd-460d-86b9-d01ab17fdacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:25.074366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a6716-41fd-460d-86b9-d01ab17fdacd None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:25.074648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a6716-41fd-460d-86b9-d01ab17fdacd None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:25.074948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a6716-41fd-460d-86b9-d01ab17fdacd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:25.076754 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-983949fd-cdb8-4f73-864f-f27a19271720 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 27 03:01:25.076754 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:25.076754 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:25.076754 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:25.076754 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:25.076754 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:25.076754 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:25.076754 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:25.076754 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:25.076754 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:25.076754 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:25.076754 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:25.076754 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:01:25.076754 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:01:25.076754 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:01:25.076754 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:01:25.087899 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:25.087899 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:25.087899 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:01:25.087899 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:25.087899 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:01:25.087899 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:25.087899 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:25.087899 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:25.087899 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:25.087899 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:25.087899 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:25.087899 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:25.087899 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:25.087899 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:25.087899 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:25.087899 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:25.087899 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:25.087899 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:25.089021 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:25.089021 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:25.089021 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:01:25.089021 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:01:25.089021 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:01:25.089021 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:01:25.089021 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:01:25.089021 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:01:25.089021 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 27 03:01:25.089021 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:25.089021 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 191/388] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:01:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:25.089021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983949fd-cdb8-4f73-864f-f27a19271720 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:25.089679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a6716-41fd-460d-86b9-d01ab17fdacd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:25.089679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a6716-41fd-460d-86b9-d01ab17fdacd None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:25.097119 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-ff3a6716-41fd-460d-86b9-d01ab17fdacd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 03:01:25.097119 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:25.097119 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:25.097119 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:25.097119 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:25.097119 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:25.097119 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:25.097119 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:25.097119 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:25.097119 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:25.097119 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:25.097119 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:25.097119 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:01:25.097119 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:01:25.097119 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:01:25.097119 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:01:25.098224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:25.098224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:25.098224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:01:25.098224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:25.098224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:01:25.098224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:25.098224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:25.098224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:25.098224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:25.098224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:25.098224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:25.098224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:25.098224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:25.098224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:25.098224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:25.098224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:25.098224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:25.098224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:25.103835 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:25.103835 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:25.103835 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:01:25.103835 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:01:25.103835 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:01:25.103835 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:01:25.103835 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:01:25.103835 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:01:25.103835 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 03:01:25.103835 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:25.103835 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 198/389] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:01:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:25.103835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a6716-41fd-460d-86b9-d01ab17fdacd None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:25.176461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983949fd-cdb8-4f73-864f-f27a19271720 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:25.185851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:25.201759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a6716-41fd-460d-86b9-d01ab17fdacd None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:25.212175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09766287-5e0f-44cf-80f3-35c28b4e96fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:25.212879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09766287-5e0f-44cf-80f3-35c28b4e96fc None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:25.213238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09766287-5e0f-44cf-80f3-35c28b4e96fc None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:25.213587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09766287-5e0f-44cf-80f3-35c28b4e96fc None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:25.214272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09766287-5e0f-44cf-80f3-35c28b4e96fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:25.214585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09766287-5e0f-44cf-80f3-35c28b4e96fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:25.216132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09766287-5e0f-44cf-80f3-35c28b4e96fc None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:25.227558 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 192/390] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:25.230947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09766287-5e0f-44cf-80f3-35c28b4e96fc None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:25.234537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df616f-57d5-4403-9177-f177099bc0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:25.235145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df616f-57d5-4403-9177-f177099bc0f8 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:25.235419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df616f-57d5-4403-9177-f177099bc0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:25.235688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df616f-57d5-4403-9177-f177099bc0f8 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:25.236340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df616f-57d5-4403-9177-f177099bc0f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:25.236640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df616f-57d5-4403-9177-f177099bc0f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:25.238005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df616f-57d5-4403-9177-f177099bc0f8 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:25.246291 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 199/391] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 27 03:01:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:25.247048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df616f-57d5-4403-9177-f177099bc0f8 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:25.289739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:25.331105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09766287-5e0f-44cf-80f3-35c28b4e96fc None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:25.343858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df616f-57d5-4403-9177-f177099bc0f8 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:25.363712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb587ba-659b-42b3-8367-2fb209be8d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:25.364342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb587ba-659b-42b3-8367-2fb209be8d1c None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:25.364625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb587ba-659b-42b3-8367-2fb209be8d1c None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:25.364901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb587ba-659b-42b3-8367-2fb209be8d1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:25.375567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb587ba-659b-42b3-8367-2fb209be8d1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:25.376992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb587ba-659b-42b3-8367-2fb209be8d1c None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:25.377323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee6309-8833-4a10-ba56-5b5b1eea97b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:25.377919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee6309-8833-4a10-ba56-5b5b1eea97b7 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:25.378256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee6309-8833-4a10-ba56-5b5b1eea97b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:25.378527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee6309-8833-4a10-ba56-5b5b1eea97b7 None admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:25.379254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee6309-8833-4a10-ba56-5b5b1eea97b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:25.379566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee6309-8833-4a10-ba56-5b5b1eea97b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:25.380993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee6309-8833-4a10-ba56-5b5b1eea97b7 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:25.390959 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-0fb587ba-659b-42b3-8367-2fb209be8d1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:25.390959 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:25.390959 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:25.390959 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:25.390959 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:25.390959 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:25.390959 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:25.390959 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:25.390959 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:25.390959 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:25.390959 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:25.390959 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:25.390959 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:25.390959 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:25.390959 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:25.390959 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:25.391991 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:25.391991 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:25.391991 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:25.391991 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:25.391991 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:25.391991 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:25.391991 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:25.391991 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:25.391991 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:25.391991 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:25.391991 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:25.391991 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:25.391991 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:25.391991 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:25.391991 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:25.391991 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:25.391991 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:25.392883 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:25.392883 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:25.392883 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:25.392883 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 193/392] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:25.393259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb587ba-659b-42b3-8367-2fb209be8d1c None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:25.418707 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 200/393] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Oct 27 03:01:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:25.419554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee6309-8833-4a10-ba56-5b5b1eea97b7 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:25.428955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:25.489953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb587ba-659b-42b3-8367-2fb209be8d1c None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:25.500641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:25.518696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee6309-8833-4a10-ba56-5b5b1eea97b7 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:25.523494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39d16f-63ba-4b61-b2e3-6390eae41d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:25.524107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39d16f-63ba-4b61-b2e3-6390eae41d89 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:25.524390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39d16f-63ba-4b61-b2e3-6390eae41d89 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:25.524664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39d16f-63ba-4b61-b2e3-6390eae41d89 None admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:25.525390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39d16f-63ba-4b61-b2e3-6390eae41d89 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:25.525698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39d16f-63ba-4b61-b2e3-6390eae41d89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:25.527180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39d16f-63ba-4b61-b2e3-6390eae41d89 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:25.544811 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 194/394] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Oct 27 03:01:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:25.549514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39d16f-63ba-4b61-b2e3-6390eae41d89 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:25.551868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3c231-c1c4-414f-b1f5-f3878f9ad57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:25.552488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3c231-c1c4-414f-b1f5-f3878f9ad57c None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:25.552766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3c231-c1c4-414f-b1f5-f3878f9ad57c None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:25.553033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3c231-c1c4-414f-b1f5-f3878f9ad57c None admin] PATH_INFO: `/v3/projects/service` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:25.561371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3c231-c1c4-414f-b1f5-f3878f9ad57c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:25.562870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3c231-c1c4-414f-b1f5-f3878f9ad57c None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:25.574612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-d5b3c231-c1c4-414f-b1f5-f3878f9ad57c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:25.574612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:25.574612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:25.574612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:25.574612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:25.574612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:25.574612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:25.574612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:25.574612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:25.574612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:25.574612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:25.574612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:25.574612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:01:25.574612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:01:25.574612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:01:25.575493 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:01:25.575493 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:25.575493 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:25.575493 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:25.575493 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:25.575493 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:25.575493 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:25.575493 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:25.575493 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:25.575493 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:25.575493 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:25.575493 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:25.575493 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:25.575493 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:25.575493 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:25.575493 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:25.575493 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:25.576385 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:01:25.576385 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:01:25.576385 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:01:25.576385 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:01:25.576385 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:01:25.576385 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:01:25.576385 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:25.576385 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:25.576385 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 201/395] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:01:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:25.577346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3c231-c1c4-414f-b1f5-f3878f9ad57c None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:25.640122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:25.652798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39d16f-63ba-4b61-b2e3-6390eae41d89 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:25.675176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3c231-c1c4-414f-b1f5-f3878f9ad57c None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:25.686241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226aeba-e5a8-4eb3-8159-07ed689c14eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:25.686819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226aeba-e5a8-4eb3-8159-07ed689c14eb None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:25.687115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226aeba-e5a8-4eb3-8159-07ed689c14eb None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:25.687396 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226aeba-e5a8-4eb3-8159-07ed689c14eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:25.697338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226aeba-e5a8-4eb3-8159-07ed689c14eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:25.698839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226aeba-e5a8-4eb3-8159-07ed689c14eb None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:25.707290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b024a-f666-44a9-b1c0-0dda29fb6f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:25.707890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b024a-f666-44a9-b1c0-0dda29fb6f34 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:25.708173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b024a-f666-44a9-b1c0-0dda29fb6f34 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:25.708447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b024a-f666-44a9-b1c0-0dda29fb6f34 None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:25.709090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b024a-f666-44a9-b1c0-0dda29fb6f34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:25.709394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b024a-f666-44a9-b1c0-0dda29fb6f34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:25.710808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b024a-f666-44a9-b1c0-0dda29fb6f34 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:25.714656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-e226aeba-e5a8-4eb3-8159-07ed689c14eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:25.714656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:25.714656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:25.714656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:25.714656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:25.714656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:25.714656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:25.714656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:25.714656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:25.714656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:25.714656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:25.714656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:25.714656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:25.714656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:25.714656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:25.714656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:25.715524 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:25.715524 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:25.715524 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:25.715524 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:25.715524 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:25.715524 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:25.715524 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:25.715524 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:25.715524 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:25.715524 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:25.715524 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:25.715524 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:25.715524 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:25.715524 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:25.715524 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:25.715524 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:25.715524 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:25.716473 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:25.716473 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:25.716473 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:25.716473 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 195/396] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:25.716693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226aeba-e5a8-4eb3-8159-07ed689c14eb None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:25.727790 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 202/397] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:25.727790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b024a-f666-44a9-b1c0-0dda29fb6f34 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:25.740661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:25.816796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226aeba-e5a8-4eb3-8159-07ed689c14eb None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:25.822411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b024a-f666-44a9-b1c0-0dda29fb6f34 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:25.848023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:25.851205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86cd9e-5998-439d-a8f4-d596411cb887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:25.852428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86cd9e-5998-439d-a8f4-d596411cb887 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:25.852737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86cd9e-5998-439d-a8f4-d596411cb887 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:25.853011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86cd9e-5998-439d-a8f4-d596411cb887 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:25.857373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69190c-2e36-4427-810c-24ab1a8802bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:25.858082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69190c-2e36-4427-810c-24ab1a8802bc None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:25.858394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69190c-2e36-4427-810c-24ab1a8802bc None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:25.858695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69190c-2e36-4427-810c-24ab1a8802bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:25.862964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86cd9e-5998-439d-a8f4-d596411cb887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:25.865153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86cd9e-5998-439d-a8f4-d596411cb887 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:25.868852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69190c-2e36-4427-810c-24ab1a8802bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:25.870307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69190c-2e36-4427-810c-24ab1a8802bc None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:25.878676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-9e86cd9e-5998-439d-a8f4-d596411cb887 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:25.878676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:25.878676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:25.878676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:25.878676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:25.878676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:25.878676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:25.878676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:25.878676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:25.878676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:25.878676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:25.878676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:25.878676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:25.878676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:25.878676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:25.878676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:25.879580 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:25.879580 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:25.879580 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:25.879580 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:25.879580 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:25.879580 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:25.879580 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:25.879580 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:25.879580 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:25.879580 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:25.879580 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:25.879580 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:25.879580 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:25.879580 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:25.879580 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:25.879580 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:25.879580 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:25.880506 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:25.880506 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:25.880506 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:25.880506 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 196/398] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:25.880506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86cd9e-5998-439d-a8f4-d596411cb887 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:25.884985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-4d69190c-2e36-4427-810c-24ab1a8802bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:25.884985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:25.884985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:25.884985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:25.884985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:25.884985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:25.884985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:25.884985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:25.884985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:25.884985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:25.884985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:25.884985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:25.884985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:25.884985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:25.884985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:25.884985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:25.885905 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:25.885905 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:25.885905 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:25.885905 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:25.885905 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:25.885905 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:25.885905 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:25.885905 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:25.885905 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:25.885905 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:25.885905 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:25.885905 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:25.885905 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:25.885905 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:25.885905 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:25.885905 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:25.885905 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:25.886834 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:25.886834 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:25.886834 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:25.886834 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 203/399] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:25.887065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69190c-2e36-4427-810c-24ab1a8802bc None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:25.950167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:25.979227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86cd9e-5998-439d-a8f4-d596411cb887 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:25.989550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69190c-2e36-4427-810c-24ab1a8802bc None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:26.012648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566b6ec-4a23-485d-849c-382f0d3a8993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:26.013254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566b6ec-4a23-485d-849c-382f0d3a8993 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:26.013539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566b6ec-4a23-485d-849c-382f0d3a8993 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:26.013815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566b6ec-4a23-485d-849c-382f0d3a8993 None admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:26.014548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566b6ec-4a23-485d-849c-382f0d3a8993 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:26.014858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566b6ec-4a23-485d-849c-382f0d3a8993 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:26.016289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566b6ec-4a23-485d-849c-382f0d3a8993 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:26.022465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcba0c6-b0ea-4ff0-80fd-a633f7119d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:26.023062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcba0c6-b0ea-4ff0-80fd-a633f7119d74 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:26.023344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcba0c6-b0ea-4ff0-80fd-a633f7119d74 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:26.024426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcba0c6-b0ea-4ff0-80fd-a633f7119d74 None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:26.024829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcba0c6-b0ea-4ff0-80fd-a633f7119d74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:26.025133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcba0c6-b0ea-4ff0-80fd-a633f7119d74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:26.026541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcba0c6-b0ea-4ff0-80fd-a633f7119d74 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:26.034054 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 197/400] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 27 03:01:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:26.034883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566b6ec-4a23-485d-849c-382f0d3a8993 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:26.042187 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 204/401] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:26.042187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcba0c6-b0ea-4ff0-80fd-a633f7119d74 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:26.076871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:26.135947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcba0c6-b0ea-4ff0-80fd-a633f7119d74 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:26.138458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566b6ec-4a23-485d-849c-382f0d3a8993 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:26.167713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:26.171609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdd10e-7c21-42cd-99c6-67d8dd8597dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:26.172209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdd10e-7c21-42cd-99c6-67d8dd8597dc None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:26.172395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861a814-e8dc-49e4-8c93-2b01e3c1b779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:26.172603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdd10e-7c21-42cd-99c6-67d8dd8597dc None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:26.172881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdd10e-7c21-42cd-99c6-67d8dd8597dc None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:26.173007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861a814-e8dc-49e4-8c93-2b01e3c1b779 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:26.173293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861a814-e8dc-49e4-8c93-2b01e3c1b779 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:26.173521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdd10e-7c21-42cd-99c6-67d8dd8597dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:26.173606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861a814-e8dc-49e4-8c93-2b01e3c1b779 None admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:26.173822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdd10e-7c21-42cd-99c6-67d8dd8597dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:26.174235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861a814-e8dc-49e4-8c93-2b01e3c1b779 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:26.175225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdd10e-7c21-42cd-99c6-67d8dd8597dc None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:26.175665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861a814-e8dc-49e4-8c93-2b01e3c1b779 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:26.189094 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 205/402] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:26.190063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdd10e-7c21-42cd-99c6-67d8dd8597dc None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:26.249960 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 198/403] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 27 03:01:26 2022] POST /identity/v3/users => generated 247 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:01:26.250836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861a814-e8dc-49e4-8c93-2b01e3c1b779 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:26.301194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:26.305693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdd10e-7c21-42cd-99c6-67d8dd8597dc None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:26.346710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914ec18-1d2e-46ba-af68-bd218ddcbac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:26.347368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914ec18-1d2e-46ba-af68-bd218ddcbac8 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:26.347653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914ec18-1d2e-46ba-af68-bd218ddcbac8 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:26.347939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914ec18-1d2e-46ba-af68-bd218ddcbac8 None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:26.348609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914ec18-1d2e-46ba-af68-bd218ddcbac8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:26.348916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914ec18-1d2e-46ba-af68-bd218ddcbac8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:26.350378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914ec18-1d2e-46ba-af68-bd218ddcbac8 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:26.369653 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 206/404] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:26.369653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914ec18-1d2e-46ba-af68-bd218ddcbac8 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:26.370834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861a814-e8dc-49e4-8c93-2b01e3c1b779 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:26.409451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f455ec-54bf-4222-9923-52967ddcbfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:26.410195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f455ec-54bf-4222-9923-52967ddcbfa7 None admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:26.410485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f455ec-54bf-4222-9923-52967ddcbfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:26.410762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f455ec-54bf-4222-9923-52967ddcbfa7 None admin] PATH_INFO: `/v3/projects/1ae07f0abb504c298fc9893b1d8bb173/users/c20881251f2241a3a5ec2e5cf99db149/roles/248be75b0cf142299cd46440170c7972` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:26.427096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f455ec-54bf-4222-9923-52967ddcbfa7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ae07f0abb504c298fc9893b1d8bb173, user_id=c20881251f2241a3a5ec2e5cf99db149, role_id=248be75b0cf142299cd46440170c7972)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:26.428559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f455ec-54bf-4222-9923-52967ddcbfa7 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:26.474708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914ec18-1d2e-46ba-af68-bd218ddcbac8 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:26.508880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda04469-0305-4e1a-a9ac-5865dc9894e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:26.509447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda04469-0305-4e1a-a9ac-5865dc9894e6 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:26.509727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda04469-0305-4e1a-a9ac-5865dc9894e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:26.510002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda04469-0305-4e1a-a9ac-5865dc9894e6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:26.516939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda04469-0305-4e1a-a9ac-5865dc9894e6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:26.518511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda04469-0305-4e1a-a9ac-5865dc9894e6 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:26.530372 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 199/405] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:01:26 2022] PUT /identity/v3/projects/1ae07f0abb504c298fc9893b1d8bb173/users/c20881251f2241a3a5ec2e5cf99db149/roles/248be75b0cf142299cd46440170c7972 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:01:26.530656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-fda04469-0305-4e1a-a9ac-5865dc9894e6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 03:01:26.530656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:26.530656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:26.530656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:26.530656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:26.530656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:26.530656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:26.530656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:26.530656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:26.530656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:26.530656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:26.530656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:26.530656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:01:26.530656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:01:26.530656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:01:26.530656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:01:26.537837 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:26.537837 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:26.537837 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:01:26.537837 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:26.537837 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:01:26.537837 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:26.537837 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:26.537837 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:26.537837 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:26.537837 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:26.537837 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:26.537837 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:26.537837 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:26.537837 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:26.537837 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:26.537837 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:26.537837 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:26.537837 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:26.538784 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:26.538784 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:26.538784 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:01:26.538784 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:01:26.538784 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:01:26.538784 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:01:26.538784 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:01:26.538784 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:01:26.538784 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 03:01:26.538784 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:26.539332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f455ec-54bf-4222-9923-52967ddcbfa7 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:26.539404 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 207/406] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 27 03:01:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:26.539404 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda04469-0305-4e1a-a9ac-5865dc9894e6 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:26.564211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:26.590819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:26.659021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f455ec-54bf-4222-9923-52967ddcbfa7 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:26.659940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda04469-0305-4e1a-a9ac-5865dc9894e6 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:26.698704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ec88d-a5ba-4db8-bbb7-69a4bc3ce8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:26.699360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ec88d-a5ba-4db8-bbb7-69a4bc3ce8e0 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:26.699646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ec88d-a5ba-4db8-bbb7-69a4bc3ce8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:26.699920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ec88d-a5ba-4db8-bbb7-69a4bc3ce8e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:26.702814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f95e6-3d65-4345-9195-45a62427a0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:26.703449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f95e6-3d65-4345-9195-45a62427a0fd None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:26.703735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f95e6-3d65-4345-9195-45a62427a0fd None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:26.704004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f95e6-3d65-4345-9195-45a62427a0fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:26.708092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ec88d-a5ba-4db8-bbb7-69a4bc3ce8e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:26.709594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ec88d-a5ba-4db8-bbb7-69a4bc3ce8e0 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:26.711876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f95e6-3d65-4345-9195-45a62427a0fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:26.713326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f95e6-3d65-4345-9195-45a62427a0fd None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:26.723130 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-ad9ec88d-a5ba-4db8-bbb7-69a4bc3ce8e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:26.723130 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:26.723130 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:26.723130 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:26.723130 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:26.723130 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:26.723130 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:26.723130 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:26.723130 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:26.723130 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:26.723130 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:26.723130 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:26.723130 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:01:26.723130 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:01:26.723130 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:01:26.724017 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:01:26.724017 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:26.724017 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:26.724017 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:26.724017 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:26.724017 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:26.724017 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:26.724017 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:26.724017 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:26.724017 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:26.724017 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:26.724017 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:26.724017 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:26.724017 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:26.724017 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:26.724017 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:26.724017 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:26.724905 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:01:26.724905 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:01:26.724905 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:01:26.724905 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:01:26.724905 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:01:26.724905 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:01:26.724905 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:26.724905 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:26.724905 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 200/407] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:01:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:26.725423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ec88d-a5ba-4db8-bbb7-69a4bc3ce8e0 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:26.727196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-350f95e6-3d65-4345-9195-45a62427a0fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:26.727196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:26.727196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:26.727196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:26.727196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:26.727196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:26.727196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:26.727196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:26.727196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:26.727196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:26.727196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:26.727196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:26.727196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:01:26.727196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:01:26.727196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:01:26.728014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:01:26.728014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:26.728014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:26.728014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:26.728014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:26.728014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:26.728014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:26.728014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:26.728014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:26.728014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:26.728014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:26.728014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:26.728014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:26.728014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:26.728014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:26.728014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:26.728014 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:26.728857 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:01:26.728857 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:01:26.728857 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:01:26.728857 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:01:26.728857 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:01:26.728857 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:01:26.728857 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:26.728857 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:26.728857 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 208/408] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:01:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:26.731106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f95e6-3d65-4345-9195-45a62427a0fd None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:26.839994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:26.849374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:26.853702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ec88d-a5ba-4db8-bbb7-69a4bc3ce8e0 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:26.871130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f95e6-3d65-4345-9195-45a62427a0fd None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:26.890458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff4f69-0aa1-4a81-9771-fce68fe41a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:26.891101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff4f69-0aa1-4a81-9771-fce68fe41a40 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:26.891381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff4f69-0aa1-4a81-9771-fce68fe41a40 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:26.891716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff4f69-0aa1-4a81-9771-fce68fe41a40 None admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:26.892819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff4f69-0aa1-4a81-9771-fce68fe41a40 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:26.893131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff4f69-0aa1-4a81-9771-fce68fe41a40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:26.894650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff4f69-0aa1-4a81-9771-fce68fe41a40 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:26.916164 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 201/409] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Oct 27 03:01:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:26.916842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff4f69-0aa1-4a81-9771-fce68fe41a40 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:26.922081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd1dbe-d96c-46b0-8335-441ecb1d3a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:26.922983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd1dbe-d96c-46b0-8335-441ecb1d3a59 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:26.923527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd1dbe-d96c-46b0-8335-441ecb1d3a59 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:26.924000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd1dbe-d96c-46b0-8335-441ecb1d3a59 None admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:26.924919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd1dbe-d96c-46b0-8335-441ecb1d3a59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:26.926014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd1dbe-d96c-46b0-8335-441ecb1d3a59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:26.928256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd1dbe-d96c-46b0-8335-441ecb1d3a59 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:26.960462 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 209/410] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 27 03:01:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:26.960462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd1dbe-d96c-46b0-8335-441ecb1d3a59 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:27.034767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff4f69-0aa1-4a81-9771-fce68fe41a40 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:27.074581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1837ffc-093c-43de-88b6-a33ff50111ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:27.075351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1837ffc-093c-43de-88b6-a33ff50111ff None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:27.075739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1837ffc-093c-43de-88b6-a33ff50111ff None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:27.076013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1837ffc-093c-43de-88b6-a33ff50111ff None admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:27.076763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1837ffc-093c-43de-88b6-a33ff50111ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:27.077072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1837ffc-093c-43de-88b6-a33ff50111ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:27.079266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1837ffc-093c-43de-88b6-a33ff50111ff None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:27.098271 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 202/411] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 27 03:01:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:27.099502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1837ffc-093c-43de-88b6-a33ff50111ff None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:27.104223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd1dbe-d96c-46b0-8335-441ecb1d3a59 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:27.124830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:27.148459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa10cd-598e-43bf-943a-4681af998339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:27.149594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa10cd-598e-43bf-943a-4681af998339 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:27.149876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa10cd-598e-43bf-943a-4681af998339 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:27.150183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa10cd-598e-43bf-943a-4681af998339 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:27.158392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:27.162572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa10cd-598e-43bf-943a-4681af998339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:27.164221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa10cd-598e-43bf-943a-4681af998339 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:27.180569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-c1aa10cd-598e-43bf-943a-4681af998339 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:27.180569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:27.180569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:27.180569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:27.180569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:27.180569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:27.180569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:27.180569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:27.180569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:27.180569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:27.180569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:27.180569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:27.180569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:27.180569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:27.180569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:27.180569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:27.181553 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:27.181553 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:27.181553 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:27.181553 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:27.181553 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:27.181553 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:27.181553 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:27.181553 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:27.181553 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:27.181553 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:27.181553 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:27.181553 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:27.181553 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:27.181553 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:27.181553 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:27.181553 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:27.181553 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:27.182413 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:27.182413 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:27.182413 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:27.182413 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 210/412] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:27.183168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa10cd-598e-43bf-943a-4681af998339 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:27.244976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1837ffc-093c-43de-88b6-a33ff50111ff None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:27.288179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bf4f0-15ec-4fa4-b7d3-b2e4f7c6a548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:27.289136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bf4f0-15ec-4fa4-b7d3-b2e4f7c6a548 None admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:27.290108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bf4f0-15ec-4fa4-b7d3-b2e4f7c6a548 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:27.290521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bf4f0-15ec-4fa4-b7d3-b2e4f7c6a548 None admin] PATH_INFO: `/v3/projects/1ae07f0abb504c298fc9893b1d8bb173/users/c2b7050fa8404001876dbfd40e392015/roles/248be75b0cf142299cd46440170c7972` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:27.290960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa10cd-598e-43bf-943a-4681af998339 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:27.308711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790bf4f0-15ec-4fa4-b7d3-b2e4f7c6a548 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ae07f0abb504c298fc9893b1d8bb173, user_id=c2b7050fa8404001876dbfd40e392015, role_id=248be75b0cf142299cd46440170c7972)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:27.310700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790bf4f0-15ec-4fa4-b7d3-b2e4f7c6a548 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:27.326523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8808dec-8c16-4d71-85a5-a724ed8cbc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:27.327185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8808dec-8c16-4d71-85a5-a724ed8cbc5d None admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:27.327468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8808dec-8c16-4d71-85a5-a724ed8cbc5d None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:27.327749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8808dec-8c16-4d71-85a5-a724ed8cbc5d None admin] PATH_INFO: `/v3/projects/1ae07f0abb504c298fc9893b1d8bb173/users/5ec1d24520c447a38ed321f62d4f9e98/roles/248be75b0cf142299cd46440170c7972` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:27.343710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8808dec-8c16-4d71-85a5-a724ed8cbc5d None admin] RBAC: Authorizing `identity:create_grant(project_id=1ae07f0abb504c298fc9893b1d8bb173, user_id=5ec1d24520c447a38ed321f62d4f9e98, role_id=248be75b0cf142299cd46440170c7972)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:27.345227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8808dec-8c16-4d71-85a5-a724ed8cbc5d None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:27.390158 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 203/413] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:01:27 2022] PUT /identity/v3/projects/1ae07f0abb504c298fc9893b1d8bb173/users/c2b7050fa8404001876dbfd40e392015/roles/248be75b0cf142299cd46440170c7972 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:01:27.390158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bf4f0-15ec-4fa4-b7d3-b2e4f7c6a548 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:27.422973 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 211/414] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:01:27 2022] PUT /identity/v3/projects/1ae07f0abb504c298fc9893b1d8bb173/users/5ec1d24520c447a38ed321f62d4f9e98/roles/248be75b0cf142299cd46440170c7972 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:01:27.474060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:27.517176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bf4f0-15ec-4fa4-b7d3-b2e4f7c6a548 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:27.555779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dc2a2-829d-49f0-a87b-d4811acad9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:27.556409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dc2a2-829d-49f0-a87b-d4811acad9a1 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:27.556692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dc2a2-829d-49f0-a87b-d4811acad9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:27.556965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dc2a2-829d-49f0-a87b-d4811acad9a1 None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:27.557633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8dc2a2-829d-49f0-a87b-d4811acad9a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:27.557937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8dc2a2-829d-49f0-a87b-d4811acad9a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:27.559438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8dc2a2-829d-49f0-a87b-d4811acad9a1 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:27.574121 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 204/415] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:27.579504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8808dec-8c16-4d71-85a5-a724ed8cbc5d None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:27.656121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:27.733304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8808dec-8c16-4d71-85a5-a724ed8cbc5d None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:27.774863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05ced9-43eb-447f-8ddc-1b5a4ec7caad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:27.775970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05ced9-43eb-447f-8ddc-1b5a4ec7caad None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:27.776500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05ced9-43eb-447f-8ddc-1b5a4ec7caad None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:27.776970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05ced9-43eb-447f-8ddc-1b5a4ec7caad None admin] PATH_INFO: `/v3/projects/service` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:27.784247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05ced9-43eb-447f-8ddc-1b5a4ec7caad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:27.785947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05ced9-43eb-447f-8ddc-1b5a4ec7caad None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:27.798749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-ff05ced9-43eb-447f-8ddc-1b5a4ec7caad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:27.798749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:27.798749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:27.798749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:27.798749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:27.798749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:27.798749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:27.798749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:27.798749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:27.798749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:27.798749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:27.798749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:27.798749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:01:27.798749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:01:27.798749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:01:27.799614 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:01:27.799614 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:27.799614 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:27.799614 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:27.799614 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:27.799614 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:27.799614 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:27.799614 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:27.799614 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:27.799614 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:27.799614 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:27.799614 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:27.799614 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:27.799614 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:27.799614 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:27.799614 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:27.799614 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:27.800455 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:01:27.800455 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:01:27.800455 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:01:27.800455 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:01:27.800455 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:01:27.800455 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:01:27.800455 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:27.800455 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:27.802795 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 212/416] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:01:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:27.808341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dc2a2-829d-49f0-a87b-d4811acad9a1 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:27.936833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dc2a2-829d-49f0-a87b-d4811acad9a1 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:27.971458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:27.982467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fe171-1f7d-42c5-a7cc-4cd06049735f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:27.983082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fe171-1f7d-42c5-a7cc-4cd06049735f None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:27.984300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fe171-1f7d-42c5-a7cc-4cd06049735f None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:27.984300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fe171-1f7d-42c5-a7cc-4cd06049735f None admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:27.984300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fe171-1f7d-42c5-a7cc-4cd06049735f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:27.984598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fe171-1f7d-42c5-a7cc-4cd06049735f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:27.986050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fe171-1f7d-42c5-a7cc-4cd06049735f None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:28.001247 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 205/417] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 27 03:01:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:28.007130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05ced9-43eb-447f-8ddc-1b5a4ec7caad None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:28.162907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:28.166121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05ced9-43eb-447f-8ddc-1b5a4ec7caad None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:28.217341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee7a4b-ea6e-404a-98af-df29e1aaf10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:28.224563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee7a4b-ea6e-404a-98af-df29e1aaf10a None admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:28.224563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee7a4b-ea6e-404a-98af-df29e1aaf10a None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:28.224563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee7a4b-ea6e-404a-98af-df29e1aaf10a None admin] PATH_INFO: `/v3/projects/1ae07f0abb504c298fc9893b1d8bb173/users/9b359391fbc34c259d987e42e8826c86/roles/248be75b0cf142299cd46440170c7972` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:28.240215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee7a4b-ea6e-404a-98af-df29e1aaf10a None admin] RBAC: Authorizing `identity:create_grant(project_id=1ae07f0abb504c298fc9893b1d8bb173, user_id=9b359391fbc34c259d987e42e8826c86, role_id=248be75b0cf142299cd46440170c7972)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:28.241863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee7a4b-ea6e-404a-98af-df29e1aaf10a None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:28.317117 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 213/418] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:01:28 2022] PUT /identity/v3/projects/1ae07f0abb504c298fc9893b1d8bb173/users/9b359391fbc34c259d987e42e8826c86/roles/248be75b0cf142299cd46440170c7972 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:01:28.710894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf95585-b1db-4f15-8a54-0464ca83218a None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:28.712081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf95585-b1db-4f15-8a54-0464ca83218a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:28.712557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf95585-b1db-4f15-8a54-0464ca83218a None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:28.714401 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 206/419] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:28.723534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b984ec6-43e4-4e8a-a34b-ec95e519f88e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:28.724116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b984ec6-43e4-4e8a-a34b-ec95e519f88e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:28.724582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b984ec6-43e4-4e8a-a34b-ec95e519f88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:28.745601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0b984ec6-43e4-4e8a-a34b-ec95e519f88e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:28.747635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0b984ec6-43e4-4e8a-a34b-ec95e519f88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:28.830137 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 214/420] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:28.894717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4614cdf-8652-4c72-a407-bd47e7948536 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:28.895636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4614cdf-8652-4c72-a407-bd47e7948536 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:28.896103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4614cdf-8652-4c72-a407-bd47e7948536 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:28.897896 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 207/421] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:28.903336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e04e2-572d-4aab-88b9-b415257473bc None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:28.903847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e04e2-572d-4aab-88b9-b415257473bc None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:28.904310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e04e2-572d-4aab-88b9-b415257473bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:28.923340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0f1e04e2-572d-4aab-88b9-b415257473bc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:28.924820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0f1e04e2-572d-4aab-88b9-b415257473bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:29.012719 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 215/422] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:29.176234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4614cdf-8652-4c72-a407-bd47e7948536 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:29.350806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4614cdf-8652-4c72-a407-bd47e7948536 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:29.374529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e04e2-572d-4aab-88b9-b415257473bc None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:29.390058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:29.402390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2aac3-84a7-44c3-9614-9cf63da379e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:29.403030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2aac3-84a7-44c3-9614-9cf63da379e5 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:29.403309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2aac3-84a7-44c3-9614-9cf63da379e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:29.403583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2aac3-84a7-44c3-9614-9cf63da379e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:29.426586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2aac3-84a7-44c3-9614-9cf63da379e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:29.434262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-7ff2aac3-84a7-44c3-9614-9cf63da379e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:01:29.434262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:29.434262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:29.434262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:29.434262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:29.434262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:29.434262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:29.434262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:29.434262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:29.434262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:29.434262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:29.434262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:29.434262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:29.434262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:29.434262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:29.434262 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:29.435142 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:29.435142 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:29.435142 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:29.435142 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:29.435142 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:29.435142 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:29.435142 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:29.435142 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:29.435142 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:29.435142 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:29.435142 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:29.435142 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:29.435142 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:29.435142 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:29.435142 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:29.435142 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:29.435937 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:29.435937 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:29.435937 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:29.435937 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:29.435937 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:29.435937 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:29.435937 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:29.435937 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:29.435937 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:29.435937 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:29.435937 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:01:29.435937 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:29.436536 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 208/423] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 27 03:01:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:29.441984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2aac3-84a7-44c3-9614-9cf63da379e5 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:29.543894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:29.550888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e04e2-572d-4aab-88b9-b415257473bc None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:29.614252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2aac3-84a7-44c3-9614-9cf63da379e5 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:29.622649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9843a95-1213-40eb-94e2-d979c720e839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:29.623306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9843a95-1213-40eb-94e2-d979c720e839 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:29.623583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9843a95-1213-40eb-94e2-d979c720e839 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:29.623852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9843a95-1213-40eb-94e2-d979c720e839 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:29.654782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9843a95-1213-40eb-94e2-d979c720e839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:29.662662 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-c9843a95-1213-40eb-94e2-d979c720e839 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:01:29.662662 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:29.662662 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:29.662662 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:29.662662 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:29.662662 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:29.662662 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:29.662662 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:29.662662 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:29.662662 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:29.662662 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:29.662662 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:29.662662 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:29.662662 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:29.662662 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:29.662662 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:29.663576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:29.663576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:29.663576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:29.663576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:29.663576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:29.663576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:29.663576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:29.663576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:29.663576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:29.663576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:29.663576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:29.663576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:29.663576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:29.663576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:29.663576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:29.663576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:29.664401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:29.664401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:29.664401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:29.664401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:29.664401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:29.664401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:29.664401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:29.664401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:29.664401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:29.664401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:29.664401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:01:29.664401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:29.664401 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 216/424] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 27 03:01:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:01:29.665062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14292ba4-affb-4c4e-a913-4a313ce5283d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:29.665638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14292ba4-affb-4c4e-a913-4a313ce5283d None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:29.665638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14292ba4-affb-4c4e-a913-4a313ce5283d None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:29.665923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14292ba4-affb-4c4e-a913-4a313ce5283d None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:29.670075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14292ba4-affb-4c4e-a913-4a313ce5283d None admin] RBAC: Adding query filter params (name=service) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:29.670075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14292ba4-affb-4c4e-a913-4a313ce5283d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:29.670075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14292ba4-affb-4c4e-a913-4a313ce5283d None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:29.670549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9843a95-1213-40eb-94e2-d979c720e839 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:29.687395 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 209/425] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 27 03:01:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:29.692094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14292ba4-affb-4c4e-a913-4a313ce5283d None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:29.800716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:29.860008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9843a95-1213-40eb-94e2-d979c720e839 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:29.886329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14292ba4-affb-4c4e-a913-4a313ce5283d None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:29.896224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:29.913683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27345f-bcff-4593-8b10-b5a2dc7735a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:29.914860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27345f-bcff-4593-8b10-b5a2dc7735a3 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:29.915148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27345f-bcff-4593-8b10-b5a2dc7735a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:29.915424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27345f-bcff-4593-8b10-b5a2dc7735a3 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:29.916102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27345f-bcff-4593-8b10-b5a2dc7735a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:29.916409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27345f-bcff-4593-8b10-b5a2dc7735a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:29.917810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27345f-bcff-4593-8b10-b5a2dc7735a3 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:29.923798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec687071-ebfc-4033-ab1d-e1b500123f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:29.924440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec687071-ebfc-4033-ab1d-e1b500123f5f None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:29.924723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec687071-ebfc-4033-ab1d-e1b500123f5f None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:29.924992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec687071-ebfc-4033-ab1d-e1b500123f5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:29.927467 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 217/426] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 27 03:01:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:29.934714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27345f-bcff-4593-8b10-b5a2dc7735a3 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:29.937497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec687071-ebfc-4033-ab1d-e1b500123f5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:29.939996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec687071-ebfc-4033-ab1d-e1b500123f5f None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:29.956395 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-ec687071-ebfc-4033-ab1d-e1b500123f5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:29.956395 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:29.956395 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:29.956395 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:29.956395 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:29.956395 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:29.956395 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:29.956395 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:29.956395 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:29.956395 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:29.956395 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:29.956395 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:29.956395 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:29.956395 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:29.956395 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:29.956395 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:29.957346 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:29.957346 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:29.957346 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:29.957346 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:29.957346 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:29.957346 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:29.957346 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:29.957346 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:29.957346 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:29.957346 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:29.957346 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:29.957346 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:29.957346 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:29.957346 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:29.957346 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:29.957346 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:29.957346 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:29.958237 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:29.958237 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:29.958237 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:29.970066 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 210/427] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:29.970066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec687071-ebfc-4033-ab1d-e1b500123f5f None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:30.082062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec687071-ebfc-4033-ab1d-e1b500123f5f None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:30.115991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd6475-ccbf-43b6-ac69-8feeb2a834e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:30.116890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd6475-ccbf-43b6-ac69-8feeb2a834e1 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:30.117785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd6475-ccbf-43b6-ac69-8feeb2a834e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:30.118113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd6475-ccbf-43b6-ac69-8feeb2a834e1 None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:30.118860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd6475-ccbf-43b6-ac69-8feeb2a834e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:30.119172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd6475-ccbf-43b6-ac69-8feeb2a834e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:30.122047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd6475-ccbf-43b6-ac69-8feeb2a834e1 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:30.134791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27345f-bcff-4593-8b10-b5a2dc7735a3 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:30.142120 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 211/428] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:01:30.142120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd6475-ccbf-43b6-ac69-8feeb2a834e1 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:30.171847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:30.180294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:30.196685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab583bbf-16ff-4a4f-b526-88d4aabd8fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:30.197575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab583bbf-16ff-4a4f-b526-88d4aabd8fe7 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:30.198010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab583bbf-16ff-4a4f-b526-88d4aabd8fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:30.198976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab583bbf-16ff-4a4f-b526-88d4aabd8fe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:30.213310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab583bbf-16ff-4a4f-b526-88d4aabd8fe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:30.215249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab583bbf-16ff-4a4f-b526-88d4aabd8fe7 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:30.232333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-ab583bbf-16ff-4a4f-b526-88d4aabd8fe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:30.232333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:30.232333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:30.232333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:30.232333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:30.232333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:30.232333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:30.232333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:30.232333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:30.232333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:30.232333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:30.232333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:30.232333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:30.232333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:30.232333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:30.232333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:30.238988 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:30.238988 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:30.238988 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:30.238988 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:30.238988 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:30.238988 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:30.238988 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:30.238988 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:30.238988 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:30.238988 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:30.238988 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:30.238988 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:30.238988 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:30.238988 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:30.238988 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:30.238988 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:30.238988 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:30.243333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:30.243333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:30.243333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:30.243333 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 218/429] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:30.243333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb1495-6fa4-4369-896e-ae50ea54a618 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:30.243333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb1495-6fa4-4369-896e-ae50ea54a618 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:30.243333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb1495-6fa4-4369-896e-ae50ea54a618 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:30.243333 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 219/430] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:30.243333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b07e6-df79-4eff-a0c0-938bbe34600b None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:30.244325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b07e6-df79-4eff-a0c0-938bbe34600b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:30.244325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b07e6-df79-4eff-a0c0-938bbe34600b None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:30.244325 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 220/431] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:30.244325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b07e6-df79-4eff-a0c0-938bbe34600b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:30.255272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd6475-ccbf-43b6-ac69-8feeb2a834e1 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:30.290212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0e98b-6ee9-4e61-bc09-9154529ff8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:30.290846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0e98b-6ee9-4e61-bc09-9154529ff8db None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:30.291126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0e98b-6ee9-4e61-bc09-9154529ff8db None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:30.291404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0e98b-6ee9-4e61-bc09-9154529ff8db None admin] PATH_INFO: `/v3/users/swift` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:30.298336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0e98b-6ee9-4e61-bc09-9154529ff8db None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:30.299773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0e98b-6ee9-4e61-bc09-9154529ff8db None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:30.311373 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-f9f0e98b-6ee9-4e61-bc09-9154529ff8db None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 03:01:30.311373 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:30.311373 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:30.311373 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:30.311373 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:30.311373 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:30.311373 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:30.311373 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:30.311373 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:30.311373 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:30.311373 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:30.311373 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:30.311373 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:01:30.311373 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:01:30.311373 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:01:30.311373 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:01:30.312265 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:30.312265 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:30.312265 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:01:30.312265 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:30.312265 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:01:30.312265 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:30.312265 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:30.312265 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:30.312265 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:30.312265 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:30.312265 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:30.312265 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:30.312265 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:30.312265 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:30.312265 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:30.312265 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:30.312265 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:30.312265 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:30.313141 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:30.313141 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:30.313141 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:01:30.313141 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:01:30.313141 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:01:30.313141 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:01:30.313141 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:01:30.313141 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:01:30.313141 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 27 03:01:30.313141 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:30.313141 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 212/432] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 27 03:01:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:01:30.313701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a56ae4-5c70-492a-a965-356720fae05c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:30.314157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a56ae4-5c70-492a-a965-356720fae05c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:30.314157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a56ae4-5c70-492a-a965-356720fae05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:30.332972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-84a56ae4-5c70-492a-a965-356720fae05c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:30.334171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-84a56ae4-5c70-492a-a965-356720fae05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:30.360778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b07e6-df79-4eff-a0c0-938bbe34600b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:30.396907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a90db-5fca-4dbd-91fe-afc9dedfc1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:30.397751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a90db-5fca-4dbd-91fe-afc9dedfc1f6 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:30.398127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a90db-5fca-4dbd-91fe-afc9dedfc1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:30.398526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a90db-5fca-4dbd-91fe-afc9dedfc1f6 None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:30.399153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a90db-5fca-4dbd-91fe-afc9dedfc1f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:30.399454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a90db-5fca-4dbd-91fe-afc9dedfc1f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:30.400200 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 213/433] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:30.401372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267aa73f-859a-4251-abf4-9598d14ef9d0 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:30.401662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267aa73f-859a-4251-abf4-9598d14ef9d0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:30.401932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267aa73f-859a-4251-abf4-9598d14ef9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:30.406783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a90db-5fca-4dbd-91fe-afc9dedfc1f6 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:30.424458 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 221/434] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:30.424458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a90db-5fca-4dbd-91fe-afc9dedfc1f6 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:30.432169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-267aa73f-859a-4251-abf4-9598d14ef9d0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:30.433913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-267aa73f-859a-4251-abf4-9598d14ef9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:30.462404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:30.478064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:30.526176 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 214/435] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:30.527385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267aa73f-859a-4251-abf4-9598d14ef9d0 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:30.559032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a90db-5fca-4dbd-91fe-afc9dedfc1f6 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:30.616212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0363d59-75e2-4c07-81f4-64c35ed71780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:30.617383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0363d59-75e2-4c07-81f4-64c35ed71780 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:30.618387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0363d59-75e2-4c07-81f4-64c35ed71780 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:30.618846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0363d59-75e2-4c07-81f4-64c35ed71780 None admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:30.619769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0363d59-75e2-4c07-81f4-64c35ed71780 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:30.620321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0363d59-75e2-4c07-81f4-64c35ed71780 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:30.622057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0363d59-75e2-4c07-81f4-64c35ed71780 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:30.648931 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 222/436] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Oct 27 03:01:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:30.655763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0363d59-75e2-4c07-81f4-64c35ed71780 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:30.711953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267aa73f-859a-4251-abf4-9598d14ef9d0 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:30.749636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b09b28-5851-4d01-b90e-5267393839f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:30.750433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b09b28-5851-4d01-b90e-5267393839f7 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:30.750782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b09b28-5851-4d01-b90e-5267393839f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:30.751164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b09b28-5851-4d01-b90e-5267393839f7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:30.759245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b09b28-5851-4d01-b90e-5267393839f7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:30.760875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b09b28-5851-4d01-b90e-5267393839f7 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:30.764268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:30.774672 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-f2b09b28-5851-4d01-b90e-5267393839f7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 03:01:30.774672 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:30.774672 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:30.774672 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:30.774672 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:30.774672 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:30.774672 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:30.774672 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:30.774672 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:30.774672 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:30.774672 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:30.774672 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:30.774672 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:01:30.774672 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:01:30.774672 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:01:30.774672 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:01:30.775561 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:30.775561 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:30.775561 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:01:30.775561 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:30.775561 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:01:30.775561 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:30.775561 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:30.775561 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:30.775561 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:30.775561 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:30.775561 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:30.775561 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:30.775561 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:30.775561 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:30.775561 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:30.775561 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:30.775561 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:30.775561 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:30.776477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:30.776477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:30.776477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:01:30.776477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:01:30.776477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:01:30.776477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:01:30.776477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:01:30.776477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:01:30.776477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 27 03:01:30.776477 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:30.778914 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 215/437] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Oct 27 03:01:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:30.779957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b09b28-5851-4d01-b90e-5267393839f7 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:30.786832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0363d59-75e2-4c07-81f4-64c35ed71780 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:30.788398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:30.831418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286f597-c025-4e32-a616-0388b6e3a09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:30.832093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286f597-c025-4e32-a616-0388b6e3a09c None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:30.832317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286f597-c025-4e32-a616-0388b6e3a09c None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:30.832592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286f597-c025-4e32-a616-0388b6e3a09c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:30.845217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286f597-c025-4e32-a616-0388b6e3a09c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:30.847077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286f597-c025-4e32-a616-0388b6e3a09c None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:30.866542 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-c286f597-c025-4e32-a616-0388b6e3a09c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:30.866542 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:30.866542 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:30.866542 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:30.866542 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:30.866542 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:30.866542 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:30.866542 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:30.866542 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:30.866542 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:30.866542 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:30.866542 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:30.866542 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:30.866542 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:30.866542 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:30.866542 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:30.868203 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:30.868203 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:30.868203 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:30.868203 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:30.868203 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:30.868203 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:30.868203 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:30.868203 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:30.868203 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:30.868203 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:30.868203 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:30.868203 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:30.868203 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:30.868203 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:30.868203 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:30.868203 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:30.868203 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:30.869228 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:30.869228 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:30.869228 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:30.870882 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 223/438] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:01:30.871816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286f597-c025-4e32-a616-0388b6e3a09c None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:30.890403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b09b28-5851-4d01-b90e-5267393839f7 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:30.928973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551dd3f-53d6-4cd5-898e-328ef2194a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:30.930340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551dd3f-53d6-4cd5-898e-328ef2194a99 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:30.930634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551dd3f-53d6-4cd5-898e-328ef2194a99 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:30.930920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551dd3f-53d6-4cd5-898e-328ef2194a99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:30.941488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551dd3f-53d6-4cd5-898e-328ef2194a99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:30.946873 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-2551dd3f-53d6-4cd5-898e-328ef2194a99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:01:30.946873 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:30.946873 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:30.946873 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:30.946873 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:30.946873 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:30.946873 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:30.946873 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:30.946873 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:30.946873 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:30.946873 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:30.946873 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:30.946873 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:30.946873 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:30.946873 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:30.946873 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:30.947755 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:30.947755 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:30.947755 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:30.947755 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:30.947755 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:30.947755 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:30.947755 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:30.947755 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:30.947755 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:30.947755 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:30.947755 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:30.947755 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:30.947755 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:30.947755 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:30.947755 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:30.947755 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:30.948629 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:30.948629 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:30.948629 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:30.948629 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:30.948629 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:30.948629 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:30.948629 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:30.948629 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:30.948629 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:30.948629 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:30.948629 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:01:30.948629 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:30.948629 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 216/439] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 27 03:01:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:30.949284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551dd3f-53d6-4cd5-898e-328ef2194a99 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:30.983818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286f597-c025-4e32-a616-0388b6e3a09c None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:31.015140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:31.024111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7da7a-9117-46e6-9c14-419e135a7000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:31.024899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7da7a-9117-46e6-9c14-419e135a7000 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:31.029896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7da7a-9117-46e6-9c14-419e135a7000 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:31.029896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7da7a-9117-46e6-9c14-419e135a7000 None admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:31.029896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7da7a-9117-46e6-9c14-419e135a7000 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:31.029896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7da7a-9117-46e6-9c14-419e135a7000 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:31.029896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7da7a-9117-46e6-9c14-419e135a7000 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:31.049705 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 224/440] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Oct 27 03:01:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:31.051086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7da7a-9117-46e6-9c14-419e135a7000 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:31.060115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551dd3f-53d6-4cd5-898e-328ef2194a99 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:31.070053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:31.094087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36652521-65d1-44f7-8133-a7545c6f99df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:31.094728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36652521-65d1-44f7-8133-a7545c6f99df None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:31.095013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36652521-65d1-44f7-8133-a7545c6f99df None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:31.095290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36652521-65d1-44f7-8133-a7545c6f99df None admin] PATH_INFO: `/v3/roles/service` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:31.106363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36652521-65d1-44f7-8133-a7545c6f99df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:31.112291 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-36652521-65d1-44f7-8133-a7545c6f99df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:01:31.112291 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:31.112291 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:31.112291 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:31.112291 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:31.112291 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:31.112291 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:31.112291 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:31.112291 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:31.112291 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:31.112291 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:31.112291 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:31.112291 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:31.112291 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:31.112291 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:31.112291 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:31.113329 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:31.113329 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:31.113329 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:31.113329 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:31.113329 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:31.113329 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:31.113329 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:31.113329 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:31.113329 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:31.113329 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:31.113329 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:31.113329 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:31.113329 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:31.113329 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:31.113329 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:31.113329 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:31.114489 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:31.114489 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:31.114489 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:31.114489 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:31.114489 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:31.114489 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:31.114489 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:31.114489 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:31.114489 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:31.114489 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:31.114489 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:01:31.114489 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:31.114489 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 217/441] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 27 03:01:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:31.114489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36652521-65d1-44f7-8133-a7545c6f99df None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:31.157729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7da7a-9117-46e6-9c14-419e135a7000 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:31.195086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf42ce5-714a-444d-89ca-6e78b62b0d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:31.195701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf42ce5-714a-444d-89ca-6e78b62b0d3a None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:31.195987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf42ce5-714a-444d-89ca-6e78b62b0d3a None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:31.196264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf42ce5-714a-444d-89ca-6e78b62b0d3a None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:31.196912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf42ce5-714a-444d-89ca-6e78b62b0d3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:31.197248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf42ce5-714a-444d-89ca-6e78b62b0d3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:31.198671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf42ce5-714a-444d-89ca-6e78b62b0d3a None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:31.209881 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 225/442] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:31.210716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf42ce5-714a-444d-89ca-6e78b62b0d3a None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:31.228174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36652521-65d1-44f7-8133-a7545c6f99df None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:31.247536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:31.261351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c62cc-52fa-4338-8920-fe6207164568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:31.265094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c62cc-52fa-4338-8920-fe6207164568 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:31.265094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c62cc-52fa-4338-8920-fe6207164568 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:31.265094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c62cc-52fa-4338-8920-fe6207164568 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:31.265094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c62cc-52fa-4338-8920-fe6207164568 None admin] RBAC: Adding query filter params (name=service) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:31.265094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c62cc-52fa-4338-8920-fe6207164568 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:31.265094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c62cc-52fa-4338-8920-fe6207164568 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:31.273267 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 218/443] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 27 03:01:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:31.275044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8195eea-45c3-4aad-bdc1-d68bf905cc14 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:31.275330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8195eea-45c3-4aad-bdc1-d68bf905cc14 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:31.275605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8195eea-45c3-4aad-bdc1-d68bf905cc14 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:31.278072 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 219/444] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:31.278214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8195eea-45c3-4aad-bdc1-d68bf905cc14 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:31.286642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:31.319327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf42ce5-714a-444d-89ca-6e78b62b0d3a None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:31.356279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8d26d-526e-412e-a71e-4ce45a661559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:31.356894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8d26d-526e-412e-a71e-4ce45a661559 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:31.357177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8d26d-526e-412e-a71e-4ce45a661559 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:31.357454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8d26d-526e-412e-a71e-4ce45a661559 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:31.387550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8195eea-45c3-4aad-bdc1-d68bf905cc14 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:31.422109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98f8c4-cc63-4def-8709-851226bd6c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:31.422713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98f8c4-cc63-4def-8709-851226bd6c74 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:31.422993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98f8c4-cc63-4def-8709-851226bd6c74 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:31.423262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98f8c4-cc63-4def-8709-851226bd6c74 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:31.423917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98f8c4-cc63-4def-8709-851226bd6c74 None admin] RBAC: Adding query filter params (name=service) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:31.424219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98f8c4-cc63-4def-8709-851226bd6c74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:31.425582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98f8c4-cc63-4def-8709-851226bd6c74 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:31.430399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8d26d-526e-412e-a71e-4ce45a661559 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:31.431860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8d26d-526e-412e-a71e-4ce45a661559 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:31.434788 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 220/445] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 27 03:01:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:31.435679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98f8c4-cc63-4def-8709-851226bd6c74 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:31.481087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:31.505494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:31.539294 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 226/446] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:01:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 03:01:31.543321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8d26d-526e-412e-a71e-4ce45a661559 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:31.544246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98f8c4-cc63-4def-8709-851226bd6c74 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:31.578340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8b10d-0c27-4802-83b0-ec939eb22cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:31.578972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8b10d-0c27-4802-83b0-ec939eb22cff None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:31.579252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8b10d-0c27-4802-83b0-ec939eb22cff None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:31.579524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8b10d-0c27-4802-83b0-ec939eb22cff None admin] PATH_INFO: `/v3/projects/service` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:31.586808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8b10d-0c27-4802-83b0-ec939eb22cff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:31.588781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8b10d-0c27-4802-83b0-ec939eb22cff None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:31.605363 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-1fc8b10d-0c27-4802-83b0-ec939eb22cff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:31.605363 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:31.605363 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:31.605363 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:31.605363 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:31.605363 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:31.605363 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:31.605363 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:31.605363 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:31.605363 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:31.605363 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:31.605363 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:31.605363 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:01:31.605363 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:01:31.605363 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:01:31.606374 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:01:31.606374 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:31.606374 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:31.606374 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:31.606374 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:31.606374 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:31.606374 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:31.606374 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:31.606374 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:31.606374 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:31.606374 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:31.606374 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:31.606374 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:31.606374 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:31.606374 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:31.606374 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:31.606374 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:31.607200 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:01:31.607200 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:01:31.607200 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:01:31.607200 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:01:31.607200 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:01:31.607200 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:01:31.607200 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:31.607200 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:31.607200 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 221/447] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:01:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:31.607738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236e40d-bc09-494d-a255-c78e8ccc6c0d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:31.608198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236e40d-bc09-494d-a255-c78e8ccc6c0d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:31.608484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236e40d-bc09-494d-a255-c78e8ccc6c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:31.631191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e236e40d-bc09-494d-a255-c78e8ccc6c0d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:31.636436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e236e40d-bc09-494d-a255-c78e8ccc6c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:31.654811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8d26d-526e-412e-a71e-4ce45a661559 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:31.692275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916ac52-375a-48c0-a318-7b611f2f734b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:31.692827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916ac52-375a-48c0-a318-7b611f2f734b None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:31.693109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916ac52-375a-48c0-a318-7b611f2f734b None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:31.693382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916ac52-375a-48c0-a318-7b611f2f734b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:31.704156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916ac52-375a-48c0-a318-7b611f2f734b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:31.705695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916ac52-375a-48c0-a318-7b611f2f734b None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:31.711864 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 222/448] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:31.721166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236e40d-bc09-494d-a255-c78e8ccc6c0d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:31.731795 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-9916ac52-375a-48c0-a318-7b611f2f734b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:31.731795 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:31.731795 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:31.731795 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:31.731795 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:31.731795 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:31.731795 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:31.731795 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:31.731795 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:31.731795 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:31.731795 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:31.731795 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:31.731795 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:31.731795 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:31.731795 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:31.731795 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:31.732733 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:31.732733 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:31.732733 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:31.732733 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:31.732733 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:31.732733 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:31.732733 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:31.732733 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:31.732733 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:31.732733 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:31.732733 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:31.732733 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:31.732733 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:31.732733 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:31.732733 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:31.732733 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:31.732733 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:31.738621 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:31.738621 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:31.738621 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:31.738621 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 227/449] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:31.738621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916ac52-375a-48c0-a318-7b611f2f734b None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:31.747999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:31.776281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:31.829662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236e40d-bc09-494d-a255-c78e8ccc6c0d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:31.857753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916ac52-375a-48c0-a318-7b611f2f734b None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:31.870364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac748e-03cb-4847-aa94-11434e6ca35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:31.871006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac748e-03cb-4847-aa94-11434e6ca35b None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:31.871299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac748e-03cb-4847-aa94-11434e6ca35b None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:31.871575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac748e-03cb-4847-aa94-11434e6ca35b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:31.885796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac748e-03cb-4847-aa94-11434e6ca35b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:31.887352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac748e-03cb-4847-aa94-11434e6ca35b None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:31.893092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2aca2a-60c4-41ff-a69c-97e4599544ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:31.893732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2aca2a-60c4-41ff-a69c-97e4599544ac None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:31.894018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2aca2a-60c4-41ff-a69c-97e4599544ac None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:31.894328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2aca2a-60c4-41ff-a69c-97e4599544ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:31.904190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-67ac748e-03cb-4847-aa94-11434e6ca35b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:31.904190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:31.904190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:31.904190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:31.904190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:31.904190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:31.904190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:31.904190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:31.904190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:31.904190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:31.904190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:31.904190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:31.904190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:31.904190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:31.904190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:31.904190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:31.905784 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:31.905784 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:31.905784 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:31.905784 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:31.905784 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:31.905784 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:31.905784 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:31.905784 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:31.905784 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:31.905784 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:31.905784 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:31.905784 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:31.905784 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:31.905784 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:31.905784 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:31.905784 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:31.905784 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:31.907264 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:31.907264 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:31.907264 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:31.907741 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 223/450] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:31.908686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac748e-03cb-4847-aa94-11434e6ca35b None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:31.913654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2aca2a-60c4-41ff-a69c-97e4599544ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:31.915340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2aca2a-60c4-41ff-a69c-97e4599544ac None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:31.935899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-de2aca2a-60c4-41ff-a69c-97e4599544ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:31.935899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:31.935899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:31.935899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:31.935899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:31.935899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:31.935899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:31.935899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:31.935899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:31.935899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:31.935899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:31.935899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:31.935899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:31.935899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:31.935899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:31.935899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:31.937003 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:31.937003 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:31.937003 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:31.937003 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:31.937003 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:31.937003 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:31.937003 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:31.937003 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:31.937003 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:31.937003 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:31.937003 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:31.937003 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:31.937003 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:31.937003 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:31.937003 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:31.937003 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:31.937003 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:31.938081 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:31.938081 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:31.938081 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:31.938309 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 228/451] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:31.943338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2aca2a-60c4-41ff-a69c-97e4599544ac None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:32.001323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:32.018551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac748e-03cb-4847-aa94-11434e6ca35b None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:32.024913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:32.048411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2aca2a-60c4-41ff-a69c-97e4599544ac None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:32.054171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be258cf5-a968-4c11-bec2-6b99826065c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:32.055423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be258cf5-a968-4c11-bec2-6b99826065c6 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:32.055700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be258cf5-a968-4c11-bec2-6b99826065c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:32.055965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be258cf5-a968-4c11-bec2-6b99826065c6 None admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:32.056675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be258cf5-a968-4c11-bec2-6b99826065c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:32.056967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be258cf5-a968-4c11-bec2-6b99826065c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:32.058521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be258cf5-a968-4c11-bec2-6b99826065c6 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:32.070270 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 224/452] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 27 03:01:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:32.071099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be258cf5-a968-4c11-bec2-6b99826065c6 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:32.085588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b85859-b972-496b-84fa-41ff35bfe9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:32.086418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b85859-b972-496b-84fa-41ff35bfe9fd None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:32.086783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b85859-b972-496b-84fa-41ff35bfe9fd None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:32.087136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b85859-b972-496b-84fa-41ff35bfe9fd None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:32.087785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b85859-b972-496b-84fa-41ff35bfe9fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:32.088100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b85859-b972-496b-84fa-41ff35bfe9fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:32.089476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b85859-b972-496b-84fa-41ff35bfe9fd None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:32.101132 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 229/453] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:32.102649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b85859-b972-496b-84fa-41ff35bfe9fd None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:32.175921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be258cf5-a968-4c11-bec2-6b99826065c6 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:32.241850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b85859-b972-496b-84fa-41ff35bfe9fd None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:32.244356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b73c5-8836-4ba1-9cd6-ce3677d0f6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:32.244963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b73c5-8836-4ba1-9cd6-ce3677d0f6d7 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:32.245240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b73c5-8836-4ba1-9cd6-ce3677d0f6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:32.245512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b73c5-8836-4ba1-9cd6-ce3677d0f6d7 None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:32.246180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b73c5-8836-4ba1-9cd6-ce3677d0f6d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:32.246482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b73c5-8836-4ba1-9cd6-ce3677d0f6d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:32.247841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b73c5-8836-4ba1-9cd6-ce3677d0f6d7 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:32.259530 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 225/454] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:32.260314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b73c5-8836-4ba1-9cd6-ce3677d0f6d7 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:32.268388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:32.277087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7545b-ba0f-48cc-abf9-30f8cc606c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:32.277693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7545b-ba0f-48cc-abf9-30f8cc606c76 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:32.277972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7545b-ba0f-48cc-abf9-30f8cc606c76 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:32.278323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7545b-ba0f-48cc-abf9-30f8cc606c76 None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:32.278919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7545b-ba0f-48cc-abf9-30f8cc606c76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:32.279222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7545b-ba0f-48cc-abf9-30f8cc606c76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:32.280582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7545b-ba0f-48cc-abf9-30f8cc606c76 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:32.282907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:32.292325 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 230/455] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:32.293148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7545b-ba0f-48cc-abf9-30f8cc606c76 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:32.361262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b73c5-8836-4ba1-9cd6-ce3677d0f6d7 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:32.389685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7545b-ba0f-48cc-abf9-30f8cc606c76 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:32.396176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70faa3-f0e4-42cc-bb88-1a6afd850bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:32.396835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70faa3-f0e4-42cc-bb88-1a6afd850bc2 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:32.397119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70faa3-f0e4-42cc-bb88-1a6afd850bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:32.397395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70faa3-f0e4-42cc-bb88-1a6afd850bc2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:32.408100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70faa3-f0e4-42cc-bb88-1a6afd850bc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:32.413354 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-7b70faa3-f0e4-42cc-bb88-1a6afd850bc2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:01:32.413354 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:32.413354 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:32.413354 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:32.413354 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:32.413354 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:32.413354 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:32.413354 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:32.413354 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:32.413354 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:32.413354 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:32.413354 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:32.413354 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:32.413354 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:32.413354 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:32.413354 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:32.414985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:32.414985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:32.414985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:32.414985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:32.414985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:32.414985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:32.414985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:32.414985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:32.414985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:32.414985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:32.414985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:32.414985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:32.414985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:32.414985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:32.414985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:32.414985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:32.415976 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:32.415976 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:32.415976 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:32.415976 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:32.415976 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:32.415976 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:32.415976 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:32.415976 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:32.415976 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:32.415976 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:32.415976 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:01:32.415976 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:32.415976 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 226/456] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 27 03:01:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:32.416860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70faa3-f0e4-42cc-bb88-1a6afd850bc2 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:32.426675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a692a5e-4684-4ef7-87c9-4269d9bb7145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:32.427327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a692a5e-4684-4ef7-87c9-4269d9bb7145 None admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:32.427606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a692a5e-4684-4ef7-87c9-4269d9bb7145 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:32.427882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a692a5e-4684-4ef7-87c9-4269d9bb7145 None admin] PATH_INFO: `/v3/projects/1ae07f0abb504c298fc9893b1d8bb173/users/fe7800497c6e460f9a2a0bd259e6d236/roles/248be75b0cf142299cd46440170c7972` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:32.442664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a692a5e-4684-4ef7-87c9-4269d9bb7145 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ae07f0abb504c298fc9893b1d8bb173, user_id=fe7800497c6e460f9a2a0bd259e6d236, role_id=248be75b0cf142299cd46440170c7972)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:32.444124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a692a5e-4684-4ef7-87c9-4269d9bb7145 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:32.479947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:32.511972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70faa3-f0e4-42cc-bb88-1a6afd850bc2 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:32.512208 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 231/457] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:01:32 2022] PUT /identity/v3/projects/1ae07f0abb504c298fc9893b1d8bb173/users/fe7800497c6e460f9a2a0bd259e6d236/roles/248be75b0cf142299cd46440170c7972 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:01:32.513022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a692a5e-4684-4ef7-87c9-4269d9bb7145 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:32.549459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f123cb-b1f5-4d07-a37b-a800a131c760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:32.550147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f123cb-b1f5-4d07-a37b-a800a131c760 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:32.550434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f123cb-b1f5-4d07-a37b-a800a131c760 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:32.550713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f123cb-b1f5-4d07-a37b-a800a131c760 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:32.558717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f123cb-b1f5-4d07-a37b-a800a131c760 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:32.560208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f123cb-b1f5-4d07-a37b-a800a131c760 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:32.573123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-00f123cb-b1f5-4d07-a37b-a800a131c760 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 27 03:01:32.573123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:32.573123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:32.573123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:32.573123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:32.573123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:32.573123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:32.573123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:32.573123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:32.573123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:32.573123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:32.573123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:32.573123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:01:32.573123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:01:32.573123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:01:32.573123 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:01:32.574331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:32.574331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:32.574331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:01:32.574331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:32.574331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:01:32.574331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:32.574331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:32.574331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:32.574331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:32.574331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:32.574331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:32.574331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:32.574331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:32.574331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:32.574331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:32.574331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:32.574331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:32.574331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:32.580415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:32.580415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:32.580415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:01:32.580415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:01:32.580415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:01:32.580415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:01:32.580415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:01:32.580415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:01:32.580415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 27 03:01:32.580415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:32.580415 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 227/458] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:01:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:32.580415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f123cb-b1f5-4d07-a37b-a800a131c760 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:32.595939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:32.664041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a692a5e-4684-4ef7-87c9-4269d9bb7145 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:32.698642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f123cb-b1f5-4d07-a37b-a800a131c760 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:32.706436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40abc1-1826-40ca-a195-ec4c2a2b820f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:32.707179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40abc1-1826-40ca-a195-ec4c2a2b820f None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:32.707556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40abc1-1826-40ca-a195-ec4c2a2b820f None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:32.707985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40abc1-1826-40ca-a195-ec4c2a2b820f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:32.715973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40abc1-1826-40ca-a195-ec4c2a2b820f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:32.717493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40abc1-1826-40ca-a195-ec4c2a2b820f None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:32.724972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:32.729687 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-0c40abc1-1826-40ca-a195-ec4c2a2b820f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 03:01:32.729687 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:32.729687 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:32.729687 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:32.729687 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:32.729687 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:32.729687 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:32.729687 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:32.729687 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:32.729687 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:32.729687 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:32.729687 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:32.729687 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:01:32.729687 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:01:32.729687 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:01:32.729687 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:01:32.730868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:32.730868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:32.730868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:01:32.730868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:32.730868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:01:32.730868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:32.730868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:32.730868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:32.730868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:32.730868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:32.730868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:32.730868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:32.730868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:32.730868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:32.730868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:32.730868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:32.730868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:32.730868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:32.731983 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:32.731983 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:32.731983 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:01:32.731983 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:01:32.731983 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:01:32.731983 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:01:32.731983 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:01:32.731983 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:01:32.731983 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 03:01:32.731983 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:32.734101 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 232/459] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:01:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:32.735297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40abc1-1826-40ca-a195-ec4c2a2b820f None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:32.736987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fb6ca-8735-43f7-8cb5-7bc10e8cc49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:32.737620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fb6ca-8735-43f7-8cb5-7bc10e8cc49f None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:32.737901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fb6ca-8735-43f7-8cb5-7bc10e8cc49f None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:32.738210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fb6ca-8735-43f7-8cb5-7bc10e8cc49f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:32.744965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914fb6ca-8735-43f7-8cb5-7bc10e8cc49f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:32.746489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914fb6ca-8735-43f7-8cb5-7bc10e8cc49f None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:32.759095 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-914fb6ca-8735-43f7-8cb5-7bc10e8cc49f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:32.759095 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:32.759095 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:32.759095 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:32.759095 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:32.759095 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:32.759095 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:32.759095 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:32.759095 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:32.759095 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:32.759095 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:32.759095 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:32.759095 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:01:32.759095 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:01:32.759095 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:01:32.760101 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:01:32.760101 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:32.760101 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:32.760101 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:32.760101 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:32.760101 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:32.760101 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:32.760101 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:32.760101 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:32.760101 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:32.760101 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:32.760101 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:32.760101 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:32.760101 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:32.760101 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:32.760101 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:32.760101 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:32.761227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:01:32.761227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:01:32.761227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:01:32.761227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:01:32.761227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:01:32.761227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:01:32.761227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:32.761227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:32.764970 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 228/460] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:01:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:32.766076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fb6ca-8735-43f7-8cb5-7bc10e8cc49f None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:32.843127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40abc1-1826-40ca-a195-ec4c2a2b820f None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:32.850671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:32.874287 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fb6ca-8735-43f7-8cb5-7bc10e8cc49f None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:32.880930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025afb33-029d-40fa-9db8-f704f6514bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:32.881659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025afb33-029d-40fa-9db8-f704f6514bd9 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:32.881937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025afb33-029d-40fa-9db8-f704f6514bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:32.882231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025afb33-029d-40fa-9db8-f704f6514bd9 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:32.883737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025afb33-029d-40fa-9db8-f704f6514bd9 None admin] RBAC: Adding query filter params (name=service) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:32.884046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025afb33-029d-40fa-9db8-f704f6514bd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:32.885637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025afb33-029d-40fa-9db8-f704f6514bd9 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:32.894066 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 233/461] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 27 03:01:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:32.894978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025afb33-029d-40fa-9db8-f704f6514bd9 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:32.914300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01943441-2e07-4cfa-ae4b-2707f97f033b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:32.914912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01943441-2e07-4cfa-ae4b-2707f97f033b None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:32.915195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01943441-2e07-4cfa-ae4b-2707f97f033b None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:32.915468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01943441-2e07-4cfa-ae4b-2707f97f033b None admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:32.916201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01943441-2e07-4cfa-ae4b-2707f97f033b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:32.916508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01943441-2e07-4cfa-ae4b-2707f97f033b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:32.917933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01943441-2e07-4cfa-ae4b-2707f97f033b None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:32.939448 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 229/462] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Oct 27 03:01:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:32.939448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01943441-2e07-4cfa-ae4b-2707f97f033b None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:32.985694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:33.010652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025afb33-029d-40fa-9db8-f704f6514bd9 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:33.044183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01943441-2e07-4cfa-ae4b-2707f97f033b None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:33.047195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7fbc1-8900-44e6-9ff8-2016494a6913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:33.047810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7fbc1-8900-44e6-9ff8-2016494a6913 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:33.048095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7fbc1-8900-44e6-9ff8-2016494a6913 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:33.048372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7fbc1-8900-44e6-9ff8-2016494a6913 None admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:33.049109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7fbc1-8900-44e6-9ff8-2016494a6913 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:33.049421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7fbc1-8900-44e6-9ff8-2016494a6913 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:33.050912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7fbc1-8900-44e6-9ff8-2016494a6913 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:33.073088 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 234/463] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Oct 27 03:01:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:33.073088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7fbc1-8900-44e6-9ff8-2016494a6913 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:33.085463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b5033-c54a-4211-936a-37b3de3dd1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:33.086659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b5033-c54a-4211-936a-37b3de3dd1e3 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:33.086949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b5033-c54a-4211-936a-37b3de3dd1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:33.087217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b5033-c54a-4211-936a-37b3de3dd1e3 None admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:33.087912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b5033-c54a-4211-936a-37b3de3dd1e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:33.088215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b5033-c54a-4211-936a-37b3de3dd1e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:33.089665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b5033-c54a-4211-936a-37b3de3dd1e3 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:33.097665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:33.101499 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 230/464] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 27 03:01:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:33.103019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b5033-c54a-4211-936a-37b3de3dd1e3 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:33.175294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7fbc1-8900-44e6-9ff8-2016494a6913 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:33.211207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a8ea6-1b53-4e0b-ad51-8eadc3410e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:33.211826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a8ea6-1b53-4e0b-ad51-8eadc3410e46 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:33.212097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a8ea6-1b53-4e0b-ad51-8eadc3410e46 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:33.212368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a8ea6-1b53-4e0b-ad51-8eadc3410e46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:33.221059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b5033-c54a-4211-936a-37b3de3dd1e3 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:33.223086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a8ea6-1b53-4e0b-ad51-8eadc3410e46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:33.224454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:33.224674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a8ea6-1b53-4e0b-ad51-8eadc3410e46 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:33.240649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-c09a8ea6-1b53-4e0b-ad51-8eadc3410e46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:33.240649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:33.240649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:33.240649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:33.240649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:33.240649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:33.240649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:33.240649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:33.240649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:33.240649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:33.240649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:33.240649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:33.240649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:33.240649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:33.240649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:33.240649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:33.241643 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:33.241643 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:33.241643 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:33.241643 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:33.241643 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:33.241643 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:33.241643 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:33.241643 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:33.241643 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:33.241643 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:33.241643 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:33.241643 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:33.241643 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:33.241643 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:33.241643 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:33.241643 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:33.241643 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:33.248035 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:33.248035 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:33.248035 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:33.248035 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 235/465] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:33.248035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a8ea6-1b53-4e0b-ad51-8eadc3410e46 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:33.266761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f1db9-693b-4428-8fd0-bb3b5f809fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:33.267891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f1db9-693b-4428-8fd0-bb3b5f809fdf None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:33.268177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f1db9-693b-4428-8fd0-bb3b5f809fdf None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:33.268457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f1db9-693b-4428-8fd0-bb3b5f809fdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:33.325647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:33.337513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f1db9-693b-4428-8fd0-bb3b5f809fdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:33.339008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f1db9-693b-4428-8fd0-bb3b5f809fdf None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:33.349575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a8ea6-1b53-4e0b-ad51-8eadc3410e46 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:33.385176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a18b49-6c72-42ef-a420-6dcc690d103a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:33.385813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a18b49-6c72-42ef-a420-6dcc690d103a None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:33.386128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a18b49-6c72-42ef-a420-6dcc690d103a None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:33.386413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a18b49-6c72-42ef-a420-6dcc690d103a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:33.444052 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 231/466] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:01:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 03:01:33.445855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f1db9-693b-4428-8fd0-bb3b5f809fdf None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:33.451045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:33.461276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a18b49-6c72-42ef-a420-6dcc690d103a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:33.465748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a18b49-6c72-42ef-a420-6dcc690d103a None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:33.542583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:33.550876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f1db9-693b-4428-8fd0-bb3b5f809fdf None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:33.571661 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 236/467] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:01:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 03:01:33.571661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a18b49-6c72-42ef-a420-6dcc690d103a None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:33.592656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6290749-b9a1-4365-ba55-333c9bbe6b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:33.593190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6290749-b9a1-4365-ba55-333c9bbe6b12 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:33.593584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6290749-b9a1-4365-ba55-333c9bbe6b12 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:33.593857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6290749-b9a1-4365-ba55-333c9bbe6b12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:33.594715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6290749-b9a1-4365-ba55-333c9bbe6b12 None admin] RBAC: Adding query filter params (role.id=248be75b0cf142299cd46440170c7972, scope.project.id=1ae07f0abb504c298fc9893b1d8bb173, user.id=c20881251f2241a3a5ec2e5cf99db149) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:33.595022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6290749-b9a1-4365-ba55-333c9bbe6b12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:33.596548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6290749-b9a1-4365-ba55-333c9bbe6b12 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:33.614076 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 232/468] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:01:33 2022] GET /identity/v3/role_assignments?user.id=c20881251f2241a3a5ec2e5cf99db149&scope.project.id=1ae07f0abb504c298fc9893b1d8bb173&role.id=248be75b0cf142299cd46440170c7972 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:33.614076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6290749-b9a1-4365-ba55-333c9bbe6b12 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:33.697968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:33.698947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a18b49-6c72-42ef-a420-6dcc690d103a None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:33.744774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6290749-b9a1-4365-ba55-333c9bbe6b12 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:33.748667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23ef2c-44b8-4728-98a0-31931539f3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:33.749302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23ef2c-44b8-4728-98a0-31931539f3c3 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:33.749581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23ef2c-44b8-4728-98a0-31931539f3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:33.749853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23ef2c-44b8-4728-98a0-31931539f3c3 None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:33.750573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23ef2c-44b8-4728-98a0-31931539f3c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:33.750877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23ef2c-44b8-4728-98a0-31931539f3c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:33.752286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23ef2c-44b8-4728-98a0-31931539f3c3 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:33.769452 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 237/469] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:33.770905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23ef2c-44b8-4728-98a0-31931539f3c3 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:33.787820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d277c60-6b22-464b-9e3b-00e5d2650922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:33.788496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d277c60-6b22-464b-9e3b-00e5d2650922 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:33.788840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d277c60-6b22-464b-9e3b-00e5d2650922 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:33.789655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d277c60-6b22-464b-9e3b-00e5d2650922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:33.803192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d277c60-6b22-464b-9e3b-00e5d2650922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:33.805384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d277c60-6b22-464b-9e3b-00e5d2650922 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:33.816752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:33.824361 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-7d277c60-6b22-464b-9e3b-00e5d2650922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:33.824361 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:33.824361 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:33.824361 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:33.824361 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:33.824361 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:33.824361 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:33.824361 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:33.824361 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:33.824361 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:33.824361 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:33.824361 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:33.824361 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:33.824361 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:33.824361 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:33.824361 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:33.825396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:33.825396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:33.825396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:33.825396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:33.825396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:33.825396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:33.825396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:33.825396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:33.825396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:33.825396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:33.825396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:33.825396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:33.825396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:33.825396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:33.825396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:33.825396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:33.825396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:33.832014 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:33.832014 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:33.832014 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:33.832014 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 233/470] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:33.832014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d277c60-6b22-464b-9e3b-00e5d2650922 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:33.894687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23ef2c-44b8-4728-98a0-31931539f3c3 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:33.931580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e24b5-e1ee-4ac7-9e4f-0b65f1d2a2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:33.932403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e24b5-e1ee-4ac7-9e4f-0b65f1d2a2e1 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:33.932782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e24b5-e1ee-4ac7-9e4f-0b65f1d2a2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:33.933126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e24b5-e1ee-4ac7-9e4f-0b65f1d2a2e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:33.940700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d277c60-6b22-464b-9e3b-00e5d2650922 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:33.944822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e24b5-e1ee-4ac7-9e4f-0b65f1d2a2e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:33.946417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e24b5-e1ee-4ac7-9e4f-0b65f1d2a2e1 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:33.961414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:33.963121 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-d45e24b5-e1ee-4ac7-9e4f-0b65f1d2a2e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:33.963121 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:33.963121 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:33.963121 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:33.963121 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:33.963121 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:33.963121 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:33.963121 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:33.963121 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:33.963121 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:33.963121 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:33.963121 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:33.963121 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:33.963121 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:33.963121 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:33.963121 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:33.964043 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:33.964043 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:33.964043 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:33.964043 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:33.964043 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:33.964043 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:33.964043 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:33.964043 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:33.964043 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:33.964043 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:33.964043 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:33.964043 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:33.964043 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:33.964043 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:33.964043 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:33.964043 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:33.964043 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:33.964888 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:33.964888 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:33.964888 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:33.964888 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 238/471] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:33.965374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e24b5-e1ee-4ac7-9e4f-0b65f1d2a2e1 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:33.982259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925c44f-9213-4956-9ef3-2b729ca84c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:33.982932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925c44f-9213-4956-9ef3-2b729ca84c53 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:33.983218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925c44f-9213-4956-9ef3-2b729ca84c53 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:33.983670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925c44f-9213-4956-9ef3-2b729ca84c53 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:33.992094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925c44f-9213-4956-9ef3-2b729ca84c53 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:33.993618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925c44f-9213-4956-9ef3-2b729ca84c53 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:34.005424 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-9925c44f-9213-4956-9ef3-2b729ca84c53 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 03:01:34.005424 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:34.005424 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:34.005424 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:34.005424 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:34.005424 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:34.005424 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:34.005424 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:34.005424 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:34.005424 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:34.005424 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:34.005424 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:34.005424 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:01:34.005424 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:01:34.005424 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:01:34.005424 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:01:34.006474 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:34.006474 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:34.006474 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:01:34.006474 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:34.006474 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:01:34.006474 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:34.006474 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:34.006474 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:34.006474 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:34.006474 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:34.006474 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:34.006474 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:34.006474 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:34.006474 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:34.006474 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:34.006474 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:34.006474 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:34.006474 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:34.007367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:34.007367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:34.007367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:01:34.007367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:01:34.007367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:01:34.007367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:01:34.007367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:01:34.007367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:01:34.007367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 03:01:34.007367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:34.008202 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 234/472] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 27 03:01:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:34.009281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925c44f-9213-4956-9ef3-2b729ca84c53 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:34.095593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:34.110507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e24b5-e1ee-4ac7-9e4f-0b65f1d2a2e1 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:34.133426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925c44f-9213-4956-9ef3-2b729ca84c53 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:34.145627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f5869-a697-4ffb-aa9d-679fe7088363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:34.146220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f5869-a697-4ffb-aa9d-679fe7088363 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:34.146508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f5869-a697-4ffb-aa9d-679fe7088363 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:34.146787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f5869-a697-4ffb-aa9d-679fe7088363 None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:34.147541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f5869-a697-4ffb-aa9d-679fe7088363 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:34.147834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f5869-a697-4ffb-aa9d-679fe7088363 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:34.149770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f5869-a697-4ffb-aa9d-679fe7088363 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:34.168280 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 239/473] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:34.169207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f5869-a697-4ffb-aa9d-679fe7088363 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:34.176907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad79c6-6385-40b2-91b6-dec6b4a3c08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:34.177667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad79c6-6385-40b2-91b6-dec6b4a3c08a None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:34.178025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad79c6-6385-40b2-91b6-dec6b4a3c08a None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:34.178398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad79c6-6385-40b2-91b6-dec6b4a3c08a None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:34.179699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad79c6-6385-40b2-91b6-dec6b4a3c08a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:34.180066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad79c6-6385-40b2-91b6-dec6b4a3c08a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:34.181453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad79c6-6385-40b2-91b6-dec6b4a3c08a None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:34.196117 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 235/474] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:34.196980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad79c6-6385-40b2-91b6-dec6b4a3c08a None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:34.253572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:34.291274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f5869-a697-4ffb-aa9d-679fe7088363 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:34.325988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad79c6-6385-40b2-91b6-dec6b4a3c08a None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:34.340065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68ac0e-2314-4fd7-813f-d2d0c4f90fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:34.341144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68ac0e-2314-4fd7-813f-d2d0c4f90fa1 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:34.342026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68ac0e-2314-4fd7-813f-d2d0c4f90fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:34.342496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68ac0e-2314-4fd7-813f-d2d0c4f90fa1 None admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:34.343642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68ac0e-2314-4fd7-813f-d2d0c4f90fa1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:34.344350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68ac0e-2314-4fd7-813f-d2d0c4f90fa1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:34.346358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68ac0e-2314-4fd7-813f-d2d0c4f90fa1 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:34.363286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e32ca0-6ffc-42cf-a6a7-3d71745d4e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:34.363993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e32ca0-6ffc-42cf-a6a7-3d71745d4e97 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:34.364277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e32ca0-6ffc-42cf-a6a7-3d71745d4e97 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:34.364555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e32ca0-6ffc-42cf-a6a7-3d71745d4e97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:34.369560 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 240/475] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Oct 27 03:01:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:34.370622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68ac0e-2314-4fd7-813f-d2d0c4f90fa1 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:34.376550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e32ca0-6ffc-42cf-a6a7-3d71745d4e97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:34.379456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e32ca0-6ffc-42cf-a6a7-3d71745d4e97 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:34.388127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:34.396242 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-e8e32ca0-6ffc-42cf-a6a7-3d71745d4e97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:34.396242 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:34.396242 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:34.396242 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:34.396242 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:34.396242 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:34.396242 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:34.396242 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:34.396242 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:34.396242 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:34.396242 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:34.396242 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:34.396242 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:01:34.396242 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:01:34.396242 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:01:34.397235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:01:34.397235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:34.397235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:34.397235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:34.397235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:34.397235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:34.397235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:34.397235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:34.397235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:34.397235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:34.397235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:34.397235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:34.397235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:34.397235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:34.397235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:34.397235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:34.397235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:34.398323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:01:34.398323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:01:34.398323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:01:34.398323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:01:34.398323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:01:34.398323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:01:34.398323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:34.398323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:34.405591 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 236/476] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:01:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:34.405591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e32ca0-6ffc-42cf-a6a7-3d71745d4e97 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:34.504595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68ac0e-2314-4fd7-813f-d2d0c4f90fa1 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:34.533242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:34.538353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e32ca0-6ffc-42cf-a6a7-3d71745d4e97 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:34.549058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736b649-8519-419c-a5e4-b5881bb5703d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:34.549796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736b649-8519-419c-a5e4-b5881bb5703d None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:34.550181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736b649-8519-419c-a5e4-b5881bb5703d None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:34.550531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736b649-8519-419c-a5e4-b5881bb5703d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:34.559989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736b649-8519-419c-a5e4-b5881bb5703d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:34.562297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736b649-8519-419c-a5e4-b5881bb5703d None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:34.577928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-8736b649-8519-419c-a5e4-b5881bb5703d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:34.577928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:34.577928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:34.577928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:34.577928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:34.577928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:34.577928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:34.577928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:34.577928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:34.577928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:34.577928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:34.577928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:34.577928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:01:34.577928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:01:34.577928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:01:34.579007 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:01:34.579007 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:34.579007 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:34.579007 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:34.579007 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:34.579007 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:34.579007 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:34.579007 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:34.579007 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:34.579007 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:34.579007 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:34.579007 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:34.579007 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:34.579007 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:34.579007 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:34.579007 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:34.579007 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:34.579875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:01:34.579875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:01:34.579875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:01:34.579875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:01:34.579875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:01:34.579875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:01:34.579875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:34.579875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:34.582155 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 241/477] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:01:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:34.583303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736b649-8519-419c-a5e4-b5881bb5703d None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:34.587478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7df486-7bb3-4ab9-8e87-810eea390982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:34.588817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7df486-7bb3-4ab9-8e87-810eea390982 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:34.589317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7df486-7bb3-4ab9-8e87-810eea390982 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:34.590484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7df486-7bb3-4ab9-8e87-810eea390982 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:34.673995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:34.690698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7df486-7bb3-4ab9-8e87-810eea390982 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:34.693120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7df486-7bb3-4ab9-8e87-810eea390982 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:34.715969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736b649-8519-419c-a5e4-b5881bb5703d None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:34.751190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efe18a-7490-4261-aefb-366062c5aea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:34.751790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efe18a-7490-4261-aefb-366062c5aea1 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:34.752072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efe18a-7490-4261-aefb-366062c5aea1 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:34.752345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efe18a-7490-4261-aefb-366062c5aea1 None admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:34.753036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efe18a-7490-4261-aefb-366062c5aea1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:34.753343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efe18a-7490-4261-aefb-366062c5aea1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:34.754806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efe18a-7490-4261-aefb-366062c5aea1 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:34.772232 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 242/478] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 27 03:01:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:34.772232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efe18a-7490-4261-aefb-366062c5aea1 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:34.810630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:34.819261 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 237/479] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:01:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 03:01:34.821106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed382f89-a13e-473d-8353-40981f82d710 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:34.821399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed382f89-a13e-473d-8353-40981f82d710 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:34.829360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed382f89-a13e-473d-8353-40981f82d710 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:34.829360 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 238/480] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:34.829360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed382f89-a13e-473d-8353-40981f82d710 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:34.879946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efe18a-7490-4261-aefb-366062c5aea1 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:34.909391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:34.917859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdd6d8-dac9-4529-a3a7-9f9772e479f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:34.921007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdd6d8-dac9-4529-a3a7-9f9772e479f5 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:34.921007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdd6d8-dac9-4529-a3a7-9f9772e479f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:34.921007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdd6d8-dac9-4529-a3a7-9f9772e479f5 None admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:34.921007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdd6d8-dac9-4529-a3a7-9f9772e479f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:34.921007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdd6d8-dac9-4529-a3a7-9f9772e479f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:34.921514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdd6d8-dac9-4529-a3a7-9f9772e479f5 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:34.932836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed382f89-a13e-473d-8353-40981f82d710 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:34.933691 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 243/481] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 27 03:01:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:34.934564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdd6d8-dac9-4529-a3a7-9f9772e479f5 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:34.975316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a9f02-506b-416b-a0ca-b316997056a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:34.975928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a9f02-506b-416b-a0ca-b316997056a0 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:34.976212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a9f02-506b-416b-a0ca-b316997056a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:34.976488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a9f02-506b-416b-a0ca-b316997056a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:34.977219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a9f02-506b-416b-a0ca-b316997056a0 None admin] RBAC: Adding query filter params (role.id=248be75b0cf142299cd46440170c7972, scope.project.id=1ae07f0abb504c298fc9893b1d8bb173, user.id=c2b7050fa8404001876dbfd40e392015) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:34.977529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a9f02-506b-416b-a0ca-b316997056a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:34.979043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a9f02-506b-416b-a0ca-b316997056a0 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:34.985494 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 239/482] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:01:34 2022] GET /identity/v3/role_assignments?user.id=c2b7050fa8404001876dbfd40e392015&scope.project.id=1ae07f0abb504c298fc9893b1d8bb173&role.id=248be75b0cf142299cd46440170c7972 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:34.986750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb1109-5aed-43c1-ab5d-a73fe2cd5bf4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:34.987042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb1109-5aed-43c1-ab5d-a73fe2cd5bf4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:34.987319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb1109-5aed-43c1-ab5d-a73fe2cd5bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:35.011474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7fbb1109-5aed-43c1-ab5d-a73fe2cd5bf4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:35.012573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7fbb1109-5aed-43c1-ab5d-a73fe2cd5bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:35.069575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdd6d8-dac9-4529-a3a7-9f9772e479f5 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:35.080827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:35.091282 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 240/483] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:35.092528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb1109-5aed-43c1-ab5d-a73fe2cd5bf4 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:35.117560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b98cc4-4e29-4f57-9f9f-7d0fa683bbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:35.118619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b98cc4-4e29-4f57-9f9f-7d0fa683bbff None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:35.119376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b98cc4-4e29-4f57-9f9f-7d0fa683bbff None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:35.119797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b98cc4-4e29-4f57-9f9f-7d0fa683bbff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:35.134861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b98cc4-4e29-4f57-9f9f-7d0fa683bbff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:35.137052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b98cc4-4e29-4f57-9f9f-7d0fa683bbff None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:35.157899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-79b98cc4-4e29-4f57-9f9f-7d0fa683bbff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:35.157899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:35.157899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:35.157899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:35.157899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:35.157899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:35.157899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:35.157899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:35.157899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:35.157899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:35.157899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:35.157899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:35.157899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:35.157899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:35.157899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:35.157899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:35.159149 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:35.159149 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:35.159149 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:35.159149 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:35.159149 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:35.159149 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:35.159149 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:35.159149 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:35.159149 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:35.159149 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:35.159149 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:35.159149 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:35.159149 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:35.159149 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:35.159149 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:35.159149 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:35.159149 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:35.160197 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:35.160197 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:35.160197 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:35.162059 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 244/484] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:35.167778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b98cc4-4e29-4f57-9f9f-7d0fa683bbff None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:35.215127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:35.217764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb1109-5aed-43c1-ab5d-a73fe2cd5bf4 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:35.254381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e6f1c-0383-4965-a179-65c124f5f43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:35.255146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e6f1c-0383-4965-a179-65c124f5f43c None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:35.255504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e6f1c-0383-4965-a179-65c124f5f43c None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:35.255851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e6f1c-0383-4965-a179-65c124f5f43c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:35.256857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e6f1c-0383-4965-a179-65c124f5f43c None admin] RBAC: Adding query filter params (role.id=248be75b0cf142299cd46440170c7972, scope.project.id=1ae07f0abb504c298fc9893b1d8bb173, user.id=5ec1d24520c447a38ed321f62d4f9e98) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:35.257116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e6f1c-0383-4965-a179-65c124f5f43c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:35.260360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e6f1c-0383-4965-a179-65c124f5f43c None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:35.267266 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 241/485] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:01:35 2022] GET /identity/v3/role_assignments?user.id=5ec1d24520c447a38ed321f62d4f9e98&scope.project.id=1ae07f0abb504c298fc9893b1d8bb173&role.id=248be75b0cf142299cd46440170c7972 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:35.284830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b98cc4-4e29-4f57-9f9f-7d0fa683bbff None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:35.324130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fcf3a-f66b-46ca-92bd-beb821728588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:35.324766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fcf3a-f66b-46ca-92bd-beb821728588 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:35.325095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fcf3a-f66b-46ca-92bd-beb821728588 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:35.325378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fcf3a-f66b-46ca-92bd-beb821728588 None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:35.326069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0fcf3a-f66b-46ca-92bd-beb821728588 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:35.326389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0fcf3a-f66b-46ca-92bd-beb821728588 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:35.327832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0fcf3a-f66b-46ca-92bd-beb821728588 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:35.343183 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 245/486] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:35.348879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e6f1c-0383-4965-a179-65c124f5f43c None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:35.426399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:35.473616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e6f1c-0383-4965-a179-65c124f5f43c None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:35.479651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fcf3a-f66b-46ca-92bd-beb821728588 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:35.513972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f530af-2e6f-449c-81d5-c92b9d25111e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:35.514738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f530af-2e6f-449c-81d5-c92b9d25111e None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:35.515024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f530af-2e6f-449c-81d5-c92b9d25111e None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:35.515305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f530af-2e6f-449c-81d5-c92b9d25111e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:35.523844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f530af-2e6f-449c-81d5-c92b9d25111e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:35.525715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f530af-2e6f-449c-81d5-c92b9d25111e None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:35.538542 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-25f530af-2e6f-449c-81d5-c92b9d25111e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:35.538542 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:35.538542 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:35.538542 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:35.538542 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:35.538542 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:35.538542 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:35.538542 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:35.538542 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:35.538542 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:35.538542 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:35.538542 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:35.538542 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:01:35.538542 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:01:35.538542 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:01:35.539464 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:01:35.539464 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:35.539464 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:35.539464 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:35.539464 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:35.539464 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:35.539464 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:35.539464 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:35.539464 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:35.539464 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:35.539464 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:35.539464 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:35.539464 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:35.539464 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:35.539464 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:35.539464 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:35.539464 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:35.540314 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:01:35.540314 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:01:35.540314 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:01:35.540314 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:01:35.540314 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:01:35.540314 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:01:35.540314 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:35.540314 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:35.542915 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 242/487] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:01:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:35.549004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f530af-2e6f-449c-81d5-c92b9d25111e None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:35.594157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:35.597703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fcf3a-f66b-46ca-92bd-beb821728588 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:35.633980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e15da3-20e5-4c9d-9450-88ce3a795f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:35.634880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e15da3-20e5-4c9d-9450-88ce3a795f70 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:35.634990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e15da3-20e5-4c9d-9450-88ce3a795f70 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:35.636417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e15da3-20e5-4c9d-9450-88ce3a795f70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:35.647328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e15da3-20e5-4c9d-9450-88ce3a795f70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:35.652253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-c6e15da3-20e5-4c9d-9450-88ce3a795f70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:01:35.652253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:35.652253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:35.652253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:35.652253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:35.652253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:35.652253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:35.652253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:35.652253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:35.652253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:35.652253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:35.652253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:35.652253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:35.652253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:35.652253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:35.652253 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:35.653135 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:35.653135 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:35.653135 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:35.653135 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:35.653135 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:35.653135 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:35.653135 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:35.653135 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:35.653135 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:35.653135 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:35.653135 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:35.653135 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:35.653135 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:35.653135 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:35.653135 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:35.653135 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:35.653929 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:35.653929 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:35.653929 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:35.653929 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:35.653929 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:35.653929 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:35.653929 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:35.653929 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:35.653929 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:35.653929 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:35.653929 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:01:35.653929 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:35.658132 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 246/488] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 27 03:01:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:35.659533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e15da3-20e5-4c9d-9450-88ce3a795f70 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:35.665258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f530af-2e6f-449c-81d5-c92b9d25111e None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:35.683705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:35.701766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c694ede-3ac0-4fb9-ae42-274ef3778236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:35.702739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c694ede-3ac0-4fb9-ae42-274ef3778236 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:35.703222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c694ede-3ac0-4fb9-ae42-274ef3778236 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:35.703689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c694ede-3ac0-4fb9-ae42-274ef3778236 None admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:35.704580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c694ede-3ac0-4fb9-ae42-274ef3778236 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:35.705109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c694ede-3ac0-4fb9-ae42-274ef3778236 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:35.706777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c694ede-3ac0-4fb9-ae42-274ef3778236 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:35.720485 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 243/489] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 27 03:01:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:35.727401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c694ede-3ac0-4fb9-ae42-274ef3778236 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:35.796122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e15da3-20e5-4c9d-9450-88ce3a795f70 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:35.835940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c694ede-3ac0-4fb9-ae42-274ef3778236 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:35.858851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a60d3-d8c4-455d-bd54-dbd2d28069c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:35.859475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a60d3-d8c4-455d-bd54-dbd2d28069c7 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:35.859757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a60d3-d8c4-455d-bd54-dbd2d28069c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:35.860035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a60d3-d8c4-455d-bd54-dbd2d28069c7 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:35.860714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a60d3-d8c4-455d-bd54-dbd2d28069c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:35.861024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a60d3-d8c4-455d-bd54-dbd2d28069c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:35.862482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a60d3-d8c4-455d-bd54-dbd2d28069c7 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:35.875787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38eb173-c0c8-4e6f-a711-4fcec9532cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:35.876714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38eb173-c0c8-4e6f-a711-4fcec9532cab None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:35.877195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38eb173-c0c8-4e6f-a711-4fcec9532cab None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:35.877662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38eb173-c0c8-4e6f-a711-4fcec9532cab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:35.877763 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 247/490] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 27 03:01:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:01:35.878768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38eb173-c0c8-4e6f-a711-4fcec9532cab None admin] RBAC: Adding query filter params (role.id=248be75b0cf142299cd46440170c7972, scope.project.id=1ae07f0abb504c298fc9893b1d8bb173, user.id=9b359391fbc34c259d987e42e8826c86) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:35.879304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38eb173-c0c8-4e6f-a711-4fcec9532cab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:35.880943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38eb173-c0c8-4e6f-a711-4fcec9532cab None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:35.883677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a60d3-d8c4-455d-bd54-dbd2d28069c7 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:35.888550 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 244/491] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:01:35 2022] GET /identity/v3/role_assignments?user.id=9b359391fbc34c259d987e42e8826c86&scope.project.id=1ae07f0abb504c298fc9893b1d8bb173&role.id=248be75b0cf142299cd46440170c7972 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:35.934431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:35.950806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef2e4f-6049-483f-bfc8-ed117a14fcd2 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:35.951433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef2e4f-6049-483f-bfc8-ed117a14fcd2 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:35.951908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef2e4f-6049-483f-bfc8-ed117a14fcd2 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:35.953701 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 245/492] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:35.967522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6dd8b-0f5f-4173-a41c-b4054dc75cca None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:35.967907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6dd8b-0f5f-4173-a41c-b4054dc75cca None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:35.974243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6dd8b-0f5f-4173-a41c-b4054dc75cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:36.005550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a60d3-d8c4-455d-bd54-dbd2d28069c7 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:36.011202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-58a6dd8b-0f5f-4173-a41c-b4054dc75cca None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:36.012422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-58a6dd8b-0f5f-4173-a41c-b4054dc75cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:36.054199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71624fe5-e63e-424e-ae08-3e52d6ef5e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:36.055426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71624fe5-e63e-424e-ae08-3e52d6ef5e5b None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:36.055709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71624fe5-e63e-424e-ae08-3e52d6ef5e5b None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:36.056204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71624fe5-e63e-424e-ae08-3e52d6ef5e5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:36.071840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71624fe5-e63e-424e-ae08-3e52d6ef5e5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:36.073375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71624fe5-e63e-424e-ae08-3e52d6ef5e5b None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:36.089874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:36.100647 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-71624fe5-e63e-424e-ae08-3e52d6ef5e5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:36.100647 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:36.100647 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:36.100647 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:36.100647 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:36.100647 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:36.100647 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:36.100647 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:36.100647 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:36.100647 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:36.100647 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:36.100647 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:36.100647 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:36.100647 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:36.100647 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:36.100647 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:36.106788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:36.106788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:36.106788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:36.106788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:36.106788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:36.106788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:36.106788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:36.106788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:36.106788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:36.106788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:36.106788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:36.106788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:36.106788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:36.106788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:36.106788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:36.106788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:36.106788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:36.107640 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:36.107640 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:36.107640 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:36.107640 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 248/493] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:36.108967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71624fe5-e63e-424e-ae08-3e52d6ef5e5b None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:36.144974 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 246/494] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 03:01:36.214359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:36.243641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71624fe5-e63e-424e-ae08-3e52d6ef5e5b None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:36.282208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f27b2e-577b-4237-825b-b6f9c03ae3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:36.282748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f27b2e-577b-4237-825b-b6f9c03ae3fe None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:36.283027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f27b2e-577b-4237-825b-b6f9c03ae3fe None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:36.283301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f27b2e-577b-4237-825b-b6f9c03ae3fe None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:36.284016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f27b2e-577b-4237-825b-b6f9c03ae3fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:36.284325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f27b2e-577b-4237-825b-b6f9c03ae3fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:36.285714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f27b2e-577b-4237-825b-b6f9c03ae3fe None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:36.298921 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 249/495] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:36.305112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6dd8b-0f5f-4173-a41c-b4054dc75cca None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:36.408163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6dd8b-0f5f-4173-a41c-b4054dc75cca None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:36.448167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bef73-54fb-4abf-8d53-d97a5071bda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:36.448891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bef73-54fb-4abf-8d53-d97a5071bda2 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:36.449179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bef73-54fb-4abf-8d53-d97a5071bda2 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:36.449456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bef73-54fb-4abf-8d53-d97a5071bda2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:36.457662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61bef73-54fb-4abf-8d53-d97a5071bda2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:36.459237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61bef73-54fb-4abf-8d53-d97a5071bda2 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:36.475144 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-d61bef73-54fb-4abf-8d53-d97a5071bda2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 03:01:36.475144 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:36.475144 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:36.475144 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:36.475144 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:36.475144 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:36.475144 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:36.475144 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:36.475144 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:36.475144 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:36.475144 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:36.475144 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:36.475144 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:01:36.475144 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:01:36.475144 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:01:36.475144 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:01:36.476308 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:36.476308 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:36.476308 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:01:36.476308 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:36.476308 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:01:36.476308 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:36.476308 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:36.476308 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:36.476308 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:36.476308 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:36.476308 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:36.476308 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:36.476308 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:36.476308 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:36.476308 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:36.476308 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:36.476308 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:36.476308 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:36.477741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:36.477741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:36.477741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:01:36.477741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:01:36.477741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:01:36.477741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:01:36.477741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:01:36.477741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:01:36.477741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 27 03:01:36.477741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:36.478968 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 247/496] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 27 03:01:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:36.482787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f27b2e-577b-4237-825b-b6f9c03ae3fe None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:36.484331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bef73-54fb-4abf-8d53-d97a5071bda2 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:36.550486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:36.678188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bef73-54fb-4abf-8d53-d97a5071bda2 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:36.682221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f27b2e-577b-4237-825b-b6f9c03ae3fe None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:36.743836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1c1f8-c6f8-4692-95c1-b6b3cfe375f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:36.744456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1c1f8-c6f8-4692-95c1-b6b3cfe375f2 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:36.744742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1c1f8-c6f8-4692-95c1-b6b3cfe375f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:36.745020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1c1f8-c6f8-4692-95c1-b6b3cfe375f2 None admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:36.746538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acec8f-c184-4a8a-acfa-fd3baae4eefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:36.747172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acec8f-c184-4a8a-acfa-fd3baae4eefd None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:36.747446 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acec8f-c184-4a8a-acfa-fd3baae4eefd None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:36.747719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acec8f-c184-4a8a-acfa-fd3baae4eefd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:36.748768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1c1f8-c6f8-4692-95c1-b6b3cfe375f2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:36.749080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1c1f8-c6f8-4692-95c1-b6b3cfe375f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:36.751690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:36.751909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1c1f8-c6f8-4692-95c1-b6b3cfe375f2 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:36.774743 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 248/497] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Oct 27 03:01:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:01:36.782056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acec8f-c184-4a8a-acfa-fd3baae4eefd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:36.782736 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-85acec8f-c184-4a8a-acfa-fd3baae4eefd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:01:36.782736 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:36.782736 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:36.782736 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:36.782736 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:36.782736 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:36.782736 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:36.782736 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:36.782736 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:36.782736 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:36.782736 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:36.782736 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:36.782736 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:36.782736 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:36.782736 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:36.782736 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:36.783714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:36.783714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:36.783714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:36.783714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:36.783714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:36.783714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:36.783714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:36.783714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:36.783714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:36.783714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:36.783714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:36.783714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:36.783714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:36.783714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:36.783714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:36.783714 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:36.784523 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:36.784523 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:36.784523 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:36.784523 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:36.784523 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:36.784523 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:36.784523 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:36.784523 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:36.784523 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:36.784523 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:36.784523 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:01:36.784523 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:36.784523 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 250/498] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 27 03:01:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:36.785804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1c1f8-c6f8-4692-95c1-b6b3cfe375f2 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:36.791965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acec8f-c184-4a8a-acfa-fd3baae4eefd None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:36.947086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:36.957404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1c1f8-c6f8-4692-95c1-b6b3cfe375f2 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:36.998537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d756f38-d64b-481c-b32e-eb5dd817d30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:36.999417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d756f38-d64b-481c-b32e-eb5dd817d30f None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:36.999843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d756f38-d64b-481c-b32e-eb5dd817d30f None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:37.000267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d756f38-d64b-481c-b32e-eb5dd817d30f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:37.003896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acec8f-c184-4a8a-acfa-fd3baae4eefd None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:37.086065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d756f38-d64b-481c-b32e-eb5dd817d30f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:37.086065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d756f38-d64b-481c-b32e-eb5dd817d30f None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:37.091860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78e8d2-c6e2-4a62-8a7d-a3aed2825647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:37.092649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78e8d2-c6e2-4a62-8a7d-a3aed2825647 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:37.093076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78e8d2-c6e2-4a62-8a7d-a3aed2825647 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:37.093511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78e8d2-c6e2-4a62-8a7d-a3aed2825647 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:37.094357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78e8d2-c6e2-4a62-8a7d-a3aed2825647 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:37.094805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78e8d2-c6e2-4a62-8a7d-a3aed2825647 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:37.096315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78e8d2-c6e2-4a62-8a7d-a3aed2825647 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:37.118203 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 251/499] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:01:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:37.123754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78e8d2-c6e2-4a62-8a7d-a3aed2825647 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:37.176747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:37.189728 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 249/500] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:01:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 03:01:37.194670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d756f38-d64b-481c-b32e-eb5dd817d30f None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:37.255127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:37.301348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d756f38-d64b-481c-b32e-eb5dd817d30f None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:37.339615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3b163-8d9e-4f65-9711-a57a72f45d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:37.340232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3b163-8d9e-4f65-9711-a57a72f45d30 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:37.340508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3b163-8d9e-4f65-9711-a57a72f45d30 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:37.340779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3b163-8d9e-4f65-9711-a57a72f45d30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:37.345466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78e8d2-c6e2-4a62-8a7d-a3aed2825647 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:37.362808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3b163-8d9e-4f65-9711-a57a72f45d30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:37.364254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3b163-8d9e-4f65-9711-a57a72f45d30 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:37.389552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-64f3b163-8d9e-4f65-9711-a57a72f45d30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:37.389552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:37.389552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:37.389552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:37.389552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:37.389552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:37.389552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:37.389552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:37.389552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:37.389552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:37.389552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:37.389552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:37.389552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:37.389552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:37.389552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:37.389552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:37.391365 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:37.391365 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:37.391365 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:37.391365 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:37.391365 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:37.391365 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:37.391365 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:37.391365 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:37.391365 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:37.391365 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:37.391365 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:37.391365 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:37.391365 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:37.391365 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:37.391365 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:37.391365 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:37.391365 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:37.392488 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:37.392488 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:37.392488 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:37.392488 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 250/501] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:37.398997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3b163-8d9e-4f65-9711-a57a72f45d30 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:37.407962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75113ddb-2181-4143-bb5b-4b43e0b2a500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:37.408906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75113ddb-2181-4143-bb5b-4b43e0b2a500 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:37.409413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75113ddb-2181-4143-bb5b-4b43e0b2a500 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:37.409888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75113ddb-2181-4143-bb5b-4b43e0b2a500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:37.422146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75113ddb-2181-4143-bb5b-4b43e0b2a500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:37.423958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75113ddb-2181-4143-bb5b-4b43e0b2a500 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:37.440625 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-75113ddb-2181-4143-bb5b-4b43e0b2a500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:37.440625 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:37.440625 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:37.440625 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:37.440625 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:37.440625 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:37.440625 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:37.440625 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:37.440625 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:37.440625 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:37.440625 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:37.440625 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:37.440625 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:37.440625 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:37.440625 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:37.440625 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:37.441650 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:37.441650 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:37.441650 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:37.441650 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:37.441650 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:37.441650 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:37.441650 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:37.441650 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:37.441650 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:37.441650 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:37.441650 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:37.441650 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:37.441650 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:37.441650 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:37.441650 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:37.441650 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:37.441650 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:37.442655 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:37.442655 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:37.442655 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:37.445445 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 252/502] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:01:37.450605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75113ddb-2181-4143-bb5b-4b43e0b2a500 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:37.498825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:37.562417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3b163-8d9e-4f65-9711-a57a72f45d30 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:37.599101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734f13a-dfee-4907-8670-7e868f21ab32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:37.599717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734f13a-dfee-4907-8670-7e868f21ab32 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:37.600003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734f13a-dfee-4907-8670-7e868f21ab32 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:37.600283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734f13a-dfee-4907-8670-7e868f21ab32 None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:37.600932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734f13a-dfee-4907-8670-7e868f21ab32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:37.601810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734f13a-dfee-4907-8670-7e868f21ab32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:37.603273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734f13a-dfee-4907-8670-7e868f21ab32 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:37.618428 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 251/503] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:37.624785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734f13a-dfee-4907-8670-7e868f21ab32 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:37.679801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75113ddb-2181-4143-bb5b-4b43e0b2a500 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:37.699672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:37.739441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734f13a-dfee-4907-8670-7e868f21ab32 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:37.741087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:37.752414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0dd15-4ddf-4092-a7a4-3bf269a801f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:37.753149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0dd15-4ddf-4092-a7a4-3bf269a801f6 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:37.753493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0dd15-4ddf-4092-a7a4-3bf269a801f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:37.753832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0dd15-4ddf-4092-a7a4-3bf269a801f6 None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:37.762331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0dd15-4ddf-4092-a7a4-3bf269a801f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:37.762331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0dd15-4ddf-4092-a7a4-3bf269a801f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:37.762331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0dd15-4ddf-4092-a7a4-3bf269a801f6 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:37.782060 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 253/504] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:01:37.787726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0dd15-4ddf-4092-a7a4-3bf269a801f6 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:37.805006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2814cd8-d306-44a1-8ef6-6c0de7f4e1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:37.805672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2814cd8-d306-44a1-8ef6-6c0de7f4e1f8 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:37.805959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2814cd8-d306-44a1-8ef6-6c0de7f4e1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:37.806260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2814cd8-d306-44a1-8ef6-6c0de7f4e1f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:37.821150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2814cd8-d306-44a1-8ef6-6c0de7f4e1f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:37.823566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2814cd8-d306-44a1-8ef6-6c0de7f4e1f8 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:37.844480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-d2814cd8-d306-44a1-8ef6-6c0de7f4e1f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:37.844480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:37.844480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:37.844480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:37.844480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:37.844480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:37.844480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:37.844480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:37.844480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:37.844480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:37.844480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:37.844480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:37.844480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:01:37.844480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:01:37.844480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:01:37.845513 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:01:37.845513 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:37.845513 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:37.845513 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:37.845513 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:37.845513 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:37.845513 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:37.845513 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:37.845513 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:37.845513 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:37.845513 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:37.845513 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:37.845513 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:37.845513 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:37.845513 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:37.845513 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:37.845513 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:37.846434 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:01:37.846434 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:01:37.846434 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:01:37.846434 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:01:37.846434 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:01:37.846434 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:01:37.846434 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:37.846434 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:37.846880 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 252/505] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:01:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:37.855199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2814cd8-d306-44a1-8ef6-6c0de7f4e1f8 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:37.973874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0dd15-4ddf-4092-a7a4-3bf269a801f6 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:38.013518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c5a95-d958-47e4-a613-b34c6e02ad84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:38.014179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c5a95-d958-47e4-a613-b34c6e02ad84 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:38.014465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c5a95-d958-47e4-a613-b34c6e02ad84 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:38.014743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c5a95-d958-47e4-a613-b34c6e02ad84 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:38.022278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c5a95-d958-47e4-a613-b34c6e02ad84 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:38.024323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c5a95-d958-47e4-a613-b34c6e02ad84 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:38.029535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2814cd8-d306-44a1-8ef6-6c0de7f4e1f8 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:38.036382 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-cd3c5a95-d958-47e4-a613-b34c6e02ad84 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 03:01:38.036382 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:38.036382 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:38.036382 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:38.036382 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:38.036382 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:38.036382 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:38.036382 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:38.036382 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:38.036382 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:38.036382 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:38.036382 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:38.036382 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:01:38.036382 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:01:38.036382 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:01:38.036382 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:01:38.037320 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:38.037320 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:38.037320 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:01:38.037320 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:38.037320 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:01:38.037320 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:38.037320 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:38.037320 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:38.037320 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:38.037320 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:38.037320 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:38.037320 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:38.037320 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:38.037320 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:38.037320 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:38.037320 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:38.037320 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:38.037320 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:38.039170 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:38.039170 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:38.039170 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:01:38.039170 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:01:38.039170 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:01:38.039170 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:01:38.039170 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:01:38.039170 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:01:38.039170 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 27 03:01:38.039170 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:38.039170 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 254/506] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Oct 27 03:01:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:38.039170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67885f3-41c7-4935-aa5a-443ccc133bba None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:38.039823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67885f3-41c7-4935-aa5a-443ccc133bba None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:38.039823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67885f3-41c7-4935-aa5a-443ccc133bba None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:38.044954 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 255/507] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:38.044954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4c12c-c33f-4dfd-9a3b-e26b0c1800bd None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:38.044954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4c12c-c33f-4dfd-9a3b-e26b0c1800bd None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:38.044954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4c12c-c33f-4dfd-9a3b-e26b0c1800bd None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:38.044954 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 256/508] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:38.044954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4c12c-c33f-4dfd-9a3b-e26b0c1800bd None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:38.074128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:38.077957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340f3a2-e0ec-4632-9ee9-dc7de4639438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:38.078704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340f3a2-e0ec-4632-9ee9-dc7de4639438 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:38.079056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340f3a2-e0ec-4632-9ee9-dc7de4639438 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:38.079420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340f3a2-e0ec-4632-9ee9-dc7de4639438 None admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:38.080187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340f3a2-e0ec-4632-9ee9-dc7de4639438 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:38.080562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340f3a2-e0ec-4632-9ee9-dc7de4639438 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:38.082099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340f3a2-e0ec-4632-9ee9-dc7de4639438 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:38.095008 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 253/509] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 27 03:01:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:38.096360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc748f4-690c-4759-9ec0-a4cce8663159 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:38.096717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc748f4-690c-4759-9ec0-a4cce8663159 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:38.097062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc748f4-690c-4759-9ec0-a4cce8663159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:38.115455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4dc748f4-690c-4759-9ec0-a4cce8663159 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:38.116660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4dc748f4-690c-4759-9ec0-a4cce8663159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:38.134243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:38.156411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4c12c-c33f-4dfd-9a3b-e26b0c1800bd None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:38.190342 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 254/510] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:38.199146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd168dfb-d470-49fe-a3aa-1309aaa38708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:38.199746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd168dfb-d470-49fe-a3aa-1309aaa38708 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:38.200167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7d8b7-9b06-4719-8164-81c3419b13e2 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:38.200284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd168dfb-d470-49fe-a3aa-1309aaa38708 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:38.200455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd168dfb-d470-49fe-a3aa-1309aaa38708 None admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:38.200943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7d8b7-9b06-4719-8164-81c3419b13e2 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:38.201184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd168dfb-d470-49fe-a3aa-1309aaa38708 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:38.201495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd168dfb-d470-49fe-a3aa-1309aaa38708 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:38.201849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7d8b7-9b06-4719-8164-81c3419b13e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:38.202979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd168dfb-d470-49fe-a3aa-1309aaa38708 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:38.221721 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 257/511] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Oct 27 03:01:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:38.222664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd168dfb-d470-49fe-a3aa-1309aaa38708 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:38.230498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2cf7d8b7-9b06-4719-8164-81c3419b13e2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:38.232609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2cf7d8b7-9b06-4719-8164-81c3419b13e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:38.321091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:38.341179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd168dfb-d470-49fe-a3aa-1309aaa38708 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:38.341339 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 255/512] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:38.341339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7d8b7-9b06-4719-8164-81c3419b13e2 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:38.427465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5cb98-586a-4dd7-ae96-059b98c75a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:38.428134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5cb98-586a-4dd7-ae96-059b98c75a93 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:38.428419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5cb98-586a-4dd7-ae96-059b98c75a93 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:38.428693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5cb98-586a-4dd7-ae96-059b98c75a93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:38.429576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5cb98-586a-4dd7-ae96-059b98c75a93 None admin] RBAC: Adding query filter params (role.id=248be75b0cf142299cd46440170c7972, scope.project.id=1ae07f0abb504c298fc9893b1d8bb173, user.id=fe7800497c6e460f9a2a0bd259e6d236) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:38.429888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5cb98-586a-4dd7-ae96-059b98c75a93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:38.431417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5cb98-586a-4dd7-ae96-059b98c75a93 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:38.437453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:38.449865 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 258/513] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:01:38 2022] GET /identity/v3/role_assignments?user.id=fe7800497c6e460f9a2a0bd259e6d236&scope.project.id=1ae07f0abb504c298fc9893b1d8bb173&role.id=248be75b0cf142299cd46440170c7972 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:38.462083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7d8b7-9b06-4719-8164-81c3419b13e2 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:38.491615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5cb98-586a-4dd7-ae96-059b98c75a93 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:38.503024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83642b3-041c-4db1-a855-0c207c2e77c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:38.504069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83642b3-041c-4db1-a855-0c207c2e77c4 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:38.504560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83642b3-041c-4db1-a855-0c207c2e77c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:38.505068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83642b3-041c-4db1-a855-0c207c2e77c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:38.519296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83642b3-041c-4db1-a855-0c207c2e77c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:38.521420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83642b3-041c-4db1-a855-0c207c2e77c4 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:38.542761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-b83642b3-041c-4db1-a855-0c207c2e77c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:38.542761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:38.542761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:38.542761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:38.542761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:38.542761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:38.542761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:38.542761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:38.542761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:38.542761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:38.542761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:38.542761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:38.542761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:38.542761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:38.542761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:38.542761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:38.543788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:38.543788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:38.543788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:38.543788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:38.543788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:38.543788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:38.543788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:38.543788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:38.543788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:38.543788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:38.543788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:38.543788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:38.543788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:38.543788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:38.543788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:38.543788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:38.543788 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:38.544711 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:38.544711 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:38.544711 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:38.547010 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 256/514] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:38.552544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83642b3-041c-4db1-a855-0c207c2e77c4 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:38.646257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5cb98-586a-4dd7-ae96-059b98c75a93 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:38.689902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700007f-f60d-465e-8d22-4741eb004597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:38.690682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700007f-f60d-465e-8d22-4741eb004597 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:38.690964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700007f-f60d-465e-8d22-4741eb004597 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:38.691772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700007f-f60d-465e-8d22-4741eb004597 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:38.691876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700007f-f60d-465e-8d22-4741eb004597 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:38.693331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700007f-f60d-465e-8d22-4741eb004597 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:38.695613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83642b3-041c-4db1-a855-0c207c2e77c4 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:38.706124 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-f700007f-f60d-465e-8d22-4741eb004597 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 03:01:38.706124 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:38.706124 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:01:38.706124 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:01:38.706124 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:01:38.706124 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:01:38.706124 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:01:38.706124 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:01:38.706124 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 03:01:38.706124 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:38.706124 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:01:38.706124 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:38.706124 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:38.706124 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:38.706124 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:38.706124 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:38.706124 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:38.707158 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:38.707158 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:38.707158 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:38.707158 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:38.707158 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:38.707158 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:38.707158 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:01:38.707158 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:01:38.707158 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:01:38.707158 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:01:38.707158 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:38.707158 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:38.707158 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:38.707158 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:38.707158 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:38.707158 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:38.708013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:38.708013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:38.708013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:38.708013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:38.708013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:38.708013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:38.708013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:38.708013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:38.708013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:38.708013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:38.708013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:01:38.708013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:01:38.708013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 03:01:38.708013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:38.708013 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 259/515] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Oct 27 03:01:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:38.708879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a0167-7b0e-47f8-b41d-2b65c64280db None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:38.708879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a0167-7b0e-47f8-b41d-2b65c64280db None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:38.709602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a0167-7b0e-47f8-b41d-2b65c64280db None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:38.711155 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 260/516] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:38.711871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a0167-7b0e-47f8-b41d-2b65c64280db None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:38.728314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:38.740128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8908e78-4f04-4014-a502-242fb3a9ba5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:38.740906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8908e78-4f04-4014-a502-242fb3a9ba5c None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:38.741196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8908e78-4f04-4014-a502-242fb3a9ba5c None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:38.741815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8908e78-4f04-4014-a502-242fb3a9ba5c None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:38.742798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8908e78-4f04-4014-a502-242fb3a9ba5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:38.743085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8908e78-4f04-4014-a502-242fb3a9ba5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:38.744922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8908e78-4f04-4014-a502-242fb3a9ba5c None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:38.746817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:38.758425 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 257/517] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:01:38.763736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8908e78-4f04-4014-a502-242fb3a9ba5c None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:38.821156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a0167-7b0e-47f8-b41d-2b65c64280db None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:38.857032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c94b53-fc98-4614-b1c3-36730e6eea08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:38.857660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c94b53-fc98-4614-b1c3-36730e6eea08 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:38.857989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c94b53-fc98-4614-b1c3-36730e6eea08 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:38.858296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c94b53-fc98-4614-b1c3-36730e6eea08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:38.862443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8908e78-4f04-4014-a502-242fb3a9ba5c None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:38.869023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c94b53-fc98-4614-b1c3-36730e6eea08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:38.870639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c94b53-fc98-4614-b1c3-36730e6eea08 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:38.886997 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-b3c94b53-fc98-4614-b1c3-36730e6eea08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:38.886997 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:38.886997 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:38.886997 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:38.886997 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:38.886997 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:38.886997 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:38.886997 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:38.886997 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:38.886997 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:38.886997 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:38.886997 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:38.886997 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:38.886997 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:38.886997 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:38.886997 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:38.887944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:38.887944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:38.887944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:38.887944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:38.887944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:38.887944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:38.887944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:38.887944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:38.887944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:38.887944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:38.887944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:38.887944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:38.887944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:38.887944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:38.887944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:38.887944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:38.887944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:38.888834 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:38.888834 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:38.888834 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:38.888834 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 261/518] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:38.889474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3631bf-f14a-4a64-badd-1de9c3e6136e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:38.889661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3631bf-f14a-4a64-badd-1de9c3e6136e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:38.889934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3631bf-f14a-4a64-badd-1de9c3e6136e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:38.901878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add46348-ae87-4fb7-877f-4f1eeeaadb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:38.902459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add46348-ae87-4fb7-877f-4f1eeeaadb7c None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:38.902742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add46348-ae87-4fb7-877f-4f1eeeaadb7c None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:38.903021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add46348-ae87-4fb7-877f-4f1eeeaadb7c None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:38.903660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add46348-ae87-4fb7-877f-4f1eeeaadb7c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:38.903965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add46348-ae87-4fb7-877f-4f1eeeaadb7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:38.905369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add46348-ae87-4fb7-877f-4f1eeeaadb7c None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:38.908784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5f3631bf-f14a-4a64-badd-1de9c3e6136e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:38.914159 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 258/519] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Oct 27 03:01:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:38.914316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5f3631bf-f14a-4a64-badd-1de9c3e6136e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:38.914407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add46348-ae87-4fb7-877f-4f1eeeaadb7c None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:38.972712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:38.975949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:38.983889 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 262/520] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:38.984036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3631bf-f14a-4a64-badd-1de9c3e6136e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:39.017716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add46348-ae87-4fb7-877f-4f1eeeaadb7c None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:39.053042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a73ae9-159d-4a3b-bcda-1b9be1dc0a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:39.053856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a73ae9-159d-4a3b-bcda-1b9be1dc0a7b None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:39.054312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a73ae9-159d-4a3b-bcda-1b9be1dc0a7b None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:39.054676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a73ae9-159d-4a3b-bcda-1b9be1dc0a7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:39.061721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a73ae9-159d-4a3b-bcda-1b9be1dc0a7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:39.063345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a73ae9-159d-4a3b-bcda-1b9be1dc0a7b None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:39.075415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-b3a73ae9-159d-4a3b-bcda-1b9be1dc0a7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:39.075415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:39.075415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:39.075415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:39.075415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:39.075415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:39.075415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:39.075415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:39.075415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:39.075415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:39.075415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:39.075415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:39.075415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:01:39.075415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:01:39.075415 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:01:39.076317 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:01:39.076317 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:39.076317 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:39.076317 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:39.076317 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:39.076317 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:39.076317 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:39.076317 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:39.076317 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:39.076317 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:39.076317 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:39.076317 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:39.076317 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:39.076317 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:39.076317 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:39.076317 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:39.076317 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:39.077235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:01:39.077235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:01:39.077235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:01:39.077235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:01:39.077235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:01:39.077235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:01:39.077235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:39.077235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:39.081410 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 259/521] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:01:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:39.082476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a73ae9-159d-4a3b-bcda-1b9be1dc0a7b None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:39.110352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3631bf-f14a-4a64-badd-1de9c3e6136e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:39.156381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf17b1-043a-46b0-a889-95234fd650fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:39.156927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf17b1-043a-46b0-a889-95234fd650fe None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:39.157279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf17b1-043a-46b0-a889-95234fd650fe None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:39.157479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf17b1-043a-46b0-a889-95234fd650fe None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:39.158252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf17b1-043a-46b0-a889-95234fd650fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:39.158525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf17b1-043a-46b0-a889-95234fd650fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:39.160159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf17b1-043a-46b0-a889-95234fd650fe None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:39.172862 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 263/522] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:39.173890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf17b1-043a-46b0-a889-95234fd650fe None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:39.207525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a73ae9-159d-4a3b-bcda-1b9be1dc0a7b None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:39.225641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:39.244514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b125e-bfe1-4032-9598-e4ef12aeb851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:39.245400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b125e-bfe1-4032-9598-e4ef12aeb851 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:39.245826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b125e-bfe1-4032-9598-e4ef12aeb851 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:39.246296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b125e-bfe1-4032-9598-e4ef12aeb851 None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:39.247099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b125e-bfe1-4032-9598-e4ef12aeb851 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:39.247616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b125e-bfe1-4032-9598-e4ef12aeb851 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:39.249257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b125e-bfe1-4032-9598-e4ef12aeb851 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:39.251060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:39.262237 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 260/523] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Oct 27 03:01:39 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:39.264412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b125e-bfe1-4032-9598-e4ef12aeb851 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:39.301609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf17b1-043a-46b0-a889-95234fd650fe None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:39.347293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3fd73-5aca-4a15-be53-6944083e9fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:39.348236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3fd73-5aca-4a15-be53-6944083e9fbe None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:39.348702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3fd73-5aca-4a15-be53-6944083e9fbe None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:39.349493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3fd73-5aca-4a15-be53-6944083e9fbe None admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:39.350468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3fd73-5aca-4a15-be53-6944083e9fbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:39.351327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3fd73-5aca-4a15-be53-6944083e9fbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:39.353970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3fd73-5aca-4a15-be53-6944083e9fbe None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:39.373138 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 264/524] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 27 03:01:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:39.374771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3fd73-5aca-4a15-be53-6944083e9fbe None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:39.399165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b125e-bfe1-4032-9598-e4ef12aeb851 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:39.442291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8aa8e1-a3a9-44e1-83fb-df566080238b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:39.443523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8aa8e1-a3a9-44e1-83fb-df566080238b None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:39.444268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8aa8e1-a3a9-44e1-83fb-df566080238b None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:39.444724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8aa8e1-a3a9-44e1-83fb-df566080238b None admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:39.445947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8aa8e1-a3a9-44e1-83fb-df566080238b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:39.450197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8aa8e1-a3a9-44e1-83fb-df566080238b None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:39.503858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3fd73-5aca-4a15-be53-6944083e9fbe None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:39.521390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:39.533120 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 261/525] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 27 03:01:39 2022] POST /identity/v3/users => generated 254 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:01:39.534766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8aa8e1-a3a9-44e1-83fb-df566080238b None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:39.540023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0097aa7-5292-4616-9531-08be1e4ec38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:39.540692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0097aa7-5292-4616-9531-08be1e4ec38c None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:39.540973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0097aa7-5292-4616-9531-08be1e4ec38c None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:39.541246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0097aa7-5292-4616-9531-08be1e4ec38c None admin] PATH_INFO: `/v3/services/network` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:39.541856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0097aa7-5292-4616-9531-08be1e4ec38c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:39.543331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0097aa7-5292-4616-9531-08be1e4ec38c None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:39.554363 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-c0097aa7-5292-4616-9531-08be1e4ec38c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 03:01:39.554363 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:39.554363 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:01:39.554363 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:01:39.554363 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:01:39.554363 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:01:39.554363 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:01:39.554363 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:01:39.554363 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 03:01:39.554363 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:39.554363 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:01:39.554363 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:39.554363 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:39.554363 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:39.554363 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:39.554363 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:39.554363 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:39.555914 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:39.555914 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:39.555914 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:39.555914 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:39.555914 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:39.555914 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:39.555914 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:01:39.555914 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:01:39.555914 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:01:39.555914 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:01:39.555914 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:39.555914 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:39.555914 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:39.555914 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:39.555914 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:39.555914 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:39.556813 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:39.556813 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:39.556813 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:39.556813 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:39.556813 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:39.556813 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:39.556813 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:39.556813 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:39.556813 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:39.556813 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:39.556813 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:01:39.556813 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:01:39.556813 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 03:01:39.556813 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:39.556813 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 265/526] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:01:39 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:39.562937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0097aa7-5292-4616-9531-08be1e4ec38c None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:39.606413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:39.672814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8aa8e1-a3a9-44e1-83fb-df566080238b None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:39.715043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175df11-881a-48c9-a84f-a8f39c246465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:39.715975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175df11-881a-48c9-a84f-a8f39c246465 None admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:39.716263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175df11-881a-48c9-a84f-a8f39c246465 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:39.716540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175df11-881a-48c9-a84f-a8f39c246465 None admin] PATH_INFO: `/v3/projects/1ae07f0abb504c298fc9893b1d8bb173/users/c20881251f2241a3a5ec2e5cf99db149/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:39.718921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175df11-881a-48c9-a84f-a8f39c246465 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ae07f0abb504c298fc9893b1d8bb173, user_id=c20881251f2241a3a5ec2e5cf99db149, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:39.720669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175df11-881a-48c9-a84f-a8f39c246465 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:39.777139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0097aa7-5292-4616-9531-08be1e4ec38c None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:39.796486 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 262/527] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:01:39 2022] PUT /identity/v3/projects/1ae07f0abb504c298fc9893b1d8bb173/users/c20881251f2241a3a5ec2e5cf99db149/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:01:39.814994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010f58c-4991-4070-8f22-32f2c7531f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:39.815645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010f58c-4991-4070-8f22-32f2c7531f2c None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:39.815928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010f58c-4991-4070-8f22-32f2c7531f2c None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:39.816199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010f58c-4991-4070-8f22-32f2c7531f2c None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:39.816854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010f58c-4991-4070-8f22-32f2c7531f2c None admin] RBAC: Adding query filter params (name=network) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:39.817155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010f58c-4991-4070-8f22-32f2c7531f2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:39.818624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010f58c-4991-4070-8f22-32f2c7531f2c None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:39.824212 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 266/528] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 27 03:01:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:01:39.829880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175df11-881a-48c9-a84f-a8f39c246465 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:39.977188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175df11-881a-48c9-a84f-a8f39c246465 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:39.991309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:40.019956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73f305-891f-46d4-9ee0-9f661fbb3ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:40.020962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73f305-891f-46d4-9ee0-9f661fbb3ad9 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:40.021440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73f305-891f-46d4-9ee0-9f661fbb3ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:40.021954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73f305-891f-46d4-9ee0-9f661fbb3ad9 None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:40.022817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73f305-891f-46d4-9ee0-9f661fbb3ad9 None admin] RBAC: Adding query filter params (type=network) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:40.023896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73f305-891f-46d4-9ee0-9f661fbb3ad9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:40.025462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73f305-891f-46d4-9ee0-9f661fbb3ad9 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:40.035133 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 263/529] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 27 03:01:39 2022] GET /identity/v3/services?type=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:40.955228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d7ebb-d775-4e0e-970e-05490037c62b None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:40.955747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d7ebb-d775-4e0e-970e-05490037c62b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:40.955855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d7ebb-d775-4e0e-970e-05490037c62b None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:40.957376 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 267/530] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:40.962953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196006b-3de4-40ba-ba38-10f218ae7523 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:40.963338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196006b-3de4-40ba-ba38-10f218ae7523 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:40.963504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196006b-3de4-40ba-ba38-10f218ae7523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:40.989405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6196006b-3de4-40ba-ba38-10f218ae7523 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:40.990639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6196006b-3de4-40ba-ba38-10f218ae7523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:41.092253 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 264/531] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 03:01:41.384646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d7ebb-d775-4e0e-970e-05490037c62b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:41.441905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:41.519678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d7ebb-d775-4e0e-970e-05490037c62b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:41.564857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64513179-1c03-4028-9460-db1f24a831c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:41.565496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64513179-1c03-4028-9460-db1f24a831c3 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:41.565783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64513179-1c03-4028-9460-db1f24a831c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:41.566074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64513179-1c03-4028-9460-db1f24a831c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:41.582887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64513179-1c03-4028-9460-db1f24a831c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:41.588675 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-64513179-1c03-4028-9460-db1f24a831c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:01:41.588675 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:41.588675 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:41.588675 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:41.588675 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:41.588675 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:41.588675 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:41.588675 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:41.588675 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:41.588675 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:41.588675 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:41.588675 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:41.588675 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:41.588675 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:41.588675 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:41.588675 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:41.589585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:41.589585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:41.589585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:41.589585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:41.589585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:41.589585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:41.589585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:41.589585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:41.589585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:41.589585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:41.589585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:41.589585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:41.589585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:41.589585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:41.589585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:41.589585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:41.590453 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:41.590453 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:41.590453 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:41.590453 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:41.590453 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:41.590453 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:41.590453 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:41.590453 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:41.590453 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:41.590453 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:41.590453 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:01:41.590453 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:41.590453 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 268/532] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 27 03:01:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:41.595933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196006b-3de4-40ba-ba38-10f218ae7523 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:41.737553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:41.749901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196006b-3de4-40ba-ba38-10f218ae7523 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:41.785891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596b7ae-98ba-466f-af0a-71be38a0b169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:41.786538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596b7ae-98ba-466f-af0a-71be38a0b169 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:41.786822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596b7ae-98ba-466f-af0a-71be38a0b169 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:41.787101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596b7ae-98ba-466f-af0a-71be38a0b169 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:41.787839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596b7ae-98ba-466f-af0a-71be38a0b169 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:41.788151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596b7ae-98ba-466f-af0a-71be38a0b169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:41.789571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596b7ae-98ba-466f-af0a-71be38a0b169 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:41.802142 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 265/533] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:01:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:41.804107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64513179-1c03-4028-9460-db1f24a831c3 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:41.819038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19a7e4-b1af-4837-8d17-e783aa79967c None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:41.819638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19a7e4-b1af-4837-8d17-e783aa79967c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:41.820666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19a7e4-b1af-4837-8d17-e783aa79967c None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:41.822209 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 266/534] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:41.827221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a025e9-c72a-46f2-b517-96b118cc7ead None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:41.827779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a025e9-c72a-46f2-b517-96b118cc7ead None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:41.828264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a025e9-c72a-46f2-b517-96b118cc7ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:41.863089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-34a025e9-c72a-46f2-b517-96b118cc7ead None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:41.864623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-34a025e9-c72a-46f2-b517-96b118cc7ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:41.970796 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 267/535] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 03:01:41.982147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64513179-1c03-4028-9460-db1f24a831c3 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:41.992468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:42.041142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911b58d-68cd-489a-b5ee-e38edfefdb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:42.041780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911b58d-68cd-489a-b5ee-e38edfefdb58 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:42.042088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911b58d-68cd-489a-b5ee-e38edfefdb58 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:42.042372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911b58d-68cd-489a-b5ee-e38edfefdb58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:42.058478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911b58d-68cd-489a-b5ee-e38edfefdb58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:42.059945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911b58d-68cd-489a-b5ee-e38edfefdb58 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:42.086443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-f911b58d-68cd-489a-b5ee-e38edfefdb58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:42.086443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:42.086443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:42.086443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:42.086443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:42.086443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:42.086443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:42.086443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:42.086443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:42.086443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:42.086443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:42.086443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:42.086443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:42.086443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:42.086443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:42.086443 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:42.087435 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:42.087435 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:42.087435 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:42.087435 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:42.087435 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:42.087435 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:42.087435 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:42.087435 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:42.087435 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:42.087435 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:42.087435 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:42.087435 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:42.087435 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:42.087435 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:42.087435 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:42.087435 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:42.087435 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:42.088777 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:42.088777 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:42.088777 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:42.088777 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 269/536] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:42.094919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a025e9-c72a-46f2-b517-96b118cc7ead None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:42.230176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:42.259621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a025e9-c72a-46f2-b517-96b118cc7ead None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:42.264720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911b58d-68cd-489a-b5ee-e38edfefdb58 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:42.301132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69a6da-5715-4123-9db3-1c709c307049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:42.301746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69a6da-5715-4123-9db3-1c709c307049 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:42.302042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69a6da-5715-4123-9db3-1c709c307049 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:42.302337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69a6da-5715-4123-9db3-1c709c307049 None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:42.303525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69a6da-5715-4123-9db3-1c709c307049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:42.303836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69a6da-5715-4123-9db3-1c709c307049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:42.305756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69a6da-5715-4123-9db3-1c709c307049 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:42.319261 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 268/537] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:42.325474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69a6da-5715-4123-9db3-1c709c307049 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:42.465772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911b58d-68cd-489a-b5ee-e38edfefdb58 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:42.475650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69a6da-5715-4123-9db3-1c709c307049 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:42.503355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fd0bd-e89c-45fc-87b4-d026c99bba9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:42.504236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fd0bd-e89c-45fc-87b4-d026c99bba9d None admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:42.504687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fd0bd-e89c-45fc-87b4-d026c99bba9d None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:42.505101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fd0bd-e89c-45fc-87b4-d026c99bba9d None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:42.506081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fd0bd-e89c-45fc-87b4-d026c99bba9d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:42.508589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fd0bd-e89c-45fc-87b4-d026c99bba9d None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:42.519527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ee95d-baa8-401e-84d2-2a173caff6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:42.520190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ee95d-baa8-401e-84d2-2a173caff6f9 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:42.520540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ee95d-baa8-401e-84d2-2a173caff6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:42.520818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ee95d-baa8-401e-84d2-2a173caff6f9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:42.529901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ee95d-baa8-401e-84d2-2a173caff6f9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:42.531440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ee95d-baa8-401e-84d2-2a173caff6f9 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:42.544691 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-2d5ee95d-baa8-401e-84d2-2a173caff6f9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 03:01:42.544691 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:42.544691 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:42.544691 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:42.544691 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:42.544691 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:42.544691 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:42.544691 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:42.544691 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:42.544691 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:42.544691 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:42.544691 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:42.544691 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:01:42.544691 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:01:42.544691 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:01:42.544691 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:01:42.545945 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:42.545945 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:42.545945 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:01:42.545945 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:42.545945 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:01:42.545945 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:42.545945 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:42.545945 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:42.545945 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:42.545945 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:42.545945 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:42.545945 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:42.545945 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:42.545945 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:42.545945 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:42.545945 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:42.545945 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:42.545945 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:42.547084 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:42.547084 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:42.547084 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:01:42.547084 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:01:42.547084 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:01:42.547084 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:01:42.547084 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:01:42.547084 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:01:42.547084 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 27 03:01:42.547084 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:42.547084 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 269/538] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 27 03:01:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:01:42.547672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cf0e2-2b5c-429a-888e-5cd8f2782403 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:42.547672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cf0e2-2b5c-429a-888e-5cd8f2782403 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:42.548145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cf0e2-2b5c-429a-888e-5cd8f2782403 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:42.550596 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 270/539] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:42.552294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cf0e2-2b5c-429a-888e-5cd8f2782403 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:42.556852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:42.615056 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 270/540] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 27 03:01:42 2022] POST /identity/v3/services => generated 251 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:01:42.616606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03309013-65d2-4bc9-b39d-e2b1e6527b91 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:42.617459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03309013-65d2-4bc9-b39d-e2b1e6527b91 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:42.617751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03309013-65d2-4bc9-b39d-e2b1e6527b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:42.652261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-03309013-65d2-4bc9-b39d-e2b1e6527b91 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:42.653348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-03309013-65d2-4bc9-b39d-e2b1e6527b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:42.670138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:42.708440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cf0e2-2b5c-429a-888e-5cd8f2782403 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:42.756839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917d144-0251-4aca-a42e-8083aa0fb1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:42.757767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917d144-0251-4aca-a42e-8083aa0fb1c4 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:42.758094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917d144-0251-4aca-a42e-8083aa0fb1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:42.758339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917d144-0251-4aca-a42e-8083aa0fb1c4 None admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:42.759056 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 271/541] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:42.760650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8d7fd-615d-4b68-82a6-bd8f406086c8 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:42.761201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8d7fd-615d-4b68-82a6-bd8f406086c8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:42.761674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8d7fd-615d-4b68-82a6-bd8f406086c8 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:42.763658 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 272/542] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:42.766498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917d144-0251-4aca-a42e-8083aa0fb1c4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:42.767148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917d144-0251-4aca-a42e-8083aa0fb1c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:42.768909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917d144-0251-4aca-a42e-8083aa0fb1c4 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:42.783698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9ddf5-f291-4fbf-b376-5cb4a6e94794 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:42.784302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9ddf5-f291-4fbf-b376-5cb4a6e94794 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:42.784794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9ddf5-f291-4fbf-b376-5cb4a6e94794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:42.805825 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 271/543] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Oct 27 03:01:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:42.812509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0ed9ddf5-f291-4fbf-b376-5cb4a6e94794 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:42.813938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0ed9ddf5-f291-4fbf-b376-5cb4a6e94794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:42.814372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55a93a-1492-4674-97f5-23bc6b4359a9 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:42.814763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55a93a-1492-4674-97f5-23bc6b4359a9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:42.815144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55a93a-1492-4674-97f5-23bc6b4359a9 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:42.818096 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 272/544] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:42.819027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55a93a-1492-4674-97f5-23bc6b4359a9 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:42.894240 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 273/545] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 03:01:42.895478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5e988-f511-4430-95b0-d5f3e737758f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:42.895768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5e988-f511-4430-95b0-d5f3e737758f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:42.896044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5e988-f511-4430-95b0-d5f3e737758f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:42.906462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:42.934154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6cc5e988-f511-4430-95b0-d5f3e737758f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:42.935390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6cc5e988-f511-4430-95b0-d5f3e737758f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:42.978909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55a93a-1492-4674-97f5-23bc6b4359a9 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:43.035035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479cef5-e86a-43b4-b212-7eefab48a19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:43.035597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479cef5-e86a-43b4-b212-7eefab48a19c None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:43.035881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479cef5-e86a-43b4-b212-7eefab48a19c None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:43.036161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479cef5-e86a-43b4-b212-7eefab48a19c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:43.047976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479cef5-e86a-43b4-b212-7eefab48a19c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:43.049441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479cef5-e86a-43b4-b212-7eefab48a19c None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:43.052895 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 274/546] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:01:43.053757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5e988-f511-4430-95b0-d5f3e737758f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:43.066356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:43.079385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-5479cef5-e86a-43b4-b212-7eefab48a19c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:43.079385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:43.079385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:43.079385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:43.079385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:43.079385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:43.079385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:43.079385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:43.079385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:43.079385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:43.079385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:43.079385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:43.079385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:43.079385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:43.079385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:43.079385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:43.080494 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:43.080494 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:43.080494 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:43.080494 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:43.080494 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:43.080494 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:43.080494 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:43.080494 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:43.080494 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:43.080494 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:43.080494 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:43.080494 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:43.080494 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:43.080494 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:43.080494 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:43.080494 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:43.080494 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:43.081380 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:43.081380 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:43.081380 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:43.081380 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 273/547] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:43.087558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479cef5-e86a-43b4-b212-7eefab48a19c None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:43.173274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5e988-f511-4430-95b0-d5f3e737758f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:43.219521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b9257-273c-4ba7-bd75-e6da444013ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:43.220981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b9257-273c-4ba7-bd75-e6da444013ff None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:43.221688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b9257-273c-4ba7-bd75-e6da444013ff None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:43.222144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b9257-273c-4ba7-bd75-e6da444013ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:43.236329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b9257-273c-4ba7-bd75-e6da444013ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:43.243249 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-1d2b9257-273c-4ba7-bd75-e6da444013ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:01:43.243249 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:43.243249 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:43.243249 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:43.243249 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:43.243249 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:43.243249 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:43.243249 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:43.243249 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:43.243249 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:43.243249 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:43.243249 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:43.243249 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:43.243249 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:43.243249 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:43.243249 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:43.244367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:43.244367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:43.244367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:43.244367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:43.244367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:43.244367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:43.244367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:43.244367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:43.244367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:43.244367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:43.244367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:43.244367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:43.244367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:43.244367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:43.244367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:43.244367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:43.245397 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:43.245397 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:43.245397 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:43.245397 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:43.245397 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:43.245397 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:43.245397 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:43.245397 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:43.245397 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:43.245397 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:43.245397 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:01:43.245397 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:43.253177 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 275/548] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 27 03:01:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:43.254695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b9257-273c-4ba7-bd75-e6da444013ff None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:43.264706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479cef5-e86a-43b4-b212-7eefab48a19c None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:43.276649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:43.301053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fb36b-aeea-47ad-b44c-255f4b13d2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:43.301977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fb36b-aeea-47ad-b44c-255f4b13d2ee None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:43.302118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fb36b-aeea-47ad-b44c-255f4b13d2ee None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:43.302463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fb36b-aeea-47ad-b44c-255f4b13d2ee None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:43.303291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160fb36b-aeea-47ad-b44c-255f4b13d2ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:43.303661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160fb36b-aeea-47ad-b44c-255f4b13d2ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:43.305132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160fb36b-aeea-47ad-b44c-255f4b13d2ee None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:43.323993 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 274/549] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:01:43.323993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fb36b-aeea-47ad-b44c-255f4b13d2ee None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:43.353530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:43.392891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b9257-273c-4ba7-bd75-e6da444013ff None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:43.427093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ef8a6-741b-4b49-a2f9-9f4f8ac61936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:43.427724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ef8a6-741b-4b49-a2f9-9f4f8ac61936 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:43.428011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ef8a6-741b-4b49-a2f9-9f4f8ac61936 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:43.428292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ef8a6-741b-4b49-a2f9-9f4f8ac61936 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:43.436914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fb36b-aeea-47ad-b44c-255f4b13d2ee None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:43.438850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ef8a6-741b-4b49-a2f9-9f4f8ac61936 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:43.443588 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-156ef8a6-741b-4b49-a2f9-9f4f8ac61936 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:01:43.443588 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:43.443588 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:43.443588 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:43.443588 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:43.443588 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:43.443588 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:43.443588 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:43.443588 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:43.443588 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:43.443588 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:43.443588 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:43.443588 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:43.443588 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:43.443588 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:43.443588 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:43.445286 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:43.445286 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:43.445286 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:43.445286 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:43.445286 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:43.445286 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:43.445286 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:43.445286 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:43.445286 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:43.445286 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:43.445286 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:43.445286 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:43.445286 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:43.445286 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:43.445286 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:43.445286 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:43.446196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:43.446196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:43.446196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:43.446196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:43.446196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:43.446196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:43.446196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:43.446196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:43.446196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:43.446196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:43.446196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:01:43.446196 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:43.446196 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 276/550] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 27 03:01:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:43.446196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ef8a6-741b-4b49-a2f9-9f4f8ac61936 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:43.481350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69b029-b3f4-4db5-8cc9-22eefec72fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:43.482309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69b029-b3f4-4db5-8cc9-22eefec72fe7 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:43.482591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69b029-b3f4-4db5-8cc9-22eefec72fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:43.482865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69b029-b3f4-4db5-8cc9-22eefec72fe7 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:43.483536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69b029-b3f4-4db5-8cc9-22eefec72fe7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:43.483840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69b029-b3f4-4db5-8cc9-22eefec72fe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:43.485209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69b029-b3f4-4db5-8cc9-22eefec72fe7 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:43.499480 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 275/551] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:01:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:43.499480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69b029-b3f4-4db5-8cc9-22eefec72fe7 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:43.532492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:43.552714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ef8a6-741b-4b49-a2f9-9f4f8ac61936 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:43.579346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:43.588836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99070eaf-7165-4006-a22b-6b23c9007d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:43.589580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99070eaf-7165-4006-a22b-6b23c9007d19 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:43.589869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99070eaf-7165-4006-a22b-6b23c9007d19 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:43.590180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99070eaf-7165-4006-a22b-6b23c9007d19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:43.596797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99070eaf-7165-4006-a22b-6b23c9007d19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:43.598350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99070eaf-7165-4006-a22b-6b23c9007d19 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:43.605830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69b029-b3f4-4db5-8cc9-22eefec72fe7 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:43.610777 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-99070eaf-7165-4006-a22b-6b23c9007d19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:43.610777 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:43.610777 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:43.610777 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:43.610777 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:43.610777 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:43.610777 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:43.610777 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:43.610777 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:43.610777 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:43.610777 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:43.610777 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:43.610777 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:01:43.610777 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:01:43.610777 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:01:43.611649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:01:43.611649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:43.611649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:43.611649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:43.611649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:43.611649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:43.611649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:43.611649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:43.611649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:43.611649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:43.611649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:43.611649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:43.611649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:43.611649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:43.611649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:43.611649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:43.611649 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:43.612561 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:01:43.612561 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:01:43.612561 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:01:43.612561 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:01:43.612561 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:01:43.612561 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:01:43.612561 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:43.612561 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:43.614175 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 277/552] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:01:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:43.615044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99070eaf-7165-4006-a22b-6b23c9007d19 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:43.646980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455e5c6-45ee-42e5-978f-d300f81bf1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:43.647598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455e5c6-45ee-42e5-978f-d300f81bf1c6 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:43.647913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455e5c6-45ee-42e5-978f-d300f81bf1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:43.648193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455e5c6-45ee-42e5-978f-d300f81bf1c6 None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:43.648849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455e5c6-45ee-42e5-978f-d300f81bf1c6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:43.650256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455e5c6-45ee-42e5-978f-d300f81bf1c6 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:43.716493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99070eaf-7165-4006-a22b-6b23c9007d19 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:43.737134 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 276/553] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 27 03:01:43 2022] POST /identity/v3/services => generated 240 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:01:43.738565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455e5c6-45ee-42e5-978f-d300f81bf1c6 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:43.776512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c186d9-9280-4314-9894-1edf7c9cd59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:43.777681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c186d9-9280-4314-9894-1edf7c9cd59a None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:43.778182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c186d9-9280-4314-9894-1edf7c9cd59a None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:43.778872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c186d9-9280-4314-9894-1edf7c9cd59a None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:43.780125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c186d9-9280-4314-9894-1edf7c9cd59a None admin] RBAC: Adding query filter params (name=service) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:43.780847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c186d9-9280-4314-9894-1edf7c9cd59a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:43.782430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c186d9-9280-4314-9894-1edf7c9cd59a None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:43.797669 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 278/554] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 27 03:01:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:43.798830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c186d9-9280-4314-9894-1edf7c9cd59a None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:43.856960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:43.863860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:43.870172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455e5c6-45ee-42e5-978f-d300f81bf1c6 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:43.911833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d327d-939c-4524-9c06-cabe2ed5e5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:43.912476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d327d-939c-4524-9c06-cabe2ed5e5fc None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:43.914184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d327d-939c-4524-9c06-cabe2ed5e5fc None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:43.914184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d327d-939c-4524-9c06-cabe2ed5e5fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:43.927373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d327d-939c-4524-9c06-cabe2ed5e5fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:43.929023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d327d-939c-4524-9c06-cabe2ed5e5fc None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:43.938994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c186d9-9280-4314-9894-1edf7c9cd59a None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:43.948247 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-ef5d327d-939c-4524-9c06-cabe2ed5e5fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:43.948247 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:43.948247 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:43.948247 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:43.948247 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:43.948247 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:43.948247 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:43.948247 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:43.948247 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:43.948247 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:43.948247 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:43.948247 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:43.948247 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:43.948247 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:43.948247 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:43.948247 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:43.949179 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:43.949179 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:43.949179 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:43.949179 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:43.949179 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:43.949179 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:43.949179 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:43.949179 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:43.949179 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:43.949179 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:43.949179 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:43.949179 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:43.949179 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:43.949179 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:43.949179 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:43.949179 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:43.949179 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:43.950109 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:43.950109 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:43.950109 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:43.952029 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 277/555] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:43.953027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d327d-939c-4524-9c06-cabe2ed5e5fc None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:43.987455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90968b-5e9f-4a22-96f8-6fdb5c3a45f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:43.988071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90968b-5e9f-4a22-96f8-6fdb5c3a45f2 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:43.988353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90968b-5e9f-4a22-96f8-6fdb5c3a45f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:43.988630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90968b-5e9f-4a22-96f8-6fdb5c3a45f2 None admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:43.989335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90968b-5e9f-4a22-96f8-6fdb5c3a45f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:43.989658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90968b-5e9f-4a22-96f8-6fdb5c3a45f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:43.991389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90968b-5e9f-4a22-96f8-6fdb5c3a45f2 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:44.004774 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 279/556] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 27 03:01:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:44.005597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90968b-5e9f-4a22-96f8-6fdb5c3a45f2 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:44.074729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d327d-939c-4524-9c06-cabe2ed5e5fc None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:44.114206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bb3b0-c288-4a44-b213-66084458f8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:44.115201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bb3b0-c288-4a44-b213-66084458f8b1 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:44.115685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bb3b0-c288-4a44-b213-66084458f8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:44.116158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bb3b0-c288-4a44-b213-66084458f8b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:44.121899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90968b-5e9f-4a22-96f8-6fdb5c3a45f2 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:44.124427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:44.129586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bb3b0-c288-4a44-b213-66084458f8b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:44.131334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bb3b0-c288-4a44-b213-66084458f8b1 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:44.135042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:44.150797 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-cb0bb3b0-c288-4a44-b213-66084458f8b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:44.150797 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:44.150797 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:44.150797 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:44.150797 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:44.150797 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:44.150797 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:44.150797 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:44.150797 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:44.150797 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:44.150797 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:44.150797 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:44.150797 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:44.150797 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:44.150797 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:44.150797 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:44.151786 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:44.151786 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:44.151786 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:44.151786 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:44.151786 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:44.151786 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:44.151786 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:44.151786 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:44.151786 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:44.151786 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:44.151786 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:44.151786 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:44.151786 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:44.151786 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:44.151786 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:44.151786 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:44.151786 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:44.152720 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:44.152720 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:44.152720 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:44.154919 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 278/557] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:44.155935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bb3b0-c288-4a44-b213-66084458f8b1 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:44.165901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dd30f-a854-4c50-90a3-e44ad9879f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:44.166707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dd30f-a854-4c50-90a3-e44ad9879f5f None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:44.167515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dd30f-a854-4c50-90a3-e44ad9879f5f None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:44.167889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dd30f-a854-4c50-90a3-e44ad9879f5f None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:44.168685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042dd30f-a854-4c50-90a3-e44ad9879f5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:44.169439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042dd30f-a854-4c50-90a3-e44ad9879f5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:44.171272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042dd30f-a854-4c50-90a3-e44ad9879f5f None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:44.187711 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 280/558] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:44.188898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dd30f-a854-4c50-90a3-e44ad9879f5f None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:44.275115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bb3b0-c288-4a44-b213-66084458f8b1 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:44.322560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2955a-9c35-44e8-93dc-4d29c6004332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:44.323192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dd30f-a854-4c50-90a3-e44ad9879f5f None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:44.323354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2955a-9c35-44e8-93dc-4d29c6004332 None admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:44.323744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2955a-9c35-44e8-93dc-4d29c6004332 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:44.324089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2955a-9c35-44e8-93dc-4d29c6004332 None admin] PATH_INFO: `/v3/projects/1ae07f0abb504c298fc9893b1d8bb173/users/fe7800497c6e460f9a2a0bd259e6d236/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:44.327293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2955a-9c35-44e8-93dc-4d29c6004332 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ae07f0abb504c298fc9893b1d8bb173, user_id=fe7800497c6e460f9a2a0bd259e6d236, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:44.328806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2955a-9c35-44e8-93dc-4d29c6004332 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:44.359017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f953fa-3aaf-4b68-b16f-c6939a83f6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:44.359625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f953fa-3aaf-4b68-b16f-c6939a83f6e2 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:44.359904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f953fa-3aaf-4b68-b16f-c6939a83f6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:44.360232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f953fa-3aaf-4b68-b16f-c6939a83f6e2 None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:44.360872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f953fa-3aaf-4b68-b16f-c6939a83f6e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:44.361293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f953fa-3aaf-4b68-b16f-c6939a83f6e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:44.362707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f953fa-3aaf-4b68-b16f-c6939a83f6e2 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:44.376473 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 281/559] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:44.377220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f953fa-3aaf-4b68-b16f-c6939a83f6e2 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:44.406771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:44.413303 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 279/560] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:01:44 2022] PUT /identity/v3/projects/1ae07f0abb504c298fc9893b1d8bb173/users/fe7800497c6e460f9a2a0bd259e6d236/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:01:44.414779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2955a-9c35-44e8-93dc-4d29c6004332 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:44.520868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:44.559082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f953fa-3aaf-4b68-b16f-c6939a83f6e2 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:44.612185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2955a-9c35-44e8-93dc-4d29c6004332 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:44.629607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aed228-0fa8-4606-90d1-a10d328191b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:44.630255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aed228-0fa8-4606-90d1-a10d328191b7 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:44.630540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aed228-0fa8-4606-90d1-a10d328191b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:44.630815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aed228-0fa8-4606-90d1-a10d328191b7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:44.641428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aed228-0fa8-4606-90d1-a10d328191b7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:44.642931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aed228-0fa8-4606-90d1-a10d328191b7 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:44.655514 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-61aed228-0fa8-4606-90d1-a10d328191b7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 03:01:44.655514 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:44.655514 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:44.655514 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:44.655514 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:44.655514 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:44.655514 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:44.655514 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:44.655514 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:44.655514 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:44.655514 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:44.655514 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:44.655514 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:01:44.655514 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:01:44.655514 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:01:44.655514 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:01:44.656510 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:44.656510 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:44.656510 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:01:44.656510 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:44.656510 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:01:44.656510 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:44.656510 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:44.656510 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:44.656510 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:44.656510 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:44.656510 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:44.656510 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:44.656510 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:44.656510 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:44.656510 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:44.656510 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:44.656510 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:44.656510 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:44.657462 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:44.657462 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:44.657462 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:01:44.657462 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:01:44.657462 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:01:44.657462 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:01:44.657462 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:01:44.657462 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:01:44.657462 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 27 03:01:44.657462 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:44.657992 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 282/561] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Oct 27 03:01:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:44.665922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aed228-0fa8-4606-90d1-a10d328191b7 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:44.675043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab387c21-e324-45ba-af1c-874ae459bb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:44.675963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab387c21-e324-45ba-af1c-874ae459bb7a None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:44.676426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab387c21-e324-45ba-af1c-874ae459bb7a None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:44.676902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab387c21-e324-45ba-af1c-874ae459bb7a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:44.685553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab387c21-e324-45ba-af1c-874ae459bb7a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:44.687049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab387c21-e324-45ba-af1c-874ae459bb7a None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:44.700035 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-ab387c21-e324-45ba-af1c-874ae459bb7a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 03:01:44.700035 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:44.700035 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:44.700035 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:44.700035 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:44.700035 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:44.700035 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:44.700035 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:44.700035 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:44.700035 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:44.700035 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:44.700035 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:44.700035 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:01:44.700035 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:01:44.700035 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:01:44.700035 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:01:44.701148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:44.701148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:44.701148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:01:44.701148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:44.701148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:01:44.701148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:44.701148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:44.701148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:44.701148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:44.701148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:44.701148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:44.701148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:44.701148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:44.701148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:44.701148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:44.701148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:44.701148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:44.701148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:44.703237 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:44.703237 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:44.703237 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:01:44.703237 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:01:44.703237 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:01:44.703237 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:01:44.703237 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:01:44.703237 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:01:44.703237 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 03:01:44.703237 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:44.703237 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 280/562] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Oct 27 03:01:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:44.707668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab387c21-e324-45ba-af1c-874ae459bb7a None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:44.786173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:44.805688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aed228-0fa8-4606-90d1-a10d328191b7 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:44.846460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4847036-4f81-4234-ada8-cbf828c71b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:44.847424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4847036-4f81-4234-ada8-cbf828c71b38 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:44.847908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4847036-4f81-4234-ada8-cbf828c71b38 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:44.848419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4847036-4f81-4234-ada8-cbf828c71b38 None admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:44.849369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4847036-4f81-4234-ada8-cbf828c71b38 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:44.849879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4847036-4f81-4234-ada8-cbf828c71b38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:44.852602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4847036-4f81-4234-ada8-cbf828c71b38 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:44.873228 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 283/563] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Oct 27 03:01:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:44.879266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4847036-4f81-4234-ada8-cbf828c71b38 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:44.965884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab387c21-e324-45ba-af1c-874ae459bb7a None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:44.990999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4847036-4f81-4234-ada8-cbf828c71b38 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:45.011639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:45.031084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ef169-8fed-437b-a946-4c8f026796c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:45.035280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ef169-8fed-437b-a946-4c8f026796c2 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:45.035280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ef169-8fed-437b-a946-4c8f026796c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:45.035280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ef169-8fed-437b-a946-4c8f026796c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:45.100715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa972f5c-5414-49cb-ad47-104e5aae66ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:45.101432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa972f5c-5414-49cb-ad47-104e5aae66ea None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:45.101740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa972f5c-5414-49cb-ad47-104e5aae66ea None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:45.102017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa972f5c-5414-49cb-ad47-104e5aae66ea None admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:45.102795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa972f5c-5414-49cb-ad47-104e5aae66ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:45.103104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa972f5c-5414-49cb-ad47-104e5aae66ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:45.103568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:45.104577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa972f5c-5414-49cb-ad47-104e5aae66ea None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:45.113283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ef169-8fed-437b-a946-4c8f026796c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:45.115213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ef169-8fed-437b-a946-4c8f026796c2 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:45.152938 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 281/564] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Oct 27 03:01:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:01:45.153856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa972f5c-5414-49cb-ad47-104e5aae66ea None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:45.224310 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 284/565] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:01:44 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 03:01:45.229683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ef169-8fed-437b-a946-4c8f026796c2 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:45.276865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:45.317595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa972f5c-5414-49cb-ad47-104e5aae66ea None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:45.346070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ef169-8fed-437b-a946-4c8f026796c2 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:45.359217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f8aae-2ade-4cac-8309-1f64a26da264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:45.359856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f8aae-2ade-4cac-8309-1f64a26da264 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:45.360142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f8aae-2ade-4cac-8309-1f64a26da264 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:45.360420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f8aae-2ade-4cac-8309-1f64a26da264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:45.373535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f8aae-2ade-4cac-8309-1f64a26da264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:45.375070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f8aae-2ade-4cac-8309-1f64a26da264 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:45.376289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b6af3-4798-434e-955f-c4546745beda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:45.377022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b6af3-4798-434e-955f-c4546745beda None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:45.377329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b6af3-4798-434e-955f-c4546745beda None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:45.377679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b6af3-4798-434e-955f-c4546745beda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:45.389001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b6af3-4798-434e-955f-c4546745beda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:45.390561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b6af3-4798-434e-955f-c4546745beda None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:45.390880 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-508f8aae-2ade-4cac-8309-1f64a26da264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:45.390880 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:45.390880 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:45.390880 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:45.390880 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:45.390880 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:45.390880 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:45.390880 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:45.390880 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:45.390880 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:45.390880 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:45.390880 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:45.390880 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:45.390880 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:45.390880 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:45.390880 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:45.391819 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:45.391819 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:45.391819 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:45.391819 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:45.391819 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:45.391819 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:45.391819 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:45.391819 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:45.391819 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:45.391819 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:45.391819 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:45.391819 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:45.391819 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:45.391819 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:45.391819 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:45.391819 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:45.391819 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:45.392711 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:45.392711 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:45.392711 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:45.392711 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 282/566] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:45.397637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a304a80-57fa-424c-831d-e2dd9a0cd577 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:45.397637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a304a80-57fa-424c-831d-e2dd9a0cd577 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:45.397637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a304a80-57fa-424c-831d-e2dd9a0cd577 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:45.397637 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 283/567] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:45.399430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a304a80-57fa-424c-831d-e2dd9a0cd577 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:45.406946 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-499b6af3-4798-434e-955f-c4546745beda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:45.406946 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:45.406946 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:45.406946 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:45.406946 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:45.406946 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:45.406946 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:45.406946 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:45.406946 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:45.406946 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:45.406946 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:45.406946 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:45.406946 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:45.406946 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:45.406946 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:45.406946 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:45.408805 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:45.408805 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:45.408805 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:45.408805 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:45.408805 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:45.408805 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:45.408805 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:45.408805 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:45.408805 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:45.408805 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:45.408805 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:45.408805 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:45.408805 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:45.408805 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:45.408805 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:45.408805 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:45.408805 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:45.411013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:45.411013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:45.411013 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:45.411013 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 285/568] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:01:45.418062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f872da7-4365-4530-858d-071a2e841101 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:45.418062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f872da7-4365-4530-858d-071a2e841101 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:45.418062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f872da7-4365-4530-858d-071a2e841101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:45.430659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:45.436734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4f872da7-4365-4530-858d-071a2e841101 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:45.438231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4f872da7-4365-4530-858d-071a2e841101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:45.515256 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 286/569] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:01:45.516112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f872da7-4365-4530-858d-071a2e841101 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:45.523023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a304a80-57fa-424c-831d-e2dd9a0cd577 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:45.543423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:45.570973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c0c46-a4e9-44af-820d-ec0fbdcbdcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:45.571889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c0c46-a4e9-44af-820d-ec0fbdcbdcd0 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:45.572384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c0c46-a4e9-44af-820d-ec0fbdcbdcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:45.572907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c0c46-a4e9-44af-820d-ec0fbdcbdcd0 None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:45.574228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c0c46-a4e9-44af-820d-ec0fbdcbdcd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:45.575038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c0c46-a4e9-44af-820d-ec0fbdcbdcd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:45.576700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c0c46-a4e9-44af-820d-ec0fbdcbdcd0 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:45.591293 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 284/570] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:45.599072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c0c46-a4e9-44af-820d-ec0fbdcbdcd0 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:45.628394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f872da7-4365-4530-858d-071a2e841101 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:45.671415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bed09-6222-4d38-a3d2-0875f1e0835d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:45.672004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bed09-6222-4d38-a3d2-0875f1e0835d None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:45.672288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bed09-6222-4d38-a3d2-0875f1e0835d None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:45.672562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bed09-6222-4d38-a3d2-0875f1e0835d None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:45.673216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92bed09-6222-4d38-a3d2-0875f1e0835d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:45.673524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92bed09-6222-4d38-a3d2-0875f1e0835d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:45.674917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92bed09-6222-4d38-a3d2-0875f1e0835d None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:45.699188 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 287/571] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:45.704644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bed09-6222-4d38-a3d2-0875f1e0835d None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:45.748359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:45.774097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c0c46-a4e9-44af-820d-ec0fbdcbdcd0 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:45.835611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9facc3-a9cb-42f2-ac94-227d060fe526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:45.836258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9facc3-a9cb-42f2-ac94-227d060fe526 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:45.836542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9facc3-a9cb-42f2-ac94-227d060fe526 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:45.836819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9facc3-a9cb-42f2-ac94-227d060fe526 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:45.854811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9facc3-a9cb-42f2-ac94-227d060fe526 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:45.856586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9facc3-a9cb-42f2-ac94-227d060fe526 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:45.862161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:45.876564 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-dd9facc3-a9cb-42f2-ac94-227d060fe526 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:45.876564 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:45.876564 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:45.876564 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:45.876564 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:45.876564 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:45.876564 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:45.876564 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:45.876564 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:45.876564 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:45.876564 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:45.876564 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:45.876564 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:01:45.876564 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:01:45.876564 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:01:45.877585 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:01:45.877585 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:45.877585 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:45.877585 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:45.877585 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:45.877585 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:45.877585 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:45.877585 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:45.877585 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:45.877585 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:45.877585 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:45.877585 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:45.877585 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:45.877585 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:45.877585 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:45.877585 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:45.877585 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:45.878545 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:01:45.878545 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:01:45.878545 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:01:45.878545 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:01:45.878545 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:01:45.878545 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:01:45.878545 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:45.878545 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:45.880351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bed09-6222-4d38-a3d2-0875f1e0835d None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:45.882201 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 285/572] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:01:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:45.887030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9facc3-a9cb-42f2-ac94-227d060fe526 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:45.941908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9e236-1358-4fbe-a7f2-54d2560d4006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:45.941908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9e236-1358-4fbe-a7f2-54d2560d4006 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:45.942343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9e236-1358-4fbe-a7f2-54d2560d4006 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:45.942594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9e236-1358-4fbe-a7f2-54d2560d4006 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:45.950375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9e236-1358-4fbe-a7f2-54d2560d4006 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:45.951942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9e236-1358-4fbe-a7f2-54d2560d4006 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:45.964881 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-12f9e236-1358-4fbe-a7f2-54d2560d4006 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:45.964881 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:45.964881 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:45.964881 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:45.964881 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:45.964881 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:45.964881 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:45.964881 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:45.964881 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:45.964881 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:45.964881 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:45.964881 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:45.964881 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:01:45.964881 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:01:45.964881 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:01:45.965802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:01:45.965802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:45.965802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:45.965802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:45.965802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:45.965802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:45.965802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:45.965802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:45.965802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:45.965802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:45.965802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:45.965802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:45.965802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:45.965802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:45.965802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:45.965802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:45.965802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:45.966738 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:01:45.966738 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:01:45.966738 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:01:45.966738 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:01:45.966738 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:01:45.966738 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:01:45.966738 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:45.966738 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:45.966738 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 288/573] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:01:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:45.967352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9e236-1358-4fbe-a7f2-54d2560d4006 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:46.014956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9facc3-a9cb-42f2-ac94-227d060fe526 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:46.051379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae312ec-5444-437d-8e8a-6c6adc786fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:46.051923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae312ec-5444-437d-8e8a-6c6adc786fed None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:46.052213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae312ec-5444-437d-8e8a-6c6adc786fed None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:46.052480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae312ec-5444-437d-8e8a-6c6adc786fed None admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:46.053188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae312ec-5444-437d-8e8a-6c6adc786fed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:46.053497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae312ec-5444-437d-8e8a-6c6adc786fed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:46.055050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae312ec-5444-437d-8e8a-6c6adc786fed None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:46.066871 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 286/574] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 27 03:01:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:46.067669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae312ec-5444-437d-8e8a-6c6adc786fed None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:46.078575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:46.081549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9e236-1358-4fbe-a7f2-54d2560d4006 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:46.120158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685ce08-dc1e-45b9-8b14-1d8a75721560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:46.121150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685ce08-dc1e-45b9-8b14-1d8a75721560 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:46.121597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685ce08-dc1e-45b9-8b14-1d8a75721560 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:46.122014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685ce08-dc1e-45b9-8b14-1d8a75721560 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:46.122786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685ce08-dc1e-45b9-8b14-1d8a75721560 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:46.124438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685ce08-dc1e-45b9-8b14-1d8a75721560 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:46.134347 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-c685ce08-dc1e-45b9-8b14-1d8a75721560 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 03:01:46.134347 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:46.134347 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:01:46.134347 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:01:46.134347 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:01:46.134347 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:01:46.134347 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:01:46.134347 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:01:46.134347 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 03:01:46.134347 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:46.134347 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:01:46.134347 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:46.134347 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:46.134347 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:46.134347 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:46.134347 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:46.134347 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:46.135521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:46.135521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:46.135521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:46.135521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:46.135521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:46.135521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:46.135521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:01:46.135521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:01:46.135521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:01:46.135521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:01:46.135521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:46.135521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:46.135521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:46.135521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:46.135521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:46.135521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:46.136562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:46.136562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:46.136562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:46.136562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:46.136562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:46.136562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:46.136562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:46.136562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:46.136562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:46.136562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:46.136562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:01:46.136562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:01:46.136562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 03:01:46.136562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:46.138807 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 289/575] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Oct 27 03:01:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:46.140112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22a62f-be4a-4aaf-b338-9274a383cb53 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:46.140397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22a62f-be4a-4aaf-b338-9274a383cb53 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:46.140672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22a62f-be4a-4aaf-b338-9274a383cb53 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:46.141896 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 290/576] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:46.142603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22a62f-be4a-4aaf-b338-9274a383cb53 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:46.155186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:46.187039 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae312ec-5444-437d-8e8a-6c6adc786fed None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:46.220818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ee01d-251a-4b10-8c60-57e8555c2507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:46.221429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ee01d-251a-4b10-8c60-57e8555c2507 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:46.221716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ee01d-251a-4b10-8c60-57e8555c2507 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:46.222004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ee01d-251a-4b10-8c60-57e8555c2507 None admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:46.222707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ee01d-251a-4b10-8c60-57e8555c2507 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:46.223019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ee01d-251a-4b10-8c60-57e8555c2507 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:46.224469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ee01d-251a-4b10-8c60-57e8555c2507 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:46.238091 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 287/577] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 27 03:01:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:46.238257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c689bc-c78c-46f0-9c0b-adc5d25aecf6 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:46.238684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c689bc-c78c-46f0-9c0b-adc5d25aecf6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:46.238851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c689bc-c78c-46f0-9c0b-adc5d25aecf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:46.257816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-77c689bc-c78c-46f0-9c0b-adc5d25aecf6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:46.259076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-77c689bc-c78c-46f0-9c0b-adc5d25aecf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:46.267581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22a62f-be4a-4aaf-b338-9274a383cb53 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:46.303419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02491c-77b5-4113-93e3-5954125aaf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:46.304386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02491c-77b5-4113-93e3-5954125aaf25 None admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:46.304813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02491c-77b5-4113-93e3-5954125aaf25 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:46.305243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02491c-77b5-4113-93e3-5954125aaf25 None admin] PATH_INFO: `/v3/projects/1ae07f0abb504c298fc9893b1d8bb173/users/f0310313e99d4faebbaa952d20c6dd9c/roles/248be75b0cf142299cd46440170c7972` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:46.320605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:46.321828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02491c-77b5-4113-93e3-5954125aaf25 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ae07f0abb504c298fc9893b1d8bb173, user_id=f0310313e99d4faebbaa952d20c6dd9c, role_id=248be75b0cf142299cd46440170c7972)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:46.323337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02491c-77b5-4113-93e3-5954125aaf25 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:46.328025 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 288/578] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:01:46.328842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c689bc-c78c-46f0-9c0b-adc5d25aecf6 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:46.414774 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 291/579] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:01:46 2022] PUT /identity/v3/projects/1ae07f0abb504c298fc9893b1d8bb173/users/f0310313e99d4faebbaa952d20c6dd9c/roles/248be75b0cf142299cd46440170c7972 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:01:46.424342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02491c-77b5-4113-93e3-5954125aaf25 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:46.452887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c689bc-c78c-46f0-9c0b-adc5d25aecf6 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:46.535832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803daa9-bf48-4990-bea6-e271ecd68cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:46.536799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803daa9-bf48-4990-bea6-e271ecd68cb3 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:46.537090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803daa9-bf48-4990-bea6-e271ecd68cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:46.537369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803daa9-bf48-4990-bea6-e271ecd68cb3 None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:46.538026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803daa9-bf48-4990-bea6-e271ecd68cb3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:46.538390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803daa9-bf48-4990-bea6-e271ecd68cb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:46.539888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803daa9-bf48-4990-bea6-e271ecd68cb3 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:46.545784 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 289/580] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Oct 27 03:01:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:46.553685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:46.555237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803daa9-bf48-4990-bea6-e271ecd68cb3 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:46.627297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02491c-77b5-4113-93e3-5954125aaf25 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:46.654869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:46.667249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c81da-79b9-4e1b-8f42-573af09916d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:46.667869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c81da-79b9-4e1b-8f42-573af09916d6 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:46.668152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c81da-79b9-4e1b-8f42-573af09916d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:46.668425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c81da-79b9-4e1b-8f42-573af09916d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:46.669168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c81da-79b9-4e1b-8f42-573af09916d6 None admin] RBAC: Adding query filter params (role.id=6e91e7a416ac452b86ec238a2b81bc07, scope.project.id=1ae07f0abb504c298fc9893b1d8bb173, user.id=c20881251f2241a3a5ec2e5cf99db149) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:46.670281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c81da-79b9-4e1b-8f42-573af09916d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:46.671813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c81da-79b9-4e1b-8f42-573af09916d6 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:46.678665 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 292/581] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:01:46 2022] GET /identity/v3/role_assignments?user.id=c20881251f2241a3a5ec2e5cf99db149&scope.project.id=1ae07f0abb504c298fc9893b1d8bb173&role.id=6e91e7a416ac452b86ec238a2b81bc07 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:46.680086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c81da-79b9-4e1b-8f42-573af09916d6 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:46.705718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803daa9-bf48-4990-bea6-e271ecd68cb3 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:46.747619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d681a2-9907-4300-9bcd-d2570eed8508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:46.748701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d681a2-9907-4300-9bcd-d2570eed8508 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:46.749191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d681a2-9907-4300-9bcd-d2570eed8508 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:46.749671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d681a2-9907-4300-9bcd-d2570eed8508 None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:46.750608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d681a2-9907-4300-9bcd-d2570eed8508 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:46.751786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d681a2-9907-4300-9bcd-d2570eed8508 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:46.753926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d681a2-9907-4300-9bcd-d2570eed8508 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:46.761302 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 290/582] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Oct 27 03:01:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:01:46.767920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d681a2-9907-4300-9bcd-d2570eed8508 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:46.885836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c81da-79b9-4e1b-8f42-573af09916d6 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:46.911407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:46.926467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e64229-ce1e-4f5c-85f6-c92291521bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:46.927123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e64229-ce1e-4f5c-85f6-c92291521bc5 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:46.927401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e64229-ce1e-4f5c-85f6-c92291521bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:46.927665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e64229-ce1e-4f5c-85f6-c92291521bc5 None admin] PATH_INFO: `/v3/services/network` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:46.928248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e64229-ce1e-4f5c-85f6-c92291521bc5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:46.930173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e64229-ce1e-4f5c-85f6-c92291521bc5 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:46.934015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d681a2-9907-4300-9bcd-d2570eed8508 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:46.940818 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-95e64229-ce1e-4f5c-85f6-c92291521bc5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 03:01:46.940818 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:46.940818 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:01:46.940818 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:01:46.940818 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:01:46.940818 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:01:46.940818 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:01:46.940818 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:01:46.940818 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 03:01:46.940818 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:46.940818 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:01:46.940818 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:46.940818 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:46.940818 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:46.940818 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:46.940818 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:46.940818 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:46.941899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:46.941899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:46.941899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:46.941899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:46.941899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:46.941899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:46.941899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:01:46.941899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:01:46.941899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:01:46.941899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:01:46.941899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:46.941899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:46.941899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:46.941899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:46.941899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:46.941899 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:46.943374 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:46.943374 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:46.943374 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:46.943374 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:46.943374 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:46.943374 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:46.943374 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:46.943374 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:46.943374 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:46.943374 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:46.943374 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:01:46.943374 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:01:46.943374 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 03:01:46.943374 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:46.943374 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 293/583] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:01:46 2022] GET /identity/v3/services/network => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:46.944220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe824d-ac6d-4ef9-aa4b-8ea6452c3642 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:46.944493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe824d-ac6d-4ef9-aa4b-8ea6452c3642 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:46.945278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe824d-ac6d-4ef9-aa4b-8ea6452c3642 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:46.948842 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 294/584] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:46.954914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62645de8-8aad-4f2c-83d8-11abc35c0f29 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:46.955044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62645de8-8aad-4f2c-83d8-11abc35c0f29 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:46.955238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62645de8-8aad-4f2c-83d8-11abc35c0f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:46.968403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:46.980735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-62645de8-8aad-4f2c-83d8-11abc35c0f29 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:46.981273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-62645de8-8aad-4f2c-83d8-11abc35c0f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:46.981854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d26a5-a78c-463c-812e-2f0b0c95a6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:46.982545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d26a5-a78c-463c-812e-2f0b0c95a6ca None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:46.982835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d26a5-a78c-463c-812e-2f0b0c95a6ca None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:46.983179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d26a5-a78c-463c-812e-2f0b0c95a6ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:46.984599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d26a5-a78c-463c-812e-2f0b0c95a6ca None admin] RBAC: Adding query filter params (interface=public, service_id=9b1e4e91a25749fcb7e843162b19e887, region_id=RegionOne) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:46.984599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d26a5-a78c-463c-812e-2f0b0c95a6ca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:46.985577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d26a5-a78c-463c-812e-2f0b0c95a6ca None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:46.998475 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 291/585] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Oct 27 03:01:46 2022] GET /identity/v3/endpoints?service_id=9b1e4e91a25749fcb7e843162b19e887&interface=public®ion_id=RegionOne => generated 194 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:01:46.999513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d26a5-a78c-463c-812e-2f0b0c95a6ca None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:47.066089 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 295/586] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:01:47.067260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62645de8-8aad-4f2c-83d8-11abc35c0f29 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:47.153126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d26a5-a78c-463c-812e-2f0b0c95a6ca None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:47.192792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62645de8-8aad-4f2c-83d8-11abc35c0f29 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:47.213313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:47.230606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1bdeb-e83d-4a4f-8e00-1059ccd694ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:47.231422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1bdeb-e83d-4a4f-8e00-1059ccd694ca None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:47.231726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1bdeb-e83d-4a4f-8e00-1059ccd694ca None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:47.232035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1bdeb-e83d-4a4f-8e00-1059ccd694ca None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:47.232958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1bdeb-e83d-4a4f-8e00-1059ccd694ca None admin] RBAC: Adding query filter params (name=network) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:47.233273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1bdeb-e83d-4a4f-8e00-1059ccd694ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:47.234850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1bdeb-e83d-4a4f-8e00-1059ccd694ca None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:47.235486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a1594-7dad-4ffa-a647-8c8e24532e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:47.236571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a1594-7dad-4ffa-a647-8c8e24532e63 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:47.237039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a1594-7dad-4ffa-a647-8c8e24532e63 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:47.237596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a1594-7dad-4ffa-a647-8c8e24532e63 None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:47.238426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a1594-7dad-4ffa-a647-8c8e24532e63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:47.239978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a1594-7dad-4ffa-a647-8c8e24532e63 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:47.246585 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 292/587] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 27 03:01:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:47.247244 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 296/588] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Oct 27 03:01:47 2022] GET /identity/v3/services => generated 772 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:47.252008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1bdeb-e83d-4a4f-8e00-1059ccd694ca None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:47.315594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:47.368676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1bdeb-e83d-4a4f-8e00-1059ccd694ca None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:47.404858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75365d7-f85d-43b6-97b1-b7eaac47f228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:47.405399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75365d7-f85d-43b6-97b1-b7eaac47f228 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:47.405681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75365d7-f85d-43b6-97b1-b7eaac47f228 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:47.405960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75365d7-f85d-43b6-97b1-b7eaac47f228 None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:47.406638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75365d7-f85d-43b6-97b1-b7eaac47f228 None admin] RBAC: Adding query filter params (type=network) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:47.406944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75365d7-f85d-43b6-97b1-b7eaac47f228 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:47.408322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75365d7-f85d-43b6-97b1-b7eaac47f228 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:47.414843 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 293/589] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 27 03:01:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:47.420377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a1594-7dad-4ffa-a647-8c8e24532e63 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:47.498120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75365d7-f85d-43b6-97b1-b7eaac47f228 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:47.572349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a1594-7dad-4ffa-a647-8c8e24532e63 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:47.610476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615ed0f-78be-4cb2-b574-77414c974479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:47.611215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615ed0f-78be-4cb2-b574-77414c974479 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:47.611658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615ed0f-78be-4cb2-b574-77414c974479 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:47.611963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615ed0f-78be-4cb2-b574-77414c974479 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:47.612690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615ed0f-78be-4cb2-b574-77414c974479 None admin] RBAC: Adding query filter params (interface=public, service_id=5e617f443f5d4286a95345dc2d9881b1, region_id=RegionOne) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:47.613012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615ed0f-78be-4cb2-b574-77414c974479 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:47.614681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615ed0f-78be-4cb2-b574-77414c974479 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:47.617417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75365d7-f85d-43b6-97b1-b7eaac47f228 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:47.623866 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 297/590] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Oct 27 03:01:47 2022] GET /identity/v3/endpoints?service_id=5e617f443f5d4286a95345dc2d9881b1&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:47.630545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615ed0f-78be-4cb2-b574-77414c974479 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:47.636815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:47.659365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842a15d-33bd-484b-94b8-0618fe1d1a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:47.660288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842a15d-33bd-484b-94b8-0618fe1d1a8f None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:47.660811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842a15d-33bd-484b-94b8-0618fe1d1a8f None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:47.661091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842a15d-33bd-484b-94b8-0618fe1d1a8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:47.676197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842a15d-33bd-484b-94b8-0618fe1d1a8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:47.682793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:47.683741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-e842a15d-33bd-484b-94b8-0618fe1d1a8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:01:47.683741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:47.683741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:47.683741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:47.683741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:47.683741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:47.683741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:47.683741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:47.683741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:47.683741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:47.683741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:47.683741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:47.683741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:47.683741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:47.683741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:47.683741 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:47.684697 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:47.684697 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:47.684697 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:47.684697 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:47.684697 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:47.684697 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:47.684697 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:47.684697 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:47.684697 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:47.684697 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:47.684697 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:47.684697 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:47.684697 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:47.684697 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:47.684697 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:47.684697 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:47.685550 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:47.685550 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:47.685550 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:47.685550 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:47.685550 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:47.685550 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:47.685550 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:47.685550 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:47.685550 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:47.685550 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:47.685550 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:01:47.685550 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:47.693038 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 294/591] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 27 03:01:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:47.694506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842a15d-33bd-484b-94b8-0618fe1d1a8f None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:47.778422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615ed0f-78be-4cb2-b574-77414c974479 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:47.813979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55605b4-2bb2-4ae0-82d0-50ef3b681fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:47.814972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55605b4-2bb2-4ae0-82d0-50ef3b681fd0 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:47.815461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55605b4-2bb2-4ae0-82d0-50ef3b681fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:47.815937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55605b4-2bb2-4ae0-82d0-50ef3b681fd0 None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:47.816862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55605b4-2bb2-4ae0-82d0-50ef3b681fd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:47.818629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55605b4-2bb2-4ae0-82d0-50ef3b681fd0 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:47.830274 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 298/592] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Oct 27 03:01:47 2022] GET /identity/v3/services => generated 772 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:01:47.874440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842a15d-33bd-484b-94b8-0618fe1d1a8f None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:47.923650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59121334-6109-4e45-9ebb-a80407947ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:47.924186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59121334-6109-4e45-9ebb-a80407947ea5 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:47.924467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59121334-6109-4e45-9ebb-a80407947ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:47.924803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59121334-6109-4e45-9ebb-a80407947ea5 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:47.925486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59121334-6109-4e45-9ebb-a80407947ea5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:47.925839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59121334-6109-4e45-9ebb-a80407947ea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:47.927273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59121334-6109-4e45-9ebb-a80407947ea5 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:47.941459 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 295/593] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:01:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:01:47.948330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55605b4-2bb2-4ae0-82d0-50ef3b681fd0 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:48.104377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55605b4-2bb2-4ae0-82d0-50ef3b681fd0 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:48.114231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:48.150835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d125eb8-6c7f-4604-b939-d9bc575019b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:48.151535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d125eb8-6c7f-4604-b939-d9bc575019b1 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:48.151823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d125eb8-6c7f-4604-b939-d9bc575019b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:48.152100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d125eb8-6c7f-4604-b939-d9bc575019b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:48.163089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d125eb8-6c7f-4604-b939-d9bc575019b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:48.165268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d125eb8-6c7f-4604-b939-d9bc575019b1 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:48.182774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-8d125eb8-6c7f-4604-b939-d9bc575019b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:48.182774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:48.182774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:48.182774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:48.182774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:48.182774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:48.182774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:48.182774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:48.182774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:48.182774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:48.182774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:48.182774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:48.182774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:48.182774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:48.182774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:48.182774 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:48.183727 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:48.183727 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:48.183727 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:48.183727 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:48.183727 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:48.183727 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:48.183727 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:48.183727 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:48.183727 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:48.183727 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:48.183727 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:48.183727 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:48.183727 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:48.183727 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:48.183727 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:48.183727 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:48.183727 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:48.184623 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:48.184623 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:48.184623 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:48.189617 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 299/594] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:48.189761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59121334-6109-4e45-9ebb-a80407947ea5 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:48.231343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:48.311381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59121334-6109-4e45-9ebb-a80407947ea5 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:48.359331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172fab6-8227-486c-bada-0a044c8fe742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:48.359951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172fab6-8227-486c-bada-0a044c8fe742 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:48.360231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172fab6-8227-486c-bada-0a044c8fe742 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:48.360508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172fab6-8227-486c-bada-0a044c8fe742 None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:48.361159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1172fab6-8227-486c-bada-0a044c8fe742 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:48.361460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1172fab6-8227-486c-bada-0a044c8fe742 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:48.362843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1172fab6-8227-486c-bada-0a044c8fe742 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:48.378671 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 296/595] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:48.384940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d125eb8-6c7f-4604-b939-d9bc575019b1 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:48.520393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d125eb8-6c7f-4604-b939-d9bc575019b1 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:48.559928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f8ad2-96a8-4eec-a4a1-4674791e5ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:48.560574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f8ad2-96a8-4eec-a4a1-4674791e5ca3 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:48.560919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f8ad2-96a8-4eec-a4a1-4674791e5ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:48.561200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f8ad2-96a8-4eec-a4a1-4674791e5ca3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:48.568976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f8ad2-96a8-4eec-a4a1-4674791e5ca3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:48.570604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f8ad2-96a8-4eec-a4a1-4674791e5ca3 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:48.582188 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-0e6f8ad2-96a8-4eec-a4a1-4674791e5ca3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 03:01:48.582188 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:48.582188 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:48.582188 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:48.582188 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:48.582188 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:48.582188 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:48.582188 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:48.582188 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:48.582188 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:48.582188 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:48.582188 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:48.582188 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:01:48.582188 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:01:48.582188 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:01:48.582188 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:01:48.583182 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:48.583182 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:48.583182 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:01:48.583182 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:48.583182 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:01:48.583182 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:48.583182 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:48.583182 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:48.583182 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:48.583182 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:48.583182 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:48.583182 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:48.583182 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:48.583182 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:48.583182 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:48.583182 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:48.583182 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:48.583182 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:48.584151 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:48.584151 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:48.584151 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:01:48.584151 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:01:48.584151 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:01:48.584151 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:01:48.584151 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:01:48.584151 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:01:48.584151 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 27 03:01:48.584151 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:48.588058 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 300/596] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 27 03:01:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:48.589414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172fab6-8227-486c-bada-0a044c8fe742 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:48.716322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:48.720608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172fab6-8227-486c-bada-0a044c8fe742 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:48.766934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e4eb3-445f-497e-8f86-3b0e50dd064c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:48.767558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e4eb3-445f-497e-8f86-3b0e50dd064c None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:48.767844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e4eb3-445f-497e-8f86-3b0e50dd064c None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:48.768122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e4eb3-445f-497e-8f86-3b0e50dd064c None admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:48.768919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e4eb3-445f-497e-8f86-3b0e50dd064c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:48.769234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e4eb3-445f-497e-8f86-3b0e50dd064c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:48.770757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e4eb3-445f-497e-8f86-3b0e50dd064c None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:48.793475 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 297/597] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Oct 27 03:01:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:48.798296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f8ad2-96a8-4eec-a4a1-4674791e5ca3 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:48.829300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:48.912663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f8ad2-96a8-4eec-a4a1-4674791e5ca3 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:48.948779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfa476-0db4-4182-8b62-b77f3c52de84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:48.949402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfa476-0db4-4182-8b62-b77f3c52de84 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:48.949688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfa476-0db4-4182-8b62-b77f3c52de84 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:48.949968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfa476-0db4-4182-8b62-b77f3c52de84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:49.051152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfa476-0db4-4182-8b62-b77f3c52de84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:49.052547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfa476-0db4-4182-8b62-b77f3c52de84 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:49.078537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:49.158985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dabdb3-8c79-42fc-84e3-c6ba7c4b8ab5 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:49.159334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dabdb3-8c79-42fc-84e3-c6ba7c4b8ab5 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:49.159552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dabdb3-8c79-42fc-84e3-c6ba7c4b8ab5 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:49.161172 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 298/598] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:01:49.166833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eda4eb-6ce1-4772-8824-52ce1b4321cf None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:49.167119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eda4eb-6ce1-4772-8824-52ce1b4321cf None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:49.167393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eda4eb-6ce1-4772-8824-52ce1b4321cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:49.182483 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 301/599] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:01:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 03:01:49.193080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfa476-0db4-4182-8b62-b77f3c52de84 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:49.195315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-06eda4eb-6ce1-4772-8824-52ce1b4321cf None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:49.196772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-06eda4eb-6ce1-4772-8824-52ce1b4321cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:49.311646 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 299/600] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 03:01:49.368891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfa476-0db4-4182-8b62-b77f3c52de84 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:49.401088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:49.418320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5ba92-f478-4c0e-8eb4-f7b0fd74e705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:49.421240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5ba92-f478-4c0e-8eb4-f7b0fd74e705 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:49.421240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5ba92-f478-4c0e-8eb4-f7b0fd74e705 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:49.421240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5ba92-f478-4c0e-8eb4-f7b0fd74e705 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:49.422811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc8a09-6f8a-4f5c-b79d-779b63e505dd None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:49.423199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc8a09-6f8a-4f5c-b79d-779b63e505dd None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:49.423573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc8a09-6f8a-4f5c-b79d-779b63e505dd None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:49.425134 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 300/601] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:01:49.430778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624579be-3419-48b8-9fe6-3bde6c1a4e74 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:49.431201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624579be-3419-48b8-9fe6-3bde6c1a4e74 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:49.431568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624579be-3419-48b8-9fe6-3bde6c1a4e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:49.437967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5ba92-f478-4c0e-8eb4-f7b0fd74e705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:49.439660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5ba92-f478-4c0e-8eb4-f7b0fd74e705 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:49.458362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-624579be-3419-48b8-9fe6-3bde6c1a4e74 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:49.459551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-624579be-3419-48b8-9fe6-3bde6c1a4e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:49.467350 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-4ab5ba92-f478-4c0e-8eb4-f7b0fd74e705 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:49.467350 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:49.467350 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:49.467350 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:49.467350 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:49.467350 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:49.467350 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:49.467350 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:49.467350 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:49.467350 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:49.467350 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:49.467350 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:49.467350 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:49.467350 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:49.467350 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:49.467350 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:49.468278 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:49.468278 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:49.468278 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:49.468278 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:49.468278 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:49.468278 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:49.468278 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:49.468278 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:49.468278 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:49.468278 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:49.468278 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:49.468278 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:49.468278 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:49.468278 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:49.468278 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:49.468278 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:49.468278 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:49.469173 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:49.469173 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:49.469173 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:49.469728 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 302/602] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:49.476215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5ba92-f478-4c0e-8eb4-f7b0fd74e705 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:49.588806 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 301/603] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 03:01:49.609965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624579be-3419-48b8-9fe6-3bde6c1a4e74 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:49.628259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:49.635029 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5ba92-f478-4c0e-8eb4-f7b0fd74e705 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:49.670790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7c7fe-fd22-4a91-b3fb-43b5846d324d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:49.671406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7c7fe-fd22-4a91-b3fb-43b5846d324d None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:49.671686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7c7fe-fd22-4a91-b3fb-43b5846d324d None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:49.672068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7c7fe-fd22-4a91-b3fb-43b5846d324d None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:49.672813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7c7fe-fd22-4a91-b3fb-43b5846d324d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:49.673126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7c7fe-fd22-4a91-b3fb-43b5846d324d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:49.674571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7c7fe-fd22-4a91-b3fb-43b5846d324d None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:49.688084 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 303/604] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:49.695706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7c7fe-fd22-4a91-b3fb-43b5846d324d None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:49.711317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624579be-3419-48b8-9fe6-3bde6c1a4e74 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:49.743814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:49.749677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8287e6-27b1-402d-9a57-f4918a98dbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:49.750338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8287e6-27b1-402d-9a57-f4918a98dbc7 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:49.750621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8287e6-27b1-402d-9a57-f4918a98dbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:49.750898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8287e6-27b1-402d-9a57-f4918a98dbc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:49.762366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8287e6-27b1-402d-9a57-f4918a98dbc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:49.767164 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-8e8287e6-27b1-402d-9a57-f4918a98dbc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:01:49.767164 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:49.767164 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:49.767164 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:49.767164 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:49.767164 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:49.767164 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:49.767164 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:49.767164 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:49.767164 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:49.767164 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:49.767164 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:49.767164 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:49.767164 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:49.767164 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:49.767164 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:49.769264 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:49.769264 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:49.769264 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:49.769264 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:49.769264 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:49.769264 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:49.769264 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:49.769264 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:49.769264 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:49.769264 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:49.769264 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:49.769264 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:49.769264 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:49.769264 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:49.769264 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:49.769264 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:49.771286 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:49.771286 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:49.771286 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:49.771286 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:49.771286 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:49.771286 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:49.771286 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:49.771286 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:49.771286 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:49.771286 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:49.771286 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:01:49.771286 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:49.771286 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 302/605] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 27 03:01:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:01:49.778078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8287e6-27b1-402d-9a57-f4918a98dbc7 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:49.823021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7c7fe-fd22-4a91-b3fb-43b5846d324d None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:49.852946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:49.860407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2919066-7c4c-4091-bedd-4d195185ffb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:49.867007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2919066-7c4c-4091-bedd-4d195185ffb2 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:49.867007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2919066-7c4c-4091-bedd-4d195185ffb2 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:49.867007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2919066-7c4c-4091-bedd-4d195185ffb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:49.869552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2919066-7c4c-4091-bedd-4d195185ffb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:49.871049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2919066-7c4c-4091-bedd-4d195185ffb2 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:49.876129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8287e6-27b1-402d-9a57-f4918a98dbc7 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:49.892282 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-a2919066-7c4c-4091-bedd-4d195185ffb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:49.892282 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:49.892282 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:49.892282 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:49.892282 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:49.892282 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:49.892282 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:49.892282 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:49.892282 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:49.892282 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:49.892282 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:49.892282 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:49.892282 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:01:49.892282 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:01:49.892282 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:01:49.894380 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:01:49.894380 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:49.894380 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:49.894380 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:49.894380 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:49.894380 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:49.894380 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:49.894380 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:49.894380 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:49.894380 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:49.894380 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:49.894380 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:49.894380 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:49.894380 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:49.894380 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:49.894380 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:49.894380 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:49.896536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:01:49.896536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:01:49.896536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:01:49.896536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:01:49.896536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:01:49.896536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:01:49.896536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:49.896536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:49.896536 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 304/606] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:01:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:49.903221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2919066-7c4c-4091-bedd-4d195185ffb2 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:49.922746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fdc60-a6a3-4945-9d45-6bafd372a64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:49.923427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fdc60-a6a3-4945-9d45-6bafd372a64d None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:49.923650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fdc60-a6a3-4945-9d45-6bafd372a64d None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:49.923909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fdc60-a6a3-4945-9d45-6bafd372a64d None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:49.924584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fdc60-a6a3-4945-9d45-6bafd372a64d None admin] RBAC: Adding query filter params (name=service) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:49.924890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fdc60-a6a3-4945-9d45-6bafd372a64d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:49.926283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fdc60-a6a3-4945-9d45-6bafd372a64d None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:49.941296 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 303/607] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 27 03:01:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:01:49.947536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fdc60-a6a3-4945-9d45-6bafd372a64d None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:50.004510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:50.014885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2919066-7c4c-4091-bedd-4d195185ffb2 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:50.051427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ad85a-e5a5-42a6-9aa6-b7df7e250292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:50.052174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ad85a-e5a5-42a6-9aa6-b7df7e250292 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:50.052558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ad85a-e5a5-42a6-9aa6-b7df7e250292 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:50.052834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ad85a-e5a5-42a6-9aa6-b7df7e250292 None admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:50.053525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ad85a-e5a5-42a6-9aa6-b7df7e250292 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:50.053873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ad85a-e5a5-42a6-9aa6-b7df7e250292 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:50.055952 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ad85a-e5a5-42a6-9aa6-b7df7e250292 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:50.069636 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 305/608] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 27 03:01:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:01:50.070673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ad85a-e5a5-42a6-9aa6-b7df7e250292 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:50.112646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fdc60-a6a3-4945-9d45-6bafd372a64d None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:50.156698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626602c4-871a-4e3b-9a2c-eb6ac285a5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:50.170394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626602c4-871a-4e3b-9a2c-eb6ac285a5f8 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:50.170394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626602c4-871a-4e3b-9a2c-eb6ac285a5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:50.170394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626602c4-871a-4e3b-9a2c-eb6ac285a5f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:50.170394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:50.173300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626602c4-871a-4e3b-9a2c-eb6ac285a5f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:50.175303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626602c4-871a-4e3b-9a2c-eb6ac285a5f8 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:50.198872 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-626602c4-871a-4e3b-9a2c-eb6ac285a5f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:50.198872 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:50.198872 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:50.198872 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:50.198872 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:50.198872 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:50.198872 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:50.198872 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:50.198872 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:50.198872 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:50.198872 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:50.198872 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:50.198872 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:50.198872 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:50.198872 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:50.198872 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:50.200148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:50.200148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:50.200148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:50.200148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:50.200148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:50.200148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:50.200148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:50.200148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:50.200148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:50.200148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:50.200148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:50.200148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:50.200148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:50.200148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:50.200148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:50.200148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:50.200148 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:50.201256 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:50.201256 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:50.201256 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:50.206091 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 304/609] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:01:50.206091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626602c4-871a-4e3b-9a2c-eb6ac285a5f8 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:50.206617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ad85a-e5a5-42a6-9aa6-b7df7e250292 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:50.253888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa038fe9-6b87-4118-8337-7b0e76e9f2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:50.255287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa038fe9-6b87-4118-8337-7b0e76e9f2bc None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:50.255862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa038fe9-6b87-4118-8337-7b0e76e9f2bc None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:50.256700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa038fe9-6b87-4118-8337-7b0e76e9f2bc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:50.258173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa038fe9-6b87-4118-8337-7b0e76e9f2bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:50.259963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa038fe9-6b87-4118-8337-7b0e76e9f2bc None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:50.269547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-aa038fe9-6b87-4118-8337-7b0e76e9f2bc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 03:01:50.269547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:50.269547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:01:50.269547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:01:50.269547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:01:50.269547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:01:50.269547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:01:50.269547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:01:50.269547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 03:01:50.269547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:50.269547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:01:50.269547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:50.269547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:50.269547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:50.269547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:50.269547 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:50.270617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:50.270617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:50.270617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:50.270617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:50.270617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:50.270617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:50.270617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:50.270617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:01:50.270617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:01:50.270617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:01:50.270617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:01:50.270617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:50.270617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:50.270617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:50.270617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:50.270617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:50.270617 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:50.271917 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:50.271917 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:50.271917 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:50.271917 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:50.271917 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:50.271917 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:50.271917 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:50.271917 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:50.271917 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:50.271917 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:50.271917 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:01:50.271917 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:01:50.271917 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 03:01:50.271917 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:50.271917 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 306/610] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Oct 27 03:01:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:50.274341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa038fe9-6b87-4118-8337-7b0e76e9f2bc None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:50.296718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:50.327222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626602c4-871a-4e3b-9a2c-eb6ac285a5f8 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:50.364996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea52470-6dcf-4d13-b945-691ca17b8427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:50.365537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea52470-6dcf-4d13-b945-691ca17b8427 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:50.365824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea52470-6dcf-4d13-b945-691ca17b8427 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:50.366136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea52470-6dcf-4d13-b945-691ca17b8427 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:50.367433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea52470-6dcf-4d13-b945-691ca17b8427 None admin] RBAC: Adding query filter params (role.id=6e91e7a416ac452b86ec238a2b81bc07, scope.project.id=1ae07f0abb504c298fc9893b1d8bb173, user.id=fe7800497c6e460f9a2a0bd259e6d236) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:50.367748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea52470-6dcf-4d13-b945-691ca17b8427 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:50.369203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea52470-6dcf-4d13-b945-691ca17b8427 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:50.375304 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 305/611] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:01:50 2022] GET /identity/v3/role_assignments?user.id=fe7800497c6e460f9a2a0bd259e6d236&scope.project.id=1ae07f0abb504c298fc9893b1d8bb173&role.id=6e91e7a416ac452b86ec238a2b81bc07 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:50.376566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e53f3-6827-4326-8a25-17d3e9a5c515 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:50.376857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e53f3-6827-4326-8a25-17d3e9a5c515 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:50.377136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e53f3-6827-4326-8a25-17d3e9a5c515 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:50.378550 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 306/612] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:50.384194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e53f3-6827-4326-8a25-17d3e9a5c515 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:50.390245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa038fe9-6b87-4118-8337-7b0e76e9f2bc None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:50.433524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff5b34-02f9-4207-ba43-792dddbfda78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:50.435074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff5b34-02f9-4207-ba43-792dddbfda78 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:50.435547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff5b34-02f9-4207-ba43-792dddbfda78 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:50.436432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff5b34-02f9-4207-ba43-792dddbfda78 None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:50.437581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff5b34-02f9-4207-ba43-792dddbfda78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:50.438098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff5b34-02f9-4207-ba43-792dddbfda78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:50.440674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff5b34-02f9-4207-ba43-792dddbfda78 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:50.450363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:50.465010 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 307/613] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:50.465010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc11f98-afe6-462e-847e-e779575bcdf5 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:50.465010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc11f98-afe6-462e-847e-e779575bcdf5 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:50.465010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc11f98-afe6-462e-847e-e779575bcdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:50.492662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6fc11f98-afe6-462e-847e-e779575bcdf5 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:50.494812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6fc11f98-afe6-462e-847e-e779575bcdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:50.511408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e53f3-6827-4326-8a25-17d3e9a5c515 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:50.561032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4b535-b0f2-4f0c-a648-1692c699990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:50.561668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4b535-b0f2-4f0c-a648-1692c699990d None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:50.561953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4b535-b0f2-4f0c-a648-1692c699990d None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:50.562280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4b535-b0f2-4f0c-a648-1692c699990d None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:50.562935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4b535-b0f2-4f0c-a648-1692c699990d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:50.563242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4b535-b0f2-4f0c-a648-1692c699990d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:50.564644 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4b535-b0f2-4f0c-a648-1692c699990d None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:50.569950 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 307/614] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Oct 27 03:01:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:50.570884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4b535-b0f2-4f0c-a648-1692c699990d None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:50.603711 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 308/615] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:01:50.604955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc11f98-afe6-462e-847e-e779575bcdf5 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:50.613176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:50.717040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4b535-b0f2-4f0c-a648-1692c699990d None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:50.720300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc11f98-afe6-462e-847e-e779575bcdf5 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:50.738398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:50.756335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9bfa6-6839-47f4-a47a-96ecf789796d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:50.757921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9bfa6-6839-47f4-a47a-96ecf789796d None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:50.758232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9bfa6-6839-47f4-a47a-96ecf789796d None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:50.758508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9bfa6-6839-47f4-a47a-96ecf789796d None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:50.759137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369c3d6-d399-4dd5-983d-70440d38d333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:50.759258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9bfa6-6839-47f4-a47a-96ecf789796d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:50.759436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9bfa6-6839-47f4-a47a-96ecf789796d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:50.759782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369c3d6-d399-4dd5-983d-70440d38d333 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:50.760116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369c3d6-d399-4dd5-983d-70440d38d333 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:50.760395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369c3d6-d399-4dd5-983d-70440d38d333 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:50.760804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9bfa6-6839-47f4-a47a-96ecf789796d None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:50.768283 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 309/616] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Oct 27 03:01:50 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:50.769912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed178e95-e54f-46e8-8c60-6a236cd3bd32 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:50.770226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed178e95-e54f-46e8-8c60-6a236cd3bd32 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:50.770350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369c3d6-d399-4dd5-983d-70440d38d333 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:50.770515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed178e95-e54f-46e8-8c60-6a236cd3bd32 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:50.771703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369c3d6-d399-4dd5-983d-70440d38d333 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:50.771909 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 310/617] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:50.779317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6144c-61f8-496f-97fb-e290d7d19fb8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:50.779632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6144c-61f8-496f-97fb-e290d7d19fb8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:50.779881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6144c-61f8-496f-97fb-e290d7d19fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:50.790372 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-8369c3d6-d399-4dd5-983d-70440d38d333 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 03:01:50.790372 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:50.790372 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:50.790372 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:50.790372 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:50.790372 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:50.790372 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:50.790372 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:50.790372 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:50.790372 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:50.790372 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:50.790372 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:50.790372 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:01:50.790372 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:01:50.790372 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:01:50.790372 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:01:50.791396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:50.791396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:50.791396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:01:50.791396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:50.791396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:01:50.791396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:50.791396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:50.791396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:50.791396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:50.791396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:50.791396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:50.791396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:50.791396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:50.791396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:50.791396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:50.791396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:50.791396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:50.791396 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:50.792342 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:50.792342 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:50.792342 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:01:50.792342 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:01:50.792342 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:01:50.792342 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:01:50.792342 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:01:50.792342 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:01:50.792342 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 03:01:50.792342 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:50.792342 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 308/618] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Oct 27 03:01:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:50.797892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369c3d6-d399-4dd5-983d-70440d38d333 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:50.803461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f6d6144c-61f8-496f-97fb-e290d7d19fb8 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:50.804788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f6d6144c-61f8-496f-97fb-e290d7d19fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:50.934207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:50.941235 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 311/619] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 03:01:50.942148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6144c-61f8-496f-97fb-e290d7d19fb8 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:50.977979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369c3d6-d399-4dd5-983d-70440d38d333 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:51.020956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b4e35-614e-4799-9e55-6aa588fa03c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:51.020956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b4e35-614e-4799-9e55-6aa588fa03c0 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:51.021253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b4e35-614e-4799-9e55-6aa588fa03c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:51.021328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b4e35-614e-4799-9e55-6aa588fa03c0 None admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:51.022052 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b4e35-614e-4799-9e55-6aa588fa03c0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:51.022367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b4e35-614e-4799-9e55-6aa588fa03c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:51.024367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b4e35-614e-4799-9e55-6aa588fa03c0 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:51.043876 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 309/620] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Oct 27 03:01:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:51.054776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b4e35-614e-4799-9e55-6aa588fa03c0 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:51.096498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:51.135464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6144c-61f8-496f-97fb-e290d7d19fb8 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:51.171368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be3644-6b7b-4e3f-b816-598001d6688e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:51.175273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be3644-6b7b-4e3f-b816-598001d6688e None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:51.175273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be3644-6b7b-4e3f-b816-598001d6688e None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:51.175273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be3644-6b7b-4e3f-b816-598001d6688e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:51.175273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be3644-6b7b-4e3f-b816-598001d6688e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:51.175273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be3644-6b7b-4e3f-b816-598001d6688e None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:51.192788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-80be3644-6b7b-4e3f-b816-598001d6688e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 03:01:51.192788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:51.192788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:01:51.192788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:01:51.192788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:01:51.192788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:01:51.192788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:01:51.192788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:01:51.192788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 03:01:51.192788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:51.192788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:01:51.192788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:51.192788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:51.192788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:51.192788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:51.192788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:51.192788 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:51.193773 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:51.193773 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:51.193773 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:51.193773 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:51.193773 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:51.193773 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:51.193773 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:01:51.193773 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:01:51.193773 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:01:51.193773 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:01:51.193773 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:51.193773 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:51.193773 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:51.193773 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:51.193773 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:51.193773 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:51.195301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:51.195301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:51.195301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:51.195301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:51.195301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:51.195301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:51.195301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:51.195301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:51.195301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:51.195301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:51.195301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:01:51.195301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:01:51.195301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 03:01:51.195301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:51.197459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b4e35-614e-4799-9e55-6aa588fa03c0 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:51.198358 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 312/621] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Oct 27 03:01:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:51.212914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be3644-6b7b-4e3f-b816-598001d6688e None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:51.240184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7f54a-49a1-46bf-a467-7aba1ae407b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:51.240720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7f54a-49a1-46bf-a467-7aba1ae407b0 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:51.241004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7f54a-49a1-46bf-a467-7aba1ae407b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:51.241868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7f54a-49a1-46bf-a467-7aba1ae407b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:51.312815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7f54a-49a1-46bf-a467-7aba1ae407b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:51.314377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7f54a-49a1-46bf-a467-7aba1ae407b0 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:51.330108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be3644-6b7b-4e3f-b816-598001d6688e None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:51.351005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:51.357920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:51.370832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722dfed-4fc1-4cb1-be62-c0a625711ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:51.371720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722dfed-4fc1-4cb1-be62-c0a625711ad3 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:51.372149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722dfed-4fc1-4cb1-be62-c0a625711ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:51.372587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722dfed-4fc1-4cb1-be62-c0a625711ad3 None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:51.373369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722dfed-4fc1-4cb1-be62-c0a625711ad3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:51.373885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722dfed-4fc1-4cb1-be62-c0a625711ad3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:51.375485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722dfed-4fc1-4cb1-be62-c0a625711ad3 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:51.380659 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 313/622] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Oct 27 03:01:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:01:51.381757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722dfed-4fc1-4cb1-be62-c0a625711ad3 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:51.423187 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 310/623] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:01:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 03:01:51.423187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7f54a-49a1-46bf-a467-7aba1ae407b0 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:51.523270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722dfed-4fc1-4cb1-be62-c0a625711ad3 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:51.540170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7f54a-49a1-46bf-a467-7aba1ae407b0 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:51.560945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:51.573146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee5c5c-22e4-4c14-9e1d-53b37893bb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:51.573790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee5c5c-22e4-4c14-9e1d-53b37893bb64 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:51.574103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee5c5c-22e4-4c14-9e1d-53b37893bb64 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:51.574386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee5c5c-22e4-4c14-9e1d-53b37893bb64 None admin] PATH_INFO: `/v3/services/network` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:51.574990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee5c5c-22e4-4c14-9e1d-53b37893bb64 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:51.576011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f324e7-a7fa-48e6-a6ab-9e56357107ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:51.576452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee5c5c-22e4-4c14-9e1d-53b37893bb64 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:51.576834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f324e7-a7fa-48e6-a6ab-9e56357107ac None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:51.577221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f324e7-a7fa-48e6-a6ab-9e56357107ac None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:51.577598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f324e7-a7fa-48e6-a6ab-9e56357107ac None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:51.578373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f324e7-a7fa-48e6-a6ab-9e56357107ac None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:51.578777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f324e7-a7fa-48e6-a6ab-9e56357107ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:51.580231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f324e7-a7fa-48e6-a6ab-9e56357107ac None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:51.582865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:51.586452 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 311/624] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Oct 27 03:01:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:51.587419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f324e7-a7fa-48e6-a6ab-9e56357107ac None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:51.589128 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-17ee5c5c-22e4-4c14-9e1d-53b37893bb64 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 03:01:51.589128 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:51.589128 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:01:51.589128 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:01:51.589128 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:01:51.589128 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:01:51.589128 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:01:51.589128 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:01:51.589128 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 03:01:51.589128 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:51.589128 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:01:51.589128 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:51.589128 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:51.589128 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:51.589128 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:51.589128 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:51.589128 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:51.590504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:51.590504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:51.590504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:51.590504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:51.590504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:51.590504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:51.590504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:01:51.590504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:01:51.590504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:01:51.590504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:01:51.590504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:51.590504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:51.590504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:51.590504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:51.590504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:51.590504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:51.591636 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:51.591636 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:51.591636 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:51.591636 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:51.591636 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:51.591636 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:51.591636 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:51.591636 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:51.591636 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:51.591636 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:51.591636 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:01:51.591636 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:01:51.591636 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 03:01:51.591636 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:51.598349 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 314/625] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:01:51 2022] GET /identity/v3/services/network => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:51.599390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee5c5c-22e4-4c14-9e1d-53b37893bb64 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:51.697085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f324e7-a7fa-48e6-a6ab-9e56357107ac None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:51.711121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee5c5c-22e4-4c14-9e1d-53b37893bb64 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:51.731698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1903f-7661-48be-932b-03afcc26669d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:51.732428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1903f-7661-48be-932b-03afcc26669d None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:51.732782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1903f-7661-48be-932b-03afcc26669d None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:51.733530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1903f-7661-48be-932b-03afcc26669d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:51.744915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1903f-7661-48be-932b-03afcc26669d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:51.746577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1903f-7661-48be-932b-03afcc26669d None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:51.749313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0c136-34ab-4636-a816-b15c51c9d904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:51.750573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0c136-34ab-4636-a816-b15c51c9d904 None admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:51.751063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0c136-34ab-4636-a816-b15c51c9d904 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:51.751530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0c136-34ab-4636-a816-b15c51c9d904 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:51.752417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0c136-34ab-4636-a816-b15c51c9d904 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:51.754082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0c136-34ab-4636-a816-b15c51c9d904 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:51.764774 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-04a1903f-7661-48be-932b-03afcc26669d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:51.764774 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:51.764774 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:51.764774 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:51.764774 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:51.764774 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:51.764774 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:51.764774 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:51.764774 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:51.764774 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:51.764774 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:51.764774 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:51.764774 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:51.764774 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:51.764774 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:51.764774 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:51.765842 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:51.765842 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:51.765842 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:51.765842 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:51.765842 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:51.765842 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:51.765842 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:51.765842 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:51.765842 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:51.765842 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:51.765842 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:51.765842 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:51.765842 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:51.765842 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:51.765842 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:51.765842 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:51.765842 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:51.767105 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:51.767105 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:51.767105 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:51.767105 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 312/626] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:51.767703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1903f-7661-48be-932b-03afcc26669d None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:51.824311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:51.871036 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1903f-7661-48be-932b-03afcc26669d None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:51.885618 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 315/627] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:01:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:01:51.887081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0c136-34ab-4636-a816-b15c51c9d904 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:51.958683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044631a8-2ce0-445d-932b-06c2797ae285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:51.961471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044631a8-2ce0-445d-932b-06c2797ae285 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:51.962346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044631a8-2ce0-445d-932b-06c2797ae285 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:51.963118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044631a8-2ce0-445d-932b-06c2797ae285 None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:51.964537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044631a8-2ce0-445d-932b-06c2797ae285 None admin] RBAC: Adding query filter params (name=network) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:51.966507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044631a8-2ce0-445d-932b-06c2797ae285 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:51.968266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044631a8-2ce0-445d-932b-06c2797ae285 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:51.983679 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 313/628] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 27 03:01:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:51.987480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044631a8-2ce0-445d-932b-06c2797ae285 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:52.013076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:52.110617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0c136-34ab-4636-a816-b15c51c9d904 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:52.150618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e78fee-3a55-49c1-9443-0bb4b61554c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:52.155566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e78fee-3a55-49c1-9443-0bb4b61554c3 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:52.155566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e78fee-3a55-49c1-9443-0bb4b61554c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:52.155566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e78fee-3a55-49c1-9443-0bb4b61554c3 None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:52.155566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e78fee-3a55-49c1-9443-0bb4b61554c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:52.155566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e78fee-3a55-49c1-9443-0bb4b61554c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:52.156156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e78fee-3a55-49c1-9443-0bb4b61554c3 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:52.159303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044631a8-2ce0-445d-932b-06c2797ae285 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:52.171628 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 316/629] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:52.176095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:52.176950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e78fee-3a55-49c1-9443-0bb4b61554c3 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:52.214807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d164cb-d1ed-4057-9925-04f5515c270e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:52.215437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d164cb-d1ed-4057-9925-04f5515c270e None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:52.215720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d164cb-d1ed-4057-9925-04f5515c270e None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:52.215992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d164cb-d1ed-4057-9925-04f5515c270e None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:52.216639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d164cb-d1ed-4057-9925-04f5515c270e None admin] RBAC: Adding query filter params (type=network) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:52.216943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d164cb-d1ed-4057-9925-04f5515c270e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:52.218922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d164cb-d1ed-4057-9925-04f5515c270e None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:52.226398 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 314/630] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 27 03:01:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:52.235426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d164cb-d1ed-4057-9925-04f5515c270e None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:52.314890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e78fee-3a55-49c1-9443-0bb4b61554c3 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:52.325780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:52.354222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48593ee7-067c-40c1-9107-075fa78f5cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:52.354989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48593ee7-067c-40c1-9107-075fa78f5cab None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:52.355338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48593ee7-067c-40c1-9107-075fa78f5cab None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:52.355685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48593ee7-067c-40c1-9107-075fa78f5cab None admin] PATH_INFO: `/v3/projects/service` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:52.357503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d164cb-d1ed-4057-9925-04f5515c270e None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:52.364850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48593ee7-067c-40c1-9107-075fa78f5cab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:52.367073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48593ee7-067c-40c1-9107-075fa78f5cab None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:52.388706 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-48593ee7-067c-40c1-9107-075fa78f5cab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:52.388706 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:52.388706 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:52.388706 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:52.388706 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:52.388706 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:52.388706 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:52.388706 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:52.388706 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:52.388706 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:52.388706 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:52.388706 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:52.388706 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:01:52.388706 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:01:52.388706 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:01:52.389863 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:01:52.389863 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:52.389863 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:52.389863 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:52.389863 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:52.389863 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:52.389863 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:52.389863 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:52.389863 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:52.389863 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:52.389863 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:52.389863 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:52.389863 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:52.389863 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:52.389863 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:52.389863 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:52.389863 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:52.391008 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:01:52.391008 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:01:52.391008 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:01:52.391008 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:01:52.391008 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:01:52.391008 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:01:52.391008 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:52.391008 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:52.394490 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 317/631] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:01:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:52.395753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48593ee7-067c-40c1-9107-075fa78f5cab None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:52.398843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4ac61-2f3a-4042-8b2b-374a2f943894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:52.399649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4ac61-2f3a-4042-8b2b-374a2f943894 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:52.400084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4ac61-2f3a-4042-8b2b-374a2f943894 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:52.400603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4ac61-2f3a-4042-8b2b-374a2f943894 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:52.401527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4ac61-2f3a-4042-8b2b-374a2f943894 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:52.403079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4ac61-2f3a-4042-8b2b-374a2f943894 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:52.489453 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 315/632] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:01:52 2022] POST /identity/v3/endpoints => generated 337 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:01:52.523878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48593ee7-067c-40c1-9107-075fa78f5cab None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:52.568751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80a87f-e68c-4fe1-8e78-67d81112a96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:52.569914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80a87f-e68c-4fe1-8e78-67d81112a96f None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:52.570235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80a87f-e68c-4fe1-8e78-67d81112a96f None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:52.570511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80a87f-e68c-4fe1-8e78-67d81112a96f None admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:52.571269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80a87f-e68c-4fe1-8e78-67d81112a96f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:52.571577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80a87f-e68c-4fe1-8e78-67d81112a96f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:52.573087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80a87f-e68c-4fe1-8e78-67d81112a96f None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:52.587162 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 318/633] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 27 03:01:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:52.592906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4ac61-2f3a-4042-8b2b-374a2f943894 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:52.654146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:52.744962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4ac61-2f3a-4042-8b2b-374a2f943894 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:52.793603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c59905-4915-4469-bf8d-174b721cd8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:52.794622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c59905-4915-4469-bf8d-174b721cd8fa None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:52.795101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c59905-4915-4469-bf8d-174b721cd8fa None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:52.795592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c59905-4915-4469-bf8d-174b721cd8fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:52.796535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c59905-4915-4469-bf8d-174b721cd8fa None admin] RBAC: Adding query filter params (role.id=248be75b0cf142299cd46440170c7972, scope.project.id=1ae07f0abb504c298fc9893b1d8bb173, user.id=f0310313e99d4faebbaa952d20c6dd9c) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:52.797054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c59905-4915-4469-bf8d-174b721cd8fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:52.798710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c59905-4915-4469-bf8d-174b721cd8fa None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:52.806153 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 316/634] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:01:52 2022] GET /identity/v3/role_assignments?user.id=f0310313e99d4faebbaa952d20c6dd9c&scope.project.id=1ae07f0abb504c298fc9893b1d8bb173&role.id=248be75b0cf142299cd46440170c7972 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:53.011721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a55d1-69ae-4b33-a3e5-c9ff244f1a71 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:53.012252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a55d1-69ae-4b33-a3e5-c9ff244f1a71 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:53.012252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a55d1-69ae-4b33-a3e5-c9ff244f1a71 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:53.013926 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 319/635] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:53.019778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afe212-c3db-4a2f-8f0b-d3e7aea0ee43 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:53.020428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afe212-c3db-4a2f-8f0b-d3e7aea0ee43 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:53.020706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afe212-c3db-4a2f-8f0b-d3e7aea0ee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:53.042984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f3afe212-c3db-4a2f-8f0b-d3e7aea0ee43 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:53.044211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f3afe212-c3db-4a2f-8f0b-d3e7aea0ee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:53.126479 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 317/636] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:01:53.152158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fd813-8448-4309-8b6e-2a2f8dd524f7 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:53.158537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fd813-8448-4309-8b6e-2a2f8dd524f7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:53.158537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fd813-8448-4309-8b6e-2a2f8dd524f7 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:53.158537 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 320/637] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:53.159278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebf0ae-7082-49ac-a324-1e8ec2ae71c6 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:53.159565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebf0ae-7082-49ac-a324-1e8ec2ae71c6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:53.159838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebf0ae-7082-49ac-a324-1e8ec2ae71c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:53.179400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-62ebf0ae-7082-49ac-a324-1e8ec2ae71c6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:53.180607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-62ebf0ae-7082-49ac-a324-1e8ec2ae71c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:53.202422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:53.250307 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 318/638] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:01:53.408937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fd813-8448-4309-8b6e-2a2f8dd524f7 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:53.436762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:53.517667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fd813-8448-4309-8b6e-2a2f8dd524f7 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:53.518289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebf0ae-7082-49ac-a324-1e8ec2ae71c6 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:53.556503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94126a8-fbf4-4fae-b688-4b389102166e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:53.557497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94126a8-fbf4-4fae-b688-4b389102166e None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:53.558004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94126a8-fbf4-4fae-b688-4b389102166e None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:53.558512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94126a8-fbf4-4fae-b688-4b389102166e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:53.559387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94126a8-fbf4-4fae-b688-4b389102166e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:53.561082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94126a8-fbf4-4fae-b688-4b389102166e None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:53.570944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-d94126a8-fbf4-4fae-b688-4b389102166e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 03:01:53.570944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:53.570944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:01:53.570944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:01:53.570944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:01:53.570944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:01:53.570944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:01:53.570944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:01:53.570944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 03:01:53.570944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:53.570944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:01:53.570944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:53.570944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:53.570944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:53.570944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:53.570944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:53.570944 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:53.571989 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:53.571989 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:53.571989 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:53.571989 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:53.571989 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:53.571989 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:53.571989 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:01:53.571989 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:01:53.571989 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:01:53.571989 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:01:53.571989 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:53.571989 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:53.571989 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:53.571989 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:53.571989 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:53.571989 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:53.572843 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:53.572843 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:53.572843 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:53.572843 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:53.572843 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:53.572843 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:53.572843 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:53.572843 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:53.572843 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:53.572843 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:53.572843 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:01:53.572843 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:01:53.572843 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 03:01:53.572843 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:53.580480 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 321/639] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Oct 27 03:01:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:53.582010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94126a8-fbf4-4fae-b688-4b389102166e None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:53.620724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebf0ae-7082-49ac-a324-1e8ec2ae71c6 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:53.654944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e8a5c-78bd-4da6-93b9-3bc1047d6f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:53.655566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e8a5c-78bd-4da6-93b9-3bc1047d6f45 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:53.656215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e8a5c-78bd-4da6-93b9-3bc1047d6f45 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:53.656215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e8a5c-78bd-4da6-93b9-3bc1047d6f45 None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:53.656736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e8a5c-78bd-4da6-93b9-3bc1047d6f45 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:53.658167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e8a5c-78bd-4da6-93b9-3bc1047d6f45 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:53.679846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:53.692299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94126a8-fbf4-4fae-b688-4b389102166e None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:53.728808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061a4b4-8867-419f-a518-140292ff3bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:53.729870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061a4b4-8867-419f-a518-140292ff3bb0 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:53.730544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061a4b4-8867-419f-a518-140292ff3bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:53.736709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061a4b4-8867-419f-a518-140292ff3bb0 None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:53.736709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061a4b4-8867-419f-a518-140292ff3bb0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:53.736709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061a4b4-8867-419f-a518-140292ff3bb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:53.736709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061a4b4-8867-419f-a518-140292ff3bb0 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:53.738398 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 319/640] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 27 03:01:53 2022] POST /identity/v3/services => generated 269 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:01:53.744603 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 322/641] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Oct 27 03:01:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:01:53.746509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e8a5c-78bd-4da6-93b9-3bc1047d6f45 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:53.768769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:53.870891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e8a5c-78bd-4da6-93b9-3bc1047d6f45 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:53.911741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceefebb-abca-4c78-afe9-e1c493f5ca36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:53.912784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceefebb-abca-4c78-afe9-e1c493f5ca36 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:53.913375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceefebb-abca-4c78-afe9-e1c493f5ca36 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:53.913862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceefebb-abca-4c78-afe9-e1c493f5ca36 None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:53.914749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceefebb-abca-4c78-afe9-e1c493f5ca36 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:53.915280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceefebb-abca-4c78-afe9-e1c493f5ca36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:53.916979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceefebb-abca-4c78-afe9-e1c493f5ca36 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:53.922817 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 320/642] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Oct 27 03:01:53 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:54.418273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41589570-8e31-4704-8476-35ed41dcff78 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:54.418774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41589570-8e31-4704-8476-35ed41dcff78 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:54.418902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41589570-8e31-4704-8476-35ed41dcff78 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:54.420438 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 323/643] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:54.425689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e933651-87f4-4fcd-90f9-c5d495defdb1 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:54.425979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e933651-87f4-4fcd-90f9-c5d495defdb1 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:54.426297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e933651-87f4-4fcd-90f9-c5d495defdb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:54.445468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1e933651-87f4-4fcd-90f9-c5d495defdb1 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:54.446620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1e933651-87f4-4fcd-90f9-c5d495defdb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:54.519515 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 321/644] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:54 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:01:54.786838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41589570-8e31-4704-8476-35ed41dcff78 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:54.899161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41589570-8e31-4704-8476-35ed41dcff78 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:54.934482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c1843-966d-4b20-b037-5571617266af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:54.935461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c1843-966d-4b20-b037-5571617266af None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:54.935947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c1843-966d-4b20-b037-5571617266af None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:54.936418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c1843-966d-4b20-b037-5571617266af None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:54.937197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c1843-966d-4b20-b037-5571617266af None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:54.938833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c1843-966d-4b20-b037-5571617266af None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:54.947961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-723c1843-966d-4b20-b037-5571617266af None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 03:01:54.947961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:54.947961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:01:54.947961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:01:54.947961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:01:54.947961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:01:54.947961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:01:54.947961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:01:54.947961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 03:01:54.947961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:54.947961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:01:54.947961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:54.947961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:54.947961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:54.947961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:54.947961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:54.947961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:54.948932 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:54.948932 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:54.948932 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:54.948932 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:54.948932 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:54.948932 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:54.948932 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:01:54.948932 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:01:54.948932 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:01:54.948932 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:01:54.948932 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:54.948932 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:54.948932 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:54.948932 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:54.948932 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:54.948932 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:54.949769 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:54.949769 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:54.949769 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:54.949769 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:54.949769 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:54.949769 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:54.949769 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:54.949769 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:54.949769 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:54.949769 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:54.949769 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:01:54.949769 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:01:54.949769 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 03:01:54.949769 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:54.952514 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 324/645] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 27 03:01:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:54.960437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e933651-87f4-4fcd-90f9-c5d495defdb1 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:54.966933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:55.067664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e933651-87f4-4fcd-90f9-c5d495defdb1 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:55.102762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd76c7-3f94-4ed6-bc17-d9d6ac362c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:55.103381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd76c7-3f94-4ed6-bc17-d9d6ac362c87 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:55.103723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd76c7-3f94-4ed6-bc17-d9d6ac362c87 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:55.103997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd76c7-3f94-4ed6-bc17-d9d6ac362c87 None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:55.104633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd76c7-3f94-4ed6-bc17-d9d6ac362c87 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:55.104935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd76c7-3f94-4ed6-bc17-d9d6ac362c87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:55.106330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd76c7-3f94-4ed6-bc17-d9d6ac362c87 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:55.111398 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 322/646] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 27 03:01:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:55.116888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c1843-966d-4b20-b037-5571617266af None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:55.136111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:55.137005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad36574-8e26-4208-a007-6a2564a82bae None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:55.137299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad36574-8e26-4208-a007-6a2564a82bae None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:55.137633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad36574-8e26-4208-a007-6a2564a82bae None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:55.139191 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 323/647] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:01:55.144215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2170617-a037-48f1-a67a-bb58e4341564 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:55.144730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2170617-a037-48f1-a67a-bb58e4341564 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:55.145162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2170617-a037-48f1-a67a-bb58e4341564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:55.165008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a2170617-a037-48f1-a67a-bb58e4341564 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:55.166318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a2170617-a037-48f1-a67a-bb58e4341564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:55.241864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:55.244508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c1843-966d-4b20-b037-5571617266af None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:55.248252 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 324/648] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:55 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 03:01:55.282985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87585a-ed15-48a0-8421-ffe13ca6a650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:55.283598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87585a-ed15-48a0-8421-ffe13ca6a650 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:55.283884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87585a-ed15-48a0-8421-ffe13ca6a650 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:55.284159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87585a-ed15-48a0-8421-ffe13ca6a650 None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:55.284792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87585a-ed15-48a0-8421-ffe13ca6a650 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:55.285098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87585a-ed15-48a0-8421-ffe13ca6a650 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:55.286520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87585a-ed15-48a0-8421-ffe13ca6a650 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:55.291346 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 325/649] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 27 03:01:55 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:55.518125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2170617-a037-48f1-a67a-bb58e4341564 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:55.615774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2170617-a037-48f1-a67a-bb58e4341564 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:55.653070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70dcbf-0459-4dac-84e4-060989d8e4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:55.653715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70dcbf-0459-4dac-84e4-060989d8e4c1 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:55.653998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70dcbf-0459-4dac-84e4-060989d8e4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:55.654301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70dcbf-0459-4dac-84e4-060989d8e4c1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:55.664837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70dcbf-0459-4dac-84e4-060989d8e4c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:01:55.669666 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-dd70dcbf-0459-4dac-84e4-060989d8e4c1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 03:01:55.669666 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:55.669666 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:55.669666 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:55.669666 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:55.669666 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:55.669666 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:55.669666 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:55.669666 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:55.669666 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:55.669666 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:55.669666 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:55.669666 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:01:55.669666 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:01:55.669666 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:01:55.669666 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:01:55.670640 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:01:55.670640 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:01:55.670640 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:01:55.670640 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:01:55.670640 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:55.670640 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:55.670640 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:55.670640 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:55.670640 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:55.670640 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:55.670640 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:55.670640 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:55.670640 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:55.670640 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:55.670640 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:55.670640 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:55.672181 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:55.672181 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:55.672181 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:55.672181 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:55.672181 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:01:55.672181 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:01:55.672181 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:01:55.672181 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:01:55.672181 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:01:55.672181 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:01:55.672181 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 03:01:55.672181 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:55.672181 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 325/650] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Oct 27 03:01:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:55.676692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87585a-ed15-48a0-8421-ffe13ca6a650 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:55.771006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:55.790467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87585a-ed15-48a0-8421-ffe13ca6a650 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:55.830016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f4dbb-6b2f-4af5-93fe-49d028437120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:55.830665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f4dbb-6b2f-4af5-93fe-49d028437120 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:55.831014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f4dbb-6b2f-4af5-93fe-49d028437120 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:55.831292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f4dbb-6b2f-4af5-93fe-49d028437120 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:55.832007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f4dbb-6b2f-4af5-93fe-49d028437120 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:55.832324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f4dbb-6b2f-4af5-93fe-49d028437120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:55.833767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f4dbb-6b2f-4af5-93fe-49d028437120 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:55.842556 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 326/651] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Oct 27 03:01:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:55.847695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70dcbf-0459-4dac-84e4-060989d8e4c1 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:55.916233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:55.958723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70dcbf-0459-4dac-84e4-060989d8e4c1 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:55.993931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272eb54b-b78e-4d7d-8a80-9d6f0f214bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:55.994605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272eb54b-b78e-4d7d-8a80-9d6f0f214bcd None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:55.994888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272eb54b-b78e-4d7d-8a80-9d6f0f214bcd None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:55.995162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272eb54b-b78e-4d7d-8a80-9d6f0f214bcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:56.005572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272eb54b-b78e-4d7d-8a80-9d6f0f214bcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:56.007900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272eb54b-b78e-4d7d-8a80-9d6f0f214bcd None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:56.018997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039dd345-eb79-44b7-b055-7d81d2d95ab1 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:56.019395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039dd345-eb79-44b7-b055-7d81d2d95ab1 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:56.019679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039dd345-eb79-44b7-b055-7d81d2d95ab1 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:56.021343 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 327/652] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:01:56.024323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-272eb54b-b78e-4d7d-8a80-9d6f0f214bcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:56.024323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:56.024323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:56.024323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:56.024323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:56.024323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:56.024323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:56.024323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:56.024323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:56.024323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:56.024323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:56.024323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:56.024323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:56.024323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:56.024323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:56.024323 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:56.026645 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:56.026645 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:56.026645 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:56.026645 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:56.026645 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:56.026645 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:56.026645 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:56.026645 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:56.026645 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:56.026645 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:56.026645 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:56.026645 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:56.026645 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:56.026645 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:56.026645 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:56.026645 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:56.026645 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:56.028809 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:56.028809 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:56.028809 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:56.028809 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 326/653] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:56.029329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e059cd-6ed7-476d-b1bf-6a1096faf4e9 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:56.029329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e059cd-6ed7-476d-b1bf-6a1096faf4e9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:56.029329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e059cd-6ed7-476d-b1bf-6a1096faf4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:56.034063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272eb54b-b78e-4d7d-8a80-9d6f0f214bcd None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:56.048830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-91e059cd-6ed7-476d-b1bf-6a1096faf4e9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:56.050863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-91e059cd-6ed7-476d-b1bf-6a1096faf4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:56.150427 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 328/654] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:56 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:01:56.152629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272eb54b-b78e-4d7d-8a80-9d6f0f214bcd None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:56.166291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:56.198071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2529e5-f131-4d61-ad67-7d45013adfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:56.199028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2529e5-f131-4d61-ad67-7d45013adfdb None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:56.199482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2529e5-f131-4d61-ad67-7d45013adfdb None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:56.199968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2529e5-f131-4d61-ad67-7d45013adfdb None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:56.200801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2529e5-f131-4d61-ad67-7d45013adfdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:56.201275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2529e5-f131-4d61-ad67-7d45013adfdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:56.202904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2529e5-f131-4d61-ad67-7d45013adfdb None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:56.216429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff1503-22d5-4861-893c-9319fb363d0e None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:56.216719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff1503-22d5-4861-893c-9319fb363d0e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:56.216920 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 327/655] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:01:56.217031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff1503-22d5-4861-893c-9319fb363d0e None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:56.222066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2529e5-f131-4d61-ad67-7d45013adfdb None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:56.222223 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 329/656] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:01:56.224131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86628901-f792-433f-bdfd-1933dc1d3278 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:56.224421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86628901-f792-433f-bdfd-1933dc1d3278 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:56.224714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86628901-f792-433f-bdfd-1933dc1d3278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:56.243283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-86628901-f792-433f-bdfd-1933dc1d3278 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:56.244522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-86628901-f792-433f-bdfd-1933dc1d3278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:56.334526 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 330/657] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:56 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 03:01:56.342981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2529e5-f131-4d61-ad67-7d45013adfdb None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:56.377597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347ccbf-2d1e-40d7-9fcd-15b1153250d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:56.378262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347ccbf-2d1e-40d7-9fcd-15b1153250d3 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:56.378549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347ccbf-2d1e-40d7-9fcd-15b1153250d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:56.378827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347ccbf-2d1e-40d7-9fcd-15b1153250d3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:56.386824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347ccbf-2d1e-40d7-9fcd-15b1153250d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:56.388264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347ccbf-2d1e-40d7-9fcd-15b1153250d3 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:56.399856 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-c347ccbf-2d1e-40d7-9fcd-15b1153250d3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 03:01:56.399856 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:56.399856 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:56.399856 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:56.399856 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:56.399856 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:56.399856 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:56.399856 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:56.399856 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:56.399856 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:56.399856 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:56.399856 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:56.399856 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:01:56.399856 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:01:56.399856 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:01:56.399856 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:01:56.400771 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:56.400771 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:56.400771 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:01:56.400771 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:56.400771 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:01:56.400771 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:01:56.400771 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:56.400771 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:56.400771 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:56.400771 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:56.400771 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:56.400771 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:56.400771 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:56.400771 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:56.400771 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:56.400771 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:56.400771 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:56.400771 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:56.401730 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:56.401730 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:56.401730 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:01:56.401730 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:01:56.401730 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:01:56.401730 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:01:56.401730 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:01:56.401730 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:01:56.401730 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 03:01:56.401730 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:56.401730 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 328/658] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Oct 27 03:01:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:56.408489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86628901-f792-433f-bdfd-1933dc1d3278 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:56.411417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:56.435160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347ccbf-2d1e-40d7-9fcd-15b1153250d3 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:56.468671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:56.530975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86628901-f792-433f-bdfd-1933dc1d3278 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:56.545683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347ccbf-2d1e-40d7-9fcd-15b1153250d3 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:56.577447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5871a7-40d3-4ac5-973e-a4cb21096e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:56.578352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5871a7-40d3-4ac5-973e-a4cb21096e87 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:56.578640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5871a7-40d3-4ac5-973e-a4cb21096e87 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:56.579184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5871a7-40d3-4ac5-973e-a4cb21096e87 None admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:56.579930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5871a7-40d3-4ac5-973e-a4cb21096e87 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:56.580194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5871a7-40d3-4ac5-973e-a4cb21096e87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:56.581536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5871a7-40d3-4ac5-973e-a4cb21096e87 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:56.586305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439617e7-b9ae-4b28-83ca-39e44d53a38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:56.587187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439617e7-b9ae-4b28-83ca-39e44d53a38c None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:56.587661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439617e7-b9ae-4b28-83ca-39e44d53a38c None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:56.588125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439617e7-b9ae-4b28-83ca-39e44d53a38c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:56.588904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439617e7-b9ae-4b28-83ca-39e44d53a38c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:56.590671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439617e7-b9ae-4b28-83ca-39e44d53a38c None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:56.604497 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 331/659] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Oct 27 03:01:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:56.604664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-439617e7-b9ae-4b28-83ca-39e44d53a38c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 03:01:56.604664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:56.604664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:01:56.604664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:01:56.604664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:01:56.604664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:01:56.604664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:01:56.604664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:01:56.604664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 03:01:56.604664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:56.604664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:01:56.604664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:56.604664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:56.604664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:56.604664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:56.604664 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:56.605551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:56.605551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:56.605551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:56.605551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:56.605551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:56.605551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:56.605551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:56.605551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:01:56.605551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:01:56.605551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:01:56.605551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:01:56.605551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:56.605551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:56.605551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:56.605551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:56.605551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:56.605551 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:56.606470 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:56.606470 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:56.606470 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:56.606470 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:56.606470 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:56.606470 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:56.606470 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:56.606470 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:56.606470 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:56.606470 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:56.606470 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:01:56.606470 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:01:56.606470 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 03:01:56.606470 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:01:56.606470 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 329/660] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Oct 27 03:01:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:01:56.611070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5871a7-40d3-4ac5-973e-a4cb21096e87 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:56.614971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439617e7-b9ae-4b28-83ca-39e44d53a38c None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:56.680837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:56.715031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:56.721055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439617e7-b9ae-4b28-83ca-39e44d53a38c None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:56.722757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5871a7-40d3-4ac5-973e-a4cb21096e87 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:56.758297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3a25e-5bb0-4e90-949e-51adff32d443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:56.758900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3a25e-5bb0-4e90-949e-51adff32d443 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:56.759219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3a25e-5bb0-4e90-949e-51adff32d443 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:56.759443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3a25e-5bb0-4e90-949e-51adff32d443 None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:56.760199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3a25e-5bb0-4e90-949e-51adff32d443 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:56.760387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3a25e-5bb0-4e90-949e-51adff32d443 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:56.761706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3a25e-5bb0-4e90-949e-51adff32d443 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:56.765256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12570ce-9285-4212-95cc-398d340f44ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:56.765889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12570ce-9285-4212-95cc-398d340f44ed None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:56.771041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12570ce-9285-4212-95cc-398d340f44ed None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:56.771178 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 330/661] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Oct 27 03:01:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:56.771265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12570ce-9285-4212-95cc-398d340f44ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:56.771337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3a25e-5bb0-4e90-949e-51adff32d443 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:56.782679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12570ce-9285-4212-95cc-398d340f44ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:56.784137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12570ce-9285-4212-95cc-398d340f44ed None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:56.799091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-b12570ce-9285-4212-95cc-398d340f44ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:56.799091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:56.799091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:56.799091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:56.799091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:56.799091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:56.799091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:56.799091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:56.799091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:56.799091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:56.799091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:56.799091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:56.799091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:01:56.799091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:01:56.799091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:01:56.799091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:01:56.800080 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:56.800080 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:56.800080 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:56.800080 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:56.800080 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:56.800080 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:56.800080 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:56.800080 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:56.800080 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:56.800080 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:56.800080 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:56.800080 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:56.800080 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:56.800080 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:56.800080 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:56.800080 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:56.800080 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:01:56.800989 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:01:56.800989 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:01:56.800989 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:56.800989 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 332/662] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:56.801735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12570ce-9285-4212-95cc-398d340f44ed None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:56.878479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3a25e-5bb0-4e90-949e-51adff32d443 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:56.904797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12570ce-9285-4212-95cc-398d340f44ed None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:56.916865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ff275-5d5e-424d-9a68-e4aa9297c508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:56.917583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ff275-5d5e-424d-9a68-e4aa9297c508 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:56.917867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ff275-5d5e-424d-9a68-e4aa9297c508 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:56.918325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ff275-5d5e-424d-9a68-e4aa9297c508 None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:56.918545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:56.918967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ff275-5d5e-424d-9a68-e4aa9297c508 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:56.920727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ff275-5d5e-424d-9a68-e4aa9297c508 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:56.939951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c42c8c-3735-4d96-b19f-da93a2250e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:56.940559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c42c8c-3735-4d96-b19f-da93a2250e20 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:56.940843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c42c8c-3735-4d96-b19f-da93a2250e20 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:56.941121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c42c8c-3735-4d96-b19f-da93a2250e20 None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:56.941759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c42c8c-3735-4d96-b19f-da93a2250e20 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:56.942091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c42c8c-3735-4d96-b19f-da93a2250e20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:56.943466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c42c8c-3735-4d96-b19f-da93a2250e20 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:56.948721 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 333/663] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Oct 27 03:01:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:56.950816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c42c8c-3735-4d96-b19f-da93a2250e20 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:56.999189 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 331/664] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 27 03:01:56 2022] POST /identity/v3/services => generated 241 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:01:57.000235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ff275-5d5e-424d-9a68-e4aa9297c508 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:57.029155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:57.077527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c42c8c-3735-4d96-b19f-da93a2250e20 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:57.128623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ff275-5d5e-424d-9a68-e4aa9297c508 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:57.131980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065eb5b8-6ba8-4449-b46a-01df31fd1ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:57.134144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065eb5b8-6ba8-4449-b46a-01df31fd1ae9 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:57.134598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065eb5b8-6ba8-4449-b46a-01df31fd1ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:57.135020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065eb5b8-6ba8-4449-b46a-01df31fd1ae9 None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:57.135867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065eb5b8-6ba8-4449-b46a-01df31fd1ae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:57.136508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065eb5b8-6ba8-4449-b46a-01df31fd1ae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:57.138241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065eb5b8-6ba8-4449-b46a-01df31fd1ae9 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:57.157885 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 334/665] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:57.164169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065eb5b8-6ba8-4449-b46a-01df31fd1ae9 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:57.177743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fede4-c74b-45af-a577-59991fd07d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:57.178599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fede4-c74b-45af-a577-59991fd07d05 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:57.178974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fede4-c74b-45af-a577-59991fd07d05 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:57.179337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fede4-c74b-45af-a577-59991fd07d05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:57.180278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fede4-c74b-45af-a577-59991fd07d05 None admin] RBAC: Adding query filter params (interface=public, service_id=935c5c3798474d5780074521d869ec2f, region_id=RegionOne) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:57.180570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fede4-c74b-45af-a577-59991fd07d05 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:57.182145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fede4-c74b-45af-a577-59991fd07d05 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:57.192104 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 332/666] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Oct 27 03:01:56 2022] GET /identity/v3/endpoints?service_id=935c5c3798474d5780074521d869ec2f&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:57.199147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fede4-c74b-45af-a577-59991fd07d05 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:57.216218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:57.291250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:57.311215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fede4-c74b-45af-a577-59991fd07d05 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:57.314605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065eb5b8-6ba8-4449-b46a-01df31fd1ae9 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:57.347200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2a513-6cd8-4fa0-86c0-7883c6afe126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:57.347843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2a513-6cd8-4fa0-86c0-7883c6afe126 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:57.348152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2a513-6cd8-4fa0-86c0-7883c6afe126 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:57.348398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2a513-6cd8-4fa0-86c0-7883c6afe126 None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:57.349013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2a513-6cd8-4fa0-86c0-7883c6afe126 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:57.350484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2a513-6cd8-4fa0-86c0-7883c6afe126 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:57.356931 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 333/667] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Oct 27 03:01:57 2022] GET /identity/v3/services => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:01:57.362017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f891ec-8a47-44a5-8cfb-c0e53c16d65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:57.363023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f891ec-8a47-44a5-8cfb-c0e53c16d65d None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:57.363587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f891ec-8a47-44a5-8cfb-c0e53c16d65d None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:57.364062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f891ec-8a47-44a5-8cfb-c0e53c16d65d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:57.372652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f891ec-8a47-44a5-8cfb-c0e53c16d65d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:57.374715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f891ec-8a47-44a5-8cfb-c0e53c16d65d None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:57.389562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-48f891ec-8a47-44a5-8cfb-c0e53c16d65d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:57.389562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:57.389562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:57.389562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:57.389562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:57.389562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:57.389562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:57.389562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:57.389562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:57.389562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:57.389562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:57.389562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:57.389562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:01:57.389562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:01:57.389562 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:01:57.390531 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:01:57.390531 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:57.390531 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:57.390531 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:57.390531 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:57.390531 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:57.390531 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:57.390531 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:57.390531 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:57.390531 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:57.390531 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:57.390531 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:57.390531 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:57.390531 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:57.390531 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:57.390531 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:57.390531 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:57.391458 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:01:57.391458 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:01:57.391458 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:01:57.391458 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:01:57.391458 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:01:57.391458 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:01:57.391458 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:01:57.391458 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:57.395383 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 335/668] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:01:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:01:57.401329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2a513-6cd8-4fa0-86c0-7883c6afe126 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:57.524457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2a513-6cd8-4fa0-86c0-7883c6afe126 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:57.565284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f884903-080b-4e71-b8bb-c1c79e1b2641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:57.565908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f884903-080b-4e71-b8bb-c1c79e1b2641 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:57.566225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f884903-080b-4e71-b8bb-c1c79e1b2641 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:57.566502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f884903-080b-4e71-b8bb-c1c79e1b2641 None admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:57.567210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f884903-080b-4e71-b8bb-c1c79e1b2641 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:57.567517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f884903-080b-4e71-b8bb-c1c79e1b2641 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:57.568953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f884903-080b-4e71-b8bb-c1c79e1b2641 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:57.582648 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 334/669] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 27 03:01:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:01:57.588818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f891ec-8a47-44a5-8cfb-c0e53c16d65d None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:57.591025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f7283-2aba-48ad-91d6-f2f2b73e65fa None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:57.591310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f7283-2aba-48ad-91d6-f2f2b73e65fa None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:57.591710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f7283-2aba-48ad-91d6-f2f2b73e65fa None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:57.593288 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 335/670] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:57.598703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfbda7-e7bd-447b-9213-a840a2707cc0 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:57.599246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfbda7-e7bd-447b-9213-a840a2707cc0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:57.599724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfbda7-e7bd-447b-9213-a840a2707cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:57.608467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:57.619508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7acfbda7-e7bd-447b-9213-a840a2707cc0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:57.621013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7acfbda7-e7bd-447b-9213-a840a2707cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:57.696138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:57.702756 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 336/671] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:57 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 03:01:57.707251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f891ec-8a47-44a5-8cfb-c0e53c16d65d None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:57.743614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98e634-f753-4790-9d3c-0a833164effc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:57.744288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98e634-f753-4790-9d3c-0a833164effc None admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:57.744573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98e634-f753-4790-9d3c-0a833164effc None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:57.744851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98e634-f753-4790-9d3c-0a833164effc None admin] PATH_INFO: `/v3/projects/1ae07f0abb504c298fc9893b1d8bb173/users/f0310313e99d4faebbaa952d20c6dd9c/roles/9a155af878464393911225ae1d6e3cbb` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:57.747090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98e634-f753-4790-9d3c-0a833164effc None admin] RBAC: Authorizing `identity:create_grant(project_id=1ae07f0abb504c298fc9893b1d8bb173, user_id=f0310313e99d4faebbaa952d20c6dd9c, role_id=9a155af878464393911225ae1d6e3cbb)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:57.748538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98e634-f753-4790-9d3c-0a833164effc None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:57.822253 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 336/672] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:01:57 2022] PUT /identity/v3/projects/1ae07f0abb504c298fc9893b1d8bb173/users/f0310313e99d4faebbaa952d20c6dd9c/roles/9a155af878464393911225ae1d6e3cbb => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:01:57.975477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acfbda7-e7bd-447b-9213-a840a2707cc0 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:58.081267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acfbda7-e7bd-447b-9213-a840a2707cc0 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:58.115840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec937a-7ac9-4e5e-88f4-e0e53a65e3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:58.117393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec937a-7ac9-4e5e-88f4-e0e53a65e3d4 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:58.117879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec937a-7ac9-4e5e-88f4-e0e53a65e3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:58.118393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec937a-7ac9-4e5e-88f4-e0e53a65e3d4 None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:58.119275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec937a-7ac9-4e5e-88f4-e0e53a65e3d4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:58.120835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec937a-7ac9-4e5e-88f4-e0e53a65e3d4 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:58.124543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:58.198703 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 337/673] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 27 03:01:57 2022] POST /identity/v3/services => generated 251 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:01:59.292584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82326c-abcf-46ac-8d39-bce11bbe967d None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:59.293101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82326c-abcf-46ac-8d39-bce11bbe967d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:59.293185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82326c-abcf-46ac-8d39-bce11bbe967d None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:59.294769 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 337/674] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:59.299969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848437b-0ea7-4144-950d-2c6ccad230ea None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:59.300404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848437b-0ea7-4144-950d-2c6ccad230ea None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:59.300597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848437b-0ea7-4144-950d-2c6ccad230ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:59.319189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8848437b-0ea7-4144-950d-2c6ccad230ea None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:59.320375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8848437b-0ea7-4144-950d-2c6ccad230ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:59.392820 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 338/675] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:01:59.585756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71968db2-0a20-4391-b2fc-3fb09e5e2ce9 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:59.586169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71968db2-0a20-4391-b2fc-3fb09e5e2ce9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:59.586348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71968db2-0a20-4391-b2fc-3fb09e5e2ce9 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:59.587923 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 338/676] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:01:59.593269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21b724-b57d-4b0f-81c5-9f334dcbebdc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:59.593803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21b724-b57d-4b0f-81c5-9f334dcbebdc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:59.594323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21b724-b57d-4b0f-81c5-9f334dcbebdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:59.613157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1f21b724-b57d-4b0f-81c5-9f334dcbebdc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:01:59.614669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1f21b724-b57d-4b0f-81c5-9f334dcbebdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:01:59.673558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71968db2-0a20-4391-b2fc-3fb09e5e2ce9 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:59.690084 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 339/677] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:01:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:01:59.786497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71968db2-0a20-4391-b2fc-3fb09e5e2ce9 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:59.823241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c9c73-2cf9-4493-8934-b610222127d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:59.824122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c9c73-2cf9-4493-8934-b610222127d4 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:59.824582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c9c73-2cf9-4493-8934-b610222127d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:59.825000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c9c73-2cf9-4493-8934-b610222127d4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:59.825724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c9c73-2cf9-4493-8934-b610222127d4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:59.827336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c9c73-2cf9-4493-8934-b610222127d4 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:01:59.836705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-672c9c73-2cf9-4493-8934-b610222127d4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 03:01:59.836705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:59.836705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:01:59.836705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:01:59.836705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:01:59.836705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:01:59.836705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:01:59.836705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:01:59.836705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 03:01:59.836705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:59.836705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:01:59.836705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:59.836705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:01:59.836705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:01:59.836705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:01:59.836705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:01:59.836705 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:01:59.837875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:01:59.837875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:01:59.837875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:01:59.837875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:01:59.837875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:01:59.837875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:01:59.837875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:01:59.837875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:01:59.837875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:01:59.837875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:01:59.837875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:01:59.837875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:01:59.837875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:01:59.837875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:01:59.837875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:01:59.837875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:01:59.838985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:01:59.838985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:01:59.838985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:01:59.838985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:01:59.838985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:01:59.838985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:01:59.838985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:01:59.838985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:01:59.838985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:01:59.838985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:01:59.838985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:01:59.838985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:01:59.838985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 03:01:59.838985 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:01:59.841227 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 339/678] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Oct 27 03:01:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:01:59.847226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21b724-b57d-4b0f-81c5-9f334dcbebdc None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:59.898917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:59.950882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21b724-b57d-4b0f-81c5-9f334dcbebdc None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:01:59.961076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c9c73-2cf9-4493-8934-b610222127d4 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:01:59.993521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:01:59.995056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5c902-b294-4ad3-8b11-b5b4a9b78674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:01:59.995783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5c902-b294-4ad3-8b11-b5b4a9b78674 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:01:59.996177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5c902-b294-4ad3-8b11-b5b4a9b78674 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:01:59.996548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5c902-b294-4ad3-8b11-b5b4a9b78674 None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:01:59.997291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5c902-b294-4ad3-8b11-b5b4a9b78674 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:01:59.997698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5c902-b294-4ad3-8b11-b5b4a9b78674 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:01:59.999311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5c902-b294-4ad3-8b11-b5b4a9b78674 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:00.006085 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 340/679] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Oct 27 03:01:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:00.010223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5c902-b294-4ad3-8b11-b5b4a9b78674 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:00.097595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c9c73-2cf9-4493-8934-b610222127d4 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:00.115914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5c902-b294-4ad3-8b11-b5b4a9b78674 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:00.130466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:00.138588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d20aa-c98b-4a25-b0c2-79d4b7c1202a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:00.139214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d20aa-c98b-4a25-b0c2-79d4b7c1202a None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:00.139504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d20aa-c98b-4a25-b0c2-79d4b7c1202a None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:00.140035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d20aa-c98b-4a25-b0c2-79d4b7c1202a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:00.140364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d20aa-c98b-4a25-b0c2-79d4b7c1202a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:00.141828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d20aa-c98b-4a25-b0c2-79d4b7c1202a None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:00.151549 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-aa8d20aa-c98b-4a25-b0c2-79d4b7c1202a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 03:02:00.151549 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:00.151549 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:02:00.151549 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:02:00.151549 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:02:00.151549 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:02:00.151549 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:02:00.151549 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:02:00.151549 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 03:02:00.151549 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:00.151549 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:02:00.151549 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:00.151549 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:00.151549 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:00.151549 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:00.151549 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:00.152504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:00.152504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:00.152504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:00.152504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:00.152504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:00.152504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:00.152504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:00.152504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:02:00.152504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:02:00.152504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:02:00.152504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:02:00.152504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:00.152504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:00.152504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:00.152504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:00.152504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:00.152504 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:00.153994 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:00.153994 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:00.153994 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:00.153994 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:00.153994 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:00.153994 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:00.153994 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:00.153994 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:00.153994 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:00.153994 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:00.153994 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:02:00.153994 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:02:00.153994 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 03:02:00.153994 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:00.153994 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 340/680] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Oct 27 03:01:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:00.156407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ec20e-f663-433e-afc3-2fb64008e44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:00.157023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ec20e-f663-433e-afc3-2fb64008e44d None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:00.157305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ec20e-f663-433e-afc3-2fb64008e44d None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:00.157580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ec20e-f663-433e-afc3-2fb64008e44d None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:00.158252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ec20e-f663-433e-afc3-2fb64008e44d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:00.158567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ec20e-f663-433e-afc3-2fb64008e44d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:00.158875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e8fdb-eaa0-417e-a171-2e00e6e8c574 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:00.159169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e8fdb-eaa0-417e-a171-2e00e6e8c574 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:00.159452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e8fdb-eaa0-417e-a171-2e00e6e8c574 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:00.160068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ec20e-f663-433e-afc3-2fb64008e44d None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:00.160972 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 341/681] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:00.161621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e8fdb-eaa0-417e-a171-2e00e6e8c574 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:00.166088 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 341/682] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Oct 27 03:02:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:00.171946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba37cf0-7eea-4eee-a83f-32908b4a1606 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:00.172239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba37cf0-7eea-4eee-a83f-32908b4a1606 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:00.172520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba37cf0-7eea-4eee-a83f-32908b4a1606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:00.196005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-eba37cf0-7eea-4eee-a83f-32908b4a1606 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:00.197208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-eba37cf0-7eea-4eee-a83f-32908b4a1606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:00.260865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:00.277099 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 342/683] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:00.277099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba37cf0-7eea-4eee-a83f-32908b4a1606 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:00.289783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e8fdb-eaa0-417e-a171-2e00e6e8c574 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:00.339523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9e090-1c60-4545-a2b9-d85eade83d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:00.340837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9e090-1c60-4545-a2b9-d85eade83d22 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:00.341269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9e090-1c60-4545-a2b9-d85eade83d22 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:00.341708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9e090-1c60-4545-a2b9-d85eade83d22 None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:00.342516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9e090-1c60-4545-a2b9-d85eade83d22 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:00.342957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9e090-1c60-4545-a2b9-d85eade83d22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:00.344477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9e090-1c60-4545-a2b9-d85eade83d22 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:00.349789 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 342/684] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Oct 27 03:02:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:00.356884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9e090-1c60-4545-a2b9-d85eade83d22 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:00.384840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba37cf0-7eea-4eee-a83f-32908b4a1606 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:00.399840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:00.433835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae5e6d-5fd8-46e4-8e38-35bade1c8d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:00.434557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae5e6d-5fd8-46e4-8e38-35bade1c8d2a None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:00.434838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae5e6d-5fd8-46e4-8e38-35bade1c8d2a None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:00.435281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae5e6d-5fd8-46e4-8e38-35bade1c8d2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:00.436484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae5e6d-5fd8-46e4-8e38-35bade1c8d2a None admin] RBAC: Adding query filter params (interface=public, service_id=f8f6860646d94ba787213d26a28bac54, region_id=RegionOne) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:00.436809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae5e6d-5fd8-46e4-8e38-35bade1c8d2a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:00.438203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae5e6d-5fd8-46e4-8e38-35bade1c8d2a None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:00.443195 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 343/685] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Oct 27 03:02:00 2022] GET /identity/v3/endpoints?service_id=f8f6860646d94ba787213d26a28bac54&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:00.445132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0327b-2b56-4c20-82a5-656497e9fd9d None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:00.445624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0327b-2b56-4c20-82a5-656497e9fd9d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:00.446156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0327b-2b56-4c20-82a5-656497e9fd9d None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:00.448279 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 344/686] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:00.449158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0327b-2b56-4c20-82a5-656497e9fd9d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:00.473746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9e090-1c60-4545-a2b9-d85eade83d22 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:00.512524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74d2bf-6294-4354-8c8d-1ed2f65defce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:00.513238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74d2bf-6294-4354-8c8d-1ed2f65defce None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:00.513522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74d2bf-6294-4354-8c8d-1ed2f65defce None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:00.513827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74d2bf-6294-4354-8c8d-1ed2f65defce None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:00.514449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74d2bf-6294-4354-8c8d-1ed2f65defce None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:00.514758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74d2bf-6294-4354-8c8d-1ed2f65defce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:00.516138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74d2bf-6294-4354-8c8d-1ed2f65defce None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:00.521461 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 343/687] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Oct 27 03:02:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:02:00.524179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd43a0d-b0c7-4699-8a7e-1687b340de63 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:00.525260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd43a0d-b0c7-4699-8a7e-1687b340de63 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:00.525540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd43a0d-b0c7-4699-8a7e-1687b340de63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:00.545391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-abd43a0d-b0c7-4699-8a7e-1687b340de63 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:00.546766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-abd43a0d-b0c7-4699-8a7e-1687b340de63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:00.555136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0327b-2b56-4c20-82a5-656497e9fd9d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:00.555577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:00.589625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26187cee-3400-4f9c-bbd1-c5fe2144bd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:00.590261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26187cee-3400-4f9c-bbd1-c5fe2144bd47 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:00.590550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26187cee-3400-4f9c-bbd1-c5fe2144bd47 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:00.590817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26187cee-3400-4f9c-bbd1-c5fe2144bd47 None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:00.591418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26187cee-3400-4f9c-bbd1-c5fe2144bd47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:00.592782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26187cee-3400-4f9c-bbd1-c5fe2144bd47 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:00.598501 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 345/688] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Oct 27 03:02:00 2022] GET /identity/v3/services => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:02:00.599246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26187cee-3400-4f9c-bbd1-c5fe2144bd47 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:00.626153 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 344/689] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:00.626153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd43a0d-b0c7-4699-8a7e-1687b340de63 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:00.650559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:00.731818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26187cee-3400-4f9c-bbd1-c5fe2144bd47 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:00.776658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd43a0d-b0c7-4699-8a7e-1687b340de63 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:00.776853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87287a46-3e22-446e-a01e-ef6c75ef66be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:00.777465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87287a46-3e22-446e-a01e-ef6c75ef66be None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:00.777744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87287a46-3e22-446e-a01e-ef6c75ef66be None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:00.778015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87287a46-3e22-446e-a01e-ef6c75ef66be None admin] PATH_INFO: `/v3/endpoints` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:00.778712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87287a46-3e22-446e-a01e-ef6c75ef66be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:00.780117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87287a46-3e22-446e-a01e-ef6c75ef66be None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:00.813739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62fe2f-15a6-4526-9024-7eddb1562513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:00.814407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62fe2f-15a6-4526-9024-7eddb1562513 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:00.814692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62fe2f-15a6-4526-9024-7eddb1562513 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:00.814968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62fe2f-15a6-4526-9024-7eddb1562513 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:00.826011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62fe2f-15a6-4526-9024-7eddb1562513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:02:00.831140 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-6b62fe2f-15a6-4526-9024-7eddb1562513 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 03:02:00.831140 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:00.831140 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:00.831140 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:00.831140 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:00.831140 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:00.831140 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:00.831140 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:00.831140 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:00.831140 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:00.831140 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:00.831140 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:00.831140 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:02:00.831140 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:02:00.831140 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:02:00.831140 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:02:00.832059 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:02:00.832059 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:02:00.832059 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:02:00.832059 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:02:00.832059 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:00.832059 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:00.832059 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:00.832059 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:00.832059 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:00.832059 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:00.832059 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:00.832059 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:00.832059 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:00.832059 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:00.832059 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:00.832059 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:00.833083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:00.833083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:00.833083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:00.833083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:00.833083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:02:00.833083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:02:00.833083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:02:00.833083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:02:00.833083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:02:00.833083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:02:00.833083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 03:02:00.833083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:00.833083 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 345/690] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Oct 27 03:02:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:00.838867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62fe2f-15a6-4526-9024-7eddb1562513 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:00.842330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:00.882471 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 346/691] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:02:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:02:00.900723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87287a46-3e22-446e-a01e-ef6c75ef66be None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:00.977549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62fe2f-15a6-4526-9024-7eddb1562513 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:01.010065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:01.026570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87287a46-3e22-446e-a01e-ef6c75ef66be None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:01.027587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b1224-c6d6-4820-af21-15f315daea42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:01.029795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b1224-c6d6-4820-af21-15f315daea42 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:01.030097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b1224-c6d6-4820-af21-15f315daea42 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:01.030373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b1224-c6d6-4820-af21-15f315daea42 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:01.031072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b1224-c6d6-4820-af21-15f315daea42 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:01.031377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b1224-c6d6-4820-af21-15f315daea42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:01.032808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b1224-c6d6-4820-af21-15f315daea42 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:01.047356 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 346/692] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Oct 27 03:02:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:02:01.048858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b1224-c6d6-4820-af21-15f315daea42 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:01.084867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220f7fb-1947-4896-bf5a-2dc98248c030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:01.085531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220f7fb-1947-4896-bf5a-2dc98248c030 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:01.085823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220f7fb-1947-4896-bf5a-2dc98248c030 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:01.086145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220f7fb-1947-4896-bf5a-2dc98248c030 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:01.086746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220f7fb-1947-4896-bf5a-2dc98248c030 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:01.088705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220f7fb-1947-4896-bf5a-2dc98248c030 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:01.103350 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-3220f7fb-1947-4896-bf5a-2dc98248c030 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 03:02:01.103350 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:01.103350 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:02:01.103350 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:02:01.103350 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:02:01.103350 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:02:01.103350 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:02:01.103350 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:02:01.103350 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 03:02:01.103350 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:01.103350 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:02:01.103350 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:01.103350 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:01.103350 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:01.103350 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:01.103350 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:01.103350 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:01.104405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:01.104405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:01.104405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:01.104405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:01.104405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:01.104405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:01.104405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:02:01.104405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:02:01.104405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:02:01.104405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:02:01.104405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:01.104405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:01.104405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:01.104405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:01.104405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:01.104405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:01.105335 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:01.105335 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:01.105335 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:01.105335 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:01.105335 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:01.105335 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:01.105335 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:01.105335 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:01.105335 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:01.105335 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:01.105335 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:02:01.105335 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:02:01.105335 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 03:02:01.105335 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:01.105335 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 347/693] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 27 03:02:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:02:01.112637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220f7fb-1947-4896-bf5a-2dc98248c030 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:01.141156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:01.189587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b1224-c6d6-4820-af21-15f315daea42 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:01.225533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293d3de-4616-4b9d-93c7-753582bdd297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:01.226202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293d3de-4616-4b9d-93c7-753582bdd297 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:01.226475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293d3de-4616-4b9d-93c7-753582bdd297 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:01.226933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293d3de-4616-4b9d-93c7-753582bdd297 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:01.243754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293d3de-4616-4b9d-93c7-753582bdd297 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:01.245452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293d3de-4616-4b9d-93c7-753582bdd297 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:01.251825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220f7fb-1947-4896-bf5a-2dc98248c030 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:01.261224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-c293d3de-4616-4b9d-93c7-753582bdd297 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:02:01.261224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:01.261224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:01.261224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:01.261224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:01.261224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:01.261224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:01.261224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:01.261224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:01.261224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:01.261224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:01.261224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:01.261224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:02:01.261224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:02:01.261224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:02:01.261224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:02:01.262236 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:01.262236 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:01.262236 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:01.262236 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:01.262236 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:01.262236 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:01.262236 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:01.262236 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:01.262236 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:01.262236 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:01.262236 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:01.262236 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:01.262236 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:01.262236 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:01.262236 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:01.262236 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:01.262236 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:02:01.263147 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:02:01.263147 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:02:01.263147 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:01.269684 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 347/694] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:01.270856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293d3de-4616-4b9d-93c7-753582bdd297 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:01.293252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efb142-61f2-48c5-a1d7-4ca22f3dd094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:01.293892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efb142-61f2-48c5-a1d7-4ca22f3dd094 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:01.294243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efb142-61f2-48c5-a1d7-4ca22f3dd094 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:01.294522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efb142-61f2-48c5-a1d7-4ca22f3dd094 None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:01.295796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efb142-61f2-48c5-a1d7-4ca22f3dd094 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:01.296122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efb142-61f2-48c5-a1d7-4ca22f3dd094 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:01.297786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efb142-61f2-48c5-a1d7-4ca22f3dd094 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:01.304736 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 348/695] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 27 03:02:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:01.310290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efb142-61f2-48c5-a1d7-4ca22f3dd094 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:01.331934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:01.383644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293d3de-4616-4b9d-93c7-753582bdd297 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:01.396846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:01.419012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc5103-27a4-4405-bd2d-43f427bf7900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:01.419958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc5103-27a4-4405-bd2d-43f427bf7900 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:01.420388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc5103-27a4-4405-bd2d-43f427bf7900 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:01.420843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc5103-27a4-4405-bd2d-43f427bf7900 None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:01.421652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc5103-27a4-4405-bd2d-43f427bf7900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:01.422190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc5103-27a4-4405-bd2d-43f427bf7900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:01.423919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc5103-27a4-4405-bd2d-43f427bf7900 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:01.427429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efb142-61f2-48c5-a1d7-4ca22f3dd094 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:01.443339 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 348/696] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:01.444624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc5103-27a4-4405-bd2d-43f427bf7900 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:01.469523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d5105-2a62-46ba-a96f-2edb14ce8a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:01.470393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d5105-2a62-46ba-a96f-2edb14ce8a0f None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:01.470841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d5105-2a62-46ba-a96f-2edb14ce8a0f None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:01.471327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d5105-2a62-46ba-a96f-2edb14ce8a0f None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:01.472107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d5105-2a62-46ba-a96f-2edb14ce8a0f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:01.472571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d5105-2a62-46ba-a96f-2edb14ce8a0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:01.474385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d5105-2a62-46ba-a96f-2edb14ce8a0f None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:01.481785 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 349/697] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 27 03:02:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:02:01.490239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d5105-2a62-46ba-a96f-2edb14ce8a0f None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:01.571337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc5103-27a4-4405-bd2d-43f427bf7900 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:01.585297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:01.607361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d5105-2a62-46ba-a96f-2edb14ce8a0f None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:01.609851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce0eb8-762f-47df-88ba-aa70a8ff2dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:01.610755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce0eb8-762f-47df-88ba-aa70a8ff2dfb None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:01.611234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce0eb8-762f-47df-88ba-aa70a8ff2dfb None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:01.611815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce0eb8-762f-47df-88ba-aa70a8ff2dfb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:01.620504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce0eb8-762f-47df-88ba-aa70a8ff2dfb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:01.622246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce0eb8-762f-47df-88ba-aa70a8ff2dfb None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:01.634595 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-b4ce0eb8-762f-47df-88ba-aa70a8ff2dfb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 03:02:01.634595 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:01.634595 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:01.634595 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:01.634595 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:01.634595 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:01.634595 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:01.634595 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:01.634595 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:01.634595 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:01.634595 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:01.634595 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:01.634595 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:02:01.634595 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:02:01.634595 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:02:01.634595 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:02:01.635572 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:01.635572 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:01.635572 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:02:01.635572 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:02:01.635572 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:02:01.635572 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:02:01.635572 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:01.635572 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:01.635572 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:01.635572 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:01.635572 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:01.635572 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:01.635572 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:01.635572 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:01.635572 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:01.635572 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:01.635572 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:01.635572 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:01.636499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:01.636499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:01.636499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:02:01.636499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:02:01.636499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:02:01.636499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:02:01.636499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:02:01.636499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:02:01.636499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 03:02:01.636499 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:01.638724 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 349/698] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Oct 27 03:02:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:01.650141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce0eb8-762f-47df-88ba-aa70a8ff2dfb None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:01.650272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306d0a5-f2d5-44da-9423-19471b9acc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:01.650272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306d0a5-f2d5-44da-9423-19471b9acc09 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:01.650272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306d0a5-f2d5-44da-9423-19471b9acc09 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:01.650272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306d0a5-f2d5-44da-9423-19471b9acc09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:01.650553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306d0a5-f2d5-44da-9423-19471b9acc09 None admin] RBAC: Adding query filter params (interface=public, service_id=1ab079c2dcbb4a12b8d3d78025259ff2, region_id=RegionOne) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:01.650553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306d0a5-f2d5-44da-9423-19471b9acc09 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:01.651909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306d0a5-f2d5-44da-9423-19471b9acc09 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:01.657635 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 350/699] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Oct 27 03:02:01 2022] GET /identity/v3/endpoints?service_id=1ab079c2dcbb4a12b8d3d78025259ff2&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:01.663546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306d0a5-f2d5-44da-9423-19471b9acc09 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:01.680486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:01.750498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce0eb8-762f-47df-88ba-aa70a8ff2dfb None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:01.786198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306d0a5-f2d5-44da-9423-19471b9acc09 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:01.790094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124a2b4-246d-411b-8b51-1ef90e811a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:01.791002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124a2b4-246d-411b-8b51-1ef90e811a20 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:01.791306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124a2b4-246d-411b-8b51-1ef90e811a20 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:01.791630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124a2b4-246d-411b-8b51-1ef90e811a20 None admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:01.792363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124a2b4-246d-411b-8b51-1ef90e811a20 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:01.792673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124a2b4-246d-411b-8b51-1ef90e811a20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:01.794163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124a2b4-246d-411b-8b51-1ef90e811a20 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:01.814867 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 350/700] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Oct 27 03:02:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:01.823309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124a2b4-246d-411b-8b51-1ef90e811a20 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:01.832257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336b2a1-bc8b-4650-a59e-b7ca0ec6f15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:01.833099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336b2a1-bc8b-4650-a59e-b7ca0ec6f15c None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:01.833691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336b2a1-bc8b-4650-a59e-b7ca0ec6f15c None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:01.834217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336b2a1-bc8b-4650-a59e-b7ca0ec6f15c None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:01.835561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336b2a1-bc8b-4650-a59e-b7ca0ec6f15c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:01.837220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336b2a1-bc8b-4650-a59e-b7ca0ec6f15c None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:01.845462 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 351/701] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Oct 27 03:02:01 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:02:01.930842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:01.941010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124a2b4-246d-411b-8b51-1ef90e811a20 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:01.979458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b6b88-205a-41bc-a00d-bc03332346de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:01.980122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b6b88-205a-41bc-a00d-bc03332346de None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:01.980402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b6b88-205a-41bc-a00d-bc03332346de None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:01.980680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b6b88-205a-41bc-a00d-bc03332346de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:02.057862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b6b88-205a-41bc-a00d-bc03332346de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:02.059426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b6b88-205a-41bc-a00d-bc03332346de None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:02.153167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:02.164187 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 351/702] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:02:01 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 03:02:02.169848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336b2a1-bc8b-4650-a59e-b7ca0ec6f15c None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:02.189751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:02.283108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336b2a1-bc8b-4650-a59e-b7ca0ec6f15c None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:02.317418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a49e8f-cfb6-4b91-8e45-9e05faa67147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:02.318463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a49e8f-cfb6-4b91-8e45-9e05faa67147 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:02.319487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a49e8f-cfb6-4b91-8e45-9e05faa67147 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:02.319983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a49e8f-cfb6-4b91-8e45-9e05faa67147 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:02.330539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a49e8f-cfb6-4b91-8e45-9e05faa67147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:02.332211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a49e8f-cfb6-4b91-8e45-9e05faa67147 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:02.352764 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-a5a49e8f-cfb6-4b91-8e45-9e05faa67147 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:02:02.352764 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:02.352764 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:02.352764 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:02.352764 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:02.352764 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:02.352764 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:02.352764 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:02.352764 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:02.352764 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:02.352764 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:02.352764 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:02.352764 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:02:02.352764 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:02:02.352764 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:02:02.352764 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:02:02.354413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:02.354413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:02.354413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:02.354413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:02.354413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:02.354413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:02.354413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:02.354413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:02.354413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:02.354413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:02.354413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:02.354413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:02.354413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:02.354413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:02.354413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:02.354413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:02.354413 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:02:02.355466 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:02:02.355466 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:02:02.355466 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:02.357372 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 352/703] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:02:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:02.363126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b6b88-205a-41bc-a00d-bc03332346de None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:02.468708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b6b88-205a-41bc-a00d-bc03332346de None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:02.507868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30304921-f959-4572-a7ad-fd42b4a4a7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:02.508850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30304921-f959-4572-a7ad-fd42b4a4a7e2 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:02.509334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30304921-f959-4572-a7ad-fd42b4a4a7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:02.509819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30304921-f959-4572-a7ad-fd42b4a4a7e2 None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:02.510680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30304921-f959-4572-a7ad-fd42b4a4a7e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:02.511198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30304921-f959-4572-a7ad-fd42b4a4a7e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:02.512753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30304921-f959-4572-a7ad-fd42b4a4a7e2 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:02.524891 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 352/704] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:02.530568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a49e8f-cfb6-4b91-8e45-9e05faa67147 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:02.600541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:02.635116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a49e8f-cfb6-4b91-8e45-9e05faa67147 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:02.669543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8460cd8-7a90-4e75-8388-ba433e90fba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:02.670606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8460cd8-7a90-4e75-8388-ba433e90fba0 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:02.671088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8460cd8-7a90-4e75-8388-ba433e90fba0 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:02.671555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8460cd8-7a90-4e75-8388-ba433e90fba0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:02.679289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8460cd8-7a90-4e75-8388-ba433e90fba0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:02.680974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8460cd8-7a90-4e75-8388-ba433e90fba0 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:02.692814 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-f8460cd8-7a90-4e75-8388-ba433e90fba0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:02:02.692814 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:02.692814 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:02.692814 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:02.692814 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:02.692814 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:02.692814 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:02.692814 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:02.692814 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:02.692814 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:02.692814 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:02.692814 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:02.692814 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:02:02.692814 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:02:02.692814 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:02:02.693719 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:02:02.693719 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:02.693719 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:02.693719 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:02.693719 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:02.693719 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:02.693719 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:02.693719 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:02.693719 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:02.693719 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:02.693719 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:02.693719 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:02.693719 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:02.693719 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:02.693719 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:02.693719 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:02.693719 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:02.695254 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:02:02.695254 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:02:02.695254 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:02:02.695254 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:02:02.695254 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:02:02.695254 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:02:02.695254 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:02:02.695254 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:02.697576 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 353/705] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:02:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:02.703492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30304921-f959-4572-a7ad-fd42b4a4a7e2 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:02.760130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:02.821456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30304921-f959-4572-a7ad-fd42b4a4a7e2 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:02.857358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6a19a-876a-42ea-9dff-7348de543e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:02.858416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6a19a-876a-42ea-9dff-7348de543e4d None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:02.858927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6a19a-876a-42ea-9dff-7348de543e4d None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:02.859392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6a19a-876a-42ea-9dff-7348de543e4d None admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:02.860284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6a19a-876a-42ea-9dff-7348de543e4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:02.860780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6a19a-876a-42ea-9dff-7348de543e4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:02.862444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6a19a-876a-42ea-9dff-7348de543e4d None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:02.874289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49e5df-e3e7-4900-b727-fb61fe0fdc7c None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:02.874858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49e5df-e3e7-4900-b727-fb61fe0fdc7c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:02.875583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49e5df-e3e7-4900-b727-fb61fe0fdc7c None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:02.877356 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 354/707] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:02.877541 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 353/707] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 27 03:02:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:02.883311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83be703-8548-46e2-844c-ec89282b9dd8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:02.883596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83be703-8548-46e2-844c-ec89282b9dd8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:02.883869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83be703-8548-46e2-844c-ec89282b9dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:02.884464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49e5df-e3e7-4900-b727-fb61fe0fdc7c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:02.902342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e83be703-8548-46e2-844c-ec89282b9dd8 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:02.903648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e83be703-8548-46e2-844c-ec89282b9dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:02.990115 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 354/708] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 03:02:03.013900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49e5df-e3e7-4900-b727-fb61fe0fdc7c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:03.034954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:03.049699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b562f4-7692-46e4-9c76-960ecb28cf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:03.053187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b562f4-7692-46e4-9c76-960ecb28cf14 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:03.053187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b562f4-7692-46e4-9c76-960ecb28cf14 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:03.053187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b562f4-7692-46e4-9c76-960ecb28cf14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:03.053187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b562f4-7692-46e4-9c76-960ecb28cf14 None admin] RBAC: Adding query filter params (role.id=9a155af878464393911225ae1d6e3cbb, scope.project.id=1ae07f0abb504c298fc9893b1d8bb173, user.id=f0310313e99d4faebbaa952d20c6dd9c) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:03.053187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b562f4-7692-46e4-9c76-960ecb28cf14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:03.054373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b562f4-7692-46e4-9c76-960ecb28cf14 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:03.060622 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 355/709] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:02:02 2022] GET /identity/v3/role_assignments?user.id=f0310313e99d4faebbaa952d20c6dd9c&scope.project.id=1ae07f0abb504c298fc9893b1d8bb173&role.id=9a155af878464393911225ae1d6e3cbb => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:03.217155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13a88d-8acd-44f2-935b-5010897fb11d None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:03.217892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13a88d-8acd-44f2-935b-5010897fb11d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:03.218460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13a88d-8acd-44f2-935b-5010897fb11d None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:03.220339 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 355/710] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:03.227944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d6e75-15f1-4075-8d89-f493c4a7bebb None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:03.228279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d6e75-15f1-4075-8d89-f493c4a7bebb None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:03.228502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d6e75-15f1-4075-8d89-f493c4a7bebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:03.249266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-514d6e75-15f1-4075-8d89-f493c4a7bebb None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:03.255251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-514d6e75-15f1-4075-8d89-f493c4a7bebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:03.279603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13a88d-8acd-44f2-935b-5010897fb11d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:03.324968 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 356/711] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:03.325624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:03.393012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13a88d-8acd-44f2-935b-5010897fb11d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:03.430200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec970c-7093-4758-9564-e5b454051289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:03.430838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec970c-7093-4758-9564-e5b454051289 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:03.431172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec970c-7093-4758-9564-e5b454051289 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:03.431451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec970c-7093-4758-9564-e5b454051289 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:03.432038 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec970c-7093-4758-9564-e5b454051289 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:03.433419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec970c-7093-4758-9564-e5b454051289 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:03.442697 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-93ec970c-7093-4758-9564-e5b454051289 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 03:02:03.442697 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:03.442697 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:02:03.442697 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:02:03.442697 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:02:03.442697 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:02:03.442697 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:02:03.442697 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:02:03.442697 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 03:02:03.442697 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:03.442697 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:02:03.442697 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:03.442697 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:03.442697 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:03.442697 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:03.442697 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:03.442697 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:03.443678 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:03.443678 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:03.443678 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:03.443678 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:03.443678 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:03.443678 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:03.443678 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:02:03.443678 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:02:03.443678 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:02:03.443678 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:02:03.443678 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:03.443678 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:03.443678 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:03.443678 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:03.443678 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:03.443678 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:03.445656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:03.445656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:03.445656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:03.445656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:03.445656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:03.445656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:03.445656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:03.445656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:03.445656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:03.445656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:03.445656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:02:03.445656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:02:03.445656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 03:02:03.445656 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:03.445656 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 356/712] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Oct 27 03:02:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:02:03.450199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d6e75-15f1-4075-8d89-f493c4a7bebb None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:03.552053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d6e75-15f1-4075-8d89-f493c4a7bebb None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:03.570836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:03.595714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064ce4a-e3ef-4ab6-acd9-dc5b056bbc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:03.596327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064ce4a-e3ef-4ab6-acd9-dc5b056bbc6f None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:03.596608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064ce4a-e3ef-4ab6-acd9-dc5b056bbc6f None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:03.596881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064ce4a-e3ef-4ab6-acd9-dc5b056bbc6f None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:03.597513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064ce4a-e3ef-4ab6-acd9-dc5b056bbc6f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:03.597813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064ce4a-e3ef-4ab6-acd9-dc5b056bbc6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:03.599222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064ce4a-e3ef-4ab6-acd9-dc5b056bbc6f None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:03.604885 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 357/713] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Oct 27 03:02:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:03.608616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec970c-7093-4758-9564-e5b454051289 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:03.611580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064ce4a-e3ef-4ab6-acd9-dc5b056bbc6f None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:03.714465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064ce4a-e3ef-4ab6-acd9-dc5b056bbc6f None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:03.741852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec970c-7093-4758-9564-e5b454051289 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:03.745162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:03.752733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f424e-8061-4c29-8b0b-bef59140950d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:03.758018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f424e-8061-4c29-8b0b-bef59140950d None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:03.758018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f424e-8061-4c29-8b0b-bef59140950d None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:03.758018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f424e-8061-4c29-8b0b-bef59140950d None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:03.758018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f424e-8061-4c29-8b0b-bef59140950d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:03.758018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f424e-8061-4c29-8b0b-bef59140950d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:03.758018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f424e-8061-4c29-8b0b-bef59140950d None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:03.767309 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 358/714] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Oct 27 03:02:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:03.768458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f424e-8061-4c29-8b0b-bef59140950d None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:03.781733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b831a-d00f-4f26-9972-a1f23726c06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:03.782673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b831a-d00f-4f26-9972-a1f23726c06a None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:03.782964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b831a-d00f-4f26-9972-a1f23726c06a None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:03.783240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b831a-d00f-4f26-9972-a1f23726c06a None admin] PATH_INFO: `/v3/services/compute` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:03.783826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b831a-d00f-4f26-9972-a1f23726c06a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:03.785377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b831a-d00f-4f26-9972-a1f23726c06a None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:03.797498 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-c48b831a-d00f-4f26-9972-a1f23726c06a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 03:02:03.797498 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:03.797498 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:02:03.797498 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:02:03.797498 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:02:03.797498 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:02:03.797498 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:02:03.797498 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:02:03.797498 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 03:02:03.797498 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:03.797498 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:02:03.797498 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:03.797498 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:03.797498 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:03.797498 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:03.797498 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:03.797498 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:03.798565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:03.798565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:03.798565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:03.798565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:03.798565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:03.798565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:03.798565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:02:03.798565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:02:03.798565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:02:03.798565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:02:03.798565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:03.798565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:03.798565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:03.798565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:03.798565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:03.798565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:03.799402 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:03.799402 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:03.799402 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:03.799402 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:03.799402 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:03.799402 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:03.799402 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:03.799402 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:03.799402 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:03.799402 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:03.799402 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:02:03.799402 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:02:03.799402 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 03:02:03.799402 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:03.802159 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 357/715] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:02:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:03.808763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b831a-d00f-4f26-9972-a1f23726c06a None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:03.824558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:03.886614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f424e-8061-4c29-8b0b-bef59140950d None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:03.923519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8b197-66aa-43d6-8c54-cbb4043e28be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:03.924493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8b197-66aa-43d6-8c54-cbb4043e28be None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:03.924671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b831a-d00f-4f26-9972-a1f23726c06a None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:03.925168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8b197-66aa-43d6-8c54-cbb4043e28be None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:03.925648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8b197-66aa-43d6-8c54-cbb4043e28be None admin] PATH_INFO: `/v3/endpoints` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:03.926555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8b197-66aa-43d6-8c54-cbb4043e28be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:03.928174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8b197-66aa-43d6-8c54-cbb4043e28be None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:03.960479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b7469-a5cf-49db-8df8-3a258bbbd1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:03.961088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b7469-a5cf-49db-8df8-3a258bbbd1c9 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:03.961374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b7469-a5cf-49db-8df8-3a258bbbd1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:03.961643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b7469-a5cf-49db-8df8-3a258bbbd1c9 None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:03.962361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b7469-a5cf-49db-8df8-3a258bbbd1c9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:03.962667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b7469-a5cf-49db-8df8-3a258bbbd1c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:03.964041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b7469-a5cf-49db-8df8-3a258bbbd1c9 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:03.969197 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 358/716] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 27 03:02:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:02:03.975001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b7469-a5cf-49db-8df8-3a258bbbd1c9 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:04.012193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:04.038567 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 359/717] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:02:03 2022] POST /identity/v3/endpoints => generated 349 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:02:04.100780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b7469-a5cf-49db-8df8-3a258bbbd1c9 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:04.104153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3ab8d-898a-48c1-b353-6f64c07edfc4 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:04.104443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3ab8d-898a-48c1-b353-6f64c07edfc4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:04.104726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3ab8d-898a-48c1-b353-6f64c07edfc4 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:04.106402 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 360/718] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:02:04.112091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07778670-cb74-47f8-ad0e-c150949b2278 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:04.112371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07778670-cb74-47f8-ad0e-c150949b2278 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:04.112646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07778670-cb74-47f8-ad0e-c150949b2278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:04.131530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-07778670-cb74-47f8-ad0e-c150949b2278 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:04.133752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-07778670-cb74-47f8-ad0e-c150949b2278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:04.155114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f81811-c594-4223-9e03-f5cb46e67baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:04.156181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f81811-c594-4223-9e03-f5cb46e67baa None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:04.156459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f81811-c594-4223-9e03-f5cb46e67baa None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:04.156731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f81811-c594-4223-9e03-f5cb46e67baa None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:04.157371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f81811-c594-4223-9e03-f5cb46e67baa None admin] RBAC: Adding query filter params (type=compute) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:04.157674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f81811-c594-4223-9e03-f5cb46e67baa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:04.159714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f81811-c594-4223-9e03-f5cb46e67baa None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:04.170140 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 359/719] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 27 03:02:03 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:02:04.234801 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 361/720] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 03:02:04.508786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f81811-c594-4223-9e03-f5cb46e67baa None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:04.603684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:04.613076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f81811-c594-4223-9e03-f5cb46e67baa None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:04.649144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ae746-33f4-487b-a88a-e3de8973d835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:04.649784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ae746-33f4-487b-a88a-e3de8973d835 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:04.650080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ae746-33f4-487b-a88a-e3de8973d835 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:04.650360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ae746-33f4-487b-a88a-e3de8973d835 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:04.650941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ae746-33f4-487b-a88a-e3de8973d835 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:04.652298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ae746-33f4-487b-a88a-e3de8973d835 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:04.661171 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-010ae746-33f4-487b-a88a-e3de8973d835 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 03:02:04.661171 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:04.661171 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:02:04.661171 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:02:04.661171 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:02:04.661171 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:02:04.661171 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:02:04.661171 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:02:04.661171 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 03:02:04.661171 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:04.661171 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:02:04.661171 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:04.661171 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:04.661171 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:04.661171 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:04.661171 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:04.661171 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:04.662194 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:04.662194 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:04.662194 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:04.662194 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:04.662194 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:04.662194 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:04.662194 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:02:04.662194 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:02:04.662194 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:02:04.662194 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:02:04.662194 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:04.662194 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:04.662194 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:04.662194 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:04.662194 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:04.662194 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:04.663075 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:04.663075 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:04.663075 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:04.663075 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:04.663075 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:04.663075 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:04.663075 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:04.663075 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:04.663075 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:04.663075 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:04.663075 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:02:04.663075 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:02:04.663075 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 03:02:04.663075 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:04.663075 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 360/721] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 27 03:02:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:04.668610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07778670-cb74-47f8-ad0e-c150949b2278 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:04.697853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:04.771158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07778670-cb74-47f8-ad0e-c150949b2278 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:04.806761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851f8f0-b98c-4491-a67b-2799b160855c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:04.807381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851f8f0-b98c-4491-a67b-2799b160855c None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:04.807658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851f8f0-b98c-4491-a67b-2799b160855c None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:04.807931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851f8f0-b98c-4491-a67b-2799b160855c None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:04.808625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851f8f0-b98c-4491-a67b-2799b160855c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:04.808930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851f8f0-b98c-4491-a67b-2799b160855c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:04.810387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851f8f0-b98c-4491-a67b-2799b160855c None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:04.815590 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 362/722] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 27 03:02:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:04.822085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ae746-33f4-487b-a88a-e3de8973d835 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:04.931095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ae746-33f4-487b-a88a-e3de8973d835 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:04.966670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd8302-aab9-485a-990e-8947ab49ed90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:04.967662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd8302-aab9-485a-990e-8947ab49ed90 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:04.968138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd8302-aab9-485a-990e-8947ab49ed90 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:04.968606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd8302-aab9-485a-990e-8947ab49ed90 None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:04.969429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd8302-aab9-485a-990e-8947ab49ed90 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:04.969947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd8302-aab9-485a-990e-8947ab49ed90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:04.971523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd8302-aab9-485a-990e-8947ab49ed90 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:04.977306 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 361/723] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 27 03:02:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:04.983425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851f8f0-b98c-4491-a67b-2799b160855c None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:05.091992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851f8f0-b98c-4491-a67b-2799b160855c None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:05.094326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:05.128965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da17f4-821d-4c68-8a36-5e838497d141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:05.129571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da17f4-821d-4c68-8a36-5e838497d141 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:05.129857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da17f4-821d-4c68-8a36-5e838497d141 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:05.130159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da17f4-821d-4c68-8a36-5e838497d141 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:05.130837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da17f4-821d-4c68-8a36-5e838497d141 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:05.132550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da17f4-821d-4c68-8a36-5e838497d141 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:05.209896 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 363/724] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:02:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:02:05.430727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a26bc4-ef56-49ea-9985-784c85135fb9 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:05.431207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a26bc4-ef56-49ea-9985-784c85135fb9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:05.431595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a26bc4-ef56-49ea-9985-784c85135fb9 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:05.433278 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 362/725] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:05.438746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b796cf-44eb-44e7-9f2f-d8c602348618 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:05.439142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b796cf-44eb-44e7-9f2f-d8c602348618 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:05.439517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b796cf-44eb-44e7-9f2f-d8c602348618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:05.458785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-57b796cf-44eb-44e7-9f2f-d8c602348618 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:05.460572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-57b796cf-44eb-44e7-9f2f-d8c602348618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:05.649924 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 364/726] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:05.915314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a26bc4-ef56-49ea-9985-784c85135fb9 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:05.938173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:06.026762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a26bc4-ef56-49ea-9985-784c85135fb9 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:06.061688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48ddca-2851-4e73-bd4a-8469e8b18913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:06.062365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48ddca-2851-4e73-bd4a-8469e8b18913 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:06.062647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48ddca-2851-4e73-bd4a-8469e8b18913 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:06.062921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48ddca-2851-4e73-bd4a-8469e8b18913 None admin] PATH_INFO: `/v3/services/image` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:06.063506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48ddca-2851-4e73-bd4a-8469e8b18913 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:06.064869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48ddca-2851-4e73-bd4a-8469e8b18913 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:06.074138 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-0e48ddca-2851-4e73-bd4a-8469e8b18913 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 03:02:06.074138 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:06.074138 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:02:06.074138 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:02:06.074138 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:02:06.074138 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:02:06.074138 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:02:06.074138 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:02:06.074138 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 03:02:06.074138 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:06.074138 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:02:06.074138 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:06.074138 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:06.074138 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:06.074138 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:06.074138 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:06.074138 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:06.075120 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:06.075120 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:06.075120 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:06.075120 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:06.075120 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:06.075120 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:06.075120 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:02:06.075120 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:02:06.075120 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:02:06.075120 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:02:06.075120 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:06.075120 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:06.075120 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:06.075120 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:06.075120 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:06.075120 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:06.075950 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:06.075950 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:06.075950 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:06.075950 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:06.075950 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:06.075950 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:06.075950 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:06.075950 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:06.075950 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:06.075950 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:06.075950 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:02:06.075950 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:02:06.075950 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 03:02:06.075950 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:06.075950 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 363/727] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Oct 27 03:02:05 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:06.081317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b796cf-44eb-44e7-9f2f-d8c602348618 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:06.159582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:06.188663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b796cf-44eb-44e7-9f2f-d8c602348618 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:06.226836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482b93a-7fb2-4172-b71a-0823dd37a738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:06.227451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482b93a-7fb2-4172-b71a-0823dd37a738 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:06.227728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482b93a-7fb2-4172-b71a-0823dd37a738 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:06.227996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482b93a-7fb2-4172-b71a-0823dd37a738 None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:06.228715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482b93a-7fb2-4172-b71a-0823dd37a738 None admin] RBAC: Adding query filter params (name=image) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:06.229017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482b93a-7fb2-4172-b71a-0823dd37a738 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:06.230395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482b93a-7fb2-4172-b71a-0823dd37a738 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:06.235318 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 365/728] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:02:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:06.241571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48ddca-2851-4e73-bd4a-8469e8b18913 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:06.307358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344c589-f1a8-4825-ab41-a86606564d74 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:06.307690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344c589-f1a8-4825-ab41-a86606564d74 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:06.307910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344c589-f1a8-4825-ab41-a86606564d74 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:06.309489 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 366/729] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:06.314286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f219ad-1738-4bf6-85d3-9220461a71eb None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:06.314769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f219ad-1738-4bf6-85d3-9220461a71eb None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:06.315049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f219ad-1738-4bf6-85d3-9220461a71eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:06.336186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-19f219ad-1738-4bf6-85d3-9220461a71eb None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:06.337631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-19f219ad-1738-4bf6-85d3-9220461a71eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:06.341172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:06.362503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48ddca-2851-4e73-bd4a-8469e8b18913 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:06.413540 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 367/730] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:06.422136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79613787-c732-4073-9d83-9f33e6454891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:06.422307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802823b5-6c03-4ea1-8734-0571be1aabd6 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:06.422388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79613787-c732-4073-9d83-9f33e6454891 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:06.422457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802823b5-6c03-4ea1-8734-0571be1aabd6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:06.422542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79613787-c732-4073-9d83-9f33e6454891 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:06.422625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802823b5-6c03-4ea1-8734-0571be1aabd6 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:06.422694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79613787-c732-4073-9d83-9f33e6454891 None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:06.422694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79613787-c732-4073-9d83-9f33e6454891 None admin] RBAC: Adding query filter params (type=image) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:06.422694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79613787-c732-4073-9d83-9f33e6454891 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:06.422694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79613787-c732-4073-9d83-9f33e6454891 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:06.422930 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 368/731] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:06.423252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9887dc-f509-4f1b-aa5f-5fb542e47865 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:06.423357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9887dc-f509-4f1b-aa5f-5fb542e47865 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:06.426074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9887dc-f509-4f1b-aa5f-5fb542e47865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:06.426209 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 364/732] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:02:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:06.443521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4b9887dc-f509-4f1b-aa5f-5fb542e47865 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:06.445319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4b9887dc-f509-4f1b-aa5f-5fb542e47865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:06.518882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:06.524137 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 369/733] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:06.693619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79613787-c732-4073-9d83-9f33e6454891 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:06.795596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79613787-c732-4073-9d83-9f33e6454891 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:06.804363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9887dc-f509-4f1b-aa5f-5fb542e47865 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:06.838555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0bdca-6405-4b77-a3b0-f404f608c5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:06.839201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0bdca-6405-4b77-a3b0-f404f608c5f1 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:06.839485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0bdca-6405-4b77-a3b0-f404f608c5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:06.839759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0bdca-6405-4b77-a3b0-f404f608c5f1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:06.840366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0bdca-6405-4b77-a3b0-f404f608c5f1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:06.842060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0bdca-6405-4b77-a3b0-f404f608c5f1 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:06.851352 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-c7c0bdca-6405-4b77-a3b0-f404f608c5f1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 03:02:06.851352 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:06.851352 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:02:06.851352 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:02:06.851352 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:02:06.851352 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:02:06.851352 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:02:06.851352 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:02:06.851352 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 03:02:06.851352 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:06.851352 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:02:06.851352 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:06.851352 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:06.851352 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:06.851352 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:06.851352 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:06.851352 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:06.852378 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:06.852378 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:06.852378 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:06.852378 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:06.852378 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:06.852378 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:06.852378 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:02:06.852378 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:02:06.852378 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:02:06.852378 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:02:06.852378 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:06.852378 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:06.852378 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:06.852378 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:06.852378 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:06.852378 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:06.853220 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:06.853220 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:06.853220 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:06.853220 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:06.853220 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:06.853220 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:06.853220 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:06.853220 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:06.853220 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:06.853220 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:06.853220 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:02:06.853220 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:02:06.853220 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 03:02:06.853220 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:06.853220 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 365/734] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Oct 27 03:02:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:06.858222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0bdca-6405-4b77-a3b0-f404f608c5f1 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:06.873885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:06.915703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9887dc-f509-4f1b-aa5f-5fb542e47865 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:06.952076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfd6ca-2e28-46b2-b4e7-be4108cde777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:06.953049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfd6ca-2e28-46b2-b4e7-be4108cde777 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:06.953532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfd6ca-2e28-46b2-b4e7-be4108cde777 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:06.954009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfd6ca-2e28-46b2-b4e7-be4108cde777 None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:06.954900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dfd6ca-2e28-46b2-b4e7-be4108cde777 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:06.956474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dfd6ca-2e28-46b2-b4e7-be4108cde777 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:06.961047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0bdca-6405-4b77-a3b0-f404f608c5f1 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:06.996204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d1a32-35ae-4ef5-a428-25494a382144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:06.996817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d1a32-35ae-4ef5-a428-25494a382144 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:06.997101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d1a32-35ae-4ef5-a428-25494a382144 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:06.997376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d1a32-35ae-4ef5-a428-25494a382144 None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:06.998001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d1a32-35ae-4ef5-a428-25494a382144 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:06.998373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d1a32-35ae-4ef5-a428-25494a382144 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:06.999750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d1a32-35ae-4ef5-a428-25494a382144 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:07.004754 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 366/735] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Oct 27 03:02:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:07.010537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d1a32-35ae-4ef5-a428-25494a382144 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:07.028148 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 370/736] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 27 03:02:06 2022] POST /identity/v3/services => generated 242 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:02:07.116712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:07.160056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d1a32-35ae-4ef5-a428-25494a382144 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:07.219114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eedfae-3a67-490b-ac28-3924f154fb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:07.220088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eedfae-3a67-490b-ac28-3924f154fb39 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:07.220542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eedfae-3a67-490b-ac28-3924f154fb39 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:07.220984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eedfae-3a67-490b-ac28-3924f154fb39 None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:07.221793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eedfae-3a67-490b-ac28-3924f154fb39 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:07.222305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eedfae-3a67-490b-ac28-3924f154fb39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:07.223862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eedfae-3a67-490b-ac28-3924f154fb39 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:07.230598 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 367/737] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Oct 27 03:02:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:02:07.236870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfd6ca-2e28-46b2-b4e7-be4108cde777 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:07.299443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:07.345641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfd6ca-2e28-46b2-b4e7-be4108cde777 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:07.379948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd000b9d-3839-4f74-a966-90e3adfc3671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:07.380940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd000b9d-3839-4f74-a966-90e3adfc3671 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:07.381961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd000b9d-3839-4f74-a966-90e3adfc3671 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:07.382741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd000b9d-3839-4f74-a966-90e3adfc3671 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:07.383620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd000b9d-3839-4f74-a966-90e3adfc3671 None admin] RBAC: Adding query filter params (interface=admin, service_id=f8f6860646d94ba787213d26a28bac54, region_id=RegionOne) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:07.384099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd000b9d-3839-4f74-a966-90e3adfc3671 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:07.385697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd000b9d-3839-4f74-a966-90e3adfc3671 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:07.391555 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 371/738] 10.222.0.20 () {56 vars in 1249 bytes} [Thu Oct 27 03:02:07 2022] GET /identity/v3/endpoints?service_id=f8f6860646d94ba787213d26a28bac54&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:07.397980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eedfae-3a67-490b-ac28-3924f154fb39 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:07.505237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eedfae-3a67-490b-ac28-3924f154fb39 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:07.541316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471802c-4ab3-4df7-9381-5150cfb6baab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:07.542273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471802c-4ab3-4df7-9381-5150cfb6baab None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:07.542734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471802c-4ab3-4df7-9381-5150cfb6baab None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:07.543195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471802c-4ab3-4df7-9381-5150cfb6baab None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:07.543967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471802c-4ab3-4df7-9381-5150cfb6baab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:07.545557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471802c-4ab3-4df7-9381-5150cfb6baab None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:07.547682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:07.552971 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 368/739] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Oct 27 03:02:07 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:02:07.553271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a69d61-e9d4-47fb-afb9-fb768d17743e None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:07.553498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a69d61-e9d4-47fb-afb9-fb768d17743e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:07.553771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a69d61-e9d4-47fb-afb9-fb768d17743e None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:07.556574 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 372/740] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:02:07.561233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bcd5a-63ab-4541-95ee-7c12aab541ef None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:07.561519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bcd5a-63ab-4541-95ee-7c12aab541ef None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:07.561766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bcd5a-63ab-4541-95ee-7c12aab541ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:07.581891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c91bcd5a-63ab-4541-95ee-7c12aab541ef None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:07.583183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c91bcd5a-63ab-4541-95ee-7c12aab541ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:07.664263 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 369/741] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:07 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:07.929497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a69d61-e9d4-47fb-afb9-fb768d17743e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:08.039830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a69d61-e9d4-47fb-afb9-fb768d17743e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:08.070407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:08.074650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4bc21-f030-48d9-aacb-10a7c204b905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:08.075534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4bc21-f030-48d9-aacb-10a7c204b905 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:08.075813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4bc21-f030-48d9-aacb-10a7c204b905 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:08.076090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4bc21-f030-48d9-aacb-10a7c204b905 None admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:08.076740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4bc21-f030-48d9-aacb-10a7c204b905 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:08.078212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4bc21-f030-48d9-aacb-10a7c204b905 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:08.080808 n-d-862769-1 devstack@keystone.service[82180]: WARNING keystone.server.flask.common [None req-01b4bc21-f030-48d9-aacb-10a7c204b905 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 27 03:02:08.122912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.sql.core [None req-01b4bc21-f030-48d9-aacb-10a7c204b905 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 27 03:02:08.122912 n-d-862769-1 devstack@keystone.service[82180]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 03:02:08.122912 n-d-862769-1 devstack@keystone.service[82180]: [parameters: {'id': '1d04d96f6a3f4719b956884ae38b227d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 27 03:02:08.122912 n-d-862769-1 devstack@keystone.service[82180]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82180) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 03:02:08.130748 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-01b4bc21-f030-48d9-aacb-10a7c204b905 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1d04d96f6a3f4719b956884ae38b227d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1d04d96f6a3f4719b956884ae38b227d. Oct 27 03:02:08.130748 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:08.130748 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 03:02:08.130748 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 03:02:08.130748 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 03:02:08.130748 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 03:02:08.130748 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 03:02:08.130748 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 03:02:08.130748 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 03:02:08.130748 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application conn.query(q) Oct 27 03:02:08.130748 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 03:02:08.130748 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 03:02:08.130748 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 03:02:08.131643 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application result.read() Oct 27 03:02:08.131643 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 03:02:08.131643 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 03:02:08.131643 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 03:02:08.131643 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 03:02:08.131643 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 03:02:08.131643 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 03:02:08.131643 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 03:02:08.131643 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 03:02:08.131643 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 27 03:02:08.131643 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:08.131643 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 27 03:02:08.131643 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:08.131643 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:08.131643 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 27 03:02:08.131643 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 27 03:02:08.131643 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 27 03:02:08.131643 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 27 03:02:08.132878 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 03:02:08.132878 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application next(self.gen) Oct 27 03:02:08.132878 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 27 03:02:08.132878 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application yield resource Oct 27 03:02:08.132878 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 03:02:08.132878 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application next(self.gen) Oct 27 03:02:08.132878 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 27 03:02:08.132878 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.session.rollback() Oct 27 03:02:08.132878 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:02:08.132878 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.force_reraise() Oct 27 03:02:08.132878 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:02:08.132878 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise self.value Oct 27 03:02:08.132878 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 27 03:02:08.132878 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 27 03:02:08.132878 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 27 03:02:08.132878 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application session.commit() Oct 27 03:02:08.132878 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 27 03:02:08.133770 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 27 03:02:08.133770 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 27 03:02:08.133770 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._prepare_impl() Oct 27 03:02:08.133770 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 27 03:02:08.133770 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.session.flush() Oct 27 03:02:08.133770 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 03:02:08.133770 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._flush(objects) Oct 27 03:02:08.133770 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 03:02:08.133770 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 27 03:02:08.133770 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 03:02:08.133770 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application compat.raise_( Oct 27 03:02:08.133770 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 03:02:08.133770 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception Oct 27 03:02:08.133770 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 03:02:08.133770 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application flush_context.execute() Oct 27 03:02:08.133770 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 03:02:08.133770 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rec.execute(self) Oct 27 03:02:08.134713 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 03:02:08.134713 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 27 03:02:08.134713 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 03:02:08.134713 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 27 03:02:08.134713 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 27 03:02:08.134713 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 27 03:02:08.134713 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 03:02:08.134713 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 03:02:08.134713 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 03:02:08.134713 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 27 03:02:08.134713 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 03:02:08.134713 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 27 03:02:08.134713 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 03:02:08.134713 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 27 03:02:08.134713 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 03:02:08.135495 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 03:02:08.135495 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 03:02:08.135495 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception Oct 27 03:02:08.135495 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 03:02:08.135495 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 03:02:08.135495 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 03:02:08.135495 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 03:02:08.135495 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 03:02:08.135495 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 03:02:08.135495 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 03:02:08.135495 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application conn.query(q) Oct 27 03:02:08.135495 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 03:02:08.135495 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 03:02:08.135495 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 03:02:08.135495 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application result.read() Oct 27 03:02:08.135495 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 03:02:08.135495 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 03:02:08.136369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 03:02:08.136369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 03:02:08.136369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 03:02:08.136369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 03:02:08.136369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 03:02:08.136369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 03:02:08.136369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 27 03:02:08.136369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 03:02:08.136369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [parameters: {'id': '1d04d96f6a3f4719b956884ae38b227d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 27 03:02:08.136369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 03:02:08.136369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:08.136369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:02:08.136369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:08.136369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:08.136369 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 27 03:02:08.138636 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 27 03:02:08.138636 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 27 03:02:08.138636 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 27 03:02:08.138636 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 27 03:02:08.138636 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:08.138636 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:02:08.138636 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:08.138636 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:08.138636 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:08.138636 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:08.138636 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:08.138636 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:08.138636 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:08.138636 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:08.138636 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:08.138636 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:08.138636 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:08.140857 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:08.140857 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 27 03:02:08.140857 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 27 03:02:08.140857 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:08.140857 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:08.140857 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 27 03:02:08.140857 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 27 03:02:08.140857 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1d04d96f6a3f4719b956884ae38b227d. Oct 27 03:02:08.140857 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:08.140857 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 373/742] 10.222.0.20 () {60 vars in 1140 bytes} [Thu Oct 27 03:02:07 2022] POST /identity/v3/projects => generated 262 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:08.141776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bcd5a-63ab-4541-95ee-7c12aab541ef None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:08.258880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bcd5a-63ab-4541-95ee-7c12aab541ef None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:08.290846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:08.296889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e39f7f-e9c6-4551-970a-ea56f13c5aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:08.297541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e39f7f-e9c6-4551-970a-ea56f13c5aa8 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:08.297822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e39f7f-e9c6-4551-970a-ea56f13c5aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:08.298116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e39f7f-e9c6-4551-970a-ea56f13c5aa8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:08.305611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e39f7f-e9c6-4551-970a-ea56f13c5aa8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:08.307170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e39f7f-e9c6-4551-970a-ea56f13c5aa8 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:08.318893 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-d4e39f7f-e9c6-4551-970a-ea56f13c5aa8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:02:08.318893 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:08.318893 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:08.318893 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:08.318893 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:08.318893 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:08.318893 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:08.318893 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:08.318893 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:08.318893 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:08.318893 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:08.318893 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:08.318893 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:02:08.318893 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:02:08.318893 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:02:08.321279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:02:08.321279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:08.321279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:08.321279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:08.321279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:08.321279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:08.321279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:08.321279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:08.321279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:08.321279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:08.321279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:08.321279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:08.321279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:08.321279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:08.321279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:08.321279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:08.321279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:08.323481 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:02:08.323481 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:02:08.323481 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:02:08.323481 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:02:08.323481 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:02:08.323481 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:02:08.323481 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:02:08.323481 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:08.323481 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 370/743] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:02:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:08.329141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4bc21-f030-48d9-aacb-10a7c204b905 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:08.438413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4bc21-f030-48d9-aacb-10a7c204b905 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:08.474575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8de4e0-978c-4916-965b-3a1f1018cdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:08.475818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8de4e0-978c-4916-965b-3a1f1018cdd8 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:08.476099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8de4e0-978c-4916-965b-3a1f1018cdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:08.476370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8de4e0-978c-4916-965b-3a1f1018cdd8 None admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:08.477059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8de4e0-978c-4916-965b-3a1f1018cdd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:08.477367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8de4e0-978c-4916-965b-3a1f1018cdd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:08.479105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8de4e0-978c-4916-965b-3a1f1018cdd8 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:08.502828 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 374/744] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 27 03:02:08 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:08.610112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4ca75-02d1-4b46-88e4-64ee19136723 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:08.610469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4ca75-02d1-4b46-88e4-64ee19136723 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:08.610668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4ca75-02d1-4b46-88e4-64ee19136723 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:08.612289 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 371/745] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:08.618521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfef894-d33d-4e9e-9b3a-ed887272a307 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:08.618803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfef894-d33d-4e9e-9b3a-ed887272a307 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:08.619085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfef894-d33d-4e9e-9b3a-ed887272a307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:08.640167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8dfef894-d33d-4e9e-9b3a-ed887272a307 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:08.641741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8dfef894-d33d-4e9e-9b3a-ed887272a307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:08.676248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:08.716888 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 375/746] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 03:02:08.990603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4ca75-02d1-4b46-88e4-64ee19136723 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:09.096733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4ca75-02d1-4b46-88e4-64ee19136723 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:09.132031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d1e94-7f30-49a6-bffb-ea81455cc701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:09.132885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d1e94-7f30-49a6-bffb-ea81455cc701 None admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:09.133166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d1e94-7f30-49a6-bffb-ea81455cc701 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:09.133438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d1e94-7f30-49a6-bffb-ea81455cc701 None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:09.134119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d1e94-7f30-49a6-bffb-ea81455cc701 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:09.135495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d1e94-7f30-49a6-bffb-ea81455cc701 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:09.221552 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 372/747] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 27 03:02:08 2022] POST /identity/v3/services => generated 242 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:02:09.312570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47b7c4-aaca-4670-9333-138c6a75c1f5 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:09.312768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47b7c4-aaca-4670-9333-138c6a75c1f5 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:09.313044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47b7c4-aaca-4670-9333-138c6a75c1f5 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:09.314779 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 376/748] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:09.321248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493f846-88f3-4865-9ae5-64d84cbea4fc None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:09.321544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493f846-88f3-4865-9ae5-64d84cbea4fc None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:09.321864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493f846-88f3-4865-9ae5-64d84cbea4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:09.341932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-2493f846-88f3-4865-9ae5-64d84cbea4fc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:09.343187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2493f846-88f3-4865-9ae5-64d84cbea4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:09.397825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:09.425472 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 373/749] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:09 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:09.703187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47b7c4-aaca-4670-9333-138c6a75c1f5 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:09.810201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47b7c4-aaca-4670-9333-138c6a75c1f5 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:09.811550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dcf09-f28e-4a1f-b641-1b704b9705c9 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:09.811838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dcf09-f28e-4a1f-b641-1b704b9705c9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:09.812118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dcf09-f28e-4a1f-b641-1b704b9705c9 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:09.813464 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 374/750] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:02:09.818566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f55272-a7f5-4180-a6f2-592e647d6120 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:09.818891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f55272-a7f5-4180-a6f2-592e647d6120 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:09.819169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f55272-a7f5-4180-a6f2-592e647d6120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:09.837098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b0f55272-a7f5-4180-a6f2-592e647d6120 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:09.838323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b0f55272-a7f5-4180-a6f2-592e647d6120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:09.849602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c5f67-60f4-43cc-a742-37d7ef7ce6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:09.850913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c5f67-60f4-43cc-a742-37d7ef7ce6f2 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:09.851193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c5f67-60f4-43cc-a742-37d7ef7ce6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:09.851455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c5f67-60f4-43cc-a742-37d7ef7ce6f2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:09.852037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c5f67-60f4-43cc-a742-37d7ef7ce6f2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:09.853396 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c5f67-60f4-43cc-a742-37d7ef7ce6f2 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:09.862893 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-075c5f67-60f4-43cc-a742-37d7ef7ce6f2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 03:02:09.862893 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:09.862893 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:02:09.862893 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:02:09.862893 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:02:09.862893 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:02:09.862893 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:02:09.862893 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:02:09.862893 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 03:02:09.862893 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:09.862893 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:02:09.862893 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:09.862893 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:09.862893 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:09.862893 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:09.862893 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:09.862893 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:09.863970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:09.863970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:09.863970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:09.863970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:09.863970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:09.863970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:09.863970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:02:09.863970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:02:09.863970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:02:09.863970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:02:09.863970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:09.863970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:09.863970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:09.863970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:09.863970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:09.863970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:09.864832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:09.864832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:09.864832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:09.864832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:09.864832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:09.864832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:09.864832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:09.864832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:09.864832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:09.864832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:09.864832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:02:09.864832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:02:09.864832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 03:02:09.864832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:09.864832 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 377/751] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:02:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:09.872146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c5f67-60f4-43cc-a742-37d7ef7ce6f2 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:09.908382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:09.931207 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 375/752] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:09 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 03:02:09.988796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c5f67-60f4-43cc-a742-37d7ef7ce6f2 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:10.024705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcf94c-b447-48bb-bd64-2701f40a01aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:10.025634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcf94c-b447-48bb-bd64-2701f40a01aa None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:10.026114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcf94c-b447-48bb-bd64-2701f40a01aa None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:10.026587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcf94c-b447-48bb-bd64-2701f40a01aa None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:10.027383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcf94c-b447-48bb-bd64-2701f40a01aa None admin] RBAC: Adding query filter params (name=compute) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:10.027869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcf94c-b447-48bb-bd64-2701f40a01aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:10.029394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcf94c-b447-48bb-bd64-2701f40a01aa None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:10.034951 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 378/753] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 27 03:02:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:10.042200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f55272-a7f5-4180-a6f2-592e647d6120 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:10.143909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f55272-a7f5-4180-a6f2-592e647d6120 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:10.151803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:10.179174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44301791-6279-4207-86d5-30cdb52884f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:10.179797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44301791-6279-4207-86d5-30cdb52884f5 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:10.180081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44301791-6279-4207-86d5-30cdb52884f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:10.180359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44301791-6279-4207-86d5-30cdb52884f5 None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:10.181012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44301791-6279-4207-86d5-30cdb52884f5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:10.181322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44301791-6279-4207-86d5-30cdb52884f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:10.182747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44301791-6279-4207-86d5-30cdb52884f5 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:10.188411 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 376/754] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 27 03:02:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:10.194882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcf94c-b447-48bb-bd64-2701f40a01aa None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:10.217323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44301791-6279-4207-86d5-30cdb52884f5 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:10.303762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:10.311164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcf94c-b447-48bb-bd64-2701f40a01aa None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:10.328025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44301791-6279-4207-86d5-30cdb52884f5 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:10.352328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f7837-21bc-4e9a-b129-dd09cbb5c9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:10.353585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f7837-21bc-4e9a-b129-dd09cbb5c9df None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:10.354395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f7837-21bc-4e9a-b129-dd09cbb5c9df None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:10.354814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f7837-21bc-4e9a-b129-dd09cbb5c9df None admin] PATH_INFO: `/v3/endpoints` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:10.355660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f7837-21bc-4e9a-b129-dd09cbb5c9df None admin] RBAC: Adding query filter params (interface=public, service_id=04ea24d5186442249813dfd61898b429, region_id=RegionOne) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:10.356108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f7837-21bc-4e9a-b129-dd09cbb5c9df None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:10.357603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f7837-21bc-4e9a-b129-dd09cbb5c9df None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:10.364027 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 379/755] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Oct 27 03:02:10 2022] GET /identity/v3/endpoints?service_id=04ea24d5186442249813dfd61898b429&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:10.370077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f7837-21bc-4e9a-b129-dd09cbb5c9df None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:10.379376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa929dd-7f24-41d0-a956-4f0997484e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:10.380019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa929dd-7f24-41d0-a956-4f0997484e35 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:10.380300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa929dd-7f24-41d0-a956-4f0997484e35 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:10.380572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa929dd-7f24-41d0-a956-4f0997484e35 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:10.381711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa929dd-7f24-41d0-a956-4f0997484e35 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:10.383377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa929dd-7f24-41d0-a956-4f0997484e35 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:10.395301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-ffa929dd-7f24-41d0-a956-4f0997484e35 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 03:02:10.395301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:10.395301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:02:10.395301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:02:10.395301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:02:10.395301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:02:10.395301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:02:10.395301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:02:10.395301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 03:02:10.395301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:10.395301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:02:10.395301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:10.395301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:10.395301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:10.395301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:10.395301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:10.395301 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:10.396322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:10.396322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:10.396322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:10.396322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:10.396322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:10.396322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:10.396322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:02:10.396322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:02:10.396322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:02:10.396322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:02:10.396322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:10.396322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:10.396322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:10.396322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:10.396322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:10.396322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:10.397719 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:10.397719 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:10.397719 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:10.397719 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:10.397719 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:10.397719 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:10.397719 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:10.397719 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:10.397719 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:10.397719 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:10.397719 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:02:10.397719 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:02:10.397719 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 03:02:10.397719 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:10.397719 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 377/756] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Oct 27 03:02:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:02:10.407219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa929dd-7f24-41d0-a956-4f0997484e35 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:10.453241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:10.501842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f7837-21bc-4e9a-b129-dd09cbb5c9df None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:10.521698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa929dd-7f24-41d0-a956-4f0997484e35 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:10.543128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efebbb-54c3-4436-96f4-ee273aa74602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:10.544089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efebbb-54c3-4436-96f4-ee273aa74602 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:10.544573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efebbb-54c3-4436-96f4-ee273aa74602 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:10.545292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efebbb-54c3-4436-96f4-ee273aa74602 None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:10.546546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efebbb-54c3-4436-96f4-ee273aa74602 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:10.548460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efebbb-54c3-4436-96f4-ee273aa74602 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:10.556871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55625e-4d1f-492b-abf8-1c89316beee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:10.563641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55625e-4d1f-492b-abf8-1c89316beee8 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:10.563641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55625e-4d1f-492b-abf8-1c89316beee8 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:10.563641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55625e-4d1f-492b-abf8-1c89316beee8 None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:10.563641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55625e-4d1f-492b-abf8-1c89316beee8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:10.563641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55625e-4d1f-492b-abf8-1c89316beee8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:10.563641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55625e-4d1f-492b-abf8-1c89316beee8 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:10.564699 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 380/757] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Oct 27 03:02:10 2022] GET /identity/v3/services => generated 1957 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:02:10.566015 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 378/758] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Oct 27 03:02:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:10.572676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efebbb-54c3-4436-96f4-ee273aa74602 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:10.607266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:10.684968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efebbb-54c3-4436-96f4-ee273aa74602 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:10.726698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acd412-efbd-47fb-bc82-ab5467a0577f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:10.728146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acd412-efbd-47fb-bc82-ab5467a0577f None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:10.728623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acd412-efbd-47fb-bc82-ab5467a0577f None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:10.729099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acd412-efbd-47fb-bc82-ab5467a0577f None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:10.729955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08acd412-efbd-47fb-bc82-ab5467a0577f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:10.730478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08acd412-efbd-47fb-bc82-ab5467a0577f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:10.732051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08acd412-efbd-47fb-bc82-ab5467a0577f None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:10.738467 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 381/759] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Oct 27 03:02:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:10.744555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55625e-4d1f-492b-abf8-1c89316beee8 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:10.809386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f2c94-b84e-40ea-a34a-b3f419c28318 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:10.809667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f2c94-b84e-40ea-a34a-b3f419c28318 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:10.809850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f2c94-b84e-40ea-a34a-b3f419c28318 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:10.811527 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 382/760] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:02:10.817269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e630bc-08b7-4191-a907-df540d1bdeaf None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:10.817630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e630bc-08b7-4191-a907-df540d1bdeaf None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:10.817989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e630bc-08b7-4191-a907-df540d1bdeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:10.841046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-14e630bc-08b7-4191-a907-df540d1bdeaf None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:10.843271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-14e630bc-08b7-4191-a907-df540d1bdeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:10.855601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:10.860309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55625e-4d1f-492b-abf8-1c89316beee8 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:10.909054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46022595-7802-4911-b568-321c195b69e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:10.909930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46022595-7802-4911-b568-321c195b69e1 None admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:10.910254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46022595-7802-4911-b568-321c195b69e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:10.910528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46022595-7802-4911-b568-321c195b69e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:10.911193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46022595-7802-4911-b568-321c195b69e1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:10.913333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46022595-7802-4911-b568-321c195b69e1 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:10.933566 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 383/761] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:10 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 03:02:10.994271 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 379/762] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:02:10 2022] POST /identity/v3/endpoints => generated 325 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:02:11.226843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e630bc-08b7-4191-a907-df540d1bdeaf None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:11.246897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:11.330474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e630bc-08b7-4191-a907-df540d1bdeaf None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:11.372050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a9de9-a079-44d8-8616-9f4cada3baa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:11.373069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a9de9-a079-44d8-8616-9f4cada3baa1 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:11.373549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a9de9-a079-44d8-8616-9f4cada3baa1 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:11.374017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a9de9-a079-44d8-8616-9f4cada3baa1 None admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:11.374939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a9de9-a079-44d8-8616-9f4cada3baa1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:11.376569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a9de9-a079-44d8-8616-9f4cada3baa1 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:11.429600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.sql.core [None req-c74a9de9-a079-44d8-8616-9f4cada3baa1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 27 03:02:11.429600 n-d-862769-1 devstack@keystone.service[82180]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 27 03:02:11.429600 n-d-862769-1 devstack@keystone.service[82180]: [parameters: {'user_id': 'a0c475eb1d24461b977e1384ca42f386', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 27 03:02:11.429600 n-d-862769-1 devstack@keystone.service[82180]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82180) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 03:02:11.437661 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-c74a9de9-a079-44d8-8616-9f4cada3baa1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 27 03:02:11.437661 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:11.437661 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 03:02:11.437661 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 03:02:11.437661 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 03:02:11.437661 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 03:02:11.437661 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 03:02:11.437661 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 03:02:11.437661 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 03:02:11.437661 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application conn.query(q) Oct 27 03:02:11.437661 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 03:02:11.437661 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 03:02:11.437661 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 03:02:11.437661 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application result.read() Oct 27 03:02:11.437661 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 03:02:11.438660 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 03:02:11.438660 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 03:02:11.438660 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 03:02:11.438660 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 03:02:11.438660 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 03:02:11.438660 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 03:02:11.438660 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 03:02:11.438660 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 27 03:02:11.438660 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:11.438660 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 27 03:02:11.438660 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:11.438660 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:11.438660 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 27 03:02:11.438660 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 27 03:02:11.438660 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 27 03:02:11.438660 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 27 03:02:11.438660 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 03:02:11.438660 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application next(self.gen) Oct 27 03:02:11.439717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 27 03:02:11.439717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application yield resource Oct 27 03:02:11.439717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 03:02:11.439717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application next(self.gen) Oct 27 03:02:11.439717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 27 03:02:11.439717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.session.rollback() Oct 27 03:02:11.439717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:02:11.439717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.force_reraise() Oct 27 03:02:11.439717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:02:11.439717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise self.value Oct 27 03:02:11.439717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 27 03:02:11.439717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 27 03:02:11.439717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 27 03:02:11.439717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application session.commit() Oct 27 03:02:11.439717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 27 03:02:11.439717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 27 03:02:11.439717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 27 03:02:11.440586 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._prepare_impl() Oct 27 03:02:11.440586 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 27 03:02:11.440586 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.session.flush() Oct 27 03:02:11.440586 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 03:02:11.440586 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._flush(objects) Oct 27 03:02:11.440586 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 03:02:11.440586 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 27 03:02:11.440586 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 03:02:11.440586 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application compat.raise_( Oct 27 03:02:11.440586 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 03:02:11.440586 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception Oct 27 03:02:11.440586 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 03:02:11.440586 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application flush_context.execute() Oct 27 03:02:11.440586 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 03:02:11.440586 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rec.execute(self) Oct 27 03:02:11.440586 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 03:02:11.440586 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 27 03:02:11.442589 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 03:02:11.442589 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 27 03:02:11.442589 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 27 03:02:11.442589 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 27 03:02:11.442589 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 03:02:11.442589 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 03:02:11.442589 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 03:02:11.442589 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 27 03:02:11.442589 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 03:02:11.442589 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 27 03:02:11.442589 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 03:02:11.442589 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 27 03:02:11.442589 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 03:02:11.442589 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 03:02:11.442589 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 03:02:11.442589 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception Oct 27 03:02:11.444665 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 03:02:11.444665 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 03:02:11.444665 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 03:02:11.444665 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 03:02:11.444665 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 03:02:11.444665 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 03:02:11.444665 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 03:02:11.444665 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application conn.query(q) Oct 27 03:02:11.444665 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 03:02:11.444665 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 03:02:11.444665 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 03:02:11.444665 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application result.read() Oct 27 03:02:11.444665 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 03:02:11.444665 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 03:02:11.444665 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 03:02:11.444665 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 03:02:11.446743 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 03:02:11.446743 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 03:02:11.446743 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 03:02:11.446743 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 03:02:11.446743 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 27 03:02:11.446743 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 27 03:02:11.446743 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a0c475eb1d24461b977e1384ca42f386', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 27 03:02:11.446743 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 03:02:11.446743 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:11.446743 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:02:11.446743 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:11.446743 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:11.446743 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:11.446743 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:11.446743 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:11.448638 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:11.448638 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:11.448638 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:11.448638 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:11.448638 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:11.448638 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:11.448638 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:11.448638 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 27 03:02:11.448638 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 27 03:02:11.448638 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:11.448638 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:11.448638 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:02:11.448638 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:02:11.448638 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:02:11.448638 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:02:11.448638 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 27 03:02:11.448638 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 27 03:02:11.451313 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 27 03:02:11.451313 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 27 03:02:11.451313 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 27 03:02:11.451313 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 27 03:02:11.451313 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 27 03:02:11.451313 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:11.452479 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 384/763] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Oct 27 03:02:11 2022] POST /identity/v3/users => generated 160 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:11.459700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46022595-7802-4911-b568-321c195b69e1 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:11.570082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbf072-b32c-4677-b7f2-b23d782b47c4 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:11.570082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbf072-b32c-4677-b7f2-b23d782b47c4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:11.570082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbf072-b32c-4677-b7f2-b23d782b47c4 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:11.572408 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 385/764] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:11.576372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46022595-7802-4911-b568-321c195b69e1 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:11.577740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64b35a-7824-41ad-9495-0d96cee46150 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:11.578022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64b35a-7824-41ad-9495-0d96cee46150 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:11.578312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64b35a-7824-41ad-9495-0d96cee46150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:11.597557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-5e64b35a-7824-41ad-9495-0d96cee46150 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:11.599728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5e64b35a-7824-41ad-9495-0d96cee46150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:11.617021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ac69b-ce05-478f-a801-8dc50c57a3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:11.617650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ac69b-ce05-478f-a801-8dc50c57a3e2 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:11.617929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ac69b-ce05-478f-a801-8dc50c57a3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:11.618251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ac69b-ce05-478f-a801-8dc50c57a3e2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:11.625875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ac69b-ce05-478f-a801-8dc50c57a3e2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:11.627353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ac69b-ce05-478f-a801-8dc50c57a3e2 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:11.639045 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-970ac69b-ce05-478f-a801-8dc50c57a3e2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 03:02:11.639045 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:11.639045 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:11.639045 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:11.639045 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:11.639045 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:11.639045 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:11.639045 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:11.639045 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:11.639045 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:11.639045 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:11.639045 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:11.639045 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:02:11.639045 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:02:11.639045 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:02:11.639045 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:02:11.640001 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:11.640001 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:11.640001 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:02:11.640001 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:02:11.640001 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:02:11.640001 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:02:11.640001 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:11.640001 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:11.640001 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:11.640001 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:11.640001 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:11.640001 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:11.640001 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:11.640001 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:11.640001 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:11.640001 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:11.640001 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:11.640001 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:11.641521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:11.641521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:11.641521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:02:11.641521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:02:11.641521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:02:11.641521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:02:11.641521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:02:11.641521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:02:11.641521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 03:02:11.641521 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:11.641521 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 380/765] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:02:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:11.645724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ac69b-ce05-478f-a801-8dc50c57a3e2 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:11.666843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:11.686057 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 386/766] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:11 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:11.754473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ac69b-ce05-478f-a801-8dc50c57a3e2 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:11.790474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a08ef2-b249-4572-b970-ed85780bcd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:11.791088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a08ef2-b249-4572-b970-ed85780bcd53 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:11.791372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a08ef2-b249-4572-b970-ed85780bcd53 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:11.791641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a08ef2-b249-4572-b970-ed85780bcd53 None admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:11.792338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a08ef2-b249-4572-b970-ed85780bcd53 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:11.792697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a08ef2-b249-4572-b970-ed85780bcd53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:11.794215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a08ef2-b249-4572-b970-ed85780bcd53 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:11.829503 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 381/767] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 27 03:02:11 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:02:11.961596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64b35a-7824-41ad-9495-0d96cee46150 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:11.970688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:12.069975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64b35a-7824-41ad-9495-0d96cee46150 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:12.106339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d9c46-9364-41f6-b34f-4c0f7c26dfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:12.106971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d9c46-9364-41f6-b34f-4c0f7c26dfe5 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:12.107252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d9c46-9364-41f6-b34f-4c0f7c26dfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:12.107523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d9c46-9364-41f6-b34f-4c0f7c26dfe5 None admin] PATH_INFO: `/v3/services/image` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:12.108108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d9c46-9364-41f6-b34f-4c0f7c26dfe5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:12.109583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d9c46-9364-41f6-b34f-4c0f7c26dfe5 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:12.119482 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-137d9c46-9364-41f6-b34f-4c0f7c26dfe5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 03:02:12.119482 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:12.119482 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:02:12.119482 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:02:12.119482 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:02:12.119482 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:02:12.119482 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:02:12.119482 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:02:12.119482 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 03:02:12.119482 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:12.119482 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:02:12.119482 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:12.119482 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:12.119482 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:12.119482 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:12.119482 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:12.119482 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:12.120505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:12.120505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:12.120505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:12.120505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:12.120505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:12.120505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:12.120505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:02:12.120505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:02:12.120505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:02:12.120505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:02:12.120505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:12.120505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:12.120505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:12.120505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:12.120505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:12.120505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:12.121540 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:12.121540 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:12.121540 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:12.121540 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:12.121540 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:12.121540 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:12.121540 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:12.121540 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:12.121540 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:12.121540 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:12.121540 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:02:12.121540 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:02:12.121540 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 03:02:12.121540 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:12.121540 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 387/768] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Oct 27 03:02:11 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:12.128091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a08ef2-b249-4572-b970-ed85780bcd53 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:12.217154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:12.239580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a08ef2-b249-4572-b970-ed85780bcd53 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:12.276238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a2c86-977c-4f41-9e00-ff0c8910af46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:12.276862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a2c86-977c-4f41-9e00-ff0c8910af46 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:12.277145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a2c86-977c-4f41-9e00-ff0c8910af46 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:12.277416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a2c86-977c-4f41-9e00-ff0c8910af46 None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:12.278062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a2c86-977c-4f41-9e00-ff0c8910af46 None admin] RBAC: Adding query filter params (name=image) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:12.278377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a2c86-977c-4f41-9e00-ff0c8910af46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:12.279779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a2c86-977c-4f41-9e00-ff0c8910af46 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:12.284943 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 382/769] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:02:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:12.290287 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d9c46-9364-41f6-b34f-4c0f7c26dfe5 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:12.361304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:12.391976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d9c46-9364-41f6-b34f-4c0f7c26dfe5 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:12.424913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c4504-17bc-4881-bb15-9e541b80552f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:12.425634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c4504-17bc-4881-bb15-9e541b80552f None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:12.425984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c4504-17bc-4881-bb15-9e541b80552f None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:12.426345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c4504-17bc-4881-bb15-9e541b80552f None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:12.427042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c4504-17bc-4881-bb15-9e541b80552f None admin] RBAC: Adding query filter params (type=image) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:12.427413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c4504-17bc-4881-bb15-9e541b80552f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:12.429359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c4504-17bc-4881-bb15-9e541b80552f None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:12.434438 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 388/770] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:02:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:12.440017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a2c86-977c-4f41-9e00-ff0c8910af46 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:12.538273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a2c86-977c-4f41-9e00-ff0c8910af46 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:12.571148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17944003-1af5-44dc-a78e-888929d58a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:12.571754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17944003-1af5-44dc-a78e-888929d58a89 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:12.572032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17944003-1af5-44dc-a78e-888929d58a89 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:12.572302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17944003-1af5-44dc-a78e-888929d58a89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:12.572997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17944003-1af5-44dc-a78e-888929d58a89 None admin] RBAC: Adding query filter params (interface=public, service_id=8ad9545c22a5407185b03fa22b18e803, region_id=RegionOne) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:12.573303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17944003-1af5-44dc-a78e-888929d58a89 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:12.574702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17944003-1af5-44dc-a78e-888929d58a89 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:12.584402 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 383/771] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Oct 27 03:02:12 2022] GET /identity/v3/endpoints?service_id=8ad9545c22a5407185b03fa22b18e803&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:12.585980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c4504-17bc-4881-bb15-9e541b80552f None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:12.683878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c4504-17bc-4881-bb15-9e541b80552f None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:12.715832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4287ec-510a-4e74-b0ba-ca5168da5ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:12.716519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4287ec-510a-4e74-b0ba-ca5168da5ae1 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:12.716864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4287ec-510a-4e74-b0ba-ca5168da5ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:12.717197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4287ec-510a-4e74-b0ba-ca5168da5ae1 None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:12.717866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4287ec-510a-4e74-b0ba-ca5168da5ae1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:12.719322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4287ec-510a-4e74-b0ba-ca5168da5ae1 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:12.720488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:12.727974 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 389/772] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Oct 27 03:02:12 2022] GET /identity/v3/services => generated 1957 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:02:12.857923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a6c71-2591-45b8-890c-20159a6f24ba None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:12.858283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a6c71-2591-45b8-890c-20159a6f24ba None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:12.858516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a6c71-2591-45b8-890c-20159a6f24ba None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:12.860049 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 384/773] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:12.866221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c0ae1-a0e2-47bd-af70-ad0e5caedb66 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:12.866547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c0ae1-a0e2-47bd-af70-ad0e5caedb66 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:12.866778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c0ae1-a0e2-47bd-af70-ad0e5caedb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:12.890056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-909c0ae1-a0e2-47bd-af70-ad0e5caedb66 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:12.891369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-909c0ae1-a0e2-47bd-af70-ad0e5caedb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:12.962244 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 390/774] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:12 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:13.235291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a6c71-2591-45b8-890c-20159a6f24ba None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:13.239075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:13.260961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c015ef6-5f89-4a27-bb43-379bd7505e1f None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:13.261267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c015ef6-5f89-4a27-bb43-379bd7505e1f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:13.261512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c015ef6-5f89-4a27-bb43-379bd7505e1f None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:13.262904 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 391/775] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:02:13.268401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4da8e0-2863-45f7-acb8-3eed26a8d24d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:13.268736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4da8e0-2863-45f7-acb8-3eed26a8d24d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:13.268931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4da8e0-2863-45f7-acb8-3eed26a8d24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:13.287736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9f4da8e0-2863-45f7-acb8-3eed26a8d24d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:13.289195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9f4da8e0-2863-45f7-acb8-3eed26a8d24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:13.341608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a6c71-2591-45b8-890c-20159a6f24ba None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:13.360466 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 392/776] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:13 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:13.377981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c94b77-27fa-4840-8aec-0c2b82be8a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:13.378649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c94b77-27fa-4840-8aec-0c2b82be8a59 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:13.378930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c94b77-27fa-4840-8aec-0c2b82be8a59 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:13.379199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c94b77-27fa-4840-8aec-0c2b82be8a59 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:13.379776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c94b77-27fa-4840-8aec-0c2b82be8a59 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:13.381173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c94b77-27fa-4840-8aec-0c2b82be8a59 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:13.390279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-36c94b77-27fa-4840-8aec-0c2b82be8a59 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 03:02:13.390279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:13.390279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:02:13.390279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:02:13.390279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:02:13.390279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:02:13.390279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:02:13.390279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:02:13.390279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 03:02:13.390279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:13.390279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:02:13.390279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:13.390279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:13.390279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:13.390279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:13.390279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:13.390279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:13.391263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:13.391263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:13.391263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:13.391263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:13.391263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:13.391263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:13.391263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:02:13.391263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:02:13.391263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:02:13.391263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:02:13.391263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:13.391263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:13.391263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:13.391263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:13.391263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:13.391263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:13.392095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:13.392095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:13.392095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:13.392095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:13.392095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:13.392095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:13.392095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:13.392095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:13.392095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:13.392095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:13.392095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:02:13.392095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:02:13.392095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 03:02:13.392095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:13.393441 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 385/777] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:02:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:13.397348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4da8e0-2863-45f7-acb8-3eed26a8d24d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:13.456234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:13.497973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4da8e0-2863-45f7-acb8-3eed26a8d24d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:13.530301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab17507-6344-4512-89d2-fc88ecfd6d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:13.530905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab17507-6344-4512-89d2-fc88ecfd6d24 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:13.531187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab17507-6344-4512-89d2-fc88ecfd6d24 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:13.531461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab17507-6344-4512-89d2-fc88ecfd6d24 None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:13.532089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab17507-6344-4512-89d2-fc88ecfd6d24 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:13.532392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab17507-6344-4512-89d2-fc88ecfd6d24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:13.533870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab17507-6344-4512-89d2-fc88ecfd6d24 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:13.543748 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 393/778] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 27 03:02:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:13.544992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c94b77-27fa-4840-8aec-0c2b82be8a59 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:13.615000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:13.631100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab17507-6344-4512-89d2-fc88ecfd6d24 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:13.650638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c94b77-27fa-4840-8aec-0c2b82be8a59 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:13.685947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61ca25-03c1-44ea-9983-3bb4fefc761b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:13.686596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61ca25-03c1-44ea-9983-3bb4fefc761b None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:13.686912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61ca25-03c1-44ea-9983-3bb4fefc761b None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:13.687192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61ca25-03c1-44ea-9983-3bb4fefc761b None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:13.687818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61ca25-03c1-44ea-9983-3bb4fefc761b None admin] RBAC: Adding query filter params (type=compute) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:13.688181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61ca25-03c1-44ea-9983-3bb4fefc761b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:13.689553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61ca25-03c1-44ea-9983-3bb4fefc761b None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:13.694523 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 386/779] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 27 03:02:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:13.700060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61ca25-03c1-44ea-9983-3bb4fefc761b None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:13.737142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab17507-6344-4512-89d2-fc88ecfd6d24 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:13.760554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:13.772647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449b02f-3d70-49f5-89e8-d07f6030d970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:13.792332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449b02f-3d70-49f5-89e8-d07f6030d970 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:13.792332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449b02f-3d70-49f5-89e8-d07f6030d970 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:13.792332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449b02f-3d70-49f5-89e8-d07f6030d970 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:13.792332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449b02f-3d70-49f5-89e8-d07f6030d970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:13.792332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449b02f-3d70-49f5-89e8-d07f6030d970 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:13.792332 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 394/780] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:02:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:13.793035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449b02f-3d70-49f5-89e8-d07f6030d970 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:13.804775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61ca25-03c1-44ea-9983-3bb4fefc761b None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:13.833849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:13.840478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cc452-b13d-4338-9e35-84cebc82123b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:13.841219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cc452-b13d-4338-9e35-84cebc82123b None admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:13.841431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cc452-b13d-4338-9e35-84cebc82123b None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:13.841705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cc452-b13d-4338-9e35-84cebc82123b None admin] PATH_INFO: `/v3/endpoints` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:13.842408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787cc452-b13d-4338-9e35-84cebc82123b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:13.843810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787cc452-b13d-4338-9e35-84cebc82123b None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:13.884658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449b02f-3d70-49f5-89e8-d07f6030d970 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:13.918711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a09f01-50ca-457a-aafc-0e59bff6681b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:13.919348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a09f01-50ca-457a-aafc-0e59bff6681b None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:13.919632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a09f01-50ca-457a-aafc-0e59bff6681b None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:13.919907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a09f01-50ca-457a-aafc-0e59bff6681b None admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:13.920552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a09f01-50ca-457a-aafc-0e59bff6681b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:13.921972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a09f01-50ca-457a-aafc-0e59bff6681b None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:13.935927 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 387/781] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:02:13 2022] POST /identity/v3/endpoints => generated 334 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:02:14.034151 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 395/782] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 27 03:02:13 2022] POST /identity/v3/projects => generated 311 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:02:14.868369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8ffa7-6e48-4497-80dc-5b3ae1050a52 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:14.868886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8ffa7-6e48-4497-80dc-5b3ae1050a52 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:14.868886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8ffa7-6e48-4497-80dc-5b3ae1050a52 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:14.870318 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 388/783] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:14.875427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0960b-b353-4807-a482-9a0ff99762bc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:14.875714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0960b-b353-4807-a482-9a0ff99762bc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:14.875986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0960b-b353-4807-a482-9a0ff99762bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:14.893903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-48b0960b-b353-4807-a482-9a0ff99762bc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:14.895098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-48b0960b-b353-4807-a482-9a0ff99762bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:14.937426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:14.976998 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 396/784] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:15.241215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8ffa7-6e48-4497-80dc-5b3ae1050a52 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:15.343591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8ffa7-6e48-4497-80dc-5b3ae1050a52 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:15.376861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0b378-c18f-4a1e-a054-2b98cf8bebd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:15.377489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0b378-c18f-4a1e-a054-2b98cf8bebd2 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:15.377771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0b378-c18f-4a1e-a054-2b98cf8bebd2 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:15.378080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0b378-c18f-4a1e-a054-2b98cf8bebd2 None admin] PATH_INFO: `/v3/services/image` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:15.378646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0b378-c18f-4a1e-a054-2b98cf8bebd2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:15.380025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0b378-c18f-4a1e-a054-2b98cf8bebd2 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:15.389454 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-77f0b378-c18f-4a1e-a054-2b98cf8bebd2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 03:02:15.389454 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:15.389454 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:02:15.389454 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:02:15.389454 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:02:15.389454 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:02:15.389454 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:02:15.389454 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:02:15.389454 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 03:02:15.389454 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:15.389454 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:02:15.389454 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:15.389454 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:15.389454 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:15.389454 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:15.389454 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:15.389454 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:15.390786 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:15.390786 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:15.390786 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:15.390786 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:15.390786 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:15.390786 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:15.390786 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:02:15.390786 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:02:15.390786 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:02:15.390786 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:02:15.390786 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:15.390786 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:15.390786 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:15.390786 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:15.390786 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:15.390786 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:15.391721 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:15.391721 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:15.391721 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:15.391721 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:15.391721 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:15.391721 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:15.391721 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:15.391721 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:15.391721 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:15.391721 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:15.391721 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:02:15.391721 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:02:15.391721 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 03:02:15.391721 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:15.394357 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 389/785] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Oct 27 03:02:15 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:15.396418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0960b-b353-4807-a482-9a0ff99762bc None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:15.491950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0960b-b353-4807-a482-9a0ff99762bc None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:15.524968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8c33c-ef6a-42d2-aee5-e208f3c8b8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:15.525572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8c33c-ef6a-42d2-aee5-e208f3c8b8a3 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:15.525853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8c33c-ef6a-42d2-aee5-e208f3c8b8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:15.526155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8c33c-ef6a-42d2-aee5-e208f3c8b8a3 None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:15.526781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8c33c-ef6a-42d2-aee5-e208f3c8b8a3 None admin] RBAC: Adding query filter params (name=image) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:15.527083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8c33c-ef6a-42d2-aee5-e208f3c8b8a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:15.528442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8c33c-ef6a-42d2-aee5-e208f3c8b8a3 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:15.533377 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 397/786] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:02:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:15.539302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0b378-c18f-4a1e-a054-2b98cf8bebd2 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:15.592044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:15.638889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0b378-c18f-4a1e-a054-2b98cf8bebd2 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:15.673114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa981048-2a86-4536-944d-010f2ac95738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:15.673725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa981048-2a86-4536-944d-010f2ac95738 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:15.674003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa981048-2a86-4536-944d-010f2ac95738 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:15.674304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa981048-2a86-4536-944d-010f2ac95738 None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:15.674942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa981048-2a86-4536-944d-010f2ac95738 None admin] RBAC: Adding query filter params (type=image) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:15.675244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa981048-2a86-4536-944d-010f2ac95738 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:15.676622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa981048-2a86-4536-944d-010f2ac95738 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:15.686681 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 390/787] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:02:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:15.687724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8c33c-ef6a-42d2-aee5-e208f3c8b8a3 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:15.719542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:15.788985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8c33c-ef6a-42d2-aee5-e208f3c8b8a3 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:15.823169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbeefdc-79d4-4ca5-9b3c-2f53f00f9a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:15.823785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbeefdc-79d4-4ca5-9b3c-2f53f00f9a80 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:15.824068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbeefdc-79d4-4ca5-9b3c-2f53f00f9a80 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:15.824342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbeefdc-79d4-4ca5-9b3c-2f53f00f9a80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:15.825016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbeefdc-79d4-4ca5-9b3c-2f53f00f9a80 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:15.826412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbeefdc-79d4-4ca5-9b3c-2f53f00f9a80 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:15.921810 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 398/788] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:02:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:02:16.201544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08cd6e-f579-410b-92e9-e7df8eac9a9c None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:16.202185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08cd6e-f579-410b-92e9-e7df8eac9a9c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:16.202185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08cd6e-f579-410b-92e9-e7df8eac9a9c None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:16.203616 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 391/789] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:16.208736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25736eaa-6bd2-4d98-af71-d88a73205d86 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:16.209571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25736eaa-6bd2-4d98-af71-d88a73205d86 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:16.209853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25736eaa-6bd2-4d98-af71-d88a73205d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:16.229333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-25736eaa-6bd2-4d98-af71-d88a73205d86 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:16.230554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-25736eaa-6bd2-4d98-af71-d88a73205d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:16.257645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b81d13-4471-442d-be09-86356846517c None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:16.257965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b81d13-4471-442d-be09-86356846517c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:16.258237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b81d13-4471-442d-be09-86356846517c None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:16.259585 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 392/790] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:16.264634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7b38b-71f0-421b-a2d6-49056f08a40f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:16.264923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7b38b-71f0-421b-a2d6-49056f08a40f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:16.265203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7b38b-71f0-421b-a2d6-49056f08a40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:16.283454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4ec7b38b-71f0-421b-a2d6-49056f08a40f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:16.284653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4ec7b38b-71f0-421b-a2d6-49056f08a40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:16.309394 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 399/791] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:16.356137 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 393/792] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 03:02:16.581438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25736eaa-6bd2-4d98-af71-d88a73205d86 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:16.597315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:16.627755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7b38b-71f0-421b-a2d6-49056f08a40f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:16.683431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:16.687912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25736eaa-6bd2-4d98-af71-d88a73205d86 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:16.722160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897dd982-8f50-4cc9-8225-ecc1d2222a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:16.722803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897dd982-8f50-4cc9-8225-ecc1d2222a51 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:16.723079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897dd982-8f50-4cc9-8225-ecc1d2222a51 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:16.723350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897dd982-8f50-4cc9-8225-ecc1d2222a51 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:16.736352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897dd982-8f50-4cc9-8225-ecc1d2222a51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:02:16.741357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7b38b-71f0-421b-a2d6-49056f08a40f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:16.741616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-897dd982-8f50-4cc9-8225-ecc1d2222a51 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 03:02:16.741616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:16.741616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:16.741616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:16.741616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:16.741616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:16.741616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:16.741616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:16.741616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:16.741616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:16.741616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:16.741616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:16.741616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:02:16.741616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:02:16.741616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:02:16.741616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:02:16.742552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:02:16.742552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:02:16.742552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:02:16.742552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:02:16.742552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:16.742552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:16.742552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:16.742552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:16.742552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:16.742552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:16.742552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:16.742552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:16.742552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:16.742552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:16.742552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:16.742552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:16.743405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:16.743405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:16.743405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:16.743405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:16.743405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:02:16.743405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:02:16.743405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:02:16.743405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:02:16.743405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:02:16.743405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:02:16.743405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 03:02:16.743405 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:16.743405 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 400/793] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Oct 27 03:02:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:16.748553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897dd982-8f50-4cc9-8225-ecc1d2222a51 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:16.778734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c20978-00b8-44ff-8a43-7078e731d35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:16.779387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c20978-00b8-44ff-8a43-7078e731d35c None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:16.779662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c20978-00b8-44ff-8a43-7078e731d35c None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:16.779931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c20978-00b8-44ff-8a43-7078e731d35c None admin] PATH_INFO: `/v3/domains/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:16.781018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c20978-00b8-44ff-8a43-7078e731d35c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:16.782520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c20978-00b8-44ff-8a43-7078e731d35c None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:16.784366 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 394/794] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:02:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:02:16.789645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c20978-00b8-44ff-8a43-7078e731d35c None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:16.828463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:16.854418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897dd982-8f50-4cc9-8225-ecc1d2222a51 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:16.891417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b304c-e92d-4476-a07c-1d1b55f994b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:16.892025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b304c-e92d-4476-a07c-1d1b55f994b6 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:16.892310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b304c-e92d-4476-a07c-1d1b55f994b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:16.892582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b304c-e92d-4476-a07c-1d1b55f994b6 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:16.893250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b304c-e92d-4476-a07c-1d1b55f994b6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:16.893564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b304c-e92d-4476-a07c-1d1b55f994b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:16.894952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b304c-e92d-4476-a07c-1d1b55f994b6 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:16.895872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c20978-00b8-44ff-8a43-7078e731d35c None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:16.912297 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 401/795] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Oct 27 03:02:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:02:16.913452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b304c-e92d-4476-a07c-1d1b55f994b6 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:16.918509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:16.941018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074105d8-03e8-467d-af57-792e35c62f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:16.942006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074105d8-03e8-467d-af57-792e35c62f6f None admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:16.942518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074105d8-03e8-467d-af57-792e35c62f6f None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:16.942802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074105d8-03e8-467d-af57-792e35c62f6f None admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:16.944063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074105d8-03e8-467d-af57-792e35c62f6f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:16.945510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074105d8-03e8-467d-af57-792e35c62f6f None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:17.012503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b304c-e92d-4476-a07c-1d1b55f994b6 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:17.026421 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 395/796] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 27 03:02:16 2022] POST /identity/v3/users => generated 285 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:02:17.046728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0731f-e0ff-4be3-b6ae-5d53e7ff8a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:17.047470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0731f-e0ff-4be3-b6ae-5d53e7ff8a90 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:17.047751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0731f-e0ff-4be3-b6ae-5d53e7ff8a90 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:17.048025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0731f-e0ff-4be3-b6ae-5d53e7ff8a90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:17.051336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:17.061180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0731f-e0ff-4be3-b6ae-5d53e7ff8a90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:17.062787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0731f-e0ff-4be3-b6ae-5d53e7ff8a90 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:17.078437 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-2cc0731f-e0ff-4be3-b6ae-5d53e7ff8a90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:02:17.078437 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:17.078437 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:17.078437 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:17.078437 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:17.078437 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:17.078437 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:17.078437 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:17.078437 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:17.078437 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:17.078437 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:17.078437 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:17.078437 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:02:17.078437 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:02:17.078437 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:02:17.078437 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:02:17.079520 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:17.079520 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:17.079520 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:17.079520 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:17.079520 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:17.079520 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:17.079520 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:17.079520 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:17.079520 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:17.079520 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:17.079520 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:17.079520 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:17.079520 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:17.079520 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:17.079520 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:17.079520 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:17.079520 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:02:17.080438 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:02:17.080438 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:02:17.080438 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:17.080438 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 402/797] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:02:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:02:17.087411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074105d8-03e8-467d-af57-792e35c62f6f None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:17.207033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074105d8-03e8-467d-af57-792e35c62f6f None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:17.247195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11521d-0dc4-4ce8-a3a2-3560b8b6f14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:17.247812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11521d-0dc4-4ce8-a3a2-3560b8b6f14a None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:17.248093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11521d-0dc4-4ce8-a3a2-3560b8b6f14a None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:17.248368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11521d-0dc4-4ce8-a3a2-3560b8b6f14a None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:17.249016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11521d-0dc4-4ce8-a3a2-3560b8b6f14a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:17.249319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11521d-0dc4-4ce8-a3a2-3560b8b6f14a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:17.250913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11521d-0dc4-4ce8-a3a2-3560b8b6f14a None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:17.263219 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 396/798] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:17.269031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0731f-e0ff-4be3-b6ae-5d53e7ff8a90 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:17.368221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0731f-e0ff-4be3-b6ae-5d53e7ff8a90 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:17.401041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ada525-6a7d-474c-8d10-d1ed727fad0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:17.401670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ada525-6a7d-474c-8d10-d1ed727fad0b None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:17.401947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ada525-6a7d-474c-8d10-d1ed727fad0b None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:17.402246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ada525-6a7d-474c-8d10-d1ed727fad0b None admin] PATH_INFO: `/v3/users/nova` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:17.409481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ada525-6a7d-474c-8d10-d1ed727fad0b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:17.410992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ada525-6a7d-474c-8d10-d1ed727fad0b None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:17.422411 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-f1ada525-6a7d-474c-8d10-d1ed727fad0b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 03:02:17.422411 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:17.422411 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:17.422411 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:17.422411 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:17.422411 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:17.422411 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:17.422411 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:17.422411 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:17.422411 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:17.422411 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:17.422411 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:17.422411 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:02:17.422411 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:02:17.422411 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:02:17.422411 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:02:17.423345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:17.423345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:17.423345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:02:17.423345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:02:17.423345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:02:17.423345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:02:17.423345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:17.423345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:17.423345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:17.423345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:17.423345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:17.423345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:17.423345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:17.423345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:17.423345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:17.423345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:17.423345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:17.423345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:17.424341 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:17.424341 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:17.424341 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:02:17.424341 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:02:17.424341 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:02:17.424341 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:02:17.424341 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:02:17.424341 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:02:17.424341 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 27 03:02:17.424341 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:17.424341 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 403/799] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Oct 27 03:02:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:17.431546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11521d-0dc4-4ce8-a3a2-3560b8b6f14a None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:17.462750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:17.533020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11521d-0dc4-4ce8-a3a2-3560b8b6f14a None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:17.569740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fa5c4-a0c8-44a5-a724-8e1717eb8a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:17.570380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fa5c4-a0c8-44a5-a724-8e1717eb8a19 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:17.570663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fa5c4-a0c8-44a5-a724-8e1717eb8a19 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:17.570936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fa5c4-a0c8-44a5-a724-8e1717eb8a19 None admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:17.571663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fa5c4-a0c8-44a5-a724-8e1717eb8a19 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:17.571970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fa5c4-a0c8-44a5-a724-8e1717eb8a19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:17.573448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fa5c4-a0c8-44a5-a724-8e1717eb8a19 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:17.591115 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 397/800] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Oct 27 03:02:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:17.596698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ada525-6a7d-474c-8d10-d1ed727fad0b None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:17.647129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:17.697536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ada525-6a7d-474c-8d10-d1ed727fad0b None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:17.731219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ecb27-c506-47c9-8bad-728682696a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:17.731777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ecb27-c506-47c9-8bad-728682696a66 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:17.732058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ecb27-c506-47c9-8bad-728682696a66 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:17.732330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ecb27-c506-47c9-8bad-728682696a66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:17.742835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ecb27-c506-47c9-8bad-728682696a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:17.744269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ecb27-c506-47c9-8bad-728682696a66 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:17.759090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-492ecb27-c506-47c9-8bad-728682696a66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:02:17.759090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:17.759090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:17.759090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:17.759090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:17.759090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:17.759090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:17.759090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:17.759090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:17.759090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:17.759090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:17.759090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:17.759090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:02:17.759090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:02:17.759090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:02:17.759090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:02:17.760077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:17.760077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:17.760077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:17.760077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:17.760077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:17.760077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:17.760077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:17.760077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:17.760077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:17.760077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:17.760077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:17.760077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:17.760077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:17.760077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:17.760077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:17.760077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:17.760077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:02:17.761009 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:02:17.761009 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:02:17.761009 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:17.762348 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 404/801] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:17.765921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fa5c4-a0c8-44a5-a724-8e1717eb8a19 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:17.853991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:17.866012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fa5c4-a0c8-44a5-a724-8e1717eb8a19 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:17.900306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bae8e-7e5b-4f48-a94c-851a1ae3a4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:17.900904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bae8e-7e5b-4f48-a94c-851a1ae3a4fa None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:17.901180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bae8e-7e5b-4f48-a94c-851a1ae3a4fa None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:17.901449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bae8e-7e5b-4f48-a94c-851a1ae3a4fa None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:17.902107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bae8e-7e5b-4f48-a94c-851a1ae3a4fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:17.902408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bae8e-7e5b-4f48-a94c-851a1ae3a4fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:17.903761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bae8e-7e5b-4f48-a94c-851a1ae3a4fa None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:17.919055 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 398/802] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:17.920600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ecb27-c506-47c9-8bad-728682696a66 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:18.023690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:18.027428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ecb27-c506-47c9-8bad-728682696a66 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:18.061849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a1db7-7d18-445f-a19f-a8a1df9fb6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:18.062505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a1db7-7d18-445f-a19f-a8a1df9fb6f6 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:18.062787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a1db7-7d18-445f-a19f-a8a1df9fb6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:18.063060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a1db7-7d18-445f-a19f-a8a1df9fb6f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:18.070167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a1db7-7d18-445f-a19f-a8a1df9fb6f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:18.071598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a1db7-7d18-445f-a19f-a8a1df9fb6f6 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:18.082500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-e00a1db7-7d18-445f-a19f-a8a1df9fb6f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:02:18.082500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:18.082500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:18.082500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:18.082500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:18.082500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:18.082500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:18.082500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:18.082500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:18.082500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:18.082500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:18.082500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:18.082500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:02:18.082500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:02:18.082500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:02:18.083359 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:02:18.083359 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:18.083359 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:18.083359 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:18.083359 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:18.083359 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:18.083359 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:18.083359 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:18.083359 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:18.083359 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:18.083359 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:18.083359 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:18.083359 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:18.083359 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:18.083359 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:18.083359 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:18.083359 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:18.084867 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:02:18.084867 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:02:18.084867 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:02:18.084867 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:02:18.084867 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:02:18.084867 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:02:18.084867 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:02:18.084867 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:18.086349 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 405/803] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:02:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:18.089855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bae8e-7e5b-4f48-a94c-851a1ae3a4fa None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:18.128913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7ce8e-6036-4f1f-97f2-b54553d1dc87 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:18.129263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7ce8e-6036-4f1f-97f2-b54553d1dc87 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:18.129480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7ce8e-6036-4f1f-97f2-b54553d1dc87 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:18.131599 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 406/804] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:02:18.136672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d61624-24f4-4ce3-879e-07f5737c3748 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:18.136930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d61624-24f4-4ce3-879e-07f5737c3748 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:18.137211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d61624-24f4-4ce3-879e-07f5737c3748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:18.155440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b9d61624-24f4-4ce3-879e-07f5737c3748 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:18.156638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b9d61624-24f4-4ce3-879e-07f5737c3748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:18.200484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bae8e-7e5b-4f48-a94c-851a1ae3a4fa None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:18.234079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749b9b8-d0b1-4b22-82a4-5a4bca54fdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:18.234712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749b9b8-d0b1-4b22-82a4-5a4bca54fdb7 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:18.235016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749b9b8-d0b1-4b22-82a4-5a4bca54fdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:18.235371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749b9b8-d0b1-4b22-82a4-5a4bca54fdb7 None admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:18.236096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749b9b8-d0b1-4b22-82a4-5a4bca54fdb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:18.236406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749b9b8-d0b1-4b22-82a4-5a4bca54fdb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:18.237842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749b9b8-d0b1-4b22-82a4-5a4bca54fdb7 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:18.255042 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 399/805] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 27 03:02:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:18.256676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749b9b8-d0b1-4b22-82a4-5a4bca54fdb7 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:18.258203 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 407/806] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 03:02:18.267728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:18.357942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749b9b8-d0b1-4b22-82a4-5a4bca54fdb7 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:18.392126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacf73a-08dd-4e19-97b1-1ae4e245f6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:18.392839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacf73a-08dd-4e19-97b1-1ae4e245f6c2 None admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:18.393120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacf73a-08dd-4e19-97b1-1ae4e245f6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:18.393395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacf73a-08dd-4e19-97b1-1ae4e245f6c2 None admin] PATH_INFO: `/v3/projects/1ae07f0abb504c298fc9893b1d8bb173/users/c20881251f2241a3a5ec2e5cf99db149/roles/9a155af878464393911225ae1d6e3cbb` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:18.395614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacf73a-08dd-4e19-97b1-1ae4e245f6c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ae07f0abb504c298fc9893b1d8bb173, user_id=c20881251f2241a3a5ec2e5cf99db149, role_id=9a155af878464393911225ae1d6e3cbb)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:18.397149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacf73a-08dd-4e19-97b1-1ae4e245f6c2 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:18.474329 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 400/807] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:02:18 2022] PUT /identity/v3/projects/1ae07f0abb504c298fc9893b1d8bb173/users/c20881251f2241a3a5ec2e5cf99db149/roles/9a155af878464393911225ae1d6e3cbb => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:02:18.527514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d61624-24f4-4ce3-879e-07f5737c3748 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:18.623581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:18.634907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d61624-24f4-4ce3-879e-07f5737c3748 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:18.671254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612dbe1b-31e2-4577-b501-2761f9d3431c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:18.671870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dbe1b-31e2-4577-b501-2761f9d3431c None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:18.672153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dbe1b-31e2-4577-b501-2761f9d3431c None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:18.672427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dbe1b-31e2-4577-b501-2761f9d3431c None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:18.673106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612dbe1b-31e2-4577-b501-2761f9d3431c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:18.674510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612dbe1b-31e2-4577-b501-2761f9d3431c None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:18.722161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.sql.core [None req-612dbe1b-31e2-4577-b501-2761f9d3431c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 27 03:02:18.722161 n-d-862769-1 devstack@keystone.service[82180]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 03:02:18.722161 n-d-862769-1 devstack@keystone.service[82180]: [parameters: {'id': 'be660f70dc1049a7982b618e7a19bdfd', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 27 03:02:18.722161 n-d-862769-1 devstack@keystone.service[82180]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82180) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 03:02:18.730476 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-612dbe1b-31e2-4577-b501-2761f9d3431c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 27 03:02:18.730476 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:18.730476 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 03:02:18.730476 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 03:02:18.730476 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 03:02:18.730476 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 03:02:18.730476 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 03:02:18.730476 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 03:02:18.730476 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 03:02:18.730476 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application conn.query(q) Oct 27 03:02:18.730476 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 03:02:18.730476 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 03:02:18.730476 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 03:02:18.730476 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application result.read() Oct 27 03:02:18.731459 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 03:02:18.731459 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 03:02:18.731459 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 03:02:18.731459 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 03:02:18.731459 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 03:02:18.731459 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 03:02:18.731459 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 03:02:18.731459 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 03:02:18.731459 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 27 03:02:18.731459 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:18.731459 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 27 03:02:18.731459 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:18.731459 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:18.731459 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 27 03:02:18.731459 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 27 03:02:18.731459 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 27 03:02:18.731459 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 27 03:02:18.731459 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 03:02:18.732408 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application next(self.gen) Oct 27 03:02:18.732408 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 27 03:02:18.732408 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application yield resource Oct 27 03:02:18.732408 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 03:02:18.732408 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application next(self.gen) Oct 27 03:02:18.732408 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 27 03:02:18.732408 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.session.rollback() Oct 27 03:02:18.732408 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:02:18.732408 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.force_reraise() Oct 27 03:02:18.732408 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:02:18.732408 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise self.value Oct 27 03:02:18.732408 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 27 03:02:18.732408 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 27 03:02:18.732408 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 27 03:02:18.732408 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application session.commit() Oct 27 03:02:18.732408 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 27 03:02:18.732408 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 27 03:02:18.733306 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 27 03:02:18.733306 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._prepare_impl() Oct 27 03:02:18.733306 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 27 03:02:18.733306 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.session.flush() Oct 27 03:02:18.733306 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 03:02:18.733306 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._flush(objects) Oct 27 03:02:18.733306 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 03:02:18.733306 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 27 03:02:18.733306 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 03:02:18.733306 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application compat.raise_( Oct 27 03:02:18.733306 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 03:02:18.733306 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception Oct 27 03:02:18.733306 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 03:02:18.733306 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application flush_context.execute() Oct 27 03:02:18.733306 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 03:02:18.733306 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rec.execute(self) Oct 27 03:02:18.733306 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 03:02:18.735014 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 27 03:02:18.735014 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 03:02:18.735014 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 27 03:02:18.735014 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 27 03:02:18.735014 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 27 03:02:18.735014 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 03:02:18.735014 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 03:02:18.735014 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 03:02:18.735014 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 27 03:02:18.735014 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 03:02:18.735014 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 27 03:02:18.735014 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 03:02:18.735014 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 27 03:02:18.735014 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 03:02:18.735014 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 03:02:18.736971 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 03:02:18.736971 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception Oct 27 03:02:18.736971 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 03:02:18.736971 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 03:02:18.736971 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 03:02:18.736971 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 03:02:18.736971 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 03:02:18.736971 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 03:02:18.736971 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 03:02:18.736971 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application conn.query(q) Oct 27 03:02:18.736971 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 03:02:18.736971 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 03:02:18.736971 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 03:02:18.736971 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application result.read() Oct 27 03:02:18.736971 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 03:02:18.736971 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 03:02:18.736971 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 03:02:18.739439 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 03:02:18.739439 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 03:02:18.739439 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 03:02:18.739439 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 03:02:18.739439 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 03:02:18.739439 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 27 03:02:18.739439 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 03:02:18.739439 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [parameters: {'id': 'be660f70dc1049a7982b618e7a19bdfd', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 27 03:02:18.739439 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 03:02:18.739439 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:18.739439 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:02:18.739439 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:18.739439 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:18.739439 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 27 03:02:18.739439 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 27 03:02:18.741910 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 27 03:02:18.741910 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 27 03:02:18.741910 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 27 03:02:18.741910 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:18.741910 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:02:18.741910 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:18.741910 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:18.741910 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:18.741910 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:18.741910 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:18.741910 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:18.741910 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:18.741910 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:18.741910 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:18.741910 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:18.741910 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:18.741910 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:18.744214 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 27 03:02:18.744214 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 27 03:02:18.744214 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:18.744214 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:18.744214 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 27 03:02:18.744214 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 27 03:02:18.744214 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:18.744214 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:18.744214 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 27 03:02:18.744214 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 27 03:02:18.744214 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 27 03:02:18.744214 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:18.744214 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 408/808] 10.222.0.20 () {60 vars in 1137 bytes} [Thu Oct 27 03:02:18 2022] POST /identity/v3/domains => generated 190 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:18.745843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacf73a-08dd-4e19-97b1-1ae4e245f6c2 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:18.810444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:18.845842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacf73a-08dd-4e19-97b1-1ae4e245f6c2 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:18.881811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8db2d-21f6-480f-aa8b-6f748dc3778b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:18.882663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8db2d-21f6-480f-aa8b-6f748dc3778b None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:18.882947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8db2d-21f6-480f-aa8b-6f748dc3778b None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:18.883224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8db2d-21f6-480f-aa8b-6f748dc3778b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:18.893410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8db2d-21f6-480f-aa8b-6f748dc3778b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:18.894898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8db2d-21f6-480f-aa8b-6f748dc3778b None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:18.910288 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-3bb8db2d-21f6-480f-aa8b-6f748dc3778b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:02:18.910288 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:18.910288 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:18.910288 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:18.910288 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:18.910288 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:18.910288 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:18.910288 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:18.910288 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:18.910288 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:18.910288 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:18.910288 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:18.910288 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:02:18.910288 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:02:18.910288 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:02:18.910288 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:02:18.911233 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:18.911233 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:18.911233 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:18.911233 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:18.911233 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:18.911233 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:18.911233 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:18.911233 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:18.911233 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:18.911233 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:18.911233 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:18.911233 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:18.911233 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:18.911233 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:18.911233 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:18.911233 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:18.911233 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:02:18.912756 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:02:18.912756 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:02:18.912756 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:18.913404 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 401/809] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:18.918525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612dbe1b-31e2-4577-b501-2761f9d3431c None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:19.020890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612dbe1b-31e2-4577-b501-2761f9d3431c None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:19.055180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0b0e8-0873-466b-81a5-e1434b0f490f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:19.055794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0b0e8-0873-466b-81a5-e1434b0f490f None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:19.056077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0b0e8-0873-466b-81a5-e1434b0f490f None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:19.056414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0b0e8-0873-466b-81a5-e1434b0f490f None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:19.057071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0b0e8-0873-466b-81a5-e1434b0f490f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:19.057380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0b0e8-0873-466b-81a5-e1434b0f490f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:19.058780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0b0e8-0873-466b-81a5-e1434b0f490f None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:19.078079 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 409/810] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:19.232429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5dd1f-4298-4f47-9fb6-c2ca09a51f65 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:19.232782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5dd1f-4298-4f47-9fb6-c2ca09a51f65 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:19.233017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5dd1f-4298-4f47-9fb6-c2ca09a51f65 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:19.234562 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 402/811] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:19.239963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693140f-660b-47b7-a9e9-1e620f4fbd57 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:19.240286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693140f-660b-47b7-a9e9-1e620f4fbd57 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:19.240558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693140f-660b-47b7-a9e9-1e620f4fbd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:19.259795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9693140f-660b-47b7-a9e9-1e620f4fbd57 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:19.261000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9693140f-660b-47b7-a9e9-1e620f4fbd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:19.270875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:19.332299 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 410/812] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:19.603740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5dd1f-4298-4f47-9fb6-c2ca09a51f65 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:19.704700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5dd1f-4298-4f47-9fb6-c2ca09a51f65 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:19.723780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:19.737169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6fee7-f18e-484d-9497-daa63f448431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:19.737802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6fee7-f18e-484d-9497-daa63f448431 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:19.747835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6fee7-f18e-484d-9497-daa63f448431 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:19.747835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6fee7-f18e-484d-9497-daa63f448431 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:19.749208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6fee7-f18e-484d-9497-daa63f448431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:02:19.753962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-53b6fee7-f18e-484d-9497-daa63f448431 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:02:19.753962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:19.753962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:19.753962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:19.753962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:19.753962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:19.753962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:19.753962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:19.753962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:19.753962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:19.753962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:19.753962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:19.753962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:02:19.753962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:02:19.753962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:02:19.753962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:02:19.755050 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:02:19.755050 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:02:19.755050 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:02:19.755050 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:02:19.755050 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:19.755050 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:19.755050 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:19.755050 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:19.755050 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:19.755050 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:19.755050 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:19.755050 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:19.755050 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:19.755050 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:19.755050 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:19.755050 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:19.756452 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:19.756452 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:19.756452 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:19.756452 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:19.756452 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:02:19.756452 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:02:19.756452 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:02:19.756452 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:02:19.756452 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:02:19.756452 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:02:19.756452 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:02:19.756452 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:19.756452 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 403/813] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 27 03:02:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:19.762015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693140f-660b-47b7-a9e9-1e620f4fbd57 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:19.857209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693140f-660b-47b7-a9e9-1e620f4fbd57 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:19.890713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702a7f4-374d-4447-bea9-193aded5ae40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:19.891316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702a7f4-374d-4447-bea9-193aded5ae40 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:19.891598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702a7f4-374d-4447-bea9-193aded5ae40 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:19.891873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702a7f4-374d-4447-bea9-193aded5ae40 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:19.892540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702a7f4-374d-4447-bea9-193aded5ae40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:19.892847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702a7f4-374d-4447-bea9-193aded5ae40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:19.894240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702a7f4-374d-4447-bea9-193aded5ae40 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:19.901932 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 411/814] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:02:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:19.907620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6fee7-f18e-484d-9497-daa63f448431 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:20.004760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6fee7-f18e-484d-9497-daa63f448431 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:20.038055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81db28-270d-4393-adeb-d94333ac658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:20.038679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81db28-270d-4393-adeb-d94333ac658d None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:20.038970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81db28-270d-4393-adeb-d94333ac658d None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:20.039232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81db28-270d-4393-adeb-d94333ac658d None admin] PATH_INFO: `/v3/users/6d1e8c67c1ad4d67937b77beb4c54e4a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:20.051878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81db28-270d-4393-adeb-d94333ac658d None admin] RBAC: Authorizing `identity:get_user(user_id=6d1e8c67c1ad4d67937b77beb4c54e4a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:20.053911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81db28-270d-4393-adeb-d94333ac658d None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:20.055527 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 404/815] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:02:19 2022] GET /identity/v3/users/6d1e8c67c1ad4d67937b77beb4c54e4a => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:20.061189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702a7f4-374d-4447-bea9-193aded5ae40 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:20.070382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:20.156728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702a7f4-374d-4447-bea9-193aded5ae40 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:20.194662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a8ab0-2315-40ef-847e-b09ebc39c406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:20.195392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a8ab0-2315-40ef-847e-b09ebc39c406 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:20.195612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a8ab0-2315-40ef-847e-b09ebc39c406 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:20.195884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a8ab0-2315-40ef-847e-b09ebc39c406 None admin] PATH_INFO: `/v3/projects/49dbcc3d743945439063bcfe7fd9d2f7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:20.196997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a8ab0-2315-40ef-847e-b09ebc39c406 None admin] RBAC: Authorizing `identity:get_project(project_id=49dbcc3d743945439063bcfe7fd9d2f7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:20.198441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a8ab0-2315-40ef-847e-b09ebc39c406 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:20.200067 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 412/816] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:02:20 2022] GET /identity/v3/projects/49dbcc3d743945439063bcfe7fd9d2f7 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:20.206043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81db28-270d-4393-adeb-d94333ac658d None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:20.245804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:20.305064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81db28-270d-4393-adeb-d94333ac658d None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:20.337597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c62586-8004-44e2-a8d6-2d8c06614011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:20.338350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c62586-8004-44e2-a8d6-2d8c06614011 None admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:20.338638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c62586-8004-44e2-a8d6-2d8c06614011 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:20.338921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c62586-8004-44e2-a8d6-2d8c06614011 None admin] PATH_INFO: `/v3/projects/49dbcc3d743945439063bcfe7fd9d2f7/users/6d1e8c67c1ad4d67937b77beb4c54e4a/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:20.340811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c62586-8004-44e2-a8d6-2d8c06614011 None admin] RBAC: Authorizing `identity:create_grant(project_id=49dbcc3d743945439063bcfe7fd9d2f7, user_id=6d1e8c67c1ad4d67937b77beb4c54e4a, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:20.342275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c62586-8004-44e2-a8d6-2d8c06614011 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:20.408271 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 405/817] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:02:20 2022] PUT /identity/v3/projects/49dbcc3d743945439063bcfe7fd9d2f7/users/6d1e8c67c1ad4d67937b77beb4c54e4a/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:02:20.645595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eef9d7-25d6-4c01-9c8f-d8809063935a None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:20.645959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eef9d7-25d6-4c01-9c8f-d8809063935a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:20.646783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eef9d7-25d6-4c01-9c8f-d8809063935a None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:20.648151 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 413/818] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:20.653442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e479b47-9558-4c06-9ef5-d68a58065f27 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:20.653727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e479b47-9558-4c06-9ef5-d68a58065f27 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:20.654001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e479b47-9558-4c06-9ef5-d68a58065f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:20.672388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8e479b47-9558-4c06-9ef5-d68a58065f27 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:20.673537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8e479b47-9558-4c06-9ef5-d68a58065f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:20.738135 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 406/819] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:21.008278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eef9d7-25d6-4c01-9c8f-d8809063935a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:21.081709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:21.106474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eef9d7-25d6-4c01-9c8f-d8809063935a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:21.140557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc052f3-a85a-452c-8584-35f9d13479f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:21.141183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc052f3-a85a-452c-8584-35f9d13479f1 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:21.141463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc052f3-a85a-452c-8584-35f9d13479f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:21.141733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc052f3-a85a-452c-8584-35f9d13479f1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:21.151522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc052f3-a85a-452c-8584-35f9d13479f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:02:21.156244 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-0cc052f3-a85a-452c-8584-35f9d13479f1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 03:02:21.156244 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:21.156244 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:21.156244 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:21.156244 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:21.156244 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:21.156244 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:21.156244 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:21.156244 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:21.156244 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:21.156244 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:21.156244 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:21.156244 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:02:21.156244 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:02:21.156244 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:02:21.156244 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:02:21.157163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:02:21.157163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:02:21.157163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:02:21.157163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:02:21.157163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:21.157163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:21.157163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:21.157163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:21.157163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:21.157163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:21.157163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:21.157163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:21.157163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:21.157163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:21.157163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:21.157163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:21.158257 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:21.158257 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:21.158257 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:21.158257 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:21.158257 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:02:21.158257 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:02:21.158257 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:02:21.158257 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:02:21.158257 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:02:21.158257 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:02:21.158257 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 03:02:21.158257 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:21.158257 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 414/820] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Oct 27 03:02:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:21.163329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e479b47-9558-4c06-9ef5-d68a58065f27 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:21.195255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:21.263744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e479b47-9558-4c06-9ef5-d68a58065f27 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:21.297823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308175b-7871-4430-8fdd-92ac401575a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:21.298460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308175b-7871-4430-8fdd-92ac401575a5 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:21.298740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308175b-7871-4430-8fdd-92ac401575a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:21.299007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308175b-7871-4430-8fdd-92ac401575a5 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:21.299672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308175b-7871-4430-8fdd-92ac401575a5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:21.299974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308175b-7871-4430-8fdd-92ac401575a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:21.301338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308175b-7871-4430-8fdd-92ac401575a5 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:21.309594 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 407/821] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Oct 27 03:02:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:21.315460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc052f3-a85a-452c-8584-35f9d13479f1 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:21.410280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc052f3-a85a-452c-8584-35f9d13479f1 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:21.441901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50676485-7d5a-4390-9e5c-885dd9f08917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:21.442543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50676485-7d5a-4390-9e5c-885dd9f08917 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:21.442816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50676485-7d5a-4390-9e5c-885dd9f08917 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:21.443081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50676485-7d5a-4390-9e5c-885dd9f08917 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:21.445435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:21.453657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50676485-7d5a-4390-9e5c-885dd9f08917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:21.459397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50676485-7d5a-4390-9e5c-885dd9f08917 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:21.468843 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-50676485-7d5a-4390-9e5c-885dd9f08917 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:02:21.468843 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:21.468843 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:21.468843 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:21.468843 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:21.468843 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:21.468843 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:21.468843 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:21.468843 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:21.468843 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:21.468843 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:21.468843 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:21.468843 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:02:21.468843 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:02:21.468843 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:02:21.468843 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:02:21.469825 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:21.469825 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:21.469825 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:21.469825 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:21.469825 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:21.469825 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:21.469825 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:21.469825 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:21.469825 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:21.469825 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:21.469825 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:21.469825 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:21.469825 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:21.469825 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:21.469825 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:21.469825 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:21.469825 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:02:21.471449 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:02:21.471449 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:02:21.471449 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:21.471449 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 415/822] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:02:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:21.475643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308175b-7871-4430-8fdd-92ac401575a5 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:21.564148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:21.573249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308175b-7871-4430-8fdd-92ac401575a5 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:21.605582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda191e4-9e5d-4cb5-910e-4750b5c33c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:21.606216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda191e4-9e5d-4cb5-910e-4750b5c33c90 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:21.606493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda191e4-9e5d-4cb5-910e-4750b5c33c90 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:21.606760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda191e4-9e5d-4cb5-910e-4750b5c33c90 None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:21.607402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda191e4-9e5d-4cb5-910e-4750b5c33c90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:21.607702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda191e4-9e5d-4cb5-910e-4750b5c33c90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:21.609063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda191e4-9e5d-4cb5-910e-4750b5c33c90 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:21.621239 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 408/823] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:21.626954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50676485-7d5a-4390-9e5c-885dd9f08917 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:21.721265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50676485-7d5a-4390-9e5c-885dd9f08917 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:21.753282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e6fe9-8373-42de-aca7-d2c0129c780b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:21.753895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e6fe9-8373-42de-aca7-d2c0129c780b None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:21.754204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e6fe9-8373-42de-aca7-d2c0129c780b None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:21.754475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e6fe9-8373-42de-aca7-d2c0129c780b None admin] PATH_INFO: `/v3/users/nova` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:21.761716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e6fe9-8373-42de-aca7-d2c0129c780b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:21.763173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e6fe9-8373-42de-aca7-d2c0129c780b None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:21.773761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-744e6fe9-8373-42de-aca7-d2c0129c780b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 03:02:21.773761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:21.773761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:21.773761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:21.773761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:21.773761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:21.773761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:21.773761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:21.773761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:21.773761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:21.773761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:21.773761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:21.773761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:02:21.773761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:02:21.773761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:02:21.773761 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:02:21.774816 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:21.774816 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:21.774816 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:02:21.774816 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:02:21.774816 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:02:21.774816 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:02:21.774816 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:21.774816 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:21.774816 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:21.774816 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:21.774816 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:21.774816 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:21.774816 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:21.774816 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:21.774816 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:21.774816 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:21.774816 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:21.774816 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:21.775800 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:21.775800 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:21.775800 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:02:21.775800 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:02:21.775800 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:02:21.775800 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:02:21.775800 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:02:21.775800 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:02:21.775800 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 27 03:02:21.775800 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:21.775800 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 416/824] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Oct 27 03:02:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:02:21.780559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda191e4-9e5d-4cb5-910e-4750b5c33c90 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:21.876230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda191e4-9e5d-4cb5-910e-4750b5c33c90 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:21.908759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf87de-83e3-4f8a-841a-742f6a554e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:21.909354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf87de-83e3-4f8a-841a-742f6a554e12 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:21.909633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf87de-83e3-4f8a-841a-742f6a554e12 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:21.909904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf87de-83e3-4f8a-841a-742f6a554e12 None admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:21.910658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf87de-83e3-4f8a-841a-742f6a554e12 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:21.910963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf87de-83e3-4f8a-841a-742f6a554e12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:21.912984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf87de-83e3-4f8a-841a-742f6a554e12 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:21.929301 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 409/825] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Oct 27 03:02:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:21.935025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e6fe9-8373-42de-aca7-d2c0129c780b None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:21.979998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:22.030904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e6fe9-8373-42de-aca7-d2c0129c780b None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:22.063342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d674f-30f3-4b6b-8d22-25fbee7b8932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:22.063943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d674f-30f3-4b6b-8d22-25fbee7b8932 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:22.064219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d674f-30f3-4b6b-8d22-25fbee7b8932 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:22.064490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d674f-30f3-4b6b-8d22-25fbee7b8932 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:22.129148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d674f-30f3-4b6b-8d22-25fbee7b8932 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:22.130565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d674f-30f3-4b6b-8d22-25fbee7b8932 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:22.175390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:22.230690 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 417/826] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:02:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 27 03:02:22.236748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf87de-83e3-4f8a-841a-742f6a554e12 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:22.247183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:22.332686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf87de-83e3-4f8a-841a-742f6a554e12 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:22.365138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae170e-ee82-4a84-89ed-12e5450373f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:22.365761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae170e-ee82-4a84-89ed-12e5450373f4 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:22.366063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae170e-ee82-4a84-89ed-12e5450373f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:22.366335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae170e-ee82-4a84-89ed-12e5450373f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:22.375890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae170e-ee82-4a84-89ed-12e5450373f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:22.377314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae170e-ee82-4a84-89ed-12e5450373f4 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:22.392091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-eaae170e-ee82-4a84-89ed-12e5450373f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:02:22.392091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:22.392091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:22.392091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:22.392091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:22.392091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:22.392091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:22.392091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:22.392091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:22.392091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:22.392091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:22.392091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:22.392091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:02:22.392091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:02:22.392091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:02:22.392091 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:02:22.393224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:22.393224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:22.393224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:22.393224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:22.393224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:22.393224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:22.393224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:22.393224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:22.393224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:22.393224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:22.393224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:22.393224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:22.393224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:22.393224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:22.393224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:22.393224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:22.393224 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:02:22.394245 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:02:22.394245 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:02:22.394245 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:22.394245 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 410/827] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:22.399297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d674f-30f3-4b6b-8d22-25fbee7b8932 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:22.498647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d674f-30f3-4b6b-8d22-25fbee7b8932 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:22.531954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74158be-338b-4ae1-acfe-2b67e191b08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:22.532556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74158be-338b-4ae1-acfe-2b67e191b08a None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:22.532836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74158be-338b-4ae1-acfe-2b67e191b08a None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:22.533108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74158be-338b-4ae1-acfe-2b67e191b08a None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:22.533749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74158be-338b-4ae1-acfe-2b67e191b08a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:22.534074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74158be-338b-4ae1-acfe-2b67e191b08a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:22.535441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74158be-338b-4ae1-acfe-2b67e191b08a None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:22.543465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90427004-caa0-4fd2-9066-93ef5a33a044 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:22.543758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90427004-caa0-4fd2-9066-93ef5a33a044 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:22.544036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90427004-caa0-4fd2-9066-93ef5a33a044 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:22.545375 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 411/828] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:02:22.549257 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 418/829] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:22.550374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85617bb7-794d-4665-9917-145532f95614 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:22.550661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85617bb7-794d-4665-9917-145532f95614 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:22.550933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85617bb7-794d-4665-9917-145532f95614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:22.551955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74158be-338b-4ae1-acfe-2b67e191b08a None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:22.563650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:22.570741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-85617bb7-794d-4665-9917-145532f95614 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:22.571954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-85617bb7-794d-4665-9917-145532f95614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:22.626860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:22.638589 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 412/830] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:22.653131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74158be-338b-4ae1-acfe-2b67e191b08a None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:22.685305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910ce2a-af61-4dda-a31f-4b5032df9d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:22.685930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910ce2a-af61-4dda-a31f-4b5032df9d64 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:22.686237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910ce2a-af61-4dda-a31f-4b5032df9d64 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:22.686515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910ce2a-af61-4dda-a31f-4b5032df9d64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:22.692918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4910ce2a-af61-4dda-a31f-4b5032df9d64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:22.694990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4910ce2a-af61-4dda-a31f-4b5032df9d64 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:22.705922 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-4910ce2a-af61-4dda-a31f-4b5032df9d64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:02:22.705922 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:22.705922 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:22.705922 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:22.705922 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:22.705922 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:22.705922 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:22.705922 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:22.705922 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:22.705922 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:22.705922 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:22.705922 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:22.705922 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:02:22.705922 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:02:22.705922 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:02:22.706977 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:02:22.706977 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:22.706977 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:22.706977 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:22.706977 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:22.706977 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:22.706977 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:22.706977 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:22.706977 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:22.706977 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:22.706977 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:22.706977 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:22.706977 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:22.706977 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:22.706977 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:22.706977 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:22.706977 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:22.707881 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:02:22.707881 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:02:22.707881 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:02:22.707881 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:02:22.707881 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:02:22.707881 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:02:22.707881 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:02:22.707881 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:22.707881 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 419/831] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:02:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:02:22.712829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85617bb7-794d-4665-9917-145532f95614 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:22.807570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85617bb7-794d-4665-9917-145532f95614 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:22.841341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42088fee-fba2-4de6-8ef9-713896cb9910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:22.841941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42088fee-fba2-4de6-8ef9-713896cb9910 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:22.842246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42088fee-fba2-4de6-8ef9-713896cb9910 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:22.842528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42088fee-fba2-4de6-8ef9-713896cb9910 None admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:22.843222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42088fee-fba2-4de6-8ef9-713896cb9910 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:22.843531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42088fee-fba2-4de6-8ef9-713896cb9910 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:22.844974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42088fee-fba2-4de6-8ef9-713896cb9910 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:22.855920 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 413/832] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 27 03:02:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:22.861827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910ce2a-af61-4dda-a31f-4b5032df9d64 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:22.905633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42088fee-fba2-4de6-8ef9-713896cb9910 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:22.930186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:22.961216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:22.963790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910ce2a-af61-4dda-a31f-4b5032df9d64 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:22.997235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbffc8f-9a60-44ff-b761-2c088ddb240a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:22.997833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbffc8f-9a60-44ff-b761-2c088ddb240a None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:22.998146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbffc8f-9a60-44ff-b761-2c088ddb240a None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:22.998413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbffc8f-9a60-44ff-b761-2c088ddb240a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:22.999142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbffc8f-9a60-44ff-b761-2c088ddb240a None admin] RBAC: Adding query filter params (role.id=9a155af878464393911225ae1d6e3cbb, scope.project.id=1ae07f0abb504c298fc9893b1d8bb173, user.id=c20881251f2241a3a5ec2e5cf99db149) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:22.999445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbffc8f-9a60-44ff-b761-2c088ddb240a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:23.000900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbffc8f-9a60-44ff-b761-2c088ddb240a None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:23.007591 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 420/833] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:02:22 2022] GET /identity/v3/role_assignments?user.id=c20881251f2241a3a5ec2e5cf99db149&scope.project.id=1ae07f0abb504c298fc9893b1d8bb173&role.id=9a155af878464393911225ae1d6e3cbb => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:02:23.014202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42088fee-fba2-4de6-8ef9-713896cb9910 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:23.050658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2b803-15fd-4f92-b4e6-ee676c54efc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:23.051312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2b803-15fd-4f92-b4e6-ee676c54efc2 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:23.051594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2b803-15fd-4f92-b4e6-ee676c54efc2 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:23.051868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2b803-15fd-4f92-b4e6-ee676c54efc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:23.063849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2b803-15fd-4f92-b4e6-ee676c54efc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:02:23.069982 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-f6b2b803-15fd-4f92-b4e6-ee676c54efc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:02:23.069982 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:23.069982 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:23.069982 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:23.069982 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:23.069982 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:23.069982 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:23.069982 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:23.069982 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:23.069982 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:23.069982 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:23.069982 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:23.069982 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:02:23.069982 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:02:23.069982 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:02:23.069982 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:02:23.071213 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:02:23.071213 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:02:23.071213 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:02:23.071213 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:02:23.071213 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:23.071213 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:23.071213 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:23.071213 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:23.071213 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:23.071213 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:23.071213 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:23.071213 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:23.071213 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:23.071213 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:23.071213 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:23.071213 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:23.072117 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:23.072117 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:23.072117 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:23.072117 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:23.072117 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:02:23.072117 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:02:23.072117 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:02:23.072117 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:02:23.072117 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:02:23.072117 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:02:23.072117 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:02:23.072117 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:23.072117 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 414/834] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 27 03:02:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:02:23.077389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbffc8f-9a60-44ff-b761-2c088ddb240a None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:23.181412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbffc8f-9a60-44ff-b761-2c088ddb240a None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:23.210819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:23.217409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca900d25-fbeb-49df-9d03-3b303cc8fc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:23.218024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca900d25-fbeb-49df-9d03-3b303cc8fc3e None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:23.218376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca900d25-fbeb-49df-9d03-3b303cc8fc3e None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:23.218647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca900d25-fbeb-49df-9d03-3b303cc8fc3e None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:23.219312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca900d25-fbeb-49df-9d03-3b303cc8fc3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:23.219642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca900d25-fbeb-49df-9d03-3b303cc8fc3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:23.220995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca900d25-fbeb-49df-9d03-3b303cc8fc3e None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:23.229524 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 421/835] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:02:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:23.235723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2b803-15fd-4f92-b4e6-ee676c54efc2 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:23.336746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2b803-15fd-4f92-b4e6-ee676c54efc2 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:23.347040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:23.371180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa2975-6463-4820-9842-7411bb13a6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:23.371808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa2975-6463-4820-9842-7411bb13a6c5 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:23.372086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa2975-6463-4820-9842-7411bb13a6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:23.372368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa2975-6463-4820-9842-7411bb13a6c5 None admin] PATH_INFO: `/v3/users/6d1e8c67c1ad4d67937b77beb4c54e4a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:23.373793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa2975-6463-4820-9842-7411bb13a6c5 None admin] RBAC: Authorizing `identity:get_user(user_id=6d1e8c67c1ad4d67937b77beb4c54e4a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:23.375313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa2975-6463-4820-9842-7411bb13a6c5 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:23.377246 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 415/836] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:02:23 2022] GET /identity/v3/users/6d1e8c67c1ad4d67937b77beb4c54e4a => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:23.383613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca900d25-fbeb-49df-9d03-3b303cc8fc3e None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:23.482135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca900d25-fbeb-49df-9d03-3b303cc8fc3e None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:23.516450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631422f-332c-4361-8056-31562061277a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:23.517086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631422f-332c-4361-8056-31562061277a None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:23.517368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631422f-332c-4361-8056-31562061277a None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:23.517640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631422f-332c-4361-8056-31562061277a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:23.575227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:23.584682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631422f-332c-4361-8056-31562061277a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:23.590166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631422f-332c-4361-8056-31562061277a None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:23.682650 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 422/837] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:02:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 03:02:23.688770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa2975-6463-4820-9842-7411bb13a6c5 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:23.790894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa2975-6463-4820-9842-7411bb13a6c5 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:23.824084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28eb852-d489-463a-8013-a947a059b71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:23.824714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28eb852-d489-463a-8013-a947a059b71d None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:23.824991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28eb852-d489-463a-8013-a947a059b71d None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:23.825262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28eb852-d489-463a-8013-a947a059b71d None admin] PATH_INFO: `/v3/projects/49dbcc3d743945439063bcfe7fd9d2f7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:23.826460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28eb852-d489-463a-8013-a947a059b71d None admin] RBAC: Authorizing `identity:get_project(project_id=49dbcc3d743945439063bcfe7fd9d2f7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:23.827885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28eb852-d489-463a-8013-a947a059b71d None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:23.829508 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 416/838] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:02:23 2022] GET /identity/v3/projects/49dbcc3d743945439063bcfe7fd9d2f7 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:23.835772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631422f-332c-4361-8056-31562061277a None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:23.926264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:23.934963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631422f-332c-4361-8056-31562061277a None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:23.966612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce2dc2-d3ba-42af-99e3-3fbad0f1d31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:23.967222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce2dc2-d3ba-42af-99e3-3fbad0f1d31a None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:23.967847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce2dc2-d3ba-42af-99e3-3fbad0f1d31a None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:23.968122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce2dc2-d3ba-42af-99e3-3fbad0f1d31a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:23.968851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce2dc2-d3ba-42af-99e3-3fbad0f1d31a None admin] RBAC: Adding query filter params (role.id=6e91e7a416ac452b86ec238a2b81bc07, scope.project.id=49dbcc3d743945439063bcfe7fd9d2f7, user.id=6d1e8c67c1ad4d67937b77beb4c54e4a) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:23.969160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce2dc2-d3ba-42af-99e3-3fbad0f1d31a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:23.970609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce2dc2-d3ba-42af-99e3-3fbad0f1d31a None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:23.976658 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 423/839] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:02:23 2022] GET /identity/v3/role_assignments?user.id=6d1e8c67c1ad4d67937b77beb4c54e4a&scope.project.id=49dbcc3d743945439063bcfe7fd9d2f7&role.id=6e91e7a416ac452b86ec238a2b81bc07 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:26.106049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bc836-dcc8-4777-8ed0-5aa2de566f76 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:26.106605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bc836-dcc8-4777-8ed0-5aa2de566f76 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:26.106605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bc836-dcc8-4777-8ed0-5aa2de566f76 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:26.107922 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 417/840] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:26.113059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd52b22-215e-40c5-a627-f3e235dd580e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:26.113487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd52b22-215e-40c5-a627-f3e235dd580e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:26.113640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd52b22-215e-40c5-a627-f3e235dd580e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:26.132360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-dfd52b22-215e-40c5-a627-f3e235dd580e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:26.133546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-dfd52b22-215e-40c5-a627-f3e235dd580e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:26.197464 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 424/841] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:26.461717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bc836-dcc8-4777-8ed0-5aa2de566f76 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:26.507705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:26.558996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bc836-dcc8-4777-8ed0-5aa2de566f76 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:26.597536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df05fca-454c-416e-8b99-bbdda20bcf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:26.598181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df05fca-454c-416e-8b99-bbdda20bcf82 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:26.598461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df05fca-454c-416e-8b99-bbdda20bcf82 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:26.598731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df05fca-454c-416e-8b99-bbdda20bcf82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:26.600423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df05fca-454c-416e-8b99-bbdda20bcf82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:26.601844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df05fca-454c-416e-8b99-bbdda20bcf82 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:26.603426 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 418/842] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:02:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:26.609176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd52b22-215e-40c5-a627-f3e235dd580e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:26.688286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:26.701922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd52b22-215e-40c5-a627-f3e235dd580e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:26.734565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a495f1-8021-4ff3-ab1d-da06e0dd0355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:26.735097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a495f1-8021-4ff3-ab1d-da06e0dd0355 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:26.735375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a495f1-8021-4ff3-ab1d-da06e0dd0355 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:26.735644 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a495f1-8021-4ff3-ab1d-da06e0dd0355 None admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:26.736288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a495f1-8021-4ff3-ab1d-da06e0dd0355 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:26.737699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a495f1-8021-4ff3-ab1d-da06e0dd0355 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:26.828175 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 425/843] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 27 03:02:26 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:02:28.969018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa266fdc-5407-4e30-a96e-496e2f77b683 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:28.969563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa266fdc-5407-4e30-a96e-496e2f77b683 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:28.969563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa266fdc-5407-4e30-a96e-496e2f77b683 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:28.970921 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 419/844] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:28.976098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6ec20-fa8d-455a-bf86-941f705440d3 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:28.976517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6ec20-fa8d-455a-bf86-941f705440d3 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:28.976639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6ec20-fa8d-455a-bf86-941f705440d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:28.994825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-72a6ec20-fa8d-455a-bf86-941f705440d3 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:28.995996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-72a6ec20-fa8d-455a-bf86-941f705440d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:29.059228 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 426/845] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 03:02:29.330231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa266fdc-5407-4e30-a96e-496e2f77b683 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:29.429575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa266fdc-5407-4e30-a96e-496e2f77b683 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:29.442460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:29.461600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffabafe-3bf9-4b08-8525-9982010bb2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:29.462260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffabafe-3bf9-4b08-8525-9982010bb2fa None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:29.462545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffabafe-3bf9-4b08-8525-9982010bb2fa None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:29.462818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffabafe-3bf9-4b08-8525-9982010bb2fa None admin] PATH_INFO: `/v3/roles/31c2fac3eedc4006a84fcd0bee6d22e8` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:29.464194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffabafe-3bf9-4b08-8525-9982010bb2fa None admin] RBAC: Authorizing `identity:get_role(role_id=31c2fac3eedc4006a84fcd0bee6d22e8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:29.465553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffabafe-3bf9-4b08-8525-9982010bb2fa None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:29.466891 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 420/846] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:02:29 2022] GET /identity/v3/roles/31c2fac3eedc4006a84fcd0bee6d22e8 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:29.472715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6ec20-fa8d-455a-bf86-941f705440d3 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:29.539324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:29.567293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6ec20-fa8d-455a-bf86-941f705440d3 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:29.600850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9684c24-e952-4a31-8ef2-130ab4b8902e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:29.601402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9684c24-e952-4a31-8ef2-130ab4b8902e None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:29.601680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9684c24-e952-4a31-8ef2-130ab4b8902e None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:29.601949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9684c24-e952-4a31-8ef2-130ab4b8902e None admin] PATH_INFO: `/v3/users/a65dd7985eb945cd8d1f4a9daaf45b23` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:29.614303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9684c24-e952-4a31-8ef2-130ab4b8902e None admin] RBAC: Authorizing `identity:get_user(user_id=a65dd7985eb945cd8d1f4a9daaf45b23)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:29.615805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9684c24-e952-4a31-8ef2-130ab4b8902e None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:29.617350 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 427/847] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:02:29 2022] GET /identity/v3/users/a65dd7985eb945cd8d1f4a9daaf45b23 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:29.622968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffabafe-3bf9-4b08-8525-9982010bb2fa None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:29.718384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffabafe-3bf9-4b08-8525-9982010bb2fa None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:29.750182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5959f-31c6-4c73-9b58-02c2ada81a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:29.750784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5959f-31c6-4c73-9b58-02c2ada81a98 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:29.751059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5959f-31c6-4c73-9b58-02c2ada81a98 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:29.751323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5959f-31c6-4c73-9b58-02c2ada81a98 None admin] PATH_INFO: `/v3/projects/49dbcc3d743945439063bcfe7fd9d2f7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:29.752412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5959f-31c6-4c73-9b58-02c2ada81a98 None admin] RBAC: Authorizing `identity:get_project(project_id=49dbcc3d743945439063bcfe7fd9d2f7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:29.753814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5959f-31c6-4c73-9b58-02c2ada81a98 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:29.755939 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 421/848] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:02:29 2022] GET /identity/v3/projects/49dbcc3d743945439063bcfe7fd9d2f7 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:02:29.761896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9684c24-e952-4a31-8ef2-130ab4b8902e None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:29.857111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9684c24-e952-4a31-8ef2-130ab4b8902e None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:29.884365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:29.889774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708593e-cd70-4a24-aa00-5bef676d532c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:29.890458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708593e-cd70-4a24-aa00-5bef676d532c None admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:29.890739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708593e-cd70-4a24-aa00-5bef676d532c None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:29.891011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708593e-cd70-4a24-aa00-5bef676d532c None admin] PATH_INFO: `/v3/projects/49dbcc3d743945439063bcfe7fd9d2f7/users/a65dd7985eb945cd8d1f4a9daaf45b23/roles/31c2fac3eedc4006a84fcd0bee6d22e8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:29.893121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708593e-cd70-4a24-aa00-5bef676d532c None admin] RBAC: Authorizing `identity:create_grant(project_id=49dbcc3d743945439063bcfe7fd9d2f7, user_id=a65dd7985eb945cd8d1f4a9daaf45b23, role_id=31c2fac3eedc4006a84fcd0bee6d22e8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:29.894574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708593e-cd70-4a24-aa00-5bef676d532c None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:29.976888 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 428/849] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:02:29 2022] PUT /identity/v3/projects/49dbcc3d743945439063bcfe7fd9d2f7/users/a65dd7985eb945cd8d1f4a9daaf45b23/roles/31c2fac3eedc4006a84fcd0bee6d22e8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:02:32.265233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a9b17-9512-4b6a-859c-f04cf9832a31 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:32.265740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a9b17-9512-4b6a-859c-f04cf9832a31 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:32.265825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a9b17-9512-4b6a-859c-f04cf9832a31 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:32.267185 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 422/850] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:32.272524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374138f0-661f-48be-baf9-d5d661cfe19e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:32.272942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374138f0-661f-48be-baf9-d5d661cfe19e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:32.273074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374138f0-661f-48be-baf9-d5d661cfe19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:32.291604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-374138f0-661f-48be-baf9-d5d661cfe19e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:32.292810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-374138f0-661f-48be-baf9-d5d661cfe19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:32.356428 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 429/851] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:32.630255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a9b17-9512-4b6a-859c-f04cf9832a31 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:32.680245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:32.729453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a9b17-9512-4b6a-859c-f04cf9832a31 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:32.761910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a52cd-421c-40bb-b231-f14cf5c1733b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:32.762557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a52cd-421c-40bb-b231-f14cf5c1733b None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:32.762843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a52cd-421c-40bb-b231-f14cf5c1733b None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:32.763122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a52cd-421c-40bb-b231-f14cf5c1733b None admin] PATH_INFO: `/v3/roles/31c2fac3eedc4006a84fcd0bee6d22e8` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:32.764511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a52cd-421c-40bb-b231-f14cf5c1733b None admin] RBAC: Authorizing `identity:get_role(role_id=31c2fac3eedc4006a84fcd0bee6d22e8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:32.765879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a52cd-421c-40bb-b231-f14cf5c1733b None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:32.767207 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 423/852] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:02:32 2022] GET /identity/v3/roles/31c2fac3eedc4006a84fcd0bee6d22e8 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:32.773490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374138f0-661f-48be-baf9-d5d661cfe19e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:32.866802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374138f0-661f-48be-baf9-d5d661cfe19e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:32.886394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:32.899833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03192d73-864b-4a71-8573-7a04299ea254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:32.904043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03192d73-864b-4a71-8573-7a04299ea254 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:32.904043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03192d73-864b-4a71-8573-7a04299ea254 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:32.904043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03192d73-864b-4a71-8573-7a04299ea254 None admin] PATH_INFO: `/v3/users/a65dd7985eb945cd8d1f4a9daaf45b23` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:32.904043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03192d73-864b-4a71-8573-7a04299ea254 None admin] RBAC: Authorizing `identity:get_user(user_id=a65dd7985eb945cd8d1f4a9daaf45b23)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:32.904043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03192d73-864b-4a71-8573-7a04299ea254 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:32.905045 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 430/853] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:02:32 2022] GET /identity/v3/users/a65dd7985eb945cd8d1f4a9daaf45b23 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:32.910639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a52cd-421c-40bb-b231-f14cf5c1733b None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:33.010971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a52cd-421c-40bb-b231-f14cf5c1733b None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:33.027372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:33.043487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efa608-cc2c-4ff2-a953-b53c6b92dee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:33.044094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efa608-cc2c-4ff2-a953-b53c6b92dee8 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:33.044380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efa608-cc2c-4ff2-a953-b53c6b92dee8 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:33.044658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efa608-cc2c-4ff2-a953-b53c6b92dee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:33.109322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efa608-cc2c-4ff2-a953-b53c6b92dee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:33.110808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efa608-cc2c-4ff2-a953-b53c6b92dee8 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:33.205737 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 424/854] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:02:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 03:02:33.211810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03192d73-864b-4a71-8573-7a04299ea254 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:33.308185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03192d73-864b-4a71-8573-7a04299ea254 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:33.340498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3972a85-7ae4-45ed-b594-d0655ef78d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:33.341115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3972a85-7ae4-45ed-b594-d0655ef78d45 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:33.341398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3972a85-7ae4-45ed-b594-d0655ef78d45 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:33.341675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3972a85-7ae4-45ed-b594-d0655ef78d45 None admin] PATH_INFO: `/v3/projects/49dbcc3d743945439063bcfe7fd9d2f7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:33.342814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3972a85-7ae4-45ed-b594-d0655ef78d45 None admin] RBAC: Authorizing `identity:get_project(project_id=49dbcc3d743945439063bcfe7fd9d2f7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:33.344241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3972a85-7ae4-45ed-b594-d0655ef78d45 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:33.345847 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 431/855] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:02:33 2022] GET /identity/v3/projects/49dbcc3d743945439063bcfe7fd9d2f7 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:33.351912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efa608-cc2c-4ff2-a953-b53c6b92dee8 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:33.369744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:33.447283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efa608-cc2c-4ff2-a953-b53c6b92dee8 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:33.478989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ad625-075e-44ac-be23-443db311af59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:33.479580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ad625-075e-44ac-be23-443db311af59 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:33.479858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ad625-075e-44ac-be23-443db311af59 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:33.480129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ad625-075e-44ac-be23-443db311af59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:33.480844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ad625-075e-44ac-be23-443db311af59 None admin] RBAC: Adding query filter params (role.id=31c2fac3eedc4006a84fcd0bee6d22e8, scope.project.id=49dbcc3d743945439063bcfe7fd9d2f7, user.id=a65dd7985eb945cd8d1f4a9daaf45b23) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:33.481149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ad625-075e-44ac-be23-443db311af59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:33.482622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ad625-075e-44ac-be23-443db311af59 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:33.488077 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 425/856] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:02:33 2022] GET /identity/v3/role_assignments?user.id=a65dd7985eb945cd8d1f4a9daaf45b23&scope.project.id=49dbcc3d743945439063bcfe7fd9d2f7&role.id=31c2fac3eedc4006a84fcd0bee6d22e8 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:02:35.619126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683aeadc-c532-475f-8a9a-e18c761a0e6e None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:35.619686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683aeadc-c532-475f-8a9a-e18c761a0e6e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:35.619686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683aeadc-c532-475f-8a9a-e18c761a0e6e None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:35.621027 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 432/857] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:35.626302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd81737-502d-48b3-9147-d7bd0163495d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:35.626681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd81737-502d-48b3-9147-d7bd0163495d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:35.626853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd81737-502d-48b3-9147-d7bd0163495d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:35.644820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-2dd81737-502d-48b3-9147-d7bd0163495d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:35.646558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2dd81737-502d-48b3-9147-d7bd0163495d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:35.710583 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 426/858] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:35.974529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683aeadc-c532-475f-8a9a-e18c761a0e6e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:36.030003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:36.072629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683aeadc-c532-475f-8a9a-e18c761a0e6e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:36.104489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8885c01-4a95-42f6-b962-404c164f3261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:36.105111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8885c01-4a95-42f6-b962-404c164f3261 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:36.105394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8885c01-4a95-42f6-b962-404c164f3261 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:36.105668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8885c01-4a95-42f6-b962-404c164f3261 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:36.106885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8885c01-4a95-42f6-b962-404c164f3261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:36.108342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8885c01-4a95-42f6-b962-404c164f3261 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:36.109922 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 433/859] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:02:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:36.116142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd81737-502d-48b3-9147-d7bd0163495d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:36.131368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:36.213916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd81737-502d-48b3-9147-d7bd0163495d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:36.246779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004b1fd-aaa5-4c7b-ae55-7271df08ba83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:36.247332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004b1fd-aaa5-4c7b-ae55-7271df08ba83 None admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:36.247612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004b1fd-aaa5-4c7b-ae55-7271df08ba83 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:36.247884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004b1fd-aaa5-4c7b-ae55-7271df08ba83 None admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:36.248543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004b1fd-aaa5-4c7b-ae55-7271df08ba83 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:36.250000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004b1fd-aaa5-4c7b-ae55-7271df08ba83 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:36.339212 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 427/860] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 27 03:02:36 2022] POST /identity/v3/projects => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:02:38.507257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae5a18-847f-4495-8a24-b12fa6f132e4 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:38.507784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae5a18-847f-4495-8a24-b12fa6f132e4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:38.507784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae5a18-847f-4495-8a24-b12fa6f132e4 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:38.509146 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 434/861] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:38.514461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423e82e-8005-4935-8d2f-2e285c2eed0d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:38.514876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423e82e-8005-4935-8d2f-2e285c2eed0d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:38.515015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423e82e-8005-4935-8d2f-2e285c2eed0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:38.532579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-3423e82e-8005-4935-8d2f-2e285c2eed0d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:38.533760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3423e82e-8005-4935-8d2f-2e285c2eed0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:38.589664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:38.597526 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 428/862] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:38.872762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae5a18-847f-4495-8a24-b12fa6f132e4 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:38.967719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae5a18-847f-4495-8a24-b12fa6f132e4 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:38.997644 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:39.008013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de4648-aa8f-4d7a-b82e-1ad497d4e1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:39.008635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de4648-aa8f-4d7a-b82e-1ad497d4e1c9 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:39.008960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de4648-aa8f-4d7a-b82e-1ad497d4e1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:39.009229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de4648-aa8f-4d7a-b82e-1ad497d4e1c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:39.010351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de4648-aa8f-4d7a-b82e-1ad497d4e1c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:39.011806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de4648-aa8f-4d7a-b82e-1ad497d4e1c9 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:39.013352 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 435/863] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:02:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:39.019268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423e82e-8005-4935-8d2f-2e285c2eed0d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:39.113660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423e82e-8005-4935-8d2f-2e285c2eed0d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:39.147166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1feaa-4500-4ef2-be48-1c65420e2181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:39.147703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1feaa-4500-4ef2-be48-1c65420e2181 None admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:39.147987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1feaa-4500-4ef2-be48-1c65420e2181 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:39.148264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1feaa-4500-4ef2-be48-1c65420e2181 None admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:39.148913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1feaa-4500-4ef2-be48-1c65420e2181 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:39.150379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1feaa-4500-4ef2-be48-1c65420e2181 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:39.268339 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 429/864] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 27 03:02:39 2022] POST /identity/v3/users => generated 286 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:02:41.407440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bd744-7333-4513-89f9-ad72b3559b3d None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:41.407955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bd744-7333-4513-89f9-ad72b3559b3d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:41.407955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bd744-7333-4513-89f9-ad72b3559b3d None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:41.409308 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 436/865] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:41.414670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d767c42-9234-4ff0-a2e7-6e6c22d54d6c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:41.415108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d767c42-9234-4ff0-a2e7-6e6c22d54d6c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:41.415208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d767c42-9234-4ff0-a2e7-6e6c22d54d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:41.433437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5d767c42-9234-4ff0-a2e7-6e6c22d54d6c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:41.434731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5d767c42-9234-4ff0-a2e7-6e6c22d54d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:41.478946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:41.499220 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 430/866] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:41.764120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bd744-7333-4513-89f9-ad72b3559b3d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:41.859656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bd744-7333-4513-89f9-ad72b3559b3d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:41.891499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ef378-60bb-4ec7-999a-69e466804311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:41.892106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ef378-60bb-4ec7-999a-69e466804311 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:41.892391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ef378-60bb-4ec7-999a-69e466804311 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:41.892663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ef378-60bb-4ec7-999a-69e466804311 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:41.902186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ef378-60bb-4ec7-999a-69e466804311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:02:41.906913 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-4a6ef378-60bb-4ec7-999a-69e466804311 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:02:41.906913 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:41.906913 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:41.906913 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:41.906913 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:41.906913 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:41.906913 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:41.906913 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:41.906913 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:41.906913 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:41.906913 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:41.906913 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:41.906913 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:02:41.906913 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:02:41.906913 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:02:41.906913 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:02:41.907979 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:02:41.907979 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:02:41.907979 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:02:41.907979 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:02:41.907979 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:41.907979 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:41.907979 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:41.907979 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:41.907979 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:41.907979 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:41.907979 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:41.907979 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:41.907979 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:41.907979 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:41.907979 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:41.907979 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:41.908804 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:41.908804 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:41.908804 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:41.908804 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:41.908804 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:02:41.908804 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:02:41.908804 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:02:41.908804 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:02:41.908804 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:02:41.908804 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:02:41.908804 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:02:41.908804 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:41.908804 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 437/867] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 27 03:02:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:41.914430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d767c42-9234-4ff0-a2e7-6e6c22d54d6c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:42.009268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d767c42-9234-4ff0-a2e7-6e6c22d54d6c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:42.041799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f331a6-a886-4c98-a1bb-3accec986a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:42.042370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f331a6-a886-4c98-a1bb-3accec986a5f None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:42.042653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f331a6-a886-4c98-a1bb-3accec986a5f None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:42.042929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f331a6-a886-4c98-a1bb-3accec986a5f None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:42.043592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f331a6-a886-4c98-a1bb-3accec986a5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:42.043898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f331a6-a886-4c98-a1bb-3accec986a5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:42.045265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f331a6-a886-4c98-a1bb-3accec986a5f None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:42.053563 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 431/868] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:02:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:42.059250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ef378-60bb-4ec7-999a-69e466804311 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:42.109279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:42.153952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ef378-60bb-4ec7-999a-69e466804311 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:42.187283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9ff83-ed54-4073-835e-ec8bb1b41c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:42.187911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9ff83-ed54-4073-835e-ec8bb1b41c14 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:42.188189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9ff83-ed54-4073-835e-ec8bb1b41c14 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:42.188458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9ff83-ed54-4073-835e-ec8bb1b41c14 None admin] PATH_INFO: `/v3/users/8e884c56961549f49c8a5977256a9693` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:42.201896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9ff83-ed54-4073-835e-ec8bb1b41c14 None admin] RBAC: Authorizing `identity:get_user(user_id=8e884c56961549f49c8a5977256a9693)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:42.203352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9ff83-ed54-4073-835e-ec8bb1b41c14 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:42.204934 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 438/869] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:02:42 2022] GET /identity/v3/users/8e884c56961549f49c8a5977256a9693 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:42.210822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f331a6-a886-4c98-a1bb-3accec986a5f None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:42.252898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:42.308981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f331a6-a886-4c98-a1bb-3accec986a5f None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:42.341429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39d98e-ffa3-49c8-b608-2db4ec8f6128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:42.342164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39d98e-ffa3-49c8-b608-2db4ec8f6128 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:42.342445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39d98e-ffa3-49c8-b608-2db4ec8f6128 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:42.342713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39d98e-ffa3-49c8-b608-2db4ec8f6128 None admin] PATH_INFO: `/v3/projects/0c6d198c13a64256826219b439d9d8ea` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:42.343810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39d98e-ffa3-49c8-b608-2db4ec8f6128 None admin] RBAC: Authorizing `identity:get_project(project_id=0c6d198c13a64256826219b439d9d8ea)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:42.345224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39d98e-ffa3-49c8-b608-2db4ec8f6128 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:42.346839 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 432/870] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:02:42 2022] GET /identity/v3/projects/0c6d198c13a64256826219b439d9d8ea => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:42.352797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9ff83-ed54-4073-835e-ec8bb1b41c14 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:42.446954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9ff83-ed54-4073-835e-ec8bb1b41c14 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:42.456917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:42.478445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b181a-3549-4fec-9d5d-08bf7b3495ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:42.479085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b181a-3549-4fec-9d5d-08bf7b3495ad None admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:42.479365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b181a-3549-4fec-9d5d-08bf7b3495ad None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:42.479634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b181a-3549-4fec-9d5d-08bf7b3495ad None admin] PATH_INFO: `/v3/projects/0c6d198c13a64256826219b439d9d8ea/users/8e884c56961549f49c8a5977256a9693/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:42.481755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b181a-3549-4fec-9d5d-08bf7b3495ad None admin] RBAC: Authorizing `identity:create_grant(project_id=0c6d198c13a64256826219b439d9d8ea, user_id=8e884c56961549f49c8a5977256a9693, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:42.483430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b181a-3549-4fec-9d5d-08bf7b3495ad None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:42.543272 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 439/871] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:02:42 2022] PUT /identity/v3/projects/0c6d198c13a64256826219b439d9d8ea/users/8e884c56961549f49c8a5977256a9693/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:02:44.637561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189e3f2-4c9b-4ed0-9780-8e193b7611c8 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:44.638144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189e3f2-4c9b-4ed0-9780-8e193b7611c8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:44.638144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189e3f2-4c9b-4ed0-9780-8e193b7611c8 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:44.639474 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 433/872] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:44.644877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5ecd6-cff1-4514-9dc2-d12e53da6ae3 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:44.645823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5ecd6-cff1-4514-9dc2-d12e53da6ae3 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:44.645913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5ecd6-cff1-4514-9dc2-d12e53da6ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:44.664742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e9d5ecd6-cff1-4514-9dc2-d12e53da6ae3 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:44.665921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e9d5ecd6-cff1-4514-9dc2-d12e53da6ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:44.729355 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 440/873] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:44.994349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189e3f2-4c9b-4ed0-9780-8e193b7611c8 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:45.208506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189e3f2-4c9b-4ed0-9780-8e193b7611c8 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:45.218826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:45.240972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a3a18-c0f4-4df4-a2b5-efbe7de8edfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:45.241591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a3a18-c0f4-4df4-a2b5-efbe7de8edfd None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:45.241873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a3a18-c0f4-4df4-a2b5-efbe7de8edfd None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:45.242178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a3a18-c0f4-4df4-a2b5-efbe7de8edfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:45.251731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a3a18-c0f4-4df4-a2b5-efbe7de8edfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:02:45.257578 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-c51a3a18-c0f4-4df4-a2b5-efbe7de8edfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:02:45.257578 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:45.257578 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:45.257578 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:45.257578 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:45.257578 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:45.257578 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:45.257578 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:45.257578 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:45.257578 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:45.257578 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:45.257578 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:45.257578 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:02:45.257578 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:02:45.257578 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:02:45.257578 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:02:45.258527 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:02:45.258527 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:02:45.258527 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:02:45.258527 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:02:45.258527 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:45.258527 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:45.258527 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:45.258527 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:45.258527 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:45.258527 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:45.258527 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:45.258527 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:45.258527 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:45.258527 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:45.258527 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:45.258527 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:45.259371 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:45.259371 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:45.259371 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:45.259371 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:45.259371 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:02:45.259371 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:02:45.259371 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:02:45.259371 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:02:45.259371 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:02:45.259371 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:02:45.259371 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:02:45.259371 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:02:45.259371 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 434/874] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 27 03:02:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:45.264928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5ecd6-cff1-4514-9dc2-d12e53da6ae3 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:45.354791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:45.357585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5ecd6-cff1-4514-9dc2-d12e53da6ae3 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:45.390808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ed0b0-1cb4-44f4-9d04-e587f90eadb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:45.391403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ed0b0-1cb4-44f4-9d04-e587f90eadb3 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:45.391686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ed0b0-1cb4-44f4-9d04-e587f90eadb3 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:45.391961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ed0b0-1cb4-44f4-9d04-e587f90eadb3 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:45.392620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ed0b0-1cb4-44f4-9d04-e587f90eadb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:45.392926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ed0b0-1cb4-44f4-9d04-e587f90eadb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:45.394307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ed0b0-1cb4-44f4-9d04-e587f90eadb3 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:45.401899 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 441/875] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:02:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:02:45.407650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a3a18-c0f4-4df4-a2b5-efbe7de8edfd None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:45.501261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a3a18-c0f4-4df4-a2b5-efbe7de8edfd None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:45.533331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbdca5-2814-4fe1-8d7a-28fafb5996b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:45.533887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbdca5-2814-4fe1-8d7a-28fafb5996b8 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:45.534195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbdca5-2814-4fe1-8d7a-28fafb5996b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:45.534465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbdca5-2814-4fe1-8d7a-28fafb5996b8 None admin] PATH_INFO: `/v3/users/8e884c56961549f49c8a5977256a9693` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:45.535555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbdca5-2814-4fe1-8d7a-28fafb5996b8 None admin] RBAC: Authorizing `identity:get_user(user_id=8e884c56961549f49c8a5977256a9693)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:45.537503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbdca5-2814-4fe1-8d7a-28fafb5996b8 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:45.539045 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 435/876] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:02:45 2022] GET /identity/v3/users/8e884c56961549f49c8a5977256a9693 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:45.544630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ed0b0-1cb4-44f4-9d04-e587f90eadb3 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:45.639213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ed0b0-1cb4-44f4-9d04-e587f90eadb3 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:45.671459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47de56d-9abf-432b-8cbd-b87d0732191c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:45.672053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47de56d-9abf-432b-8cbd-b87d0732191c None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:45.672318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47de56d-9abf-432b-8cbd-b87d0732191c None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:45.672588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47de56d-9abf-432b-8cbd-b87d0732191c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:45.701351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:45.737864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47de56d-9abf-432b-8cbd-b87d0732191c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:45.739891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47de56d-9abf-432b-8cbd-b87d0732191c None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:45.831036 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 442/877] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:02:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 03:02:45.836783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbdca5-2814-4fe1-8d7a-28fafb5996b8 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:45.874998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:45.931554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbdca5-2814-4fe1-8d7a-28fafb5996b8 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:45.963641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3c505-f08e-4206-9ca9-aada2ee2994c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:45.964251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3c505-f08e-4206-9ca9-aada2ee2994c None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:45.964527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3c505-f08e-4206-9ca9-aada2ee2994c None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:45.964794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3c505-f08e-4206-9ca9-aada2ee2994c None admin] PATH_INFO: `/v3/projects/0c6d198c13a64256826219b439d9d8ea` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:45.965877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3c505-f08e-4206-9ca9-aada2ee2994c None admin] RBAC: Authorizing `identity:get_project(project_id=0c6d198c13a64256826219b439d9d8ea)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:45.967317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3c505-f08e-4206-9ca9-aada2ee2994c None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:45.968892 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 436/878] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:02:45 2022] GET /identity/v3/projects/0c6d198c13a64256826219b439d9d8ea => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:45.975565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47de56d-9abf-432b-8cbd-b87d0732191c None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:46.032761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:46.069717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47de56d-9abf-432b-8cbd-b87d0732191c None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:46.102071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f2718-6280-4475-83de-db585bc83d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:46.102610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f2718-6280-4475-83de-db585bc83d51 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:46.102894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f2718-6280-4475-83de-db585bc83d51 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:46.103169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f2718-6280-4475-83de-db585bc83d51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:46.103898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f2718-6280-4475-83de-db585bc83d51 None admin] RBAC: Adding query filter params (role.id=6e91e7a416ac452b86ec238a2b81bc07, scope.project.id=0c6d198c13a64256826219b439d9d8ea, user.id=8e884c56961549f49c8a5977256a9693) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:46.104209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f2718-6280-4475-83de-db585bc83d51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:46.105622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f2718-6280-4475-83de-db585bc83d51 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:46.111127 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 443/879] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:02:45 2022] GET /identity/v3/role_assignments?user.id=8e884c56961549f49c8a5977256a9693&scope.project.id=0c6d198c13a64256826219b439d9d8ea&role.id=6e91e7a416ac452b86ec238a2b81bc07 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:48.255399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748e168-02b0-435f-bf2e-2c3a64ce5285 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:48.255884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748e168-02b0-435f-bf2e-2c3a64ce5285 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:48.255985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748e168-02b0-435f-bf2e-2c3a64ce5285 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:48.257508 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 437/880] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:48.262685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d84bae-5b3c-4aa4-9c9a-49c62a1fa040 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:48.263066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d84bae-5b3c-4aa4-9c9a-49c62a1fa040 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:48.263244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d84bae-5b3c-4aa4-9c9a-49c62a1fa040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:48.281027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e3d84bae-5b3c-4aa4-9c9a-49c62a1fa040 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:48.282250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e3d84bae-5b3c-4aa4-9c9a-49c62a1fa040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:48.346333 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 444/881] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:48.612376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748e168-02b0-435f-bf2e-2c3a64ce5285 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:48.713712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748e168-02b0-435f-bf2e-2c3a64ce5285 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:48.720937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:48.745931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd732e8-b7a9-46df-85f5-0e8942009a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:48.746548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd732e8-b7a9-46df-85f5-0e8942009a44 None admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:48.746825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd732e8-b7a9-46df-85f5-0e8942009a44 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:48.747091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd732e8-b7a9-46df-85f5-0e8942009a44 None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:48.747753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd732e8-b7a9-46df-85f5-0e8942009a44 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:48.749111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd732e8-b7a9-46df-85f5-0e8942009a44 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:48.817391 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 438/882] 10.222.0.20 () {60 vars in 1138 bytes} [Thu Oct 27 03:02:48 2022] POST /identity/v3/domains => generated 267 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:02:50.970544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e27f98-7571-45f3-b1e6-de3769f2a4ed None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:50.971073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e27f98-7571-45f3-b1e6-de3769f2a4ed None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:50.971073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e27f98-7571-45f3-b1e6-de3769f2a4ed None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:50.972437 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 445/883] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:50.978242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b1dcd-ef27-42ce-be5e-a3e616532551 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:50.978659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b1dcd-ef27-42ce-be5e-a3e616532551 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:50.978792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b1dcd-ef27-42ce-be5e-a3e616532551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:50.996846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-bf9b1dcd-ef27-42ce-be5e-a3e616532551 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:50.998022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bf9b1dcd-ef27-42ce-be5e-a3e616532551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:51.062875 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 439/884] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:51.330307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e27f98-7571-45f3-b1e6-de3769f2a4ed None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:51.385164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:51.427585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e27f98-7571-45f3-b1e6-de3769f2a4ed None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:51.459342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d465aa5-047f-49d8-b04f-2e4319260b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:51.459954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d465aa5-047f-49d8-b04f-2e4319260b8d None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:51.460233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d465aa5-047f-49d8-b04f-2e4319260b8d None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:51.460505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d465aa5-047f-49d8-b04f-2e4319260b8d None admin] PATH_INFO: `/v3/domains/fa9e327d37a24821b015da5f6604d55a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:51.470421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d465aa5-047f-49d8-b04f-2e4319260b8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=fa9e327d37a24821b015da5f6604d55a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:51.471854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d465aa5-047f-49d8-b04f-2e4319260b8d None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:51.473977 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 446/885] 10.222.0.20 () {56 vars in 1183 bytes} [Thu Oct 27 03:02:51 2022] GET /identity/v3/domains/fa9e327d37a24821b015da5f6604d55a => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:51.479674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b1dcd-ef27-42ce-be5e-a3e616532551 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:51.568499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:51.573949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b1dcd-ef27-42ce-be5e-a3e616532551 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:51.606048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13e2f4-deb0-443b-8a56-295113bade98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:51.606592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13e2f4-deb0-443b-8a56-295113bade98 None admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:51.606869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13e2f4-deb0-443b-8a56-295113bade98 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:51.607139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13e2f4-deb0-443b-8a56-295113bade98 None admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:51.607772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13e2f4-deb0-443b-8a56-295113bade98 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:51.609182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13e2f4-deb0-443b-8a56-295113bade98 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:51.698740 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 440/886] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 27 03:02:51 2022] POST /identity/v3/projects => generated 361 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:02:53.854777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac495c2-0fc1-4622-a428-5aa43a58a2d4 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:53.855356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac495c2-0fc1-4622-a428-5aa43a58a2d4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:53.855356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac495c2-0fc1-4622-a428-5aa43a58a2d4 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:53.856672 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 447/887] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:53.861939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b85ab9-7b5c-4d39-9cfd-f25e9e9459c2 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:53.862375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b85ab9-7b5c-4d39-9cfd-f25e9e9459c2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:53.862531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b85ab9-7b5c-4d39-9cfd-f25e9e9459c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:53.880808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-49b85ab9-7b5c-4d39-9cfd-f25e9e9459c2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:53.882300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-49b85ab9-7b5c-4d39-9cfd-f25e9e9459c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:53.945621 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 441/888] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:54.215632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac495c2-0fc1-4622-a428-5aa43a58a2d4 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:54.313534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac495c2-0fc1-4622-a428-5aa43a58a2d4 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:54.328936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:54.346272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9a2ee-4cec-4af6-a840-1cf1fa0a442a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:54.346895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9a2ee-4cec-4af6-a840-1cf1fa0a442a None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:54.347178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9a2ee-4cec-4af6-a840-1cf1fa0a442a None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:54.347451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9a2ee-4cec-4af6-a840-1cf1fa0a442a None admin] PATH_INFO: `/v3/domains/fa9e327d37a24821b015da5f6604d55a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:54.349218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9a2ee-4cec-4af6-a840-1cf1fa0a442a None admin] RBAC: Authorizing `identity:get_domain(domain_id=fa9e327d37a24821b015da5f6604d55a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:54.350670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9a2ee-4cec-4af6-a840-1cf1fa0a442a None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:54.352226 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 448/889] 10.222.0.20 () {56 vars in 1183 bytes} [Thu Oct 27 03:02:54 2022] GET /identity/v3/domains/fa9e327d37a24821b015da5f6604d55a => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:54.357913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b85ab9-7b5c-4d39-9cfd-f25e9e9459c2 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:54.432275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:54.452366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b85ab9-7b5c-4d39-9cfd-f25e9e9459c2 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:54.485707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1af5d-8a26-4fc0-8f9b-3943a39945e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:54.486338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1af5d-8a26-4fc0-8f9b-3943a39945e4 None admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:54.486622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1af5d-8a26-4fc0-8f9b-3943a39945e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:54.486899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1af5d-8a26-4fc0-8f9b-3943a39945e4 None admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:54.487555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1af5d-8a26-4fc0-8f9b-3943a39945e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:54.489030 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1af5d-8a26-4fc0-8f9b-3943a39945e4 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:54.554626 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 442/890] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 27 03:02:54 2022] POST /identity/v3/users => generated 311 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:02:56.695773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04609e62-6c9b-40af-8d82-d4c2b1c8542f None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:56.696328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04609e62-6c9b-40af-8d82-d4c2b1c8542f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:56.696328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04609e62-6c9b-40af-8d82-d4c2b1c8542f None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:56.697657 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 449/891] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:56.702829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f3754-f755-4c67-803e-610c3c25ecfa None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:56.703262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f3754-f755-4c67-803e-610c3c25ecfa None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:56.703361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f3754-f755-4c67-803e-610c3c25ecfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:56.721006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-320f3754-f755-4c67-803e-610c3c25ecfa None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:56.722196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-320f3754-f755-4c67-803e-610c3c25ecfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:02:56.790651 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 443/892] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:02:57.062622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04609e62-6c9b-40af-8d82-d4c2b1c8542f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:57.160084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04609e62-6c9b-40af-8d82-d4c2b1c8542f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:57.196151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a14b67-0313-4105-853d-91c82df242ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:57.196811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a14b67-0313-4105-853d-91c82df242ad None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:57.197094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a14b67-0313-4105-853d-91c82df242ad None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:57.197368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a14b67-0313-4105-853d-91c82df242ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:57.207873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a14b67-0313-4105-853d-91c82df242ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:02:57.212696 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-64a14b67-0313-4105-853d-91c82df242ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:02:57.212696 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:02:57.212696 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:02:57.212696 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:02:57.212696 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:02:57.212696 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:02:57.212696 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:02:57.212696 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:02:57.212696 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:02:57.212696 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:02:57.212696 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:02:57.212696 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:02:57.212696 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:02:57.212696 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:02:57.212696 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:02:57.212696 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:02:57.217726 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:02:57.217726 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:02:57.217726 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:02:57.217726 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:02:57.217726 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:02:57.217726 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:02:57.217726 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:02:57.217726 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:02:57.217726 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:02:57.217726 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:02:57.217726 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:02:57.217726 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:02:57.217726 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:02:57.217726 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:02:57.217726 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:02:57.217726 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:02:57.218683 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:02:57.218683 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:02:57.218683 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:02:57.218683 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:02:57.218683 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:02:57.218683 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:02:57.218683 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:02:57.218683 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:02:57.218683 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:02:57.218683 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:02:57.218683 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:02:57.218683 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:02:57.218683 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 450/893] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 27 03:02:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:02:57.219823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f3754-f755-4c67-803e-610c3c25ecfa None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:57.278765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:57.314618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f3754-f755-4c67-803e-610c3c25ecfa None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:57.347504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c0144-5032-4f6f-9384-c1c0c5d762a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:57.348676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c0144-5032-4f6f-9384-c1c0c5d762a6 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:57.348951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c0144-5032-4f6f-9384-c1c0c5d762a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:57.349222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c0144-5032-4f6f-9384-c1c0c5d762a6 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:57.349873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c0144-5032-4f6f-9384-c1c0c5d762a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:02:57.350217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c0144-5032-4f6f-9384-c1c0c5d762a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:57.351565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c0144-5032-4f6f-9384-c1c0c5d762a6 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:57.359186 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 444/894] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:02:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:57.364902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a14b67-0313-4105-853d-91c82df242ad None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:57.409334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:57.461182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a14b67-0313-4105-853d-91c82df242ad None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:57.493350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f5ad7-c4a1-4c02-9c31-0fecb9f925e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:57.493964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f5ad7-c4a1-4c02-9c31-0fecb9f925e3 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:57.494278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f5ad7-c4a1-4c02-9c31-0fecb9f925e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:57.494554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f5ad7-c4a1-4c02-9c31-0fecb9f925e3 None admin] PATH_INFO: `/v3/users/273a5823a98b4d94a5918b7774b2f81c` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:57.508382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f5ad7-c4a1-4c02-9c31-0fecb9f925e3 None admin] RBAC: Authorizing `identity:get_user(user_id=273a5823a98b4d94a5918b7774b2f81c)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:57.509813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f5ad7-c4a1-4c02-9c31-0fecb9f925e3 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:57.511546 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 451/895] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:02:57 2022] GET /identity/v3/users/273a5823a98b4d94a5918b7774b2f81c => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:57.517136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c0144-5032-4f6f-9384-c1c0c5d762a6 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:57.610639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c0144-5032-4f6f-9384-c1c0c5d762a6 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:57.634950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:57.643552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c40b01-aeb8-4f8a-a859-b82c43ec5da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:57.648041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c40b01-aeb8-4f8a-a859-b82c43ec5da1 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:57.648041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c40b01-aeb8-4f8a-a859-b82c43ec5da1 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:57.648041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c40b01-aeb8-4f8a-a859-b82c43ec5da1 None admin] PATH_INFO: `/v3/projects/83ac30a5fcf14cb9a8bfd79703c320f5` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:57.648041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c40b01-aeb8-4f8a-a859-b82c43ec5da1 None admin] RBAC: Authorizing `identity:get_project(project_id=83ac30a5fcf14cb9a8bfd79703c320f5)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:57.648041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c40b01-aeb8-4f8a-a859-b82c43ec5da1 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:57.649554 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 445/896] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:02:57 2022] GET /identity/v3/projects/83ac30a5fcf14cb9a8bfd79703c320f5 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:02:57.655430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f5ad7-c4a1-4c02-9c31-0fecb9f925e3 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:02:57.748465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f5ad7-c4a1-4c02-9c31-0fecb9f925e3 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:02:57.749934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:02:57.781828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657871d-c041-427f-a349-0b0d05a786b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:02:57.782495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657871d-c041-427f-a349-0b0d05a786b6 None admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:57.782778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657871d-c041-427f-a349-0b0d05a786b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:57.783053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657871d-c041-427f-a349-0b0d05a786b6 None admin] PATH_INFO: `/v3/projects/83ac30a5fcf14cb9a8bfd79703c320f5/users/273a5823a98b4d94a5918b7774b2f81c/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:57.784929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657871d-c041-427f-a349-0b0d05a786b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=83ac30a5fcf14cb9a8bfd79703c320f5, user_id=273a5823a98b4d94a5918b7774b2f81c, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:02:57.786398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657871d-c041-427f-a349-0b0d05a786b6 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:02:57.839923 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 452/897] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:02:57 2022] PUT /identity/v3/projects/83ac30a5fcf14cb9a8bfd79703c320f5/users/273a5823a98b4d94a5918b7774b2f81c/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:02:59.952189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14076a-c98a-41b4-9b62-76afee820fea None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:59.952745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14076a-c98a-41b4-9b62-76afee820fea None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:59.952745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14076a-c98a-41b4-9b62-76afee820fea None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:59.954143 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 446/898] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:02:59.959261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a4f7a-8412-4b8d-885d-5582ad34ec2b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:02:59.959649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a4f7a-8412-4b8d-885d-5582ad34ec2b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:02:59.959805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a4f7a-8412-4b8d-885d-5582ad34ec2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:02:59.977955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-081a4f7a-8412-4b8d-885d-5582ad34ec2b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:02:59.979166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-081a4f7a-8412-4b8d-885d-5582ad34ec2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:03:00.042109 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 453/899] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:02:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:03:00.309869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14076a-c98a-41b4-9b62-76afee820fea None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:03:00.407054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14076a-c98a-41b4-9b62-76afee820fea None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:03:00.438619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b17cd4-8851-4ac8-a640-10ca0045cd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:03:00.439172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b17cd4-8851-4ac8-a640-10ca0045cd77 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:03:00.439454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b17cd4-8851-4ac8-a640-10ca0045cd77 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:03:00.439724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b17cd4-8851-4ac8-a640-10ca0045cd77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:03:00.450179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b17cd4-8851-4ac8-a640-10ca0045cd77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:03:00.454825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-d7b17cd4-8851-4ac8-a640-10ca0045cd77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:03:00.454825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:03:00.454825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:03:00.454825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:03:00.454825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:03:00.454825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:03:00.454825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:03:00.454825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:03:00.454825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:03:00.454825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:03:00.454825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:03:00.454825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:03:00.454825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:03:00.454825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:03:00.454825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:03:00.454825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:03:00.455927 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:03:00.455927 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:03:00.455927 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:03:00.455927 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:03:00.455927 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:03:00.455927 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:03:00.455927 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:03:00.455927 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:03:00.455927 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:03:00.455927 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:03:00.455927 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:03:00.455927 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:03:00.455927 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:03:00.455927 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:03:00.455927 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:03:00.455927 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:03:00.456919 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:03:00.456919 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:03:00.456919 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:03:00.456919 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:03:00.456919 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:03:00.456919 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:03:00.456919 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:03:00.456919 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:03:00.456919 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:03:00.456919 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:03:00.456919 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:03:00.456919 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:03:00.456919 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 447/900] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 27 03:03:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:03:00.461750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a4f7a-8412-4b8d-885d-5582ad34ec2b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:03:00.548011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:03:00.556753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a4f7a-8412-4b8d-885d-5582ad34ec2b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:03:00.588630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855f870-c29c-4abe-b59f-6ae5e487759c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:03:00.589166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855f870-c29c-4abe-b59f-6ae5e487759c None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:03:00.589447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855f870-c29c-4abe-b59f-6ae5e487759c None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:03:00.589724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855f870-c29c-4abe-b59f-6ae5e487759c None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:03:00.590418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855f870-c29c-4abe-b59f-6ae5e487759c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:03:00.590727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855f870-c29c-4abe-b59f-6ae5e487759c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:03:00.592086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855f870-c29c-4abe-b59f-6ae5e487759c None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:03:00.600679 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 454/901] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:03:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:03:00.606522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b17cd4-8851-4ac8-a640-10ca0045cd77 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:03:00.658703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:03:00.702350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b17cd4-8851-4ac8-a640-10ca0045cd77 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:03:00.734436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0230eba-f5d5-422e-a79a-b678d19fde54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:03:00.735058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0230eba-f5d5-422e-a79a-b678d19fde54 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:03:00.735339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0230eba-f5d5-422e-a79a-b678d19fde54 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:03:00.735611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0230eba-f5d5-422e-a79a-b678d19fde54 None admin] PATH_INFO: `/v3/users/273a5823a98b4d94a5918b7774b2f81c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:03:00.736739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0230eba-f5d5-422e-a79a-b678d19fde54 None admin] RBAC: Authorizing `identity:get_user(user_id=273a5823a98b4d94a5918b7774b2f81c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:03:00.738188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0230eba-f5d5-422e-a79a-b678d19fde54 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:03:00.740282 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 448/902] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 27 03:03:00 2022] GET /identity/v3/users/273a5823a98b4d94a5918b7774b2f81c => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:03:00.745945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855f870-c29c-4abe-b59f-6ae5e487759c None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:03:00.842420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855f870-c29c-4abe-b59f-6ae5e487759c None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:03:00.874850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8f6fe-96d1-4a68-bf73-3f32e1a28e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:03:00.875441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8f6fe-96d1-4a68-bf73-3f32e1a28e50 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:03:00.875726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8f6fe-96d1-4a68-bf73-3f32e1a28e50 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:03:00.876001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8f6fe-96d1-4a68-bf73-3f32e1a28e50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:03:00.899532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:03:00.941266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8f6fe-96d1-4a68-bf73-3f32e1a28e50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:03:00.942899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8f6fe-96d1-4a68-bf73-3f32e1a28e50 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:03:01.034206 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 455/903] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:03:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 03:03:01.041361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0230eba-f5d5-422e-a79a-b678d19fde54 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:03:01.141027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0230eba-f5d5-422e-a79a-b678d19fde54 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:03:01.163437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:03:01.174420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b818b-85c5-4166-861e-6f87c44c96ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:03:01.175043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b818b-85c5-4166-861e-6f87c44c96ba None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:03:01.175325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b818b-85c5-4166-861e-6f87c44c96ba None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:03:01.175599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b818b-85c5-4166-861e-6f87c44c96ba None admin] PATH_INFO: `/v3/projects/83ac30a5fcf14cb9a8bfd79703c320f5` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:03:01.176732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b818b-85c5-4166-861e-6f87c44c96ba None admin] RBAC: Authorizing `identity:get_project(project_id=83ac30a5fcf14cb9a8bfd79703c320f5)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:03:01.178204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b818b-85c5-4166-861e-6f87c44c96ba None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:03:01.179847 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 449/904] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 27 03:03:01 2022] GET /identity/v3/projects/83ac30a5fcf14cb9a8bfd79703c320f5 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:03:01.189796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8f6fe-96d1-4a68-bf73-3f32e1a28e50 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:03:01.239593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:03:01.282015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8f6fe-96d1-4a68-bf73-3f32e1a28e50 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:03:01.312947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3864454-6375-49a3-bd8c-b7d57e47a89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:03:01.313534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3864454-6375-49a3-bd8c-b7d57e47a89d None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:03:01.313811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3864454-6375-49a3-bd8c-b7d57e47a89d None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:03:01.314107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3864454-6375-49a3-bd8c-b7d57e47a89d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:03:01.314832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3864454-6375-49a3-bd8c-b7d57e47a89d None admin] RBAC: Adding query filter params (role.id=6e91e7a416ac452b86ec238a2b81bc07, scope.project.id=83ac30a5fcf14cb9a8bfd79703c320f5, user.id=273a5823a98b4d94a5918b7774b2f81c) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:03:01.315140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3864454-6375-49a3-bd8c-b7d57e47a89d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:03:01.317082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3864454-6375-49a3-bd8c-b7d57e47a89d None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:03:01.322564 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 456/905] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:03:01 2022] GET /identity/v3/role_assignments?user.id=273a5823a98b4d94a5918b7774b2f81c&scope.project.id=83ac30a5fcf14cb9a8bfd79703c320f5&role.id=6e91e7a416ac452b86ec238a2b81bc07 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:03:11.205889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:03:11.320089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=41 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:11.784899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc44c46-b8ce-4b7c-99a5-de04398e8ca5 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:11.785488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc44c46-b8ce-4b7c-99a5-de04398e8ca5 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:11.785488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc44c46-b8ce-4b7c-99a5-de04398e8ca5 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:11.786871 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 450/906] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:04:11.792605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c83cab-31e5-4a59-8059-5a46c473a909 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:11.793037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c83cab-31e5-4a59-8059-5a46c473a909 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:11.793129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c83cab-31e5-4a59-8059-5a46c473a909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:11.811782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d4c83cab-31e5-4a59-8059-5a46c473a909 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:04:11.813015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d4c83cab-31e5-4a59-8059-5a46c473a909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:04:11.877345 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 457/907] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:04:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:04:12.145226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc44c46-b8ce-4b7c-99a5-de04398e8ca5 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:12.245397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc44c46-b8ce-4b7c-99a5-de04398e8ca5 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:12.278043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484c539-cbb5-4bbb-9c25-21109caee9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:12.278685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484c539-cbb5-4bbb-9c25-21109caee9d2 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:12.278965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484c539-cbb5-4bbb-9c25-21109caee9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:12.279237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484c539-cbb5-4bbb-9c25-21109caee9d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:12.290023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484c539-cbb5-4bbb-9c25-21109caee9d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:12.291482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484c539-cbb5-4bbb-9c25-21109caee9d2 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:12.305284 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-c484c539-cbb5-4bbb-9c25-21109caee9d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:04:12.305284 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:12.305284 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:04:12.305284 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:04:12.305284 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:04:12.305284 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:04:12.305284 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:04:12.305284 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:04:12.305284 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:04:12.305284 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:04:12.305284 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:04:12.305284 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:04:12.305284 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:04:12.305284 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:04:12.305284 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:04:12.305284 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:04:12.311083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:04:12.311083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:04:12.311083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:04:12.311083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:04:12.311083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:04:12.311083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:04:12.311083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:04:12.311083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:04:12.311083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:04:12.311083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:04:12.311083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:04:12.311083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:04:12.311083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:04:12.311083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:04:12.311083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:04:12.311083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:04:12.311083 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:04:12.312092 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:04:12.312092 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:04:12.312092 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:04:12.312092 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 451/908] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:04:12.312598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c83cab-31e5-4a59-8059-5a46c473a909 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:12.408367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c83cab-31e5-4a59-8059-5a46c473a909 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:12.435080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:12.440800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ffa5b-116f-4f4f-ba49-f2ab791e5c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:12.441605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ffa5b-116f-4f4f-ba49-f2ab791e5c95 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:12.441886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ffa5b-116f-4f4f-ba49-f2ab791e5c95 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:12.442189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ffa5b-116f-4f4f-ba49-f2ab791e5c95 None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:12.442833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ffa5b-116f-4f4f-ba49-f2ab791e5c95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:12.443135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ffa5b-116f-4f4f-ba49-f2ab791e5c95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:12.445012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ffa5b-116f-4f4f-ba49-f2ab791e5c95 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:12.455677 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 458/909] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:12.462215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484c539-cbb5-4bbb-9c25-21109caee9d2 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:12.513215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:12.558906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484c539-cbb5-4bbb-9c25-21109caee9d2 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:12.592780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855adca-7797-4e46-8dbc-ce57d9bea3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:12.593485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855adca-7797-4e46-8dbc-ce57d9bea3d9 None admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:12.593768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855adca-7797-4e46-8dbc-ce57d9bea3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:12.594062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855adca-7797-4e46-8dbc-ce57d9bea3d9 None admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:12.594707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855adca-7797-4e46-8dbc-ce57d9bea3d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:12.596207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855adca-7797-4e46-8dbc-ce57d9bea3d9 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:12.688348 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 452/910] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 27 03:04:12 2022] POST /identity/v3/users => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:04:14.836620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee93cd7-f20a-49c8-8f8c-598169f19183 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:14.837185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee93cd7-f20a-49c8-8f8c-598169f19183 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:14.837185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee93cd7-f20a-49c8-8f8c-598169f19183 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:14.838549 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 459/911] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:04:14.843856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d43ee-0436-44e1-a830-da9713673c89 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:14.844282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d43ee-0436-44e1-a830-da9713673c89 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:14.844420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d43ee-0436-44e1-a830-da9713673c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:14.863716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-2c1d43ee-0436-44e1-a830-da9713673c89 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:04:14.864910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2c1d43ee-0436-44e1-a830-da9713673c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:04:14.929654 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 453/912] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:04:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 03:04:15.204373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee93cd7-f20a-49c8-8f8c-598169f19183 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:15.306190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee93cd7-f20a-49c8-8f8c-598169f19183 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:15.338200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e6810-a723-4b80-a4c4-cf1f80386044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:15.338848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e6810-a723-4b80-a4c4-cf1f80386044 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:15.339123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e6810-a723-4b80-a4c4-cf1f80386044 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:15.339392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e6810-a723-4b80-a4c4-cf1f80386044 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:15.348860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e6810-a723-4b80-a4c4-cf1f80386044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:04:15.354190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-fc1e6810-a723-4b80-a4c4-cf1f80386044 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:04:15.354190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:15.354190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:04:15.354190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:04:15.354190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:04:15.354190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:04:15.354190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:04:15.354190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:04:15.354190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:04:15.354190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:04:15.354190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:04:15.354190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:04:15.354190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:04:15.354190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:04:15.354190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:04:15.354190 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:04:15.355331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:04:15.355331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:04:15.355331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:04:15.355331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:04:15.355331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:04:15.355331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:04:15.355331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:04:15.355331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:04:15.355331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:04:15.355331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:04:15.355331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:04:15.355331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:04:15.355331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:04:15.355331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:04:15.355331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:04:15.355331 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:04:15.356165 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:04:15.356165 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:04:15.356165 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:04:15.356165 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:04:15.356165 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:04:15.356165 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:04:15.356165 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:04:15.356165 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:04:15.356165 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:04:15.356165 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:04:15.356165 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:04:15.356165 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:04:15.356165 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 460/913] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 27 03:04:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:04:15.361461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d43ee-0436-44e1-a830-da9713673c89 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:15.400124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:15.456770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d43ee-0436-44e1-a830-da9713673c89 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:15.489366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72f64b-114d-4fd6-a1ca-c8bae2550458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:15.489964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72f64b-114d-4fd6-a1ca-c8bae2550458 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:15.490271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72f64b-114d-4fd6-a1ca-c8bae2550458 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:15.490569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72f64b-114d-4fd6-a1ca-c8bae2550458 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:15.491228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72f64b-114d-4fd6-a1ca-c8bae2550458 None admin] RBAC: Adding query filter params (name=service) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:15.491528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72f64b-114d-4fd6-a1ca-c8bae2550458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:15.492956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72f64b-114d-4fd6-a1ca-c8bae2550458 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:15.500373 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 454/914] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 27 03:04:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:15.506985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e6810-a723-4b80-a4c4-cf1f80386044 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:15.556611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:15.604054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e6810-a723-4b80-a4c4-cf1f80386044 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:15.635884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912844a-d269-4cf3-8be4-c797f0b5e55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:15.636501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912844a-d269-4cf3-8be4-c797f0b5e55b None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:15.636781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912844a-d269-4cf3-8be4-c797f0b5e55b None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:15.637050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912844a-d269-4cf3-8be4-c797f0b5e55b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:15.648322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912844a-d269-4cf3-8be4-c797f0b5e55b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:15.650357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912844a-d269-4cf3-8be4-c797f0b5e55b None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:15.663805 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-1912844a-d269-4cf3-8be4-c797f0b5e55b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:04:15.663805 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:15.663805 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:04:15.663805 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:04:15.663805 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:04:15.663805 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:04:15.663805 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:04:15.663805 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:04:15.663805 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:04:15.663805 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:04:15.663805 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:04:15.663805 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:04:15.663805 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:04:15.663805 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:04:15.663805 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:04:15.663805 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:04:15.664909 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:04:15.664909 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:04:15.664909 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:04:15.664909 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:04:15.664909 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:04:15.664909 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:04:15.664909 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:04:15.664909 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:04:15.664909 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:04:15.664909 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:04:15.664909 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:04:15.664909 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:04:15.664909 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:04:15.664909 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:04:15.664909 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:04:15.664909 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:04:15.664909 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:04:15.665973 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:04:15.665973 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:04:15.665973 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:04:15.665973 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 461/915] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 03:04:15.670731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72f64b-114d-4fd6-a1ca-c8bae2550458 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:15.770425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:15.773368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72f64b-114d-4fd6-a1ca-c8bae2550458 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:15.805671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9e2cb-a18b-45c8-b156-9ba64fa17159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:15.806294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9e2cb-a18b-45c8-b156-9ba64fa17159 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:15.806578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9e2cb-a18b-45c8-b156-9ba64fa17159 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:15.806849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9e2cb-a18b-45c8-b156-9ba64fa17159 None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:15.807545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9e2cb-a18b-45c8-b156-9ba64fa17159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:15.807842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9e2cb-a18b-45c8-b156-9ba64fa17159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:15.809213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9e2cb-a18b-45c8-b156-9ba64fa17159 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:15.821188 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 455/916] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:15.827100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912844a-d269-4cf3-8be4-c797f0b5e55b None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:15.922946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912844a-d269-4cf3-8be4-c797f0b5e55b None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:15.924413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:15.957420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e662465-edc8-4f07-a8ab-ff7f845bbb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:15.958059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e662465-edc8-4f07-a8ab-ff7f845bbb8b None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:15.958344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e662465-edc8-4f07-a8ab-ff7f845bbb8b None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:15.958622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e662465-edc8-4f07-a8ab-ff7f845bbb8b None admin] PATH_INFO: `/v3/users/placement` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:15.966133 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e662465-edc8-4f07-a8ab-ff7f845bbb8b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:15.979648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e662465-edc8-4f07-a8ab-ff7f845bbb8b None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:15.979648 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-9e662465-edc8-4f07-a8ab-ff7f845bbb8b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 03:04:15.979648 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:15.979648 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:04:15.979648 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:04:15.979648 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:04:15.979648 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:04:15.979648 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:04:15.979648 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:04:15.979648 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:04:15.979648 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:04:15.979648 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:04:15.979648 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:04:15.979648 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:04:15.980654 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:04:15.980654 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:04:15.980654 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:04:15.980654 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:04:15.980654 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:04:15.980654 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:04:15.980654 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:04:15.980654 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:04:15.980654 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:04:15.980654 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:04:15.980654 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:04:15.980654 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:04:15.980654 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:04:15.980654 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:04:15.980654 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:04:15.980654 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:04:15.980654 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:04:15.980654 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:04:15.981866 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:04:15.981866 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:04:15.981866 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:04:15.981866 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:04:15.981866 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:04:15.981866 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:04:15.981866 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:04:15.981866 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:04:15.981866 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:04:15.981866 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:04:15.981866 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:04:15.981866 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 27 03:04:15.981866 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:04:15.981866 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 462/917] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:04:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:04:15.985584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9e2cb-a18b-45c8-b156-9ba64fa17159 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:16.087552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9e2cb-a18b-45c8-b156-9ba64fa17159 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:16.121147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adb7ae-c957-4856-8c58-85e3ed9d991c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:16.121735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adb7ae-c957-4856-8c58-85e3ed9d991c None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:16.122092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adb7ae-c957-4856-8c58-85e3ed9d991c None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:16.122382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adb7ae-c957-4856-8c58-85e3ed9d991c None admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:16.123097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adb7ae-c957-4856-8c58-85e3ed9d991c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:16.123399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adb7ae-c957-4856-8c58-85e3ed9d991c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:16.124846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adb7ae-c957-4856-8c58-85e3ed9d991c None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:16.141723 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 456/918] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Oct 27 03:04:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:16.147698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e662465-edc8-4f07-a8ab-ff7f845bbb8b None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:16.245692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e662465-edc8-4f07-a8ab-ff7f845bbb8b None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:16.277240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12850333-7a43-4ed2-acc9-aa05776b96f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:16.281393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12850333-7a43-4ed2-acc9-aa05776b96f1 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:16.281393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12850333-7a43-4ed2-acc9-aa05776b96f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:16.281393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12850333-7a43-4ed2-acc9-aa05776b96f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:16.288923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12850333-7a43-4ed2-acc9-aa05776b96f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:16.290377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12850333-7a43-4ed2-acc9-aa05776b96f1 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:16.304456 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-12850333-7a43-4ed2-acc9-aa05776b96f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:04:16.304456 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:16.304456 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:04:16.304456 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:04:16.304456 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:04:16.304456 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:04:16.304456 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:04:16.304456 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:04:16.304456 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:04:16.304456 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:04:16.304456 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:04:16.304456 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:04:16.304456 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:04:16.304456 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:04:16.304456 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:04:16.304456 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:04:16.310177 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:04:16.310177 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:04:16.310177 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:04:16.310177 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:04:16.310177 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:04:16.310177 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:04:16.310177 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:04:16.310177 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:04:16.310177 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:04:16.310177 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:04:16.310177 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:04:16.310177 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:04:16.310177 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:04:16.310177 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:04:16.310177 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:04:16.310177 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:04:16.310177 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:04:16.311312 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:04:16.311312 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:04:16.311312 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:04:16.311312 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 463/919] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:04:16.311579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adb7ae-c957-4856-8c58-85e3ed9d991c None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:16.329747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:16.407729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adb7ae-c957-4856-8c58-85e3ed9d991c None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:16.440937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225b832-db4d-4db7-b1ef-07d6281a0a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:16.441537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225b832-db4d-4db7-b1ef-07d6281a0a71 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:16.441863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225b832-db4d-4db7-b1ef-07d6281a0a71 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:16.442159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225b832-db4d-4db7-b1ef-07d6281a0a71 None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:16.442792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225b832-db4d-4db7-b1ef-07d6281a0a71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:16.443091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225b832-db4d-4db7-b1ef-07d6281a0a71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:16.444485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225b832-db4d-4db7-b1ef-07d6281a0a71 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:16.455536 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 457/920] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:16.461334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12850333-7a43-4ed2-acc9-aa05776b96f1 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:16.477683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:16.557807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12850333-7a43-4ed2-acc9-aa05776b96f1 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:16.590998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6f86a-ae64-4ef8-ba89-151dee15b40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:16.591607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6f86a-ae64-4ef8-ba89-151dee15b40e None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:16.591888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6f86a-ae64-4ef8-ba89-151dee15b40e None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:16.592162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6f86a-ae64-4ef8-ba89-151dee15b40e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:16.598685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6f86a-ae64-4ef8-ba89-151dee15b40e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:16.600755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6f86a-ae64-4ef8-ba89-151dee15b40e None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:16.611841 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-eea6f86a-ae64-4ef8-ba89-151dee15b40e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:04:16.611841 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:16.611841 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:04:16.611841 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:04:16.611841 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:04:16.611841 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:04:16.611841 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:04:16.611841 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:04:16.611841 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:04:16.611841 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:04:16.611841 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:04:16.611841 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:04:16.611841 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:04:16.611841 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:04:16.611841 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:04:16.612772 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:04:16.612772 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:04:16.612772 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:04:16.612772 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:04:16.612772 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:04:16.612772 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:04:16.612772 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:04:16.612772 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:04:16.612772 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:04:16.612772 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:04:16.612772 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:04:16.612772 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:04:16.612772 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:04:16.612772 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:04:16.612772 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:04:16.612772 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:04:16.612772 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:04:16.613715 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:04:16.613715 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:04:16.613715 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:04:16.613715 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:04:16.613715 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:04:16.613715 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:04:16.613715 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:04:16.613715 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:04:16.613715 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 464/921] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:04:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:04:16.618932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225b832-db4d-4db7-b1ef-07d6281a0a71 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:16.696501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:16.717098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225b832-db4d-4db7-b1ef-07d6281a0a71 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:16.750313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60ac2e-e601-41d6-ba36-f94927892afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:16.750920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60ac2e-e601-41d6-ba36-f94927892afe None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:16.751200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60ac2e-e601-41d6-ba36-f94927892afe None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:16.751473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60ac2e-e601-41d6-ba36-f94927892afe None admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:16.752174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60ac2e-e601-41d6-ba36-f94927892afe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:16.752481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60ac2e-e601-41d6-ba36-f94927892afe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:16.753915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60ac2e-e601-41d6-ba36-f94927892afe None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:16.766127 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 458/922] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 27 03:04:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:16.772829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6f86a-ae64-4ef8-ba89-151dee15b40e None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:16.847005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:16.870444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6f86a-ae64-4ef8-ba89-151dee15b40e None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:16.902851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d3811-b237-4089-98df-495939167d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:16.903501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d3811-b237-4089-98df-495939167d43 None admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:16.903781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d3811-b237-4089-98df-495939167d43 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:16.904055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d3811-b237-4089-98df-495939167d43 None admin] PATH_INFO: `/v3/projects/1ae07f0abb504c298fc9893b1d8bb173/users/1a395d2414cd4da085a77ddc9b1f1caa/roles/248be75b0cf142299cd46440170c7972` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:16.919909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d3811-b237-4089-98df-495939167d43 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ae07f0abb504c298fc9893b1d8bb173, user_id=1a395d2414cd4da085a77ddc9b1f1caa, role_id=248be75b0cf142299cd46440170c7972)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:16.921334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d3811-b237-4089-98df-495939167d43 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:17.002795 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 465/923] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:04:16 2022] PUT /identity/v3/projects/1ae07f0abb504c298fc9893b1d8bb173/users/1a395d2414cd4da085a77ddc9b1f1caa/roles/248be75b0cf142299cd46440170c7972 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:04:19.141154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0570a6-2900-4eb0-946c-ecef2e1646fb None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:19.141708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0570a6-2900-4eb0-946c-ecef2e1646fb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:19.141708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0570a6-2900-4eb0-946c-ecef2e1646fb None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:19.143049 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 459/924] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:04:19.148477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a1fa7-0a74-482c-a10d-c9ccd96e1aab None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:19.148936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a1fa7-0a74-482c-a10d-c9ccd96e1aab None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:19.149067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a1fa7-0a74-482c-a10d-c9ccd96e1aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:19.167392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-be2a1fa7-0a74-482c-a10d-c9ccd96e1aab None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:04:19.168587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-be2a1fa7-0a74-482c-a10d-c9ccd96e1aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:04:19.235282 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 466/925] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:04:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:04:19.505244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0570a6-2900-4eb0-946c-ecef2e1646fb None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:19.605697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0570a6-2900-4eb0-946c-ecef2e1646fb None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:19.638303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f52f3-27b2-45b5-8366-2b468841bad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:19.639248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f52f3-27b2-45b5-8366-2b468841bad9 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:19.639541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f52f3-27b2-45b5-8366-2b468841bad9 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:19.639817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f52f3-27b2-45b5-8366-2b468841bad9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:19.647002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:19.650821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f52f3-27b2-45b5-8366-2b468841bad9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:04:19.655576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-e87f52f3-27b2-45b5-8366-2b468841bad9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:04:19.655576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:19.655576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:04:19.655576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:04:19.655576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:04:19.655576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:04:19.655576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:04:19.655576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:04:19.655576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:04:19.655576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:04:19.655576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:04:19.655576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:04:19.655576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:04:19.655576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:04:19.655576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:04:19.655576 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:04:19.663852 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:04:19.663852 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:04:19.663852 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:04:19.663852 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:04:19.663852 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:04:19.663852 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:04:19.663852 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:04:19.663852 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:04:19.663852 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:04:19.663852 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:04:19.663852 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:04:19.663852 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:04:19.663852 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:04:19.663852 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:04:19.663852 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:04:19.663852 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:04:19.664918 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:04:19.664918 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:04:19.664918 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:04:19.664918 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:04:19.664918 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:04:19.664918 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:04:19.664918 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:04:19.664918 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:04:19.664918 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:04:19.664918 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:04:19.664918 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 03:04:19.664918 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:04:19.664918 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 460/926] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 27 03:04:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:04:19.665820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a1fa7-0a74-482c-a10d-c9ccd96e1aab None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:19.717479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:19.759781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a1fa7-0a74-482c-a10d-c9ccd96e1aab None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:19.793230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bcdc9-a01c-4190-8a98-b81c48dbe990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:19.793834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bcdc9-a01c-4190-8a98-b81c48dbe990 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:19.794148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bcdc9-a01c-4190-8a98-b81c48dbe990 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:19.794428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bcdc9-a01c-4190-8a98-b81c48dbe990 None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:19.795092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bcdc9-a01c-4190-8a98-b81c48dbe990 None admin] RBAC: Adding query filter params (name=service) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:19.795426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bcdc9-a01c-4190-8a98-b81c48dbe990 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:19.796788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bcdc9-a01c-4190-8a98-b81c48dbe990 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:19.805120 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 467/927] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 27 03:04:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:19.811054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f52f3-27b2-45b5-8366-2b468841bad9 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:19.909752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f52f3-27b2-45b5-8366-2b468841bad9 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:19.942861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538ae01-104b-4b4e-b43d-792a08e00680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:19.943997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538ae01-104b-4b4e-b43d-792a08e00680 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:19.944282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538ae01-104b-4b4e-b43d-792a08e00680 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:19.944551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538ae01-104b-4b4e-b43d-792a08e00680 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:19.954696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538ae01-104b-4b4e-b43d-792a08e00680 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:19.956142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538ae01-104b-4b4e-b43d-792a08e00680 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:19.970884 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-c538ae01-104b-4b4e-b43d-792a08e00680 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:04:19.970884 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:19.970884 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:04:19.970884 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:04:19.970884 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:04:19.970884 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:04:19.970884 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:04:19.970884 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:04:19.970884 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:04:19.970884 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:04:19.970884 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:04:19.970884 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:04:19.970884 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:04:19.970884 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:04:19.970884 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:04:19.970884 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:04:19.971949 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:04:19.971949 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:04:19.971949 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:04:19.971949 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:04:19.971949 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:04:19.971949 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:04:19.971949 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:04:19.971949 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:04:19.971949 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:04:19.971949 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:04:19.971949 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:04:19.971949 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:04:19.971949 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:04:19.971949 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:04:19.971949 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:04:19.971949 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:04:19.971949 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:04:19.973056 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:04:19.973056 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:04:19.973056 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:04:19.973056 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 461/928] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:04:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:04:19.977882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bcdc9-a01c-4190-8a98-b81c48dbe990 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:20.076100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bcdc9-a01c-4190-8a98-b81c48dbe990 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:20.092038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:20.109222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc3358-83a5-4e50-aad3-10635f5335fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:20.109846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc3358-83a5-4e50-aad3-10635f5335fc None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:20.110149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc3358-83a5-4e50-aad3-10635f5335fc None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:20.110426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc3358-83a5-4e50-aad3-10635f5335fc None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:20.111071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc3358-83a5-4e50-aad3-10635f5335fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:20.111378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc3358-83a5-4e50-aad3-10635f5335fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:20.112744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc3358-83a5-4e50-aad3-10635f5335fc None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:20.123913 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 468/929] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:04:20.129657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538ae01-104b-4b4e-b43d-792a08e00680 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:20.179826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:20.230123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538ae01-104b-4b4e-b43d-792a08e00680 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:20.263501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c76ca-89ff-4ce4-bf27-399d39ba8f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:20.264120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c76ca-89ff-4ce4-bf27-399d39ba8f23 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:20.264394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c76ca-89ff-4ce4-bf27-399d39ba8f23 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:20.264665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c76ca-89ff-4ce4-bf27-399d39ba8f23 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:20.271776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c76ca-89ff-4ce4-bf27-399d39ba8f23 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:20.273195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c76ca-89ff-4ce4-bf27-399d39ba8f23 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:20.283872 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-5b3c76ca-89ff-4ce4-bf27-399d39ba8f23 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 03:04:20.283872 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:20.283872 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:04:20.283872 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:04:20.283872 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:04:20.283872 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:04:20.283872 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:04:20.283872 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:04:20.283872 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:04:20.283872 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:04:20.283872 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:04:20.283872 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:04:20.283872 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:04:20.283872 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:04:20.283872 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:04:20.283872 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:04:20.284962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:04:20.284962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:04:20.284962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:04:20.284962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:04:20.284962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:04:20.284962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:04:20.284962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:04:20.284962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:04:20.284962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:04:20.284962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:04:20.284962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:04:20.284962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:04:20.284962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:04:20.284962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:04:20.284962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:04:20.284962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:04:20.284962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:04:20.284962 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:04:20.286076 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:04:20.286076 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:04:20.286076 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:04:20.286076 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:04:20.286076 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:04:20.286076 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:04:20.286076 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:04:20.286076 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:04:20.286076 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 27 03:04:20.286076 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:04:20.286076 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 462/930] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:04:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:04:20.290924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc3358-83a5-4e50-aad3-10635f5335fc None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:20.388768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc3358-83a5-4e50-aad3-10635f5335fc None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:20.421685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2122e-9124-4b18-aa27-1b3c483fccbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:20.422329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2122e-9124-4b18-aa27-1b3c483fccbe None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:20.422617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2122e-9124-4b18-aa27-1b3c483fccbe None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:20.422892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2122e-9124-4b18-aa27-1b3c483fccbe None admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:20.423624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2122e-9124-4b18-aa27-1b3c483fccbe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:20.423931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2122e-9124-4b18-aa27-1b3c483fccbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:20.425375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2122e-9124-4b18-aa27-1b3c483fccbe None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:20.442764 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 469/931] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Oct 27 03:04:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:20.449127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c76ca-89ff-4ce4-bf27-399d39ba8f23 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:20.546357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c76ca-89ff-4ce4-bf27-399d39ba8f23 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:20.556765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:20.579427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c8654-f104-4dbf-ac58-a0eea2487459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:20.580032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c8654-f104-4dbf-ac58-a0eea2487459 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:20.580314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c8654-f104-4dbf-ac58-a0eea2487459 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:20.580588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c8654-f104-4dbf-ac58-a0eea2487459 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:20.647178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c8654-f104-4dbf-ac58-a0eea2487459 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:20.648571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c8654-f104-4dbf-ac58-a0eea2487459 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:20.744178 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 463/932] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:04:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 03:04:20.750021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2122e-9124-4b18-aa27-1b3c483fccbe None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:20.783229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:20.846111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2122e-9124-4b18-aa27-1b3c483fccbe None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:20.879479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a94387-27cd-4309-906c-cf8939cca157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:20.880099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a94387-27cd-4309-906c-cf8939cca157 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:20.880379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a94387-27cd-4309-906c-cf8939cca157 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:20.880906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a94387-27cd-4309-906c-cf8939cca157 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:20.890670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a94387-27cd-4309-906c-cf8939cca157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:20.892107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a94387-27cd-4309-906c-cf8939cca157 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:20.906427 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-65a94387-27cd-4309-906c-cf8939cca157 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:04:20.906427 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:20.906427 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:04:20.906427 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:04:20.906427 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:04:20.906427 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:04:20.906427 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:04:20.906427 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:04:20.906427 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:04:20.906427 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:04:20.906427 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:04:20.906427 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:04:20.906427 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:04:20.906427 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:04:20.906427 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:04:20.906427 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:04:20.907512 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:04:20.907512 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:04:20.907512 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:04:20.907512 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:04:20.907512 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:04:20.907512 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:04:20.907512 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:04:20.907512 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:04:20.907512 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:04:20.907512 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:04:20.907512 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:04:20.907512 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:04:20.907512 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:04:20.907512 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:04:20.907512 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:04:20.907512 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:04:20.907512 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:04:20.908618 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:04:20.908618 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:04:20.908618 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:04:20.908618 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 470/933] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:04:20.913677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c8654-f104-4dbf-ac58-a0eea2487459 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:20.925201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:21.013560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c8654-f104-4dbf-ac58-a0eea2487459 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:21.047487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf71c4-66f9-4f7f-93e3-c76b423d7515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:21.048090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf71c4-66f9-4f7f-93e3-c76b423d7515 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:21.048368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf71c4-66f9-4f7f-93e3-c76b423d7515 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:21.048637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf71c4-66f9-4f7f-93e3-c76b423d7515 None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:21.049273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf71c4-66f9-4f7f-93e3-c76b423d7515 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:21.049575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf71c4-66f9-4f7f-93e3-c76b423d7515 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:21.051025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf71c4-66f9-4f7f-93e3-c76b423d7515 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:21.062140 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 464/934] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:21.067821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a94387-27cd-4309-906c-cf8939cca157 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:21.149955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:21.165743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a94387-27cd-4309-906c-cf8939cca157 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:21.198894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d9b73-0bc4-4526-af70-a16e1ddb925e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:21.199551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d9b73-0bc4-4526-af70-a16e1ddb925e None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:21.199831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d9b73-0bc4-4526-af70-a16e1ddb925e None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:21.200105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d9b73-0bc4-4526-af70-a16e1ddb925e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:21.206781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d9b73-0bc4-4526-af70-a16e1ddb925e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:21.208214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d9b73-0bc4-4526-af70-a16e1ddb925e None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:21.220431 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-977d9b73-0bc4-4526-af70-a16e1ddb925e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:04:21.220431 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:21.220431 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:04:21.220431 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:04:21.220431 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:04:21.220431 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:04:21.220431 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:04:21.220431 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:04:21.220431 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:04:21.220431 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:04:21.220431 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:04:21.220431 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:04:21.220431 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:04:21.220431 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:04:21.220431 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:04:21.226282 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:04:21.226282 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:04:21.226282 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:04:21.226282 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:04:21.226282 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:04:21.226282 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:04:21.226282 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:04:21.226282 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:04:21.226282 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:04:21.226282 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:04:21.226282 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:04:21.226282 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:04:21.226282 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:04:21.226282 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:04:21.226282 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:04:21.226282 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:04:21.226282 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:04:21.227354 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:04:21.227354 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:04:21.227354 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:04:21.227354 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:04:21.227354 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:04:21.227354 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:04:21.227354 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:04:21.227354 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:04:21.227354 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 471/935] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:04:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:04:21.228144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf71c4-66f9-4f7f-93e3-c76b423d7515 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:21.296481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:21.325774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf71c4-66f9-4f7f-93e3-c76b423d7515 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:21.358538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b9f04-1939-4892-a9c1-1db39efeb770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:21.359134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b9f04-1939-4892-a9c1-1db39efeb770 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:21.359415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b9f04-1939-4892-a9c1-1db39efeb770 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:21.359690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b9f04-1939-4892-a9c1-1db39efeb770 None admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:21.360377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b9f04-1939-4892-a9c1-1db39efeb770 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:21.360681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b9f04-1939-4892-a9c1-1db39efeb770 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:21.362132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b9f04-1939-4892-a9c1-1db39efeb770 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:21.373446 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 465/936] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 27 03:04:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:21.379556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d9b73-0bc4-4526-af70-a16e1ddb925e None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:21.479626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d9b73-0bc4-4526-af70-a16e1ddb925e None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:21.511904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec8822-8dad-43c5-af12-74b3bf955c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:21.512504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec8822-8dad-43c5-af12-74b3bf955c93 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:21.512788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec8822-8dad-43c5-af12-74b3bf955c93 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:21.513064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec8822-8dad-43c5-af12-74b3bf955c93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:21.513788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec8822-8dad-43c5-af12-74b3bf955c93 None admin] RBAC: Adding query filter params (role.id=248be75b0cf142299cd46440170c7972, scope.project.id=1ae07f0abb504c298fc9893b1d8bb173, user.id=1a395d2414cd4da085a77ddc9b1f1caa) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:21.514127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec8822-8dad-43c5-af12-74b3bf955c93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:21.515546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec8822-8dad-43c5-af12-74b3bf955c93 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:21.521037 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 472/937] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:04:21 2022] GET /identity/v3/role_assignments?user.id=1a395d2414cd4da085a77ddc9b1f1caa&scope.project.id=1ae07f0abb504c298fc9893b1d8bb173&role.id=248be75b0cf142299cd46440170c7972 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:23.656332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a0e02-474c-49fc-a8a2-a25d49839f0a None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:23.656903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a0e02-474c-49fc-a8a2-a25d49839f0a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:23.656903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a0e02-474c-49fc-a8a2-a25d49839f0a None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:23.658216 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 466/938] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:04:23.663263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be93a37-1558-4924-a55c-77784a788b36 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:23.663627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be93a37-1558-4924-a55c-77784a788b36 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:23.663813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be93a37-1558-4924-a55c-77784a788b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:23.681625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6be93a37-1558-4924-a55c-77784a788b36 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:04:23.682850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6be93a37-1558-4924-a55c-77784a788b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:04:23.685505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:23.747078 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 473/939] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:04:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:04:24.014296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a0e02-474c-49fc-a8a2-a25d49839f0a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:24.113858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a0e02-474c-49fc-a8a2-a25d49839f0a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:24.142720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:24.149256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6f408-a45b-4075-9bbd-adda8ab27ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:24.149894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6f408-a45b-4075-9bbd-adda8ab27ed7 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:24.150208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6f408-a45b-4075-9bbd-adda8ab27ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:24.150482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6f408-a45b-4075-9bbd-adda8ab27ed7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:24.160873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6f408-a45b-4075-9bbd-adda8ab27ed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:04:24.165688 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-98e6f408-a45b-4075-9bbd-adda8ab27ed7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:04:24.165688 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:24.165688 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:04:24.165688 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:04:24.165688 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:04:24.165688 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:04:24.165688 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:04:24.165688 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:04:24.165688 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:04:24.165688 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:04:24.165688 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:04:24.165688 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:04:24.165688 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:04:24.165688 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:04:24.165688 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:04:24.165688 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:04:24.166850 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:04:24.166850 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:04:24.166850 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:04:24.166850 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:04:24.166850 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:04:24.166850 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:04:24.166850 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:04:24.166850 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:04:24.166850 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:04:24.166850 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:04:24.166850 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:04:24.166850 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:04:24.166850 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:04:24.166850 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:04:24.166850 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:04:24.166850 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:04:24.167755 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:04:24.167755 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:04:24.167755 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:04:24.167755 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:04:24.167755 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:04:24.167755 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:04:24.167755 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:04:24.167755 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:04:24.167755 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:04:24.167755 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:04:24.167755 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:04:24.167755 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:04:24.167755 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 467/940] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 27 03:04:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:04:24.172964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be93a37-1558-4924-a55c-77784a788b36 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:24.272505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be93a37-1558-4924-a55c-77784a788b36 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:24.305876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d654b-b849-400c-a5db-55eeb7afe4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:24.306503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d654b-b849-400c-a5db-55eeb7afe4eb None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:24.306781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d654b-b849-400c-a5db-55eeb7afe4eb None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:24.307052 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d654b-b849-400c-a5db-55eeb7afe4eb None admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:24.307704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d654b-b849-400c-a5db-55eeb7afe4eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:24.308004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d654b-b849-400c-a5db-55eeb7afe4eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:24.309352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d654b-b849-400c-a5db-55eeb7afe4eb None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:24.317258 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 474/941] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:04:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:24.323577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6f408-a45b-4075-9bbd-adda8ab27ed7 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:24.421186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6f408-a45b-4075-9bbd-adda8ab27ed7 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:24.454766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe70166-835c-43ce-91ee-b804a583722c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:24.455392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe70166-835c-43ce-91ee-b804a583722c None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:24.455673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe70166-835c-43ce-91ee-b804a583722c None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:24.455943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe70166-835c-43ce-91ee-b804a583722c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:24.465735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe70166-835c-43ce-91ee-b804a583722c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:24.467241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe70166-835c-43ce-91ee-b804a583722c None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:24.481910 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-dfe70166-835c-43ce-91ee-b804a583722c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:04:24.481910 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:24.481910 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:04:24.481910 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:04:24.481910 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:04:24.481910 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:04:24.481910 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:04:24.481910 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:04:24.481910 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:04:24.481910 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:04:24.481910 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:04:24.481910 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:04:24.481910 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:04:24.481910 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:04:24.481910 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:04:24.481910 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:04:24.483087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:04:24.483087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:04:24.483087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:04:24.483087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:04:24.483087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:04:24.483087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:04:24.483087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:04:24.483087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:04:24.483087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:04:24.483087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:04:24.483087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:04:24.483087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:04:24.483087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:04:24.483087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:04:24.483087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:04:24.483087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:04:24.483087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:04:24.484142 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:04:24.484142 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:04:24.484142 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:04:24.484142 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 468/942] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:04:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:04:24.488680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d654b-b849-400c-a5db-55eeb7afe4eb None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:24.492118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:24.585176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d654b-b849-400c-a5db-55eeb7afe4eb None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:24.618048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6b0da-3e0b-46a4-86ac-d264a4fa329e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:24.618659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6b0da-3e0b-46a4-86ac-d264a4fa329e None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:24.618939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6b0da-3e0b-46a4-86ac-d264a4fa329e None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:24.619211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6b0da-3e0b-46a4-86ac-d264a4fa329e None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:24.619846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6b0da-3e0b-46a4-86ac-d264a4fa329e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:24.620148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6b0da-3e0b-46a4-86ac-d264a4fa329e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:24.621505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6b0da-3e0b-46a4-86ac-d264a4fa329e None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:24.633301 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 475/943] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:24.639031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe70166-835c-43ce-91ee-b804a583722c None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:24.682081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:24.736172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe70166-835c-43ce-91ee-b804a583722c None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:24.769335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6a54f-c74f-4e81-9f79-0079fd9f102a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:24.769957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6a54f-c74f-4e81-9f79-0079fd9f102a None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:24.770274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6a54f-c74f-4e81-9f79-0079fd9f102a None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:24.770549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6a54f-c74f-4e81-9f79-0079fd9f102a None admin] PATH_INFO: `/v3/users/placement` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:24.778157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6a54f-c74f-4e81-9f79-0079fd9f102a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:24.780590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6a54f-c74f-4e81-9f79-0079fd9f102a None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:24.791263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-2ab6a54f-c74f-4e81-9f79-0079fd9f102a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 03:04:24.791263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:24.791263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:04:24.791263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:04:24.791263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:04:24.791263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:04:24.791263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:04:24.791263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:04:24.791263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:04:24.791263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:04:24.791263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:04:24.791263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:04:24.791263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:04:24.791263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:04:24.791263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:04:24.791263 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:04:24.792421 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:04:24.792421 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:04:24.792421 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:04:24.792421 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:04:24.792421 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:04:24.792421 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:04:24.792421 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:04:24.792421 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:04:24.792421 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:04:24.792421 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:04:24.792421 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:04:24.792421 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:04:24.792421 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:04:24.792421 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:04:24.792421 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:04:24.792421 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:04:24.792421 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:04:24.792421 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:04:24.793466 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:04:24.793466 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:04:24.793466 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:04:24.793466 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:04:24.793466 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:04:24.793466 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:04:24.793466 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:04:24.793466 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:04:24.793466 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 27 03:04:24.793466 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:04:24.793466 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 469/944] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:04:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:04:24.798433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6b0da-3e0b-46a4-86ac-d264a4fa329e None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:24.860448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:24.896191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6b0da-3e0b-46a4-86ac-d264a4fa329e None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:24.927851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92926994-f2ea-48de-bc22-1519bdd8b74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:24.928453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92926994-f2ea-48de-bc22-1519bdd8b74d None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:24.928733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92926994-f2ea-48de-bc22-1519bdd8b74d None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:24.929006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92926994-f2ea-48de-bc22-1519bdd8b74d None admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:24.929724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92926994-f2ea-48de-bc22-1519bdd8b74d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:24.930028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92926994-f2ea-48de-bc22-1519bdd8b74d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:24.931469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92926994-f2ea-48de-bc22-1519bdd8b74d None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:24.948210 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 476/945] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Oct 27 03:04:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:24.954108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6a54f-c74f-4e81-9f79-0079fd9f102a None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:25.054565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6a54f-c74f-4e81-9f79-0079fd9f102a None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:25.056064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:25.087874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05930741-4f2e-410e-923a-e92dc2bcb014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:25.088503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05930741-4f2e-410e-923a-e92dc2bcb014 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:25.088786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05930741-4f2e-410e-923a-e92dc2bcb014 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:25.089061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05930741-4f2e-410e-923a-e92dc2bcb014 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:25.100495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05930741-4f2e-410e-923a-e92dc2bcb014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:25.101979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05930741-4f2e-410e-923a-e92dc2bcb014 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:25.115951 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-05930741-4f2e-410e-923a-e92dc2bcb014 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:04:25.115951 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:25.115951 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:04:25.115951 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:04:25.115951 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:04:25.115951 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:04:25.115951 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:04:25.115951 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:04:25.115951 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:04:25.115951 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:04:25.115951 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:04:25.115951 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:04:25.115951 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:04:25.115951 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:04:25.115951 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:04:25.115951 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:04:25.117074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:04:25.117074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:04:25.117074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:04:25.117074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:04:25.117074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:04:25.117074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:04:25.117074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:04:25.117074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:04:25.117074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:04:25.117074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:04:25.117074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:04:25.117074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:04:25.117074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:04:25.117074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:04:25.117074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:04:25.117074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:04:25.117074 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:04:25.118214 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:04:25.118214 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:04:25.118214 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:04:25.118214 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 470/946] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:04:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:04:25.122761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92926994-f2ea-48de-bc22-1519bdd8b74d None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:25.226896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92926994-f2ea-48de-bc22-1519bdd8b74d None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:25.246323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:25.260278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34a6db-871c-43d9-9817-5585be817fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:25.260886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34a6db-871c-43d9-9817-5585be817fb7 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:25.261166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34a6db-871c-43d9-9817-5585be817fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:25.261447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34a6db-871c-43d9-9817-5585be817fb7 None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:25.262114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34a6db-871c-43d9-9817-5585be817fb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:25.262419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34a6db-871c-43d9-9817-5585be817fb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:25.263777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34a6db-871c-43d9-9817-5585be817fb7 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:25.275093 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 477/947] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:25.280767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05930741-4f2e-410e-923a-e92dc2bcb014 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:25.388720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05930741-4f2e-410e-923a-e92dc2bcb014 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:25.427416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b94e5c-bfd8-42ac-9da5-62fec2a1ae3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:25.428071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b94e5c-bfd8-42ac-9da5-62fec2a1ae3e None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:25.428354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b94e5c-bfd8-42ac-9da5-62fec2a1ae3e None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:25.428634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b94e5c-bfd8-42ac-9da5-62fec2a1ae3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:25.435454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b94e5c-bfd8-42ac-9da5-62fec2a1ae3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:25.436908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b94e5c-bfd8-42ac-9da5-62fec2a1ae3e None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:25.449433 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-71b94e5c-bfd8-42ac-9da5-62fec2a1ae3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:04:25.449433 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:25.449433 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:04:25.449433 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:04:25.449433 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:04:25.449433 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:04:25.449433 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:04:25.449433 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:04:25.449433 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:04:25.449433 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:04:25.449433 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:04:25.449433 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:04:25.449433 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:04:25.449433 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:04:25.449433 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:04:25.450612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:04:25.450612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:04:25.450612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:04:25.450612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:04:25.450612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:04:25.450612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:04:25.450612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:04:25.450612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:04:25.450612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:04:25.450612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:04:25.450612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:04:25.450612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:04:25.450612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:04:25.450612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:04:25.450612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:04:25.450612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:04:25.450612 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:04:25.451728 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:04:25.451728 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:04:25.451728 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:04:25.451728 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:04:25.451728 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:04:25.451728 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:04:25.451728 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:04:25.451728 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:04:25.451728 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 471/948] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:04:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:04:25.456435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34a6db-871c-43d9-9817-5585be817fb7 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:25.560386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34a6db-871c-43d9-9817-5585be817fb7 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:25.596428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af3a0d-31a2-4817-b587-8a5a1822299b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:25.597054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af3a0d-31a2-4817-b587-8a5a1822299b None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:25.597310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af3a0d-31a2-4817-b587-8a5a1822299b None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:25.597585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af3a0d-31a2-4817-b587-8a5a1822299b None admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:25.598314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af3a0d-31a2-4817-b587-8a5a1822299b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:25.598618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af3a0d-31a2-4817-b587-8a5a1822299b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:25.600044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af3a0d-31a2-4817-b587-8a5a1822299b None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:25.611628 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 478/949] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 27 03:04:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:25.618461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b94e5c-bfd8-42ac-9da5-62fec2a1ae3e None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:25.635324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:25.716557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b94e5c-bfd8-42ac-9da5-62fec2a1ae3e None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:25.749034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abcb61-ff28-40d9-8b6c-10129b89e24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:25.749741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abcb61-ff28-40d9-8b6c-10129b89e24b None admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:25.749964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abcb61-ff28-40d9-8b6c-10129b89e24b None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:25.750270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abcb61-ff28-40d9-8b6c-10129b89e24b None admin] PATH_INFO: `/v3/projects/1ae07f0abb504c298fc9893b1d8bb173/users/1a395d2414cd4da085a77ddc9b1f1caa/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:25.752140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abcb61-ff28-40d9-8b6c-10129b89e24b None admin] RBAC: Authorizing `identity:create_grant(project_id=1ae07f0abb504c298fc9893b1d8bb173, user_id=1a395d2414cd4da085a77ddc9b1f1caa, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:25.753574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abcb61-ff28-40d9-8b6c-10129b89e24b None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:25.808761 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 472/950] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 27 03:04:25 2022] PUT /identity/v3/projects/1ae07f0abb504c298fc9893b1d8bb173/users/1a395d2414cd4da085a77ddc9b1f1caa/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:04:27.916112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02376ebb-47ff-439a-ba62-d5b1b8236502 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:27.916681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02376ebb-47ff-439a-ba62-d5b1b8236502 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:27.916681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02376ebb-47ff-439a-ba62-d5b1b8236502 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:27.918018 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 479/951] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:04:27.923271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3d339-589f-4eb9-976d-5ce638f0272f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:27.930225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3d339-589f-4eb9-976d-5ce638f0272f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:27.930225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3d339-589f-4eb9-976d-5ce638f0272f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:27.941753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9bf3d339-589f-4eb9-976d-5ce638f0272f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:04:27.942999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9bf3d339-589f-4eb9-976d-5ce638f0272f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:04:28.008732 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 473/952] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:04:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:04:28.277678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02376ebb-47ff-439a-ba62-d5b1b8236502 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:28.319603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:28.373665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02376ebb-47ff-439a-ba62-d5b1b8236502 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:28.407342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63baf9b6-3c29-4f25-9a67-0ad71d7985ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:28.407952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63baf9b6-3c29-4f25-9a67-0ad71d7985ba None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:28.408279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63baf9b6-3c29-4f25-9a67-0ad71d7985ba None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:28.408551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63baf9b6-3c29-4f25-9a67-0ad71d7985ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:28.418369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63baf9b6-3c29-4f25-9a67-0ad71d7985ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:04:28.423138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-63baf9b6-3c29-4f25-9a67-0ad71d7985ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:04:28.423138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:28.423138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:04:28.423138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:04:28.423138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:04:28.423138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:04:28.423138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:04:28.423138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:04:28.423138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:04:28.423138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:04:28.423138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:04:28.423138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:04:28.423138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 03:04:28.423138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 03:04:28.423138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 03:04:28.423138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 03:04:28.428248 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:04:28.428248 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:04:28.428248 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:04:28.428248 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:04:28.428248 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:04:28.428248 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:04:28.428248 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:04:28.428248 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:04:28.428248 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:04:28.428248 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:04:28.428248 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:04:28.428248 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:04:28.428248 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:04:28.428248 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:04:28.428248 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:04:28.428248 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:04:28.429240 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:04:28.429240 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:04:28.429240 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:04:28.429240 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:04:28.429240 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:04:28.429240 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:04:28.429240 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:04:28.429240 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:04:28.429240 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:04:28.429240 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:04:28.429240 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 03:04:28.429240 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:04:28.429240 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 480/953] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 27 03:04:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:04:28.430414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3d339-589f-4eb9-976d-5ce638f0272f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:28.433469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:28.527773 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3d339-589f-4eb9-976d-5ce638f0272f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:28.560883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e62d4-1354-46df-ab14-7101de8f7693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:28.561480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e62d4-1354-46df-ab14-7101de8f7693 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:28.561755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e62d4-1354-46df-ab14-7101de8f7693 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:28.562021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e62d4-1354-46df-ab14-7101de8f7693 None admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:28.562704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e62d4-1354-46df-ab14-7101de8f7693 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:28.563004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e62d4-1354-46df-ab14-7101de8f7693 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:28.564372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e62d4-1354-46df-ab14-7101de8f7693 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:28.572750 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 474/954] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 27 03:04:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:28.578815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63baf9b6-3c29-4f25-9a67-0ad71d7985ba None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:28.672712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:28.675720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63baf9b6-3c29-4f25-9a67-0ad71d7985ba None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:28.709551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a416c3-a1ec-4fa4-a10d-ec5284e6e736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:28.710209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a416c3-a1ec-4fa4-a10d-ec5284e6e736 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:28.710496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a416c3-a1ec-4fa4-a10d-ec5284e6e736 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:28.710770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a416c3-a1ec-4fa4-a10d-ec5284e6e736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:28.721034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a416c3-a1ec-4fa4-a10d-ec5284e6e736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:28.724919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a416c3-a1ec-4fa4-a10d-ec5284e6e736 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:28.736675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-86a416c3-a1ec-4fa4-a10d-ec5284e6e736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:04:28.736675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:28.736675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:04:28.736675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:04:28.736675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:04:28.736675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:04:28.736675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:04:28.736675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:04:28.736675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:04:28.736675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:04:28.736675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:04:28.736675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:04:28.736675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:04:28.736675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:04:28.736675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:04:28.736675 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:04:28.737870 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:04:28.737870 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:04:28.737870 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:04:28.737870 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:04:28.737870 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:04:28.737870 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:04:28.737870 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:04:28.737870 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:04:28.737870 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:04:28.737870 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:04:28.737870 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:04:28.737870 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:04:28.737870 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:04:28.737870 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:04:28.737870 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:04:28.737870 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:04:28.737870 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:04:28.738817 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:04:28.738817 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:04:28.738817 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:04:28.738817 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 481/955] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:04:28.744203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e62d4-1354-46df-ab14-7101de8f7693 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:28.808691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:28.842754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e62d4-1354-46df-ab14-7101de8f7693 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:28.876898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6224c-2d28-4702-a1d3-4ca85b767e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:28.877504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6224c-2d28-4702-a1d3-4ca85b767e20 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:28.877803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6224c-2d28-4702-a1d3-4ca85b767e20 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:28.878105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6224c-2d28-4702-a1d3-4ca85b767e20 None admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:28.878749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6224c-2d28-4702-a1d3-4ca85b767e20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:28.879054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6224c-2d28-4702-a1d3-4ca85b767e20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:28.880696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6224c-2d28-4702-a1d3-4ca85b767e20 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:28.892106 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 475/956] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:28.897743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a416c3-a1ec-4fa4-a10d-ec5284e6e736 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:28.994721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a416c3-a1ec-4fa4-a10d-ec5284e6e736 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:29.026188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63379d95-2e46-4c3e-9941-08f4ab96482a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:29.026798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63379d95-2e46-4c3e-9941-08f4ab96482a None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:29.027078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63379d95-2e46-4c3e-9941-08f4ab96482a None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:29.027354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63379d95-2e46-4c3e-9941-08f4ab96482a None admin] PATH_INFO: `/v3/users/placement` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:29.034612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63379d95-2e46-4c3e-9941-08f4ab96482a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:29.036044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63379d95-2e46-4c3e-9941-08f4ab96482a None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:29.047367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-63379d95-2e46-4c3e-9941-08f4ab96482a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 03:04:29.047367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:29.047367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:04:29.047367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:04:29.047367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:04:29.047367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:04:29.047367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:04:29.047367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:04:29.047367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:04:29.047367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:04:29.047367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:04:29.047367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:04:29.047367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:04:29.047367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:04:29.047367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:04:29.047367 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:04:29.048521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:04:29.048521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:04:29.048521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:04:29.048521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:04:29.048521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:04:29.048521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:04:29.048521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:04:29.048521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:04:29.048521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:04:29.048521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:04:29.048521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:04:29.048521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:04:29.048521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:04:29.048521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:04:29.048521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:04:29.048521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:04:29.048521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:04:29.048521 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:04:29.049656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:04:29.049656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:04:29.049656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:04:29.049656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:04:29.049656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:04:29.049656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:04:29.049656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:04:29.049656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:04:29.049656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 27 03:04:29.049656 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:04:29.049656 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 482/957] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:04:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:04:29.054974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6224c-2d28-4702-a1d3-4ca85b767e20 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:29.152172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6224c-2d28-4702-a1d3-4ca85b767e20 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:29.178047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:29.187006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667727b-0c1c-45ce-b849-db6ca2e7c523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:29.187620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667727b-0c1c-45ce-b849-db6ca2e7c523 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:29.187900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667727b-0c1c-45ce-b849-db6ca2e7c523 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:29.188374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667727b-0c1c-45ce-b849-db6ca2e7c523 None admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:29.189103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667727b-0c1c-45ce-b849-db6ca2e7c523 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:29.189412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667727b-0c1c-45ce-b849-db6ca2e7c523 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:29.191008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667727b-0c1c-45ce-b849-db6ca2e7c523 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:29.208563 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 476/958] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Oct 27 03:04:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:29.215444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63379d95-2e46-4c3e-9941-08f4ab96482a None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:29.231376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:29.313612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63379d95-2e46-4c3e-9941-08f4ab96482a None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:29.347092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bf65c-45b2-4cd1-ac67-c41cb289521f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:29.347693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bf65c-45b2-4cd1-ac67-c41cb289521f None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:29.347975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bf65c-45b2-4cd1-ac67-c41cb289521f None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:29.348246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bf65c-45b2-4cd1-ac67-c41cb289521f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:29.413774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262bf65c-45b2-4cd1-ac67-c41cb289521f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:29.415199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262bf65c-45b2-4cd1-ac67-c41cb289521f None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:29.428411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:29.509048 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 483/959] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 27 03:04:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 27 03:04:29.515096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667727b-0c1c-45ce-b849-db6ca2e7c523 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:29.611983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667727b-0c1c-45ce-b849-db6ca2e7c523 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:29.644656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864439b-811f-4bf0-9634-1379679092aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:29.645269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864439b-811f-4bf0-9634-1379679092aa None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:29.645548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864439b-811f-4bf0-9634-1379679092aa None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:29.645818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864439b-811f-4bf0-9634-1379679092aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:29.660100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864439b-811f-4bf0-9634-1379679092aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:29.661550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864439b-811f-4bf0-9634-1379679092aa None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:29.676113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-f864439b-811f-4bf0-9634-1379679092aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:04:29.676113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:29.676113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:04:29.676113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:04:29.676113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:04:29.676113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:04:29.676113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:04:29.676113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:04:29.676113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:04:29.676113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:04:29.676113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:04:29.676113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:04:29.676113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:04:29.676113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:04:29.676113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:04:29.676113 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:04:29.677108 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:04:29.677108 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:04:29.677108 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:04:29.677108 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:04:29.677108 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:04:29.677108 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:04:29.677108 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:04:29.677108 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:04:29.677108 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:04:29.677108 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:04:29.677108 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:04:29.677108 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:04:29.677108 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:04:29.677108 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:04:29.677108 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:04:29.677108 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:04:29.677108 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 03:04:29.677998 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:04:29.677998 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 03:04:29.677998 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:04:29.677998 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 477/960] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:04:29.683089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bf65c-45b2-4cd1-ac67-c41cb289521f None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:29.778191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bf65c-45b2-4cd1-ac67-c41cb289521f None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:29.790720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:29.810630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7b063-3ca5-45d3-805c-82c5c4deac27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:29.811229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7b063-3ca5-45d3-805c-82c5c4deac27 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:29.811507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7b063-3ca5-45d3-805c-82c5c4deac27 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:29.811776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7b063-3ca5-45d3-805c-82c5c4deac27 None admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:29.812446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7b063-3ca5-45d3-805c-82c5c4deac27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:29.812749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7b063-3ca5-45d3-805c-82c5c4deac27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:29.814132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7b063-3ca5-45d3-805c-82c5c4deac27 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:29.826304 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 484/961] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 27 03:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:29.832046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864439b-811f-4bf0-9634-1379679092aa None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:29.866190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:29.928869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864439b-811f-4bf0-9634-1379679092aa None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:29.965021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd8e5c-1567-430e-832c-bb5e4b404b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:29.965650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd8e5c-1567-430e-832c-bb5e4b404b71 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:29.965933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd8e5c-1567-430e-832c-bb5e4b404b71 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:29.966240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd8e5c-1567-430e-832c-bb5e4b404b71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:29.972758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd8e5c-1567-430e-832c-bb5e4b404b71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:29.974265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd8e5c-1567-430e-832c-bb5e4b404b71 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:29.985192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-d5fd8e5c-1567-430e-832c-bb5e4b404b71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:04:29.985192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:29.985192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:04:29.985192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:04:29.985192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:04:29.985192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:04:29.985192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:04:29.985192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:04:29.985192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:04:29.985192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:04:29.985192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:04:29.985192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:04:29.985192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 03:04:29.985192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 03:04:29.985192 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 03:04:29.986762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 03:04:29.986762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:04:29.986762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:04:29.986762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:04:29.986762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:04:29.986762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:04:29.986762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:04:29.986762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:04:29.986762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:04:29.986762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:04:29.986762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:04:29.986762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:04:29.986762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:04:29.986762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:04:29.986762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:04:29.986762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:04:29.986762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:04:29.987780 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 03:04:29.987780 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 03:04:29.987780 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:04:29.987780 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:04:29.987780 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:04:29.987780 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:04:29.987780 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 03:04:29.987780 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:04:29.987780 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 478/962] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 27 03:04:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:04:29.992934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7b063-3ca5-45d3-805c-82c5c4deac27 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:30.089125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7b063-3ca5-45d3-805c-82c5c4deac27 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:30.122308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f9eb2-1c36-4bd1-997a-8acde5fd5421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:30.122927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f9eb2-1c36-4bd1-997a-8acde5fd5421 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:30.123213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f9eb2-1c36-4bd1-997a-8acde5fd5421 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:30.123486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f9eb2-1c36-4bd1-997a-8acde5fd5421 None admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:30.124175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f9eb2-1c36-4bd1-997a-8acde5fd5421 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:30.124480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f9eb2-1c36-4bd1-997a-8acde5fd5421 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:30.125904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f9eb2-1c36-4bd1-997a-8acde5fd5421 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:30.138308 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 485/963] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 27 03:04:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:30.144333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd8e5c-1567-430e-832c-bb5e4b404b71 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:30.237453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:30.244363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd8e5c-1567-430e-832c-bb5e4b404b71 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:30.277237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abbaa2-79b9-4b2d-a6dd-deb1413ecadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:30.277831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abbaa2-79b9-4b2d-a6dd-deb1413ecadc None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:30.278150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abbaa2-79b9-4b2d-a6dd-deb1413ecadc None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:30.278428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abbaa2-79b9-4b2d-a6dd-deb1413ecadc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:30.279148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abbaa2-79b9-4b2d-a6dd-deb1413ecadc None admin] RBAC: Adding query filter params (role.id=6e91e7a416ac452b86ec238a2b81bc07, scope.project.id=1ae07f0abb504c298fc9893b1d8bb173, user.id=1a395d2414cd4da085a77ddc9b1f1caa) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:30.279458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abbaa2-79b9-4b2d-a6dd-deb1413ecadc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:30.280908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abbaa2-79b9-4b2d-a6dd-deb1413ecadc None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:30.289527 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 479/964] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 27 03:04:30 2022] GET /identity/v3/role_assignments?user.id=1a395d2414cd4da085a77ddc9b1f1caa&scope.project.id=1ae07f0abb504c298fc9893b1d8bb173&role.id=6e91e7a416ac452b86ec238a2b81bc07 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:32.443854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec9f50-7ffe-46f9-b30d-fefaf8d2792b None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:32.444354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec9f50-7ffe-46f9-b30d-fefaf8d2792b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:32.444354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec9f50-7ffe-46f9-b30d-fefaf8d2792b None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:32.445752 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 486/965] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:04:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:04:32.451376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543392c9-f497-4d1b-8c3c-b9349b9e8006 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:32.451827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543392c9-f497-4d1b-8c3c-b9349b9e8006 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:32.451827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543392c9-f497-4d1b-8c3c-b9349b9e8006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:32.470194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-543392c9-f497-4d1b-8c3c-b9349b9e8006 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:04:32.471374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-543392c9-f497-4d1b-8c3c-b9349b9e8006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:04:32.543745 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 480/966] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:04:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:04:32.853513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec9f50-7ffe-46f9-b30d-fefaf8d2792b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:32.894809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:32.981138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec9f50-7ffe-46f9-b30d-fefaf8d2792b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:33.016688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebc849-a42a-4fa5-aa09-adf2daf92d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:33.017312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebc849-a42a-4fa5-aa09-adf2daf92d2e None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:33.017590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebc849-a42a-4fa5-aa09-adf2daf92d2e None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:33.017857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebc849-a42a-4fa5-aa09-adf2daf92d2e None admin] PATH_INFO: `/v3/services/placement` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:33.018464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebc849-a42a-4fa5-aa09-adf2daf92d2e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:33.019820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebc849-a42a-4fa5-aa09-adf2daf92d2e None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:33.029118 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-93ebc849-a42a-4fa5-aa09-adf2daf92d2e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 03:04:33.029118 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:33.029118 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:04:33.029118 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:04:33.029118 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:04:33.029118 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:04:33.029118 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:04:33.029118 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:04:33.029118 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 03:04:33.029118 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:04:33.029118 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:04:33.029118 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:04:33.029118 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:33.029118 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:04:33.029118 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:04:33.029118 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:04:33.029118 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:04:33.036097 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:04:33.036097 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:04:33.036097 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:04:33.036097 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:04:33.036097 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:04:33.036097 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:04:33.036097 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:04:33.036097 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:04:33.036097 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:04:33.036097 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:04:33.036097 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:04:33.036097 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:04:33.036097 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:04:33.036097 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:04:33.036097 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:04:33.036097 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:04:33.037824 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:04:33.037824 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:04:33.037824 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:04:33.037824 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:04:33.037824 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:04:33.037824 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:04:33.037824 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:04:33.037824 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:04:33.037824 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:04:33.037824 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:04:33.037824 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:04:33.037824 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:04:33.037824 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 03:04:33.037824 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:04:33.037824 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 487/967] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Oct 27 03:04:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:04:33.038829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543392c9-f497-4d1b-8c3c-b9349b9e8006 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:33.128782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:33.138163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543392c9-f497-4d1b-8c3c-b9349b9e8006 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:33.172522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f746440-c9e2-4023-afa5-238c9ff0b5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:33.173127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f746440-c9e2-4023-afa5-238c9ff0b5f3 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:33.173407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f746440-c9e2-4023-afa5-238c9ff0b5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:33.173680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f746440-c9e2-4023-afa5-238c9ff0b5f3 None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:33.174360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f746440-c9e2-4023-afa5-238c9ff0b5f3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:33.174666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f746440-c9e2-4023-afa5-238c9ff0b5f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:33.176031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f746440-c9e2-4023-afa5-238c9ff0b5f3 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:33.180812 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 481/968] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Oct 27 03:04:33 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:04:33.189821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebc849-a42a-4fa5-aa09-adf2daf92d2e None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:33.280817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:33.286397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebc849-a42a-4fa5-aa09-adf2daf92d2e None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:33.319290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e540a-0ae3-40dc-9245-e7f6550846b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:33.319887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e540a-0ae3-40dc-9245-e7f6550846b0 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:33.320167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e540a-0ae3-40dc-9245-e7f6550846b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:33.320437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e540a-0ae3-40dc-9245-e7f6550846b0 None admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:33.321059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e540a-0ae3-40dc-9245-e7f6550846b0 None admin] RBAC: Adding query filter params (type=placement) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:33.321361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e540a-0ae3-40dc-9245-e7f6550846b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:33.322742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e540a-0ae3-40dc-9245-e7f6550846b0 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:33.326912 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 488/969] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Oct 27 03:04:33 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:35.472538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33515f3-e90c-4018-bd27-88beb5d34272 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:35.473106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33515f3-e90c-4018-bd27-88beb5d34272 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:35.473106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33515f3-e90c-4018-bd27-88beb5d34272 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:35.474432 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 482/970] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:04:35.480096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefec8f-26ae-4c49-8b0c-00b623dc8e70 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:35.480550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefec8f-26ae-4c49-8b0c-00b623dc8e70 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:35.480645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefec8f-26ae-4c49-8b0c-00b623dc8e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:35.499705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-5eefec8f-26ae-4c49-8b0c-00b623dc8e70 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:04:35.500903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5eefec8f-26ae-4c49-8b0c-00b623dc8e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:04:35.570071 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 489/971] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:04:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 03:04:35.833782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33515f3-e90c-4018-bd27-88beb5d34272 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:35.951525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33515f3-e90c-4018-bd27-88beb5d34272 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:35.984423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1125e-4637-4509-95a2-d1653083d7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:35.985024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1125e-4637-4509-95a2-d1653083d7a4 None admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:35.985303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1125e-4637-4509-95a2-d1653083d7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:35.985573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1125e-4637-4509-95a2-d1653083d7a4 None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:35.986246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1125e-4637-4509-95a2-d1653083d7a4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:35.987617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1125e-4637-4509-95a2-d1653083d7a4 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:36.054910 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 483/972] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 27 03:04:35 2022] POST /identity/v3/services => generated 246 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:04:38.250634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7cef2-db99-4123-a3d7-cf79d0680d1d None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:38.251162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7cef2-db99-4123-a3d7-cf79d0680d1d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:38.251162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7cef2-db99-4123-a3d7-cf79d0680d1d None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:38.252547 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 490/973] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:04:38.258301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef4cf9-7d4e-4297-ab81-0a948095ec38 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:38.258713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef4cf9-7d4e-4297-ab81-0a948095ec38 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:38.258845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef4cf9-7d4e-4297-ab81-0a948095ec38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:38.276638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4bef4cf9-7d4e-4297-ab81-0a948095ec38 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:04:38.287368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4bef4cf9-7d4e-4297-ab81-0a948095ec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:04:38.287368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:38.349802 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 484/974] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:04:38 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:04:38.618818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7cef2-db99-4123-a3d7-cf79d0680d1d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:38.707065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:38.716995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7cef2-db99-4123-a3d7-cf79d0680d1d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:38.750086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf65890-6526-4486-84ff-095c0cbed2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:38.750712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf65890-6526-4486-84ff-095c0cbed2bd None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:38.750998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf65890-6526-4486-84ff-095c0cbed2bd None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:38.751386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf65890-6526-4486-84ff-095c0cbed2bd None admin] PATH_INFO: `/v3/services/placement` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:38.751973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf65890-6526-4486-84ff-095c0cbed2bd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:38.753334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf65890-6526-4486-84ff-095c0cbed2bd None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:38.762081 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-ecf65890-6526-4486-84ff-095c0cbed2bd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 03:04:38.762081 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:38.762081 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:04:38.762081 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:04:38.762081 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:04:38.762081 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:04:38.762081 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:04:38.762081 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:04:38.762081 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 03:04:38.762081 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:04:38.762081 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:04:38.762081 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:04:38.762081 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:38.762081 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:04:38.762081 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:04:38.762081 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:04:38.762081 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:04:38.763263 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:04:38.763263 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:04:38.763263 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:04:38.763263 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:04:38.763263 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:04:38.763263 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:04:38.763263 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:04:38.763263 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:04:38.763263 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:04:38.763263 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:04:38.763263 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:04:38.763263 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:04:38.763263 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:04:38.763263 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:04:38.763263 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:04:38.763263 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:04:38.764310 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:04:38.764310 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:04:38.764310 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:04:38.764310 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:04:38.764310 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:04:38.764310 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:04:38.764310 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:04:38.764310 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:04:38.764310 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:04:38.764310 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:04:38.764310 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:04:38.764310 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:04:38.764310 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 03:04:38.764310 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:04:38.764310 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 491/975] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Oct 27 03:04:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:04:38.769207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef4cf9-7d4e-4297-ab81-0a948095ec38 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:38.864383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef4cf9-7d4e-4297-ab81-0a948095ec38 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:38.898087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf8e28-9da1-497b-952c-29fe0a720b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:38.898644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf8e28-9da1-497b-952c-29fe0a720b76 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:38.898924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf8e28-9da1-497b-952c-29fe0a720b76 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:38.899215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf8e28-9da1-497b-952c-29fe0a720b76 None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:38.899826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf8e28-9da1-497b-952c-29fe0a720b76 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:38.900129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf8e28-9da1-497b-952c-29fe0a720b76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:38.901503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf8e28-9da1-497b-952c-29fe0a720b76 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:38.906633 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 485/976] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Oct 27 03:04:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:38.913206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf65890-6526-4486-84ff-095c0cbed2bd None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:39.008673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf65890-6526-4486-84ff-095c0cbed2bd None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:39.041148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb57d2-6c54-470e-8b89-457d5870e185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:39.041737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb57d2-6c54-470e-8b89-457d5870e185 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:39.042020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb57d2-6c54-470e-8b89-457d5870e185 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:39.042321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb57d2-6c54-470e-8b89-457d5870e185 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:39.043019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb57d2-6c54-470e-8b89-457d5870e185 None admin] RBAC: Adding query filter params (interface=public, service_id=1503094737bb4d0a82871adf83b5fa02, region_id=RegionOne) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:39.043327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb57d2-6c54-470e-8b89-457d5870e185 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:39.044675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb57d2-6c54-470e-8b89-457d5870e185 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:39.049513 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 492/977] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Oct 27 03:04:38 2022] GET /identity/v3/endpoints?service_id=1503094737bb4d0a82871adf83b5fa02&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:39.055141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf8e28-9da1-497b-952c-29fe0a720b76 None admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:39.058933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:39.152958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf8e28-9da1-497b-952c-29fe0a720b76 None admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:39.186367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c8303-645d-4351-aeff-b10fb7cc8043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:39.186982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c8303-645d-4351-aeff-b10fb7cc8043 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:39.187264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c8303-645d-4351-aeff-b10fb7cc8043 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:39.187538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c8303-645d-4351-aeff-b10fb7cc8043 None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:39.188146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c8303-645d-4351-aeff-b10fb7cc8043 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:39.189557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c8303-645d-4351-aeff-b10fb7cc8043 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:39.196461 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 486/978] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Oct 27 03:04:39 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:04:41.311425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d884b1-2a63-4457-af79-eb5487db6fe6 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:41.311947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d884b1-2a63-4457-af79-eb5487db6fe6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:41.311947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d884b1-2a63-4457-af79-eb5487db6fe6 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:41.313304 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 493/979] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:04:41.318797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f588e1-3f4a-4d3c-9041-fdb667f96de7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:41.319220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f588e1-3f4a-4d3c-9041-fdb667f96de7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:41.319348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f588e1-3f4a-4d3c-9041-fdb667f96de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:41.337634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f1f588e1-3f4a-4d3c-9041-fdb667f96de7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:04:41.338846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f1f588e1-3f4a-4d3c-9041-fdb667f96de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:04:41.398349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:41.403622 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 487/980] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:04:41 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:04:41.669100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d884b1-2a63-4457-af79-eb5487db6fe6 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:41.687962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:41.768865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d884b1-2a63-4457-af79-eb5487db6fe6 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:41.802265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c068a-bac3-4383-93da-1c16db70e238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:41.802881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c068a-bac3-4383-93da-1c16db70e238 None admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:41.803192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c068a-bac3-4383-93da-1c16db70e238 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:41.803427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c068a-bac3-4383-93da-1c16db70e238 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:41.804000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c068a-bac3-4383-93da-1c16db70e238 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:41.805344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c068a-bac3-4383-93da-1c16db70e238 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:41.813701 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-e23c068a-bac3-4383-93da-1c16db70e238 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 03:04:41.813701 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:41.813701 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:04:41.813701 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:04:41.813701 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:04:41.813701 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:04:41.813701 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:04:41.813701 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:04:41.813701 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 03:04:41.813701 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:04:41.813701 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:04:41.813701 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:04:41.813701 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:04:41.813701 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:04:41.813701 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:04:41.813701 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:04:41.813701 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:04:41.814970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:04:41.814970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:04:41.814970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:04:41.814970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:04:41.814970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:04:41.814970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:04:41.814970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:04:41.814970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:04:41.814970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:04:41.814970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:04:41.814970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:04:41.814970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:04:41.814970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:04:41.814970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:04:41.814970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:04:41.814970 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:04:41.816003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:04:41.816003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:04:41.816003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:04:41.816003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:04:41.816003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:04:41.816003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:04:41.816003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:04:41.816003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:04:41.816003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:04:41.816003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:04:41.816003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:04:41.816003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:04:41.816003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 03:04:41.816003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:04:41.816003 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 494/981] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Oct 27 03:04:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:04:41.821516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f588e1-3f4a-4d3c-9041-fdb667f96de7 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:41.918524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f588e1-3f4a-4d3c-9041-fdb667f96de7 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:41.952057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d725c-86d0-4831-827c-ee30f35c71c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:41.952593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d725c-86d0-4831-827c-ee30f35c71c3 None admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:41.952883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d725c-86d0-4831-827c-ee30f35c71c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:41.953158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d725c-86d0-4831-827c-ee30f35c71c3 None admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:41.953779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d725c-86d0-4831-827c-ee30f35c71c3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:04:41.954112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d725c-86d0-4831-827c-ee30f35c71c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:41.955469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d725c-86d0-4831-827c-ee30f35c71c3 None admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:41.960901 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 488/982] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Oct 27 03:04:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:04:41.966633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c068a-bac3-4383-93da-1c16db70e238 None admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:04:42.044594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:42.061985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c068a-bac3-4383-93da-1c16db70e238 None admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:04:42.094593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58277afd-e0bf-4e91-8ea9-82286d8e6557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:04:42.095186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58277afd-e0bf-4e91-8ea9-82286d8e6557 None admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:04:42.095462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58277afd-e0bf-4e91-8ea9-82286d8e6557 None admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:04:42.095730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58277afd-e0bf-4e91-8ea9-82286d8e6557 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:04:42.096383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58277afd-e0bf-4e91-8ea9-82286d8e6557 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:04:42.097721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58277afd-e0bf-4e91-8ea9-82286d8e6557 None admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:04:42.161571 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 495/983] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:04:41 2022] POST /identity/v3/endpoints => generated 331 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:04:51.957430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=69 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:04:52.157042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:10:35.570762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f4776-f4ff-492c-8466-15e2aa418710 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:35.571234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f4776-f4ff-492c-8466-15e2aa418710 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:35.571324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f4776-f4ff-492c-8466-15e2aa418710 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:35.572648 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 489/984] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:10:35.578262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1e126-0ba5-4faf-a21a-299a82217485 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:35.578672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1e126-0ba5-4faf-a21a-299a82217485 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:35.578870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1e126-0ba5-4faf-a21a-299a82217485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:35.698861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-87a1e126-0ba5-4faf-a21a-299a82217485 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:10:35.700011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-87a1e126-0ba5-4faf-a21a-299a82217485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:10:35.834504 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 496/985] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:10:36.124098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d22dff-28bf-451a-ad7a-224d6a8604ce None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:36.124722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d22dff-28bf-451a-ad7a-224d6a8604ce None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:36.125210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d22dff-28bf-451a-ad7a-224d6a8604ce None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:36.127136 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 490/986] 10.222.0.20 () {54 vars in 965 bytes} [Thu Oct 27 03:10:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:10:36.132774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f9583-a0ab-4936-aa08-0eec9db3cc67 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:36.137294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f9583-a0ab-4936-aa08-0eec9db3cc67 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:36.137294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f9583-a0ab-4936-aa08-0eec9db3cc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:36.221986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-143f9583-a0ab-4936-aa08-0eec9db3cc67 None None] MFA Rules not processed for user `9b359391fbc34c259d987e42e8826c86`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:10:36.223353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-143f9583-a0ab-4936-aa08-0eec9db3cc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:10:36.246795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:10:36.306726 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 497/987] 10.222.0.20 () {58 vars in 1062 bytes} [Thu Oct 27 03:10:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:10:36.315811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d22dff-28bf-451a-ad7a-224d6a8604ce None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:10:36.317934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-48d22dff-28bf-451a-ad7a-224d6a8604ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:10:36.450584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d22dff-28bf-451a-ad7a-224d6a8604ce None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:10:36.541644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349c926-9a6b-4ff4-87e5-6ce2d64710ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:10:36.542283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349c926-9a6b-4ff4-87e5-6ce2d64710ea service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:36.542569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349c926-9a6b-4ff4-87e5-6ce2d64710ea service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:36.542848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349c926-9a6b-4ff4-87e5-6ce2d64710ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:36.544553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1349c926-9a6b-4ff4-87e5-6ce2d64710ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:10:36.622929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:10:36.688544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349c926-9a6b-4ff4-87e5-6ce2d64710ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:10:36.690013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349c926-9a6b-4ff4-87e5-6ce2d64710ea service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:10:36.711908 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 491/988] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:10:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:10:39.180171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c1886-4539-4e36-9af4-b55f35f6acda None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:39.180695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c1886-4539-4e36-9af4-b55f35f6acda None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:39.180773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c1886-4539-4e36-9af4-b55f35f6acda None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:39.182327 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 498/989] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:10:39.188068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7665ae1-4159-474d-bac6-bd7c913b51ab None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:39.188531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7665ae1-4159-474d-bac6-bd7c913b51ab None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:39.188624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7665ae1-4159-474d-bac6-bd7c913b51ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:39.264269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c7665ae1-4159-474d-bac6-bd7c913b51ab None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:10:39.265486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c7665ae1-4159-474d-bac6-bd7c913b51ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:10:39.359911 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 492/990] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:10:39.657528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036293b3-8363-45fd-8ac8-660cd7147515 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:39.657852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036293b3-8363-45fd-8ac8-660cd7147515 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:39.658166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036293b3-8363-45fd-8ac8-660cd7147515 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:39.659520 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 499/991] 10.222.0.20 () {54 vars in 965 bytes} [Thu Oct 27 03:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:10:39.665212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bec409-4291-4020-a6e5-60a8b54982bb None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:39.665496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bec409-4291-4020-a6e5-60a8b54982bb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:39.665771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bec409-4291-4020-a6e5-60a8b54982bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:39.677858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:10:39.742640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-75bec409-4291-4020-a6e5-60a8b54982bb None None] MFA Rules not processed for user `9b359391fbc34c259d987e42e8826c86`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:10:39.743843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-75bec409-4291-4020-a6e5-60a8b54982bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:10:39.818805 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 493/992] 10.222.0.20 () {58 vars in 1062 bytes} [Thu Oct 27 03:10:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:10:39.827539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036293b3-8363-45fd-8ac8-660cd7147515 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:10:39.829112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-036293b3-8363-45fd-8ac8-660cd7147515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:10:39.932138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036293b3-8363-45fd-8ac8-660cd7147515 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:10:40.001880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:10:40.004117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc32e12-bda4-4099-b081-f464680d98f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:10:40.004782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc32e12-bda4-4099-b081-f464680d98f4 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:40.005064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc32e12-bda4-4099-b081-f464680d98f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:40.005339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc32e12-bda4-4099-b081-f464680d98f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:40.006977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3dc32e12-bda4-4099-b081-f464680d98f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:10:40.112691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc32e12-bda4-4099-b081-f464680d98f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:10:40.114815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc32e12-bda4-4099-b081-f464680d98f4 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:10:40.132631 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 500/993] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:10:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:10:42.988648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc0983-bb88-491e-a2c5-4d2f554bc7d4 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:42.989789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc0983-bb88-491e-a2c5-4d2f554bc7d4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:42.989789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc0983-bb88-491e-a2c5-4d2f554bc7d4 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:42.991147 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 494/994] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:10:42.996307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a90d9-7cfb-452b-8f0b-27704c96215a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:42.996727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a90d9-7cfb-452b-8f0b-27704c96215a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:42.996900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a90d9-7cfb-452b-8f0b-27704c96215a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:43.062167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0a7a90d9-7cfb-452b-8f0b-27704c96215a None None] MFA Rules not processed for user `424dced1baf54e1892a377e81493f665`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:10:43.063365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0a7a90d9-7cfb-452b-8f0b-27704c96215a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:10:43.112766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:10:43.156621 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 501/995] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:10:42 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:10:43.436498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc0983-bb88-491e-a2c5-4d2f554bc7d4 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:10:43.438092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-36bc0983-bb88-491e-a2c5-4d2f554bc7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:10:43.538532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc0983-bb88-491e-a2c5-4d2f554bc7d4 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:10:43.541271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:10:43.609484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3de284-14f0-4de1-8f8d-4fd709fc0ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:10:43.610105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3de284-14f0-4de1-8f8d-4fd709fc0ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:43.610390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3de284-14f0-4de1-8f8d-4fd709fc0ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:43.610661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3de284-14f0-4de1-8f8d-4fd709fc0ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:43.612237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-df3de284-14f0-4de1-8f8d-4fd709fc0ee9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:10:43.717647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3de284-14f0-4de1-8f8d-4fd709fc0ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:10:43.719138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3de284-14f0-4de1-8f8d-4fd709fc0ee9 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:10:43.736684 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 495/996] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:10:43 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:10:46.724159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a4479-8116-4ed7-ac18-419dc5a3f994 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:46.724719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a4479-8116-4ed7-ac18-419dc5a3f994 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:46.724719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a4479-8116-4ed7-ac18-419dc5a3f994 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:46.726063 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 502/997] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:10:46.731280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d972e-57f3-4321-9101-3ca7e48ea4b4 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:46.731681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d972e-57f3-4321-9101-3ca7e48ea4b4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:46.731844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d972e-57f3-4321-9101-3ca7e48ea4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:46.773109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:10:46.797514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-511d972e-57f3-4321-9101-3ca7e48ea4b4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:10:46.798760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-511d972e-57f3-4321-9101-3ca7e48ea4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:10:46.892987 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 496/998] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:10:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:10:47.180957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a4479-8116-4ed7-ac18-419dc5a3f994 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:10:47.182518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5c4a4479-8116-4ed7-ac18-419dc5a3f994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:10:47.281808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a4479-8116-4ed7-ac18-419dc5a3f994 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:10:47.352365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c89dd0-43c6-4a2e-a1c1-a21b99049c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:10:47.352958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c89dd0-43c6-4a2e-a1c1-a21b99049c3b service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:47.353236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c89dd0-43c6-4a2e-a1c1-a21b99049c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:47.353504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c89dd0-43c6-4a2e-a1c1-a21b99049c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:47.355113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d4c89dd0-43c6-4a2e-a1c1-a21b99049c3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:10:47.361699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:10:47.459323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c89dd0-43c6-4a2e-a1c1-a21b99049c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:10:47.460740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c89dd0-43c6-4a2e-a1c1-a21b99049c3b service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:10:47.477852 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 503/999] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:10:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:10:50.530965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01ea3c-6576-498d-a235-5c761b2b2e76 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:50.531541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01ea3c-6576-498d-a235-5c761b2b2e76 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:50.531541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01ea3c-6576-498d-a235-5c761b2b2e76 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:50.532839 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 497/1000] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:10:50.538835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f190c9e-8255-4f72-b9eb-348d5961359a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:50.539275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f190c9e-8255-4f72-b9eb-348d5961359a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:50.539536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f190c9e-8255-4f72-b9eb-348d5961359a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:50.605236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8f190c9e-8255-4f72-b9eb-348d5961359a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:10:50.606479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8f190c9e-8255-4f72-b9eb-348d5961359a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:10:50.674726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:10:50.717328 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 504/1001] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:10:51.004764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01ea3c-6576-498d-a235-5c761b2b2e76 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:10:51.006317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1d01ea3c-6576-498d-a235-5c761b2b2e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:10:51.108162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01ea3c-6576-498d-a235-5c761b2b2e76 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:10:51.120822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:10:51.184345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468935e2-71bb-4233-b1c8-93df8868d55c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:10:51.185836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468935e2-71bb-4233-b1c8-93df8868d55c service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:51.186203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468935e2-71bb-4233-b1c8-93df8868d55c service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:51.186484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468935e2-71bb-4233-b1c8-93df8868d55c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:51.188135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-468935e2-71bb-4233-b1c8-93df8868d55c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:10:51.296653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468935e2-71bb-4233-b1c8-93df8868d55c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:10:51.298145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468935e2-71bb-4233-b1c8-93df8868d55c service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:10:51.316386 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 498/1002] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:10:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:10:53.538666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5cc33-d028-4b92-8e34-9459bbf95771 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:53.539197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5cc33-d028-4b92-8e34-9459bbf95771 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:53.539197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5cc33-d028-4b92-8e34-9459bbf95771 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:53.540725 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 505/1003] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:10:53.545932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30819fcf-3ab6-4daf-b3c6-be2883555e33 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:53.546379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30819fcf-3ab6-4daf-b3c6-be2883555e33 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:53.546511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30819fcf-3ab6-4daf-b3c6-be2883555e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:53.595115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:10:53.612412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-30819fcf-3ab6-4daf-b3c6-be2883555e33 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:10:53.622892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-30819fcf-3ab6-4daf-b3c6-be2883555e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:10:53.719330 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 499/1004] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:10:54.002614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5cc33-d028-4b92-8e34-9459bbf95771 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:10:54.004141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5fb5cc33-d028-4b92-8e34-9459bbf95771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:10:54.109999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5cc33-d028-4b92-8e34-9459bbf95771 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:10:54.187223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde4c02-154c-411b-9a5e-85e241c08b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:10:54.187839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde4c02-154c-411b-9a5e-85e241c08b81 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:54.188144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde4c02-154c-411b-9a5e-85e241c08b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:54.188418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde4c02-154c-411b-9a5e-85e241c08b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:54.190106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cfde4c02-154c-411b-9a5e-85e241c08b81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:10:54.207417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:10:54.305235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde4c02-154c-411b-9a5e-85e241c08b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:10:54.306626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde4c02-154c-411b-9a5e-85e241c08b81 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:10:54.324401 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 506/1005] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:10:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:10:56.525912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce74c85-f7bb-498a-b1b7-6c7f3defef68 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:56.526436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce74c85-f7bb-498a-b1b7-6c7f3defef68 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:56.526436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce74c85-f7bb-498a-b1b7-6c7f3defef68 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:56.527750 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 500/1006] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:10:56.532937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b6ba3-85e4-4509-9158-0fcf46735f32 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:56.533317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b6ba3-85e4-4509-9158-0fcf46735f32 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:56.533502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b6ba3-85e4-4509-9158-0fcf46735f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:56.598832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a66b6ba3-85e4-4509-9158-0fcf46735f32 None None] MFA Rules not processed for user `424dced1baf54e1892a377e81493f665`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:10:56.600025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a66b6ba3-85e4-4509-9158-0fcf46735f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:10:56.667234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:10:56.697770 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 507/1007] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:10:56 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:10:56.979241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce74c85-f7bb-498a-b1b7-6c7f3defef68 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:10:56.980825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4ce74c85-f7bb-498a-b1b7-6c7f3defef68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:10:57.089329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce74c85-f7bb-498a-b1b7-6c7f3defef68 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:10:57.109691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:10:57.163167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fedaf-1d7f-4242-adb6-813456fe9507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:10:57.163690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fedaf-1d7f-4242-adb6-813456fe9507 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:57.163963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fedaf-1d7f-4242-adb6-813456fe9507 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:57.164229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fedaf-1d7f-4242-adb6-813456fe9507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:57.165822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-065fedaf-1d7f-4242-adb6-813456fe9507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:10:57.277377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fedaf-1d7f-4242-adb6-813456fe9507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:10:57.278869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fedaf-1d7f-4242-adb6-813456fe9507 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:10:57.296493 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 501/1008] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:10:56 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:10:59.907987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764643cc-3d89-468e-a91b-3f99e12f1ffd None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:59.908522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764643cc-3d89-468e-a91b-3f99e12f1ffd None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:59.908522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764643cc-3d89-468e-a91b-3f99e12f1ffd None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:59.909814 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 508/1009] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:10:59.915474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce86f1-7749-44f0-8b1a-69f4538a5745 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:10:59.915892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce86f1-7749-44f0-8b1a-69f4538a5745 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:10:59.916093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce86f1-7749-44f0-8b1a-69f4538a5745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:10:59.978693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:10:59.981362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-90ce86f1-7749-44f0-8b1a-69f4538a5745 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:10:59.982596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-90ce86f1-7749-44f0-8b1a-69f4538a5745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:00.078375 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 502/1010] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:11:00.355539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764643cc-3d89-468e-a91b-3f99e12f1ffd None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:11:00.357079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-764643cc-3d89-468e-a91b-3f99e12f1ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:00.457450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764643cc-3d89-468e-a91b-3f99e12f1ffd None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:11:00.528388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b82bc-9b6c-40ff-863f-4ed252b845ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:11:00.528986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b82bc-9b6c-40ff-863f-4ed252b845ef service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:00.529263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b82bc-9b6c-40ff-863f-4ed252b845ef service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:00.529544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b82bc-9b6c-40ff-863f-4ed252b845ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:00.531140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-be9b82bc-9b6c-40ff-863f-4ed252b845ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:00.557924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:00.637281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b82bc-9b6c-40ff-863f-4ed252b845ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:11:00.638740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b82bc-9b6c-40ff-863f-4ed252b845ef service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:11:00.656604 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 509/1011] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:11:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:11:02.873389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c809b87-5c69-42e3-8eee-59a91b159eeb None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:02.873904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c809b87-5c69-42e3-8eee-59a91b159eeb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:02.873904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c809b87-5c69-42e3-8eee-59a91b159eeb None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:02.875219 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 503/1012] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:11:02.881138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98735259-5c36-42fd-a62b-eb927504e7af None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:02.881554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98735259-5c36-42fd-a62b-eb927504e7af None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:02.881694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98735259-5c36-42fd-a62b-eb927504e7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:02.946989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-98735259-5c36-42fd-a62b-eb927504e7af None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:11:02.948193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-98735259-5c36-42fd-a62b-eb927504e7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:03.022907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:03.044280 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 510/1013] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:11:03.328425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c809b87-5c69-42e3-8eee-59a91b159eeb None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:11:03.329970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5c809b87-5c69-42e3-8eee-59a91b159eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:03.430864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c809b87-5c69-42e3-8eee-59a91b159eeb None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:11:03.458536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:03.501577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a1c38-1a4c-468b-8f90-996410c62692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:11:03.502203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a1c38-1a4c-468b-8f90-996410c62692 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:03.502486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a1c38-1a4c-468b-8f90-996410c62692 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:03.502760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a1c38-1a4c-468b-8f90-996410c62692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:03.504950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-628a1c38-1a4c-468b-8f90-996410c62692 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:03.609589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a1c38-1a4c-468b-8f90-996410c62692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:11:03.611058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a1c38-1a4c-468b-8f90-996410c62692 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:11:03.628877 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 504/1014] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:11:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:11:06.323163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c10c2-5dd9-413d-bad0-f3592b04d23f None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:06.323683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c10c2-5dd9-413d-bad0-f3592b04d23f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:06.323768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c10c2-5dd9-413d-bad0-f3592b04d23f None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:06.325052 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 511/1015] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:11:06.330346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671124e9-4e09-4d0b-b912-a54e29aec38e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:06.330750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671124e9-4e09-4d0b-b912-a54e29aec38e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:06.330854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671124e9-4e09-4d0b-b912-a54e29aec38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:06.397397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-671124e9-4e09-4d0b-b912-a54e29aec38e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:11:06.398640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-671124e9-4e09-4d0b-b912-a54e29aec38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:06.406794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:06.493526 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 505/1016] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:11:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:11:06.776906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c10c2-5dd9-413d-bad0-f3592b04d23f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:11:06.778477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3c1c10c2-5dd9-413d-bad0-f3592b04d23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:06.879384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c10c2-5dd9-413d-bad0-f3592b04d23f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:11:06.950643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf80ac9-5894-4e44-b855-9dc8aae0cad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:11:06.951252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf80ac9-5894-4e44-b855-9dc8aae0cad2 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:06.951531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf80ac9-5894-4e44-b855-9dc8aae0cad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:06.951805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf80ac9-5894-4e44-b855-9dc8aae0cad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:06.953395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ebf80ac9-5894-4e44-b855-9dc8aae0cad2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:06.989460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:07.061679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf80ac9-5894-4e44-b855-9dc8aae0cad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:11:07.063083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf80ac9-5894-4e44-b855-9dc8aae0cad2 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:11:07.081461 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 512/1017] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:11:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:11:11.433953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36993337-bb1c-4b58-93ac-24f0a9d4e22c None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:11.434523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36993337-bb1c-4b58-93ac-24f0a9d4e22c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:11.434523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36993337-bb1c-4b58-93ac-24f0a9d4e22c None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:11.435864 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 506/1018] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:11:11.441328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e46af-ce1e-43d8-a70a-fc081ae6ed7d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:11.441733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e46af-ce1e-43d8-a70a-fc081ae6ed7d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:11.441870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e46af-ce1e-43d8-a70a-fc081ae6ed7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:11.508672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-fe0e46af-ce1e-43d8-a70a-fc081ae6ed7d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:11:11.509886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fe0e46af-ce1e-43d8-a70a-fc081ae6ed7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:11.595144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:11.606395 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 513/1019] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:11:11.889306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36993337-bb1c-4b58-93ac-24f0a9d4e22c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:11:11.890887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-36993337-bb1c-4b58-93ac-24f0a9d4e22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:11.996478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36993337-bb1c-4b58-93ac-24f0a9d4e22c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:11:12.036023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:12.071350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c83525-124b-4198-8106-03835b71a31c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:11:12.071964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c83525-124b-4198-8106-03835b71a31c service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:12.072244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c83525-124b-4198-8106-03835b71a31c service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:12.072511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c83525-124b-4198-8106-03835b71a31c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:12.074137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-99c83525-124b-4198-8106-03835b71a31c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:12.181770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c83525-124b-4198-8106-03835b71a31c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:11:12.183265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c83525-124b-4198-8106-03835b71a31c service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:11:12.202351 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 507/1020] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:11:15.327941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1923b14-41eb-4df0-884e-2fe37175c92e None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:15.328493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1923b14-41eb-4df0-884e-2fe37175c92e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:15.328586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1923b14-41eb-4df0-884e-2fe37175c92e None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:15.329930 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 514/1021] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:11:15.335307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ac249-de29-4f3f-9fd0-d315c0b05773 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:15.335747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ac249-de29-4f3f-9fd0-d315c0b05773 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:15.335863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ac249-de29-4f3f-9fd0-d315c0b05773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:15.401747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-873ac249-de29-4f3f-9fd0-d315c0b05773 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:11:15.402993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-873ac249-de29-4f3f-9fd0-d315c0b05773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:15.421236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:15.503021 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 508/1022] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:11:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:11:15.792383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1923b14-41eb-4df0-884e-2fe37175c92e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:11:15.794017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c1923b14-41eb-4df0-884e-2fe37175c92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:15.893814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1923b14-41eb-4df0-884e-2fe37175c92e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:11:15.984677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a3dfc-6125-46ac-8943-8c4cda084158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:11:15.985290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a3dfc-6125-46ac-8943-8c4cda084158 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:15.991002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a3dfc-6125-46ac-8943-8c4cda084158 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:15.991002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a3dfc-6125-46ac-8943-8c4cda084158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:15.991002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f77a3dfc-6125-46ac-8943-8c4cda084158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:16.035471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:16.104828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a3dfc-6125-46ac-8943-8c4cda084158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:11:16.106336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a3dfc-6125-46ac-8943-8c4cda084158 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:11:16.125724 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 515/1023] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:11:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:11:20.374272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7c624-8457-499d-a4e9-bd285d62e340 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:20.374844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7c624-8457-499d-a4e9-bd285d62e340 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:20.374844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7c624-8457-499d-a4e9-bd285d62e340 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:20.376172 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 509/1024] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:11:20.382123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b38a6a-4026-4b74-ade7-4a58fd58c203 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:20.382582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b38a6a-4026-4b74-ade7-4a58fd58c203 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:20.382666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b38a6a-4026-4b74-ade7-4a58fd58c203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:20.453720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-67b38a6a-4026-4b74-ade7-4a58fd58c203 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:11:20.454986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-67b38a6a-4026-4b74-ade7-4a58fd58c203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:20.553148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:20.555694 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 516/1025] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:11:20.840140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7c624-8457-499d-a4e9-bd285d62e340 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:11:20.841686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fcd7c624-8457-499d-a4e9-bd285d62e340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:20.944495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7c624-8457-499d-a4e9-bd285d62e340 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:11:20.991615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:21.016931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1475a-45dc-42c3-8c5e-f7db50214c3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:11:21.017538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1475a-45dc-42c3-8c5e-f7db50214c3e service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:21.017821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1475a-45dc-42c3-8c5e-f7db50214c3e service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:21.018122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1475a-45dc-42c3-8c5e-f7db50214c3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:21.019756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-eae1475a-45dc-42c3-8c5e-f7db50214c3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:21.125833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1475a-45dc-42c3-8c5e-f7db50214c3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:11:21.127308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1475a-45dc-42c3-8c5e-f7db50214c3e service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:11:21.146556 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 510/1026] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:11:26.294293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6d6cb-961f-4a1c-893d-fb5450dd7e4e None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:26.295503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6d6cb-961f-4a1c-893d-fb5450dd7e4e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:26.296006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6d6cb-961f-4a1c-893d-fb5450dd7e4e None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:26.297925 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 517/1027] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 27 03:11:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:11:26.304461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cea6c-b25b-41f8-a53a-59956d4e6d71 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:26.304863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cea6c-b25b-41f8-a53a-59956d4e6d71 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:26.305055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cea6c-b25b-41f8-a53a-59956d4e6d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:26.436596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-fb5cea6c-b25b-41f8-a53a-59956d4e6d71 None None] MFA Rules not processed for user `1a395d2414cd4da085a77ddc9b1f1caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:11:26.438396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fb5cea6c-b25b-41f8-a53a-59956d4e6d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:26.459369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:26.579282 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 511/1028] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 03:11:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:11:30.727677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaa89e-88d2-447d-829c-7565ad55bf9a None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:30.728227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaa89e-88d2-447d-829c-7565ad55bf9a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:30.728227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaa89e-88d2-447d-829c-7565ad55bf9a None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:30.729752 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 518/1029] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 27 03:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:11:30.734662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1e610-f8e4-4eef-b577-6b7c868a3304 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:30.735124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1e610-f8e4-4eef-b577-6b7c868a3304 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:30.735410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1e610-f8e4-4eef-b577-6b7c868a3304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:30.814460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d0f1e610-f8e4-4eef-b577-6b7c868a3304 None None] MFA Rules not processed for user `1a395d2414cd4da085a77ddc9b1f1caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:11:30.815854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d0f1e610-f8e4-4eef-b577-6b7c868a3304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:30.886902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:30.922651 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 512/1030] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 03:11:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:11:32.396551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40402742-101f-470a-9e1f-9462ffcc32a2 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:32.397117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40402742-101f-470a-9e1f-9462ffcc32a2 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:32.397117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40402742-101f-470a-9e1f-9462ffcc32a2 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:32.398627 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 519/1031] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 27 03:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:11:32.403499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b1cfc-e7c5-45ea-af6c-a0b3e69db59e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:32.403897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b1cfc-e7c5-45ea-af6c-a0b3e69db59e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:32.404076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b1cfc-e7c5-45ea-af6c-a0b3e69db59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:32.482140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-576b1cfc-e7c5-45ea-af6c-a0b3e69db59e None None] MFA Rules not processed for user `1a395d2414cd4da085a77ddc9b1f1caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:11:32.483357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-576b1cfc-e7c5-45ea-af6c-a0b3e69db59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:32.592281 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 513/1032] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 03:11:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:11:36.107442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0ccb1-2738-4d69-afc1-e57a0ff29856 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:36.108311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0ccb1-2738-4d69-afc1-e57a0ff29856 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:36.108597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0ccb1-2738-4d69-afc1-e57a0ff29856 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:36.110153 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 520/1033] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:11:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:11:36.116039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec577c8-5391-42a7-b205-c193332c65dc None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:36.116900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec577c8-5391-42a7-b205-c193332c65dc None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:36.119260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec577c8-5391-42a7-b205-c193332c65dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:36.169417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:36.208338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-aec577c8-5391-42a7-b205-c193332c65dc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:11:36.209746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-aec577c8-5391-42a7-b205-c193332c65dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:36.317732 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 514/1034] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:11:36.615155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ac271-4517-4659-89fa-65184d146bc1 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:36.615523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ac271-4517-4659-89fa-65184d146bc1 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:36.615873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ac271-4517-4659-89fa-65184d146bc1 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:36.617397 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 521/1035] 10.222.0.20 () {54 vars in 961 bytes} [Thu Oct 27 03:11:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:11:36.627183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a4040-d331-4bca-8b8d-cf069519a291 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:36.634162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a4040-d331-4bca-8b8d-cf069519a291 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:36.634162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a4040-d331-4bca-8b8d-cf069519a291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:36.717965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-286a4040-d331-4bca-8b8d-cf069519a291 None None] MFA Rules not processed for user `c20881251f2241a3a5ec2e5cf99db149`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:11:36.719287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-286a4040-d331-4bca-8b8d-cf069519a291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:36.771741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:36.846624 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 515/1036] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Oct 27 03:11:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:11:36.854936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ac271-4517-4659-89fa-65184d146bc1 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:11:36.856451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-736ac271-4517-4659-89fa-65184d146bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:37.020759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ac271-4517-4659-89fa-65184d146bc1 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:11:37.104741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:37.146822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe530e-1f40-4da5-8a86-22624fb45f07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:11:37.147442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe530e-1f40-4da5-8a86-22624fb45f07 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:37.147704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe530e-1f40-4da5-8a86-22624fb45f07 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:37.147980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe530e-1f40-4da5-8a86-22624fb45f07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:37.149790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ffbe530e-1f40-4da5-8a86-22624fb45f07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:37.256560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe530e-1f40-4da5-8a86-22624fb45f07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:11:37.258255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe530e-1f40-4da5-8a86-22624fb45f07 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:11:37.277736 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 522/1037] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:11:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:11:39.662085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99afde-179a-41bf-b972-b858053627c5 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:39.664785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99afde-179a-41bf-b972-b858053627c5 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:39.666747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99afde-179a-41bf-b972-b858053627c5 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:39.679060 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 516/1038] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:11:39 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:11:39.686182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c1f33-9ffb-4a4f-bb7b-03e1b98051fe None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:39.686182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c1f33-9ffb-4a4f-bb7b-03e1b98051fe None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:39.686182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c1f33-9ffb-4a4f-bb7b-03e1b98051fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:39.751445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e60c1f33-9ffb-4a4f-bb7b-03e1b98051fe None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:11:39.752639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e60c1f33-9ffb-4a4f-bb7b-03e1b98051fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:39.793461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:39.856851 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 523/1039] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:11:40.142402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99afde-179a-41bf-b972-b858053627c5 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:11:40.145028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bb99afde-179a-41bf-b972-b858053627c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:40.328994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99afde-179a-41bf-b972-b858053627c5 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:11:40.341581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:40.463204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19612da-557c-4e36-afb5-657f8508d510 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:11:40.463824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19612da-557c-4e36-afb5-657f8508d510 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:40.464217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19612da-557c-4e36-afb5-657f8508d510 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:40.464498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19612da-557c-4e36-afb5-657f8508d510 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:40.466981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b19612da-557c-4e36-afb5-657f8508d510 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:40.571286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19612da-557c-4e36-afb5-657f8508d510 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:11:40.572854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19612da-557c-4e36-afb5-657f8508d510 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:11:40.592054 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 517/1040] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:11:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:11:43.332455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cbff8-be82-4c35-a23e-634485dec475 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:43.333866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cbff8-be82-4c35-a23e-634485dec475 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:43.334436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cbff8-be82-4c35-a23e-634485dec475 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:43.335863 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 524/1041] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:11:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:11:43.349425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7ec3f-a648-408e-be02-aa1e05a4738d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:43.349425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7ec3f-a648-408e-be02-aa1e05a4738d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:43.349425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7ec3f-a648-408e-be02-aa1e05a4738d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:43.378805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:43.436984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-58f7ec3f-a648-408e-be02-aa1e05a4738d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:11:43.438159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-58f7ec3f-a648-408e-be02-aa1e05a4738d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:43.539790 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 518/1042] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:11:43.832503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efa28d-c9f0-4407-97fc-0e3019cc4641 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:43.833097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efa28d-c9f0-4407-97fc-0e3019cc4641 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:43.833577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efa28d-c9f0-4407-97fc-0e3019cc4641 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:43.836242 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 525/1043] 10.222.0.20 () {54 vars in 961 bytes} [Thu Oct 27 03:11:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:11:43.845397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dd13f-ce5a-4ed2-b1b0-8d2a38ce2b14 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:43.845397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dd13f-ce5a-4ed2-b1b0-8d2a38ce2b14 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:43.845397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dd13f-ce5a-4ed2-b1b0-8d2a38ce2b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:43.949991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8e3dd13f-ce5a-4ed2-b1b0-8d2a38ce2b14 None None] MFA Rules not processed for user `c20881251f2241a3a5ec2e5cf99db149`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:11:43.951933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8e3dd13f-ce5a-4ed2-b1b0-8d2a38ce2b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:43.998926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:44.108468 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 519/1044] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Oct 27 03:11:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:11:44.117845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efa28d-c9f0-4407-97fc-0e3019cc4641 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:11:44.120088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-89efa28d-c9f0-4407-97fc-0e3019cc4641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:44.329674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efa28d-c9f0-4407-97fc-0e3019cc4641 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:11:44.355317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:44.502591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404dd4a-4088-4cca-9d8a-6677ede8933d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:11:44.503556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404dd4a-4088-4cca-9d8a-6677ede8933d service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:44.504614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404dd4a-4088-4cca-9d8a-6677ede8933d service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:44.505096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404dd4a-4088-4cca-9d8a-6677ede8933d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:44.508231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1404dd4a-4088-4cca-9d8a-6677ede8933d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:44.624078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404dd4a-4088-4cca-9d8a-6677ede8933d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:11:44.625944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404dd4a-4088-4cca-9d8a-6677ede8933d service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:11:44.662543 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 526/1045] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:11:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:11:47.420957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8f05d-abb0-45f3-98ff-246a29e2907e None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:47.421482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8f05d-abb0-45f3-98ff-246a29e2907e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:47.421482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8f05d-abb0-45f3-98ff-246a29e2907e None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:47.431254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07bc46-ef9d-4b92-bb13-05bfbb4c8ddb None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:47.431254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07bc46-ef9d-4b92-bb13-05bfbb4c8ddb None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:47.431254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07bc46-ef9d-4b92-bb13-05bfbb4c8ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:47.433317 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 520/1046] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:11:47 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:11:47.463709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:47.518571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-bc07bc46-ef9d-4b92-bb13-05bfbb4c8ddb None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:11:47.520798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bc07bc46-ef9d-4b92-bb13-05bfbb4c8ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:47.707766 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 527/1047] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:11:48.006765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8f05d-abb0-45f3-98ff-246a29e2907e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:11:48.008277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-88c8f05d-abb0-45f3-98ff-246a29e2907e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:48.059374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58546f17-6684-45a2-b651-a200b10ec6ab None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:48.060315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58546f17-6684-45a2-b651-a200b10ec6ab None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:48.061134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58546f17-6684-45a2-b651-a200b10ec6ab None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:48.063058 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 528/1048] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:11:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:11:48.068572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c4981-ae82-4f58-b6cf-5f5fe0c9d121 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:48.071012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c4981-ae82-4f58-b6cf-5f5fe0c9d121 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:48.071012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c4981-ae82-4f58-b6cf-5f5fe0c9d121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:48.142650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-676c4981-ae82-4f58-b6cf-5f5fe0c9d121 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:11:48.144088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-676c4981-ae82-4f58-b6cf-5f5fe0c9d121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:48.168394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:48.173770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8f05d-abb0-45f3-98ff-246a29e2907e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:11:48.205964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:48.255063 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 529/1049] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:11:48.322527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68191b08-a633-4ae1-a905-3818a053b325 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:11:48.323426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68191b08-a633-4ae1-a905-3818a053b325 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:48.325100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68191b08-a633-4ae1-a905-3818a053b325 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:48.325100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68191b08-a633-4ae1-a905-3818a053b325 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:48.325657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-68191b08-a633-4ae1-a905-3818a053b325 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:48.420317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68191b08-a633-4ae1-a905-3818a053b325 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:11:48.422094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68191b08-a633-4ae1-a905-3818a053b325 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:11:48.439324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:48.443862 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 521/1050] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:11:48.591340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1572481-f7d7-40de-a097-575038141b81 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:48.591831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1572481-f7d7-40de-a097-575038141b81 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:48.591938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1572481-f7d7-40de-a097-575038141b81 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:48.593595 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 530/1051] 10.222.0.20 () {54 vars in 963 bytes} [Thu Oct 27 03:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:11:48.599133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eac188-eae2-4dc7-86b1-9c9d8f37508d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:48.599430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eac188-eae2-4dc7-86b1-9c9d8f37508d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:48.599740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eac188-eae2-4dc7-86b1-9c9d8f37508d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:48.697082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a7eac188-eae2-4dc7-86b1-9c9d8f37508d None None] MFA Rules not processed for user `5ec1d24520c447a38ed321f62d4f9e98`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:11:48.698535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a7eac188-eae2-4dc7-86b1-9c9d8f37508d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:48.795856 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 522/1052] 10.222.0.20 () {58 vars in 1060 bytes} [Thu Oct 27 03:11:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:11:48.804002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1572481-f7d7-40de-a097-575038141b81 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:11:48.805506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d1572481-f7d7-40de-a097-575038141b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:48.921339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1572481-f7d7-40de-a097-575038141b81 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:11:49.006217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e61ea-51b9-4b54-9632-6441b9bbc31b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:11:49.006834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e61ea-51b9-4b54-9632-6441b9bbc31b service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:49.007114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e61ea-51b9-4b54-9632-6441b9bbc31b service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:49.007385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e61ea-51b9-4b54-9632-6441b9bbc31b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:49.009444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8d4e61ea-51b9-4b54-9632-6441b9bbc31b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:49.019564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:49.129994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e61ea-51b9-4b54-9632-6441b9bbc31b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:11:49.131466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e61ea-51b9-4b54-9632-6441b9bbc31b service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:11:49.151122 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 531/1053] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:11:50.718443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb2ff6-addd-4722-a519-2697a0f8bf1a None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:50.718991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb2ff6-addd-4722-a519-2697a0f8bf1a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:50.718991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb2ff6-addd-4722-a519-2697a0f8bf1a None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:50.720485 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 523/1054] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:11:50.726392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7cd32-057a-4a2b-8839-7d8123fe7798 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:50.726870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7cd32-057a-4a2b-8839-7d8123fe7798 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:50.726980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7cd32-057a-4a2b-8839-7d8123fe7798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:50.801793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-61d7cd32-057a-4a2b-8839-7d8123fe7798 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:11:50.803171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-61d7cd32-057a-4a2b-8839-7d8123fe7798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:50.869334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:50.926141 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 532/1055] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:11:51.337884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb2ff6-addd-4722-a519-2697a0f8bf1a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:11:51.337884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-20eb2ff6-addd-4722-a519-2697a0f8bf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:51.339497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:51.404546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb2ff6-addd-4722-a519-2697a0f8bf1a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:11:51.534153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f9592-a0e1-4956-8589-ad4c662a952a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:11:51.534743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f9592-a0e1-4956-8589-ad4c662a952a service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:51.535092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f9592-a0e1-4956-8589-ad4c662a952a service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:51.535373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f9592-a0e1-4956-8589-ad4c662a952a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:51.537221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8f2f9592-a0e1-4956-8589-ad4c662a952a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:51.608451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:51.645633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f9592-a0e1-4956-8589-ad4c662a952a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:11:51.647380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f9592-a0e1-4956-8589-ad4c662a952a service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:11:51.669723 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 524/1056] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:11:54.110629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9cda9-7299-4e32-bebd-9ade7fdaa3c7 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:54.111700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9cda9-7299-4e32-bebd-9ade7fdaa3c7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:54.112210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9cda9-7299-4e32-bebd-9ade7fdaa3c7 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:54.118454 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 533/1057] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:11:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:11:54.119999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496aded-5afc-41b3-97e7-6c7ff0275c45 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:54.120413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496aded-5afc-41b3-97e7-6c7ff0275c45 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:54.120632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496aded-5afc-41b3-97e7-6c7ff0275c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:54.202184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e496aded-5afc-41b3-97e7-6c7ff0275c45 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:11:54.203539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e496aded-5afc-41b3-97e7-6c7ff0275c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:54.306080 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 525/1058] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:11:54.606724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9cda9-7299-4e32-bebd-9ade7fdaa3c7 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:11:54.608396 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ddb9cda9-7299-4e32-bebd-9ade7fdaa3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:54.777210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9cda9-7299-4e32-bebd-9ade7fdaa3c7 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:11:54.828333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:54.898485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521b120-7b91-48da-a374-021a63fc08ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:11:54.899105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521b120-7b91-48da-a374-021a63fc08ef service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:54.899388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521b120-7b91-48da-a374-021a63fc08ef service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:54.899666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521b120-7b91-48da-a374-021a63fc08ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:54.901281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a521b120-7b91-48da-a374-021a63fc08ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:55.006785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521b120-7b91-48da-a374-021a63fc08ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:11:55.008413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521b120-7b91-48da-a374-021a63fc08ef service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:11:55.030234 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 534/1059] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:11:57.377840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d79d8-bef4-408b-97be-f72f90acf153 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:57.378505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d79d8-bef4-408b-97be-f72f90acf153 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:57.378505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d79d8-bef4-408b-97be-f72f90acf153 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:57.379790 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 526/1060] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:11:57.385227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becc068-298a-48bf-b83c-7aa096d4492a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:57.385701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becc068-298a-48bf-b83c-7aa096d4492a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:57.385847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becc068-298a-48bf-b83c-7aa096d4492a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:57.462749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0becc068-298a-48bf-b83c-7aa096d4492a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:11:57.464232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0becc068-298a-48bf-b83c-7aa096d4492a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:57.466744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:57.588554 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 535/1061] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:11:57.873580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d79d8-bef4-408b-97be-f72f90acf153 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:11:57.878072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d32d79d8-bef4-408b-97be-f72f90acf153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:57.917382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:58.035317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d79d8-bef4-408b-97be-f72f90acf153 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:11:58.161759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:58.168419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df5547-c6c2-4a83-9ed5-7525dcf2e23b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:11:58.169036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df5547-c6c2-4a83-9ed5-7525dcf2e23b service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:11:58.169328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df5547-c6c2-4a83-9ed5-7525dcf2e23b service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:11:58.169607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df5547-c6c2-4a83-9ed5-7525dcf2e23b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:11:58.171265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f7df5547-c6c2-4a83-9ed5-7525dcf2e23b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:11:58.276189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df5547-c6c2-4a83-9ed5-7525dcf2e23b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:11:58.278282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df5547-c6c2-4a83-9ed5-7525dcf2e23b service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:11:58.299050 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 527/1062] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:12:00.460388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112df18-f8dd-438f-af0d-075c3017a41c None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:00.460965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112df18-f8dd-438f-af0d-075c3017a41c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:00.460965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112df18-f8dd-438f-af0d-075c3017a41c None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:00.462331 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 536/1063] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:12:00.467587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763b940-48a1-4813-8856-66f76f85a675 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:00.468146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763b940-48a1-4813-8856-66f76f85a675 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:00.468146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763b940-48a1-4813-8856-66f76f85a675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:00.535779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-2763b940-48a1-4813-8856-66f76f85a675 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:12:00.537021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2763b940-48a1-4813-8856-66f76f85a675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:00.603348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:00.639976 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 528/1064] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:12:00.940338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112df18-f8dd-438f-af0d-075c3017a41c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:12:00.942509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e112df18-f8dd-438f-af0d-075c3017a41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:01.110936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:01.130085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112df18-f8dd-438f-af0d-075c3017a41c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:12:01.252773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260dd91-b258-4237-86d5-405984c31469 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:12:01.253995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260dd91-b258-4237-86d5-405984c31469 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:01.254323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260dd91-b258-4237-86d5-405984c31469 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:01.254597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260dd91-b258-4237-86d5-405984c31469 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:01.256219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a260dd91-b258-4237-86d5-405984c31469 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:01.352068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260dd91-b258-4237-86d5-405984c31469 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:12:01.353741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260dd91-b258-4237-86d5-405984c31469 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:12:01.359127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:01.374361 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 537/1065] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:12:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:12:03.788418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03aed28-e6f6-4883-89bd-32751f5b44d6 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:03.789026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03aed28-e6f6-4883-89bd-32751f5b44d6 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:03.789026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03aed28-e6f6-4883-89bd-32751f5b44d6 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:03.790382 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 529/1066] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:12:03.795902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c80de8-2c71-4e3b-afc7-668efffe1619 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:03.796315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c80de8-2c71-4e3b-afc7-668efffe1619 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:03.796461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c80de8-2c71-4e3b-afc7-668efffe1619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:03.865256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e3c80de8-2c71-4e3b-afc7-668efffe1619 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:12:03.865256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e3c80de8-2c71-4e3b-afc7-668efffe1619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:03.960923 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 538/1067] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:12:04.253491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03aed28-e6f6-4883-89bd-32751f5b44d6 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:12:04.255122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e03aed28-e6f6-4883-89bd-32751f5b44d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:04.401847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03aed28-e6f6-4883-89bd-32751f5b44d6 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:12:04.454090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:04.519691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29435ee1-7588-4ab3-9913-f6e6f6cb33e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:12:04.520304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29435ee1-7588-4ab3-9913-f6e6f6cb33e8 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:04.520585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29435ee1-7588-4ab3-9913-f6e6f6cb33e8 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:04.520857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29435ee1-7588-4ab3-9913-f6e6f6cb33e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:04.522520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-29435ee1-7588-4ab3-9913-f6e6f6cb33e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:04.612928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29435ee1-7588-4ab3-9913-f6e6f6cb33e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:12:04.614579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29435ee1-7588-4ab3-9913-f6e6f6cb33e8 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:12:04.635093 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 530/1068] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:12:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:12:05.041060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94937e64-63a4-4fb4-a238-4e1752a7d40d None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:05.041587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94937e64-63a4-4fb4-a238-4e1752a7d40d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:05.041587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94937e64-63a4-4fb4-a238-4e1752a7d40d None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:05.042900 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 539/1069] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:12:05.048393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce162b7-820c-4ef8-b6cc-ae97f3477635 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:05.048805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce162b7-820c-4ef8-b6cc-ae97f3477635 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:05.048926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce162b7-820c-4ef8-b6cc-ae97f3477635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:05.115091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-bce162b7-820c-4ef8-b6cc-ae97f3477635 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:12:05.116299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bce162b7-820c-4ef8-b6cc-ae97f3477635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:05.122966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:05.216229 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 531/1070] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:12:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:12:05.522402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5fc39-2c41-43a8-a7c6-15c0726a8aed None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:05.522694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5fc39-2c41-43a8-a7c6-15c0726a8aed None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:05.522973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5fc39-2c41-43a8-a7c6-15c0726a8aed None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:05.524380 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 540/1071] 10.222.0.20 () {54 vars in 962 bytes} [Thu Oct 27 03:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:12:05.529624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4edcdf-23da-4680-b5c7-6c7d01e6666e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:05.529951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4edcdf-23da-4680-b5c7-6c7d01e6666e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:05.530238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4edcdf-23da-4680-b5c7-6c7d01e6666e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:05.607171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-3e4edcdf-23da-4680-b5c7-6c7d01e6666e None None] MFA Rules not processed for user `c2b7050fa8404001876dbfd40e392015`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:12:05.608391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3e4edcdf-23da-4680-b5c7-6c7d01e6666e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:05.686382 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 532/1072] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Oct 27 03:12:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:12:05.694224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5fc39-2c41-43a8-a7c6-15c0726a8aed None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:12:05.695803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c9f5fc39-2c41-43a8-a7c6-15c0726a8aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:05.769762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:05.801224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5fc39-2c41-43a8-a7c6-15c0726a8aed None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:12:05.874707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ec639-54bd-4254-8b31-bbd03b5bc145 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:12:05.875351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ec639-54bd-4254-8b31-bbd03b5bc145 service glance] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:05.875652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ec639-54bd-4254-8b31-bbd03b5bc145 service glance] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:05.875912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ec639-54bd-4254-8b31-bbd03b5bc145 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:05.877518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c59ec639-54bd-4254-8b31-bbd03b5bc145 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:05.992423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ec639-54bd-4254-8b31-bbd03b5bc145 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:12:05.993906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ec639-54bd-4254-8b31-bbd03b5bc145 service glance] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:12:06.010720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:06.013950 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 541/1073] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:12:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:12:06.884163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fd820-36aa-42e8-a6b7-b553d3fcba6d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:06.884670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fd820-36aa-42e8-a6b7-b553d3fcba6d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:06.884767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fd820-36aa-42e8-a6b7-b553d3fcba6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:06.889702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:06.920763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5522e6f-33f1-4505-81d0-600d14806d32 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:06.921343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5522e6f-33f1-4505-81d0-600d14806d32 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:06.921343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5522e6f-33f1-4505-81d0-600d14806d32 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:06.922801 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 542/1074] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:12:06.928803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af772da0-5298-4869-8a59-2ff261612c64 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:06.929096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af772da0-5298-4869-8a59-2ff261612c64 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:06.929378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af772da0-5298-4869-8a59-2ff261612c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:06.958378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a85fd820-36aa-42e8-a6b7-b553d3fcba6d None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:12:06.959611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a85fd820-36aa-42e8-a6b7-b553d3fcba6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:06.997254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-af772da0-5298-4869-8a59-2ff261612c64 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:12:06.998520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-af772da0-5298-4869-8a59-2ff261612c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:07.047262 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 533/1075] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:12:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:12:07.094546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f4da6-0975-427c-ab4d-61fb60d9f2e3 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:07.094858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f4da6-0975-427c-ab4d-61fb60d9f2e3 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:07.095154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f4da6-0975-427c-ab4d-61fb60d9f2e3 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:07.096616 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 534/1076] 10.222.0.20 () {54 vars in 943 bytes} [Thu Oct 27 03:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:12:07.099103 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 543/1077] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:12:07.106345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d326d-d0c7-44fc-aad5-a9f3ada1c670 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:07.106627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d326d-d0c7-44fc-aad5-a9f3ada1c670 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:07.106900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d326d-d0c7-44fc-aad5-a9f3ada1c670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:07.191163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9d2d326d-d0c7-44fc-aad5-a9f3ada1c670 None None] MFA Rules not processed for user `fe7800497c6e460f9a2a0bd259e6d236`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:12:07.192370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9d2d326d-d0c7-44fc-aad5-a9f3ada1c670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:07.226574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:07.297577 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 535/1078] 10.222.0.20 () {58 vars in 1040 bytes} [Thu Oct 27 03:12:07 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:12:07.306660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af772da0-5298-4869-8a59-2ff261612c64 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:12:07.307876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-af772da0-5298-4869-8a59-2ff261612c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:07.382280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:07.388160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d326d-d0c7-44fc-aad5-a9f3ada1c670 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:12:07.392524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9d2d326d-d0c7-44fc-aad5-a9f3ada1c670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:07.411390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af772da0-5298-4869-8a59-2ff261612c64 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:12:07.488401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d326d-d0c7-44fc-aad5-a9f3ada1c670 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:12:07.521412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dce64-c7e0-48fc-be61-17efd0132b6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:12:07.522025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dce64-c7e0-48fc-be61-17efd0132b6a service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:07.522340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dce64-c7e0-48fc-be61-17efd0132b6a service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:07.522613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dce64-c7e0-48fc-be61-17efd0132b6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:07.524315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cf7dce64-c7e0-48fc-be61-17efd0132b6a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:07.544425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:07.606384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54aaf8-bb4e-4031-8d29-0e13b1b19848 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:12:07.607005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54aaf8-bb4e-4031-8d29-0e13b1b19848 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:07.607284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54aaf8-bb4e-4031-8d29-0e13b1b19848 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:07.607554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54aaf8-bb4e-4031-8d29-0e13b1b19848 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:07.609051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7dce64-c7e0-48fc-be61-17efd0132b6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:12:07.609176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8b54aaf8-bb4e-4031-8d29-0e13b1b19848 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:07.610689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7dce64-c7e0-48fc-be61-17efd0132b6a service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:12:07.618709 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 544/1079] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:12:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:12:07.704070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54aaf8-bb4e-4031-8d29-0e13b1b19848 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:12:07.705693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54aaf8-bb4e-4031-8d29-0e13b1b19848 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:12:07.724220 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 536/1080] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:12:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:12:10.168816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd18698-01f4-4643-8832-7ea454e297e3 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:10.169399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd18698-01f4-4643-8832-7ea454e297e3 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:10.169399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd18698-01f4-4643-8832-7ea454e297e3 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:10.170867 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 545/1081] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:12:10.176582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c90dcb-a337-4d62-8774-21375fa66d29 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:10.177046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c90dcb-a337-4d62-8774-21375fa66d29 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:10.177141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c90dcb-a337-4d62-8774-21375fa66d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:10.260525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-47c90dcb-a337-4d62-8774-21375fa66d29 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:12:10.262080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-47c90dcb-a337-4d62-8774-21375fa66d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:10.275314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:10.368918 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 537/1082] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:12:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:12:10.663579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd18698-01f4-4643-8832-7ea454e297e3 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:12:10.665110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-acd18698-01f4-4643-8832-7ea454e297e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:10.680089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:10.827414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd18698-01f4-4643-8832-7ea454e297e3 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:12:10.926672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:10.958615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ab25c-b690-4fad-a916-ec1b466a5bdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:12:10.959226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ab25c-b690-4fad-a916-ec1b466a5bdb service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:10.959507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ab25c-b690-4fad-a916-ec1b466a5bdb service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:10.959786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ab25c-b690-4fad-a916-ec1b466a5bdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:10.962252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fe5ab25c-b690-4fad-a916-ec1b466a5bdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:11.066737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ab25c-b690-4fad-a916-ec1b466a5bdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:12:11.068355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ab25c-b690-4fad-a916-ec1b466a5bdb service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:12:11.087429 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 546/1083] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:12:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:12:13.415342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4c0ef-8af5-445a-ae63-604bed62e83a None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:13.415907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4c0ef-8af5-445a-ae63-604bed62e83a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:13.415907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4c0ef-8af5-445a-ae63-604bed62e83a None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:13.418430 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 538/1084] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:12:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:12:13.422358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0ad85-c09e-4b32-9c12-cecbe6013ee3 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:13.422762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0ad85-c09e-4b32-9c12-cecbe6013ee3 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:13.422940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0ad85-c09e-4b32-9c12-cecbe6013ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:13.495553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9ba0ad85-c09e-4b32-9c12-cecbe6013ee3 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:12:13.496777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9ba0ad85-c09e-4b32-9c12-cecbe6013ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:13.548325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:13.600466 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 547/1085] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:12:13.887033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4c0ef-8af5-445a-ae63-604bed62e83a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:12:13.888572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ebf4c0ef-8af5-445a-ae63-604bed62e83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:14.047048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:14.052658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4c0ef-8af5-445a-ae63-604bed62e83a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:12:14.178200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaf37e-5439-4398-a6f8-bc01992efe07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:12:14.178726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaf37e-5439-4398-a6f8-bc01992efe07 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:14.179006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaf37e-5439-4398-a6f8-bc01992efe07 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:14.179274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaf37e-5439-4398-a6f8-bc01992efe07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:14.181403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-02eaf37e-5439-4398-a6f8-bc01992efe07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:14.288700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eaf37e-5439-4398-a6f8-bc01992efe07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:12:14.290391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eaf37e-5439-4398-a6f8-bc01992efe07 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:12:14.307427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:14.310765 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 539/1086] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:12:23.598714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=22 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:31.822296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69093b37-6718-4f9f-b7b2-7ebdd6e0a530 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:31.822971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69093b37-6718-4f9f-b7b2-7ebdd6e0a530 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:31.822971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69093b37-6718-4f9f-b7b2-7ebdd6e0a530 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:31.824259 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 548/1087] 10.222.0.20 () {54 vars in 918 bytes} [Thu Oct 27 03:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:12:31.829246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd769e-5faf-421b-9633-330b292d9038 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:31.829708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd769e-5faf-421b-9633-330b292d9038 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:31.829802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd769e-5faf-421b-9633-330b292d9038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:31.904934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-82bd769e-5faf-421b-9633-330b292d9038 None None] MFA Rules not processed for user `1a395d2414cd4da085a77ddc9b1f1caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:12:31.906158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-82bd769e-5faf-421b-9633-330b292d9038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:32.010660 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 540/1088] 10.222.0.20 () {58 vars in 1015 bytes} [Thu Oct 27 03:12:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:12:32.025806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10a123-d06b-42bf-8bc9-30223d87977c None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:32.026126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10a123-d06b-42bf-8bc9-30223d87977c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:32.026407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10a123-d06b-42bf-8bc9-30223d87977c None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:32.027773 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 549/1089] 10.222.0.20 () {54 vars in 918 bytes} [Thu Oct 27 03:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:12:32.032250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc0b9f-8f94-43be-8b7a-508da83d046b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:32.032537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc0b9f-8f94-43be-8b7a-508da83d046b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:32.032839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc0b9f-8f94-43be-8b7a-508da83d046b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:32.104819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:32.107799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-33dc0b9f-8f94-43be-8b7a-508da83d046b None None] MFA Rules not processed for user `c20881251f2241a3a5ec2e5cf99db149`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:12:32.108996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-33dc0b9f-8f94-43be-8b7a-508da83d046b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:32.226648 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 541/1090] 10.222.0.20 () {58 vars in 1015 bytes} [Thu Oct 27 03:12:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:12:34.784569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5bab0-e01a-41fe-9e9e-5fbd35411a3b None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:34.785124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5bab0-e01a-41fe-9e9e-5fbd35411a3b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:34.785244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5bab0-e01a-41fe-9e9e-5fbd35411a3b None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:34.786522 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 550/1091] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 03:12:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:12:34.791895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045946c5-f4fa-42b4-b907-9b608eb1ec80 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:34.792281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045946c5-f4fa-42b4-b907-9b608eb1ec80 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:34.792476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045946c5-f4fa-42b4-b907-9b608eb1ec80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:34.858257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-045946c5-f4fa-42b4-b907-9b608eb1ec80 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:12:34.863292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-045946c5-f4fa-42b4-b907-9b608eb1ec80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:34.918254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:34.961219 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 542/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 03:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:12:35.256465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5bab0-e01a-41fe-9e9e-5fbd35411a3b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:12:35.257983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-13c5bab0-e01a-41fe-9e9e-5fbd35411a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:35.403713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5bab0-e01a-41fe-9e9e-5fbd35411a3b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:12:35.475317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:35.514989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e910dde-0ee3-4d25-b57f-5f68f7428bfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:12:35.515538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e910dde-0ee3-4d25-b57f-5f68f7428bfb service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:35.515825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e910dde-0ee3-4d25-b57f-5f68f7428bfb service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:35.516098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e910dde-0ee3-4d25-b57f-5f68f7428bfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:35.517728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6e910dde-0ee3-4d25-b57f-5f68f7428bfb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:35.605740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e910dde-0ee3-4d25-b57f-5f68f7428bfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:12:35.607350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e910dde-0ee3-4d25-b57f-5f68f7428bfb service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:12:35.625014 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 551/1093] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:12:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:12:36.756645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e210a94-3b9b-4479-a349-69e4d4d09c10 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:36.757210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e210a94-3b9b-4479-a349-69e4d4d09c10 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:36.757210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e210a94-3b9b-4479-a349-69e4d4d09c10 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:36.758597 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 543/1094] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 03:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:12:36.763553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364723b4-eea0-4aa6-b7f3-9321d755c293 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:36.763994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364723b4-eea0-4aa6-b7f3-9321d755c293 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:36.764092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364723b4-eea0-4aa6-b7f3-9321d755c293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:36.837932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-364723b4-eea0-4aa6-b7f3-9321d755c293 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:12:36.839158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-364723b4-eea0-4aa6-b7f3-9321d755c293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:36.866454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:36.935741 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 552/1095] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 03:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:12:37.099973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e210a94-3b9b-4479-a349-69e4d4d09c10 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:12:37.101433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8e210a94-3b9b-4479-a349-69e4d4d09c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:37.247675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e210a94-3b9b-4479-a349-69e4d4d09c10 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:12:37.287333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:37.358493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2af23-64dc-4645-9d63-2cf7db6bd7b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:12:37.359032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2af23-64dc-4645-9d63-2cf7db6bd7b8 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:37.359312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2af23-64dc-4645-9d63-2cf7db6bd7b8 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:37.359598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2af23-64dc-4645-9d63-2cf7db6bd7b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:37.361172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7ed2af23-64dc-4645-9d63-2cf7db6bd7b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:37.448727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2af23-64dc-4645-9d63-2cf7db6bd7b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:12:37.450355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2af23-64dc-4645-9d63-2cf7db6bd7b8 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:12:37.468339 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 544/1096] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:12:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:12:38.594602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fa9a2-d179-47e0-ba67-a3b4d9dcd2f3 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:38.595198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fa9a2-d179-47e0-ba67-a3b4d9dcd2f3 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:38.595198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fa9a2-d179-47e0-ba67-a3b4d9dcd2f3 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:38.597063 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 553/1097] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 03:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:12:38.601897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c515f0-7579-42a7-a7c7-7055323e5b00 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:38.602331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c515f0-7579-42a7-a7c7-7055323e5b00 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:38.602481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c515f0-7579-42a7-a7c7-7055323e5b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:38.655472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:38.676878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-47c515f0-7579-42a7-a7c7-7055323e5b00 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:12:38.678092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-47c515f0-7579-42a7-a7c7-7055323e5b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:38.772874 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 545/1098] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 03:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:12:38.924240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fa9a2-d179-47e0-ba67-a3b4d9dcd2f3 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:12:38.925703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-702fa9a2-d179-47e0-ba67-a3b4d9dcd2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:39.068721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fa9a2-d179-47e0-ba67-a3b4d9dcd2f3 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:12:39.081114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:39.179725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb267d-ec38-4988-b419-ee9221f5d4a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:12:39.180259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb267d-ec38-4988-b419-ee9221f5d4a2 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:39.180535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb267d-ec38-4988-b419-ee9221f5d4a2 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:39.180800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb267d-ec38-4988-b419-ee9221f5d4a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:39.182436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8eeb267d-ec38-4988-b419-ee9221f5d4a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:39.269960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb267d-ec38-4988-b419-ee9221f5d4a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:12:39.271574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb267d-ec38-4988-b419-ee9221f5d4a2 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:12:39.288991 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 554/1099] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:12:40.372922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e00eab-96c5-41f6-96ce-85e7b85a23fe None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:40.373454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e00eab-96c5-41f6-96ce-85e7b85a23fe None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:40.373454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e00eab-96c5-41f6-96ce-85e7b85a23fe None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:40.374843 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 546/1100] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 03:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:12:40.379789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69b156-d048-4281-8fcb-0bfd7a7f4b9d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:40.380188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69b156-d048-4281-8fcb-0bfd7a7f4b9d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:40.380501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69b156-d048-4281-8fcb-0bfd7a7f4b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:40.400596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:40.455125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7d69b156-d048-4281-8fcb-0bfd7a7f4b9d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:12:40.456844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7d69b156-d048-4281-8fcb-0bfd7a7f4b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:40.549966 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 555/1101] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 03:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:12:40.698235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e00eab-96c5-41f6-96ce-85e7b85a23fe None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:12:40.699768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-65e00eab-96c5-41f6-96ce-85e7b85a23fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:40.840317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:40.878414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e00eab-96c5-41f6-96ce-85e7b85a23fe None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:12:40.999161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81be43-da17-42bd-9840-b5d371e45c1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:12:41.000016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81be43-da17-42bd-9840-b5d371e45c1c service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:41.000292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81be43-da17-42bd-9840-b5d371e45c1c service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:41.000559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81be43-da17-42bd-9840-b5d371e45c1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:41.002764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7f81be43-da17-42bd-9840-b5d371e45c1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:41.082969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:41.096913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81be43-da17-42bd-9840-b5d371e45c1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:12:41.097955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81be43-da17-42bd-9840-b5d371e45c1c service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:12:41.116909 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 547/1102] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:12:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:12:42.245307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b519247-eb2c-4087-8388-4dba1c92c7c7 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:42.245830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b519247-eb2c-4087-8388-4dba1c92c7c7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:42.245830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b519247-eb2c-4087-8388-4dba1c92c7c7 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:42.247248 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 556/1103] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 03:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:12:42.252631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bbf4f-af0b-46b2-9f26-c6de8a0b9478 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:42.253038 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bbf4f-af0b-46b2-9f26-c6de8a0b9478 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:42.253189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bbf4f-af0b-46b2-9f26-c6de8a0b9478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:42.327250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-3e0bbf4f-af0b-46b2-9f26-c6de8a0b9478 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:12:42.328458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3e0bbf4f-af0b-46b2-9f26-c6de8a0b9478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:42.424681 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 548/1104] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 03:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:12:42.573604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b519247-eb2c-4087-8388-4dba1c92c7c7 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:12:42.575175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6b519247-eb2c-4087-8388-4dba1c92c7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:42.658216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:42.718459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b519247-eb2c-4087-8388-4dba1c92c7c7 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:12:42.829043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103f66b-492e-45bd-ab94-7e1948f35bde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:12:42.829653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103f66b-492e-45bd-ab94-7e1948f35bde service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:42.829935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103f66b-492e-45bd-ab94-7e1948f35bde service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:42.830261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103f66b-492e-45bd-ab94-7e1948f35bde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:42.831856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9103f66b-492e-45bd-ab94-7e1948f35bde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:42.880183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:42.920463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103f66b-492e-45bd-ab94-7e1948f35bde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:12:42.922079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103f66b-492e-45bd-ab94-7e1948f35bde service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:12:42.940058 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 557/1105] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:12:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:12:44.011933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a7817-d915-49fa-8354-a5bb51eb72ce None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:44.012569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a7817-d915-49fa-8354-a5bb51eb72ce None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:44.012569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a7817-d915-49fa-8354-a5bb51eb72ce None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:44.013814 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 549/1106] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 03:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:12:44.019543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132e644-5a0e-42a6-95a9-9f5b29cc1326 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:44.019970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132e644-5a0e-42a6-95a9-9f5b29cc1326 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:44.020121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132e644-5a0e-42a6-95a9-9f5b29cc1326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:44.094539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b132e644-5a0e-42a6-95a9-9f5b29cc1326 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:12:44.095754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b132e644-5a0e-42a6-95a9-9f5b29cc1326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:44.191547 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 558/1107] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 03:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:12:44.341765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a7817-d915-49fa-8354-a5bb51eb72ce None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:12:44.343306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9a9a7817-d915-49fa-8354-a5bb51eb72ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:44.391053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:44.484967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a7817-d915-49fa-8354-a5bb51eb72ce None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:12:44.594781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517de546-5f1b-4041-896f-ada699debf5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:12:44.595337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517de546-5f1b-4041-896f-ada699debf5e service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:44.595619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517de546-5f1b-4041-896f-ada699debf5e service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:44.595893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517de546-5f1b-4041-896f-ada699debf5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:44.597474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-517de546-5f1b-4041-896f-ada699debf5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:44.604185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:44.685091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517de546-5f1b-4041-896f-ada699debf5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:12:44.686717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517de546-5f1b-4041-896f-ada699debf5e service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:12:44.704556 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 550/1108] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:12:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:12:45.783031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadeaba3-ef7c-46bf-addb-51615c7da8aa None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:45.783565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadeaba3-ef7c-46bf-addb-51615c7da8aa None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:45.783565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadeaba3-ef7c-46bf-addb-51615c7da8aa None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:45.785412 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 559/1109] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 03:12:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:12:45.790488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d2ba1-62b4-45c9-8c2c-453def27f399 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:45.790941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d2ba1-62b4-45c9-8c2c-453def27f399 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:45.791036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d2ba1-62b4-45c9-8c2c-453def27f399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:45.866869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0c1d2ba1-62b4-45c9-8c2c-453def27f399 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:12:45.868015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0c1d2ba1-62b4-45c9-8c2c-453def27f399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:45.935872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:45.963364 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 551/1110] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 03:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:12:46.113875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadeaba3-ef7c-46bf-addb-51615c7da8aa None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:12:46.115422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cadeaba3-ef7c-46bf-addb-51615c7da8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:46.133357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:46.257373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadeaba3-ef7c-46bf-addb-51615c7da8aa None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:12:46.342269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:46.366781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab57c6d-fa37-4134-9e78-dfd080c3489e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:12:46.367384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab57c6d-fa37-4134-9e78-dfd080c3489e service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:46.367661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab57c6d-fa37-4134-9e78-dfd080c3489e service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:46.367928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab57c6d-fa37-4134-9e78-dfd080c3489e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:46.369510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9ab57c6d-fa37-4134-9e78-dfd080c3489e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:46.455302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab57c6d-fa37-4134-9e78-dfd080c3489e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:12:46.457393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab57c6d-fa37-4134-9e78-dfd080c3489e service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:12:46.475352 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 560/1111] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:12:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:12:47.575368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc096b1d-70dc-412b-a8b5-e72922718399 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:47.575910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc096b1d-70dc-412b-a8b5-e72922718399 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:47.575910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc096b1d-70dc-412b-a8b5-e72922718399 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:47.577262 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 552/1112] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 03:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:12:47.582718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f36fa0-8adf-4daa-b930-621620d1ebc2 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:47.583145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f36fa0-8adf-4daa-b930-621620d1ebc2 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:47.583259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f36fa0-8adf-4daa-b930-621620d1ebc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:47.657679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a0f36fa0-8adf-4daa-b930-621620d1ebc2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:12:47.658919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a0f36fa0-8adf-4daa-b930-621620d1ebc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:47.700692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:47.754742 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 561/1113] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 03:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:12:47.904634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc096b1d-70dc-412b-a8b5-e72922718399 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:12:47.906109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dc096b1d-70dc-412b-a8b5-e72922718399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:48.048850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc096b1d-70dc-412b-a8b5-e72922718399 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:12:48.102161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:48.160099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95fae5-b17e-4cba-a594-8b6a7bf57a78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:12:48.160633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95fae5-b17e-4cba-a594-8b6a7bf57a78 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:48.160914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95fae5-b17e-4cba-a594-8b6a7bf57a78 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:48.161183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95fae5-b17e-4cba-a594-8b6a7bf57a78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:48.162820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9a95fae5-b17e-4cba-a594-8b6a7bf57a78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:48.250897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95fae5-b17e-4cba-a594-8b6a7bf57a78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:12:48.252530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95fae5-b17e-4cba-a594-8b6a7bf57a78 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:12:48.270177 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 553/1114] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:12:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:12:49.363251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b13051-550c-450d-bd9f-145514a4da25 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:49.363793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b13051-550c-450d-bd9f-145514a4da25 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:49.363891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b13051-550c-450d-bd9f-145514a4da25 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:49.365193 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 562/1115] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 03:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:12:49.370092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d96b5b-6b2a-4454-98a0-0cc7d26ad5ff None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:49.370511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d96b5b-6b2a-4454-98a0-0cc7d26ad5ff None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:49.370653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d96b5b-6b2a-4454-98a0-0cc7d26ad5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:49.445861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-04d96b5b-6b2a-4454-98a0-0cc7d26ad5ff None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:12:49.447027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-04d96b5b-6b2a-4454-98a0-0cc7d26ad5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:49.449050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:49.543366 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 554/1116] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 03:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:12:49.692499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b13051-550c-450d-bd9f-145514a4da25 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:12:49.694047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-12b13051-550c-450d-bd9f-145514a4da25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:49.837945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b13051-550c-450d-bd9f-145514a4da25 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:12:49.864830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:49.952830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae300c-37cf-4cd6-b17f-864661a960e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:12:49.980858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae300c-37cf-4cd6-b17f-864661a960e0 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:49.980858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae300c-37cf-4cd6-b17f-864661a960e0 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:49.980858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae300c-37cf-4cd6-b17f-864661a960e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:49.980858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-28ae300c-37cf-4cd6-b17f-864661a960e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:50.043723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae300c-37cf-4cd6-b17f-864661a960e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:12:50.045372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae300c-37cf-4cd6-b17f-864661a960e0 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:12:50.063334 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 563/1117] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:12:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:12:52.103780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48319e3c-02b2-436b-b672-c52901778ffa None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:52.104348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48319e3c-02b2-436b-b672-c52901778ffa None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:52.104348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48319e3c-02b2-436b-b672-c52901778ffa None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:52.105743 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 555/1118] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 03:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:12:52.111164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da3e5b-a7eb-406c-8988-f6ccc657652f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:52.111558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da3e5b-a7eb-406c-8988-f6ccc657652f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:52.111763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da3e5b-a7eb-406c-8988-f6ccc657652f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:52.153630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:52.179184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b2da3e5b-a7eb-406c-8988-f6ccc657652f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:12:52.182915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b2da3e5b-a7eb-406c-8988-f6ccc657652f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:52.280904 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 564/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 03:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:12:52.564066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48319e3c-02b2-436b-b672-c52901778ffa None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:12:52.565640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-48319e3c-02b2-436b-b672-c52901778ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:52.667058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48319e3c-02b2-436b-b672-c52901778ffa None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:12:52.698851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:52.740163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e18b3-99df-4ec5-9167-5be48048b428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:12:52.740765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e18b3-99df-4ec5-9167-5be48048b428 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:52.741044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e18b3-99df-4ec5-9167-5be48048b428 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:52.741314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e18b3-99df-4ec5-9167-5be48048b428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:52.742962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-727e18b3-99df-4ec5-9167-5be48048b428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:52.847942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e18b3-99df-4ec5-9167-5be48048b428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:12:52.849298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e18b3-99df-4ec5-9167-5be48048b428 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:12:52.867314 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 556/1120] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:12:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:12:55.185896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7cc26-fd57-47b7-9420-27b90e4e1bdd None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:55.186377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7cc26-fd57-47b7-9420-27b90e4e1bdd None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:55.186475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7cc26-fd57-47b7-9420-27b90e4e1bdd None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:55.188119 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 565/1121] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 03:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:12:55.193908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7521a00-17da-4dcd-9ec3-209ca499bb73 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:55.194389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7521a00-17da-4dcd-9ec3-209ca499bb73 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:55.194500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7521a00-17da-4dcd-9ec3-209ca499bb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:55.259284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d7521a00-17da-4dcd-9ec3-209ca499bb73 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:12:55.260494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d7521a00-17da-4dcd-9ec3-209ca499bb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:55.273418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:55.357112 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 557/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 03:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:12:55.644911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7cc26-fd57-47b7-9420-27b90e4e1bdd None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:12:55.646503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cdb7cc26-fd57-47b7-9420-27b90e4e1bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:55.748598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7cc26-fd57-47b7-9420-27b90e4e1bdd None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:12:55.761083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:55.820741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c72438-4330-4041-badc-0da0e391db86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:12:55.821340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c72438-4330-4041-badc-0da0e391db86 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:55.821620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c72438-4330-4041-badc-0da0e391db86 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:55.821891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c72438-4330-4041-badc-0da0e391db86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:55.823508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d9c72438-4330-4041-badc-0da0e391db86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:55.929976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c72438-4330-4041-badc-0da0e391db86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:12:55.931401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c72438-4330-4041-badc-0da0e391db86 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:12:55.948774 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 566/1123] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:12:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:12:58.424929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f62f63-cb1d-491e-9e6c-ac9edc2ac1f5 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:58.425473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f62f63-cb1d-491e-9e6c-ac9edc2ac1f5 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:58.425473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f62f63-cb1d-491e-9e6c-ac9edc2ac1f5 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:58.426806 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 558/1124] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 03:12:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:12:58.432146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b055b-ac8f-4fcb-810b-d46eb85250de None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:58.432574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b055b-ac8f-4fcb-810b-d46eb85250de None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:58.432677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b055b-ac8f-4fcb-810b-d46eb85250de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:58.479738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:58.497633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-992b055b-ac8f-4fcb-810b-d46eb85250de None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:12:58.500450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-992b055b-ac8f-4fcb-810b-d46eb85250de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:58.593723 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 567/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 03:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:12:58.876287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f62f63-cb1d-491e-9e6c-ac9edc2ac1f5 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:12:58.877866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-50f62f63-cb1d-491e-9e6c-ac9edc2ac1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:58.981718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f62f63-cb1d-491e-9e6c-ac9edc2ac1f5 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:12:59.021389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:59.057922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147192aa-9e3e-4ed1-91a9-d5ce00dba3f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:12:59.058645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147192aa-9e3e-4ed1-91a9-d5ce00dba3f7 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:12:59.058927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147192aa-9e3e-4ed1-91a9-d5ce00dba3f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:12:59.059202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147192aa-9e3e-4ed1-91a9-d5ce00dba3f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:12:59.060817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-147192aa-9e3e-4ed1-91a9-d5ce00dba3f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:12:59.168842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147192aa-9e3e-4ed1-91a9-d5ce00dba3f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:12:59.170233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147192aa-9e3e-4ed1-91a9-d5ce00dba3f7 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:12:59.188811 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 559/1126] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:12:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:13:01.480595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93787267-3df1-4543-bb7c-aeedbd01efad None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:01.481144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93787267-3df1-4543-bb7c-aeedbd01efad None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:01.481144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93787267-3df1-4543-bb7c-aeedbd01efad None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:01.482540 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 568/1127] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 03:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:13:01.487835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938571b-931f-447f-bd5e-48df8cd7d99a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:01.488217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938571b-931f-447f-bd5e-48df8cd7d99a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:01.488386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938571b-931f-447f-bd5e-48df8cd7d99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:01.555369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5938571b-931f-447f-bd5e-48df8cd7d99a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:13:01.556581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5938571b-931f-447f-bd5e-48df8cd7d99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:01.577232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:01.652781 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 560/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 03:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:13:01.937174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93787267-3df1-4543-bb7c-aeedbd01efad None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:13:01.938793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-93787267-3df1-4543-bb7c-aeedbd01efad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:02.041486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93787267-3df1-4543-bb7c-aeedbd01efad None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:13:02.061273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:02.113855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c31fa6-edc8-4d7a-b2ac-4a0e5926f3f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:13:02.114491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c31fa6-edc8-4d7a-b2ac-4a0e5926f3f7 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:02.114770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c31fa6-edc8-4d7a-b2ac-4a0e5926f3f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:02.115042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c31fa6-edc8-4d7a-b2ac-4a0e5926f3f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:02.116623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-86c31fa6-edc8-4d7a-b2ac-4a0e5926f3f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:02.224407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c31fa6-edc8-4d7a-b2ac-4a0e5926f3f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:13:02.225838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c31fa6-edc8-4d7a-b2ac-4a0e5926f3f7 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:13:02.243286 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 569/1129] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:13:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:13:04.427289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18241a5-b900-4379-b683-4ddb5d5ed679 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:04.427849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18241a5-b900-4379-b683-4ddb5d5ed679 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:04.427849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18241a5-b900-4379-b683-4ddb5d5ed679 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:04.429216 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 561/1130] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 03:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:13:04.434467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6befb-1c1c-4ca6-bea4-37352590fe9b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:04.434888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6befb-1c1c-4ca6-bea4-37352590fe9b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:04.435220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6befb-1c1c-4ca6-bea4-37352590fe9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:04.498440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:04.501258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f7f6befb-1c1c-4ca6-bea4-37352590fe9b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:13:04.502504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f7f6befb-1c1c-4ca6-bea4-37352590fe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:04.598574 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 570/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 03:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:13:04.884205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18241a5-b900-4379-b683-4ddb5d5ed679 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:13:04.885754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c18241a5-b900-4379-b683-4ddb5d5ed679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:04.988633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18241a5-b900-4379-b683-4ddb5d5ed679 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:13:05.037196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:05.060556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2316d-1741-4276-ba87-40a81f5db5c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:13:05.061157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2316d-1741-4276-ba87-40a81f5db5c4 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:05.061440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2316d-1741-4276-ba87-40a81f5db5c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:05.061713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2316d-1741-4276-ba87-40a81f5db5c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:05.063335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ace2316d-1741-4276-ba87-40a81f5db5c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:05.170713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2316d-1741-4276-ba87-40a81f5db5c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:13:05.172153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2316d-1741-4276-ba87-40a81f5db5c4 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:13:05.190718 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 562/1132] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:13:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:13:07.508800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58c800-ad69-49b0-9ca0-b6642e426024 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:07.509360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58c800-ad69-49b0-9ca0-b6642e426024 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:07.509360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58c800-ad69-49b0-9ca0-b6642e426024 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:07.510725 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 571/1133] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 03:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:13:07.516293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4aac0-a680-4033-999b-0681f775852e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:07.516689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4aac0-a680-4033-999b-0681f775852e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:07.516834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4aac0-a680-4033-999b-0681f775852e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:07.581230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-cde4aac0-a680-4033-999b-0681f775852e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:13:07.582459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cde4aac0-a680-4033-999b-0681f775852e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:07.611232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:07.679537 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 563/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 03:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:13:07.960117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58c800-ad69-49b0-9ca0-b6642e426024 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:13:07.961810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4b58c800-ad69-49b0-9ca0-b6642e426024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:08.063855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58c800-ad69-49b0-9ca0-b6642e426024 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:13:08.092813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:08.136576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef117ea-7bcf-4040-8ee0-19e03058ea26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:13:08.137599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef117ea-7bcf-4040-8ee0-19e03058ea26 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:08.138256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef117ea-7bcf-4040-8ee0-19e03058ea26 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:08.138532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef117ea-7bcf-4040-8ee0-19e03058ea26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:08.140388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-eef117ea-7bcf-4040-8ee0-19e03058ea26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:08.248337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef117ea-7bcf-4040-8ee0-19e03058ea26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:13:08.249772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef117ea-7bcf-4040-8ee0-19e03058ea26 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:13:08.268424 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 572/1135] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:13:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:13:10.439871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b59f0-8add-43fd-af44-9c4e4fe355d1 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:10.440386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b59f0-8add-43fd-af44-9c4e4fe355d1 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:10.440386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b59f0-8add-43fd-af44-9c4e4fe355d1 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:10.441718 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 564/1136] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 03:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:13:10.447043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947f9d8-4ca1-4b44-855f-69198cad7d36 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:10.447449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947f9d8-4ca1-4b44-855f-69198cad7d36 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:10.447594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947f9d8-4ca1-4b44-855f-69198cad7d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:10.512142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1947f9d8-4ca1-4b44-855f-69198cad7d36 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:13:10.513347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1947f9d8-4ca1-4b44-855f-69198cad7d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:10.522304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:10.608745 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 573/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 03:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:13:10.887308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b59f0-8add-43fd-af44-9c4e4fe355d1 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:13:10.888913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e62b59f0-8add-43fd-af44-9c4e4fe355d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:10.995180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b59f0-8add-43fd-af44-9c4e4fe355d1 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:13:11.050042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:11.067674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2a077-1344-4e9b-b7a4-1a78b5d1a7b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:13:11.068353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2a077-1344-4e9b-b7a4-1a78b5d1a7b8 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:11.068630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2a077-1344-4e9b-b7a4-1a78b5d1a7b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:11.068941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2a077-1344-4e9b-b7a4-1a78b5d1a7b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:11.070546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-caf2a077-1344-4e9b-b7a4-1a78b5d1a7b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:11.179231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2a077-1344-4e9b-b7a4-1a78b5d1a7b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:13:11.181173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2a077-1344-4e9b-b7a4-1a78b5d1a7b8 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:13:11.199822 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 565/1138] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:13:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:13:13.504893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b85fd8-de1f-4411-be38-2350f82c595a None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:13.505471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b85fd8-de1f-4411-be38-2350f82c595a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:13.505471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b85fd8-de1f-4411-be38-2350f82c595a None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:13.506830 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 574/1139] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 03:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:13:13.512114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5045206-8874-4451-b24d-a9aa4e3a2cd2 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:13.512582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5045206-8874-4451-b24d-a9aa4e3a2cd2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:13.512680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5045206-8874-4451-b24d-a9aa4e3a2cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:13.577540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a5045206-8874-4451-b24d-a9aa4e3a2cd2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:13:13.578773 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a5045206-8874-4451-b24d-a9aa4e3a2cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:13.617741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:13.675668 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 566/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 03:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:13:13.955657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b85fd8-de1f-4411-be38-2350f82c595a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:13:13.957249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b4b85fd8-de1f-4411-be38-2350f82c595a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:14.061234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b85fd8-de1f-4411-be38-2350f82c595a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:13:14.100016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:14.135266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd3412-db74-42f0-a794-a4e377690836 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:13:14.135884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd3412-db74-42f0-a794-a4e377690836 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:14.136163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd3412-db74-42f0-a794-a4e377690836 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:14.136435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd3412-db74-42f0-a794-a4e377690836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:14.138058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a2bd3412-db74-42f0-a794-a4e377690836 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:14.249948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd3412-db74-42f0-a794-a4e377690836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:13:14.251403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd3412-db74-42f0-a794-a4e377690836 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:13:14.271285 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 575/1141] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:13:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:13:16.419449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440126a-6099-43ee-b3c6-8ebcaee976d7 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:16.419960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440126a-6099-43ee-b3c6-8ebcaee976d7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:16.419960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440126a-6099-43ee-b3c6-8ebcaee976d7 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:16.421266 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 567/1142] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 03:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:13:16.427031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3910b0f-d7e8-456e-9b49-ae34b4054dfc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:16.427418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3910b0f-d7e8-456e-9b49-ae34b4054dfc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:16.427576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3910b0f-d7e8-456e-9b49-ae34b4054dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:16.491644 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d3910b0f-d7e8-456e-9b49-ae34b4054dfc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:13:16.492846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d3910b0f-d7e8-456e-9b49-ae34b4054dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:16.509968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:16.587712 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 576/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 03:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:13:16.867494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440126a-6099-43ee-b3c6-8ebcaee976d7 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:13:16.870796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1440126a-6099-43ee-b3c6-8ebcaee976d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:16.973165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440126a-6099-43ee-b3c6-8ebcaee976d7 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:13:17.039069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:17.045353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b53ca9-5109-4cd7-9371-9b6bb0a7b7c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:13:17.045989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b53ca9-5109-4cd7-9371-9b6bb0a7b7c9 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:17.046300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b53ca9-5109-4cd7-9371-9b6bb0a7b7c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:17.046572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b53ca9-5109-4cd7-9371-9b6bb0a7b7c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:17.048166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-95b53ca9-5109-4cd7-9371-9b6bb0a7b7c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:17.155704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b53ca9-5109-4cd7-9371-9b6bb0a7b7c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:13:17.157135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b53ca9-5109-4cd7-9371-9b6bb0a7b7c9 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:13:17.175414 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 568/1144] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:13:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:13:19.323553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a9834-5608-4e82-8f99-0ffcaa57e1a1 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:19.324112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a9834-5608-4e82-8f99-0ffcaa57e1a1 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:19.324112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a9834-5608-4e82-8f99-0ffcaa57e1a1 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:19.325484 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 577/1145] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 03:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:13:19.330714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591fe01-4b28-40db-9327-e26a3e6e243f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:19.331116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591fe01-4b28-40db-9327-e26a3e6e243f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:19.331264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591fe01-4b28-40db-9327-e26a3e6e243f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:19.396466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-2591fe01-4b28-40db-9327-e26a3e6e243f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:13:19.397683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2591fe01-4b28-40db-9327-e26a3e6e243f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:19.445106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:19.492897 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 569/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 03:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:13:19.774754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a9834-5608-4e82-8f99-0ffcaa57e1a1 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:13:19.776457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-925a9834-5608-4e82-8f99-0ffcaa57e1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:19.881901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a9834-5608-4e82-8f99-0ffcaa57e1a1 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:13:19.931648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:19.956959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d87190-f2ff-4c9d-a2c0-ae5031c40ba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:13:19.957573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d87190-f2ff-4c9d-a2c0-ae5031c40ba7 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:19.957853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d87190-f2ff-4c9d-a2c0-ae5031c40ba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:19.958161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d87190-f2ff-4c9d-a2c0-ae5031c40ba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:19.960433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-93d87190-f2ff-4c9d-a2c0-ae5031c40ba7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:20.065554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d87190-f2ff-4c9d-a2c0-ae5031c40ba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:13:20.066924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d87190-f2ff-4c9d-a2c0-ae5031c40ba7 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:13:20.084975 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 578/1147] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:13:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:13:29.491341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=22 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:30.082747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=66 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:40.205779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42be53e-0e66-4387-96f1-6a9b6abccaf9 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:40.206309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42be53e-0e66-4387-96f1-6a9b6abccaf9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:40.206441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42be53e-0e66-4387-96f1-6a9b6abccaf9 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:40.207747 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 570/1148] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:13:40.213138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c480fb-d66a-45ee-a57f-4ac5586ad830 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:40.213540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c480fb-d66a-45ee-a57f-4ac5586ad830 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:40.213726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c480fb-d66a-45ee-a57f-4ac5586ad830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:40.278623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-53c480fb-d66a-45ee-a57f-4ac5586ad830 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:13:40.279812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-53c480fb-d66a-45ee-a57f-4ac5586ad830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:40.372514 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 579/1149] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:13:40.671488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bdc8e-e3fb-451b-af43-9cdb21bd163b None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:40.671789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bdc8e-e3fb-451b-af43-9cdb21bd163b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:40.672079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bdc8e-e3fb-451b-af43-9cdb21bd163b None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:40.674063 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 571/1150] 10.222.0.20 () {54 vars in 962 bytes} [Thu Oct 27 03:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:13:40.684051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7206935-67d5-4563-a534-b1edfd1be6ed None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:40.684051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7206935-67d5-4563-a534-b1edfd1be6ed None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:40.684051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7206935-67d5-4563-a534-b1edfd1be6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:40.755079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e7206935-67d5-4563-a534-b1edfd1be6ed None None] MFA Rules not processed for user `c2b7050fa8404001876dbfd40e392015`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:13:40.756281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e7206935-67d5-4563-a534-b1edfd1be6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:40.776237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:40.830955 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 580/1151] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Oct 27 03:13:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:13:40.838682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bdc8e-e3fb-451b-af43-9cdb21bd163b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:13:40.840236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2d3bdc8e-e3fb-451b-af43-9cdb21bd163b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:40.943334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bdc8e-e3fb-451b-af43-9cdb21bd163b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:13:41.015964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f9f1f-d479-4d6f-918d-29dfe8105a83 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:13:41.016599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f9f1f-d479-4d6f-918d-29dfe8105a83 service glance] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:41.017480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f9f1f-d479-4d6f-918d-29dfe8105a83 service glance] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:41.017751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f9f1f-d479-4d6f-918d-29dfe8105a83 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:41.019354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-092f9f1f-d479-4d6f-918d-29dfe8105a83 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:41.071713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:41.125389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f9f1f-d479-4d6f-918d-29dfe8105a83 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:13:41.126872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f9f1f-d479-4d6f-918d-29dfe8105a83 service glance] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:13:41.145617 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 572/1152] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:13:43.458476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff40c0-32dc-4388-b754-4620cac823f7 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:43.458994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff40c0-32dc-4388-b754-4620cac823f7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:43.459109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff40c0-32dc-4388-b754-4620cac823f7 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:43.460372 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 581/1153] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:13:43.465684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714f67a-06df-4326-afa6-20b80ac717c7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:43.466163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714f67a-06df-4326-afa6-20b80ac717c7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:43.466268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714f67a-06df-4326-afa6-20b80ac717c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:43.531220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9714f67a-06df-4326-afa6-20b80ac717c7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:13:43.532934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9714f67a-06df-4326-afa6-20b80ac717c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:43.628105 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 573/1154] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:13:43.900879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff40c0-32dc-4388-b754-4620cac823f7 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:13:43.902378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-dcff40c0-32dc-4388-b754-4620cac823f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:44.024975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff40c0-32dc-4388-b754-4620cac823f7 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:13:44.072423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:44.115701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c29642-8ed8-48a8-a0c8-1ffdcab1deee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:13:44.116304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c29642-8ed8-48a8-a0c8-1ffdcab1deee admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:44.116585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c29642-8ed8-48a8-a0c8-1ffdcab1deee admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:44.116859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c29642-8ed8-48a8-a0c8-1ffdcab1deee admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:44.117500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c29642-8ed8-48a8-a0c8-1ffdcab1deee admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:13:44.118623 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-17c29642-8ed8-48a8-a0c8-1ffdcab1deee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:13:44.118623 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:13:44.118623 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:13:44.119760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c29642-8ed8-48a8-a0c8-1ffdcab1deee admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:13:44.138698 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 582/1155] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 27 03:13:43 2022] GET /identity/v3/projects => generated 2553 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:13:46.287154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4f640-67be-4c59-9bbe-d468e41021e0 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:46.287662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4f640-67be-4c59-9bbe-d468e41021e0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:46.287662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4f640-67be-4c59-9bbe-d468e41021e0 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:46.289018 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 574/1156] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:13:46.294195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6472a7e-36b7-4084-9056-5d84c46b4b60 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:46.294641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6472a7e-36b7-4084-9056-5d84c46b4b60 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:46.294779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6472a7e-36b7-4084-9056-5d84c46b4b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:46.360169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e6472a7e-36b7-4084-9056-5d84c46b4b60 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:13:46.361871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e6472a7e-36b7-4084-9056-5d84c46b4b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:46.457228 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 583/1157] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:13:46.747283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4f640-67be-4c59-9bbe-d468e41021e0 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:13:46.748825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-84d4f640-67be-4c59-9bbe-d468e41021e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:46.758995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:46.896062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4f640-67be-4c59-9bbe-d468e41021e0 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:13:46.975187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:47.007293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c9d75-c73f-4daa-aa42-b051ae2e4d5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:13:47.007837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c9d75-c73f-4daa-aa42-b051ae2e4d5f service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:47.008116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c9d75-c73f-4daa-aa42-b051ae2e4d5f service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:47.008390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c9d75-c73f-4daa-aa42-b051ae2e4d5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:47.009977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-403c9d75-c73f-4daa-aa42-b051ae2e4d5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:47.098199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c9d75-c73f-4daa-aa42-b051ae2e4d5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:13:47.099795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c9d75-c73f-4daa-aa42-b051ae2e4d5f service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:13:47.117211 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 575/1158] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:13:49.454767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a3240-67d3-454e-891d-fe3116a16889 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:49.455305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a3240-67d3-454e-891d-fe3116a16889 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:49.455414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a3240-67d3-454e-891d-fe3116a16889 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:49.456707 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 584/1159] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:13:49.461908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bb49f-57bd-483d-bb8a-9b81071fe18a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:49.462349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bb49f-57bd-483d-bb8a-9b81071fe18a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:49.462497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bb49f-57bd-483d-bb8a-9b81071fe18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:49.527530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a19bb49f-57bd-483d-bb8a-9b81071fe18a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:13:49.528715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a19bb49f-57bd-483d-bb8a-9b81071fe18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:49.573921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:49.623308 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 576/1160] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:13:49.910355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a3240-67d3-454e-891d-fe3116a16889 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:13:49.911917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7d7a3240-67d3-454e-891d-fe3116a16889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:49.935058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:50.012425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a3240-67d3-454e-891d-fe3116a16889 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:13:50.084877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869467fc-67fa-40a9-aacf-da38bed66de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:13:50.085480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869467fc-67fa-40a9-aacf-da38bed66de1 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:50.085760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869467fc-67fa-40a9-aacf-da38bed66de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:50.086045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869467fc-67fa-40a9-aacf-da38bed66de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:50.087640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-869467fc-67fa-40a9-aacf-da38bed66de1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:50.160653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:50.194552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869467fc-67fa-40a9-aacf-da38bed66de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:13:50.196030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869467fc-67fa-40a9-aacf-da38bed66de1 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:13:50.214143 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 585/1161] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:13:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:13:52.409218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70537a42-1536-468a-abf8-63a737802f08 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:52.409816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70537a42-1536-468a-abf8-63a737802f08 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:52.409816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70537a42-1536-468a-abf8-63a737802f08 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:52.411171 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 577/1162] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:13:52.416282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206816d-4983-4296-aefa-c3f94c321084 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:52.416730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206816d-4983-4296-aefa-c3f94c321084 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:52.416837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206816d-4983-4296-aefa-c3f94c321084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:52.481889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f206816d-4983-4296-aefa-c3f94c321084 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:13:52.483135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f206816d-4983-4296-aefa-c3f94c321084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:52.578394 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 586/1163] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:13:52.861668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70537a42-1536-468a-abf8-63a737802f08 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:13:52.863242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-70537a42-1536-468a-abf8-63a737802f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:52.966479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70537a42-1536-468a-abf8-63a737802f08 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:13:53.037303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:53.038821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b83718-ed47-4096-8b8d-5dd709d5dcb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:13:53.039428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b83718-ed47-4096-8b8d-5dd709d5dcb4 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:53.039706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b83718-ed47-4096-8b8d-5dd709d5dcb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:53.039974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b83718-ed47-4096-8b8d-5dd709d5dcb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:53.041543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b8b83718-ed47-4096-8b8d-5dd709d5dcb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:53.148120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b83718-ed47-4096-8b8d-5dd709d5dcb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:13:53.149484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b83718-ed47-4096-8b8d-5dd709d5dcb4 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:13:53.167357 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 578/1164] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:13:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:13:55.381675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b061e-537a-4638-8df0-3ad0a9ae8f7e None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:55.386876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b061e-537a-4638-8df0-3ad0a9ae8f7e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:55.386876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b061e-537a-4638-8df0-3ad0a9ae8f7e None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:55.386876 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 587/1165] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:13:55.389042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114390d-9fa0-428d-8246-c89f29e8a1b8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:55.389444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114390d-9fa0-428d-8246-c89f29e8a1b8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:55.389855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114390d-9fa0-428d-8246-c89f29e8a1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:55.455936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c114390d-9fa0-428d-8246-c89f29e8a1b8 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:13:55.457161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c114390d-9fa0-428d-8246-c89f29e8a1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:55.509323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:55.552399 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 579/1166] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:13:55.842335 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b061e-537a-4638-8df0-3ad0a9ae8f7e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:13:55.843895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-562b061e-537a-4638-8df0-3ad0a9ae8f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:55.881070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:55.948824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b061e-537a-4638-8df0-3ad0a9ae8f7e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:13:56.020745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd781d17-4545-48a9-88f1-28cf677e6cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:13:56.021362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd781d17-4545-48a9-88f1-28cf677e6cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:56.021645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd781d17-4545-48a9-88f1-28cf677e6cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:56.021919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd781d17-4545-48a9-88f1-28cf677e6cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:56.023561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cd781d17-4545-48a9-88f1-28cf677e6cb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:56.101693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:56.130266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd781d17-4545-48a9-88f1-28cf677e6cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:13:56.131787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd781d17-4545-48a9-88f1-28cf677e6cb6 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:13:56.149318 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 588/1167] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:13:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:13:58.613370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175433a-30b4-4691-9810-1e2a33b66b4a None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:58.613951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175433a-30b4-4691-9810-1e2a33b66b4a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:58.613951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175433a-30b4-4691-9810-1e2a33b66b4a None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:58.615299 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 580/1168] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 27 03:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:13:58.620381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cc92f-a8bb-444e-9067-fcbef253fa22 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:58.620825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cc92f-a8bb-444e-9067-fcbef253fa22 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:58.620939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cc92f-a8bb-444e-9067-fcbef253fa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:58.686470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0a0cc92f-a8bb-444e-9067-fcbef253fa22 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:13:58.687714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0a0cc92f-a8bb-444e-9067-fcbef253fa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:58.782702 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 589/1169] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 27 03:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:13:59.065659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175433a-30b4-4691-9810-1e2a33b66b4a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:13:59.067240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1175433a-30b4-4691-9810-1e2a33b66b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:59.167721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175433a-30b4-4691-9810-1e2a33b66b4a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:13:59.244119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f90da-1280-4a75-bf10-dfdd7f6126cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:13:59.244725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f90da-1280-4a75-bf10-dfdd7f6126cd service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:13:59.245002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f90da-1280-4a75-bf10-dfdd7f6126cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:13:59.245294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f90da-1280-4a75-bf10-dfdd7f6126cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:13:59.246906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5c8f90da-1280-4a75-bf10-dfdd7f6126cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:13:59.255227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:59.352466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f90da-1280-4a75-bf10-dfdd7f6126cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:13:59.353844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f90da-1280-4a75-bf10-dfdd7f6126cd service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:13:59.371762 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 581/1170] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:14:08.781142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=82 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:14:09.369561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=50 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:15:47.072807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16154e9c-b4ce-479d-846b-b2f8c729ed51 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:15:47.073388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16154e9c-b4ce-479d-846b-b2f8c729ed51 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:15:47.073388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16154e9c-b4ce-479d-846b-b2f8c729ed51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:15:47.151450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-16154e9c-b4ce-479d-846b-b2f8c729ed51 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:15:47.152571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-16154e9c-b4ce-479d-846b-b2f8c729ed51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:15:47.254805 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 590/1171] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:15:47.262858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b588a0-1218-4823-a750-e1a8ff09d567 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:15:47.263320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b588a0-1218-4823-a750-e1a8ff09d567 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:15:47.263426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b588a0-1218-4823-a750-e1a8ff09d567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:15:47.283994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b2b588a0-1218-4823-a750-e1a8ff09d567 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:15:47.285193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b2b588a0-1218-4823-a750-e1a8ff09d567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:15:47.293641 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 582/1172] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:15:47.298121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16154e9c-b4ce-479d-846b-b2f8c729ed51 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:15:47.307385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16154e9c-b4ce-479d-846b-b2f8c729ed51 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:15:47.312474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdd4f7-01bc-4b7a-a3be-52ced6a621e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:15:47.313062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdd4f7-01bc-4b7a-a3be-52ced6a621e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:15:47.313343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdd4f7-01bc-4b7a-a3be-52ced6a621e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:15:47.313642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdd4f7-01bc-4b7a-a3be-52ced6a621e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:15:47.314318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfdd4f7-01bc-4b7a-a3be-52ced6a621e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:15:47.314648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfdd4f7-01bc-4b7a-a3be-52ced6a621e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:15:47.315653 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-5bfdd4f7-01bc-4b7a-a3be-52ced6a621e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:15:47.315653 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:15:47.315653 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:15:47.316533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfdd4f7-01bc-4b7a-a3be-52ced6a621e6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:15:47.328171 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 591/1173] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:15:47.337224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b588a0-1218-4823-a750-e1a8ff09d567 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:15:47.346252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b588a0-1218-4823-a750-e1a8ff09d567 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:15:47.350879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7826234-bfd7-4b82-91d8-9ed85216a6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:15:47.351474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7826234-bfd7-4b82-91d8-9ed85216a6fc admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:15:47.351755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7826234-bfd7-4b82-91d8-9ed85216a6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:15:47.352031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7826234-bfd7-4b82-91d8-9ed85216a6fc admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:15:47.352656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7826234-bfd7-4b82-91d8-9ed85216a6fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:15:47.353680 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-e7826234-bfd7-4b82-91d8-9ed85216a6fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:15:47.353680 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:15:47.353680 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:15:47.354919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7826234-bfd7-4b82-91d8-9ed85216a6fc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:15:47.466147 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 583/1174] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:15:47 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:15:47.470302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdd4f7-01bc-4b7a-a3be-52ced6a621e6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:15:47.480111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdd4f7-01bc-4b7a-a3be-52ced6a621e6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:15:47.528922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:15:47.535686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d3ed2-cf74-478c-94b8-0fb5e647a90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:15:47.541070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d3ed2-cf74-478c-94b8-0fb5e647a90f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:15:47.541070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d3ed2-cf74-478c-94b8-0fb5e647a90f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:15:47.541070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d3ed2-cf74-478c-94b8-0fb5e647a90f admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:15:47.541070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d3ed2-cf74-478c-94b8-0fb5e647a90f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:15:47.541070 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-222d3ed2-cf74-478c-94b8-0fb5e647a90f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:15:47.541070 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:15:47.541070 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:15:47.541658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d3ed2-cf74-478c-94b8-0fb5e647a90f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:15:47.639707 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 592/1175] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:15:47 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:15:47.643871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7826234-bfd7-4b82-91d8-9ed85216a6fc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:15:47.654007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7826234-bfd7-4b82-91d8-9ed85216a6fc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:15:47.658693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346be7dd-45b6-4c6f-a2b0-95c05cb809b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:15:47.659286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346be7dd-45b6-4c6f-a2b0-95c05cb809b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:15:47.659571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346be7dd-45b6-4c6f-a2b0-95c05cb809b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:15:47.659844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346be7dd-45b6-4c6f-a2b0-95c05cb809b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:15:47.660489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346be7dd-45b6-4c6f-a2b0-95c05cb809b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:15:47.662125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346be7dd-45b6-4c6f-a2b0-95c05cb809b2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:15:47.675125 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 584/1176] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:15:47.679008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d3ed2-cf74-478c-94b8-0fb5e647a90f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:15:47.689488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d3ed2-cf74-478c-94b8-0fb5e647a90f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:15:47.694282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d62eff-2ac4-4c6a-b0ba-4114909bcc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:15:47.694888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d62eff-2ac4-4c6a-b0ba-4114909bcc18 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:15:47.695178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d62eff-2ac4-4c6a-b0ba-4114909bcc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:15:47.695451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d62eff-2ac4-4c6a-b0ba-4114909bcc18 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:15:47.696102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d62eff-2ac4-4c6a-b0ba-4114909bcc18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:15:47.697755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d62eff-2ac4-4c6a-b0ba-4114909bcc18 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:15:47.710917 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 593/1177] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:15:47.714913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346be7dd-45b6-4c6f-a2b0-95c05cb809b2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:15:47.724748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346be7dd-45b6-4c6f-a2b0-95c05cb809b2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:15:47.729255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238ee87-9235-4623-bffb-bc2c6465690d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:15:47.729898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238ee87-9235-4623-bffb-bc2c6465690d admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:15:47.730278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238ee87-9235-4623-bffb-bc2c6465690d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:15:47.730561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238ee87-9235-4623-bffb-bc2c6465690d admin admin] PATH_INFO: `/v3/projects/33dcb24f9fbb4c089fc028de7e723bfe/users/564ae8c20bcc40bc839d39eedef0c952/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:15:47.745261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238ee87-9235-4623-bffb-bc2c6465690d admin admin] RBAC: Authorizing `identity:create_grant(project_id=33dcb24f9fbb4c089fc028de7e723bfe, user_id=564ae8c20bcc40bc839d39eedef0c952, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:15:47.747951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238ee87-9235-4623-bffb-bc2c6465690d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:15:47.808706 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 585/1178] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:15:47 2022] PUT /identity/v3/projects/33dcb24f9fbb4c089fc028de7e723bfe/users/564ae8c20bcc40bc839d39eedef0c952/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:15:47.820499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140605c7-e25b-4ef8-bdd3-14b54416dc75 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:15:47.820785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140605c7-e25b-4ef8-bdd3-14b54416dc75 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:15:47.821059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140605c7-e25b-4ef8-bdd3-14b54416dc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:15:47.848127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-140605c7-e25b-4ef8-bdd3-14b54416dc75 None None] MFA Rules not processed for user `564ae8c20bcc40bc839d39eedef0c952`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:15:47.849322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-140605c7-e25b-4ef8-bdd3-14b54416dc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:15:47.913160 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 594/1179] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:15:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:15:47.927152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75f5b0-1f3c-4c33-acc2-14b5e7a92187 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:15:47.927442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75f5b0-1f3c-4c33-acc2-14b5e7a92187 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:15:47.927721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75f5b0-1f3c-4c33-acc2-14b5e7a92187 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:15:47.929062 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 586/1180] 10.222.0.20 () {54 vars in 963 bytes} [Thu Oct 27 03:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:15:47.933719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3e0ba-b8f0-49d2-a2b7-d1fdb5a74cf5 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:15:47.934007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3e0ba-b8f0-49d2-a2b7-d1fdb5a74cf5 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:15:47.934323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3e0ba-b8f0-49d2-a2b7-d1fdb5a74cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:15:47.993725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-01a3e0ba-b8f0-49d2-a2b7-d1fdb5a74cf5 None None] MFA Rules not processed for user `5ec1d24520c447a38ed321f62d4f9e98`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:15:47.994870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-01a3e0ba-b8f0-49d2-a2b7-d1fdb5a74cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:15:48.069539 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 595/1181] 10.222.0.20 () {58 vars in 1060 bytes} [Thu Oct 27 03:15:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:15:48.077380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75f5b0-1f3c-4c33-acc2-14b5e7a92187 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:15:48.087949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75f5b0-1f3c-4c33-acc2-14b5e7a92187 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:15:48.091512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682deec-620e-4576-8d1b-d7c354481079 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:15:48.092101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682deec-620e-4576-8d1b-d7c354481079 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:15:48.092383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682deec-620e-4576-8d1b-d7c354481079 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:15:48.092654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682deec-620e-4576-8d1b-d7c354481079 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:15:48.101205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682deec-620e-4576-8d1b-d7c354481079 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:15:48.102676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682deec-620e-4576-8d1b-d7c354481079 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:15:48.112097 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 587/1182] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:15:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:15:48.159620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61005fe1-e633-4c90-825d-ee004d18176c None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:15:48.160062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61005fe1-e633-4c90-825d-ee004d18176c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:15:48.160197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61005fe1-e633-4c90-825d-ee004d18176c None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:15:48.161537 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 596/1183] 10.222.0.20 () {52 vars in 830 bytes} [Thu Oct 27 03:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:15:48.165133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682deec-620e-4576-8d1b-d7c354481079 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:15:48.227210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682deec-620e-4576-8d1b-d7c354481079 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:15:48.231991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1d4a5-5997-48ab-994c-de5c9d9920fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:15:48.232617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1d4a5-5997-48ab-994c-de5c9d9920fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:15:48.232926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1d4a5-5997-48ab-994c-de5c9d9920fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:15:48.233197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1d4a5-5997-48ab-994c-de5c9d9920fb admin admin] PATH_INFO: `/v3/users/564ae8c20bcc40bc839d39eedef0c952` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:15:48.234955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1d4a5-5997-48ab-994c-de5c9d9920fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=564ae8c20bcc40bc839d39eedef0c952)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:15:48.235986 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-d0b1d4a5-5997-48ab-994c-de5c9d9920fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:15:48.235986 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:15:48.235986 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:15:48.237235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1d4a5-5997-48ab-994c-de5c9d9920fb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:15:48.469164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d0b1d4a5-5997-48ab-994c-de5c9d9920fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '564ae8c20bcc40bc839d39eedef0c952'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:15:48.469893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d0b1d4a5-5997-48ab-994c-de5c9d9920fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '564ae8c20bcc40bc839d39eedef0c952'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:15:48.484523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d0b1d4a5-5997-48ab-994c-de5c9d9920fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '564ae8c20bcc40bc839d39eedef0c952'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:15:48.509569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d0b1d4a5-5997-48ab-994c-de5c9d9920fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '564ae8c20bcc40bc839d39eedef0c952'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:15:48.513537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:15:48.596475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d0b1d4a5-5997-48ab-994c-de5c9d9920fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '564ae8c20bcc40bc839d39eedef0c952'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:15:48.602711 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 588/1184] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:15:48 2022] DELETE /identity/v3/users/564ae8c20bcc40bc839d39eedef0c952 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:15:48.607035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cb394-7c06-4184-b8ff-90e9d4b53bbb None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:15:48.607328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cb394-7c06-4184-b8ff-90e9d4b53bbb None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:15:48.607608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cb394-7c06-4184-b8ff-90e9d4b53bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:15:48.626404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0d8cb394-7c06-4184-b8ff-90e9d4b53bbb None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:15:48.627604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0d8cb394-7c06-4184-b8ff-90e9d4b53bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:15:48.636411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:15:48.692599 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 597/1185] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:15:48.703613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1d4a5-5997-48ab-994c-de5c9d9920fb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:15:48.705014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d0b1d4a5-5997-48ab-994c-de5c9d9920fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:15:48.781412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1d4a5-5997-48ab-994c-de5c9d9920fb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:15:48.784951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b7a3a-9685-46be-8fa0-d1900c635f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:15:48.785553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b7a3a-9685-46be-8fa0-d1900c635f38 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:15:48.785833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b7a3a-9685-46be-8fa0-d1900c635f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:15:48.786140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b7a3a-9685-46be-8fa0-d1900c635f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:15:48.794906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b7a3a-9685-46be-8fa0-d1900c635f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:15:48.796342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b7a3a-9685-46be-8fa0-d1900c635f38 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:15:48.805473 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 589/1186] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:15:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:15:49.323731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cb394-7c06-4184-b8ff-90e9d4b53bbb None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:15:49.326892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0d8cb394-7c06-4184-b8ff-90e9d4b53bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:15:49.336973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cb394-7c06-4184-b8ff-90e9d4b53bbb None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:15:49.341802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b479788-947f-40c5-b379-3d86954c5de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:15:49.342475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b479788-947f-40c5-b379-3d86954c5de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:15:49.342763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b479788-947f-40c5-b379-3d86954c5de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:15:49.343040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b479788-947f-40c5-b379-3d86954c5de1 admin admin] PATH_INFO: `/v3/projects/33dcb24f9fbb4c089fc028de7e723bfe` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:15:49.344204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b479788-947f-40c5-b379-3d86954c5de1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33dcb24f9fbb4c089fc028de7e723bfe)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:15:49.345257 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-0b479788-947f-40c5-b379-3d86954c5de1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:15:49.345257 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:15:49.345257 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:15:49.346458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b479788-947f-40c5-b379-3d86954c5de1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:15:49.475147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0b479788-947f-40c5-b379-3d86954c5de1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33dcb24f9fbb4c089fc028de7e723bfe', 'request_id': 'req-0b479788-947f-40c5-b379-3d86954c5de1'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:15:49.488918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0b479788-947f-40c5-b379-3d86954c5de1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33dcb24f9fbb4c089fc028de7e723bfe', 'request_id': 'req-0b479788-947f-40c5-b379-3d86954c5de1'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:15:49.495119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0b479788-947f-40c5-b379-3d86954c5de1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33dcb24f9fbb4c089fc028de7e723bfe', 'request_id': 'req-0b479788-947f-40c5-b379-3d86954c5de1'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:15:49.543874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0b479788-947f-40c5-b379-3d86954c5de1 admin admin] The token cache is being invalidate because project 33dcb24f9fbb4c089fc028de7e723bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:15:49.544165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0b479788-947f-40c5-b379-3d86954c5de1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:15:49.544791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0b479788-947f-40c5-b379-3d86954c5de1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:15:49.546982 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 598/1187] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:15:49 2022] DELETE /identity/v3/projects/33dcb24f9fbb4c089fc028de7e723bfe => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:15:58.801435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:15:59.540809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:18:47.212663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bfa45-f533-4da8-a7f4-5221a268a152 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:18:47.213150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bfa45-f533-4da8-a7f4-5221a268a152 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:18:47.213256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bfa45-f533-4da8-a7f4-5221a268a152 None None] PATH_INFO: `/v3` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:18:47.214513 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 590/1188] 10.222.0.44 () {54 vars in 925 bytes} [Thu Oct 27 03:18:47 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:18:47.221470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f3db4-0683-4db6-98e8-ff7e1cd309b9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:18:47.221873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f3db4-0683-4db6-98e8-ff7e1cd309b9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:18:47.222024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f3db4-0683-4db6-98e8-ff7e1cd309b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:18:47.270516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e37f3db4-0683-4db6-98e8-ff7e1cd309b9 None None] MFA Rules not processed for user `1a395d2414cd4da085a77ddc9b1f1caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:18:47.271714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e37f3db4-0683-4db6-98e8-ff7e1cd309b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:18:47.340401 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 599/1189] 10.222.0.44 () {58 vars in 1015 bytes} [Thu Oct 27 03:18:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:18:47.524441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5633ea-91d1-4e58-9c9e-064c7c276b7c None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:18:47.524727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5633ea-91d1-4e58-9c9e-064c7c276b7c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:18:47.525004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5633ea-91d1-4e58-9c9e-064c7c276b7c None None] PATH_INFO: `/v3` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:18:47.526295 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 591/1190] 10.222.0.18 () {54 vars in 925 bytes} [Thu Oct 27 03:18:47 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:18:47.539854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1cbf0-d8bd-4de4-9b6e-14eecf44196d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:18:47.540137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1cbf0-d8bd-4de4-9b6e-14eecf44196d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:18:47.540412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1cbf0-d8bd-4de4-9b6e-14eecf44196d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:18:47.559556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4aa1cbf0-d8bd-4de4-9b6e-14eecf44196d None None] MFA Rules not processed for user `1a395d2414cd4da085a77ddc9b1f1caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:18:47.560778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4aa1cbf0-d8bd-4de4-9b6e-14eecf44196d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:18:47.569235 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 600/1191] 10.222.0.18 () {58 vars in 1015 bytes} [Thu Oct 27 03:18:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:18:50.956632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe77b3f-195c-4a45-8598-4b31ac8b9464 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:18:50.957099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe77b3f-195c-4a45-8598-4b31ac8b9464 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:18:50.957207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe77b3f-195c-4a45-8598-4b31ac8b9464 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:18:50.958531 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 592/1192] 10.222.0.20 () {54 vars in 961 bytes} [Thu Oct 27 03:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:18:50.963576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b70a1-44d7-43cc-9262-0fdbc237a724 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:18:50.963969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b70a1-44d7-43cc-9262-0fdbc237a724 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:18:50.964141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b70a1-44d7-43cc-9262-0fdbc237a724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:18:50.983455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-651b70a1-44d7-43cc-9262-0fdbc237a724 None None] MFA Rules not processed for user `1a395d2414cd4da085a77ddc9b1f1caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:18:50.984661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-651b70a1-44d7-43cc-9262-0fdbc237a724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:18:50.993302 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 601/1193] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Oct 27 03:18:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:18:51.000681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe77b3f-195c-4a45-8598-4b31ac8b9464 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:18:51.014479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe77b3f-195c-4a45-8598-4b31ac8b9464 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:18:51.020744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c93a0-6404-4bc2-8054-572c0f037db9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:18:51.026258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c93a0-6404-4bc2-8054-572c0f037db9 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:18:51.026258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c93a0-6404-4bc2-8054-572c0f037db9 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:18:51.026258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c93a0-6404-4bc2-8054-572c0f037db9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:18:51.031370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c93a0-6404-4bc2-8054-572c0f037db9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:18:51.033515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c93a0-6404-4bc2-8054-572c0f037db9 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:18:51.044360 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 593/1194] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:18:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:18:51.310756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6e8d9-1ab7-4edc-86cf-ec112e0c7047 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:18:51.311048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6e8d9-1ab7-4edc-86cf-ec112e0c7047 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:18:51.311340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6e8d9-1ab7-4edc-86cf-ec112e0c7047 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:18:51.312676 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 602/1195] 10.222.0.20 () {54 vars in 961 bytes} [Thu Oct 27 03:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:18:51.318438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5471690-4913-4cca-abb0-beac3ba848fe None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:18:51.318737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5471690-4913-4cca-abb0-beac3ba848fe None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:18:51.319014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5471690-4913-4cca-abb0-beac3ba848fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:18:51.338402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c5471690-4913-4cca-abb0-beac3ba848fe None None] MFA Rules not processed for user `1a395d2414cd4da085a77ddc9b1f1caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:18:51.339653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c5471690-4913-4cca-abb0-beac3ba848fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:18:51.348074 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 594/1196] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Oct 27 03:18:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:18:51.355376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6e8d9-1ab7-4edc-86cf-ec112e0c7047 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:18:51.368827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6e8d9-1ab7-4edc-86cf-ec112e0c7047 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:18:51.373652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f4be2-995b-4e6e-84f3-6e7cf95e40e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:18:51.374264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f4be2-995b-4e6e-84f3-6e7cf95e40e4 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:18:51.374545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f4be2-995b-4e6e-84f3-6e7cf95e40e4 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:18:51.374815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f4be2-995b-4e6e-84f3-6e7cf95e40e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:18:51.383376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f4be2-995b-4e6e-84f3-6e7cf95e40e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:18:51.384942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f4be2-995b-4e6e-84f3-6e7cf95e40e4 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:18:51.394919 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 603/1197] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:18:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:19:01.333422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=9 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:19:01.390669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=56 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:19:15.763629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6909fe9-1b9a-49f1-9d1e-ed0ff9cd81ab None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:19:15.764179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6909fe9-1b9a-49f1-9d1e-ed0ff9cd81ab None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:19:15.764286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6909fe9-1b9a-49f1-9d1e-ed0ff9cd81ab None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:19:15.765579 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 595/1198] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 03:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:19:15.771117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77654e6-4cfd-44ce-8d22-f1abcb22f3a9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:19:15.771564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77654e6-4cfd-44ce-8d22-f1abcb22f3a9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:19:15.771669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77654e6-4cfd-44ce-8d22-f1abcb22f3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:19:15.791394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f77654e6-4cfd-44ce-8d22-f1abcb22f3a9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:19:15.792588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f77654e6-4cfd-44ce-8d22-f1abcb22f3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:19:15.852441 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 604/1199] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 03:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:19:16.004831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6909fe9-1b9a-49f1-9d1e-ed0ff9cd81ab None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:19:16.006548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f6909fe9-1b9a-49f1-9d1e-ed0ff9cd81ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:19:16.109077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6909fe9-1b9a-49f1-9d1e-ed0ff9cd81ab None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:19:16.114755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d7881-3fce-4d8e-ae13-2627a0913ad0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:19:16.115363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d7881-3fce-4d8e-ae13-2627a0913ad0 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:19:16.115644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d7881-3fce-4d8e-ae13-2627a0913ad0 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:19:16.115916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d7881-3fce-4d8e-ae13-2627a0913ad0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:19:16.124033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d7881-3fce-4d8e-ae13-2627a0913ad0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:19:16.125611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d7881-3fce-4d8e-ae13-2627a0913ad0 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:19:16.135540 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 596/1200] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:19:17.203811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f284e-7368-4626-a102-df0f076d3bb6 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:19:17.204258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f284e-7368-4626-a102-df0f076d3bb6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:19:17.204357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f284e-7368-4626-a102-df0f076d3bb6 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:19:17.205647 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 605/1201] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 03:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:19:17.211032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc1cdc-a5dd-4730-9099-48f2ccf07ecd None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:19:17.213550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc1cdc-a5dd-4730-9099-48f2ccf07ecd None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:19:17.213550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc1cdc-a5dd-4730-9099-48f2ccf07ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:19:17.231512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d7cc1cdc-a5dd-4730-9099-48f2ccf07ecd None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:19:17.232746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d7cc1cdc-a5dd-4730-9099-48f2ccf07ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:19:17.241487 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 597/1202] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 03:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:19:17.392205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f284e-7368-4626-a102-df0f076d3bb6 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:19:17.406763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f284e-7368-4626-a102-df0f076d3bb6 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:19:17.412715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772985fa-95a0-4b8b-afbc-5dad0d13d11d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:19:17.413311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772985fa-95a0-4b8b-afbc-5dad0d13d11d service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:19:17.413589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772985fa-95a0-4b8b-afbc-5dad0d13d11d service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:19:17.413859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772985fa-95a0-4b8b-afbc-5dad0d13d11d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:19:17.421758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772985fa-95a0-4b8b-afbc-5dad0d13d11d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:19:17.423385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772985fa-95a0-4b8b-afbc-5dad0d13d11d service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:19:17.432552 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 606/1203] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:19:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:19:21.260662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac69b4e-bd7d-4fb5-b1c6-cc31269a2445 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:19:21.261209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac69b4e-bd7d-4fb5-b1c6-cc31269a2445 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:19:21.261209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac69b4e-bd7d-4fb5-b1c6-cc31269a2445 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:19:21.262584 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 598/1204] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 03:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:19:21.267909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b9ec1-32da-4367-9ff9-a39ce1191149 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:19:21.268319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b9ec1-32da-4367-9ff9-a39ce1191149 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:19:21.268457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b9ec1-32da-4367-9ff9-a39ce1191149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:19:21.287404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ab4b9ec1-32da-4367-9ff9-a39ce1191149 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:19:21.288604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ab4b9ec1-32da-4367-9ff9-a39ce1191149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:19:21.296259 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 607/1205] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 03:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:19:21.580632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac69b4e-bd7d-4fb5-b1c6-cc31269a2445 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:19:21.582394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6ac69b4e-bd7d-4fb5-b1c6-cc31269a2445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:19:21.638051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac69b4e-bd7d-4fb5-b1c6-cc31269a2445 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:19:21.641785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8429a4c-d576-4da2-949c-1f513da69682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:19:21.642410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8429a4c-d576-4da2-949c-1f513da69682 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:19:21.642691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8429a4c-d576-4da2-949c-1f513da69682 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:19:21.642962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8429a4c-d576-4da2-949c-1f513da69682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:19:21.651516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8429a4c-d576-4da2-949c-1f513da69682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:19:21.652949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8429a4c-d576-4da2-949c-1f513da69682 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:19:21.662536 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 599/1206] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:19:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:19:23.788359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ded23d-8e29-4efc-a0df-28413d1af0f8 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:19:23.788948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ded23d-8e29-4efc-a0df-28413d1af0f8 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:19:23.788948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ded23d-8e29-4efc-a0df-28413d1af0f8 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:19:23.790312 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 608/1207] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 03:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:19:23.795677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cef6a-ab35-4660-a07b-60a1bf6b69ea None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:19:23.796139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cef6a-ab35-4660-a07b-60a1bf6b69ea None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:19:23.796240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cef6a-ab35-4660-a07b-60a1bf6b69ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:19:23.815936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e05cef6a-ab35-4660-a07b-60a1bf6b69ea None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:19:23.820553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e05cef6a-ab35-4660-a07b-60a1bf6b69ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:19:23.824995 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 600/1208] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 03:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:19:24.110491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ded23d-8e29-4efc-a0df-28413d1af0f8 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:19:24.121283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ded23d-8e29-4efc-a0df-28413d1af0f8 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:19:24.124811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514ebe0-4f1b-4354-9e10-123d3ebdd804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:19:24.125408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514ebe0-4f1b-4354-9e10-123d3ebdd804 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:19:24.125698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514ebe0-4f1b-4354-9e10-123d3ebdd804 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:19:24.125972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514ebe0-4f1b-4354-9e10-123d3ebdd804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:19:24.134715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514ebe0-4f1b-4354-9e10-123d3ebdd804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:19:24.136141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514ebe0-4f1b-4354-9e10-123d3ebdd804 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:19:24.146052 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 609/1209] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:19:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:19:33.810570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=78 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:19:34.141455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=42 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:14.317907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65794703-7ade-463f-ab5a-e285af5814a4 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:14.318489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65794703-7ade-463f-ab5a-e285af5814a4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:14.318489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65794703-7ade-463f-ab5a-e285af5814a4 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:14.320082 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 601/1210] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 27 03:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:20:14.325501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d305f-f6a5-4bc8-913b-b46f7856973d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:14.326012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d305f-f6a5-4bc8-913b-b46f7856973d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:14.326128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d305f-f6a5-4bc8-913b-b46f7856973d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:14.347566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9e0d305f-f6a5-4bc8-913b-b46f7856973d None None] MFA Rules not processed for user `1a395d2414cd4da085a77ddc9b1f1caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:14.348872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9e0d305f-f6a5-4bc8-913b-b46f7856973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:14.357755 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 610/1211] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 03:20:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:20:24.341805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:46.001910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7941b32-cb88-4e95-a5e1-a064cc466890 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:46.002984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7941b32-cb88-4e95-a5e1-a064cc466890 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:46.003440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7941b32-cb88-4e95-a5e1-a064cc466890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:46.029210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e7941b32-cb88-4e95-a5e1-a064cc466890 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:46.030723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e7941b32-cb88-4e95-a5e1-a064cc466890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:46.044009 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 602/1212] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:46.064180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f9360-8834-416c-a3f6-5f3c238ddde7 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:46.066150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f9360-8834-416c-a3f6-5f3c238ddde7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:46.066150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f9360-8834-416c-a3f6-5f3c238ddde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:46.094073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-526f9360-8834-416c-a3f6-5f3c238ddde7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:46.096602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-526f9360-8834-416c-a3f6-5f3c238ddde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:46.109254 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 611/1213] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:46.114754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7941b32-cb88-4e95-a5e1-a064cc466890 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:46.127860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7941b32-cb88-4e95-a5e1-a064cc466890 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:46.140110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4837e3-0acf-45db-9531-283c8fc53e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:46.140759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4837e3-0acf-45db-9531-283c8fc53e7a admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:46.141043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4837e3-0acf-45db-9531-283c8fc53e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:46.141879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4837e3-0acf-45db-9531-283c8fc53e7a admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:46.142592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4837e3-0acf-45db-9531-283c8fc53e7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:20:46.142904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4837e3-0acf-45db-9531-283c8fc53e7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:46.143976 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-2d4837e3-0acf-45db-9531-283c8fc53e7a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:20:46.143976 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:20:46.143976 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:20:46.145061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4837e3-0acf-45db-9531-283c8fc53e7a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:46.161071 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 603/1214] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:20:46.170688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f9360-8834-416c-a3f6-5f3c238ddde7 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:46.199104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f9360-8834-416c-a3f6-5f3c238ddde7 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:46.209291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8c19e-fc45-4e3a-a704-954dfba58bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:46.209944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8c19e-fc45-4e3a-a704-954dfba58bee admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:46.210242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8c19e-fc45-4e3a-a704-954dfba58bee admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:46.210524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8c19e-fc45-4e3a-a704-954dfba58bee admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:46.211277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8c19e-fc45-4e3a-a704-954dfba58bee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:46.212323 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-3ed8c19e-fc45-4e3a-a704-954dfba58bee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:20:46.212323 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:20:46.212323 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:20:46.213551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8c19e-fc45-4e3a-a704-954dfba58bee admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:46.339749 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 612/1215] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:20:46 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:46.344596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4837e3-0acf-45db-9531-283c8fc53e7a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:46.358403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4837e3-0acf-45db-9531-283c8fc53e7a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:46.377853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8534c4-938a-4b5d-ba11-f8766fbb88b7 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:46.383124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8534c4-938a-4b5d-ba11-f8766fbb88b7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:46.383124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8534c4-938a-4b5d-ba11-f8766fbb88b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:46.415175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4d8534c4-938a-4b5d-ba11-f8766fbb88b7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:46.416595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4d8534c4-938a-4b5d-ba11-f8766fbb88b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:46.446399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294685f2-5248-44a3-b0d9-3d21842a0000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:46.447040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294685f2-5248-44a3-b0d9-3d21842a0000 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:46.447688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294685f2-5248-44a3-b0d9-3d21842a0000 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:46.447688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294685f2-5248-44a3-b0d9-3d21842a0000 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:46.448391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294685f2-5248-44a3-b0d9-3d21842a0000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:46.449431 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-294685f2-5248-44a3-b0d9-3d21842a0000 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:20:46.449431 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:20:46.449431 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:20:46.450837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294685f2-5248-44a3-b0d9-3d21842a0000 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:46.538527 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 613/1216] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:46.542757 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 604/1217] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:20:46 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:46.547423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c4643-d2a4-4346-a502-566f2339a8cf None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:46.548134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294685f2-5248-44a3-b0d9-3d21842a0000 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:46.548240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c4643-d2a4-4346-a502-566f2339a8cf None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:46.548506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c4643-d2a4-4346-a502-566f2339a8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:46.566579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294685f2-5248-44a3-b0d9-3d21842a0000 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:46.572271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd567051-f6ee-4b90-89ae-dde8a7b261ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:46.573347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd567051-f6ee-4b90-89ae-dde8a7b261ee admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:46.573347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd567051-f6ee-4b90-89ae-dde8a7b261ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:46.573561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd567051-f6ee-4b90-89ae-dde8a7b261ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:46.574079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd567051-f6ee-4b90-89ae-dde8a7b261ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:46.578083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd567051-f6ee-4b90-89ae-dde8a7b261ee admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:46.588086 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 605/1218] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:46.589321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7a550-8c5e-4f6c-b56c-fe5ff7b7fe20 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:46.589721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7a550-8c5e-4f6c-b56c-fe5ff7b7fe20 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:46.590004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7a550-8c5e-4f6c-b56c-fe5ff7b7fe20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:46.595240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-465c4643-d2a4-4346-a502-566f2339a8cf None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:46.596430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-465c4643-d2a4-4346-a502-566f2339a8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:46.627621 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 614/1219] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:46.628692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91caadf7-b235-4954-848e-7d81c065a56a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:46.628966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91caadf7-b235-4954-848e-7d81c065a56a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:46.629245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91caadf7-b235-4954-848e-7d81c065a56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:46.641631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-fde7a550-8c5e-4f6c-b56c-fe5ff7b7fe20 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:46.642883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fde7a550-8c5e-4f6c-b56c-fe5ff7b7fe20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:46.667685 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 606/1220] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:46.669603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c400cbe-f0b4-4d73-9401-caff1cf90477 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:46.669896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c400cbe-f0b4-4d73-9401-caff1cf90477 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:46.670204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c400cbe-f0b4-4d73-9401-caff1cf90477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:46.680295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-91caadf7-b235-4954-848e-7d81c065a56a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:46.683145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-91caadf7-b235-4954-848e-7d81c065a56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:46.694646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6c400cbe-f0b4-4d73-9401-caff1cf90477 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:46.695868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6c400cbe-f0b4-4d73-9401-caff1cf90477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:46.699268 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 615/1221] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:46.700129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91caadf7-b235-4954-848e-7d81c065a56a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:46.717550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91caadf7-b235-4954-848e-7d81c065a56a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:46.719667 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 607/1222] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:46.720971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f3ca8-c05e-44fc-9334-11d978a4d5d8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:46.721265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f3ca8-c05e-44fc-9334-11d978a4d5d8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:46.721541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f3ca8-c05e-44fc-9334-11d978a4d5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:46.727552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec23dc1-6be8-4404-9771-ef1db691ed1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:46.728276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec23dc1-6be8-4404-9771-ef1db691ed1a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:46.728559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec23dc1-6be8-4404-9771-ef1db691ed1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:46.728834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec23dc1-6be8-4404-9771-ef1db691ed1a admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:46.729543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec23dc1-6be8-4404-9771-ef1db691ed1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:46.731182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec23dc1-6be8-4404-9771-ef1db691ed1a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:46.743330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b90f3ca8-c05e-44fc-9334-11d978a4d5d8 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:46.744787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b90f3ca8-c05e-44fc-9334-11d978a4d5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:46.749075 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 616/1223] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:46.752986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec23dc1-6be8-4404-9771-ef1db691ed1a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:46.759348 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 608/1224] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:46.760812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a83fe-3153-46a1-9071-df65fd0837f0 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:46.761263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a83fe-3153-46a1-9071-df65fd0837f0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:46.761703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a83fe-3153-46a1-9071-df65fd0837f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:46.765161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec23dc1-6be8-4404-9771-ef1db691ed1a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:46.770336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeacae6-e1d1-44e4-bde2-478b5c7b0a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:46.770946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeacae6-e1d1-44e4-bde2-478b5c7b0a39 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:46.771233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeacae6-e1d1-44e4-bde2-478b5c7b0a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:46.771509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeacae6-e1d1-44e4-bde2-478b5c7b0a39 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:46.772166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeacae6-e1d1-44e4-bde2-478b5c7b0a39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:20:46.772474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeacae6-e1d1-44e4-bde2-478b5c7b0a39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:46.774078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeacae6-e1d1-44e4-bde2-478b5c7b0a39 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:46.782354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a83a83fe-3153-46a1-9071-df65fd0837f0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:46.783680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a83a83fe-3153-46a1-9071-df65fd0837f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:46.788555 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 617/1225] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:20:46.789913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7de763-991d-4547-983b-4372d5661c9e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:46.790237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7de763-991d-4547-983b-4372d5661c9e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:46.790520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7de763-991d-4547-983b-4372d5661c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:46.792646 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 609/1226] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:46.794100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f9a23-ef5f-4c09-a04f-d4ecd5e44382 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:46.794547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f9a23-ef5f-4c09-a04f-d4ecd5e44382 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:46.794987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f9a23-ef5f-4c09-a04f-d4ecd5e44382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:46.811637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0c7de763-991d-4547-983b-4372d5661c9e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:46.812854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0c7de763-991d-4547-983b-4372d5661c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:46.817281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d06f9a23-ef5f-4c09-a04f-d4ecd5e44382 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:46.818731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d06f9a23-ef5f-4c09-a04f-d4ecd5e44382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:46.821932 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 618/1227] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:46.823246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fc0b5-26c5-4027-b4de-e89a3efeb171 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:46.823540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fc0b5-26c5-4027-b4de-e89a3efeb171 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:46.823820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fc0b5-26c5-4027-b4de-e89a3efeb171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:46.830674 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 610/1228] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:46.831314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f9a23-ef5f-4c09-a04f-d4ecd5e44382 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:46.846652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-306fc0b5-26c5-4027-b4de-e89a3efeb171 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:46.847841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-306fc0b5-26c5-4027-b4de-e89a3efeb171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:46.850600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f9a23-ef5f-4c09-a04f-d4ecd5e44382 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:46.857584 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 619/1229] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:46.863642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4a442-4324-46f8-9115-305c7708ff4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:46.864392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fc0b5-26c5-4027-b4de-e89a3efeb171 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:46.864478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4a442-4324-46f8-9115-305c7708ff4b admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:46.864478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4a442-4324-46f8-9115-305c7708ff4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:46.864478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4a442-4324-46f8-9115-305c7708ff4b admin admin] PATH_INFO: `/v3/projects/9f71e54f5a0f4a97bed3c89cda637a1e/users/5fe38379160246da8a176b544646ce6d/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:46.870373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fc0b5-26c5-4027-b4de-e89a3efeb171 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:46.875011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a031a-d3fa-4e2a-b834-4271d8c523bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:46.875646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a031a-d3fa-4e2a-b834-4271d8c523bf admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:46.875796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4a442-4324-46f8-9115-305c7708ff4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f71e54f5a0f4a97bed3c89cda637a1e, user_id=5fe38379160246da8a176b544646ce6d, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:46.875922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a031a-d3fa-4e2a-b834-4271d8c523bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:46.876188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a031a-d3fa-4e2a-b834-4271d8c523bf admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:46.876834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a031a-d3fa-4e2a-b834-4271d8c523bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:20:46.877138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a031a-d3fa-4e2a-b834-4271d8c523bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:46.878578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4a442-4324-46f8-9115-305c7708ff4b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:46.878782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a031a-d3fa-4e2a-b834-4271d8c523bf admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:46.891354 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 620/1230] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:20:46.892914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b01e64-a619-4382-a456-573bbc84a789 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:46.893202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b01e64-a619-4382-a456-573bbc84a789 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:46.893477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b01e64-a619-4382-a456-573bbc84a789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:46.913734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-53b01e64-a619-4382-a456-573bbc84a789 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:46.920942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-53b01e64-a619-4382-a456-573bbc84a789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:46.923595 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 621/1231] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:46.924378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b01e64-a619-4382-a456-573bbc84a789 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:46.934710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b01e64-a619-4382-a456-573bbc84a789 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:46.939272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35112c5-66e0-4447-9857-d412df23ae45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:46.939943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35112c5-66e0-4447-9857-d412df23ae45 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:46.940223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35112c5-66e0-4447-9857-d412df23ae45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:46.940495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35112c5-66e0-4447-9857-d412df23ae45 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:46.941115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35112c5-66e0-4447-9857-d412df23ae45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:46.943066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35112c5-66e0-4447-9857-d412df23ae45 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:46.977770 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 611/1232] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:46 2022] PUT /identity/v3/projects/9f71e54f5a0f4a97bed3c89cda637a1e/users/5fe38379160246da8a176b544646ce6d/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:46.979224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120f288-8e1f-425b-80b1-9f4e414894bf None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:46.979516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120f288-8e1f-425b-80b1-9f4e414894bf None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:46.979788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120f288-8e1f-425b-80b1-9f4e414894bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:46.999442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e120f288-8e1f-425b-80b1-9f4e414894bf None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:47.000630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e120f288-8e1f-425b-80b1-9f4e414894bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:47.030057 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 622/1233] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:20:46 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:47.030890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35112c5-66e0-4447-9857-d412df23ae45 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:47.062176 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 612/1234] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:47.063520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8887f-1182-45f1-8ba8-2a9fe51cfa26 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:47.063816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8887f-1182-45f1-8ba8-2a9fe51cfa26 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:47.064087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8887f-1182-45f1-8ba8-2a9fe51cfa26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:47.072858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:47.077675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:47.084945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-05c8887f-1182-45f1-8ba8-2a9fe51cfa26 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:47.086198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-05c8887f-1182-45f1-8ba8-2a9fe51cfa26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:47.097554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35112c5-66e0-4447-9857-d412df23ae45 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:47.102384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e48d3f-e7b2-42e4-aaa5-dce21072b340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:47.102993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e48d3f-e7b2-42e4-aaa5-dce21072b340 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:47.103273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e48d3f-e7b2-42e4-aaa5-dce21072b340 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:47.103542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e48d3f-e7b2-42e4-aaa5-dce21072b340 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:47.104184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e48d3f-e7b2-42e4-aaa5-dce21072b340 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:20:47.104487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e48d3f-e7b2-42e4-aaa5-dce21072b340 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:47.106265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e48d3f-e7b2-42e4-aaa5-dce21072b340 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:47.118600 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 623/1235] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:20:47.122907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e48d3f-e7b2-42e4-aaa5-dce21072b340 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:47.129006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e48d3f-e7b2-42e4-aaa5-dce21072b340 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:47.133689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a646e-4dd1-4733-9888-f876eb123542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:47.134321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a646e-4dd1-4733-9888-f876eb123542 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:47.134624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a646e-4dd1-4733-9888-f876eb123542 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:47.134899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a646e-4dd1-4733-9888-f876eb123542 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:47.135609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a646e-4dd1-4733-9888-f876eb123542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:20:47.135866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a646e-4dd1-4733-9888-f876eb123542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:47.137444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a646e-4dd1-4733-9888-f876eb123542 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:47.150848 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 613/1236] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:47.150848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8887f-1182-45f1-8ba8-2a9fe51cfa26 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:47.157637 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 624/1237] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:20:47.157637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a33e36-30a2-4244-979d-bd4b1c3f9f80 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:47.157637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a33e36-30a2-4244-979d-bd4b1c3f9f80 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:47.157637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a33e36-30a2-4244-979d-bd4b1c3f9f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:47.161294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8887f-1182-45f1-8ba8-2a9fe51cfa26 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:47.167571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003eeb9-a5e9-4d57-85b1-9f65b28dbfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:47.168251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003eeb9-a5e9-4d57-85b1-9f65b28dbfa9 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:47.168517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003eeb9-a5e9-4d57-85b1-9f65b28dbfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:47.168815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003eeb9-a5e9-4d57-85b1-9f65b28dbfa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:47.169563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003eeb9-a5e9-4d57-85b1-9f65b28dbfa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:47.171572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003eeb9-a5e9-4d57-85b1-9f65b28dbfa9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:47.178081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-77a33e36-30a2-4244-979d-bd4b1c3f9f80 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:47.179295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-77a33e36-30a2-4244-979d-bd4b1c3f9f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:47.191115 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 625/1238] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:47.192498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492072b-2b9b-4613-8042-67bef9cfc254 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:47.192822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492072b-2b9b-4613-8042-67bef9cfc254 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:47.193096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492072b-2b9b-4613-8042-67bef9cfc254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:47.221672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f492072b-2b9b-4613-8042-67bef9cfc254 None None] MFA Rules not processed for user `5fe38379160246da8a176b544646ce6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:47.222896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f492072b-2b9b-4613-8042-67bef9cfc254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:47.268562 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 614/1239] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:20:47 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:47.268562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003eeb9-a5e9-4d57-85b1-9f65b28dbfa9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:47.292496 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 626/1240] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:47.293634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492072b-2b9b-4613-8042-67bef9cfc254 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:47.306073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492072b-2b9b-4613-8042-67bef9cfc254 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:47.336530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003eeb9-a5e9-4d57-85b1-9f65b28dbfa9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:47.345859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0175fa-456c-4029-9a3f-56360d1a4473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:47.346527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0175fa-456c-4029-9a3f-56360d1a4473 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:47.346827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0175fa-456c-4029-9a3f-56360d1a4473 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:47.347972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0175fa-456c-4029-9a3f-56360d1a4473 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:47.347972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0175fa-456c-4029-9a3f-56360d1a4473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:47.349912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0175fa-456c-4029-9a3f-56360d1a4473 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:47.371103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592d8ec-3de0-433b-82dd-914d348f7c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:47.371758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592d8ec-3de0-433b-82dd-914d348f7c08 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:47.372037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592d8ec-3de0-433b-82dd-914d348f7c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:47.372333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592d8ec-3de0-433b-82dd-914d348f7c08 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:47.372976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592d8ec-3de0-433b-82dd-914d348f7c08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:20:47.373278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592d8ec-3de0-433b-82dd-914d348f7c08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:47.374952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592d8ec-3de0-433b-82dd-914d348f7c08 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:47.386427 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 627/1241] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:20:47.387246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592d8ec-3de0-433b-82dd-914d348f7c08 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:47.397176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592d8ec-3de0-433b-82dd-914d348f7c08 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:47.401671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1df8d4-b216-41e2-af91-2005ad5b636e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:47.402272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1df8d4-b216-41e2-af91-2005ad5b636e admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:47.405513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1df8d4-b216-41e2-af91-2005ad5b636e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:47.405513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1df8d4-b216-41e2-af91-2005ad5b636e admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:47.405513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1df8d4-b216-41e2-af91-2005ad5b636e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:47.405513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1df8d4-b216-41e2-af91-2005ad5b636e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:47.454699 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 615/1242] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:20:47 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:47.455166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0175fa-456c-4029-9a3f-56360d1a4473 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:47.470096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0175fa-456c-4029-9a3f-56360d1a4473 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:47.475540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e209357-a525-41ff-8a1d-f53aee8298ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:47.478903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e209357-a525-41ff-8a1d-f53aee8298ab admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:47.478903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e209357-a525-41ff-8a1d-f53aee8298ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:47.478903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e209357-a525-41ff-8a1d-f53aee8298ab admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:47.478903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e209357-a525-41ff-8a1d-f53aee8298ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:20:47.478903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e209357-a525-41ff-8a1d-f53aee8298ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:47.479353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e209357-a525-41ff-8a1d-f53aee8298ab admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:47.498205 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 616/1243] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:20:47.499023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e209357-a525-41ff-8a1d-f53aee8298ab admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:47.508625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e209357-a525-41ff-8a1d-f53aee8298ab admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:47.513622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6eaa71-5d59-4834-a253-955387ed3353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:47.514306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6eaa71-5d59-4834-a253-955387ed3353 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:47.514585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6eaa71-5d59-4834-a253-955387ed3353 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:47.514858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6eaa71-5d59-4834-a253-955387ed3353 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:47.515501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6eaa71-5d59-4834-a253-955387ed3353 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:47.517948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6eaa71-5d59-4834-a253-955387ed3353 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:47.535517 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 628/1244] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:20:47 2022] POST /identity/v3/projects => generated 397 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:47.535517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1df8d4-b216-41e2-af91-2005ad5b636e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:47.552696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:47.593175 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 617/1245] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:20:47 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:47.593175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6eaa71-5d59-4834-a253-955387ed3353 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:47.611197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1df8d4-b216-41e2-af91-2005ad5b636e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:47.637432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:47.663052 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c880b-56db-47af-bc36-3bcff41fc1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:47.663671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c880b-56db-47af-bc36-3bcff41fc1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:47.663955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c880b-56db-47af-bc36-3bcff41fc1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:47.664225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c880b-56db-47af-bc36-3bcff41fc1b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:47.664898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c880b-56db-47af-bc36-3bcff41fc1b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:20:47.665209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c880b-56db-47af-bc36-3bcff41fc1b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:47.666158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6eaa71-5d59-4834-a253-955387ed3353 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:47.666914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c880b-56db-47af-bc36-3bcff41fc1b4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:47.671443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bfcba-3748-4167-9bd9-badf0edf821b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:47.672059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bfcba-3748-4167-9bd9-badf0edf821b admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:47.672343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bfcba-3748-4167-9bd9-badf0edf821b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:47.672642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bfcba-3748-4167-9bd9-badf0edf821b admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:47.673273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bfcba-3748-4167-9bd9-badf0edf821b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:47.675238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bfcba-3748-4167-9bd9-badf0edf821b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:47.685797 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 629/1246] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:20:47.685797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c880b-56db-47af-bc36-3bcff41fc1b4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:47.690203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c880b-56db-47af-bc36-3bcff41fc1b4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:47.695050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc2f3f-c400-484e-8aeb-ab3218ab14f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:47.695689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc2f3f-c400-484e-8aeb-ab3218ab14f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:47.695972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc2f3f-c400-484e-8aeb-ab3218ab14f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:47.696257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc2f3f-c400-484e-8aeb-ab3218ab14f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:47.696881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc2f3f-c400-484e-8aeb-ab3218ab14f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:47.698825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc2f3f-c400-484e-8aeb-ab3218ab14f4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:47.743381 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 618/1247] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:20:47 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:47.744195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bfcba-3748-4167-9bd9-badf0edf821b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:47.757614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bfcba-3748-4167-9bd9-badf0edf821b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:47.763956 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 630/1248] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:20:47 2022] POST /identity/v3/projects => generated 377 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:47.764154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de57f22-b15c-41bf-a3e2-827bcfd3d462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:47.770276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc2f3f-c400-484e-8aeb-ab3218ab14f4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:47.770440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de57f22-b15c-41bf-a3e2-827bcfd3d462 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:47.770440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de57f22-b15c-41bf-a3e2-827bcfd3d462 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:47.770440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de57f22-b15c-41bf-a3e2-827bcfd3d462 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:47.770440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de57f22-b15c-41bf-a3e2-827bcfd3d462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:47.770440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de57f22-b15c-41bf-a3e2-827bcfd3d462 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:47.842990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc2f3f-c400-484e-8aeb-ab3218ab14f4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:47.854514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99071ba-c176-4001-aadd-e245d137988a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:47.854628 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 619/1249] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:20:47 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:47.855985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de57f22-b15c-41bf-a3e2-827bcfd3d462 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:47.856668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99071ba-c176-4001-aadd-e245d137988a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:47.857313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99071ba-c176-4001-aadd-e245d137988a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:47.857848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99071ba-c176-4001-aadd-e245d137988a admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:47.859270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99071ba-c176-4001-aadd-e245d137988a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:47.861103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99071ba-c176-4001-aadd-e245d137988a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:47.885824 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 631/1250] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:47.885824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99071ba-c176-4001-aadd-e245d137988a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:47.893837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99071ba-c176-4001-aadd-e245d137988a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:47.926255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:47.932967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de57f22-b15c-41bf-a3e2-827bcfd3d462 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:47.938910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9c261-23a8-4dff-934f-4659a59cd226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:47.939875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9c261-23a8-4dff-934f-4659a59cd226 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:47.939875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9c261-23a8-4dff-934f-4659a59cd226 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:47.940124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9c261-23a8-4dff-934f-4659a59cd226 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:47.940887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9c261-23a8-4dff-934f-4659a59cd226 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:47.942850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9c261-23a8-4dff-934f-4659a59cd226 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:47.967774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b36ac6-d19b-46f8-8d81-bb5734aac1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:47.968530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b36ac6-d19b-46f8-8d81-bb5734aac1f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:47.968811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b36ac6-d19b-46f8-8d81-bb5734aac1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:47.969085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b36ac6-d19b-46f8-8d81-bb5734aac1f2 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:47.969829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b36ac6-d19b-46f8-8d81-bb5734aac1f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:47.971904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b36ac6-d19b-46f8-8d81-bb5734aac1f2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:48.030704 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 620/1251] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:20:47 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:48.031503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9c261-23a8-4dff-934f-4659a59cd226 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:48.052565 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 632/1252] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:20:47 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:48.053525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b36ac6-d19b-46f8-8d81-bb5734aac1f2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:48.063929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b36ac6-d19b-46f8-8d81-bb5734aac1f2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:48.099077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9c261-23a8-4dff-934f-4659a59cd226 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:48.104151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a0089-d3eb-4146-bbc8-d29e7f084cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:48.104763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a0089-d3eb-4146-bbc8-d29e7f084cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:48.105044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a0089-d3eb-4146-bbc8-d29e7f084cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:48.105421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a0089-d3eb-4146-bbc8-d29e7f084cd6 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:48.106080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a0089-d3eb-4146-bbc8-d29e7f084cd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:48.108142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a0089-d3eb-4146-bbc8-d29e7f084cd6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:48.128348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f935465-c240-44b8-bdaa-e6db07fa7c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:48.135821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f935465-c240-44b8-bdaa-e6db07fa7c45 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:48.135821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f935465-c240-44b8-bdaa-e6db07fa7c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:48.135821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f935465-c240-44b8-bdaa-e6db07fa7c45 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:48.135821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f935465-c240-44b8-bdaa-e6db07fa7c45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:48.135821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f935465-c240-44b8-bdaa-e6db07fa7c45 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:48.212639 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 621/1253] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:20:48 2022] POST /identity/v3/users => generated 291 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:48.213518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a0089-d3eb-4146-bbc8-d29e7f084cd6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:48.223913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a0089-d3eb-4146-bbc8-d29e7f084cd6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:48.228925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158a69f-81b0-4ea0-912b-ceae650169a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:48.229639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158a69f-81b0-4ea0-912b-ceae650169a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:48.230084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158a69f-81b0-4ea0-912b-ceae650169a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:48.233908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158a69f-81b0-4ea0-912b-ceae650169a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:48.233908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158a69f-81b0-4ea0-912b-ceae650169a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:48.233908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158a69f-81b0-4ea0-912b-ceae650169a3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:48.238481 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 633/1254] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:20:48 2022] POST /identity/v3/projects => generated 371 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:48.239395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f935465-c240-44b8-bdaa-e6db07fa7c45 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:48.247276 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 622/1255] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:48.248209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158a69f-81b0-4ea0-912b-ceae650169a3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:48.262259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158a69f-81b0-4ea0-912b-ceae650169a3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:48.267158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:48.317172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f935465-c240-44b8-bdaa-e6db07fa7c45 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:48.322600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9642f-c6b8-4cea-aa14-27cb6611d1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:48.322991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9642f-c6b8-4cea-aa14-27cb6611d1e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:48.323276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9642f-c6b8-4cea-aa14-27cb6611d1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:48.323555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9642f-c6b8-4cea-aa14-27cb6611d1e9 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:48.324344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9642f-c6b8-4cea-aa14-27cb6611d1e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:48.326320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9642f-c6b8-4cea-aa14-27cb6611d1e9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:48.345696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d381b-3ae3-4e25-9904-be4a52e43f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:48.348582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d381b-3ae3-4e25-9904-be4a52e43f28 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:48.348582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d381b-3ae3-4e25-9904-be4a52e43f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:48.348582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d381b-3ae3-4e25-9904-be4a52e43f28 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:48.348582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d381b-3ae3-4e25-9904-be4a52e43f28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:48.349852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d381b-3ae3-4e25-9904-be4a52e43f28 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:48.417836 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 634/1256] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:20:48 2022] POST /identity/v3/users => generated 295 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:48.418804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9642f-c6b8-4cea-aa14-27cb6611d1e9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:48.428690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9642f-c6b8-4cea-aa14-27cb6611d1e9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:48.434240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1611b8-fe88-4dfc-a9ac-669fba6e5665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:48.434881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1611b8-fe88-4dfc-a9ac-669fba6e5665 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:48.435224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1611b8-fe88-4dfc-a9ac-669fba6e5665 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:48.435457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1611b8-fe88-4dfc-a9ac-669fba6e5665 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:48.436109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1611b8-fe88-4dfc-a9ac-669fba6e5665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:48.438475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1611b8-fe88-4dfc-a9ac-669fba6e5665 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:48.448121 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 623/1257] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:20:48 2022] POST /identity/v3/users => generated 291 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:48.448121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d381b-3ae3-4e25-9904-be4a52e43f28 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:48.452898 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 635/1258] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:48.453864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1611b8-fe88-4dfc-a9ac-669fba6e5665 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:48.454852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d381b-3ae3-4e25-9904-be4a52e43f28 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:48.459881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62433473-c1e3-499c-81b4-831ae52ec0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:48.460498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62433473-c1e3-499c-81b4-831ae52ec0ce admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:48.460785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62433473-c1e3-499c-81b4-831ae52ec0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:48.461060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62433473-c1e3-499c-81b4-831ae52ec0ce admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:48.461696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62433473-c1e3-499c-81b4-831ae52ec0ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:48.463792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62433473-c1e3-499c-81b4-831ae52ec0ce admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:48.464718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1611b8-fe88-4dfc-a9ac-669fba6e5665 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:48.470145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956078f-230b-4861-9405-b7ec28e037f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:48.470784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956078f-230b-4861-9405-b7ec28e037f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:48.471068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956078f-230b-4861-9405-b7ec28e037f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:48.471344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956078f-230b-4861-9405-b7ec28e037f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:48.472139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956078f-230b-4861-9405-b7ec28e037f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:48.473626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956078f-230b-4861-9405-b7ec28e037f1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:48.484602 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 636/1259] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:48.486054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956078f-230b-4861-9405-b7ec28e037f1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:48.495597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956078f-230b-4861-9405-b7ec28e037f1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:48.500281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c5edd-c63e-4911-8992-46190628f0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:48.505344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c5edd-c63e-4911-8992-46190628f0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:48.505344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c5edd-c63e-4911-8992-46190628f0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:48.505344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c5edd-c63e-4911-8992-46190628f0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:48.505344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c5edd-c63e-4911-8992-46190628f0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:48.505344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c5edd-c63e-4911-8992-46190628f0c8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:48.513778 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 637/1260] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:48.514564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c5edd-c63e-4911-8992-46190628f0c8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:48.519361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:48.524334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c5edd-c63e-4911-8992-46190628f0c8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:48.527464 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 624/1261] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:20:48 2022] POST /identity/v3/users => generated 290 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:48.527464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62433473-c1e3-499c-81b4-831ae52ec0ce admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:48.532487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a399e-7b07-47ec-a3c6-58b319833d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:48.532487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a399e-7b07-47ec-a3c6-58b319833d25 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:48.532487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a399e-7b07-47ec-a3c6-58b319833d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:48.532487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a399e-7b07-47ec-a3c6-58b319833d25 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:48.532861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a399e-7b07-47ec-a3c6-58b319833d25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:48.533165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a399e-7b07-47ec-a3c6-58b319833d25 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:48.539125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62433473-c1e3-499c-81b4-831ae52ec0ce admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:48.545913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3305e-b1b3-4c93-8a8d-a4221c2d98c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:48.551289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3305e-b1b3-4c93-8a8d-a4221c2d98c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:48.551289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3305e-b1b3-4c93-8a8d-a4221c2d98c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:48.551289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3305e-b1b3-4c93-8a8d-a4221c2d98c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:48.551289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3305e-b1b3-4c93-8a8d-a4221c2d98c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:48.551289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3305e-b1b3-4c93-8a8d-a4221c2d98c4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:48.560842 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 625/1262] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:48.561657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3305e-b1b3-4c93-8a8d-a4221c2d98c4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:48.572137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3305e-b1b3-4c93-8a8d-a4221c2d98c4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:48.576801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594ee53-3361-4a5f-81ca-b48e4e606f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:48.577376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594ee53-3361-4a5f-81ca-b48e4e606f4b admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:48.577659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594ee53-3361-4a5f-81ca-b48e4e606f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:48.578093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594ee53-3361-4a5f-81ca-b48e4e606f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:48.579270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594ee53-3361-4a5f-81ca-b48e4e606f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:48.580883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594ee53-3361-4a5f-81ca-b48e4e606f4b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:48.590765 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 626/1263] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:48.591538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594ee53-3361-4a5f-81ca-b48e4e606f4b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:48.600833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594ee53-3361-4a5f-81ca-b48e4e606f4b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:48.605621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84af67-2793-4bf6-ab8e-30a4785f6db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:48.606206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84af67-2793-4bf6-ab8e-30a4785f6db0 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:48.606493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84af67-2793-4bf6-ab8e-30a4785f6db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:48.606773 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84af67-2793-4bf6-ab8e-30a4785f6db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:48.607386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84af67-2793-4bf6-ab8e-30a4785f6db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:48.609026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84af67-2793-4bf6-ab8e-30a4785f6db0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:48.621867 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 627/1264] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:48.621867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84af67-2793-4bf6-ab8e-30a4785f6db0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:48.623103 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 638/1265] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:20:48 2022] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:48.624665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a399e-7b07-47ec-a3c6-58b319833d25 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:48.630289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84af67-2793-4bf6-ab8e-30a4785f6db0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:48.634818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a399e-7b07-47ec-a3c6-58b319833d25 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:48.635004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc513744-a31f-4267-94d2-f1354f700590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:48.635655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc513744-a31f-4267-94d2-f1354f700590 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:48.635939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc513744-a31f-4267-94d2-f1354f700590 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:48.636224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc513744-a31f-4267-94d2-f1354f700590 admin admin] PATH_INFO: `/v3/projects/772de4d4cb664c249d812c768757b3e4/users/3cade06c95d9420b8a5864473641adc6/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:48.639710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a824c78-5098-4ee4-85ef-cc3421dfac70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:48.640310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a824c78-5098-4ee4-85ef-cc3421dfac70 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:48.640587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a824c78-5098-4ee4-85ef-cc3421dfac70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:48.640862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a824c78-5098-4ee4-85ef-cc3421dfac70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:48.642175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a824c78-5098-4ee4-85ef-cc3421dfac70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:48.643773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a824c78-5098-4ee4-85ef-cc3421dfac70 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:48.652124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc513744-a31f-4267-94d2-f1354f700590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=772de4d4cb664c249d812c768757b3e4, user_id=3cade06c95d9420b8a5864473641adc6, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:48.655747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc513744-a31f-4267-94d2-f1354f700590 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:48.658910 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 639/1266] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:48.660025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a824c78-5098-4ee4-85ef-cc3421dfac70 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:48.671293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a824c78-5098-4ee4-85ef-cc3421dfac70 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:48.676212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b769a53-3882-480e-9fff-87602b047c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:48.676839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b769a53-3882-480e-9fff-87602b047c06 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:48.677106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b769a53-3882-480e-9fff-87602b047c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:48.677381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b769a53-3882-480e-9fff-87602b047c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:48.678057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b769a53-3882-480e-9fff-87602b047c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:48.679790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b769a53-3882-480e-9fff-87602b047c06 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:48.692872 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 640/1267] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:48.693942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b769a53-3882-480e-9fff-87602b047c06 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:48.704593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b769a53-3882-480e-9fff-87602b047c06 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:48.709905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037ee63-071e-4f64-b79d-861d4a9a5398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:48.710539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037ee63-071e-4f64-b79d-861d4a9a5398 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:48.710834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037ee63-071e-4f64-b79d-861d4a9a5398 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:48.711107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037ee63-071e-4f64-b79d-861d4a9a5398 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:48.711750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037ee63-071e-4f64-b79d-861d4a9a5398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:48.713352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037ee63-071e-4f64-b79d-861d4a9a5398 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:48.722117 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 628/1268] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:48 2022] PUT /identity/v3/projects/772de4d4cb664c249d812c768757b3e4/users/3cade06c95d9420b8a5864473641adc6/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:48.726238 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 641/1269] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:48.726238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037ee63-071e-4f64-b79d-861d4a9a5398 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:48.734178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc513744-a31f-4267-94d2-f1354f700590 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:48.737199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037ee63-071e-4f64-b79d-861d4a9a5398 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:48.796576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a41e9f-35e4-4993-b0b7-275cab3941ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:48.797242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a41e9f-35e4-4993-b0b7-275cab3941ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:48.798196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a41e9f-35e4-4993-b0b7-275cab3941ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:48.798479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a41e9f-35e4-4993-b0b7-275cab3941ea admin admin] PATH_INFO: `/v3/projects/a02545ab3aed449d8c142e73cfdb5a3c/users/39b441f59d4449f5ac98e28a87677274/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:48.799719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc513744-a31f-4267-94d2-f1354f700590 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:48.804938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05232a-ac87-4842-bfee-eb389bec8bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:48.805600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05232a-ac87-4842-bfee-eb389bec8bca admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:48.805877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05232a-ac87-4842-bfee-eb389bec8bca admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:48.806248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05232a-ac87-4842-bfee-eb389bec8bca admin admin] PATH_INFO: `/v3/projects/0c0ff2f64e0f448d9c108c82307c28c9/users/e9dbadbd5fc54b23801d0901b7cfd58f/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:48.815317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a41e9f-35e4-4993-b0b7-275cab3941ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02545ab3aed449d8c142e73cfdb5a3c, user_id=39b441f59d4449f5ac98e28a87677274, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:48.819541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a41e9f-35e4-4993-b0b7-275cab3941ea admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:48.824236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05232a-ac87-4842-bfee-eb389bec8bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c0ff2f64e0f448d9c108c82307c28c9, user_id=e9dbadbd5fc54b23801d0901b7cfd58f, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:48.827046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05232a-ac87-4842-bfee-eb389bec8bca admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:48.892208 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 642/1270] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:48 2022] PUT /identity/v3/projects/a02545ab3aed449d8c142e73cfdb5a3c/users/39b441f59d4449f5ac98e28a87677274/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:48.893185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a41e9f-35e4-4993-b0b7-275cab3941ea admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:48.910061 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 629/1271] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:48 2022] PUT /identity/v3/projects/0c0ff2f64e0f448d9c108c82307c28c9/users/e9dbadbd5fc54b23801d0901b7cfd58f/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:48.911489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05232a-ac87-4842-bfee-eb389bec8bca admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:48.917577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:48.957752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a41e9f-35e4-4993-b0b7-275cab3941ea admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:48.974255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05232a-ac87-4842-bfee-eb389bec8bca admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:48.979267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08092615-6fea-4e95-a58b-4989f3baeabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:48.979901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08092615-6fea-4e95-a58b-4989f3baeabc admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:48.980212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08092615-6fea-4e95-a58b-4989f3baeabc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:48.980486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08092615-6fea-4e95-a58b-4989f3baeabc admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:48.981179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08092615-6fea-4e95-a58b-4989f3baeabc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:48.982863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08092615-6fea-4e95-a58b-4989f3baeabc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:48.996922 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 630/1272] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:48.996922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08092615-6fea-4e95-a58b-4989f3baeabc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:48.998680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:49.006449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08092615-6fea-4e95-a58b-4989f3baeabc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:49.011368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77459043-7a6f-4877-be18-ee3b91262f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:49.012050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77459043-7a6f-4877-be18-ee3b91262f28 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:49.012336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77459043-7a6f-4877-be18-ee3b91262f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:49.012614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77459043-7a6f-4877-be18-ee3b91262f28 admin admin] PATH_INFO: `/v3/projects/873ceb34cf6548fdb54bdd7c39c9318b/users/747002f449e641f0a7d2c0f38cf541a0/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:49.015313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dabba-a450-405d-be66-e5dd1f574700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:49.015943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dabba-a450-405d-be66-e5dd1f574700 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:49.016225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dabba-a450-405d-be66-e5dd1f574700 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:49.016491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dabba-a450-405d-be66-e5dd1f574700 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:49.017139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581dabba-a450-405d-be66-e5dd1f574700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:49.018772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581dabba-a450-405d-be66-e5dd1f574700 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:49.027951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77459043-7a6f-4877-be18-ee3b91262f28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=873ceb34cf6548fdb54bdd7c39c9318b, user_id=747002f449e641f0a7d2c0f38cf541a0, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:49.028494 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 643/1273] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:49.029415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dabba-a450-405d-be66-e5dd1f574700 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:49.030976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77459043-7a6f-4877-be18-ee3b91262f28 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:49.038668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dabba-a450-405d-be66-e5dd1f574700 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:49.044525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff94a61-7b7d-4f22-acb2-f1216bdfb24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:49.044525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff94a61-7b7d-4f22-acb2-f1216bdfb24a admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:49.044847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff94a61-7b7d-4f22-acb2-f1216bdfb24a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:49.045121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff94a61-7b7d-4f22-acb2-f1216bdfb24a admin admin] PATH_INFO: `/v3/projects/2cee0e3469fc42a49004f9b5d1f5b6d0/users/015a9fcd508e4d20ad51dcb71053c28f/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:49.061360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff94a61-7b7d-4f22-acb2-f1216bdfb24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cee0e3469fc42a49004f9b5d1f5b6d0, user_id=015a9fcd508e4d20ad51dcb71053c28f, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:49.064919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff94a61-7b7d-4f22-acb2-f1216bdfb24a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:49.098425 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 631/1274] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:48 2022] PUT /identity/v3/projects/873ceb34cf6548fdb54bdd7c39c9318b/users/747002f449e641f0a7d2c0f38cf541a0/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:49.099843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7041e4e-0e6d-4a2c-a436-28287a8a6f65 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:49.100405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7041e4e-0e6d-4a2c-a436-28287a8a6f65 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:49.100405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7041e4e-0e6d-4a2c-a436-28287a8a6f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:49.131432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e7041e4e-0e6d-4a2c-a436-28287a8a6f65 None None] MFA Rules not processed for user `3cade06c95d9420b8a5864473641adc6`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:49.132657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e7041e4e-0e6d-4a2c-a436-28287a8a6f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:49.171064 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 644/1275] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:49 2022] PUT /identity/v3/projects/2cee0e3469fc42a49004f9b5d1f5b6d0/users/015a9fcd508e4d20ad51dcb71053c28f/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:49.172031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff94a61-7b7d-4f22-acb2-f1216bdfb24a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:49.201573 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 632/1276] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:49.202645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7041e4e-0e6d-4a2c-a436-28287a8a6f65 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:49.244723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff94a61-7b7d-4f22-acb2-f1216bdfb24a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:49.249705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1a682-e9ff-4c07-b52e-bc180d48e021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:49.250345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1a682-e9ff-4c07-b52e-bc180d48e021 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:49.250670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1a682-e9ff-4c07-b52e-bc180d48e021 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:49.250947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1a682-e9ff-4c07-b52e-bc180d48e021 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:49.251583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1a682-e9ff-4c07-b52e-bc180d48e021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:49.253214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1a682-e9ff-4c07-b52e-bc180d48e021 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:49.263103 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 645/1277] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:49.264261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259fdd2-6260-4356-adf1-717e708c79a6 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:49.264545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259fdd2-6260-4356-adf1-717e708c79a6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:49.264818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259fdd2-6260-4356-adf1-717e708c79a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:49.270428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7041e4e-0e6d-4a2c-a436-28287a8a6f65 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:49.275090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6e2ed-5e1e-4110-9ced-94c572d78196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:49.275705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6e2ed-5e1e-4110-9ced-94c572d78196 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:49.275990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6e2ed-5e1e-4110-9ced-94c572d78196 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:49.276267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6e2ed-5e1e-4110-9ced-94c572d78196 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:49.276918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6e2ed-5e1e-4110-9ced-94c572d78196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:49.278576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6e2ed-5e1e-4110-9ced-94c572d78196 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:49.289033 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 633/1278] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:49.289835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6e2ed-5e1e-4110-9ced-94c572d78196 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:49.294589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:49.295336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3259fdd2-6260-4356-adf1-717e708c79a6 None None] MFA Rules not processed for user `e9dbadbd5fc54b23801d0901b7cfd58f`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:49.296547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3259fdd2-6260-4356-adf1-717e708c79a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:49.301041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6e2ed-5e1e-4110-9ced-94c572d78196 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:49.307391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a033d7-9dc0-4b29-aca1-32dd5ff36782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:49.309842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a033d7-9dc0-4b29-aca1-32dd5ff36782 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:49.309842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a033d7-9dc0-4b29-aca1-32dd5ff36782 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:49.309842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a033d7-9dc0-4b29-aca1-32dd5ff36782 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:49.309842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a033d7-9dc0-4b29-aca1-32dd5ff36782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:49.310968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a033d7-9dc0-4b29-aca1-32dd5ff36782 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:49.324927 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 634/1279] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:49.325772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a033d7-9dc0-4b29-aca1-32dd5ff36782 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:49.335385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a033d7-9dc0-4b29-aca1-32dd5ff36782 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:49.340172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3d706-e250-45d2-b699-adadc65de885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:49.340845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3d706-e250-45d2-b699-adadc65de885 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:49.341131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3d706-e250-45d2-b699-adadc65de885 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:49.341402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3d706-e250-45d2-b699-adadc65de885 admin admin] PATH_INFO: `/v3/projects/b6969931949a40fa9d2bcf19d686a54c/users/bc0c2b49f5a3425888656721ad5fb8c7/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:49.356569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3d706-e250-45d2-b699-adadc65de885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6969931949a40fa9d2bcf19d686a54c, user_id=bc0c2b49f5a3425888656721ad5fb8c7, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:49.359278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3d706-e250-45d2-b699-adadc65de885 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:49.365310 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 646/1280] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:49.366699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b2314-051f-4185-b89d-73306751d6a7 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:49.366990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b2314-051f-4185-b89d-73306751d6a7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:49.367264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b2314-051f-4185-b89d-73306751d6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:49.394174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e63b2314-051f-4185-b89d-73306751d6a7 None None] MFA Rules not processed for user `747002f449e641f0a7d2c0f38cf541a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:49.395399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e63b2314-051f-4185-b89d-73306751d6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:49.424446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:49.440511 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 635/1281] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:49 2022] PUT /identity/v3/projects/b6969931949a40fa9d2bcf19d686a54c/users/bc0c2b49f5a3425888656721ad5fb8c7/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:49.441976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d85134-c612-4711-bae8-38bfd5028b1d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:49.442368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d85134-c612-4711-bae8-38bfd5028b1d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:49.442696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d85134-c612-4711-bae8-38bfd5028b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:49.461191 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 647/1282] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:49 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:49.462312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b2314-051f-4185-b89d-73306751d6a7 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:49.475985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c9d85134-c612-4711-bae8-38bfd5028b1d None None] MFA Rules not processed for user `015a9fcd508e4d20ad51dcb71053c28f`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:49.477209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c9d85134-c612-4711-bae8-38bfd5028b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:49.518081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b2314-051f-4185-b89d-73306751d6a7 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:49.540324 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 636/1283] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:49.541211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d85134-c612-4711-bae8-38bfd5028b1d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:49.568305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaadd94-873b-4eac-8e6c-b01d36ec37d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:49.568951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaadd94-873b-4eac-8e6c-b01d36ec37d1 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:49.569234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaadd94-873b-4eac-8e6c-b01d36ec37d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:49.569505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaadd94-873b-4eac-8e6c-b01d36ec37d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:49.603586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d85134-c612-4711-bae8-38bfd5028b1d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:49.608271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4934b-af3a-4f80-b0cb-3b84745022a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:49.609028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4934b-af3a-4f80-b0cb-3b84745022a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:49.609315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4934b-af3a-4f80-b0cb-3b84745022a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:49.609589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4934b-af3a-4f80-b0cb-3b84745022a8 admin admin] PATH_INFO: `/v3/projects/3c57cd10266e45f78f55210ba1bbb288/users/cd1f4c2336f240c8baf4d36005fd5e6a/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:49.623492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4934b-af3a-4f80-b0cb-3b84745022a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c57cd10266e45f78f55210ba1bbb288, user_id=cd1f4c2336f240c8baf4d36005fd5e6a, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:49.624701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaadd94-873b-4eac-8e6c-b01d36ec37d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:49.626175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaadd94-873b-4eac-8e6c-b01d36ec37d1 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:49.626314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4934b-af3a-4f80-b0cb-3b84745022a8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:49.635058 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 648/1284] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:20:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:20:49.635958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaadd94-873b-4eac-8e6c-b01d36ec37d1 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:49.646613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaadd94-873b-4eac-8e6c-b01d36ec37d1 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:49.651200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd343f-d52a-44ec-854a-bd2ddefc601c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:49.653716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd343f-d52a-44ec-854a-bd2ddefc601c admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:49.654168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd343f-d52a-44ec-854a-bd2ddefc601c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:49.654548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd343f-d52a-44ec-854a-bd2ddefc601c admin admin] PATH_INFO: `/v3/projects/a02545ab3aed449d8c142e73cfdb5a3c/users/39b441f59d4449f5ac98e28a87677274/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:49.656623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd343f-d52a-44ec-854a-bd2ddefc601c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02545ab3aed449d8c142e73cfdb5a3c, user_id=39b441f59d4449f5ac98e28a87677274, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:49.659939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd343f-d52a-44ec-854a-bd2ddefc601c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:49.670740 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 649/1285] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:49 2022] PUT /identity/v3/projects/a02545ab3aed449d8c142e73cfdb5a3c/users/39b441f59d4449f5ac98e28a87677274/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:49.679872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd343f-d52a-44ec-854a-bd2ddefc601c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:49.686854 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 637/1286] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:49 2022] PUT /identity/v3/projects/3c57cd10266e45f78f55210ba1bbb288/users/cd1f4c2336f240c8baf4d36005fd5e6a/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:49.697200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4934b-af3a-4f80-b0cb-3b84745022a8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:49.712569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:49.745088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd343f-d52a-44ec-854a-bd2ddefc601c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:49.746442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:49.769801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4934b-af3a-4f80-b0cb-3b84745022a8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:49.774621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fc646-836d-408b-a0b6-20ecc857938b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:49.775401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fc646-836d-408b-a0b6-20ecc857938b admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:49.775868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fc646-836d-408b-a0b6-20ecc857938b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:49.776181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fc646-836d-408b-a0b6-20ecc857938b admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:49.777139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fc646-836d-408b-a0b6-20ecc857938b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:49.782417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fc646-836d-408b-a0b6-20ecc857938b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:49.808375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2101497-84d8-482e-9e6b-7d0d2f91885f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:49.809044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2101497-84d8-482e-9e6b-7d0d2f91885f admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:49.809326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2101497-84d8-482e-9e6b-7d0d2f91885f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:49.809603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2101497-84d8-482e-9e6b-7d0d2f91885f admin admin] PATH_INFO: `/v3/projects/c6c5229aafcb4483b4682cfbb5e03360/users/dc460a978f40458d9aecdb7e776fe39a/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:49.824272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2101497-84d8-482e-9e6b-7d0d2f91885f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c5229aafcb4483b4682cfbb5e03360, user_id=dc460a978f40458d9aecdb7e776fe39a, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:49.827097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2101497-84d8-482e-9e6b-7d0d2f91885f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:49.847841 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 638/1287] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:20:49 2022] POST /identity/v3/projects => generated 393 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:49.852434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869730a-cc14-40cf-b6fa-5a1f47fea833 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:49.852604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869730a-cc14-40cf-b6fa-5a1f47fea833 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:49.852894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869730a-cc14-40cf-b6fa-5a1f47fea833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:49.882542 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 650/1288] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:49 2022] PUT /identity/v3/projects/c6c5229aafcb4483b4682cfbb5e03360/users/dc460a978f40458d9aecdb7e776fe39a/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:49.882964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-7869730a-cc14-40cf-b6fa-5a1f47fea833 None None] MFA Rules not processed for user `bc0c2b49f5a3425888656721ad5fb8c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:49.883804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2101497-84d8-482e-9e6b-7d0d2f91885f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:49.884447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7869730a-cc14-40cf-b6fa-5a1f47fea833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:49.956907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2101497-84d8-482e-9e6b-7d0d2f91885f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:49.961698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cf60a-a8da-4f1b-88f8-5453efb1aa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:49.961868 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 639/1289] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:49.962437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cf60a-a8da-4f1b-88f8-5453efb1aa12 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:49.962732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869730a-cc14-40cf-b6fa-5a1f47fea833 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:49.962851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cf60a-a8da-4f1b-88f8-5453efb1aa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:49.963145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cf60a-a8da-4f1b-88f8-5453efb1aa12 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:49.963813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cf60a-a8da-4f1b-88f8-5453efb1aa12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:49.965809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cf60a-a8da-4f1b-88f8-5453efb1aa12 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:49.973501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869730a-cc14-40cf-b6fa-5a1f47fea833 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:49.978515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac4bb2-87d1-4018-9cdc-6041382b4734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:49.979106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac4bb2-87d1-4018-9cdc-6041382b4734 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:49.979386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac4bb2-87d1-4018-9cdc-6041382b4734 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:49.979656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac4bb2-87d1-4018-9cdc-6041382b4734 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:49.980279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac4bb2-87d1-4018-9cdc-6041382b4734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:49.982223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac4bb2-87d1-4018-9cdc-6041382b4734 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:50.076849 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 651/1290] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:20:49 2022] POST /identity/v3/projects => generated 399 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:50.076849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445a791-aa9c-49b0-91b2-9a50c66039e4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:50.076849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445a791-aa9c-49b0-91b2-9a50c66039e4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:50.076849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445a791-aa9c-49b0-91b2-9a50c66039e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:50.082781 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 640/1291] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:20:49 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:50.083816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b1aa0-637a-4d3b-8179-5b8335516156 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:50.084469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b1aa0-637a-4d3b-8179-5b8335516156 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:50.084469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b1aa0-637a-4d3b-8179-5b8335516156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:50.107016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4445a791-aa9c-49b0-91b2-9a50c66039e4 None None] MFA Rules not processed for user `39b441f59d4449f5ac98e28a87677274`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:50.108236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4445a791-aa9c-49b0-91b2-9a50c66039e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:50.111227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-da9b1aa0-637a-4d3b-8179-5b8335516156 None None] MFA Rules not processed for user `cd1f4c2336f240c8baf4d36005fd5e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:50.112395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-da9b1aa0-637a-4d3b-8179-5b8335516156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:50.139369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:50.176699 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 641/1292] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:50.177526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b1aa0-637a-4d3b-8179-5b8335516156 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:50.178419 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 652/1293] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:50.181263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fca57f-cc8c-4220-9ad0-0523156b3a66 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:50.181263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fca57f-cc8c-4220-9ad0-0523156b3a66 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:50.181263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fca57f-cc8c-4220-9ad0-0523156b3a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:50.212814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:50.213002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-88fca57f-cc8c-4220-9ad0-0523156b3a66 None None] MFA Rules not processed for user `dc460a978f40458d9aecdb7e776fe39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:50.214162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-88fca57f-cc8c-4220-9ad0-0523156b3a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:50.249376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b1aa0-637a-4d3b-8179-5b8335516156 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:50.254576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17378135-f571-4090-bfe6-9cb0241a1d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:50.255180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17378135-f571-4090-bfe6-9cb0241a1d81 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:50.255455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17378135-f571-4090-bfe6-9cb0241a1d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:50.255792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17378135-f571-4090-bfe6-9cb0241a1d81 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:50.256417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17378135-f571-4090-bfe6-9cb0241a1d81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:50.258379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17378135-f571-4090-bfe6-9cb0241a1d81 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:50.279438 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 653/1294] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:50.280284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fca57f-cc8c-4220-9ad0-0523156b3a66 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:50.290793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fca57f-cc8c-4220-9ad0-0523156b3a66 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:50.295329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e5e34-5c62-4bf7-b2b6-4918016f72f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:50.295953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e5e34-5c62-4bf7-b2b6-4918016f72f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:50.296230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e5e34-5c62-4bf7-b2b6-4918016f72f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:50.296507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e5e34-5c62-4bf7-b2b6-4918016f72f6 admin admin] PATH_INFO: `/v3/users/3cade06c95d9420b8a5864473641adc6` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:50.298185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e5e34-5c62-4bf7-b2b6-4918016f72f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cade06c95d9420b8a5864473641adc6)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:50.299197 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-cf1e5e34-5c62-4bf7-b2b6-4918016f72f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:20:50.299197 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:20:50.299197 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:20:50.300396 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e5e34-5c62-4bf7-b2b6-4918016f72f6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:50.369556 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 642/1295] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:20:50 2022] POST /identity/v3/users => generated 303 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:50.369556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17378135-f571-4090-bfe6-9cb0241a1d81 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:50.377265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17378135-f571-4090-bfe6-9cb0241a1d81 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:50.381924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fddfeda-6e27-4cc2-8bdc-9bc54d23d3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:50.382539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddfeda-6e27-4cc2-8bdc-9bc54d23d3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:50.382818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddfeda-6e27-4cc2-8bdc-9bc54d23d3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:50.383199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddfeda-6e27-4cc2-8bdc-9bc54d23d3d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:50.383876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fddfeda-6e27-4cc2-8bdc-9bc54d23d3d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:50.385809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fddfeda-6e27-4cc2-8bdc-9bc54d23d3d7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:50.495908 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 643/1296] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:20:50 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:50.495908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fddfeda-6e27-4cc2-8bdc-9bc54d23d3d7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:50.503034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cf1e5e34-5c62-4bf7-b2b6-4918016f72f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cade06c95d9420b8a5864473641adc6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:50.503696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cf1e5e34-5c62-4bf7-b2b6-4918016f72f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cade06c95d9420b8a5864473641adc6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:50.514435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cf1e5e34-5c62-4bf7-b2b6-4918016f72f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cade06c95d9420b8a5864473641adc6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:50.532015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cf1e5e34-5c62-4bf7-b2b6-4918016f72f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cade06c95d9420b8a5864473641adc6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:50.532706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cf1e5e34-5c62-4bf7-b2b6-4918016f72f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cade06c95d9420b8a5864473641adc6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:50.556714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fddfeda-6e27-4cc2-8bdc-9bc54d23d3d7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:50.561424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0e1af-81ed-43e0-a4ee-12e587219a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:50.562025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0e1af-81ed-43e0-a4ee-12e587219a6c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:50.562332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0e1af-81ed-43e0-a4ee-12e587219a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:50.562609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0e1af-81ed-43e0-a4ee-12e587219a6c admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:50.563872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0e1af-81ed-43e0-a4ee-12e587219a6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:50.565800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0e1af-81ed-43e0-a4ee-12e587219a6c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:50.594698 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 654/1297] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:20:50 2022] DELETE /identity/v3/users/3cade06c95d9420b8a5864473641adc6 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:50.595573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e5e34-5c62-4bf7-b2b6-4918016f72f6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:50.596906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cf1e5e34-5c62-4bf7-b2b6-4918016f72f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:50.627972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:50.660323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e5e34-5c62-4bf7-b2b6-4918016f72f6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:50.666270 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 644/1298] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:20:50 2022] POST /identity/v3/users => generated 306 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:50.666270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0e1af-81ed-43e0-a4ee-12e587219a6c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:50.666518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc814c1c-85a5-4a22-b93f-a99ffca1ff88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:50.666634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-26c0e1af-81ed-43e0-a4ee-12e587219a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:50.666750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc814c1c-85a5-4a22-b93f-a99ffca1ff88 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:50.666750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc814c1c-85a5-4a22-b93f-a99ffca1ff88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:50.666750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc814c1c-85a5-4a22-b93f-a99ffca1ff88 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:50.666993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc814c1c-85a5-4a22-b93f-a99ffca1ff88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:50.668977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc814c1c-85a5-4a22-b93f-a99ffca1ff88 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:50.679100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0e1af-81ed-43e0-a4ee-12e587219a6c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:50.683758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ace8c-1383-4314-a420-74b5f85018ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:50.684355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ace8c-1383-4314-a420-74b5f85018ff admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:50.684639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ace8c-1383-4314-a420-74b5f85018ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:50.684910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ace8c-1383-4314-a420-74b5f85018ff admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:50.685538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ace8c-1383-4314-a420-74b5f85018ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:50.687498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ace8c-1383-4314-a420-74b5f85018ff admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:50.763543 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 655/1299] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:20:50 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:50.763543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35347d-e7aa-4ee9-80c6-f014ad6c1805 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:50.763543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35347d-e7aa-4ee9-80c6-f014ad6c1805 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:50.763543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35347d-e7aa-4ee9-80c6-f014ad6c1805 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:50.764812 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 656/1300] 10.222.0.20 () {54 vars in 961 bytes} [Thu Oct 27 03:20:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:20:50.765587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35347d-e7aa-4ee9-80c6-f014ad6c1805 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:50.767910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5c35347d-e7aa-4ee9-80c6-f014ad6c1805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:50.771696 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 645/1301] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:20:50 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:50.771696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ace8c-1383-4314-a420-74b5f85018ff admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:50.772297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2f4ace8c-1383-4314-a420-74b5f85018ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:50.832646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:50.836189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35347d-e7aa-4ee9-80c6-f014ad6c1805 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:50.836336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ace8c-1383-4314-a420-74b5f85018ff admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:50.840669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4062310-7dd5-4b4d-a5c9-a508c32a947c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:50.840810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467ea86-1d23-4c83-9dba-9014237747f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:50.841277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4062310-7dd5-4b4d-a5c9-a508c32a947c admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:50.841379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467ea86-1d23-4c83-9dba-9014237747f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:50.841574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4062310-7dd5-4b4d-a5c9-a508c32a947c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:50.841722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467ea86-1d23-4c83-9dba-9014237747f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:50.841856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4062310-7dd5-4b4d-a5c9-a508c32a947c admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:50.841964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467ea86-1d23-4c83-9dba-9014237747f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:50.842501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4062310-7dd5-4b4d-a5c9-a508c32a947c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:50.842621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467ea86-1d23-4c83-9dba-9014237747f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:50.844694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467ea86-1d23-4c83-9dba-9014237747f5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:50.845168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4062310-7dd5-4b4d-a5c9-a508c32a947c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:50.854625 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 646/1302] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:50.855229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467ea86-1d23-4c83-9dba-9014237747f5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:50.856892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2467ea86-1d23-4c83-9dba-9014237747f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:50.869429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467ea86-1d23-4c83-9dba-9014237747f5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:50.874237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7486024-9be0-46da-a85a-737d5822e8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:50.875094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7486024-9be0-46da-a85a-737d5822e8c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:50.875766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7486024-9be0-46da-a85a-737d5822e8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:50.876099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7486024-9be0-46da-a85a-737d5822e8c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:50.879223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7486024-9be0-46da-a85a-737d5822e8c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:50.879223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7486024-9be0-46da-a85a-737d5822e8c0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:50.953078 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 657/1303] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:20:50 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:50.953078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82eecc-2bec-463f-9469-12f2a6d7b28d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:50.953078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82eecc-2bec-463f-9469-12f2a6d7b28d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:50.953078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82eecc-2bec-463f-9469-12f2a6d7b28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:50.957555 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 647/1304] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:20:50 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:50.957555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7486024-9be0-46da-a85a-737d5822e8c0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:50.957555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d7486024-9be0-46da-a85a-737d5822e8c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:50.969005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7486024-9be0-46da-a85a-737d5822e8c0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:50.973722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8a82eecc-2bec-463f-9469-12f2a6d7b28d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:50.974971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8a82eecc-2bec-463f-9469-12f2a6d7b28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:51.025776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d2ebf-522c-4f75-94d5-d161e049450f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:51.026514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d2ebf-522c-4f75-94d5-d161e049450f admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:51.026796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d2ebf-522c-4f75-94d5-d161e049450f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:51.027099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d2ebf-522c-4f75-94d5-d161e049450f admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:51.027839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d2ebf-522c-4f75-94d5-d161e049450f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:51.029512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d2ebf-522c-4f75-94d5-d161e049450f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:51.041158 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 648/1305] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:51.044772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d2ebf-522c-4f75-94d5-d161e049450f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:51.052468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d2ebf-522c-4f75-94d5-d161e049450f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:51.057361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540f8cd-438f-4ffd-a22a-b0f8f7e45445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:51.057997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540f8cd-438f-4ffd-a22a-b0f8f7e45445 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:51.058323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540f8cd-438f-4ffd-a22a-b0f8f7e45445 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:51.058595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540f8cd-438f-4ffd-a22a-b0f8f7e45445 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:51.059252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540f8cd-438f-4ffd-a22a-b0f8f7e45445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:51.060900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540f8cd-438f-4ffd-a22a-b0f8f7e45445 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:51.072514 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 649/1306] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:51.073374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540f8cd-438f-4ffd-a22a-b0f8f7e45445 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:51.085896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540f8cd-438f-4ffd-a22a-b0f8f7e45445 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:51.093763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01538ef-4ceb-43c6-98b9-c5e51878049e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:51.095496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01538ef-4ceb-43c6-98b9-c5e51878049e admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:51.096008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01538ef-4ceb-43c6-98b9-c5e51878049e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:51.096507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01538ef-4ceb-43c6-98b9-c5e51878049e admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:51.097461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01538ef-4ceb-43c6-98b9-c5e51878049e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:51.099819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01538ef-4ceb-43c6-98b9-c5e51878049e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:51.153438 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 658/1307] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:51.154653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5530b9-52b7-40f9-9d77-38283a8e06e5 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:51.154938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5530b9-52b7-40f9-9d77-38283a8e06e5 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:51.155211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5530b9-52b7-40f9-9d77-38283a8e06e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:51.173033 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 650/1308] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:20:51 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:51.173827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01538ef-4ceb-43c6-98b9-c5e51878049e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:51.186889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01538ef-4ceb-43c6-98b9-c5e51878049e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:51.191882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436db20-5d6c-4008-8450-e63a8fcda956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:51.193488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436db20-5d6c-4008-8450-e63a8fcda956 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:51.193488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436db20-5d6c-4008-8450-e63a8fcda956 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:51.193488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436db20-5d6c-4008-8450-e63a8fcda956 admin admin] PATH_INFO: `/v3/projects/556b3e501c6543c4aec9b19bb07edccf/users/ac9a13a498824d8eb6db84a9dd9a3a99/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:51.195390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9c5530b9-52b7-40f9-9d77-38283a8e06e5 None None] MFA Rules not processed for user `c20881251f2241a3a5ec2e5cf99db149`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:51.196606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9c5530b9-52b7-40f9-9d77-38283a8e06e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:51.210169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436db20-5d6c-4008-8450-e63a8fcda956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=556b3e501c6543c4aec9b19bb07edccf, user_id=ac9a13a498824d8eb6db84a9dd9a3a99, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:51.212843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436db20-5d6c-4008-8450-e63a8fcda956 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:51.223493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:51.261244 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 659/1309] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Oct 27 03:20:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:51.263186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5530b9-52b7-40f9-9d77-38283a8e06e5 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:51.274271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5530b9-52b7-40f9-9d77-38283a8e06e5 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:51.274691 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 651/1310] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:51 2022] PUT /identity/v3/projects/556b3e501c6543c4aec9b19bb07edccf/users/ac9a13a498824d8eb6db84a9dd9a3a99/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:51.278393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436db20-5d6c-4008-8450-e63a8fcda956 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:51.332232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cf549-8ab7-45a1-87ea-5f5b45b3e969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:51.332859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cf549-8ab7-45a1-87ea-5f5b45b3e969 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:51.333144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cf549-8ab7-45a1-87ea-5f5b45b3e969 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:51.333422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cf549-8ab7-45a1-87ea-5f5b45b3e969 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:51.334079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cf549-8ab7-45a1-87ea-5f5b45b3e969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:51.336145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cf549-8ab7-45a1-87ea-5f5b45b3e969 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:51.341028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436db20-5d6c-4008-8450-e63a8fcda956 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:51.346446 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68f1dd-c0e2-431b-9d30-fffd3f43e9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:51.347340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68f1dd-c0e2-431b-9d30-fffd3f43e9da admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:51.347340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68f1dd-c0e2-431b-9d30-fffd3f43e9da admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:51.347584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68f1dd-c0e2-431b-9d30-fffd3f43e9da admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:51.348230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68f1dd-c0e2-431b-9d30-fffd3f43e9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:51.349846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68f1dd-c0e2-431b-9d30-fffd3f43e9da admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:51.359652 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 652/1311] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:51.362988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68f1dd-c0e2-431b-9d30-fffd3f43e9da admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:51.369503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68f1dd-c0e2-431b-9d30-fffd3f43e9da admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:51.373928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e50b1-2942-4651-adac-4b5b585e70d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:51.374606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e50b1-2942-4651-adac-4b5b585e70d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:51.374886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e50b1-2942-4651-adac-4b5b585e70d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:51.375155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e50b1-2942-4651-adac-4b5b585e70d2 admin admin] PATH_INFO: `/v3/projects/80aae888f8984fab9d12c5304427c794/users/fb130d3fbf88475ab63f87ce203d563f/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:51.388538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:51.392161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e50b1-2942-4651-adac-4b5b585e70d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80aae888f8984fab9d12c5304427c794, user_id=fb130d3fbf88475ab63f87ce203d563f, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:51.394934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e50b1-2942-4651-adac-4b5b585e70d2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:51.433908 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 660/1312] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:20:51 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:51.434812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cf549-8ab7-45a1-87ea-5f5b45b3e969 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:51.444706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cf549-8ab7-45a1-87ea-5f5b45b3e969 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:51.449321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498e4b2-1be5-4656-b5a3-cfdb705df03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:51.449952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498e4b2-1be5-4656-b5a3-cfdb705df03a admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:51.450261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498e4b2-1be5-4656-b5a3-cfdb705df03a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:51.450537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498e4b2-1be5-4656-b5a3-cfdb705df03a admin admin] PATH_INFO: `/v3/projects/94e3ce3876734a51b1857a6e6f40be07/users/f019f47a03c74f59aaae11ba363180e1/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:51.458151 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 653/1313] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:51 2022] PUT /identity/v3/projects/80aae888f8984fab9d12c5304427c794/users/fb130d3fbf88475ab63f87ce203d563f/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:51.462225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e50b1-2942-4651-adac-4b5b585e70d2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:51.462225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7f3e50b1-2942-4651-adac-4b5b585e70d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:51.466353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498e4b2-1be5-4656-b5a3-cfdb705df03a admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e3ce3876734a51b1857a6e6f40be07, user_id=f019f47a03c74f59aaae11ba363180e1, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:51.469004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498e4b2-1be5-4656-b5a3-cfdb705df03a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:51.517483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e50b1-2942-4651-adac-4b5b585e70d2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:51.521116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba93ba-2f20-472d-9f7f-97b4762fc482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:51.521714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba93ba-2f20-472d-9f7f-97b4762fc482 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:51.521997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba93ba-2f20-472d-9f7f-97b4762fc482 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:51.522309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba93ba-2f20-472d-9f7f-97b4762fc482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:51.531545 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 661/1314] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:51 2022] PUT /identity/v3/projects/94e3ce3876734a51b1857a6e6f40be07/users/f019f47a03c74f59aaae11ba363180e1/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:51.532541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498e4b2-1be5-4656-b5a3-cfdb705df03a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:51.584438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba93ba-2f20-472d-9f7f-97b4762fc482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:51.585886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba93ba-2f20-472d-9f7f-97b4762fc482 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:51.594501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498e4b2-1be5-4656-b5a3-cfdb705df03a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:51.595421 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 654/1315] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:20:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:20:51.596424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba93ba-2f20-472d-9f7f-97b4762fc482 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:51.599424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71190145-6fd4-40b5-8ec5-cec0b15a4de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:51.600103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71190145-6fd4-40b5-8ec5-cec0b15a4de9 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:51.600456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71190145-6fd4-40b5-8ec5-cec0b15a4de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:51.600791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71190145-6fd4-40b5-8ec5-cec0b15a4de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:51.601505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71190145-6fd4-40b5-8ec5-cec0b15a4de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:51.603213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71190145-6fd4-40b5-8ec5-cec0b15a4de9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:51.618339 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 662/1316] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:51.618339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71190145-6fd4-40b5-8ec5-cec0b15a4de9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:51.627784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71190145-6fd4-40b5-8ec5-cec0b15a4de9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:51.633301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e58c4a-3d29-488e-993d-927150e3303f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:51.633925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e58c4a-3d29-488e-993d-927150e3303f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:51.634238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e58c4a-3d29-488e-993d-927150e3303f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:51.634561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e58c4a-3d29-488e-993d-927150e3303f admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:51.635246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e58c4a-3d29-488e-993d-927150e3303f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:51.636839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e58c4a-3d29-488e-993d-927150e3303f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:51.649225 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 663/1317] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:51.650457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e58c4a-3d29-488e-993d-927150e3303f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:51.660603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e58c4a-3d29-488e-993d-927150e3303f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:51.665393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd14d5f-ac6b-4ffe-bfd4-2666a03303b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:51.666073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd14d5f-ac6b-4ffe-bfd4-2666a03303b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:51.666343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd14d5f-ac6b-4ffe-bfd4-2666a03303b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:51.666617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd14d5f-ac6b-4ffe-bfd4-2666a03303b2 admin admin] PATH_INFO: `/v3/projects/0ee1195a82e645029b39497fdfad0e18/users/d1e25d4a021c4102a526bd6b46e4f52c/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:51.680695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:51.682499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba93ba-2f20-472d-9f7f-97b4762fc482 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:51.687723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd14d5f-ac6b-4ffe-bfd4-2666a03303b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ee1195a82e645029b39497fdfad0e18, user_id=d1e25d4a021c4102a526bd6b46e4f52c, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:51.687723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd14d5f-ac6b-4ffe-bfd4-2666a03303b2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:51.725484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:51.750296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b2f04-b223-49ef-be38-097957c62647 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:51.751063 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 664/1318] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:51 2022] PUT /identity/v3/projects/0ee1195a82e645029b39497fdfad0e18/users/d1e25d4a021c4102a526bd6b46e4f52c/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:51.751590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b2f04-b223-49ef-be38-097957c62647 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:51.751878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b2f04-b223-49ef-be38-097957c62647 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:51.752157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b2f04-b223-49ef-be38-097957c62647 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:51.752908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd14d5f-ac6b-4ffe-bfd4-2666a03303b2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:51.755117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-936b2f04-b223-49ef-be38-097957c62647 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:51.831957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b2f04-b223-49ef-be38-097957c62647 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:51.833633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b2f04-b223-49ef-be38-097957c62647 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:51.844713 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 655/1319] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:20:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:20:51.845478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd14d5f-ac6b-4ffe-bfd4-2666a03303b2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:51.845607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b2f04-b223-49ef-be38-097957c62647 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:51.851053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687373d4-4a8b-459e-a675-24a2877cde82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:51.852964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687373d4-4a8b-459e-a675-24a2877cde82 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:51.853565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687373d4-4a8b-459e-a675-24a2877cde82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:51.853900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687373d4-4a8b-459e-a675-24a2877cde82 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:51.854952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687373d4-4a8b-459e-a675-24a2877cde82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:51.855780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b2f04-b223-49ef-be38-097957c62647 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:51.856801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687373d4-4a8b-459e-a675-24a2877cde82 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:51.861013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e21499-e025-4579-b727-8e7296588a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:51.861638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e21499-e025-4579-b727-8e7296588a1c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:51.861925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e21499-e025-4579-b727-8e7296588a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:51.862237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e21499-e025-4579-b727-8e7296588a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:51.862882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e21499-e025-4579-b727-8e7296588a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:51.864471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e21499-e025-4579-b727-8e7296588a1c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:51.870741 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 665/1320] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:51.871628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687373d4-4a8b-459e-a675-24a2877cde82 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:51.880559 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 656/1321] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:51.880559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e21499-e025-4579-b727-8e7296588a1c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:51.887436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687373d4-4a8b-459e-a675-24a2877cde82 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:51.890755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e21499-e025-4579-b727-8e7296588a1c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:51.892911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee3a41-ca18-4bc5-9509-9f9186f98d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:51.893962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee3a41-ca18-4bc5-9509-9f9186f98d22 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:51.894288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee3a41-ca18-4bc5-9509-9f9186f98d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:51.894556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee3a41-ca18-4bc5-9509-9f9186f98d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:51.895504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee3a41-ca18-4bc5-9509-9f9186f98d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:51.896383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feada2aa-b851-4b4a-8a9d-655e28715cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:51.897060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feada2aa-b851-4b4a-8a9d-655e28715cec admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:51.897329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feada2aa-b851-4b4a-8a9d-655e28715cec admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:51.897443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee3a41-ca18-4bc5-9509-9f9186f98d22 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:51.897609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feada2aa-b851-4b4a-8a9d-655e28715cec admin admin] PATH_INFO: `/v3/projects/c4036e5ce7a04f9ab7acb32521ddf233/users/77e84568cc2f49cd89a83a6258bad4b3/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:51.909555 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 666/1322] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:51.910584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee3a41-ca18-4bc5-9509-9f9186f98d22 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:51.915867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feada2aa-b851-4b4a-8a9d-655e28715cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4036e5ce7a04f9ab7acb32521ddf233, user_id=77e84568cc2f49cd89a83a6258bad4b3, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:51.919536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feada2aa-b851-4b4a-8a9d-655e28715cec admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:51.923433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee3a41-ca18-4bc5-9509-9f9186f98d22 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:51.929088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75660deb-53d3-406e-85e5-c00f1923d90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:51.929743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75660deb-53d3-406e-85e5-c00f1923d90d admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:51.930025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75660deb-53d3-406e-85e5-c00f1923d90d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:51.930360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75660deb-53d3-406e-85e5-c00f1923d90d admin admin] PATH_INFO: `/v3/projects/556b3e501c6543c4aec9b19bb07edccf/users/ac9a13a498824d8eb6db84a9dd9a3a99/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:51.932629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75660deb-53d3-406e-85e5-c00f1923d90d admin admin] RBAC: Authorizing `identity:create_grant(project_id=556b3e501c6543c4aec9b19bb07edccf, user_id=ac9a13a498824d8eb6db84a9dd9a3a99, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:51.938710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75660deb-53d3-406e-85e5-c00f1923d90d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:51.950115 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 667/1323] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:51 2022] PUT /identity/v3/projects/556b3e501c6543c4aec9b19bb07edccf/users/ac9a13a498824d8eb6db84a9dd9a3a99/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:52.195050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75660deb-53d3-406e-85e5-c00f1923d90d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:52.196741 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 657/1324] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:51 2022] PUT /identity/v3/projects/c4036e5ce7a04f9ab7acb32521ddf233/users/77e84568cc2f49cd89a83a6258bad4b3/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:52.196741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feada2aa-b851-4b4a-8a9d-655e28715cec admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:52.199814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75660deb-53d3-406e-85e5-c00f1923d90d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:52.200293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feada2aa-b851-4b4a-8a9d-655e28715cec admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:52.200293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0116e-487d-412b-8912-fd75985db1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:52.200293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0116e-487d-412b-8912-fd75985db1c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:52.200293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0116e-487d-412b-8912-fd75985db1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:52.200531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0116e-487d-412b-8912-fd75985db1c4 admin admin] PATH_INFO: `/v3/projects/4831ce886e7c4091b56092a48227f755/users/6bf04fca731149668789cbb0a9f95308/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:52.200531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0116e-487d-412b-8912-fd75985db1c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4831ce886e7c4091b56092a48227f755, user_id=6bf04fca731149668789cbb0a9f95308, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:52.200531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0116e-487d-412b-8912-fd75985db1c4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:52.200690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfa119-bc53-497b-873f-4f249ba02fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:52.200690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfa119-bc53-497b-873f-4f249ba02fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:52.200690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfa119-bc53-497b-873f-4f249ba02fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:52.200690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfa119-bc53-497b-873f-4f249ba02fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:52.200920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dfa119-bc53-497b-873f-4f249ba02fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:52.200920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dfa119-bc53-497b-873f-4f249ba02fa9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:52.200920 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 668/1325] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:52.200920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfa119-bc53-497b-873f-4f249ba02fa9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:52.200920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:52.200920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfa119-bc53-497b-873f-4f249ba02fa9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:52.201262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6799ce-88b6-462b-ad06-257cc3b385a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:52.201262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6799ce-88b6-462b-ad06-257cc3b385a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:52.201262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6799ce-88b6-462b-ad06-257cc3b385a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:52.201262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6799ce-88b6-462b-ad06-257cc3b385a0 admin admin] PATH_INFO: `/v3/projects/80aae888f8984fab9d12c5304427c794/users/fb130d3fbf88475ab63f87ce203d563f/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:52.201496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6799ce-88b6-462b-ad06-257cc3b385a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80aae888f8984fab9d12c5304427c794, user_id=fb130d3fbf88475ab63f87ce203d563f, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:52.201496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6799ce-88b6-462b-ad06-257cc3b385a0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:52.201496 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 669/1326] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:52 2022] PUT /identity/v3/projects/80aae888f8984fab9d12c5304427c794/users/fb130d3fbf88475ab63f87ce203d563f/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:52.201496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6799ce-88b6-462b-ad06-257cc3b385a0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:52.205818 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 658/1327] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:52 2022] PUT /identity/v3/projects/4831ce886e7c4091b56092a48227f755/users/6bf04fca731149668789cbb0a9f95308/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:52.207256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6e132-4ff2-476d-b5e3-1e917b795dea None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:52.207550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6e132-4ff2-476d-b5e3-1e917b795dea None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:52.207827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6e132-4ff2-476d-b5e3-1e917b795dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:52.238961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e2d6e132-4ff2-476d-b5e3-1e917b795dea None None] MFA Rules not processed for user `ac9a13a498824d8eb6db84a9dd9a3a99`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:52.240293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e2d6e132-4ff2-476d-b5e3-1e917b795dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:52.248397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6799ce-88b6-462b-ad06-257cc3b385a0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:52.249419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:52.307256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc426d-c48d-4a92-9186-c6dcb6e55b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:52.307933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc426d-c48d-4a92-9186-c6dcb6e55b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:52.308214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc426d-c48d-4a92-9186-c6dcb6e55b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:52.308488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc426d-c48d-4a92-9186-c6dcb6e55b1c admin admin] PATH_INFO: `/v3/projects/94e3ce3876734a51b1857a6e6f40be07/users/f019f47a03c74f59aaae11ba363180e1/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:52.310820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc426d-c48d-4a92-9186-c6dcb6e55b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e3ce3876734a51b1857a6e6f40be07, user_id=f019f47a03c74f59aaae11ba363180e1, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:52.314231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc426d-c48d-4a92-9186-c6dcb6e55b1c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:52.316678 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 659/1328] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:52 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:52.325026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6e132-4ff2-476d-b5e3-1e917b795dea None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:52.327577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6e132-4ff2-476d-b5e3-1e917b795dea None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:52.331715 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 670/1329] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:52 2022] PUT /identity/v3/projects/94e3ce3876734a51b1857a6e6f40be07/users/f019f47a03c74f59aaae11ba363180e1/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:52.332548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc426d-c48d-4a92-9186-c6dcb6e55b1c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:52.338107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-49bc426d-c48d-4a92-9186-c6dcb6e55b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:52.397780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe049868-90e9-47cd-a2a9-6b9b703058c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:52.398580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe049868-90e9-47cd-a2a9-6b9b703058c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:52.398936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe049868-90e9-47cd-a2a9-6b9b703058c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:52.399297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe049868-90e9-47cd-a2a9-6b9b703058c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:52.400102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe049868-90e9-47cd-a2a9-6b9b703058c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:52.401801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe049868-90e9-47cd-a2a9-6b9b703058c4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:52.408898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc426d-c48d-4a92-9186-c6dcb6e55b1c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:52.413621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c923334-5ead-4eb1-8306-586764f4b0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:52.413949 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 660/1330] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:52.414434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c923334-5ead-4eb1-8306-586764f4b0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:52.414718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c923334-5ead-4eb1-8306-586764f4b0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:52.414997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c923334-5ead-4eb1-8306-586764f4b0d0 admin admin] PATH_INFO: `/v3/projects/772de4d4cb664c249d812c768757b3e4` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:52.415372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe049868-90e9-47cd-a2a9-6b9b703058c4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:52.417478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c923334-5ead-4eb1-8306-586764f4b0d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=772de4d4cb664c249d812c768757b3e4)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:52.419477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c923334-5ead-4eb1-8306-586764f4b0d0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:52.427442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe049868-90e9-47cd-a2a9-6b9b703058c4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:52.432787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04b59b-4962-4ba8-bced-dd6aeb8dc360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:52.433578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04b59b-4962-4ba8-bced-dd6aeb8dc360 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:52.433998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04b59b-4962-4ba8-bced-dd6aeb8dc360 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:52.434441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04b59b-4962-4ba8-bced-dd6aeb8dc360 admin admin] PATH_INFO: `/v3/projects/0ee1195a82e645029b39497fdfad0e18/users/d1e25d4a021c4102a526bd6b46e4f52c/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:52.436475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04b59b-4962-4ba8-bced-dd6aeb8dc360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ee1195a82e645029b39497fdfad0e18, user_id=d1e25d4a021c4102a526bd6b46e4f52c, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:52.439425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04b59b-4962-4ba8-bced-dd6aeb8dc360 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:52.450828 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 661/1331] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:52 2022] PUT /identity/v3/projects/0ee1195a82e645029b39497fdfad0e18/users/d1e25d4a021c4102a526bd6b46e4f52c/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:52.452158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704b9ad-25b5-4949-830c-782a22c18ebb None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:52.452445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704b9ad-25b5-4949-830c-782a22c18ebb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:52.452718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704b9ad-25b5-4949-830c-782a22c18ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:52.489186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b704b9ad-25b5-4949-830c-782a22c18ebb None None] MFA Rules not processed for user `fb130d3fbf88475ab63f87ce203d563f`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:52.490482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b704b9ad-25b5-4949-830c-782a22c18ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:52.506962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:52.517968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9c923334-5ead-4eb1-8306-586764f4b0d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '772de4d4cb664c249d812c768757b3e4', 'request_id': 'req-9c923334-5ead-4eb1-8306-586764f4b0d0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:52.524396 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9c923334-5ead-4eb1-8306-586764f4b0d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '772de4d4cb664c249d812c768757b3e4', 'request_id': 'req-9c923334-5ead-4eb1-8306-586764f4b0d0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:52.532498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9c923334-5ead-4eb1-8306-586764f4b0d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '772de4d4cb664c249d812c768757b3e4', 'request_id': 'req-9c923334-5ead-4eb1-8306-586764f4b0d0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:52.564294 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 662/1332] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:52 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:52.565165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704b9ad-25b5-4949-830c-782a22c18ebb None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:52.585085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:52.622691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9c923334-5ead-4eb1-8306-586764f4b0d0 admin admin] The token cache is being invalidate because project 772de4d4cb664c249d812c768757b3e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:20:52.622989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9c923334-5ead-4eb1-8306-586764f4b0d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:52.623648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9c923334-5ead-4eb1-8306-586764f4b0d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:52.625159 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 671/1333] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:20:52 2022] DELETE /identity/v3/projects/772de4d4cb664c249d812c768757b3e4 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:52.631134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c923334-5ead-4eb1-8306-586764f4b0d0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:52.632476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9c923334-5ead-4eb1-8306-586764f4b0d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:52.634239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704b9ad-25b5-4949-830c-782a22c18ebb None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:52.705190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c923334-5ead-4eb1-8306-586764f4b0d0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:52.707841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3dbf3-12e7-48bf-abc1-2b2cafac06fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:52.708511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3dbf3-12e7-48bf-abc1-2b2cafac06fd admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:52.708794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3dbf3-12e7-48bf-abc1-2b2cafac06fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:52.709060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3dbf3-12e7-48bf-abc1-2b2cafac06fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:52.709705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3dbf3-12e7-48bf-abc1-2b2cafac06fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:52.710239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1871714-338b-48b4-af72-5b8f9164dc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:52.710946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1871714-338b-48b4-af72-5b8f9164dc6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:52.711229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1871714-338b-48b4-af72-5b8f9164dc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:52.711449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3dbf3-12e7-48bf-abc1-2b2cafac06fd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:52.711541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1871714-338b-48b4-af72-5b8f9164dc6d admin admin] PATH_INFO: `/v3/users/e9dbadbd5fc54b23801d0901b7cfd58f` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:52.712796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1871714-338b-48b4-af72-5b8f9164dc6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9dbadbd5fc54b23801d0901b7cfd58f)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:52.714786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1871714-338b-48b4-af72-5b8f9164dc6d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:52.722882 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 663/1334] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:52.727924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fffca0-1cb8-46c4-aede-980488b6fea6 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:52.728213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fffca0-1cb8-46c4-aede-980488b6fea6 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:52.728486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fffca0-1cb8-46c4-aede-980488b6fea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:52.755937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f0fffca0-1cb8-46c4-aede-980488b6fea6 None None] MFA Rules not processed for user `f019f47a03c74f59aaae11ba363180e1`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:52.757163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f0fffca0-1cb8-46c4-aede-980488b6fea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:52.822545 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 664/1335] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:52.823624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fffca0-1cb8-46c4-aede-980488b6fea6 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:52.824858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f0fffca0-1cb8-46c4-aede-980488b6fea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:52.837948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fffca0-1cb8-46c4-aede-980488b6fea6 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:52.842459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711384f0-7877-49e9-9e93-f4eff6ecc3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:52.843104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711384f0-7877-49e9-9e93-f4eff6ecc3fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:52.843384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711384f0-7877-49e9-9e93-f4eff6ecc3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:52.843657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711384f0-7877-49e9-9e93-f4eff6ecc3fb admin admin] PATH_INFO: `/v3/projects/c4036e5ce7a04f9ab7acb32521ddf233/users/77e84568cc2f49cd89a83a6258bad4b3/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:52.846217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711384f0-7877-49e9-9e93-f4eff6ecc3fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4036e5ce7a04f9ab7acb32521ddf233, user_id=77e84568cc2f49cd89a83a6258bad4b3, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:52.848858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711384f0-7877-49e9-9e93-f4eff6ecc3fb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:52.860101 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 665/1336] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:52 2022] PUT /identity/v3/projects/c4036e5ce7a04f9ab7acb32521ddf233/users/77e84568cc2f49cd89a83a6258bad4b3/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:52.861315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28b9de-0edc-4ea1-aa42-d408d167a4a8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:52.861605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28b9de-0edc-4ea1-aa42-d408d167a4a8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:52.861869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28b9de-0edc-4ea1-aa42-d408d167a4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:52.889409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1d28b9de-0edc-4ea1-aa42-d408d167a4a8 None None] MFA Rules not processed for user `d1e25d4a021c4102a526bd6b46e4f52c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:52.890664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1d28b9de-0edc-4ea1-aa42-d408d167a4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:52.946272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a1871714-338b-48b4-af72-5b8f9164dc6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9dbadbd5fc54b23801d0901b7cfd58f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:52.947010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a1871714-338b-48b4-af72-5b8f9164dc6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9dbadbd5fc54b23801d0901b7cfd58f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:52.954516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a1871714-338b-48b4-af72-5b8f9164dc6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9dbadbd5fc54b23801d0901b7cfd58f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:52.959853 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 666/1337] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:52.960725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28b9de-0edc-4ea1-aa42-d408d167a4a8 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:52.961993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1d28b9de-0edc-4ea1-aa42-d408d167a4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:52.967398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a1871714-338b-48b4-af72-5b8f9164dc6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9dbadbd5fc54b23801d0901b7cfd58f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:52.968177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a1871714-338b-48b4-af72-5b8f9164dc6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9dbadbd5fc54b23801d0901b7cfd58f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:52.973379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:53.017862 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 672/1338] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:20:52 2022] DELETE /identity/v3/users/e9dbadbd5fc54b23801d0901b7cfd58f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:53.018977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa992a-a166-4a27-a7a5-61a073fa0d16 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:53.019271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa992a-a166-4a27-a7a5-61a073fa0d16 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:53.019538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa992a-a166-4a27-a7a5-61a073fa0d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:53.038314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28b9de-0edc-4ea1-aa42-d408d167a4a8 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:53.038848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-52fa992a-a166-4a27-a7a5-61a073fa0d16 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:53.040060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-52fa992a-a166-4a27-a7a5-61a073fa0d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:53.077978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:53.099600 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 673/1339] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:53.100493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa992a-a166-4a27-a7a5-61a073fa0d16 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:53.101669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61458c-f106-421a-a1e1-cd79f56fecc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:53.101936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-52fa992a-a166-4a27-a7a5-61a073fa0d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:53.102324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61458c-f106-421a-a1e1-cd79f56fecc4 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:53.102609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61458c-f106-421a-a1e1-cd79f56fecc4 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:53.102884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61458c-f106-421a-a1e1-cd79f56fecc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:53.104611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ce61458c-f106-421a-a1e1-cd79f56fecc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:53.116266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa992a-a166-4a27-a7a5-61a073fa0d16 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:53.124159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0122f-8901-4701-914c-3ea8f6efc422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:53.125279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0122f-8901-4701-914c-3ea8f6efc422 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:53.126360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0122f-8901-4701-914c-3ea8f6efc422 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:53.126857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0122f-8901-4701-914c-3ea8f6efc422 admin admin] PATH_INFO: `/v3/projects/4831ce886e7c4091b56092a48227f755/users/6bf04fca731149668789cbb0a9f95308/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:53.129306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0122f-8901-4701-914c-3ea8f6efc422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4831ce886e7c4091b56092a48227f755, user_id=6bf04fca731149668789cbb0a9f95308, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:53.132014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0122f-8901-4701-914c-3ea8f6efc422 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:53.143827 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 674/1340] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:53 2022] PUT /identity/v3/projects/4831ce886e7c4091b56092a48227f755/users/6bf04fca731149668789cbb0a9f95308/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:53.145200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09761707-4a88-45bc-a388-9799b9630361 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:53.145485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09761707-4a88-45bc-a388-9799b9630361 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:53.145757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09761707-4a88-45bc-a388-9799b9630361 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:53.147234 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 675/1341] 10.222.0.20 () {54 vars in 961 bytes} [Thu Oct 27 03:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:20:53.151699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca37ea-ab16-4bcc-95e1-ce643efe2f90 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:53.152006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca37ea-ab16-4bcc-95e1-ce643efe2f90 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:53.152939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca37ea-ab16-4bcc-95e1-ce643efe2f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:53.161539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:53.176526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61458c-f106-421a-a1e1-cd79f56fecc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:53.178185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61458c-f106-421a-a1e1-cd79f56fecc4 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:53.181539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-25ca37ea-ab16-4bcc-95e1-ce643efe2f90 None None] MFA Rules not processed for user `77e84568cc2f49cd89a83a6258bad4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:53.182815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-25ca37ea-ab16-4bcc-95e1-ce643efe2f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:53.192437 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 667/1342] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:20:52 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:20:53.195397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12fca0-edd2-435e-9c78-f9933bcba436 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:53.195688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12fca0-edd2-435e-9c78-f9933bcba436 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:53.195969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12fca0-edd2-435e-9c78-f9933bcba436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:53.217506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1f12fca0-edd2-435e-9c78-f9933bcba436 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:53.217506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1f12fca0-edd2-435e-9c78-f9933bcba436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:53.274484 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 676/1343] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:53.276042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae890e-2f4a-45be-a764-26e528c539ab None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:53.276333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae890e-2f4a-45be-a764-26e528c539ab None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:53.276614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae890e-2f4a-45be-a764-26e528c539ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:53.285487 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 668/1344] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:53.286699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d56f3-5ea7-4e71-bfbd-3be54dedbca0 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:53.286978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d56f3-5ea7-4e71-bfbd-3be54dedbca0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:53.287262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d56f3-5ea7-4e71-bfbd-3be54dedbca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:53.302920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-efae890e-2f4a-45be-a764-26e528c539ab None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:53.304246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-efae890e-2f4a-45be-a764-26e528c539ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:53.312630 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 677/1345] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:53.314534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042200e-2436-4ec2-9961-1c566575c2a0 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:53.314885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042200e-2436-4ec2-9961-1c566575c2a0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:53.315335 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042200e-2436-4ec2-9961-1c566575c2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:53.316989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9a2d56f3-5ea7-4e71-bfbd-3be54dedbca0 None None] MFA Rules not processed for user `c20881251f2241a3a5ec2e5cf99db149`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:53.318211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9a2d56f3-5ea7-4e71-bfbd-3be54dedbca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:53.347712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d042200e-2436-4ec2-9961-1c566575c2a0 None None] MFA Rules not processed for user `6bf04fca731149668789cbb0a9f95308`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:53.348933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d042200e-2436-4ec2-9961-1c566575c2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:53.391708 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 669/1346] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Oct 27 03:20:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:53.392558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d56f3-5ea7-4e71-bfbd-3be54dedbca0 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:53.393843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9a2d56f3-5ea7-4e71-bfbd-3be54dedbca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:53.418477 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 678/1347] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:53.419312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042200e-2436-4ec2-9961-1c566575c2a0 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:53.420583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d042200e-2436-4ec2-9961-1c566575c2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:53.435506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042200e-2436-4ec2-9961-1c566575c2a0 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:53.441526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194dcd71-eab3-42dc-bcf6-9e3a8c793a5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:53.442148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dcd71-eab3-42dc-bcf6-9e3a8c793a5a service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:53.442428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dcd71-eab3-42dc-bcf6-9e3a8c793a5a service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:53.442701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dcd71-eab3-42dc-bcf6-9e3a8c793a5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:53.444398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-194dcd71-eab3-42dc-bcf6-9e3a8c793a5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:53.452590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d56f3-5ea7-4e71-bfbd-3be54dedbca0 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:53.456261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e2c47-de20-449c-850c-9f0e501dbd17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:53.456867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e2c47-de20-449c-850c-9f0e501dbd17 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:53.457148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e2c47-de20-449c-850c-9f0e501dbd17 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:53.457427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e2c47-de20-449c-850c-9f0e501dbd17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:53.467061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e2c47-de20-449c-850c-9f0e501dbd17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:53.468569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e2c47-de20-449c-850c-9f0e501dbd17 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:53.475590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:53.479234 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 670/1348] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:20:53.480382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e2c47-de20-449c-850c-9f0e501dbd17 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:53.490892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e2c47-de20-449c-850c-9f0e501dbd17 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:53.495999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fbfdd-7c2d-4af2-bbcf-8ddf4c75ad58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:53.496607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fbfdd-7c2d-4af2-bbcf-8ddf4c75ad58 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:53.496891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fbfdd-7c2d-4af2-bbcf-8ddf4c75ad58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:53.497171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fbfdd-7c2d-4af2-bbcf-8ddf4c75ad58 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:53.497821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fbfdd-7c2d-4af2-bbcf-8ddf4c75ad58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:20:53.498166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fbfdd-7c2d-4af2-bbcf-8ddf4c75ad58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:53.499780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fbfdd-7c2d-4af2-bbcf-8ddf4c75ad58 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:53.510575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194dcd71-eab3-42dc-bcf6-9e3a8c793a5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:53.512393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194dcd71-eab3-42dc-bcf6-9e3a8c793a5a service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:53.513126 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 671/1349] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:20:53.513872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fbfdd-7c2d-4af2-bbcf-8ddf4c75ad58 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:53.524677 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 679/1350] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:20:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:20:53.525487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194dcd71-eab3-42dc-bcf6-9e3a8c793a5a service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:53.535319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fbfdd-7c2d-4af2-bbcf-8ddf4c75ad58 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:53.542570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922d824-27f1-4d69-8d9c-adea1f6a4efe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:53.542692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922d824-27f1-4d69-8d9c-adea1f6a4efe service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:53.542898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922d824-27f1-4d69-8d9c-adea1f6a4efe service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:53.543419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922d824-27f1-4d69-8d9c-adea1f6a4efe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:53.549034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194dcd71-eab3-42dc-bcf6-9e3a8c793a5a service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:53.549795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8922d824-27f1-4d69-8d9c-adea1f6a4efe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:53.556557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:53.557650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcaadd0-fee2-4c24-9116-82198315c451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:53.558653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaadd0-fee2-4c24-9116-82198315c451 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:53.558947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaadd0-fee2-4c24-9116-82198315c451 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:53.559231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaadd0-fee2-4c24-9116-82198315c451 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:53.560066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcaadd0-fee2-4c24-9116-82198315c451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:53.562492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcaadd0-fee2-4c24-9116-82198315c451 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:53.630304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922d824-27f1-4d69-8d9c-adea1f6a4efe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:53.631917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922d824-27f1-4d69-8d9c-adea1f6a4efe service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:53.642023 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 672/1351] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:20:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:20:53.664744 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 680/1352] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:20:53 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:53.671244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922d824-27f1-4d69-8d9c-adea1f6a4efe service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:53.686360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922d824-27f1-4d69-8d9c-adea1f6a4efe service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:53.734518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcaadd0-fee2-4c24-9116-82198315c451 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:53.771013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e658022-bbc4-49a7-890a-6ac2c84f1a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:53.771926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e658022-bbc4-49a7-890a-6ac2c84f1a2c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:53.772352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e658022-bbc4-49a7-890a-6ac2c84f1a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:53.772955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e658022-bbc4-49a7-890a-6ac2c84f1a2c admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:53.774174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e658022-bbc4-49a7-890a-6ac2c84f1a2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:53.776314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e658022-bbc4-49a7-890a-6ac2c84f1a2c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:53.827254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcaadd0-fee2-4c24-9116-82198315c451 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:53.832831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f954e78-67ef-4d6d-9c15-32c8f7114c1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:53.833467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f954e78-67ef-4d6d-9c15-32c8f7114c1f service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:53.833747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f954e78-67ef-4d6d-9c15-32c8f7114c1f service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:53.834022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f954e78-67ef-4d6d-9c15-32c8f7114c1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:53.842727 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 673/1353] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:20:53 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:53.846286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e658022-bbc4-49a7-890a-6ac2c84f1a2c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:53.867724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e658022-bbc4-49a7-890a-6ac2c84f1a2c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:53.875460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecb91c-c89f-4fd5-a7e1-998b79c06c14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:53.877023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecb91c-c89f-4fd5-a7e1-998b79c06c14 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:53.877373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecb91c-c89f-4fd5-a7e1-998b79c06c14 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:53.877718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecb91c-c89f-4fd5-a7e1-998b79c06c14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:53.901927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f954e78-67ef-4d6d-9c15-32c8f7114c1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:53.903575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f954e78-67ef-4d6d-9c15-32c8f7114c1f service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:53.920720 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 681/1354] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:20:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:20:53.923641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f954e78-67ef-4d6d-9c15-32c8f7114c1f service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:53.936536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f954e78-67ef-4d6d-9c15-32c8f7114c1f service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:53.941451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208c5a8-8794-4098-ad9a-f5be9b926ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:53.942329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208c5a8-8794-4098-ad9a-f5be9b926ece admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:53.942617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208c5a8-8794-4098-ad9a-f5be9b926ece admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:53.942894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208c5a8-8794-4098-ad9a-f5be9b926ece admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:53.943549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208c5a8-8794-4098-ad9a-f5be9b926ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:53.945409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208c5a8-8794-4098-ad9a-f5be9b926ece admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:53.947083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ecb91c-c89f-4fd5-a7e1-998b79c06c14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:53.951108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ecb91c-c89f-4fd5-a7e1-998b79c06c14 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:53.956322 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 682/1355] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:53.957316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208c5a8-8794-4098-ad9a-f5be9b926ece admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:53.959299 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 674/1356] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:20:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:20:53.960434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecb91c-c89f-4fd5-a7e1-998b79c06c14 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:53.962375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1208c5a8-8794-4098-ad9a-f5be9b926ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:53.970887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecb91c-c89f-4fd5-a7e1-998b79c06c14 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:53.975645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60924a-8a09-430e-b392-862c0981fc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:53.976310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60924a-8a09-430e-b392-862c0981fc27 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:53.976596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60924a-8a09-430e-b392-862c0981fc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:53.985369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60924a-8a09-430e-b392-862c0981fc27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:53.985369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60924a-8a09-430e-b392-862c0981fc27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:53.985605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208c5a8-8794-4098-ad9a-f5be9b926ece admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:53.985689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60924a-8a09-430e-b392-862c0981fc27 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:53.985761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe53885-5436-4105-bff7-f7094c82577c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:53.985761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe53885-5436-4105-bff7-f7094c82577c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:53.985761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe53885-5436-4105-bff7-f7094c82577c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:53.985761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe53885-5436-4105-bff7-f7094c82577c admin admin] PATH_INFO: `/v3/projects/0c0ff2f64e0f448d9c108c82307c28c9` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:53.986024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe53885-5436-4105-bff7-f7094c82577c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c0ff2f64e0f448d9c108c82307c28c9)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:53.987341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe53885-5436-4105-bff7-f7094c82577c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:53.989346 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 675/1357] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:20:53.993459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60924a-8a09-430e-b392-862c0981fc27 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:54.003195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60924a-8a09-430e-b392-862c0981fc27 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:54.008173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78077b4b-3f44-42c9-8c18-a0d3ad245d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:54.014230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78077b4b-3f44-42c9-8c18-a0d3ad245d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:54.014230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78077b4b-3f44-42c9-8c18-a0d3ad245d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:54.014230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78077b4b-3f44-42c9-8c18-a0d3ad245d5e admin admin] PATH_INFO: `/v3/projects/1707c15835fd4feea2c04085bf79c430/users/a032658e53dc4c119f3d0fd96087466c/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:54.014471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:54.022305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:54.026745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78077b4b-3f44-42c9-8c18-a0d3ad245d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1707c15835fd4feea2c04085bf79c430, user_id=a032658e53dc4c119f3d0fd96087466c, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:54.029472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78077b4b-3f44-42c9-8c18-a0d3ad245d5e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:54.119952 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 676/1358] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:53 2022] PUT /identity/v3/projects/1707c15835fd4feea2c04085bf79c430/users/a032658e53dc4c119f3d0fd96087466c/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:20:54.131222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffe53885-5436-4105-bff7-f7094c82577c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c0ff2f64e0f448d9c108c82307c28c9', 'request_id': 'req-ffe53885-5436-4105-bff7-f7094c82577c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:54.131483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f0d16-c401-4357-81ad-f9b999d9edbb None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:54.131780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f0d16-c401-4357-81ad-f9b999d9edbb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:54.132128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f0d16-c401-4357-81ad-f9b999d9edbb None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:54.133451 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 677/1359] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:20:54 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:20:54.134620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd13a7-2c9c-4327-bd88-701c6bcb4c9a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:54.134919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd13a7-2c9c-4327-bd88-701c6bcb4c9a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:54.135174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd13a7-2c9c-4327-bd88-701c6bcb4c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:54.138646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffe53885-5436-4105-bff7-f7094c82577c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c0ff2f64e0f448d9c108c82307c28c9', 'request_id': 'req-ffe53885-5436-4105-bff7-f7094c82577c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:54.145520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffe53885-5436-4105-bff7-f7094c82577c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c0ff2f64e0f448d9c108c82307c28c9', 'request_id': 'req-ffe53885-5436-4105-bff7-f7094c82577c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:54.165079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0efd13a7-2c9c-4327-bd88-701c6bcb4c9a None None] MFA Rules not processed for user `a032658e53dc4c119f3d0fd96087466c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:54.166343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0efd13a7-2c9c-4327-bd88-701c6bcb4c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:54.233190 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 678/1360] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:54.234766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd13a7-2c9c-4327-bd88-701c6bcb4c9a None None] Authenticating service token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:20:54.247045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffe53885-5436-4105-bff7-f7094c82577c admin admin] The token cache is being invalidate because project 0c0ff2f64e0f448d9c108c82307c28c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:20:54.247538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffe53885-5436-4105-bff7-f7094c82577c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:54.248101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffe53885-5436-4105-bff7-f7094c82577c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:54.249917 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 683/1361] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:20:53 2022] DELETE /identity/v3/projects/0c0ff2f64e0f448d9c108c82307c28c9 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:54.250660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe53885-5436-4105-bff7-f7094c82577c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:54.252130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ffe53885-5436-4105-bff7-f7094c82577c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:54.309402 n-d-862769-1 devstack@keystone.service[82179]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-0efd13a7-2c9c-4327-bd88-701c6bcb4c9a None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 27 03:20:54.309710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd13a7-2c9c-4327-bd88-701c6bcb4c9a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:54.316873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe53885-5436-4105-bff7-f7094c82577c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:54.321417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c063bfd-b6fb-40e4-9866-006915bf516c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:54.322058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c063bfd-b6fb-40e4-9866-006915bf516c admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:54.322350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c063bfd-b6fb-40e4-9866-006915bf516c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:54.322619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c063bfd-b6fb-40e4-9866-006915bf516c admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:54.323355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c063bfd-b6fb-40e4-9866-006915bf516c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:54.325291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c063bfd-b6fb-40e4-9866-006915bf516c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:54.372570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd13a7-2c9c-4327-bd88-701c6bcb4c9a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:54.377682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10879ab6-3334-4d2e-bba8-7df5e43ddf35 tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e84568cc2f49cd89a83a6258bad4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4036e5ce7a04f9ab7acb32521ddf233', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:54.378362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10879ab6-3334-4d2e-bba8-7df5e43ddf35 tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:54.378656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10879ab6-3334-4d2e-bba8-7df5e43ddf35 tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:54.378936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10879ab6-3334-4d2e-bba8-7df5e43ddf35 tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] PATH_INFO: `/v3/projects/3c57cd10266e45f78f55210ba1bbb288` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:54.380062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10879ab6-3334-4d2e-bba8-7df5e43ddf35 tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] RBAC: Authorizing `identity:get_project(project_id=3c57cd10266e45f78f55210ba1bbb288)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:54.382161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10879ab6-3334-4d2e-bba8-7df5e43ddf35 tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:54.383845 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 679/1362] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:20:54 2022] GET /identity/v3/projects/3c57cd10266e45f78f55210ba1bbb288 => generated 379 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:20:54.385311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10879ab6-3334-4d2e-bba8-7df5e43ddf35 tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:54.386357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-10879ab6-3334-4d2e-bba8-7df5e43ddf35 tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:54.400565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10879ab6-3334-4d2e-bba8-7df5e43ddf35 tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:54.405238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610366ea-2116-445e-bab1-f21ddee7d6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:54.405850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610366ea-2116-445e-bab1-f21ddee7d6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:54.410141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610366ea-2116-445e-bab1-f21ddee7d6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:54.410141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610366ea-2116-445e-bab1-f21ddee7d6c5 admin admin] PATH_INFO: `/v3/users/ac9a13a498824d8eb6db84a9dd9a3a99` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:54.410141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610366ea-2116-445e-bab1-f21ddee7d6c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac9a13a498824d8eb6db84a9dd9a3a99)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:54.410141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610366ea-2116-445e-bab1-f21ddee7d6c5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:54.412818 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 684/1363] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:20:54 2022] POST /identity/v3/projects => generated 371 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:54.414095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e1ea5-6190-4c42-9758-91af4acd48fe None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:54.414383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e1ea5-6190-4c42-9758-91af4acd48fe None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:54.414656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e1ea5-6190-4c42-9758-91af4acd48fe None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:54.416149 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 685/1364] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:20:54.416840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e1ea5-6190-4c42-9758-91af4acd48fe None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:54.427641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:54.483105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e1ea5-6190-4c42-9758-91af4acd48fe None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:54.488178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd32d96-0771-4903-9f17-2f5e19e0a327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:54.488727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd32d96-0771-4903-9f17-2f5e19e0a327 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:54.489009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd32d96-0771-4903-9f17-2f5e19e0a327 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:54.489283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd32d96-0771-4903-9f17-2f5e19e0a327 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:54.489965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd32d96-0771-4903-9f17-2f5e19e0a327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:54.491910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd32d96-0771-4903-9f17-2f5e19e0a327 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:54.586423 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 686/1365] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:20:54 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:54.586423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e77d8-b12a-4565-86f1-eb4856395c1a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:54.586423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e77d8-b12a-4565-86f1-eb4856395c1a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:54.586423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e77d8-b12a-4565-86f1-eb4856395c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:54.605466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-260e77d8-b12a-4565-86f1-eb4856395c1a None None] MFA Rules not processed for user `1a395d2414cd4da085a77ddc9b1f1caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:54.606740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-260e77d8-b12a-4565-86f1-eb4856395c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:54.626241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:54.626526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-610366ea-2116-445e-bab1-f21ddee7d6c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac9a13a498824d8eb6db84a9dd9a3a99'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:54.627253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-610366ea-2116-445e-bab1-f21ddee7d6c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac9a13a498824d8eb6db84a9dd9a3a99'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:54.634550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-610366ea-2116-445e-bab1-f21ddee7d6c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac9a13a498824d8eb6db84a9dd9a3a99'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:54.647788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-610366ea-2116-445e-bab1-f21ddee7d6c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac9a13a498824d8eb6db84a9dd9a3a99'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:54.671902 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 687/1366] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:20:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:54.672837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e77d8-b12a-4565-86f1-eb4856395c1a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:54.674204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-260e77d8-b12a-4565-86f1-eb4856395c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:54.685877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-610366ea-2116-445e-bab1-f21ddee7d6c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac9a13a498824d8eb6db84a9dd9a3a99'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:54.693969 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 680/1367] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:20:54 2022] DELETE /identity/v3/users/ac9a13a498824d8eb6db84a9dd9a3a99 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:54.694728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610366ea-2116-445e-bab1-f21ddee7d6c5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:54.696112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-610366ea-2116-445e-bab1-f21ddee7d6c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:54.757003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e77d8-b12a-4565-86f1-eb4856395c1a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:54.769313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610366ea-2116-445e-bab1-f21ddee7d6c5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:54.774480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585dee89-f737-4277-93be-57b3493aa754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:54.775537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dee89-f737-4277-93be-57b3493aa754 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:54.775998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dee89-f737-4277-93be-57b3493aa754 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:54.776284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dee89-f737-4277-93be-57b3493aa754 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:54.777360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585dee89-f737-4277-93be-57b3493aa754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:54.779370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585dee89-f737-4277-93be-57b3493aa754 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:54.792537 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 681/1368] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:54.796188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585dee89-f737-4277-93be-57b3493aa754 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:54.799183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-585dee89-f737-4277-93be-57b3493aa754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:54.827995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db0d4d-3d9a-434e-a28f-9ad76929e395 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:54.828637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db0d4d-3d9a-434e-a28f-9ad76929e395 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:54.828922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db0d4d-3d9a-434e-a28f-9ad76929e395 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:54.829195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db0d4d-3d9a-434e-a28f-9ad76929e395 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:54.830945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f1db0d4d-3d9a-434e-a28f-9ad76929e395 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:54.870729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585dee89-f737-4277-93be-57b3493aa754 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:54.877249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff09ab8-bb4f-4775-a534-177f5ba70254 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:54.877870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff09ab8-bb4f-4775-a534-177f5ba70254 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:54.878189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff09ab8-bb4f-4775-a534-177f5ba70254 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:54.878468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff09ab8-bb4f-4775-a534-177f5ba70254 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:54.887667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff09ab8-bb4f-4775-a534-177f5ba70254 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:54.889544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff09ab8-bb4f-4775-a534-177f5ba70254 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:54.892409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:54.894730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db0d4d-3d9a-434e-a28f-9ad76929e395 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:54.896668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db0d4d-3d9a-434e-a28f-9ad76929e395 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:54.900433 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 682/1369] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:20:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:20:54.903656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff09ab8-bb4f-4775-a534-177f5ba70254 service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:54.911842 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 688/1370] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:20:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:20:54.924501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff09ab8-bb4f-4775-a534-177f5ba70254 service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:54.932460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76054f81-6a07-4dc5-80a6-59f4a2fee7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:54.933304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76054f81-6a07-4dc5-80a6-59f4a2fee7f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:54.933683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76054f81-6a07-4dc5-80a6-59f4a2fee7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:54.934138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76054f81-6a07-4dc5-80a6-59f4a2fee7f3 admin admin] PATH_INFO: `/v3/projects/71dd6a8eded64966aaf7adccc074dd90/users/efb95cf93d744f9b9f498d46e691f85f/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:54.965855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:54.971048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76054f81-6a07-4dc5-80a6-59f4a2fee7f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71dd6a8eded64966aaf7adccc074dd90, user_id=efb95cf93d744f9b9f498d46e691f85f, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:54.974399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76054f81-6a07-4dc5-80a6-59f4a2fee7f3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:55.024107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db0d4d-3d9a-434e-a28f-9ad76929e395 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:55.039172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db0d4d-3d9a-434e-a28f-9ad76929e395 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:55.041033 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 683/1371] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:54 2022] PUT /identity/v3/projects/71dd6a8eded64966aaf7adccc074dd90/users/efb95cf93d744f9b9f498d46e691f85f/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:55.042411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76054f81-6a07-4dc5-80a6-59f4a2fee7f3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:55.133983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f664ef-dc11-4cd4-9823-892b3f09a3f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:55.135389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f664ef-dc11-4cd4-9823-892b3f09a3f2 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:55.135534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76054f81-6a07-4dc5-80a6-59f4a2fee7f3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:55.135984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f664ef-dc11-4cd4-9823-892b3f09a3f2 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:55.136609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f664ef-dc11-4cd4-9823-892b3f09a3f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:55.139938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-57f664ef-dc11-4cd4-9823-892b3f09a3f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:55.144062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cf4c7-472e-4ec0-80bf-526355ed99e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:55.144698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cf4c7-472e-4ec0-80bf-526355ed99e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:55.144983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cf4c7-472e-4ec0-80bf-526355ed99e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:55.145877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cf4c7-472e-4ec0-80bf-526355ed99e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:55.146613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039cf4c7-472e-4ec0-80bf-526355ed99e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:55.148299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039cf4c7-472e-4ec0-80bf-526355ed99e6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:55.163782 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 684/1372] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:55.164875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cf4c7-472e-4ec0-80bf-526355ed99e6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:55.166725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-039cf4c7-472e-4ec0-80bf-526355ed99e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:55.184249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cf4c7-472e-4ec0-80bf-526355ed99e6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:55.191238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6594a-1b8a-4798-81f2-7eb4a4d5e653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:55.191887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6594a-1b8a-4798-81f2-7eb4a4d5e653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:55.192171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6594a-1b8a-4798-81f2-7eb4a4d5e653 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:55.192538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6594a-1b8a-4798-81f2-7eb4a4d5e653 admin admin] PATH_INFO: `/v3/projects/556b3e501c6543c4aec9b19bb07edccf` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:55.194193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6594a-1b8a-4798-81f2-7eb4a4d5e653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=556b3e501c6543c4aec9b19bb07edccf)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:55.195243 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-39d6594a-1b8a-4798-81f2-7eb4a4d5e653 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:20:55.195243 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:20:55.195243 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:20:55.196860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6594a-1b8a-4798-81f2-7eb4a4d5e653 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:55.214920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f664ef-dc11-4cd4-9823-892b3f09a3f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:55.216550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f664ef-dc11-4cd4-9823-892b3f09a3f2 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:55.226354 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 689/1373] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:20:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:20:55.226964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f664ef-dc11-4cd4-9823-892b3f09a3f2 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:55.237191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f664ef-dc11-4cd4-9823-892b3f09a3f2 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:55.244360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ff919-d301-49d7-a1b0-ec28f1b8e031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:55.244360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ff919-d301-49d7-a1b0-ec28f1b8e031 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:55.244360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ff919-d301-49d7-a1b0-ec28f1b8e031 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:55.244360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ff919-d301-49d7-a1b0-ec28f1b8e031 admin admin] PATH_INFO: `/v3/projects/71dd6a8eded64966aaf7adccc074dd90/users/efb95cf93d744f9b9f498d46e691f85f/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:55.244866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ff919-d301-49d7-a1b0-ec28f1b8e031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71dd6a8eded64966aaf7adccc074dd90, user_id=efb95cf93d744f9b9f498d46e691f85f, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:55.247536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ff919-d301-49d7-a1b0-ec28f1b8e031 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:55.258834 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 690/1374] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:55 2022] PUT /identity/v3/projects/71dd6a8eded64966aaf7adccc074dd90/users/efb95cf93d744f9b9f498d46e691f85f/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:55.269934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982da4f1-4230-43e9-bc4c-54238c6e7fd3 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:55.270662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982da4f1-4230-43e9-bc4c-54238c6e7fd3 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:55.271049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982da4f1-4230-43e9-bc4c-54238c6e7fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:55.314352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-982da4f1-4230-43e9-bc4c-54238c6e7fd3 None None] MFA Rules not processed for user `efb95cf93d744f9b9f498d46e691f85f`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:55.315594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-982da4f1-4230-43e9-bc4c-54238c6e7fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:55.318955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-39d6594a-1b8a-4798-81f2-7eb4a4d5e653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '556b3e501c6543c4aec9b19bb07edccf', 'request_id': 'req-39d6594a-1b8a-4798-81f2-7eb4a4d5e653'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:55.389258 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 691/1375] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:55.416477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72591bbd-eaf6-4aff-ae97-e684bc28d258 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:55.416477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72591bbd-eaf6-4aff-ae97-e684bc28d258 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:55.416477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72591bbd-eaf6-4aff-ae97-e684bc28d258 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:55.416477 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 692/1376] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:20:55.422117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72591bbd-eaf6-4aff-ae97-e684bc28d258 None None] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:20:55.424543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-72591bbd-eaf6-4aff-ae97-e684bc28d258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:55.431665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:55.434004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-39d6594a-1b8a-4798-81f2-7eb4a4d5e653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '556b3e501c6543c4aec9b19bb07edccf', 'request_id': 'req-39d6594a-1b8a-4798-81f2-7eb4a4d5e653'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:55.449090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-39d6594a-1b8a-4798-81f2-7eb4a4d5e653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '556b3e501c6543c4aec9b19bb07edccf', 'request_id': 'req-39d6594a-1b8a-4798-81f2-7eb4a4d5e653'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:55.461508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-39d6594a-1b8a-4798-81f2-7eb4a4d5e653 admin admin] The token cache is being invalidate because project 556b3e501c6543c4aec9b19bb07edccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:20:55.461900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-39d6594a-1b8a-4798-81f2-7eb4a4d5e653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:55.462681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-39d6594a-1b8a-4798-81f2-7eb4a4d5e653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:55.468029 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 685/1377] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:20:55 2022] DELETE /identity/v3/projects/556b3e501c6543c4aec9b19bb07edccf => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:55.468873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6594a-1b8a-4798-81f2-7eb4a4d5e653 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:55.470854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-39d6594a-1b8a-4798-81f2-7eb4a4d5e653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:55.512205 n-d-862769-1 devstack@keystone.service[82180]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-72591bbd-eaf6-4aff-ae97-e684bc28d258 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 27 03:20:55.512607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72591bbd-eaf6-4aff-ae97-e684bc28d258 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:55.514201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-72591bbd-eaf6-4aff-ae97-e684bc28d258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:55.545417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6594a-1b8a-4798-81f2-7eb4a4d5e653 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:55.552222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa137ab3-8d53-47f0-8b94-7fe837dad359 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:55.552950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa137ab3-8d53-47f0-8b94-7fe837dad359 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:55.553242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa137ab3-8d53-47f0-8b94-7fe837dad359 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:55.553515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa137ab3-8d53-47f0-8b94-7fe837dad359 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:55.555245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fa137ab3-8d53-47f0-8b94-7fe837dad359 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:55.563809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:55.567188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa137ab3-8d53-47f0-8b94-7fe837dad359 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:55.568814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa137ab3-8d53-47f0-8b94-7fe837dad359 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:55.578882 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 686/1378] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:20:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:20:55.580202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10091aeb-775a-45e3-a1e9-7651fa8e2683 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:55.580490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10091aeb-775a-45e3-a1e9-7651fa8e2683 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:55.580769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10091aeb-775a-45e3-a1e9-7651fa8e2683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:55.581288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72591bbd-eaf6-4aff-ae97-e684bc28d258 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:55.586635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249121c-0ed6-4a8c-80fa-5234289c71ba tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e84568cc2f49cd89a83a6258bad4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4036e5ce7a04f9ab7acb32521ddf233', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:55.587558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249121c-0ed6-4a8c-80fa-5234289c71ba tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:55.588013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249121c-0ed6-4a8c-80fa-5234289c71ba tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:55.588371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249121c-0ed6-4a8c-80fa-5234289c71ba tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] PATH_INFO: `/v3/projects/3c57cd10266e45f78f55210ba1bbb288` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:55.589636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249121c-0ed6-4a8c-80fa-5234289c71ba tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] RBAC: Authorizing `identity:get_project(project_id=3c57cd10266e45f78f55210ba1bbb288)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:55.592927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249121c-0ed6-4a8c-80fa-5234289c71ba tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:55.595431 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 693/1379] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:20:55 2022] GET /identity/v3/projects/3c57cd10266e45f78f55210ba1bbb288 => generated 379 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:20:55.601852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-10091aeb-775a-45e3-a1e9-7651fa8e2683 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:55.603102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-10091aeb-775a-45e3-a1e9-7651fa8e2683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:55.664301 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 687/1380] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:55.673439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29fd04-85b0-4595-8b00-0374e2536b5a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:55.673588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cbc51-1bd5-476d-9af7-4616385e5bdc None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:55.673734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cbc51-1bd5-476d-9af7-4616385e5bdc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:55.674138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29fd04-85b0-4595-8b00-0374e2536b5a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:55.674316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cbc51-1bd5-476d-9af7-4616385e5bdc None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:55.674415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29fd04-85b0-4595-8b00-0374e2536b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:55.676049 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 694/1381] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:20:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:20:55.681368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed88be-18c6-48f4-944e-6767d0176da7 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:55.681744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed88be-18c6-48f4-944e-6767d0176da7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:55.682214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed88be-18c6-48f4-944e-6767d0176da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:55.707403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ffed88be-18c6-48f4-944e-6767d0176da7 None None] MFA Rules not processed for user `1a395d2414cd4da085a77ddc9b1f1caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:55.708867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ffed88be-18c6-48f4-944e-6767d0176da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:55.709599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4f29fd04-85b0-4595-8b00-0374e2536b5a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:55.711270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4f29fd04-85b0-4595-8b00-0374e2536b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:55.722518 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 688/1382] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:55.727159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29fd04-85b0-4595-8b00-0374e2536b5a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:55.737262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29fd04-85b0-4595-8b00-0374e2536b5a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:55.741954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0cbc2-8d36-4026-8728-f03dd1d2ce20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:55.742592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0cbc2-8d36-4026-8728-f03dd1d2ce20 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:55.742877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0cbc2-8d36-4026-8728-f03dd1d2ce20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:55.743276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0cbc2-8d36-4026-8728-f03dd1d2ce20 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:55.743933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0cbc2-8d36-4026-8728-f03dd1d2ce20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:20:55.744225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0cbc2-8d36-4026-8728-f03dd1d2ce20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:55.746019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0cbc2-8d36-4026-8728-f03dd1d2ce20 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:55.759673 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 689/1383] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:20:55.764194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0cbc2-8d36-4026-8728-f03dd1d2ce20 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:55.775286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0cbc2-8d36-4026-8728-f03dd1d2ce20 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:55.780180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fa0bc-7787-4b40-ac97-037091744c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:55.780854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fa0bc-7787-4b40-ac97-037091744c1f admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:55.781207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fa0bc-7787-4b40-ac97-037091744c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:55.782127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fa0bc-7787-4b40-ac97-037091744c1f admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:55.782840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fa0bc-7787-4b40-ac97-037091744c1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:55.785103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fa0bc-7787-4b40-ac97-037091744c1f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:55.794920 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 695/1384] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:20:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:55.795707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed88be-18c6-48f4-944e-6767d0176da7 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:55.797331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ffed88be-18c6-48f4-944e-6767d0176da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:55.813490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed88be-18c6-48f4-944e-6767d0176da7 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:55.818842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f97a6-7a5d-40db-8969-b4b6806d58e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:55.819479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f97a6-7a5d-40db-8969-b4b6806d58e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:55.819828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f97a6-7a5d-40db-8969-b4b6806d58e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:55.830179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f97a6-7a5d-40db-8969-b4b6806d58e9 admin admin] PATH_INFO: `/v3/users/a032658e53dc4c119f3d0fd96087466c` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:55.830179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f97a6-7a5d-40db-8969-b4b6806d58e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a032658e53dc4c119f3d0fd96087466c)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:55.830179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f97a6-7a5d-40db-8969-b4b6806d58e9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:55.888824 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 690/1385] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:20:55 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:20:55.889542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fa0bc-7787-4b40-ac97-037091744c1f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:55.891697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-266fa0bc-7787-4b40-ac97-037091744c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:55.961689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fa0bc-7787-4b40-ac97-037091744c1f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:55.966967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551f841-ccd8-47e5-931c-043fb1f4c471 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:55.967575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551f841-ccd8-47e5-931c-043fb1f4c471 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:55.967864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551f841-ccd8-47e5-931c-043fb1f4c471 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:55.968136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551f841-ccd8-47e5-931c-043fb1f4c471 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:55.973394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:55.976909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551f841-ccd8-47e5-931c-043fb1f4c471 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:55.978618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551f841-ccd8-47e5-931c-043fb1f4c471 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:55.986549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9c1f97a6-7a5d-40db-8969-b4b6806d58e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a032658e53dc4c119f3d0fd96087466c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:55.988498 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 691/1386] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:20:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:20:55.989255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551f841-ccd8-47e5-931c-043fb1f4c471 service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:55.998872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9c1f97a6-7a5d-40db-8969-b4b6806d58e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a032658e53dc4c119f3d0fd96087466c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:56.014520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9c1f97a6-7a5d-40db-8969-b4b6806d58e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a032658e53dc4c119f3d0fd96087466c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:56.028027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9c1f97a6-7a5d-40db-8969-b4b6806d58e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a032658e53dc4c119f3d0fd96087466c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:56.028725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9c1f97a6-7a5d-40db-8969-b4b6806d58e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a032658e53dc4c119f3d0fd96087466c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:56.044652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:56.062666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551f841-ccd8-47e5-931c-043fb1f4c471 service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:56.067887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256a6b1-007d-4358-9a04-d906bb704b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:56.068500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256a6b1-007d-4358-9a04-d906bb704b64 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:56.068780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256a6b1-007d-4358-9a04-d906bb704b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:56.069058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256a6b1-007d-4358-9a04-d906bb704b64 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:56.069690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256a6b1-007d-4358-9a04-d906bb704b64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:56.071736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256a6b1-007d-4358-9a04-d906bb704b64 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:56.116493 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 696/1387] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:20:55 2022] DELETE /identity/v3/users/a032658e53dc4c119f3d0fd96087466c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:56.120929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf29133-8d95-4ed7-ba00-13898f501a91 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:56.121224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf29133-8d95-4ed7-ba00-13898f501a91 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:56.121503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf29133-8d95-4ed7-ba00-13898f501a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:56.134131 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 692/1388] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:20:55 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:56.147378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256a6b1-007d-4358-9a04-d906bb704b64 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:56.147639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-fcf29133-8d95-4ed7-ba00-13898f501a91 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:56.148874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fcf29133-8d95-4ed7-ba00-13898f501a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:56.149189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9256a6b1-007d-4358-9a04-d906bb704b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:56.161928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256a6b1-007d-4358-9a04-d906bb704b64 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:56.210828 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 697/1389] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:20:56.220357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf29133-8d95-4ed7-ba00-13898f501a91 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:56.221722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fcf29133-8d95-4ed7-ba00-13898f501a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:56.223435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296db16-9d09-4c6b-9fa7-53994d177dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:56.224078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296db16-9d09-4c6b-9fa7-53994d177dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:56.224360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296db16-9d09-4c6b-9fa7-53994d177dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:56.224674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296db16-9d09-4c6b-9fa7-53994d177dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:56.225316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296db16-9d09-4c6b-9fa7-53994d177dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:56.226948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296db16-9d09-4c6b-9fa7-53994d177dd4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:56.246314 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 693/1390] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:56.250848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296db16-9d09-4c6b-9fa7-53994d177dd4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:56.263766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296db16-9d09-4c6b-9fa7-53994d177dd4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:56.269881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5ef74-5bd4-4903-b2c2-03029e77c798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:56.270671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5ef74-5bd4-4903-b2c2-03029e77c798 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:56.271065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5ef74-5bd4-4903-b2c2-03029e77c798 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:56.271730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5ef74-5bd4-4903-b2c2-03029e77c798 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:56.272581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5ef74-5bd4-4903-b2c2-03029e77c798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:56.287861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5ef74-5bd4-4903-b2c2-03029e77c798 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:56.301963 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 694/1391] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:20:56.302934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5ef74-5bd4-4903-b2c2-03029e77c798 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:56.307691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6fd5ef74-5bd4-4903-b2c2-03029e77c798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:56.309041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf29133-8d95-4ed7-ba00-13898f501a91 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:56.317062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7e916-653e-4c83-992e-621276000966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:56.317802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7e916-653e-4c83-992e-621276000966 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:56.318792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7e916-653e-4c83-992e-621276000966 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:56.319082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7e916-653e-4c83-992e-621276000966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:56.322411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5ef74-5bd4-4903-b2c2-03029e77c798 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:56.327640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ec40f-19cb-4f7d-8e9a-7352aa18348e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:56.328271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ec40f-19cb-4f7d-8e9a-7352aa18348e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:56.328588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ec40f-19cb-4f7d-8e9a-7352aa18348e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:56.328867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ec40f-19cb-4f7d-8e9a-7352aa18348e admin admin] PATH_INFO: `/v3/users/dc460a978f40458d9aecdb7e776fe39a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:56.330101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ec40f-19cb-4f7d-8e9a-7352aa18348e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc460a978f40458d9aecdb7e776fe39a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:56.333224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ec40f-19cb-4f7d-8e9a-7352aa18348e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:56.340979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7e916-653e-4c83-992e-621276000966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:56.342494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7e916-653e-4c83-992e-621276000966 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:56.354176 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 698/1392] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:20:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:20:56.355391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7e916-653e-4c83-992e-621276000966 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:56.367379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7e916-653e-4c83-992e-621276000966 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:56.373192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc62ce-6c67-45f5-8f0d-075e6480a681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:56.374139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc62ce-6c67-45f5-8f0d-075e6480a681 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:56.374424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc62ce-6c67-45f5-8f0d-075e6480a681 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:56.374702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc62ce-6c67-45f5-8f0d-075e6480a681 admin admin] PATH_INFO: `/v3/projects/4e3631cc0e734c0cb0bff3519fdbe38d/users/ef1dfae2bc0f4c4a8a75ad5ebd7526d0/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:56.394513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc62ce-6c67-45f5-8f0d-075e6480a681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3631cc0e734c0cb0bff3519fdbe38d, user_id=ef1dfae2bc0f4c4a8a75ad5ebd7526d0, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:56.397711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc62ce-6c67-45f5-8f0d-075e6480a681 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:56.511798 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 699/1393] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:56 2022] PUT /identity/v3/projects/4e3631cc0e734c0cb0bff3519fdbe38d/users/ef1dfae2bc0f4c4a8a75ad5ebd7526d0/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:56.517733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04a8b3-66cd-4968-8ac4-a19292639d43 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:56.518238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04a8b3-66cd-4968-8ac4-a19292639d43 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:56.518653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04a8b3-66cd-4968-8ac4-a19292639d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:56.550218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-fa04a8b3-66cd-4968-8ac4-a19292639d43 None None] MFA Rules not processed for user `ef1dfae2bc0f4c4a8a75ad5ebd7526d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:56.551442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fa04a8b3-66cd-4968-8ac4-a19292639d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:56.568988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:56.571359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8b6ec40f-19cb-4f7d-8e9a-7352aa18348e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc460a978f40458d9aecdb7e776fe39a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:56.572175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8b6ec40f-19cb-4f7d-8e9a-7352aa18348e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc460a978f40458d9aecdb7e776fe39a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:56.580511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8b6ec40f-19cb-4f7d-8e9a-7352aa18348e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc460a978f40458d9aecdb7e776fe39a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:56.595281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8b6ec40f-19cb-4f7d-8e9a-7352aa18348e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc460a978f40458d9aecdb7e776fe39a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:56.618724 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 700/1394] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:20:56.623132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04a8b3-66cd-4968-8ac4-a19292639d43 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:56.624526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fa04a8b3-66cd-4968-8ac4-a19292639d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:56.687368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8b6ec40f-19cb-4f7d-8e9a-7352aa18348e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc460a978f40458d9aecdb7e776fe39a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:56.700516 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 695/1395] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:20:56 2022] DELETE /identity/v3/users/dc460a978f40458d9aecdb7e776fe39a => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:56.701501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ec40f-19cb-4f7d-8e9a-7352aa18348e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:56.703215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8b6ec40f-19cb-4f7d-8e9a-7352aa18348e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:56.708362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04a8b3-66cd-4968-8ac4-a19292639d43 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:56.745604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:56.776356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26059e57-8cee-48dd-8b98-fef531e6be58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:56.776968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26059e57-8cee-48dd-8b98-fef531e6be58 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:56.777249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26059e57-8cee-48dd-8b98-fef531e6be58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:56.777523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26059e57-8cee-48dd-8b98-fef531e6be58 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:56.778192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26059e57-8cee-48dd-8b98-fef531e6be58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:56.780137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26059e57-8cee-48dd-8b98-fef531e6be58 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:56.802626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ec40f-19cb-4f7d-8e9a-7352aa18348e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:56.808557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0c767-a5c4-451d-a749-720b4867d907 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:56.809193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0c767-a5c4-451d-a749-720b4867d907 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:56.809501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0c767-a5c4-451d-a749-720b4867d907 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:56.809790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0c767-a5c4-451d-a749-720b4867d907 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:56.811648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cce0c767-a5c4-451d-a749-720b4867d907 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:56.879343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0c767-a5c4-451d-a749-720b4867d907 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:56.881197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0c767-a5c4-451d-a749-720b4867d907 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:56.883094 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 701/1396] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:20:56 2022] POST /identity/v3/projects => generated 373 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:20:56.884710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40cb7a-1694-47c1-a525-381c8527ef05 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:56.885001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40cb7a-1694-47c1-a525-381c8527ef05 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:56.885471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40cb7a-1694-47c1-a525-381c8527ef05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:56.891756 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 696/1397] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:20:56 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:20:56.892599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0c767-a5c4-451d-a749-720b4867d907 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:56.893992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cce0c767-a5c4-451d-a749-720b4867d907 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:56.907714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0c767-a5c4-451d-a749-720b4867d907 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:56.910449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9c40cb7a-1694-47c1-a525-381c8527ef05 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:56.911708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9c40cb7a-1694-47c1-a525-381c8527ef05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:56.982212 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 702/1398] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:56.983485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cad15f-a5f5-46d0-9246-736b74a274f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:56.984249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cad15f-a5f5-46d0-9246-736b74a274f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:56.984661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cad15f-a5f5-46d0-9246-736b74a274f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:56.985004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cad15f-a5f5-46d0-9246-736b74a274f5 admin admin] PATH_INFO: `/v3/users/cd1f4c2336f240c8baf4d36005fd5e6a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:56.986276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cad15f-a5f5-46d0-9246-736b74a274f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd1f4c2336f240c8baf4d36005fd5e6a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:56.988505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cad15f-a5f5-46d0-9246-736b74a274f5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:56.988920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40cb7a-1694-47c1-a525-381c8527ef05 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:56.990366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9c40cb7a-1694-47c1-a525-381c8527ef05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:57.006018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40cb7a-1694-47c1-a525-381c8527ef05 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:57.013113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cb965-b000-4aac-8f54-e64134dd551a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:57.013828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cb965-b000-4aac-8f54-e64134dd551a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:57.014215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cb965-b000-4aac-8f54-e64134dd551a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:57.015229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cb965-b000-4aac-8f54-e64134dd551a admin admin] PATH_INFO: `/v3/projects/1707c15835fd4feea2c04085bf79c430` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:57.016389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cb965-b000-4aac-8f54-e64134dd551a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1707c15835fd4feea2c04085bf79c430)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:57.018489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cb965-b000-4aac-8f54-e64134dd551a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:57.202260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c13cb965-b000-4aac-8f54-e64134dd551a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1707c15835fd4feea2c04085bf79c430', 'request_id': 'req-c13cb965-b000-4aac-8f54-e64134dd551a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:57.204323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e4cad15f-a5f5-46d0-9246-736b74a274f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd1f4c2336f240c8baf4d36005fd5e6a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:57.205349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e4cad15f-a5f5-46d0-9246-736b74a274f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd1f4c2336f240c8baf4d36005fd5e6a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:57.209365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c13cb965-b000-4aac-8f54-e64134dd551a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1707c15835fd4feea2c04085bf79c430', 'request_id': 'req-c13cb965-b000-4aac-8f54-e64134dd551a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:57.212603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e4cad15f-a5f5-46d0-9246-736b74a274f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd1f4c2336f240c8baf4d36005fd5e6a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:57.222447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c13cb965-b000-4aac-8f54-e64134dd551a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1707c15835fd4feea2c04085bf79c430', 'request_id': 'req-c13cb965-b000-4aac-8f54-e64134dd551a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:57.232700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e4cad15f-a5f5-46d0-9246-736b74a274f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd1f4c2336f240c8baf4d36005fd5e6a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:57.296821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c13cb965-b000-4aac-8f54-e64134dd551a admin admin] The token cache is being invalidate because project 1707c15835fd4feea2c04085bf79c430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:20:57.297289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c13cb965-b000-4aac-8f54-e64134dd551a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:57.297961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c13cb965-b000-4aac-8f54-e64134dd551a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:57.299582 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 703/1399] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:20:56 2022] DELETE /identity/v3/projects/1707c15835fd4feea2c04085bf79c430 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:57.300264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cb965-b000-4aac-8f54-e64134dd551a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:57.303717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c13cb965-b000-4aac-8f54-e64134dd551a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:57.359908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e4cad15f-a5f5-46d0-9246-736b74a274f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd1f4c2336f240c8baf4d36005fd5e6a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:57.369788 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 697/1400] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:20:56 2022] DELETE /identity/v3/users/cd1f4c2336f240c8baf4d36005fd5e6a => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:57.372239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cad15f-a5f5-46d0-9246-736b74a274f5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:57.373365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cb965-b000-4aac-8f54-e64134dd551a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:57.374743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e4cad15f-a5f5-46d0-9246-736b74a274f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:57.447229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1100924-0c09-4c0b-9cb0-e7c608a18f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:57.447739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1100924-0c09-4c0b-9cb0-e7c608a18f8b admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:57.448139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1100924-0c09-4c0b-9cb0-e7c608a18f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:57.448505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1100924-0c09-4c0b-9cb0-e7c608a18f8b admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:57.449206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1100924-0c09-4c0b-9cb0-e7c608a18f8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:57.450453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cad15f-a5f5-46d0-9246-736b74a274f5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:57.453059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1100924-0c09-4c0b-9cb0-e7c608a18f8b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:57.459826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4ac42-bbeb-428e-b48c-a586694ef853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:57.459826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4ac42-bbeb-428e-b48c-a586694ef853 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:57.459826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4ac42-bbeb-428e-b48c-a586694ef853 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:57.459826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4ac42-bbeb-428e-b48c-a586694ef853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:57.460247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-99d4ac42-bbeb-428e-b48c-a586694ef853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:57.480009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4ac42-bbeb-428e-b48c-a586694ef853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:57.480009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4ac42-bbeb-428e-b48c-a586694ef853 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:57.480361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:57.486088 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 698/1401] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:20:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:20:57.486937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4ac42-bbeb-428e-b48c-a586694ef853 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:57.488280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-99d4ac42-bbeb-428e-b48c-a586694ef853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:57.561238 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 704/1402] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:20:57 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:57.564152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5bf45-9854-468b-a7f9-db1d0b0b56c0 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:57.564518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5bf45-9854-468b-a7f9-db1d0b0b56c0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:57.565187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5bf45-9854-468b-a7f9-db1d0b0b56c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:57.566941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4ac42-bbeb-428e-b48c-a586694ef853 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:57.572782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c60943-610a-4ada-824a-f085665cbcfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:57.573397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c60943-610a-4ada-824a-f085665cbcfc service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:57.573682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c60943-610a-4ada-824a-f085665cbcfc service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:57.573957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c60943-610a-4ada-824a-f085665cbcfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:57.575919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c0c60943-610a-4ada-824a-f085665cbcfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:57.585717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0bc5bf45-9854-468b-a7f9-db1d0b0b56c0 None None] MFA Rules not processed for user `015a9fcd508e4d20ad51dcb71053c28f`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:57.586958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0bc5bf45-9854-468b-a7f9-db1d0b0b56c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:57.643624 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 705/1403] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:57.649079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5bf45-9854-468b-a7f9-db1d0b0b56c0 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:57.649187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c60943-610a-4ada-824a-f085665cbcfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:57.649264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0bc5bf45-9854-468b-a7f9-db1d0b0b56c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:57.649331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c60943-610a-4ada-824a-f085665cbcfc service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:57.663762 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 699/1404] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:20:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:20:57.663904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07157a68-ae5f-4a49-bd12-fc531259141e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:57.664303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07157a68-ae5f-4a49-bd12-fc531259141e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:57.664445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07157a68-ae5f-4a49-bd12-fc531259141e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:57.679328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5bf45-9854-468b-a7f9-db1d0b0b56c0 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:57.684030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83807232-98f3-40e3-8fc3-e2452e58292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:57.684819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83807232-98f3-40e3-8fc3-e2452e58292d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:57.685123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83807232-98f3-40e3-8fc3-e2452e58292d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:57.685390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83807232-98f3-40e3-8fc3-e2452e58292d admin admin] PATH_INFO: `/v3/users/efb95cf93d744f9b9f498d46e691f85f` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:57.686585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83807232-98f3-40e3-8fc3-e2452e58292d admin admin] RBAC: Authorizing `identity:delete_user(user_id=efb95cf93d744f9b9f498d46e691f85f)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:57.689084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83807232-98f3-40e3-8fc3-e2452e58292d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:57.690263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-07157a68-ae5f-4a49-bd12-fc531259141e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:57.691578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-07157a68-ae5f-4a49-bd12-fc531259141e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:57.701858 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 700/1405] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:57.702985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07157a68-ae5f-4a49-bd12-fc531259141e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:57.735645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07157a68-ae5f-4a49-bd12-fc531259141e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:57.740836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844d8aa-1ecf-4461-8cd2-9184081c94f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:57.741537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844d8aa-1ecf-4461-8cd2-9184081c94f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:57.741817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844d8aa-1ecf-4461-8cd2-9184081c94f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:57.745344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844d8aa-1ecf-4461-8cd2-9184081c94f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:57.745344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844d8aa-1ecf-4461-8cd2-9184081c94f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:57.745344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844d8aa-1ecf-4461-8cd2-9184081c94f0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:57.755822 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 701/1406] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:57.756470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844d8aa-1ecf-4461-8cd2-9184081c94f0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:57.758268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f844d8aa-1ecf-4461-8cd2-9184081c94f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:57.773798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844d8aa-1ecf-4461-8cd2-9184081c94f0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:57.779259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a433e-9f44-47bb-bdd4-f757ed52c9f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:57.779853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a433e-9f44-47bb-bdd4-f757ed52c9f7 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:57.780165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a433e-9f44-47bb-bdd4-f757ed52c9f7 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:57.780401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a433e-9f44-47bb-bdd4-f757ed52c9f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:57.782178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5b4a433e-9f44-47bb-bdd4-f757ed52c9f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:57.792689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a433e-9f44-47bb-bdd4-f757ed52c9f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:57.794302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a433e-9f44-47bb-bdd4-f757ed52c9f7 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:57.804077 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 702/1407] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:20:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:20:57.804599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a433e-9f44-47bb-bdd4-f757ed52c9f7 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:57.805909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5b4a433e-9f44-47bb-bdd4-f757ed52c9f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:57.823803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a433e-9f44-47bb-bdd4-f757ed52c9f7 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:57.827884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b15ed-5144-44ff-b7fb-1dd5166a0186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:57.828535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b15ed-5144-44ff-b7fb-1dd5166a0186 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:57.828814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b15ed-5144-44ff-b7fb-1dd5166a0186 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:57.829090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b15ed-5144-44ff-b7fb-1dd5166a0186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:57.841463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b15ed-5144-44ff-b7fb-1dd5166a0186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:57.843717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b15ed-5144-44ff-b7fb-1dd5166a0186 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:57.862083 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 703/1408] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:20:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:20:57.863206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b15ed-5144-44ff-b7fb-1dd5166a0186 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:57.877278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b15ed-5144-44ff-b7fb-1dd5166a0186 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:57.890437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c46cc-4bac-4137-bf29-3cf626c5a624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:57.891462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c46cc-4bac-4137-bf29-3cf626c5a624 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:57.891745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c46cc-4bac-4137-bf29-3cf626c5a624 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:57.892021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c46cc-4bac-4137-bf29-3cf626c5a624 admin admin] PATH_INFO: `/v3/projects/ca6ccd2039fb423aaa00d68d1a8c564a/users/fd421e4662e744138204f259f4719ec6/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:57.907024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c46cc-4bac-4137-bf29-3cf626c5a624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca6ccd2039fb423aaa00d68d1a8c564a, user_id=fd421e4662e744138204f259f4719ec6, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:57.909700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c46cc-4bac-4137-bf29-3cf626c5a624 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:57.982619 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 704/1409] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:57 2022] PUT /identity/v3/projects/ca6ccd2039fb423aaa00d68d1a8c564a/users/fd421e4662e744138204f259f4719ec6/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:57.986115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c6c75-f577-463f-b840-14d80d738993 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:57.986115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c6c75-f577-463f-b840-14d80d738993 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:57.986115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c6c75-f577-463f-b840-14d80d738993 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:57.986605 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 705/1410] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:20:57.987323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c6c75-f577-463f-b840-14d80d738993 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:57.989010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-979c6c75-f577-463f-b840-14d80d738993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:57.997628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-83807232-98f3-40e3-8fc3-e2452e58292d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efb95cf93d744f9b9f498d46e691f85f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:57.998350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-83807232-98f3-40e3-8fc3-e2452e58292d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efb95cf93d744f9b9f498d46e691f85f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:58.021834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-83807232-98f3-40e3-8fc3-e2452e58292d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efb95cf93d744f9b9f498d46e691f85f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:58.036742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-83807232-98f3-40e3-8fc3-e2452e58292d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efb95cf93d744f9b9f498d46e691f85f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:58.037586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-83807232-98f3-40e3-8fc3-e2452e58292d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efb95cf93d744f9b9f498d46e691f85f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:58.070254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c6c75-f577-463f-b840-14d80d738993 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:58.070254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0dc93-d1df-4f2b-b092-c209b9b4d2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:58.070607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0dc93-d1df-4f2b-b092-c209b9b4d2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:58.070887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0dc93-d1df-4f2b-b092-c209b9b4d2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:58.071162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0dc93-d1df-4f2b-b092-c209b9b4d2b9 admin admin] PATH_INFO: `/v3/projects/c6c5229aafcb4483b4682cfbb5e03360` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:58.072291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0dc93-d1df-4f2b-b092-c209b9b4d2b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6c5229aafcb4483b4682cfbb5e03360)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:58.074217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0dc93-d1df-4f2b-b092-c209b9b4d2b9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:58.131557 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 706/1411] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:20:57 2022] DELETE /identity/v3/users/efb95cf93d744f9b9f498d46e691f85f => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:58.132611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83807232-98f3-40e3-8fc3-e2452e58292d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:58.134125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-83807232-98f3-40e3-8fc3-e2452e58292d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:58.149225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:58.215753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-87e0dc93-d1df-4f2b-b092-c209b9b4d2b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6c5229aafcb4483b4682cfbb5e03360', 'request_id': 'req-87e0dc93-d1df-4f2b-b092-c209b9b4d2b9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:58.239568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83807232-98f3-40e3-8fc3-e2452e58292d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:58.286155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-87e0dc93-d1df-4f2b-b092-c209b9b4d2b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6c5229aafcb4483b4682cfbb5e03360', 'request_id': 'req-87e0dc93-d1df-4f2b-b092-c209b9b4d2b9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:58.294614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-87e0dc93-d1df-4f2b-b092-c209b9b4d2b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6c5229aafcb4483b4682cfbb5e03360', 'request_id': 'req-87e0dc93-d1df-4f2b-b092-c209b9b4d2b9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:58.306423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5aa92-0b54-40bd-9951-f3a09ce14f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:58.307247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5aa92-0b54-40bd-9951-f3a09ce14f5c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:58.307425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5aa92-0b54-40bd-9951-f3a09ce14f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:58.307657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5aa92-0b54-40bd-9951-f3a09ce14f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:58.308874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5aa92-0b54-40bd-9951-f3a09ce14f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:58.310957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5aa92-0b54-40bd-9951-f3a09ce14f5c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:58.317625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-87e0dc93-d1df-4f2b-b092-c209b9b4d2b9 admin admin] The token cache is being invalidate because project c6c5229aafcb4483b4682cfbb5e03360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:20:58.317922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-87e0dc93-d1df-4f2b-b092-c209b9b4d2b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:58.320270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-87e0dc93-d1df-4f2b-b092-c209b9b4d2b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:58.323979 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 706/1412] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:20:57 2022] DELETE /identity/v3/projects/c6c5229aafcb4483b4682cfbb5e03360 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:58.326304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad286fc9-bc1b-4c21-904e-3f860482e87d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:58.326598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad286fc9-bc1b-4c21-904e-3f860482e87d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:58.327070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad286fc9-bc1b-4c21-904e-3f860482e87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:58.353369 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 707/1413] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:20:58.357177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5aa92-0b54-40bd-9951-f3a09ce14f5c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:58.364635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2ff5aa92-0b54-40bd-9951-f3a09ce14f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:58.388684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5aa92-0b54-40bd-9951-f3a09ce14f5c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:58.390833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ad286fc9-bc1b-4c21-904e-3f860482e87d None None] MFA Rules not processed for user `c20881251f2241a3a5ec2e5cf99db149`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:58.391690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:58.392052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ad286fc9-bc1b-4c21-904e-3f860482e87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:58.395910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92f994-5c0f-44fe-af3f-03f05c812a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:58.396683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92f994-5c0f-44fe-af3f-03f05c812a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:58.397081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92f994-5c0f-44fe-af3f-03f05c812a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:58.401533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92f994-5c0f-44fe-af3f-03f05c812a33 admin admin] PATH_INFO: `/v3/users/6bf04fca731149668789cbb0a9f95308` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:58.401533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92f994-5c0f-44fe-af3f-03f05c812a33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf04fca731149668789cbb0a9f95308)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:58.401533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92f994-5c0f-44fe-af3f-03f05c812a33 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:58.468589 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 707/1414] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:20:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:58.470274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad286fc9-bc1b-4c21-904e-3f860482e87d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:58.472390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ad286fc9-bc1b-4c21-904e-3f860482e87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:58.486942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad286fc9-bc1b-4c21-904e-3f860482e87d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:58.491520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008816ca-7ef9-4d7c-82b0-0b5b559a4da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:58.492205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008816ca-7ef9-4d7c-82b0-0b5b559a4da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:58.492481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008816ca-7ef9-4d7c-82b0-0b5b559a4da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:58.492750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008816ca-7ef9-4d7c-82b0-0b5b559a4da8 admin admin] PATH_INFO: `/v3/projects/ca6ccd2039fb423aaa00d68d1a8c564a/users/fd421e4662e744138204f259f4719ec6/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:58.494785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008816ca-7ef9-4d7c-82b0-0b5b559a4da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca6ccd2039fb423aaa00d68d1a8c564a, user_id=fd421e4662e744138204f259f4719ec6, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:58.497426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008816ca-7ef9-4d7c-82b0-0b5b559a4da8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:58.510601 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 708/1415] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:20:58 2022] PUT /identity/v3/projects/ca6ccd2039fb423aaa00d68d1a8c564a/users/fd421e4662e744138204f259f4719ec6/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:58.517960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008816ca-7ef9-4d7c-82b0-0b5b559a4da8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:58.519442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-008816ca-7ef9-4d7c-82b0-0b5b559a4da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:58.586218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008816ca-7ef9-4d7c-82b0-0b5b559a4da8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:58.590930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9be36-8546-4bac-9c23-458c945f3b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:58.591563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9be36-8546-4bac-9c23-458c945f3b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:58.591848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9be36-8546-4bac-9c23-458c945f3b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:58.592128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9be36-8546-4bac-9c23-458c945f3b08 admin admin] PATH_INFO: `/v3/projects/3c57cd10266e45f78f55210ba1bbb288` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:58.593243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e9be36-8546-4bac-9c23-458c945f3b08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c57cd10266e45f78f55210ba1bbb288)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:58.595853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e9be36-8546-4bac-9c23-458c945f3b08 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:58.671596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8f92f994-5c0f-44fe-af3f-03f05c812a33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf04fca731149668789cbb0a9f95308'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:58.672300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8f92f994-5c0f-44fe-af3f-03f05c812a33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf04fca731149668789cbb0a9f95308'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:58.680004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8f92f994-5c0f-44fe-af3f-03f05c812a33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf04fca731149668789cbb0a9f95308'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:58.699434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a3e9be36-8546-4bac-9c23-458c945f3b08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c57cd10266e45f78f55210ba1bbb288', 'request_id': 'req-a3e9be36-8546-4bac-9c23-458c945f3b08'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:58.709789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8f92f994-5c0f-44fe-af3f-03f05c812a33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf04fca731149668789cbb0a9f95308'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:58.709789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8f92f994-5c0f-44fe-af3f-03f05c812a33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf04fca731149668789cbb0a9f95308'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:58.742981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:58.759511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a3e9be36-8546-4bac-9c23-458c945f3b08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c57cd10266e45f78f55210ba1bbb288', 'request_id': 'req-a3e9be36-8546-4bac-9c23-458c945f3b08'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:58.767216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a3e9be36-8546-4bac-9c23-458c945f3b08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c57cd10266e45f78f55210ba1bbb288', 'request_id': 'req-a3e9be36-8546-4bac-9c23-458c945f3b08'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:58.783586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a3e9be36-8546-4bac-9c23-458c945f3b08 admin admin] The token cache is being invalidate because project 3c57cd10266e45f78f55210ba1bbb288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:20:58.784114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a3e9be36-8546-4bac-9c23-458c945f3b08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:58.784780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a3e9be36-8546-4bac-9c23-458c945f3b08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:58.786370 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 709/1416] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:20:58 2022] DELETE /identity/v3/projects/3c57cd10266e45f78f55210ba1bbb288 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:58.788953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9be36-8546-4bac-9c23-458c945f3b08 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:58.788953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a3e9be36-8546-4bac-9c23-458c945f3b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:58.811209 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 708/1417] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:20:58 2022] DELETE /identity/v3/users/6bf04fca731149668789cbb0a9f95308 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:58.812471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe800086-f8fe-45cf-9a28-374afecb3a4c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:58.812763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe800086-f8fe-45cf-9a28-374afecb3a4c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:58.813040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe800086-f8fe-45cf-9a28-374afecb3a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:58.853171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-fe800086-f8fe-45cf-9a28-374afecb3a4c None None] MFA Rules not processed for user `fd421e4662e744138204f259f4719ec6`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:58.854505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fe800086-f8fe-45cf-9a28-374afecb3a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:58.885107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9be36-8546-4bac-9c23-458c945f3b08 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:58.947367 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 709/1418] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:58.947367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe800086-f8fe-45cf-9a28-374afecb3a4c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:58.947367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fe800086-f8fe-45cf-9a28-374afecb3a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:58.957856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3a3fb-d04e-4862-ae87-1b1ad1e51546 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:58.958870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3a3fb-d04e-4862-ae87-1b1ad1e51546 service glance] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:58.959154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3a3fb-d04e-4862-ae87-1b1ad1e51546 service glance] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:58.959601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3a3fb-d04e-4862-ae87-1b1ad1e51546 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:58.961505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a1d3a3fb-d04e-4862-ae87-1b1ad1e51546 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:59.029449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe800086-f8fe-45cf-9a28-374afecb3a4c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:59.035239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ae1c4-0204-4d3e-bcfc-927abbab0e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:59.035922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ae1c4-0204-4d3e-bcfc-927abbab0e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:59.036210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ae1c4-0204-4d3e-bcfc-927abbab0e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:59.036491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ae1c4-0204-4d3e-bcfc-927abbab0e84 admin admin] PATH_INFO: `/v3/projects/71dd6a8eded64966aaf7adccc074dd90` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:59.037633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ae1c4-0204-4d3e-bcfc-927abbab0e84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71dd6a8eded64966aaf7adccc074dd90)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:59.039612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ae1c4-0204-4d3e-bcfc-927abbab0e84 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:59.082451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3a3fb-d04e-4862-ae87-1b1ad1e51546 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:59.083932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3a3fb-d04e-4862-ae87-1b1ad1e51546 service glance] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:59.092359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:59.095242 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 710/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:20:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:20:59.096198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3a3fb-d04e-4862-ae87-1b1ad1e51546 service glance] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:59.097616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a1d3a3fb-d04e-4862-ae87-1b1ad1e51546 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:59.110824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3a3fb-d04e-4862-ae87-1b1ad1e51546 service glance] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:59.116451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6ac9d-ce9f-416b-81d6-939a4dcb4385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:59.127685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6ac9d-ce9f-416b-81d6-939a4dcb4385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:59.127685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6ac9d-ce9f-416b-81d6-939a4dcb4385 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:59.127685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6ac9d-ce9f-416b-81d6-939a4dcb4385 admin admin] PATH_INFO: `/v3/users/77e84568cc2f49cd89a83a6258bad4b3` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:59.127685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6ac9d-ce9f-416b-81d6-939a4dcb4385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77e84568cc2f49cd89a83a6258bad4b3)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:59.127685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6ac9d-ce9f-416b-81d6-939a4dcb4385 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:59.191117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c06ae1c4-0204-4d3e-bcfc-927abbab0e84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71dd6a8eded64966aaf7adccc074dd90', 'request_id': 'req-c06ae1c4-0204-4d3e-bcfc-927abbab0e84'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:59.198259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c06ae1c4-0204-4d3e-bcfc-927abbab0e84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71dd6a8eded64966aaf7adccc074dd90', 'request_id': 'req-c06ae1c4-0204-4d3e-bcfc-927abbab0e84'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:59.204472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c06ae1c4-0204-4d3e-bcfc-927abbab0e84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71dd6a8eded64966aaf7adccc074dd90', 'request_id': 'req-c06ae1c4-0204-4d3e-bcfc-927abbab0e84'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:59.305154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c06ae1c4-0204-4d3e-bcfc-927abbab0e84 admin admin] The token cache is being invalidate because project 71dd6a8eded64966aaf7adccc074dd90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:20:59.305411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c06ae1c4-0204-4d3e-bcfc-927abbab0e84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:59.306292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c06ae1c4-0204-4d3e-bcfc-927abbab0e84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:59.311191 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 710/1420] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:20:58 2022] DELETE /identity/v3/projects/71dd6a8eded64966aaf7adccc074dd90 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:59.312215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ae1c4-0204-4d3e-bcfc-927abbab0e84 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:59.314297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c06ae1c4-0204-4d3e-bcfc-927abbab0e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:59.319144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-06d6ac9d-ce9f-416b-81d6-939a4dcb4385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77e84568cc2f49cd89a83a6258bad4b3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:59.320310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-06d6ac9d-ce9f-416b-81d6-939a4dcb4385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77e84568cc2f49cd89a83a6258bad4b3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:59.331348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-06d6ac9d-ce9f-416b-81d6-939a4dcb4385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77e84568cc2f49cd89a83a6258bad4b3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:59.344265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-06d6ac9d-ce9f-416b-81d6-939a4dcb4385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77e84568cc2f49cd89a83a6258bad4b3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:59.393453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ae1c4-0204-4d3e-bcfc-927abbab0e84 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:59.402243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6961f-6c7c-44a2-8b8c-16444abb0ced service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:59.402243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6961f-6c7c-44a2-8b8c-16444abb0ced service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:59.402243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6961f-6c7c-44a2-8b8c-16444abb0ced service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:59.402243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6961f-6c7c-44a2-8b8c-16444abb0ced service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:59.402801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-14f6961f-6c7c-44a2-8b8c-16444abb0ced service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:59.423430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-06d6ac9d-ce9f-416b-81d6-939a4dcb4385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77e84568cc2f49cd89a83a6258bad4b3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:59.430892 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 711/1421] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:20:59 2022] DELETE /identity/v3/users/77e84568cc2f49cd89a83a6258bad4b3 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:59.431987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6ac9d-ce9f-416b-81d6-939a4dcb4385 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:59.433423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-06d6ac9d-ce9f-416b-81d6-939a4dcb4385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:59.457970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:59.486796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6961f-6c7c-44a2-8b8c-16444abb0ced service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:59.489115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6961f-6c7c-44a2-8b8c-16444abb0ced service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:59.504571 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 711/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:20:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:20:59.505905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6feae-0a80-4688-8882-815e0f1605e5 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:59.506291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6feae-0a80-4688-8882-815e0f1605e5 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:59.506649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6feae-0a80-4688-8882-815e0f1605e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:59.530763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6ac9d-ce9f-416b-81d6-939a4dcb4385 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:59.538951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8cc6feae-0a80-4688-8882-815e0f1605e5 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:59.541308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8cc6feae-0a80-4688-8882-815e0f1605e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:59.543667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a76618-151a-4b79-8611-eb8a29ae280f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:59.544377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a76618-151a-4b79-8611-eb8a29ae280f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:59.544660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a76618-151a-4b79-8611-eb8a29ae280f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:59.544934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a76618-151a-4b79-8611-eb8a29ae280f admin admin] PATH_INFO: `/v3/projects/4831ce886e7c4091b56092a48227f755` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:59.547777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a76618-151a-4b79-8611-eb8a29ae280f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4831ce886e7c4091b56092a48227f755)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:59.551151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a76618-151a-4b79-8611-eb8a29ae280f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:59.554683 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 712/1423] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:20:59.571380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21396386-ba3b-44b7-948e-a8f4470f6205 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:59.571665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21396386-ba3b-44b7-948e-a8f4470f6205 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:59.571941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21396386-ba3b-44b7-948e-a8f4470f6205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:59.602438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-21396386-ba3b-44b7-948e-a8f4470f6205 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:59.604245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-21396386-ba3b-44b7-948e-a8f4470f6205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:59.616527 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 713/1424] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:20:59.621828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21396386-ba3b-44b7-948e-a8f4470f6205 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:59.644046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21396386-ba3b-44b7-948e-a8f4470f6205 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:59.663099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839c1d9-8cb8-4c8d-9c43-92170c291e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:59.666494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839c1d9-8cb8-4c8d-9c43-92170c291e90 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:59.666494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839c1d9-8cb8-4c8d-9c43-92170c291e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:59.666494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839c1d9-8cb8-4c8d-9c43-92170c291e90 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:59.668120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839c1d9-8cb8-4c8d-9c43-92170c291e90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:20:59.668855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839c1d9-8cb8-4c8d-9c43-92170c291e90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:59.676960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839c1d9-8cb8-4c8d-9c43-92170c291e90 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:59.705460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e4a76618-151a-4b79-8611-eb8a29ae280f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4831ce886e7c4091b56092a48227f755', 'request_id': 'req-e4a76618-151a-4b79-8611-eb8a29ae280f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:59.705798 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 714/1425] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:20:59.707018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839c1d9-8cb8-4c8d-9c43-92170c291e90 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:59.722603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839c1d9-8cb8-4c8d-9c43-92170c291e90 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:59.783071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e4a76618-151a-4b79-8611-eb8a29ae280f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4831ce886e7c4091b56092a48227f755', 'request_id': 'req-e4a76618-151a-4b79-8611-eb8a29ae280f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:59.790491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e4a76618-151a-4b79-8611-eb8a29ae280f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4831ce886e7c4091b56092a48227f755', 'request_id': 'req-e4a76618-151a-4b79-8611-eb8a29ae280f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:59.799215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c9686-2aff-4bf1-b4de-c7d6a70413ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:20:59.799832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c9686-2aff-4bf1-b4de-c7d6a70413ff admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:59.800210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c9686-2aff-4bf1-b4de-c7d6a70413ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:59.800587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c9686-2aff-4bf1-b4de-c7d6a70413ff admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:59.801340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c9686-2aff-4bf1-b4de-c7d6a70413ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:20:59.803355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c9686-2aff-4bf1-b4de-c7d6a70413ff admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:20:59.803756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e4a76618-151a-4b79-8611-eb8a29ae280f admin admin] The token cache is being invalidate because project 4831ce886e7c4091b56092a48227f755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:20:59.804291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e4a76618-151a-4b79-8611-eb8a29ae280f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:59.805007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e4a76618-151a-4b79-8611-eb8a29ae280f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:20:59.806804 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 712/1426] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:20:59 2022] DELETE /identity/v3/projects/4831ce886e7c4091b56092a48227f755 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:20:59.808130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7363c-b4e3-489b-8f71-2d7e2fd3bd7a None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:59.808593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7363c-b4e3-489b-8f71-2d7e2fd3bd7a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:59.808975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7363c-b4e3-489b-8f71-2d7e2fd3bd7a None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:59.810992 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 713/1427] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:20:59.811792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7363c-b4e3-489b-8f71-2d7e2fd3bd7a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:20:59.813569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-65b7363c-b4e3-489b-8f71-2d7e2fd3bd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:20:59.923764 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 715/1428] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:20:59 2022] POST /identity/v3/projects => generated 387 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:20:59.929023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8504d32-e0e5-433f-a262-21c772c706d4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:20:59.929154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7363c-b4e3-489b-8f71-2d7e2fd3bd7a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:20:59.929398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8504d32-e0e5-433f-a262-21c772c706d4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:20:59.929687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8504d32-e0e5-433f-a262-21c772c706d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:20:59.938676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:59.955284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c8504d32-e0e5-433f-a262-21c772c706d4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:20:59.956512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c8504d32-e0e5-433f-a262-21c772c706d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:00.012538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd725368-8916-4101-aa43-48fc2ba1efae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:00.013425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd725368-8916-4101-aa43-48fc2ba1efae service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:00.013712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd725368-8916-4101-aa43-48fc2ba1efae service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:00.013987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd725368-8916-4101-aa43-48fc2ba1efae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:00.016333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bd725368-8916-4101-aa43-48fc2ba1efae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:00.028045 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 716/1429] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:00.029581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e07fe-76e7-4661-88b8-21480fe0a2cc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:00.030083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e07fe-76e7-4661-88b8-21480fe0a2cc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:00.030373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e07fe-76e7-4661-88b8-21480fe0a2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:00.035257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd725368-8916-4101-aa43-48fc2ba1efae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:00.037286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd725368-8916-4101-aa43-48fc2ba1efae service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:00.048530 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 714/1430] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:20:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:00.049396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd725368-8916-4101-aa43-48fc2ba1efae service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:00.053166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bd725368-8916-4101-aa43-48fc2ba1efae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:00.053277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-632e07fe-76e7-4661-88b8-21480fe0a2cc None None] MFA Rules not processed for user `c20881251f2241a3a5ec2e5cf99db149`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:00.053277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-632e07fe-76e7-4661-88b8-21480fe0a2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:00.064534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd725368-8916-4101-aa43-48fc2ba1efae service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:00.070138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45bb54-097a-41ba-89b4-27ab293a2709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:00.070926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45bb54-097a-41ba-89b4-27ab293a2709 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:00.071270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45bb54-097a-41ba-89b4-27ab293a2709 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:00.071633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45bb54-097a-41ba-89b4-27ab293a2709 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:00.072431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45bb54-097a-41ba-89b4-27ab293a2709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:00.074672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45bb54-097a-41ba-89b4-27ab293a2709 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:00.131216 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 717/1431] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:21:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:00.131873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1886453-2dc9-4521-9307-0c4e67bf92c1 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:00.132168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1886453-2dc9-4521-9307-0c4e67bf92c1 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:00.132446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1886453-2dc9-4521-9307-0c4e67bf92c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:00.157062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c1886453-2dc9-4521-9307-0c4e67bf92c1 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:00.157062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c1886453-2dc9-4521-9307-0c4e67bf92c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:00.164883 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 718/1432] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:00.165882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1886453-2dc9-4521-9307-0c4e67bf92c1 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:00.168250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c1886453-2dc9-4521-9307-0c4e67bf92c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:00.183472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1886453-2dc9-4521-9307-0c4e67bf92c1 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:00.194870 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 715/1433] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:00 2022] POST /identity/v3/users => generated 294 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:00.195644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45bb54-097a-41ba-89b4-27ab293a2709 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:00.198478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8e45bb54-097a-41ba-89b4-27ab293a2709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:00.204342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e6ba8-c368-4ccd-b3ab-0d801edf2d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:00.204996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e6ba8-c368-4ccd-b3ab-0d801edf2d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:00.205371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e6ba8-c368-4ccd-b3ab-0d801edf2d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:00.205546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e6ba8-c368-4ccd-b3ab-0d801edf2d68 admin admin] PATH_INFO: `/v3/projects/c4036e5ce7a04f9ab7acb32521ddf233` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:00.208692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e6ba8-c368-4ccd-b3ab-0d801edf2d68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4036e5ce7a04f9ab7acb32521ddf233)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:00.210835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e6ba8-c368-4ccd-b3ab-0d801edf2d68 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:00.266455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45bb54-097a-41ba-89b4-27ab293a2709 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:00.270428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4aa87-9653-4b8a-9065-06a01ec75693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:00.271040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4aa87-9653-4b8a-9065-06a01ec75693 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:00.271905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4aa87-9653-4b8a-9065-06a01ec75693 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:00.271905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4aa87-9653-4b8a-9065-06a01ec75693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:00.285845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4aa87-9653-4b8a-9065-06a01ec75693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:00.287345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4aa87-9653-4b8a-9065-06a01ec75693 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:00.303939 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 716/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:00.303939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4aa87-9653-4b8a-9065-06a01ec75693 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:00.310237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4aa87-9653-4b8a-9065-06a01ec75693 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:00.315083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6c3f6-62b0-45d7-a630-2fd0f5a7f29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:00.315691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6c3f6-62b0-45d7-a630-2fd0f5a7f29e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:00.315977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6c3f6-62b0-45d7-a630-2fd0f5a7f29e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:00.316260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6c3f6-62b0-45d7-a630-2fd0f5a7f29e admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:00.316905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6c3f6-62b0-45d7-a630-2fd0f5a7f29e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:21:00.317268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6c3f6-62b0-45d7-a630-2fd0f5a7f29e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:00.319020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6c3f6-62b0-45d7-a630-2fd0f5a7f29e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:00.331761 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 717/1435] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:21:00.332639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6c3f6-62b0-45d7-a630-2fd0f5a7f29e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:00.344973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6c3f6-62b0-45d7-a630-2fd0f5a7f29e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:00.349829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fe65f-fca6-449e-8bc5-2bf3a94df43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:00.350466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fe65f-fca6-449e-8bc5-2bf3a94df43f admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:00.350752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fe65f-fca6-449e-8bc5-2bf3a94df43f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:00.351036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fe65f-fca6-449e-8bc5-2bf3a94df43f admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:00.351684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fe65f-fca6-449e-8bc5-2bf3a94df43f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:00.353406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fe65f-fca6-449e-8bc5-2bf3a94df43f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:00.366295 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 718/1436] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:00.368857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fe65f-fca6-449e-8bc5-2bf3a94df43f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:00.377535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-577e6ba8-c368-4ccd-b3ab-0d801edf2d68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4036e5ce7a04f9ab7acb32521ddf233', 'request_id': 'req-577e6ba8-c368-4ccd-b3ab-0d801edf2d68'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:00.383354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fe65f-fca6-449e-8bc5-2bf3a94df43f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:00.391596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-577e6ba8-c368-4ccd-b3ab-0d801edf2d68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4036e5ce7a04f9ab7acb32521ddf233', 'request_id': 'req-577e6ba8-c368-4ccd-b3ab-0d801edf2d68'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:00.397961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-577e6ba8-c368-4ccd-b3ab-0d801edf2d68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4036e5ce7a04f9ab7acb32521ddf233', 'request_id': 'req-577e6ba8-c368-4ccd-b3ab-0d801edf2d68'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:00.445763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9538d-31aa-4281-bba3-e51415dd5c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:00.446341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9538d-31aa-4281-bba3-e51415dd5c4c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:00.446603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9538d-31aa-4281-bba3-e51415dd5c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:00.446880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9538d-31aa-4281-bba3-e51415dd5c4c admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:00.447512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9538d-31aa-4281-bba3-e51415dd5c4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:00.449431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9538d-31aa-4281-bba3-e51415dd5c4c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:00.473242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-577e6ba8-c368-4ccd-b3ab-0d801edf2d68 admin admin] The token cache is being invalidate because project c4036e5ce7a04f9ab7acb32521ddf233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:00.476767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-577e6ba8-c368-4ccd-b3ab-0d801edf2d68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:00.476767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-577e6ba8-c368-4ccd-b3ab-0d801edf2d68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:00.476767 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 719/1437] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:00 2022] DELETE /identity/v3/projects/c4036e5ce7a04f9ab7acb32521ddf233 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:00.476767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e6ba8-c368-4ccd-b3ab-0d801edf2d68 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:00.481084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-577e6ba8-c368-4ccd-b3ab-0d801edf2d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:00.494228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e6ba8-c368-4ccd-b3ab-0d801edf2d68 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:00.499052 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e0baa-3e77-4c19-9dc7-aebc8b673303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:00.499804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e0baa-3e77-4c19-9dc7-aebc8b673303 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:00.500602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e0baa-3e77-4c19-9dc7-aebc8b673303 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:00.500884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e0baa-3e77-4c19-9dc7-aebc8b673303 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:00.501552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e0baa-3e77-4c19-9dc7-aebc8b673303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:00.503192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e0baa-3e77-4c19-9dc7-aebc8b673303 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:00.513475 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 720/1438] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:00.514643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb8e07-d220-4ed2-933e-af217244fb23 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:00.515004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb8e07-d220-4ed2-933e-af217244fb23 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:00.515191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb8e07-d220-4ed2-933e-af217244fb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:00.541543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e4eb8e07-d220-4ed2-933e-af217244fb23 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:00.542779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e4eb8e07-d220-4ed2-933e-af217244fb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:00.550232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:00.551049 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 721/1439] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:00.551827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb8e07-d220-4ed2-933e-af217244fb23 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:00.561070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb8e07-d220-4ed2-933e-af217244fb23 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:00.565710 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 719/1440] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:00 2022] POST /identity/v3/projects => generated 393 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:00.566961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ede3a0-24ac-4f52-9225-1363a7ec9bcf None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:00.567254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ede3a0-24ac-4f52-9225-1363a7ec9bcf None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:00.567536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ede3a0-24ac-4f52-9225-1363a7ec9bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:00.569207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70271487-d6e5-44db-a743-a0b7bc77c4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:00.569868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70271487-d6e5-44db-a743-a0b7bc77c4b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:00.570180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70271487-d6e5-44db-a743-a0b7bc77c4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:00.570462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70271487-d6e5-44db-a743-a0b7bc77c4b1 admin admin] PATH_INFO: `/v3/projects/ac1da8ce26ab49ddae972233777c4c55/users/ff070c0383324e1da5c49e3d9c652516/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:00.585759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70271487-d6e5-44db-a743-a0b7bc77c4b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1da8ce26ab49ddae972233777c4c55, user_id=ff070c0383324e1da5c49e3d9c652516, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:00.587243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e1ede3a0-24ac-4f52-9225-1363a7ec9bcf None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:00.588471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70271487-d6e5-44db-a743-a0b7bc77c4b1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:00.588567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e1ede3a0-24ac-4f52-9225-1363a7ec9bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:00.650096 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 720/1441] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:00.651090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ede3a0-24ac-4f52-9225-1363a7ec9bcf None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:00.652657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e1ede3a0-24ac-4f52-9225-1363a7ec9bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:00.666913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ede3a0-24ac-4f52-9225-1363a7ec9bcf None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:00.671566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d13f0b-473d-4487-96e5-1fab4eaf86d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:00.672232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d13f0b-473d-4487-96e5-1fab4eaf86d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:00.672513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d13f0b-473d-4487-96e5-1fab4eaf86d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:00.672787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d13f0b-473d-4487-96e5-1fab4eaf86d3 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:00.673446 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d13f0b-473d-4487-96e5-1fab4eaf86d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:00.675402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d13f0b-473d-4487-96e5-1fab4eaf86d3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:00.686438 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 722/1442] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:00 2022] PUT /identity/v3/projects/ac1da8ce26ab49ddae972233777c4c55/users/ff070c0383324e1da5c49e3d9c652516/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:00.687354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70271487-d6e5-44db-a743-a0b7bc77c4b1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:00.748639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70271487-d6e5-44db-a743-a0b7bc77c4b1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:00.753945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba0b3a-0017-44d8-ac07-c4ff1b393f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:00.754583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba0b3a-0017-44d8-ac07-c4ff1b393f2c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:00.754865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba0b3a-0017-44d8-ac07-c4ff1b393f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:00.755141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba0b3a-0017-44d8-ac07-c4ff1b393f2c admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:00.755788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba0b3a-0017-44d8-ac07-c4ff1b393f2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:21:00.756095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba0b3a-0017-44d8-ac07-c4ff1b393f2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:00.757830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba0b3a-0017-44d8-ac07-c4ff1b393f2c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:00.773844 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 723/1443] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:21:00.773844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64592b2-b105-4f38-895e-9660c90d4c82 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:00.773844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64592b2-b105-4f38-895e-9660c90d4c82 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:00.773844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64592b2-b105-4f38-895e-9660c90d4c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:00.782873 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 721/1444] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:00 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:00.783999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d13f0b-473d-4487-96e5-1fab4eaf86d3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:00.798447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d13f0b-473d-4487-96e5-1fab4eaf86d3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:00.811831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f64592b2-b105-4f38-895e-9660c90d4c82 None None] MFA Rules not processed for user `ff070c0383324e1da5c49e3d9c652516`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:00.814843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f64592b2-b105-4f38-895e-9660c90d4c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:00.814965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50902f03-e344-42a3-8341-d6f628c613df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:00.815598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50902f03-e344-42a3-8341-d6f628c613df admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:00.815887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50902f03-e344-42a3-8341-d6f628c613df admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:00.816166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50902f03-e344-42a3-8341-d6f628c613df admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:00.816812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50902f03-e344-42a3-8341-d6f628c613df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:00.819015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50902f03-e344-42a3-8341-d6f628c613df admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:00.884048 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 724/1445] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:00.884908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64592b2-b105-4f38-895e-9660c90d4c82 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:00.895254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64592b2-b105-4f38-895e-9660c90d4c82 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:00.899828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c61798-fdeb-448c-ab98-07fbd97a24fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:00.900428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c61798-fdeb-448c-ab98-07fbd97a24fa admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:00.900715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c61798-fdeb-448c-ab98-07fbd97a24fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:00.900993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c61798-fdeb-448c-ab98-07fbd97a24fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:00.901641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c61798-fdeb-448c-ab98-07fbd97a24fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:00.903282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c61798-fdeb-448c-ab98-07fbd97a24fa admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:00.912905 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 725/1446] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:00.913686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c61798-fdeb-448c-ab98-07fbd97a24fa admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:00.915305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-60c61798-fdeb-448c-ab98-07fbd97a24fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:00.927521 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 722/1447] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:00 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:00.928059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c61798-fdeb-448c-ab98-07fbd97a24fa admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:00.928711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50902f03-e344-42a3-8341-d6f628c613df admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:00.943915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:00.994374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a8186-b21d-496c-b582-5215cd17ed4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:00.995099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a8186-b21d-496c-b582-5215cd17ed4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:00.995366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a8186-b21d-496c-b582-5215cd17ed4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:00.995642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a8186-b21d-496c-b582-5215cd17ed4a admin admin] PATH_INFO: `/v3/users/5fe38379160246da8a176b544646ce6d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:00.995938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50902f03-e344-42a3-8341-d6f628c613df admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:00.996793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a8186-b21d-496c-b582-5215cd17ed4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fe38379160246da8a176b544646ce6d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:00.998810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a8186-b21d-496c-b582-5215cd17ed4a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:01.001794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73b997-f600-4dd0-9420-163b72c471c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:01.002438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73b997-f600-4dd0-9420-163b72c471c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:01.002720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73b997-f600-4dd0-9420-163b72c471c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:01.002989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73b997-f600-4dd0-9420-163b72c471c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:01.003614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f73b997-f600-4dd0-9420-163b72c471c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:01.005619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f73b997-f600-4dd0-9420-163b72c471c7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:01.096386 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 723/1448] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:00 2022] POST /identity/v3/projects => generated 389 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:01.096386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73b997-f600-4dd0-9420-163b72c471c7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:01.153648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73b997-f600-4dd0-9420-163b72c471c7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:01.158937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479067ee-45cf-436c-af31-d29f5e0b2c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:01.159529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479067ee-45cf-436c-af31-d29f5e0b2c9c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:01.159808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479067ee-45cf-436c-af31-d29f5e0b2c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:01.160080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479067ee-45cf-436c-af31-d29f5e0b2c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:01.160715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479067ee-45cf-436c-af31-d29f5e0b2c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:01.162336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479067ee-45cf-436c-af31-d29f5e0b2c9c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:01.171959 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 724/1449] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:01.173221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479067ee-45cf-436c-af31-d29f5e0b2c9c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:01.183326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479067ee-45cf-436c-af31-d29f5e0b2c9c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:01.191049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb366c-e596-4c00-99fd-e5a030904201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:01.196290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb366c-e596-4c00-99fd-e5a030904201 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:01.196290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb366c-e596-4c00-99fd-e5a030904201 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:01.196290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb366c-e596-4c00-99fd-e5a030904201 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:01.196290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb366c-e596-4c00-99fd-e5a030904201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:01.196569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5e4a8186-b21d-496c-b582-5215cd17ed4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fe38379160246da8a176b544646ce6d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:01.197385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5e4a8186-b21d-496c-b582-5215cd17ed4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fe38379160246da8a176b544646ce6d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:01.198244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb366c-e596-4c00-99fd-e5a030904201 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:01.205508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5e4a8186-b21d-496c-b582-5215cd17ed4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fe38379160246da8a176b544646ce6d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:01.219558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5e4a8186-b21d-496c-b582-5215cd17ed4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fe38379160246da8a176b544646ce6d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:01.220307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5e4a8186-b21d-496c-b582-5215cd17ed4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fe38379160246da8a176b544646ce6d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:01.245791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:01.280063 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 725/1450] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:01 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:01.280822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb366c-e596-4c00-99fd-e5a030904201 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:01.282965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3abb366c-e596-4c00-99fd-e5a030904201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:01.295136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb366c-e596-4c00-99fd-e5a030904201 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:01.300375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302aad53-7b8d-4059-a356-d98fa9c9151a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:01.301053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302aad53-7b8d-4059-a356-d98fa9c9151a admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:01.301336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302aad53-7b8d-4059-a356-d98fa9c9151a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:01.301617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302aad53-7b8d-4059-a356-d98fa9c9151a admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:01.302269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302aad53-7b8d-4059-a356-d98fa9c9151a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:01.304219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302aad53-7b8d-4059-a356-d98fa9c9151a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:01.320547 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 726/1451] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:00 2022] DELETE /identity/v3/users/5fe38379160246da8a176b544646ce6d => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:01.321507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a8186-b21d-496c-b582-5215cd17ed4a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:01.322867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5e4a8186-b21d-496c-b582-5215cd17ed4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:01.386629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a8186-b21d-496c-b582-5215cd17ed4a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:01.392119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfb7ce-09a6-47eb-a51e-0c276b3402b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:01.392784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfb7ce-09a6-47eb-a51e-0c276b3402b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:01.393067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfb7ce-09a6-47eb-a51e-0c276b3402b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:01.393340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfb7ce-09a6-47eb-a51e-0c276b3402b5 admin admin] PATH_INFO: `/v3/projects/1fd60901a706424fb5762496265a699a/users/a1db1df695924749bb228f88e05886c0/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:01.408566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfb7ce-09a6-47eb-a51e-0c276b3402b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fd60901a706424fb5762496265a699a, user_id=a1db1df695924749bb228f88e05886c0, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:01.411285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfb7ce-09a6-47eb-a51e-0c276b3402b5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:01.426992 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 726/1452] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:01 2022] POST /identity/v3/users => generated 301 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:01.426992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302aad53-7b8d-4059-a356-d98fa9c9151a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:01.426992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-302aad53-7b8d-4059-a356-d98fa9c9151a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:01.439867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302aad53-7b8d-4059-a356-d98fa9c9151a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:01.444912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d734f2-6489-473f-9d95-3ab84c885315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:01.445525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d734f2-6489-473f-9d95-3ab84c885315 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:01.445807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d734f2-6489-473f-9d95-3ab84c885315 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:01.446459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d734f2-6489-473f-9d95-3ab84c885315 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:01.446858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d734f2-6489-473f-9d95-3ab84c885315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:01.448348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d734f2-6489-473f-9d95-3ab84c885315 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:01.452116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:01.460019 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 727/1453] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:01.464203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e5b5a-26d3-4c39-99c7-33c69eb2b63f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:01.464494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e5b5a-26d3-4c39-99c7-33c69eb2b63f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:01.464773 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e5b5a-26d3-4c39-99c7-33c69eb2b63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:01.480467 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 727/1454] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:01 2022] PUT /identity/v3/projects/1fd60901a706424fb5762496265a699a/users/a1db1df695924749bb228f88e05886c0/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:01.481307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfb7ce-09a6-47eb-a51e-0c276b3402b5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:01.486879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-7d9e5b5a-26d3-4c39-99c7-33c69eb2b63f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:01.488228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7d9e5b5a-26d3-4c39-99c7-33c69eb2b63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:01.559135 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 728/1455] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:01.559802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfb7ce-09a6-47eb-a51e-0c276b3402b5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:01.560316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e5b5a-26d3-4c39-99c7-33c69eb2b63f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:01.567900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba237f-06c6-4c6d-83a7-7085563e9d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:01.568626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba237f-06c6-4c6d-83a7-7085563e9d0a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:01.569042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba237f-06c6-4c6d-83a7-7085563e9d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:01.569321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba237f-06c6-4c6d-83a7-7085563e9d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:01.569974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba237f-06c6-4c6d-83a7-7085563e9d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:01.570854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e5b5a-26d3-4c39-99c7-33c69eb2b63f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:01.571746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba237f-06c6-4c6d-83a7-7085563e9d0a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:01.575810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd3279-4df1-457e-b4eb-820aaadba830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:01.576479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd3279-4df1-457e-b4eb-820aaadba830 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:01.576837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd3279-4df1-457e-b4eb-820aaadba830 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:01.577188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd3279-4df1-457e-b4eb-820aaadba830 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:01.577852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd3279-4df1-457e-b4eb-820aaadba830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:01.579519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd3279-4df1-457e-b4eb-820aaadba830 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:01.582284 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 728/1456] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:01.583483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cf57a-fd9d-4b0d-9e69-35a363344e4b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:01.583767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cf57a-fd9d-4b0d-9e69-35a363344e4b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:01.584045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cf57a-fd9d-4b0d-9e69-35a363344e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:01.589820 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 729/1457] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:01.590769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd3279-4df1-457e-b4eb-820aaadba830 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:01.592975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8dcd3279-4df1-457e-b4eb-820aaadba830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:01.612399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-bc5cf57a-fd9d-4b0d-9e69-35a363344e4b None None] MFA Rules not processed for user `a1db1df695924749bb228f88e05886c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:01.613630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bc5cf57a-fd9d-4b0d-9e69-35a363344e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:01.652913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd3279-4df1-457e-b4eb-820aaadba830 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:01.657835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e65e40-c35c-42d9-af41-118800afc4ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:01.658550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e65e40-c35c-42d9-af41-118800afc4ce service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:01.661567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e65e40-c35c-42d9-af41-118800afc4ce service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:01.661567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e65e40-c35c-42d9-af41-118800afc4ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:01.672120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e65e40-c35c-42d9-af41-118800afc4ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:01.673814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e65e40-c35c-42d9-af41-118800afc4ce service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:01.683614 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 730/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:01.684823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e65e40-c35c-42d9-af41-118800afc4ce service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:01.690148 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 729/1459] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:01.690148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5cf57a-fd9d-4b0d-9e69-35a363344e4b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:01.694475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e65e40-c35c-42d9-af41-118800afc4ce service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:01.699416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd86a86-d831-4590-934b-762531f6da13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:01.702505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd86a86-d831-4590-934b-762531f6da13 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:01.702505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd86a86-d831-4590-934b-762531f6da13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:01.702505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd86a86-d831-4590-934b-762531f6da13 admin admin] PATH_INFO: `/v3/projects/a17f16c286a44f31b5c4ac8ae77b4f16/users/852d4b8d85264eb591321670b14dd62c/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:01.702743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5cf57a-fd9d-4b0d-9e69-35a363344e4b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:01.709377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba982d-a54d-4a51-94c9-6c7d8241c454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:01.710223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba982d-a54d-4a51-94c9-6c7d8241c454 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:01.710609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba982d-a54d-4a51-94c9-6c7d8241c454 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:01.710988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba982d-a54d-4a51-94c9-6c7d8241c454 admin admin] PATH_INFO: `/v3/projects/495904ebaf5c4b09bf06f58ec938a680/users/8413dddbee5e4f26a256aa429bc036af/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:01.722320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd86a86-d831-4590-934b-762531f6da13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a17f16c286a44f31b5c4ac8ae77b4f16, user_id=852d4b8d85264eb591321670b14dd62c, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:01.725584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd86a86-d831-4590-934b-762531f6da13 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:01.729682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:01.730531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba982d-a54d-4a51-94c9-6c7d8241c454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=495904ebaf5c4b09bf06f58ec938a680, user_id=8413dddbee5e4f26a256aa429bc036af, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:01.733269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba982d-a54d-4a51-94c9-6c7d8241c454 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:01.819081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:01.824874 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 731/1460] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:01 2022] PUT /identity/v3/projects/a17f16c286a44f31b5c4ac8ae77b4f16/users/852d4b8d85264eb591321670b14dd62c/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:01.825790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd86a86-d831-4590-934b-762531f6da13 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:01.828009 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 730/1461] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:01 2022] PUT /identity/v3/projects/495904ebaf5c4b09bf06f58ec938a680/users/8413dddbee5e4f26a256aa429bc036af/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:01.829520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba982d-a54d-4a51-94c9-6c7d8241c454 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:01.902019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba982d-a54d-4a51-94c9-6c7d8241c454 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:01.913450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd86a86-d831-4590-934b-762531f6da13 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:01.919198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1c1de-66d9-41bd-9b0b-0d1631da9da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:01.920654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1c1de-66d9-41bd-9b0b-0d1631da9da3 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:01.920654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1c1de-66d9-41bd-9b0b-0d1631da9da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:01.920654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1c1de-66d9-41bd-9b0b-0d1631da9da3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:01.921114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1c1de-66d9-41bd-9b0b-0d1631da9da3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:01.924198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1c1de-66d9-41bd-9b0b-0d1631da9da3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:01.978845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6044d8-8c4d-43ae-beb3-bb7512ee62f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:01.979467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6044d8-8c4d-43ae-beb3-bb7512ee62f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:01.979780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6044d8-8c4d-43ae-beb3-bb7512ee62f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:01.980055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6044d8-8c4d-43ae-beb3-bb7512ee62f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:01.980705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6044d8-8c4d-43ae-beb3-bb7512ee62f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:01.982516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6044d8-8c4d-43ae-beb3-bb7512ee62f4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:01.994140 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 731/1462] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:01.994293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d46bb7-b3c1-40a2-a4cc-f6f9ee8d9257 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:01.994523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d46bb7-b3c1-40a2-a4cc-f6f9ee8d9257 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:01.994800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d46bb7-b3c1-40a2-a4cc-f6f9ee8d9257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:02.025664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-95d46bb7-b3c1-40a2-a4cc-f6f9ee8d9257 None None] MFA Rules not processed for user `8413dddbee5e4f26a256aa429bc036af`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:02.027224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-95d46bb7-b3c1-40a2-a4cc-f6f9ee8d9257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:02.028253 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 732/1463] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:01 2022] POST /identity/v3/projects => generated 393 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:02.029155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1c1de-66d9-41bd-9b0b-0d1631da9da3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:02.041761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:02.096366 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 732/1464] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:02.097512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d46bb7-b3c1-40a2-a4cc-f6f9ee8d9257 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:02.120729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:02.154334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1c1de-66d9-41bd-9b0b-0d1631da9da3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:02.160461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745d703-618f-4866-af22-8721224ea5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:02.161343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745d703-618f-4866-af22-8721224ea5cf admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:02.161627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745d703-618f-4866-af22-8721224ea5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:02.161905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745d703-618f-4866-af22-8721224ea5cf admin admin] PATH_INFO: `/v3/projects/a17f16c286a44f31b5c4ac8ae77b4f16/users/852d4b8d85264eb591321670b14dd62c/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:02.163911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745d703-618f-4866-af22-8721224ea5cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a17f16c286a44f31b5c4ac8ae77b4f16, user_id=852d4b8d85264eb591321670b14dd62c, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:02.166887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745d703-618f-4866-af22-8721224ea5cf admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:02.171565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d46bb7-b3c1-40a2-a4cc-f6f9ee8d9257 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:02.179500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4e633-f90a-4d27-a844-103e5e50ce0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:02.180291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4e633-f90a-4d27-a844-103e5e50ce0b admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:02.180680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4e633-f90a-4d27-a844-103e5e50ce0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:02.181158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4e633-f90a-4d27-a844-103e5e50ce0b admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:02.182053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4e633-f90a-4d27-a844-103e5e50ce0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:02.184518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4e633-f90a-4d27-a844-103e5e50ce0b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:02.202782 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 733/1465] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:02 2022] PUT /identity/v3/projects/a17f16c286a44f31b5c4ac8ae77b4f16/users/852d4b8d85264eb591321670b14dd62c/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:02.207055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745d703-618f-4866-af22-8721224ea5cf admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:02.274442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745d703-618f-4866-af22-8721224ea5cf admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:02.276813 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 733/1466] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:02 2022] POST /identity/v3/users => generated 303 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:02.277730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4e633-f90a-4d27-a844-103e5e50ce0b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:02.279584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-40a4e633-f90a-4d27-a844-103e5e50ce0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:02.279717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ddc8d-4623-4f29-828e-e32a6cbe93cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:02.280158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ddc8d-4623-4f29-828e-e32a6cbe93cc admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:02.280451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ddc8d-4623-4f29-828e-e32a6cbe93cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:02.280731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ddc8d-4623-4f29-828e-e32a6cbe93cc admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:02.281365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ddc8d-4623-4f29-828e-e32a6cbe93cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:02.283346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ddc8d-4623-4f29-828e-e32a6cbe93cc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:02.291900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4e633-f90a-4d27-a844-103e5e50ce0b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:02.297415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b00f83-2ee8-4f07-a769-2c5a2a073a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:02.298057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b00f83-2ee8-4f07-a769-2c5a2a073a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:02.298374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b00f83-2ee8-4f07-a769-2c5a2a073a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:02.298657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b00f83-2ee8-4f07-a769-2c5a2a073a5b admin admin] PATH_INFO: `/v3/projects/9f71e54f5a0f4a97bed3c89cda637a1e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:02.299779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b00f83-2ee8-4f07-a769-2c5a2a073a5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f71e54f5a0f4a97bed3c89cda637a1e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:02.301681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b00f83-2ee8-4f07-a769-2c5a2a073a5b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:02.358808 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 734/1467] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:02 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:02.358808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a6a33-2fb8-45a9-9f79-cd3a1e7566ad None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:02.358808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a6a33-2fb8-45a9-9f79-cd3a1e7566ad None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:02.358808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a6a33-2fb8-45a9-9f79-cd3a1e7566ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:02.385906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-808a6a33-2fb8-45a9-9f79-cd3a1e7566ad None None] MFA Rules not processed for user `852d4b8d85264eb591321670b14dd62c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:02.387176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-808a6a33-2fb8-45a9-9f79-cd3a1e7566ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:02.390514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-10b00f83-2ee8-4f07-a769-2c5a2a073a5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f71e54f5a0f4a97bed3c89cda637a1e', 'request_id': 'req-10b00f83-2ee8-4f07-a769-2c5a2a073a5b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:02.396841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:02.397493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-10b00f83-2ee8-4f07-a769-2c5a2a073a5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f71e54f5a0f4a97bed3c89cda637a1e', 'request_id': 'req-10b00f83-2ee8-4f07-a769-2c5a2a073a5b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:02.403102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-10b00f83-2ee8-4f07-a769-2c5a2a073a5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f71e54f5a0f4a97bed3c89cda637a1e', 'request_id': 'req-10b00f83-2ee8-4f07-a769-2c5a2a073a5b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:02.458498 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 735/1468] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:02 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:02.459384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a6a33-2fb8-45a9-9f79-cd3a1e7566ad None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:02.492102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-10b00f83-2ee8-4f07-a769-2c5a2a073a5b admin admin] The token cache is being invalidate because project 9f71e54f5a0f4a97bed3c89cda637a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:02.492606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-10b00f83-2ee8-4f07-a769-2c5a2a073a5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:02.493265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-10b00f83-2ee8-4f07-a769-2c5a2a073a5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:02.495242 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 734/1469] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:02 2022] DELETE /identity/v3/projects/9f71e54f5a0f4a97bed3c89cda637a1e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:02.495698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b00f83-2ee8-4f07-a769-2c5a2a073a5b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:02.497012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-10b00f83-2ee8-4f07-a769-2c5a2a073a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:02.530449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a6a33-2fb8-45a9-9f79-cd3a1e7566ad None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:02.535139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bbc9e-eb81-4edd-9e55-0769909b6c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:02.535748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bbc9e-eb81-4edd-9e55-0769909b6c4d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:02.536025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bbc9e-eb81-4edd-9e55-0769909b6c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:02.536294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bbc9e-eb81-4edd-9e55-0769909b6c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:02.536933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bbc9e-eb81-4edd-9e55-0769909b6c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:02.538569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bbc9e-eb81-4edd-9e55-0769909b6c4d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:02.555625 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 736/1470] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:02.555625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ace875-2a4f-407f-9ffa-800fcd8debad None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:02.555625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ace875-2a4f-407f-9ffa-800fcd8debad None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:02.555625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ace875-2a4f-407f-9ffa-800fcd8debad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:02.568077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b00f83-2ee8-4f07-a769-2c5a2a073a5b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:02.576017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd20617-b5cb-4f8a-8b01-5b1e9c5dabc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:02.576017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd20617-b5cb-4f8a-8b01-5b1e9c5dabc4 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:02.576017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd20617-b5cb-4f8a-8b01-5b1e9c5dabc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:02.576017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd20617-b5cb-4f8a-8b01-5b1e9c5dabc4 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:02.576356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd20617-b5cb-4f8a-8b01-5b1e9c5dabc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:02.576886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-42ace875-2a4f-407f-9ffa-800fcd8debad None None] MFA Rules not processed for user `ff070c0383324e1da5c49e3d9c652516`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:02.577990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd20617-b5cb-4f8a-8b01-5b1e9c5dabc4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:02.578363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-42ace875-2a4f-407f-9ffa-800fcd8debad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:02.634385 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 737/1471] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:02.635334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ace875-2a4f-407f-9ffa-800fcd8debad None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:02.636755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-42ace875-2a4f-407f-9ffa-800fcd8debad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:02.644989 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 735/1472] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:02 2022] POST /identity/v3/users => generated 297 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:02.644989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd20617-b5cb-4f8a-8b01-5b1e9c5dabc4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:02.647403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9bd20617-b5cb-4f8a-8b01-5b1e9c5dabc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:02.651901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ace875-2a4f-407f-9ffa-800fcd8debad None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:02.657917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f46037-3f3b-4f5d-b77b-a6a9c076234e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:02.658861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f46037-3f3b-4f5d-b77b-a6a9c076234e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:02.659147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f46037-3f3b-4f5d-b77b-a6a9c076234e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:02.659491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f46037-3f3b-4f5d-b77b-a6a9c076234e admin admin] PATH_INFO: `/v3/users/39b441f59d4449f5ac98e28a87677274` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:02.660886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f46037-3f3b-4f5d-b77b-a6a9c076234e admin admin] RBAC: Authorizing `identity:delete_user(user_id=39b441f59d4449f5ac98e28a87677274)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:02.662978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f46037-3f3b-4f5d-b77b-a6a9c076234e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:02.663086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd20617-b5cb-4f8a-8b01-5b1e9c5dabc4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:02.670534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c8efc-9316-4f30-b183-0e8d22e92b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:02.671343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c8efc-9316-4f30-b183-0e8d22e92b23 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:02.671635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c8efc-9316-4f30-b183-0e8d22e92b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:02.672533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c8efc-9316-4f30-b183-0e8d22e92b23 admin admin] PATH_INFO: `/v3/projects/fe4dfe4b6e774cb4bf57ad93219a25b4/users/ed0df2cb8f9c42f299ec2f1773188774/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:02.683520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:02.691179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c8efc-9316-4f30-b183-0e8d22e92b23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe4dfe4b6e774cb4bf57ad93219a25b4, user_id=ed0df2cb8f9c42f299ec2f1773188774, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:02.694048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c8efc-9316-4f30-b183-0e8d22e92b23 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:02.771786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:02.777543 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 736/1473] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:02 2022] PUT /identity/v3/projects/fe4dfe4b6e774cb4bf57ad93219a25b4/users/ed0df2cb8f9c42f299ec2f1773188774/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:02.779068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c8efc-9316-4f30-b183-0e8d22e92b23 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:02.840126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c8efc-9316-4f30-b183-0e8d22e92b23 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:02.845326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ec526-0289-4a06-b7ba-6e0731e31ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:02.845945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ec526-0289-4a06-b7ba-6e0731e31ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:02.846259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ec526-0289-4a06-b7ba-6e0731e31ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:02.846538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ec526-0289-4a06-b7ba-6e0731e31ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:02.847195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ec526-0289-4a06-b7ba-6e0731e31ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:02.848808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ec526-0289-4a06-b7ba-6e0731e31ab1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:02.858750 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 737/1474] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:02.860311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ec526-0289-4a06-b7ba-6e0731e31ab1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:02.861932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a88ec526-0289-4a06-b7ba-6e0731e31ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:02.881349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-40f46037-3f3b-4f5d-b77b-a6a9c076234e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39b441f59d4449f5ac98e28a87677274'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:02.882078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-40f46037-3f3b-4f5d-b77b-a6a9c076234e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39b441f59d4449f5ac98e28a87677274'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:02.889300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-40f46037-3f3b-4f5d-b77b-a6a9c076234e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39b441f59d4449f5ac98e28a87677274'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:02.901563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-40f46037-3f3b-4f5d-b77b-a6a9c076234e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39b441f59d4449f5ac98e28a87677274'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:02.936044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ec526-0289-4a06-b7ba-6e0731e31ab1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:02.942143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80468d-4474-4f4f-a6c5-1d7bead2ba6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:02.942772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80468d-4474-4f4f-a6c5-1d7bead2ba6c service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:02.943051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80468d-4474-4f4f-a6c5-1d7bead2ba6c service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:02.943323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80468d-4474-4f4f-a6c5-1d7bead2ba6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:02.945526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ca80468d-4474-4f4f-a6c5-1d7bead2ba6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:02.994761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-40f46037-3f3b-4f5d-b77b-a6a9c076234e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39b441f59d4449f5ac98e28a87677274'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:03.007694 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 738/1475] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:02 2022] DELETE /identity/v3/users/39b441f59d4449f5ac98e28a87677274 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:03.008649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f46037-3f3b-4f5d-b77b-a6a9c076234e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:03.008901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80468d-4474-4f4f-a6c5-1d7bead2ba6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:03.010663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-40f46037-3f3b-4f5d-b77b-a6a9c076234e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:03.011989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80468d-4474-4f4f-a6c5-1d7bead2ba6c service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:03.025354 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 738/1476] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:03.027060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80468d-4474-4f4f-a6c5-1d7bead2ba6c service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:03.028645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ca80468d-4474-4f4f-a6c5-1d7bead2ba6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:03.044696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80468d-4474-4f4f-a6c5-1d7bead2ba6c service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:03.110610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f46037-3f3b-4f5d-b77b-a6a9c076234e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:03.118887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56440cc-9c7e-4893-9c80-2b87f6c98a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:03.130186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56440cc-9c7e-4893-9c80-2b87f6c98a87 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:03.130186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56440cc-9c7e-4893-9c80-2b87f6c98a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:03.130186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56440cc-9c7e-4893-9c80-2b87f6c98a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:03.130186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56440cc-9c7e-4893-9c80-2b87f6c98a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:03.130186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56440cc-9c7e-4893-9c80-2b87f6c98a87 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:03.130778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:03.141776 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 739/1477] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:03.145593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56440cc-9c7e-4893-9c80-2b87f6c98a87 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:03.156843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56440cc-9c7e-4893-9c80-2b87f6c98a87 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:03.162686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaaf4cc-7c08-46a5-8ba4-c3637bbe2e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:03.163357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaaf4cc-7c08-46a5-8ba4-c3637bbe2e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:03.163701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaaf4cc-7c08-46a5-8ba4-c3637bbe2e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:03.163824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf05a11-a1d4-4384-9f3a-2a65fc7f2be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:03.163947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaaf4cc-7c08-46a5-8ba4-c3637bbe2e94 admin admin] PATH_INFO: `/v3/projects/fe4dfe4b6e774cb4bf57ad93219a25b4/users/ed0df2cb8f9c42f299ec2f1773188774/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:03.164816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf05a11-a1d4-4384-9f3a-2a65fc7f2be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:03.165227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf05a11-a1d4-4384-9f3a-2a65fc7f2be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:03.165600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf05a11-a1d4-4384-9f3a-2a65fc7f2be9 admin admin] PATH_INFO: `/v3/projects/855f620a03fd4a8b968c732e9b4e7c24/users/fa66222009294d45b9044d1722b85497/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:03.165843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaaf4cc-7c08-46a5-8ba4-c3637bbe2e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe4dfe4b6e774cb4bf57ad93219a25b4, user_id=ed0df2cb8f9c42f299ec2f1773188774, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:03.168677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaaf4cc-7c08-46a5-8ba4-c3637bbe2e94 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:03.184753 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 740/1478] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:03 2022] PUT /identity/v3/projects/fe4dfe4b6e774cb4bf57ad93219a25b4/users/ed0df2cb8f9c42f299ec2f1773188774/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:21:03.192597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b9de6-1593-401b-8fa4-e16a58381690 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:03.192889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b9de6-1593-401b-8fa4-e16a58381690 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:03.194079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b9de6-1593-401b-8fa4-e16a58381690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:03.199737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf05a11-a1d4-4384-9f3a-2a65fc7f2be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=855f620a03fd4a8b968c732e9b4e7c24, user_id=fa66222009294d45b9044d1722b85497, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:03.202828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf05a11-a1d4-4384-9f3a-2a65fc7f2be9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:03.207882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:03.225884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d53b9de6-1593-401b-8fa4-e16a58381690 None None] MFA Rules not processed for user `ed0df2cb8f9c42f299ec2f1773188774`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:03.227168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d53b9de6-1593-401b-8fa4-e16a58381690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:03.307225 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 739/1479] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:03 2022] PUT /identity/v3/projects/855f620a03fd4a8b968c732e9b4e7c24/users/fa66222009294d45b9044d1722b85497/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:03.308815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf05a11-a1d4-4384-9f3a-2a65fc7f2be9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:03.342099 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 741/1480] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:03 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:03.351498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b9de6-1593-401b-8fa4-e16a58381690 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:03.354327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d53b9de6-1593-401b-8fa4-e16a58381690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:03.390566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf05a11-a1d4-4384-9f3a-2a65fc7f2be9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:03.396852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229ff8a-02f0-4cb4-8aed-fb95b29fdcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:03.397606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229ff8a-02f0-4cb4-8aed-fb95b29fdcde admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:03.397988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229ff8a-02f0-4cb4-8aed-fb95b29fdcde admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:03.398431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229ff8a-02f0-4cb4-8aed-fb95b29fdcde admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:03.399357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229ff8a-02f0-4cb4-8aed-fb95b29fdcde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:03.401248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229ff8a-02f0-4cb4-8aed-fb95b29fdcde admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:03.418250 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 740/1481] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:21:03.419447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229ff8a-02f0-4cb4-8aed-fb95b29fdcde admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:03.432093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229ff8a-02f0-4cb4-8aed-fb95b29fdcde admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:03.441257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e80dc4-5f1a-4d75-8d44-71f38271b293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:03.445235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e80dc4-5f1a-4d75-8d44-71f38271b293 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:03.445235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e80dc4-5f1a-4d75-8d44-71f38271b293 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:03.448608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e80dc4-5f1a-4d75-8d44-71f38271b293 admin admin] PATH_INFO: `/v3/projects/855f620a03fd4a8b968c732e9b4e7c24/users/fa66222009294d45b9044d1722b85497/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:03.448608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e80dc4-5f1a-4d75-8d44-71f38271b293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=855f620a03fd4a8b968c732e9b4e7c24, user_id=fa66222009294d45b9044d1722b85497, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:03.451948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e80dc4-5f1a-4d75-8d44-71f38271b293 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:03.469447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=85,keystone:INSERT=8,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:03.474791 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 741/1482] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:03 2022] PUT /identity/v3/projects/855f620a03fd4a8b968c732e9b4e7c24/users/fa66222009294d45b9044d1722b85497/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:03.478348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca76164-416b-4b08-b740-eab3457423e4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:03.478822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca76164-416b-4b08-b740-eab3457423e4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:03.479232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca76164-416b-4b08-b740-eab3457423e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:03.525472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b9de6-1593-401b-8fa4-e16a58381690 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:03.530863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-fca76164-416b-4b08-b740-eab3457423e4 None None] MFA Rules not processed for user `fa66222009294d45b9044d1722b85497`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:03.534599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fca76164-416b-4b08-b740-eab3457423e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:03.563385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:03.614197 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 742/1483] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:03.615889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be66435-c95e-412f-897b-aec3534a7c9e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:03.619273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be66435-c95e-412f-897b-aec3534a7c9e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:03.619273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be66435-c95e-412f-897b-aec3534a7c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:03.627646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e95a4-9d49-427f-a6cb-d2e2a68bdb51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:03.628372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e95a4-9d49-427f-a6cb-d2e2a68bdb51 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:03.628724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e95a4-9d49-427f-a6cb-d2e2a68bdb51 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:03.629360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e95a4-9d49-427f-a6cb-d2e2a68bdb51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:03.679777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9be66435-c95e-412f-897b-aec3534a7c9e None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:03.682400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9be66435-c95e-412f-897b-aec3534a7c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:03.696915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e95a4-9d49-427f-a6cb-d2e2a68bdb51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:03.698574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e95a4-9d49-427f-a6cb-d2e2a68bdb51 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:03.722610 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 742/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:03 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:21:03.723950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e95a4-9d49-427f-a6cb-d2e2a68bdb51 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:03.728049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8c3e95a4-9d49-427f-a6cb-d2e2a68bdb51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:03.779594 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 743/1485] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:21:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:03.780352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be66435-c95e-412f-897b-aec3534a7c9e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:03.781943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9be66435-c95e-412f-897b-aec3534a7c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:03.827642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e95a4-9d49-427f-a6cb-d2e2a68bdb51 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:03.830660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be66435-c95e-412f-897b-aec3534a7c9e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:03.833729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f7e55-a6fe-4219-bb21-cb6b7b4f5d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:03.835182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f7e55-a6fe-4219-bb21-cb6b7b4f5d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:03.839287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f7e55-a6fe-4219-bb21-cb6b7b4f5d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:03.839287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f7e55-a6fe-4219-bb21-cb6b7b4f5d70 admin admin] PATH_INFO: `/v3/projects/a02545ab3aed449d8c142e73cfdb5a3c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:03.839502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d34a9a-c4e5-4ea9-98ec-e912a38cb62a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:03.839604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f7e55-a6fe-4219-bb21-cb6b7b4f5d70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a02545ab3aed449d8c142e73cfdb5a3c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:03.839765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d34a9a-c4e5-4ea9-98ec-e912a38cb62a service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:03.839765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d34a9a-c4e5-4ea9-98ec-e912a38cb62a service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:03.839765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d34a9a-c4e5-4ea9-98ec-e912a38cb62a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:03.839974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f7e55-a6fe-4219-bb21-cb6b7b4f5d70 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:03.849940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d34a9a-c4e5-4ea9-98ec-e912a38cb62a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:03.858425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d34a9a-c4e5-4ea9-98ec-e912a38cb62a service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:03.867524 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 744/1486] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:04.014171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-575f7e55-a6fe-4219-bb21-cb6b7b4f5d70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a02545ab3aed449d8c142e73cfdb5a3c', 'request_id': 'req-575f7e55-a6fe-4219-bb21-cb6b7b4f5d70'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:04.080348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-575f7e55-a6fe-4219-bb21-cb6b7b4f5d70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a02545ab3aed449d8c142e73cfdb5a3c', 'request_id': 'req-575f7e55-a6fe-4219-bb21-cb6b7b4f5d70'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:04.090997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-575f7e55-a6fe-4219-bb21-cb6b7b4f5d70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a02545ab3aed449d8c142e73cfdb5a3c', 'request_id': 'req-575f7e55-a6fe-4219-bb21-cb6b7b4f5d70'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:04.113973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-575f7e55-a6fe-4219-bb21-cb6b7b4f5d70 admin admin] The token cache is being invalidate because project a02545ab3aed449d8c142e73cfdb5a3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:04.115676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-575f7e55-a6fe-4219-bb21-cb6b7b4f5d70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:04.117750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-575f7e55-a6fe-4219-bb21-cb6b7b4f5d70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:04.123740 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 743/1487] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:03 2022] DELETE /identity/v3/projects/a02545ab3aed449d8c142e73cfdb5a3c => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:04.131993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbf04f-16af-40b4-b59f-44b5db883757 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:04.132531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbf04f-16af-40b4-b59f-44b5db883757 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:04.133021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbf04f-16af-40b4-b59f-44b5db883757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:04.156847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:04.170365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-21bbf04f-16af-40b4-b59f-44b5db883757 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:04.171745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-21bbf04f-16af-40b4-b59f-44b5db883757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:04.176177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f7e55-a6fe-4219-bb21-cb6b7b4f5d70 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:04.178243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-575f7e55-a6fe-4219-bb21-cb6b7b4f5d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:04.197502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:04.338625 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 745/1488] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:04.338625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbf04f-16af-40b4-b59f-44b5db883757 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:04.338625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-21bbf04f-16af-40b4-b59f-44b5db883757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:04.338625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:04.350022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbf04f-16af-40b4-b59f-44b5db883757 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:04.355906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115368e-4918-4fe5-9f44-6e9dc94113ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:04.356629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115368e-4918-4fe5-9f44-6e9dc94113ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:04.356978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115368e-4918-4fe5-9f44-6e9dc94113ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:04.357341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115368e-4918-4fe5-9f44-6e9dc94113ee admin admin] PATH_INFO: `/v3/users/a1db1df695924749bb228f88e05886c0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:04.360001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115368e-4918-4fe5-9f44-6e9dc94113ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1db1df695924749bb228f88e05886c0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:04.362352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115368e-4918-4fe5-9f44-6e9dc94113ee admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:04.379326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f7e55-a6fe-4219-bb21-cb6b7b4f5d70 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:04.382690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf498f-9463-4159-8fb1-795fa1923f4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:04.383954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf498f-9463-4159-8fb1-795fa1923f4d service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:04.384431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf498f-9463-4159-8fb1-795fa1923f4d service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:04.384897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf498f-9463-4159-8fb1-795fa1923f4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:04.388482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cadf498f-9463-4159-8fb1-795fa1923f4d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:04.498519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf498f-9463-4159-8fb1-795fa1923f4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:04.498519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf498f-9463-4159-8fb1-795fa1923f4d service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:04.507878 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 744/1489] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:21:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:21:04.509198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3f7b8-0289-43aa-86e9-ffa99362b994 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:04.509550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3f7b8-0289-43aa-86e9-ffa99362b994 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:04.509832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3f7b8-0289-43aa-86e9-ffa99362b994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:04.532316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-47f3f7b8-0289-43aa-86e9-ffa99362b994 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:04.532819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-47f3f7b8-0289-43aa-86e9-ffa99362b994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:04.541309 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 745/1490] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:04.545537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3f7b8-0289-43aa-86e9-ffa99362b994 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:04.559794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3f7b8-0289-43aa-86e9-ffa99362b994 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:04.563116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80e6fc-7a8a-4b83-b9f7-27f5beeacd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:04.563810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80e6fc-7a8a-4b83-b9f7-27f5beeacd63 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:04.564242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80e6fc-7a8a-4b83-b9f7-27f5beeacd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:04.564472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80e6fc-7a8a-4b83-b9f7-27f5beeacd63 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:04.565138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80e6fc-7a8a-4b83-b9f7-27f5beeacd63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:21:04.565496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80e6fc-7a8a-4b83-b9f7-27f5beeacd63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:04.567238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80e6fc-7a8a-4b83-b9f7-27f5beeacd63 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:04.587524 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 746/1491] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:21:04.592482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80e6fc-7a8a-4b83-b9f7-27f5beeacd63 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:04.617570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80e6fc-7a8a-4b83-b9f7-27f5beeacd63 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:04.625733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a9882-5ba1-407d-97dd-953f370986bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:04.627013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a9882-5ba1-407d-97dd-953f370986bd admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:04.627383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a9882-5ba1-407d-97dd-953f370986bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:04.628075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a9882-5ba1-407d-97dd-953f370986bd admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:04.629813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a9882-5ba1-407d-97dd-953f370986bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:04.629909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a115368e-4918-4fe5-9f44-6e9dc94113ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1db1df695924749bb228f88e05886c0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:04.630830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a115368e-4918-4fe5-9f44-6e9dc94113ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1db1df695924749bb228f88e05886c0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:04.631326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a9882-5ba1-407d-97dd-953f370986bd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:04.646807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a115368e-4918-4fe5-9f44-6e9dc94113ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1db1df695924749bb228f88e05886c0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:04.684519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a115368e-4918-4fe5-9f44-6e9dc94113ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1db1df695924749bb228f88e05886c0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:04.685525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a115368e-4918-4fe5-9f44-6e9dc94113ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1db1df695924749bb228f88e05886c0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:04.728716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:04.802240 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 747/1492] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:04 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:21:04.802240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a9882-5ba1-407d-97dd-953f370986bd admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:04.807611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5d3a9882-5ba1-407d-97dd-953f370986bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:04.820144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:04.836159 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 746/1493] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:04 2022] DELETE /identity/v3/users/a1db1df695924749bb228f88e05886c0 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:04.837367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115368e-4918-4fe5-9f44-6e9dc94113ee admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:04.840186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a115368e-4918-4fe5-9f44-6e9dc94113ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:04.984820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a9882-5ba1-407d-97dd-953f370986bd admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:05.004399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f26907-f12d-4fe2-b2c7-da392c21500a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:05.005697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f26907-f12d-4fe2-b2c7-da392c21500a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:05.006257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f26907-f12d-4fe2-b2c7-da392c21500a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:05.006706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f26907-f12d-4fe2-b2c7-da392c21500a admin admin] PATH_INFO: `/v3/users/8413dddbee5e4f26a256aa429bc036af` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:05.008640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115368e-4918-4fe5-9f44-6e9dc94113ee admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:05.009014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f26907-f12d-4fe2-b2c7-da392c21500a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8413dddbee5e4f26a256aa429bc036af)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:05.022474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f26907-f12d-4fe2-b2c7-da392c21500a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:05.026605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed7d83-3714-4cfa-858c-16679c8d0048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:05.029879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed7d83-3714-4cfa-858c-16679c8d0048 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:05.030293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed7d83-3714-4cfa-858c-16679c8d0048 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:05.030572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed7d83-3714-4cfa-858c-16679c8d0048 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:05.031357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed7d83-3714-4cfa-858c-16679c8d0048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:05.037247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed7d83-3714-4cfa-858c-16679c8d0048 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:05.059893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:05.178151 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 747/1494] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:04 2022] POST /identity/v3/users => generated 293 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:05.181304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03699d85-de18-4ab8-981f-56a0395edf77 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:05.181834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03699d85-de18-4ab8-981f-56a0395edf77 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:05.186707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03699d85-de18-4ab8-981f-56a0395edf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:05.226620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-03699d85-de18-4ab8-981f-56a0395edf77 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:05.228208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-03699d85-de18-4ab8-981f-56a0395edf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:05.243430 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 748/1495] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:05.245480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb287a5-1ea9-4058-ad4b-f97c5e10e6f4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:05.245891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb287a5-1ea9-4058-ad4b-f97c5e10e6f4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:05.247586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb287a5-1ea9-4058-ad4b-f97c5e10e6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:05.324337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3bb287a5-1ea9-4058-ad4b-f97c5e10e6f4 None None] MFA Rules not processed for user `9b359391fbc34c259d987e42e8826c86`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:05.325590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3bb287a5-1ea9-4058-ad4b-f97c5e10e6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:05.343779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-39f26907-f12d-4fe2-b2c7-da392c21500a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8413dddbee5e4f26a256aa429bc036af'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:05.344636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-39f26907-f12d-4fe2-b2c7-da392c21500a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8413dddbee5e4f26a256aa429bc036af'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:05.359073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-39f26907-f12d-4fe2-b2c7-da392c21500a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8413dddbee5e4f26a256aa429bc036af'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:05.389179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-39f26907-f12d-4fe2-b2c7-da392c21500a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8413dddbee5e4f26a256aa429bc036af'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:05.465036 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 749/1496] 10.222.0.44 () {58 vars in 1015 bytes} [Thu Oct 27 03:21:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:05.468527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb287a5-1ea9-4058-ad4b-f97c5e10e6f4 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:05.470792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3bb287a5-1ea9-4058-ad4b-f97c5e10e6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:05.496337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb287a5-1ea9-4058-ad4b-f97c5e10e6f4 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:05.507560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99dda15-1be2-4e1e-b897-0702bb82db1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:05.508144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-39f26907-f12d-4fe2-b2c7-da392c21500a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8413dddbee5e4f26a256aa429bc036af'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:05.508274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dda15-1be2-4e1e-b897-0702bb82db1a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:05.508504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dda15-1be2-4e1e-b897-0702bb82db1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:05.508781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dda15-1be2-4e1e-b897-0702bb82db1a admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:05.509439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99dda15-1be2-4e1e-b897-0702bb82db1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:05.515617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99dda15-1be2-4e1e-b897-0702bb82db1a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:05.515833 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 748/1497] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:04 2022] DELETE /identity/v3/users/8413dddbee5e4f26a256aa429bc036af => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:05.516613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f26907-f12d-4fe2-b2c7-da392c21500a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:05.595112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-39f26907-f12d-4fe2-b2c7-da392c21500a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:05.595758 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 750/1498] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:05.595758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bbc88-13e6-40c7-9aaa-af47ff9f6985 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:05.595758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bbc88-13e6-40c7-9aaa-af47ff9f6985 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:05.595758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bbc88-13e6-40c7-9aaa-af47ff9f6985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:05.595758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-fe9bbc88-13e6-40c7-9aaa-af47ff9f6985 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:05.595758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fe9bbc88-13e6-40c7-9aaa-af47ff9f6985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:05.596189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f26907-f12d-4fe2-b2c7-da392c21500a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:05.596189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29816bd-fc35-4fc5-88eb-24fd598c5c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:05.596189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29816bd-fc35-4fc5-88eb-24fd598c5c39 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:05.596189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29816bd-fc35-4fc5-88eb-24fd598c5c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:05.596483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29816bd-fc35-4fc5-88eb-24fd598c5c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:05.596483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c29816bd-fc35-4fc5-88eb-24fd598c5c39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:05.644935 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 751/1499] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:05.646182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bbc88-13e6-40c7-9aaa-af47ff9f6985 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:05.660972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bbc88-13e6-40c7-9aaa-af47ff9f6985 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:05.666639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fcefb-0b08-41dd-80eb-eb00d3f198d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:05.667675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fcefb-0b08-41dd-80eb-eb00d3f198d9 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:05.667982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fcefb-0b08-41dd-80eb-eb00d3f198d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:05.668254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fcefb-0b08-41dd-80eb-eb00d3f198d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:05.677373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fcefb-0b08-41dd-80eb-eb00d3f198d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:05.867413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fcefb-0b08-41dd-80eb-eb00d3f198d9 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:05.868077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29816bd-fc35-4fc5-88eb-24fd598c5c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:05.868160 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 752/1500] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:05.868232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29816bd-fc35-4fc5-88eb-24fd598c5c39 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:05.868307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fcefb-0b08-41dd-80eb-eb00d3f198d9 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:05.868377 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 749/1501] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:05.868377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29816bd-fc35-4fc5-88eb-24fd598c5c39 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:05.868529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fcefb-0b08-41dd-80eb-eb00d3f198d9 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:05.868529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41098eaa-ecbc-4ca8-bb39-fe025580c054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:05.868529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41098eaa-ecbc-4ca8-bb39-fe025580c054 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:05.868529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41098eaa-ecbc-4ca8-bb39-fe025580c054 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:05.868791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41098eaa-ecbc-4ca8-bb39-fe025580c054 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:05.868791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41098eaa-ecbc-4ca8-bb39-fe025580c054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:05.868915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29816bd-fc35-4fc5-88eb-24fd598c5c39 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:05.868991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41098eaa-ecbc-4ca8-bb39-fe025580c054 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:05.869056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f6bad-59d5-40e3-a460-edde79440cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:05.869056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f6bad-59d5-40e3-a460-edde79440cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:05.869056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f6bad-59d5-40e3-a460-edde79440cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:05.869056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f6bad-59d5-40e3-a460-edde79440cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:05.869359 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 753/1502] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:05.869433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f6bad-59d5-40e3-a460-edde79440cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:05.869433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f6bad-59d5-40e3-a460-edde79440cb6 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:05.869433 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 750/1503] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:05.877731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41098eaa-ecbc-4ca8-bb39-fe025580c054 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:05.902128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41098eaa-ecbc-4ca8-bb39-fe025580c054 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:05.915768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e027a-cf12-4984-a793-31d099b5af52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:05.920120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e027a-cf12-4984-a793-31d099b5af52 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:05.920964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e027a-cf12-4984-a793-31d099b5af52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:05.921790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e027a-cf12-4984-a793-31d099b5af52 admin admin] PATH_INFO: `/v3/projects/1153299025194196bccd2bcf88717515/users/3b7efdee7be643ddade53144cec6d07c/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:05.946610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e027a-cf12-4984-a793-31d099b5af52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1153299025194196bccd2bcf88717515, user_id=3b7efdee7be643ddade53144cec6d07c, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:05.973404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e027a-cf12-4984-a793-31d099b5af52 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:06.200804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:06.204580 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 754/1504] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:05 2022] PUT /identity/v3/projects/1153299025194196bccd2bcf88717515/users/3b7efdee7be643ddade53144cec6d07c/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:06.214641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be270a70-96c3-4b6a-922a-2059b5c9587d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:06.215140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be270a70-96c3-4b6a-922a-2059b5c9587d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:06.215372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be270a70-96c3-4b6a-922a-2059b5c9587d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:06.278545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-be270a70-96c3-4b6a-922a-2059b5c9587d None None] MFA Rules not processed for user `3b7efdee7be643ddade53144cec6d07c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:06.280444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-be270a70-96c3-4b6a-922a-2059b5c9587d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:06.393390 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 751/1505] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:06.400827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e027a-cf12-4984-a793-31d099b5af52 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:06.440077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:06.511617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e027a-cf12-4984-a793-31d099b5af52 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:06.519307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb479b84-7f5d-4903-9ce0-b5138858fab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:06.520004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb479b84-7f5d-4903-9ce0-b5138858fab1 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:06.520294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb479b84-7f5d-4903-9ce0-b5138858fab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:06.521022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb479b84-7f5d-4903-9ce0-b5138858fab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:06.521707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb479b84-7f5d-4903-9ce0-b5138858fab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:06.524367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb479b84-7f5d-4903-9ce0-b5138858fab1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:06.671618 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 755/1506] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:06 2022] POST /identity/v3/projects => generated 385 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:06.675898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be270a70-96c3-4b6a-922a-2059b5c9587d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:06.692482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be270a70-96c3-4b6a-922a-2059b5c9587d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:06.788613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb479b84-7f5d-4903-9ce0-b5138858fab1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:06.791334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bb479b84-7f5d-4903-9ce0-b5138858fab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:06.808543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b549bf-1e2a-4095-b8e8-a20407008bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:06.816880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b549bf-1e2a-4095-b8e8-a20407008bad admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:06.816880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b549bf-1e2a-4095-b8e8-a20407008bad admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:06.816880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b549bf-1e2a-4095-b8e8-a20407008bad admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:06.816880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b549bf-1e2a-4095-b8e8-a20407008bad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:06.816880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b549bf-1e2a-4095-b8e8-a20407008bad admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:06.934302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb479b84-7f5d-4903-9ce0-b5138858fab1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:06.946999 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 752/1507] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:06 2022] POST /identity/v3/users => generated 299 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:06.946999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b549bf-1e2a-4095-b8e8-a20407008bad admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:06.949616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-83b549bf-1e2a-4095-b8e8-a20407008bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:06.952863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb8a1e-2952-43ea-9fc0-b44ed2c21d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:06.954127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb8a1e-2952-43ea-9fc0-b44ed2c21d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:06.954414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb8a1e-2952-43ea-9fc0-b44ed2c21d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:06.954711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb8a1e-2952-43ea-9fc0-b44ed2c21d08 admin admin] PATH_INFO: `/v3/projects/495904ebaf5c4b09bf06f58ec938a680` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:06.960149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb8a1e-2952-43ea-9fc0-b44ed2c21d08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=495904ebaf5c4b09bf06f58ec938a680)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:06.962596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb8a1e-2952-43ea-9fc0-b44ed2c21d08 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:06.969823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b549bf-1e2a-4095-b8e8-a20407008bad admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:06.977790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a729f80-eec1-4bc4-9b84-88a259dd6371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:06.977790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a729f80-eec1-4bc4-9b84-88a259dd6371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:06.978245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a729f80-eec1-4bc4-9b84-88a259dd6371 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:06.978245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a729f80-eec1-4bc4-9b84-88a259dd6371 admin admin] PATH_INFO: `/v3/projects/1fd60901a706424fb5762496265a699a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:06.979368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a729f80-eec1-4bc4-9b84-88a259dd6371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fd60901a706424fb5762496265a699a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:06.981529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a729f80-eec1-4bc4-9b84-88a259dd6371 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:07.120642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6a729f80-eec1-4bc4-9b84-88a259dd6371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fd60901a706424fb5762496265a699a', 'request_id': 'req-6a729f80-eec1-4bc4-9b84-88a259dd6371'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:07.171890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:07.173198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-79fb8a1e-2952-43ea-9fc0-b44ed2c21d08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '495904ebaf5c4b09bf06f58ec938a680', 'request_id': 'req-79fb8a1e-2952-43ea-9fc0-b44ed2c21d08'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:07.180397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-79fb8a1e-2952-43ea-9fc0-b44ed2c21d08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '495904ebaf5c4b09bf06f58ec938a680', 'request_id': 'req-79fb8a1e-2952-43ea-9fc0-b44ed2c21d08'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:07.189349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-79fb8a1e-2952-43ea-9fc0-b44ed2c21d08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '495904ebaf5c4b09bf06f58ec938a680', 'request_id': 'req-79fb8a1e-2952-43ea-9fc0-b44ed2c21d08'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:07.229467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6a729f80-eec1-4bc4-9b84-88a259dd6371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fd60901a706424fb5762496265a699a', 'request_id': 'req-6a729f80-eec1-4bc4-9b84-88a259dd6371'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:07.237680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6a729f80-eec1-4bc4-9b84-88a259dd6371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fd60901a706424fb5762496265a699a', 'request_id': 'req-6a729f80-eec1-4bc4-9b84-88a259dd6371'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:07.254676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6a729f80-eec1-4bc4-9b84-88a259dd6371 admin admin] The token cache is being invalidate because project 1fd60901a706424fb5762496265a699a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:07.256702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6a729f80-eec1-4bc4-9b84-88a259dd6371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:07.256702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6a729f80-eec1-4bc4-9b84-88a259dd6371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:07.257253 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 753/1508] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:06 2022] DELETE /identity/v3/projects/1fd60901a706424fb5762496265a699a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:07.260587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a729f80-eec1-4bc4-9b84-88a259dd6371 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:07.262259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6a729f80-eec1-4bc4-9b84-88a259dd6371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:07.308055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-79fb8a1e-2952-43ea-9fc0-b44ed2c21d08 admin admin] The token cache is being invalidate because project 495904ebaf5c4b09bf06f58ec938a680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:07.308422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-79fb8a1e-2952-43ea-9fc0-b44ed2c21d08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:07.310347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-79fb8a1e-2952-43ea-9fc0-b44ed2c21d08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:07.315452 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 756/1509] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:06 2022] DELETE /identity/v3/projects/495904ebaf5c4b09bf06f58ec938a680 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:21:07.327759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb8a1e-2952-43ea-9fc0-b44ed2c21d08 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:07.332111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-79fb8a1e-2952-43ea-9fc0-b44ed2c21d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:07.338308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:07.403853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a729f80-eec1-4bc4-9b84-88a259dd6371 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:07.439914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb8a1e-2952-43ea-9fc0-b44ed2c21d08 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:07.445494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b673473-c81b-4b03-8958-89c65acfe308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:07.446464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b673473-c81b-4b03-8958-89c65acfe308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:07.446755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b673473-c81b-4b03-8958-89c65acfe308 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:07.447208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b673473-c81b-4b03-8958-89c65acfe308 admin admin] PATH_INFO: `/v3/users/ed0df2cb8f9c42f299ec2f1773188774` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:07.448625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b673473-c81b-4b03-8958-89c65acfe308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed0df2cb8f9c42f299ec2f1773188774)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:07.450963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b673473-c81b-4b03-8958-89c65acfe308 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:07.601463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a91403-b268-4f88-8bbd-cd3d58bdc2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:07.602668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a91403-b268-4f88-8bbd-cd3d58bdc2bf admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:07.603216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a91403-b268-4f88-8bbd-cd3d58bdc2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:07.603685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a91403-b268-4f88-8bbd-cd3d58bdc2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:07.604521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a91403-b268-4f88-8bbd-cd3d58bdc2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:07.607462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a91403-b268-4f88-8bbd-cd3d58bdc2bf admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:07.633922 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 754/1510] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:07.635083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a91403-b268-4f88-8bbd-cd3d58bdc2bf admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:07.640361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c3a91403-b268-4f88-8bbd-cd3d58bdc2bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:07.663351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a91403-b268-4f88-8bbd-cd3d58bdc2bf admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:07.669812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d5a7e-5836-407f-8780-3d50960184ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:07.671917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d5a7e-5836-407f-8780-3d50960184ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:07.671917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d5a7e-5836-407f-8780-3d50960184ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:07.671917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d5a7e-5836-407f-8780-3d50960184ce admin admin] PATH_INFO: `/v3/users/fa66222009294d45b9044d1722b85497` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:07.674772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d5a7e-5836-407f-8780-3d50960184ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa66222009294d45b9044d1722b85497)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:07.676890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d5a7e-5836-407f-8780-3d50960184ce admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:07.744397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4b673473-c81b-4b03-8958-89c65acfe308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed0df2cb8f9c42f299ec2f1773188774'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:07.745942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4b673473-c81b-4b03-8958-89c65acfe308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed0df2cb8f9c42f299ec2f1773188774'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:07.759184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4b673473-c81b-4b03-8958-89c65acfe308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed0df2cb8f9c42f299ec2f1773188774'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:07.797484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4b673473-c81b-4b03-8958-89c65acfe308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed0df2cb8f9c42f299ec2f1773188774'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:07.799612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4b673473-c81b-4b03-8958-89c65acfe308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed0df2cb8f9c42f299ec2f1773188774'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:07.912780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:07.921283 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 757/1511] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:07 2022] DELETE /identity/v3/users/ed0df2cb8f9c42f299ec2f1773188774 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:07.923148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece9c01-2cc4-41f5-a00f-1b267e129d56 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:07.924183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece9c01-2cc4-41f5-a00f-1b267e129d56 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:07.924298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece9c01-2cc4-41f5-a00f-1b267e129d56 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:07.927292 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 758/1512] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 27 03:21:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:21:07.928113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece9c01-2cc4-41f5-a00f-1b267e129d56 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:07.931209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6ece9c01-2cc4-41f5-a00f-1b267e129d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:07.956580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-493d5a7e-5836-407f-8780-3d50960184ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa66222009294d45b9044d1722b85497'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:07.957275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-493d5a7e-5836-407f-8780-3d50960184ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa66222009294d45b9044d1722b85497'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:07.971219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-493d5a7e-5836-407f-8780-3d50960184ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa66222009294d45b9044d1722b85497'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:08.016286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-493d5a7e-5836-407f-8780-3d50960184ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa66222009294d45b9044d1722b85497'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:08.054333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:08.070081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece9c01-2cc4-41f5-a00f-1b267e129d56 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:08.074256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-493d5a7e-5836-407f-8780-3d50960184ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa66222009294d45b9044d1722b85497'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:08.085581 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 755/1513] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:07 2022] DELETE /identity/v3/users/fa66222009294d45b9044d1722b85497 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:08.087667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714e4d-dcf7-4fd2-8fee-61d734f6b820 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:08.088103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714e4d-dcf7-4fd2-8fee-61d734f6b820 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:08.088390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714e4d-dcf7-4fd2-8fee-61d734f6b820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:08.103907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784412b1-ddf0-4b51-8534-24e258edcee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:08.114296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784412b1-ddf0-4b51-8534-24e258edcee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:08.114701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784412b1-ddf0-4b51-8534-24e258edcee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:08.114990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784412b1-ddf0-4b51-8534-24e258edcee0 admin admin] PATH_INFO: `/v3/projects/9bd4af5222dd421f8b4036c6e052d5b9/users/a68f7ce9bc084d7298bf248e24c4cfce/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:08.134028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0c714e4d-dcf7-4fd2-8fee-61d734f6b820 None None] MFA Rules not processed for user `c20881251f2241a3a5ec2e5cf99db149`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:08.135318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0c714e4d-dcf7-4fd2-8fee-61d734f6b820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:08.175394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784412b1-ddf0-4b51-8534-24e258edcee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bd4af5222dd421f8b4036c6e052d5b9, user_id=a68f7ce9bc084d7298bf248e24c4cfce, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:08.184119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784412b1-ddf0-4b51-8534-24e258edcee0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:08.274945 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 756/1514] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 03:21:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:08.299933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c714e4d-dcf7-4fd2-8fee-61d734f6b820 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:08.301593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0c714e4d-dcf7-4fd2-8fee-61d734f6b820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:08.316770 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 759/1515] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:07 2022] PUT /identity/v3/projects/9bd4af5222dd421f8b4036c6e052d5b9/users/a68f7ce9bc084d7298bf248e24c4cfce/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:08.320755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784412b1-ddf0-4b51-8534-24e258edcee0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:08.323669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-784412b1-ddf0-4b51-8534-24e258edcee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:08.340234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c714e4d-dcf7-4fd2-8fee-61d734f6b820 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:08.477681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57d176-d783-4ad9-a84d-063058fe428f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:08.479748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57d176-d783-4ad9-a84d-063058fe428f service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:08.480518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57d176-d783-4ad9-a84d-063058fe428f service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:08.480935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784412b1-ddf0-4b51-8534-24e258edcee0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:08.481405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57d176-d783-4ad9-a84d-063058fe428f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:08.488353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242742c9-6639-4e5c-846a-d77deaffddaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:08.489262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242742c9-6639-4e5c-846a-d77deaffddaa admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:08.489758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242742c9-6639-4e5c-846a-d77deaffddaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:08.490284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242742c9-6639-4e5c-846a-d77deaffddaa admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:08.498981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242742c9-6639-4e5c-846a-d77deaffddaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:08.502291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242742c9-6639-4e5c-846a-d77deaffddaa admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:08.505393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57d176-d783-4ad9-a84d-063058fe428f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:08.507903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57d176-d783-4ad9-a84d-063058fe428f service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:08.519558 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 760/1516] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:08.523055 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 757/1517] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:21:08.526151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242742c9-6639-4e5c-846a-d77deaffddaa admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:08.537044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242742c9-6639-4e5c-846a-d77deaffddaa admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:08.559818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad13f52-ceef-4075-98bb-4377279e7f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:08.560666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad13f52-ceef-4075-98bb-4377279e7f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:08.561076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad13f52-ceef-4075-98bb-4377279e7f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:08.561223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad13f52-ceef-4075-98bb-4377279e7f9c admin admin] PATH_INFO: `/v3/projects/9bd4af5222dd421f8b4036c6e052d5b9/users/a68f7ce9bc084d7298bf248e24c4cfce/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:08.564224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad13f52-ceef-4075-98bb-4377279e7f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bd4af5222dd421f8b4036c6e052d5b9, user_id=a68f7ce9bc084d7298bf248e24c4cfce, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:08.566966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad13f52-ceef-4075-98bb-4377279e7f9c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:08.581849 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 761/1518] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:08 2022] PUT /identity/v3/projects/9bd4af5222dd421f8b4036c6e052d5b9/users/a68f7ce9bc084d7298bf248e24c4cfce/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:08.598275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a498b-f9b8-4d08-93ec-2f3edefa562f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:08.598571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a498b-f9b8-4d08-93ec-2f3edefa562f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:08.598899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a498b-f9b8-4d08-93ec-2f3edefa562f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:08.673867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a06a498b-f9b8-4d08-93ec-2f3edefa562f None None] MFA Rules not processed for user `a68f7ce9bc084d7298bf248e24c4cfce`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:08.680935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a06a498b-f9b8-4d08-93ec-2f3edefa562f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:08.701126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:08.766753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e655b7-b02d-442a-9956-c15a06445e6e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:08.767385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e655b7-b02d-442a-9956-c15a06445e6e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:08.768071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e655b7-b02d-442a-9956-c15a06445e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:08.810698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-29e655b7-b02d-442a-9956-c15a06445e6e None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:08.814571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-29e655b7-b02d-442a-9956-c15a06445e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:08.873816 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 758/1519] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:08.882839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a498b-f9b8-4d08-93ec-2f3edefa562f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:08.951032 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 762/1520] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:21:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:08.968391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e655b7-b02d-442a-9956-c15a06445e6e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:08.971340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-29e655b7-b02d-442a-9956-c15a06445e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:09.060019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a498b-f9b8-4d08-93ec-2f3edefa562f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:09.082722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80bc021-f29d-4774-8ee9-3210fe847bcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:09.084645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bc021-f29d-4774-8ee9-3210fe847bcb service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:09.085761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bc021-f29d-4774-8ee9-3210fe847bcb service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:09.087537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bc021-f29d-4774-8ee9-3210fe847bcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:09.116218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80bc021-f29d-4774-8ee9-3210fe847bcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:09.119510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80bc021-f29d-4774-8ee9-3210fe847bcb service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:09.163621 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 759/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:09.164983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e655b7-b02d-442a-9956-c15a06445e6e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:09.172945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bc875-97a1-40e3-bedf-39928e384a0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:09.173732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bc875-97a1-40e3-bedf-39928e384a0f service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:09.174235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bc875-97a1-40e3-bedf-39928e384a0f service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:09.174755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bc875-97a1-40e3-bedf-39928e384a0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:09.184045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:09.198319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bc875-97a1-40e3-bedf-39928e384a0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:09.200553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bc875-97a1-40e3-bedf-39928e384a0f service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:09.226137 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 763/1522] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:21:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:21:09.269969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80bc021-f29d-4774-8ee9-3210fe847bcb service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:09.272622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c80bc021-f29d-4774-8ee9-3210fe847bcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:09.535373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80bc021-f29d-4774-8ee9-3210fe847bcb service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:09.550175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b524a0-42f0-4b40-90a2-5f34d4cd4c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:09.552234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b524a0-42f0-4b40-90a2-5f34d4cd4c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:09.552507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b524a0-42f0-4b40-90a2-5f34d4cd4c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:09.553118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b524a0-42f0-4b40-90a2-5f34d4cd4c83 admin admin] PATH_INFO: `/v3/projects/fe4dfe4b6e774cb4bf57ad93219a25b4` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:09.555436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b524a0-42f0-4b40-90a2-5f34d4cd4c83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe4dfe4b6e774cb4bf57ad93219a25b4)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:09.563449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b524a0-42f0-4b40-90a2-5f34d4cd4c83 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:09.748948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:09.874326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-07b524a0-42f0-4b40-90a2-5f34d4cd4c83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe4dfe4b6e774cb4bf57ad93219a25b4', 'request_id': 'req-07b524a0-42f0-4b40-90a2-5f34d4cd4c83'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:10.012147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-07b524a0-42f0-4b40-90a2-5f34d4cd4c83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe4dfe4b6e774cb4bf57ad93219a25b4', 'request_id': 'req-07b524a0-42f0-4b40-90a2-5f34d4cd4c83'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:10.022485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-07b524a0-42f0-4b40-90a2-5f34d4cd4c83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe4dfe4b6e774cb4bf57ad93219a25b4', 'request_id': 'req-07b524a0-42f0-4b40-90a2-5f34d4cd4c83'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:10.047705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-07b524a0-42f0-4b40-90a2-5f34d4cd4c83 admin admin] The token cache is being invalidate because project fe4dfe4b6e774cb4bf57ad93219a25b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:10.048000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-07b524a0-42f0-4b40-90a2-5f34d4cd4c83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:10.048763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-07b524a0-42f0-4b40-90a2-5f34d4cd4c83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:10.055337 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 760/1523] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:09 2022] DELETE /identity/v3/projects/fe4dfe4b6e774cb4bf57ad93219a25b4 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:10.057605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1330b5-5c9c-4c71-9440-d992737a20dd None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:10.058175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1330b5-5c9c-4c71-9440-d992737a20dd None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:10.058712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1330b5-5c9c-4c71-9440-d992737a20dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:10.122661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-de1330b5-5c9c-4c71-9440-d992737a20dd None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:10.125425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-de1330b5-5c9c-4c71-9440-d992737a20dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:10.130065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b524a0-42f0-4b40-90a2-5f34d4cd4c83 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:10.131967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-07b524a0-42f0-4b40-90a2-5f34d4cd4c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:10.304676 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 764/1524] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:10.310820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447bd1a-a5a5-4d7c-bd0d-75ff5c9bce16 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:10.311339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447bd1a-a5a5-4d7c-bd0d-75ff5c9bce16 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:10.311887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447bd1a-a5a5-4d7c-bd0d-75ff5c9bce16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:10.349519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0447bd1a-a5a5-4d7c-bd0d-75ff5c9bce16 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:10.351394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0447bd1a-a5a5-4d7c-bd0d-75ff5c9bce16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:10.374090 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 765/1525] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:10.377972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b524a0-42f0-4b40-90a2-5f34d4cd4c83 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:10.384124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447bd1a-a5a5-4d7c-bd0d-75ff5c9bce16 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:10.389804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b1f31-d24b-4209-b0c2-8ac4011dd136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:10.391318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b1f31-d24b-4209-b0c2-8ac4011dd136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:10.391820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b1f31-d24b-4209-b0c2-8ac4011dd136 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:10.392311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b1f31-d24b-4209-b0c2-8ac4011dd136 admin admin] PATH_INFO: `/v3/projects/855f620a03fd4a8b968c732e9b4e7c24` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:10.393739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b1f31-d24b-4209-b0c2-8ac4011dd136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=855f620a03fd4a8b968c732e9b4e7c24)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:10.395808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b1f31-d24b-4209-b0c2-8ac4011dd136 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:10.397430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447bd1a-a5a5-4d7c-bd0d-75ff5c9bce16 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:10.405394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22418922-4d51-495e-82b8-b92446ded4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:10.409424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22418922-4d51-495e-82b8-b92446ded4ec admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:10.409424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22418922-4d51-495e-82b8-b92446ded4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:10.409424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22418922-4d51-495e-82b8-b92446ded4ec admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:10.409424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22418922-4d51-495e-82b8-b92446ded4ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:21:10.409424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22418922-4d51-495e-82b8-b92446ded4ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:10.415381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22418922-4d51-495e-82b8-b92446ded4ec admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:10.450536 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 766/1526] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:21:10.456336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22418922-4d51-495e-82b8-b92446ded4ec admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:10.476969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22418922-4d51-495e-82b8-b92446ded4ec admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:10.507270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582eef1-7abb-406e-82d8-5502e2f49ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:10.509167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582eef1-7abb-406e-82d8-5502e2f49ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:10.510206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582eef1-7abb-406e-82d8-5502e2f49ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:10.511060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582eef1-7abb-406e-82d8-5502e2f49ae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:10.512978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582eef1-7abb-406e-82d8-5502e2f49ae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:10.516246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582eef1-7abb-406e-82d8-5502e2f49ae2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:10.550417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-aa4b1f31-d24b-4209-b0c2-8ac4011dd136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855f620a03fd4a8b968c732e9b4e7c24', 'request_id': 'req-aa4b1f31-d24b-4209-b0c2-8ac4011dd136'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:10.623033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-aa4b1f31-d24b-4209-b0c2-8ac4011dd136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855f620a03fd4a8b968c732e9b4e7c24', 'request_id': 'req-aa4b1f31-d24b-4209-b0c2-8ac4011dd136'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:10.635785 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 767/1527] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:10 2022] POST /identity/v3/projects => generated 399 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:10.636334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-aa4b1f31-d24b-4209-b0c2-8ac4011dd136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855f620a03fd4a8b968c732e9b4e7c24', 'request_id': 'req-aa4b1f31-d24b-4209-b0c2-8ac4011dd136'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:10.641460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582eef1-7abb-406e-82d8-5502e2f49ae2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:10.663297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-aa4b1f31-d24b-4209-b0c2-8ac4011dd136 admin admin] The token cache is being invalidate because project 855f620a03fd4a8b968c732e9b4e7c24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:10.663619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-aa4b1f31-d24b-4209-b0c2-8ac4011dd136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:10.664243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-aa4b1f31-d24b-4209-b0c2-8ac4011dd136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:10.667602 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 761/1528] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:10 2022] DELETE /identity/v3/projects/855f620a03fd4a8b968c732e9b4e7c24 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:10.678939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6931a4-9382-415a-8250-6e96064ac2c7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:10.679854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6931a4-9382-415a-8250-6e96064ac2c7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:10.680729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6931a4-9382-415a-8250-6e96064ac2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:10.745148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-7d6931a4-9382-415a-8250-6e96064ac2c7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:10.747327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7d6931a4-9382-415a-8250-6e96064ac2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:10.892266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:10.893268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582eef1-7abb-406e-82d8-5502e2f49ae2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:10.903005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec7648-4055-4e92-8808-c1bc2fa94fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:10.908883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec7648-4055-4e92-8808-c1bc2fa94fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:10.909261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec7648-4055-4e92-8808-c1bc2fa94fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:10.909451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec7648-4055-4e92-8808-c1bc2fa94fa4 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:10.913784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec7648-4055-4e92-8808-c1bc2fa94fa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:10.921347 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 762/1529] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:21:10.923301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec7648-4055-4e92-8808-c1bc2fa94fa4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:10.931705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca1bdd-b29d-4e5d-8b0e-98eeb47e4786 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:10.932094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca1bdd-b29d-4e5d-8b0e-98eeb47e4786 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:10.932636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca1bdd-b29d-4e5d-8b0e-98eeb47e4786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:10.989900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-eaca1bdd-b29d-4e5d-8b0e-98eeb47e4786 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:10.993525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-eaca1bdd-b29d-4e5d-8b0e-98eeb47e4786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:11.039230 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 763/1530] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:21:11.045125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca1bdd-b29d-4e5d-8b0e-98eeb47e4786 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:11.078674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca1bdd-b29d-4e5d-8b0e-98eeb47e4786 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:11.095407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b03eb1-0f2b-4b85-b096-e3a6647df95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:11.097091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b03eb1-0f2b-4b85-b096-e3a6647df95a admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:11.097932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b03eb1-0f2b-4b85-b096-e3a6647df95a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:11.098936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b03eb1-0f2b-4b85-b096-e3a6647df95a admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:11.109761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b03eb1-0f2b-4b85-b096-e3a6647df95a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:21:11.110103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b03eb1-0f2b-4b85-b096-e3a6647df95a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:11.116075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b03eb1-0f2b-4b85-b096-e3a6647df95a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:11.147298 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 768/1531] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:10 2022] POST /identity/v3/users => generated 300 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:11.147298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db3b02-d882-40dc-9c44-077d027e468e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:11.147298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db3b02-d882-40dc-9c44-077d027e468e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:11.147298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db3b02-d882-40dc-9c44-077d027e468e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:11.155534 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 764/1532] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:21:11.157582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b03eb1-0f2b-4b85-b096-e3a6647df95a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:11.160131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-02b03eb1-0f2b-4b85-b096-e3a6647df95a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:11.197988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b03eb1-0f2b-4b85-b096-e3a6647df95a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:11.206387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bc41a-ff72-4d1b-82c3-4ccee0a5775b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:11.207167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bc41a-ff72-4d1b-82c3-4ccee0a5775b admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:11.208143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bc41a-ff72-4d1b-82c3-4ccee0a5775b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:11.208422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bc41a-ff72-4d1b-82c3-4ccee0a5775b admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:11.209216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bc41a-ff72-4d1b-82c3-4ccee0a5775b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:11.211516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bc41a-ff72-4d1b-82c3-4ccee0a5775b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:11.245589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c9db3b02-d882-40dc-9c44-077d027e468e None None] MFA Rules not processed for user `9b359391fbc34c259d987e42e8826c86`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:11.247144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c9db3b02-d882-40dc-9c44-077d027e468e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:11.253738 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 765/1533] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:11.255977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bc41a-ff72-4d1b-82c3-4ccee0a5775b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:11.280376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bc41a-ff72-4d1b-82c3-4ccee0a5775b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:11.287067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc9ea5-30b6-4216-846e-ce61ca562f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:11.288578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc9ea5-30b6-4216-846e-ce61ca562f76 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:11.289107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc9ea5-30b6-4216-846e-ce61ca562f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:11.289590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc9ea5-30b6-4216-846e-ce61ca562f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:11.291609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc9ea5-30b6-4216-846e-ce61ca562f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:11.294145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc9ea5-30b6-4216-846e-ce61ca562f76 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:11.435333 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 766/1534] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:11 2022] POST /identity/v3/projects => generated 375 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:11.436559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc9ea5-30b6-4216-846e-ce61ca562f76 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:11.444855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6edc9ea5-30b6-4216-846e-ce61ca562f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:11.454000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:11.474348 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 769/1535] 10.222.0.18 () {58 vars in 1015 bytes} [Thu Oct 27 03:21:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:11.475896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db3b02-d882-40dc-9c44-077d027e468e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:11.503754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db3b02-d882-40dc-9c44-077d027e468e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:11.602242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc4a98-9b1f-4460-9fd7-92827cfecab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:11.602966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc4a98-9b1f-4460-9fd7-92827cfecab1 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:11.603223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc4a98-9b1f-4460-9fd7-92827cfecab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:11.603500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc4a98-9b1f-4460-9fd7-92827cfecab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:11.604177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc4a98-9b1f-4460-9fd7-92827cfecab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:11.607454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc4a98-9b1f-4460-9fd7-92827cfecab1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:11.624568 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 770/1536] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:11.626320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc4a98-9b1f-4460-9fd7-92827cfecab1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:11.638531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc4a98-9b1f-4460-9fd7-92827cfecab1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:11.645790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69822ed-2af9-4ed3-80a1-ebe833926f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:11.646855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69822ed-2af9-4ed3-80a1-ebe833926f9e admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:11.647160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69822ed-2af9-4ed3-80a1-ebe833926f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:11.647438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69822ed-2af9-4ed3-80a1-ebe833926f9e admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:11.648873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69822ed-2af9-4ed3-80a1-ebe833926f9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:11.651263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69822ed-2af9-4ed3-80a1-ebe833926f9e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:11.706200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc9ea5-30b6-4216-846e-ce61ca562f76 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:11.730648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4aaf1-9702-4c6e-8f0f-8f4442bb0602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:11.750517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4aaf1-9702-4c6e-8f0f-8f4442bb0602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:11.750517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4aaf1-9702-4c6e-8f0f-8f4442bb0602 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:11.750517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4aaf1-9702-4c6e-8f0f-8f4442bb0602 admin admin] PATH_INFO: `/v3/users/3b7efdee7be643ddade53144cec6d07c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:11.751693 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 771/1537] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:11 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:11.753084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69822ed-2af9-4ed3-80a1-ebe833926f9e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:11.756269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c69822ed-2af9-4ed3-80a1-ebe833926f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:11.757748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4aaf1-9702-4c6e-8f0f-8f4442bb0602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b7efdee7be643ddade53144cec6d07c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:11.766845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4aaf1-9702-4c6e-8f0f-8f4442bb0602 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:11.914626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69822ed-2af9-4ed3-80a1-ebe833926f9e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:11.919658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a58a13-5cfa-4b8b-8303-f03154b68bae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:11.921854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a58a13-5cfa-4b8b-8303-f03154b68bae service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:11.924238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a58a13-5cfa-4b8b-8303-f03154b68bae service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:11.924607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a58a13-5cfa-4b8b-8303-f03154b68bae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:11.941028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a58a13-5cfa-4b8b-8303-f03154b68bae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:11.950202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a58a13-5cfa-4b8b-8303-f03154b68bae service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:11.973715 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 772/1538] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:11.975195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a58a13-5cfa-4b8b-8303-f03154b68bae service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:11.993851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a58a13-5cfa-4b8b-8303-f03154b68bae service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:12.023861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0199f8-a2f4-4fa3-b3e7-0f023324eb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:12.024912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0199f8-a2f4-4fa3-b3e7-0f023324eb56 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:12.025470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0199f8-a2f4-4fa3-b3e7-0f023324eb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:12.026289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0199f8-a2f4-4fa3-b3e7-0f023324eb56 admin admin] PATH_INFO: `/v3/projects/4a1f4a66977f45ba8cc988db0eef4ce9/users/cced1d7bdec74ae69545e09602491712/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:12.054763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-85b4aaf1-9702-4c6e-8f0f-8f4442bb0602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b7efdee7be643ddade53144cec6d07c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:12.056173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0199f8-a2f4-4fa3-b3e7-0f023324eb56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a1f4a66977f45ba8cc988db0eef4ce9, user_id=cced1d7bdec74ae69545e09602491712, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:12.056473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-85b4aaf1-9702-4c6e-8f0f-8f4442bb0602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b7efdee7be643ddade53144cec6d07c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:12.060866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0199f8-a2f4-4fa3-b3e7-0f023324eb56 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:12.077236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-85b4aaf1-9702-4c6e-8f0f-8f4442bb0602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b7efdee7be643ddade53144cec6d07c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:12.100337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-85b4aaf1-9702-4c6e-8f0f-8f4442bb0602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b7efdee7be643ddade53144cec6d07c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:12.161393 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 773/1539] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:11 2022] PUT /identity/v3/projects/4a1f4a66977f45ba8cc988db0eef4ce9/users/cced1d7bdec74ae69545e09602491712/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:12.163527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0199f8-a2f4-4fa3-b3e7-0f023324eb56 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:12.165699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bb0199f8-a2f4-4fa3-b3e7-0f023324eb56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:12.182745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-85b4aaf1-9702-4c6e-8f0f-8f4442bb0602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b7efdee7be643ddade53144cec6d07c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:12.196828 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 767/1540] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:11 2022] DELETE /identity/v3/users/3b7efdee7be643ddade53144cec6d07c => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:12.199174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce5ae7-eb4c-47d3-a4be-148bb1784b65 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:12.200620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce5ae7-eb4c-47d3-a4be-148bb1784b65 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:12.202803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce5ae7-eb4c-47d3-a4be-148bb1784b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:12.269080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-91ce5ae7-eb4c-47d3-a4be-148bb1784b65 None None] MFA Rules not processed for user `cced1d7bdec74ae69545e09602491712`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:12.270450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-91ce5ae7-eb4c-47d3-a4be-148bb1784b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:12.280574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:12.310572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:12.349253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0199f8-a2f4-4fa3-b3e7-0f023324eb56 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:12.490973 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 768/1541] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:12 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:12.496049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1929f-5618-4a94-87e0-0a7871a54d43 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:12.496349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1929f-5618-4a94-87e0-0a7871a54d43 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:12.496860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1929f-5618-4a94-87e0-0a7871a54d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:12.547707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-7ce1929f-5618-4a94-87e0-0a7871a54d43 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:12.551996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7ce1929f-5618-4a94-87e0-0a7871a54d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:12.555075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96392e13-75db-4b82-99e0-13cde0769229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:12.556258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96392e13-75db-4b82-99e0-13cde0769229 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:12.556683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96392e13-75db-4b82-99e0-13cde0769229 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:12.557098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96392e13-75db-4b82-99e0-13cde0769229 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:12.558130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96392e13-75db-4b82-99e0-13cde0769229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:12.560069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96392e13-75db-4b82-99e0-13cde0769229 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:12.572596 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 774/1542] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:12.573745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96392e13-75db-4b82-99e0-13cde0769229 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:12.583347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-96392e13-75db-4b82-99e0-13cde0769229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:12.599169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96392e13-75db-4b82-99e0-13cde0769229 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:12.609016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e6c31-db45-4167-9018-4af019ad08fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:12.609016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e6c31-db45-4167-9018-4af019ad08fc admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:12.609016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e6c31-db45-4167-9018-4af019ad08fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:12.609016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e6c31-db45-4167-9018-4af019ad08fc admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:12.610219 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 769/1543] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:12.611568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1929f-5618-4a94-87e0-0a7871a54d43 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:12.617663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e6c31-db45-4167-9018-4af019ad08fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:12.620022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e6c31-db45-4167-9018-4af019ad08fc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:12.636361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1929f-5618-4a94-87e0-0a7871a54d43 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:12.642794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d8c2a-131e-4ed9-898d-561ca0f35da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:12.643624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d8c2a-131e-4ed9-898d-561ca0f35da2 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:12.644095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d8c2a-131e-4ed9-898d-561ca0f35da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:12.644563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d8c2a-131e-4ed9-898d-561ca0f35da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:12.645487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d8c2a-131e-4ed9-898d-561ca0f35da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:12.648092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d8c2a-131e-4ed9-898d-561ca0f35da2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:12.665113 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 770/1544] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:12.666291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d8c2a-131e-4ed9-898d-561ca0f35da2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:12.671022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8d1d8c2a-131e-4ed9-898d-561ca0f35da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:12.747368 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 775/1545] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:12 2022] POST /identity/v3/projects => generated 397 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:12.748549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e6c31-db45-4167-9018-4af019ad08fc admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:12.918847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d8c2a-131e-4ed9-898d-561ca0f35da2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:12.975403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e6c31-db45-4167-9018-4af019ad08fc admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:12.985786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07aee5-86dc-4702-ad8a-fc1ec6e6c652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:12.986882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07aee5-86dc-4702-ad8a-fc1ec6e6c652 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:12.988130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07aee5-86dc-4702-ad8a-fc1ec6e6c652 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:12.988703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07aee5-86dc-4702-ad8a-fc1ec6e6c652 admin admin] PATH_INFO: `/v3/projects/48e708fb3bdd45bc976db7bd92af09c8/users/d3f1177e2cbd4ba6b659f8a714be86ac/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:13.027783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07aee5-86dc-4702-ad8a-fc1ec6e6c652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e708fb3bdd45bc976db7bd92af09c8, user_id=d3f1177e2cbd4ba6b659f8a714be86ac, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:13.031026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07aee5-86dc-4702-ad8a-fc1ec6e6c652 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:13.098851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd1f78-403e-4445-9cdf-73049a720b5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:13.100997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd1f78-403e-4445-9cdf-73049a720b5c service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:13.101359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd1f78-403e-4445-9cdf-73049a720b5c service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:13.104619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd1f78-403e-4445-9cdf-73049a720b5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:13.110534 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 776/1546] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:12 2022] PUT /identity/v3/projects/48e708fb3bdd45bc976db7bd92af09c8/users/d3f1177e2cbd4ba6b659f8a714be86ac/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:13.115329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07aee5-86dc-4702-ad8a-fc1ec6e6c652 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:13.140235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd1f78-403e-4445-9cdf-73049a720b5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:13.141899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd1f78-403e-4445-9cdf-73049a720b5c service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:13.182825 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 771/1547] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:13.189353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58fad2-3c4e-40a7-bc8f-a300b22ead8b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:13.190060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58fad2-3c4e-40a7-bc8f-a300b22ead8b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:13.190060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58fad2-3c4e-40a7-bc8f-a300b22ead8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:13.295774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:13.298810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1f58fad2-3c4e-40a7-bc8f-a300b22ead8b None None] MFA Rules not processed for user `d3f1177e2cbd4ba6b659f8a714be86ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:13.302352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1f58fad2-3c4e-40a7-bc8f-a300b22ead8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:13.308887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07aee5-86dc-4702-ad8a-fc1ec6e6c652 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:13.328178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b6536-eb02-4338-8385-e5d16c616bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:13.328838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b6536-eb02-4338-8385-e5d16c616bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:13.329123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b6536-eb02-4338-8385-e5d16c616bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:13.331284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b6536-eb02-4338-8385-e5d16c616bb6 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:13.331952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b6536-eb02-4338-8385-e5d16c616bb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:13.337098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b6536-eb02-4338-8385-e5d16c616bb6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:13.411968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:13.471465 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 772/1548] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:13.476319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58fad2-3c4e-40a7-bc8f-a300b22ead8b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:13.495096 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 777/1549] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:13 2022] POST /identity/v3/users => generated 305 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:13.498008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b6536-eb02-4338-8385-e5d16c616bb6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:13.498909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58fad2-3c4e-40a7-bc8f-a300b22ead8b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:13.504798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07118402-b41c-429b-972f-093781b762be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:13.505712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07118402-b41c-429b-972f-093781b762be admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:13.506268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07118402-b41c-429b-972f-093781b762be admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:13.506756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07118402-b41c-429b-972f-093781b762be admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:13.507733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07118402-b41c-429b-972f-093781b762be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:13.510796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07118402-b41c-429b-972f-093781b762be admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:13.541745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b6536-eb02-4338-8385-e5d16c616bb6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:13.583349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ddf3d-6f89-4583-ac37-d9fd0029f584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:13.585184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ddf3d-6f89-4583-ac37-d9fd0029f584 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:13.585994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ddf3d-6f89-4583-ac37-d9fd0029f584 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:13.592060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ddf3d-6f89-4583-ac37-d9fd0029f584 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:13.594149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ddf3d-6f89-4583-ac37-d9fd0029f584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:13.599466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ddf3d-6f89-4583-ac37-d9fd0029f584 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:13.634994 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 778/1550] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:13.639941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ddf3d-6f89-4583-ac37-d9fd0029f584 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:13.655022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ddf3d-6f89-4583-ac37-d9fd0029f584 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:13.666901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacbf40-7119-488f-b5e1-f1afe92f6bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:13.673779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacbf40-7119-488f-b5e1-f1afe92f6bca admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:13.673779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacbf40-7119-488f-b5e1-f1afe92f6bca admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:13.673779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacbf40-7119-488f-b5e1-f1afe92f6bca admin admin] PATH_INFO: `/v3/projects/124903834b6745c899d644b7fa6c36f2/users/a5dd1f3cbb394266a14f25c332bbbcc9/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:13.690727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacbf40-7119-488f-b5e1-f1afe92f6bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=124903834b6745c899d644b7fa6c36f2, user_id=a5dd1f3cbb394266a14f25c332bbbcc9, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:13.699872 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 773/1551] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:13 2022] POST /identity/v3/projects => generated 373 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:13.704760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacbf40-7119-488f-b5e1-f1afe92f6bca admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:13.705308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07118402-b41c-429b-972f-093781b762be admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:13.787051 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 779/1552] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:13 2022] PUT /identity/v3/projects/124903834b6745c899d644b7fa6c36f2/users/a5dd1f3cbb394266a14f25c332bbbcc9/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:13.791584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacbf40-7119-488f-b5e1-f1afe92f6bca admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:13.925002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07118402-b41c-429b-972f-093781b762be admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:14.019388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacbf40-7119-488f-b5e1-f1afe92f6bca admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:14.041630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db681da9-9489-48c1-b8b5-946b51941070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:14.044952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db681da9-9489-48c1-b8b5-946b51941070 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:14.045379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db681da9-9489-48c1-b8b5-946b51941070 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:14.045749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db681da9-9489-48c1-b8b5-946b51941070 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:14.046835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db681da9-9489-48c1-b8b5-946b51941070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:14.048695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db681da9-9489-48c1-b8b5-946b51941070 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:14.094554 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 780/1553] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:21:14.109697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db681da9-9489-48c1-b8b5-946b51941070 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:14.111702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db681da9-9489-48c1-b8b5-946b51941070 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:14.118972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08f071-86f2-4c6f-9c80-a9a72e697c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:14.119915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08f071-86f2-4c6f-9c80-a9a72e697c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:14.120405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08f071-86f2-4c6f-9c80-a9a72e697c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:14.120828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08f071-86f2-4c6f-9c80-a9a72e697c45 admin admin] PATH_INFO: `/v3/projects/124903834b6745c899d644b7fa6c36f2/users/a5dd1f3cbb394266a14f25c332bbbcc9/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:14.123422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08f071-86f2-4c6f-9c80-a9a72e697c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=124903834b6745c899d644b7fa6c36f2, user_id=a5dd1f3cbb394266a14f25c332bbbcc9, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:14.129409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08f071-86f2-4c6f-9c80-a9a72e697c45 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:14.166123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2557304-585a-4971-b6cc-6da364933b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:14.166746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2557304-585a-4971-b6cc-6da364933b6a admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:14.167028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2557304-585a-4971-b6cc-6da364933b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:14.167336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2557304-585a-4971-b6cc-6da364933b6a admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:14.167460 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 781/1554] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:14 2022] PUT /identity/v3/projects/124903834b6745c899d644b7fa6c36f2/users/a5dd1f3cbb394266a14f25c332bbbcc9/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:14.167926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2557304-585a-4971-b6cc-6da364933b6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:14.168315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08f071-86f2-4c6f-9c80-a9a72e697c45 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:14.169880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2557304-585a-4971-b6cc-6da364933b6a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:14.175820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4e08f071-86f2-4c6f-9c80-a9a72e697c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:14.350202 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 774/1555] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:13 2022] POST /identity/v3/users => generated 293 bytes in 645 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:14.351877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff084053-e13f-4126-a20a-77d46487c4a3 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:14.351877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff084053-e13f-4126-a20a-77d46487c4a3 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:14.352161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff084053-e13f-4126-a20a-77d46487c4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:14.434311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08f071-86f2-4c6f-9c80-a9a72e697c45 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:14.451023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ff084053-e13f-4126-a20a-77d46487c4a3 None None] MFA Rules not processed for user `a5dd1f3cbb394266a14f25c332bbbcc9`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:14.452271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ff084053-e13f-4126-a20a-77d46487c4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:14.452391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13530a-c333-439f-b238-20d772124758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:14.453288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13530a-c333-439f-b238-20d772124758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:14.454624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13530a-c333-439f-b238-20d772124758 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:14.455081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13530a-c333-439f-b238-20d772124758 admin admin] PATH_INFO: `/v3/projects/1153299025194196bccd2bcf88717515` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:14.456677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13530a-c333-439f-b238-20d772124758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1153299025194196bccd2bcf88717515)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:14.459432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13530a-c333-439f-b238-20d772124758 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:14.608096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:14.653395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:14.681244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5c13530a-c333-439f-b238-20d772124758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1153299025194196bccd2bcf88717515', 'request_id': 'req-5c13530a-c333-439f-b238-20d772124758'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:14.707389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5c13530a-c333-439f-b238-20d772124758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1153299025194196bccd2bcf88717515', 'request_id': 'req-5c13530a-c333-439f-b238-20d772124758'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:14.736609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5c13530a-c333-439f-b238-20d772124758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1153299025194196bccd2bcf88717515', 'request_id': 'req-5c13530a-c333-439f-b238-20d772124758'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:14.756226 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 775/1556] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:14 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:14.762427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff084053-e13f-4126-a20a-77d46487c4a3 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:14.789861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff084053-e13f-4126-a20a-77d46487c4a3 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:14.838489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5c13530a-c333-439f-b238-20d772124758 admin admin] The token cache is being invalidate because project 1153299025194196bccd2bcf88717515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:14.838918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5c13530a-c333-439f-b238-20d772124758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:14.839897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5c13530a-c333-439f-b238-20d772124758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:14.852867 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 782/1557] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:14 2022] DELETE /identity/v3/projects/1153299025194196bccd2bcf88717515 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:14.862647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13530a-c333-439f-b238-20d772124758 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:14.867705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5c13530a-c333-439f-b238-20d772124758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:15.003714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b42206-2900-498b-85dd-938023843e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:15.004726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b42206-2900-498b-85dd-938023843e72 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:15.005213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b42206-2900-498b-85dd-938023843e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:15.005618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b42206-2900-498b-85dd-938023843e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:15.007503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b42206-2900-498b-85dd-938023843e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:15.013563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b42206-2900-498b-85dd-938023843e72 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:15.050365 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 776/1558] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:15.051252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b42206-2900-498b-85dd-938023843e72 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:15.065018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-00b42206-2900-498b-85dd-938023843e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:15.113595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b42206-2900-498b-85dd-938023843e72 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:15.131445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07f610-f75b-4db1-a020-2a6b1ccfea27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:15.132119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07f610-f75b-4db1-a020-2a6b1ccfea27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:15.132400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07f610-f75b-4db1-a020-2a6b1ccfea27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:15.132680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07f610-f75b-4db1-a020-2a6b1ccfea27 admin admin] PATH_INFO: `/v3/users/a68f7ce9bc084d7298bf248e24c4cfce` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:15.135336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07f610-f75b-4db1-a020-2a6b1ccfea27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a68f7ce9bc084d7298bf248e24c4cfce)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:15.137303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07f610-f75b-4db1-a020-2a6b1ccfea27 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:15.167714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13530a-c333-439f-b238-20d772124758 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:15.194078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4b740-bc26-4882-81ab-b6f6eab233c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:15.194916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4b740-bc26-4882-81ab-b6f6eab233c5 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:15.199175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4b740-bc26-4882-81ab-b6f6eab233c5 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:15.199783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4b740-bc26-4882-81ab-b6f6eab233c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:15.214529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cbb4b740-bc26-4882-81ab-b6f6eab233c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:15.383945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0d07f610-f75b-4db1-a020-2a6b1ccfea27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a68f7ce9bc084d7298bf248e24c4cfce'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:15.384664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0d07f610-f75b-4db1-a020-2a6b1ccfea27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a68f7ce9bc084d7298bf248e24c4cfce'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:15.401448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0d07f610-f75b-4db1-a020-2a6b1ccfea27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a68f7ce9bc084d7298bf248e24c4cfce'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:15.436014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0d07f610-f75b-4db1-a020-2a6b1ccfea27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a68f7ce9bc084d7298bf248e24c4cfce'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:15.450333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4b740-bc26-4882-81ab-b6f6eab233c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:15.457291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4b740-bc26-4882-81ab-b6f6eab233c5 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:15.473231 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 783/1559] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:14 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:15.474910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4b740-bc26-4882-81ab-b6f6eab233c5 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:15.477752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cbb4b740-bc26-4882-81ab-b6f6eab233c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:15.509204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4b740-bc26-4882-81ab-b6f6eab233c5 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:15.519624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc7ebe-d2ea-426c-ad1a-3f71c4a24821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:15.520804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc7ebe-d2ea-426c-ad1a-3f71c4a24821 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:15.521111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc7ebe-d2ea-426c-ad1a-3f71c4a24821 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:15.522284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc7ebe-d2ea-426c-ad1a-3f71c4a24821 admin admin] PATH_INFO: `/v3/projects/333b6e5cda4e482ab1ce3f241ec6cfe9/users/4e8002bf6ca34327b2d4faa37f93c6ac/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:15.554395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0d07f610-f75b-4db1-a020-2a6b1ccfea27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a68f7ce9bc084d7298bf248e24c4cfce'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:15.566666 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 777/1560] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:15 2022] DELETE /identity/v3/users/a68f7ce9bc084d7298bf248e24c4cfce => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:15.568149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01924d-f455-40b3-aab6-59f0d78180dc None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:15.568441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01924d-f455-40b3-aab6-59f0d78180dc None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:15.568916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01924d-f455-40b3-aab6-59f0d78180dc None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:15.575614 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 778/1561] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 27 03:21:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:21:15.581054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01924d-f455-40b3-aab6-59f0d78180dc None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:15.584614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ed01924d-f455-40b3-aab6-59f0d78180dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:15.586058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc7ebe-d2ea-426c-ad1a-3f71c4a24821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=333b6e5cda4e482ab1ce3f241ec6cfe9, user_id=4e8002bf6ca34327b2d4faa37f93c6ac, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:15.596374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc7ebe-d2ea-426c-ad1a-3f71c4a24821 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:15.670502 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 784/1562] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:15 2022] PUT /identity/v3/projects/333b6e5cda4e482ab1ce3f241ec6cfe9/users/4e8002bf6ca34327b2d4faa37f93c6ac/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:15.672506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339384b1-5190-41be-8589-8693f8b1687d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:15.677050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339384b1-5190-41be-8589-8693f8b1687d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:15.677758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339384b1-5190-41be-8589-8693f8b1687d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:15.733157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:15.789696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01924d-f455-40b3-aab6-59f0d78180dc None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:15.802776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-339384b1-5190-41be-8589-8693f8b1687d None None] MFA Rules not processed for user `c20881251f2241a3a5ec2e5cf99db149`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:15.811224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-339384b1-5190-41be-8589-8693f8b1687d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:15.961020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04cf26-6eea-4cd0-90b1-cc7063dd049f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:15.961996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04cf26-6eea-4cd0-90b1-cc7063dd049f service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:15.962982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04cf26-6eea-4cd0-90b1-cc7063dd049f service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:15.963638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04cf26-6eea-4cd0-90b1-cc7063dd049f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:15.969751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2a04cf26-6eea-4cd0-90b1-cc7063dd049f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:16.013411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:16.119538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a04cf26-6eea-4cd0-90b1-cc7063dd049f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:16.121448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a04cf26-6eea-4cd0-90b1-cc7063dd049f service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:16.143300 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 779/1563] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:15 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:16.144298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04cf26-6eea-4cd0-90b1-cc7063dd049f service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:16.145658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2a04cf26-6eea-4cd0-90b1-cc7063dd049f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:16.209381 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 785/1564] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 03:21:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 538 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:16.271385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04cf26-6eea-4cd0-90b1-cc7063dd049f service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:16.294914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725cf0b-9b90-4be3-ac91-3a348646b542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:16.294914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725cf0b-9b90-4be3-ac91-3a348646b542 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:16.294914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725cf0b-9b90-4be3-ac91-3a348646b542 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:16.294914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725cf0b-9b90-4be3-ac91-3a348646b542 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:16.300159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725cf0b-9b90-4be3-ac91-3a348646b542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:16.300159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725cf0b-9b90-4be3-ac91-3a348646b542 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:16.310725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339384b1-5190-41be-8589-8693f8b1687d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:16.341161 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 780/1565] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:16.342271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725cf0b-9b90-4be3-ac91-3a348646b542 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:16.343036 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339384b1-5190-41be-8589-8693f8b1687d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:16.348573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5725cf0b-9b90-4be3-ac91-3a348646b542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:16.359795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246aced-4c8e-4f60-8d56-a9b0a161319f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:16.362150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246aced-4c8e-4f60-8d56-a9b0a161319f service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:16.362571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246aced-4c8e-4f60-8d56-a9b0a161319f service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:16.363441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246aced-4c8e-4f60-8d56-a9b0a161319f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:16.380391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246aced-4c8e-4f60-8d56-a9b0a161319f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:16.382307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246aced-4c8e-4f60-8d56-a9b0a161319f service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:16.388520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725cf0b-9b90-4be3-ac91-3a348646b542 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:16.400773 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9470fe-b760-466b-85ef-77548096cd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:16.401488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9470fe-b760-466b-85ef-77548096cd0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:16.401868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9470fe-b760-466b-85ef-77548096cd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:16.402268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9470fe-b760-466b-85ef-77548096cd0c admin admin] PATH_INFO: `/v3/projects/9bd4af5222dd421f8b4036c6e052d5b9` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:16.403411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9470fe-b760-466b-85ef-77548096cd0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bd4af5222dd421f8b4036c6e052d5b9)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:16.405423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9470fe-b760-466b-85ef-77548096cd0c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:16.429270 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 786/1566] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:21:16.430718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246aced-4c8e-4f60-8d56-a9b0a161319f service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:16.432329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:16.467595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246aced-4c8e-4f60-8d56-a9b0a161319f service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:16.500099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3203281-eb36-4bf3-96c7-1bfdd25e9556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:16.509657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3203281-eb36-4bf3-96c7-1bfdd25e9556 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:16.510296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3203281-eb36-4bf3-96c7-1bfdd25e9556 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:16.511658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3203281-eb36-4bf3-96c7-1bfdd25e9556 admin admin] PATH_INFO: `/v3/projects/333b6e5cda4e482ab1ce3f241ec6cfe9/users/4e8002bf6ca34327b2d4faa37f93c6ac/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:16.525495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3203281-eb36-4bf3-96c7-1bfdd25e9556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=333b6e5cda4e482ab1ce3f241ec6cfe9, user_id=4e8002bf6ca34327b2d4faa37f93c6ac, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:16.535815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3203281-eb36-4bf3-96c7-1bfdd25e9556 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:16.603673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5f9470fe-b760-466b-85ef-77548096cd0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bd4af5222dd421f8b4036c6e052d5b9', 'request_id': 'req-5f9470fe-b760-466b-85ef-77548096cd0c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:16.634109 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 787/1567] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:16 2022] PUT /identity/v3/projects/333b6e5cda4e482ab1ce3f241ec6cfe9/users/4e8002bf6ca34327b2d4faa37f93c6ac/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:16.649323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116fc30-2a2a-45b3-81f2-4a98249ba0fb None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:16.649632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116fc30-2a2a-45b3-81f2-4a98249ba0fb None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:16.649989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116fc30-2a2a-45b3-81f2-4a98249ba0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:16.691167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5f9470fe-b760-466b-85ef-77548096cd0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bd4af5222dd421f8b4036c6e052d5b9', 'request_id': 'req-5f9470fe-b760-466b-85ef-77548096cd0c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:16.700082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5f9470fe-b760-466b-85ef-77548096cd0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bd4af5222dd421f8b4036c6e052d5b9', 'request_id': 'req-5f9470fe-b760-466b-85ef-77548096cd0c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:16.731919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5f9470fe-b760-466b-85ef-77548096cd0c admin admin] The token cache is being invalidate because project 9bd4af5222dd421f8b4036c6e052d5b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:16.732261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5f9470fe-b760-466b-85ef-77548096cd0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:16.734526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5f9470fe-b760-466b-85ef-77548096cd0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:16.741849 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 781/1568] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:16 2022] DELETE /identity/v3/projects/9bd4af5222dd421f8b4036c6e052d5b9 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:16.743499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efe6ea-d2e1-44de-be68-1c2619326930 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:16.743849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efe6ea-d2e1-44de-be68-1c2619326930 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:16.744279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efe6ea-d2e1-44de-be68-1c2619326930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:16.792773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9116fc30-2a2a-45b3-81f2-4a98249ba0fb None None] MFA Rules not processed for user `4e8002bf6ca34327b2d4faa37f93c6ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:16.798253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9116fc30-2a2a-45b3-81f2-4a98249ba0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:16.817341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-42efe6ea-d2e1-44de-be68-1c2619326930 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:16.821522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-42efe6ea-d2e1-44de-be68-1c2619326930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:17.063703 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 782/1569] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:17.063703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efe6ea-d2e1-44de-be68-1c2619326930 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:17.063703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-42efe6ea-d2e1-44de-be68-1c2619326930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:17.085931 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 788/1570] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:17.088047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7491b5-f797-4d87-af44-d178f672a41f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:17.090347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7491b5-f797-4d87-af44-d178f672a41f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:17.090918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7491b5-f797-4d87-af44-d178f672a41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:17.094270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efe6ea-d2e1-44de-be68-1c2619326930 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:17.103673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb828877-bb19-43b9-8be8-09051a257d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:17.104608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb828877-bb19-43b9-8be8-09051a257d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:17.104932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb828877-bb19-43b9-8be8-09051a257d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:17.105183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb828877-bb19-43b9-8be8-09051a257d7b admin admin] PATH_INFO: `/v3/users/cced1d7bdec74ae69545e09602491712` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:17.108957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb828877-bb19-43b9-8be8-09051a257d7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cced1d7bdec74ae69545e09602491712)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:17.110973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb828877-bb19-43b9-8be8-09051a257d7b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:17.162692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1b7491b5-f797-4d87-af44-d178f672a41f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:17.164386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1b7491b5-f797-4d87-af44-d178f672a41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:17.194337 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 789/1571] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:17.195398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f515c-b826-44f2-adf0-d8309c86df01 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:17.195398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f515c-b826-44f2-adf0-d8309c86df01 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:17.195589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f515c-b826-44f2-adf0-d8309c86df01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:17.273381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-759f515c-b826-44f2-adf0-d8309c86df01 None None] MFA Rules not processed for user `d3f1177e2cbd4ba6b659f8a714be86ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:17.275020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-759f515c-b826-44f2-adf0-d8309c86df01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:17.382251 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 790/1572] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:17.383797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f515c-b826-44f2-adf0-d8309c86df01 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:17.400295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f515c-b826-44f2-adf0-d8309c86df01 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:17.417308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4fea0-2dd4-40bd-86df-b25e355160a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:17.418193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4fea0-2dd4-40bd-86df-b25e355160a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:17.419282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4fea0-2dd4-40bd-86df-b25e355160a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:17.419594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4fea0-2dd4-40bd-86df-b25e355160a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:17.421019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4fea0-2dd4-40bd-86df-b25e355160a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:21:17.421378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4fea0-2dd4-40bd-86df-b25e355160a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:17.424866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4fea0-2dd4-40bd-86df-b25e355160a9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:17.448985 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 791/1573] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:21:17.450090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4fea0-2dd4-40bd-86df-b25e355160a9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:17.454612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1fb4fea0-2dd4-40bd-86df-b25e355160a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:17.475257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:17.496046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb828877-bb19-43b9-8be8-09051a257d7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cced1d7bdec74ae69545e09602491712'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:17.497735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb828877-bb19-43b9-8be8-09051a257d7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cced1d7bdec74ae69545e09602491712'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:17.528503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb828877-bb19-43b9-8be8-09051a257d7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cced1d7bdec74ae69545e09602491712'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:17.567957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb828877-bb19-43b9-8be8-09051a257d7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cced1d7bdec74ae69545e09602491712'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:17.624245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4fea0-2dd4-40bd-86df-b25e355160a9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:17.633878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5a2e9-685b-4dc9-8266-692655b00a1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:17.636562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5a2e9-685b-4dc9-8266-692655b00a1d service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:17.636562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5a2e9-685b-4dc9-8266-692655b00a1d service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:17.636562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5a2e9-685b-4dc9-8266-692655b00a1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:17.639881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f9e5a2e9-685b-4dc9-8266-692655b00a1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:17.657992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb828877-bb19-43b9-8be8-09051a257d7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cced1d7bdec74ae69545e09602491712'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:17.663552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5a2e9-685b-4dc9-8266-692655b00a1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:17.668472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5a2e9-685b-4dc9-8266-692655b00a1d service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:17.685704 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 783/1574] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:17 2022] DELETE /identity/v3/users/cced1d7bdec74ae69545e09602491712 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:17.692931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb828877-bb19-43b9-8be8-09051a257d7b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:17.706956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bb828877-bb19-43b9-8be8-09051a257d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:17.707777 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 792/1575] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:17.710278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2910fa5-6a13-406e-8235-0418fd7b8d47 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:17.710735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2910fa5-6a13-406e-8235-0418fd7b8d47 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:17.711232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2910fa5-6a13-406e-8235-0418fd7b8d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:17.761741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:17.782937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a2910fa5-6a13-406e-8235-0418fd7b8d47 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:17.787591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a2910fa5-6a13-406e-8235-0418fd7b8d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:17.908662 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 793/1576] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:17.925493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2910fa5-6a13-406e-8235-0418fd7b8d47 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:17.931232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a2910fa5-6a13-406e-8235-0418fd7b8d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:17.947832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb828877-bb19-43b9-8be8-09051a257d7b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:17.961991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676bf1f-05ab-4c87-a2f9-548add2ac74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:17.963164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676bf1f-05ab-4c87-a2f9-548add2ac74c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:17.963543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676bf1f-05ab-4c87-a2f9-548add2ac74c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:17.964322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676bf1f-05ab-4c87-a2f9-548add2ac74c admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:17.966348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676bf1f-05ab-4c87-a2f9-548add2ac74c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:17.971125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676bf1f-05ab-4c87-a2f9-548add2ac74c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:18.027237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2910fa5-6a13-406e-8235-0418fd7b8d47 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:18.033993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbd230-cea9-4ba5-8cf2-7478bb4088e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:18.037012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbd230-cea9-4ba5-8cf2-7478bb4088e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:18.037012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbd230-cea9-4ba5-8cf2-7478bb4088e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:18.037012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbd230-cea9-4ba5-8cf2-7478bb4088e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:18.047791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbd230-cea9-4ba5-8cf2-7478bb4088e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:18.049538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbd230-cea9-4ba5-8cf2-7478bb4088e2 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:18.059582 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 794/1577] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:18.118271 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 784/1578] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:17 2022] POST /identity/v3/projects => generated 391 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:18.122283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbd230-cea9-4ba5-8cf2-7478bb4088e2 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:18.146367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbd230-cea9-4ba5-8cf2-7478bb4088e2 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:18.268176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:18.297954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef75a1a-57c0-4df8-8152-37007c007744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:18.298626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef75a1a-57c0-4df8-8152-37007c007744 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:18.299135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef75a1a-57c0-4df8-8152-37007c007744 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:18.299419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef75a1a-57c0-4df8-8152-37007c007744 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:18.300515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef75a1a-57c0-4df8-8152-37007c007744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:18.302638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef75a1a-57c0-4df8-8152-37007c007744 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:18.407548 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 795/1579] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:18 2022] POST /identity/v3/users => generated 296 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:21:18.419028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676bf1f-05ab-4c87-a2f9-548add2ac74c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:18.435069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676bf1f-05ab-4c87-a2f9-548add2ac74c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:18.440901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873bd4b-8e40-4b3d-bcc4-0677378fd5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:18.441677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873bd4b-8e40-4b3d-bcc4-0677378fd5ca admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:18.441975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873bd4b-8e40-4b3d-bcc4-0677378fd5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:18.442407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873bd4b-8e40-4b3d-bcc4-0677378fd5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:18.443210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873bd4b-8e40-4b3d-bcc4-0677378fd5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:18.445545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873bd4b-8e40-4b3d-bcc4-0677378fd5ca admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:18.467184 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 785/1580] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:18.471199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef75a1a-57c0-4df8-8152-37007c007744 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:18.501499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef75a1a-57c0-4df8-8152-37007c007744 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:18.518240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a7524-82e5-4820-be81-1546b6f00098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:18.519706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a7524-82e5-4820-be81-1546b6f00098 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:18.520309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a7524-82e5-4820-be81-1546b6f00098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:18.521103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a7524-82e5-4820-be81-1546b6f00098 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:18.522213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a7524-82e5-4820-be81-1546b6f00098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:18.526772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a7524-82e5-4820-be81-1546b6f00098 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:18.569019 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 796/1581] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:18.573913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873bd4b-8e40-4b3d-bcc4-0677378fd5ca admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:18.587804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873bd4b-8e40-4b3d-bcc4-0677378fd5ca admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:18.608569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c68f74-5906-4f05-93e1-9a03c68a2cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:18.609840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c68f74-5906-4f05-93e1-9a03c68a2cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:18.610150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c68f74-5906-4f05-93e1-9a03c68a2cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:18.610497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c68f74-5906-4f05-93e1-9a03c68a2cd5 admin admin] PATH_INFO: `/v3/projects/11fb9090ce414b1d9ab195faec4cc45e/users/3756b0d73d634269bec89f1be45cdc5d/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:18.645611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c68f74-5906-4f05-93e1-9a03c68a2cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11fb9090ce414b1d9ab195faec4cc45e, user_id=3756b0d73d634269bec89f1be45cdc5d, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:18.648361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c68f74-5906-4f05-93e1-9a03c68a2cd5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:18.731933 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 786/1582] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:18 2022] PUT /identity/v3/projects/11fb9090ce414b1d9ab195faec4cc45e/users/3756b0d73d634269bec89f1be45cdc5d/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:18.746606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172ed52-8fc1-4568-a65f-29f41aefd04c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:18.747150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172ed52-8fc1-4568-a65f-29f41aefd04c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:18.747628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172ed52-8fc1-4568-a65f-29f41aefd04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:18.799945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9172ed52-8fc1-4568-a65f-29f41aefd04c None None] MFA Rules not processed for user `3756b0d73d634269bec89f1be45cdc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:18.801434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9172ed52-8fc1-4568-a65f-29f41aefd04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:18.808799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c68f74-5906-4f05-93e1-9a03c68a2cd5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:18.813647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-47c68f74-5906-4f05-93e1-9a03c68a2cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:18.980455 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 797/1583] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:21:18.987345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172ed52-8fc1-4568-a65f-29f41aefd04c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:19.011057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c68f74-5906-4f05-93e1-9a03c68a2cd5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:19.016498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172ed52-8fc1-4568-a65f-29f41aefd04c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:19.027470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8857f-ce9e-4ca0-91ae-cd23a5ee42fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:19.028164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8857f-ce9e-4ca0-91ae-cd23a5ee42fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:19.028420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8857f-ce9e-4ca0-91ae-cd23a5ee42fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:19.028702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8857f-ce9e-4ca0-91ae-cd23a5ee42fb admin admin] PATH_INFO: `/v3/projects/4a1f4a66977f45ba8cc988db0eef4ce9` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:19.031383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8857f-ce9e-4ca0-91ae-cd23a5ee42fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a1f4a66977f45ba8cc988db0eef4ce9)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:19.035966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8857f-ce9e-4ca0-91ae-cd23a5ee42fb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:19.055418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b43198-8f97-40a7-8c01-043358f5e9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:19.056818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b43198-8f97-40a7-8c01-043358f5e9f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:19.057420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b43198-8f97-40a7-8c01-043358f5e9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:19.059362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b43198-8f97-40a7-8c01-043358f5e9f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:19.060929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b43198-8f97-40a7-8c01-043358f5e9f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:19.065631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b43198-8f97-40a7-8c01-043358f5e9f9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:19.193372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d4d8857f-ce9e-4ca0-91ae-cd23a5ee42fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a1f4a66977f45ba8cc988db0eef4ce9', 'request_id': 'req-d4d8857f-ce9e-4ca0-91ae-cd23a5ee42fb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:19.218138 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 798/1584] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:18 2022] POST /identity/v3/projects => generated 389 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:19.227448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b43198-8f97-40a7-8c01-043358f5e9f9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:19.255391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d4d8857f-ce9e-4ca0-91ae-cd23a5ee42fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a1f4a66977f45ba8cc988db0eef4ce9', 'request_id': 'req-d4d8857f-ce9e-4ca0-91ae-cd23a5ee42fb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:19.262342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d4d8857f-ce9e-4ca0-91ae-cd23a5ee42fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a1f4a66977f45ba8cc988db0eef4ce9', 'request_id': 'req-d4d8857f-ce9e-4ca0-91ae-cd23a5ee42fb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:19.264789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:19.275080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d4d8857f-ce9e-4ca0-91ae-cd23a5ee42fb admin admin] The token cache is being invalidate because project 4a1f4a66977f45ba8cc988db0eef4ce9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:19.275489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d4d8857f-ce9e-4ca0-91ae-cd23a5ee42fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:19.276455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d4d8857f-ce9e-4ca0-91ae-cd23a5ee42fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:19.279246 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 787/1585] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:18 2022] DELETE /identity/v3/projects/4a1f4a66977f45ba8cc988db0eef4ce9 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:19.283835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8857f-ce9e-4ca0-91ae-cd23a5ee42fb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:19.286886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d4d8857f-ce9e-4ca0-91ae-cd23a5ee42fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:19.300508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b43198-8f97-40a7-8c01-043358f5e9f9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:19.305333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fcbf8-af9c-46d5-920b-5fc0bdb05a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:19.305941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fcbf8-af9c-46d5-920b-5fc0bdb05a18 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:19.306249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fcbf8-af9c-46d5-920b-5fc0bdb05a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:19.306524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fcbf8-af9c-46d5-920b-5fc0bdb05a18 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:19.307155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fcbf8-af9c-46d5-920b-5fc0bdb05a18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:19.309102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fcbf8-af9c-46d5-920b-5fc0bdb05a18 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:19.359944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8857f-ce9e-4ca0-91ae-cd23a5ee42fb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:19.364572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a1b24-32fb-4b5d-991d-50f212dbc356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:19.367866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a1b24-32fb-4b5d-991d-50f212dbc356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:19.367866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a1b24-32fb-4b5d-991d-50f212dbc356 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:19.367866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a1b24-32fb-4b5d-991d-50f212dbc356 admin admin] PATH_INFO: `/v3/users/a5dd1f3cbb394266a14f25c332bbbcc9` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:19.367866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a1b24-32fb-4b5d-991d-50f212dbc356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5dd1f3cbb394266a14f25c332bbbcc9)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:19.369032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a1b24-32fb-4b5d-991d-50f212dbc356 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:19.422603 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 799/1586] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:19 2022] POST /identity/v3/users => generated 301 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:19.426343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fcbf8-af9c-46d5-920b-5fc0bdb05a18 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:19.427912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1b9fcbf8-af9c-46d5-920b-5fc0bdb05a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:19.439982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fcbf8-af9c-46d5-920b-5fc0bdb05a18 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:19.444890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acb2da-e9ec-41a4-a356-f2e370377464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:19.446786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acb2da-e9ec-41a4-a356-f2e370377464 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:19.447084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acb2da-e9ec-41a4-a356-f2e370377464 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:19.447365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acb2da-e9ec-41a4-a356-f2e370377464 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:19.448029 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69acb2da-e9ec-41a4-a356-f2e370377464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:19.449709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69acb2da-e9ec-41a4-a356-f2e370377464 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:19.467333 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 800/1587] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:21:19.468214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acb2da-e9ec-41a4-a356-f2e370377464 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:19.474712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:19.478361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acb2da-e9ec-41a4-a356-f2e370377464 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:19.483625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df712a37-ba69-42b3-97bf-cdd33556e727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:19.484802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df712a37-ba69-42b3-97bf-cdd33556e727 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:19.485089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df712a37-ba69-42b3-97bf-cdd33556e727 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:19.485397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df712a37-ba69-42b3-97bf-cdd33556e727 admin admin] PATH_INFO: `/v3/projects/e56c4dbd10e0472e8bc7bd723726888a/users/e58209f7e8fc477680b1d36db6ea94c4/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:19.501144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df712a37-ba69-42b3-97bf-cdd33556e727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e56c4dbd10e0472e8bc7bd723726888a, user_id=e58209f7e8fc477680b1d36db6ea94c4, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:19.503942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df712a37-ba69-42b3-97bf-cdd33556e727 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:19.566774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-135a1b24-32fb-4b5d-991d-50f212dbc356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5dd1f3cbb394266a14f25c332bbbcc9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:19.567456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-135a1b24-32fb-4b5d-991d-50f212dbc356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5dd1f3cbb394266a14f25c332bbbcc9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:19.574542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-135a1b24-32fb-4b5d-991d-50f212dbc356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5dd1f3cbb394266a14f25c332bbbcc9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:19.586161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-135a1b24-32fb-4b5d-991d-50f212dbc356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5dd1f3cbb394266a14f25c332bbbcc9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:19.626874 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 801/1588] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:19 2022] PUT /identity/v3/projects/e56c4dbd10e0472e8bc7bd723726888a/users/e58209f7e8fc477680b1d36db6ea94c4/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:21:19.630888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df712a37-ba69-42b3-97bf-cdd33556e727 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:19.632626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-df712a37-ba69-42b3-97bf-cdd33556e727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:19.697311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df712a37-ba69-42b3-97bf-cdd33556e727 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:19.702001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79baa9-1370-461c-9669-864e7fa06585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:19.702709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79baa9-1370-461c-9669-864e7fa06585 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:19.702988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79baa9-1370-461c-9669-864e7fa06585 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:19.703258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79baa9-1370-461c-9669-864e7fa06585 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:19.703901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79baa9-1370-461c-9669-864e7fa06585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:19.705601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79baa9-1370-461c-9669-864e7fa06585 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:19.706905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-135a1b24-32fb-4b5d-991d-50f212dbc356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5dd1f3cbb394266a14f25c332bbbcc9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:19.713799 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 788/1589] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:19 2022] DELETE /identity/v3/users/a5dd1f3cbb394266a14f25c332bbbcc9 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:19.717816 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 802/1590] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:21:19.721605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a1b24-32fb-4b5d-991d-50f212dbc356 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:19.800484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a1b24-32fb-4b5d-991d-50f212dbc356 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:19.806710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695243c-de09-468b-974e-4c5ec02d2e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:19.806710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695243c-de09-468b-974e-4c5ec02d2e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:19.807523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695243c-de09-468b-974e-4c5ec02d2e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:19.807912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695243c-de09-468b-974e-4c5ec02d2e7f admin admin] PATH_INFO: `/v3/projects/e56c4dbd10e0472e8bc7bd723726888a/users/e58209f7e8fc477680b1d36db6ea94c4/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:19.810851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695243c-de09-468b-974e-4c5ec02d2e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e56c4dbd10e0472e8bc7bd723726888a, user_id=e58209f7e8fc477680b1d36db6ea94c4, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:19.814791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695243c-de09-468b-974e-4c5ec02d2e7f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:19.829247 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 789/1591] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:19 2022] PUT /identity/v3/projects/e56c4dbd10e0472e8bc7bd723726888a/users/e58209f7e8fc477680b1d36db6ea94c4/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:19.840888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43db40-031e-44e4-b9fa-fa4e32b642c7 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:19.841176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43db40-031e-44e4-b9fa-fa4e32b642c7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:19.841460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43db40-031e-44e4-b9fa-fa4e32b642c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:19.891505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ac43db40-031e-44e4-b9fa-fa4e32b642c7 None None] MFA Rules not processed for user `e58209f7e8fc477680b1d36db6ea94c4`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:19.892741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ac43db40-031e-44e4-b9fa-fa4e32b642c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:19.988680 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 803/1592] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:19 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:20.001212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7f828-167b-4187-83f2-70fbe1f6e625 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:20.001589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7f828-167b-4187-83f2-70fbe1f6e625 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:20.001933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7f828-167b-4187-83f2-70fbe1f6e625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:20.009461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:20.024009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f7e7f828-167b-4187-83f2-70fbe1f6e625 None None] MFA Rules not processed for user `3756b0d73d634269bec89f1be45cdc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:20.025332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f7e7f828-167b-4187-83f2-70fbe1f6e625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:20.100706 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 790/1593] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:20.113867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43db40-031e-44e4-b9fa-fa4e32b642c7 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:20.120740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ac43db40-031e-44e4-b9fa-fa4e32b642c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:20.215698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:20.235929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43db40-031e-44e4-b9fa-fa4e32b642c7 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:20.241969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f9987-1319-445a-894d-a4d53e7a1aeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:20.242615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f9987-1319-445a-894d-a4d53e7a1aeb service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:20.242892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f9987-1319-445a-894d-a4d53e7a1aeb service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:20.243173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f9987-1319-445a-894d-a4d53e7a1aeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:20.245153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c21f9987-1319-445a-894d-a4d53e7a1aeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:20.256077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f9987-1319-445a-894d-a4d53e7a1aeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:20.257707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f9987-1319-445a-894d-a4d53e7a1aeb service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:20.268911 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 804/1594] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:20 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:20.311083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7f828-167b-4187-83f2-70fbe1f6e625 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:20.313571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f7e7f828-167b-4187-83f2-70fbe1f6e625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:20.387109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7f828-167b-4187-83f2-70fbe1f6e625 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:20.392778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780579c-edaa-4861-81fe-57d0279a070a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:20.393502 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780579c-edaa-4861-81fe-57d0279a070a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:20.393708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780579c-edaa-4861-81fe-57d0279a070a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:20.394016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780579c-edaa-4861-81fe-57d0279a070a admin admin] PATH_INFO: `/v3/projects/124903834b6745c899d644b7fa6c36f2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:20.395333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780579c-edaa-4861-81fe-57d0279a070a admin admin] RBAC: Authorizing `identity:delete_project(project_id=124903834b6745c899d644b7fa6c36f2)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:20.397274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780579c-edaa-4861-81fe-57d0279a070a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:20.513431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4780579c-edaa-4861-81fe-57d0279a070a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '124903834b6745c899d644b7fa6c36f2', 'request_id': 'req-4780579c-edaa-4861-81fe-57d0279a070a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:20.587612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4780579c-edaa-4861-81fe-57d0279a070a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '124903834b6745c899d644b7fa6c36f2', 'request_id': 'req-4780579c-edaa-4861-81fe-57d0279a070a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:20.594887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4780579c-edaa-4861-81fe-57d0279a070a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '124903834b6745c899d644b7fa6c36f2', 'request_id': 'req-4780579c-edaa-4861-81fe-57d0279a070a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:20.606287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4780579c-edaa-4861-81fe-57d0279a070a admin admin] The token cache is being invalidate because project 124903834b6745c899d644b7fa6c36f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:20.606704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4780579c-edaa-4861-81fe-57d0279a070a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:20.607366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4780579c-edaa-4861-81fe-57d0279a070a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:20.609013 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 791/1595] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:20 2022] DELETE /identity/v3/projects/124903834b6745c899d644b7fa6c36f2 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:21:20.613939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1de64-0cd1-4558-98c4-c944c929d498 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:20.614995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1de64-0cd1-4558-98c4-c944c929d498 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:20.615397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1de64-0cd1-4558-98c4-c944c929d498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:20.638179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-46b1de64-0cd1-4558-98c4-c944c929d498 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:20.639420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-46b1de64-0cd1-4558-98c4-c944c929d498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:20.701003 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 805/1596] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:20.709313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43778875-58c4-4b17-916b-3feab8c76b98 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:20.709607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43778875-58c4-4b17-916b-3feab8c76b98 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:20.709869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43778875-58c4-4b17-916b-3feab8c76b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:20.729892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-43778875-58c4-4b17-916b-3feab8c76b98 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:20.731145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-43778875-58c4-4b17-916b-3feab8c76b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:20.740279 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 792/1597] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:20.744581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1de64-0cd1-4558-98c4-c944c929d498 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:20.755077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1de64-0cd1-4558-98c4-c944c929d498 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:20.759757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351b4de-fe73-47e0-903e-6fe212a25c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:20.760468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351b4de-fe73-47e0-903e-6fe212a25c29 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:20.760815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351b4de-fe73-47e0-903e-6fe212a25c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:20.761156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351b4de-fe73-47e0-903e-6fe212a25c29 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:20.761866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351b4de-fe73-47e0-903e-6fe212a25c29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:21:20.762293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351b4de-fe73-47e0-903e-6fe212a25c29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:20.764279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351b4de-fe73-47e0-903e-6fe212a25c29 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:20.778088 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 806/1598] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:21:20.786415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43778875-58c4-4b17-916b-3feab8c76b98 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:20.795677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43778875-58c4-4b17-916b-3feab8c76b98 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:20.800350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c847a65-5db0-44f5-be4e-2072ab73aeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:20.800957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c847a65-5db0-44f5-be4e-2072ab73aeb4 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:20.801243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c847a65-5db0-44f5-be4e-2072ab73aeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:20.801520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c847a65-5db0-44f5-be4e-2072ab73aeb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:20.802200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c847a65-5db0-44f5-be4e-2072ab73aeb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:20.804152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c847a65-5db0-44f5-be4e-2072ab73aeb4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:20.926520 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 793/1599] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:20 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:20.930838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351b4de-fe73-47e0-903e-6fe212a25c29 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:20.941688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351b4de-fe73-47e0-903e-6fe212a25c29 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:20.998823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbc6b1-7df0-401e-a9eb-83a1360cb63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:21.000086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbc6b1-7df0-401e-a9eb-83a1360cb63b admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:21.000338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbc6b1-7df0-401e-a9eb-83a1360cb63b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:21.000613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbc6b1-7df0-401e-a9eb-83a1360cb63b admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:21.001251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fbc6b1-7df0-401e-a9eb-83a1360cb63b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:21.003766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fbc6b1-7df0-401e-a9eb-83a1360cb63b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:21.093863 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 807/1600] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:20 2022] POST /identity/v3/users => generated 294 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:21.095838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c847a65-5db0-44f5-be4e-2072ab73aeb4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:21.107771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c847a65-5db0-44f5-be4e-2072ab73aeb4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:21.127306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f86032-4f6b-4498-9b43-b9845c808e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:21.128618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f86032-4f6b-4498-9b43-b9845c808e62 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:21.129675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f86032-4f6b-4498-9b43-b9845c808e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:21.130502 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f86032-4f6b-4498-9b43-b9845c808e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:21.130930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f86032-4f6b-4498-9b43-b9845c808e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:21.132744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f86032-4f6b-4498-9b43-b9845c808e62 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:21.136223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:21.145432 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 794/1601] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:21.149698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbc6b1-7df0-401e-a9eb-83a1360cb63b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:21.167012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbc6b1-7df0-401e-a9eb-83a1360cb63b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:21.173488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ba308-3c03-4b94-b5dc-1e1179b5fc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:21.174414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ba308-3c03-4b94-b5dc-1e1179b5fc75 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:21.174880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ba308-3c03-4b94-b5dc-1e1179b5fc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:21.175157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ba308-3c03-4b94-b5dc-1e1179b5fc75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:21.175860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ba308-3c03-4b94-b5dc-1e1179b5fc75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:21.177539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ba308-3c03-4b94-b5dc-1e1179b5fc75 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:21.193621 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 808/1602] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:21.198086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f86032-4f6b-4498-9b43-b9845c808e62 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:21.209227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f86032-4f6b-4498-9b43-b9845c808e62 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:21.214184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222f7ad-56bf-4674-bf7b-04d3ccfca620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:21.214895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222f7ad-56bf-4674-bf7b-04d3ccfca620 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:21.215476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222f7ad-56bf-4674-bf7b-04d3ccfca620 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:21.215999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222f7ad-56bf-4674-bf7b-04d3ccfca620 admin admin] PATH_INFO: `/v3/projects/44b2b8b909c54f36b61d934d09607b5a/users/ae3d2208faeb4421af21da56d455be92/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:21.232675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222f7ad-56bf-4674-bf7b-04d3ccfca620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b2b8b909c54f36b61d934d09607b5a, user_id=ae3d2208faeb4421af21da56d455be92, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:21.236098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222f7ad-56bf-4674-bf7b-04d3ccfca620 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:21.342150 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 795/1603] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:21 2022] PUT /identity/v3/projects/44b2b8b909c54f36b61d934d09607b5a/users/ae3d2208faeb4421af21da56d455be92/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:21.354132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84a84d-9cdf-4095-9d65-7cccb4cd4a7f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:21.354445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84a84d-9cdf-4095-9d65-7cccb4cd4a7f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:21.354725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84a84d-9cdf-4095-9d65-7cccb4cd4a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:21.394635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7c84a84d-9cdf-4095-9d65-7cccb4cd4a7f None None] MFA Rules not processed for user `ae3d2208faeb4421af21da56d455be92`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:21.395895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7c84a84d-9cdf-4095-9d65-7cccb4cd4a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:21.458844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:21.483176 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 809/1604] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:21.488161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222f7ad-56bf-4674-bf7b-04d3ccfca620 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:21.565877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222f7ad-56bf-4674-bf7b-04d3ccfca620 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:21.572096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025170e-8073-46f8-aa41-295f60b97904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:21.572724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025170e-8073-46f8-aa41-295f60b97904 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:21.573006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025170e-8073-46f8-aa41-295f60b97904 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:21.573333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025170e-8073-46f8-aa41-295f60b97904 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:21.573986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025170e-8073-46f8-aa41-295f60b97904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:21.576080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025170e-8073-46f8-aa41-295f60b97904 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:21.709521 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 796/1605] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:21 2022] POST /identity/v3/projects => generated 387 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:21:21.710732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84a84d-9cdf-4095-9d65-7cccb4cd4a7f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:21.724705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84a84d-9cdf-4095-9d65-7cccb4cd4a7f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:21.786546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc628d03-d095-4a85-982f-6a8c5a30ef56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:21.787160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc628d03-d095-4a85-982f-6a8c5a30ef56 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:21.787436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc628d03-d095-4a85-982f-6a8c5a30ef56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:21.787707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc628d03-d095-4a85-982f-6a8c5a30ef56 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:21.789300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc628d03-d095-4a85-982f-6a8c5a30ef56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:21.791266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc628d03-d095-4a85-982f-6a8c5a30ef56 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:21.865247 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 810/1606] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:21 2022] POST /identity/v3/users => generated 300 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:21.866415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025170e-8073-46f8-aa41-295f60b97904 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:21.877395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025170e-8073-46f8-aa41-295f60b97904 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:21.881903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58be9c-b797-4e5d-ab0b-73d3fa0a0f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:21.882547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58be9c-b797-4e5d-ab0b-73d3fa0a0f7e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:21.882830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58be9c-b797-4e5d-ab0b-73d3fa0a0f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:21.883130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58be9c-b797-4e5d-ab0b-73d3fa0a0f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:21.883785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58be9c-b797-4e5d-ab0b-73d3fa0a0f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:21.885398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58be9c-b797-4e5d-ab0b-73d3fa0a0f7e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:21.898745 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 797/1607] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:21:21.903046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc628d03-d095-4a85-982f-6a8c5a30ef56 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:21.916558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc628d03-d095-4a85-982f-6a8c5a30ef56 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:21.921675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751d29f-1a7b-4efe-8d89-e7096f3ec88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:21.922477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751d29f-1a7b-4efe-8d89-e7096f3ec88d admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:21.922762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751d29f-1a7b-4efe-8d89-e7096f3ec88d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:21.923035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751d29f-1a7b-4efe-8d89-e7096f3ec88d admin admin] PATH_INFO: `/v3/projects/9472aa97aca64edda6b0e0ffd956af70/users/8c5e02ab3926413c82a1f53cb7a2b9f3/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:21.939838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751d29f-1a7b-4efe-8d89-e7096f3ec88d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9472aa97aca64edda6b0e0ffd956af70, user_id=8c5e02ab3926413c82a1f53cb7a2b9f3, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:21.942544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751d29f-1a7b-4efe-8d89-e7096f3ec88d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:22.029772 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 811/1608] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:21 2022] PUT /identity/v3/projects/9472aa97aca64edda6b0e0ffd956af70/users/8c5e02ab3926413c82a1f53cb7a2b9f3/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:21:22.037437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58be9c-b797-4e5d-ab0b-73d3fa0a0f7e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:22.052725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58be9c-b797-4e5d-ab0b-73d3fa0a0f7e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:22.111753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb298d52-a380-402c-aeda-1d4682e3422e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:22.112282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb298d52-a380-402c-aeda-1d4682e3422e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:22.112562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb298d52-a380-402c-aeda-1d4682e3422e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:22.112834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb298d52-a380-402c-aeda-1d4682e3422e admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:22.113471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb298d52-a380-402c-aeda-1d4682e3422e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:22.115106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb298d52-a380-402c-aeda-1d4682e3422e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:22.129951 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 798/1609] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:22.131478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751d29f-1a7b-4efe-8d89-e7096f3ec88d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:22.143752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751d29f-1a7b-4efe-8d89-e7096f3ec88d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:22.148546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9189a-cb8b-4cf1-a8b7-7f766a01bb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:22.149204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9189a-cb8b-4cf1-a8b7-7f766a01bb6b admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:22.149482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9189a-cb8b-4cf1-a8b7-7f766a01bb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:22.149751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9189a-cb8b-4cf1-a8b7-7f766a01bb6b admin admin] PATH_INFO: `/v3/projects/9472aa97aca64edda6b0e0ffd956af70/users/8c5e02ab3926413c82a1f53cb7a2b9f3/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:22.151833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9189a-cb8b-4cf1-a8b7-7f766a01bb6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9472aa97aca64edda6b0e0ffd956af70, user_id=8c5e02ab3926413c82a1f53cb7a2b9f3, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:22.154675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9189a-cb8b-4cf1-a8b7-7f766a01bb6b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:22.166767 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 812/1610] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:22 2022] PUT /identity/v3/projects/9472aa97aca64edda6b0e0ffd956af70/users/8c5e02ab3926413c82a1f53cb7a2b9f3/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:22.194221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76be491-9a28-4c47-90bd-65aadb946139 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:22.195397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76be491-9a28-4c47-90bd-65aadb946139 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:22.195857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76be491-9a28-4c47-90bd-65aadb946139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:22.229402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f76be491-9a28-4c47-90bd-65aadb946139 None None] MFA Rules not processed for user `8c5e02ab3926413c82a1f53cb7a2b9f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:22.230892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f76be491-9a28-4c47-90bd-65aadb946139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:22.271765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:22.309099 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 799/1611] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:22.320281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc11f61-fb41-45c0-988f-d6afe0d6c70e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:22.320564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc11f61-fb41-45c0-988f-d6afe0d6c70e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:22.320885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc11f61-fb41-45c0-988f-d6afe0d6c70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:22.361586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-cfc11f61-fb41-45c0-988f-d6afe0d6c70e None None] MFA Rules not processed for user `ae3d2208faeb4421af21da56d455be92`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:22.362866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cfc11f61-fb41-45c0-988f-d6afe0d6c70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:22.425005 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 813/1612] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:22.437810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76be491-9a28-4c47-90bd-65aadb946139 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:22.439344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f76be491-9a28-4c47-90bd-65aadb946139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:22.517877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76be491-9a28-4c47-90bd-65aadb946139 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:22.523438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b68da0-85c5-4ac0-b980-90e201b7b656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:22.524058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b68da0-85c5-4ac0-b980-90e201b7b656 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:22.524342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b68da0-85c5-4ac0-b980-90e201b7b656 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:22.524618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b68da0-85c5-4ac0-b980-90e201b7b656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:22.532184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b68da0-85c5-4ac0-b980-90e201b7b656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:22.533802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b68da0-85c5-4ac0-b980-90e201b7b656 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:22.542416 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 800/1613] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:23.823922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a219c0-0848-4fa2-beac-5bbe7b309d0d None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:23.824386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a219c0-0848-4fa2-beac-5bbe7b309d0d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:23.824457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a219c0-0848-4fa2-beac-5bbe7b309d0d None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:23.825793 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 814/1614] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 27 03:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:21:23.845695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f3543-0ba0-40f1-8ced-f8cbd6226d7b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:23.846259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f3543-0ba0-40f1-8ced-f8cbd6226d7b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:23.846259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f3543-0ba0-40f1-8ced-f8cbd6226d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:23.871086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-be8f3543-0ba0-40f1-8ced-f8cbd6226d7b None None] MFA Rules not processed for user `c20881251f2241a3a5ec2e5cf99db149`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:23.872402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-be8f3543-0ba0-40f1-8ced-f8cbd6226d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:23.892011 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 801/1615] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 03:21:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:23.905730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a219c0-0848-4fa2-beac-5bbe7b309d0d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:23.924138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a219c0-0848-4fa2-beac-5bbe7b309d0d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:23.930521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047d997-e349-45c6-88d0-1debe7a07017 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:23.931279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047d997-e349-45c6-88d0-1debe7a07017 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:23.932161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047d997-e349-45c6-88d0-1debe7a07017 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:23.932513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047d997-e349-45c6-88d0-1debe7a07017 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:23.942979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047d997-e349-45c6-88d0-1debe7a07017 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:23.944695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047d997-e349-45c6-88d0-1debe7a07017 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:23.957163 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 815/1616] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:29.035949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f3543-0ba0-40f1-8ced-f8cbd6226d7b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:29.037442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-be8f3543-0ba0-40f1-8ced-f8cbd6226d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:29.051889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f3543-0ba0-40f1-8ced-f8cbd6226d7b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:29.057479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1db11-2806-462d-b48e-572c87dd29ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:29.058104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1db11-2806-462d-b48e-572c87dd29ef service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:29.058386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1db11-2806-462d-b48e-572c87dd29ef service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:29.058655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1db11-2806-462d-b48e-572c87dd29ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:29.060467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-40d1db11-2806-462d-b48e-572c87dd29ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:29.131146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1db11-2806-462d-b48e-572c87dd29ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:29.136211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1db11-2806-462d-b48e-572c87dd29ef service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:29.147940 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 802/1617] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:29 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:21:30.279988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047d997-e349-45c6-88d0-1debe7a07017 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:30.291163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047d997-e349-45c6-88d0-1debe7a07017 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:30.297403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200b906-7ad3-49de-b93e-034ceef95536 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:30.298006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200b906-7ad3-49de-b93e-034ceef95536 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:30.298317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200b906-7ad3-49de-b93e-034ceef95536 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:30.301188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200b906-7ad3-49de-b93e-034ceef95536 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:30.301188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8200b906-7ad3-49de-b93e-034ceef95536 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:30.327501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:30.371438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200b906-7ad3-49de-b93e-034ceef95536 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:30.371438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200b906-7ad3-49de-b93e-034ceef95536 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:30.384164 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 816/1618] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:30 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:33.703774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1db11-2806-462d-b48e-572c87dd29ef service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:33.705376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-40d1db11-2806-462d-b48e-572c87dd29ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:33.761343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:33.784361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1db11-2806-462d-b48e-572c87dd29ef service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:33.789168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa65f6a-b5ce-48f0-b527-8eb9d1ab7e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:33.790075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa65f6a-b5ce-48f0-b527-8eb9d1ab7e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:33.790374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa65f6a-b5ce-48f0-b527-8eb9d1ab7e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:33.790724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa65f6a-b5ce-48f0-b527-8eb9d1ab7e50 admin admin] PATH_INFO: `/v3/users/ef1dfae2bc0f4c4a8a75ad5ebd7526d0` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:33.792541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa65f6a-b5ce-48f0-b527-8eb9d1ab7e50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef1dfae2bc0f4c4a8a75ad5ebd7526d0)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:33.794847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa65f6a-b5ce-48f0-b527-8eb9d1ab7e50 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:34.008719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0fa65f6a-b5ce-48f0-b527-8eb9d1ab7e50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef1dfae2bc0f4c4a8a75ad5ebd7526d0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:34.009397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0fa65f6a-b5ce-48f0-b527-8eb9d1ab7e50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef1dfae2bc0f4c4a8a75ad5ebd7526d0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:34.021200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0fa65f6a-b5ce-48f0-b527-8eb9d1ab7e50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef1dfae2bc0f4c4a8a75ad5ebd7526d0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:34.039392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0fa65f6a-b5ce-48f0-b527-8eb9d1ab7e50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef1dfae2bc0f4c4a8a75ad5ebd7526d0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:34.165360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0fa65f6a-b5ce-48f0-b527-8eb9d1ab7e50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef1dfae2bc0f4c4a8a75ad5ebd7526d0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:34.172053 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 803/1619] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:33 2022] DELETE /identity/v3/users/ef1dfae2bc0f4c4a8a75ad5ebd7526d0 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:34.176845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ef286-5c81-4f59-aeba-a257979be627 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:34.177368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ef286-5c81-4f59-aeba-a257979be627 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:34.177444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ef286-5c81-4f59-aeba-a257979be627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:34.206664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b12ef286-5c81-4f59-aeba-a257979be627 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:34.207912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b12ef286-5c81-4f59-aeba-a257979be627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:34.301529 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 817/1620] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:34.313477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa65f6a-b5ce-48f0-b527-8eb9d1ab7e50 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:34.314938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0fa65f6a-b5ce-48f0-b527-8eb9d1ab7e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:34.387931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa65f6a-b5ce-48f0-b527-8eb9d1ab7e50 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:34.394569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a95a5-c0d0-4e12-95c3-a909318f5247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:34.395297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a95a5-c0d0-4e12-95c3-a909318f5247 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:34.395686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a95a5-c0d0-4e12-95c3-a909318f5247 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:34.396051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a95a5-c0d0-4e12-95c3-a909318f5247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:34.398013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9052ef4-85a2-41f0-ad0d-70ba5952f47c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:34.398358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9052ef4-85a2-41f0-ad0d-70ba5952f47c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:34.398638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9052ef4-85a2-41f0-ad0d-70ba5952f47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:34.406563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a95a5-c0d0-4e12-95c3-a909318f5247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:34.408155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a95a5-c0d0-4e12-95c3-a909318f5247 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:34.417441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a9052ef4-85a2-41f0-ad0d-70ba5952f47c None None] MFA Rules not processed for user `ff070c0383324e1da5c49e3d9c652516`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:34.418572 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 804/1621] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:34.418751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a9052ef4-85a2-41f0-ad0d-70ba5952f47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:34.487406 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 818/1622] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:21:34.994640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a95a5-c0d0-4e12-95c3-a909318f5247 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:34.996256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-364a95a5-c0d0-4e12-95c3-a909318f5247 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:35.015921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a95a5-c0d0-4e12-95c3-a909318f5247 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:35.021166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c9193-38e8-4596-9c86-c30e1751a59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:35.021882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c9193-38e8-4596-9c86-c30e1751a59f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:35.022290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c9193-38e8-4596-9c86-c30e1751a59f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:35.023189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c9193-38e8-4596-9c86-c30e1751a59f admin admin] PATH_INFO: `/v3/projects/4e3631cc0e734c0cb0bff3519fdbe38d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:35.024464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c9193-38e8-4596-9c86-c30e1751a59f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e3631cc0e734c0cb0bff3519fdbe38d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:35.033295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c9193-38e8-4596-9c86-c30e1751a59f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:35.183367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-381c9193-38e8-4596-9c86-c30e1751a59f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3631cc0e734c0cb0bff3519fdbe38d', 'request_id': 'req-381c9193-38e8-4596-9c86-c30e1751a59f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:35.272903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-381c9193-38e8-4596-9c86-c30e1751a59f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3631cc0e734c0cb0bff3519fdbe38d', 'request_id': 'req-381c9193-38e8-4596-9c86-c30e1751a59f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:35.276133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:35.280815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-381c9193-38e8-4596-9c86-c30e1751a59f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3631cc0e734c0cb0bff3519fdbe38d', 'request_id': 'req-381c9193-38e8-4596-9c86-c30e1751a59f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:35.291251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-381c9193-38e8-4596-9c86-c30e1751a59f admin admin] The token cache is being invalidate because project 4e3631cc0e734c0cb0bff3519fdbe38d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:35.291544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-381c9193-38e8-4596-9c86-c30e1751a59f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:35.292293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-381c9193-38e8-4596-9c86-c30e1751a59f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:35.293861 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 805/1623] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:34 2022] DELETE /identity/v3/projects/4e3631cc0e734c0cb0bff3519fdbe38d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:35.299524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9052ef4-85a2-41f0-ad0d-70ba5952f47c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:35.311018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9052ef4-85a2-41f0-ad0d-70ba5952f47c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:35.370452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cbc75-c824-469e-b08c-0793bed18dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:35.371098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cbc75-c824-469e-b08c-0793bed18dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:35.371383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cbc75-c824-469e-b08c-0793bed18dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:35.371660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cbc75-c824-469e-b08c-0793bed18dc4 admin admin] PATH_INFO: `/v3/users/fd421e4662e744138204f259f4719ec6` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:35.372835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cbc75-c824-469e-b08c-0793bed18dc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd421e4662e744138204f259f4719ec6)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:35.374905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cbc75-c824-469e-b08c-0793bed18dc4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:35.381696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:35.573405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9a8cbc75-c824-469e-b08c-0793bed18dc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd421e4662e744138204f259f4719ec6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:35.574167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9a8cbc75-c824-469e-b08c-0793bed18dc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd421e4662e744138204f259f4719ec6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:35.581464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9a8cbc75-c824-469e-b08c-0793bed18dc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd421e4662e744138204f259f4719ec6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:35.595312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9a8cbc75-c824-469e-b08c-0793bed18dc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd421e4662e744138204f259f4719ec6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:35.596145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9a8cbc75-c824-469e-b08c-0793bed18dc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd421e4662e744138204f259f4719ec6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:35.651482 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 819/1624] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:35 2022] DELETE /identity/v3/users/fd421e4662e744138204f259f4719ec6 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:36.010711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c9193-38e8-4596-9c86-c30e1751a59f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:36.010711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-381c9193-38e8-4596-9c86-c30e1751a59f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:36.086453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c9193-38e8-4596-9c86-c30e1751a59f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:36.130264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cbc75-c824-469e-b08c-0793bed18dc4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:36.130820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9a8cbc75-c824-469e-b08c-0793bed18dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:36.166656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadded04-2916-4811-a639-bb7b937e912f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:36.167418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadded04-2916-4811-a639-bb7b937e912f service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:36.167854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadded04-2916-4811-a639-bb7b937e912f service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:36.168138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadded04-2916-4811-a639-bb7b937e912f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:36.171553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-aadded04-2916-4811-a639-bb7b937e912f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:36.244699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cbc75-c824-469e-b08c-0793bed18dc4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:36.248704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadded04-2916-4811-a639-bb7b937e912f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:36.250828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9d129-c9c7-4178-aa9a-eb54815b08e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:36.250962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadded04-2916-4811-a639-bb7b937e912f service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:36.251648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9d129-c9c7-4178-aa9a-eb54815b08e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:36.252038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9d129-c9c7-4178-aa9a-eb54815b08e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:36.252385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9d129-c9c7-4178-aa9a-eb54815b08e3 admin admin] PATH_INFO: `/v3/projects/ca6ccd2039fb423aaa00d68d1a8c564a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:36.253762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9d129-c9c7-4178-aa9a-eb54815b08e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca6ccd2039fb423aaa00d68d1a8c564a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:36.255913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9d129-c9c7-4178-aa9a-eb54815b08e3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:36.261094 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 806/1625] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:21:36.418324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b6f9d129-c9c7-4178-aa9a-eb54815b08e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca6ccd2039fb423aaa00d68d1a8c564a', 'request_id': 'req-b6f9d129-c9c7-4178-aa9a-eb54815b08e3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:36.425132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b6f9d129-c9c7-4178-aa9a-eb54815b08e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca6ccd2039fb423aaa00d68d1a8c564a', 'request_id': 'req-b6f9d129-c9c7-4178-aa9a-eb54815b08e3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:36.432948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b6f9d129-c9c7-4178-aa9a-eb54815b08e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca6ccd2039fb423aaa00d68d1a8c564a', 'request_id': 'req-b6f9d129-c9c7-4178-aa9a-eb54815b08e3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:36.555683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b6f9d129-c9c7-4178-aa9a-eb54815b08e3 admin admin] The token cache is being invalidate because project ca6ccd2039fb423aaa00d68d1a8c564a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:36.556680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b6f9d129-c9c7-4178-aa9a-eb54815b08e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:36.558477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b6f9d129-c9c7-4178-aa9a-eb54815b08e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:36.560571 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 820/1626] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:36 2022] DELETE /identity/v3/projects/ca6ccd2039fb423aaa00d68d1a8c564a => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:21:36.565948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c23186-9537-47bb-a44e-5275fd27b493 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:36.566287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c23186-9537-47bb-a44e-5275fd27b493 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:36.566569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c23186-9537-47bb-a44e-5275fd27b493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:36.591550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a3c23186-9537-47bb-a44e-5275fd27b493 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:36.593291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a3c23186-9537-47bb-a44e-5275fd27b493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:36.662287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:36.670504 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 807/1627] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:36.678847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3577525-8ecb-4b7d-9cf0-9047033e5b6d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:36.679205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3577525-8ecb-4b7d-9cf0-9047033e5b6d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:36.679401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3577525-8ecb-4b7d-9cf0-9047033e5b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:36.710336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d3577525-8ecb-4b7d-9cf0-9047033e5b6d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:36.711827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d3577525-8ecb-4b7d-9cf0-9047033e5b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:36.721008 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 821/1628] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:36.725384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c23186-9537-47bb-a44e-5275fd27b493 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:36.737310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c23186-9537-47bb-a44e-5275fd27b493 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:36.742531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd985d-900e-4e4e-a04e-8e2659edfcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:36.743171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd985d-900e-4e4e-a04e-8e2659edfcfd admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:36.743531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd985d-900e-4e4e-a04e-8e2659edfcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:36.743840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd985d-900e-4e4e-a04e-8e2659edfcfd admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:36.744490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd985d-900e-4e4e-a04e-8e2659edfcfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:21:36.744794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd985d-900e-4e4e-a04e-8e2659edfcfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:36.746661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd985d-900e-4e4e-a04e-8e2659edfcfd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:36.760192 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 808/1629] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:21:36.765555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3577525-8ecb-4b7d-9cf0-9047033e5b6d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:36.777654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3577525-8ecb-4b7d-9cf0-9047033e5b6d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:36.783195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1815213-8072-4ab0-bda1-9b97fb52e395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:36.783881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1815213-8072-4ab0-bda1-9b97fb52e395 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:36.784229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1815213-8072-4ab0-bda1-9b97fb52e395 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:36.784566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1815213-8072-4ab0-bda1-9b97fb52e395 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:36.785305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1815213-8072-4ab0-bda1-9b97fb52e395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:36.787600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1815213-8072-4ab0-bda1-9b97fb52e395 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:36.793756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:36.894107 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 822/1630] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:36 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:36.898268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd985d-900e-4e4e-a04e-8e2659edfcfd admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:36.909369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd985d-900e-4e4e-a04e-8e2659edfcfd admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:36.939045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024dfb5-1092-4638-92d6-cb0019fa8d29 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:36.939508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024dfb5-1092-4638-92d6-cb0019fa8d29 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:36.939615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024dfb5-1092-4638-92d6-cb0019fa8d29 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:36.940944 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 823/1631] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:21:36.946145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df2ed5-e123-4418-b5ed-edf2c9d77703 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:36.946437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df2ed5-e123-4418-b5ed-edf2c9d77703 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:36.946715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df2ed5-e123-4418-b5ed-edf2c9d77703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:36.966666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-41df2ed5-e123-4418-b5ed-edf2c9d77703 None None] MFA Rules not processed for user `9b359391fbc34c259d987e42e8826c86`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:36.971244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-41df2ed5-e123-4418-b5ed-edf2c9d77703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:36.973082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a3acd-8436-44b4-994e-1a97b5c85750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:36.981234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a3acd-8436-44b4-994e-1a97b5c85750 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:36.981532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a3acd-8436-44b4-994e-1a97b5c85750 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:36.981798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a3acd-8436-44b4-994e-1a97b5c85750 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:36.983502 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a3acd-8436-44b4-994e-1a97b5c85750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:36.985525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a3acd-8436-44b4-994e-1a97b5c85750 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:37.040516 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 824/1632] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:21:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:21:37.051926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df2ed5-e123-4418-b5ed-edf2c9d77703 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:37.053258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-41df2ed5-e123-4418-b5ed-edf2c9d77703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:37.063457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df2ed5-e123-4418-b5ed-edf2c9d77703 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:37.067060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a32e9f-83a7-4941-9984-84034d74f68e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:37.067657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a32e9f-83a7-4941-9984-84034d74f68e service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:37.067940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a32e9f-83a7-4941-9984-84034d74f68e service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:37.068217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a32e9f-83a7-4941-9984-84034d74f68e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:37.075213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a32e9f-83a7-4941-9984-84034d74f68e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:37.076662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a32e9f-83a7-4941-9984-84034d74f68e service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:37.087172 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 809/1633] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:36 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:37.087746 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 825/1634] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:21:37.088403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a3acd-8436-44b4-994e-1a97b5c85750 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:37.099083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a3acd-8436-44b4-994e-1a97b5c85750 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:37.103925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d32a52-29d6-4c9b-96d5-6588b68ffdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:37.104985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d32a52-29d6-4c9b-96d5-6588b68ffdcd admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:37.104985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d32a52-29d6-4c9b-96d5-6588b68ffdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:37.105172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d32a52-29d6-4c9b-96d5-6588b68ffdcd admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:37.110993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d32a52-29d6-4c9b-96d5-6588b68ffdcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:37.111729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d32a52-29d6-4c9b-96d5-6588b68ffdcd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:37.126728 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 810/1635] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:21:37.134177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a32e9f-83a7-4941-9984-84034d74f68e service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:37.142694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a32e9f-83a7-4941-9984-84034d74f68e service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:37.147431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfee1b-84c4-456d-8c11-b2531470e443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:37.148578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfee1b-84c4-456d-8c11-b2531470e443 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:37.148862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfee1b-84c4-456d-8c11-b2531470e443 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:37.149141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfee1b-84c4-456d-8c11-b2531470e443 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:37.149790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dfee1b-84c4-456d-8c11-b2531470e443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:37.151431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dfee1b-84c4-456d-8c11-b2531470e443 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:37.161793 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 826/1636] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:37.166165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d32a52-29d6-4c9b-96d5-6588b68ffdcd admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:37.176333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d32a52-29d6-4c9b-96d5-6588b68ffdcd admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:37.185551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863316d-1ab8-471a-852e-94b204c7486c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:37.186795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863316d-1ab8-471a-852e-94b204c7486c admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:37.187082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863316d-1ab8-471a-852e-94b204c7486c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:37.187410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863316d-1ab8-471a-852e-94b204c7486c admin admin] PATH_INFO: `/v3/projects/b917ec5f17ae4e039e21a111593f36ae/users/46b1fb50bed740ddbe860ed904362253/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:37.203583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863316d-1ab8-471a-852e-94b204c7486c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b917ec5f17ae4e039e21a111593f36ae, user_id=46b1fb50bed740ddbe860ed904362253, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:37.206276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863316d-1ab8-471a-852e-94b204c7486c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:37.358351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef3c40-a13f-4acc-a44d-9a725f87825a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:37.358717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef3c40-a13f-4acc-a44d-9a725f87825a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:37.358961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef3c40-a13f-4acc-a44d-9a725f87825a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:37.361749 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 811/1637] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:37 2022] PUT /identity/v3/projects/b917ec5f17ae4e039e21a111593f36ae/users/46b1fb50bed740ddbe860ed904362253/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:37.391668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-17ef3c40-a13f-4acc-a44d-9a725f87825a None None] MFA Rules not processed for user `46b1fb50bed740ddbe860ed904362253`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:37.392891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-17ef3c40-a13f-4acc-a44d-9a725f87825a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:37.477203 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 827/1638] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:37.481609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863316d-1ab8-471a-852e-94b204c7486c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:37.591238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863316d-1ab8-471a-852e-94b204c7486c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:37.597369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704a3d7-4c4d-4710-8628-7a9f2810a411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:37.598182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704a3d7-4c4d-4710-8628-7a9f2810a411 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:37.598543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704a3d7-4c4d-4710-8628-7a9f2810a411 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:37.598890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704a3d7-4c4d-4710-8628-7a9f2810a411 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:37.599596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704a3d7-4c4d-4710-8628-7a9f2810a411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:37.601732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704a3d7-4c4d-4710-8628-7a9f2810a411 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:37.606672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:37.704106 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 812/1639] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:37 2022] POST /identity/v3/projects => generated 379 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:37.705754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef3c40-a13f-4acc-a44d-9a725f87825a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:37.709421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3ede6-98cd-4f8d-9e51-5d4de31af940 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:37.709835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3ede6-98cd-4f8d-9e51-5d4de31af940 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:37.710275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3ede6-98cd-4f8d-9e51-5d4de31af940 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:37.711866 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 813/1640] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 27 03:21:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:21:37.723913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd24fb-3e11-4efd-ad5b-77f0964ebdbc None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:37.729177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd24fb-3e11-4efd-ad5b-77f0964ebdbc None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:37.729177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd24fb-3e11-4efd-ad5b-77f0964ebdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:37.730830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef3c40-a13f-4acc-a44d-9a725f87825a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:37.773840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-74bd24fb-3e11-4efd-ad5b-77f0964ebdbc None None] MFA Rules not processed for user `9b359391fbc34c259d987e42e8826c86`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:37.775126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-74bd24fb-3e11-4efd-ad5b-77f0964ebdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:37.806240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491efb72-791c-4a21-ba99-1127fe65de50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:37.806864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491efb72-791c-4a21-ba99-1127fe65de50 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:37.807145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491efb72-791c-4a21-ba99-1127fe65de50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:37.807586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491efb72-791c-4a21-ba99-1127fe65de50 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:37.808386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491efb72-791c-4a21-ba99-1127fe65de50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:37.810746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491efb72-791c-4a21-ba99-1127fe65de50 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:37.869780 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 814/1641] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 03:21:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:37.891079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd24fb-3e11-4efd-ad5b-77f0964ebdbc None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:37.902678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd24fb-3e11-4efd-ad5b-77f0964ebdbc None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:37.908568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07669a8-8b80-43fb-a3f0-18e7fd65fbac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:37.909183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07669a8-8b80-43fb-a3f0-18e7fd65fbac service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:37.909467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07669a8-8b80-43fb-a3f0-18e7fd65fbac service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:37.909743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07669a8-8b80-43fb-a3f0-18e7fd65fbac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:37.918847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07669a8-8b80-43fb-a3f0-18e7fd65fbac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:37.921036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07669a8-8b80-43fb-a3f0-18e7fd65fbac service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:37.931407 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 815/1642] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:37.935634 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 828/1643] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:37 2022] POST /identity/v3/users => generated 296 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:37.940169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07669a8-8b80-43fb-a3f0-18e7fd65fbac service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:37.969310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07669a8-8b80-43fb-a3f0-18e7fd65fbac service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:37.990964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9a7f6-0c55-4636-a1a1-414c6521fda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:37.991915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9a7f6-0c55-4636-a1a1-414c6521fda4 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:37.992336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9a7f6-0c55-4636-a1a1-414c6521fda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:37.992817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9a7f6-0c55-4636-a1a1-414c6521fda4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:38.001101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9a7f6-0c55-4636-a1a1-414c6521fda4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:38.002835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9a7f6-0c55-4636-a1a1-414c6521fda4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:38.022371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:38.030688 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 816/1644] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:38.035463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491efb72-791c-4a21-ba99-1127fe65de50 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:38.057257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491efb72-791c-4a21-ba99-1127fe65de50 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:38.070742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f6c41-9c90-4462-a4ef-a606d84a2342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:38.070742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f6c41-9c90-4462-a4ef-a606d84a2342 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:38.070742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f6c41-9c90-4462-a4ef-a606d84a2342 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:38.070742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f6c41-9c90-4462-a4ef-a606d84a2342 admin admin] PATH_INFO: `/v3/projects/3a96cc0969134743b59a328cdfe6ec39/users/969b51aba3c947dfa668ae03aeb589c8/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:38.090562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f6c41-9c90-4462-a4ef-a606d84a2342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a96cc0969134743b59a328cdfe6ec39, user_id=969b51aba3c947dfa668ae03aeb589c8, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:38.094812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f6c41-9c90-4462-a4ef-a606d84a2342 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:38.170300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9a7f6-0c55-4636-a1a1-414c6521fda4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:38.172909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0da9a7f6-0c55-4636-a1a1-414c6521fda4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:38.208727 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 829/1645] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:38 2022] PUT /identity/v3/projects/3a96cc0969134743b59a328cdfe6ec39/users/969b51aba3c947dfa668ae03aeb589c8/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:38.213086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f6c41-9c90-4462-a4ef-a606d84a2342 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:38.275137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9a7f6-0c55-4636-a1a1-414c6521fda4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:38.291656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f6c41-9c90-4462-a4ef-a606d84a2342 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:38.297141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd177486-e7be-49d6-97f8-a8d5f337e341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:38.297753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd177486-e7be-49d6-97f8-a8d5f337e341 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:38.298063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd177486-e7be-49d6-97f8-a8d5f337e341 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:38.298345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd177486-e7be-49d6-97f8-a8d5f337e341 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:38.299151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd177486-e7be-49d6-97f8-a8d5f337e341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:38.310791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd177486-e7be-49d6-97f8-a8d5f337e341 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:38.326328 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 830/1646] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:38.328267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd177486-e7be-49d6-97f8-a8d5f337e341 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:38.348677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd177486-e7be-49d6-97f8-a8d5f337e341 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:38.350408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb097f4-ff40-4322-a273-f47e3fb2ceb5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:38.351155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb097f4-ff40-4322-a273-f47e3fb2ceb5 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:38.351701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb097f4-ff40-4322-a273-f47e3fb2ceb5 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:38.351985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb097f4-ff40-4322-a273-f47e3fb2ceb5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:38.354711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1bb097f4-ff40-4322-a273-f47e3fb2ceb5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:38.356571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940aeec-b3a1-4df8-acff-36035445d024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:38.357416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940aeec-b3a1-4df8-acff-36035445d024 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:38.357836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940aeec-b3a1-4df8-acff-36035445d024 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:38.358828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940aeec-b3a1-4df8-acff-36035445d024 admin admin] PATH_INFO: `/v3/projects/3a96cc0969134743b59a328cdfe6ec39/users/969b51aba3c947dfa668ae03aeb589c8/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:38.362319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940aeec-b3a1-4df8-acff-36035445d024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a96cc0969134743b59a328cdfe6ec39, user_id=969b51aba3c947dfa668ae03aeb589c8, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:38.365962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940aeec-b3a1-4df8-acff-36035445d024 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:38.369021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb097f4-ff40-4322-a273-f47e3fb2ceb5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:38.376885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb097f4-ff40-4322-a273-f47e3fb2ceb5 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:38.392955 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 817/1648] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:21:38.395600 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 831/1648] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:38 2022] PUT /identity/v3/projects/3a96cc0969134743b59a328cdfe6ec39/users/969b51aba3c947dfa668ae03aeb589c8/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:21:38.398932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940aeec-b3a1-4df8-acff-36035445d024 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:38.402966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c940aeec-b3a1-4df8-acff-36035445d024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:38.408628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60ab19-56e1-45d4-a9d1-45bbb2fed6aa None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:38.409121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60ab19-56e1-45d4-a9d1-45bbb2fed6aa None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:38.409565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60ab19-56e1-45d4-a9d1-45bbb2fed6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:38.423043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:38.462924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-dc60ab19-56e1-45d4-a9d1-45bbb2fed6aa None None] MFA Rules not processed for user `969b51aba3c947dfa668ae03aeb589c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:38.466025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dc60ab19-56e1-45d4-a9d1-45bbb2fed6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:38.520183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940aeec-b3a1-4df8-acff-36035445d024 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:38.529239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bc3f6-ec77-454d-80c7-20b32ee5a1c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:38.530086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bc3f6-ec77-454d-80c7-20b32ee5a1c2 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:38.530434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bc3f6-ec77-454d-80c7-20b32ee5a1c2 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:38.536043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bc3f6-ec77-454d-80c7-20b32ee5a1c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:38.536043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-042bc3f6-ec77-454d-80c7-20b32ee5a1c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:38.591839 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 818/1649] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:38.607253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042bc3f6-ec77-454d-80c7-20b32ee5a1c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:38.609485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042bc3f6-ec77-454d-80c7-20b32ee5a1c2 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:38.619149 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 832/1650] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:38 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:38.640773 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60ab19-56e1-45d4-a9d1-45bbb2fed6aa None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:38.642783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dc60ab19-56e1-45d4-a9d1-45bbb2fed6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:38.676589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bc3f6-ec77-454d-80c7-20b32ee5a1c2 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:38.677981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-042bc3f6-ec77-454d-80c7-20b32ee5a1c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:38.693578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bc3f6-ec77-454d-80c7-20b32ee5a1c2 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:38.703101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bec1b-7e16-4b07-973c-d4af7e27f1a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:38.703734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bec1b-7e16-4b07-973c-d4af7e27f1a9 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:38.704020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bec1b-7e16-4b07-973c-d4af7e27f1a9 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:38.704298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bec1b-7e16-4b07-973c-d4af7e27f1a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:38.714223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bec1b-7e16-4b07-973c-d4af7e27f1a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:38.715860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bec1b-7e16-4b07-973c-d4af7e27f1a9 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:38.727027 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 833/1651] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:21:38.728272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b889dc-d3f2-492a-bfa5-6586a14f27d7 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:38.728639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b889dc-d3f2-492a-bfa5-6586a14f27d7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:38.728919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b889dc-d3f2-492a-bfa5-6586a14f27d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:38.735569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60ab19-56e1-45d4-a9d1-45bbb2fed6aa None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:38.741068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43c8d0-f922-40ca-bd0a-80111d74e627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:38.741714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43c8d0-f922-40ca-bd0a-80111d74e627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:38.741988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43c8d0-f922-40ca-bd0a-80111d74e627 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:38.749030 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43c8d0-f922-40ca-bd0a-80111d74e627 admin admin] PATH_INFO: `/v3/users/bc0c2b49f5a3425888656721ad5fb8c7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:38.749030 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43c8d0-f922-40ca-bd0a-80111d74e627 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc0c2b49f5a3425888656721ad5fb8c7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:38.749030 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43c8d0-f922-40ca-bd0a-80111d74e627 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:38.753237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d7b889dc-d3f2-492a-bfa5-6586a14f27d7 None None] MFA Rules not processed for user `9b359391fbc34c259d987e42e8826c86`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:38.754674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d7b889dc-d3f2-492a-bfa5-6586a14f27d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:38.817996 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 834/1652] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:21:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:38.819621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabe4e0-da15-48e3-9588-a6dc004f9eb1 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:38.819992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabe4e0-da15-48e3-9588-a6dc004f9eb1 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:38.820450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabe4e0-da15-48e3-9588-a6dc004f9eb1 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:38.821836 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 835/1653] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 27 03:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:21:38.827442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fe595-2df9-475f-b68c-d369411f9efe None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:38.827727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fe595-2df9-475f-b68c-d369411f9efe None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:38.828042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fe595-2df9-475f-b68c-d369411f9efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:38.850172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-385fe595-2df9-475f-b68c-d369411f9efe None None] MFA Rules not processed for user `c20881251f2241a3a5ec2e5cf99db149`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:38.851395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-385fe595-2df9-475f-b68c-d369411f9efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:38.863529 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 836/1654] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 03:21:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:38.868653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385fe595-2df9-475f-b68c-d369411f9efe None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:38.870195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-385fe595-2df9-475f-b68c-d369411f9efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:38.882519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385fe595-2df9-475f-b68c-d369411f9efe None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:38.886154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6e1f4-fd63-4451-946f-a1d1940b80f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:38.886766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6e1f4-fd63-4451-946f-a1d1940b80f4 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:38.887045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6e1f4-fd63-4451-946f-a1d1940b80f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:38.887313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6e1f4-fd63-4451-946f-a1d1940b80f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:38.895349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6e1f4-fd63-4451-946f-a1d1940b80f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:38.896799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6e1f4-fd63-4451-946f-a1d1940b80f4 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:38.913981 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 837/1655] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:38.913981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6e1f4-fd63-4451-946f-a1d1940b80f4 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:38.916814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6e1f4-fd63-4451-946f-a1d1940b80f4 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:38.921355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d9728-dcf4-4334-85b8-a75f59c9a630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:38.921972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d9728-dcf4-4334-85b8-a75f59c9a630 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:38.923080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d9728-dcf4-4334-85b8-a75f59c9a630 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:38.923366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d9728-dcf4-4334-85b8-a75f59c9a630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:38.949980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d9728-dcf4-4334-85b8-a75f59c9a630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:38.949980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d9728-dcf4-4334-85b8-a75f59c9a630 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:38.964098 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 838/1656] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:39.043324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2f43c8d0-f922-40ca-bd0a-80111d74e627 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc0c2b49f5a3425888656721ad5fb8c7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:39.043324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2f43c8d0-f922-40ca-bd0a-80111d74e627 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc0c2b49f5a3425888656721ad5fb8c7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:39.047154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2f43c8d0-f922-40ca-bd0a-80111d74e627 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc0c2b49f5a3425888656721ad5fb8c7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:39.062274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:39.089475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2f43c8d0-f922-40ca-bd0a-80111d74e627 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc0c2b49f5a3425888656721ad5fb8c7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:39.176242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d9728-dcf4-4334-85b8-a75f59c9a630 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:39.197919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2f43c8d0-f922-40ca-bd0a-80111d74e627 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc0c2b49f5a3425888656721ad5fb8c7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:39.220618 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 819/1657] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:38 2022] DELETE /identity/v3/users/bc0c2b49f5a3425888656721ad5fb8c7 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:39.223032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a52491-b77b-4fcf-b317-5744b29dab4a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:39.223320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a52491-b77b-4fcf-b317-5744b29dab4a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:39.223598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a52491-b77b-4fcf-b317-5744b29dab4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:39.223944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d9728-dcf4-4334-85b8-a75f59c9a630 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:39.276871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e2a52491-b77b-4fcf-b317-5744b29dab4a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:39.281922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:39.283347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e2a52491-b77b-4fcf-b317-5744b29dab4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:39.348046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3417fb-771d-4635-99d7-bee0c04ef151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:39.348046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3417fb-771d-4635-99d7-bee0c04ef151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:39.348046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3417fb-771d-4635-99d7-bee0c04ef151 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:39.348262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3417fb-771d-4635-99d7-bee0c04ef151 admin admin] PATH_INFO: `/v3/users/46b1fb50bed740ddbe860ed904362253` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:39.351003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3417fb-771d-4635-99d7-bee0c04ef151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46b1fb50bed740ddbe860ed904362253)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:39.353011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3417fb-771d-4635-99d7-bee0c04ef151 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:39.411802 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 820/1658] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:39.448288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a52491-b77b-4fcf-b317-5744b29dab4a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:39.451005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e2a52491-b77b-4fcf-b317-5744b29dab4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:39.536243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a52491-b77b-4fcf-b317-5744b29dab4a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:39.541356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f7594-c92a-40b8-b7fc-ddb997e38335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:39.542104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f7594-c92a-40b8-b7fc-ddb997e38335 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:39.542456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f7594-c92a-40b8-b7fc-ddb997e38335 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:39.542781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f7594-c92a-40b8-b7fc-ddb997e38335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:39.554505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f7594-c92a-40b8-b7fc-ddb997e38335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:39.555928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f7594-c92a-40b8-b7fc-ddb997e38335 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:39.589774 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 821/1659] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:21:39.589774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83250185-01b0-4cc8-b238-9fe5b0d3c849 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:39.589774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83250185-01b0-4cc8-b238-9fe5b0d3c849 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:39.589774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83250185-01b0-4cc8-b238-9fe5b0d3c849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:39.604026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0c3417fb-771d-4635-99d7-bee0c04ef151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46b1fb50bed740ddbe860ed904362253'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:39.605125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0c3417fb-771d-4635-99d7-bee0c04ef151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46b1fb50bed740ddbe860ed904362253'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:39.613614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-83250185-01b0-4cc8-b238-9fe5b0d3c849 None None] MFA Rules not processed for user `ae3d2208faeb4421af21da56d455be92`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:39.614999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-83250185-01b0-4cc8-b238-9fe5b0d3c849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:39.631827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0c3417fb-771d-4635-99d7-bee0c04ef151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46b1fb50bed740ddbe860ed904362253'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:39.655038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0c3417fb-771d-4635-99d7-bee0c04ef151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46b1fb50bed740ddbe860ed904362253'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:39.657714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0c3417fb-771d-4635-99d7-bee0c04ef151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46b1fb50bed740ddbe860ed904362253'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:39.687764 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 822/1660] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:39.743009 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 839/1661] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:39 2022] DELETE /identity/v3/users/46b1fb50bed740ddbe860ed904362253 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:21:39.747464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d62591-8921-4cbc-b814-2dfa15517cee None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:39.747936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d62591-8921-4cbc-b814-2dfa15517cee None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:39.748307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d62591-8921-4cbc-b814-2dfa15517cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:39.769935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-76d62591-8921-4cbc-b814-2dfa15517cee None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:39.771361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-76d62591-8921-4cbc-b814-2dfa15517cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:39.884977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:39.922963 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 823/1662] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:39.939971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3417fb-771d-4635-99d7-bee0c04ef151 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:39.941271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0c3417fb-771d-4635-99d7-bee0c04ef151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:40.008869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3417fb-771d-4635-99d7-bee0c04ef151 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:40.013007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1679d-fb46-4df6-b54b-abe83f1649ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:40.013698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1679d-fb46-4df6-b54b-abe83f1649ad service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:40.014129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1679d-fb46-4df6-b54b-abe83f1649ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:40.014517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1679d-fb46-4df6-b54b-abe83f1649ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:40.025908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1679d-fb46-4df6-b54b-abe83f1649ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:40.028020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1679d-fb46-4df6-b54b-abe83f1649ad service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:40.039001 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 840/1663] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:40.308916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d62591-8921-4cbc-b814-2dfa15517cee None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:40.310399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-76d62591-8921-4cbc-b814-2dfa15517cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:40.327322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d62591-8921-4cbc-b814-2dfa15517cee None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:40.373936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e1755-8ecc-45e5-bd3c-14d3dcaf09aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:40.376239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e1755-8ecc-45e5-bd3c-14d3dcaf09aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:40.377020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e1755-8ecc-45e5-bd3c-14d3dcaf09aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:40.378639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e1755-8ecc-45e5-bd3c-14d3dcaf09aa admin admin] PATH_INFO: `/v3/projects/b6969931949a40fa9d2bcf19d686a54c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:40.381766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e1755-8ecc-45e5-bd3c-14d3dcaf09aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6969931949a40fa9d2bcf19d686a54c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:40.391266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e1755-8ecc-45e5-bd3c-14d3dcaf09aa admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:40.587023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7e6e1755-8ecc-45e5-bd3c-14d3dcaf09aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6969931949a40fa9d2bcf19d686a54c', 'request_id': 'req-7e6e1755-8ecc-45e5-bd3c-14d3dcaf09aa'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:40.688731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7e6e1755-8ecc-45e5-bd3c-14d3dcaf09aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6969931949a40fa9d2bcf19d686a54c', 'request_id': 'req-7e6e1755-8ecc-45e5-bd3c-14d3dcaf09aa'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:40.700415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7e6e1755-8ecc-45e5-bd3c-14d3dcaf09aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6969931949a40fa9d2bcf19d686a54c', 'request_id': 'req-7e6e1755-8ecc-45e5-bd3c-14d3dcaf09aa'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:40.727783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7e6e1755-8ecc-45e5-bd3c-14d3dcaf09aa admin admin] The token cache is being invalidate because project b6969931949a40fa9d2bcf19d686a54c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:40.728178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7e6e1755-8ecc-45e5-bd3c-14d3dcaf09aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:40.729337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7e6e1755-8ecc-45e5-bd3c-14d3dcaf09aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:40.731277 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 824/1664] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:40 2022] DELETE /identity/v3/projects/b6969931949a40fa9d2bcf19d686a54c => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:40.735298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1679d-fb46-4df6-b54b-abe83f1649ad service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:40.749616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1679d-fb46-4df6-b54b-abe83f1649ad service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:40.836049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e1755-8ecc-45e5-bd3c-14d3dcaf09aa admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:40.837568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7e6e1755-8ecc-45e5-bd3c-14d3dcaf09aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:40.842083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e3e5f-57e9-4112-8bce-1c75a98ac0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:40.843551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e3e5f-57e9-4112-8bce-1c75a98ac0b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:40.843989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e3e5f-57e9-4112-8bce-1c75a98ac0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:40.844402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e3e5f-57e9-4112-8bce-1c75a98ac0b4 admin admin] PATH_INFO: `/v3/users/d1e25d4a021c4102a526bd6b46e4f52c` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:40.845820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e3e5f-57e9-4112-8bce-1c75a98ac0b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1e25d4a021c4102a526bd6b46e4f52c)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:40.848203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e3e5f-57e9-4112-8bce-1c75a98ac0b4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:40.855665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e1755-8ecc-45e5-bd3c-14d3dcaf09aa admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:40.861648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4853bb-5231-496d-9ce7-7a84526e95e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:40.862592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4853bb-5231-496d-9ce7-7a84526e95e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:40.862879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4853bb-5231-496d-9ce7-7a84526e95e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:40.863157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4853bb-5231-496d-9ce7-7a84526e95e9 admin admin] PATH_INFO: `/v3/projects/b917ec5f17ae4e039e21a111593f36ae` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:40.864967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4853bb-5231-496d-9ce7-7a84526e95e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b917ec5f17ae4e039e21a111593f36ae)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:40.867286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4853bb-5231-496d-9ce7-7a84526e95e9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:41.063176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5c8e3e5f-57e9-4112-8bce-1c75a98ac0b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1e25d4a021c4102a526bd6b46e4f52c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:41.064291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5c8e3e5f-57e9-4112-8bce-1c75a98ac0b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1e25d4a021c4102a526bd6b46e4f52c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:41.073821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5c8e3e5f-57e9-4112-8bce-1c75a98ac0b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1e25d4a021c4102a526bd6b46e4f52c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:41.095062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7b4853bb-5231-496d-9ce7-7a84526e95e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b917ec5f17ae4e039e21a111593f36ae', 'request_id': 'req-7b4853bb-5231-496d-9ce7-7a84526e95e9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:41.113104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:41.121724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5c8e3e5f-57e9-4112-8bce-1c75a98ac0b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1e25d4a021c4102a526bd6b46e4f52c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:41.122795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5c8e3e5f-57e9-4112-8bce-1c75a98ac0b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1e25d4a021c4102a526bd6b46e4f52c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:41.191680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7b4853bb-5231-496d-9ce7-7a84526e95e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b917ec5f17ae4e039e21a111593f36ae', 'request_id': 'req-7b4853bb-5231-496d-9ce7-7a84526e95e9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:41.203098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7b4853bb-5231-496d-9ce7-7a84526e95e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b917ec5f17ae4e039e21a111593f36ae', 'request_id': 'req-7b4853bb-5231-496d-9ce7-7a84526e95e9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:41.215082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7b4853bb-5231-496d-9ce7-7a84526e95e9 admin admin] The token cache is being invalidate because project b917ec5f17ae4e039e21a111593f36ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:41.215369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7b4853bb-5231-496d-9ce7-7a84526e95e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:41.216031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7b4853bb-5231-496d-9ce7-7a84526e95e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:41.217618 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 825/1665] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:40 2022] DELETE /identity/v3/projects/b917ec5f17ae4e039e21a111593f36ae => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:21:41.221420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4853bb-5231-496d-9ce7-7a84526e95e9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:41.222718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7b4853bb-5231-496d-9ce7-7a84526e95e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:41.292975 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 841/1666] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:40 2022] DELETE /identity/v3/users/d1e25d4a021c4102a526bd6b46e4f52c => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:41.312923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4853bb-5231-496d-9ce7-7a84526e95e9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:41.419088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4fd32-3470-4404-a8ef-b033c2ac023b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:41.419738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4fd32-3470-4404-a8ef-b033c2ac023b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:41.420065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4fd32-3470-4404-a8ef-b033c2ac023b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:41.420883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4fd32-3470-4404-a8ef-b033c2ac023b admin admin] PATH_INFO: `/v3/users/969b51aba3c947dfa668ae03aeb589c8` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:41.422112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4fd32-3470-4404-a8ef-b033c2ac023b admin admin] RBAC: Authorizing `identity:delete_user(user_id=969b51aba3c947dfa668ae03aeb589c8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:41.424137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4fd32-3470-4404-a8ef-b033c2ac023b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:41.518153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:41.537503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e3e5f-57e9-4112-8bce-1c75a98ac0b4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:41.539350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5c8e3e5f-57e9-4112-8bce-1c75a98ac0b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:41.585063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e3e5f-57e9-4112-8bce-1c75a98ac0b4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:41.591881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4770ba5-43c8-4130-a5d2-84660eeb6ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:41.593388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4770ba5-43c8-4130-a5d2-84660eeb6ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:41.593824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4770ba5-43c8-4130-a5d2-84660eeb6ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:41.594357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4770ba5-43c8-4130-a5d2-84660eeb6ba2 admin admin] PATH_INFO: `/v3/users/747002f449e641f0a7d2c0f38cf541a0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:41.595677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4770ba5-43c8-4130-a5d2-84660eeb6ba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=747002f449e641f0a7d2c0f38cf541a0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:41.599079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4770ba5-43c8-4130-a5d2-84660eeb6ba2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:41.616056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-85a4fd32-3470-4404-a8ef-b033c2ac023b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '969b51aba3c947dfa668ae03aeb589c8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:41.616975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-85a4fd32-3470-4404-a8ef-b033c2ac023b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '969b51aba3c947dfa668ae03aeb589c8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:41.627721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-85a4fd32-3470-4404-a8ef-b033c2ac023b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '969b51aba3c947dfa668ae03aeb589c8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:41.651122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-85a4fd32-3470-4404-a8ef-b033c2ac023b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '969b51aba3c947dfa668ae03aeb589c8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:41.771233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-85a4fd32-3470-4404-a8ef-b033c2ac023b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '969b51aba3c947dfa668ae03aeb589c8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:41.778231 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 826/1667] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:41 2022] DELETE /identity/v3/users/969b51aba3c947dfa668ae03aeb589c8 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:21:41.782652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4fd32-3470-4404-a8ef-b033c2ac023b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:41.784534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-85a4fd32-3470-4404-a8ef-b033c2ac023b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:41.853474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d4770ba5-43c8-4130-a5d2-84660eeb6ba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '747002f449e641f0a7d2c0f38cf541a0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:41.854474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d4770ba5-43c8-4130-a5d2-84660eeb6ba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '747002f449e641f0a7d2c0f38cf541a0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:41.862468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d4770ba5-43c8-4130-a5d2-84660eeb6ba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '747002f449e641f0a7d2c0f38cf541a0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:41.866574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4fd32-3470-4404-a8ef-b033c2ac023b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:41.872827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebbf34-578c-4f30-a764-184290d35b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:41.876977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebbf34-578c-4f30-a764-184290d35b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:41.876977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebbf34-578c-4f30-a764-184290d35b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:41.876977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebbf34-578c-4f30-a764-184290d35b4c admin admin] PATH_INFO: `/v3/users/015a9fcd508e4d20ad51dcb71053c28f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:41.877223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d4770ba5-43c8-4130-a5d2-84660eeb6ba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '747002f449e641f0a7d2c0f38cf541a0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:41.877316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebbf34-578c-4f30-a764-184290d35b4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=015a9fcd508e4d20ad51dcb71053c28f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:41.877390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d4770ba5-43c8-4130-a5d2-84660eeb6ba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '747002f449e641f0a7d2c0f38cf541a0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:41.877848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebbf34-578c-4f30-a764-184290d35b4c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:41.905757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:41.969519 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 842/1668] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:41 2022] DELETE /identity/v3/users/747002f449e641f0a7d2c0f38cf541a0 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:41.970576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4770ba5-43c8-4130-a5d2-84660eeb6ba2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:41.973659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d4770ba5-43c8-4130-a5d2-84660eeb6ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:42.065916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4770ba5-43c8-4130-a5d2-84660eeb6ba2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:42.071662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839fff5a-5995-4b3c-9b3c-10623b7a5f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:42.072819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fff5a-5995-4b3c-9b3c-10623b7a5f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:42.073534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fff5a-5995-4b3c-9b3c-10623b7a5f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:42.074709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fff5a-5995-4b3c-9b3c-10623b7a5f5c admin admin] PATH_INFO: `/v3/projects/0ee1195a82e645029b39497fdfad0e18` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:42.075992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839fff5a-5995-4b3c-9b3c-10623b7a5f5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ee1195a82e645029b39497fdfad0e18)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:42.078586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839fff5a-5995-4b3c-9b3c-10623b7a5f5c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:42.122938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ceebbf34-578c-4f30-a764-184290d35b4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '015a9fcd508e4d20ad51dcb71053c28f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:42.130220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ceebbf34-578c-4f30-a764-184290d35b4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '015a9fcd508e4d20ad51dcb71053c28f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:42.133480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ceebbf34-578c-4f30-a764-184290d35b4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '015a9fcd508e4d20ad51dcb71053c28f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:42.180503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ceebbf34-578c-4f30-a764-184290d35b4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '015a9fcd508e4d20ad51dcb71053c28f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:42.207536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-839fff5a-5995-4b3c-9b3c-10623b7a5f5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ee1195a82e645029b39497fdfad0e18', 'request_id': 'req-839fff5a-5995-4b3c-9b3c-10623b7a5f5c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:42.215039 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-839fff5a-5995-4b3c-9b3c-10623b7a5f5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ee1195a82e645029b39497fdfad0e18', 'request_id': 'req-839fff5a-5995-4b3c-9b3c-10623b7a5f5c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:42.223167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-839fff5a-5995-4b3c-9b3c-10623b7a5f5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ee1195a82e645029b39497fdfad0e18', 'request_id': 'req-839fff5a-5995-4b3c-9b3c-10623b7a5f5c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:42.278517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ceebbf34-578c-4f30-a764-184290d35b4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '015a9fcd508e4d20ad51dcb71053c28f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:42.290377 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 827/1669] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:41 2022] DELETE /identity/v3/users/015a9fcd508e4d20ad51dcb71053c28f => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:42.292073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec19035-5a8f-445c-989a-6be29a1a500a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:42.292500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec19035-5a8f-445c-989a-6be29a1a500a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:42.293550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec19035-5a8f-445c-989a-6be29a1a500a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:42.320825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0ec19035-5a8f-445c-989a-6be29a1a500a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:42.322893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0ec19035-5a8f-445c-989a-6be29a1a500a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:42.397404 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 828/1670] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:42.398907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447ced5-e2f5-4062-b4e0-f19e693de51b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:42.399301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447ced5-e2f5-4062-b4e0-f19e693de51b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:42.399682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447ced5-e2f5-4062-b4e0-f19e693de51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:42.419535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4447ced5-e2f5-4062-b4e0-f19e693de51b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:42.420827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4447ced5-e2f5-4062-b4e0-f19e693de51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:42.428755 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 829/1671] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:42.430536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447ced5-e2f5-4062-b4e0-f19e693de51b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:42.432107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4447ced5-e2f5-4062-b4e0-f19e693de51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:42.470413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-839fff5a-5995-4b3c-9b3c-10623b7a5f5c admin admin] The token cache is being invalidate because project 0ee1195a82e645029b39497fdfad0e18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:42.470852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-839fff5a-5995-4b3c-9b3c-10623b7a5f5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:42.471910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-839fff5a-5995-4b3c-9b3c-10623b7a5f5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:42.477409 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 843/1672] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:41 2022] DELETE /identity/v3/projects/0ee1195a82e645029b39497fdfad0e18 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:42.479208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839fff5a-5995-4b3c-9b3c-10623b7a5f5c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:42.481214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-839fff5a-5995-4b3c-9b3c-10623b7a5f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:42.503764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447ced5-e2f5-4062-b4e0-f19e693de51b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:42.509184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5db51a-e8ac-4e7a-b14e-354169689c2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:42.509826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5db51a-e8ac-4e7a-b14e-354169689c2b service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:42.510133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5db51a-e8ac-4e7a-b14e-354169689c2b service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:42.510674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5db51a-e8ac-4e7a-b14e-354169689c2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:42.512231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8b5db51a-e8ac-4e7a-b14e-354169689c2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:42.539223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5db51a-e8ac-4e7a-b14e-354169689c2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:42.541356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5db51a-e8ac-4e7a-b14e-354169689c2b service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:42.554353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839fff5a-5995-4b3c-9b3c-10623b7a5f5c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:42.560475 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 830/1673] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:42.562746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822c417-c2f9-49d8-b0db-a21170e055dd None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:42.563235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822c417-c2f9-49d8-b0db-a21170e055dd None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:42.563642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822c417-c2f9-49d8-b0db-a21170e055dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:42.577871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cb905-6833-4481-a824-209e4ca5e826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:42.578842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cb905-6833-4481-a824-209e4ca5e826 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:42.579193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cb905-6833-4481-a824-209e4ca5e826 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:42.579529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cb905-6833-4481-a824-209e4ca5e826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:42.584430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-896cb905-6833-4481-a824-209e4ca5e826 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:42.592632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5822c417-c2f9-49d8-b0db-a21170e055dd None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:42.592632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5822c417-c2f9-49d8-b0db-a21170e055dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:42.609418 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 831/1674] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:42.625884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc407989-b2ef-4480-a13f-ad5b249b4f01 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:42.626193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc407989-b2ef-4480-a13f-ad5b249b4f01 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:42.626476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc407989-b2ef-4480-a13f-ad5b249b4f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:42.634367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896cb905-6833-4481-a824-209e4ca5e826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:42.640075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896cb905-6833-4481-a824-209e4ca5e826 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:42.653945 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 844/1675] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:42.654938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cb905-6833-4481-a824-209e4ca5e826 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:42.656710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-896cb905-6833-4481-a824-209e4ca5e826 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:42.661937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-cc407989-b2ef-4480-a13f-ad5b249b4f01 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:42.663393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cc407989-b2ef-4480-a13f-ad5b249b4f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:42.671873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cb905-6833-4481-a824-209e4ca5e826 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:42.675910 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 832/1676] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:42.678165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d600d81-3bf2-44d4-9615-e1ef789aaadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:42.678922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d600d81-3bf2-44d4-9615-e1ef789aaadb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:42.679475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d600d81-3bf2-44d4-9615-e1ef789aaadb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:42.679762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d600d81-3bf2-44d4-9615-e1ef789aaadb admin admin] PATH_INFO: `/v3/projects/3a96cc0969134743b59a328cdfe6ec39` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:42.680546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc407989-b2ef-4480-a13f-ad5b249b4f01 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:42.681213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d600d81-3bf2-44d4-9615-e1ef789aaadb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a96cc0969134743b59a328cdfe6ec39)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:42.683196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d600d81-3bf2-44d4-9615-e1ef789aaadb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:42.695018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc407989-b2ef-4480-a13f-ad5b249b4f01 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:42.702578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642dd08-2bde-4e4b-8703-a0ff9fbc097a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:42.703386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642dd08-2bde-4e4b-8703-a0ff9fbc097a admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:42.703884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642dd08-2bde-4e4b-8703-a0ff9fbc097a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:42.704334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642dd08-2bde-4e4b-8703-a0ff9fbc097a admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:42.705283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642dd08-2bde-4e4b-8703-a0ff9fbc097a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:21:42.705825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642dd08-2bde-4e4b-8703-a0ff9fbc097a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:42.707803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642dd08-2bde-4e4b-8703-a0ff9fbc097a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:42.729815 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 833/1677] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:21:42.730935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642dd08-2bde-4e4b-8703-a0ff9fbc097a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:42.743012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642dd08-2bde-4e4b-8703-a0ff9fbc097a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:42.749203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b4490-a21b-445b-bb98-0e941b8ef93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:42.749832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b4490-a21b-445b-bb98-0e941b8ef93f admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:42.750151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b4490-a21b-445b-bb98-0e941b8ef93f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:42.750431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b4490-a21b-445b-bb98-0e941b8ef93f admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:42.751155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b4490-a21b-445b-bb98-0e941b8ef93f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:42.753040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b4490-a21b-445b-bb98-0e941b8ef93f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:42.822063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1d600d81-3bf2-44d4-9615-e1ef789aaadb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a96cc0969134743b59a328cdfe6ec39', 'request_id': 'req-1d600d81-3bf2-44d4-9615-e1ef789aaadb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:42.828394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1d600d81-3bf2-44d4-9615-e1ef789aaadb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a96cc0969134743b59a328cdfe6ec39', 'request_id': 'req-1d600d81-3bf2-44d4-9615-e1ef789aaadb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:42.834359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1d600d81-3bf2-44d4-9615-e1ef789aaadb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a96cc0969134743b59a328cdfe6ec39', 'request_id': 'req-1d600d81-3bf2-44d4-9615-e1ef789aaadb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:42.842066 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 834/1678] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:42 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:42.843742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b4490-a21b-445b-bb98-0e941b8ef93f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:42.908512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1d600d81-3bf2-44d4-9615-e1ef789aaadb admin admin] The token cache is being invalidate because project 3a96cc0969134743b59a328cdfe6ec39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:42.909017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1d600d81-3bf2-44d4-9615-e1ef789aaadb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:42.909860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1d600d81-3bf2-44d4-9615-e1ef789aaadb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:42.913962 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 845/1679] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:42 2022] DELETE /identity/v3/projects/3a96cc0969134743b59a328cdfe6ec39 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:42.918118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b4490-a21b-445b-bb98-0e941b8ef93f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:42.919758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68aee4e-9fe0-4341-95cd-92874e8ca903 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:42.920985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68aee4e-9fe0-4341-95cd-92874e8ca903 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:42.921368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68aee4e-9fe0-4341-95cd-92874e8ca903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:42.930100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96273057-b9ed-423c-87d3-d108bec4a83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:42.931075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96273057-b9ed-423c-87d3-d108bec4a83e admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:42.931572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96273057-b9ed-423c-87d3-d108bec4a83e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:42.932209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96273057-b9ed-423c-87d3-d108bec4a83e admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:42.933742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96273057-b9ed-423c-87d3-d108bec4a83e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:42.936869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96273057-b9ed-423c-87d3-d108bec4a83e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:43.003732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f68aee4e-9fe0-4341-95cd-92874e8ca903 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:43.007703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f68aee4e-9fe0-4341-95cd-92874e8ca903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:43.033058 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 846/1680] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:43.036402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0f9db-22f7-4766-8f09-a0d5609bc340 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:43.036795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0f9db-22f7-4766-8f09-a0d5609bc340 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:43.037084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0f9db-22f7-4766-8f09-a0d5609bc340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:43.062901 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 835/1681] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:42 2022] POST /identity/v3/users => generated 291 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:21:43.067405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96273057-b9ed-423c-87d3-d108bec4a83e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:43.069147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-96273057-b9ed-423c-87d3-d108bec4a83e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:43.075455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f3a0f9db-22f7-4766-8f09-a0d5609bc340 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:43.076831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f3a0f9db-22f7-4766-8f09-a0d5609bc340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:43.085422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96273057-b9ed-423c-87d3-d108bec4a83e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:43.100621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bea6f5-178e-4f86-9183-8cf47bab99f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:43.101376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bea6f5-178e-4f86-9183-8cf47bab99f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:43.101668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bea6f5-178e-4f86-9183-8cf47bab99f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:43.102134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bea6f5-178e-4f86-9183-8cf47bab99f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:43.103358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bea6f5-178e-4f86-9183-8cf47bab99f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:43.107406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bea6f5-178e-4f86-9183-8cf47bab99f9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:43.118539 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 847/1682] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:43.122935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0f9db-22f7-4766-8f09-a0d5609bc340 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:43.128721 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 836/1683] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:21:43.132894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bea6f5-178e-4f86-9183-8cf47bab99f9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:43.137347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0f9db-22f7-4766-8f09-a0d5609bc340 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:43.146698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bea6f5-178e-4f86-9183-8cf47bab99f9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:43.154330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009cedc-f4f0-4e9f-83b5-907f9e5c03bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:43.155433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009cedc-f4f0-4e9f-83b5-907f9e5c03bc admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:43.155836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009cedc-f4f0-4e9f-83b5-907f9e5c03bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:43.156125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009cedc-f4f0-4e9f-83b5-907f9e5c03bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:43.156783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009cedc-f4f0-4e9f-83b5-907f9e5c03bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:43.158515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009cedc-f4f0-4e9f-83b5-907f9e5c03bc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:43.160326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847feaea-00d2-463a-9f13-84137380ee49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:43.161186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847feaea-00d2-463a-9f13-84137380ee49 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:43.161606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847feaea-00d2-463a-9f13-84137380ee49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:43.162143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847feaea-00d2-463a-9f13-84137380ee49 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:43.166471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847feaea-00d2-463a-9f13-84137380ee49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:21:43.166934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847feaea-00d2-463a-9f13-84137380ee49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:43.169819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847feaea-00d2-463a-9f13-84137380ee49 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:43.178965 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 837/1684] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:21:43.178965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009cedc-f4f0-4e9f-83b5-907f9e5c03bc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:43.185145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c009cedc-f4f0-4e9f-83b5-907f9e5c03bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:43.190007 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 848/1685] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:21:43.191362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847feaea-00d2-463a-9f13-84137380ee49 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:43.200562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009cedc-f4f0-4e9f-83b5-907f9e5c03bc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:43.203869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847feaea-00d2-463a-9f13-84137380ee49 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:43.208783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67093f09-6e42-4d76-a6aa-3e5b7690be41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:43.209439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67093f09-6e42-4d76-a6aa-3e5b7690be41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:43.218550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67093f09-6e42-4d76-a6aa-3e5b7690be41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:43.218550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67093f09-6e42-4d76-a6aa-3e5b7690be41 admin admin] PATH_INFO: `/v3/projects/2cee0e3469fc42a49004f9b5d1f5b6d0` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:43.218550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67093f09-6e42-4d76-a6aa-3e5b7690be41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cee0e3469fc42a49004f9b5d1f5b6d0)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:43.218890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88889489-07bc-4932-baa0-cea017e46029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:43.218890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88889489-07bc-4932-baa0-cea017e46029 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:43.218890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88889489-07bc-4932-baa0-cea017e46029 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:43.218890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88889489-07bc-4932-baa0-cea017e46029 admin admin] PATH_INFO: `/v3/projects/3556f61432de40308762eef473ea4ce8/users/6b578dba0ba146d9a8e48d57814932eb/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:43.220017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67093f09-6e42-4d76-a6aa-3e5b7690be41 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:43.244716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88889489-07bc-4932-baa0-cea017e46029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3556f61432de40308762eef473ea4ce8, user_id=6b578dba0ba146d9a8e48d57814932eb, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:43.247529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88889489-07bc-4932-baa0-cea017e46029 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:43.343591 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 849/1686] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:43 2022] PUT /identity/v3/projects/3556f61432de40308762eef473ea4ce8/users/6b578dba0ba146d9a8e48d57814932eb/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:43.351276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88889489-07bc-4932-baa0-cea017e46029 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:43.357387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-67093f09-6e42-4d76-a6aa-3e5b7690be41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'request_id': 'req-67093f09-6e42-4d76-a6aa-3e5b7690be41'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:43.444903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-67093f09-6e42-4d76-a6aa-3e5b7690be41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'request_id': 'req-67093f09-6e42-4d76-a6aa-3e5b7690be41'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:43.452863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-67093f09-6e42-4d76-a6aa-3e5b7690be41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'request_id': 'req-67093f09-6e42-4d76-a6aa-3e5b7690be41'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:43.454081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88889489-07bc-4932-baa0-cea017e46029 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:43.474355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-67093f09-6e42-4d76-a6aa-3e5b7690be41 admin admin] The token cache is being invalidate because project 2cee0e3469fc42a49004f9b5d1f5b6d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:43.474355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-67093f09-6e42-4d76-a6aa-3e5b7690be41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:43.474355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-67093f09-6e42-4d76-a6aa-3e5b7690be41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:43.474355 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 838/1687] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:43 2022] DELETE /identity/v3/projects/2cee0e3469fc42a49004f9b5d1f5b6d0 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:43.486253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67093f09-6e42-4d76-a6aa-3e5b7690be41 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:43.486253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-67093f09-6e42-4d76-a6aa-3e5b7690be41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:43.527246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19efae-aaf2-4b56-91ba-febd1299f544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:43.527893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19efae-aaf2-4b56-91ba-febd1299f544 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:43.528208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19efae-aaf2-4b56-91ba-febd1299f544 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:43.528480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19efae-aaf2-4b56-91ba-febd1299f544 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:43.529255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19efae-aaf2-4b56-91ba-febd1299f544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:43.531847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19efae-aaf2-4b56-91ba-febd1299f544 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:43.560707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67093f09-6e42-4d76-a6aa-3e5b7690be41 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:43.570815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65832023-e428-4dd8-9109-ceb14ec2f90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:43.571548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65832023-e428-4dd8-9109-ceb14ec2f90c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:43.571900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65832023-e428-4dd8-9109-ceb14ec2f90c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:43.572264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65832023-e428-4dd8-9109-ceb14ec2f90c admin admin] PATH_INFO: `/v3/projects/873ceb34cf6548fdb54bdd7c39c9318b` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:43.573536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65832023-e428-4dd8-9109-ceb14ec2f90c admin admin] RBAC: Authorizing `identity:delete_project(project_id=873ceb34cf6548fdb54bdd7c39c9318b)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:43.575502 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65832023-e428-4dd8-9109-ceb14ec2f90c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:43.626236 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 850/1688] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:43 2022] POST /identity/v3/projects => generated 361 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:43.627633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98993cc-2029-4ae8-b23d-c8714a8ace60 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:43.627930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98993cc-2029-4ae8-b23d-c8714a8ace60 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:43.629320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98993cc-2029-4ae8-b23d-c8714a8ace60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:43.662566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e98993cc-2029-4ae8-b23d-c8714a8ace60 None None] MFA Rules not processed for user `6b578dba0ba146d9a8e48d57814932eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:43.663849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e98993cc-2029-4ae8-b23d-c8714a8ace60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:43.707744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-65832023-e428-4dd8-9109-ceb14ec2f90c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '873ceb34cf6548fdb54bdd7c39c9318b', 'request_id': 'req-65832023-e428-4dd8-9109-ceb14ec2f90c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:43.740284 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 851/1689] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:43.741407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98993cc-2029-4ae8-b23d-c8714a8ace60 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:43.742756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e98993cc-2029-4ae8-b23d-c8714a8ace60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:43.782237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-65832023-e428-4dd8-9109-ceb14ec2f90c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '873ceb34cf6548fdb54bdd7c39c9318b', 'request_id': 'req-65832023-e428-4dd8-9109-ceb14ec2f90c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:43.791230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-65832023-e428-4dd8-9109-ceb14ec2f90c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '873ceb34cf6548fdb54bdd7c39c9318b', 'request_id': 'req-65832023-e428-4dd8-9109-ceb14ec2f90c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:43.814933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-65832023-e428-4dd8-9109-ceb14ec2f90c admin admin] The token cache is being invalidate because project 873ceb34cf6548fdb54bdd7c39c9318b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:43.815353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-65832023-e428-4dd8-9109-ceb14ec2f90c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:43.816416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-65832023-e428-4dd8-9109-ceb14ec2f90c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:43.821210 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 839/1690] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:43 2022] DELETE /identity/v3/projects/873ceb34cf6548fdb54bdd7c39c9318b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:43.821210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65832023-e428-4dd8-9109-ceb14ec2f90c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:43.821210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-65832023-e428-4dd8-9109-ceb14ec2f90c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:43.840911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98993cc-2029-4ae8-b23d-c8714a8ace60 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:43.902220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65832023-e428-4dd8-9109-ceb14ec2f90c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:43.907374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15445fb6-26d1-4597-bc80-92c1725cc94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:43.907988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15445fb6-26d1-4597-bc80-92c1725cc94b admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:43.908410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15445fb6-26d1-4597-bc80-92c1725cc94b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:43.908699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15445fb6-26d1-4597-bc80-92c1725cc94b admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:43.909079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ed393-76c4-41c5-af74-3cfb122587b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:43.909548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15445fb6-26d1-4597-bc80-92c1725cc94b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:43.909722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ed393-76c4-41c5-af74-3cfb122587b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:43.910081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ed393-76c4-41c5-af74-3cfb122587b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:43.910365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ed393-76c4-41c5-af74-3cfb122587b5 admin admin] PATH_INFO: `/v3/users/f019f47a03c74f59aaae11ba363180e1` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:43.911545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15445fb6-26d1-4597-bc80-92c1725cc94b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:43.911681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ed393-76c4-41c5-af74-3cfb122587b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f019f47a03c74f59aaae11ba363180e1)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:43.913476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ed393-76c4-41c5-af74-3cfb122587b5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:43.919281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:43.999633 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 840/1691] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:43 2022] POST /identity/v3/users => generated 281 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:44.000387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15445fb6-26d1-4597-bc80-92c1725cc94b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:44.002076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-15445fb6-26d1-4597-bc80-92c1725cc94b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:44.014985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15445fb6-26d1-4597-bc80-92c1725cc94b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:44.019894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdf71f-1158-4028-8107-a63eac2e1566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:44.020547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdf71f-1158-4028-8107-a63eac2e1566 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:44.020837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdf71f-1158-4028-8107-a63eac2e1566 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:44.021117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdf71f-1158-4028-8107-a63eac2e1566 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:44.021752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdf71f-1158-4028-8107-a63eac2e1566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:44.023760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdf71f-1158-4028-8107-a63eac2e1566 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:44.144207 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 841/1692] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:43 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:44.148952 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdf71f-1158-4028-8107-a63eac2e1566 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:44.151113 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dfcdf71f-1158-4028-8107-a63eac2e1566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:44.153635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-320ed393-76c4-41c5-af74-3cfb122587b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f019f47a03c74f59aaae11ba363180e1'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:44.154423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-320ed393-76c4-41c5-af74-3cfb122587b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f019f47a03c74f59aaae11ba363180e1'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:44.162319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-320ed393-76c4-41c5-af74-3cfb122587b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f019f47a03c74f59aaae11ba363180e1'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:44.189210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-320ed393-76c4-41c5-af74-3cfb122587b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f019f47a03c74f59aaae11ba363180e1'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:44.190681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-320ed393-76c4-41c5-af74-3cfb122587b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f019f47a03c74f59aaae11ba363180e1'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:44.251700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdf71f-1158-4028-8107-a63eac2e1566 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:44.257723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f964c-1f96-4064-a074-a26caa1fca3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:44.259051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f964c-1f96-4064-a074-a26caa1fca3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:44.259353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f964c-1f96-4064-a074-a26caa1fca3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:44.259643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f964c-1f96-4064-a074-a26caa1fca3d admin admin] PATH_INFO: `/v3/users/fb130d3fbf88475ab63f87ce203d563f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:44.260872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f964c-1f96-4064-a074-a26caa1fca3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb130d3fbf88475ab63f87ce203d563f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:44.263533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f964c-1f96-4064-a074-a26caa1fca3d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:44.274452 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 852/1693] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:43 2022] DELETE /identity/v3/users/f019f47a03c74f59aaae11ba363180e1 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:44.274452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ed393-76c4-41c5-af74-3cfb122587b5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:44.274452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-320ed393-76c4-41c5-af74-3cfb122587b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:44.303677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:44.408551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ed393-76c4-41c5-af74-3cfb122587b5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:44.422939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576722a2-5ee9-4d22-8ea1-608c5e92f05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:44.423754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576722a2-5ee9-4d22-8ea1-608c5e92f05f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:44.424091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576722a2-5ee9-4d22-8ea1-608c5e92f05f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:44.424420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576722a2-5ee9-4d22-8ea1-608c5e92f05f admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:44.425355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576722a2-5ee9-4d22-8ea1-608c5e92f05f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:44.428130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576722a2-5ee9-4d22-8ea1-608c5e92f05f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:44.441925 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 853/1694] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:44.442878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576722a2-5ee9-4d22-8ea1-608c5e92f05f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:44.445218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-576722a2-5ee9-4d22-8ea1-608c5e92f05f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:44.459364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576722a2-5ee9-4d22-8ea1-608c5e92f05f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:44.465028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e59154-95f6-4654-b801-46ee437a3ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:44.474654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e59154-95f6-4654-b801-46ee437a3ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:44.476043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e59154-95f6-4654-b801-46ee437a3ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:44.479400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e59154-95f6-4654-b801-46ee437a3ca0 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:44.481068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e59154-95f6-4654-b801-46ee437a3ca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:44.488930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e59154-95f6-4654-b801-46ee437a3ca0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:44.495337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b34f964c-1f96-4064-a074-a26caa1fca3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb130d3fbf88475ab63f87ce203d563f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:44.496648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b34f964c-1f96-4064-a074-a26caa1fca3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb130d3fbf88475ab63f87ce203d563f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:44.506721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b34f964c-1f96-4064-a074-a26caa1fca3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb130d3fbf88475ab63f87ce203d563f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:44.519374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b34f964c-1f96-4064-a074-a26caa1fca3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb130d3fbf88475ab63f87ce203d563f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:44.601681 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 854/1695] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:44 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:44.603109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e59154-95f6-4654-b801-46ee437a3ca0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:44.609523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-70e59154-95f6-4654-b801-46ee437a3ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:44.623156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e59154-95f6-4654-b801-46ee437a3ca0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:44.630319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba40199-3bb5-4894-b30e-38c7933bd8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:44.631118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba40199-3bb5-4894-b30e-38c7933bd8ad admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:44.631625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba40199-3bb5-4894-b30e-38c7933bd8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:44.632087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba40199-3bb5-4894-b30e-38c7933bd8ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:44.632909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba40199-3bb5-4894-b30e-38c7933bd8ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:44.634718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba40199-3bb5-4894-b30e-38c7933bd8ad admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:44.645850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b34f964c-1f96-4064-a074-a26caa1fca3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb130d3fbf88475ab63f87ce203d563f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:44.648946 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 855/1696] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:44.650325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba40199-3bb5-4894-b30e-38c7933bd8ad admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:44.653251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fba40199-3bb5-4894-b30e-38c7933bd8ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:44.658952 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 842/1697] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:44 2022] DELETE /identity/v3/users/fb130d3fbf88475ab63f87ce203d563f => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:44.659839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f964c-1f96-4064-a074-a26caa1fca3d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:44.676289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba40199-3bb5-4894-b30e-38c7933bd8ad admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:44.743261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f964c-1f96-4064-a074-a26caa1fca3d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:44.752621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc394732-3713-4f23-8767-fb0dadf9261d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:44.753408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc394732-3713-4f23-8767-fb0dadf9261d admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:44.753698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc394732-3713-4f23-8767-fb0dadf9261d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:44.753975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc394732-3713-4f23-8767-fb0dadf9261d admin admin] PATH_INFO: `/v3/projects/c2f7992345614b94a5030c7194ad6fd1/users/83b69c5af6224eb799552fcac6105cd0/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:44.765312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af55e76-e21b-48f8-9abc-b8cea9aae0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:44.765859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af55e76-e21b-48f8-9abc-b8cea9aae0ee admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:44.766147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af55e76-e21b-48f8-9abc-b8cea9aae0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:44.766422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af55e76-e21b-48f8-9abc-b8cea9aae0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:44.767336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af55e76-e21b-48f8-9abc-b8cea9aae0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:44.769836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af55e76-e21b-48f8-9abc-b8cea9aae0ee admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:44.777673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc394732-3713-4f23-8767-fb0dadf9261d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2f7992345614b94a5030c7194ad6fd1, user_id=83b69c5af6224eb799552fcac6105cd0, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:44.781033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc394732-3713-4f23-8767-fb0dadf9261d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:44.786098 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 856/1698] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:44.787218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af55e76-e21b-48f8-9abc-b8cea9aae0ee admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:44.790807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8af55e76-e21b-48f8-9abc-b8cea9aae0ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:44.804067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af55e76-e21b-48f8-9abc-b8cea9aae0ee admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:44.809896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934391bf-fe17-46cc-94af-af11f9e6f96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:44.810703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934391bf-fe17-46cc-94af-af11f9e6f96a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:44.811146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934391bf-fe17-46cc-94af-af11f9e6f96a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:44.811524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934391bf-fe17-46cc-94af-af11f9e6f96a admin admin] PATH_INFO: `/v3/projects/94e3ce3876734a51b1857a6e6f40be07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:44.813368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934391bf-fe17-46cc-94af-af11f9e6f96a admin admin] RBAC: Authorizing `identity:delete_project(project_id=94e3ce3876734a51b1857a6e6f40be07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:44.818523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934391bf-fe17-46cc-94af-af11f9e6f96a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:44.846476 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 843/1699] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:44 2022] PUT /identity/v3/projects/c2f7992345614b94a5030c7194ad6fd1/users/83b69c5af6224eb799552fcac6105cd0/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:44.847378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc394732-3713-4f23-8767-fb0dadf9261d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:44.917105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc394732-3713-4f23-8767-fb0dadf9261d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:44.922431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef6051-7ef4-452d-bc28-efa9a826ef00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:44.923693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef6051-7ef4-452d-bc28-efa9a826ef00 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:44.923693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef6051-7ef4-452d-bc28-efa9a826ef00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:44.923693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef6051-7ef4-452d-bc28-efa9a826ef00 admin admin] PATH_INFO: `/v3/projects/6776414ecd6d4c84b9450c1b5595846a/users/95aacfa6f0c341588669e25da92ca60c/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:44.976905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-934391bf-fe17-46cc-94af-af11f9e6f96a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94e3ce3876734a51b1857a6e6f40be07', 'request_id': 'req-934391bf-fe17-46cc-94af-af11f9e6f96a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:44.985429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-934391bf-fe17-46cc-94af-af11f9e6f96a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94e3ce3876734a51b1857a6e6f40be07', 'request_id': 'req-934391bf-fe17-46cc-94af-af11f9e6f96a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:44.992839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-934391bf-fe17-46cc-94af-af11f9e6f96a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94e3ce3876734a51b1857a6e6f40be07', 'request_id': 'req-934391bf-fe17-46cc-94af-af11f9e6f96a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:45.062561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef6051-7ef4-452d-bc28-efa9a826ef00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6776414ecd6d4c84b9450c1b5595846a, user_id=95aacfa6f0c341588669e25da92ca60c, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:45.065292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef6051-7ef4-452d-bc28-efa9a826ef00 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:45.079709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-934391bf-fe17-46cc-94af-af11f9e6f96a admin admin] The token cache is being invalidate because project 94e3ce3876734a51b1857a6e6f40be07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:45.080070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-934391bf-fe17-46cc-94af-af11f9e6f96a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:45.082463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-934391bf-fe17-46cc-94af-af11f9e6f96a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:45.085891 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 857/1700] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:44 2022] DELETE /identity/v3/projects/94e3ce3876734a51b1857a6e6f40be07 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:45.087364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad3036-1415-40a5-be44-dada78d4ac34 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:45.087635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad3036-1415-40a5-be44-dada78d4ac34 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:45.087999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad3036-1415-40a5-be44-dada78d4ac34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:45.135568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c0ad3036-1415-40a5-be44-dada78d4ac34 None None] MFA Rules not processed for user `83b69c5af6224eb799552fcac6105cd0`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:45.136801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c0ad3036-1415-40a5-be44-dada78d4ac34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:45.151132 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 844/1701] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:44 2022] PUT /identity/v3/projects/6776414ecd6d4c84b9450c1b5595846a/users/95aacfa6f0c341588669e25da92ca60c/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:45.151132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730aaeb-5dea-4d1a-8a8e-d199bbb47ba1 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:45.151132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730aaeb-5dea-4d1a-8a8e-d199bbb47ba1 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:45.151132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730aaeb-5dea-4d1a-8a8e-d199bbb47ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:45.174881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6730aaeb-5dea-4d1a-8a8e-d199bbb47ba1 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:45.177419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6730aaeb-5dea-4d1a-8a8e-d199bbb47ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:45.235211 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 858/1702] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:45.236436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad3036-1415-40a5-be44-dada78d4ac34 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:45.239716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c0ad3036-1415-40a5-be44-dada78d4ac34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:45.262958 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 845/1703] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:45.270378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730aaeb-5dea-4d1a-8a8e-d199bbb47ba1 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:45.271767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6730aaeb-5dea-4d1a-8a8e-d199bbb47ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:45.284670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730aaeb-5dea-4d1a-8a8e-d199bbb47ba1 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:45.289780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e8127-fe1e-41da-8122-eba3cc00f8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:45.290436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e8127-fe1e-41da-8122-eba3cc00f8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:45.290719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e8127-fe1e-41da-8122-eba3cc00f8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:45.290995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e8127-fe1e-41da-8122-eba3cc00f8a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:45.291803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e8127-fe1e-41da-8122-eba3cc00f8a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:45.293929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e8127-fe1e-41da-8122-eba3cc00f8a0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:45.325571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad3036-1415-40a5-be44-dada78d4ac34 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:45.331662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d49755-fd91-4cae-b6fe-e4ba40dcddbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:45.332311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d49755-fd91-4cae-b6fe-e4ba40dcddbd admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:45.332596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d49755-fd91-4cae-b6fe-e4ba40dcddbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:45.332895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d49755-fd91-4cae-b6fe-e4ba40dcddbd admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:45.333551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d49755-fd91-4cae-b6fe-e4ba40dcddbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:45.335195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d49755-fd91-4cae-b6fe-e4ba40dcddbd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:45.346283 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 859/1704] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:45.347654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808fa6a-06af-4717-9ad9-4fc9189a30da None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:45.347944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808fa6a-06af-4717-9ad9-4fc9189a30da None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:45.348220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808fa6a-06af-4717-9ad9-4fc9189a30da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:45.367117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4808fa6a-06af-4717-9ad9-4fc9189a30da None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:45.368322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4808fa6a-06af-4717-9ad9-4fc9189a30da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:45.376841 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 860/1705] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:45.377731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808fa6a-06af-4717-9ad9-4fc9189a30da None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:45.379035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4808fa6a-06af-4717-9ad9-4fc9189a30da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:45.390110 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 846/1706] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:45 2022] POST /identity/v3/projects => generated 361 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:45.391167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e8127-fe1e-41da-8122-eba3cc00f8a0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:45.391324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808fa6a-06af-4717-9ad9-4fc9189a30da None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:45.489625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0014d4-a838-4e28-9f55-bb0d06d3cd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:45.490325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0014d4-a838-4e28-9f55-bb0d06d3cd04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:45.491128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0014d4-a838-4e28-9f55-bb0d06d3cd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:45.491128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0014d4-a838-4e28-9f55-bb0d06d3cd04 admin admin] PATH_INFO: `/v3/projects/80aae888f8984fab9d12c5304427c794` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:45.492129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0014d4-a838-4e28-9f55-bb0d06d3cd04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80aae888f8984fab9d12c5304427c794)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:45.494495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0014d4-a838-4e28-9f55-bb0d06d3cd04 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:45.499116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e8127-fe1e-41da-8122-eba3cc00f8a0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:45.506779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea9f0f-4801-4a71-b296-2cfac1c71e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:45.507911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea9f0f-4801-4a71-b296-2cfac1c71e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:45.508469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea9f0f-4801-4a71-b296-2cfac1c71e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:45.508904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea9f0f-4801-4a71-b296-2cfac1c71e5b admin admin] PATH_INFO: `/v3/projects/6776414ecd6d4c84b9450c1b5595846a/users/95aacfa6f0c341588669e25da92ca60c/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:45.511853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea9f0f-4801-4a71-b296-2cfac1c71e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6776414ecd6d4c84b9450c1b5595846a, user_id=95aacfa6f0c341588669e25da92ca60c, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:45.516533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea9f0f-4801-4a71-b296-2cfac1c71e5b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:45.531076 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 847/1707] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:45 2022] PUT /identity/v3/projects/6776414ecd6d4c84b9450c1b5595846a/users/95aacfa6f0c341588669e25da92ca60c/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:45.532024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea9f0f-4801-4a71-b296-2cfac1c71e5b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:45.616002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea9f0f-4801-4a71-b296-2cfac1c71e5b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:45.619589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ff0014d4-a838-4e28-9f55-bb0d06d3cd04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80aae888f8984fab9d12c5304427c794', 'request_id': 'req-ff0014d4-a838-4e28-9f55-bb0d06d3cd04'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:45.639620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ff0014d4-a838-4e28-9f55-bb0d06d3cd04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80aae888f8984fab9d12c5304427c794', 'request_id': 'req-ff0014d4-a838-4e28-9f55-bb0d06d3cd04'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:45.652607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ff0014d4-a838-4e28-9f55-bb0d06d3cd04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80aae888f8984fab9d12c5304427c794', 'request_id': 'req-ff0014d4-a838-4e28-9f55-bb0d06d3cd04'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:45.708985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561ceec-e9b8-474e-8612-0d66c72bc9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:45.709619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561ceec-e9b8-474e-8612-0d66c72bc9fa admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:45.709901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561ceec-e9b8-474e-8612-0d66c72bc9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:45.710260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561ceec-e9b8-474e-8612-0d66c72bc9fa admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:45.711286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561ceec-e9b8-474e-8612-0d66c72bc9fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:21:45.711612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561ceec-e9b8-474e-8612-0d66c72bc9fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:45.713403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561ceec-e9b8-474e-8612-0d66c72bc9fa admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:45.732086 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 848/1708] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:21:45.735942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561ceec-e9b8-474e-8612-0d66c72bc9fa admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:45.747396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561ceec-e9b8-474e-8612-0d66c72bc9fa admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:45.754149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ff0014d4-a838-4e28-9f55-bb0d06d3cd04 admin admin] The token cache is being invalidate because project 80aae888f8984fab9d12c5304427c794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:45.754299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb3d4b-d1ca-4f16-b805-bc6f5de1307b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:45.754849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb3d4b-d1ca-4f16-b805-bc6f5de1307b admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:45.754954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ff0014d4-a838-4e28-9f55-bb0d06d3cd04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:45.755130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb3d4b-d1ca-4f16-b805-bc6f5de1307b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:45.755409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb3d4b-d1ca-4f16-b805-bc6f5de1307b admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:45.756048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb3d4b-d1ca-4f16-b805-bc6f5de1307b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:45.756445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ff0014d4-a838-4e28-9f55-bb0d06d3cd04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:45.758416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb3d4b-d1ca-4f16-b805-bc6f5de1307b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:45.759189 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 861/1709] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:45 2022] DELETE /identity/v3/projects/80aae888f8984fab9d12c5304427c794 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:45.760888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8683b40-c75c-46ad-bbb6-6d4b70855f05 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:45.761475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8683b40-c75c-46ad-bbb6-6d4b70855f05 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:45.761941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8683b40-c75c-46ad-bbb6-6d4b70855f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:45.793702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a8683b40-c75c-46ad-bbb6-6d4b70855f05 None None] MFA Rules not processed for user `95aacfa6f0c341588669e25da92ca60c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:45.795663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a8683b40-c75c-46ad-bbb6-6d4b70855f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:45.878518 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 849/1710] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:45 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:45.880547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb3d4b-d1ca-4f16-b805-bc6f5de1307b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:45.882835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d9eb3d4b-d1ca-4f16-b805-bc6f5de1307b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:45.897840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb3d4b-d1ca-4f16-b805-bc6f5de1307b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:45.903872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1da22-13c3-4afc-bbc1-e7b0358e3a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:45.904698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1da22-13c3-4afc-bbc1-e7b0358e3a62 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:45.904979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1da22-13c3-4afc-bbc1-e7b0358e3a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:45.905261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1da22-13c3-4afc-bbc1-e7b0358e3a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:45.906060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1da22-13c3-4afc-bbc1-e7b0358e3a62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:45.908789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1da22-13c3-4afc-bbc1-e7b0358e3a62 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:45.933853 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 862/1711] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:45.933853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe0b2a-13fd-41a6-abb5-4ee0599653b4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:45.933853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe0b2a-13fd-41a6-abb5-4ee0599653b4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:45.933853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe0b2a-13fd-41a6-abb5-4ee0599653b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:45.952617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-5efe0b2a-13fd-41a6-abb5-4ee0599653b4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:45.953892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5efe0b2a-13fd-41a6-abb5-4ee0599653b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:45.962798 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 863/1712] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:45.963377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe0b2a-13fd-41a6-abb5-4ee0599653b4 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:45.967245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5efe0b2a-13fd-41a6-abb5-4ee0599653b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:45.977575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe0b2a-13fd-41a6-abb5-4ee0599653b4 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:45.984149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d421e8-c614-42e1-80f9-c31e86ffbf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:45.985042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d421e8-c614-42e1-80f9-c31e86ffbf39 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:45.985042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d421e8-c614-42e1-80f9-c31e86ffbf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:45.985878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d421e8-c614-42e1-80f9-c31e86ffbf39 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:45.986010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d421e8-c614-42e1-80f9-c31e86ffbf39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:45.987549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d421e8-c614-42e1-80f9-c31e86ffbf39 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:46.006085 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 864/1713] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:46.007380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb731662-441b-4e1a-8638-89fb4141791f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:46.007380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb731662-441b-4e1a-8638-89fb4141791f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:46.007593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb731662-441b-4e1a-8638-89fb4141791f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:46.023280 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 850/1714] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:45 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:46.025478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1da22-13c3-4afc-bbc1-e7b0358e3a62 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:46.046471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-eb731662-441b-4e1a-8638-89fb4141791f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:46.047864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-eb731662-441b-4e1a-8638-89fb4141791f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:46.103810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1da22-13c3-4afc-bbc1-e7b0358e3a62 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:46.110298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6acb2-d1b9-4d68-9e38-0c105707de6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:46.111028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6acb2-d1b9-4d68-9e38-0c105707de6b admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:46.111307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6acb2-d1b9-4d68-9e38-0c105707de6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:46.111582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6acb2-d1b9-4d68-9e38-0c105707de6b admin admin] PATH_INFO: `/v3/projects/52842cb4c0884ce2982ce49c6415ed47/users/a635ed49a7e24ba5a914e4f895250594/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:46.136656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6acb2-d1b9-4d68-9e38-0c105707de6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=52842cb4c0884ce2982ce49c6415ed47, user_id=a635ed49a7e24ba5a914e4f895250594, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:46.136908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:46.145167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6acb2-d1b9-4d68-9e38-0c105707de6b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:46.167788 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 865/1715] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:46.172768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb731662-441b-4e1a-8638-89fb4141791f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:46.174637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-eb731662-441b-4e1a-8638-89fb4141791f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:46.223407 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 851/1716] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:46 2022] PUT /identity/v3/projects/52842cb4c0884ce2982ce49c6415ed47/users/a635ed49a7e24ba5a914e4f895250594/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:46.224558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6acb2-d1b9-4d68-9e38-0c105707de6b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:46.260344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb731662-441b-4e1a-8638-89fb4141791f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:46.296813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6acb2-d1b9-4d68-9e38-0c105707de6b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:46.303097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc7a26-d327-48ef-ba52-7b726061d8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:46.303718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc7a26-d327-48ef-ba52-7b726061d8af admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:46.304566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc7a26-d327-48ef-ba52-7b726061d8af admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:46.304858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc7a26-d327-48ef-ba52-7b726061d8af admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:46.305736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc7a26-d327-48ef-ba52-7b726061d8af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:46.308361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc7a26-d327-48ef-ba52-7b726061d8af admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:46.353069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07d39d-d9bf-4287-a92e-d7f0734014ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:46.353607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07d39d-d9bf-4287-a92e-d7f0734014ad service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:46.353886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07d39d-d9bf-4287-a92e-d7f0734014ad service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:46.354263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07d39d-d9bf-4287-a92e-d7f0734014ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:46.356061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ce07d39d-d9bf-4287-a92e-d7f0734014ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:46.399296 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 852/1717] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:46 2022] POST /identity/v3/users => generated 294 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:46.403197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc7a26-d327-48ef-ba52-7b726061d8af admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:46.413245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07d39d-d9bf-4287-a92e-d7f0734014ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:46.414281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc7a26-d327-48ef-ba52-7b726061d8af admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:46.414901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07d39d-d9bf-4287-a92e-d7f0734014ad service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:46.419531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6400c-f10d-4a45-a453-facc397e24bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:46.421975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6400c-f10d-4a45-a453-facc397e24bc admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:46.421975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6400c-f10d-4a45-a453-facc397e24bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:46.421975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6400c-f10d-4a45-a453-facc397e24bc admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:46.421975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6400c-f10d-4a45-a453-facc397e24bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:21:46.422331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6400c-f10d-4a45-a453-facc397e24bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:46.423651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6400c-f10d-4a45-a453-facc397e24bc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:46.424642 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 866/1718] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:46.425457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07d39d-d9bf-4287-a92e-d7f0734014ad service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:46.435723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07d39d-d9bf-4287-a92e-d7f0734014ad service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:46.437519 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 853/1719] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:21:46.438386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6400c-f10d-4a45-a453-facc397e24bc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:46.444601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff4d18-f2a0-45cc-aecc-a88583f51982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:46.445254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff4d18-f2a0-45cc-aecc-a88583f51982 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:46.445565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff4d18-f2a0-45cc-aecc-a88583f51982 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:46.445801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff4d18-f2a0-45cc-aecc-a88583f51982 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:46.446562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff4d18-f2a0-45cc-aecc-a88583f51982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:46.448494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff4d18-f2a0-45cc-aecc-a88583f51982 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:46.453959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6400c-f10d-4a45-a453-facc397e24bc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:46.459092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15cb07-7012-4bc6-97c9-caf858957a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:46.459790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15cb07-7012-4bc6-97c9-caf858957a43 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:46.460140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15cb07-7012-4bc6-97c9-caf858957a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:46.460485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15cb07-7012-4bc6-97c9-caf858957a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:46.464185 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 867/1720] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:46.464323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15cb07-7012-4bc6-97c9-caf858957a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:46.464425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff4d18-f2a0-45cc-aecc-a88583f51982 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:46.464508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15cb07-7012-4bc6-97c9-caf858957a43 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:46.472916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff4d18-f2a0-45cc-aecc-a88583f51982 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:46.476164 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 854/1721] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:46.476995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15cb07-7012-4bc6-97c9-caf858957a43 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:46.478230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b63d3a-adc5-40d7-9c87-e71278d5b184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:46.478689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cb15cb07-7012-4bc6-97c9-caf858957a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:46.478838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b63d3a-adc5-40d7-9c87-e71278d5b184 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:46.479203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b63d3a-adc5-40d7-9c87-e71278d5b184 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:46.479386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b63d3a-adc5-40d7-9c87-e71278d5b184 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:46.480014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b63d3a-adc5-40d7-9c87-e71278d5b184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:46.482026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b63d3a-adc5-40d7-9c87-e71278d5b184 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:46.491677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15cb07-7012-4bc6-97c9-caf858957a43 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:46.496528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281be1f4-f13e-4085-9fbc-e3cd144e3600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:46.497153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281be1f4-f13e-4085-9fbc-e3cd144e3600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:46.497436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281be1f4-f13e-4085-9fbc-e3cd144e3600 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:46.497710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281be1f4-f13e-4085-9fbc-e3cd144e3600 admin admin] PATH_INFO: `/v3/users/6b578dba0ba146d9a8e48d57814932eb` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:46.498894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281be1f4-f13e-4085-9fbc-e3cd144e3600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b578dba0ba146d9a8e48d57814932eb)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:46.500837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281be1f4-f13e-4085-9fbc-e3cd144e3600 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:46.599892 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 868/1722] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:46 2022] POST /identity/v3/projects => generated 403 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:46.600827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b63d3a-adc5-40d7-9c87-e71278d5b184 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:46.667412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b63d3a-adc5-40d7-9c87-e71278d5b184 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:46.675657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590325bb-9302-408a-8b20-423fc965ab4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:46.676334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590325bb-9302-408a-8b20-423fc965ab4f admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:46.676618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590325bb-9302-408a-8b20-423fc965ab4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:46.676894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590325bb-9302-408a-8b20-423fc965ab4f admin admin] PATH_INFO: `/v3/projects/52842cb4c0884ce2982ce49c6415ed47/users/a635ed49a7e24ba5a914e4f895250594/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:46.678877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590325bb-9302-408a-8b20-423fc965ab4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=52842cb4c0884ce2982ce49c6415ed47, user_id=a635ed49a7e24ba5a914e4f895250594, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:46.687529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590325bb-9302-408a-8b20-423fc965ab4f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:46.692040 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 869/1723] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:46 2022] PUT /identity/v3/projects/52842cb4c0884ce2982ce49c6415ed47/users/a635ed49a7e24ba5a914e4f895250594/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:46.693038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590325bb-9302-408a-8b20-423fc965ab4f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:46.707572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:46.760185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590325bb-9302-408a-8b20-423fc965ab4f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:46.763684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-281be1f4-f13e-4085-9fbc-e3cd144e3600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b578dba0ba146d9a8e48d57814932eb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:46.764907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-281be1f4-f13e-4085-9fbc-e3cd144e3600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b578dba0ba146d9a8e48d57814932eb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:46.765760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e954ae-b2dc-4113-a6f5-5a6ff6418345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:46.766403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e954ae-b2dc-4113-a6f5-5a6ff6418345 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:46.766683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e954ae-b2dc-4113-a6f5-5a6ff6418345 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:46.766949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e954ae-b2dc-4113-a6f5-5a6ff6418345 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:46.767589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e954ae-b2dc-4113-a6f5-5a6ff6418345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:46.769191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e954ae-b2dc-4113-a6f5-5a6ff6418345 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:46.774420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-281be1f4-f13e-4085-9fbc-e3cd144e3600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b578dba0ba146d9a8e48d57814932eb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:46.780427 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 870/1724] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:46.781365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e954ae-b2dc-4113-a6f5-5a6ff6418345 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:46.783244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-61e954ae-b2dc-4113-a6f5-5a6ff6418345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:46.787325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-281be1f4-f13e-4085-9fbc-e3cd144e3600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b578dba0ba146d9a8e48d57814932eb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:46.795969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e954ae-b2dc-4113-a6f5-5a6ff6418345 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:46.801002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a7913-d35f-49a7-87d8-0091bf9cf3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:46.801606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a7913-d35f-49a7-87d8-0091bf9cf3db admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:46.801884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a7913-d35f-49a7-87d8-0091bf9cf3db admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:46.802191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a7913-d35f-49a7-87d8-0091bf9cf3db admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:46.802816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a7913-d35f-49a7-87d8-0091bf9cf3db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:46.804862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a7913-d35f-49a7-87d8-0091bf9cf3db admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:46.855805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-281be1f4-f13e-4085-9fbc-e3cd144e3600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b578dba0ba146d9a8e48d57814932eb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:46.872664 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 855/1725] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:46 2022] DELETE /identity/v3/users/6b578dba0ba146d9a8e48d57814932eb => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:46.872664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a23919-27af-4fe8-9c73-c4fb915b1287 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:46.872664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a23919-27af-4fe8-9c73-c4fb915b1287 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:46.872664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a23919-27af-4fe8-9c73-c4fb915b1287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:46.894101 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 871/1726] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:46 2022] POST /identity/v3/users => generated 302 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:46.895214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a7913-d35f-49a7-87d8-0091bf9cf3db admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:46.901776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2b7a7913-d35f-49a7-87d8-0091bf9cf3db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:46.909442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e4a23919-27af-4fe8-9c73-c4fb915b1287 None None] MFA Rules not processed for user `a635ed49a7e24ba5a914e4f895250594`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:46.912347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e4a23919-27af-4fe8-9c73-c4fb915b1287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:46.915054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a7913-d35f-49a7-87d8-0091bf9cf3db admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:46.992635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a7550-6bc7-46d3-9cec-fe597f84bfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:46.993352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a7550-6bc7-46d3-9cec-fe597f84bfcb admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:46.993733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a7550-6bc7-46d3-9cec-fe597f84bfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:46.994009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a7550-6bc7-46d3-9cec-fe597f84bfcb admin admin] PATH_INFO: `/v3/projects/9af002efe87e4f71bc8cc39e3863802d/users/78d185f3121242c9a52b4e7605b6e53a/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:47.005558 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 856/1727] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:46 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:47.015814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a7550-6bc7-46d3-9cec-fe597f84bfcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af002efe87e4f71bc8cc39e3863802d, user_id=78d185f3121242c9a52b4e7605b6e53a, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:47.018455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a7550-6bc7-46d3-9cec-fe597f84bfcb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:47.018762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59951ece-db41-4432-8732-e38dca1097f0 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:47.019049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59951ece-db41-4432-8732-e38dca1097f0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:47.019320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59951ece-db41-4432-8732-e38dca1097f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:47.040399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-59951ece-db41-4432-8732-e38dca1097f0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:47.041616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-59951ece-db41-4432-8732-e38dca1097f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:47.051041 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 857/1728] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:47.051963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59951ece-db41-4432-8732-e38dca1097f0 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:47.062879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59951ece-db41-4432-8732-e38dca1097f0 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:47.068755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42401f-d422-48b0-b871-59b41f062c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:47.068755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42401f-d422-48b0-b871-59b41f062c41 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:47.068755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42401f-d422-48b0-b871-59b41f062c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:47.068755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42401f-d422-48b0-b871-59b41f062c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:47.069530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42401f-d422-48b0-b871-59b41f062c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:47.071337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42401f-d422-48b0-b871-59b41f062c41 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:47.082421 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 858/1729] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:47.087256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42401f-d422-48b0-b871-59b41f062c41 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:47.087256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9d42401f-d422-48b0-b871-59b41f062c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:47.089981 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 872/1730] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:46 2022] PUT /identity/v3/projects/9af002efe87e4f71bc8cc39e3863802d/users/78d185f3121242c9a52b4e7605b6e53a/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:47.092813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a7550-6bc7-46d3-9cec-fe597f84bfcb admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:47.093453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5e2a7550-6bc7-46d3-9cec-fe597f84bfcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:47.170078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a7550-6bc7-46d3-9cec-fe597f84bfcb admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:47.174553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e161a1-1ddb-47ec-a015-0b5f444418fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:47.175159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e161a1-1ddb-47ec-a015-0b5f444418fc service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:47.175436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e161a1-1ddb-47ec-a015-0b5f444418fc service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:47.175710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e161a1-1ddb-47ec-a015-0b5f444418fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:47.221377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42401f-d422-48b0-b871-59b41f062c41 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:47.257050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e161a1-1ddb-47ec-a015-0b5f444418fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:47.259092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e161a1-1ddb-47ec-a015-0b5f444418fc service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:47.270603 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 873/1731] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:47.271538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e161a1-1ddb-47ec-a015-0b5f444418fc service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:47.282783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e161a1-1ddb-47ec-a015-0b5f444418fc service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:47.288333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0ba01-583a-43d4-9278-447aea009f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:47.289076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0ba01-583a-43d4-9278-447aea009f51 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:47.289458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0ba01-583a-43d4-9278-447aea009f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:47.289978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0ba01-583a-43d4-9278-447aea009f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:47.290795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0ba01-583a-43d4-9278-447aea009f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:47.292518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0ba01-583a-43d4-9278-447aea009f51 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:47.309112 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 874/1732] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:47.311339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628cddd-f5c2-49c2-a8f1-5d43fe968c92 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:47.311473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628cddd-f5c2-49c2-a8f1-5d43fe968c92 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:47.311752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628cddd-f5c2-49c2-a8f1-5d43fe968c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:47.322109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acf56a-18c5-4c0a-8c38-5573728e32dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:47.322993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acf56a-18c5-4c0a-8c38-5573728e32dd service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:47.323287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acf56a-18c5-4c0a-8c38-5573728e32dd service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:47.323564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acf56a-18c5-4c0a-8c38-5573728e32dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:47.363235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0628cddd-f5c2-49c2-a8f1-5d43fe968c92 None None] MFA Rules not processed for user `78d185f3121242c9a52b4e7605b6e53a`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:47.365283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0628cddd-f5c2-49c2-a8f1-5d43fe968c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:47.439646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acf56a-18c5-4c0a-8c38-5573728e32dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:47.442134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acf56a-18c5-4c0a-8c38-5573728e32dd service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:47.456030 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 859/1733] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:47 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:47.456736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acf56a-18c5-4c0a-8c38-5573728e32dd service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:47.496826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acf56a-18c5-4c0a-8c38-5573728e32dd service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:47.504312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e1983-18be-4713-b81e-6fc3a38361eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:47.506231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e1983-18be-4713-b81e-6fc3a38361eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:47.506799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e1983-18be-4713-b81e-6fc3a38361eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:47.507397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e1983-18be-4713-b81e-6fc3a38361eb admin admin] PATH_INFO: `/v3/projects/39f033d34ad44397bfda5cba4c041071/users/2e23378ed283426cbff623265d9bbc96/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:47.513814 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 875/1734] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:47.518282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628cddd-f5c2-49c2-a8f1-5d43fe968c92 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:47.539183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628cddd-f5c2-49c2-a8f1-5d43fe968c92 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:47.540780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e1983-18be-4713-b81e-6fc3a38361eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f033d34ad44397bfda5cba4c041071, user_id=2e23378ed283426cbff623265d9bbc96, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:47.547789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e1983-18be-4713-b81e-6fc3a38361eb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:47.548448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d74a4-4d18-45a1-b81e-89a1a2ada875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:47.549154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d74a4-4d18-45a1-b81e-89a1a2ada875 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:47.550125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d74a4-4d18-45a1-b81e-89a1a2ada875 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:47.550125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d74a4-4d18-45a1-b81e-89a1a2ada875 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:47.550572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d74a4-4d18-45a1-b81e-89a1a2ada875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:47.556276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d74a4-4d18-45a1-b81e-89a1a2ada875 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:47.646016 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 860/1735] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:47 2022] PUT /identity/v3/projects/39f033d34ad44397bfda5cba4c041071/users/2e23378ed283426cbff623265d9bbc96/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:47.647630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa478ef4-e59c-479d-b7ca-8d08b58c8c4c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:47.647927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa478ef4-e59c-479d-b7ca-8d08b58c8c4c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:47.648407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa478ef4-e59c-479d-b7ca-8d08b58c8c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:47.688772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-aa478ef4-e59c-479d-b7ca-8d08b58c8c4c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:47.690102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-aa478ef4-e59c-479d-b7ca-8d08b58c8c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:47.694091 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 876/1736] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:47 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:21:47.696512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d74a4-4d18-45a1-b81e-89a1a2ada875 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:47.719881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:47.792536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:47.807582 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 861/1737] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:47.813082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d74a4-4d18-45a1-b81e-89a1a2ada875 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:47.817568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa478ef4-e59c-479d-b7ca-8d08b58c8c4c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:47.821424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-aa478ef4-e59c-479d-b7ca-8d08b58c8c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:47.831012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0ea75-6a88-49d6-8b00-77b8b0ffea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:47.831681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0ea75-6a88-49d6-8b00-77b8b0ffea39 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:47.831959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0ea75-6a88-49d6-8b00-77b8b0ffea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:47.834571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0ea75-6a88-49d6-8b00-77b8b0ffea39 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:47.835253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0ea75-6a88-49d6-8b00-77b8b0ffea39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:47.841833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0ea75-6a88-49d6-8b00-77b8b0ffea39 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:47.938534 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 877/1738] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:47 2022] POST /identity/v3/users => generated 300 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:47.941589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa478ef4-e59c-479d-b7ca-8d08b58c8c4c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:47.942986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0ea75-6a88-49d6-8b00-77b8b0ffea39 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:47.949968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bb991-ce70-4e74-869c-5c3bdafdd092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:47.950635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bb991-ce70-4e74-869c-5c3bdafdd092 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:47.950921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bb991-ce70-4e74-869c-5c3bdafdd092 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:47.952124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bb991-ce70-4e74-869c-5c3bdafdd092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:47.972437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7bb991-ce70-4e74-869c-5c3bdafdd092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:47.975078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7bb991-ce70-4e74-869c-5c3bdafdd092 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:47.983098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0ea75-6a88-49d6-8b00-77b8b0ffea39 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:47.989680 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 862/1739] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:47.998311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4344f-5056-4d26-9655-294bb8ffb245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:47.998311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4344f-5056-4d26-9655-294bb8ffb245 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:47.998311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4344f-5056-4d26-9655-294bb8ffb245 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:47.998311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4344f-5056-4d26-9655-294bb8ffb245 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:47.998979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4344f-5056-4d26-9655-294bb8ffb245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:48.003728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4344f-5056-4d26-9655-294bb8ffb245 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:48.021286 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 878/1740] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:48.024900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bb991-ce70-4e74-869c-5c3bdafdd092 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:48.035880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bb991-ce70-4e74-869c-5c3bdafdd092 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:48.046668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e045d8c-f679-4298-9afc-ca87267e765c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:48.048740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e045d8c-f679-4298-9afc-ca87267e765c admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:48.049215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e045d8c-f679-4298-9afc-ca87267e765c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:48.050021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e045d8c-f679-4298-9afc-ca87267e765c admin admin] PATH_INFO: `/v3/projects/13feb46371e24c51aecf48ab4beb22ce/users/8bb895e1300a4ae2a783e6153c39c93e/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:48.099436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e045d8c-f679-4298-9afc-ca87267e765c admin admin] RBAC: Authorizing `identity:create_grant(project_id=13feb46371e24c51aecf48ab4beb22ce, user_id=8bb895e1300a4ae2a783e6153c39c93e, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:48.103522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e045d8c-f679-4298-9afc-ca87267e765c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:48.181834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4344f-5056-4d26-9655-294bb8ffb245 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:48.182222 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 863/1741] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:48 2022] PUT /identity/v3/projects/13feb46371e24c51aecf48ab4beb22ce/users/8bb895e1300a4ae2a783e6153c39c93e/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:48.193763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4344f-5056-4d26-9655-294bb8ffb245 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:48.232942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:48.295113 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e045d8c-f679-4298-9afc-ca87267e765c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:48.296069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9d08b-2bfd-455b-b4e5-1f713bb868e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:48.296869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9d08b-2bfd-455b-b4e5-1f713bb868e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:48.296984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2e045d8c-f679-4298-9afc-ca87267e765c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:48.297264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9d08b-2bfd-455b-b4e5-1f713bb868e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:48.297654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9d08b-2bfd-455b-b4e5-1f713bb868e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:48.298468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9d08b-2bfd-455b-b4e5-1f713bb868e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:48.300335 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9d08b-2bfd-455b-b4e5-1f713bb868e4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:48.312195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e045d8c-f679-4298-9afc-ca87267e765c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:48.314141 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 879/1742] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:48.318162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9d08b-2bfd-455b-b4e5-1f713bb868e4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:48.322211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce35f2e-8082-4b91-8108-24beb88eb6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:48.322869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce35f2e-8082-4b91-8108-24beb88eb6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:48.323153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce35f2e-8082-4b91-8108-24beb88eb6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:48.323436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce35f2e-8082-4b91-8108-24beb88eb6e1 admin admin] PATH_INFO: `/v3/users/83b69c5af6224eb799552fcac6105cd0` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:48.324609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce35f2e-8082-4b91-8108-24beb88eb6e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83b69c5af6224eb799552fcac6105cd0)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:48.327209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce35f2e-8082-4b91-8108-24beb88eb6e1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:48.331223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9d08b-2bfd-455b-b4e5-1f713bb868e4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:48.350815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c622515-a40c-4358-9110-bff53374c429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:48.351933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c622515-a40c-4358-9110-bff53374c429 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:48.352364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c622515-a40c-4358-9110-bff53374c429 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:48.352733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c622515-a40c-4358-9110-bff53374c429 admin admin] PATH_INFO: `/v3/projects/13feb46371e24c51aecf48ab4beb22ce/users/8bb895e1300a4ae2a783e6153c39c93e/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:48.355543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c622515-a40c-4358-9110-bff53374c429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13feb46371e24c51aecf48ab4beb22ce, user_id=8bb895e1300a4ae2a783e6153c39c93e, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:48.358516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c622515-a40c-4358-9110-bff53374c429 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:48.391277 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 880/1743] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:48 2022] PUT /identity/v3/projects/13feb46371e24c51aecf48ab4beb22ce/users/8bb895e1300a4ae2a783e6153c39c93e/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:21:48.395475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c622515-a40c-4358-9110-bff53374c429 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:48.395475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9c622515-a40c-4358-9110-bff53374c429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:48.487859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c622515-a40c-4358-9110-bff53374c429 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:48.489807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26192535-c843-40aa-b138-322fbe7e3a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:48.490529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26192535-c843-40aa-b138-322fbe7e3a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:48.490821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26192535-c843-40aa-b138-322fbe7e3a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:48.491097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26192535-c843-40aa-b138-322fbe7e3a4c admin admin] PATH_INFO: `/v3/projects/3556f61432de40308762eef473ea4ce8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:48.492238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26192535-c843-40aa-b138-322fbe7e3a4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3556f61432de40308762eef473ea4ce8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:48.494351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26192535-c843-40aa-b138-322fbe7e3a4c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:48.783231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7ce35f2e-8082-4b91-8108-24beb88eb6e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83b69c5af6224eb799552fcac6105cd0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:48.960804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7ce35f2e-8082-4b91-8108-24beb88eb6e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83b69c5af6224eb799552fcac6105cd0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:48.960804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7ce35f2e-8082-4b91-8108-24beb88eb6e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83b69c5af6224eb799552fcac6105cd0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:48.960804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7ce35f2e-8082-4b91-8108-24beb88eb6e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83b69c5af6224eb799552fcac6105cd0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:49.005078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-26192535-c843-40aa-b138-322fbe7e3a4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3556f61432de40308762eef473ea4ce8', 'request_id': 'req-26192535-c843-40aa-b138-322fbe7e3a4c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:49.015205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-26192535-c843-40aa-b138-322fbe7e3a4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3556f61432de40308762eef473ea4ce8', 'request_id': 'req-26192535-c843-40aa-b138-322fbe7e3a4c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:49.021913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-26192535-c843-40aa-b138-322fbe7e3a4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3556f61432de40308762eef473ea4ce8', 'request_id': 'req-26192535-c843-40aa-b138-322fbe7e3a4c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:49.128066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7ce35f2e-8082-4b91-8108-24beb88eb6e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83b69c5af6224eb799552fcac6105cd0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:49.136145 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 864/1744] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:48 2022] DELETE /identity/v3/users/83b69c5af6224eb799552fcac6105cd0 => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:21:49.137741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce2791-54e3-4d63-8d85-adc1649f81d7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:49.138244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce2791-54e3-4d63-8d85-adc1649f81d7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:49.138588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce2791-54e3-4d63-8d85-adc1649f81d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:49.180778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-21ce2791-54e3-4d63-8d85-adc1649f81d7 None None] MFA Rules not processed for user `8bb895e1300a4ae2a783e6153c39c93e`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:49.180778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-21ce2791-54e3-4d63-8d85-adc1649f81d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:49.200579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-26192535-c843-40aa-b138-322fbe7e3a4c admin admin] The token cache is being invalidate because project 3556f61432de40308762eef473ea4ce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:49.200985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-26192535-c843-40aa-b138-322fbe7e3a4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:49.202070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-26192535-c843-40aa-b138-322fbe7e3a4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:49.207259 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 881/1745] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:48 2022] DELETE /identity/v3/projects/3556f61432de40308762eef473ea4ce8 => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:49.207259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382f852-81e7-489e-a3b5-58bdf40e74e4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:49.208410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:49.208536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382f852-81e7-489e-a3b5-58bdf40e74e4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:49.208647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382f852-81e7-489e-a3b5-58bdf40e74e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:49.232354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a382f852-81e7-489e-a3b5-58bdf40e74e4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:49.234519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a382f852-81e7-489e-a3b5-58bdf40e74e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:49.264652 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 865/1746] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:49 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:49.265437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce2791-54e3-4d63-8d85-adc1649f81d7 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:49.266738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-21ce2791-54e3-4d63-8d85-adc1649f81d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:49.303720 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 882/1747] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:49.304813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382f852-81e7-489e-a3b5-58bdf40e74e4 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:49.306235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a382f852-81e7-489e-a3b5-58bdf40e74e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:49.352490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce2791-54e3-4d63-8d85-adc1649f81d7 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:49.362770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27788e-ddac-4185-bfbd-351dc32adbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:49.363513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27788e-ddac-4185-bfbd-351dc32adbe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:49.363864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27788e-ddac-4185-bfbd-351dc32adbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:49.364568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27788e-ddac-4185-bfbd-351dc32adbe9 admin admin] PATH_INFO: `/v3/users/95aacfa6f0c341588669e25da92ca60c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:49.366609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27788e-ddac-4185-bfbd-351dc32adbe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95aacfa6f0c341588669e25da92ca60c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:49.369298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27788e-ddac-4185-bfbd-351dc32adbe9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:49.407525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382f852-81e7-489e-a3b5-58bdf40e74e4 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:49.414275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae7b6c-59ea-49c6-a3f4-3e011c00edee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:49.414959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae7b6c-59ea-49c6-a3f4-3e011c00edee service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:49.415331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae7b6c-59ea-49c6-a3f4-3e011c00edee service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:49.415526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae7b6c-59ea-49c6-a3f4-3e011c00edee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:49.437528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae7b6c-59ea-49c6-a3f4-3e011c00edee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:49.439606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae7b6c-59ea-49c6-a3f4-3e011c00edee service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:49.456627 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 883/1748] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:49 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:49.457648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae7b6c-59ea-49c6-a3f4-3e011c00edee service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:49.459477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-91ae7b6c-59ea-49c6-a3f4-3e011c00edee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:49.573486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae7b6c-59ea-49c6-a3f4-3e011c00edee service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:49.585649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16227bb-ad71-432c-8b7e-d29f8cbf4432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:49.586464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16227bb-ad71-432c-8b7e-d29f8cbf4432 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:49.586753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16227bb-ad71-432c-8b7e-d29f8cbf4432 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:49.587026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16227bb-ad71-432c-8b7e-d29f8cbf4432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:49.591769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7f27788e-ddac-4185-bfbd-351dc32adbe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95aacfa6f0c341588669e25da92ca60c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:49.593948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7f27788e-ddac-4185-bfbd-351dc32adbe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95aacfa6f0c341588669e25da92ca60c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:49.615224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7f27788e-ddac-4185-bfbd-351dc32adbe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95aacfa6f0c341588669e25da92ca60c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:49.618937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16227bb-ad71-432c-8b7e-d29f8cbf4432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:49.621485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16227bb-ad71-432c-8b7e-d29f8cbf4432 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:49.648028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7f27788e-ddac-4185-bfbd-351dc32adbe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95aacfa6f0c341588669e25da92ca60c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:49.660006 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 884/1749] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:49.756739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7f27788e-ddac-4185-bfbd-351dc32adbe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95aacfa6f0c341588669e25da92ca60c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:49.766061 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 866/1750] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:49 2022] DELETE /identity/v3/users/95aacfa6f0c341588669e25da92ca60c => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:49.852561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16227bb-ad71-432c-8b7e-d29f8cbf4432 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:49.855805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f16227bb-ad71-432c-8b7e-d29f8cbf4432 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:49.871913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16227bb-ad71-432c-8b7e-d29f8cbf4432 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:49.974648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:49.989893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec1b40-6a9b-43b1-8302-a3997996705e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:49.990714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec1b40-6a9b-43b1-8302-a3997996705e service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:49.991002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec1b40-6a9b-43b1-8302-a3997996705e service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:49.991306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec1b40-6a9b-43b1-8302-a3997996705e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:49.993059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ddec1b40-6a9b-43b1-8302-a3997996705e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:50.081004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec1b40-6a9b-43b1-8302-a3997996705e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:50.083958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec1b40-6a9b-43b1-8302-a3997996705e service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:50.095766 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 885/1751] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:50.268006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27788e-ddac-4185-bfbd-351dc32adbe9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:50.269542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7f27788e-ddac-4185-bfbd-351dc32adbe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:50.419229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27788e-ddac-4185-bfbd-351dc32adbe9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:50.427487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaab44-d726-4608-8f2a-2d0af3fda99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:50.428396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaab44-d726-4608-8f2a-2d0af3fda99c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:50.428618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaab44-d726-4608-8f2a-2d0af3fda99c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:50.428893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaab44-d726-4608-8f2a-2d0af3fda99c admin admin] PATH_INFO: `/v3/projects/c2f7992345614b94a5030c7194ad6fd1` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:50.430575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaab44-d726-4608-8f2a-2d0af3fda99c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2f7992345614b94a5030c7194ad6fd1)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:50.432578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaab44-d726-4608-8f2a-2d0af3fda99c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:50.650917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-eaeaab44-d726-4608-8f2a-2d0af3fda99c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2f7992345614b94a5030c7194ad6fd1', 'request_id': 'req-eaeaab44-d726-4608-8f2a-2d0af3fda99c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:50.657642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:50.764947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-eaeaab44-d726-4608-8f2a-2d0af3fda99c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2f7992345614b94a5030c7194ad6fd1', 'request_id': 'req-eaeaab44-d726-4608-8f2a-2d0af3fda99c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:50.779916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-eaeaab44-d726-4608-8f2a-2d0af3fda99c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2f7992345614b94a5030c7194ad6fd1', 'request_id': 'req-eaeaab44-d726-4608-8f2a-2d0af3fda99c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:50.820414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-eaeaab44-d726-4608-8f2a-2d0af3fda99c admin admin] The token cache is being invalidate because project c2f7992345614b94a5030c7194ad6fd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:50.822113 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-eaeaab44-d726-4608-8f2a-2d0af3fda99c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:50.823262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-eaeaab44-d726-4608-8f2a-2d0af3fda99c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:50.827878 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 867/1752] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:50 2022] DELETE /identity/v3/projects/c2f7992345614b94a5030c7194ad6fd1 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:50.831237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec1b40-6a9b-43b1-8302-a3997996705e service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:50.844493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec1b40-6a9b-43b1-8302-a3997996705e service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:50.916309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f09cf3-dae9-4362-9e89-0c015f55d124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:50.920827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f09cf3-dae9-4362-9e89-0c015f55d124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:50.920827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f09cf3-dae9-4362-9e89-0c015f55d124 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:50.920827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f09cf3-dae9-4362-9e89-0c015f55d124 admin admin] PATH_INFO: `/v3/users/a635ed49a7e24ba5a914e4f895250594` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:50.920827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f09cf3-dae9-4362-9e89-0c015f55d124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a635ed49a7e24ba5a914e4f895250594)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:50.921668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f09cf3-dae9-4362-9e89-0c015f55d124 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:51.098169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaab44-d726-4608-8f2a-2d0af3fda99c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:51.100206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-eaeaab44-d726-4608-8f2a-2d0af3fda99c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:51.135749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaab44-d726-4608-8f2a-2d0af3fda99c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:51.146058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a0492-6891-47c5-ba9b-458099a689d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:51.146058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a0492-6891-47c5-ba9b-458099a689d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:51.146058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a0492-6891-47c5-ba9b-458099a689d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:51.146058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a0492-6891-47c5-ba9b-458099a689d5 admin admin] PATH_INFO: `/v3/projects/6776414ecd6d4c84b9450c1b5595846a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:51.148939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a0492-6891-47c5-ba9b-458099a689d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6776414ecd6d4c84b9450c1b5595846a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:51.153158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-85f09cf3-dae9-4362-9e89-0c015f55d124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a635ed49a7e24ba5a914e4f895250594'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:51.155313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-85f09cf3-dae9-4362-9e89-0c015f55d124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a635ed49a7e24ba5a914e4f895250594'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:51.155671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a0492-6891-47c5-ba9b-458099a689d5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:51.174337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-85f09cf3-dae9-4362-9e89-0c015f55d124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a635ed49a7e24ba5a914e4f895250594'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:51.205194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-85f09cf3-dae9-4362-9e89-0c015f55d124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a635ed49a7e24ba5a914e4f895250594'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:51.209106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-85f09cf3-dae9-4362-9e89-0c015f55d124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a635ed49a7e24ba5a914e4f895250594'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:51.324672 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 886/1753] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:50 2022] DELETE /identity/v3/users/a635ed49a7e24ba5a914e4f895250594 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:21:51.339835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9e0a0492-6891-47c5-ba9b-458099a689d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6776414ecd6d4c84b9450c1b5595846a', 'request_id': 'req-9e0a0492-6891-47c5-ba9b-458099a689d5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:51.408802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9e0a0492-6891-47c5-ba9b-458099a689d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6776414ecd6d4c84b9450c1b5595846a', 'request_id': 'req-9e0a0492-6891-47c5-ba9b-458099a689d5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:51.417377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9e0a0492-6891-47c5-ba9b-458099a689d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6776414ecd6d4c84b9450c1b5595846a', 'request_id': 'req-9e0a0492-6891-47c5-ba9b-458099a689d5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:51.430881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9e0a0492-6891-47c5-ba9b-458099a689d5 admin admin] The token cache is being invalidate because project 6776414ecd6d4c84b9450c1b5595846a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:51.433052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9e0a0492-6891-47c5-ba9b-458099a689d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:51.434834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9e0a0492-6891-47c5-ba9b-458099a689d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:51.437398 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 868/1754] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:51 2022] DELETE /identity/v3/projects/6776414ecd6d4c84b9450c1b5595846a => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:21:51.442238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e4104-a91d-4a55-959f-fd9894fc21d5 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:51.443024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e4104-a91d-4a55-959f-fd9894fc21d5 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:51.443317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e4104-a91d-4a55-959f-fd9894fc21d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:51.470685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-aa3e4104-a91d-4a55-959f-fd9894fc21d5 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:51.473963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-aa3e4104-a91d-4a55-959f-fd9894fc21d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:51.568761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a0492-6891-47c5-ba9b-458099a689d5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:51.570574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9e0a0492-6891-47c5-ba9b-458099a689d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:51.618646 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 887/1755] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:51.625603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664efbc-ce5c-4b96-877a-de135e6a8c95 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:51.629383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664efbc-ce5c-4b96-877a-de135e6a8c95 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:51.629383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664efbc-ce5c-4b96-877a-de135e6a8c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:51.671932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-5664efbc-ce5c-4b96-877a-de135e6a8c95 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:51.677795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5664efbc-ce5c-4b96-877a-de135e6a8c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:51.697035 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 888/1756] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:21:51.701867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664efbc-ce5c-4b96-877a-de135e6a8c95 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:51.704984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a0492-6891-47c5-ba9b-458099a689d5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:51.717930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664efbc-ce5c-4b96-877a-de135e6a8c95 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:51.718520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c60ec-ddfc-44a4-a255-ede88b1d6f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:51.719407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c60ec-ddfc-44a4-a255-ede88b1d6f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:51.720218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c60ec-ddfc-44a4-a255-ede88b1d6f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:51.721040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c60ec-ddfc-44a4-a255-ede88b1d6f74 admin admin] PATH_INFO: `/v3/users/78d185f3121242c9a52b4e7605b6e53a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:51.723084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c60ec-ddfc-44a4-a255-ede88b1d6f74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78d185f3121242c9a52b4e7605b6e53a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:51.725184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c60ec-ddfc-44a4-a255-ede88b1d6f74 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:51.730938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38237876-cdac-4cfb-84ca-2ffbbd13ed4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:51.731669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38237876-cdac-4cfb-84ca-2ffbbd13ed4a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:51.731870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38237876-cdac-4cfb-84ca-2ffbbd13ed4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:51.735434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38237876-cdac-4cfb-84ca-2ffbbd13ed4a admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:51.735434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38237876-cdac-4cfb-84ca-2ffbbd13ed4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:21:51.735434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38237876-cdac-4cfb-84ca-2ffbbd13ed4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:51.736394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38237876-cdac-4cfb-84ca-2ffbbd13ed4a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:51.753702 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 889/1757] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:21:51.764292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38237876-cdac-4cfb-84ca-2ffbbd13ed4a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:51.773106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38237876-cdac-4cfb-84ca-2ffbbd13ed4a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:51.781220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7bffc-31b5-4a02-9c92-44dd2f3a3e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:51.782126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7bffc-31b5-4a02-9c92-44dd2f3a3e4f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:51.782411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7bffc-31b5-4a02-9c92-44dd2f3a3e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:51.782729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7bffc-31b5-4a02-9c92-44dd2f3a3e4f admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:51.783377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7bffc-31b5-4a02-9c92-44dd2f3a3e4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:51.785337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7bffc-31b5-4a02-9c92-44dd2f3a3e4f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:51.924789 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 890/1758] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:51 2022] POST /identity/v3/projects => generated 393 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:51.925877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7bffc-31b5-4a02-9c92-44dd2f3a3e4f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:51.960426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cf0c60ec-ddfc-44a4-a255-ede88b1d6f74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78d185f3121242c9a52b4e7605b6e53a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:51.961377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cf0c60ec-ddfc-44a4-a255-ede88b1d6f74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78d185f3121242c9a52b4e7605b6e53a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:51.973344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cf0c60ec-ddfc-44a4-a255-ede88b1d6f74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78d185f3121242c9a52b4e7605b6e53a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:51.999892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cf0c60ec-ddfc-44a4-a255-ede88b1d6f74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78d185f3121242c9a52b4e7605b6e53a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:52.077200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cf0c60ec-ddfc-44a4-a255-ede88b1d6f74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78d185f3121242c9a52b4e7605b6e53a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:52.085639 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 869/1759] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:51 2022] DELETE /identity/v3/users/78d185f3121242c9a52b4e7605b6e53a => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:21:52.099715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e57a1-e75c-4f77-bbed-93a5931c6a08 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:52.104117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e57a1-e75c-4f77-bbed-93a5931c6a08 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:52.104117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e57a1-e75c-4f77-bbed-93a5931c6a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:52.106233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7bffc-31b5-4a02-9c92-44dd2f3a3e4f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:52.178721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-839e57a1-e75c-4f77-bbed-93a5931c6a08 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:52.178721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-839e57a1-e75c-4f77-bbed-93a5931c6a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:52.229834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c04b80-e6ce-4827-9633-11ebcba3b717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:52.231525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c04b80-e6ce-4827-9633-11ebcba3b717 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:52.231823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c04b80-e6ce-4827-9633-11ebcba3b717 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:52.233093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c04b80-e6ce-4827-9633-11ebcba3b717 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:52.233797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c04b80-e6ce-4827-9633-11ebcba3b717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:52.237231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c04b80-e6ce-4827-9633-11ebcba3b717 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:52.285020 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 870/1760] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:52.291620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:52.298189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e57a1-e75c-4f77-bbed-93a5931c6a08 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:52.300948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-839e57a1-e75c-4f77-bbed-93a5931c6a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:52.348247 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 891/1761] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:51 2022] POST /identity/v3/users => generated 297 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:52.352412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c04b80-e6ce-4827-9633-11ebcba3b717 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:52.354453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a1c04b80-e6ce-4827-9633-11ebcba3b717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:52.377854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e57a1-e75c-4f77-bbed-93a5931c6a08 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:52.382769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820d1ce-ffb3-48c7-8147-a6cd026c35d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:52.383826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820d1ce-ffb3-48c7-8147-a6cd026c35d5 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:52.384283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820d1ce-ffb3-48c7-8147-a6cd026c35d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:52.384563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820d1ce-ffb3-48c7-8147-a6cd026c35d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:52.385562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c04b80-e6ce-4827-9633-11ebcba3b717 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:52.397261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820d1ce-ffb3-48c7-8147-a6cd026c35d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:52.398931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820d1ce-ffb3-48c7-8147-a6cd026c35d5 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:52.401206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6443c-3ef6-469e-9be0-d1af602f5f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:52.401835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6443c-3ef6-469e-9be0-d1af602f5f65 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:52.402457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6443c-3ef6-469e-9be0-d1af602f5f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:52.402737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6443c-3ef6-469e-9be0-d1af602f5f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:52.403410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6443c-3ef6-469e-9be0-d1af602f5f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:52.406291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6443c-3ef6-469e-9be0-d1af602f5f65 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:52.413416 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 871/1762] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:52.417463 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 892/1763] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:52.422211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820d1ce-ffb3-48c7-8147-a6cd026c35d5 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:52.433634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6443c-3ef6-469e-9be0-d1af602f5f65 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:52.433756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820d1ce-ffb3-48c7-8147-a6cd026c35d5 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:52.435764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-15a6443c-3ef6-469e-9be0-d1af602f5f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:52.440033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd4c60-3248-43ca-812a-ced6a269efd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:52.440680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd4c60-3248-43ca-812a-ced6a269efd4 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:52.441023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd4c60-3248-43ca-812a-ced6a269efd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:52.441683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd4c60-3248-43ca-812a-ced6a269efd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:52.442387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd4c60-3248-43ca-812a-ced6a269efd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:52.444564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd4c60-3248-43ca-812a-ced6a269efd4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:52.453891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6443c-3ef6-469e-9be0-d1af602f5f65 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:52.459799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fe29c-7989-4251-a4f5-a42e465f0954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:52.460834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fe29c-7989-4251-a4f5-a42e465f0954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:52.461776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fe29c-7989-4251-a4f5-a42e465f0954 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:52.463347 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 872/1764] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:52.464062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fe29c-7989-4251-a4f5-a42e465f0954 admin admin] PATH_INFO: `/v3/projects/52842cb4c0884ce2982ce49c6415ed47` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:52.465164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd4c60-3248-43ca-812a-ced6a269efd4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:52.467596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fe29c-7989-4251-a4f5-a42e465f0954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52842cb4c0884ce2982ce49c6415ed47)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:52.470361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fe29c-7989-4251-a4f5-a42e465f0954 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:52.481130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd4c60-3248-43ca-812a-ced6a269efd4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:52.486875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d286d-103a-4b8f-b876-0f74c1c04422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:52.487586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d286d-103a-4b8f-b876-0f74c1c04422 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:52.487873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d286d-103a-4b8f-b876-0f74c1c04422 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:52.489673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d286d-103a-4b8f-b876-0f74c1c04422 admin admin] PATH_INFO: `/v3/projects/7460b59c19294e8090ba35ceecdb8686/users/2a3bb4b6469145d6951f8e2c8df97f75/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:52.514198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d286d-103a-4b8f-b876-0f74c1c04422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7460b59c19294e8090ba35ceecdb8686, user_id=2a3bb4b6469145d6951f8e2c8df97f75, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:52.517423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d286d-103a-4b8f-b876-0f74c1c04422 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:52.622252 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 873/1765] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:52 2022] PUT /identity/v3/projects/7460b59c19294e8090ba35ceecdb8686/users/2a3bb4b6469145d6951f8e2c8df97f75/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:52.635289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b939c-73d4-4bb8-855a-44f8e3fb2378 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:52.635577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b939c-73d4-4bb8-855a-44f8e3fb2378 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:52.636017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b939c-73d4-4bb8-855a-44f8e3fb2378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:52.673486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-124fe29c-7989-4251-a4f5-a42e465f0954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52842cb4c0884ce2982ce49c6415ed47', 'request_id': 'req-124fe29c-7989-4251-a4f5-a42e465f0954'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:52.683878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-124fe29c-7989-4251-a4f5-a42e465f0954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52842cb4c0884ce2982ce49c6415ed47', 'request_id': 'req-124fe29c-7989-4251-a4f5-a42e465f0954'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:52.688330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b49b939c-73d4-4bb8-855a-44f8e3fb2378 None None] MFA Rules not processed for user `2a3bb4b6469145d6951f8e2c8df97f75`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:52.690653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b49b939c-73d4-4bb8-855a-44f8e3fb2378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:52.691280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-124fe29c-7989-4251-a4f5-a42e465f0954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52842cb4c0884ce2982ce49c6415ed47', 'request_id': 'req-124fe29c-7989-4251-a4f5-a42e465f0954'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:52.767561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-124fe29c-7989-4251-a4f5-a42e465f0954 admin admin] The token cache is being invalidate because project 52842cb4c0884ce2982ce49c6415ed47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:52.768682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-124fe29c-7989-4251-a4f5-a42e465f0954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:52.769464 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 874/1766] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:21:52.772579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-124fe29c-7989-4251-a4f5-a42e465f0954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:52.772579 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 893/1767] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:52 2022] DELETE /identity/v3/projects/52842cb4c0884ce2982ce49c6415ed47 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:52.777050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fe29c-7989-4251-a4f5-a42e465f0954 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:52.777483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61816118-c0dd-4654-bf1a-2be01ec3a2e7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:52.777779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61816118-c0dd-4654-bf1a-2be01ec3a2e7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:52.778077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61816118-c0dd-4654-bf1a-2be01ec3a2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:52.780595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-124fe29c-7989-4251-a4f5-a42e465f0954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:52.804584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-61816118-c0dd-4654-bf1a-2be01ec3a2e7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:52.806451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-61816118-c0dd-4654-bf1a-2be01ec3a2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:52.870877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fe29c-7989-4251-a4f5-a42e465f0954 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:52.884732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ceeb05-83e3-4e43-99a5-ec30ddd2c944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:52.885368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceeb05-83e3-4e43-99a5-ec30ddd2c944 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:52.885650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceeb05-83e3-4e43-99a5-ec30ddd2c944 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:52.885924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceeb05-83e3-4e43-99a5-ec30ddd2c944 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:52.890740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ceeb05-83e3-4e43-99a5-ec30ddd2c944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:52.895537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ceeb05-83e3-4e43-99a5-ec30ddd2c944 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:52.930231 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 875/1768] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:52.948840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b831f-78ef-41af-ae00-e22a556a93d1 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:52.948840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b831f-78ef-41af-ae00-e22a556a93d1 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:52.948840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b831f-78ef-41af-ae00-e22a556a93d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:52.970514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b79b831f-78ef-41af-ae00-e22a556a93d1 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:52.971956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b79b831f-78ef-41af-ae00-e22a556a93d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:52.982457 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 876/1769] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:52.987609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b831f-78ef-41af-ae00-e22a556a93d1 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:53.000321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b831f-78ef-41af-ae00-e22a556a93d1 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:53.007456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cedfc-4888-410c-8e10-61a3bdbdecb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:53.008287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cedfc-4888-410c-8e10-61a3bdbdecb7 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:53.008713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cedfc-4888-410c-8e10-61a3bdbdecb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:53.009184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cedfc-4888-410c-8e10-61a3bdbdecb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:53.009991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85cedfc-4888-410c-8e10-61a3bdbdecb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:21:53.010538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85cedfc-4888-410c-8e10-61a3bdbdecb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:53.012584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85cedfc-4888-410c-8e10-61a3bdbdecb7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:53.034184 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 877/1770] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:21:53.034184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cedfc-4888-410c-8e10-61a3bdbdecb7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:53.035634 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 894/1771] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:52 2022] POST /identity/v3/projects => generated 393 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:53.036832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ceeb05-83e3-4e43-99a5-ec30ddd2c944 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:53.049215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cedfc-4888-410c-8e10-61a3bdbdecb7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:53.122425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406be011-ec85-4d9b-b9b3-144fa14c051c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:53.123976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406be011-ec85-4d9b-b9b3-144fa14c051c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:53.124374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406be011-ec85-4d9b-b9b3-144fa14c051c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:53.125158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406be011-ec85-4d9b-b9b3-144fa14c051c admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:53.125819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406be011-ec85-4d9b-b9b3-144fa14c051c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:53.130465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406be011-ec85-4d9b-b9b3-144fa14c051c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:53.135184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ceeb05-83e3-4e43-99a5-ec30ddd2c944 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:53.143449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6764790-1d6a-4031-8427-f98891139e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:53.144678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6764790-1d6a-4031-8427-f98891139e93 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:53.145983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6764790-1d6a-4031-8427-f98891139e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:53.149836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6764790-1d6a-4031-8427-f98891139e93 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:53.150505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6764790-1d6a-4031-8427-f98891139e93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:53.152983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6764790-1d6a-4031-8427-f98891139e93 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:53.260339 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 878/1772] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:53 2022] POST /identity/v3/users => generated 303 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:53.261320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406be011-ec85-4d9b-b9b3-144fa14c051c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:53.263451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-406be011-ec85-4d9b-b9b3-144fa14c051c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:53.277212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406be011-ec85-4d9b-b9b3-144fa14c051c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:53.289319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1edf2-b73a-4da9-9c9e-f6d35fbb471d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:53.292131 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 895/1773] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:53 2022] POST /identity/v3/projects => generated 381 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:53.294080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6764790-1d6a-4031-8427-f98891139e93 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:53.297653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1edf2-b73a-4da9-9c9e-f6d35fbb471d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:53.310574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1edf2-b73a-4da9-9c9e-f6d35fbb471d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:53.311614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1edf2-b73a-4da9-9c9e-f6d35fbb471d admin admin] PATH_INFO: `/v3/projects/9af002efe87e4f71bc8cc39e3863802d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:53.314907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1edf2-b73a-4da9-9c9e-f6d35fbb471d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9af002efe87e4f71bc8cc39e3863802d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:53.318853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1edf2-b73a-4da9-9c9e-f6d35fbb471d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:53.391392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6764790-1d6a-4031-8427-f98891139e93 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:53.396117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d731b0d-f2de-489e-aab7-6187ab8db7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:53.396743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d731b0d-f2de-489e-aab7-6187ab8db7be admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:53.397030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d731b0d-f2de-489e-aab7-6187ab8db7be admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:53.397308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d731b0d-f2de-489e-aab7-6187ab8db7be admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:53.397959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d731b0d-f2de-489e-aab7-6187ab8db7be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:53.399843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d731b0d-f2de-489e-aab7-6187ab8db7be admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:53.421874 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 896/1774] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:53.422926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d731b0d-f2de-489e-aab7-6187ab8db7be admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:53.440609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d731b0d-f2de-489e-aab7-6187ab8db7be admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:53.446549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec2759-5fc2-4786-b2b6-5bf56b1eabf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:53.447298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec2759-5fc2-4786-b2b6-5bf56b1eabf2 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:53.447677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec2759-5fc2-4786-b2b6-5bf56b1eabf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:53.448045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec2759-5fc2-4786-b2b6-5bf56b1eabf2 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:53.450691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec2759-5fc2-4786-b2b6-5bf56b1eabf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:53.453416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec2759-5fc2-4786-b2b6-5bf56b1eabf2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:53.473318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-07d1edf2-b73a-4da9-9c9e-f6d35fbb471d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9af002efe87e4f71bc8cc39e3863802d', 'request_id': 'req-07d1edf2-b73a-4da9-9c9e-f6d35fbb471d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:53.502026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:53.539907 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 897/1775] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:53 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:53.540987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec2759-5fc2-4786-b2b6-5bf56b1eabf2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:53.556407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-07d1edf2-b73a-4da9-9c9e-f6d35fbb471d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9af002efe87e4f71bc8cc39e3863802d', 'request_id': 'req-07d1edf2-b73a-4da9-9c9e-f6d35fbb471d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:53.564489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec2759-5fc2-4786-b2b6-5bf56b1eabf2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:53.582075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-07d1edf2-b73a-4da9-9c9e-f6d35fbb471d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9af002efe87e4f71bc8cc39e3863802d', 'request_id': 'req-07d1edf2-b73a-4da9-9c9e-f6d35fbb471d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:53.612312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-07d1edf2-b73a-4da9-9c9e-f6d35fbb471d admin admin] The token cache is being invalidate because project 9af002efe87e4f71bc8cc39e3863802d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:53.612630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-07d1edf2-b73a-4da9-9c9e-f6d35fbb471d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:53.616406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-07d1edf2-b73a-4da9-9c9e-f6d35fbb471d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:53.622380 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 879/1776] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:53 2022] DELETE /identity/v3/projects/9af002efe87e4f71bc8cc39e3863802d => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:53.623542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1edf2-b73a-4da9-9c9e-f6d35fbb471d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:53.628983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-07d1edf2-b73a-4da9-9c9e-f6d35fbb471d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:53.681453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0aefce-79d5-4ac2-9a1d-2badecffa277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:53.681940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aefce-79d5-4ac2-9a1d-2badecffa277 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:53.682304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aefce-79d5-4ac2-9a1d-2badecffa277 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:53.682617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aefce-79d5-4ac2-9a1d-2badecffa277 admin admin] PATH_INFO: `/v3/projects/3d4dd82f48e04315abb577f300e0c4db/users/91732d221c874b1085b59ecc1e1a60ee/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:53.731303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0aefce-79d5-4ac2-9a1d-2badecffa277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4dd82f48e04315abb577f300e0c4db, user_id=91732d221c874b1085b59ecc1e1a60ee, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:53.735611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0aefce-79d5-4ac2-9a1d-2badecffa277 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:53.771724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1edf2-b73a-4da9-9c9e-f6d35fbb471d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:53.777683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814ed00-e611-4f47-9b3d-cb95cbe2a7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:53.778416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814ed00-e611-4f47-9b3d-cb95cbe2a7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:53.778779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814ed00-e611-4f47-9b3d-cb95cbe2a7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:53.779806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814ed00-e611-4f47-9b3d-cb95cbe2a7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:53.781077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814ed00-e611-4f47-9b3d-cb95cbe2a7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:53.782888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814ed00-e611-4f47-9b3d-cb95cbe2a7d0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:53.795947 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 880/1777] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:53.797056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814ed00-e611-4f47-9b3d-cb95cbe2a7d0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:53.799283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2814ed00-e611-4f47-9b3d-cb95cbe2a7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:53.815109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814ed00-e611-4f47-9b3d-cb95cbe2a7d0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:53.820584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e68e8-d7c9-4885-a758-cc10d74192e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:53.822695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e68e8-d7c9-4885-a758-cc10d74192e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:53.822695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e68e8-d7c9-4885-a758-cc10d74192e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:53.822695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e68e8-d7c9-4885-a758-cc10d74192e2 admin admin] PATH_INFO: `/v3/users/8bb895e1300a4ae2a783e6153c39c93e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:53.823792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e68e8-d7c9-4885-a758-cc10d74192e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bb895e1300a4ae2a783e6153c39c93e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:53.825875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e68e8-d7c9-4885-a758-cc10d74192e2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:53.882816 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 898/1778] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:53 2022] PUT /identity/v3/projects/3d4dd82f48e04315abb577f300e0c4db/users/91732d221c874b1085b59ecc1e1a60ee/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:53.882816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0aefce-79d5-4ac2-9a1d-2badecffa277 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:54.000156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0aefce-79d5-4ac2-9a1d-2badecffa277 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:54.008286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a834f35-0d83-4eee-ad00-e2a961a82f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:54.009064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a834f35-0d83-4eee-ad00-e2a961a82f90 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:54.009354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a834f35-0d83-4eee-ad00-e2a961a82f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:54.009629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a834f35-0d83-4eee-ad00-e2a961a82f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:54.010467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a834f35-0d83-4eee-ad00-e2a961a82f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:54.013275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a834f35-0d83-4eee-ad00-e2a961a82f90 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:54.041413 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 899/1779] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:54.042347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a834f35-0d83-4eee-ad00-e2a961a82f90 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:54.051318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5a834f35-0d83-4eee-ad00-e2a961a82f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:54.057179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-821e68e8-d7c9-4885-a758-cc10d74192e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bb895e1300a4ae2a783e6153c39c93e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:54.058354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-821e68e8-d7c9-4885-a758-cc10d74192e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bb895e1300a4ae2a783e6153c39c93e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:54.075177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-821e68e8-d7c9-4885-a758-cc10d74192e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bb895e1300a4ae2a783e6153c39c93e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:54.080134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a834f35-0d83-4eee-ad00-e2a961a82f90 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:54.090356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-821e68e8-d7c9-4885-a758-cc10d74192e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bb895e1300a4ae2a783e6153c39c93e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:54.097929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe3a47-d2ab-4c26-b3e4-be8746ba1b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:54.098665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe3a47-d2ab-4c26-b3e4-be8746ba1b31 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:54.098949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe3a47-d2ab-4c26-b3e4-be8746ba1b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:54.099231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe3a47-d2ab-4c26-b3e4-be8746ba1b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:54.099891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe3a47-d2ab-4c26-b3e4-be8746ba1b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:54.101514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe3a47-d2ab-4c26-b3e4-be8746ba1b31 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:54.115004 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 900/1780] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:54.116456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe3a47-d2ab-4c26-b3e4-be8746ba1b31 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:54.119851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-21fe3a47-d2ab-4c26-b3e4-be8746ba1b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:54.135771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe3a47-d2ab-4c26-b3e4-be8746ba1b31 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:54.142540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fbb28-a048-46a5-8001-a705de266c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:54.143163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fbb28-a048-46a5-8001-a705de266c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:54.143456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fbb28-a048-46a5-8001-a705de266c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:54.155023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fbb28-a048-46a5-8001-a705de266c10 admin admin] PATH_INFO: `/v3/projects/b95729a8c8a14361b7cbf8b2b13900b2/users/91d1351fcb6b4cd08f176e6d0cc5bb11/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:54.176557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fbb28-a048-46a5-8001-a705de266c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95729a8c8a14361b7cbf8b2b13900b2, user_id=91d1351fcb6b4cd08f176e6d0cc5bb11, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:54.180898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fbb28-a048-46a5-8001-a705de266c10 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:54.199189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-821e68e8-d7c9-4885-a758-cc10d74192e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bb895e1300a4ae2a783e6153c39c93e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:54.209272 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 881/1781] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:53 2022] DELETE /identity/v3/users/8bb895e1300a4ae2a783e6153c39c93e => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:54.212335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e68e8-d7c9-4885-a758-cc10d74192e2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:54.212335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-821e68e8-d7c9-4885-a758-cc10d74192e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:54.273607 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 901/1782] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:54 2022] PUT /identity/v3/projects/b95729a8c8a14361b7cbf8b2b13900b2/users/91d1351fcb6b4cd08f176e6d0cc5bb11/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:54.287126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6191b-0af9-4e90-8f66-adfbc31c3263 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:54.287464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6191b-0af9-4e90-8f66-adfbc31c3263 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:54.287688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6191b-0af9-4e90-8f66-adfbc31c3263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:54.343870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1ff6191b-0af9-4e90-8f66-adfbc31c3263 None None] MFA Rules not processed for user `91d1351fcb6b4cd08f176e6d0cc5bb11`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:54.345116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1ff6191b-0af9-4e90-8f66-adfbc31c3263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:54.363208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e68e8-d7c9-4885-a758-cc10d74192e2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:54.488469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d58201-2c48-41e9-912b-6c98d6b4be17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:54.489398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d58201-2c48-41e9-912b-6c98d6b4be17 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:54.489780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d58201-2c48-41e9-912b-6c98d6b4be17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:54.490196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d58201-2c48-41e9-912b-6c98d6b4be17 admin admin] PATH_INFO: `/v3/projects/3d4dd82f48e04315abb577f300e0c4db/users/91732d221c874b1085b59ecc1e1a60ee/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:54.492311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d58201-2c48-41e9-912b-6c98d6b4be17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4dd82f48e04315abb577f300e0c4db, user_id=91732d221c874b1085b59ecc1e1a60ee, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:54.495294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d58201-2c48-41e9-912b-6c98d6b4be17 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:54.501951 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 902/1783] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:21:54.506556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6191b-0af9-4e90-8f66-adfbc31c3263 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:54.525126 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 882/1784] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:54 2022] PUT /identity/v3/projects/3d4dd82f48e04315abb577f300e0c4db/users/91732d221c874b1085b59ecc1e1a60ee/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:54.528060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6191b-0af9-4e90-8f66-adfbc31c3263 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:54.536514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21936f-1233-4ce9-b5ea-f898994a6dbe None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:54.538371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21936f-1233-4ce9-b5ea-f898994a6dbe None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:54.538371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21936f-1233-4ce9-b5ea-f898994a6dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:54.597890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ef21936f-1233-4ce9-b5ea-f898994a6dbe None None] MFA Rules not processed for user `91732d221c874b1085b59ecc1e1a60ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:54.601375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ef21936f-1233-4ce9-b5ea-f898994a6dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:54.645229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271fa5e-0b32-4f69-b4c5-e6ee320f6b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:54.645854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271fa5e-0b32-4f69-b4c5-e6ee320f6b8d admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:54.646171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271fa5e-0b32-4f69-b4c5-e6ee320f6b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:54.646455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271fa5e-0b32-4f69-b4c5-e6ee320f6b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:54.647096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271fa5e-0b32-4f69-b4c5-e6ee320f6b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:54.649968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271fa5e-0b32-4f69-b4c5-e6ee320f6b8d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:54.691899 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 883/1785] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:54 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:21:54.699178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21936f-1233-4ce9-b5ea-f898994a6dbe None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:54.724834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21936f-1233-4ce9-b5ea-f898994a6dbe None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:54.746491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffdbef-1639-43f3-aacd-c1d7a4bfbd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:54.747345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffdbef-1639-43f3-aacd-c1d7a4bfbd3c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:54.747891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffdbef-1639-43f3-aacd-c1d7a4bfbd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:54.749083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffdbef-1639-43f3-aacd-c1d7a4bfbd3c admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:54.749925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffdbef-1639-43f3-aacd-c1d7a4bfbd3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:54.750229 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 903/1786] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:54 2022] POST /identity/v3/projects => generated 383 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:21:54.759539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271fa5e-0b32-4f69-b4c5-e6ee320f6b8d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:54.763097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffdbef-1639-43f3-aacd-c1d7a4bfbd3c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:54.870207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271fa5e-0b32-4f69-b4c5-e6ee320f6b8d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:54.876937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083ffb2-0ad1-471e-ae81-4140b4fb6915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:54.877955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083ffb2-0ad1-471e-ae81-4140b4fb6915 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:54.878471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083ffb2-0ad1-471e-ae81-4140b4fb6915 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:54.878891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083ffb2-0ad1-471e-ae81-4140b4fb6915 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:54.879642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083ffb2-0ad1-471e-ae81-4140b4fb6915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:54.894642 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 884/1787] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:54 2022] POST /identity/v3/projects => generated 395 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:54.898473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffdbef-1639-43f3-aacd-c1d7a4bfbd3c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:54.900251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083ffb2-0ad1-471e-ae81-4140b4fb6915 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:55.030375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffdbef-1639-43f3-aacd-c1d7a4bfbd3c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:55.035961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081103b6-dce7-47ca-95db-08c18ed40e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:55.036942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081103b6-dce7-47ca-95db-08c18ed40e03 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:55.040882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081103b6-dce7-47ca-95db-08c18ed40e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:55.047648 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 904/1788] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:54 2022] POST /identity/v3/users => generated 298 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:55.047950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081103b6-dce7-47ca-95db-08c18ed40e03 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:55.049436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081103b6-dce7-47ca-95db-08c18ed40e03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:55.051176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083ffb2-0ad1-471e-ae81-4140b4fb6915 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:55.052689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081103b6-dce7-47ca-95db-08c18ed40e03 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:55.067670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:55.072331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083ffb2-0ad1-471e-ae81-4140b4fb6915 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:55.090884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b608f-a0a6-4319-8ba7-c4470fdd1382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:55.092271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b608f-a0a6-4319-8ba7-c4470fdd1382 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:55.092609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b608f-a0a6-4319-8ba7-c4470fdd1382 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:55.092950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b608f-a0a6-4319-8ba7-c4470fdd1382 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:55.094215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b608f-a0a6-4319-8ba7-c4470fdd1382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:55.095567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b608f-a0a6-4319-8ba7-c4470fdd1382 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:55.109812 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 905/1789] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:55.113541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b608f-a0a6-4319-8ba7-c4470fdd1382 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:55.126904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b608f-a0a6-4319-8ba7-c4470fdd1382 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:55.133115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d0f9d-c960-4f77-9adc-5415896517ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:55.136585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d0f9d-c960-4f77-9adc-5415896517ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:55.136585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d0f9d-c960-4f77-9adc-5415896517ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:55.136585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d0f9d-c960-4f77-9adc-5415896517ad admin admin] PATH_INFO: `/v3/projects/55e16dad037842a4aea9f4516cc36775/users/2ee077a3c9884bd9a2425514e67a5cf2/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:55.164292 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 885/1790] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:54 2022] POST /identity/v3/users => generated 298 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:55.164693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d0f9d-c960-4f77-9adc-5415896517ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=55e16dad037842a4aea9f4516cc36775, user_id=2ee077a3c9884bd9a2425514e67a5cf2, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:55.165341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081103b6-dce7-47ca-95db-08c18ed40e03 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:55.174994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d0f9d-c960-4f77-9adc-5415896517ad admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:55.181394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081103b6-dce7-47ca-95db-08c18ed40e03 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:55.187869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:55.189628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2486ff0-f1e1-417f-bc93-c503489035c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:55.190616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2486ff0-f1e1-417f-bc93-c503489035c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:55.191165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2486ff0-f1e1-417f-bc93-c503489035c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:55.195892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2486ff0-f1e1-417f-bc93-c503489035c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:55.195892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2486ff0-f1e1-417f-bc93-c503489035c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:55.195892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2486ff0-f1e1-417f-bc93-c503489035c2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:55.207087 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 886/1791] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:55.219638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2486ff0-f1e1-417f-bc93-c503489035c2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:55.245818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2486ff0-f1e1-417f-bc93-c503489035c2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:55.251733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ae7af-623b-467a-84b3-f9b0beb371b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:55.254000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ae7af-623b-467a-84b3-f9b0beb371b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:55.254000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ae7af-623b-467a-84b3-f9b0beb371b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:55.254000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ae7af-623b-467a-84b3-f9b0beb371b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:55.254000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ae7af-623b-467a-84b3-f9b0beb371b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:55.255447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ae7af-623b-467a-84b3-f9b0beb371b6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:55.270254 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 887/1792] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:55.277398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ae7af-623b-467a-84b3-f9b0beb371b6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:55.316563 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 906/1793] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:55 2022] PUT /identity/v3/projects/55e16dad037842a4aea9f4516cc36775/users/2ee077a3c9884bd9a2425514e67a5cf2/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:21:55.317053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ae7af-623b-467a-84b3-f9b0beb371b6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:55.320807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d0f9d-c960-4f77-9adc-5415896517ad admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:55.429525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d0f9d-c960-4f77-9adc-5415896517ad admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:55.439947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb60111-c535-4ffe-9871-014f867d188d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:55.440638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb60111-c535-4ffe-9871-014f867d188d admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:55.440930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb60111-c535-4ffe-9871-014f867d188d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:55.441206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb60111-c535-4ffe-9871-014f867d188d admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:55.441865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb60111-c535-4ffe-9871-014f867d188d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:55.444268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb60111-c535-4ffe-9871-014f867d188d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:55.459990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5113398-f57e-47e5-8cad-be8472c54312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:55.460760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5113398-f57e-47e5-8cad-be8472c54312 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:55.461116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5113398-f57e-47e5-8cad-be8472c54312 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:55.461396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5113398-f57e-47e5-8cad-be8472c54312 admin admin] PATH_INFO: `/v3/projects/66e9e7e2054d49ca88a72c1f0e14b9f8/users/df4ccd7138c446ae978634ebe91ac281/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:55.465073 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 907/1794] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:55.466153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb60111-c535-4ffe-9871-014f867d188d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:55.469048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-feb60111-c535-4ffe-9871-014f867d188d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:55.486097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb60111-c535-4ffe-9871-014f867d188d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:55.486186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5113398-f57e-47e5-8cad-be8472c54312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e9e7e2054d49ca88a72c1f0e14b9f8, user_id=df4ccd7138c446ae978634ebe91ac281, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:55.489884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5113398-f57e-47e5-8cad-be8472c54312 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:55.507878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921cc38-617e-4843-b89e-e8b013aee50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:55.517150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921cc38-617e-4843-b89e-e8b013aee50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:55.517150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921cc38-617e-4843-b89e-e8b013aee50d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:55.517150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921cc38-617e-4843-b89e-e8b013aee50d admin admin] PATH_INFO: `/v3/projects/13feb46371e24c51aecf48ab4beb22ce` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:55.517150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921cc38-617e-4843-b89e-e8b013aee50d admin admin] RBAC: Authorizing `identity:delete_project(project_id=13feb46371e24c51aecf48ab4beb22ce)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:55.517150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921cc38-617e-4843-b89e-e8b013aee50d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:55.644902 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 888/1795] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:55 2022] PUT /identity/v3/projects/66e9e7e2054d49ca88a72c1f0e14b9f8/users/df4ccd7138c446ae978634ebe91ac281/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:55.647673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5113398-f57e-47e5-8cad-be8472c54312 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:55.733216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c921cc38-617e-4843-b89e-e8b013aee50d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13feb46371e24c51aecf48ab4beb22ce', 'request_id': 'req-c921cc38-617e-4843-b89e-e8b013aee50d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:55.741369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c921cc38-617e-4843-b89e-e8b013aee50d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13feb46371e24c51aecf48ab4beb22ce', 'request_id': 'req-c921cc38-617e-4843-b89e-e8b013aee50d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:55.748064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c921cc38-617e-4843-b89e-e8b013aee50d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13feb46371e24c51aecf48ab4beb22ce', 'request_id': 'req-c921cc38-617e-4843-b89e-e8b013aee50d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:55.778619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5113398-f57e-47e5-8cad-be8472c54312 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:55.844425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17145b-15eb-4006-ad66-75277d71d120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:55.845267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17145b-15eb-4006-ad66-75277d71d120 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:55.845551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17145b-15eb-4006-ad66-75277d71d120 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:55.845847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17145b-15eb-4006-ad66-75277d71d120 admin admin] PATH_INFO: `/v3/projects/55e16dad037842a4aea9f4516cc36775/users/2ee077a3c9884bd9a2425514e67a5cf2/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:55.855618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c921cc38-617e-4843-b89e-e8b013aee50d admin admin] The token cache is being invalidate because project 13feb46371e24c51aecf48ab4beb22ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:21:55.855820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17145b-15eb-4006-ad66-75277d71d120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55e16dad037842a4aea9f4516cc36775, user_id=2ee077a3c9884bd9a2425514e67a5cf2, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:55.856392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c921cc38-617e-4843-b89e-e8b013aee50d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:55.858666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17145b-15eb-4006-ad66-75277d71d120 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:55.859153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c921cc38-617e-4843-b89e-e8b013aee50d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:55.861114 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 908/1796] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:21:55 2022] DELETE /identity/v3/projects/13feb46371e24c51aecf48ab4beb22ce => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:55.862396 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87d5cb-ff02-48e8-856a-d3bb9b01bc16 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:55.862781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87d5cb-ff02-48e8-856a-d3bb9b01bc16 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:55.863152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87d5cb-ff02-48e8-856a-d3bb9b01bc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:55.880242 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 889/1797] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:55 2022] PUT /identity/v3/projects/55e16dad037842a4aea9f4516cc36775/users/2ee077a3c9884bd9a2425514e67a5cf2/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:55.890950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50521e-487e-44b1-8e1d-fe0c555c9ed8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:55.890950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50521e-487e-44b1-8e1d-fe0c555c9ed8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:55.890950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50521e-487e-44b1-8e1d-fe0c555c9ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:55.935230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-de50521e-487e-44b1-8e1d-fe0c555c9ed8 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:55.938781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-de50521e-487e-44b1-8e1d-fe0c555c9ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:55.972926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0f87d5cb-ff02-48e8-856a-d3bb9b01bc16 None None] MFA Rules not processed for user `df4ccd7138c446ae978634ebe91ac281`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:55.977559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0f87d5cb-ff02-48e8-856a-d3bb9b01bc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:56.098193 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 890/1798] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:56.099887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d29de-4975-4bab-bb04-6567c033dd17 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:56.100178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d29de-4975-4bab-bb04-6567c033dd17 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:56.100453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d29de-4975-4bab-bb04-6567c033dd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:56.145736 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 909/1799] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:55 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:56.147403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb1e14-a3e9-4cc4-8de5-899e428c90dc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:56.147915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb1e14-a3e9-4cc4-8de5-899e428c90dc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:56.148716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb1e14-a3e9-4cc4-8de5-899e428c90dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:56.172441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ce0d29de-4975-4bab-bb04-6567c033dd17 None None] MFA Rules not processed for user `2ee077a3c9884bd9a2425514e67a5cf2`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:56.176984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ce0d29de-4975-4bab-bb04-6567c033dd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:56.211150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:56.216083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-77bb1e14-a3e9-4cc4-8de5-899e428c90dc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:56.216083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-77bb1e14-a3e9-4cc4-8de5-899e428c90dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:56.240294 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 910/1800] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:56.242022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb1e14-a3e9-4cc4-8de5-899e428c90dc None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:56.243915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-77bb1e14-a3e9-4cc4-8de5-899e428c90dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:56.305610 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 891/1801] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:56.306677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d29de-4975-4bab-bb04-6567c033dd17 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:56.321724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d29de-4975-4bab-bb04-6567c033dd17 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:56.329252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd52b2-8115-4f90-bd4f-5bc8e90984ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:56.329613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd52b2-8115-4f90-bd4f-5bc8e90984ec admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:56.330183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd52b2-8115-4f90-bd4f-5bc8e90984ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:56.330346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd52b2-8115-4f90-bd4f-5bc8e90984ec admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:56.331040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd52b2-8115-4f90-bd4f-5bc8e90984ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:21:56.331316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd52b2-8115-4f90-bd4f-5bc8e90984ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:56.334250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd52b2-8115-4f90-bd4f-5bc8e90984ec admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:56.353597 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 892/1802] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:21:56.356389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6788c-c35d-4002-a37b-d7dfc40f207a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:56.356684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6788c-c35d-4002-a37b-d7dfc40f207a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:56.356963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6788c-c35d-4002-a37b-d7dfc40f207a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:56.381126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb1e14-a3e9-4cc4-8de5-899e428c90dc None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:56.410458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a8f58-43f3-4f63-8b51-1696902c794b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:56.410458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a8f58-43f3-4f63-8b51-1696902c794b service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:56.410458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a8f58-43f3-4f63-8b51-1696902c794b service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:56.410458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a8f58-43f3-4f63-8b51-1696902c794b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:56.410790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f65a8f58-43f3-4f63-8b51-1696902c794b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:56.410870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5fb6788c-c35d-4002-a37b-d7dfc40f207a None None] MFA Rules not processed for user `91d1351fcb6b4cd08f176e6d0cc5bb11`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:56.411659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5fb6788c-c35d-4002-a37b-d7dfc40f207a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:56.553846 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 893/1803] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:56.559243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6788c-c35d-4002-a37b-d7dfc40f207a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:56.567028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a8f58-43f3-4f63-8b51-1696902c794b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:56.569193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a8f58-43f3-4f63-8b51-1696902c794b service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:56.572562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6788c-c35d-4002-a37b-d7dfc40f207a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:56.578551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31481f80-0605-47b3-9fad-817c18bb4c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:56.579864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31481f80-0605-47b3-9fad-817c18bb4c08 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:56.579864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31481f80-0605-47b3-9fad-817c18bb4c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:56.580138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31481f80-0605-47b3-9fad-817c18bb4c08 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:56.581543 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 911/1804] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:56 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:56.581675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31481f80-0605-47b3-9fad-817c18bb4c08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:56.583327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31481f80-0605-47b3-9fad-817c18bb4c08 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:56.735378 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 894/1805] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:56 2022] POST /identity/v3/projects => generated 369 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:56.739584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a8f58-43f3-4f63-8b51-1696902c794b service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:56.749909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a8f58-43f3-4f63-8b51-1696902c794b service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:56.831199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31481f80-0605-47b3-9fad-817c18bb4c08 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:56.833869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-31481f80-0605-47b3-9fad-817c18bb4c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:56.855571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee1868-dead-4c2c-8ff4-d5a6799cce97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:56.856202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee1868-dead-4c2c-8ff4-d5a6799cce97 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:56.856485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee1868-dead-4c2c-8ff4-d5a6799cce97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:56.856758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee1868-dead-4c2c-8ff4-d5a6799cce97 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:56.858999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee1868-dead-4c2c-8ff4-d5a6799cce97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:56.862330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee1868-dead-4c2c-8ff4-d5a6799cce97 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:56.926393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31481f80-0605-47b3-9fad-817c18bb4c08 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:56.932041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dde370-6043-48f7-823c-c9cbcde92afa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:56.932652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dde370-6043-48f7-823c-c9cbcde92afa service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:56.932929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dde370-6043-48f7-823c-c9cbcde92afa service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:56.933202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dde370-6043-48f7-823c-c9cbcde92afa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:56.935264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-93dde370-6043-48f7-823c-c9cbcde92afa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:56.961002 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 912/1806] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:56 2022] POST /identity/v3/users => generated 285 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:56.964780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee1868-dead-4c2c-8ff4-d5a6799cce97 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:56.978836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee1868-dead-4c2c-8ff4-d5a6799cce97 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:56.985194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c192c-58f7-438d-9fc1-1240cbe5304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:56.985948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c192c-58f7-438d-9fc1-1240cbe5304f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:56.986526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c192c-58f7-438d-9fc1-1240cbe5304f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:56.986903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c192c-58f7-438d-9fc1-1240cbe5304f admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:56.987662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c192c-58f7-438d-9fc1-1240cbe5304f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:56.989619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c192c-58f7-438d-9fc1-1240cbe5304f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:57.003553 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 913/1807] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:57.005088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a6655-9aa6-489a-83f3-99ae6a6a7452 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:57.006275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a6655-9aa6-489a-83f3-99ae6a6a7452 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:57.006520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a6655-9aa6-489a-83f3-99ae6a6a7452 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:57.008190 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 914/1808] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:21:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:21:57.008935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a6655-9aa6-489a-83f3-99ae6a6a7452 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:57.018661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dde370-6043-48f7-823c-c9cbcde92afa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:57.020851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dde370-6043-48f7-823c-c9cbcde92afa service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:57.025552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a6655-9aa6-489a-83f3-99ae6a6a7452 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:57.032725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988e7dc-3ae7-46f1-bfca-2ef73b0feff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:57.033783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988e7dc-3ae7-46f1-bfca-2ef73b0feff0 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:57.033895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988e7dc-3ae7-46f1-bfca-2ef73b0feff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:57.034292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988e7dc-3ae7-46f1-bfca-2ef73b0feff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:57.035020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988e7dc-3ae7-46f1-bfca-2ef73b0feff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:57.036410 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 895/1809] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:21:57.036892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988e7dc-3ae7-46f1-bfca-2ef73b0feff0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:57.037528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dde370-6043-48f7-823c-c9cbcde92afa service nova] Authenticating service token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:21:57.049542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dde370-6043-48f7-823c-c9cbcde92afa service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:57.053884 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 915/1810] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:57.064855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988e7dc-3ae7-46f1-bfca-2ef73b0feff0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:57.081422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988e7dc-3ae7-46f1-bfca-2ef73b0feff0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:57.086667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582cae5-963a-473e-9bcb-0e079e15f3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:57.087435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582cae5-963a-473e-9bcb-0e079e15f3dd admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:57.087865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582cae5-963a-473e-9bcb-0e079e15f3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:57.088335 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582cae5-963a-473e-9bcb-0e079e15f3dd admin admin] PATH_INFO: `/v3/projects/aaee7e66f16e4ed5b49394311bd2803a/users/8c93886c5818439690564c2299a4f3ee/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:57.118400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582cae5-963a-473e-9bcb-0e079e15f3dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaee7e66f16e4ed5b49394311bd2803a, user_id=8c93886c5818439690564c2299a4f3ee, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:57.122505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582cae5-963a-473e-9bcb-0e079e15f3dd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:57.157750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dde370-6043-48f7-823c-c9cbcde92afa service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:57.163341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c04fb8-bd59-4f20-9de1-0cf015b28450 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91732d221c874b1085b59ecc1e1a60ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d4dd82f48e04315abb577f300e0c4db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:57.164210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c04fb8-bd59-4f20-9de1-0cf015b28450 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:57.164383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c04fb8-bd59-4f20-9de1-0cf015b28450 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:57.164567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c04fb8-bd59-4f20-9de1-0cf015b28450 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] PATH_INFO: `/v3/projects/7460b59c19294e8090ba35ceecdb8686` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:57.165737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c04fb8-bd59-4f20-9de1-0cf015b28450 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] RBAC: Authorizing `identity:get_project(project_id=7460b59c19294e8090ba35ceecdb8686)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:57.167954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c04fb8-bd59-4f20-9de1-0cf015b28450 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:57.169781 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 896/1811] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:21:57 2022] GET /identity/v3/projects/7460b59c19294e8090ba35ceecdb8686 => generated 393 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:21:57.226621 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 916/1812] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:57 2022] PUT /identity/v3/projects/aaee7e66f16e4ed5b49394311bd2803a/users/8c93886c5818439690564c2299a4f3ee/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:57.230522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6eef4-99b3-4f9f-8ee4-b434a1eba39c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:57.233153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6eef4-99b3-4f9f-8ee4-b434a1eba39c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:57.233620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6eef4-99b3-4f9f-8ee4-b434a1eba39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:57.256716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c1d6eef4-99b3-4f9f-8ee4-b434a1eba39c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:57.258439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c1d6eef4-99b3-4f9f-8ee4-b434a1eba39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:57.262711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:57.370939 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 897/1813] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:57.394799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582cae5-963a-473e-9bcb-0e079e15f3dd admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:57.397848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2582cae5-963a-473e-9bcb-0e079e15f3dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:57.490844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582cae5-963a-473e-9bcb-0e079e15f3dd admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:57.495013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a24a4-e301-411c-9e44-dbc2840b6e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:57.495694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a24a4-e301-411c-9e44-dbc2840b6e0f service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:57.496343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a24a4-e301-411c-9e44-dbc2840b6e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:57.496343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a24a4-e301-411c-9e44-dbc2840b6e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:57.508194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a24a4-e301-411c-9e44-dbc2840b6e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:57.509559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a24a4-e301-411c-9e44-dbc2840b6e0f service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:57.521428 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 917/1814] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:21:57.575288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e27749-f1d6-40d7-a403-ad6fc9e05b18 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:57.575709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e27749-f1d6-40d7-a403-ad6fc9e05b18 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:57.575998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e27749-f1d6-40d7-a403-ad6fc9e05b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:57.607482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b2e27749-f1d6-40d7-a403-ad6fc9e05b18 None None] MFA Rules not processed for user `2e23378ed283426cbff623265d9bbc96`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:57.607482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b2e27749-f1d6-40d7-a403-ad6fc9e05b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:57.678944 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 898/1815] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:57 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:57.680538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a24a4-e301-411c-9e44-dbc2840b6e0f service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:57.682815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8b1a24a4-e301-411c-9e44-dbc2840b6e0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:57.698625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a24a4-e301-411c-9e44-dbc2840b6e0f service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:57.706942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d83bbd-20e2-4c3a-bda8-3f5807d58006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:57.707913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d83bbd-20e2-4c3a-bda8-3f5807d58006 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:57.708465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d83bbd-20e2-4c3a-bda8-3f5807d58006 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:57.708938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d83bbd-20e2-4c3a-bda8-3f5807d58006 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:57.710652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d83bbd-20e2-4c3a-bda8-3f5807d58006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:57.713521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d83bbd-20e2-4c3a-bda8-3f5807d58006 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:57.760883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7977eca-3f9f-4eca-a775-b617e8e807a0 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:57.761180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7977eca-3f9f-4eca-a775-b617e8e807a0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:57.761481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7977eca-3f9f-4eca-a775-b617e8e807a0 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:57.763307 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 899/1816] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:21:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:21:57.768443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7977eca-3f9f-4eca-a775-b617e8e807a0 None None] Authenticating service token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:21:57.846505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7977eca-3f9f-4eca-a775-b617e8e807a0 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:57.871689 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 918/1817] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:21:57 2022] POST /identity/v3/projects => generated 401 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:57.873483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d83bbd-20e2-4c3a-bda8-3f5807d58006 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:57.955755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7977eca-3f9f-4eca-a775-b617e8e807a0 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:58.038113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d83bbd-20e2-4c3a-bda8-3f5807d58006 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:58.052504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4427d-f52e-4628-899d-f236e2a09923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:58.053151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4427d-f52e-4628-899d-f236e2a09923 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:58.053444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4427d-f52e-4628-899d-f236e2a09923 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:58.053728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4427d-f52e-4628-899d-f236e2a09923 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:58.054779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4427d-f52e-4628-899d-f236e2a09923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:58.058728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4427d-f52e-4628-899d-f236e2a09923 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:58.079466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a289de5-6f9b-4ac5-8827-95467c0e31b3 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91732d221c874b1085b59ecc1e1a60ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d4dd82f48e04315abb577f300e0c4db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:58.081348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a289de5-6f9b-4ac5-8827-95467c0e31b3 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:58.081742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a289de5-6f9b-4ac5-8827-95467c0e31b3 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:58.082173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a289de5-6f9b-4ac5-8827-95467c0e31b3 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] PATH_INFO: `/v3/projects/7460b59c19294e8090ba35ceecdb8686` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:58.094416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a289de5-6f9b-4ac5-8827-95467c0e31b3 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] RBAC: Authorizing `identity:get_project(project_id=7460b59c19294e8090ba35ceecdb8686)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:58.094416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a289de5-6f9b-4ac5-8827-95467c0e31b3 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:58.094416 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 900/1818] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:21:57 2022] GET /identity/v3/projects/7460b59c19294e8090ba35ceecdb8686 => generated 393 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:21:58.176783 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 919/1819] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:21:57 2022] POST /identity/v3/users => generated 307 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:21:58.177809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a289de5-6f9b-4ac5-8827-95467c0e31b3 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:58.199674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a289de5-6f9b-4ac5-8827-95467c0e31b3 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:58.210414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22595770-9c64-4cb7-a73e-87efd9173586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:58.211706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22595770-9c64-4cb7-a73e-87efd9173586 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:58.212174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22595770-9c64-4cb7-a73e-87efd9173586 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:58.212858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22595770-9c64-4cb7-a73e-87efd9173586 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:58.213745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22595770-9c64-4cb7-a73e-87efd9173586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:58.219560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22595770-9c64-4cb7-a73e-87efd9173586 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:58.247373 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 901/1820] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:58.251823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4427d-f52e-4628-899d-f236e2a09923 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:58.262816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:58.266944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4427d-f52e-4628-899d-f236e2a09923 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:58.273024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617b8fe-0d5c-4d14-ada9-0b6f728bffd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:58.273887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617b8fe-0d5c-4d14-ada9-0b6f728bffd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:58.274366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617b8fe-0d5c-4d14-ada9-0b6f728bffd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:58.274794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617b8fe-0d5c-4d14-ada9-0b6f728bffd2 admin admin] PATH_INFO: `/v3/projects/9ec63e1dd41442f48d270aea6a917ff7/users/ac4a306da0e940a99b3155ce3d7b2d58/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:58.296246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617b8fe-0d5c-4d14-ada9-0b6f728bffd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ec63e1dd41442f48d270aea6a917ff7, user_id=ac4a306da0e940a99b3155ce3d7b2d58, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:58.301110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617b8fe-0d5c-4d14-ada9-0b6f728bffd2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:58.392643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22595770-9c64-4cb7-a73e-87efd9173586 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:58.399494 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 920/1821] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:58 2022] PUT /identity/v3/projects/9ec63e1dd41442f48d270aea6a917ff7/users/ac4a306da0e940a99b3155ce3d7b2d58/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:21:58.408514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22595770-9c64-4cb7-a73e-87efd9173586 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:58.468526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d91516-85ee-41a5-8202-a4fbcc9ed813 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:58.468819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d91516-85ee-41a5-8202-a4fbcc9ed813 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:58.469288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d91516-85ee-41a5-8202-a4fbcc9ed813 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:58.470938 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 921/1822] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:21:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:21:58.487759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d91516-85ee-41a5-8202-a4fbcc9ed813 None None] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:21:58.527322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d505bf-1ba6-41ed-a440-59d83d3d7a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:58.531746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d505bf-1ba6-41ed-a440-59d83d3d7a94 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:58.531746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d505bf-1ba6-41ed-a440-59d83d3d7a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:58.531746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d505bf-1ba6-41ed-a440-59d83d3d7a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:58.531746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d505bf-1ba6-41ed-a440-59d83d3d7a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:58.533719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d505bf-1ba6-41ed-a440-59d83d3d7a94 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:58.546707 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 902/1823] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:21:58.551257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d505bf-1ba6-41ed-a440-59d83d3d7a94 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:58.565038 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d505bf-1ba6-41ed-a440-59d83d3d7a94 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:58.570429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a0300-fc03-48e7-9857-e12131f68a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:58.572212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a0300-fc03-48e7-9857-e12131f68a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:58.572506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a0300-fc03-48e7-9857-e12131f68a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:58.572839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a0300-fc03-48e7-9857-e12131f68a4b admin admin] PATH_INFO: `/v3/projects/9ec63e1dd41442f48d270aea6a917ff7/users/ac4a306da0e940a99b3155ce3d7b2d58/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:58.575247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a0300-fc03-48e7-9857-e12131f68a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ec63e1dd41442f48d270aea6a917ff7, user_id=ac4a306da0e940a99b3155ce3d7b2d58, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:58.580245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a0300-fc03-48e7-9857-e12131f68a4b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:58.600229 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 903/1824] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:21:58 2022] PUT /identity/v3/projects/9ec63e1dd41442f48d270aea6a917ff7/users/ac4a306da0e940a99b3155ce3d7b2d58/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:58.619900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d91516-85ee-41a5-8202-a4fbcc9ed813 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:58.707932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d91516-85ee-41a5-8202-a4fbcc9ed813 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:58.787008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee568873-4ff1-4b22-9cab-40852eb1bc87 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91732d221c874b1085b59ecc1e1a60ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d4dd82f48e04315abb577f300e0c4db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:58.787824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee568873-4ff1-4b22-9cab-40852eb1bc87 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:58.788131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee568873-4ff1-4b22-9cab-40852eb1bc87 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:58.788412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee568873-4ff1-4b22-9cab-40852eb1bc87 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] PATH_INFO: `/v3/projects/7460b59c19294e8090ba35ceecdb8686` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:58.790262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee568873-4ff1-4b22-9cab-40852eb1bc87 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] RBAC: Authorizing `identity:get_project(project_id=7460b59c19294e8090ba35ceecdb8686)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:58.793282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee568873-4ff1-4b22-9cab-40852eb1bc87 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:58.801261 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 922/1825] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:21:58 2022] GET /identity/v3/projects/7460b59c19294e8090ba35ceecdb8686 => generated 393 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:21:59.160110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a0300-fc03-48e7-9857-e12131f68a4b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:59.163239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-635a0300-fc03-48e7-9857-e12131f68a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:59.258588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a0300-fc03-48e7-9857-e12131f68a4b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:59.263741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5d3bd-abba-48e4-891f-81f63e224719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:59.264380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5d3bd-abba-48e4-891f-81f63e224719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:59.264705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5d3bd-abba-48e4-891f-81f63e224719 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:59.264966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5d3bd-abba-48e4-891f-81f63e224719 admin admin] PATH_INFO: `/v3/users/ff070c0383324e1da5c49e3d9c652516` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:59.266374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a5d3bd-abba-48e4-891f-81f63e224719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff070c0383324e1da5c49e3d9c652516)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:21:59.268334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a5d3bd-abba-48e4-891f-81f63e224719 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:21:59.549751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-50a5d3bd-abba-48e4-891f-81f63e224719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff070c0383324e1da5c49e3d9c652516'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:59.550474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-50a5d3bd-abba-48e4-891f-81f63e224719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff070c0383324e1da5c49e3d9c652516'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:59.559241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-50a5d3bd-abba-48e4-891f-81f63e224719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff070c0383324e1da5c49e3d9c652516'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:59.575980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-50a5d3bd-abba-48e4-891f-81f63e224719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff070c0383324e1da5c49e3d9c652516'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:59.701620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-50a5d3bd-abba-48e4-891f-81f63e224719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff070c0383324e1da5c49e3d9c652516'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:21:59.708393 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 904/1826] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:21:59 2022] DELETE /identity/v3/users/ff070c0383324e1da5c49e3d9c652516 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:21:59.713745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e410f46-1681-4776-8637-b2d61714fa9d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:59.714681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e410f46-1681-4776-8637-b2d61714fa9d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:59.715139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e410f46-1681-4776-8637-b2d61714fa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:59.752578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1e410f46-1681-4776-8637-b2d61714fa9d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:21:59.754297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1e410f46-1681-4776-8637-b2d61714fa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:59.881853 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 923/1827] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:21:59.892839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5d3bd-abba-48e4-891f-81f63e224719 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:59.894301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-50a5d3bd-abba-48e4-891f-81f63e224719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:59.963118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5d3bd-abba-48e4-891f-81f63e224719 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:21:59.973996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7cb47-6d2e-4f15-abc2-44c3c00e95ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:21:59.973996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7cb47-6d2e-4f15-abc2-44c3c00e95ad service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:21:59.973996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7cb47-6d2e-4f15-abc2-44c3c00e95ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:21:59.973996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7cb47-6d2e-4f15-abc2-44c3c00e95ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:21:59.981374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e410f46-1681-4776-8637-b2d61714fa9d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:21:59.983153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1e410f46-1681-4776-8637-b2d61714fa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:21:59.998641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7cb47-6d2e-4f15-abc2-44c3c00e95ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:00.000237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7cb47-6d2e-4f15-abc2-44c3c00e95ad service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:00.015595 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 905/1828] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:22:00.133703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e410f46-1681-4776-8637-b2d61714fa9d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:00.141025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7f499-8970-485c-9cc1-8071bb0ecc5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:00.141741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7f499-8970-485c-9cc1-8071bb0ecc5b service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:00.142057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7f499-8970-485c-9cc1-8071bb0ecc5b service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:00.142539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7f499-8970-485c-9cc1-8071bb0ecc5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:00.145061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7ac7f499-8970-485c-9cc1-8071bb0ecc5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:00.245676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:00.283821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7f499-8970-485c-9cc1-8071bb0ecc5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:00.286489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7f499-8970-485c-9cc1-8071bb0ecc5b service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:00.304658 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 924/1829] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:21:59 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:22:00.371284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:00.531387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7cb47-6d2e-4f15-abc2-44c3c00e95ad service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:00.533152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d0d7cb47-6d2e-4f15-abc2-44c3c00e95ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:00.553324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7cb47-6d2e-4f15-abc2-44c3c00e95ad service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:00.559171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8e14d-cb97-466b-baf6-fafed5754e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:00.559910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8e14d-cb97-466b-baf6-fafed5754e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:00.560971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8e14d-cb97-466b-baf6-fafed5754e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:00.561433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8e14d-cb97-466b-baf6-fafed5754e9e admin admin] PATH_INFO: `/v3/projects/ac1da8ce26ab49ddae972233777c4c55` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:00.563993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8e14d-cb97-466b-baf6-fafed5754e9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac1da8ce26ab49ddae972233777c4c55)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:00.568093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8e14d-cb97-466b-baf6-fafed5754e9e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:00.670295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822398de-5825-4bb3-ac5c-40a812b18b6f None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:00.670584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822398de-5825-4bb3-ac5c-40a812b18b6f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:00.670862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822398de-5825-4bb3-ac5c-40a812b18b6f None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:00.672566 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 925/1830] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:22:00.680914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822398de-5825-4bb3-ac5c-40a812b18b6f None None] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:22:00.684402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-822398de-5825-4bb3-ac5c-40a812b18b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:00.725198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822398de-5825-4bb3-ac5c-40a812b18b6f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:00.730464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-822398de-5825-4bb3-ac5c-40a812b18b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:00.766306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b3f8e14d-cb97-466b-baf6-fafed5754e9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac1da8ce26ab49ddae972233777c4c55', 'request_id': 'req-b3f8e14d-cb97-466b-baf6-fafed5754e9e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:00.855738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b3f8e14d-cb97-466b-baf6-fafed5754e9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac1da8ce26ab49ddae972233777c4c55', 'request_id': 'req-b3f8e14d-cb97-466b-baf6-fafed5754e9e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:00.866515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b3f8e14d-cb97-466b-baf6-fafed5754e9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac1da8ce26ab49ddae972233777c4c55', 'request_id': 'req-b3f8e14d-cb97-466b-baf6-fafed5754e9e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:00.871234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822398de-5825-4bb3-ac5c-40a812b18b6f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:00.880293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b3f8e14d-cb97-466b-baf6-fafed5754e9e admin admin] The token cache is being invalidate because project ac1da8ce26ab49ddae972233777c4c55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:00.880804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b3f8e14d-cb97-466b-baf6-fafed5754e9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:00.881942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b3f8e14d-cb97-466b-baf6-fafed5754e9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:00.887642 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 906/1831] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:00 2022] DELETE /identity/v3/projects/ac1da8ce26ab49ddae972233777c4c55 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:00.889564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8e14d-cb97-466b-baf6-fafed5754e9e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:00.891265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b3f8e14d-cb97-466b-baf6-fafed5754e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:00.996870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8e14d-cb97-466b-baf6-fafed5754e9e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:01.007182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9be8c9-3299-4273-ac36-91c6966f5da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:01.007839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9be8c9-3299-4273-ac36-91c6966f5da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:01.008124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9be8c9-3299-4273-ac36-91c6966f5da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:01.008398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9be8c9-3299-4273-ac36-91c6966f5da6 admin admin] PATH_INFO: `/v3/users/852d4b8d85264eb591321670b14dd62c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:01.011185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9be8c9-3299-4273-ac36-91c6966f5da6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=852d4b8d85264eb591321670b14dd62c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:01.015492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6220935-59e4-4c89-a0fa-040c20753fd9 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91732d221c874b1085b59ecc1e1a60ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d4dd82f48e04315abb577f300e0c4db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:01.016152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6220935-59e4-4c89-a0fa-040c20753fd9 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:01.016437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6220935-59e4-4c89-a0fa-040c20753fd9 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:01.016715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6220935-59e4-4c89-a0fa-040c20753fd9 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] PATH_INFO: `/v3/projects/7460b59c19294e8090ba35ceecdb8686` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:01.017399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9be8c9-3299-4273-ac36-91c6966f5da6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:01.019640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6220935-59e4-4c89-a0fa-040c20753fd9 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] RBAC: Authorizing `identity:get_project(project_id=7460b59c19294e8090ba35ceecdb8686)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:01.021940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6220935-59e4-4c89-a0fa-040c20753fd9 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:01.026198 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 926/1832] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:22:00 2022] GET /identity/v3/projects/7460b59c19294e8090ba35ceecdb8686 => generated 393 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:22:01.289254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5e9be8c9-3299-4273-ac36-91c6966f5da6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '852d4b8d85264eb591321670b14dd62c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:01.290301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5e9be8c9-3299-4273-ac36-91c6966f5da6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '852d4b8d85264eb591321670b14dd62c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:01.309168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5e9be8c9-3299-4273-ac36-91c6966f5da6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '852d4b8d85264eb591321670b14dd62c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:01.331736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5e9be8c9-3299-4273-ac36-91c6966f5da6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '852d4b8d85264eb591321670b14dd62c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:01.352804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:01.437043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5e9be8c9-3299-4273-ac36-91c6966f5da6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '852d4b8d85264eb591321670b14dd62c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:01.461001 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 907/1833] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:22:00 2022] DELETE /identity/v3/users/852d4b8d85264eb591321670b14dd62c => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:22:01.482976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0dec5-f27b-46d3-81f6-4b7c30e3cfd6 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:01.483419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0dec5-f27b-46d3-81f6-4b7c30e3cfd6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:01.483766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0dec5-f27b-46d3-81f6-4b7c30e3cfd6 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:01.485249 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 927/1834] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:22:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:22:01.495095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9be8c9-3299-4273-ac36-91c6966f5da6 admin admin] Authenticating service token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:22:01.498464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5e9be8c9-3299-4273-ac36-91c6966f5da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:01.608824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9be8c9-3299-4273-ac36-91c6966f5da6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:01.610695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5e9be8c9-3299-4273-ac36-91c6966f5da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:01.715638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9be8c9-3299-4273-ac36-91c6966f5da6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:01.723455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281b115-cadb-460b-91f9-09209f4d290c tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91732d221c874b1085b59ecc1e1a60ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d4dd82f48e04315abb577f300e0c4db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:01.724749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281b115-cadb-460b-91f9-09209f4d290c tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:01.724880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281b115-cadb-460b-91f9-09209f4d290c tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:01.725644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281b115-cadb-460b-91f9-09209f4d290c tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] PATH_INFO: `/v3/projects/7460b59c19294e8090ba35ceecdb8686` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:01.727184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281b115-cadb-460b-91f9-09209f4d290c tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] RBAC: Authorizing `identity:get_project(project_id=7460b59c19294e8090ba35ceecdb8686)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:01.731749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281b115-cadb-460b-91f9-09209f4d290c tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:01.734996 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 908/1835] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:22:01 2022] GET /identity/v3/projects/7460b59c19294e8090ba35ceecdb8686 => generated 393 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:01.814501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:02.330550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb3810-83d2-47a2-92c8-0565b1455f28 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:02.331020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb3810-83d2-47a2-92c8-0565b1455f28 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:02.331444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb3810-83d2-47a2-92c8-0565b1455f28 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:02.332959 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 928/1836] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:22:02.348320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281b115-cadb-460b-91f9-09209f4d290c tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Authenticating service token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:22:02.351039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8281b115-cadb-460b-91f9-09209f4d290c tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:02.391372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281b115-cadb-460b-91f9-09209f4d290c tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:02.410925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281b115-cadb-460b-91f9-09209f4d290c tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:02.421046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581253d-86d8-4123-b0bf-2ea833761dec tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91732d221c874b1085b59ecc1e1a60ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d4dd82f48e04315abb577f300e0c4db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:02.421706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581253d-86d8-4123-b0bf-2ea833761dec tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:02.421994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581253d-86d8-4123-b0bf-2ea833761dec tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:02.422566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581253d-86d8-4123-b0bf-2ea833761dec tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] PATH_INFO: `/v3/projects/66e9e7e2054d49ca88a72c1f0e14b9f8` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:02.424496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581253d-86d8-4123-b0bf-2ea833761dec tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] RBAC: Authorizing `identity:get_project(project_id=66e9e7e2054d49ca88a72c1f0e14b9f8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:02.426633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581253d-86d8-4123-b0bf-2ea833761dec tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:02.439416 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 909/1837] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:22:02 2022] GET /identity/v3/projects/66e9e7e2054d49ca88a72c1f0e14b9f8 => generated 395 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:02.471009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb3810-83d2-47a2-92c8-0565b1455f28 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:02.473040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c3bb3810-83d2-47a2-92c8-0565b1455f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:02.639445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb3810-83d2-47a2-92c8-0565b1455f28 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:02.662591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890f223-8399-4125-aa51-9035fcecca91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:02.665163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890f223-8399-4125-aa51-9035fcecca91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:02.665610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890f223-8399-4125-aa51-9035fcecca91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:02.666417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890f223-8399-4125-aa51-9035fcecca91 admin admin] PATH_INFO: `/v3/projects/a17f16c286a44f31b5c4ac8ae77b4f16` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:02.668602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890f223-8399-4125-aa51-9035fcecca91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a17f16c286a44f31b5c4ac8ae77b4f16)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:02.675137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890f223-8399-4125-aa51-9035fcecca91 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:02.864656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e890f223-8399-4125-aa51-9035fcecca91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a17f16c286a44f31b5c4ac8ae77b4f16', 'request_id': 'req-e890f223-8399-4125-aa51-9035fcecca91'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:02.881525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e890f223-8399-4125-aa51-9035fcecca91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a17f16c286a44f31b5c4ac8ae77b4f16', 'request_id': 'req-e890f223-8399-4125-aa51-9035fcecca91'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:02.888545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e890f223-8399-4125-aa51-9035fcecca91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a17f16c286a44f31b5c4ac8ae77b4f16', 'request_id': 'req-e890f223-8399-4125-aa51-9035fcecca91'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:02.987469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e890f223-8399-4125-aa51-9035fcecca91 admin admin] The token cache is being invalidate because project a17f16c286a44f31b5c4ac8ae77b4f16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:02.987836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e890f223-8399-4125-aa51-9035fcecca91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:02.989464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e890f223-8399-4125-aa51-9035fcecca91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:02.995810 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 929/1838] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:02 2022] DELETE /identity/v3/projects/a17f16c286a44f31b5c4ac8ae77b4f16 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:03.002026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5714e5-3629-479e-8539-7ef08f9092ee None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:03.002571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5714e5-3629-479e-8539-7ef08f9092ee None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:03.002856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5714e5-3629-479e-8539-7ef08f9092ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:03.037702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-3d5714e5-3629-479e-8539-7ef08f9092ee None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:03.045090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3d5714e5-3629-479e-8539-7ef08f9092ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:03.157162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890f223-8399-4125-aa51-9035fcecca91 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:03.158997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e890f223-8399-4125-aa51-9035fcecca91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:03.249037 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 910/1839] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:22:03.251881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10bebd-d066-4404-ba38-e51849971ea1 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:03.254007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10bebd-d066-4404-ba38-e51849971ea1 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:03.255954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10bebd-d066-4404-ba38-e51849971ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:03.292835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8a10bebd-d066-4404-ba38-e51849971ea1 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:03.294768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8a10bebd-d066-4404-ba38-e51849971ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:03.328190 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 911/1840] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:03.330732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10bebd-d066-4404-ba38-e51849971ea1 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:03.346276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10bebd-d066-4404-ba38-e51849971ea1 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:03.348763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:03.355962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97662c62-86b8-456e-beb4-b2fcb9ce324e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:03.358161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97662c62-86b8-456e-beb4-b2fcb9ce324e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:03.358682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97662c62-86b8-456e-beb4-b2fcb9ce324e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:03.359094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97662c62-86b8-456e-beb4-b2fcb9ce324e admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:03.359944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97662c62-86b8-456e-beb4-b2fcb9ce324e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:22:03.360456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97662c62-86b8-456e-beb4-b2fcb9ce324e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:03.362394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97662c62-86b8-456e-beb4-b2fcb9ce324e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:03.365280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890f223-8399-4125-aa51-9035fcecca91 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:03.383403 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 912/1841] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:03.385727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97662c62-86b8-456e-beb4-b2fcb9ce324e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:03.387692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1e5f9-b80b-446d-8dc1-94d4b013fe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:03.389510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1e5f9-b80b-446d-8dc1-94d4b013fe40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:03.389799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1e5f9-b80b-446d-8dc1-94d4b013fe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:03.390095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1e5f9-b80b-446d-8dc1-94d4b013fe40 admin admin] PATH_INFO: `/v3/users/2a3bb4b6469145d6951f8e2c8df97f75` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:03.397262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1e5f9-b80b-446d-8dc1-94d4b013fe40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a3bb4b6469145d6951f8e2c8df97f75)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:03.399103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97662c62-86b8-456e-beb4-b2fcb9ce324e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:03.399293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1e5f9-b80b-446d-8dc1-94d4b013fe40 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:03.405047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e52b8-ddc2-4422-abdf-915115b21727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:03.406675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e52b8-ddc2-4422-abdf-915115b21727 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:03.407163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e52b8-ddc2-4422-abdf-915115b21727 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:03.407581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e52b8-ddc2-4422-abdf-915115b21727 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:03.408521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e52b8-ddc2-4422-abdf-915115b21727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:03.417094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e52b8-ddc2-4422-abdf-915115b21727 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:03.580783 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 913/1842] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:22:03 2022] POST /identity/v3/projects => generated 375 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:03.582658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e52b8-ddc2-4422-abdf-915115b21727 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:03.708147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffb1e5f9-b80b-446d-8dc1-94d4b013fe40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a3bb4b6469145d6951f8e2c8df97f75'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:03.710091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffb1e5f9-b80b-446d-8dc1-94d4b013fe40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a3bb4b6469145d6951f8e2c8df97f75'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:03.743313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffb1e5f9-b80b-446d-8dc1-94d4b013fe40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a3bb4b6469145d6951f8e2c8df97f75'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:03.761382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e52b8-ddc2-4422-abdf-915115b21727 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:03.770532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f1c5c-edf7-4c24-b637-ff7d725d1bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:03.771172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f1c5c-edf7-4c24-b637-ff7d725d1bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:03.771458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f1c5c-edf7-4c24-b637-ff7d725d1bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:03.771744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f1c5c-edf7-4c24-b637-ff7d725d1bd8 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:03.772866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f1c5c-edf7-4c24-b637-ff7d725d1bd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:03.774766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f1c5c-edf7-4c24-b637-ff7d725d1bd8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:03.803203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffb1e5f9-b80b-446d-8dc1-94d4b013fe40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a3bb4b6469145d6951f8e2c8df97f75'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:03.804801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffb1e5f9-b80b-446d-8dc1-94d4b013fe40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a3bb4b6469145d6951f8e2c8df97f75'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:03.843224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:03.918996 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 914/1844] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:22:03 2022] POST /identity/v3/users => generated 288 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:03.922221 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 930/1844] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:22:03 2022] DELETE /identity/v3/users/2a3bb4b6469145d6951f8e2c8df97f75 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:22:03.923717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f1c5c-edf7-4c24-b637-ff7d725d1bd8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:03.924013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc37eb-185b-4a1c-bd8d-2df22656238b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:03.924414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc37eb-185b-4a1c-bd8d-2df22656238b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:03.925118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc37eb-185b-4a1c-bd8d-2df22656238b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:03.932763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bc8f1c5c-edf7-4c24-b637-ff7d725d1bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:04.013422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f1c5c-edf7-4c24-b637-ff7d725d1bd8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:04.014007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-5bfc37eb-185b-4a1c-bd8d-2df22656238b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:04.018717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5bfc37eb-185b-4a1c-bd8d-2df22656238b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:04.170885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb765f-7bd7-4786-a4aa-fb9eb883bc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:04.171525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb765f-7bd7-4786-a4aa-fb9eb883bc31 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:04.171808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb765f-7bd7-4786-a4aa-fb9eb883bc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:04.172119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb765f-7bd7-4786-a4aa-fb9eb883bc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:04.199102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb765f-7bd7-4786-a4aa-fb9eb883bc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:04.200959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb765f-7bd7-4786-a4aa-fb9eb883bc31 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:04.217067 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 915/1845] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:04.218394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb765f-7bd7-4786-a4aa-fb9eb883bc31 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:04.231905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb765f-7bd7-4786-a4aa-fb9eb883bc31 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:04.232621 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 931/1846] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:04.238451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85880161-bf8b-4ffb-8908-44d56c58975b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:04.239137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85880161-bf8b-4ffb-8908-44d56c58975b admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:04.239428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85880161-bf8b-4ffb-8908-44d56c58975b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:04.239704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85880161-bf8b-4ffb-8908-44d56c58975b admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:04.240367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85880161-bf8b-4ffb-8908-44d56c58975b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:04.242105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85880161-bf8b-4ffb-8908-44d56c58975b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:04.276385 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 916/1847] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:04.277636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc37eb-185b-4a1c-bd8d-2df22656238b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:04.298686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc37eb-185b-4a1c-bd8d-2df22656238b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:04.304830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85880161-bf8b-4ffb-8908-44d56c58975b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:04.307450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-85880161-bf8b-4ffb-8908-44d56c58975b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:04.313478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a074f3-bae4-42f8-a49f-1f4522d8136a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:04.314307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a074f3-bae4-42f8-a49f-1f4522d8136a admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:04.314782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a074f3-bae4-42f8-a49f-1f4522d8136a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:04.315062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a074f3-bae4-42f8-a49f-1f4522d8136a admin admin] PATH_INFO: `/v3/projects/dbd79d651c7a4d4e8b08ce61abc625a9/users/086704e619624c1d902eff30586b1544/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:04.332560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:04.358326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a074f3-bae4-42f8-a49f-1f4522d8136a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbd79d651c7a4d4e8b08ce61abc625a9, user_id=086704e619624c1d902eff30586b1544, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:04.365014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a074f3-bae4-42f8-a49f-1f4522d8136a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:04.446790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85880161-bf8b-4ffb-8908-44d56c58975b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:04.472999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc8b0c-5e9e-4aa4-be01-3d9eb0044257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:04.475653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc8b0c-5e9e-4aa4-be01-3d9eb0044257 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:04.475942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc8b0c-5e9e-4aa4-be01-3d9eb0044257 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:04.476220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc8b0c-5e9e-4aa4-be01-3d9eb0044257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:04.504851 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 932/1848] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:04 2022] PUT /identity/v3/projects/dbd79d651c7a4d4e8b08ce61abc625a9/users/086704e619624c1d902eff30586b1544/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:04.506638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fd049-ebc6-4935-9e0a-946f8d20b872 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:04.506934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fd049-ebc6-4935-9e0a-946f8d20b872 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:04.507212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fd049-ebc6-4935-9e0a-946f8d20b872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:04.524182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc8b0c-5e9e-4aa4-be01-3d9eb0044257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:04.530093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc8b0c-5e9e-4aa4-be01-3d9eb0044257 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:04.549065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-614fd049-ebc6-4935-9e0a-946f8d20b872 None None] MFA Rules not processed for user `086704e619624c1d902eff30586b1544`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:04.550922 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 917/1849] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:22:04.551068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-614fd049-ebc6-4935-9e0a-946f8d20b872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:04.660397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc8b0c-5e9e-4aa4-be01-3d9eb0044257 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:04.661051 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 933/1850] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:04.678088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc8b0c-5e9e-4aa4-be01-3d9eb0044257 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:04.715283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da95d7d-d89f-48ca-8e7b-623a56bfb343 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:04.715573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da95d7d-d89f-48ca-8e7b-623a56bfb343 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:04.716178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da95d7d-d89f-48ca-8e7b-623a56bfb343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:04.777069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8da95d7d-d89f-48ca-8e7b-623a56bfb343 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:04.777459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8da95d7d-d89f-48ca-8e7b-623a56bfb343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:04.871125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c41f6e-6e08-4ea1-ba6f-987f08018001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:04.873401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c41f6e-6e08-4ea1-ba6f-987f08018001 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:04.873900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c41f6e-6e08-4ea1-ba6f-987f08018001 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:04.874403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c41f6e-6e08-4ea1-ba6f-987f08018001 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:04.875275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c41f6e-6e08-4ea1-ba6f-987f08018001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:04.884315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c41f6e-6e08-4ea1-ba6f-987f08018001 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:04.911044 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 934/1851] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:22:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:22:04.963705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da95d7d-d89f-48ca-8e7b-623a56bfb343 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:04.965428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8da95d7d-d89f-48ca-8e7b-623a56bfb343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:04.997234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:05.032280 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 918/1852] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:22:04 2022] POST /identity/v3/projects => generated 375 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:22:05.036991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c41f6e-6e08-4ea1-ba6f-987f08018001 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:05.158843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da95d7d-d89f-48ca-8e7b-623a56bfb343 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:05.172489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c41f6e-6e08-4ea1-ba6f-987f08018001 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:05.192478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246934ca-3e32-411a-a6d4-3a7346f2c1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:05.192664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246934ca-3e32-411a-a6d4-3a7346f2c1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:05.192961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246934ca-3e32-411a-a6d4-3a7346f2c1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:05.193219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246934ca-3e32-411a-a6d4-3a7346f2c1f9 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:05.193871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246934ca-3e32-411a-a6d4-3a7346f2c1f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:05.210527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246934ca-3e32-411a-a6d4-3a7346f2c1f9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:05.268522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3c783-3ad8-423d-96fe-cc00015a01c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:05.269576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3c783-3ad8-423d-96fe-cc00015a01c4 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:05.269917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3c783-3ad8-423d-96fe-cc00015a01c4 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:05.270333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3c783-3ad8-423d-96fe-cc00015a01c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:05.343452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3c783-3ad8-423d-96fe-cc00015a01c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:05.345000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3c783-3ad8-423d-96fe-cc00015a01c4 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:05.358502 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 935/1853] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:22:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 03:22:05.377766 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 919/1854] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:22:05 2022] POST /identity/v3/users => generated 294 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:05.381729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3c783-3ad8-423d-96fe-cc00015a01c4 service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:05.416615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3c783-3ad8-423d-96fe-cc00015a01c4 service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:05.433807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466a96a-f3d2-48d8-b64b-adcb410e264d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:05.434483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466a96a-f3d2-48d8-b64b-adcb410e264d admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:05.440669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466a96a-f3d2-48d8-b64b-adcb410e264d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:05.441030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466a96a-f3d2-48d8-b64b-adcb410e264d admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:05.441906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466a96a-f3d2-48d8-b64b-adcb410e264d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:05.444174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466a96a-f3d2-48d8-b64b-adcb410e264d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:05.459276 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 936/1855] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:22:05.463800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246934ca-3e32-411a-a6d4-3a7346f2c1f9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:05.479503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246934ca-3e32-411a-a6d4-3a7346f2c1f9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:05.492887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76011742-7e2f-485c-a5f3-9f4869eef68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:05.496080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76011742-7e2f-485c-a5f3-9f4869eef68e admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:05.496080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76011742-7e2f-485c-a5f3-9f4869eef68e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:05.496080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76011742-7e2f-485c-a5f3-9f4869eef68e admin admin] PATH_INFO: `/v3/projects/5b10b7b9a9604ee6a0775f0456c97553/users/60e0ca1294564879a98f05a54f921b01/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:05.525840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76011742-7e2f-485c-a5f3-9f4869eef68e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b10b7b9a9604ee6a0775f0456c97553, user_id=60e0ca1294564879a98f05a54f921b01, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:05.529602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76011742-7e2f-485c-a5f3-9f4869eef68e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:05.613533 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 920/1856] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:05 2022] PUT /identity/v3/projects/5b10b7b9a9604ee6a0775f0456c97553/users/60e0ca1294564879a98f05a54f921b01/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:05.615268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466a96a-f3d2-48d8-b64b-adcb410e264d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:05.633649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466a96a-f3d2-48d8-b64b-adcb410e264d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:05.778629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497338c1-a3df-4bde-bb34-691d672cab4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:05.780465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497338c1-a3df-4bde-bb34-691d672cab4f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:05.780753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497338c1-a3df-4bde-bb34-691d672cab4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:05.786611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497338c1-a3df-4bde-bb34-691d672cab4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:05.787414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497338c1-a3df-4bde-bb34-691d672cab4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:05.789445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497338c1-a3df-4bde-bb34-691d672cab4f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:05.837496 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 937/1857] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:05.838000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76011742-7e2f-485c-a5f3-9f4869eef68e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:05.857406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76011742-7e2f-485c-a5f3-9f4869eef68e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:05.883810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec24ba6-8b60-4f5e-aa45-3fbf2e970314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:05.884568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec24ba6-8b60-4f5e-aa45-3fbf2e970314 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:05.884785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec24ba6-8b60-4f5e-aa45-3fbf2e970314 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:05.885044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec24ba6-8b60-4f5e-aa45-3fbf2e970314 admin admin] PATH_INFO: `/v3/projects/5b10b7b9a9604ee6a0775f0456c97553/users/60e0ca1294564879a98f05a54f921b01/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:05.887530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec24ba6-8b60-4f5e-aa45-3fbf2e970314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b10b7b9a9604ee6a0775f0456c97553, user_id=60e0ca1294564879a98f05a54f921b01, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:05.891396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec24ba6-8b60-4f5e-aa45-3fbf2e970314 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:05.930064 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 921/1858] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:05 2022] PUT /identity/v3/projects/5b10b7b9a9604ee6a0775f0456c97553/users/60e0ca1294564879a98f05a54f921b01/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:05.941334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e62aa-a218-421e-bcec-8452b4befeb2 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:05.941624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e62aa-a218-421e-bcec-8452b4befeb2 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:05.941895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e62aa-a218-421e-bcec-8452b4befeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:05.998147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:06.096089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-325e62aa-a218-421e-bcec-8452b4befeb2 None None] MFA Rules not processed for user `60e0ca1294564879a98f05a54f921b01`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:06.101497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-325e62aa-a218-421e-bcec-8452b4befeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:06.310144 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 938/1859] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:06.517331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec24ba6-8b60-4f5e-aa45-3fbf2e970314 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:06.519153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dec24ba6-8b60-4f5e-aa45-3fbf2e970314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:06.645075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e62aa-a218-421e-bcec-8452b4befeb2 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:06.647213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-325e62aa-a218-421e-bcec-8452b4befeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:06.788682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e62aa-a218-421e-bcec-8452b4befeb2 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:06.807763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cc63a-52ad-466b-b5cc-4183e7fee483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:06.808723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cc63a-52ad-466b-b5cc-4183e7fee483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:06.809411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cc63a-52ad-466b-b5cc-4183e7fee483 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:06.811401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cc63a-52ad-466b-b5cc-4183e7fee483 admin admin] PATH_INFO: `/v3/projects/7460b59c19294e8090ba35ceecdb8686` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:06.814376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65cc63a-52ad-466b-b5cc-4183e7fee483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7460b59c19294e8090ba35ceecdb8686)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:06.817809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65cc63a-52ad-466b-b5cc-4183e7fee483 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:06.891396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec24ba6-8b60-4f5e-aa45-3fbf2e970314 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:06.906756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:06.916681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147f7fd-4b8a-4de6-9c1d-7a3c0fef6405 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:06.917324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147f7fd-4b8a-4de6-9c1d-7a3c0fef6405 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:06.917932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147f7fd-4b8a-4de6-9c1d-7a3c0fef6405 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:06.917932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147f7fd-4b8a-4de6-9c1d-7a3c0fef6405 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:06.966434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147f7fd-4b8a-4de6-9c1d-7a3c0fef6405 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:06.975799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147f7fd-4b8a-4de6-9c1d-7a3c0fef6405 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:06.999875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f65cc63a-52ad-466b-b5cc-4183e7fee483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7460b59c19294e8090ba35ceecdb8686', 'request_id': 'req-f65cc63a-52ad-466b-b5cc-4183e7fee483'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:07.011700 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 922/1860] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:22:07.022948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f65cc63a-52ad-466b-b5cc-4183e7fee483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7460b59c19294e8090ba35ceecdb8686', 'request_id': 'req-f65cc63a-52ad-466b-b5cc-4183e7fee483'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:07.043220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f65cc63a-52ad-466b-b5cc-4183e7fee483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7460b59c19294e8090ba35ceecdb8686', 'request_id': 'req-f65cc63a-52ad-466b-b5cc-4183e7fee483'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:07.159615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f65cc63a-52ad-466b-b5cc-4183e7fee483 admin admin] The token cache is being invalidate because project 7460b59c19294e8090ba35ceecdb8686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:07.160170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f65cc63a-52ad-466b-b5cc-4183e7fee483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:07.161306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f65cc63a-52ad-466b-b5cc-4183e7fee483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:07.168320 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 939/1861] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:06 2022] DELETE /identity/v3/projects/7460b59c19294e8090ba35ceecdb8686 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:07.168547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147f7fd-4b8a-4de6-9c1d-7a3c0fef6405 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:07.204271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147f7fd-4b8a-4de6-9c1d-7a3c0fef6405 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:07.245747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cc63a-52ad-466b-b5cc-4183e7fee483 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:07.247416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f65cc63a-52ad-466b-b5cc-4183e7fee483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:07.417838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cc63a-52ad-466b-b5cc-4183e7fee483 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:07.434563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f57c59-ad80-4dcb-86b2-c01f84d8679d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:07.435916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f57c59-ad80-4dcb-86b2-c01f84d8679d service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:07.436271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f57c59-ad80-4dcb-86b2-c01f84d8679d service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:07.436751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f57c59-ad80-4dcb-86b2-c01f84d8679d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:07.441105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a2f57c59-ad80-4dcb-86b2-c01f84d8679d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:07.538876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06151127-e9c3-41f1-a9c7-9f0ce39d3a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:07.541382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06151127-e9c3-41f1-a9c7-9f0ce39d3a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:07.541735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06151127-e9c3-41f1-a9c7-9f0ce39d3a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:07.541953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06151127-e9c3-41f1-a9c7-9f0ce39d3a2c admin admin] PATH_INFO: `/v3/users/91732d221c874b1085b59ecc1e1a60ee` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:07.552445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06151127-e9c3-41f1-a9c7-9f0ce39d3a2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=91732d221c874b1085b59ecc1e1a60ee)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:07.552445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06151127-e9c3-41f1-a9c7-9f0ce39d3a2c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:07.590484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f57c59-ad80-4dcb-86b2-c01f84d8679d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:07.592166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f57c59-ad80-4dcb-86b2-c01f84d8679d service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:07.615874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:07.626283 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 940/1862] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:22:07.926219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-06151127-e9c3-41f1-a9c7-9f0ce39d3a2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91732d221c874b1085b59ecc1e1a60ee'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:07.926219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-06151127-e9c3-41f1-a9c7-9f0ce39d3a2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91732d221c874b1085b59ecc1e1a60ee'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:07.941695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-06151127-e9c3-41f1-a9c7-9f0ce39d3a2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91732d221c874b1085b59ecc1e1a60ee'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:07.970988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-06151127-e9c3-41f1-a9c7-9f0ce39d3a2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91732d221c874b1085b59ecc1e1a60ee'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:08.063793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-06151127-e9c3-41f1-a9c7-9f0ce39d3a2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91732d221c874b1085b59ecc1e1a60ee'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:08.075566 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 923/1863] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:22:07 2022] DELETE /identity/v3/users/91732d221c874b1085b59ecc1e1a60ee => generated 0 bytes in 904 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:22:09.009443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f57c59-ad80-4dcb-86b2-c01f84d8679d service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:09.010966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a2f57c59-ad80-4dcb-86b2-c01f84d8679d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:09.033964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f57c59-ad80-4dcb-86b2-c01f84d8679d service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:09.152200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3816286-d3d1-4285-a49f-4eeb0915d773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:09.153078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3816286-d3d1-4285-a49f-4eeb0915d773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:09.153596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3816286-d3d1-4285-a49f-4eeb0915d773 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:09.154506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3816286-d3d1-4285-a49f-4eeb0915d773 admin admin] PATH_INFO: `/v3/projects/3d4dd82f48e04315abb577f300e0c4db` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:09.156277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3816286-d3d1-4285-a49f-4eeb0915d773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d4dd82f48e04315abb577f300e0c4db)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:09.159295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3816286-d3d1-4285-a49f-4eeb0915d773 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:09.431803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f3816286-d3d1-4285-a49f-4eeb0915d773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d4dd82f48e04315abb577f300e0c4db', 'request_id': 'req-f3816286-d3d1-4285-a49f-4eeb0915d773'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:09.439015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f3816286-d3d1-4285-a49f-4eeb0915d773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d4dd82f48e04315abb577f300e0c4db', 'request_id': 'req-f3816286-d3d1-4285-a49f-4eeb0915d773'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:09.461241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f3816286-d3d1-4285-a49f-4eeb0915d773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d4dd82f48e04315abb577f300e0c4db', 'request_id': 'req-f3816286-d3d1-4285-a49f-4eeb0915d773'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:09.604493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:09.610388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f3816286-d3d1-4285-a49f-4eeb0915d773 admin admin] The token cache is being invalidate because project 3d4dd82f48e04315abb577f300e0c4db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:09.610690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f3816286-d3d1-4285-a49f-4eeb0915d773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:09.611389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f3816286-d3d1-4285-a49f-4eeb0915d773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:09.612959 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 941/1864] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:09 2022] DELETE /identity/v3/projects/3d4dd82f48e04315abb577f300e0c4db => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:09.617337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06151127-e9c3-41f1-a9c7-9f0ce39d3a2c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:09.618957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-06151127-e9c3-41f1-a9c7-9f0ce39d3a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:09.644643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06151127-e9c3-41f1-a9c7-9f0ce39d3a2c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:09.659659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3816286-d3d1-4285-a49f-4eeb0915d773 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:09.661278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f3816286-d3d1-4285-a49f-4eeb0915d773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:09.832749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b1c31-53c4-4c87-9c26-3a98028a89de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:09.834261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b1c31-53c4-4c87-9c26-3a98028a89de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:09.834712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b1c31-53c4-4c87-9c26-3a98028a89de admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:09.835137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b1c31-53c4-4c87-9c26-3a98028a89de admin admin] PATH_INFO: `/v3/users/df4ccd7138c446ae978634ebe91ac281` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:09.836828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b1c31-53c4-4c87-9c26-3a98028a89de admin admin] RBAC: Authorizing `identity:delete_user(user_id=df4ccd7138c446ae978634ebe91ac281)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:09.846821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b1c31-53c4-4c87-9c26-3a98028a89de admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:09.851125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3816286-d3d1-4285-a49f-4eeb0915d773 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:09.868660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e915f9-fbe2-4a61-972c-bf798aef7828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:09.869681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e915f9-fbe2-4a61-972c-bf798aef7828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:09.870329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e915f9-fbe2-4a61-972c-bf798aef7828 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:09.870759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e915f9-fbe2-4a61-972c-bf798aef7828 admin admin] PATH_INFO: `/v3/users/086704e619624c1d902eff30586b1544` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:09.872870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e915f9-fbe2-4a61-972c-bf798aef7828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=086704e619624c1d902eff30586b1544)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:09.875059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e915f9-fbe2-4a61-972c-bf798aef7828 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:10.096471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:10.118669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a8e915f9-fbe2-4a61-972c-bf798aef7828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '086704e619624c1d902eff30586b1544'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:10.123556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a8e915f9-fbe2-4a61-972c-bf798aef7828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '086704e619624c1d902eff30586b1544'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:10.134057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-248b1c31-53c4-4c87-9c26-3a98028a89de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df4ccd7138c446ae978634ebe91ac281'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:10.137776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-248b1c31-53c4-4c87-9c26-3a98028a89de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df4ccd7138c446ae978634ebe91ac281'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:10.151661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a8e915f9-fbe2-4a61-972c-bf798aef7828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '086704e619624c1d902eff30586b1544'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:10.163267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-248b1c31-53c4-4c87-9c26-3a98028a89de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df4ccd7138c446ae978634ebe91ac281'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:10.183861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a8e915f9-fbe2-4a61-972c-bf798aef7828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '086704e619624c1d902eff30586b1544'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:10.185608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a8e915f9-fbe2-4a61-972c-bf798aef7828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '086704e619624c1d902eff30586b1544'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:10.194270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-248b1c31-53c4-4c87-9c26-3a98028a89de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df4ccd7138c446ae978634ebe91ac281'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:10.302845 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 942/1865] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:22:09 2022] DELETE /identity/v3/users/086704e619624c1d902eff30586b1544 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:10.307434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bd0c1-1f66-4406-b66d-af309b1ecb58 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:10.307799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bd0c1-1f66-4406-b66d-af309b1ecb58 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:10.308185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bd0c1-1f66-4406-b66d-af309b1ecb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:10.350452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e09bd0c1-1f66-4406-b66d-af309b1ecb58 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:10.352579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-248b1c31-53c4-4c87-9c26-3a98028a89de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df4ccd7138c446ae978634ebe91ac281'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:10.355560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e09bd0c1-1f66-4406-b66d-af309b1ecb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:10.360546 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 924/1866] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:22:09 2022] DELETE /identity/v3/users/df4ccd7138c446ae978634ebe91ac281 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:22:10.498106 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 943/1867] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:22:10.545183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b1c31-53c4-4c87-9c26-3a98028a89de admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:10.555498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-248b1c31-53c4-4c87-9c26-3a98028a89de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:10.725914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b1c31-53c4-4c87-9c26-3a98028a89de admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:10.736746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f8495-3cea-4bd3-b3cf-7b7ac09090af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:10.745501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f8495-3cea-4bd3-b3cf-7b7ac09090af service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:10.745501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f8495-3cea-4bd3-b3cf-7b7ac09090af service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:10.745501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f8495-3cea-4bd3-b3cf-7b7ac09090af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:10.762747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f8495-3cea-4bd3-b3cf-7b7ac09090af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:10.765840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f8495-3cea-4bd3-b3cf-7b7ac09090af service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:10.782411 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 925/1868] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:22:10.843381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:11.105586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:11.545956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bd0c1-1f66-4406-b66d-af309b1ecb58 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:11.547836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e09bd0c1-1f66-4406-b66d-af309b1ecb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:11.564915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bd0c1-1f66-4406-b66d-af309b1ecb58 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:11.579900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01525e9c-5868-4fda-a085-a6f35f3a462f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:11.582233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01525e9c-5868-4fda-a085-a6f35f3a462f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:11.584603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01525e9c-5868-4fda-a085-a6f35f3a462f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:11.585142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01525e9c-5868-4fda-a085-a6f35f3a462f admin admin] PATH_INFO: `/v3/projects/66e9e7e2054d49ca88a72c1f0e14b9f8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:11.607471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01525e9c-5868-4fda-a085-a6f35f3a462f admin admin] RBAC: Authorizing `identity:delete_project(project_id=66e9e7e2054d49ca88a72c1f0e14b9f8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:11.626350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01525e9c-5868-4fda-a085-a6f35f3a462f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:11.835228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-01525e9c-5868-4fda-a085-a6f35f3a462f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66e9e7e2054d49ca88a72c1f0e14b9f8', 'request_id': 'req-01525e9c-5868-4fda-a085-a6f35f3a462f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:11.867595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-01525e9c-5868-4fda-a085-a6f35f3a462f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66e9e7e2054d49ca88a72c1f0e14b9f8', 'request_id': 'req-01525e9c-5868-4fda-a085-a6f35f3a462f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:11.898116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-01525e9c-5868-4fda-a085-a6f35f3a462f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66e9e7e2054d49ca88a72c1f0e14b9f8', 'request_id': 'req-01525e9c-5868-4fda-a085-a6f35f3a462f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:12.012529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-01525e9c-5868-4fda-a085-a6f35f3a462f admin admin] The token cache is being invalidate because project 66e9e7e2054d49ca88a72c1f0e14b9f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:12.017044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-01525e9c-5868-4fda-a085-a6f35f3a462f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:12.018404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-01525e9c-5868-4fda-a085-a6f35f3a462f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:12.020969 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 944/1869] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:11 2022] DELETE /identity/v3/projects/66e9e7e2054d49ca88a72c1f0e14b9f8 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:12.027309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567fa54-c125-4dc0-b9c8-eef4546f75db None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:12.032844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567fa54-c125-4dc0-b9c8-eef4546f75db None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:12.032844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567fa54-c125-4dc0-b9c8-eef4546f75db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:12.088802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-2567fa54-c125-4dc0-b9c8-eef4546f75db None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:12.091338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2567fa54-c125-4dc0-b9c8-eef4546f75db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:12.276688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:12.335795 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 926/1870] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:12.339361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d3a60-13c0-4d73-bf86-aaeacfe09ec9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:12.339764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d3a60-13c0-4d73-bf86-aaeacfe09ec9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:12.340180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d3a60-13c0-4d73-bf86-aaeacfe09ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:12.385633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-002d3a60-13c0-4d73-bf86-aaeacfe09ec9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:12.389247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-002d3a60-13c0-4d73-bf86-aaeacfe09ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:12.414263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:12.421837 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 945/1871] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:22:12.425514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567fa54-c125-4dc0-b9c8-eef4546f75db None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:12.447493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567fa54-c125-4dc0-b9c8-eef4546f75db None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:12.463118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb95aa6-a1b8-4397-adca-b09190c03ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:12.464178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb95aa6-a1b8-4397-adca-b09190c03ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:12.464611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb95aa6-a1b8-4397-adca-b09190c03ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:12.465393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb95aa6-a1b8-4397-adca-b09190c03ca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:12.467286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb95aa6-a1b8-4397-adca-b09190c03ca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:22:12.467916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb95aa6-a1b8-4397-adca-b09190c03ca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:12.469966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb95aa6-a1b8-4397-adca-b09190c03ca4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:12.519340 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 927/1872] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:12.524203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d3a60-13c0-4d73-bf86-aaeacfe09ec9 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:12.542413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d3a60-13c0-4d73-bf86-aaeacfe09ec9 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:12.552776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745dc4d9-279e-4c37-9f7e-c6a2d664c767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:12.553731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745dc4d9-279e-4c37-9f7e-c6a2d664c767 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:12.554282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745dc4d9-279e-4c37-9f7e-c6a2d664c767 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:12.556198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745dc4d9-279e-4c37-9f7e-c6a2d664c767 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:12.557416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745dc4d9-279e-4c37-9f7e-c6a2d664c767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:12.581973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745dc4d9-279e-4c37-9f7e-c6a2d664c767 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:12.709927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb95aa6-a1b8-4397-adca-b09190c03ca4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:12.711801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2eb95aa6-a1b8-4397-adca-b09190c03ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:12.736267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb95aa6-a1b8-4397-adca-b09190c03ca4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:12.739015 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 946/1873] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:22:12 2022] POST /identity/v3/projects => generated 383 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:22:12.744069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745dc4d9-279e-4c37-9f7e-c6a2d664c767 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:12.937316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac15e2e-a748-42d4-833b-a0c3b17def25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:12.937980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac15e2e-a748-42d4-833b-a0c3b17def25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:12.944433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac15e2e-a748-42d4-833b-a0c3b17def25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:12.945054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac15e2e-a748-42d4-833b-a0c3b17def25 admin admin] PATH_INFO: `/v3/projects/dbd79d651c7a4d4e8b08ce61abc625a9` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:12.947381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac15e2e-a748-42d4-833b-a0c3b17def25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbd79d651c7a4d4e8b08ce61abc625a9)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:12.956784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac15e2e-a748-42d4-833b-a0c3b17def25 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:13.004839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745dc4d9-279e-4c37-9f7e-c6a2d664c767 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:13.033885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccfb3d-eea3-4748-9a0b-0a5f22c17fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:13.034598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccfb3d-eea3-4748-9a0b-0a5f22c17fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:13.034934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccfb3d-eea3-4748-9a0b-0a5f22c17fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:13.035385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccfb3d-eea3-4748-9a0b-0a5f22c17fc6 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:13.036255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccfb3d-eea3-4748-9a0b-0a5f22c17fc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:13.059387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccfb3d-eea3-4748-9a0b-0a5f22c17fc6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:13.213133 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 947/1874] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:22:12 2022] POST /identity/v3/users => generated 292 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:13.216929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccfb3d-eea3-4748-9a0b-0a5f22c17fc6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:13.234423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccfb3d-eea3-4748-9a0b-0a5f22c17fc6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:13.303969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6ac15e2e-a748-42d4-833b-a0c3b17def25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbd79d651c7a4d4e8b08ce61abc625a9', 'request_id': 'req-6ac15e2e-a748-42d4-833b-a0c3b17def25'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:13.367640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555d883-7352-43e0-8dbe-361a71cbbf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:13.368521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555d883-7352-43e0-8dbe-361a71cbbf31 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:13.368884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555d883-7352-43e0-8dbe-361a71cbbf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:13.371689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555d883-7352-43e0-8dbe-361a71cbbf31 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:13.371689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555d883-7352-43e0-8dbe-361a71cbbf31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:13.373111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555d883-7352-43e0-8dbe-361a71cbbf31 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:13.399334 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 948/1875] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:13.401822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6ac15e2e-a748-42d4-833b-a0c3b17def25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbd79d651c7a4d4e8b08ce61abc625a9', 'request_id': 'req-6ac15e2e-a748-42d4-833b-a0c3b17def25'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:13.402346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:13.405501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555d883-7352-43e0-8dbe-361a71cbbf31 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:13.413962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6ac15e2e-a748-42d4-833b-a0c3b17def25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbd79d651c7a4d4e8b08ce61abc625a9', 'request_id': 'req-6ac15e2e-a748-42d4-833b-a0c3b17def25'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:13.429499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555d883-7352-43e0-8dbe-361a71cbbf31 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:13.442583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563909d2-5f77-4f71-8d0c-72a17bcd7a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:13.445124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563909d2-5f77-4f71-8d0c-72a17bcd7a28 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:13.446220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563909d2-5f77-4f71-8d0c-72a17bcd7a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:13.446665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563909d2-5f77-4f71-8d0c-72a17bcd7a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:13.447491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563909d2-5f77-4f71-8d0c-72a17bcd7a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:13.451377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6ac15e2e-a748-42d4-833b-a0c3b17def25 admin admin] The token cache is being invalidate because project dbd79d651c7a4d4e8b08ce61abc625a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:13.451677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6ac15e2e-a748-42d4-833b-a0c3b17def25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:13.453534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563909d2-5f77-4f71-8d0c-72a17bcd7a28 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:13.457487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6ac15e2e-a748-42d4-833b-a0c3b17def25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:13.463489 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 928/1876] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:12 2022] DELETE /identity/v3/projects/dbd79d651c7a4d4e8b08ce61abc625a9 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:13.470835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac15e2e-a748-42d4-833b-a0c3b17def25 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:13.477185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6ac15e2e-a748-42d4-833b-a0c3b17def25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:13.478061 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 949/1877] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:13.483481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563909d2-5f77-4f71-8d0c-72a17bcd7a28 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:13.486920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-563909d2-5f77-4f71-8d0c-72a17bcd7a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:13.518567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:13.524783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac15e2e-a748-42d4-833b-a0c3b17def25 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:13.541458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563909d2-5f77-4f71-8d0c-72a17bcd7a28 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:13.549647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98e6ad-010c-454c-8e0c-a9720d559e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:13.550515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98e6ad-010c-454c-8e0c-a9720d559e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:13.550946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98e6ad-010c-454c-8e0c-a9720d559e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:13.551061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98e6ad-010c-454c-8e0c-a9720d559e7e admin admin] PATH_INFO: `/v3/users/60e0ca1294564879a98f05a54f921b01` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:13.556333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98e6ad-010c-454c-8e0c-a9720d559e7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=60e0ca1294564879a98f05a54f921b01)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:13.565825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc480c-8984-4751-a126-a8fcd1044a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:13.567986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98e6ad-010c-454c-8e0c-a9720d559e7e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:13.571117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc480c-8984-4751-a126-a8fcd1044a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:13.571496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc480c-8984-4751-a126-a8fcd1044a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:13.571787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc480c-8984-4751-a126-a8fcd1044a67 admin admin] PATH_INFO: `/v3/projects/93bce96b30214389a2b09a65f8f2c630/users/b2c5ab07251d4db9ac793361c6cff824/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:13.633153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc480c-8984-4751-a126-a8fcd1044a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93bce96b30214389a2b09a65f8f2c630, user_id=b2c5ab07251d4db9ac793361c6cff824, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:13.643596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc480c-8984-4751-a126-a8fcd1044a67 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:13.745385 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 950/1878] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:13 2022] PUT /identity/v3/projects/93bce96b30214389a2b09a65f8f2c630/users/b2c5ab07251d4db9ac793361c6cff824/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:22:13.761384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a9a7d-d872-4263-abbb-3ad535048a0a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:13.761701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a9a7d-d872-4263-abbb-3ad535048a0a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:13.761977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a9a7d-d872-4263-abbb-3ad535048a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:13.831397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6d0a9a7d-d872-4263-abbb-3ad535048a0a None None] MFA Rules not processed for user `b2c5ab07251d4db9ac793361c6cff824`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:13.832954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6d0a9a7d-d872-4263-abbb-3ad535048a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:13.986962 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 951/1879] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:22:13.991590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a9a7d-d872-4263-abbb-3ad535048a0a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:13.999496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ba98e6ad-010c-454c-8e0c-a9720d559e7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60e0ca1294564879a98f05a54f921b01'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:14.002721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ba98e6ad-010c-454c-8e0c-a9720d559e7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60e0ca1294564879a98f05a54f921b01'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:14.026349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ba98e6ad-010c-454c-8e0c-a9720d559e7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60e0ca1294564879a98f05a54f921b01'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:14.067876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:14.083992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ba98e6ad-010c-454c-8e0c-a9720d559e7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60e0ca1294564879a98f05a54f921b01'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:14.089975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:14.153042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a9a7d-d872-4263-abbb-3ad535048a0a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:14.163924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae22524-db96-4a9a-bf98-ecc386971c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:14.164811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae22524-db96-4a9a-bf98-ecc386971c40 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:14.165266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae22524-db96-4a9a-bf98-ecc386971c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:14.165685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae22524-db96-4a9a-bf98-ecc386971c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:14.166582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae22524-db96-4a9a-bf98-ecc386971c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:14.168684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae22524-db96-4a9a-bf98-ecc386971c40 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:14.189145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ba98e6ad-010c-454c-8e0c-a9720d559e7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60e0ca1294564879a98f05a54f921b01'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:14.196583 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 929/1880] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:22:13 2022] DELETE /identity/v3/users/60e0ca1294564879a98f05a54f921b01 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:14.303905 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 952/1881] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:22:13 2022] POST /identity/v3/projects => generated 385 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:22:14.308003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98e6ad-010c-454c-8e0c-a9720d559e7e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:14.310279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ba98e6ad-010c-454c-8e0c-a9720d559e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:14.398255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:14.456270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:14.526154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98e6ad-010c-454c-8e0c-a9720d559e7e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:14.738631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168be6ef-659f-412d-b56f-37b1006ca47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:14.739279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168be6ef-659f-412d-b56f-37b1006ca47a admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:14.739570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168be6ef-659f-412d-b56f-37b1006ca47a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:14.739853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168be6ef-659f-412d-b56f-37b1006ca47a admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:14.740619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168be6ef-659f-412d-b56f-37b1006ca47a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:14.755348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168be6ef-659f-412d-b56f-37b1006ca47a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:14.769876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:14.905738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:15.134953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae22524-db96-4a9a-bf98-ecc386971c40 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:15.136777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-aae22524-db96-4a9a-bf98-ecc386971c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:15.159192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae22524-db96-4a9a-bf98-ecc386971c40 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:15.166378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6828d8-6dd0-43fa-8929-d6c7c69db480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:15.167374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6828d8-6dd0-43fa-8929-d6c7c69db480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:15.167851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6828d8-6dd0-43fa-8929-d6c7c69db480 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:15.168312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6828d8-6dd0-43fa-8929-d6c7c69db480 admin admin] PATH_INFO: `/v3/users/ae3d2208faeb4421af21da56d455be92` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:15.170600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6828d8-6dd0-43fa-8929-d6c7c69db480 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae3d2208faeb4421af21da56d455be92)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:15.177033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6828d8-6dd0-43fa-8929-d6c7c69db480 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:15.334579 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 930/1882] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:22:14 2022] POST /identity/v3/users => generated 299 bytes in 1024 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:15.336880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168be6ef-659f-412d-b56f-37b1006ca47a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:15.363882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168be6ef-659f-412d-b56f-37b1006ca47a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:15.382802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719442c0-2655-49d6-983b-06db5506f1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:15.383479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719442c0-2655-49d6-983b-06db5506f1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:15.383761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719442c0-2655-49d6-983b-06db5506f1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:15.384036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719442c0-2655-49d6-983b-06db5506f1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:15.385496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719442c0-2655-49d6-983b-06db5506f1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:15.387497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719442c0-2655-49d6-983b-06db5506f1e2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:15.413176 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 931/1883] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:15.417874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719442c0-2655-49d6-983b-06db5506f1e2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:15.446019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719442c0-2655-49d6-983b-06db5506f1e2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:15.458580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cb2f9-aa8e-4091-b1ae-decac53b01ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:15.461950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cb2f9-aa8e-4091-b1ae-decac53b01ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:15.461950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cb2f9-aa8e-4091-b1ae-decac53b01ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:15.461950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cb2f9-aa8e-4091-b1ae-decac53b01ac admin admin] PATH_INFO: `/v3/projects/bb469948d9164e07b25c381715f3aaf9/users/c9bfe594b39647dab00996c90b18df52/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:15.524326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45cb2f9-aa8e-4091-b1ae-decac53b01ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb469948d9164e07b25c381715f3aaf9, user_id=c9bfe594b39647dab00996c90b18df52, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:15.531021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45cb2f9-aa8e-4091-b1ae-decac53b01ac admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:15.635656 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 932/1884] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:15 2022] PUT /identity/v3/projects/bb469948d9164e07b25c381715f3aaf9/users/c9bfe594b39647dab00996c90b18df52/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:22:15.640249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cb2f9-aa8e-4091-b1ae-decac53b01ac admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:15.661309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4f6828d8-6dd0-43fa-8929-d6c7c69db480 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae3d2208faeb4421af21da56d455be92'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:15.663838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4f6828d8-6dd0-43fa-8929-d6c7c69db480 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae3d2208faeb4421af21da56d455be92'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:15.695078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4f6828d8-6dd0-43fa-8929-d6c7c69db480 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae3d2208faeb4421af21da56d455be92'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:15.712536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:15.757136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4f6828d8-6dd0-43fa-8929-d6c7c69db480 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae3d2208faeb4421af21da56d455be92'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:15.762834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4f6828d8-6dd0-43fa-8929-d6c7c69db480 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae3d2208faeb4421af21da56d455be92'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:15.858785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cb2f9-aa8e-4091-b1ae-decac53b01ac admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:15.867408 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 953/1885] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:22:15 2022] DELETE /identity/v3/users/ae3d2208faeb4421af21da56d455be92 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:22:15.871918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef0389-2dad-4c57-a956-9013537dc3f1 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:15.877725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8893d-d309-403b-a17b-219a329e0ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:15.878409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8893d-d309-403b-a17b-219a329e0ade admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:15.878526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef0389-2dad-4c57-a956-9013537dc3f1 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:15.879595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8893d-d309-403b-a17b-219a329e0ade admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:15.879595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8893d-d309-403b-a17b-219a329e0ade admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:15.879595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8893d-d309-403b-a17b-219a329e0ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:15.880198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef0389-2dad-4c57-a956-9013537dc3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:15.889848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8893d-d309-403b-a17b-219a329e0ade admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:15.924990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f0ef0389-2dad-4c57-a956-9013537dc3f1 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:15.925418 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 933/1886] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:15.928741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f0ef0389-2dad-4c57-a956-9013537dc3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:15.929357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8893d-d309-403b-a17b-219a329e0ade admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:15.931327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-35d8893d-d309-403b-a17b-219a329e0ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:15.936174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:15.954997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8893d-d309-403b-a17b-219a329e0ade admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:16.076322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ec351-1043-4cc1-a5e8-9ca316f89055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:16.078065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ec351-1043-4cc1-a5e8-9ca316f89055 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:16.079523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ec351-1043-4cc1-a5e8-9ca316f89055 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:16.080247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ec351-1043-4cc1-a5e8-9ca316f89055 admin admin] PATH_INFO: `/v3/projects/bb469948d9164e07b25c381715f3aaf9/users/c9bfe594b39647dab00996c90b18df52/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:16.095380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ec351-1043-4cc1-a5e8-9ca316f89055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb469948d9164e07b25c381715f3aaf9, user_id=c9bfe594b39647dab00996c90b18df52, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:16.107891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ec351-1043-4cc1-a5e8-9ca316f89055 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:16.108032 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 954/1887] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:16.110513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef0389-2dad-4c57-a956-9013537dc3f1 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:16.116320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f0ef0389-2dad-4c57-a956-9013537dc3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:16.141578 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 934/1888] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:15 2022] PUT /identity/v3/projects/bb469948d9164e07b25c381715f3aaf9/users/c9bfe594b39647dab00996c90b18df52/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:16.146935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ec351-1043-4cc1-a5e8-9ca316f89055 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:16.157230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-872ec351-1043-4cc1-a5e8-9ca316f89055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:16.161523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef0389-2dad-4c57-a956-9013537dc3f1 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:16.303535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaefe1b-1236-46b8-a0fe-eafe1a67bf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:16.305463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaefe1b-1236-46b8-a0fe-eafe1a67bf00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:16.305679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaefe1b-1236-46b8-a0fe-eafe1a67bf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:16.305961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaefe1b-1236-46b8-a0fe-eafe1a67bf00 admin admin] PATH_INFO: `/v3/projects/5b10b7b9a9604ee6a0775f0456c97553` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:16.307640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaefe1b-1236-46b8-a0fe-eafe1a67bf00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b10b7b9a9604ee6a0775f0456c97553)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:16.307838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:16.316222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaefe1b-1236-46b8-a0fe-eafe1a67bf00 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:16.344519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ec351-1043-4cc1-a5e8-9ca316f89055 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:16.355739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0a0b2-2c82-4ba2-bfbf-e2322a002e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:16.356300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0a0b2-2c82-4ba2-bfbf-e2322a002e4b service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:16.357159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0a0b2-2c82-4ba2-bfbf-e2322a002e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:16.357443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0a0b2-2c82-4ba2-bfbf-e2322a002e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:16.383846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0a0b2-2c82-4ba2-bfbf-e2322a002e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:16.387697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0a0b2-2c82-4ba2-bfbf-e2322a002e4b service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:16.415922 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 935/1889] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:22:16.417246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45504dcb-cbb4-4c04-a3f0-9c5afa2bbf2a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:16.417715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45504dcb-cbb4-4c04-a3f0-9c5afa2bbf2a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:16.417999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45504dcb-cbb4-4c04-a3f0-9c5afa2bbf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:16.502876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-45504dcb-cbb4-4c04-a3f0-9c5afa2bbf2a None None] MFA Rules not processed for user `c9bfe594b39647dab00996c90b18df52`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:16.504116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-45504dcb-cbb4-4c04-a3f0-9c5afa2bbf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:16.514083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dbaefe1b-1236-46b8-a0fe-eafe1a67bf00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b10b7b9a9604ee6a0775f0456c97553', 'request_id': 'req-dbaefe1b-1236-46b8-a0fe-eafe1a67bf00'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:16.541618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dbaefe1b-1236-46b8-a0fe-eafe1a67bf00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b10b7b9a9604ee6a0775f0456c97553', 'request_id': 'req-dbaefe1b-1236-46b8-a0fe-eafe1a67bf00'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:16.561909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dbaefe1b-1236-46b8-a0fe-eafe1a67bf00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b10b7b9a9604ee6a0775f0456c97553', 'request_id': 'req-dbaefe1b-1236-46b8-a0fe-eafe1a67bf00'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:16.616817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:16.655551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dbaefe1b-1236-46b8-a0fe-eafe1a67bf00 admin admin] The token cache is being invalidate because project 5b10b7b9a9604ee6a0775f0456c97553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:16.655857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dbaefe1b-1236-46b8-a0fe-eafe1a67bf00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:16.656588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dbaefe1b-1236-46b8-a0fe-eafe1a67bf00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:16.658552 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 955/1890] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:16 2022] DELETE /identity/v3/projects/5b10b7b9a9604ee6a0775f0456c97553 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:16.666304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c464794-c7a0-49b2-9056-0c2fbb23cc5a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:16.666977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c464794-c7a0-49b2-9056-0c2fbb23cc5a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:16.666977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c464794-c7a0-49b2-9056-0c2fbb23cc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:16.730366 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 936/1891] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:16.731911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df313f-2915-42c8-b361-14dea49dd7ff None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:16.734350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df313f-2915-42c8-b361-14dea49dd7ff None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:16.734350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df313f-2915-42c8-b361-14dea49dd7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:16.740871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7c464794-c7a0-49b2-9056-0c2fbb23cc5a None None] MFA Rules not processed for user `ac4a306da0e940a99b3155ce3d7b2d58`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:16.742643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7c464794-c7a0-49b2-9056-0c2fbb23cc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:16.781283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-58df313f-2915-42c8-b361-14dea49dd7ff None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:16.783471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-58df313f-2915-42c8-b361-14dea49dd7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:16.936457 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 956/1892] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:16 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:16.967697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c464794-c7a0-49b2-9056-0c2fbb23cc5a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:16.969118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7c464794-c7a0-49b2-9056-0c2fbb23cc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:16.978262 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 937/1893] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:16.988807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dec512-0cd3-4e09-8ca6-6a1c911df151 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:16.989171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dec512-0cd3-4e09-8ca6-6a1c911df151 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:16.989824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dec512-0cd3-4e09-8ca6-6a1c911df151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:17.038427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-89dec512-0cd3-4e09-8ca6-6a1c911df151 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:17.040763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-89dec512-0cd3-4e09-8ca6-6a1c911df151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:17.051834 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 938/1894] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:17.052958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dec512-0cd3-4e09-8ca6-6a1c911df151 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:17.055719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-89dec512-0cd3-4e09-8ca6-6a1c911df151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:17.079419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dec512-0cd3-4e09-8ca6-6a1c911df151 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:17.092162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d6869-9f2c-4150-aa98-1a650801bcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:17.092830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d6869-9f2c-4150-aa98-1a650801bcc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:17.093118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d6869-9f2c-4150-aa98-1a650801bcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:17.093399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d6869-9f2c-4150-aa98-1a650801bcc6 admin admin] PATH_INFO: `/v3/projects/44b2b8b909c54f36b61d934d09607b5a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:17.096960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d6869-9f2c-4150-aa98-1a650801bcc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44b2b8b909c54f36b61d934d09607b5a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:17.099102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d6869-9f2c-4150-aa98-1a650801bcc6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:17.102708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:17.128171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c464794-c7a0-49b2-9056-0c2fbb23cc5a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:17.146236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213dd6c-9388-4a13-857e-94104c281f3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:17.146869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213dd6c-9388-4a13-857e-94104c281f3f service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:17.147150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213dd6c-9388-4a13-857e-94104c281f3f service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:17.147623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213dd6c-9388-4a13-857e-94104c281f3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:17.161068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213dd6c-9388-4a13-857e-94104c281f3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:17.164222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213dd6c-9388-4a13-857e-94104c281f3f service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:17.180068 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 957/1895] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:22:17.181167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213dd6c-9388-4a13-857e-94104c281f3f service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:17.183752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8213dd6c-9388-4a13-857e-94104c281f3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:17.203659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213dd6c-9388-4a13-857e-94104c281f3f service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:17.211486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d63b5-07b0-48f7-bbf1-ff83c9478451 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:17.212933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d63b5-07b0-48f7-bbf1-ff83c9478451 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:17.213385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d63b5-07b0-48f7-bbf1-ff83c9478451 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:17.213815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d63b5-07b0-48f7-bbf1-ff83c9478451 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:17.224812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-864d63b5-07b0-48f7-bbf1-ff83c9478451 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:17.269811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-250d6869-9f2c-4150-aa98-1a650801bcc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44b2b8b909c54f36b61d934d09607b5a', 'request_id': 'req-250d6869-9f2c-4150-aa98-1a650801bcc6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:17.369382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d63b5-07b0-48f7-bbf1-ff83c9478451 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:17.371460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d63b5-07b0-48f7-bbf1-ff83c9478451 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:17.386503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-250d6869-9f2c-4150-aa98-1a650801bcc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44b2b8b909c54f36b61d934d09607b5a', 'request_id': 'req-250d6869-9f2c-4150-aa98-1a650801bcc6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:17.388898 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 958/1896] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:17 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:22:17.392220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d63b5-07b0-48f7-bbf1-ff83c9478451 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:17.405202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-250d6869-9f2c-4150-aa98-1a650801bcc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44b2b8b909c54f36b61d934d09607b5a', 'request_id': 'req-250d6869-9f2c-4150-aa98-1a650801bcc6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:17.421723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d63b5-07b0-48f7-bbf1-ff83c9478451 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:17.478703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-250d6869-9f2c-4150-aa98-1a650801bcc6 admin admin] The token cache is being invalidate because project 44b2b8b909c54f36b61d934d09607b5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:17.479007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-250d6869-9f2c-4150-aa98-1a650801bcc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:17.483583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-250d6869-9f2c-4150-aa98-1a650801bcc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:17.488645 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 939/1897] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:17 2022] DELETE /identity/v3/projects/44b2b8b909c54f36b61d934d09607b5a => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:17.489558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d6869-9f2c-4150-aa98-1a650801bcc6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:17.495737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-250d6869-9f2c-4150-aa98-1a650801bcc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:17.560073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:17.567962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf7956-5ed1-4120-96b1-d979a491aea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:17.568658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf7956-5ed1-4120-96b1-d979a491aea0 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:17.568939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf7956-5ed1-4120-96b1-d979a491aea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:17.569221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf7956-5ed1-4120-96b1-d979a491aea0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:17.569888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf7956-5ed1-4120-96b1-d979a491aea0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:22:17.570226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf7956-5ed1-4120-96b1-d979a491aea0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:17.573630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf7956-5ed1-4120-96b1-d979a491aea0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:17.599491 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 959/1898] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:17.599491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2417d6c-615e-4696-8f02-5eeffc4c5d7f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:17.599491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2417d6c-615e-4696-8f02-5eeffc4c5d7f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:17.599491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2417d6c-615e-4696-8f02-5eeffc4c5d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:17.655184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d6869-9f2c-4150-aa98-1a650801bcc6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:17.663264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e2417d6c-615e-4696-8f02-5eeffc4c5d7f None None] MFA Rules not processed for user `8c93886c5818439690564c2299a4f3ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:17.665430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e2417d6c-615e-4696-8f02-5eeffc4c5d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:17.668600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9cb4b1-19f2-4e32-a7c9-002f7c8ed9d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:17.669813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cb4b1-19f2-4e32-a7c9-002f7c8ed9d4 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:17.670123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cb4b1-19f2-4e32-a7c9-002f7c8ed9d4 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:17.670450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cb4b1-19f2-4e32-a7c9-002f7c8ed9d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:17.674948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7d9cb4b1-19f2-4e32-a7c9-002f7c8ed9d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:17.798396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9cb4b1-19f2-4e32-a7c9-002f7c8ed9d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:17.800038 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9cb4b1-19f2-4e32-a7c9-002f7c8ed9d4 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:17.807344 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 960/1899] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:17.808418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2417d6c-615e-4696-8f02-5eeffc4c5d7f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:17.809873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e2417d6c-615e-4696-8f02-5eeffc4c5d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:17.830175 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 940/1900] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:17 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:22:17.832808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9cb4b1-19f2-4e32-a7c9-002f7c8ed9d4 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:17.834548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2417d6c-615e-4696-8f02-5eeffc4c5d7f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:17.835867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7d9cb4b1-19f2-4e32-a7c9-002f7c8ed9d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:17.861737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e14ea0-3006-4fd6-b20d-7b048aa36183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:17.862428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e14ea0-3006-4fd6-b20d-7b048aa36183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:17.862715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e14ea0-3006-4fd6-b20d-7b048aa36183 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:17.864130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e14ea0-3006-4fd6-b20d-7b048aa36183 admin admin] PATH_INFO: `/v3/users/8c5e02ab3926413c82a1f53cb7a2b9f3` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:17.865450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e14ea0-3006-4fd6-b20d-7b048aa36183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c5e02ab3926413c82a1f53cb7a2b9f3)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:17.867477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e14ea0-3006-4fd6-b20d-7b048aa36183 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:17.879572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9cb4b1-19f2-4e32-a7c9-002f7c8ed9d4 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:17.892744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be5a95-1af0-4ebf-950d-056b75756070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:17.893477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be5a95-1af0-4ebf-950d-056b75756070 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:17.893763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be5a95-1af0-4ebf-950d-056b75756070 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:17.894062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be5a95-1af0-4ebf-950d-056b75756070 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:17.894724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be5a95-1af0-4ebf-950d-056b75756070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:17.896777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be5a95-1af0-4ebf-950d-056b75756070 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:18.071847 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 941/1901] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:22:17 2022] POST /identity/v3/projects => generated 389 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:18.071847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be5a95-1af0-4ebf-950d-056b75756070 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:18.074507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c6be5a95-1af0-4ebf-950d-056b75756070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:18.185731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-45e14ea0-3006-4fd6-b20d-7b048aa36183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c5e02ab3926413c82a1f53cb7a2b9f3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:18.189312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-45e14ea0-3006-4fd6-b20d-7b048aa36183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c5e02ab3926413c82a1f53cb7a2b9f3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:18.217366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-45e14ea0-3006-4fd6-b20d-7b048aa36183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c5e02ab3926413c82a1f53cb7a2b9f3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:18.268086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be5a95-1af0-4ebf-950d-056b75756070 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:18.273418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-45e14ea0-3006-4fd6-b20d-7b048aa36183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c5e02ab3926413c82a1f53cb7a2b9f3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:18.274383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-45e14ea0-3006-4fd6-b20d-7b048aa36183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c5e02ab3926413c82a1f53cb7a2b9f3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:18.291712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c02a7-fb00-49ef-b37c-540cd65e7581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:18.292566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c02a7-fb00-49ef-b37c-540cd65e7581 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:18.292966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c02a7-fb00-49ef-b37c-540cd65e7581 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:18.293348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c02a7-fb00-49ef-b37c-540cd65e7581 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:18.295126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c02a7-fb00-49ef-b37c-540cd65e7581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:18.297415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c02a7-fb00-49ef-b37c-540cd65e7581 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:18.324063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:18.397595 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 961/1902] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:22:17 2022] DELETE /identity/v3/users/8c5e02ab3926413c82a1f53cb7a2b9f3 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:18.397595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e14ea0-3006-4fd6-b20d-7b048aa36183 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:18.401598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-45e14ea0-3006-4fd6-b20d-7b048aa36183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:18.478361 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 942/1903] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:22:18 2022] POST /identity/v3/projects => generated 371 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:18.480036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c02a7-fb00-49ef-b37c-540cd65e7581 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:18.483972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f00c02a7-fb00-49ef-b37c-540cd65e7581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:18.611296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e14ea0-3006-4fd6-b20d-7b048aa36183 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:18.661324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:18.665402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c02a7-fb00-49ef-b37c-540cd65e7581 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:18.683242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fe9be-61ff-4d93-80e7-c76c4d8433a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:18.683464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fe9be-61ff-4d93-80e7-c76c4d8433a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:18.683755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fe9be-61ff-4d93-80e7-c76c4d8433a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:18.684040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fe9be-61ff-4d93-80e7-c76c4d8433a2 admin admin] PATH_INFO: `/v3/users/b2c5ab07251d4db9ac793361c6cff824` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:18.685692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81fe9be-61ff-4d93-80e7-c76c4d8433a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2c5ab07251d4db9ac793361c6cff824)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:18.687787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81fe9be-61ff-4d93-80e7-c76c4d8433a2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:18.798887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471eff46-62db-4514-a26c-04749a77f6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:18.804711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471eff46-62db-4514-a26c-04749a77f6bb admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:18.804711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471eff46-62db-4514-a26c-04749a77f6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:18.804711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471eff46-62db-4514-a26c-04749a77f6bb admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:18.804711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471eff46-62db-4514-a26c-04749a77f6bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:18.805888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471eff46-62db-4514-a26c-04749a77f6bb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:18.926208 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 962/1904] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:22:18 2022] POST /identity/v3/users => generated 295 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:18.929163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471eff46-62db-4514-a26c-04749a77f6bb admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:18.932894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-471eff46-62db-4514-a26c-04749a77f6bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:18.952381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e81fe9be-61ff-4d93-80e7-c76c4d8433a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2c5ab07251d4db9ac793361c6cff824'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:18.957285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e81fe9be-61ff-4d93-80e7-c76c4d8433a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2c5ab07251d4db9ac793361c6cff824'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:18.977081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e81fe9be-61ff-4d93-80e7-c76c4d8433a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2c5ab07251d4db9ac793361c6cff824'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:18.998082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471eff46-62db-4514-a26c-04749a77f6bb admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:19.004912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e81fe9be-61ff-4d93-80e7-c76c4d8433a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2c5ab07251d4db9ac793361c6cff824'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:19.036066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b44c12-b019-484e-b998-07f0a802b68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:19.043485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b44c12-b019-484e-b998-07f0a802b68c admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:19.045066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b44c12-b019-484e-b998-07f0a802b68c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:19.045595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b44c12-b019-484e-b998-07f0a802b68c admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:19.046480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b44c12-b019-484e-b998-07f0a802b68c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:19.066300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b44c12-b019-484e-b998-07f0a802b68c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:19.143105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e81fe9be-61ff-4d93-80e7-c76c4d8433a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2c5ab07251d4db9ac793361c6cff824'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:19.151083 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 943/1905] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:22:18 2022] DELETE /identity/v3/users/b2c5ab07251d4db9ac793361c6cff824 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:19.151983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fe9be-61ff-4d93-80e7-c76c4d8433a2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:19.154120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e81fe9be-61ff-4d93-80e7-c76c4d8433a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:19.270126 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 963/1906] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:22:18 2022] POST /identity/v3/users => generated 292 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:19.271911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b44c12-b019-484e-b998-07f0a802b68c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:19.280343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-85b44c12-b019-484e-b998-07f0a802b68c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:19.316655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fe9be-61ff-4d93-80e7-c76c4d8433a2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:19.326884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb1bd7-f7a4-45c7-ba49-4e4fbb97be65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:19.327600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb1bd7-f7a4-45c7-ba49-4e4fbb97be65 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:19.327937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb1bd7-f7a4-45c7-ba49-4e4fbb97be65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:19.328221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb1bd7-f7a4-45c7-ba49-4e4fbb97be65 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:19.331919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb1bd7-f7a4-45c7-ba49-4e4fbb97be65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:19.331919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb1bd7-f7a4-45c7-ba49-4e4fbb97be65 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:19.356716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b44c12-b019-484e-b998-07f0a802b68c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:19.362382 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 944/1907] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:19.366773 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd06d13-e585-4211-9d49-f996942b5612 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:19.367060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd06d13-e585-4211-9d49-f996942b5612 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:19.367337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd06d13-e585-4211-9d49-f996942b5612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:19.370566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb41f6-20f8-430b-aa1f-246d8b80807e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:19.371325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb41f6-20f8-430b-aa1f-246d8b80807e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:19.373128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb41f6-20f8-430b-aa1f-246d8b80807e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:19.373998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb41f6-20f8-430b-aa1f-246d8b80807e admin admin] PATH_INFO: `/v3/projects/9472aa97aca64edda6b0e0ffd956af70` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:19.375383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb41f6-20f8-430b-aa1f-246d8b80807e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9472aa97aca64edda6b0e0ffd956af70)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:19.377316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb41f6-20f8-430b-aa1f-246d8b80807e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:19.455614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-fbd06d13-e585-4211-9d49-f996942b5612 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:19.458582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fbd06d13-e585-4211-9d49-f996942b5612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:19.483846 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 945/1908] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:19.485217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd06d13-e585-4211-9d49-f996942b5612 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:19.492937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fbd06d13-e585-4211-9d49-f996942b5612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:19.541914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd06d13-e585-4211-9d49-f996942b5612 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:19.549700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2ecb41f6-20f8-430b-aa1f-246d8b80807e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9472aa97aca64edda6b0e0ffd956af70', 'request_id': 'req-2ecb41f6-20f8-430b-aa1f-246d8b80807e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:19.570272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:19.581890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2ecb41f6-20f8-430b-aa1f-246d8b80807e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9472aa97aca64edda6b0e0ffd956af70', 'request_id': 'req-2ecb41f6-20f8-430b-aa1f-246d8b80807e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:19.595980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2ecb41f6-20f8-430b-aa1f-246d8b80807e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9472aa97aca64edda6b0e0ffd956af70', 'request_id': 'req-2ecb41f6-20f8-430b-aa1f-246d8b80807e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:19.666817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a4ab9-7ecb-4d5f-97c5-842163a84638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:19.667505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a4ab9-7ecb-4d5f-97c5-842163a84638 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:19.668411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a4ab9-7ecb-4d5f-97c5-842163a84638 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:19.668740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a4ab9-7ecb-4d5f-97c5-842163a84638 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:19.669989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a4ab9-7ecb-4d5f-97c5-842163a84638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:19.676378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a4ab9-7ecb-4d5f-97c5-842163a84638 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:19.699061 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 946/1909] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:19.701459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a4ab9-7ecb-4d5f-97c5-842163a84638 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:19.740692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a4ab9-7ecb-4d5f-97c5-842163a84638 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:19.749944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2ecb41f6-20f8-430b-aa1f-246d8b80807e admin admin] The token cache is being invalidate because project 9472aa97aca64edda6b0e0ffd956af70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:19.749944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2ecb41f6-20f8-430b-aa1f-246d8b80807e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:19.749944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2ecb41f6-20f8-430b-aa1f-246d8b80807e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:19.754988 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 964/1910] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:19 2022] DELETE /identity/v3/projects/9472aa97aca64edda6b0e0ffd956af70 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:19.763040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb41f6-20f8-430b-aa1f-246d8b80807e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:19.763198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c6a74-d18f-4d6a-8372-25cc8a348502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:19.763756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c6a74-d18f-4d6a-8372-25cc8a348502 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:19.764061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c6a74-d18f-4d6a-8372-25cc8a348502 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:19.764305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c6a74-d18f-4d6a-8372-25cc8a348502 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:19.764969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c6a74-d18f-4d6a-8372-25cc8a348502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:19.766630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c6a74-d18f-4d6a-8372-25cc8a348502 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:19.770901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2ecb41f6-20f8-430b-aa1f-246d8b80807e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:19.782334 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 947/1911] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:19.783275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c6a74-d18f-4d6a-8372-25cc8a348502 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:19.785043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b88c6a74-d18f-4d6a-8372-25cc8a348502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:19.810964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c6a74-d18f-4d6a-8372-25cc8a348502 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:19.817451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef931ab-42d4-4815-a0f4-8c23ab57e17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:19.818226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef931ab-42d4-4815-a0f4-8c23ab57e17e admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:19.818558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef931ab-42d4-4815-a0f4-8c23ab57e17e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:19.819364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef931ab-42d4-4815-a0f4-8c23ab57e17e admin admin] PATH_INFO: `/v3/projects/311879be1cc24060b2cb934481150ae0/users/ba89e0f8634941819e688be6aa9fde02/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:19.864132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef931ab-42d4-4815-a0f4-8c23ab57e17e admin admin] RBAC: Authorizing `identity:create_grant(project_id=311879be1cc24060b2cb934481150ae0, user_id=ba89e0f8634941819e688be6aa9fde02, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:19.867804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef931ab-42d4-4815-a0f4-8c23ab57e17e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:19.928489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb41f6-20f8-430b-aa1f-246d8b80807e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:19.934677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a59250-b149-4d8a-bc1c-06938304516c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:19.956235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a59250-b149-4d8a-bc1c-06938304516c service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:19.958208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a59250-b149-4d8a-bc1c-06938304516c service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:19.958672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a59250-b149-4d8a-bc1c-06938304516c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:19.984571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-83a59250-b149-4d8a-bc1c-06938304516c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:20.000629 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 948/1912] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:19 2022] PUT /identity/v3/projects/311879be1cc24060b2cb934481150ae0/users/ba89e0f8634941819e688be6aa9fde02/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:20.003032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28a292-49f1-46cc-bdc4-dc2094676164 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:20.003614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28a292-49f1-46cc-bdc4-dc2094676164 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:20.007666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28a292-49f1-46cc-bdc4-dc2094676164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:20.018174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a59250-b149-4d8a-bc1c-06938304516c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:20.020389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a59250-b149-4d8a-bc1c-06938304516c service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:20.046718 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 965/1913] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:22:20.047631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a59250-b149-4d8a-bc1c-06938304516c service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:20.049747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-83a59250-b149-4d8a-bc1c-06938304516c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:20.058249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1e28a292-49f1-46cc-bdc4-dc2094676164 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:20.061756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1e28a292-49f1-46cc-bdc4-dc2094676164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:20.074122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a59250-b149-4d8a-bc1c-06938304516c service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:20.195387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa551833-7d9e-4f87-bce7-4a5e5c72025b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:20.201625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa551833-7d9e-4f87-bce7-4a5e5c72025b admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:20.202491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa551833-7d9e-4f87-bce7-4a5e5c72025b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:20.202862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa551833-7d9e-4f87-bce7-4a5e5c72025b admin admin] PATH_INFO: `/v3/projects/22917d924b1c4258a190781b34e6c81d/users/774c19162a9148bebc234e6295929fa3/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:20.220750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa551833-7d9e-4f87-bce7-4a5e5c72025b admin admin] RBAC: Authorizing `identity:create_grant(project_id=22917d924b1c4258a190781b34e6c81d, user_id=774c19162a9148bebc234e6295929fa3, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:20.223646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa551833-7d9e-4f87-bce7-4a5e5c72025b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:20.245868 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 949/1914] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:20.252957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28a292-49f1-46cc-bdc4-dc2094676164 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:20.263982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28a292-49f1-46cc-bdc4-dc2094676164 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:20.269088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1991be3-1302-445f-9fee-045495f10637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:20.269714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1991be3-1302-445f-9fee-045495f10637 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:20.269991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1991be3-1302-445f-9fee-045495f10637 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:20.270294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1991be3-1302-445f-9fee-045495f10637 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:20.270989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1991be3-1302-445f-9fee-045495f10637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:20.272653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1991be3-1302-445f-9fee-045495f10637 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:20.290681 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 950/1915] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:20.292494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f4473-632a-4e8b-86f1-7f7aab38e1e1 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:20.292792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f4473-632a-4e8b-86f1-7f7aab38e1e1 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:20.293077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f4473-632a-4e8b-86f1-7f7aab38e1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:20.326086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a48f4473-632a-4e8b-86f1-7f7aab38e1e1 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:20.328210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a48f4473-632a-4e8b-86f1-7f7aab38e1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:20.337086 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 966/1916] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:20 2022] PUT /identity/v3/projects/22917d924b1c4258a190781b34e6c81d/users/774c19162a9148bebc234e6295929fa3/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:20.340579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa551833-7d9e-4f87-bce7-4a5e5c72025b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:20.427119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:20.502888 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 951/1917] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:20.505032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b6dbb-22ce-419e-b9fe-181826ea3a25 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:20.505479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b6dbb-22ce-419e-b9fe-181826ea3a25 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:20.506189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b6dbb-22ce-419e-b9fe-181826ea3a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:20.508438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa551833-7d9e-4f87-bce7-4a5e5c72025b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:20.519567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02166a-f95c-40ee-b10f-1127b0efc31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:20.526964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02166a-f95c-40ee-b10f-1127b0efc31e admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:20.526964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02166a-f95c-40ee-b10f-1127b0efc31e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:20.526964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02166a-f95c-40ee-b10f-1127b0efc31e admin admin] PATH_INFO: `/v3/projects/311879be1cc24060b2cb934481150ae0/users/ba89e0f8634941819e688be6aa9fde02/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:20.526964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02166a-f95c-40ee-b10f-1127b0efc31e admin admin] RBAC: Authorizing `identity:create_grant(project_id=311879be1cc24060b2cb934481150ae0, user_id=ba89e0f8634941819e688be6aa9fde02, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:20.532889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02166a-f95c-40ee-b10f-1127b0efc31e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:20.555638 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 967/1918] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:20 2022] PUT /identity/v3/projects/311879be1cc24060b2cb934481150ae0/users/ba89e0f8634941819e688be6aa9fde02/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:20.555638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02166a-f95c-40ee-b10f-1127b0efc31e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:20.626785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4c8b6dbb-22ce-419e-b9fe-181826ea3a25 None None] MFA Rules not processed for user `774c19162a9148bebc234e6295929fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:20.629632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4c8b6dbb-22ce-419e-b9fe-181826ea3a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:20.760478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02166a-f95c-40ee-b10f-1127b0efc31e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:20.776242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a385f6c-760e-47ef-9410-3a5d1679c35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:20.777195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a385f6c-760e-47ef-9410-3a5d1679c35a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:20.777666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a385f6c-760e-47ef-9410-3a5d1679c35a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:20.778381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a385f6c-760e-47ef-9410-3a5d1679c35a admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:20.781819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a385f6c-760e-47ef-9410-3a5d1679c35a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:22:20.782588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a385f6c-760e-47ef-9410-3a5d1679c35a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:20.787658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a385f6c-760e-47ef-9410-3a5d1679c35a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:20.821861 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 968/1919] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:20.823954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a385f6c-760e-47ef-9410-3a5d1679c35a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:20.850490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a385f6c-760e-47ef-9410-3a5d1679c35a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:20.869302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbf100-a616-48b3-9466-05c2eb376208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:20.870554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbf100-a616-48b3-9466-05c2eb376208 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:20.870891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbf100-a616-48b3-9466-05c2eb376208 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:20.871172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbf100-a616-48b3-9466-05c2eb376208 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:20.871827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbf100-a616-48b3-9466-05c2eb376208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:20.874490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbf100-a616-48b3-9466-05c2eb376208 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:20.892132 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 952/1920] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:20.892656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b6dbb-22ce-419e-b9fe-181826ea3a25 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:20.919483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b6dbb-22ce-419e-b9fe-181826ea3a25 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:20.932333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d5b84-b503-49c0-9dea-7bf5caa3dd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:20.933148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5b84-b503-49c0-9dea-7bf5caa3dd6a admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:20.933441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5b84-b503-49c0-9dea-7bf5caa3dd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:20.933717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5b84-b503-49c0-9dea-7bf5caa3dd6a admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:20.934398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d5b84-b503-49c0-9dea-7bf5caa3dd6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:20.936926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d5b84-b503-49c0-9dea-7bf5caa3dd6a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:21.049819 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 969/1921] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:22:20 2022] POST /identity/v3/projects => generated 407 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:21.057477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbf100-a616-48b3-9466-05c2eb376208 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:21.112853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:21.129360 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 953/1922] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:22:20 2022] POST /identity/v3/projects => generated 389 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:21.133673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d5b84-b503-49c0-9dea-7bf5caa3dd6a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:21.234238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:21.268650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbf100-a616-48b3-9466-05c2eb376208 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:21.343487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d5b84-b503-49c0-9dea-7bf5caa3dd6a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:21.353824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad2743-8c53-4f4a-883c-6aa084224afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:21.359797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad2743-8c53-4f4a-883c-6aa084224afd admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:21.361551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad2743-8c53-4f4a-883c-6aa084224afd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:21.362053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad2743-8c53-4f4a-883c-6aa084224afd admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:21.363212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad2743-8c53-4f4a-883c-6aa084224afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:21.374154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad2743-8c53-4f4a-883c-6aa084224afd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:21.375131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983cd3c-6f23-42aa-8bea-0cb2951e8618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:21.375936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983cd3c-6f23-42aa-8bea-0cb2951e8618 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:21.376226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983cd3c-6f23-42aa-8bea-0cb2951e8618 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:21.378640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983cd3c-6f23-42aa-8bea-0cb2951e8618 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:21.378640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983cd3c-6f23-42aa-8bea-0cb2951e8618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:21.385187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983cd3c-6f23-42aa-8bea-0cb2951e8618 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:21.576962 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 954/1923] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:22:21 2022] POST /identity/v3/users => generated 301 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:21.579930 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 970/1924] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:22:21 2022] POST /identity/v3/users => generated 304 bytes in 526 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:21.581895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad2743-8c53-4f4a-883c-6aa084224afd admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:21.583951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983cd3c-6f23-42aa-8bea-0cb2951e8618 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:21.608086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983cd3c-6f23-42aa-8bea-0cb2951e8618 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:21.619748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad2743-8c53-4f4a-883c-6aa084224afd admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:21.620613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68a1f0-0810-48cc-80ae-4fc6f0eed63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:21.621516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68a1f0-0810-48cc-80ae-4fc6f0eed63b admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:21.622255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68a1f0-0810-48cc-80ae-4fc6f0eed63b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:21.623912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68a1f0-0810-48cc-80ae-4fc6f0eed63b admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:21.624907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68a1f0-0810-48cc-80ae-4fc6f0eed63b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:21.628872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68a1f0-0810-48cc-80ae-4fc6f0eed63b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:21.646782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55274c06-269c-4e3a-8b2a-68441078ce54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:21.647446 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55274c06-269c-4e3a-8b2a-68441078ce54 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:21.647893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55274c06-269c-4e3a-8b2a-68441078ce54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:21.648185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55274c06-269c-4e3a-8b2a-68441078ce54 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:21.648865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55274c06-269c-4e3a-8b2a-68441078ce54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:21.657852 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 971/1925] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:21.659087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55274c06-269c-4e3a-8b2a-68441078ce54 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:21.659212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68a1f0-0810-48cc-80ae-4fc6f0eed63b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:21.666148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6b68a1f0-0810-48cc-80ae-4fc6f0eed63b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:21.693410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68a1f0-0810-48cc-80ae-4fc6f0eed63b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:21.694365 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 955/1926] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:22:21.695036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55274c06-269c-4e3a-8b2a-68441078ce54 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:21.710874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fa894-72d1-4eb1-a1f4-14425facd4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:21.711863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fa894-72d1-4eb1-a1f4-14425facd4b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:21.712253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fa894-72d1-4eb1-a1f4-14425facd4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:21.712636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fa894-72d1-4eb1-a1f4-14425facd4b6 admin admin] PATH_INFO: `/v3/projects/93bce96b30214389a2b09a65f8f2c630` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:21.714412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fa894-72d1-4eb1-a1f4-14425facd4b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93bce96b30214389a2b09a65f8f2c630)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:21.728937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fa894-72d1-4eb1-a1f4-14425facd4b6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:21.743916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55274c06-269c-4e3a-8b2a-68441078ce54 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:21.764689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2aded8-4d40-4345-acf4-23dd294f5c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:21.765360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2aded8-4d40-4345-acf4-23dd294f5c0f admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:21.765635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2aded8-4d40-4345-acf4-23dd294f5c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:21.765914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2aded8-4d40-4345-acf4-23dd294f5c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:21.766611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2aded8-4d40-4345-acf4-23dd294f5c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:21.768401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2aded8-4d40-4345-acf4-23dd294f5c0f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:21.801252 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 956/1927] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:21.802855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2aded8-4d40-4345-acf4-23dd294f5c0f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:21.818814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2aded8-4d40-4345-acf4-23dd294f5c0f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:21.835822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b390c-729c-48f5-a268-a9ee3b011b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:21.836524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b390c-729c-48f5-a268-a9ee3b011b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:21.836799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b390c-729c-48f5-a268-a9ee3b011b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:21.837793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b390c-729c-48f5-a268-a9ee3b011b05 admin admin] PATH_INFO: `/v3/projects/4b48298a698c4a6baa293ddb287b1b6c/users/2cef7271f7ef4a9a91f23002fc10ea75/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:21.862479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b390c-729c-48f5-a268-a9ee3b011b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b48298a698c4a6baa293ddb287b1b6c, user_id=2cef7271f7ef4a9a91f23002fc10ea75, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:21.865750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b390c-729c-48f5-a268-a9ee3b011b05 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:22.038200 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 957/1928] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:21 2022] PUT /identity/v3/projects/4b48298a698c4a6baa293ddb287b1b6c/users/2cef7271f7ef4a9a91f23002fc10ea75/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:22.039397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b390c-729c-48f5-a268-a9ee3b011b05 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:22.042017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ad1b390c-729c-48f5-a268-a9ee3b011b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:22.058935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-252fa894-72d1-4eb1-a1f4-14425facd4b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93bce96b30214389a2b09a65f8f2c630', 'request_id': 'req-252fa894-72d1-4eb1-a1f4-14425facd4b6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:22.069067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-252fa894-72d1-4eb1-a1f4-14425facd4b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93bce96b30214389a2b09a65f8f2c630', 'request_id': 'req-252fa894-72d1-4eb1-a1f4-14425facd4b6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:22.079544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-252fa894-72d1-4eb1-a1f4-14425facd4b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93bce96b30214389a2b09a65f8f2c630', 'request_id': 'req-252fa894-72d1-4eb1-a1f4-14425facd4b6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:22.163522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b390c-729c-48f5-a268-a9ee3b011b05 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:22.171455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89142554-fa56-4c09-bc73-2790f93494d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:22.173614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89142554-fa56-4c09-bc73-2790f93494d1 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:22.174397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89142554-fa56-4c09-bc73-2790f93494d1 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:22.175203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89142554-fa56-4c09-bc73-2790f93494d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:22.177778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-89142554-fa56-4c09-bc73-2790f93494d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:22.218326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:22.221315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-252fa894-72d1-4eb1-a1f4-14425facd4b6 admin admin] The token cache is being invalidate because project 93bce96b30214389a2b09a65f8f2c630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:22.221618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-252fa894-72d1-4eb1-a1f4-14425facd4b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:22.224111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-252fa894-72d1-4eb1-a1f4-14425facd4b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:22.227950 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 972/1929] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:21 2022] DELETE /identity/v3/projects/93bce96b30214389a2b09a65f8f2c630 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:22.236224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fa894-72d1-4eb1-a1f4-14425facd4b6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:22.255486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-252fa894-72d1-4eb1-a1f4-14425facd4b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:22.306164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89142554-fa56-4c09-bc73-2790f93494d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:22.308544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89142554-fa56-4c09-bc73-2790f93494d1 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:22.328200 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 958/1930] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:22:22.329354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89142554-fa56-4c09-bc73-2790f93494d1 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:22.454300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fa894-72d1-4eb1-a1f4-14425facd4b6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:22.479863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89142554-fa56-4c09-bc73-2790f93494d1 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:22.499698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264da58-407e-4c8b-92dd-9b63d6e9cfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:22.505708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264da58-407e-4c8b-92dd-9b63d6e9cfa7 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:22.505708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264da58-407e-4c8b-92dd-9b63d6e9cfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:22.505708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264da58-407e-4c8b-92dd-9b63d6e9cfa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:22.505708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264da58-407e-4c8b-92dd-9b63d6e9cfa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:22.505708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264da58-407e-4c8b-92dd-9b63d6e9cfa7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:22.542292 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 959/1931] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:22.542292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264da58-407e-4c8b-92dd-9b63d6e9cfa7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:22.545566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5264da58-407e-4c8b-92dd-9b63d6e9cfa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:22.569383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264da58-407e-4c8b-92dd-9b63d6e9cfa7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:22.576486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d2bc7-b47b-4a80-9679-098a14417a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:22.578026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d2bc7-b47b-4a80-9679-098a14417a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:22.579279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d2bc7-b47b-4a80-9679-098a14417a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:22.579756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d2bc7-b47b-4a80-9679-098a14417a33 admin admin] PATH_INFO: `/v3/users/c9bfe594b39647dab00996c90b18df52` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:22.582084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d2bc7-b47b-4a80-9679-098a14417a33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9bfe594b39647dab00996c90b18df52)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:22.585549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d2bc7-b47b-4a80-9679-098a14417a33 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:22.589357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372fc08-175f-4fdb-9836-f2789fbc700f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:22.589934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372fc08-175f-4fdb-9836-f2789fbc700f admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:22.590249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372fc08-175f-4fdb-9836-f2789fbc700f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:22.590534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372fc08-175f-4fdb-9836-f2789fbc700f admin admin] PATH_INFO: `/v3/projects/ff89b96c02a246bdaac8fd686b817685/users/9381468648bc4a8c8f44f53929cbc695/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:22.631319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372fc08-175f-4fdb-9836-f2789fbc700f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff89b96c02a246bdaac8fd686b817685, user_id=9381468648bc4a8c8f44f53929cbc695, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:22.633970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372fc08-175f-4fdb-9836-f2789fbc700f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:22.642272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:22.724500 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 973/1932] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:22 2022] PUT /identity/v3/projects/ff89b96c02a246bdaac8fd686b817685/users/9381468648bc4a8c8f44f53929cbc695/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:22.725095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372fc08-175f-4fdb-9836-f2789fbc700f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:22.736752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6372fc08-175f-4fdb-9836-f2789fbc700f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:22.859145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-547d2bc7-b47b-4a80-9679-098a14417a33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9bfe594b39647dab00996c90b18df52'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:22.864048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-547d2bc7-b47b-4a80-9679-098a14417a33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9bfe594b39647dab00996c90b18df52'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:22.897705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-547d2bc7-b47b-4a80-9679-098a14417a33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9bfe594b39647dab00996c90b18df52'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:22.958764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-547d2bc7-b47b-4a80-9679-098a14417a33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9bfe594b39647dab00996c90b18df52'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:22.965922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372fc08-175f-4fdb-9836-f2789fbc700f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:22.986937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bd847-ab69-47af-8658-1c7d930d56d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:22.987079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bd847-ab69-47af-8658-1c7d930d56d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:22.987317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bd847-ab69-47af-8658-1c7d930d56d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:22.987820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bd847-ab69-47af-8658-1c7d930d56d4 admin admin] PATH_INFO: `/v3/projects/4b48298a698c4a6baa293ddb287b1b6c/users/2cef7271f7ef4a9a91f23002fc10ea75/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:22.994006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32bd847-ab69-47af-8658-1c7d930d56d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b48298a698c4a6baa293ddb287b1b6c, user_id=2cef7271f7ef4a9a91f23002fc10ea75, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:23.002432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32bd847-ab69-47af-8658-1c7d930d56d4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:23.041246 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 974/1933] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:22 2022] PUT /identity/v3/projects/4b48298a698c4a6baa293ddb287b1b6c/users/2cef7271f7ef4a9a91f23002fc10ea75/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:23.044019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d72ca4-9569-48c1-971b-7ac308e7ff05 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:23.045106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d72ca4-9569-48c1-971b-7ac308e7ff05 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:23.045564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d72ca4-9569-48c1-971b-7ac308e7ff05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:23.054207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-547d2bc7-b47b-4a80-9679-098a14417a33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9bfe594b39647dab00996c90b18df52'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:23.063066 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 960/1934] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:22:22 2022] DELETE /identity/v3/users/c9bfe594b39647dab00996c90b18df52 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:23.064527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f5065-9b65-43af-83b1-6c31c4ed4300 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:23.064882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f5065-9b65-43af-83b1-6c31c4ed4300 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:23.066419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f5065-9b65-43af-83b1-6c31c4ed4300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:23.141834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8c4f5065-9b65-43af-83b1-6c31c4ed4300 None None] MFA Rules not processed for user `2cef7271f7ef4a9a91f23002fc10ea75`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:23.145236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8c4f5065-9b65-43af-83b1-6c31c4ed4300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:23.192465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f5d72ca4-9569-48c1-971b-7ac308e7ff05 None None] MFA Rules not processed for user `9381468648bc4a8c8f44f53929cbc695`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:23.195495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f5d72ca4-9569-48c1-971b-7ac308e7ff05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:23.313551 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 961/1935] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:23 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:23.326460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f5065-9b65-43af-83b1-6c31c4ed4300 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:23.328282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8c4f5065-9b65-43af-83b1-6c31c4ed4300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:23.385275 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 975/1936] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:23 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:23.389193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d72ca4-9569-48c1-971b-7ac308e7ff05 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:23.393366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f5d72ca4-9569-48c1-971b-7ac308e7ff05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:23.538850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f5065-9b65-43af-83b1-6c31c4ed4300 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:23.547301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45663652-c3f0-405f-a0e0-494f4a26848c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:23.554267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45663652-c3f0-405f-a0e0-494f4a26848c service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:23.554681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45663652-c3f0-405f-a0e0-494f4a26848c service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:23.555259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45663652-c3f0-405f-a0e0-494f4a26848c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:23.566125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45663652-c3f0-405f-a0e0-494f4a26848c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:23.567995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45663652-c3f0-405f-a0e0-494f4a26848c service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:23.585441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d72ca4-9569-48c1-971b-7ac308e7ff05 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:23.598256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c5596-d710-4902-81d4-e8e5be4cbd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:23.599247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c5596-d710-4902-81d4-e8e5be4cbd7f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:23.599840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c5596-d710-4902-81d4-e8e5be4cbd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:23.600264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c5596-d710-4902-81d4-e8e5be4cbd7f admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:23.601332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c5596-d710-4902-81d4-e8e5be4cbd7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:23.603507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c5596-d710-4902-81d4-e8e5be4cbd7f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:23.606386 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 962/1937] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:23 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:22:23.755267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45663652-c3f0-405f-a0e0-494f4a26848c service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:23.755922 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 976/1938] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:22:23 2022] POST /identity/v3/projects => generated 409 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:23.778332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45663652-c3f0-405f-a0e0-494f4a26848c service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:23.846686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c5596-d710-4902-81d4-e8e5be4cbd7f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:23.849164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-dc7c5596-d710-4902-81d4-e8e5be4cbd7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:23.958858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f1f71-525c-4bca-8d03-44c50eef63b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:23.959757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f1f71-525c-4bca-8d03-44c50eef63b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:23.960188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f1f71-525c-4bca-8d03-44c50eef63b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:23.961248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f1f71-525c-4bca-8d03-44c50eef63b6 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:23.962719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f1f71-525c-4bca-8d03-44c50eef63b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:23.966946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f1f71-525c-4bca-8d03-44c50eef63b6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:24.024786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c5596-d710-4902-81d4-e8e5be4cbd7f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:24.033695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226148cb-c561-4128-b466-ec3b53d33e94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:24.033695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226148cb-c561-4128-b466-ec3b53d33e94 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:24.033695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226148cb-c561-4128-b466-ec3b53d33e94 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:24.033695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226148cb-c561-4128-b466-ec3b53d33e94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:24.035209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-226148cb-c561-4128-b466-ec3b53d33e94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:24.102646 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 963/1939] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:22:23 2022] POST /identity/v3/users => generated 311 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:24.105575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f1f71-525c-4bca-8d03-44c50eef63b6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:24.120912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f1f71-525c-4bca-8d03-44c50eef63b6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:24.133428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294b20d-40c9-42c6-921e-b765fb64c044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:24.134464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294b20d-40c9-42c6-921e-b765fb64c044 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:24.134957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294b20d-40c9-42c6-921e-b765fb64c044 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:24.138383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294b20d-40c9-42c6-921e-b765fb64c044 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:24.143057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294b20d-40c9-42c6-921e-b765fb64c044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:24.145707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294b20d-40c9-42c6-921e-b765fb64c044 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:24.186913 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 964/1940] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:24.187882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294b20d-40c9-42c6-921e-b765fb64c044 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:24.196758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:24.198585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226148cb-c561-4128-b466-ec3b53d33e94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:24.199754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226148cb-c561-4128-b466-ec3b53d33e94 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:24.206947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294b20d-40c9-42c6-921e-b765fb64c044 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:24.219490 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 977/1941] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:23 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:22:24.231310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baecfb-cc0d-448f-a19a-9b500b6f0997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:24.233978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baecfb-cc0d-448f-a19a-9b500b6f0997 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:24.241952 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baecfb-cc0d-448f-a19a-9b500b6f0997 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:24.246767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baecfb-cc0d-448f-a19a-9b500b6f0997 admin admin] PATH_INFO: `/v3/projects/6b398cc596234acdaa77e5650b11a103/users/f618c2e8fc5f41da9ab12c557e72a748/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:24.298544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baecfb-cc0d-448f-a19a-9b500b6f0997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b398cc596234acdaa77e5650b11a103, user_id=f618c2e8fc5f41da9ab12c557e72a748, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:24.305879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baecfb-cc0d-448f-a19a-9b500b6f0997 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:24.323129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=4,keystone:SELECT=90,keystone:INSERT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:24.418959 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 965/1942] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:24 2022] PUT /identity/v3/projects/6b398cc596234acdaa77e5650b11a103/users/f618c2e8fc5f41da9ab12c557e72a748/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:24.423711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226148cb-c561-4128-b466-ec3b53d33e94 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:24.438220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226148cb-c561-4128-b466-ec3b53d33e94 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:24.558418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3c3f3-cea6-4a7c-abc8-04ccfb8ca516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:24.559249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3c3f3-cea6-4a7c-abc8-04ccfb8ca516 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:24.559537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3c3f3-cea6-4a7c-abc8-04ccfb8ca516 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:24.559841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3c3f3-cea6-4a7c-abc8-04ccfb8ca516 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:24.560522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3c3f3-cea6-4a7c-abc8-04ccfb8ca516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:24.562388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3c3f3-cea6-4a7c-abc8-04ccfb8ca516 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:24.577962 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 978/1943] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:24.588629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b5e25-0fe8-4f83-aace-bbb97d457e3c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:24.592520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b5e25-0fe8-4f83-aace-bbb97d457e3c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:24.593314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b5e25-0fe8-4f83-aace-bbb97d457e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:24.633138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3c3f3-cea6-4a7c-abc8-04ccfb8ca516 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:24.667648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b86b5e25-0fe8-4f83-aace-bbb97d457e3c None None] MFA Rules not processed for user `91d1351fcb6b4cd08f176e6d0cc5bb11`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:24.685629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b86b5e25-0fe8-4f83-aace-bbb97d457e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:24.711490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3c3f3-cea6-4a7c-abc8-04ccfb8ca516 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:24.771509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2ae64-7304-4467-802b-15baf3c146a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:24.774237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2ae64-7304-4467-802b-15baf3c146a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:24.774559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2ae64-7304-4467-802b-15baf3c146a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:24.774851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2ae64-7304-4467-802b-15baf3c146a7 admin admin] PATH_INFO: `/v3/projects/6b398cc596234acdaa77e5650b11a103/users/f618c2e8fc5f41da9ab12c557e72a748/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:24.782807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2ae64-7304-4467-802b-15baf3c146a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b398cc596234acdaa77e5650b11a103, user_id=f618c2e8fc5f41da9ab12c557e72a748, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:24.798869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2ae64-7304-4467-802b-15baf3c146a7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:24.827768 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 979/1944] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:24 2022] PUT /identity/v3/projects/6b398cc596234acdaa77e5650b11a103/users/f618c2e8fc5f41da9ab12c557e72a748/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:24.843386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54e77a-5be3-450a-971f-8993993d9d6f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:24.844116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54e77a-5be3-450a-971f-8993993d9d6f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:24.844887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54e77a-5be3-450a-971f-8993993d9d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:24.911000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2b54e77a-5be3-450a-971f-8993993d9d6f None None] MFA Rules not processed for user `f618c2e8fc5f41da9ab12c557e72a748`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:24.912404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2b54e77a-5be3-450a-971f-8993993d9d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:25.055788 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 966/1945] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:25.066059 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 980/1946] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:24 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:25.073105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b5e25-0fe8-4f83-aace-bbb97d457e3c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:25.087709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b5e25-0fe8-4f83-aace-bbb97d457e3c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:25.176246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6ceb0-9d26-488a-b0ab-53e1fbae9561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:25.177137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6ceb0-9d26-488a-b0ab-53e1fbae9561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:25.177722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6ceb0-9d26-488a-b0ab-53e1fbae9561 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:25.178234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6ceb0-9d26-488a-b0ab-53e1fbae9561 admin admin] PATH_INFO: `/v3/users/9381468648bc4a8c8f44f53929cbc695` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:25.179620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6ceb0-9d26-488a-b0ab-53e1fbae9561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9381468648bc4a8c8f44f53929cbc695)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:25.187856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6ceb0-9d26-488a-b0ab-53e1fbae9561 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:25.248766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54e77a-5be3-450a-971f-8993993d9d6f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:25.249370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2b54e77a-5be3-450a-971f-8993993d9d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:25.262472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54e77a-5be3-450a-971f-8993993d9d6f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:25.267905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0de969-191a-4550-8bc1-d827e97456a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:25.268633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0de969-191a-4550-8bc1-d827e97456a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:25.268967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0de969-191a-4550-8bc1-d827e97456a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:25.269301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0de969-191a-4550-8bc1-d827e97456a4 admin admin] PATH_INFO: `/v3/users/774c19162a9148bebc234e6295929fa3` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:25.270597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0de969-191a-4550-8bc1-d827e97456a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=774c19162a9148bebc234e6295929fa3)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:25.272875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0de969-191a-4550-8bc1-d827e97456a4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:25.580011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7dd6ceb0-9d26-488a-b0ab-53e1fbae9561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9381468648bc4a8c8f44f53929cbc695'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:25.581244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7dd6ceb0-9d26-488a-b0ab-53e1fbae9561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9381468648bc4a8c8f44f53929cbc695'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:25.588770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bc0de969-191a-4550-8bc1-d827e97456a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '774c19162a9148bebc234e6295929fa3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:25.590448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bc0de969-191a-4550-8bc1-d827e97456a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '774c19162a9148bebc234e6295929fa3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:25.596271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7dd6ceb0-9d26-488a-b0ab-53e1fbae9561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9381468648bc4a8c8f44f53929cbc695'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:25.613769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bc0de969-191a-4550-8bc1-d827e97456a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '774c19162a9148bebc234e6295929fa3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:25.635531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7dd6ceb0-9d26-488a-b0ab-53e1fbae9561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9381468648bc4a8c8f44f53929cbc695'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:25.647687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bc0de969-191a-4550-8bc1-d827e97456a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '774c19162a9148bebc234e6295929fa3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:25.648763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bc0de969-191a-4550-8bc1-d827e97456a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '774c19162a9148bebc234e6295929fa3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:25.713324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7dd6ceb0-9d26-488a-b0ab-53e1fbae9561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9381468648bc4a8c8f44f53929cbc695'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:25.723360 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 967/1947] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:22:25 2022] DELETE /identity/v3/users/9381468648bc4a8c8f44f53929cbc695 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:25.724227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6ceb0-9d26-488a-b0ab-53e1fbae9561 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:25.728438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7dd6ceb0-9d26-488a-b0ab-53e1fbae9561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:25.805900 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 981/1948] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:22:25 2022] DELETE /identity/v3/users/774c19162a9148bebc234e6295929fa3 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:25.807349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a513d0-36f1-4b96-9a44-881eac1080bd None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:25.807650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a513d0-36f1-4b96-9a44-881eac1080bd None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:25.807931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a513d0-36f1-4b96-9a44-881eac1080bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:25.845788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6ceb0-9d26-488a-b0ab-53e1fbae9561 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:25.878510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-59a513d0-36f1-4b96-9a44-881eac1080bd None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:25.879750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-59a513d0-36f1-4b96-9a44-881eac1080bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:25.974357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8e8fe-7cd6-492a-a0d1-5b45c6d7aa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:25.975081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8e8fe-7cd6-492a-a0d1-5b45c6d7aa9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:25.975631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8e8fe-7cd6-492a-a0d1-5b45c6d7aa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:25.975910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8e8fe-7cd6-492a-a0d1-5b45c6d7aa9a admin admin] PATH_INFO: `/v3/projects/bb469948d9164e07b25c381715f3aaf9` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:25.977710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff8e8fe-7cd6-492a-a0d1-5b45c6d7aa9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb469948d9164e07b25c381715f3aaf9)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:25.980022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff8e8fe-7cd6-492a-a0d1-5b45c6d7aa9a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:26.099142 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 982/1949] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:26.101624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082033d-57f1-494a-aea3-5c06a632c1b6 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:26.102077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082033d-57f1-494a-aea3-5c06a632c1b6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:26.102580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082033d-57f1-494a-aea3-5c06a632c1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:26.132962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9082033d-57f1-494a-aea3-5c06a632c1b6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:26.134848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9082033d-57f1-494a-aea3-5c06a632c1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:26.151933 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 983/1950] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:26.153324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082033d-57f1-494a-aea3-5c06a632c1b6 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:26.156598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9082033d-57f1-494a-aea3-5c06a632c1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:26.241156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cff8e8fe-7cd6-492a-a0d1-5b45c6d7aa9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb469948d9164e07b25c381715f3aaf9', 'request_id': 'req-cff8e8fe-7cd6-492a-a0d1-5b45c6d7aa9a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:26.257980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082033d-57f1-494a-aea3-5c06a632c1b6 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:26.320491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de340164-2e31-432f-bb6b-62039af71291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:26.321131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de340164-2e31-432f-bb6b-62039af71291 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:26.321415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de340164-2e31-432f-bb6b-62039af71291 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:26.321704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de340164-2e31-432f-bb6b-62039af71291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:26.346729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cff8e8fe-7cd6-492a-a0d1-5b45c6d7aa9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb469948d9164e07b25c381715f3aaf9', 'request_id': 'req-cff8e8fe-7cd6-492a-a0d1-5b45c6d7aa9a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:26.359981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cff8e8fe-7cd6-492a-a0d1-5b45c6d7aa9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb469948d9164e07b25c381715f3aaf9', 'request_id': 'req-cff8e8fe-7cd6-492a-a0d1-5b45c6d7aa9a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:26.375590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cff8e8fe-7cd6-492a-a0d1-5b45c6d7aa9a admin admin] The token cache is being invalidate because project bb469948d9164e07b25c381715f3aaf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:26.375968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cff8e8fe-7cd6-492a-a0d1-5b45c6d7aa9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:26.377304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cff8e8fe-7cd6-492a-a0d1-5b45c6d7aa9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:26.379646 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 968/1951] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:25 2022] DELETE /identity/v3/projects/bb469948d9164e07b25c381715f3aaf9 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:26.380818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8e8fe-7cd6-492a-a0d1-5b45c6d7aa9a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:26.405297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cff8e8fe-7cd6-492a-a0d1-5b45c6d7aa9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:26.458408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8e8fe-7cd6-492a-a0d1-5b45c6d7aa9a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:26.463258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de340164-2e31-432f-bb6b-62039af71291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:26.464404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de340164-2e31-432f-bb6b-62039af71291 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:26.469244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8e478-d5f9-46c7-a8df-59beb1916e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:26.470518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8e478-d5f9-46c7-a8df-59beb1916e43 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:26.470518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8e478-d5f9-46c7-a8df-59beb1916e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:26.470518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8e478-d5f9-46c7-a8df-59beb1916e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:26.476609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e7b8e478-d5f9-46c7-a8df-59beb1916e43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:26.503575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8e478-d5f9-46c7-a8df-59beb1916e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:26.505784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8e478-d5f9-46c7-a8df-59beb1916e43 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:26.506529 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 984/1952] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:22:26.508009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3635fa-2621-436d-8f03-01a2bc8fc9b6 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:26.508300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3635fa-2621-436d-8f03-01a2bc8fc9b6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:26.508600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3635fa-2621-436d-8f03-01a2bc8fc9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:26.529391 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 969/1953] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:22:26.530489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a616aa-a6f7-4f14-8ca5-a7e2b1c1e9c5 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:26.530781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a616aa-a6f7-4f14-8ca5-a7e2b1c1e9c5 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:26.531048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a616aa-a6f7-4f14-8ca5-a7e2b1c1e9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:26.561345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9b3635fa-2621-436d-8f03-01a2bc8fc9b6 None None] MFA Rules not processed for user `2e23378ed283426cbff623265d9bbc96`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:26.562595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9b3635fa-2621-436d-8f03-01a2bc8fc9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:26.578526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a9a616aa-a6f7-4f14-8ca5-a7e2b1c1e9c5 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:26.579897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a9a616aa-a6f7-4f14-8ca5-a7e2b1c1e9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:26.606690 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 970/1954] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:26.608081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5e716-ab95-410f-b870-f2dc0022ac91 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:26.608389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5e716-ab95-410f-b870-f2dc0022ac91 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:26.608626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5e716-ab95-410f-b870-f2dc0022ac91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:26.616477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:26.659117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-63e5e716-ab95-410f-b870-f2dc0022ac91 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:26.662288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-63e5e716-ab95-410f-b870-f2dc0022ac91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:26.685446 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 971/1955] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:26.693455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5e716-ab95-410f-b870-f2dc0022ac91 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:26.704280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5e716-ab95-410f-b870-f2dc0022ac91 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:26.730023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c271c0-a233-40c2-b061-0a26f84b47c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:26.730697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c271c0-a233-40c2-b061-0a26f84b47c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:26.730983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c271c0-a233-40c2-b061-0a26f84b47c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:26.731260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c271c0-a233-40c2-b061-0a26f84b47c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:26.733905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c271c0-a233-40c2-b061-0a26f84b47c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:22:26.734283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c271c0-a233-40c2-b061-0a26f84b47c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:26.739505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c271c0-a233-40c2-b061-0a26f84b47c9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:26.757702 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 985/1956] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:26 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:26.776255 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 972/1957] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:26.802845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3635fa-2621-436d-8f03-01a2bc8fc9b6 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:26.809472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3635fa-2621-436d-8f03-01a2bc8fc9b6 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:26.815278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a878b95-d17c-446e-a1e5-aa5777c9f59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:26.816731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a878b95-d17c-446e-a1e5-aa5777c9f59e admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:26.817078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a878b95-d17c-446e-a1e5-aa5777c9f59e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:26.817362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a878b95-d17c-446e-a1e5-aa5777c9f59e admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:26.818266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a878b95-d17c-446e-a1e5-aa5777c9f59e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:26.823575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a878b95-d17c-446e-a1e5-aa5777c9f59e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:26.980246 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 986/1958] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:22:26 2022] POST /identity/v3/projects => generated 387 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:26.980910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c271c0-a233-40c2-b061-0a26f84b47c9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:27.001159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c271c0-a233-40c2-b061-0a26f84b47c9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:27.029752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:27.148730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4748008-f6a2-4b79-afb9-45a8da420183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:27.149378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4748008-f6a2-4b79-afb9-45a8da420183 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:27.149663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4748008-f6a2-4b79-afb9-45a8da420183 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:27.149934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4748008-f6a2-4b79-afb9-45a8da420183 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:27.150781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4748008-f6a2-4b79-afb9-45a8da420183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:27.153248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4748008-f6a2-4b79-afb9-45a8da420183 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:27.377079 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 973/1959] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:22:26 2022] POST /identity/v3/users => generated 294 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:27.381085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a878b95-d17c-446e-a1e5-aa5777c9f59e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:27.398605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a878b95-d17c-446e-a1e5-aa5777c9f59e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:27.426917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a83c7-4bc5-4179-9b67-08cd6105d0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:27.433965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a83c7-4bc5-4179-9b67-08cd6105d0bc admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:27.434298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a83c7-4bc5-4179-9b67-08cd6105d0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:27.434583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a83c7-4bc5-4179-9b67-08cd6105d0bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:27.444374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a83c7-4bc5-4179-9b67-08cd6105d0bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:27.447820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a83c7-4bc5-4179-9b67-08cd6105d0bc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:27.478499 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 987/1960] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:27.479328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4748008-f6a2-4b79-afb9-45a8da420183 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:27.494293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4748008-f6a2-4b79-afb9-45a8da420183 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:27.510958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86253f-12fb-4b81-9e23-f4b24052044c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:27.511600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86253f-12fb-4b81-9e23-f4b24052044c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:27.511887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86253f-12fb-4b81-9e23-f4b24052044c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:27.512158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86253f-12fb-4b81-9e23-f4b24052044c admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:27.512832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86253f-12fb-4b81-9e23-f4b24052044c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:27.515359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86253f-12fb-4b81-9e23-f4b24052044c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:27.563356 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 974/1961] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:27.569018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a83c7-4bc5-4179-9b67-08cd6105d0bc admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:27.582322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a83c7-4bc5-4179-9b67-08cd6105d0bc admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:27.597797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e11393-7b92-4b07-b8c2-f32ef3fc154e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:27.598807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e11393-7b92-4b07-b8c2-f32ef3fc154e admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:27.599301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e11393-7b92-4b07-b8c2-f32ef3fc154e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:27.599727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e11393-7b92-4b07-b8c2-f32ef3fc154e admin admin] PATH_INFO: `/v3/projects/ee5fbb2498294956a8b05f6bc6a375dc/users/665869c660524d4698a3c1871ee1e813/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:27.640254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e11393-7b92-4b07-b8c2-f32ef3fc154e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5fbb2498294956a8b05f6bc6a375dc, user_id=665869c660524d4698a3c1871ee1e813, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:27.644166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e11393-7b92-4b07-b8c2-f32ef3fc154e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:27.736787 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 988/1962] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:27 2022] PUT /identity/v3/projects/ee5fbb2498294956a8b05f6bc6a375dc/users/665869c660524d4698a3c1871ee1e813/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:27.745795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35590002-c2e7-4c28-9bee-ac07c1852ef7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:27.746345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35590002-c2e7-4c28-9bee-ac07c1852ef7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:27.746660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35590002-c2e7-4c28-9bee-ac07c1852ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:27.799780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e11393-7b92-4b07-b8c2-f32ef3fc154e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:27.800536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-35590002-c2e7-4c28-9bee-ac07c1852ef7 None None] MFA Rules not processed for user `665869c660524d4698a3c1871ee1e813`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:27.803206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-20e11393-7b92-4b07-b8c2-f32ef3fc154e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:27.803338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-35590002-c2e7-4c28-9bee-ac07c1852ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:28.005381 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 975/1963] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:28.007345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e11393-7b92-4b07-b8c2-f32ef3fc154e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:28.009862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35590002-c2e7-4c28-9bee-ac07c1852ef7 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:28.019119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb96e2-c3bf-439f-9007-a600e1e9374e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:28.020385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb96e2-c3bf-439f-9007-a600e1e9374e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:28.020673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb96e2-c3bf-439f-9007-a600e1e9374e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:28.020953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb96e2-c3bf-439f-9007-a600e1e9374e admin admin] PATH_INFO: `/v3/projects/22917d924b1c4258a190781b34e6c81d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:28.027873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb96e2-c3bf-439f-9007-a600e1e9374e admin admin] RBAC: Authorizing `identity:delete_project(project_id=22917d924b1c4258a190781b34e6c81d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:28.030360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb96e2-c3bf-439f-9007-a600e1e9374e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:28.037056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35590002-c2e7-4c28-9bee-ac07c1852ef7 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:28.052103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe41046-5015-4215-a0ab-e780b81996fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:28.052840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe41046-5015-4215-a0ab-e780b81996fb admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:28.053130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe41046-5015-4215-a0ab-e780b81996fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:28.053457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe41046-5015-4215-a0ab-e780b81996fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:28.054198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe41046-5015-4215-a0ab-e780b81996fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:28.060897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe41046-5015-4215-a0ab-e780b81996fb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:28.237681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fcdb96e2-c3bf-439f-9007-a600e1e9374e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22917d924b1c4258a190781b34e6c81d', 'request_id': 'req-fcdb96e2-c3bf-439f-9007-a600e1e9374e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:28.273602 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 976/1964] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:22:28 2022] POST /identity/v3/projects => generated 387 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:28.277656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe41046-5015-4215-a0ab-e780b81996fb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:28.284292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fcdb96e2-c3bf-439f-9007-a600e1e9374e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22917d924b1c4258a190781b34e6c81d', 'request_id': 'req-fcdb96e2-c3bf-439f-9007-a600e1e9374e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:28.305972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fcdb96e2-c3bf-439f-9007-a600e1e9374e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22917d924b1c4258a190781b34e6c81d', 'request_id': 'req-fcdb96e2-c3bf-439f-9007-a600e1e9374e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:28.416816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe41046-5015-4215-a0ab-e780b81996fb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:28.423814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb45093-9757-4551-b784-e29205a3c1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:28.424564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb45093-9757-4551-b784-e29205a3c1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:28.424998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb45093-9757-4551-b784-e29205a3c1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:28.425414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb45093-9757-4551-b784-e29205a3c1c7 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:28.426157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb45093-9757-4551-b784-e29205a3c1c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:28.428235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb45093-9757-4551-b784-e29205a3c1c7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:28.443811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fcdb96e2-c3bf-439f-9007-a600e1e9374e admin admin] The token cache is being invalidate because project 22917d924b1c4258a190781b34e6c81d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:28.443811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fcdb96e2-c3bf-439f-9007-a600e1e9374e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:28.443811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fcdb96e2-c3bf-439f-9007-a600e1e9374e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:28.447561 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 989/1965] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:27 2022] DELETE /identity/v3/projects/22917d924b1c4258a190781b34e6c81d => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:22:28.448534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb96e2-c3bf-439f-9007-a600e1e9374e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:28.453801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fcdb96e2-c3bf-439f-9007-a600e1e9374e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:28.535867 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 977/1966] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:22:28 2022] POST /identity/v3/users => generated 300 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:22:28.541970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb45093-9757-4551-b784-e29205a3c1c7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:28.545539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8bb45093-9757-4551-b784-e29205a3c1c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:28.581179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb45093-9757-4551-b784-e29205a3c1c7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:28.640962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87733dbf-4020-4f91-a0d0-ed3a011bf9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:28.641812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87733dbf-4020-4f91-a0d0-ed3a011bf9da admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:28.644903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87733dbf-4020-4f91-a0d0-ed3a011bf9da admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:28.645721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87733dbf-4020-4f91-a0d0-ed3a011bf9da admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:28.646597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87733dbf-4020-4f91-a0d0-ed3a011bf9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:28.653434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87733dbf-4020-4f91-a0d0-ed3a011bf9da admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:28.672135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb96e2-c3bf-439f-9007-a600e1e9374e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:28.689505 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 978/1967] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:28.691245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cf544-7578-4f67-9cec-963f1c9f0ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:28.693069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cf544-7578-4f67-9cec-963f1c9f0ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:28.693435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cf544-7578-4f67-9cec-963f1c9f0ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:28.694562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87733dbf-4020-4f91-a0d0-ed3a011bf9da admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:28.695265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cf544-7578-4f67-9cec-963f1c9f0ed2 admin admin] PATH_INFO: `/v3/users/2cef7271f7ef4a9a91f23002fc10ea75` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:28.699315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914cf544-7578-4f67-9cec-963f1c9f0ed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cef7271f7ef4a9a91f23002fc10ea75)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:28.704407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914cf544-7578-4f67-9cec-963f1c9f0ed2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:28.743461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87733dbf-4020-4f91-a0d0-ed3a011bf9da admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:28.784357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5b4a7-101d-4816-8eb2-7a3106c5e3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:28.788047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5b4a7-101d-4816-8eb2-7a3106c5e3ba admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:28.788762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5b4a7-101d-4816-8eb2-7a3106c5e3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:28.790794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5b4a7-101d-4816-8eb2-7a3106c5e3ba admin admin] PATH_INFO: `/v3/projects/de320df7fc054bddbb49e33f68f80eb2/users/0d6e4d437b7d47a899a9e59622648227/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:28.834806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5b4a7-101d-4816-8eb2-7a3106c5e3ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=de320df7fc054bddbb49e33f68f80eb2, user_id=0d6e4d437b7d47a899a9e59622648227, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:28.847051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5b4a7-101d-4816-8eb2-7a3106c5e3ba admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:28.949612 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 979/1968] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:28 2022] PUT /identity/v3/projects/de320df7fc054bddbb49e33f68f80eb2/users/0d6e4d437b7d47a899a9e59622648227/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:28.954599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5b4a7-101d-4816-8eb2-7a3106c5e3ba admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:28.967101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:28.993108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-914cf544-7578-4f67-9cec-963f1c9f0ed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cef7271f7ef4a9a91f23002fc10ea75'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:28.996874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-914cf544-7578-4f67-9cec-963f1c9f0ed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cef7271f7ef4a9a91f23002fc10ea75'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:29.029756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-914cf544-7578-4f67-9cec-963f1c9f0ed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cef7271f7ef4a9a91f23002fc10ea75'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:29.100835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-914cf544-7578-4f67-9cec-963f1c9f0ed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cef7271f7ef4a9a91f23002fc10ea75'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:29.107415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-914cf544-7578-4f67-9cec-963f1c9f0ed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cef7271f7ef4a9a91f23002fc10ea75'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:29.246342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5b4a7-101d-4816-8eb2-7a3106c5e3ba admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:29.251077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:29.253516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533c964-2e5b-4eee-a71b-ebf67afcc5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:29.254314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533c964-2e5b-4eee-a71b-ebf67afcc5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:29.254601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533c964-2e5b-4eee-a71b-ebf67afcc5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:29.254878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533c964-2e5b-4eee-a71b-ebf67afcc5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:29.255599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533c964-2e5b-4eee-a71b-ebf67afcc5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:29.257566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533c964-2e5b-4eee-a71b-ebf67afcc5b1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:29.260869 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 990/1969] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:22:28 2022] DELETE /identity/v3/users/2cef7271f7ef4a9a91f23002fc10ea75 => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:29.262411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896887e-493a-4bd8-bfa2-ef4218650e18 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:29.263386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896887e-493a-4bd8-bfa2-ef4218650e18 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:29.263930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896887e-493a-4bd8-bfa2-ef4218650e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:29.302191 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 980/1970] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:29.304127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533c964-2e5b-4eee-a71b-ebf67afcc5b1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:29.321447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3533c964-2e5b-4eee-a71b-ebf67afcc5b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:29.344971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533c964-2e5b-4eee-a71b-ebf67afcc5b1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:29.346322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d896887e-493a-4bd8-bfa2-ef4218650e18 None None] MFA Rules not processed for user `d3f1177e2cbd4ba6b659f8a714be86ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:29.350276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d896887e-493a-4bd8-bfa2-ef4218650e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:29.463738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f51a8d-9283-4b21-bc1e-45c72bd43356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:29.466053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f51a8d-9283-4b21-bc1e-45c72bd43356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:29.466943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f51a8d-9283-4b21-bc1e-45c72bd43356 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:29.467429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f51a8d-9283-4b21-bc1e-45c72bd43356 admin admin] PATH_INFO: `/v3/projects/ff89b96c02a246bdaac8fd686b817685` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:29.471617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f51a8d-9283-4b21-bc1e-45c72bd43356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff89b96c02a246bdaac8fd686b817685)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:29.475381 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 991/1971] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:29.480526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f51a8d-9283-4b21-bc1e-45c72bd43356 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:29.482532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896887e-493a-4bd8-bfa2-ef4218650e18 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:29.500197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d896887e-493a-4bd8-bfa2-ef4218650e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:29.528924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896887e-493a-4bd8-bfa2-ef4218650e18 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:29.535809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42edc34-d688-4096-a633-0e84ec38695e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:29.536026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42edc34-d688-4096-a633-0e84ec38695e admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:29.536378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42edc34-d688-4096-a633-0e84ec38695e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:29.536725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42edc34-d688-4096-a633-0e84ec38695e admin admin] PATH_INFO: `/v3/projects/de320df7fc054bddbb49e33f68f80eb2/users/0d6e4d437b7d47a899a9e59622648227/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:29.538785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42edc34-d688-4096-a633-0e84ec38695e admin admin] RBAC: Authorizing `identity:create_grant(project_id=de320df7fc054bddbb49e33f68f80eb2, user_id=0d6e4d437b7d47a899a9e59622648227, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:29.541602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42edc34-d688-4096-a633-0e84ec38695e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:29.566011 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 992/1972] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:29 2022] PUT /identity/v3/projects/de320df7fc054bddbb49e33f68f80eb2/users/0d6e4d437b7d47a899a9e59622648227/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:29.576460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91af91-43da-47f2-82ec-5230b984288d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:29.576745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91af91-43da-47f2-82ec-5230b984288d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:29.577009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91af91-43da-47f2-82ec-5230b984288d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:29.650738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1f91af91-43da-47f2-82ec-5230b984288d None None] MFA Rules not processed for user `0d6e4d437b7d47a899a9e59622648227`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:29.651977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1f91af91-43da-47f2-82ec-5230b984288d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:29.701415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c4f51a8d-9283-4b21-bc1e-45c72bd43356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff89b96c02a246bdaac8fd686b817685', 'request_id': 'req-c4f51a8d-9283-4b21-bc1e-45c72bd43356'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:29.785863 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 993/1973] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:29 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:22:29.829057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c4f51a8d-9283-4b21-bc1e-45c72bd43356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff89b96c02a246bdaac8fd686b817685', 'request_id': 'req-c4f51a8d-9283-4b21-bc1e-45c72bd43356'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:29.860436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c4f51a8d-9283-4b21-bc1e-45c72bd43356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff89b96c02a246bdaac8fd686b817685', 'request_id': 'req-c4f51a8d-9283-4b21-bc1e-45c72bd43356'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:29.890373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c4f51a8d-9283-4b21-bc1e-45c72bd43356 admin admin] The token cache is being invalidate because project ff89b96c02a246bdaac8fd686b817685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:29.890692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c4f51a8d-9283-4b21-bc1e-45c72bd43356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:29.891600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c4f51a8d-9283-4b21-bc1e-45c72bd43356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:29.922106 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 981/1974] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:29 2022] DELETE /identity/v3/projects/ff89b96c02a246bdaac8fd686b817685 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:29.924652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91af91-43da-47f2-82ec-5230b984288d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:29.962678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f51a8d-9283-4b21-bc1e-45c72bd43356 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:29.964253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c4f51a8d-9283-4b21-bc1e-45c72bd43356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:30.057088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91af91-43da-47f2-82ec-5230b984288d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:30.064270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f5e24-854b-4816-bba6-4fd7e0403cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:30.065061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f5e24-854b-4816-bba6-4fd7e0403cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:30.065345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f5e24-854b-4816-bba6-4fd7e0403cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:30.065620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f5e24-854b-4816-bba6-4fd7e0403cb7 admin admin] PATH_INFO: `/v3/users/f618c2e8fc5f41da9ab12c557e72a748` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:30.066913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f5e24-854b-4816-bba6-4fd7e0403cb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f618c2e8fc5f41da9ab12c557e72a748)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:30.069373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f5e24-854b-4816-bba6-4fd7e0403cb7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:30.166194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f51a8d-9283-4b21-bc1e-45c72bd43356 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:30.174371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee8ae6-0fbd-450d-b8ea-66424e41f1f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:30.175283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee8ae6-0fbd-450d-b8ea-66424e41f1f4 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:30.175571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee8ae6-0fbd-450d-b8ea-66424e41f1f4 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:30.175896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee8ae6-0fbd-450d-b8ea-66424e41f1f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:30.178020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-baee8ae6-0fbd-450d-b8ea-66424e41f1f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:30.209241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee8ae6-0fbd-450d-b8ea-66424e41f1f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:30.211787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee8ae6-0fbd-450d-b8ea-66424e41f1f4 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:30.234083 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 982/1975] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:29 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:22:30.349522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ba8f5e24-854b-4816-bba6-4fd7e0403cb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f618c2e8fc5f41da9ab12c557e72a748'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:30.351082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ba8f5e24-854b-4816-bba6-4fd7e0403cb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f618c2e8fc5f41da9ab12c557e72a748'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:30.366736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ba8f5e24-854b-4816-bba6-4fd7e0403cb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f618c2e8fc5f41da9ab12c557e72a748'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:30.385864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ba8f5e24-854b-4816-bba6-4fd7e0403cb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f618c2e8fc5f41da9ab12c557e72a748'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:30.386726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ba8f5e24-854b-4816-bba6-4fd7e0403cb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f618c2e8fc5f41da9ab12c557e72a748'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:30.495114 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 994/1976] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:22:29 2022] DELETE /identity/v3/users/f618c2e8fc5f41da9ab12c557e72a748 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:30.571016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee8ae6-0fbd-450d-b8ea-66424e41f1f4 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:30.572442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-baee8ae6-0fbd-450d-b8ea-66424e41f1f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:30.600186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee8ae6-0fbd-450d-b8ea-66424e41f1f4 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:30.819536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:30.830977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bcf07-b7f5-4059-baa1-a5e545ae4d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:30.832523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bcf07-b7f5-4059-baa1-a5e545ae4d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:30.832815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bcf07-b7f5-4059-baa1-a5e545ae4d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:30.833315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bcf07-b7f5-4059-baa1-a5e545ae4d03 admin admin] PATH_INFO: `/v3/projects/4b48298a698c4a6baa293ddb287b1b6c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:30.834445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bcf07-b7f5-4059-baa1-a5e545ae4d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b48298a698c4a6baa293ddb287b1b6c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:30.839755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bcf07-b7f5-4059-baa1-a5e545ae4d03 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:31.023990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:31.033503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0e1bcf07-b7f5-4059-baa1-a5e545ae4d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b48298a698c4a6baa293ddb287b1b6c', 'request_id': 'req-0e1bcf07-b7f5-4059-baa1-a5e545ae4d03'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:31.106298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0e1bcf07-b7f5-4059-baa1-a5e545ae4d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b48298a698c4a6baa293ddb287b1b6c', 'request_id': 'req-0e1bcf07-b7f5-4059-baa1-a5e545ae4d03'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:31.124888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0e1bcf07-b7f5-4059-baa1-a5e545ae4d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b48298a698c4a6baa293ddb287b1b6c', 'request_id': 'req-0e1bcf07-b7f5-4059-baa1-a5e545ae4d03'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:31.175648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0e1bcf07-b7f5-4059-baa1-a5e545ae4d03 admin admin] The token cache is being invalidate because project 4b48298a698c4a6baa293ddb287b1b6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:31.176614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0e1bcf07-b7f5-4059-baa1-a5e545ae4d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:31.177669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0e1bcf07-b7f5-4059-baa1-a5e545ae4d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:31.185137 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 983/1977] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:30 2022] DELETE /identity/v3/projects/4b48298a698c4a6baa293ddb287b1b6c => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:31.191390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73faad-45ef-4a87-8dd1-6349c1c739c6 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:31.191390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73faad-45ef-4a87-8dd1-6349c1c739c6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:31.191390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73faad-45ef-4a87-8dd1-6349c1c739c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:31.225797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0b73faad-45ef-4a87-8dd1-6349c1c739c6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:31.225797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0b73faad-45ef-4a87-8dd1-6349c1c739c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:31.327252 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 995/1978] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:31.329152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030f7bc-7ef1-432d-a1a5-fe0d358facd5 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:31.329650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030f7bc-7ef1-432d-a1a5-fe0d358facd5 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:31.330175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030f7bc-7ef1-432d-a1a5-fe0d358facd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:31.366018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9030f7bc-7ef1-432d-a1a5-fe0d358facd5 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:31.371048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9030f7bc-7ef1-432d-a1a5-fe0d358facd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:31.405668 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 984/1979] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:31.409604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73faad-45ef-4a87-8dd1-6349c1c739c6 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:31.425039 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73faad-45ef-4a87-8dd1-6349c1c739c6 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:31.431580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb022ade-01e6-4bb1-810a-8bbed8a109e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:31.432205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb022ade-01e6-4bb1-810a-8bbed8a109e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:31.432489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb022ade-01e6-4bb1-810a-8bbed8a109e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:31.432768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb022ade-01e6-4bb1-810a-8bbed8a109e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:31.433435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb022ade-01e6-4bb1-810a-8bbed8a109e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:22:31.433752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb022ade-01e6-4bb1-810a-8bbed8a109e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:31.435674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb022ade-01e6-4bb1-810a-8bbed8a109e4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:31.463627 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 996/1980] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:31.465561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030f7bc-7ef1-432d-a1a5-fe0d358facd5 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:31.479702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030f7bc-7ef1-432d-a1a5-fe0d358facd5 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:31.486269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29f243-d407-4df2-ba89-e8632331eac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:31.487001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29f243-d407-4df2-ba89-e8632331eac7 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:31.487285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29f243-d407-4df2-ba89-e8632331eac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:31.487563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29f243-d407-4df2-ba89-e8632331eac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:31.488218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29f243-d407-4df2-ba89-e8632331eac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:31.490352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29f243-d407-4df2-ba89-e8632331eac7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:31.644299 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 985/1981] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:22:31 2022] POST /identity/v3/projects => generated 391 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:31.646338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb022ade-01e6-4bb1-810a-8bbed8a109e4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:31.670850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb022ade-01e6-4bb1-810a-8bbed8a109e4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:31.745544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:31.847592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1dfb48-0adc-4123-8bea-4d5b859720a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:31.848185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dfb48-0adc-4123-8bea-4d5b859720a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:31.848525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dfb48-0adc-4123-8bea-4d5b859720a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:31.849980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dfb48-0adc-4123-8bea-4d5b859720a4 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:31.849980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1dfb48-0adc-4123-8bea-4d5b859720a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:31.851624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1dfb48-0adc-4123-8bea-4d5b859720a4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:32.018200 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 997/1982] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:22:31 2022] POST /identity/v3/users => generated 296 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:32.022223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29f243-d407-4df2-ba89-e8632331eac7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:32.041624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29f243-d407-4df2-ba89-e8632331eac7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:32.050725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c84ff-ac29-4e9a-bab3-e6cb882c50ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:32.051882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c84ff-ac29-4e9a-bab3-e6cb882c50ab admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:32.052238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c84ff-ac29-4e9a-bab3-e6cb882c50ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:32.052611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c84ff-ac29-4e9a-bab3-e6cb882c50ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:32.053490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c84ff-ac29-4e9a-bab3-e6cb882c50ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:32.059433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c84ff-ac29-4e9a-bab3-e6cb882c50ab admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:32.124074 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 986/1983] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:32.128084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1dfb48-0adc-4123-8bea-4d5b859720a4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:32.145508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1dfb48-0adc-4123-8bea-4d5b859720a4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:32.158642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821248f-4397-4c0a-8887-27a9b3b4d5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:32.160218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821248f-4397-4c0a-8887-27a9b3b4d5cb admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:32.160607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821248f-4397-4c0a-8887-27a9b3b4d5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:32.160783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821248f-4397-4c0a-8887-27a9b3b4d5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:32.162654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821248f-4397-4c0a-8887-27a9b3b4d5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:32.165357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821248f-4397-4c0a-8887-27a9b3b4d5cb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:32.224877 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 998/1984] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:32.229074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c84ff-ac29-4e9a-bab3-e6cb882c50ab admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:32.243796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c84ff-ac29-4e9a-bab3-e6cb882c50ab admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:32.254265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:32.262599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a226243-7a0e-45f6-b9c4-e9436e8e9758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:32.263591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a226243-7a0e-45f6-b9c4-e9436e8e9758 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:32.264246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a226243-7a0e-45f6-b9c4-e9436e8e9758 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:32.264531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a226243-7a0e-45f6-b9c4-e9436e8e9758 admin admin] PATH_INFO: `/v3/projects/c1ee7e2d45aa4bd8a689c177d00523ce/users/86dbff827560413aadaff08d8c5c9aeb/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:32.317927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a226243-7a0e-45f6-b9c4-e9436e8e9758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ee7e2d45aa4bd8a689c177d00523ce, user_id=86dbff827560413aadaff08d8c5c9aeb, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:32.322399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a226243-7a0e-45f6-b9c4-e9436e8e9758 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:32.407652 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 987/1985] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:32 2022] PUT /identity/v3/projects/c1ee7e2d45aa4bd8a689c177d00523ce/users/86dbff827560413aadaff08d8c5c9aeb/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:32.418491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34feb30-ed56-4f95-b976-02b68bd32576 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:32.418491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34feb30-ed56-4f95-b976-02b68bd32576 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:32.418736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34feb30-ed56-4f95-b976-02b68bd32576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:32.479806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e34feb30-ed56-4f95-b976-02b68bd32576 None None] MFA Rules not processed for user `86dbff827560413aadaff08d8c5c9aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:32.480946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e34feb30-ed56-4f95-b976-02b68bd32576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:32.655397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a226243-7a0e-45f6-b9c4-e9436e8e9758 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:32.657209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9a226243-7a0e-45f6-b9c4-e9436e8e9758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:32.793707 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 999/1986] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:32.799329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34feb30-ed56-4f95-b976-02b68bd32576 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:32.833122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34feb30-ed56-4f95-b976-02b68bd32576 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:32.848340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a226243-7a0e-45f6-b9c4-e9436e8e9758 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:32.848565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e52d89-e392-4664-9199-5d2076144259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:32.848987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e52d89-e392-4664-9199-5d2076144259 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:32.849276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e52d89-e392-4664-9199-5d2076144259 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:32.849558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e52d89-e392-4664-9199-5d2076144259 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:32.850255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e52d89-e392-4664-9199-5d2076144259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:32.852224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e52d89-e392-4664-9199-5d2076144259 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:32.868099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc70260-6fbf-4c2c-99a3-eb8b4f6716e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:32.869220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc70260-6fbf-4c2c-99a3-eb8b4f6716e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:32.869638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc70260-6fbf-4c2c-99a3-eb8b4f6716e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:32.870205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc70260-6fbf-4c2c-99a3-eb8b4f6716e0 admin admin] PATH_INFO: `/v3/projects/6b398cc596234acdaa77e5650b11a103` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:32.873942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc70260-6fbf-4c2c-99a3-eb8b4f6716e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b398cc596234acdaa77e5650b11a103)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:32.879413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc70260-6fbf-4c2c-99a3-eb8b4f6716e0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:33.027737 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1000/1987] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:22:32 2022] POST /identity/v3/projects => generated 391 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:33.032382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e52d89-e392-4664-9199-5d2076144259 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:33.085206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bdc70260-6fbf-4c2c-99a3-eb8b4f6716e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b398cc596234acdaa77e5650b11a103', 'request_id': 'req-bdc70260-6fbf-4c2c-99a3-eb8b4f6716e0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:33.158052 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e52d89-e392-4664-9199-5d2076144259 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:33.165862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e4769-11a2-48a1-8b90-8c827a9be5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:33.166554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e4769-11a2-48a1-8b90-8c827a9be5eb admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:33.167289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e4769-11a2-48a1-8b90-8c827a9be5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:33.167289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e4769-11a2-48a1-8b90-8c827a9be5eb admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:33.168026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e4769-11a2-48a1-8b90-8c827a9be5eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:33.170739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e4769-11a2-48a1-8b90-8c827a9be5eb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:33.227077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bdc70260-6fbf-4c2c-99a3-eb8b4f6716e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b398cc596234acdaa77e5650b11a103', 'request_id': 'req-bdc70260-6fbf-4c2c-99a3-eb8b4f6716e0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:33.243472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bdc70260-6fbf-4c2c-99a3-eb8b4f6716e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b398cc596234acdaa77e5650b11a103', 'request_id': 'req-bdc70260-6fbf-4c2c-99a3-eb8b4f6716e0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:33.271095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bdc70260-6fbf-4c2c-99a3-eb8b4f6716e0 admin admin] The token cache is being invalidate because project 6b398cc596234acdaa77e5650b11a103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:33.272891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bdc70260-6fbf-4c2c-99a3-eb8b4f6716e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:33.274947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bdc70260-6fbf-4c2c-99a3-eb8b4f6716e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:33.283554 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 988/1988] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:32 2022] DELETE /identity/v3/projects/6b398cc596234acdaa77e5650b11a103 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:33.285338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52153e-fb30-4e1c-867b-a968893327aa None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:33.285692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52153e-fb30-4e1c-867b-a968893327aa None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:33.286400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52153e-fb30-4e1c-867b-a968893327aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:33.339218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-2f52153e-fb30-4e1c-867b-a968893327aa None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:33.342204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2f52153e-fb30-4e1c-867b-a968893327aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:33.380931 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 989/1989] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:33.397076 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1001/1990] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:22:33 2022] POST /identity/v3/users => generated 302 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:22:33.399057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71115e-b3e2-4a3a-afe8-79060da4fcc3 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:33.400339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e4769-11a2-48a1-8b90-8c827a9be5eb admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:33.400964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71115e-b3e2-4a3a-afe8-79060da4fcc3 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:33.401241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71115e-b3e2-4a3a-afe8-79060da4fcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:33.403110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7e7e4769-11a2-48a1-8b90-8c827a9be5eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:33.428244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e4769-11a2-48a1-8b90-8c827a9be5eb admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:33.439138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a4b50-03d3-4012-9a66-74d1bf29cb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:33.440425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a4b50-03d3-4012-9a66-74d1bf29cb83 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:33.440710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a4b50-03d3-4012-9a66-74d1bf29cb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:33.440998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a4b50-03d3-4012-9a66-74d1bf29cb83 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:33.441664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a4b50-03d3-4012-9a66-74d1bf29cb83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:33.443851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a4b50-03d3-4012-9a66-74d1bf29cb83 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:33.445211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-cc71115e-b3e2-4a3a-afe8-79060da4fcc3 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:33.447844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cc71115e-b3e2-4a3a-afe8-79060da4fcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:33.461477 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1002/1991] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:33.462547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a4b50-03d3-4012-9a66-74d1bf29cb83 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:33.505876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a4b50-03d3-4012-9a66-74d1bf29cb83 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:33.513144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1b5bd-3257-49cb-ad7f-2bfe1aa2cc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:33.514757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1b5bd-3257-49cb-ad7f-2bfe1aa2cc36 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:33.515061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1b5bd-3257-49cb-ad7f-2bfe1aa2cc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:33.515308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1b5bd-3257-49cb-ad7f-2bfe1aa2cc36 admin admin] PATH_INFO: `/v3/projects/dc6eadc1c5ed437a946b928d4a8ea094/users/3ad7ea8d139b4563849295c4c11dfbe2/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:33.523626 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 990/1992] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:33.524930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71115e-b3e2-4a3a-afe8-79060da4fcc3 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:33.560040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71115e-b3e2-4a3a-afe8-79060da4fcc3 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:33.594062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1b5bd-3257-49cb-ad7f-2bfe1aa2cc36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc6eadc1c5ed437a946b928d4a8ea094, user_id=3ad7ea8d139b4563849295c4c11dfbe2, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:33.605516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1b5bd-3257-49cb-ad7f-2bfe1aa2cc36 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:33.679511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066c1da-0f08-4ef5-b889-099fb317c547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:33.681139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066c1da-0f08-4ef5-b889-099fb317c547 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:33.681139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066c1da-0f08-4ef5-b889-099fb317c547 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:33.681139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066c1da-0f08-4ef5-b889-099fb317c547 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:33.682521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066c1da-0f08-4ef5-b889-099fb317c547 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:22:33.682902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066c1da-0f08-4ef5-b889-099fb317c547 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:33.691213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066c1da-0f08-4ef5-b889-099fb317c547 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:33.750085 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 991/1993] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:33.753994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066c1da-0f08-4ef5-b889-099fb317c547 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:33.775395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066c1da-0f08-4ef5-b889-099fb317c547 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:33.792536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead513e-7dff-4f3b-b3b4-db17f44b0fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:33.792946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead513e-7dff-4f3b-b3b4-db17f44b0fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:33.793238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead513e-7dff-4f3b-b3b4-db17f44b0fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:33.793519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead513e-7dff-4f3b-b3b4-db17f44b0fb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:33.794259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead513e-7dff-4f3b-b3b4-db17f44b0fb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:33.797016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead513e-7dff-4f3b-b3b4-db17f44b0fb2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:34.688744 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 992/1994] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:22:33 2022] POST /identity/v3/projects => generated 389 bytes in 935 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:34.692300 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1003/1995] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:33 2022] PUT /identity/v3/projects/dc6eadc1c5ed437a946b928d4a8ea094/users/3ad7ea8d139b4563849295c4c11dfbe2/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 1230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:34.694138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead513e-7dff-4f3b-b3b4-db17f44b0fb2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:34.698159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1b5bd-3257-49cb-ad7f-2bfe1aa2cc36 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:34.930063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead513e-7dff-4f3b-b3b4-db17f44b0fb2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:34.949258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1b5bd-3257-49cb-ad7f-2bfe1aa2cc36 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:34.957016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe34c9-7d17-4fb9-bb49-86935bb4619e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:34.959400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe34c9-7d17-4fb9-bb49-86935bb4619e admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:34.959693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe34c9-7d17-4fb9-bb49-86935bb4619e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:34.962911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe34c9-7d17-4fb9-bb49-86935bb4619e admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:34.964218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe34c9-7d17-4fb9-bb49-86935bb4619e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:34.969668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba1a11-39db-42e2-8d02-9cb4f649e6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:34.984338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe34c9-7d17-4fb9-bb49-86935bb4619e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:34.984503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba1a11-39db-42e2-8d02-9cb4f649e6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:34.984503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba1a11-39db-42e2-8d02-9cb4f649e6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:34.984503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba1a11-39db-42e2-8d02-9cb4f649e6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:34.984503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba1a11-39db-42e2-8d02-9cb4f649e6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:34.984503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba1a11-39db-42e2-8d02-9cb4f649e6c4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:35.031464 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1004/1996] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:35.032896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba1a11-39db-42e2-8d02-9cb4f649e6c4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:35.064102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba1a11-39db-42e2-8d02-9cb4f649e6c4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:35.078498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb63a9-e0ba-4234-8b5b-fc44e2473443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:35.079257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb63a9-e0ba-4234-8b5b-fc44e2473443 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:35.079542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb63a9-e0ba-4234-8b5b-fc44e2473443 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:35.079819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb63a9-e0ba-4234-8b5b-fc44e2473443 admin admin] PATH_INFO: `/v3/projects/dc6eadc1c5ed437a946b928d4a8ea094/users/3ad7ea8d139b4563849295c4c11dfbe2/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:35.085294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb63a9-e0ba-4234-8b5b-fc44e2473443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc6eadc1c5ed437a946b928d4a8ea094, user_id=3ad7ea8d139b4563849295c4c11dfbe2, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:35.093524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb63a9-e0ba-4234-8b5b-fc44e2473443 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:35.123533 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 993/1997] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:22:34 2022] POST /identity/v3/users => generated 295 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:35.133750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe34c9-7d17-4fb9-bb49-86935bb4619e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:35.193558 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1005/1998] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:35 2022] PUT /identity/v3/projects/dc6eadc1c5ed437a946b928d4a8ea094/users/3ad7ea8d139b4563849295c4c11dfbe2/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:35.196167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe34c9-7d17-4fb9-bb49-86935bb4619e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:35.202136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422c461-b2af-499d-b3e5-58c5cacffa20 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:35.202439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422c461-b2af-499d-b3e5-58c5cacffa20 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:35.202721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422c461-b2af-499d-b3e5-58c5cacffa20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:35.389563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f422c461-b2af-499d-b3e5-58c5cacffa20 None None] MFA Rules not processed for user `3ad7ea8d139b4563849295c4c11dfbe2`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:35.395497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f422c461-b2af-499d-b3e5-58c5cacffa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:35.407095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:35.437948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134003d-4319-40bf-8022-987622bd4970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:35.440837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134003d-4319-40bf-8022-987622bd4970 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:35.443634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134003d-4319-40bf-8022-987622bd4970 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:35.443634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134003d-4319-40bf-8022-987622bd4970 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:35.443990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134003d-4319-40bf-8022-987622bd4970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:35.448680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134003d-4319-40bf-8022-987622bd4970 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:35.493146 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 994/1999] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:35.505723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134003d-4319-40bf-8022-987622bd4970 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:35.512765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b134003d-4319-40bf-8022-987622bd4970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:35.568429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134003d-4319-40bf-8022-987622bd4970 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:35.600191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747fd22-0ac0-4757-884a-81f6d8f375a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:35.600879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747fd22-0ac0-4757-884a-81f6d8f375a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:35.601176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747fd22-0ac0-4757-884a-81f6d8f375a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:35.605542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747fd22-0ac0-4757-884a-81f6d8f375a9 admin admin] PATH_INFO: `/v3/users/665869c660524d4698a3c1871ee1e813` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:35.610799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747fd22-0ac0-4757-884a-81f6d8f375a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=665869c660524d4698a3c1871ee1e813)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:35.617780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747fd22-0ac0-4757-884a-81f6d8f375a9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:35.665381 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1006/2000] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:35 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:35.670636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422c461-b2af-499d-b3e5-58c5cacffa20 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:35.708490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:35.721531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422c461-b2af-499d-b3e5-58c5cacffa20 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:35.749140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d6a53-0283-462b-ab5a-6977909fea5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:35.749715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d6a53-0283-462b-ab5a-6977909fea5e admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:35.755007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d6a53-0283-462b-ab5a-6977909fea5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:35.755370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d6a53-0283-462b-ab5a-6977909fea5e admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:35.756118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d6a53-0283-462b-ab5a-6977909fea5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:35.765691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d6a53-0283-462b-ab5a-6977909fea5e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:35.832261 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1007/2001] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:35.836705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d6a53-0283-462b-ab5a-6977909fea5e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:35.886594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d6a53-0283-462b-ab5a-6977909fea5e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:35.912404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2421f-aa9d-4930-83f5-f2cdfe839f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:35.913152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2421f-aa9d-4930-83f5-f2cdfe839f85 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:35.913385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2421f-aa9d-4930-83f5-f2cdfe839f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:35.913670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2421f-aa9d-4930-83f5-f2cdfe839f85 admin admin] PATH_INFO: `/v3/projects/7a25f000076e40d3adbeeba937ccdf3c/users/1fa33dfcf6b24ccc9bcc3cca54f4b713/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:35.913930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1747fd22-0ac0-4757-884a-81f6d8f375a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '665869c660524d4698a3c1871ee1e813'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:35.914974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1747fd22-0ac0-4757-884a-81f6d8f375a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '665869c660524d4698a3c1871ee1e813'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:35.948729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1747fd22-0ac0-4757-884a-81f6d8f375a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '665869c660524d4698a3c1871ee1e813'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:35.954861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2421f-aa9d-4930-83f5-f2cdfe839f85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a25f000076e40d3adbeeba937ccdf3c, user_id=1fa33dfcf6b24ccc9bcc3cca54f4b713, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:35.962823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2421f-aa9d-4930-83f5-f2cdfe839f85 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:35.976957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1747fd22-0ac0-4757-884a-81f6d8f375a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '665869c660524d4698a3c1871ee1e813'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:36.125786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1747fd22-0ac0-4757-884a-81f6d8f375a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '665869c660524d4698a3c1871ee1e813'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:36.134568 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 995/2002] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:22:35 2022] DELETE /identity/v3/users/665869c660524d4698a3c1871ee1e813 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:36.140477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d802b-c960-4dc4-b0c1-a00bda0cc1d7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:36.140791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d802b-c960-4dc4-b0c1-a00bda0cc1d7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:36.151813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d802b-c960-4dc4-b0c1-a00bda0cc1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:36.152260 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1008/2003] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:35 2022] PUT /identity/v3/projects/7a25f000076e40d3adbeeba937ccdf3c/users/1fa33dfcf6b24ccc9bcc3cca54f4b713/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:36.159190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79befca5-8f3d-4eaf-ab9c-87ec7bb05d31 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:36.159578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79befca5-8f3d-4eaf-ab9c-87ec7bb05d31 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:36.159869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79befca5-8f3d-4eaf-ab9c-87ec7bb05d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:36.242212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-808d802b-c960-4dc4-b0c1-a00bda0cc1d7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:36.243895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-79befca5-8f3d-4eaf-ab9c-87ec7bb05d31 None None] MFA Rules not processed for user `1fa33dfcf6b24ccc9bcc3cca54f4b713`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:36.244845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-808d802b-c960-4dc4-b0c1-a00bda0cc1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:36.245174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-79befca5-8f3d-4eaf-ab9c-87ec7bb05d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:36.368899 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1009/2004] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:36.370739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79befca5-8f3d-4eaf-ab9c-87ec7bb05d31 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:36.372102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-79befca5-8f3d-4eaf-ab9c-87ec7bb05d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:36.382659 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 996/2005] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:36.382659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d802b-c960-4dc4-b0c1-a00bda0cc1d7 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:36.382659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-808d802b-c960-4dc4-b0c1-a00bda0cc1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:36.456126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d802b-c960-4dc4-b0c1-a00bda0cc1d7 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:36.464527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71adaef-847f-490c-bf3f-ac09fb9dbcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:36.465606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71adaef-847f-490c-bf3f-ac09fb9dbcc2 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:36.466182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71adaef-847f-490c-bf3f-ac09fb9dbcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:36.466676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71adaef-847f-490c-bf3f-ac09fb9dbcc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:36.468337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71adaef-847f-490c-bf3f-ac09fb9dbcc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:36.471598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71adaef-847f-490c-bf3f-ac09fb9dbcc2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:36.534693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79befca5-8f3d-4eaf-ab9c-87ec7bb05d31 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:36.545564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511b684-94f2-4c3d-9bb0-c3ced42c25b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:36.545564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511b684-94f2-4c3d-9bb0-c3ced42c25b8 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:36.545851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511b684-94f2-4c3d-9bb0-c3ced42c25b8 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:36.546558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511b684-94f2-4c3d-9bb0-c3ced42c25b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:36.548560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e511b684-94f2-4c3d-9bb0-c3ced42c25b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:36.579122 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 997/2006] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:22:36 2022] POST /identity/v3/projects => generated 389 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:36.583176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71adaef-847f-490c-bf3f-ac09fb9dbcc2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:36.583176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a71adaef-847f-490c-bf3f-ac09fb9dbcc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:36.706907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71adaef-847f-490c-bf3f-ac09fb9dbcc2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:36.711383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b2398-42a0-449a-ae75-6d68a0e705a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:36.718606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b2398-42a0-449a-ae75-6d68a0e705a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:36.718955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b2398-42a0-449a-ae75-6d68a0e705a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:36.719532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b2398-42a0-449a-ae75-6d68a0e705a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:36.811558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e511b684-94f2-4c3d-9bb0-c3ced42c25b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:36.816843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e511b684-94f2-4c3d-9bb0-c3ced42c25b8 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:36.864781 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1010/2007] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:36 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:22:36.865952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511b684-94f2-4c3d-9bb0-c3ced42c25b8 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:36.870191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b2398-42a0-449a-ae75-6d68a0e705a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:36.881655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511b684-94f2-4c3d-9bb0-c3ced42c25b8 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:36.888818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b2398-42a0-449a-ae75-6d68a0e705a7 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:36.908341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86c3cc-da70-43a2-95e6-27132d4416d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:36.909015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86c3cc-da70-43a2-95e6-27132d4416d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:36.909302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86c3cc-da70-43a2-95e6-27132d4416d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:36.909632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86c3cc-da70-43a2-95e6-27132d4416d8 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:36.910257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86c3cc-da70-43a2-95e6-27132d4416d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:36.912347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86c3cc-da70-43a2-95e6-27132d4416d8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:36.934353 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 998/2008] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:22:37.024773 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1011/2009] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:22:36 2022] POST /identity/v3/users => generated 301 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:37.028185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b2398-42a0-449a-ae75-6d68a0e705a7 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:37.045298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b2398-42a0-449a-ae75-6d68a0e705a7 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:37.059606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7145a3-a379-498b-b2a0-5bcfee021155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:37.060240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7145a3-a379-498b-b2a0-5bcfee021155 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:37.061326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7145a3-a379-498b-b2a0-5bcfee021155 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:37.061607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7145a3-a379-498b-b2a0-5bcfee021155 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:37.062308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7145a3-a379-498b-b2a0-5bcfee021155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:37.064137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7145a3-a379-498b-b2a0-5bcfee021155 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:37.090647 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 999/2010] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:37.095463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86c3cc-da70-43a2-95e6-27132d4416d8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:37.106251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86c3cc-da70-43a2-95e6-27132d4416d8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:37.120244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8936ae-0388-4344-aa00-2fd77388bd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:37.121004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8936ae-0388-4344-aa00-2fd77388bd79 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:37.121362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8936ae-0388-4344-aa00-2fd77388bd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:37.121766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8936ae-0388-4344-aa00-2fd77388bd79 admin admin] PATH_INFO: `/v3/projects/11501ef7d9364663a804a90589d582ca/users/1ef38bfbae654fdf8c04424c94dc0b5e/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:37.139484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8936ae-0388-4344-aa00-2fd77388bd79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11501ef7d9364663a804a90589d582ca, user_id=1ef38bfbae654fdf8c04424c94dc0b5e, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:37.142459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8936ae-0388-4344-aa00-2fd77388bd79 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:37.212725 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1012/2011] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:37 2022] PUT /identity/v3/projects/11501ef7d9364663a804a90589d582ca/users/1ef38bfbae654fdf8c04424c94dc0b5e/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:37.220754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7145a3-a379-498b-b2a0-5bcfee021155 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:37.233556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7145a3-a379-498b-b2a0-5bcfee021155 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:37.302344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:37.330147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d069e-1455-453b-9d52-576bb25f992d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:37.331442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d069e-1455-453b-9d52-576bb25f992d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:37.331980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d069e-1455-453b-9d52-576bb25f992d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:37.332808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d069e-1455-453b-9d52-576bb25f992d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:37.334708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d069e-1455-453b-9d52-576bb25f992d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:37.337360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d069e-1455-453b-9d52-576bb25f992d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:37.356125 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1000/2012] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:37.360167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8936ae-0388-4344-aa00-2fd77388bd79 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:37.371234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8936ae-0388-4344-aa00-2fd77388bd79 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:37.378090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7927549-816e-4abf-85b6-58237e0418c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:37.378774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7927549-816e-4abf-85b6-58237e0418c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:37.384388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7927549-816e-4abf-85b6-58237e0418c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:37.384388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7927549-816e-4abf-85b6-58237e0418c1 admin admin] PATH_INFO: `/v3/projects/11501ef7d9364663a804a90589d582ca/users/1ef38bfbae654fdf8c04424c94dc0b5e/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:37.384388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7927549-816e-4abf-85b6-58237e0418c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11501ef7d9364663a804a90589d582ca, user_id=1ef38bfbae654fdf8c04424c94dc0b5e, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:37.384388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7927549-816e-4abf-85b6-58237e0418c1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:37.396219 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1013/2013] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:37 2022] PUT /identity/v3/projects/11501ef7d9364663a804a90589d582ca/users/1ef38bfbae654fdf8c04424c94dc0b5e/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:37.406980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4792c-5474-4356-acf9-a4b337ba2ea1 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:37.407325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4792c-5474-4356-acf9-a4b337ba2ea1 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:37.413392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4792c-5474-4356-acf9-a4b337ba2ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:37.461196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-59b4792c-5474-4356-acf9-a4b337ba2ea1 None None] MFA Rules not processed for user `1ef38bfbae654fdf8c04424c94dc0b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:37.462511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-59b4792c-5474-4356-acf9-a4b337ba2ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:37.556724 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1001/2014] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:37 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:37.705763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40746a5b-9d93-495e-9b5d-6bbaac44cc14 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:37.705763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40746a5b-9d93-495e-9b5d-6bbaac44cc14 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:37.705763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40746a5b-9d93-495e-9b5d-6bbaac44cc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:37.753441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:37.790619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-40746a5b-9d93-495e-9b5d-6bbaac44cc14 None None] MFA Rules not processed for user `ba89e0f8634941819e688be6aa9fde02`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:37.792994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-40746a5b-9d93-495e-9b5d-6bbaac44cc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:37.941375 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1014/2015] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:37.955476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049abf3a-6579-46e3-a0b5-05fe1912ffbf None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:37.955939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049abf3a-6579-46e3-a0b5-05fe1912ffbf None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:37.956262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049abf3a-6579-46e3-a0b5-05fe1912ffbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:37.970380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40746a5b-9d93-495e-9b5d-6bbaac44cc14 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:37.971997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-40746a5b-9d93-495e-9b5d-6bbaac44cc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:38.011310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-049abf3a-6579-46e3-a0b5-05fe1912ffbf None None] MFA Rules not processed for user `8c93886c5818439690564c2299a4f3ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:38.014281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-049abf3a-6579-46e3-a0b5-05fe1912ffbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:38.137170 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1002/2016] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:38.140386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049abf3a-6579-46e3-a0b5-05fe1912ffbf None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:38.142272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40746a5b-9d93-495e-9b5d-6bbaac44cc14 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:38.145763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-049abf3a-6579-46e3-a0b5-05fe1912ffbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:38.149359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e6a87-8804-4965-aecc-d6387aef80b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:38.150435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e6a87-8804-4965-aecc-d6387aef80b9 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:38.150905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e6a87-8804-4965-aecc-d6387aef80b9 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:38.151352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e6a87-8804-4965-aecc-d6387aef80b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:38.245941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e6a87-8804-4965-aecc-d6387aef80b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:38.247960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e6a87-8804-4965-aecc-d6387aef80b9 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:38.261560 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1015/2017] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:22:38.262674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e6a87-8804-4965-aecc-d6387aef80b9 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:38.277701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e6a87-8804-4965-aecc-d6387aef80b9 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:38.289943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049abf3a-6579-46e3-a0b5-05fe1912ffbf None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:38.291577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e25fe-9751-4762-86d8-f6a547b8dcc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:38.292858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e25fe-9751-4762-86d8-f6a547b8dcc6 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:38.294083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e25fe-9751-4762-86d8-f6a547b8dcc6 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:38.295147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e25fe-9751-4762-86d8-f6a547b8dcc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:38.298823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3c3e25fe-9751-4762-86d8-f6a547b8dcc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:38.303336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff317a0f-c0d6-435d-97f2-8db559062961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:38.305203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff317a0f-c0d6-435d-97f2-8db559062961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:38.306533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff317a0f-c0d6-435d-97f2-8db559062961 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:38.307013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff317a0f-c0d6-435d-97f2-8db559062961 admin admin] PATH_INFO: `/v3/users/86dbff827560413aadaff08d8c5c9aeb` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:38.309967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff317a0f-c0d6-435d-97f2-8db559062961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86dbff827560413aadaff08d8c5c9aeb)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:38.315296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff317a0f-c0d6-435d-97f2-8db559062961 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:38.332406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e25fe-9751-4762-86d8-f6a547b8dcc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:38.336530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e25fe-9751-4762-86d8-f6a547b8dcc6 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:38.353629 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1016/2018] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:22:38.354724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e25fe-9751-4762-86d8-f6a547b8dcc6 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:38.356729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3c3e25fe-9751-4762-86d8-f6a547b8dcc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:38.376111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e25fe-9751-4762-86d8-f6a547b8dcc6 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:38.384103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b3080-9883-49b4-8364-cf9bc5046792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:38.385143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b3080-9883-49b4-8364-cf9bc5046792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:38.385968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b3080-9883-49b4-8364-cf9bc5046792 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:38.386732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b3080-9883-49b4-8364-cf9bc5046792 admin admin] PATH_INFO: `/v3/projects/ee5fbb2498294956a8b05f6bc6a375dc` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:38.390277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b3080-9883-49b4-8364-cf9bc5046792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee5fbb2498294956a8b05f6bc6a375dc)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:38.395141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b3080-9883-49b4-8364-cf9bc5046792 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:38.577502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b66b3080-9883-49b4-8364-cf9bc5046792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee5fbb2498294956a8b05f6bc6a375dc', 'request_id': 'req-b66b3080-9883-49b4-8364-cf9bc5046792'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:38.584337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ff317a0f-c0d6-435d-97f2-8db559062961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86dbff827560413aadaff08d8c5c9aeb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:38.585264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ff317a0f-c0d6-435d-97f2-8db559062961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86dbff827560413aadaff08d8c5c9aeb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:38.587553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b66b3080-9883-49b4-8364-cf9bc5046792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee5fbb2498294956a8b05f6bc6a375dc', 'request_id': 'req-b66b3080-9883-49b4-8364-cf9bc5046792'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:38.611809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b66b3080-9883-49b4-8364-cf9bc5046792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee5fbb2498294956a8b05f6bc6a375dc', 'request_id': 'req-b66b3080-9883-49b4-8364-cf9bc5046792'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:38.621372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ff317a0f-c0d6-435d-97f2-8db559062961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86dbff827560413aadaff08d8c5c9aeb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:38.646634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ff317a0f-c0d6-435d-97f2-8db559062961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86dbff827560413aadaff08d8c5c9aeb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:38.725568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b66b3080-9883-49b4-8364-cf9bc5046792 admin admin] The token cache is being invalidate because project ee5fbb2498294956a8b05f6bc6a375dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:38.736865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b66b3080-9883-49b4-8364-cf9bc5046792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:38.736865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b66b3080-9883-49b4-8364-cf9bc5046792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:38.736865 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1017/2019] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:38 2022] DELETE /identity/v3/projects/ee5fbb2498294956a8b05f6bc6a375dc => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:38.736865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b3080-9883-49b4-8364-cf9bc5046792 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:38.738809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b66b3080-9883-49b4-8364-cf9bc5046792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:38.826656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b3080-9883-49b4-8364-cf9bc5046792 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:38.832466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57ce95-aac9-478e-8b1c-f44e871041c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:38.833200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57ce95-aac9-478e-8b1c-f44e871041c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:38.833494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57ce95-aac9-478e-8b1c-f44e871041c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:38.833776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57ce95-aac9-478e-8b1c-f44e871041c0 admin admin] PATH_INFO: `/v3/users/0d6e4d437b7d47a899a9e59622648227` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:38.835003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57ce95-aac9-478e-8b1c-f44e871041c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d6e4d437b7d47a899a9e59622648227)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:38.837285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57ce95-aac9-478e-8b1c-f44e871041c0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:38.838158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ff317a0f-c0d6-435d-97f2-8db559062961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86dbff827560413aadaff08d8c5c9aeb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:38.854191 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1003/2020] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:22:38 2022] DELETE /identity/v3/users/86dbff827560413aadaff08d8c5c9aeb => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:38.859314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f61ea-4fae-455c-99e4-dae5936d9f96 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:38.859928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f61ea-4fae-455c-99e4-dae5936d9f96 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:38.860393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f61ea-4fae-455c-99e4-dae5936d9f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:38.902625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4b6f61ea-4fae-455c-99e4-dae5936d9f96 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:38.903969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4b6f61ea-4fae-455c-99e4-dae5936d9f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:39.002784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:39.009202 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1004/2021] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:39.020358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f61ea-4fae-455c-99e4-dae5936d9f96 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:39.022955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4b6f61ea-4fae-455c-99e4-dae5936d9f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:39.062744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7e57ce95-aac9-478e-8b1c-f44e871041c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d6e4d437b7d47a899a9e59622648227'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:39.063455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7e57ce95-aac9-478e-8b1c-f44e871041c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d6e4d437b7d47a899a9e59622648227'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:39.081092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7e57ce95-aac9-478e-8b1c-f44e871041c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d6e4d437b7d47a899a9e59622648227'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:39.106668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7e57ce95-aac9-478e-8b1c-f44e871041c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d6e4d437b7d47a899a9e59622648227'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:39.108159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7e57ce95-aac9-478e-8b1c-f44e871041c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d6e4d437b7d47a899a9e59622648227'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:39.141228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f61ea-4fae-455c-99e4-dae5936d9f96 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:39.145216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b4920-bcd8-4fd9-a274-b6b719548e45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:39.145980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b4920-bcd8-4fd9-a274-b6b719548e45 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:39.146582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b4920-bcd8-4fd9-a274-b6b719548e45 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:39.146843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b4920-bcd8-4fd9-a274-b6b719548e45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:39.149340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-174b4920-bcd8-4fd9-a274-b6b719548e45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:39.153895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:39.167795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b4920-bcd8-4fd9-a274-b6b719548e45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:39.169567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b4920-bcd8-4fd9-a274-b6b719548e45 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:39.194419 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1005/2022] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:22:39.219952 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1018/2023] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:22:38 2022] DELETE /identity/v3/users/0d6e4d437b7d47a899a9e59622648227 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:40.434967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:40.500523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b4920-bcd8-4fd9-a274-b6b719548e45 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:40.502232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-174b4920-bcd8-4fd9-a274-b6b719548e45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:40.520579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b4920-bcd8-4fd9-a274-b6b719548e45 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:40.617506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57ce95-aac9-478e-8b1c-f44e871041c0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:40.619055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7e57ce95-aac9-478e-8b1c-f44e871041c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:40.661976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ea504-965e-4cba-8af7-5d934ee137f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:40.663761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ea504-965e-4cba-8af7-5d934ee137f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:40.664068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ea504-965e-4cba-8af7-5d934ee137f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:40.664348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ea504-965e-4cba-8af7-5d934ee137f7 admin admin] PATH_INFO: `/v3/projects/c1ee7e2d45aa4bd8a689c177d00523ce` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:40.666736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ea504-965e-4cba-8af7-5d934ee137f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1ee7e2d45aa4bd8a689c177d00523ce)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:40.668683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ea504-965e-4cba-8af7-5d934ee137f7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:40.791419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57ce95-aac9-478e-8b1c-f44e871041c0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:40.799194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b303df-db82-48e3-8e1b-0d2019feac92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:40.799952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b303df-db82-48e3-8e1b-0d2019feac92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:40.800297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b303df-db82-48e3-8e1b-0d2019feac92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:40.800643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b303df-db82-48e3-8e1b-0d2019feac92 admin admin] PATH_INFO: `/v3/projects/de320df7fc054bddbb49e33f68f80eb2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:40.802159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b303df-db82-48e3-8e1b-0d2019feac92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de320df7fc054bddbb49e33f68f80eb2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:40.804223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b303df-db82-48e3-8e1b-0d2019feac92 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:40.874157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e95ea504-965e-4cba-8af7-5d934ee137f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1ee7e2d45aa4bd8a689c177d00523ce', 'request_id': 'req-e95ea504-965e-4cba-8af7-5d934ee137f7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:40.962234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-72b303df-db82-48e3-8e1b-0d2019feac92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de320df7fc054bddbb49e33f68f80eb2', 'request_id': 'req-72b303df-db82-48e3-8e1b-0d2019feac92'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:40.970432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e95ea504-965e-4cba-8af7-5d934ee137f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1ee7e2d45aa4bd8a689c177d00523ce', 'request_id': 'req-e95ea504-965e-4cba-8af7-5d934ee137f7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:40.975204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-72b303df-db82-48e3-8e1b-0d2019feac92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de320df7fc054bddbb49e33f68f80eb2', 'request_id': 'req-72b303df-db82-48e3-8e1b-0d2019feac92'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:40.977763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e95ea504-965e-4cba-8af7-5d934ee137f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1ee7e2d45aa4bd8a689c177d00523ce', 'request_id': 'req-e95ea504-965e-4cba-8af7-5d934ee137f7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:40.991482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-72b303df-db82-48e3-8e1b-0d2019feac92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de320df7fc054bddbb49e33f68f80eb2', 'request_id': 'req-72b303df-db82-48e3-8e1b-0d2019feac92'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:41.026570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e95ea504-965e-4cba-8af7-5d934ee137f7 admin admin] The token cache is being invalidate because project c1ee7e2d45aa4bd8a689c177d00523ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:41.027013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e95ea504-965e-4cba-8af7-5d934ee137f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:41.033285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e95ea504-965e-4cba-8af7-5d934ee137f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:41.041180 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1006/2024] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:40 2022] DELETE /identity/v3/projects/c1ee7e2d45aa4bd8a689c177d00523ce => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:41.043452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ea504-965e-4cba-8af7-5d934ee137f7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:41.046017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e95ea504-965e-4cba-8af7-5d934ee137f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:41.135614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-72b303df-db82-48e3-8e1b-0d2019feac92 admin admin] The token cache is being invalidate because project de320df7fc054bddbb49e33f68f80eb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:41.136697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-72b303df-db82-48e3-8e1b-0d2019feac92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:41.137861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-72b303df-db82-48e3-8e1b-0d2019feac92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:41.141695 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1019/2025] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:40 2022] DELETE /identity/v3/projects/de320df7fc054bddbb49e33f68f80eb2 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:41.147448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8e3b2-eaf3-483f-bdbd-06f7437ad0cf None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:41.147448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8e3b2-eaf3-483f-bdbd-06f7437ad0cf None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:41.147448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8e3b2-eaf3-483f-bdbd-06f7437ad0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:41.213353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-82f8e3b2-eaf3-483f-bdbd-06f7437ad0cf None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:41.217715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-82f8e3b2-eaf3-483f-bdbd-06f7437ad0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:41.230014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ea504-965e-4cba-8af7-5d934ee137f7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:41.250003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:41.346818 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1020/2026] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:41.355530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0cd42-6a86-479b-819e-3df8e25d3d9d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:41.355942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0cd42-6a86-479b-819e-3df8e25d3d9d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:41.356226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0cd42-6a86-479b-819e-3df8e25d3d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:41.370463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ead1c-b180-4a61-9d1d-ab486e47bde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:41.371429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ead1c-b180-4a61-9d1d-ab486e47bde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:41.374119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ead1c-b180-4a61-9d1d-ab486e47bde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:41.374856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ead1c-b180-4a61-9d1d-ab486e47bde2 admin admin] PATH_INFO: `/v3/users/3ad7ea8d139b4563849295c4c11dfbe2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:41.382180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ead1c-b180-4a61-9d1d-ab486e47bde2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ad7ea8d139b4563849295c4c11dfbe2)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:41.385811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ead1c-b180-4a61-9d1d-ab486e47bde2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:41.396194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8aa0cd42-6a86-479b-819e-3df8e25d3d9d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:41.401729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8aa0cd42-6a86-479b-819e-3df8e25d3d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:41.439168 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1021/2027] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:22:41.443242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0cd42-6a86-479b-819e-3df8e25d3d9d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:41.477910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0cd42-6a86-479b-819e-3df8e25d3d9d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:41.490236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0049703-9c0f-4769-80f4-87af44412689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:41.490984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0049703-9c0f-4769-80f4-87af44412689 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:41.492885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0049703-9c0f-4769-80f4-87af44412689 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:41.493423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0049703-9c0f-4769-80f4-87af44412689 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:41.494890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0049703-9c0f-4769-80f4-87af44412689 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:22:41.495965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0049703-9c0f-4769-80f4-87af44412689 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:41.501659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0049703-9c0f-4769-80f4-87af44412689 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:41.537241 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1022/2028] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:41.541432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0049703-9c0f-4769-80f4-87af44412689 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:41.558753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0049703-9c0f-4769-80f4-87af44412689 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:41.565460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd91112-6399-49f6-ba98-a7343eae90b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:41.566233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd91112-6399-49f6-ba98-a7343eae90b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:41.567139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd91112-6399-49f6-ba98-a7343eae90b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:41.567139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd91112-6399-49f6-ba98-a7343eae90b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:41.567659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd91112-6399-49f6-ba98-a7343eae90b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:41.569637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd91112-6399-49f6-ba98-a7343eae90b0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:41.621896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3c0ead1c-b180-4a61-9d1d-ab486e47bde2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ad7ea8d139b4563849295c4c11dfbe2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:41.623627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3c0ead1c-b180-4a61-9d1d-ab486e47bde2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ad7ea8d139b4563849295c4c11dfbe2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:41.640248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3c0ead1c-b180-4a61-9d1d-ab486e47bde2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ad7ea8d139b4563849295c4c11dfbe2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:41.660511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3c0ead1c-b180-4a61-9d1d-ab486e47bde2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ad7ea8d139b4563849295c4c11dfbe2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:41.719481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3c0ead1c-b180-4a61-9d1d-ab486e47bde2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ad7ea8d139b4563849295c4c11dfbe2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:41.722132 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1023/2029] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:22:41 2022] POST /identity/v3/projects => generated 375 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:41.727247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd91112-6399-49f6-ba98-a7343eae90b0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:41.729069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0bd91112-6399-49f6-ba98-a7343eae90b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:41.733176 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1007/2030] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:22:41 2022] DELETE /identity/v3/users/3ad7ea8d139b4563849295c4c11dfbe2 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:41.858567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd91112-6399-49f6-ba98-a7343eae90b0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:41.943187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1bcdb-90af-4240-94ee-e760416a9a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:41.943819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1bcdb-90af-4240-94ee-e760416a9a72 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:41.944153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1bcdb-90af-4240-94ee-e760416a9a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:41.944375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1bcdb-90af-4240-94ee-e760416a9a72 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:41.945020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1bcdb-90af-4240-94ee-e760416a9a72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:41.946981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1bcdb-90af-4240-94ee-e760416a9a72 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:42.008670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ead1c-b180-4a61-9d1d-ab486e47bde2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:42.022216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3c0ead1c-b180-4a61-9d1d-ab486e47bde2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:42.025936 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1024/2031] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:22:41 2022] POST /identity/v3/users => generated 288 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:42.030568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1bcdb-90af-4240-94ee-e760416a9a72 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:42.040995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1bcdb-90af-4240-94ee-e760416a9a72 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:42.048419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d262cee-282e-4f9a-9329-15aa97035723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:42.049579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d262cee-282e-4f9a-9329-15aa97035723 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:42.049923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d262cee-282e-4f9a-9329-15aa97035723 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:42.050316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d262cee-282e-4f9a-9329-15aa97035723 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:42.051043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d262cee-282e-4f9a-9329-15aa97035723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:42.052778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d262cee-282e-4f9a-9329-15aa97035723 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:42.067590 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1025/2032] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:42.072643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d262cee-282e-4f9a-9329-15aa97035723 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:42.095999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d262cee-282e-4f9a-9329-15aa97035723 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:42.102115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d9705-0556-45ce-b185-91a03dfbecd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:42.102735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d9705-0556-45ce-b185-91a03dfbecd2 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:42.103020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d9705-0556-45ce-b185-91a03dfbecd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:42.103419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d9705-0556-45ce-b185-91a03dfbecd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:42.104141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d9705-0556-45ce-b185-91a03dfbecd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:42.106717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d9705-0556-45ce-b185-91a03dfbecd2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:42.124322 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1026/2033] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:22:42.125242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d9705-0556-45ce-b185-91a03dfbecd2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:42.135447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d9705-0556-45ce-b185-91a03dfbecd2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:42.137441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ead1c-b180-4a61-9d1d-ab486e47bde2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:42.142315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d3aeb-a573-4842-a6b1-c06507123f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:42.143262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d3aeb-a573-4842-a6b1-c06507123f6f admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:42.143458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d3aeb-a573-4842-a6b1-c06507123f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:42.143692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d3aeb-a573-4842-a6b1-c06507123f6f admin admin] PATH_INFO: `/v3/projects/6abd257f3bfc49b99f90d15daeb01867/users/6fdb175018924ebc8daee4d7e466f5d4/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:42.144970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c0971-3bd2-49f5-9f18-9b895cdf42b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:42.145597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c0971-3bd2-49f5-9f18-9b895cdf42b9 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:42.145946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c0971-3bd2-49f5-9f18-9b895cdf42b9 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:42.146291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c0971-3bd2-49f5-9f18-9b895cdf42b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:42.148520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d93c0971-3bd2-49f5-9f18-9b895cdf42b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:42.169164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d3aeb-a573-4842-a6b1-c06507123f6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6abd257f3bfc49b99f90d15daeb01867, user_id=6fdb175018924ebc8daee4d7e466f5d4, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:42.173640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d3aeb-a573-4842-a6b1-c06507123f6f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:42.249049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c0971-3bd2-49f5-9f18-9b895cdf42b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:42.249049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c0971-3bd2-49f5-9f18-9b895cdf42b9 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:42.259570 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1008/2034] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:42 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:22:42.327275 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1027/2035] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:42 2022] PUT /identity/v3/projects/6abd257f3bfc49b99f90d15daeb01867/users/6fdb175018924ebc8daee4d7e466f5d4/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:42.337691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54675c-2c38-472b-b983-3735b97ff414 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:42.338018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54675c-2c38-472b-b983-3735b97ff414 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:42.338515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54675c-2c38-472b-b983-3735b97ff414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:42.369577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0c54675c-2c38-472b-b983-3735b97ff414 None None] MFA Rules not processed for user `6fdb175018924ebc8daee4d7e466f5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:42.371674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0c54675c-2c38-472b-b983-3735b97ff414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:42.375300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1050e1-7475-4596-9934-c9a3f2dabc9c None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:42.376073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1050e1-7475-4596-9934-c9a3f2dabc9c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:42.376073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1050e1-7475-4596-9934-c9a3f2dabc9c None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:42.377501 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1028/2036] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 27 03:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:22:42.387209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391c7b7-46af-420a-bec4-7913a6fa2b4b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:42.387716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391c7b7-46af-420a-bec4-7913a6fa2b4b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:42.388167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391c7b7-46af-420a-bec4-7913a6fa2b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:42.426390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4391c7b7-46af-420a-bec4-7913a6fa2b4b None None] MFA Rules not processed for user `c20881251f2241a3a5ec2e5cf99db149`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:42.427661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4391c7b7-46af-420a-bec4-7913a6fa2b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:42.470845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:42.481140 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1009/2037] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:42.485447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54675c-2c38-472b-b983-3735b97ff414 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:42.565578 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1029/2038] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 03:22:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:22:42.566627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391c7b7-46af-420a-bec4-7913a6fa2b4b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:42.568196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4391c7b7-46af-420a-bec4-7913a6fa2b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:42.607300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54675c-2c38-472b-b983-3735b97ff414 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:42.613813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e71370-30ea-4a3c-8b5e-9086eaefe9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:42.615443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e71370-30ea-4a3c-8b5e-9086eaefe9ed admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:42.615830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e71370-30ea-4a3c-8b5e-9086eaefe9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:42.616110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e71370-30ea-4a3c-8b5e-9086eaefe9ed admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:42.616763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e71370-30ea-4a3c-8b5e-9086eaefe9ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:42.620487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e71370-30ea-4a3c-8b5e-9086eaefe9ed admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:42.658271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391c7b7-46af-420a-bec4-7913a6fa2b4b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:42.663999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b576cb-1e76-4ce2-bc87-4d5ba930c875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:42.664616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b576cb-1e76-4ce2-bc87-4d5ba930c875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:42.664901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b576cb-1e76-4ce2-bc87-4d5ba930c875 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:42.665180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b576cb-1e76-4ce2-bc87-4d5ba930c875 admin admin] PATH_INFO: `/v3/projects/dc6eadc1c5ed437a946b928d4a8ea094` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:42.666397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b576cb-1e76-4ce2-bc87-4d5ba930c875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc6eadc1c5ed437a946b928d4a8ea094)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:42.668345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b576cb-1e76-4ce2-bc87-4d5ba930c875 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:42.750632 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1010/2039] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:22:42 2022] POST /identity/v3/projects => generated 375 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:42.751670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e71370-30ea-4a3c-8b5e-9086eaefe9ed admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:42.763729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b4e71370-30ea-4a3c-8b5e-9086eaefe9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:42.848665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e71370-30ea-4a3c-8b5e-9086eaefe9ed admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:42.871805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-36b576cb-1e76-4ce2-bc87-4d5ba930c875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc6eadc1c5ed437a946b928d4a8ea094', 'request_id': 'req-36b576cb-1e76-4ce2-bc87-4d5ba930c875'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:42.906663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-36b576cb-1e76-4ce2-bc87-4d5ba930c875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc6eadc1c5ed437a946b928d4a8ea094', 'request_id': 'req-36b576cb-1e76-4ce2-bc87-4d5ba930c875'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:42.918755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aeff48-db60-4904-8c29-cdc708463e68 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:42.919456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aeff48-db60-4904-8c29-cdc708463e68 service glance] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:42.919738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aeff48-db60-4904-8c29-cdc708463e68 service glance] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:42.920531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aeff48-db60-4904-8c29-cdc708463e68 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:42.929108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-36b576cb-1e76-4ce2-bc87-4d5ba930c875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc6eadc1c5ed437a946b928d4a8ea094', 'request_id': 'req-36b576cb-1e76-4ce2-bc87-4d5ba930c875'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:43.050882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aeff48-db60-4904-8c29-cdc708463e68 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:43.052925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aeff48-db60-4904-8c29-cdc708463e68 service glance] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:43.066621 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1011/2040] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:22:43.067652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aeff48-db60-4904-8c29-cdc708463e68 service glance] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:43.068870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-36b576cb-1e76-4ce2-bc87-4d5ba930c875 admin admin] The token cache is being invalidate because project dc6eadc1c5ed437a946b928d4a8ea094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:43.069297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-36b576cb-1e76-4ce2-bc87-4d5ba930c875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:43.070313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-36b576cb-1e76-4ce2-bc87-4d5ba930c875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:43.075309 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1030/2041] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:42 2022] DELETE /identity/v3/projects/dc6eadc1c5ed437a946b928d4a8ea094 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:43.076999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92227a83-942e-4121-a551-6f0a35e4a5d2 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:43.077972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92227a83-942e-4121-a551-6f0a35e4a5d2 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:43.078528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92227a83-942e-4121-a551-6f0a35e4a5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:43.105734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-92227a83-942e-4121-a551-6f0a35e4a5d2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:43.108607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-92227a83-942e-4121-a551-6f0a35e4a5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:43.187052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aeff48-db60-4904-8c29-cdc708463e68 service glance] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:43.195004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e64909-8cc8-4f28-b700-02edc672a459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:43.195908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e64909-8cc8-4f28-b700-02edc672a459 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:43.197054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e64909-8cc8-4f28-b700-02edc672a459 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:43.197468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e64909-8cc8-4f28-b700-02edc672a459 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:43.198583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e64909-8cc8-4f28-b700-02edc672a459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:43.201167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e64909-8cc8-4f28-b700-02edc672a459 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:43.249251 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1031/2042] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:43.261895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae52d4-25c8-4790-b76e-40c1320ace31 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:43.262273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae52d4-25c8-4790-b76e-40c1320ace31 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:43.262551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae52d4-25c8-4790-b76e-40c1320ace31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:43.284175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-09ae52d4-25c8-4790-b76e-40c1320ace31 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:43.285642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-09ae52d4-25c8-4790-b76e-40c1320ace31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:43.293803 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1032/2043] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:22:43.298681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae52d4-25c8-4790-b76e-40c1320ace31 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:43.307661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae52d4-25c8-4790-b76e-40c1320ace31 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:43.312459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f09585-e9dd-4539-931a-224abdf26cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:43.313042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f09585-e9dd-4539-931a-224abdf26cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:43.313322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f09585-e9dd-4539-931a-224abdf26cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:43.313589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f09585-e9dd-4539-931a-224abdf26cb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:43.314268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f09585-e9dd-4539-931a-224abdf26cb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:22:43.314568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f09585-e9dd-4539-931a-224abdf26cb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:43.316157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f09585-e9dd-4539-931a-224abdf26cb0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:43.332610 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1033/2044] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:22:43.333567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f09585-e9dd-4539-931a-224abdf26cb0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:43.344183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f09585-e9dd-4539-931a-224abdf26cb0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:43.349414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c1b52-5ca6-433a-9bcb-0526cb0eacd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:43.350015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c1b52-5ca6-433a-9bcb-0526cb0eacd5 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:43.357384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c1b52-5ca6-433a-9bcb-0526cb0eacd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:43.357384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c1b52-5ca6-433a-9bcb-0526cb0eacd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:43.357384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c1b52-5ca6-433a-9bcb-0526cb0eacd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:43.358236 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1012/2045] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:22:43 2022] POST /identity/v3/users => generated 294 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:43.358324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c1b52-5ca6-433a-9bcb-0526cb0eacd5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:43.358943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e64909-8cc8-4f28-b700-02edc672a459 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:43.360631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d1e64909-8cc8-4f28-b700-02edc672a459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:43.372628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e64909-8cc8-4f28-b700-02edc672a459 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:43.377973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f0307-ac39-470d-a337-28762912f57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:43.383027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f0307-ac39-470d-a337-28762912f57f admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:43.383027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f0307-ac39-470d-a337-28762912f57f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:43.383027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f0307-ac39-470d-a337-28762912f57f admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:43.383027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f0307-ac39-470d-a337-28762912f57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:43.383027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f0307-ac39-470d-a337-28762912f57f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:43.395692 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1013/2046] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:22:43.395692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d107964-3f10-4616-8901-da88ee8023b2 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:43.395692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d107964-3f10-4616-8901-da88ee8023b2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:43.395692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d107964-3f10-4616-8901-da88ee8023b2 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:43.395692 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1014/2047] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 27 03:22:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:22:43.398884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d107964-3f10-4616-8901-da88ee8023b2 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:43.412555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d107964-3f10-4616-8901-da88ee8023b2 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:43.417866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09080e-d891-42c5-bd7c-989cb9276895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:43.418553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09080e-d891-42c5-bd7c-989cb9276895 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:43.418831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09080e-d891-42c5-bd7c-989cb9276895 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:43.419101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09080e-d891-42c5-bd7c-989cb9276895 admin admin] PATH_INFO: `/v3/projects/06455690bf904c49ab15a6b2531bd210/users/9621fcccb68a42a3a0f96c9430cd6748/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:43.435931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09080e-d891-42c5-bd7c-989cb9276895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06455690bf904c49ab15a6b2531bd210, user_id=9621fcccb68a42a3a0f96c9430cd6748, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:43.440087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09080e-d891-42c5-bd7c-989cb9276895 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:43.441418 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1034/2048] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:22:43 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:22:43.442994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d44e9-2f0d-4d09-b8bd-4456895aa5e0 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:43.443590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d44e9-2f0d-4d09-b8bd-4456895aa5e0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:43.444012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d44e9-2f0d-4d09-b8bd-4456895aa5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:43.466259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8a4d44e9-2f0d-4d09-b8bd-4456895aa5e0 None None] MFA Rules not processed for user `9b359391fbc34c259d987e42e8826c86`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:43.468169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8a4d44e9-2f0d-4d09-b8bd-4456895aa5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:43.518550 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1015/2049] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:43 2022] PUT /identity/v3/projects/06455690bf904c49ab15a6b2531bd210/users/9621fcccb68a42a3a0f96c9430cd6748/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:43.522505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09080e-d891-42c5-bd7c-989cb9276895 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:43.531422 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1035/2050] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 03:22:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:43.532693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d44e9-2f0d-4d09-b8bd-4456895aa5e0 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:43.591799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09080e-d891-42c5-bd7c-989cb9276895 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:43.596942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f286da-512f-41ba-90d6-613c0b948e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:43.597556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f286da-512f-41ba-90d6-613c0b948e89 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:43.597831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f286da-512f-41ba-90d6-613c0b948e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:43.598137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f286da-512f-41ba-90d6-613c0b948e89 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:43.601622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f286da-512f-41ba-90d6-613c0b948e89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:43.601622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f286da-512f-41ba-90d6-613c0b948e89 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:43.602483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d44e9-2f0d-4d09-b8bd-4456895aa5e0 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:43.607506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bb8e9-1c63-4159-8325-dc7c029cd5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:43.608167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bb8e9-1c63-4159-8325-dc7c029cd5aa admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:43.608447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bb8e9-1c63-4159-8325-dc7c029cd5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:43.608772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bb8e9-1c63-4159-8325-dc7c029cd5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:43.609416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22bb8e9-1c63-4159-8325-dc7c029cd5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:43.611218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22bb8e9-1c63-4159-8325-dc7c029cd5aa admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:43.621266 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1036/2051] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:43.622245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bb8e9-1c63-4159-8325-dc7c029cd5aa admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:43.623924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b22bb8e9-1c63-4159-8325-dc7c029cd5aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:43.680926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bb8e9-1c63-4159-8325-dc7c029cd5aa admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:43.685249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9440202-fcb0-4157-90e4-bcc69a470e18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:43.685870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9440202-fcb0-4157-90e4-bcc69a470e18 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:43.686186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9440202-fcb0-4157-90e4-bcc69a470e18 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:43.686447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9440202-fcb0-4157-90e4-bcc69a470e18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:43.693668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9440202-fcb0-4157-90e4-bcc69a470e18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:43.695123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9440202-fcb0-4157-90e4-bcc69a470e18 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:43.704141 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1037/2052] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:22:43.705350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9440202-fcb0-4157-90e4-bcc69a470e18 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:43.716612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9440202-fcb0-4157-90e4-bcc69a470e18 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:43.723362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ac6ee-8480-457c-ab42-3c14d981cc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:43.723698 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1016/2053] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:22:43 2022] POST /identity/v3/users => generated 288 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:43.724086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ac6ee-8480-457c-ab42-3c14d981cc5e admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:43.724375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ac6ee-8480-457c-ab42-3c14d981cc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:43.724645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ac6ee-8480-457c-ab42-3c14d981cc5e admin admin] PATH_INFO: `/v3/projects/06455690bf904c49ab15a6b2531bd210/users/9621fcccb68a42a3a0f96c9430cd6748/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:43.724865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f286da-512f-41ba-90d6-613c0b948e89 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:43.727316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ac6ee-8480-457c-ab42-3c14d981cc5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=06455690bf904c49ab15a6b2531bd210, user_id=9621fcccb68a42a3a0f96c9430cd6748, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:43.729812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ac6ee-8480-457c-ab42-3c14d981cc5e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:43.753479 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1038/2054] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:43 2022] PUT /identity/v3/projects/06455690bf904c49ab15a6b2531bd210/users/9621fcccb68a42a3a0f96c9430cd6748/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:43.755027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b79dfc-57b7-46cd-bbcc-2db6c3c82cd0 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:43.755354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b79dfc-57b7-46cd-bbcc-2db6c3c82cd0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:43.755585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b79dfc-57b7-46cd-bbcc-2db6c3c82cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:43.770962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f286da-512f-41ba-90d6-613c0b948e89 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:43.796629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-06b79dfc-57b7-46cd-bbcc-2db6c3c82cd0 None None] MFA Rules not processed for user `9621fcccb68a42a3a0f96c9430cd6748`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:43.797962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-06b79dfc-57b7-46cd-bbcc-2db6c3c82cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:43.899563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd4da6-39a8-49e5-ac13-7a9339111655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:43.900196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd4da6-39a8-49e5-ac13-7a9339111655 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:43.901789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd4da6-39a8-49e5-ac13-7a9339111655 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:43.901789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd4da6-39a8-49e5-ac13-7a9339111655 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:43.902567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd4da6-39a8-49e5-ac13-7a9339111655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:43.905496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd4da6-39a8-49e5-ac13-7a9339111655 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:43.920877 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1017/2055] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:43.921933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd4da6-39a8-49e5-ac13-7a9339111655 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:43.932883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd4da6-39a8-49e5-ac13-7a9339111655 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:43.942870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b886e32-32ce-4bbd-a747-4666facdd849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:43.943610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b886e32-32ce-4bbd-a747-4666facdd849 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:43.943907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b886e32-32ce-4bbd-a747-4666facdd849 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:43.944186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b886e32-32ce-4bbd-a747-4666facdd849 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:43.945130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b886e32-32ce-4bbd-a747-4666facdd849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:43.950067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b886e32-32ce-4bbd-a747-4666facdd849 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:43.954973 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1039/2056] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:43.956171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b79dfc-57b7-46cd-bbcc-2db6c3c82cd0 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:43.976092 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1018/2057] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:43.979007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b79dfc-57b7-46cd-bbcc-2db6c3c82cd0 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:43.982246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b886e32-32ce-4bbd-a747-4666facdd849 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:43.988914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c594b-10ac-420c-b711-96eac2807350 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9621fcccb68a42a3a0f96c9430cd6748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06455690bf904c49ab15a6b2531bd210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:43.989666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c594b-10ac-420c-b711-96eac2807350 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:43.991387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c594b-10ac-420c-b711-96eac2807350 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:43.991975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c594b-10ac-420c-b711-96eac2807350 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:43.997868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c594b-10ac-420c-b711-96eac2807350 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:22:43.997868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c594b-10ac-420c-b711-96eac2807350 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:43.997868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c594b-10ac-420c-b711-96eac2807350 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:44.006406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b886e32-32ce-4bbd-a747-4666facdd849 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:44.018129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:44.020677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9691054-c279-4406-8134-0d2ea79412f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:44.021431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9691054-c279-4406-8134-0d2ea79412f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:44.021563 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1040/2058] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:44.021666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9691054-c279-4406-8134-0d2ea79412f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:44.021926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9691054-c279-4406-8134-0d2ea79412f5 admin admin] PATH_INFO: `/v3/projects/eb71f70bee4046cd876f85cd1fcafa7b/users/626d9f148fcd42208423d46ff1bd4488/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:44.022708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c594b-10ac-420c-b711-96eac2807350 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:44.035872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c594b-10ac-420c-b711-96eac2807350 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:44.059398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9691054-c279-4406-8134-0d2ea79412f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb71f70bee4046cd876f85cd1fcafa7b, user_id=626d9f148fcd42208423d46ff1bd4488, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:44.062926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954b38e-8266-4e65-a138-34dd7605683b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9621fcccb68a42a3a0f96c9430cd6748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06455690bf904c49ab15a6b2531bd210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:44.062926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954b38e-8266-4e65-a138-34dd7605683b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:44.062926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954b38e-8266-4e65-a138-34dd7605683b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:44.067406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954b38e-8266-4e65-a138-34dd7605683b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:44.067728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:44.068193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954b38e-8266-4e65-a138-34dd7605683b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:44.068788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9691054-c279-4406-8134-0d2ea79412f5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:44.072520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954b38e-8266-4e65-a138-34dd7605683b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:44.167010 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1019/2059] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:43 2022] PUT /identity/v3/projects/eb71f70bee4046cd876f85cd1fcafa7b/users/626d9f148fcd42208423d46ff1bd4488/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:22:44.177567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b853c-1047-455d-a5c1-e109d07d4d17 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:44.178213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b853c-1047-455d-a5c1-e109d07d4d17 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:44.178919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b853c-1047-455d-a5c1-e109d07d4d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:44.232198 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1041/2060] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:22:44 2022] POST /identity/v3/projects => generated 369 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:44.233794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954b38e-8266-4e65-a138-34dd7605683b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:44.242659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b78b853c-1047-455d-a5c1-e109d07d4d17 None None] MFA Rules not processed for user `626d9f148fcd42208423d46ff1bd4488`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:44.244161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b78b853c-1047-455d-a5c1-e109d07d4d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:44.350707 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1020/2061] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:44.351943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b853c-1047-455d-a5c1-e109d07d4d17 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:44.357013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954b38e-8266-4e65-a138-34dd7605683b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:44.375086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70304fef-3377-468f-8753-9b9dd57ccad9 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9621fcccb68a42a3a0f96c9430cd6748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06455690bf904c49ab15a6b2531bd210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:44.375724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70304fef-3377-468f-8753-9b9dd57ccad9 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:44.376011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70304fef-3377-468f-8753-9b9dd57ccad9 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:44.376296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70304fef-3377-468f-8753-9b9dd57ccad9 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:44.377517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70304fef-3377-468f-8753-9b9dd57ccad9 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:22:44.377831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70304fef-3377-468f-8753-9b9dd57ccad9 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:44.379998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70304fef-3377-468f-8753-9b9dd57ccad9 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:44.401085 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1042/2062] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:44.478820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b853c-1047-455d-a5c1-e109d07d4d17 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:44.488063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae5250-1fdd-48a4-9446-d7fdbc2a7a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:44.488697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae5250-1fdd-48a4-9446-d7fdbc2a7a86 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:44.489125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae5250-1fdd-48a4-9446-d7fdbc2a7a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:44.489408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae5250-1fdd-48a4-9446-d7fdbc2a7a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:44.490063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae5250-1fdd-48a4-9446-d7fdbc2a7a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:44.492050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae5250-1fdd-48a4-9446-d7fdbc2a7a86 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:44.624984 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1021/2063] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:22:44 2022] POST /identity/v3/projects => generated 375 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:44.628787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70304fef-3377-468f-8753-9b9dd57ccad9 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:44.644977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70304fef-3377-468f-8753-9b9dd57ccad9 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:44.762736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d976c-43f2-4889-ad0e-7fcfdf058767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:44.765233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d976c-43f2-4889-ad0e-7fcfdf058767 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:44.765233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d976c-43f2-4889-ad0e-7fcfdf058767 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:44.765233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d976c-43f2-4889-ad0e-7fcfdf058767 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:44.765552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d976c-43f2-4889-ad0e-7fcfdf058767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:44.768249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d976c-43f2-4889-ad0e-7fcfdf058767 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:44.895731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae5250-1fdd-48a4-9446-d7fdbc2a7a86 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:44.896406 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1043/2064] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:22:44 2022] POST /identity/v3/users => generated 294 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:44.906567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae5250-1fdd-48a4-9446-d7fdbc2a7a86 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:44.912130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9e3e4-e9da-4ef7-ae2a-b240f9a3a15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:44.921984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9e3e4-e9da-4ef7-ae2a-b240f9a3a15b admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:44.921984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9e3e4-e9da-4ef7-ae2a-b240f9a3a15b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:44.921984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9e3e4-e9da-4ef7-ae2a-b240f9a3a15b admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:44.921984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9e3e4-e9da-4ef7-ae2a-b240f9a3a15b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:44.921984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9e3e4-e9da-4ef7-ae2a-b240f9a3a15b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:44.928765 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1022/2065] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:44.932656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d976c-43f2-4889-ad0e-7fcfdf058767 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:44.939596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9e3e4-e9da-4ef7-ae2a-b240f9a3a15b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:44.945293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d976c-43f2-4889-ad0e-7fcfdf058767 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:44.946785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dbc9e3e4-e9da-4ef7-ae2a-b240f9a3a15b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:44.952825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989c83a-f41f-41a7-8324-55dd8e74607d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:44.953496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989c83a-f41f-41a7-8324-55dd8e74607d admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:44.953785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989c83a-f41f-41a7-8324-55dd8e74607d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:44.954093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989c83a-f41f-41a7-8324-55dd8e74607d admin admin] PATH_INFO: `/v3/projects/d1de4698a8ba49e68c791ce70b7709f7/users/ea72f9aed79946e4960318361401b8cb/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:44.974990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989c83a-f41f-41a7-8324-55dd8e74607d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1de4698a8ba49e68c791ce70b7709f7, user_id=ea72f9aed79946e4960318361401b8cb, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:44.983410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989c83a-f41f-41a7-8324-55dd8e74607d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:45.033005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9e3e4-e9da-4ef7-ae2a-b240f9a3a15b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:45.039916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dbe28-b9ea-4327-ab19-38da1dba7dd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:45.040634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dbe28-b9ea-4327-ab19-38da1dba7dd8 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:45.040976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dbe28-b9ea-4327-ab19-38da1dba7dd8 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:45.041315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dbe28-b9ea-4327-ab19-38da1dba7dd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:45.070625 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1044/2066] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:44 2022] PUT /identity/v3/projects/d1de4698a8ba49e68c791ce70b7709f7/users/ea72f9aed79946e4960318361401b8cb/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:22:45.075442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989c83a-f41f-41a7-8324-55dd8e74607d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:45.122172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1dbe28-b9ea-4327-ab19-38da1dba7dd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:45.123871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1dbe28-b9ea-4327-ab19-38da1dba7dd8 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:45.150586 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1023/2067] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:22:45.174221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e8fc9-cedf-4810-b093-71c6b103d25d None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:45.174930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e8fc9-cedf-4810-b093-71c6b103d25d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:45.175287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e8fc9-cedf-4810-b093-71c6b103d25d None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:45.177920 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1024/2068] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:22:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:22:45.184636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e8fc9-cedf-4810-b093-71c6b103d25d None None] Authenticating service token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:22:45.198469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989c83a-f41f-41a7-8324-55dd8e74607d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:45.205297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d72108-533c-4afb-b063-193d8bbeaebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:45.205297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d72108-533c-4afb-b063-193d8bbeaebb admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:45.205823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d72108-533c-4afb-b063-193d8bbeaebb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:45.206533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d72108-533c-4afb-b063-193d8bbeaebb admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:45.207150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d72108-533c-4afb-b063-193d8bbeaebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:45.208867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d72108-533c-4afb-b063-193d8bbeaebb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:45.220739 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1045/2069] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:45.224736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d72108-533c-4afb-b063-193d8bbeaebb admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:45.238974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d72108-533c-4afb-b063-193d8bbeaebb admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:45.246163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd43b6-d00a-4574-b54f-8d91be918969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:45.247472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd43b6-d00a-4574-b54f-8d91be918969 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:45.248191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd43b6-d00a-4574-b54f-8d91be918969 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:45.248191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd43b6-d00a-4574-b54f-8d91be918969 admin admin] PATH_INFO: `/v3/projects/d1de4698a8ba49e68c791ce70b7709f7/users/ea72f9aed79946e4960318361401b8cb/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:45.254530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd43b6-d00a-4574-b54f-8d91be918969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1de4698a8ba49e68c791ce70b7709f7, user_id=ea72f9aed79946e4960318361401b8cb, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:45.258405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd43b6-d00a-4574-b54f-8d91be918969 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:45.285976 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1046/2070] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:45 2022] PUT /identity/v3/projects/d1de4698a8ba49e68c791ce70b7709f7/users/ea72f9aed79946e4960318361401b8cb/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:22:45.298331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1797d-ce09-47ec-b7b7-90f300f76e69 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:45.298331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1797d-ce09-47ec-b7b7-90f300f76e69 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:45.298331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1797d-ce09-47ec-b7b7-90f300f76e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:45.300111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e8fc9-cedf-4810-b093-71c6b103d25d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:45.332846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e1b1797d-ce09-47ec-b7b7-90f300f76e69 None None] MFA Rules not processed for user `ea72f9aed79946e4960318361401b8cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:45.334301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e1b1797d-ce09-47ec-b7b7-90f300f76e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:45.391142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:45.398460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e8fc9-cedf-4810-b093-71c6b103d25d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:45.453217 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1047/2071] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:22:45.469814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7732bb2-fd4a-4a53-8b00-01255c033052 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9621fcccb68a42a3a0f96c9430cd6748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06455690bf904c49ab15a6b2531bd210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:45.470690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7732bb2-fd4a-4a53-8b00-01255c033052 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:45.471083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7732bb2-fd4a-4a53-8b00-01255c033052 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:45.471468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7732bb2-fd4a-4a53-8b00-01255c033052 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] PATH_INFO: `/v3/projects/2364aaa9984f4132be525de73eb77a3e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:45.472971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7732bb2-fd4a-4a53-8b00-01255c033052 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorizing `identity:get_project(project_id=2364aaa9984f4132be525de73eb77a3e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:45.475353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7732bb2-fd4a-4a53-8b00-01255c033052 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:45.477360 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1025/2072] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:22:45 2022] GET /identity/v3/projects/2364aaa9984f4132be525de73eb77a3e => generated 369 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:22:46.207163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1797d-ce09-47ec-b7b7-90f300f76e69 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:46.217326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:46.299097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1797d-ce09-47ec-b7b7-90f300f76e69 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:46.306417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfd16c-f5b1-4e65-9af4-bb439aceb47b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:46.307002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfd16c-f5b1-4e65-9af4-bb439aceb47b service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:46.307236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfd16c-f5b1-4e65-9af4-bb439aceb47b service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:46.307605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfd16c-f5b1-4e65-9af4-bb439aceb47b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:46.318244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfd16c-f5b1-4e65-9af4-bb439aceb47b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:46.320094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfd16c-f5b1-4e65-9af4-bb439aceb47b service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:46.336638 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1048/2073] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:22:46.355743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db44afe-d5e3-4b01-b40a-01c49d4c3723 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:46.356328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db44afe-d5e3-4b01-b40a-01c49d4c3723 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:46.356619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db44afe-d5e3-4b01-b40a-01c49d4c3723 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:46.364306 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1026/2074] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:22:46 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:22:46.372420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfd16c-f5b1-4e65-9af4-bb439aceb47b service nova] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:22:46.375372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4fbfd16c-f5b1-4e65-9af4-bb439aceb47b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:46.397316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfd16c-f5b1-4e65-9af4-bb439aceb47b service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:46.409090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfd16c-f5b1-4e65-9af4-bb439aceb47b service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:46.416201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd341bb-7500-45da-9838-fe7e6110ae3c tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9621fcccb68a42a3a0f96c9430cd6748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06455690bf904c49ab15a6b2531bd210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:46.416472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd341bb-7500-45da-9838-fe7e6110ae3c tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:46.416764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd341bb-7500-45da-9838-fe7e6110ae3c tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:46.417195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd341bb-7500-45da-9838-fe7e6110ae3c tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] PATH_INFO: `/v3/projects/2364aaa9984f4132be525de73eb77a3e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:46.420677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd341bb-7500-45da-9838-fe7e6110ae3c tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorizing `identity:get_project(project_id=2364aaa9984f4132be525de73eb77a3e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:46.422384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd341bb-7500-45da-9838-fe7e6110ae3c tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:46.428606 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1049/2075] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:22:46 2022] GET /identity/v3/projects/2364aaa9984f4132be525de73eb77a3e => generated 369 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:46.820764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:47.001654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c4696-9c3a-484a-952f-594876ce59df None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:47.002280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c4696-9c3a-484a-952f-594876ce59df None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:47.002869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c4696-9c3a-484a-952f-594876ce59df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:47.031257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-114c4696-9c3a-484a-952f-594876ce59df None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:47.032656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-114c4696-9c3a-484a-952f-594876ce59df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:47.095958 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1027/2076] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:22:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:47.109423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd341bb-7500-45da-9838-fe7e6110ae3c tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:47.111985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8bd341bb-7500-45da-9838-fe7e6110ae3c tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:47.241409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd341bb-7500-45da-9838-fe7e6110ae3c tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:47.252675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce74ac-df25-4cd6-a945-a77df7105d20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:47.253523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce74ac-df25-4cd6-a945-a77df7105d20 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:47.253983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce74ac-df25-4cd6-a945-a77df7105d20 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:47.254308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce74ac-df25-4cd6-a945-a77df7105d20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:47.263722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce74ac-df25-4cd6-a945-a77df7105d20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:47.265601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce74ac-df25-4cd6-a945-a77df7105d20 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:47.274360 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1050/2077] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:22:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:22:47.708523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:47.790168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c79b6-aa2e-42fd-b4c6-bdaf8fbed849 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:47.790523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c79b6-aa2e-42fd-b4c6-bdaf8fbed849 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:47.793269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c79b6-aa2e-42fd-b4c6-bdaf8fbed849 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:47.793269 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1028/2078] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:22:47.802498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce74ac-df25-4cd6-a945-a77df7105d20 service swift] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:22:47.817252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce74ac-df25-4cd6-a945-a77df7105d20 service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:47.842915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce74ac-df25-4cd6-a945-a77df7105d20 service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:47.850450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f9f7b-0a67-48ab-91f1-9a798a339aea tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9621fcccb68a42a3a0f96c9430cd6748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06455690bf904c49ab15a6b2531bd210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:47.851997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f9f7b-0a67-48ab-91f1-9a798a339aea tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:47.862901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f9f7b-0a67-48ab-91f1-9a798a339aea tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:47.863195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f9f7b-0a67-48ab-91f1-9a798a339aea tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] PATH_INFO: `/v3/projects/2364aaa9984f4132be525de73eb77a3e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:47.865264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f9f7b-0a67-48ab-91f1-9a798a339aea tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorizing `identity:get_project(project_id=2364aaa9984f4132be525de73eb77a3e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:47.869041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f9f7b-0a67-48ab-91f1-9a798a339aea tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:47.890404 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1051/2079] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:22:47 2022] GET /identity/v3/projects/2364aaa9984f4132be525de73eb77a3e => generated 369 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:47.920639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c79b6-aa2e-42fd-b4c6-bdaf8fbed849 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:47.947842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c79b6-aa2e-42fd-b4c6-bdaf8fbed849 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:47.958904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca135ef4-9d03-46b1-ae05-87e377551b1b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9621fcccb68a42a3a0f96c9430cd6748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06455690bf904c49ab15a6b2531bd210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:47.961705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca135ef4-9d03-46b1-ae05-87e377551b1b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:47.961705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca135ef4-9d03-46b1-ae05-87e377551b1b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:47.961705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca135ef4-9d03-46b1-ae05-87e377551b1b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] PATH_INFO: `/v3/projects/2364aaa9984f4132be525de73eb77a3e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:47.962254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca135ef4-9d03-46b1-ae05-87e377551b1b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2364aaa9984f4132be525de73eb77a3e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:47.964192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca135ef4-9d03-46b1-ae05-87e377551b1b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:48.077588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:48.278600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ca135ef4-9d03-46b1-ae05-87e377551b1b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2364aaa9984f4132be525de73eb77a3e', 'request_id': 'req-ca135ef4-9d03-46b1-ae05-87e377551b1b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:48.365295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ca135ef4-9d03-46b1-ae05-87e377551b1b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2364aaa9984f4132be525de73eb77a3e', 'request_id': 'req-ca135ef4-9d03-46b1-ae05-87e377551b1b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:48.376002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ca135ef4-9d03-46b1-ae05-87e377551b1b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2364aaa9984f4132be525de73eb77a3e', 'request_id': 'req-ca135ef4-9d03-46b1-ae05-87e377551b1b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:48.403959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ca135ef4-9d03-46b1-ae05-87e377551b1b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] The token cache is being invalidate because project 2364aaa9984f4132be525de73eb77a3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:48.406054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ca135ef4-9d03-46b1-ae05-87e377551b1b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:48.408234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ca135ef4-9d03-46b1-ae05-87e377551b1b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:48.415391 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1029/2080] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:47 2022] DELETE /identity/v3/projects/2364aaa9984f4132be525de73eb77a3e => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:48.766244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f1827-b40f-4a9e-882a-bab625cd4129 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:48.769718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f1827-b40f-4a9e-882a-bab625cd4129 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:48.775748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f1827-b40f-4a9e-882a-bab625cd4129 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:48.775748 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1052/2081] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:22:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:22:48.789827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca135ef4-9d03-46b1-ae05-87e377551b1b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Authenticating service token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:22:48.791642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ca135ef4-9d03-46b1-ae05-87e377551b1b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:48.912472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:48.964832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:48.987804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca135ef4-9d03-46b1-ae05-87e377551b1b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:48.992308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ca135ef4-9d03-46b1-ae05-87e377551b1b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:49.116181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca135ef4-9d03-46b1-ae05-87e377551b1b tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:49.124729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af768b33-4d75-4db5-a632-fdd183859283 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9621fcccb68a42a3a0f96c9430cd6748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06455690bf904c49ab15a6b2531bd210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:49.126014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af768b33-4d75-4db5-a632-fdd183859283 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:49.126536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af768b33-4d75-4db5-a632-fdd183859283 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:49.127379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af768b33-4d75-4db5-a632-fdd183859283 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] PATH_INFO: `/v3/projects/6abd257f3bfc49b99f90d15daeb01867` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:49.129425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af768b33-4d75-4db5-a632-fdd183859283 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorizing `identity:get_project(project_id=6abd257f3bfc49b99f90d15daeb01867)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:49.131866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af768b33-4d75-4db5-a632-fdd183859283 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:49.135081 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1030/2082] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:22:48 2022] GET /identity/v3/projects/6abd257f3bfc49b99f90d15daeb01867 => generated 375 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:49.161779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f1827-b40f-4a9e-882a-bab625cd4129 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:49.187635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f1827-b40f-4a9e-882a-bab625cd4129 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:49.195261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb74e4-8eaf-4365-bf6d-8c9d79380425 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9621fcccb68a42a3a0f96c9430cd6748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06455690bf904c49ab15a6b2531bd210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:49.196084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb74e4-8eaf-4365-bf6d-8c9d79380425 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:49.196541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb74e4-8eaf-4365-bf6d-8c9d79380425 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:49.197049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb74e4-8eaf-4365-bf6d-8c9d79380425 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:49.198006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb74e4-8eaf-4365-bf6d-8c9d79380425 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:22:49.198492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb74e4-8eaf-4365-bf6d-8c9d79380425 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:49.200432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb74e4-8eaf-4365-bf6d-8c9d79380425 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:49.224131 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1053/2083] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:49.228142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af768b33-4d75-4db5-a632-fdd183859283 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:49.249484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af768b33-4d75-4db5-a632-fdd183859283 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:49.272765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29305a3e-8a0d-4ca8-81f9-e94ca15fe7b8 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9621fcccb68a42a3a0f96c9430cd6748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06455690bf904c49ab15a6b2531bd210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:49.273385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29305a3e-8a0d-4ca8-81f9-e94ca15fe7b8 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:49.273840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29305a3e-8a0d-4ca8-81f9-e94ca15fe7b8 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:49.274349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29305a3e-8a0d-4ca8-81f9-e94ca15fe7b8 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:49.275450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29305a3e-8a0d-4ca8-81f9-e94ca15fe7b8 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:49.277843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29305a3e-8a0d-4ca8-81f9-e94ca15fe7b8 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:49.435342 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1031/2084] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:22:49 2022] POST /identity/v3/projects => generated 369 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:22:49.440914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb74e4-8eaf-4365-bf6d-8c9d79380425 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:49.458594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb74e4-8eaf-4365-bf6d-8c9d79380425 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:49.573009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e96f3-7559-4be4-94eb-6aa06a304d8f tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9621fcccb68a42a3a0f96c9430cd6748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06455690bf904c49ab15a6b2531bd210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:49.573643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e96f3-7559-4be4-94eb-6aa06a304d8f tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:49.573932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e96f3-7559-4be4-94eb-6aa06a304d8f tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:49.574241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e96f3-7559-4be4-94eb-6aa06a304d8f tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:49.574976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e96f3-7559-4be4-94eb-6aa06a304d8f tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:22:49.575292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e96f3-7559-4be4-94eb-6aa06a304d8f tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:49.576980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e96f3-7559-4be4-94eb-6aa06a304d8f tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:49.591866 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1054/2085] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:50.030136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501573e6-c6da-4553-af19-87502fa3da6c None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:50.030813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501573e6-c6da-4553-af19-87502fa3da6c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:50.031005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501573e6-c6da-4553-af19-87502fa3da6c None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:50.040681 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1032/2086] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:22:50 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:22:50.044531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e96f3-7559-4be4-94eb-6aa06a304d8f tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:22:50.233916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e96f3-7559-4be4-94eb-6aa06a304d8f tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:50.257102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e96f3-7559-4be4-94eb-6aa06a304d8f tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:50.263391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7479fa-8638-440f-af88-494061cedb24 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9621fcccb68a42a3a0f96c9430cd6748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06455690bf904c49ab15a6b2531bd210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:50.409516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7479fa-8638-440f-af88-494061cedb24 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:50.409516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7479fa-8638-440f-af88-494061cedb24 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:50.409516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7479fa-8638-440f-af88-494061cedb24 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] PATH_INFO: `/v3/projects/63736868eaed44c29dbf61eab697cbb8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:50.409516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7479fa-8638-440f-af88-494061cedb24 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorizing `identity:get_project(project_id=63736868eaed44c29dbf61eab697cbb8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:50.410075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7479fa-8638-440f-af88-494061cedb24 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:50.410075 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1055/2087] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:22:50 2022] GET /identity/v3/projects/63736868eaed44c29dbf61eab697cbb8 => generated 369 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:51.057081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501573e6-c6da-4553-af19-87502fa3da6c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:51.060065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-501573e6-c6da-4553-af19-87502fa3da6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:51.115741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:51.208207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7479fa-8638-440f-af88-494061cedb24 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:51.210332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ac7479fa-8638-440f-af88-494061cedb24 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:51.260004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501573e6-c6da-4553-af19-87502fa3da6c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:51.270995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ad691-1c59-4f05-bcb7-4c400a374ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:51.275599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ad691-1c59-4f05-bcb7-4c400a374ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:51.275599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ad691-1c59-4f05-bcb7-4c400a374ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:51.275599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ad691-1c59-4f05-bcb7-4c400a374ce8 admin admin] PATH_INFO: `/v3/users/1fa33dfcf6b24ccc9bcc3cca54f4b713` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:51.278065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ad691-1c59-4f05-bcb7-4c400a374ce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa33dfcf6b24ccc9bcc3cca54f4b713)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:51.283931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ad691-1c59-4f05-bcb7-4c400a374ce8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:51.335529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7479fa-8638-440f-af88-494061cedb24 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:51.341280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58aee0-18bf-405b-b802-9614b5456762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:51.342513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58aee0-18bf-405b-b802-9614b5456762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:51.342798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58aee0-18bf-405b-b802-9614b5456762 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:51.343067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58aee0-18bf-405b-b802-9614b5456762 admin admin] PATH_INFO: `/v3/users/626d9f148fcd42208423d46ff1bd4488` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:51.344373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58aee0-18bf-405b-b802-9614b5456762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=626d9f148fcd42208423d46ff1bd4488)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:51.346872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58aee0-18bf-405b-b802-9614b5456762 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:51.559832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-510ad691-1c59-4f05-bcb7-4c400a374ce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa33dfcf6b24ccc9bcc3cca54f4b713'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:51.563162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-510ad691-1c59-4f05-bcb7-4c400a374ce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa33dfcf6b24ccc9bcc3cca54f4b713'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:51.589008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-510ad691-1c59-4f05-bcb7-4c400a374ce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa33dfcf6b24ccc9bcc3cca54f4b713'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:51.600728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:51.608523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bf58aee0-18bf-405b-b802-9614b5456762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '626d9f148fcd42208423d46ff1bd4488'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:51.610102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bf58aee0-18bf-405b-b802-9614b5456762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '626d9f148fcd42208423d46ff1bd4488'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:51.621961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-510ad691-1c59-4f05-bcb7-4c400a374ce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa33dfcf6b24ccc9bcc3cca54f4b713'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:51.642818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bf58aee0-18bf-405b-b802-9614b5456762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '626d9f148fcd42208423d46ff1bd4488'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:51.687283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bf58aee0-18bf-405b-b802-9614b5456762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '626d9f148fcd42208423d46ff1bd4488'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:51.688053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bf58aee0-18bf-405b-b802-9614b5456762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '626d9f148fcd42208423d46ff1bd4488'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:51.694427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-510ad691-1c59-4f05-bcb7-4c400a374ce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa33dfcf6b24ccc9bcc3cca54f4b713'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:51.704188 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1033/2088] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:22:51 2022] DELETE /identity/v3/users/1fa33dfcf6b24ccc9bcc3cca54f4b713 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:51.710435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3fede-1ff1-4af8-9fe9-a64b9ad8ae7a None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:51.711258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3fede-1ff1-4af8-9fe9-a64b9ad8ae7a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:51.711384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3fede-1ff1-4af8-9fe9-a64b9ad8ae7a None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:51.718867 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1034/2089] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:22:51 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:22:51.720517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5da4a1-9697-452b-bd82-b4f5ab4ea9fb None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:51.720939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5da4a1-9697-452b-bd82-b4f5ab4ea9fb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:51.721288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5da4a1-9697-452b-bd82-b4f5ab4ea9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:51.750320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-7e5da4a1-9697-452b-bd82-b4f5ab4ea9fb None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:51.751865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7e5da4a1-9697-452b-bd82-b4f5ab4ea9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:51.765756 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1056/2090] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:22:51 2022] DELETE /identity/v3/users/626d9f148fcd42208423d46ff1bd4488 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:51.765756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58aee0-18bf-405b-b802-9614b5456762 admin admin] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:22:51.770591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bf58aee0-18bf-405b-b802-9614b5456762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:51.857365 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1035/2091] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:51.859122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73409f9-79ac-4811-a4a3-3a006f31f845 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:51.859490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73409f9-79ac-4811-a4a3-3a006f31f845 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:51.859842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73409f9-79ac-4811-a4a3-3a006f31f845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:51.909411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c73409f9-79ac-4811-a4a3-3a006f31f845 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:51.910920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c73409f9-79ac-4811-a4a3-3a006f31f845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:51.993110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58aee0-18bf-405b-b802-9614b5456762 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:51.994429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bf58aee0-18bf-405b-b802-9614b5456762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:52.103437 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1036/2092] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:52.104690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73409f9-79ac-4811-a4a3-3a006f31f845 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:52.109676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c73409f9-79ac-4811-a4a3-3a006f31f845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:52.112545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58aee0-18bf-405b-b802-9614b5456762 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:52.118670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac753fa2-5a96-452c-8ad9-39206b7da6a3 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9621fcccb68a42a3a0f96c9430cd6748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06455690bf904c49ab15a6b2531bd210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:52.119476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac753fa2-5a96-452c-8ad9-39206b7da6a3 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:52.119899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac753fa2-5a96-452c-8ad9-39206b7da6a3 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:52.120198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac753fa2-5a96-452c-8ad9-39206b7da6a3 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] PATH_INFO: `/v3/projects/63736868eaed44c29dbf61eab697cbb8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:52.121385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac753fa2-5a96-452c-8ad9-39206b7da6a3 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorizing `identity:get_project(project_id=63736868eaed44c29dbf61eab697cbb8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:52.124804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac753fa2-5a96-452c-8ad9-39206b7da6a3 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:52.149226 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1057/2093] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:22:51 2022] GET /identity/v3/projects/63736868eaed44c29dbf61eab697cbb8 => generated 369 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:52.150404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac753fa2-5a96-452c-8ad9-39206b7da6a3 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:52.170749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ac753fa2-5a96-452c-8ad9-39206b7da6a3 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:52.325842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73409f9-79ac-4811-a4a3-3a006f31f845 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:52.337302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83b45c-0032-426e-81d6-d32d8ca2e26a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:52.338707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83b45c-0032-426e-81d6-d32d8ca2e26a service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:52.339146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83b45c-0032-426e-81d6-d32d8ca2e26a service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:52.344585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83b45c-0032-426e-81d6-d32d8ca2e26a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:52.354776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83b45c-0032-426e-81d6-d32d8ca2e26a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:52.356534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83b45c-0032-426e-81d6-d32d8ca2e26a service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:52.382286 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1037/2094] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:22:52.383050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83b45c-0032-426e-81d6-d32d8ca2e26a service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:52.390540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac753fa2-5a96-452c-8ad9-39206b7da6a3 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:52.406001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ec8fe-3422-4b3d-9571-f001a7fae839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:52.406701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ec8fe-3422-4b3d-9571-f001a7fae839 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:52.406987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ec8fe-3422-4b3d-9571-f001a7fae839 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:52.407264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ec8fe-3422-4b3d-9571-f001a7fae839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:52.415763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83b45c-0032-426e-81d6-d32d8ca2e26a service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:52.430815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932eb9b8-cb0b-4a54-952c-f726d0e9d3ef tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9621fcccb68a42a3a0f96c9430cd6748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06455690bf904c49ab15a6b2531bd210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:52.431441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932eb9b8-cb0b-4a54-952c-f726d0e9d3ef tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:52.437344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932eb9b8-cb0b-4a54-952c-f726d0e9d3ef tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:52.437344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932eb9b8-cb0b-4a54-952c-f726d0e9d3ef tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:52.440545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932eb9b8-cb0b-4a54-952c-f726d0e9d3ef tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:22:52.440868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932eb9b8-cb0b-4a54-952c-f726d0e9d3ef tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:52.443497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ec8fe-3422-4b3d-9571-f001a7fae839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:52.446185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932eb9b8-cb0b-4a54-952c-f726d0e9d3ef tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:52.449715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ec8fe-3422-4b3d-9571-f001a7fae839 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:52.464040 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1058/2095] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:22:52.479186 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1038/2096] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:52.485127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ec8fe-3422-4b3d-9571-f001a7fae839 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:52.486199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:52.497661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ec8fe-3422-4b3d-9571-f001a7fae839 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:52.503269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e7708-38f7-4d0c-b3f1-5fc7856609ce tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9621fcccb68a42a3a0f96c9430cd6748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06455690bf904c49ab15a6b2531bd210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:52.503885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e7708-38f7-4d0c-b3f1-5fc7856609ce tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:52.504340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e7708-38f7-4d0c-b3f1-5fc7856609ce tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:52.504628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e7708-38f7-4d0c-b3f1-5fc7856609ce tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:52.505333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e7708-38f7-4d0c-b3f1-5fc7856609ce tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:52.507745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e7708-38f7-4d0c-b3f1-5fc7856609ce tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:52.605981 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1059/2097] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:22:52 2022] POST /identity/v3/users => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:52.610916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932eb9b8-cb0b-4a54-952c-f726d0e9d3ef tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:52.621536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932eb9b8-cb0b-4a54-952c-f726d0e9d3ef tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:52.644090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03033bc0-99b4-43b7-8194-4e7ca47dcf6f tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9621fcccb68a42a3a0f96c9430cd6748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06455690bf904c49ab15a6b2531bd210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:52.644819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03033bc0-99b4-43b7-8194-4e7ca47dcf6f tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:52.645176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03033bc0-99b4-43b7-8194-4e7ca47dcf6f tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:52.645453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03033bc0-99b4-43b7-8194-4e7ca47dcf6f tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:52.648116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03033bc0-99b4-43b7-8194-4e7ca47dcf6f tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:22:52.648116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03033bc0-99b4-43b7-8194-4e7ca47dcf6f tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:52.648116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03033bc0-99b4-43b7-8194-4e7ca47dcf6f tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:52.680268 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1039/2098] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:52.713334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3678b-5cb4-4bc9-96b0-0242aba70a24 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:52.713650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3678b-5cb4-4bc9-96b0-0242aba70a24 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:52.714016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3678b-5cb4-4bc9-96b0-0242aba70a24 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:52.715283 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1060/2099] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:22:52.720815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03033bc0-99b4-43b7-8194-4e7ca47dcf6f tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Authenticating service token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:22:52.740145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03033bc0-99b4-43b7-8194-4e7ca47dcf6f tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:52.752021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03033bc0-99b4-43b7-8194-4e7ca47dcf6f tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:52.767644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025e175-4c81-4833-8eaf-9369fc40e782 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9621fcccb68a42a3a0f96c9430cd6748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06455690bf904c49ab15a6b2531bd210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:52.770180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025e175-4c81-4833-8eaf-9369fc40e782 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:52.770180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025e175-4c81-4833-8eaf-9369fc40e782 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:52.770180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025e175-4c81-4833-8eaf-9369fc40e782 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] PATH_INFO: `/v3/projects/63736868eaed44c29dbf61eab697cbb8` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:52.770444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025e175-4c81-4833-8eaf-9369fc40e782 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorizing `identity:get_project(project_id=63736868eaed44c29dbf61eab697cbb8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:52.773140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025e175-4c81-4833-8eaf-9369fc40e782 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:52.776433 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1040/2100] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:22:52 2022] GET /identity/v3/projects/63736868eaed44c29dbf61eab697cbb8 => generated 369 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:53.018972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3678b-5cb4-4bc9-96b0-0242aba70a24 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:53.021542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7fa3678b-5cb4-4bc9-96b0-0242aba70a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:53.050899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3678b-5cb4-4bc9-96b0-0242aba70a24 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:53.058508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0e84a-2f88-4429-a6ed-f1f07471514c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:53.059191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0e84a-2f88-4429-a6ed-f1f07471514c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:53.059475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0e84a-2f88-4429-a6ed-f1f07471514c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:53.059783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0e84a-2f88-4429-a6ed-f1f07471514c admin admin] PATH_INFO: `/v3/projects/7a25f000076e40d3adbeeba937ccdf3c` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:53.062991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0e84a-2f88-4429-a6ed-f1f07471514c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a25f000076e40d3adbeeba937ccdf3c)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:53.070383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0e84a-2f88-4429-a6ed-f1f07471514c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:53.130954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247167f-02d5-404e-ad19-debbbe7ca939 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:53.131928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247167f-02d5-404e-ad19-debbbe7ca939 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:53.132210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247167f-02d5-404e-ad19-debbbe7ca939 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:53.133566 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1041/2101] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:22:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:22:53.141261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247167f-02d5-404e-ad19-debbbe7ca939 None None] Authenticating service token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:22:53.160983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247167f-02d5-404e-ad19-debbbe7ca939 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:53.179949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247167f-02d5-404e-ad19-debbbe7ca939 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:53.197380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fed0c-2ed2-41e1-a2e3-ef2f5fadb154 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9621fcccb68a42a3a0f96c9430cd6748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06455690bf904c49ab15a6b2531bd210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:53.201226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fed0c-2ed2-41e1-a2e3-ef2f5fadb154 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:53.202443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fed0c-2ed2-41e1-a2e3-ef2f5fadb154 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:53.208281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fed0c-2ed2-41e1-a2e3-ef2f5fadb154 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] PATH_INFO: `/v3/projects/63736868eaed44c29dbf61eab697cbb8` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:53.208281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51fed0c-2ed2-41e1-a2e3-ef2f5fadb154 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorizing `identity:get_project(project_id=63736868eaed44c29dbf61eab697cbb8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:53.208281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51fed0c-2ed2-41e1-a2e3-ef2f5fadb154 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:53.209848 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1042/2102] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:22:53 2022] GET /identity/v3/projects/63736868eaed44c29dbf61eab697cbb8 => generated 369 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:53.266941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e5d0e84a-2f88-4429-a6ed-f1f07471514c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a25f000076e40d3adbeeba937ccdf3c', 'request_id': 'req-e5d0e84a-2f88-4429-a6ed-f1f07471514c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:53.290527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fed0c-2ed2-41e1-a2e3-ef2f5fadb154 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:53.291135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e5d0e84a-2f88-4429-a6ed-f1f07471514c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a25f000076e40d3adbeeba937ccdf3c', 'request_id': 'req-e5d0e84a-2f88-4429-a6ed-f1f07471514c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:53.299228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e5d0e84a-2f88-4429-a6ed-f1f07471514c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a25f000076e40d3adbeeba937ccdf3c', 'request_id': 'req-e5d0e84a-2f88-4429-a6ed-f1f07471514c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:53.309410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fed0c-2ed2-41e1-a2e3-ef2f5fadb154 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:53.413426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e5d0e84a-2f88-4429-a6ed-f1f07471514c admin admin] The token cache is being invalidate because project 7a25f000076e40d3adbeeba937ccdf3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:53.414732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e5d0e84a-2f88-4429-a6ed-f1f07471514c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:53.420892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e5d0e84a-2f88-4429-a6ed-f1f07471514c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:53.420892 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1061/2103] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:53 2022] DELETE /identity/v3/projects/7a25f000076e40d3adbeeba937ccdf3c => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:53.424017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0e84a-2f88-4429-a6ed-f1f07471514c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:53.425499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e5d0e84a-2f88-4429-a6ed-f1f07471514c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:53.465467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420982e-6ba7-43e8-84ec-f0c514d9b481 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9621fcccb68a42a3a0f96c9430cd6748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06455690bf904c49ab15a6b2531bd210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:53.466697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420982e-6ba7-43e8-84ec-f0c514d9b481 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:53.466697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420982e-6ba7-43e8-84ec-f0c514d9b481 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:53.466880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420982e-6ba7-43e8-84ec-f0c514d9b481 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] PATH_INFO: `/v3/users/e6536ab1b86946e996047dc6d0ba107f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:53.507744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420982e-6ba7-43e8-84ec-f0c514d9b481 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e6536ab1b86946e996047dc6d0ba107f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:53.511629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420982e-6ba7-43e8-84ec-f0c514d9b481 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:53.623453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0e84a-2f88-4429-a6ed-f1f07471514c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:53.634855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e100d-f91f-4922-bee5-9c50d3b8ca57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:53.635916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e100d-f91f-4922-bee5-9c50d3b8ca57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:53.636389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e100d-f91f-4922-bee5-9c50d3b8ca57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:53.645628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e100d-f91f-4922-bee5-9c50d3b8ca57 admin admin] PATH_INFO: `/v3/users/1ef38bfbae654fdf8c04424c94dc0b5e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:53.645628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e100d-f91f-4922-bee5-9c50d3b8ca57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ef38bfbae654fdf8c04424c94dc0b5e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:53.645628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e100d-f91f-4922-bee5-9c50d3b8ca57 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:53.733653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8420982e-6ba7-43e8-84ec-f0c514d9b481 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6536ab1b86946e996047dc6d0ba107f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:53.733653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8420982e-6ba7-43e8-84ec-f0c514d9b481 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6536ab1b86946e996047dc6d0ba107f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:53.748258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8420982e-6ba7-43e8-84ec-f0c514d9b481 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6536ab1b86946e996047dc6d0ba107f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:53.778083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8420982e-6ba7-43e8-84ec-f0c514d9b481 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6536ab1b86946e996047dc6d0ba107f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:53.874900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8420982e-6ba7-43e8-84ec-f0c514d9b481 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6536ab1b86946e996047dc6d0ba107f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:53.884161 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1043/2104] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:22:53 2022] DELETE /identity/v3/users/e6536ab1b86946e996047dc6d0ba107f => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:22:53.885412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420982e-6ba7-43e8-84ec-f0c514d9b481 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:53.887016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8420982e-6ba7-43e8-84ec-f0c514d9b481 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:53.954853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:53.957943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a64e100d-f91f-4922-bee5-9c50d3b8ca57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ef38bfbae654fdf8c04424c94dc0b5e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:53.960216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a64e100d-f91f-4922-bee5-9c50d3b8ca57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ef38bfbae654fdf8c04424c94dc0b5e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:53.968108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a64e100d-f91f-4922-bee5-9c50d3b8ca57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ef38bfbae654fdf8c04424c94dc0b5e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:53.986897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a64e100d-f91f-4922-bee5-9c50d3b8ca57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ef38bfbae654fdf8c04424c94dc0b5e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:53.988044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a64e100d-f91f-4922-bee5-9c50d3b8ca57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ef38bfbae654fdf8c04424c94dc0b5e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:54.051289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420982e-6ba7-43e8-84ec-f0c514d9b481 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:54.058760 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1062/2105] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:22:53 2022] DELETE /identity/v3/users/1ef38bfbae654fdf8c04424c94dc0b5e => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:54.063612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e100d-f91f-4922-bee5-9c50d3b8ca57 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:54.065612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a64e100d-f91f-4922-bee5-9c50d3b8ca57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:54.084672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc1ad5-266d-49b3-be57-4495729c675b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:54.088345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc1ad5-266d-49b3-be57-4495729c675b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:54.088934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc1ad5-266d-49b3-be57-4495729c675b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:54.090787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc1ad5-266d-49b3-be57-4495729c675b admin admin] PATH_INFO: `/v3/projects/eb71f70bee4046cd876f85cd1fcafa7b` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:54.094733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc1ad5-266d-49b3-be57-4495729c675b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb71f70bee4046cd876f85cd1fcafa7b)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:54.112470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc1ad5-266d-49b3-be57-4495729c675b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:54.304996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e100d-f91f-4922-bee5-9c50d3b8ca57 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:54.328459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a562f-f106-419a-8369-64d51dc9cd97 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9621fcccb68a42a3a0f96c9430cd6748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06455690bf904c49ab15a6b2531bd210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:54.330622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a562f-f106-419a-8369-64d51dc9cd97 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:54.339773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a562f-f106-419a-8369-64d51dc9cd97 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:54.340207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a562f-f106-419a-8369-64d51dc9cd97 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] PATH_INFO: `/v3/projects/63736868eaed44c29dbf61eab697cbb8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:54.346196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a562f-f106-419a-8369-64d51dc9cd97 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorizing `identity:delete_project(project_id=63736868eaed44c29dbf61eab697cbb8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:54.350227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a562f-f106-419a-8369-64d51dc9cd97 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:54.382072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dffc1ad5-266d-49b3-be57-4495729c675b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb71f70bee4046cd876f85cd1fcafa7b', 'request_id': 'req-dffc1ad5-266d-49b3-be57-4495729c675b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:54.505598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dffc1ad5-266d-49b3-be57-4495729c675b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb71f70bee4046cd876f85cd1fcafa7b', 'request_id': 'req-dffc1ad5-266d-49b3-be57-4495729c675b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:54.513141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dffc1ad5-266d-49b3-be57-4495729c675b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb71f70bee4046cd876f85cd1fcafa7b', 'request_id': 'req-dffc1ad5-266d-49b3-be57-4495729c675b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:54.536573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-664a562f-f106-419a-8369-64d51dc9cd97 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63736868eaed44c29dbf61eab697cbb8', 'request_id': 'req-664a562f-f106-419a-8369-64d51dc9cd97'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:54.539452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dffc1ad5-266d-49b3-be57-4495729c675b admin admin] The token cache is being invalidate because project eb71f70bee4046cd876f85cd1fcafa7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:54.539769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dffc1ad5-266d-49b3-be57-4495729c675b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:54.555988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dffc1ad5-266d-49b3-be57-4495729c675b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:54.557244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-664a562f-f106-419a-8369-64d51dc9cd97 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63736868eaed44c29dbf61eab697cbb8', 'request_id': 'req-664a562f-f106-419a-8369-64d51dc9cd97'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:54.557414 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1044/2106] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:53 2022] DELETE /identity/v3/projects/eb71f70bee4046cd876f85cd1fcafa7b => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:54.557414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc1ad5-266d-49b3-be57-4495729c675b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:54.557414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dffc1ad5-266d-49b3-be57-4495729c675b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:54.585803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-664a562f-f106-419a-8369-64d51dc9cd97 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63736868eaed44c29dbf61eab697cbb8', 'request_id': 'req-664a562f-f106-419a-8369-64d51dc9cd97'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:54.683606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-664a562f-f106-419a-8369-64d51dc9cd97 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] The token cache is being invalidate because project 63736868eaed44c29dbf61eab697cbb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:54.685230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-664a562f-f106-419a-8369-64d51dc9cd97 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:54.686679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-664a562f-f106-419a-8369-64d51dc9cd97 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:54.704983 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1063/2107] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:54 2022] DELETE /identity/v3/projects/63736868eaed44c29dbf61eab697cbb8 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:54.718540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc1ad5-266d-49b3-be57-4495729c675b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:54.840189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:54.872893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd75c1-c569-480e-a6a4-9ea99ba99bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:54.874505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd75c1-c569-480e-a6a4-9ea99ba99bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:54.874793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd75c1-c569-480e-a6a4-9ea99ba99bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:54.875216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd75c1-c569-480e-a6a4-9ea99ba99bd9 admin admin] PATH_INFO: `/v3/users/ea72f9aed79946e4960318361401b8cb` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:54.883795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd75c1-c569-480e-a6a4-9ea99ba99bd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea72f9aed79946e4960318361401b8cb)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:54.888353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd75c1-c569-480e-a6a4-9ea99ba99bd9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:55.007694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b8695-ebc3-4a3b-8f88-3f6b255395f1 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:55.007989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b8695-ebc3-4a3b-8f88-3f6b255395f1 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:55.008275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b8695-ebc3-4a3b-8f88-3f6b255395f1 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:55.009899 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1064/2108] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:22:55.019782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b8695-ebc3-4a3b-8f88-3f6b255395f1 None None] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:22:55.019782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-001b8695-ebc3-4a3b-8f88-3f6b255395f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:55.135860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dffd75c1-c569-480e-a6a4-9ea99ba99bd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea72f9aed79946e4960318361401b8cb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:55.139164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dffd75c1-c569-480e-a6a4-9ea99ba99bd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea72f9aed79946e4960318361401b8cb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:55.149748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dffd75c1-c569-480e-a6a4-9ea99ba99bd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea72f9aed79946e4960318361401b8cb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:55.165491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b8695-ebc3-4a3b-8f88-3f6b255395f1 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:55.167667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-001b8695-ebc3-4a3b-8f88-3f6b255395f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:55.173206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dffd75c1-c569-480e-a6a4-9ea99ba99bd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea72f9aed79946e4960318361401b8cb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:55.267971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dffd75c1-c569-480e-a6a4-9ea99ba99bd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea72f9aed79946e4960318361401b8cb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:55.276500 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1045/2109] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:22:54 2022] DELETE /identity/v3/users/ea72f9aed79946e4960318361401b8cb => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:55.277508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd75c1-c569-480e-a6a4-9ea99ba99bd9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:55.280666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dffd75c1-c569-480e-a6a4-9ea99ba99bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:55.288410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b8695-ebc3-4a3b-8f88-3f6b255395f1 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:55.382281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710b387-b31c-4781-89bb-85ae522a2d59 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9621fcccb68a42a3a0f96c9430cd6748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06455690bf904c49ab15a6b2531bd210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:55.383637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710b387-b31c-4781-89bb-85ae522a2d59 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:55.384131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710b387-b31c-4781-89bb-85ae522a2d59 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:55.384619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710b387-b31c-4781-89bb-85ae522a2d59 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] PATH_INFO: `/v3/projects/6abd257f3bfc49b99f90d15daeb01867` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:55.386600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710b387-b31c-4781-89bb-85ae522a2d59 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorizing `identity:get_project(project_id=6abd257f3bfc49b99f90d15daeb01867)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:55.390179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710b387-b31c-4781-89bb-85ae522a2d59 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:55.393524 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1065/2110] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:22:55 2022] GET /identity/v3/projects/6abd257f3bfc49b99f90d15daeb01867 => generated 375 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:22:55.427881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e22e3d-ae10-44bd-a9ed-d59e2aa8aa4f None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:55.428173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e22e3d-ae10-44bd-a9ed-d59e2aa8aa4f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:55.428612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e22e3d-ae10-44bd-a9ed-d59e2aa8aa4f None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:55.430128 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1066/2111] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:22:55.448517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e22e3d-ae10-44bd-a9ed-d59e2aa8aa4f None None] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:22:55.450235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e4e22e3d-ae10-44bd-a9ed-d59e2aa8aa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:55.464645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd75c1-c569-480e-a6a4-9ea99ba99bd9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:55.471361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58bdde-c7ab-46ce-9772-38f713ea64a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:55.473588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58bdde-c7ab-46ce-9772-38f713ea64a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:55.473588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58bdde-c7ab-46ce-9772-38f713ea64a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:55.474835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58bdde-c7ab-46ce-9772-38f713ea64a9 admin admin] PATH_INFO: `/v3/projects/11501ef7d9364663a804a90589d582ca` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:55.476487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58bdde-c7ab-46ce-9772-38f713ea64a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11501ef7d9364663a804a90589d582ca)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:55.479152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58bdde-c7ab-46ce-9772-38f713ea64a9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:55.598666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e22e3d-ae10-44bd-a9ed-d59e2aa8aa4f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:55.600101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e4e22e3d-ae10-44bd-a9ed-d59e2aa8aa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:55.614944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e22e3d-ae10-44bd-a9ed-d59e2aa8aa4f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:55.620178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb44030-303a-45b2-9e15-82bdd5ada08d tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9621fcccb68a42a3a0f96c9430cd6748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06455690bf904c49ab15a6b2531bd210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:55.620958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb44030-303a-45b2-9e15-82bdd5ada08d tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:55.621250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb44030-303a-45b2-9e15-82bdd5ada08d tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:55.621528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb44030-303a-45b2-9e15-82bdd5ada08d tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] PATH_INFO: `/v3/projects/6abd257f3bfc49b99f90d15daeb01867` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:55.622709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb44030-303a-45b2-9e15-82bdd5ada08d tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorizing `identity:get_project(project_id=6abd257f3bfc49b99f90d15daeb01867)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:55.625140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb44030-303a-45b2-9e15-82bdd5ada08d tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:55.627372 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1067/2112] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:22:55 2022] GET /identity/v3/projects/6abd257f3bfc49b99f90d15daeb01867 => generated 375 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:22:55.702662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3a58bdde-c7ab-46ce-9772-38f713ea64a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11501ef7d9364663a804a90589d582ca', 'request_id': 'req-3a58bdde-c7ab-46ce-9772-38f713ea64a9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:55.792856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3a58bdde-c7ab-46ce-9772-38f713ea64a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11501ef7d9364663a804a90589d582ca', 'request_id': 'req-3a58bdde-c7ab-46ce-9772-38f713ea64a9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:55.801662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3a58bdde-c7ab-46ce-9772-38f713ea64a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11501ef7d9364663a804a90589d582ca', 'request_id': 'req-3a58bdde-c7ab-46ce-9772-38f713ea64a9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:55.836721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3a58bdde-c7ab-46ce-9772-38f713ea64a9 admin admin] The token cache is being invalidate because project 11501ef7d9364663a804a90589d582ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:55.837018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3a58bdde-c7ab-46ce-9772-38f713ea64a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:55.837755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3a58bdde-c7ab-46ce-9772-38f713ea64a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:55.840734 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1046/2113] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:55 2022] DELETE /identity/v3/projects/11501ef7d9364663a804a90589d582ca => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:55.847066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03205b-2fd4-4950-8f41-a2b4a4e036e0 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:55.847358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03205b-2fd4-4950-8f41-a2b4a4e036e0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:55.847630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03205b-2fd4-4950-8f41-a2b4a4e036e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:55.876978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-cc03205b-2fd4-4950-8f41-a2b4a4e036e0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:55.879768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:55.880757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cc03205b-2fd4-4950-8f41-a2b4a4e036e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:56.005489 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1068/2114] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:56.013558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef54aa7-179c-4dee-8b54-ef296abf7f6c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:56.013847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef54aa7-179c-4dee-8b54-ef296abf7f6c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:56.014969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef54aa7-179c-4dee-8b54-ef296abf7f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:56.059893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-fef54aa7-179c-4dee-8b54-ef296abf7f6c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:56.063305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fef54aa7-179c-4dee-8b54-ef296abf7f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:56.096051 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1047/2115] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:56.104041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03205b-2fd4-4950-8f41-a2b4a4e036e0 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:56.116816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef54aa7-179c-4dee-8b54-ef296abf7f6c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:56.120020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fef54aa7-179c-4dee-8b54-ef296abf7f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:56.134957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03205b-2fd4-4950-8f41-a2b4a4e036e0 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:56.165167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef6f9e-9fdb-43d4-adf7-54f50571c23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:56.165823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef6f9e-9fdb-43d4-adf7-54f50571c23e admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:56.166137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef6f9e-9fdb-43d4-adf7-54f50571c23e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:56.166420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef6f9e-9fdb-43d4-adf7-54f50571c23e admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:56.167153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef6f9e-9fdb-43d4-adf7-54f50571c23e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:22:56.167486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef6f9e-9fdb-43d4-adf7-54f50571c23e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:56.170000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef6f9e-9fdb-43d4-adf7-54f50571c23e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:56.171846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef54aa7-179c-4dee-8b54-ef296abf7f6c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:56.191407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5389291-915a-46fe-9507-5bbdc9b031fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:56.192307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389291-915a-46fe-9507-5bbdc9b031fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:56.192774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389291-915a-46fe-9507-5bbdc9b031fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:56.193207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389291-915a-46fe-9507-5bbdc9b031fd admin admin] PATH_INFO: `/v3/projects/d1de4698a8ba49e68c791ce70b7709f7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:56.195733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5389291-915a-46fe-9507-5bbdc9b031fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1de4698a8ba49e68c791ce70b7709f7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:56.198539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5389291-915a-46fe-9507-5bbdc9b031fd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:56.228951 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1069/2116] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:56.233871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef6f9e-9fdb-43d4-adf7-54f50571c23e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:56.266806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef6f9e-9fdb-43d4-adf7-54f50571c23e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:56.291114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ece09e-708b-4912-858d-14154f621d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:56.291885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ece09e-708b-4912-858d-14154f621d67 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:56.292161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ece09e-708b-4912-858d-14154f621d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:56.292439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ece09e-708b-4912-858d-14154f621d67 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:56.293122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ece09e-708b-4912-858d-14154f621d67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:56.295069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ece09e-708b-4912-858d-14154f621d67 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:56.430962 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1070/2117] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:22:56 2022] POST /identity/v3/projects => generated 395 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:56.435807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ece09e-708b-4912-858d-14154f621d67 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:56.457555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5389291-915a-46fe-9507-5bbdc9b031fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1de4698a8ba49e68c791ce70b7709f7', 'request_id': 'req-a5389291-915a-46fe-9507-5bbdc9b031fd'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:56.527477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5389291-915a-46fe-9507-5bbdc9b031fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1de4698a8ba49e68c791ce70b7709f7', 'request_id': 'req-a5389291-915a-46fe-9507-5bbdc9b031fd'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:56.546017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5389291-915a-46fe-9507-5bbdc9b031fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1de4698a8ba49e68c791ce70b7709f7', 'request_id': 'req-a5389291-915a-46fe-9507-5bbdc9b031fd'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:56.560412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5389291-915a-46fe-9507-5bbdc9b031fd admin admin] The token cache is being invalidate because project d1de4698a8ba49e68c791ce70b7709f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:22:56.561679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5389291-915a-46fe-9507-5bbdc9b031fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:56.562927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5389291-915a-46fe-9507-5bbdc9b031fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:22:56.565531 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1048/2118] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:22:56 2022] DELETE /identity/v3/projects/d1de4698a8ba49e68c791ce70b7709f7 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:56.573380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca2ae4-701a-41a5-90b6-21a4e74326fd None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:56.574270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca2ae4-701a-41a5-90b6-21a4e74326fd None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:56.574756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca2ae4-701a-41a5-90b6-21a4e74326fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:56.595041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ece09e-708b-4912-858d-14154f621d67 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:56.608911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbab8e-2b24-4c12-a81b-f52df1805d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:56.620051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbab8e-2b24-4c12-a81b-f52df1805d86 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:56.622895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbab8e-2b24-4c12-a81b-f52df1805d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:56.623753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbab8e-2b24-4c12-a81b-f52df1805d86 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:56.625968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dbab8e-2b24-4c12-a81b-f52df1805d86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:56.631752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dbab8e-2b24-4c12-a81b-f52df1805d86 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:56.658554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9aca2ae4-701a-41a5-90b6-21a4e74326fd None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:56.658554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9aca2ae4-701a-41a5-90b6-21a4e74326fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:56.683037 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1049/2119] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:56.687483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b458ae-cdea-4a32-8035-778ad5f6f451 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:56.688947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b458ae-cdea-4a32-8035-778ad5f6f451 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:56.688947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b458ae-cdea-4a32-8035-778ad5f6f451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:56.719722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c7b458ae-cdea-4a32-8035-778ad5f6f451 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:56.721062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c7b458ae-cdea-4a32-8035-778ad5f6f451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:56.740795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:56.745031 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1071/2120] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:22:56 2022] POST /identity/v3/users => generated 298 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:22:56.749449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbab8e-2b24-4c12-a81b-f52df1805d86 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:56.752746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-18dbab8e-2b24-4c12-a81b-f52df1805d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:56.756475 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1050/2121] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:56.757398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b458ae-cdea-4a32-8035-778ad5f6f451 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:56.779039 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbab8e-2b24-4c12-a81b-f52df1805d86 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:56.782793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b458ae-cdea-4a32-8035-778ad5f6f451 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:56.786014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd3728-9c7b-4e36-ac23-ca83e4543e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:56.789495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd3728-9c7b-4e36-ac23-ca83e4543e87 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:56.790932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd3728-9c7b-4e36-ac23-ca83e4543e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:56.791678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd3728-9c7b-4e36-ac23-ca83e4543e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:56.793228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd3728-9c7b-4e36-ac23-ca83e4543e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:56.794380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2b5be-9822-4469-ae09-1299e038443f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:56.795014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2b5be-9822-4469-ae09-1299e038443f admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:56.795865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2b5be-9822-4469-ae09-1299e038443f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:56.796177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2b5be-9822-4469-ae09-1299e038443f admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:56.796844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2b5be-9822-4469-ae09-1299e038443f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:22:56.797148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2b5be-9822-4469-ae09-1299e038443f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:56.798779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2b5be-9822-4469-ae09-1299e038443f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:56.802200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd3728-9c7b-4e36-ac23-ca83e4543e87 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:56.831372 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1072/2122] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:56.832383 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1051/2123] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:56.834180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd3728-9c7b-4e36-ac23-ca83e4543e87 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:56.837273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2b5be-9822-4469-ae09-1299e038443f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:56.855843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd3728-9c7b-4e36-ac23-ca83e4543e87 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:56.868081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f070d-71e1-4c98-bf3e-f5d67b1010ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:56.869036 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f070d-71e1-4c98-bf3e-f5d67b1010ad admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:56.869339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f070d-71e1-4c98-bf3e-f5d67b1010ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:56.869915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f070d-71e1-4c98-bf3e-f5d67b1010ad admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:56.870645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f070d-71e1-4c98-bf3e-f5d67b1010ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:56.872778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f070d-71e1-4c98-bf3e-f5d67b1010ad admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:56.877207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2b5be-9822-4469-ae09-1299e038443f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:56.916879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c428d-089e-4abd-ab68-251802304a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:56.919186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c428d-089e-4abd-ab68-251802304a45 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:56.921981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c428d-089e-4abd-ab68-251802304a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:56.923325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c428d-089e-4abd-ab68-251802304a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:56.926223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c428d-089e-4abd-ab68-251802304a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:56.932511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c428d-089e-4abd-ab68-251802304a45 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:56.974768 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1052/2124] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:22:56.984320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c428d-089e-4abd-ab68-251802304a45 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:57.017771 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1073/2125] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:22:56 2022] POST /identity/v3/projects => generated 397 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:22:57.020904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c428d-089e-4abd-ab68-251802304a45 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:57.026398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f070d-71e1-4c98-bf3e-f5d67b1010ad admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:57.166354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:57.188565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f070d-71e1-4c98-bf3e-f5d67b1010ad admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:57.199979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc8e65-e54a-4163-9efa-137fd4d4a479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:57.200891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc8e65-e54a-4163-9efa-137fd4d4a479 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:57.201401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc8e65-e54a-4163-9efa-137fd4d4a479 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:57.202529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc8e65-e54a-4163-9efa-137fd4d4a479 admin admin] PATH_INFO: `/v3/projects/c18fabfb19904c5ea3c5c096d9d6cad7/users/7bd90bf4a2aa403cacd06bcaeb502640/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:57.203837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41554e-ac9f-47ff-9913-b7fd9f18a250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:57.206625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41554e-ac9f-47ff-9913-b7fd9f18a250 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:57.206933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41554e-ac9f-47ff-9913-b7fd9f18a250 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:57.207790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41554e-ac9f-47ff-9913-b7fd9f18a250 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:57.209339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41554e-ac9f-47ff-9913-b7fd9f18a250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:57.215971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41554e-ac9f-47ff-9913-b7fd9f18a250 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:57.230368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc8e65-e54a-4163-9efa-137fd4d4a479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c18fabfb19904c5ea3c5c096d9d6cad7, user_id=7bd90bf4a2aa403cacd06bcaeb502640, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:57.233306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc8e65-e54a-4163-9efa-137fd4d4a479 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:57.324442 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1053/2126] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:56 2022] PUT /identity/v3/projects/c18fabfb19904c5ea3c5c096d9d6cad7/users/7bd90bf4a2aa403cacd06bcaeb502640/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:57.325570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc8e65-e54a-4163-9efa-137fd4d4a479 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:57.336887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a8cc8e65-e54a-4163-9efa-137fd4d4a479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:57.338190 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1074/2127] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:22:57 2022] POST /identity/v3/users => generated 299 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:57.339709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b350edd-1d6b-4421-bdcc-77f7bc968b65 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:57.340238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b350edd-1d6b-4421-bdcc-77f7bc968b65 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:57.340742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b350edd-1d6b-4421-bdcc-77f7bc968b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:57.397297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6b350edd-1d6b-4421-bdcc-77f7bc968b65 None None] MFA Rules not processed for user `7bd90bf4a2aa403cacd06bcaeb502640`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:57.398808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6b350edd-1d6b-4421-bdcc-77f7bc968b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:57.531444 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1075/2128] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:57.531444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b350edd-1d6b-4421-bdcc-77f7bc968b65 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:57.558136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc8e65-e54a-4163-9efa-137fd4d4a479 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:57.583219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeeb6ea-af76-4b95-a7c3-134fa2ebee08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:57.584022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeeb6ea-af76-4b95-a7c3-134fa2ebee08 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:57.584378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeeb6ea-af76-4b95-a7c3-134fa2ebee08 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:57.584905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeeb6ea-af76-4b95-a7c3-134fa2ebee08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:57.587853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-afeeb6ea-af76-4b95-a7c3-134fa2ebee08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:57.647679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b350edd-1d6b-4421-bdcc-77f7bc968b65 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:57.654297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba19721-3372-4fb6-a305-b1b71127fdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:57.655342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba19721-3372-4fb6-a305-b1b71127fdee admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:57.655755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba19721-3372-4fb6-a305-b1b71127fdee admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:57.656611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba19721-3372-4fb6-a305-b1b71127fdee admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:57.657367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba19721-3372-4fb6-a305-b1b71127fdee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:57.659378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba19721-3372-4fb6-a305-b1b71127fdee admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:57.683361 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1076/2129] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:57.688330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfd76f-b6e7-4201-83de-c2383d5f9be9 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:57.688625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfd76f-b6e7-4201-83de-c2383d5f9be9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:57.688907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfd76f-b6e7-4201-83de-c2383d5f9be9 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:57.692354 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1077/2130] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:22:57 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:22:57.695737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfd76f-b6e7-4201-83de-c2383d5f9be9 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:57.720771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfd76f-b6e7-4201-83de-c2383d5f9be9 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:57.726938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354776c0-60d8-4e01-974a-85afbbf6637f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:57.727991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354776c0-60d8-4e01-974a-85afbbf6637f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:57.728284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354776c0-60d8-4e01-974a-85afbbf6637f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:57.728565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354776c0-60d8-4e01-974a-85afbbf6637f admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:57.729220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354776c0-60d8-4e01-974a-85afbbf6637f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:57.731814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354776c0-60d8-4e01-974a-85afbbf6637f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:57.743398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeeb6ea-af76-4b95-a7c3-134fa2ebee08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:57.747639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeeb6ea-af76-4b95-a7c3-134fa2ebee08 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:57.764527 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1054/2131] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:22:57.766241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeeb6ea-af76-4b95-a7c3-134fa2ebee08 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:57.778014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeeb6ea-af76-4b95-a7c3-134fa2ebee08 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:57.813948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c369a-ee97-4076-9009-f39f82f080fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:57.814855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c369a-ee97-4076-9009-f39f82f080fb admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:57.816634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c369a-ee97-4076-9009-f39f82f080fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:57.817384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c369a-ee97-4076-9009-f39f82f080fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:57.818941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c369a-ee97-4076-9009-f39f82f080fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:57.822362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c369a-ee97-4076-9009-f39f82f080fb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:57.837927 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1078/2132] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:22:57 2022] POST /identity/v3/projects => generated 393 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:57.839664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354776c0-60d8-4e01-974a-85afbbf6637f admin admin] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:22:57.843867 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1055/2133] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:57.847001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c369a-ee97-4076-9009-f39f82f080fb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:57.847726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-354776c0-60d8-4e01-974a-85afbbf6637f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:57.880279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c369a-ee97-4076-9009-f39f82f080fb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:57.987993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354776c0-60d8-4e01-974a-85afbbf6637f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:57.993218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-354776c0-60d8-4e01-974a-85afbbf6637f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:58.027626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1fb74-9668-4136-9e44-9a5fdac73c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:58.028735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1fb74-9668-4136-9e44-9a5fdac73c94 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:58.029237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1fb74-9668-4136-9e44-9a5fdac73c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:58.030478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1fb74-9668-4136-9e44-9a5fdac73c94 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:58.031451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1fb74-9668-4136-9e44-9a5fdac73c94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:58.034910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1fb74-9668-4136-9e44-9a5fdac73c94 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:58.131100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354776c0-60d8-4e01-974a-85afbbf6637f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:58.147835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52863485-3f34-443d-a6b4-ee906ca98a59 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9621fcccb68a42a3a0f96c9430cd6748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06455690bf904c49ab15a6b2531bd210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:58.150361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52863485-3f34-443d-a6b4-ee906ca98a59 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:58.151134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52863485-3f34-443d-a6b4-ee906ca98a59 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:58.155258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52863485-3f34-443d-a6b4-ee906ca98a59 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] PATH_INFO: `/v3/projects/6abd257f3bfc49b99f90d15daeb01867` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:58.155258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52863485-3f34-443d-a6b4-ee906ca98a59 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorizing `identity:get_project(project_id=6abd257f3bfc49b99f90d15daeb01867)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:58.159604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52863485-3f34-443d-a6b4-ee906ca98a59 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:58.159772 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1056/2134] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:22:57 2022] POST /identity/v3/users => generated 303 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:22:58.160239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1fb74-9668-4136-9e44-9a5fdac73c94 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:58.177801 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1079/2135] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:22:57 2022] GET /identity/v3/projects/6abd257f3bfc49b99f90d15daeb01867 => generated 375 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:22:58.178911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52863485-3f34-443d-a6b4-ee906ca98a59 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:58.192715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1fb74-9668-4136-9e44-9a5fdac73c94 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:58.200837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57950be2-1ff0-44f7-81a5-60b3936830e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:58.201786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57950be2-1ff0-44f7-81a5-60b3936830e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:58.202256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57950be2-1ff0-44f7-81a5-60b3936830e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:58.202678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57950be2-1ff0-44f7-81a5-60b3936830e2 admin admin] PATH_INFO: `/v3/projects/3b1cf79289db4d7883d93ec3fe908d66/users/ba3ce7f040d24c33bcf9b97d1ef25268/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:58.222525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52863485-3f34-443d-a6b4-ee906ca98a59 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:58.226314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57950be2-1ff0-44f7-81a5-60b3936830e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1cf79289db4d7883d93ec3fe908d66, user_id=ba3ce7f040d24c33bcf9b97d1ef25268, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:58.229691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57950be2-1ff0-44f7-81a5-60b3936830e2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:58.239585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d609c-577b-4c9e-92a5-ec2c8589de49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:58.240225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d609c-577b-4c9e-92a5-ec2c8589de49 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:58.240510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d609c-577b-4c9e-92a5-ec2c8589de49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:58.240848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d609c-577b-4c9e-92a5-ec2c8589de49 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:58.241622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d609c-577b-4c9e-92a5-ec2c8589de49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:58.243508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d609c-577b-4c9e-92a5-ec2c8589de49 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:58.268132 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1080/2136] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:58.272424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d609c-577b-4c9e-92a5-ec2c8589de49 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:58.293376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d609c-577b-4c9e-92a5-ec2c8589de49 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:58.299101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83b19a-b4bb-4104-93f6-1e3e9deff4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:58.301654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83b19a-b4bb-4104-93f6-1e3e9deff4e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:58.303278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83b19a-b4bb-4104-93f6-1e3e9deff4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:58.303588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83b19a-b4bb-4104-93f6-1e3e9deff4e9 admin admin] PATH_INFO: `/v3/projects/2075e067bb8a4d98998c997ae58d8031/users/dd65012d10d44b1c8ae21909750f4c92/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:58.351726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83b19a-b4bb-4104-93f6-1e3e9deff4e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2075e067bb8a4d98998c997ae58d8031, user_id=dd65012d10d44b1c8ae21909750f4c92, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:58.355252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83b19a-b4bb-4104-93f6-1e3e9deff4e9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:58.356492 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1057/2137] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:58 2022] PUT /identity/v3/projects/3b1cf79289db4d7883d93ec3fe908d66/users/ba3ce7f040d24c33bcf9b97d1ef25268/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:58.358820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60c047-c3ad-43a7-a8a4-3ef3ec4edb60 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:58.359309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60c047-c3ad-43a7-a8a4-3ef3ec4edb60 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:58.359751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60c047-c3ad-43a7-a8a4-3ef3ec4edb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:58.369428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:58.394188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9b60c047-c3ad-43a7-a8a4-3ef3ec4edb60 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:58.397615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9b60c047-c3ad-43a7-a8a4-3ef3ec4edb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:58.443274 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1081/2138] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:58 2022] PUT /identity/v3/projects/2075e067bb8a4d98998c997ae58d8031/users/dd65012d10d44b1c8ae21909750f4c92/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:58.447926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83b19a-b4bb-4104-93f6-1e3e9deff4e9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:58.457031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:58.538969 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1058/2139] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:58.540021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60c047-c3ad-43a7-a8a4-3ef3ec4edb60 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:58.554500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9b60c047-c3ad-43a7-a8a4-3ef3ec4edb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:58.632840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83b19a-b4bb-4104-93f6-1e3e9deff4e9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:58.666689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a9c1a-609c-4fc9-8f0a-d3e6fcdaacc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:58.669778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a9c1a-609c-4fc9-8f0a-d3e6fcdaacc5 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:58.670116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a9c1a-609c-4fc9-8f0a-d3e6fcdaacc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:58.670994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a9c1a-609c-4fc9-8f0a-d3e6fcdaacc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:58.671149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a9c1a-609c-4fc9-8f0a-d3e6fcdaacc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:58.674988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a9c1a-609c-4fc9-8f0a-d3e6fcdaacc5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:58.687964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60c047-c3ad-43a7-a8a4-3ef3ec4edb60 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:58.699142 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1082/2140] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:22:58.705555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a9c1a-609c-4fc9-8f0a-d3e6fcdaacc5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:58.723828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a9c1a-609c-4fc9-8f0a-d3e6fcdaacc5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:58.736375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e808dd-14b7-47f2-a0be-03716b9b2a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:58.745590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e808dd-14b7-47f2-a0be-03716b9b2a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:58.745590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e808dd-14b7-47f2-a0be-03716b9b2a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:58.745590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e808dd-14b7-47f2-a0be-03716b9b2a64 admin admin] PATH_INFO: `/v3/projects/2075e067bb8a4d98998c997ae58d8031/users/dd65012d10d44b1c8ae21909750f4c92/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:58.745590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e808dd-14b7-47f2-a0be-03716b9b2a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2075e067bb8a4d98998c997ae58d8031, user_id=dd65012d10d44b1c8ae21909750f4c92, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:58.756383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e808dd-14b7-47f2-a0be-03716b9b2a64 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:58.774661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee48ef6-6e21-4e52-b69b-bf517cbe9fb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:58.775942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee48ef6-6e21-4e52-b69b-bf517cbe9fb7 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:58.775942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee48ef6-6e21-4e52-b69b-bf517cbe9fb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:58.775942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee48ef6-6e21-4e52-b69b-bf517cbe9fb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:58.784282 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1083/2141] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:22:58 2022] PUT /identity/v3/projects/2075e067bb8a4d98998c997ae58d8031/users/dd65012d10d44b1c8ae21909750f4c92/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:22:58.796743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd36d8b-b949-4a8a-b536-d728c7aca02d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:58.797620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd36d8b-b949-4a8a-b536-d728c7aca02d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:58.797837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd36d8b-b949-4a8a-b536-d728c7aca02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:58.815331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee48ef6-6e21-4e52-b69b-bf517cbe9fb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:58.815331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee48ef6-6e21-4e52-b69b-bf517cbe9fb7 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:58.825916 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1059/2142] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:22:58.844324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0bd36d8b-b949-4a8a-b536-d728c7aca02d None None] MFA Rules not processed for user `dd65012d10d44b1c8ae21909750f4c92`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:58.848975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0bd36d8b-b949-4a8a-b536-d728c7aca02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:59.000657 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1084/2143] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:58 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:59.012242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f881f6b-e17e-43b5-ab69-f9bb794fcbae None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:59.013082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f881f6b-e17e-43b5-ab69-f9bb794fcbae None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:59.014899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f881f6b-e17e-43b5-ab69-f9bb794fcbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:59.063332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0f881f6b-e17e-43b5-ab69-f9bb794fcbae None None] MFA Rules not processed for user `7bd90bf4a2aa403cacd06bcaeb502640`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:22:59.065400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0f881f6b-e17e-43b5-ab69-f9bb794fcbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:22:59.239427 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1060/2144] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:22:59 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:22:59.363695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:59.862987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:59.883354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd36d8b-b949-4a8a-b536-d728c7aca02d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:22:59.958166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd36d8b-b949-4a8a-b536-d728c7aca02d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:22:59.964129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b1b1e-55c8-4b73-93ca-b5428be759ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:22:59.964848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b1b1e-55c8-4b73-93ca-b5428be759ef service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:22:59.965196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b1b1e-55c8-4b73-93ca-b5428be759ef service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:22:59.965475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b1b1e-55c8-4b73-93ca-b5428be759ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:22:59.975064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b1b1e-55c8-4b73-93ca-b5428be759ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:22:59.976736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b1b1e-55c8-4b73-93ca-b5428be759ef service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:22:59.986260 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1085/2145] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:22:59 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:23:00.052402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:00.330760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f881f6b-e17e-43b5-ab69-f9bb794fcbae None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:00.332231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0f881f6b-e17e-43b5-ab69-f9bb794fcbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:00.434510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f881f6b-e17e-43b5-ab69-f9bb794fcbae None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:00.441880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577844e-6b59-4454-9281-a1903fb06bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:00.443796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577844e-6b59-4454-9281-a1903fb06bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:00.444093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577844e-6b59-4454-9281-a1903fb06bda admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:00.447051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577844e-6b59-4454-9281-a1903fb06bda admin admin] PATH_INFO: `/v3/users/6fdb175018924ebc8daee4d7e466f5d4` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:00.447051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577844e-6b59-4454-9281-a1903fb06bda admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fdb175018924ebc8daee4d7e466f5d4)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:00.450304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577844e-6b59-4454-9281-a1903fb06bda admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:00.613896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:00.694502 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f577844e-6b59-4454-9281-a1903fb06bda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fdb175018924ebc8daee4d7e466f5d4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:00.696406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f577844e-6b59-4454-9281-a1903fb06bda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fdb175018924ebc8daee4d7e466f5d4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:00.718018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f577844e-6b59-4454-9281-a1903fb06bda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fdb175018924ebc8daee4d7e466f5d4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:00.734784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f577844e-6b59-4454-9281-a1903fb06bda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fdb175018924ebc8daee4d7e466f5d4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:00.834149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f577844e-6b59-4454-9281-a1903fb06bda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fdb175018924ebc8daee4d7e466f5d4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:00.840687 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1061/2146] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:23:00 2022] DELETE /identity/v3/users/6fdb175018924ebc8daee4d7e466f5d4 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:23:00.845295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3812b5-90e1-41da-8770-1710233a1e6f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:00.845584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3812b5-90e1-41da-8770-1710233a1e6f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:00.845858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3812b5-90e1-41da-8770-1710233a1e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:00.866167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ef3812b5-90e1-41da-8770-1710233a1e6f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:00.868886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ef3812b5-90e1-41da-8770-1710233a1e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:00.946356 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1086/2147] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:00.962536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577844e-6b59-4454-9281-a1903fb06bda admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:00.962536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f577844e-6b59-4454-9281-a1903fb06bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:01.029412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577844e-6b59-4454-9281-a1903fb06bda admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:01.033717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a1f83-45de-4daa-8fa7-a022bab812ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:01.034436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a1f83-45de-4daa-8fa7-a022bab812ce service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:01.034783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a1f83-45de-4daa-8fa7-a022bab812ce service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:01.035147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a1f83-45de-4daa-8fa7-a022bab812ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:01.046458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a1f83-45de-4daa-8fa7-a022bab812ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:01.050933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a1f83-45de-4daa-8fa7-a022bab812ce service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:01.072803 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1062/2148] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:23:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:23:01.765487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:02.038875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3812b5-90e1-41da-8770-1710233a1e6f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:02.041020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ef3812b5-90e1-41da-8770-1710233a1e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:02.054264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3812b5-90e1-41da-8770-1710233a1e6f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:02.084930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b49b1-65b3-4a15-9394-6bab68b9ab70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:02.086154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b49b1-65b3-4a15-9394-6bab68b9ab70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:02.086499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b49b1-65b3-4a15-9394-6bab68b9ab70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:02.086949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b49b1-65b3-4a15-9394-6bab68b9ab70 admin admin] PATH_INFO: `/v3/projects/6abd257f3bfc49b99f90d15daeb01867` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:02.089222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b49b1-65b3-4a15-9394-6bab68b9ab70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6abd257f3bfc49b99f90d15daeb01867)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:02.091792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b49b1-65b3-4a15-9394-6bab68b9ab70 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:02.259641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9e6b49b1-65b3-4a15-9394-6bab68b9ab70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6abd257f3bfc49b99f90d15daeb01867', 'request_id': 'req-9e6b49b1-65b3-4a15-9394-6bab68b9ab70'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:02.269194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9e6b49b1-65b3-4a15-9394-6bab68b9ab70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6abd257f3bfc49b99f90d15daeb01867', 'request_id': 'req-9e6b49b1-65b3-4a15-9394-6bab68b9ab70'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:02.285067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9e6b49b1-65b3-4a15-9394-6bab68b9ab70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6abd257f3bfc49b99f90d15daeb01867', 'request_id': 'req-9e6b49b1-65b3-4a15-9394-6bab68b9ab70'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:02.372747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9e6b49b1-65b3-4a15-9394-6bab68b9ab70 admin admin] The token cache is being invalidate because project 6abd257f3bfc49b99f90d15daeb01867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:23:02.373288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9e6b49b1-65b3-4a15-9394-6bab68b9ab70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:02.376594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9e6b49b1-65b3-4a15-9394-6bab68b9ab70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:02.378512 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1087/2149] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:23:02 2022] DELETE /identity/v3/projects/6abd257f3bfc49b99f90d15daeb01867 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:23:02.382348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a1f83-45de-4daa-8fa7-a022bab812ce service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:02.392924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a1f83-45de-4daa-8fa7-a022bab812ce service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:02.485561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096be0f-12e2-47a6-9a6c-5acb488503c6 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:02.486123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096be0f-12e2-47a6-9a6c-5acb488503c6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:02.486579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096be0f-12e2-47a6-9a6c-5acb488503c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:02.491703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d675f-235c-49d4-b51a-7cacad1def9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:02.492707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d675f-235c-49d4-b51a-7cacad1def9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:02.493259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d675f-235c-49d4-b51a-7cacad1def9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:02.493815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d675f-235c-49d4-b51a-7cacad1def9e admin admin] PATH_INFO: `/v3/users/9621fcccb68a42a3a0f96c9430cd6748` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:02.495843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d675f-235c-49d4-b51a-7cacad1def9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9621fcccb68a42a3a0f96c9430cd6748)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:02.499156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d675f-235c-49d4-b51a-7cacad1def9e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:02.564452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-5096be0f-12e2-47a6-9a6c-5acb488503c6 None None] MFA Rules not processed for user `91d1351fcb6b4cd08f176e6d0cc5bb11`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:02.565814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5096be0f-12e2-47a6-9a6c-5acb488503c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:02.670188 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1088/2150] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:02.672463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464a0fb-6be0-4c77-91be-6e5ac859c99e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:02.672756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464a0fb-6be0-4c77-91be-6e5ac859c99e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:02.673131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464a0fb-6be0-4c77-91be-6e5ac859c99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:02.703137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0464a0fb-6be0-4c77-91be-6e5ac859c99e None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:02.704587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0464a0fb-6be0-4c77-91be-6e5ac859c99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:02.759896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e39d675f-235c-49d4-b51a-7cacad1def9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9621fcccb68a42a3a0f96c9430cd6748'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:02.760696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e39d675f-235c-49d4-b51a-7cacad1def9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9621fcccb68a42a3a0f96c9430cd6748'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:02.775133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e39d675f-235c-49d4-b51a-7cacad1def9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9621fcccb68a42a3a0f96c9430cd6748'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:02.793104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e39d675f-235c-49d4-b51a-7cacad1def9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9621fcccb68a42a3a0f96c9430cd6748'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:02.797286 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1089/2151] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:23:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:02.812576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464a0fb-6be0-4c77-91be-6e5ac859c99e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:02.814043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0464a0fb-6be0-4c77-91be-6e5ac859c99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:02.903089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464a0fb-6be0-4c77-91be-6e5ac859c99e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:02.909298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e52254-1b05-4ebf-aa61-1bad1241122e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:02.909961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e52254-1b05-4ebf-aa61-1bad1241122e service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:02.912302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e39d675f-235c-49d4-b51a-7cacad1def9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9621fcccb68a42a3a0f96c9430cd6748'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:02.918983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e52254-1b05-4ebf-aa61-1bad1241122e service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:02.918983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e52254-1b05-4ebf-aa61-1bad1241122e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:02.922663 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1063/2152] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:23:02 2022] DELETE /identity/v3/users/9621fcccb68a42a3a0f96c9430cd6748 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:23:02.945466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e52254-1b05-4ebf-aa61-1bad1241122e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:02.947349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e52254-1b05-4ebf-aa61-1bad1241122e service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:02.971489 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1090/2153] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:23:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 03:23:03.103230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:03.175372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc29ef-edd1-4324-ab35-47d7bfe93b97 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:03.176056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc29ef-edd1-4324-ab35-47d7bfe93b97 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:03.180010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc29ef-edd1-4324-ab35-47d7bfe93b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:03.240447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4cbc29ef-edd1-4324-ab35-47d7bfe93b97 None None] MFA Rules not processed for user `c20881251f2241a3a5ec2e5cf99db149`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:03.242870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4cbc29ef-edd1-4324-ab35-47d7bfe93b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:03.357609 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1064/2154] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 03:23:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:23:03.392619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e52254-1b05-4ebf-aa61-1bad1241122e service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:03.394628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c1e52254-1b05-4ebf-aa61-1bad1241122e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:03.477742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e52254-1b05-4ebf-aa61-1bad1241122e service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:03.590373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f666358-cd7a-4b93-816e-7f3c476e2308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:03.592231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f666358-cd7a-4b93-816e-7f3c476e2308 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:03.592231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f666358-cd7a-4b93-816e-7f3c476e2308 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:03.594286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f666358-cd7a-4b93-816e-7f3c476e2308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:03.616308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f666358-cd7a-4b93-816e-7f3c476e2308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:03.616308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f666358-cd7a-4b93-816e-7f3c476e2308 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:03.642844 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1091/2155] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:23:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:23:03.813316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc29ef-edd1-4324-ab35-47d7bfe93b97 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:03.817619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4cbc29ef-edd1-4324-ab35-47d7bfe93b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:03.990095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc29ef-edd1-4324-ab35-47d7bfe93b97 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:04.000132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646e40d-1541-4297-813e-228b30bc3bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:04.002052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646e40d-1541-4297-813e-228b30bc3bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:04.002360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646e40d-1541-4297-813e-228b30bc3bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:04.002630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646e40d-1541-4297-813e-228b30bc3bbf admin admin] PATH_INFO: `/v3/projects/06455690bf904c49ab15a6b2531bd210` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:04.008584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646e40d-1541-4297-813e-228b30bc3bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=06455690bf904c49ab15a6b2531bd210)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:04.011524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646e40d-1541-4297-813e-228b30bc3bbf admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:04.187131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9646e40d-1541-4297-813e-228b30bc3bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06455690bf904c49ab15a6b2531bd210', 'request_id': 'req-9646e40d-1541-4297-813e-228b30bc3bbf'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:04.296710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9646e40d-1541-4297-813e-228b30bc3bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06455690bf904c49ab15a6b2531bd210', 'request_id': 'req-9646e40d-1541-4297-813e-228b30bc3bbf'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:04.305046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9646e40d-1541-4297-813e-228b30bc3bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06455690bf904c49ab15a6b2531bd210', 'request_id': 'req-9646e40d-1541-4297-813e-228b30bc3bbf'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:04.328416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9646e40d-1541-4297-813e-228b30bc3bbf admin admin] The token cache is being invalidate because project 06455690bf904c49ab15a6b2531bd210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:23:04.328722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9646e40d-1541-4297-813e-228b30bc3bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:04.329952 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9646e40d-1541-4297-813e-228b30bc3bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:04.335773 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1065/2156] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:23:03 2022] DELETE /identity/v3/projects/06455690bf904c49ab15a6b2531bd210 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:23:04.341957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b3005-25ae-4d27-9ff5-c15cc1012417 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:04.343389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b3005-25ae-4d27-9ff5-c15cc1012417 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:04.344327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b3005-25ae-4d27-9ff5-c15cc1012417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:04.420178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9b1b3005-25ae-4d27-9ff5-c15cc1012417 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:04.422927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9b1b3005-25ae-4d27-9ff5-c15cc1012417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:04.522919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff36dd-3fde-478f-af7f-c8b8000f34a7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:04.523137 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1092/2157] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:04.523715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff36dd-3fde-478f-af7f-c8b8000f34a7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:04.523850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff36dd-3fde-478f-af7f-c8b8000f34a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:04.565020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-2fff36dd-3fde-478f-af7f-c8b8000f34a7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:04.566511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2fff36dd-3fde-478f-af7f-c8b8000f34a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:04.600260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b3005-25ae-4d27-9ff5-c15cc1012417 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:04.600783 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1066/2158] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:04.618246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b3005-25ae-4d27-9ff5-c15cc1012417 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:04.627016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffcbef-6e0c-402d-9b96-7c34a0a89de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:04.627967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffcbef-6e0c-402d-9b96-7c34a0a89de3 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:04.628631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffcbef-6e0c-402d-9b96-7c34a0a89de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:04.629125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffcbef-6e0c-402d-9b96-7c34a0a89de3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:04.630139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffcbef-6e0c-402d-9b96-7c34a0a89de3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:23:04.630540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffcbef-6e0c-402d-9b96-7c34a0a89de3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:04.634279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffcbef-6e0c-402d-9b96-7c34a0a89de3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:04.659930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff36dd-3fde-478f-af7f-c8b8000f34a7 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:04.661115 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1093/2159] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:23:04.663641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:04.673204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff36dd-3fde-478f-af7f-c8b8000f34a7 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:04.686783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b4348-d87e-4728-b969-4a223fa818fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:04.688884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b4348-d87e-4728-b969-4a223fa818fe admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:04.690615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b4348-d87e-4728-b969-4a223fa818fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:04.690914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b4348-d87e-4728-b969-4a223fa818fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:04.691599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b4348-d87e-4728-b969-4a223fa818fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:04.693585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b4348-d87e-4728-b969-4a223fa818fe admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:04.831163 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1067/2160] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:23:04 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:23:04.836426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffcbef-6e0c-402d-9b96-7c34a0a89de3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:04.856922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffcbef-6e0c-402d-9b96-7c34a0a89de3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:04.939259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd371fdf-76f0-4a9f-9826-35b6522ea351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:04.940305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd371fdf-76f0-4a9f-9826-35b6522ea351 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:04.940779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd371fdf-76f0-4a9f-9826-35b6522ea351 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:04.941302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd371fdf-76f0-4a9f-9826-35b6522ea351 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:04.942296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd371fdf-76f0-4a9f-9826-35b6522ea351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:04.945588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd371fdf-76f0-4a9f-9826-35b6522ea351 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:05.063319 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1094/2161] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:23:04 2022] POST /identity/v3/users => generated 292 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:23:05.063410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b4348-d87e-4728-b969-4a223fa818fe admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:05.116027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b4348-d87e-4728-b969-4a223fa818fe admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:05.134140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465102c-4ef3-4a16-b666-c800a27ad8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:05.135960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465102c-4ef3-4a16-b666-c800a27ad8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:05.136366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465102c-4ef3-4a16-b666-c800a27ad8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:05.136646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465102c-4ef3-4a16-b666-c800a27ad8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:05.137317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465102c-4ef3-4a16-b666-c800a27ad8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:05.145121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465102c-4ef3-4a16-b666-c800a27ad8a9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:05.180032 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1068/2162] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:23:05.180497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd371fdf-76f0-4a9f-9826-35b6522ea351 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:05.204670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd371fdf-76f0-4a9f-9826-35b6522ea351 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:05.218328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d41f3-6949-49f7-8dfa-3717f408bf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:05.219004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d41f3-6949-49f7-8dfa-3717f408bf65 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:05.219294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d41f3-6949-49f7-8dfa-3717f408bf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:05.219569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d41f3-6949-49f7-8dfa-3717f408bf65 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:05.234502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d41f3-6949-49f7-8dfa-3717f408bf65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:05.248056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d41f3-6949-49f7-8dfa-3717f408bf65 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:05.312949 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1095/2163] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:23:05.313608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465102c-4ef3-4a16-b666-c800a27ad8a9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:05.329469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465102c-4ef3-4a16-b666-c800a27ad8a9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:05.339336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a52bf-d886-43b3-a8c4-855656ad0571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:05.343103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a52bf-d886-43b3-a8c4-855656ad0571 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:05.343798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a52bf-d886-43b3-a8c4-855656ad0571 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:05.344269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a52bf-d886-43b3-a8c4-855656ad0571 admin admin] PATH_INFO: `/v3/projects/f4eefc2fafef4054b6d4f7d17f645406/users/ac07e3a844b349ce9e2436a4fdf36512/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:05.369263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a52bf-d886-43b3-a8c4-855656ad0571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4eefc2fafef4054b6d4f7d17f645406, user_id=ac07e3a844b349ce9e2436a4fdf36512, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:05.383883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a52bf-d886-43b3-a8c4-855656ad0571 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:05.497900 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1069/2164] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:23:05 2022] PUT /identity/v3/projects/f4eefc2fafef4054b6d4f7d17f645406/users/ac07e3a844b349ce9e2436a4fdf36512/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:23:05.510545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e564a-07a3-413d-95a9-fb6ba3598fcf None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:05.511422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e564a-07a3-413d-95a9-fb6ba3598fcf None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:05.511702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e564a-07a3-413d-95a9-fb6ba3598fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:05.569601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-483e564a-07a3-413d-95a9-fb6ba3598fcf None None] MFA Rules not processed for user `ac07e3a844b349ce9e2436a4fdf36512`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:05.571222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-483e564a-07a3-413d-95a9-fb6ba3598fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:05.715318 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1096/2165] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:05.717157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a52bf-d886-43b3-a8c4-855656ad0571 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:05.794645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a52bf-d886-43b3-a8c4-855656ad0571 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:05.802584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e369c-603a-44b3-bb85-b59e0d3c1f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:05.803603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e369c-603a-44b3-bb85-b59e0d3c1f42 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:05.803747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e369c-603a-44b3-bb85-b59e0d3c1f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:05.804067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e369c-603a-44b3-bb85-b59e0d3c1f42 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:05.805398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e369c-603a-44b3-bb85-b59e0d3c1f42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:05.807109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e369c-603a-44b3-bb85-b59e0d3c1f42 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:05.933008 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1070/2166] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:23:05 2022] POST /identity/v3/projects => generated 381 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:23:05.937912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e564a-07a3-413d-95a9-fb6ba3598fcf None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:05.963187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e564a-07a3-413d-95a9-fb6ba3598fcf None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:06.001778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:06.123444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde01b3c-199c-4a1d-97e3-aa5cdb837f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:06.125420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde01b3c-199c-4a1d-97e3-aa5cdb837f23 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:06.126007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde01b3c-199c-4a1d-97e3-aa5cdb837f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:06.126605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde01b3c-199c-4a1d-97e3-aa5cdb837f23 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:06.128880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde01b3c-199c-4a1d-97e3-aa5cdb837f23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:06.131547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde01b3c-199c-4a1d-97e3-aa5cdb837f23 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:06.284280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:06.298838 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1097/2167] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:23:05 2022] POST /identity/v3/users => generated 297 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:23:06.302721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e369c-603a-44b3-bb85-b59e0d3c1f42 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:06.330142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e369c-603a-44b3-bb85-b59e0d3c1f42 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:06.352870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e56e0-dc2c-4aa2-a588-52aaba4205f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:06.355896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e56e0-dc2c-4aa2-a588-52aaba4205f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:06.356611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e56e0-dc2c-4aa2-a588-52aaba4205f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:06.360805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e56e0-dc2c-4aa2-a588-52aaba4205f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:06.360805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e56e0-dc2c-4aa2-a588-52aaba4205f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:06.364214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e56e0-dc2c-4aa2-a588-52aaba4205f1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:06.389686 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1071/2168] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:23:06.394747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde01b3c-199c-4a1d-97e3-aa5cdb837f23 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:06.407186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde01b3c-199c-4a1d-97e3-aa5cdb837f23 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:06.413616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79280fb8-b4ce-42aa-ab41-0c396880cc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:06.414564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79280fb8-b4ce-42aa-ab41-0c396880cc53 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:06.414934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79280fb8-b4ce-42aa-ab41-0c396880cc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:06.415290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79280fb8-b4ce-42aa-ab41-0c396880cc53 admin admin] PATH_INFO: `/v3/projects/8561e58232d14e9991d8d40600cd190c/users/25824ad90b6343f48f537b899d47a569/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:06.437355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79280fb8-b4ce-42aa-ab41-0c396880cc53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8561e58232d14e9991d8d40600cd190c, user_id=25824ad90b6343f48f537b899d47a569, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:06.440711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79280fb8-b4ce-42aa-ab41-0c396880cc53 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:06.558725 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1098/2169] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:23:06 2022] PUT /identity/v3/projects/8561e58232d14e9991d8d40600cd190c/users/25824ad90b6343f48f537b899d47a569/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:23:06.562973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e56e0-dc2c-4aa2-a588-52aaba4205f1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:06.582442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e56e0-dc2c-4aa2-a588-52aaba4205f1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:06.748820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b650bac-8a48-4d4e-9a22-26b38da9cf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:06.750965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b650bac-8a48-4d4e-9a22-26b38da9cf60 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:06.751838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b650bac-8a48-4d4e-9a22-26b38da9cf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:06.753676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b650bac-8a48-4d4e-9a22-26b38da9cf60 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:06.755385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b650bac-8a48-4d4e-9a22-26b38da9cf60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:06.760860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b650bac-8a48-4d4e-9a22-26b38da9cf60 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:06.791058 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1072/2170] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:23:06.792280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79280fb8-b4ce-42aa-ab41-0c396880cc53 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:06.808791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79280fb8-b4ce-42aa-ab41-0c396880cc53 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:06.826512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a467a9-eaf8-4d70-b0bb-42f2740e84d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:06.827757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a467a9-eaf8-4d70-b0bb-42f2740e84d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:06.828039 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a467a9-eaf8-4d70-b0bb-42f2740e84d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:06.828317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a467a9-eaf8-4d70-b0bb-42f2740e84d0 admin admin] PATH_INFO: `/v3/projects/8561e58232d14e9991d8d40600cd190c/users/25824ad90b6343f48f537b899d47a569/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:06.836036 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a467a9-eaf8-4d70-b0bb-42f2740e84d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8561e58232d14e9991d8d40600cd190c, user_id=25824ad90b6343f48f537b899d47a569, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:06.838773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a467a9-eaf8-4d70-b0bb-42f2740e84d0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:06.856692 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1099/2171] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:23:06 2022] PUT /identity/v3/projects/8561e58232d14e9991d8d40600cd190c/users/25824ad90b6343f48f537b899d47a569/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:23:06.868003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e18d8-558c-48f0-9149-eef21d4f2771 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:06.868570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e18d8-558c-48f0-9149-eef21d4f2771 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:06.868973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e18d8-558c-48f0-9149-eef21d4f2771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:06.931049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-042e18d8-558c-48f0-9149-eef21d4f2771 None None] MFA Rules not processed for user `25824ad90b6343f48f537b899d47a569`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:06.937217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-042e18d8-558c-48f0-9149-eef21d4f2771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:07.049513 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1073/2172] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:07.419905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a467a9-eaf8-4d70-b0bb-42f2740e84d0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:07.422142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-95a467a9-eaf8-4d70-b0bb-42f2740e84d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:07.609623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a467a9-eaf8-4d70-b0bb-42f2740e84d0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:07.618649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461478a7-ccf9-439a-a584-151927a87dc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:07.620563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461478a7-ccf9-439a-a584-151927a87dc8 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:07.621059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461478a7-ccf9-439a-a584-151927a87dc8 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:07.622595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461478a7-ccf9-439a-a584-151927a87dc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:07.639327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461478a7-ccf9-439a-a584-151927a87dc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:07.641889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461478a7-ccf9-439a-a584-151927a87dc8 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:07.701711 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1100/2173] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:23:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:23:07.716941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7ffc7-5992-4e32-8915-55ba7febad09 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:07.717231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7ffc7-5992-4e32-8915-55ba7febad09 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:07.717571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7ffc7-5992-4e32-8915-55ba7febad09 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:07.719362 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1074/2174] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:23:07.724800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461478a7-ccf9-439a-a584-151927a87dc8 service nova] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:23:07.741812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461478a7-ccf9-439a-a584-151927a87dc8 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:07.760801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461478a7-ccf9-439a-a584-151927a87dc8 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:07.764808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f328109-38a6-4c61-9cc7-32b6e3d10481 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25824ad90b6343f48f537b899d47a569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8561e58232d14e9991d8d40600cd190c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:07.765908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f328109-38a6-4c61-9cc7-32b6e3d10481 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:07.766239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f328109-38a6-4c61-9cc7-32b6e3d10481 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:07.767131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f328109-38a6-4c61-9cc7-32b6e3d10481 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] PATH_INFO: `/v3/projects/f4eefc2fafef4054b6d4f7d17f645406` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:07.768637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f328109-38a6-4c61-9cc7-32b6e3d10481 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: Authorizing `identity:get_project(project_id=f4eefc2fafef4054b6d4f7d17f645406)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:07.771099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f328109-38a6-4c61-9cc7-32b6e3d10481 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:07.797767 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1101/2175] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:23:07 2022] GET /identity/v3/projects/f4eefc2fafef4054b6d4f7d17f645406 => generated 383 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:23:08.418116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22dd759-6fc0-4e2b-aadb-bf901edd490d None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:08.418605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22dd759-6fc0-4e2b-aadb-bf901edd490d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:08.418724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22dd759-6fc0-4e2b-aadb-bf901edd490d None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:08.420237 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1075/2176] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:23:08.430331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f328109-38a6-4c61-9cc7-32b6e3d10481 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:23:08.459901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f328109-38a6-4c61-9cc7-32b6e3d10481 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:08.466544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21749ab-e8b2-405c-9c4e-ba46c5fc5215 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:08.467330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21749ab-e8b2-405c-9c4e-ba46c5fc5215 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:08.467845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21749ab-e8b2-405c-9c4e-ba46c5fc5215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:08.509164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f328109-38a6-4c61-9cc7-32b6e3d10481 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:08.520795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a05fa-f47b-4ebd-b9dc-63c1b5a68763 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25824ad90b6343f48f537b899d47a569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8561e58232d14e9991d8d40600cd190c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:08.521748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a05fa-f47b-4ebd-b9dc-63c1b5a68763 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:08.522289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a05fa-f47b-4ebd-b9dc-63c1b5a68763 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:08.522984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a05fa-f47b-4ebd-b9dc-63c1b5a68763 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] PATH_INFO: `/v3/projects/f4eefc2fafef4054b6d4f7d17f645406` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:08.525756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a05fa-f47b-4ebd-b9dc-63c1b5a68763 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: Authorizing `identity:get_project(project_id=f4eefc2fafef4054b6d4f7d17f645406)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:08.528758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a05fa-f47b-4ebd-b9dc-63c1b5a68763 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:08.529254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b21749ab-e8b2-405c-9c4e-ba46c5fc5215 None None] MFA Rules not processed for user `ba3ce7f040d24c33bcf9b97d1ef25268`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:08.531610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b21749ab-e8b2-405c-9c4e-ba46c5fc5215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:08.545462 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1102/2177] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:23:08 2022] GET /identity/v3/projects/f4eefc2fafef4054b6d4f7d17f645406 => generated 383 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:23:08.641537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:08.674571 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1076/2178] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:08.679687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a05fa-f47b-4ebd-b9dc-63c1b5a68763 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:08.686251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-899a05fa-f47b-4ebd-b9dc-63c1b5a68763 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:08.716895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46357923-d7c0-41af-8355-510e6d238545 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:08.718160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46357923-d7c0-41af-8355-510e6d238545 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:08.718456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46357923-d7c0-41af-8355-510e6d238545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:08.746454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-46357923-d7c0-41af-8355-510e6d238545 None None] MFA Rules not processed for user `ac07e3a844b349ce9e2436a4fdf36512`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:08.748063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-46357923-d7c0-41af-8355-510e6d238545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:08.793300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:08.849120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a05fa-f47b-4ebd-b9dc-63c1b5a68763 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:08.851115 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1077/2179] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:23:08.857843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964b214-979a-4fb4-bc23-38bd22140792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:08.860684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964b214-979a-4fb4-bc23-38bd22140792 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:08.860975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964b214-979a-4fb4-bc23-38bd22140792 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:08.861403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964b214-979a-4fb4-bc23-38bd22140792 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:08.862693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964b214-979a-4fb4-bc23-38bd22140792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:08.864927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964b214-979a-4fb4-bc23-38bd22140792 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:08.866961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46357923-d7c0-41af-8355-510e6d238545 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:08.890378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46357923-d7c0-41af-8355-510e6d238545 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:08.898342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8b1da-ddac-4830-83f5-2b9d4d7b9e73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:08.901255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8b1da-ddac-4830-83f5-2b9d4d7b9e73 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:08.901255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8b1da-ddac-4830-83f5-2b9d4d7b9e73 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:08.901255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8b1da-ddac-4830-83f5-2b9d4d7b9e73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:08.912418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8b1da-ddac-4830-83f5-2b9d4d7b9e73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:08.914347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8b1da-ddac-4830-83f5-2b9d4d7b9e73 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:08.937943 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1078/2180] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:23:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:23:08.959612 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1103/2181] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:23:08 2022] POST /identity/v3/projects => generated 397 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:23:08.963942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8b1da-ddac-4830-83f5-2b9d4d7b9e73 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:08.976318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8b1da-ddac-4830-83f5-2b9d4d7b9e73 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:09.061362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e186d-8fc0-423f-b176-ee7d90732f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:09.062264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e186d-8fc0-423f-b176-ee7d90732f70 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:09.062380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e186d-8fc0-423f-b176-ee7d90732f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:09.062795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e186d-8fc0-423f-b176-ee7d90732f70 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:09.063456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e186d-8fc0-423f-b176-ee7d90732f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:09.065721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e186d-8fc0-423f-b176-ee7d90732f70 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:09.181470 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1079/2182] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:23:08 2022] POST /identity/v3/users => generated 305 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:23:09.182484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964b214-979a-4fb4-bc23-38bd22140792 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:09.210890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964b214-979a-4fb4-bc23-38bd22140792 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:09.218397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee4c6e-afdd-40c6-b998-7007739b67a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:09.219927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee4c6e-afdd-40c6-b998-7007739b67a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:09.220659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee4c6e-afdd-40c6-b998-7007739b67a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:09.221561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee4c6e-afdd-40c6-b998-7007739b67a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:09.223047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee4c6e-afdd-40c6-b998-7007739b67a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:09.226859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee4c6e-afdd-40c6-b998-7007739b67a0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:09.249594 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1104/2183] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:23:09.254071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e186d-8fc0-423f-b176-ee7d90732f70 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:09.268119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e186d-8fc0-423f-b176-ee7d90732f70 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:09.288152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cdb80-1fec-4a36-a8e8-917d3984c0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:09.288948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cdb80-1fec-4a36-a8e8-917d3984c0e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:09.289572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cdb80-1fec-4a36-a8e8-917d3984c0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:09.289572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cdb80-1fec-4a36-a8e8-917d3984c0e3 admin admin] PATH_INFO: `/v3/projects/cfecc4615ae34ec1af0db5272f29aae5/users/4a882b983a3b48bfada30b64b7002993/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:09.313475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246cdb80-1fec-4a36-a8e8-917d3984c0e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfecc4615ae34ec1af0db5272f29aae5, user_id=4a882b983a3b48bfada30b64b7002993, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:09.317608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246cdb80-1fec-4a36-a8e8-917d3984c0e3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:09.473234 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1080/2184] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:23:09 2022] PUT /identity/v3/projects/cfecc4615ae34ec1af0db5272f29aae5/users/4a882b983a3b48bfada30b64b7002993/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:23:09.477582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee4c6e-afdd-40c6-b998-7007739b67a0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:09.503517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee4c6e-afdd-40c6-b998-7007739b67a0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:09.637077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fcfe0-886f-4864-8263-045de6f948c4 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:09.637382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fcfe0-886f-4864-8263-045de6f948c4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:09.638497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fcfe0-886f-4864-8263-045de6f948c4 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:09.642225 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1081/2185] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:23:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:23:09.644313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f50299-e6ba-45a5-b515-9f1c7be635b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:09.645259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f50299-e6ba-45a5-b515-9f1c7be635b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:09.645779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f50299-e6ba-45a5-b515-9f1c7be635b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:09.646080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f50299-e6ba-45a5-b515-9f1c7be635b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:09.647434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fcfe0-886f-4864-8263-045de6f948c4 None None] Authenticating service token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:23:09.659301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f50299-e6ba-45a5-b515-9f1c7be635b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:09.662292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f50299-e6ba-45a5-b515-9f1c7be635b5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:09.685721 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1105/2186] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:23:09.688287 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f50299-e6ba-45a5-b515-9f1c7be635b5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:09.709158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f50299-e6ba-45a5-b515-9f1c7be635b5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:09.726014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be8cab-6d49-4468-bf37-71d0defd6964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:09.726801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be8cab-6d49-4468-bf37-71d0defd6964 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:09.727148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be8cab-6d49-4468-bf37-71d0defd6964 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:09.727511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be8cab-6d49-4468-bf37-71d0defd6964 admin admin] PATH_INFO: `/v3/projects/cfecc4615ae34ec1af0db5272f29aae5/users/4a882b983a3b48bfada30b64b7002993/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:09.734203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be8cab-6d49-4468-bf37-71d0defd6964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfecc4615ae34ec1af0db5272f29aae5, user_id=4a882b983a3b48bfada30b64b7002993, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:09.738061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be8cab-6d49-4468-bf37-71d0defd6964 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:09.769642 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1106/2187] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:23:09 2022] PUT /identity/v3/projects/cfecc4615ae34ec1af0db5272f29aae5/users/4a882b983a3b48bfada30b64b7002993/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:23:09.796761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fcfe0-886f-4864-8263-045de6f948c4 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:09.899192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fcfe0-886f-4864-8263-045de6f948c4 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:09.979770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99d7dc-6173-4f6a-87e8-7f16b6932035 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25824ad90b6343f48f537b899d47a569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8561e58232d14e9991d8d40600cd190c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:09.980646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99d7dc-6173-4f6a-87e8-7f16b6932035 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:09.981104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99d7dc-6173-4f6a-87e8-7f16b6932035 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:09.982507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99d7dc-6173-4f6a-87e8-7f16b6932035 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] PATH_INFO: `/v3/projects/f4eefc2fafef4054b6d4f7d17f645406` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:09.984561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99d7dc-6173-4f6a-87e8-7f16b6932035 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: Authorizing `identity:get_project(project_id=f4eefc2fafef4054b6d4f7d17f645406)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:09.987232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99d7dc-6173-4f6a-87e8-7f16b6932035 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:09.989979 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1082/2188] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:23:09 2022] GET /identity/v3/projects/f4eefc2fafef4054b6d4f7d17f645406 => generated 383 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:23:10.000924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:10.155665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:10.387295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba3027-8b01-43f1-acd0-471a9d51e2a5 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:10.387590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba3027-8b01-43f1-acd0-471a9d51e2a5 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:10.387869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba3027-8b01-43f1-acd0-471a9d51e2a5 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:10.389258 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1107/2189] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:23:10.395890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99d7dc-6173-4f6a-87e8-7f16b6932035 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Authenticating service token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:23:10.559896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99d7dc-6173-4f6a-87e8-7f16b6932035 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:10.577952 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99d7dc-6173-4f6a-87e8-7f16b6932035 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:10.586714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b328d1-147d-4d91-8ab8-80cad8c007eb tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25824ad90b6343f48f537b899d47a569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8561e58232d14e9991d8d40600cd190c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:10.587660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b328d1-147d-4d91-8ab8-80cad8c007eb tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:10.588153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b328d1-147d-4d91-8ab8-80cad8c007eb tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:10.588680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b328d1-147d-4d91-8ab8-80cad8c007eb tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] PATH_INFO: `/v3/projects/f4eefc2fafef4054b6d4f7d17f645406` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:10.592329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b328d1-147d-4d91-8ab8-80cad8c007eb tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: Authorizing `identity:get_project(project_id=f4eefc2fafef4054b6d4f7d17f645406)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:10.592561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b328d1-147d-4d91-8ab8-80cad8c007eb tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:10.610981 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1083/2190] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:23:10 2022] GET /identity/v3/projects/f4eefc2fafef4054b6d4f7d17f645406 => generated 383 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:23:10.674566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f952774-1e38-4a64-ad70-c30421a0cc18 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:10.675099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f952774-1e38-4a64-ad70-c30421a0cc18 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:10.675604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f952774-1e38-4a64-ad70-c30421a0cc18 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:10.678772 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1108/2191] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:23:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:23:10.684319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b328d1-147d-4d91-8ab8-80cad8c007eb tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Authenticating service token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:23:10.704777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b328d1-147d-4d91-8ab8-80cad8c007eb tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:10.714767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b328d1-147d-4d91-8ab8-80cad8c007eb tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:10.725884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98bafb-15cc-49e7-b761-758a4dd6a4c5 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25824ad90b6343f48f537b899d47a569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8561e58232d14e9991d8d40600cd190c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:10.727010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98bafb-15cc-49e7-b761-758a4dd6a4c5 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:10.732112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98bafb-15cc-49e7-b761-758a4dd6a4c5 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:10.732112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98bafb-15cc-49e7-b761-758a4dd6a4c5 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] PATH_INFO: `/v3/projects/f4eefc2fafef4054b6d4f7d17f645406` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:10.732112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98bafb-15cc-49e7-b761-758a4dd6a4c5 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: Authorizing `identity:get_project(project_id=f4eefc2fafef4054b6d4f7d17f645406)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:10.732625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98bafb-15cc-49e7-b761-758a4dd6a4c5 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:10.747719 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1084/2192] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:23:10 2022] GET /identity/v3/projects/f4eefc2fafef4054b6d4f7d17f645406 => generated 383 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:23:10.867234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:11.004758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334035b2-087d-4d33-a29e-c0db758f0eda None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:11.005700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334035b2-087d-4d33-a29e-c0db758f0eda None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:11.006254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334035b2-087d-4d33-a29e-c0db758f0eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:11.053361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-334035b2-087d-4d33-a29e-c0db758f0eda None None] MFA Rules not processed for user `ac07e3a844b349ce9e2436a4fdf36512`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:11.058411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-334035b2-087d-4d33-a29e-c0db758f0eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:11.203794 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1109/2193] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:11.693657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:11.880559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80121f-9d71-4fe6-a990-f63b038e8e67 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:11.881566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80121f-9d71-4fe6-a990-f63b038e8e67 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:11.882052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80121f-9d71-4fe6-a990-f63b038e8e67 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:11.884691 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1085/2194] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:23:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:23:11.891211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334035b2-087d-4d33-a29e-c0db758f0eda None None] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:23:11.908967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334035b2-087d-4d33-a29e-c0db758f0eda None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:11.922761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334035b2-087d-4d33-a29e-c0db758f0eda None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:11.928595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6755b5-52e7-4682-b781-e5f8301180f7 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25824ad90b6343f48f537b899d47a569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8561e58232d14e9991d8d40600cd190c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:11.929249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6755b5-52e7-4682-b781-e5f8301180f7 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:11.929603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6755b5-52e7-4682-b781-e5f8301180f7 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:11.930134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6755b5-52e7-4682-b781-e5f8301180f7 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] PATH_INFO: `/v3/projects/f4eefc2fafef4054b6d4f7d17f645406` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:11.931414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6755b5-52e7-4682-b781-e5f8301180f7 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: Authorizing `identity:get_project(project_id=f4eefc2fafef4054b6d4f7d17f645406)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:11.934092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6755b5-52e7-4682-b781-e5f8301180f7 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:11.937712 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1110/2195] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:23:11 2022] GET /identity/v3/projects/f4eefc2fafef4054b6d4f7d17f645406 => generated 383 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:23:12.164333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:12.416059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e74ea2-fe48-44bf-9225-2bce06991e0b None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:12.416349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e74ea2-fe48-44bf-9225-2bce06991e0b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:12.416634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e74ea2-fe48-44bf-9225-2bce06991e0b None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:12.419061 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1086/2196] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:23:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:23:12.424580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6755b5-52e7-4682-b781-e5f8301180f7 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:23:12.442264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6755b5-52e7-4682-b781-e5f8301180f7 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:12.462536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6755b5-52e7-4682-b781-e5f8301180f7 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:12.476324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086904b-13a0-4ec0-a2c3-1ffb3fd9281f tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25824ad90b6343f48f537b899d47a569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8561e58232d14e9991d8d40600cd190c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:12.482187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086904b-13a0-4ec0-a2c3-1ffb3fd9281f tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:12.482864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086904b-13a0-4ec0-a2c3-1ffb3fd9281f tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:12.483514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086904b-13a0-4ec0-a2c3-1ffb3fd9281f tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] PATH_INFO: `/v3/projects/f4eefc2fafef4054b6d4f7d17f645406` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:12.492211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086904b-13a0-4ec0-a2c3-1ffb3fd9281f tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: Authorizing `identity:get_project(project_id=f4eefc2fafef4054b6d4f7d17f645406)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:12.495137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086904b-13a0-4ec0-a2c3-1ffb3fd9281f tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:12.497381 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1111/2197] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:23:12 2022] GET /identity/v3/projects/f4eefc2fafef4054b6d4f7d17f645406 => generated 383 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:23:12.555353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e7f9f-fc2b-44be-8988-9cbbc0c2837a None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:12.555850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e7f9f-fc2b-44be-8988-9cbbc0c2837a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:12.556928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e7f9f-fc2b-44be-8988-9cbbc0c2837a None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:12.559860 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1087/2198] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:23:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:23:12.565907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086904b-13a0-4ec0-a2c3-1ffb3fd9281f tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:23:12.568544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6086904b-13a0-4ec0-a2c3-1ffb3fd9281f tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:12.590863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086904b-13a0-4ec0-a2c3-1ffb3fd9281f tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:12.605853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086904b-13a0-4ec0-a2c3-1ffb3fd9281f tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:12.610909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7286c8-a9d3-4c7c-b757-6a64f2e8b9cd tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25824ad90b6343f48f537b899d47a569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8561e58232d14e9991d8d40600cd190c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:12.611724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7286c8-a9d3-4c7c-b757-6a64f2e8b9cd tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:12.612161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7286c8-a9d3-4c7c-b757-6a64f2e8b9cd tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:12.612618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7286c8-a9d3-4c7c-b757-6a64f2e8b9cd tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] PATH_INFO: `/v3/projects/f4eefc2fafef4054b6d4f7d17f645406` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:12.613926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7286c8-a9d3-4c7c-b757-6a64f2e8b9cd tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: Authorizing `identity:get_project(project_id=f4eefc2fafef4054b6d4f7d17f645406)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:12.616527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7286c8-a9d3-4c7c-b757-6a64f2e8b9cd tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:12.626382 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1112/2199] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:23:12 2022] GET /identity/v3/projects/f4eefc2fafef4054b6d4f7d17f645406 => generated 383 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:23:12.661554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:12.987340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb610c0-354f-47a0-86a6-5e44908d9314 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:12.987340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb610c0-354f-47a0-86a6-5e44908d9314 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:12.987340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb610c0-354f-47a0-86a6-5e44908d9314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:13.021996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5fb610c0-354f-47a0-86a6-5e44908d9314 None None] MFA Rules not processed for user `ac07e3a844b349ce9e2436a4fdf36512`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:13.023970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5fb610c0-354f-47a0-86a6-5e44908d9314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:13.033952 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1088/2200] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:13.153589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:13.212319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:13.674775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:13.860332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a5d3f-2a6f-4bc8-8409-da48531130ff None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:13.860833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a5d3f-2a6f-4bc8-8409-da48531130ff None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:13.860918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a5d3f-2a6f-4bc8-8409-da48531130ff None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:13.862691 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1113/2201] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:23:13.870785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb610c0-354f-47a0-86a6-5e44908d9314 None None] Authenticating service token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:23:13.892204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb610c0-354f-47a0-86a6-5e44908d9314 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:13.913222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb610c0-354f-47a0-86a6-5e44908d9314 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:13.919508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f10c1a-820b-40ce-b572-a38a5f7ec63b tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25824ad90b6343f48f537b899d47a569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8561e58232d14e9991d8d40600cd190c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:13.920252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f10c1a-820b-40ce-b572-a38a5f7ec63b tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:13.921572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f10c1a-820b-40ce-b572-a38a5f7ec63b tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:13.922061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f10c1a-820b-40ce-b572-a38a5f7ec63b tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] PATH_INFO: `/v3/projects/f4eefc2fafef4054b6d4f7d17f645406` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:13.925122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f10c1a-820b-40ce-b572-a38a5f7ec63b tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: Authorizing `identity:get_project(project_id=f4eefc2fafef4054b6d4f7d17f645406)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:13.927254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f10c1a-820b-40ce-b572-a38a5f7ec63b tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:13.938949 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1089/2202] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:23:13 2022] GET /identity/v3/projects/f4eefc2fafef4054b6d4f7d17f645406 => generated 383 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:23:14.177238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a5d3f-2a6f-4bc8-8409-da48531130ff None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:14.314796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a5d3f-2a6f-4bc8-8409-da48531130ff None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:14.323032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927a83e-87eb-4dbe-8849-6a6764f590cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:14.324004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927a83e-87eb-4dbe-8849-6a6764f590cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:14.325733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927a83e-87eb-4dbe-8849-6a6764f590cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:14.326303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927a83e-87eb-4dbe-8849-6a6764f590cf admin admin] PATH_INFO: `/v3/users/ac07e3a844b349ce9e2436a4fdf36512` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:14.329351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927a83e-87eb-4dbe-8849-6a6764f590cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac07e3a844b349ce9e2436a4fdf36512)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:14.339541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927a83e-87eb-4dbe-8849-6a6764f590cf admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:14.575439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5927a83e-87eb-4dbe-8849-6a6764f590cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac07e3a844b349ce9e2436a4fdf36512'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:14.576597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5927a83e-87eb-4dbe-8849-6a6764f590cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac07e3a844b349ce9e2436a4fdf36512'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:14.587802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5927a83e-87eb-4dbe-8849-6a6764f590cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac07e3a844b349ce9e2436a4fdf36512'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:14.628329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5927a83e-87eb-4dbe-8849-6a6764f590cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac07e3a844b349ce9e2436a4fdf36512'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:14.632720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5927a83e-87eb-4dbe-8849-6a6764f590cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac07e3a844b349ce9e2436a4fdf36512'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:14.655858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:14.742064 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1114/2203] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:23:14 2022] DELETE /identity/v3/users/ac07e3a844b349ce9e2436a4fdf36512 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:23:14.746664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4da3d7-0d75-4da9-8eb3-bbd603536476 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:14.747513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4da3d7-0d75-4da9-8eb3-bbd603536476 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:14.747799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4da3d7-0d75-4da9-8eb3-bbd603536476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:14.777600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ff4da3d7-0d75-4da9-8eb3-bbd603536476 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:14.779335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ff4da3d7-0d75-4da9-8eb3-bbd603536476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:14.882375 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1090/2204] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:14.886335 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927a83e-87eb-4dbe-8849-6a6764f590cf admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:14.886335 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5927a83e-87eb-4dbe-8849-6a6764f590cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:14.911329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:15.078975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927a83e-87eb-4dbe-8849-6a6764f590cf admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:15.089740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016473b6-d1dc-4358-a7c5-e8533480e03a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:15.090875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016473b6-d1dc-4358-a7c5-e8533480e03a service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:15.091346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016473b6-d1dc-4358-a7c5-e8533480e03a service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:15.092630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016473b6-d1dc-4358-a7c5-e8533480e03a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:15.114761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016473b6-d1dc-4358-a7c5-e8533480e03a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:15.116227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016473b6-d1dc-4358-a7c5-e8533480e03a service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:15.136259 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1115/2205] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:23:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:23:15.888961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4da3d7-0d75-4da9-8eb3-bbd603536476 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:15.888961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ff4da3d7-0d75-4da9-8eb3-bbd603536476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:15.916585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4da3d7-0d75-4da9-8eb3-bbd603536476 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:15.932253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff607c-1c2f-4131-9027-65f76651cab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:15.933289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff607c-1c2f-4131-9027-65f76651cab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:15.933780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff607c-1c2f-4131-9027-65f76651cab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:15.934292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff607c-1c2f-4131-9027-65f76651cab0 admin admin] PATH_INFO: `/v3/projects/f4eefc2fafef4054b6d4f7d17f645406` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:15.935727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff607c-1c2f-4131-9027-65f76651cab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4eefc2fafef4054b6d4f7d17f645406)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:15.943594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff607c-1c2f-4131-9027-65f76651cab0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:16.206615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-57ff607c-1c2f-4131-9027-65f76651cab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4eefc2fafef4054b6d4f7d17f645406', 'request_id': 'req-57ff607c-1c2f-4131-9027-65f76651cab0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:16.327237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-57ff607c-1c2f-4131-9027-65f76651cab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4eefc2fafef4054b6d4f7d17f645406', 'request_id': 'req-57ff607c-1c2f-4131-9027-65f76651cab0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:16.334275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-57ff607c-1c2f-4131-9027-65f76651cab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4eefc2fafef4054b6d4f7d17f645406', 'request_id': 'req-57ff607c-1c2f-4131-9027-65f76651cab0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:16.348916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-57ff607c-1c2f-4131-9027-65f76651cab0 admin admin] The token cache is being invalidate because project f4eefc2fafef4054b6d4f7d17f645406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:23:16.349870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-57ff607c-1c2f-4131-9027-65f76651cab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:16.350724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-57ff607c-1c2f-4131-9027-65f76651cab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:16.353598 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1091/2206] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:23:15 2022] DELETE /identity/v3/projects/f4eefc2fafef4054b6d4f7d17f645406 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:23:16.357619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016473b6-d1dc-4358-a7c5-e8533480e03a service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:16.372559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016473b6-d1dc-4358-a7c5-e8533480e03a service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:16.450638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79820b0-4903-4640-916f-ca67f4d6fc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:16.452632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79820b0-4903-4640-916f-ca67f4d6fc79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:16.453144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79820b0-4903-4640-916f-ca67f4d6fc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:16.453797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79820b0-4903-4640-916f-ca67f4d6fc79 admin admin] PATH_INFO: `/v3/users/25824ad90b6343f48f537b899d47a569` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:16.455512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79820b0-4903-4640-916f-ca67f4d6fc79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25824ad90b6343f48f537b899d47a569)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:16.458407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79820b0-4903-4640-916f-ca67f4d6fc79 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:16.466643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:16.690914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e79820b0-4903-4640-916f-ca67f4d6fc79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25824ad90b6343f48f537b899d47a569'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:16.692617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e79820b0-4903-4640-916f-ca67f4d6fc79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25824ad90b6343f48f537b899d47a569'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:16.708310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e79820b0-4903-4640-916f-ca67f4d6fc79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25824ad90b6343f48f537b899d47a569'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:16.726267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e79820b0-4903-4640-916f-ca67f4d6fc79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25824ad90b6343f48f537b899d47a569'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:16.727546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e79820b0-4903-4640-916f-ca67f4d6fc79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25824ad90b6343f48f537b899d47a569'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:16.828249 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1116/2207] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:23:16 2022] DELETE /identity/v3/users/25824ad90b6343f48f537b899d47a569 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:23:17.018243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:17.544782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:18.093359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff607c-1c2f-4131-9027-65f76651cab0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:18.094963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-57ff607c-1c2f-4131-9027-65f76651cab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:18.110301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff607c-1c2f-4131-9027-65f76651cab0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:18.170695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd6b9f-c79f-4bb0-bf99-b59320483b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:18.171886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd6b9f-c79f-4bb0-bf99-b59320483b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:18.172278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd6b9f-c79f-4bb0-bf99-b59320483b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:18.172452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd6b9f-c79f-4bb0-bf99-b59320483b9e admin admin] PATH_INFO: `/v3/projects/8561e58232d14e9991d8d40600cd190c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:18.173777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd6b9f-c79f-4bb0-bf99-b59320483b9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8561e58232d14e9991d8d40600cd190c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:18.175633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd6b9f-c79f-4bb0-bf99-b59320483b9e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:18.328906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e8bd6b9f-c79f-4bb0-bf99-b59320483b9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8561e58232d14e9991d8d40600cd190c', 'request_id': 'req-e8bd6b9f-c79f-4bb0-bf99-b59320483b9e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:18.421472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e8bd6b9f-c79f-4bb0-bf99-b59320483b9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8561e58232d14e9991d8d40600cd190c', 'request_id': 'req-e8bd6b9f-c79f-4bb0-bf99-b59320483b9e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:18.432898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e8bd6b9f-c79f-4bb0-bf99-b59320483b9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8561e58232d14e9991d8d40600cd190c', 'request_id': 'req-e8bd6b9f-c79f-4bb0-bf99-b59320483b9e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:18.458146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e8bd6b9f-c79f-4bb0-bf99-b59320483b9e admin admin] The token cache is being invalidate because project 8561e58232d14e9991d8d40600cd190c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:23:18.459112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e8bd6b9f-c79f-4bb0-bf99-b59320483b9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:18.459530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e8bd6b9f-c79f-4bb0-bf99-b59320483b9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:18.463923 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1092/2208] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:23:18 2022] DELETE /identity/v3/projects/8561e58232d14e9991d8d40600cd190c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:23:18.470006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7455d6b-8773-4ad6-bcd5-a4a7466c18fe None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:18.470494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7455d6b-8773-4ad6-bcd5-a4a7466c18fe None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:18.470621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7455d6b-8773-4ad6-bcd5-a4a7466c18fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:18.480908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:18.522182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b7455d6b-8773-4ad6-bcd5-a4a7466c18fe None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:18.524997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b7455d6b-8773-4ad6-bcd5-a4a7466c18fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:18.598283 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1117/2209] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:18.606650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76e04d-4d04-4d9f-8e37-24213ddfc0ed None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:18.606941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76e04d-4d04-4d9f-8e37-24213ddfc0ed None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:18.607216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76e04d-4d04-4d9f-8e37-24213ddfc0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:18.644131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-dc76e04d-4d04-4d9f-8e37-24213ddfc0ed None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:18.646624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dc76e04d-4d04-4d9f-8e37-24213ddfc0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:18.658293 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1093/2210] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:18.662952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7455d6b-8773-4ad6-bcd5-a4a7466c18fe None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:18.675305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7455d6b-8773-4ad6-bcd5-a4a7466c18fe None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:18.684238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92fba5-4e27-49f2-8ec6-5c5d830af6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:18.685020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92fba5-4e27-49f2-8ec6-5c5d830af6de admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:18.685401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92fba5-4e27-49f2-8ec6-5c5d830af6de admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:18.685782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92fba5-4e27-49f2-8ec6-5c5d830af6de admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:18.686663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92fba5-4e27-49f2-8ec6-5c5d830af6de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:23:18.687069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92fba5-4e27-49f2-8ec6-5c5d830af6de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:18.688831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92fba5-4e27-49f2-8ec6-5c5d830af6de admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:18.705456 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1118/2211] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:23:18.706744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76e04d-4d04-4d9f-8e37-24213ddfc0ed None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:18.716363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76e04d-4d04-4d9f-8e37-24213ddfc0ed None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:18.722221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d23a4-5153-481b-b394-a2f017022c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:18.722860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d23a4-5153-481b-b394-a2f017022c1e admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:18.723145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d23a4-5153-481b-b394-a2f017022c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:18.723424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d23a4-5153-481b-b394-a2f017022c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:18.724448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d23a4-5153-481b-b394-a2f017022c1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:18.726594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d23a4-5153-481b-b394-a2f017022c1e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:18.847329 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1094/2212] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:23:18 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:23:18.856831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92fba5-4e27-49f2-8ec6-5c5d830af6de admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:18.874128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92fba5-4e27-49f2-8ec6-5c5d830af6de admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:18.951651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c123b3d-0c92-4c11-9aa1-b69faa9c4b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:18.953046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c123b3d-0c92-4c11-9aa1-b69faa9c4b7d admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:18.953332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c123b3d-0c92-4c11-9aa1-b69faa9c4b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:18.953629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c123b3d-0c92-4c11-9aa1-b69faa9c4b7d admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:18.954327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c123b3d-0c92-4c11-9aa1-b69faa9c4b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:18.956528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c123b3d-0c92-4c11-9aa1-b69faa9c4b7d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:19.073125 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1119/2213] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:23:18 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:23:19.074327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d23a4-5153-481b-b394-a2f017022c1e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:19.088712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d23a4-5153-481b-b394-a2f017022c1e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:19.099980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0acfd-5694-4e80-9874-c7281679e760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:19.101539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0acfd-5694-4e80-9874-c7281679e760 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:19.102100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0acfd-5694-4e80-9874-c7281679e760 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:19.102626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0acfd-5694-4e80-9874-c7281679e760 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:19.103451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0acfd-5694-4e80-9874-c7281679e760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:19.105593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0acfd-5694-4e80-9874-c7281679e760 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:19.119835 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1095/2214] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:23:19.124904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c123b3d-0c92-4c11-9aa1-b69faa9c4b7d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:19.136704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c123b3d-0c92-4c11-9aa1-b69faa9c4b7d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:19.143305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c76f2e-8130-4382-bc30-8a77959be86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:19.144115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c76f2e-8130-4382-bc30-8a77959be86e admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:19.144410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c76f2e-8130-4382-bc30-8a77959be86e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:19.145017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c76f2e-8130-4382-bc30-8a77959be86e admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:19.145777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c76f2e-8130-4382-bc30-8a77959be86e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:19.162244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c76f2e-8130-4382-bc30-8a77959be86e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:19.162244 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1120/2215] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:23:19.165899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0acfd-5694-4e80-9874-c7281679e760 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:19.182341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0acfd-5694-4e80-9874-c7281679e760 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:19.191699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a5087-0847-4405-970d-14d8b60cc89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:19.192457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a5087-0847-4405-970d-14d8b60cc89f admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:19.192817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a5087-0847-4405-970d-14d8b60cc89f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:19.193322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a5087-0847-4405-970d-14d8b60cc89f admin admin] PATH_INFO: `/v3/projects/78742a1d089f4aa2985fc7060d5e7cb9/users/a50a0c4308064b25a67182b77431087b/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:19.214179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a5087-0847-4405-970d-14d8b60cc89f admin admin] RBAC: Authorizing `identity:create_grant(project_id=78742a1d089f4aa2985fc7060d5e7cb9, user_id=a50a0c4308064b25a67182b77431087b, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:19.217036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a5087-0847-4405-970d-14d8b60cc89f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:19.294879 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1096/2216] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:23:19 2022] PUT /identity/v3/projects/78742a1d089f4aa2985fc7060d5e7cb9/users/a50a0c4308064b25a67182b77431087b/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:23:19.304980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b26e2-4ea8-42ec-90c3-f2eff731184c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:19.305546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b26e2-4ea8-42ec-90c3-f2eff731184c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:19.305937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b26e2-4ea8-42ec-90c3-f2eff731184c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:19.344404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6a0b26e2-4ea8-42ec-90c3-f2eff731184c None None] MFA Rules not processed for user `a50a0c4308064b25a67182b77431087b`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:19.346110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6a0b26e2-4ea8-42ec-90c3-f2eff731184c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:19.432136 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1121/2217] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:19.437206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a5087-0847-4405-970d-14d8b60cc89f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:19.540419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a5087-0847-4405-970d-14d8b60cc89f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:19.545627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7376283-80f6-453d-a97a-9610d13b6b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:19.546818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7376283-80f6-453d-a97a-9610d13b6b0b admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:19.547106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7376283-80f6-453d-a97a-9610d13b6b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:19.547389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7376283-80f6-453d-a97a-9610d13b6b0b admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:19.548031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7376283-80f6-453d-a97a-9610d13b6b0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:19.549983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7376283-80f6-453d-a97a-9610d13b6b0b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:19.648494 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1097/2218] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:23:19 2022] POST /identity/v3/projects => generated 375 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:23:19.649936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b26e2-4ea8-42ec-90c3-f2eff731184c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:19.677112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b26e2-4ea8-42ec-90c3-f2eff731184c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:19.718444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:19.742626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbb78c-79ed-438d-b61d-4b9ce7256a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:19.743439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbb78c-79ed-438d-b61d-4b9ce7256a46 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:19.743963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbb78c-79ed-438d-b61d-4b9ce7256a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:19.744387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbb78c-79ed-438d-b61d-4b9ce7256a46 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:19.745267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbb78c-79ed-438d-b61d-4b9ce7256a46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:19.747562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbb78c-79ed-438d-b61d-4b9ce7256a46 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:19.863274 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1122/2219] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:23:19 2022] POST /identity/v3/users => generated 294 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:23:19.864522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7376283-80f6-453d-a97a-9610d13b6b0b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:19.875977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7376283-80f6-453d-a97a-9610d13b6b0b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:19.884100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d654e-919b-4241-b37a-3519303506e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:19.884755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d654e-919b-4241-b37a-3519303506e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:19.885010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d654e-919b-4241-b37a-3519303506e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:19.885280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d654e-919b-4241-b37a-3519303506e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:19.885969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d654e-919b-4241-b37a-3519303506e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:19.887676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d654e-919b-4241-b37a-3519303506e8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:19.922372 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1098/2220] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:23:19.926625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbb78c-79ed-438d-b61d-4b9ce7256a46 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:19.945014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbb78c-79ed-438d-b61d-4b9ce7256a46 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:19.957967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce11b85-8263-46da-a7fd-9bb37a58727f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:19.958956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce11b85-8263-46da-a7fd-9bb37a58727f admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:19.959384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce11b85-8263-46da-a7fd-9bb37a58727f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:19.959798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce11b85-8263-46da-a7fd-9bb37a58727f admin admin] PATH_INFO: `/v3/projects/ec6ea8346e3d4c85bf11ace1a3eb098b/users/8f1dc9195d284e1dbd078dc7cd92507e/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:19.988417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce11b85-8263-46da-a7fd-9bb37a58727f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec6ea8346e3d4c85bf11ace1a3eb098b, user_id=8f1dc9195d284e1dbd078dc7cd92507e, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:19.995141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce11b85-8263-46da-a7fd-9bb37a58727f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:20.088438 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1123/2221] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:23:19 2022] PUT /identity/v3/projects/ec6ea8346e3d4c85bf11ace1a3eb098b/users/8f1dc9195d284e1dbd078dc7cd92507e/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:23:20.092611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d654e-919b-4241-b37a-3519303506e8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:20.104405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d654e-919b-4241-b37a-3519303506e8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:20.164148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92a0e1-e1ef-4fb0-bc38-0c5bcd6f1cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:20.164910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92a0e1-e1ef-4fb0-bc38-0c5bcd6f1cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:20.165189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92a0e1-e1ef-4fb0-bc38-0c5bcd6f1cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:20.165457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92a0e1-e1ef-4fb0-bc38-0c5bcd6f1cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:20.166156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92a0e1-e1ef-4fb0-bc38-0c5bcd6f1cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:20.167812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92a0e1-e1ef-4fb0-bc38-0c5bcd6f1cf3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:20.178904 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1099/2222] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:23:20.183025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce11b85-8263-46da-a7fd-9bb37a58727f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:20.228212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce11b85-8263-46da-a7fd-9bb37a58727f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:20.240279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c347244-0307-4434-9653-efbf8da4f394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:20.242395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c347244-0307-4434-9653-efbf8da4f394 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:20.242712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c347244-0307-4434-9653-efbf8da4f394 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:20.243000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c347244-0307-4434-9653-efbf8da4f394 admin admin] PATH_INFO: `/v3/projects/ec6ea8346e3d4c85bf11ace1a3eb098b/users/8f1dc9195d284e1dbd078dc7cd92507e/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:20.252948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c347244-0307-4434-9653-efbf8da4f394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec6ea8346e3d4c85bf11ace1a3eb098b, user_id=8f1dc9195d284e1dbd078dc7cd92507e, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:20.255849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c347244-0307-4434-9653-efbf8da4f394 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:20.295414 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1124/2223] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:23:20 2022] PUT /identity/v3/projects/ec6ea8346e3d4c85bf11ace1a3eb098b/users/8f1dc9195d284e1dbd078dc7cd92507e/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:23:20.307081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d9580-7fa0-4114-9b0a-18457aac21cc None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:20.307653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d9580-7fa0-4114-9b0a-18457aac21cc None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:20.308111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d9580-7fa0-4114-9b0a-18457aac21cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:20.338917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-fd2d9580-7fa0-4114-9b0a-18457aac21cc None None] MFA Rules not processed for user `8f1dc9195d284e1dbd078dc7cd92507e`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:20.340251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fd2d9580-7fa0-4114-9b0a-18457aac21cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:20.357260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:20.430068 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1100/2224] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:20.433491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aafb7f-11ae-40f4-873f-c91a6187ccbe None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:20.433728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aafb7f-11ae-40f4-873f-c91a6187ccbe None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:20.434117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aafb7f-11ae-40f4-873f-c91a6187ccbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:20.458817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a0aafb7f-11ae-40f4-873f-c91a6187ccbe None None] MFA Rules not processed for user `a50a0c4308064b25a67182b77431087b`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:20.460302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a0aafb7f-11ae-40f4-873f-c91a6187ccbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:20.529262 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1125/2225] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:20.541127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d9580-7fa0-4114-9b0a-18457aac21cc None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:20.542967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fd2d9580-7fa0-4114-9b0a-18457aac21cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:20.626222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d9580-7fa0-4114-9b0a-18457aac21cc None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:20.633017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c1be9-aa5d-4434-b012-c2ac7b3ae0df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:20.633562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c1be9-aa5d-4434-b012-c2ac7b3ae0df service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:20.633859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c1be9-aa5d-4434-b012-c2ac7b3ae0df service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:20.634169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c1be9-aa5d-4434-b012-c2ac7b3ae0df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:20.643398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c1be9-aa5d-4434-b012-c2ac7b3ae0df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:20.645978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c1be9-aa5d-4434-b012-c2ac7b3ae0df service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:20.657234 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1101/2226] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:23:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:23:20.898835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:21.012631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:21.355041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:21.618107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20d3c8-fae5-432d-849d-cb4be5a3030c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:21.618107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20d3c8-fae5-432d-849d-cb4be5a3030c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:21.618107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20d3c8-fae5-432d-849d-cb4be5a3030c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:21.698873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3f20d3c8-fae5-432d-849d-cb4be5a3030c None None] MFA Rules not processed for user `4a882b983a3b48bfada30b64b7002993`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:21.698873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3f20d3c8-fae5-432d-849d-cb4be5a3030c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:21.801893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:21.865665 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1126/2227] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:21 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:21.876154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ec91f-3b53-4d22-a59c-90e7ff86bd00 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:21.876662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ec91f-3b53-4d22-a59c-90e7ff86bd00 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:21.877167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ec91f-3b53-4d22-a59c-90e7ff86bd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:21.903108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-2c3ec91f-3b53-4d22-a59c-90e7ff86bd00 None None] MFA Rules not processed for user `ba3ce7f040d24c33bcf9b97d1ef25268`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:21.905088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2c3ec91f-3b53-4d22-a59c-90e7ff86bd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:21.987592 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1102/2228] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:21 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:22.007856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20d3c8-fae5-432d-849d-cb4be5a3030c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:22.009660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3f20d3c8-fae5-432d-849d-cb4be5a3030c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:22.051036 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20d3c8-fae5-432d-849d-cb4be5a3030c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:22.058167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305537e7-1448-4b8d-ba6e-3081673565a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:22.058806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305537e7-1448-4b8d-ba6e-3081673565a6 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:22.059128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305537e7-1448-4b8d-ba6e-3081673565a6 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:22.059411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305537e7-1448-4b8d-ba6e-3081673565a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:22.061311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-305537e7-1448-4b8d-ba6e-3081673565a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:22.074550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:22.079214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305537e7-1448-4b8d-ba6e-3081673565a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:22.080934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305537e7-1448-4b8d-ba6e-3081673565a6 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:22.107228 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1127/2229] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:23:22 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:23:22.693466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:22.774858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:23.605079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:24.212407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:24.521016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:24.580738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18683784-52dd-4e42-9ab7-11ab2a65b4e1 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:24.580738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18683784-52dd-4e42-9ab7-11ab2a65b4e1 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:24.580738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18683784-52dd-4e42-9ab7-11ab2a65b4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:24.627389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-18683784-52dd-4e42-9ab7-11ab2a65b4e1 None None] MFA Rules not processed for user `8c93886c5818439690564c2299a4f3ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:24.628661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-18683784-52dd-4e42-9ab7-11ab2a65b4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:24.750791 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1103/2230] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:24.778138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:25.156847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305537e7-1448-4b8d-ba6e-3081673565a6 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:25.160191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-305537e7-1448-4b8d-ba6e-3081673565a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:25.310776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305537e7-1448-4b8d-ba6e-3081673565a6 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:25.317354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9ad03-4ab5-4406-ba1d-f3cabc07966a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:25.318574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9ad03-4ab5-4406-ba1d-f3cabc07966a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:25.320096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9ad03-4ab5-4406-ba1d-f3cabc07966a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:25.320526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9ad03-4ab5-4406-ba1d-f3cabc07966a admin admin] PATH_INFO: `/v3/users/7bd90bf4a2aa403cacd06bcaeb502640` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:25.322711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9ad03-4ab5-4406-ba1d-f3cabc07966a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bd90bf4a2aa403cacd06bcaeb502640)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:25.325040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9ad03-4ab5-4406-ba1d-f3cabc07966a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:25.572661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0eb9ad03-4ab5-4406-ba1d-f3cabc07966a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bd90bf4a2aa403cacd06bcaeb502640'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:25.574438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0eb9ad03-4ab5-4406-ba1d-f3cabc07966a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bd90bf4a2aa403cacd06bcaeb502640'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:25.586509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0eb9ad03-4ab5-4406-ba1d-f3cabc07966a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bd90bf4a2aa403cacd06bcaeb502640'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:25.605345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0eb9ad03-4ab5-4406-ba1d-f3cabc07966a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bd90bf4a2aa403cacd06bcaeb502640'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:25.606227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0eb9ad03-4ab5-4406-ba1d-f3cabc07966a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bd90bf4a2aa403cacd06bcaeb502640'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:25.691461 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1128/2231] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:23:25 2022] DELETE /identity/v3/users/7bd90bf4a2aa403cacd06bcaeb502640 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:23:25.692455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ea779-f4ae-4c07-80b9-7401c7ffe7a7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:25.693299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ea779-f4ae-4c07-80b9-7401c7ffe7a7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:25.693728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ea779-f4ae-4c07-80b9-7401c7ffe7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:25.735071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ae4ea779-f4ae-4c07-80b9-7401c7ffe7a7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:25.737122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ae4ea779-f4ae-4c07-80b9-7401c7ffe7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:25.878990 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1104/2232] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:23:25.890559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9ad03-4ab5-4406-ba1d-f3cabc07966a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:25.893993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0eb9ad03-4ab5-4406-ba1d-f3cabc07966a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:26.019092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9ad03-4ab5-4406-ba1d-f3cabc07966a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:26.023112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21dd45-0aca-4030-8271-21ecb969853b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:26.023731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21dd45-0aca-4030-8271-21ecb969853b service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:26.024064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21dd45-0aca-4030-8271-21ecb969853b service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:26.024348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21dd45-0aca-4030-8271-21ecb969853b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:26.034896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21dd45-0aca-4030-8271-21ecb969853b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:26.036405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21dd45-0aca-4030-8271-21ecb969853b service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:26.052573 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1129/2233] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:23:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:23:26.104092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:26.371187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ea779-f4ae-4c07-80b9-7401c7ffe7a7 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:26.372838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ae4ea779-f4ae-4c07-80b9-7401c7ffe7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:26.386368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ea779-f4ae-4c07-80b9-7401c7ffe7a7 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:26.393872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7547f-60b4-47a7-9ef2-07970d5421e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:26.398351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7547f-60b4-47a7-9ef2-07970d5421e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:26.398351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7547f-60b4-47a7-9ef2-07970d5421e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:26.398351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7547f-60b4-47a7-9ef2-07970d5421e3 admin admin] PATH_INFO: `/v3/projects/c18fabfb19904c5ea3c5c096d9d6cad7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:26.398351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7547f-60b4-47a7-9ef2-07970d5421e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c18fabfb19904c5ea3c5c096d9d6cad7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:26.398911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7547f-60b4-47a7-9ef2-07970d5421e3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:26.592252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-99d7547f-60b4-47a7-9ef2-07970d5421e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c18fabfb19904c5ea3c5c096d9d6cad7', 'request_id': 'req-99d7547f-60b4-47a7-9ef2-07970d5421e3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:26.700926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-99d7547f-60b4-47a7-9ef2-07970d5421e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c18fabfb19904c5ea3c5c096d9d6cad7', 'request_id': 'req-99d7547f-60b4-47a7-9ef2-07970d5421e3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:26.709699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-99d7547f-60b4-47a7-9ef2-07970d5421e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c18fabfb19904c5ea3c5c096d9d6cad7', 'request_id': 'req-99d7547f-60b4-47a7-9ef2-07970d5421e3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:26.730269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-99d7547f-60b4-47a7-9ef2-07970d5421e3 admin admin] The token cache is being invalidate because project c18fabfb19904c5ea3c5c096d9d6cad7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:23:26.731287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-99d7547f-60b4-47a7-9ef2-07970d5421e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:26.731864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-99d7547f-60b4-47a7-9ef2-07970d5421e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:26.733397 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1105/2234] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:23:26 2022] DELETE /identity/v3/projects/c18fabfb19904c5ea3c5c096d9d6cad7 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:23:26.738729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21dd45-0aca-4030-8271-21ecb969853b service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:26.764640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21dd45-0aca-4030-8271-21ecb969853b service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:26.850217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:26.862322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92453389-1c04-40af-a4b2-1a5df63ba4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:26.863218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92453389-1c04-40af-a4b2-1a5df63ba4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:26.863995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92453389-1c04-40af-a4b2-1a5df63ba4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:26.864514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92453389-1c04-40af-a4b2-1a5df63ba4ab admin admin] PATH_INFO: `/v3/users/dd65012d10d44b1c8ae21909750f4c92` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:26.866225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92453389-1c04-40af-a4b2-1a5df63ba4ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd65012d10d44b1c8ae21909750f4c92)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:26.869190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92453389-1c04-40af-a4b2-1a5df63ba4ab admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:27.153486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-92453389-1c04-40af-a4b2-1a5df63ba4ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd65012d10d44b1c8ae21909750f4c92'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:27.154312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-92453389-1c04-40af-a4b2-1a5df63ba4ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd65012d10d44b1c8ae21909750f4c92'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:27.168829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-92453389-1c04-40af-a4b2-1a5df63ba4ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd65012d10d44b1c8ae21909750f4c92'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:27.188570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-92453389-1c04-40af-a4b2-1a5df63ba4ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd65012d10d44b1c8ae21909750f4c92'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:27.198182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-92453389-1c04-40af-a4b2-1a5df63ba4ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd65012d10d44b1c8ae21909750f4c92'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:27.371714 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1130/2235] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:23:26 2022] DELETE /identity/v3/users/dd65012d10d44b1c8ae21909750f4c92 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:23:27.854730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7547f-60b4-47a7-9ef2-07970d5421e3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:27.858726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-99d7547f-60b4-47a7-9ef2-07970d5421e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:27.893017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7547f-60b4-47a7-9ef2-07970d5421e3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:27.969099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956ab58-4da5-4f21-ab40-f5a353dda3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:27.969750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956ab58-4da5-4f21-ab40-f5a353dda3a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:27.970052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956ab58-4da5-4f21-ab40-f5a353dda3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:27.970346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956ab58-4da5-4f21-ab40-f5a353dda3a7 admin admin] PATH_INFO: `/v3/projects/2075e067bb8a4d98998c997ae58d8031` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:27.971545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956ab58-4da5-4f21-ab40-f5a353dda3a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2075e067bb8a4d98998c997ae58d8031)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:27.973471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956ab58-4da5-4f21-ab40-f5a353dda3a7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:28.096620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:28.127324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7956ab58-4da5-4f21-ab40-f5a353dda3a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2075e067bb8a4d98998c997ae58d8031', 'request_id': 'req-7956ab58-4da5-4f21-ab40-f5a353dda3a7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:28.221352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7956ab58-4da5-4f21-ab40-f5a353dda3a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2075e067bb8a4d98998c997ae58d8031', 'request_id': 'req-7956ab58-4da5-4f21-ab40-f5a353dda3a7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:28.240782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7956ab58-4da5-4f21-ab40-f5a353dda3a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2075e067bb8a4d98998c997ae58d8031', 'request_id': 'req-7956ab58-4da5-4f21-ab40-f5a353dda3a7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:28.281264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7956ab58-4da5-4f21-ab40-f5a353dda3a7 admin admin] The token cache is being invalidate because project 2075e067bb8a4d98998c997ae58d8031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:23:28.281619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7956ab58-4da5-4f21-ab40-f5a353dda3a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:28.282471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7956ab58-4da5-4f21-ab40-f5a353dda3a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:28.287789 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1106/2236] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:23:27 2022] DELETE /identity/v3/projects/2075e067bb8a4d98998c997ae58d8031 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:23:28.289474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f48d1-dba3-4399-ab61-1c7cf2a1b40b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:28.290240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f48d1-dba3-4399-ab61-1c7cf2a1b40b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:28.290525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f48d1-dba3-4399-ab61-1c7cf2a1b40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:28.316037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f50f48d1-dba3-4399-ab61-1c7cf2a1b40b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:28.316126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f50f48d1-dba3-4399-ab61-1c7cf2a1b40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:28.431479 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1131/2237] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:28.440167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114c59d-98cb-43bc-b0f3-2c2ea2dae984 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:28.440458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114c59d-98cb-43bc-b0f3-2c2ea2dae984 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:28.440739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114c59d-98cb-43bc-b0f3-2c2ea2dae984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:28.469603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8114c59d-98cb-43bc-b0f3-2c2ea2dae984 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:28.470993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8114c59d-98cb-43bc-b0f3-2c2ea2dae984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:28.480229 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1107/2238] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:28.485030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f48d1-dba3-4399-ab61-1c7cf2a1b40b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:28.494956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f48d1-dba3-4399-ab61-1c7cf2a1b40b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:28.500837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389784fa-8ab9-417f-a0d8-01006c778a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:28.501683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389784fa-8ab9-417f-a0d8-01006c778a34 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:28.501965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389784fa-8ab9-417f-a0d8-01006c778a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:28.502274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389784fa-8ab9-417f-a0d8-01006c778a34 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:28.502937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389784fa-8ab9-417f-a0d8-01006c778a34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:23:28.503244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389784fa-8ab9-417f-a0d8-01006c778a34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:28.504848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389784fa-8ab9-417f-a0d8-01006c778a34 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:28.518207 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1132/2239] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:23:28.523497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114c59d-98cb-43bc-b0f3-2c2ea2dae984 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:28.533718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114c59d-98cb-43bc-b0f3-2c2ea2dae984 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:28.538878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45893f-fd86-4464-90ed-10c345ada542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:28.539549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45893f-fd86-4464-90ed-10c345ada542 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:28.539896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45893f-fd86-4464-90ed-10c345ada542 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:28.540231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45893f-fd86-4464-90ed-10c345ada542 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:28.540965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45893f-fd86-4464-90ed-10c345ada542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:28.543692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45893f-fd86-4464-90ed-10c345ada542 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:28.650887 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1108/2240] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:23:28 2022] POST /identity/v3/projects => generated 403 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:23:28.655240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389784fa-8ab9-417f-a0d8-01006c778a34 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:28.668268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389784fa-8ab9-417f-a0d8-01006c778a34 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:28.738626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ced477-3543-4de2-a60e-7b79568671b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:28.739744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ced477-3543-4de2-a60e-7b79568671b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:28.739744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ced477-3543-4de2-a60e-7b79568671b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:28.740163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ced477-3543-4de2-a60e-7b79568671b3 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:28.740943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ced477-3543-4de2-a60e-7b79568671b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:28.743622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ced477-3543-4de2-a60e-7b79568671b3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:28.878677 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1133/2241] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:23:28 2022] POST /identity/v3/users => generated 302 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:23:28.882865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45893f-fd86-4464-90ed-10c345ada542 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:28.893563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45893f-fd86-4464-90ed-10c345ada542 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:28.898324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8137da-d153-47cc-b8a2-adc5eff564da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:28.898925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8137da-d153-47cc-b8a2-adc5eff564da admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:28.899205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8137da-d153-47cc-b8a2-adc5eff564da admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:28.899566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8137da-d153-47cc-b8a2-adc5eff564da admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:28.901418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8137da-d153-47cc-b8a2-adc5eff564da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:28.903206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8137da-d153-47cc-b8a2-adc5eff564da admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:28.925429 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1109/2242] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:23:28.927021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ced477-3543-4de2-a60e-7b79568671b3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:28.947606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ced477-3543-4de2-a60e-7b79568671b3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:28.956000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dd845-c680-40f0-9f7a-94a759383f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:28.956632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dd845-c680-40f0-9f7a-94a759383f3f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:28.956925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dd845-c680-40f0-9f7a-94a759383f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:28.957237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dd845-c680-40f0-9f7a-94a759383f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:28.957929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dd845-c680-40f0-9f7a-94a759383f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:28.959864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dd845-c680-40f0-9f7a-94a759383f3f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:28.989215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8137da-d153-47cc-b8a2-adc5eff564da admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:28.994749 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1134/2243] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:23:29.006211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8137da-d153-47cc-b8a2-adc5eff564da admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:29.021033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ed231-a3d5-4499-a73b-1db5b4d84d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:29.022472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ed231-a3d5-4499-a73b-1db5b4d84d95 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:29.022472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ed231-a3d5-4499-a73b-1db5b4d84d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:29.022472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ed231-a3d5-4499-a73b-1db5b4d84d95 admin admin] PATH_INFO: `/v3/projects/8dbb57ad89ad4d2488a5a2a77043dbe3/users/aecbca17301a4f17931b0bc3e90fc901/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:29.084772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ed231-a3d5-4499-a73b-1db5b4d84d95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dbb57ad89ad4d2488a5a2a77043dbe3, user_id=aecbca17301a4f17931b0bc3e90fc901, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:29.090143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ed231-a3d5-4499-a73b-1db5b4d84d95 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:29.189754 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1110/2244] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:23:28 2022] PUT /identity/v3/projects/8dbb57ad89ad4d2488a5a2a77043dbe3/users/aecbca17301a4f17931b0bc3e90fc901/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:23:29.200844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a4864-152a-4626-bbdf-6e48d105f9ec None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:29.203210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a4864-152a-4626-bbdf-6e48d105f9ec None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:29.203649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a4864-152a-4626-bbdf-6e48d105f9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:29.259804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4c2a4864-152a-4626-bbdf-6e48d105f9ec None None] MFA Rules not processed for user `aecbca17301a4f17931b0bc3e90fc901`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:29.262388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4c2a4864-152a-4626-bbdf-6e48d105f9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:29.378749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:29.413287 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1135/2245] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:29 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:29.419276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ed231-a3d5-4499-a73b-1db5b4d84d95 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:29.567706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:29.576849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ed231-a3d5-4499-a73b-1db5b4d84d95 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:29.582640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b79bc-47a6-495b-b571-ddc5d6db42a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:29.583264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b79bc-47a6-495b-b571-ddc5d6db42a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:29.591525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b79bc-47a6-495b-b571-ddc5d6db42a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:29.592500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b79bc-47a6-495b-b571-ddc5d6db42a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:29.594005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b79bc-47a6-495b-b571-ddc5d6db42a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:29.596675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b79bc-47a6-495b-b571-ddc5d6db42a0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:29.712828 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1111/2246] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:23:29 2022] POST /identity/v3/projects => generated 401 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:23:29.717373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a4864-152a-4626-bbdf-6e48d105f9ec None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:29.728618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a4864-152a-4626-bbdf-6e48d105f9ec None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:29.802439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105ba7a-4120-4791-83ca-4eee24665375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:29.804059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105ba7a-4120-4791-83ca-4eee24665375 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:29.804427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105ba7a-4120-4791-83ca-4eee24665375 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:29.804779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105ba7a-4120-4791-83ca-4eee24665375 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:29.805525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105ba7a-4120-4791-83ca-4eee24665375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:29.807775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105ba7a-4120-4791-83ca-4eee24665375 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:29.887137 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1136/2247] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:23:29 2022] POST /identity/v3/users => generated 307 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:23:29.892471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b79bc-47a6-495b-b571-ddc5d6db42a0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:29.906792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b79bc-47a6-495b-b571-ddc5d6db42a0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:29.913695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1467eb-97da-4195-84d3-4f1f31f69cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:29.913695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1467eb-97da-4195-84d3-4f1f31f69cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:29.913695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1467eb-97da-4195-84d3-4f1f31f69cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:29.913695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1467eb-97da-4195-84d3-4f1f31f69cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:29.914654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1467eb-97da-4195-84d3-4f1f31f69cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:29.916733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1467eb-97da-4195-84d3-4f1f31f69cc8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:29.928646 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1112/2248] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:23:29.933967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105ba7a-4120-4791-83ca-4eee24665375 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:29.946595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105ba7a-4120-4791-83ca-4eee24665375 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:29.958561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322937b-8678-4a6a-a734-cbd5d6295fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:29.959989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322937b-8678-4a6a-a734-cbd5d6295fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:29.960537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322937b-8678-4a6a-a734-cbd5d6295fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:29.961430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322937b-8678-4a6a-a734-cbd5d6295fe8 admin admin] PATH_INFO: `/v3/projects/fb961737d27e44cebc80febbcaa0d3f5/users/2bb66e6a90c84e9dad155d252debf7d6/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:29.979127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322937b-8678-4a6a-a734-cbd5d6295fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb961737d27e44cebc80febbcaa0d3f5, user_id=2bb66e6a90c84e9dad155d252debf7d6, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:29.982185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322937b-8678-4a6a-a734-cbd5d6295fe8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:30.045308 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1137/2249] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:23:29 2022] PUT /identity/v3/projects/fb961737d27e44cebc80febbcaa0d3f5/users/2bb66e6a90c84e9dad155d252debf7d6/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:23:30.050396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1467eb-97da-4195-84d3-4f1f31f69cc8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:30.081915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1467eb-97da-4195-84d3-4f1f31f69cc8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:30.148625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdd7c2-df82-4d4d-962c-0ed92f544c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:30.149477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdd7c2-df82-4d4d-962c-0ed92f544c31 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:30.149872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdd7c2-df82-4d4d-962c-0ed92f544c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:30.150304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdd7c2-df82-4d4d-962c-0ed92f544c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:30.151181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fdd7c2-df82-4d4d-962c-0ed92f544c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:30.153033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fdd7c2-df82-4d4d-962c-0ed92f544c31 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:30.176089 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1113/2250] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:23:30.185356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322937b-8678-4a6a-a734-cbd5d6295fe8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:30.193951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322937b-8678-4a6a-a734-cbd5d6295fe8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:30.201656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056a29a-2ea4-4ae5-b94d-b57bf948451e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:30.202460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a29a-2ea4-4ae5-b94d-b57bf948451e admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:30.202663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a29a-2ea4-4ae5-b94d-b57bf948451e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:30.202933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a29a-2ea4-4ae5-b94d-b57bf948451e admin admin] PATH_INFO: `/v3/projects/fb961737d27e44cebc80febbcaa0d3f5/users/2bb66e6a90c84e9dad155d252debf7d6/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:30.205016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056a29a-2ea4-4ae5-b94d-b57bf948451e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb961737d27e44cebc80febbcaa0d3f5, user_id=2bb66e6a90c84e9dad155d252debf7d6, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:30.207766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056a29a-2ea4-4ae5-b94d-b57bf948451e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:30.222068 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1138/2251] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:23:30 2022] PUT /identity/v3/projects/fb961737d27e44cebc80febbcaa0d3f5/users/2bb66e6a90c84e9dad155d252debf7d6/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:23:30.231383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753907f0-519d-400f-9a1e-251971f9cbae None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:30.231674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753907f0-519d-400f-9a1e-251971f9cbae None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:30.232095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753907f0-519d-400f-9a1e-251971f9cbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:30.267058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-753907f0-519d-400f-9a1e-251971f9cbae None None] MFA Rules not processed for user `2bb66e6a90c84e9dad155d252debf7d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:30.268680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-753907f0-519d-400f-9a1e-251971f9cbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:30.388812 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1114/2252] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:30 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:30.401179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056a29a-2ea4-4ae5-b94d-b57bf948451e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:30.403157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f056a29a-2ea4-4ae5-b94d-b57bf948451e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:30.508175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056a29a-2ea4-4ae5-b94d-b57bf948451e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:30.515643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423855b-76a2-4a46-bca4-8693f3ea08a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:30.516322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423855b-76a2-4a46-bca4-8693f3ea08a1 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:30.516680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423855b-76a2-4a46-bca4-8693f3ea08a1 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:30.517936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423855b-76a2-4a46-bca4-8693f3ea08a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:30.529687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423855b-76a2-4a46-bca4-8693f3ea08a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:30.532415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423855b-76a2-4a46-bca4-8693f3ea08a1 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:30.566490 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1139/2253] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:23:30 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:23:31.271332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:31.341888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:31.783954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:32.174074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64519d-22c3-4b2f-8422-c30b4adb4404 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:32.174371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64519d-22c3-4b2f-8422-c30b4adb4404 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:32.174652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64519d-22c3-4b2f-8422-c30b4adb4404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:32.193012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423855b-76a2-4a46-bca4-8693f3ea08a1 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:32.196688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6e64519d-22c3-4b2f-8422-c30b4adb4404 None None] MFA Rules not processed for user `91d1351fcb6b4cd08f176e6d0cc5bb11`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:32.197954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6e64519d-22c3-4b2f-8422-c30b4adb4404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:32.204486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423855b-76a2-4a46-bca4-8693f3ea08a1 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:32.211459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8c1d8-7888-4164-8469-29fad7d90ef2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:32.212070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8c1d8-7888-4164-8469-29fad7d90ef2 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:32.212347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8c1d8-7888-4164-8469-29fad7d90ef2 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:32.212780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8c1d8-7888-4164-8469-29fad7d90ef2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:32.257799 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1115/2254] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:32.280000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8c1d8-7888-4164-8469-29fad7d90ef2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:32.282160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8c1d8-7888-4164-8469-29fad7d90ef2 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:32.291719 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1140/2255] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:23:32 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:23:32.310398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64519d-22c3-4b2f-8422-c30b4adb4404 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:32.385808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64519d-22c3-4b2f-8422-c30b4adb4404 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:32.393492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491bf4c-6d2f-4506-84e8-f5d1862e5bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:32.394195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491bf4c-6d2f-4506-84e8-f5d1862e5bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:32.394482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491bf4c-6d2f-4506-84e8-f5d1862e5bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:32.394892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491bf4c-6d2f-4506-84e8-f5d1862e5bd2 admin admin] PATH_INFO: `/v3/users/aecbca17301a4f17931b0bc3e90fc901` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:32.396085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491bf4c-6d2f-4506-84e8-f5d1862e5bd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aecbca17301a4f17931b0bc3e90fc901)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:32.398439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491bf4c-6d2f-4506-84e8-f5d1862e5bd2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:32.587996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:32.604406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0491bf4c-6d2f-4506-84e8-f5d1862e5bd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aecbca17301a4f17931b0bc3e90fc901'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:32.605075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0491bf4c-6d2f-4506-84e8-f5d1862e5bd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aecbca17301a4f17931b0bc3e90fc901'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:32.612720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0491bf4c-6d2f-4506-84e8-f5d1862e5bd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aecbca17301a4f17931b0bc3e90fc901'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:32.625209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0491bf4c-6d2f-4506-84e8-f5d1862e5bd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aecbca17301a4f17931b0bc3e90fc901'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:32.635774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:32.692397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0491bf4c-6d2f-4506-84e8-f5d1862e5bd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aecbca17301a4f17931b0bc3e90fc901'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:32.699144 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1116/2256] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:23:32 2022] DELETE /identity/v3/users/aecbca17301a4f17931b0bc3e90fc901 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:23:32.704224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7372ab-cee6-4153-b8da-37cd40df1959 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:32.704513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7372ab-cee6-4153-b8da-37cd40df1959 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:32.704789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7372ab-cee6-4153-b8da-37cd40df1959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:32.723867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8b7372ab-cee6-4153-b8da-37cd40df1959 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:32.725555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8b7372ab-cee6-4153-b8da-37cd40df1959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:32.837539 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1141/2257] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:32.857489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491bf4c-6d2f-4506-84e8-f5d1862e5bd2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:32.877127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0491bf4c-6d2f-4506-84e8-f5d1862e5bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:33.018808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491bf4c-6d2f-4506-84e8-f5d1862e5bd2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:33.018808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3f4b6-7929-4cba-ab1e-0322eea9cb56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:33.018808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3f4b6-7929-4cba-ab1e-0322eea9cb56 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:33.019429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3f4b6-7929-4cba-ab1e-0322eea9cb56 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:33.020280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3f4b6-7929-4cba-ab1e-0322eea9cb56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:33.051533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3f4b6-7929-4cba-ab1e-0322eea9cb56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:33.053286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3f4b6-7929-4cba-ab1e-0322eea9cb56 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:33.070387 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1117/2258] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:23:33.116004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:33.784454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:34.106788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7372ab-cee6-4153-b8da-37cd40df1959 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:34.110288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8b7372ab-cee6-4153-b8da-37cd40df1959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:34.129600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7372ab-cee6-4153-b8da-37cd40df1959 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:34.143252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91066e88-7e1b-4e3e-ab14-e58db4d75475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:34.150453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91066e88-7e1b-4e3e-ab14-e58db4d75475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:34.155463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91066e88-7e1b-4e3e-ab14-e58db4d75475 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:34.155463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91066e88-7e1b-4e3e-ab14-e58db4d75475 admin admin] PATH_INFO: `/v3/projects/8dbb57ad89ad4d2488a5a2a77043dbe3` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:34.155463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91066e88-7e1b-4e3e-ab14-e58db4d75475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dbb57ad89ad4d2488a5a2a77043dbe3)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:34.155463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91066e88-7e1b-4e3e-ab14-e58db4d75475 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:34.306381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-91066e88-7e1b-4e3e-ab14-e58db4d75475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dbb57ad89ad4d2488a5a2a77043dbe3', 'request_id': 'req-91066e88-7e1b-4e3e-ab14-e58db4d75475'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:34.317096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-91066e88-7e1b-4e3e-ab14-e58db4d75475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dbb57ad89ad4d2488a5a2a77043dbe3', 'request_id': 'req-91066e88-7e1b-4e3e-ab14-e58db4d75475'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:34.327138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-91066e88-7e1b-4e3e-ab14-e58db4d75475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dbb57ad89ad4d2488a5a2a77043dbe3', 'request_id': 'req-91066e88-7e1b-4e3e-ab14-e58db4d75475'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:34.401219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-91066e88-7e1b-4e3e-ab14-e58db4d75475 admin admin] The token cache is being invalidate because project 8dbb57ad89ad4d2488a5a2a77043dbe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:23:34.401524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-91066e88-7e1b-4e3e-ab14-e58db4d75475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:34.402247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-91066e88-7e1b-4e3e-ab14-e58db4d75475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:34.406172 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1142/2259] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:23:34 2022] DELETE /identity/v3/projects/8dbb57ad89ad4d2488a5a2a77043dbe3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:23:34.410065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3f4b6-7929-4cba-ab1e-0322eea9cb56 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:34.423694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3f4b6-7929-4cba-ab1e-0322eea9cb56 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:34.484709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24cf91-a53b-49de-8090-6f66759412ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:34.485348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24cf91-a53b-49de-8090-6f66759412ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:34.485631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24cf91-a53b-49de-8090-6f66759412ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:34.485906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24cf91-a53b-49de-8090-6f66759412ec admin admin] PATH_INFO: `/v3/users/2bb66e6a90c84e9dad155d252debf7d6` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:34.487096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24cf91-a53b-49de-8090-6f66759412ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bb66e6a90c84e9dad155d252debf7d6)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:34.489097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24cf91-a53b-49de-8090-6f66759412ec admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:34.495983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:34.519225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:34.717941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0f24cf91-a53b-49de-8090-6f66759412ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bb66e6a90c84e9dad155d252debf7d6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:34.718747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0f24cf91-a53b-49de-8090-6f66759412ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bb66e6a90c84e9dad155d252debf7d6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:34.742672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0f24cf91-a53b-49de-8090-6f66759412ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bb66e6a90c84e9dad155d252debf7d6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:34.756665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0f24cf91-a53b-49de-8090-6f66759412ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bb66e6a90c84e9dad155d252debf7d6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:34.840594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0f24cf91-a53b-49de-8090-6f66759412ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bb66e6a90c84e9dad155d252debf7d6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:34.847662 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1118/2260] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:23:34 2022] DELETE /identity/v3/users/2bb66e6a90c84e9dad155d252debf7d6 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:23:35.249831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:35.351739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91066e88-7e1b-4e3e-ab14-e58db4d75475 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:35.353858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-91066e88-7e1b-4e3e-ab14-e58db4d75475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:35.369477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91066e88-7e1b-4e3e-ab14-e58db4d75475 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:35.429672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a847e-8efa-4547-9e94-07fab25a1092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:35.430337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a847e-8efa-4547-9e94-07fab25a1092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:35.430620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a847e-8efa-4547-9e94-07fab25a1092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:35.430892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a847e-8efa-4547-9e94-07fab25a1092 admin admin] PATH_INFO: `/v3/projects/fb961737d27e44cebc80febbcaa0d3f5` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:35.432105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a847e-8efa-4547-9e94-07fab25a1092 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb961737d27e44cebc80febbcaa0d3f5)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:35.434215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a847e-8efa-4547-9e94-07fab25a1092 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:35.561409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:35.579574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ac8a847e-8efa-4547-9e94-07fab25a1092 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb961737d27e44cebc80febbcaa0d3f5', 'request_id': 'req-ac8a847e-8efa-4547-9e94-07fab25a1092'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:35.586844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ac8a847e-8efa-4547-9e94-07fab25a1092 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb961737d27e44cebc80febbcaa0d3f5', 'request_id': 'req-ac8a847e-8efa-4547-9e94-07fab25a1092'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:35.594108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ac8a847e-8efa-4547-9e94-07fab25a1092 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb961737d27e44cebc80febbcaa0d3f5', 'request_id': 'req-ac8a847e-8efa-4547-9e94-07fab25a1092'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:35.671533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:35.678959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ac8a847e-8efa-4547-9e94-07fab25a1092 admin admin] The token cache is being invalidate because project fb961737d27e44cebc80febbcaa0d3f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:23:35.679434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ac8a847e-8efa-4547-9e94-07fab25a1092 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:35.680311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ac8a847e-8efa-4547-9e94-07fab25a1092 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:23:35.687353 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1143/2261] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:23:35 2022] DELETE /identity/v3/projects/fb961737d27e44cebc80febbcaa0d3f5 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:23:35.688921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3647a-194a-4c49-b267-62e6d1a11a08 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:35.689222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3647a-194a-4c49-b267-62e6d1a11a08 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:35.689498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3647a-194a-4c49-b267-62e6d1a11a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:35.710418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-bca3647a-194a-4c49-b267-62e6d1a11a08 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:35.712178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bca3647a-194a-4c49-b267-62e6d1a11a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:35.785818 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1119/2262] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:35.794502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa05917-c8a2-4d2b-874c-bb90ad266301 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:35.795024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa05917-c8a2-4d2b-874c-bb90ad266301 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:35.795458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa05917-c8a2-4d2b-874c-bb90ad266301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:35.835916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-efa05917-c8a2-4d2b-874c-bb90ad266301 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:35.837179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-efa05917-c8a2-4d2b-874c-bb90ad266301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:35.847823 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1144/2263] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:35.852126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3647a-194a-4c49-b267-62e6d1a11a08 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:35.869873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3647a-194a-4c49-b267-62e6d1a11a08 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:35.909044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0971e3-a5c3-455a-843c-ec84e2bde1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:35.910111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0971e3-a5c3-455a-843c-ec84e2bde1ec admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:35.910614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0971e3-a5c3-455a-843c-ec84e2bde1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:35.911104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0971e3-a5c3-455a-843c-ec84e2bde1ec admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:35.912334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0971e3-a5c3-455a-843c-ec84e2bde1ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:23:35.912852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0971e3-a5c3-455a-843c-ec84e2bde1ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:35.916024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0971e3-a5c3-455a-843c-ec84e2bde1ec admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:35.930694 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1120/2264] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:23:35.934153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa05917-c8a2-4d2b-874c-bb90ad266301 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:35.944589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa05917-c8a2-4d2b-874c-bb90ad266301 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:35.951098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a178dda-b230-4f48-b7a6-40b54eb872d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:35.951925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a178dda-b230-4f48-b7a6-40b54eb872d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:35.953398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a178dda-b230-4f48-b7a6-40b54eb872d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:35.953871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a178dda-b230-4f48-b7a6-40b54eb872d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:35.955110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a178dda-b230-4f48-b7a6-40b54eb872d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:35.957820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a178dda-b230-4f48-b7a6-40b54eb872d0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:36.041035 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1145/2265] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:23:35 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:23:36.045640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0971e3-a5c3-455a-843c-ec84e2bde1ec admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:36.057877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0971e3-a5c3-455a-843c-ec84e2bde1ec admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:36.141247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0724d85-1142-4f8c-b535-58d9eb4b3a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:36.142016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0724d85-1142-4f8c-b535-58d9eb4b3a8c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:36.143014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0724d85-1142-4f8c-b535-58d9eb4b3a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:36.143014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0724d85-1142-4f8c-b535-58d9eb4b3a8c admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:36.143940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0724d85-1142-4f8c-b535-58d9eb4b3a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:36.147958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0724d85-1142-4f8c-b535-58d9eb4b3a8c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:36.246128 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1121/2266] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:23:36 2022] POST /identity/v3/users => generated 283 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:23:36.247309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a178dda-b230-4f48-b7a6-40b54eb872d0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:36.263692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a178dda-b230-4f48-b7a6-40b54eb872d0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:36.269157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1f74e-66f2-4c5b-9cff-141af43a1830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:36.272331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1f74e-66f2-4c5b-9cff-141af43a1830 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:36.272331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1f74e-66f2-4c5b-9cff-141af43a1830 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:36.272331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1f74e-66f2-4c5b-9cff-141af43a1830 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:36.272331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1f74e-66f2-4c5b-9cff-141af43a1830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:36.273167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1f74e-66f2-4c5b-9cff-141af43a1830 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:36.283896 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1146/2267] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:23:36.290529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0724d85-1142-4f8c-b535-58d9eb4b3a8c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:36.323413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0724d85-1142-4f8c-b535-58d9eb4b3a8c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:36.334368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac80f4-25ba-44fc-afef-35949b610ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:36.335224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac80f4-25ba-44fc-afef-35949b610ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:36.335525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac80f4-25ba-44fc-afef-35949b610ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:36.335782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac80f4-25ba-44fc-afef-35949b610ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:36.336540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac80f4-25ba-44fc-afef-35949b610ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:36.340365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac80f4-25ba-44fc-afef-35949b610ef3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:36.360131 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1122/2268] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:23:36.364042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1f74e-66f2-4c5b-9cff-141af43a1830 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:36.381902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1f74e-66f2-4c5b-9cff-141af43a1830 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:36.387422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53c6c5-d830-4f7d-9dc6-99f5bae133c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:36.388299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53c6c5-d830-4f7d-9dc6-99f5bae133c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:36.388743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53c6c5-d830-4f7d-9dc6-99f5bae133c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:36.389349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53c6c5-d830-4f7d-9dc6-99f5bae133c2 admin admin] PATH_INFO: `/v3/projects/ae78c307a1504172828e668f915a3677/users/1d6175f2ac39494f8cba3db225150d6c/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:36.413141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53c6c5-d830-4f7d-9dc6-99f5bae133c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae78c307a1504172828e668f915a3677, user_id=1d6175f2ac39494f8cba3db225150d6c, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:36.418120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53c6c5-d830-4f7d-9dc6-99f5bae133c2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:36.496251 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1147/2269] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:23:36 2022] PUT /identity/v3/projects/ae78c307a1504172828e668f915a3677/users/1d6175f2ac39494f8cba3db225150d6c/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:23:36.498086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbe1d9-d3c5-4408-b4f1-07a8deb9c6ba None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:36.498431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbe1d9-d3c5-4408-b4f1-07a8deb9c6ba None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:36.498655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbe1d9-d3c5-4408-b4f1-07a8deb9c6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:36.519985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4ffbe1d9-d3c5-4408-b4f1-07a8deb9c6ba None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:36.522749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4ffbe1d9-d3c5-4408-b4f1-07a8deb9c6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:36.586747 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1123/2270] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:36.610948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53c6c5-d830-4f7d-9dc6-99f5bae133c2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:36.614270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2d53c6c5-d830-4f7d-9dc6-99f5bae133c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:36.732208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53c6c5-d830-4f7d-9dc6-99f5bae133c2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:36.738788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11309bf8-05b7-44b3-8017-b3107c71f74e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:36.739684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11309bf8-05b7-44b3-8017-b3107c71f74e service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:36.740134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11309bf8-05b7-44b3-8017-b3107c71f74e service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:36.740564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11309bf8-05b7-44b3-8017-b3107c71f74e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:36.752698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11309bf8-05b7-44b3-8017-b3107c71f74e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:36.754631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11309bf8-05b7-44b3-8017-b3107c71f74e service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:36.766195 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1148/2271] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:23:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:23:37.184812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:37.287949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:38.917072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:39.384291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbe1d9-d3c5-4408-b4f1-07a8deb9c6ba None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:39.387322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4ffbe1d9-d3c5-4408-b4f1-07a8deb9c6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:39.507326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbe1d9-d3c5-4408-b4f1-07a8deb9c6ba None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:39.514165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af0c46-c7a3-44e9-baf9-52287f06a9a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:39.514876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af0c46-c7a3-44e9-baf9-52287f06a9a7 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:39.515267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af0c46-c7a3-44e9-baf9-52287f06a9a7 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:39.515610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af0c46-c7a3-44e9-baf9-52287f06a9a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:39.525797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a2af0c46-c7a3-44e9-baf9-52287f06a9a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:39.560452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:39.614362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af0c46-c7a3-44e9-baf9-52287f06a9a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:39.616054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af0c46-c7a3-44e9-baf9-52287f06a9a7 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:39.628185 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1124/2272] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:23:39 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:23:40.210342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:40.402801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:41.581594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38841a8-8983-42ed-8afb-1b49296b739c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:41.582544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38841a8-8983-42ed-8afb-1b49296b739c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:41.583046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38841a8-8983-42ed-8afb-1b49296b739c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:41.617861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c38841a8-8983-42ed-8afb-1b49296b739c None None] MFA Rules not processed for user `d3f1177e2cbd4ba6b659f8a714be86ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:41.619160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c38841a8-8983-42ed-8afb-1b49296b739c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:41.725614 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1149/2273] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:42.195842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:43.223166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262777a-7d7c-46ec-9c88-02e1bec8597c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:43.225088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262777a-7d7c-46ec-9c88-02e1bec8597c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:43.225559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262777a-7d7c-46ec-9c88-02e1bec8597c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:43.268157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f262777a-7d7c-46ec-9c88-02e1bec8597c None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:43.271229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f262777a-7d7c-46ec-9c88-02e1bec8597c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:43.417587 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1125/2274] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:23:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:43.429140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38841a8-8983-42ed-8afb-1b49296b739c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:43.432604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c38841a8-8983-42ed-8afb-1b49296b739c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:43.674233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38841a8-8983-42ed-8afb-1b49296b739c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:43.685517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6ad5a-4e57-474d-9540-863a7c597a82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:43.686866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6ad5a-4e57-474d-9540-863a7c597a82 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:43.687473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6ad5a-4e57-474d-9540-863a7c597a82 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:43.690333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6ad5a-4e57-474d-9540-863a7c597a82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:43.714242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6ad5a-4e57-474d-9540-863a7c597a82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:43.716820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6ad5a-4e57-474d-9540-863a7c597a82 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:43.729102 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1150/2275] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:23:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:23:43.970228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be386b28-c115-4954-bab0-b0940b38e4ce None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:43.971975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be386b28-c115-4954-bab0-b0940b38e4ce None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:43.972494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be386b28-c115-4954-bab0-b0940b38e4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:44.025596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-be386b28-c115-4954-bab0-b0940b38e4ce None None] MFA Rules not processed for user `1d6175f2ac39494f8cba3db225150d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:44.027798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-be386b28-c115-4954-bab0-b0940b38e4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:44.061688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861b9cd-cc37-43e1-acad-85dc6446d997 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:44.061983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861b9cd-cc37-43e1-acad-85dc6446d997 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:44.063035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861b9cd-cc37-43e1-acad-85dc6446d997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:44.112761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c861b9cd-cc37-43e1-acad-85dc6446d997 None None] MFA Rules not processed for user `2e23378ed283426cbff623265d9bbc96`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:44.116603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c861b9cd-cc37-43e1-acad-85dc6446d997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:44.198237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:44.241598 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1126/2276] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:44.253752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55491d76-6b8f-4163-a403-42d2746e6a1c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:44.254138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55491d76-6b8f-4163-a403-42d2746e6a1c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:44.254427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55491d76-6b8f-4163-a403-42d2746e6a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:44.277621 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1151/2277] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:44 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:23:44.284668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-55491d76-6b8f-4163-a403-42d2746e6a1c None None] MFA Rules not processed for user `1d6175f2ac39494f8cba3db225150d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:44.286158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-55491d76-6b8f-4163-a403-42d2746e6a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:44.296375 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1127/2278] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:23:44.587474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861b9cd-cc37-43e1-acad-85dc6446d997 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:44.589934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c861b9cd-cc37-43e1-acad-85dc6446d997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:44.611742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861b9cd-cc37-43e1-acad-85dc6446d997 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:44.620173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb12226-1e1f-4993-9ce7-0a40bbfc9ea4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:44.620882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb12226-1e1f-4993-9ce7-0a40bbfc9ea4 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:44.621183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb12226-1e1f-4993-9ce7-0a40bbfc9ea4 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:44.621501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb12226-1e1f-4993-9ce7-0a40bbfc9ea4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:44.631766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb12226-1e1f-4993-9ce7-0a40bbfc9ea4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:44.635677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb12226-1e1f-4993-9ce7-0a40bbfc9ea4 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:44.651788 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1152/2279] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:23:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:23:45.198574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:51.055341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55491d76-6b8f-4163-a403-42d2746e6a1c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:23:51.058314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-55491d76-6b8f-4163-a403-42d2746e6a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:51.294872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55491d76-6b8f-4163-a403-42d2746e6a1c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:23:51.310016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a71edd-9094-49ce-99d0-997e5a864538 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:23:51.310694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a71edd-9094-49ce-99d0-997e5a864538 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:51.311135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a71edd-9094-49ce-99d0-997e5a864538 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:51.312633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a71edd-9094-49ce-99d0-997e5a864538 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:51.317346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-38a71edd-9094-49ce-99d0-997e5a864538 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:51.358983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a71edd-9094-49ce-99d0-997e5a864538 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:23:51.362652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a71edd-9094-49ce-99d0-997e5a864538 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:23:51.401885 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1128/2280] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:23:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:23:54.878109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d5e2b-e6f4-4ea2-b135-39682edb8869 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:23:54.878628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d5e2b-e6f4-4ea2-b135-39682edb8869 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:23:54.878710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d5e2b-e6f4-4ea2-b135-39682edb8869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:23:54.919221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-821d5e2b-e6f4-4ea2-b135-39682edb8869 None None] MFA Rules not processed for user `91d1351fcb6b4cd08f176e6d0cc5bb11`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:23:54.923005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-821d5e2b-e6f4-4ea2-b135-39682edb8869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:23:55.099315 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1153/2281] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:23:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:24:01.380780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=85 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:04.360980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a71edd-9094-49ce-99d0-997e5a864538 service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:04.376628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a71edd-9094-49ce-99d0-997e5a864538 service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:04.383251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a77d5-5d9f-45be-9199-12908efafb6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:04.384024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a77d5-5d9f-45be-9199-12908efafb6d service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:04.384305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a77d5-5d9f-45be-9199-12908efafb6d service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:04.384581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a77d5-5d9f-45be-9199-12908efafb6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:04.386458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-993a77d5-5d9f-45be-9199-12908efafb6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:04.443531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f9aa9-ad06-4768-a01f-c8450abd32a1 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:04.444112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f9aa9-ad06-4768-a01f-c8450abd32a1 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:04.444293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f9aa9-ad06-4768-a01f-c8450abd32a1 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:04.446059 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1154/2282] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 27 03:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:24:04.453064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bbfcd-c706-45fd-9105-57c1afff9482 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:04.453875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bbfcd-c706-45fd-9105-57c1afff9482 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:04.454185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bbfcd-c706-45fd-9105-57c1afff9482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:04.471334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a77d5-5d9f-45be-9199-12908efafb6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:04.473309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a77d5-5d9f-45be-9199-12908efafb6d service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:04.481122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ba9bbfcd-c706-45fd-9105-57c1afff9482 None None] MFA Rules not processed for user `c20881251f2241a3a5ec2e5cf99db149`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:04.482664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ba9bbfcd-c706-45fd-9105-57c1afff9482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:04.484891 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1129/2283] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:24:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:24:04.513436 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1155/2284] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 03:24:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:24:04.521909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a77d5-5d9f-45be-9199-12908efafb6d service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:04.535318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a77d5-5d9f-45be-9199-12908efafb6d service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:04.541984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254fa4c-2863-4237-9b46-45e2860db939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:04.543765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254fa4c-2863-4237-9b46-45e2860db939 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:04.544283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254fa4c-2863-4237-9b46-45e2860db939 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:04.544771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254fa4c-2863-4237-9b46-45e2860db939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:04.561607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254fa4c-2863-4237-9b46-45e2860db939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:04.564561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254fa4c-2863-4237-9b46-45e2860db939 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:04.580043 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1130/2285] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:24:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:24:05.392682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bbfcd-c706-45fd-9105-57c1afff9482 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:05.394430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ba9bbfcd-c706-45fd-9105-57c1afff9482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:05.406522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254fa4c-2863-4237-9b46-45e2860db939 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:05.425119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254fa4c-2863-4237-9b46-45e2860db939 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:05.431131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bbfcd-c706-45fd-9105-57c1afff9482 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:05.438165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b644a-61b2-4387-b8e3-047c12c26309 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:05.447883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b644a-61b2-4387-b8e3-047c12c26309 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:05.449953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b644a-61b2-4387-b8e3-047c12c26309 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:05.450673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b644a-61b2-4387-b8e3-047c12c26309 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:05.452916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-787b644a-61b2-4387-b8e3-047c12c26309 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:05.455541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096d145-1457-454a-b809-67e258ce2667 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:05.456266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096d145-1457-454a-b809-67e258ce2667 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:05.456709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096d145-1457-454a-b809-67e258ce2667 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:05.457140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096d145-1457-454a-b809-67e258ce2667 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:05.472244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b644a-61b2-4387-b8e3-047c12c26309 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:05.474441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096d145-1457-454a-b809-67e258ce2667 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:05.476389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096d145-1457-454a-b809-67e258ce2667 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:05.476786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b644a-61b2-4387-b8e3-047c12c26309 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:05.497824 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1156/2286] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:24:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:24:05.504120 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1131/2287] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:24:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:24:06.252311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91778018-3ad6-42fc-8480-08c05f34b674 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:06.253177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91778018-3ad6-42fc-8480-08c05f34b674 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:06.253529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91778018-3ad6-42fc-8480-08c05f34b674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:06.283630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-91778018-3ad6-42fc-8480-08c05f34b674 None None] MFA Rules not processed for user `ba3ce7f040d24c33bcf9b97d1ef25268`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:06.285075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-91778018-3ad6-42fc-8480-08c05f34b674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:06.358932 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1157/2288] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:24:13.137668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465b244-ada6-42d0-88f5-632d1c74fe51 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:13.138735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465b244-ada6-42d0-88f5-632d1c74fe51 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:13.139187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465b244-ada6-42d0-88f5-632d1c74fe51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:13.167546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d465b244-ada6-42d0-88f5-632d1c74fe51 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:13.169289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d465b244-ada6-42d0-88f5-632d1c74fe51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:13.178127 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1132/2289] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:24:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:24:13.206284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91778018-3ad6-42fc-8480-08c05f34b674 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:13.239075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91778018-3ad6-42fc-8480-08c05f34b674 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:13.245849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284127e4-95d9-443f-8aac-0db233a5bf2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:13.246741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284127e4-95d9-443f-8aac-0db233a5bf2a service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:13.247342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284127e4-95d9-443f-8aac-0db233a5bf2a service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:13.247900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284127e4-95d9-443f-8aac-0db233a5bf2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:13.261800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284127e4-95d9-443f-8aac-0db233a5bf2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:13.263920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284127e4-95d9-443f-8aac-0db233a5bf2a service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:13.277223 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1158/2290] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:24:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:24:17.987454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad38611-ce91-491d-9f4a-0ed2c651b16b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:17.987993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad38611-ce91-491d-9f4a-0ed2c651b16b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:17.988235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad38611-ce91-491d-9f4a-0ed2c651b16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:18.023247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9ad38611-ce91-491d-9f4a-0ed2c651b16b None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:18.024582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9ad38611-ce91-491d-9f4a-0ed2c651b16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:18.043193 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1133/2291] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:24:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:24:18.068411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284127e4-95d9-443f-8aac-0db233a5bf2a service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:18.075915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=85 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:18.098418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284127e4-95d9-443f-8aac-0db233a5bf2a service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:18.120906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947c7d9-7f33-4cd0-b901-1392393ad318 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:18.120906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947c7d9-7f33-4cd0-b901-1392393ad318 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:18.120906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947c7d9-7f33-4cd0-b901-1392393ad318 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:18.120906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947c7d9-7f33-4cd0-b901-1392393ad318 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:18.137725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947c7d9-7f33-4cd0-b901-1392393ad318 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:18.140412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947c7d9-7f33-4cd0-b901-1392393ad318 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:18.150741 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1159/2292] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:24:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:24:21.904836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b32b00-35e4-4304-a4bf-d6dbe4157544 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:21.905884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b32b00-35e4-4304-a4bf-d6dbe4157544 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:21.906411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b32b00-35e4-4304-a4bf-d6dbe4157544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:21.947287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d0b32b00-35e4-4304-a4bf-d6dbe4157544 None None] MFA Rules not processed for user `91d1351fcb6b4cd08f176e6d0cc5bb11`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:21.949471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d0b32b00-35e4-4304-a4bf-d6dbe4157544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:21.966622 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1134/2293] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:24:28.168511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:29.961098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6edae-ff65-43f0-a680-958f5bec4224 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:29.962179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6edae-ff65-43f0-a680-958f5bec4224 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:29.962630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6edae-ff65-43f0-a680-958f5bec4224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:29.983698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-cba6edae-ff65-43f0-a680-958f5bec4224 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:29.985696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cba6edae-ff65-43f0-a680-958f5bec4224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:30.001229 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1160/2294] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:24:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:24:30.025553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b32b00-35e4-4304-a4bf-d6dbe4157544 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:30.040043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b32b00-35e4-4304-a4bf-d6dbe4157544 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:30.046840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022a765-d8d0-4b03-b2c3-4149988b54f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:30.048147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022a765-d8d0-4b03-b2c3-4149988b54f1 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:30.048536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022a765-d8d0-4b03-b2c3-4149988b54f1 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:30.048918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022a765-d8d0-4b03-b2c3-4149988b54f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:30.058665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022a765-d8d0-4b03-b2c3-4149988b54f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:30.060825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022a765-d8d0-4b03-b2c3-4149988b54f1 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:30.072000 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1135/2295] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:24:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:24:31.807205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ef8ef-1978-4fa9-b9f5-f0099da81cba None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:31.807750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ef8ef-1978-4fa9-b9f5-f0099da81cba None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:31.807846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ef8ef-1978-4fa9-b9f5-f0099da81cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:31.832188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ff3ef8ef-1978-4fa9-b9f5-f0099da81cba None None] MFA Rules not processed for user `8c93886c5818439690564c2299a4f3ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:31.833018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ff3ef8ef-1978-4fa9-b9f5-f0099da81cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:31.892599 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1161/2296] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:24:34.800568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f814833-28a1-4d10-a31d-934cbc8600f4 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:34.801095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f814833-28a1-4d10-a31d-934cbc8600f4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:34.801278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f814833-28a1-4d10-a31d-934cbc8600f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:34.809015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=58 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:34.824634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6f814833-28a1-4d10-a31d-934cbc8600f4 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:34.827756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6f814833-28a1-4d10-a31d-934cbc8600f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:34.835425 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1136/2297] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:24:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:24:34.850189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ef8ef-1978-4fa9-b9f5-f0099da81cba None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:34.863658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ef8ef-1978-4fa9-b9f5-f0099da81cba None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:34.869767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d13883-e740-4165-9600-d4aba39a1a17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:34.870658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d13883-e740-4165-9600-d4aba39a1a17 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:34.871132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d13883-e740-4165-9600-d4aba39a1a17 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:34.871561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d13883-e740-4165-9600-d4aba39a1a17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:34.882368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d13883-e740-4165-9600-d4aba39a1a17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:34.884914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d13883-e740-4165-9600-d4aba39a1a17 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:34.895088 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1162/2298] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:24:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:24:36.600584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38af260-8e99-4407-bfbc-05dc8732abf8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:36.601100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38af260-8e99-4407-bfbc-05dc8732abf8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:36.601343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38af260-8e99-4407-bfbc-05dc8732abf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:36.623264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a38af260-8e99-4407-bfbc-05dc8732abf8 None None] MFA Rules not processed for user `1d6175f2ac39494f8cba3db225150d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:36.624491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a38af260-8e99-4407-bfbc-05dc8732abf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:36.632332 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1137/2299] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:24:41.346749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d13883-e740-4165-9600-d4aba39a1a17 service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:41.348318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-33d13883-e740-4165-9600-d4aba39a1a17 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:41.362525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d13883-e740-4165-9600-d4aba39a1a17 service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:41.367113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4f138-9246-4dde-8c64-3e90ef25da73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:41.367742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4f138-9246-4dde-8c64-3e90ef25da73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:41.368061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4f138-9246-4dde-8c64-3e90ef25da73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:41.368305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4f138-9246-4dde-8c64-3e90ef25da73 admin admin] PATH_INFO: `/v3/users/3756b0d73d634269bec89f1be45cdc5d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:41.369428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4f138-9246-4dde-8c64-3e90ef25da73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3756b0d73d634269bec89f1be45cdc5d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:41.371510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4f138-9246-4dde-8c64-3e90ef25da73 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:41.564843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-68b4f138-9246-4dde-8c64-3e90ef25da73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3756b0d73d634269bec89f1be45cdc5d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:41.565417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-68b4f138-9246-4dde-8c64-3e90ef25da73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3756b0d73d634269bec89f1be45cdc5d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:41.572238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-68b4f138-9246-4dde-8c64-3e90ef25da73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3756b0d73d634269bec89f1be45cdc5d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:41.584561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-68b4f138-9246-4dde-8c64-3e90ef25da73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3756b0d73d634269bec89f1be45cdc5d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:41.585181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-68b4f138-9246-4dde-8c64-3e90ef25da73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3756b0d73d634269bec89f1be45cdc5d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:41.673204 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1163/2300] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:24:41 2022] DELETE /identity/v3/users/3756b0d73d634269bec89f1be45cdc5d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:24:41.677739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da84b04-2f84-42ac-a2b8-4b12fad88585 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:41.678231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da84b04-2f84-42ac-a2b8-4b12fad88585 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:41.678325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da84b04-2f84-42ac-a2b8-4b12fad88585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:41.698236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8da84b04-2f84-42ac-a2b8-4b12fad88585 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:41.699470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8da84b04-2f84-42ac-a2b8-4b12fad88585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:41.757121 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1138/2301] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:24:41.767364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4f138-9246-4dde-8c64-3e90ef25da73 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:41.768744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-68b4f138-9246-4dde-8c64-3e90ef25da73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:41.825062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4f138-9246-4dde-8c64-3e90ef25da73 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:41.828588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba69183-c5c6-449e-b26d-3a65361b8f05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:41.829764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba69183-c5c6-449e-b26d-3a65361b8f05 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:41.830057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba69183-c5c6-449e-b26d-3a65361b8f05 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:41.830334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba69183-c5c6-449e-b26d-3a65361b8f05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:41.839187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba69183-c5c6-449e-b26d-3a65361b8f05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:41.840611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba69183-c5c6-449e-b26d-3a65361b8f05 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:41.845445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:41.850160 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1164/2302] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:24:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:24:42.609043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da84b04-2f84-42ac-a2b8-4b12fad88585 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:42.610598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8da84b04-2f84-42ac-a2b8-4b12fad88585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:42.624133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da84b04-2f84-42ac-a2b8-4b12fad88585 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:42.631239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1b9fe-4ce8-4513-bbd2-f1eb7a0650a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:42.631876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1b9fe-4ce8-4513-bbd2-f1eb7a0650a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:42.632158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1b9fe-4ce8-4513-bbd2-f1eb7a0650a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:42.632455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1b9fe-4ce8-4513-bbd2-f1eb7a0650a4 admin admin] PATH_INFO: `/v3/projects/11fb9090ce414b1d9ab195faec4cc45e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:42.633753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1b9fe-4ce8-4513-bbd2-f1eb7a0650a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11fb9090ce414b1d9ab195faec4cc45e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:42.635746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1b9fe-4ce8-4513-bbd2-f1eb7a0650a4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:42.819630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e5f1b9fe-4ce8-4513-bbd2-f1eb7a0650a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11fb9090ce414b1d9ab195faec4cc45e', 'request_id': 'req-e5f1b9fe-4ce8-4513-bbd2-f1eb7a0650a4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:42.873908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e5f1b9fe-4ce8-4513-bbd2-f1eb7a0650a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11fb9090ce414b1d9ab195faec4cc45e', 'request_id': 'req-e5f1b9fe-4ce8-4513-bbd2-f1eb7a0650a4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:42.890183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e5f1b9fe-4ce8-4513-bbd2-f1eb7a0650a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11fb9090ce414b1d9ab195faec4cc45e', 'request_id': 'req-e5f1b9fe-4ce8-4513-bbd2-f1eb7a0650a4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:42.902673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e5f1b9fe-4ce8-4513-bbd2-f1eb7a0650a4 admin admin] The token cache is being invalidate because project 11fb9090ce414b1d9ab195faec4cc45e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:24:42.903069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e5f1b9fe-4ce8-4513-bbd2-f1eb7a0650a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:42.903799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e5f1b9fe-4ce8-4513-bbd2-f1eb7a0650a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:42.905349 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1139/2303] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:24:42 2022] DELETE /identity/v3/projects/11fb9090ce414b1d9ab195faec4cc45e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:24:42.909522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba69183-c5c6-449e-b26d-3a65361b8f05 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:42.919735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba69183-c5c6-449e-b26d-3a65361b8f05 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:42.979828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e4432-5f5d-4bfa-b56c-f31151b06148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:42.980457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e4432-5f5d-4bfa-b56c-f31151b06148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:42.980744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e4432-5f5d-4bfa-b56c-f31151b06148 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:42.981013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e4432-5f5d-4bfa-b56c-f31151b06148 admin admin] PATH_INFO: `/v3/users/e58209f7e8fc477680b1d36db6ea94c4` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:42.982301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e4432-5f5d-4bfa-b56c-f31151b06148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e58209f7e8fc477680b1d36db6ea94c4)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:42.984217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e4432-5f5d-4bfa-b56c-f31151b06148 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:43.163285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a29e4432-5f5d-4bfa-b56c-f31151b06148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e58209f7e8fc477680b1d36db6ea94c4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:43.163948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a29e4432-5f5d-4bfa-b56c-f31151b06148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e58209f7e8fc477680b1d36db6ea94c4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:43.200882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a29e4432-5f5d-4bfa-b56c-f31151b06148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e58209f7e8fc477680b1d36db6ea94c4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:43.225394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a29e4432-5f5d-4bfa-b56c-f31151b06148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e58209f7e8fc477680b1d36db6ea94c4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:43.226186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a29e4432-5f5d-4bfa-b56c-f31151b06148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e58209f7e8fc477680b1d36db6ea94c4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:43.307486 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1165/2304] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:24:42 2022] DELETE /identity/v3/users/e58209f7e8fc477680b1d36db6ea94c4 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:24:43.814189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1b9fe-4ce8-4513-bbd2-f1eb7a0650a4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:43.815663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e5f1b9fe-4ce8-4513-bbd2-f1eb7a0650a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:43.832470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1b9fe-4ce8-4513-bbd2-f1eb7a0650a4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:43.928842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0c79d-c045-4901-af1f-ad63692a64f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:43.929654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0c79d-c045-4901-af1f-ad63692a64f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:43.930325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0c79d-c045-4901-af1f-ad63692a64f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:43.930981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0c79d-c045-4901-af1f-ad63692a64f7 admin admin] PATH_INFO: `/v3/projects/e56c4dbd10e0472e8bc7bd723726888a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:43.932420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0c79d-c045-4901-af1f-ad63692a64f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e56c4dbd10e0472e8bc7bd723726888a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:43.934556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0c79d-c045-4901-af1f-ad63692a64f7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:43.962360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:44.063939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42e0c79d-c045-4901-af1f-ad63692a64f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e56c4dbd10e0472e8bc7bd723726888a', 'request_id': 'req-42e0c79d-c045-4901-af1f-ad63692a64f7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:44.160200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42e0c79d-c045-4901-af1f-ad63692a64f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e56c4dbd10e0472e8bc7bd723726888a', 'request_id': 'req-42e0c79d-c045-4901-af1f-ad63692a64f7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:44.186765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42e0c79d-c045-4901-af1f-ad63692a64f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e56c4dbd10e0472e8bc7bd723726888a', 'request_id': 'req-42e0c79d-c045-4901-af1f-ad63692a64f7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:44.212378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42e0c79d-c045-4901-af1f-ad63692a64f7 admin admin] The token cache is being invalidate because project e56c4dbd10e0472e8bc7bd723726888a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:24:44.212945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42e0c79d-c045-4901-af1f-ad63692a64f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:44.216715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42e0c79d-c045-4901-af1f-ad63692a64f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:44.220385 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1140/2305] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:24:43 2022] DELETE /identity/v3/projects/e56c4dbd10e0472e8bc7bd723726888a => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:24:44.226324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157698b-0705-4c2e-86df-b886b76786ce None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:44.226825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157698b-0705-4c2e-86df-b886b76786ce None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:44.226927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157698b-0705-4c2e-86df-b886b76786ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:44.267525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f157698b-0705-4c2e-86df-b886b76786ce None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:44.271314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f157698b-0705-4c2e-86df-b886b76786ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:44.354128 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1166/2306] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:24:44.362591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593de09-f063-4b56-a4ef-bccdde396094 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:44.363292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593de09-f063-4b56-a4ef-bccdde396094 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:44.363292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593de09-f063-4b56-a4ef-bccdde396094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:44.398539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e593de09-f063-4b56-a4ef-bccdde396094 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:44.400005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e593de09-f063-4b56-a4ef-bccdde396094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:44.414552 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1141/2307] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:24:44.415900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157698b-0705-4c2e-86df-b886b76786ce None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:44.427826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157698b-0705-4c2e-86df-b886b76786ce None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:44.440675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2421d-ba79-495b-96cf-5fff755283fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:44.443699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2421d-ba79-495b-96cf-5fff755283fd admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:44.443699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2421d-ba79-495b-96cf-5fff755283fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:44.445216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2421d-ba79-495b-96cf-5fff755283fd admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:44.445939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2421d-ba79-495b-96cf-5fff755283fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:24:44.446292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2421d-ba79-495b-96cf-5fff755283fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:44.447938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2421d-ba79-495b-96cf-5fff755283fd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:44.472770 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1167/2308] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:24:44.475114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593de09-f063-4b56-a4ef-bccdde396094 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:44.490160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593de09-f063-4b56-a4ef-bccdde396094 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:44.496872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc7e6c-3f44-4711-9c9d-3ccb9c545d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:44.498796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc7e6c-3f44-4711-9c9d-3ccb9c545d19 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:44.499249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc7e6c-3f44-4711-9c9d-3ccb9c545d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:44.499766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc7e6c-3f44-4711-9c9d-3ccb9c545d19 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:44.500547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc7e6c-3f44-4711-9c9d-3ccb9c545d19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:44.505782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc7e6c-3f44-4711-9c9d-3ccb9c545d19 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:44.621975 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1142/2309] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:24:44 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:24:44.625429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2421d-ba79-495b-96cf-5fff755283fd admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:44.635493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2421d-ba79-495b-96cf-5fff755283fd admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:44.642375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:44.762516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2d4fb-4f71-44e9-9996-b0faca56d326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:44.763479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2d4fb-4f71-44e9-9996-b0faca56d326 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:44.764234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2d4fb-4f71-44e9-9996-b0faca56d326 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:44.764710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2d4fb-4f71-44e9-9996-b0faca56d326 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:44.765583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2d4fb-4f71-44e9-9996-b0faca56d326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:44.768433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2d4fb-4f71-44e9-9996-b0faca56d326 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:44.883729 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1168/2310] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:24:44 2022] POST /identity/v3/users => generated 289 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:24:44.888968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc7e6c-3f44-4711-9c9d-3ccb9c545d19 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:44.903959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc7e6c-3f44-4711-9c9d-3ccb9c545d19 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:44.911085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8fc24-d601-413b-bf5c-1a1379b83673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:44.916984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8fc24-d601-413b-bf5c-1a1379b83673 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:44.916984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8fc24-d601-413b-bf5c-1a1379b83673 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:44.916984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8fc24-d601-413b-bf5c-1a1379b83673 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:44.916984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8fc24-d601-413b-bf5c-1a1379b83673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:44.916984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8fc24-d601-413b-bf5c-1a1379b83673 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:44.933082 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1143/2311] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:24:44.934298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2d4fb-4f71-44e9-9996-b0faca56d326 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:44.944355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2d4fb-4f71-44e9-9996-b0faca56d326 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:44.950605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d36b1-6148-422b-887c-84f4c3cc55d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:44.950605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d36b1-6148-422b-887c-84f4c3cc55d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:44.950605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d36b1-6148-422b-887c-84f4c3cc55d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:44.950605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d36b1-6148-422b-887c-84f4c3cc55d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:44.951099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d36b1-6148-422b-887c-84f4c3cc55d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:44.952458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d36b1-6148-422b-887c-84f4c3cc55d6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:44.963306 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1169/2312] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:24:44.967527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8fc24-d601-413b-bf5c-1a1379b83673 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:44.979189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8fc24-d601-413b-bf5c-1a1379b83673 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:44.983876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219a497-46f0-4d21-aecb-1af24f6dc3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:44.984536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219a497-46f0-4d21-aecb-1af24f6dc3da admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:44.985044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219a497-46f0-4d21-aecb-1af24f6dc3da admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:44.985358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219a497-46f0-4d21-aecb-1af24f6dc3da admin admin] PATH_INFO: `/v3/projects/26581195363e4a018c9c06d475499691/users/b84c971ccb9e4e6282926b55661e68e9/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:45.018767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219a497-46f0-4d21-aecb-1af24f6dc3da admin admin] RBAC: Authorizing `identity:create_grant(project_id=26581195363e4a018c9c06d475499691, user_id=b84c971ccb9e4e6282926b55661e68e9, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:45.022301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219a497-46f0-4d21-aecb-1af24f6dc3da admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:45.108205 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1144/2313] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:24:44 2022] PUT /identity/v3/projects/26581195363e4a018c9c06d475499691/users/b84c971ccb9e4e6282926b55661e68e9/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:24:45.109090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a39b0-6b68-4e3a-bdfe-8024346d210f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:45.109383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a39b0-6b68-4e3a-bdfe-8024346d210f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:45.109669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a39b0-6b68-4e3a-bdfe-8024346d210f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:45.166028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-da4a39b0-6b68-4e3a-bdfe-8024346d210f None None] MFA Rules not processed for user `b84c971ccb9e4e6282926b55661e68e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:45.167418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-da4a39b0-6b68-4e3a-bdfe-8024346d210f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:45.296995 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1170/2314] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:24:45.301895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219a497-46f0-4d21-aecb-1af24f6dc3da admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:45.445382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219a497-46f0-4d21-aecb-1af24f6dc3da admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:45.463864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e9755-f60b-4b59-b7d8-343ec55fb259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:45.464644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e9755-f60b-4b59-b7d8-343ec55fb259 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:45.464986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e9755-f60b-4b59-b7d8-343ec55fb259 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:45.468504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e9755-f60b-4b59-b7d8-343ec55fb259 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:45.468504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e9755-f60b-4b59-b7d8-343ec55fb259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:45.468901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e9755-f60b-4b59-b7d8-343ec55fb259 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:45.626533 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1145/2315] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:24:45 2022] POST /identity/v3/projects => generated 377 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:24:45.629176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a39b0-6b68-4e3a-bdfe-8024346d210f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:45.648670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a39b0-6b68-4e3a-bdfe-8024346d210f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:45.813177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fa394-15cd-4135-801f-aa67c5eb23f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:45.815033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fa394-15cd-4135-801f-aa67c5eb23f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:45.815553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fa394-15cd-4135-801f-aa67c5eb23f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:45.815982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fa394-15cd-4135-801f-aa67c5eb23f9 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:45.817011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fa394-15cd-4135-801f-aa67c5eb23f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:45.821072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fa394-15cd-4135-801f-aa67c5eb23f9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:45.971616 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1171/2316] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:24:45 2022] POST /identity/v3/users => generated 295 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:24:45.976967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e9755-f60b-4b59-b7d8-343ec55fb259 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:45.996746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e9755-f60b-4b59-b7d8-343ec55fb259 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:46.003329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62ab4a-94f8-4ecf-82d4-4b1c0da0b7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:46.003950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62ab4a-94f8-4ecf-82d4-4b1c0da0b7bc admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:46.004363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62ab4a-94f8-4ecf-82d4-4b1c0da0b7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:46.004654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62ab4a-94f8-4ecf-82d4-4b1c0da0b7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:46.005553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62ab4a-94f8-4ecf-82d4-4b1c0da0b7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:46.007290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62ab4a-94f8-4ecf-82d4-4b1c0da0b7bc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:46.077150 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1146/2317] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:24:46.079190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fa394-15cd-4135-801f-aa67c5eb23f9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:46.089691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:46.104399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fa394-15cd-4135-801f-aa67c5eb23f9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:46.128852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d28421-b7de-436d-8983-733340313208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:46.128852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d28421-b7de-436d-8983-733340313208 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:46.128852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d28421-b7de-436d-8983-733340313208 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:46.128852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d28421-b7de-436d-8983-733340313208 admin admin] PATH_INFO: `/v3/projects/f3ea07b0e4f145deaea4b51881aadef8/users/4207db52f4f84c5895ffbad9fab99d18/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:46.148966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d28421-b7de-436d-8983-733340313208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3ea07b0e4f145deaea4b51881aadef8, user_id=4207db52f4f84c5895ffbad9fab99d18, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:46.152040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d28421-b7de-436d-8983-733340313208 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:46.282901 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1172/2318] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:24:46 2022] PUT /identity/v3/projects/f3ea07b0e4f145deaea4b51881aadef8/users/4207db52f4f84c5895ffbad9fab99d18/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:24:46.286916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62ab4a-94f8-4ecf-82d4-4b1c0da0b7bc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:46.298364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62ab4a-94f8-4ecf-82d4-4b1c0da0b7bc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:46.308887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:46.361480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f327076-fd26-4b77-be23-fb633fef6197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:46.362466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f327076-fd26-4b77-be23-fb633fef6197 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:46.362865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f327076-fd26-4b77-be23-fb633fef6197 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:46.363236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f327076-fd26-4b77-be23-fb633fef6197 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:46.364162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f327076-fd26-4b77-be23-fb633fef6197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:46.365803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f327076-fd26-4b77-be23-fb633fef6197 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:46.379298 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1147/2319] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:24:46.380608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d28421-b7de-436d-8983-733340313208 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:46.391299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d28421-b7de-436d-8983-733340313208 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:46.396288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989818f-6ef8-4b66-a4f4-6048c1126095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:46.396966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989818f-6ef8-4b66-a4f4-6048c1126095 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:46.397248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989818f-6ef8-4b66-a4f4-6048c1126095 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:46.397518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989818f-6ef8-4b66-a4f4-6048c1126095 admin admin] PATH_INFO: `/v3/projects/f3ea07b0e4f145deaea4b51881aadef8/users/4207db52f4f84c5895ffbad9fab99d18/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:46.399549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989818f-6ef8-4b66-a4f4-6048c1126095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3ea07b0e4f145deaea4b51881aadef8, user_id=4207db52f4f84c5895ffbad9fab99d18, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:46.402245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989818f-6ef8-4b66-a4f4-6048c1126095 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:46.413258 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1173/2320] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:24:46 2022] PUT /identity/v3/projects/f3ea07b0e4f145deaea4b51881aadef8/users/4207db52f4f84c5895ffbad9fab99d18/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:24:46.423914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a6756-b068-4690-b879-c34c5c80618d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:46.424203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a6756-b068-4690-b879-c34c5c80618d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:46.424527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a6756-b068-4690-b879-c34c5c80618d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:46.459405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-913a6756-b068-4690-b879-c34c5c80618d None None] MFA Rules not processed for user `4207db52f4f84c5895ffbad9fab99d18`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:46.460953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-913a6756-b068-4690-b879-c34c5c80618d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:46.545798 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1148/2321] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:24:46.602331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989818f-6ef8-4b66-a4f4-6048c1126095 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:46.604507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5989818f-6ef8-4b66-a4f4-6048c1126095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:46.734368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989818f-6ef8-4b66-a4f4-6048c1126095 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:46.740025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc42398-325d-4328-a527-7df46465f1d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:46.740705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc42398-325d-4328-a527-7df46465f1d4 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:46.741152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc42398-325d-4328-a527-7df46465f1d4 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:46.741577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc42398-325d-4328-a527-7df46465f1d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:46.752703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc42398-325d-4328-a527-7df46465f1d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:46.755442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc42398-325d-4328-a527-7df46465f1d4 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:46.767559 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1174/2322] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:24:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:24:46.995202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a6756-b068-4690-b879-c34c5c80618d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:47.122145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a6756-b068-4690-b879-c34c5c80618d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:47.140963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddbf80-8262-4d90-a5a8-9010fdc1961a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:47.142474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddbf80-8262-4d90-a5a8-9010fdc1961a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:47.143477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddbf80-8262-4d90-a5a8-9010fdc1961a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:47.145093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddbf80-8262-4d90-a5a8-9010fdc1961a admin admin] PATH_INFO: `/v3/users/b84c971ccb9e4e6282926b55661e68e9` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:47.146736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddbf80-8262-4d90-a5a8-9010fdc1961a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b84c971ccb9e4e6282926b55661e68e9)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:47.149270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddbf80-8262-4d90-a5a8-9010fdc1961a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:47.393008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a0ddbf80-8262-4d90-a5a8-9010fdc1961a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b84c971ccb9e4e6282926b55661e68e9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:47.393753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a0ddbf80-8262-4d90-a5a8-9010fdc1961a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b84c971ccb9e4e6282926b55661e68e9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:47.405703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a0ddbf80-8262-4d90-a5a8-9010fdc1961a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b84c971ccb9e4e6282926b55661e68e9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:47.421119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a0ddbf80-8262-4d90-a5a8-9010fdc1961a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b84c971ccb9e4e6282926b55661e68e9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:47.521315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a0ddbf80-8262-4d90-a5a8-9010fdc1961a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b84c971ccb9e4e6282926b55661e68e9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:47.529725 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1149/2323] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:24:46 2022] DELETE /identity/v3/users/b84c971ccb9e4e6282926b55661e68e9 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:24:47.534745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5be163-e9c1-4af8-a0fa-b03ff27b3bbf None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:47.536010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5be163-e9c1-4af8-a0fa-b03ff27b3bbf None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:47.536560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5be163-e9c1-4af8-a0fa-b03ff27b3bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:47.573404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-cb5be163-e9c1-4af8-a0fa-b03ff27b3bbf None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:47.575139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cb5be163-e9c1-4af8-a0fa-b03ff27b3bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:47.690082 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1175/2324] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:24:47.747255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddbf80-8262-4d90-a5a8-9010fdc1961a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:47.750024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a0ddbf80-8262-4d90-a5a8-9010fdc1961a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:47.846009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddbf80-8262-4d90-a5a8-9010fdc1961a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:47.850158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af2c99-e816-4bf0-915e-80aabbce0d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:47.851046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af2c99-e816-4bf0-915e-80aabbce0d9f service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:47.851327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af2c99-e816-4bf0-915e-80aabbce0d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:47.851805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af2c99-e816-4bf0-915e-80aabbce0d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:47.864496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af2c99-e816-4bf0-915e-80aabbce0d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:47.867380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af2c99-e816-4bf0-915e-80aabbce0d9f service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:47.882530 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1150/2325] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:24:48.388456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5be163-e9c1-4af8-a0fa-b03ff27b3bbf None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:48.391044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cb5be163-e9c1-4af8-a0fa-b03ff27b3bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:48.400387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:48.417686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5be163-e9c1-4af8-a0fa-b03ff27b3bbf None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:48.423941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3000b3a-b5c8-4dc7-9d2c-df1be6343550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:48.424799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3000b3a-b5c8-4dc7-9d2c-df1be6343550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:48.425315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3000b3a-b5c8-4dc7-9d2c-df1be6343550 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:48.425576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3000b3a-b5c8-4dc7-9d2c-df1be6343550 admin admin] PATH_INFO: `/v3/users/a50a0c4308064b25a67182b77431087b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:48.426811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3000b3a-b5c8-4dc7-9d2c-df1be6343550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a50a0c4308064b25a67182b77431087b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:48.428866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3000b3a-b5c8-4dc7-9d2c-df1be6343550 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:48.531914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af2c99-e816-4bf0-915e-80aabbce0d9f service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:48.533882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-32af2c99-e816-4bf0-915e-80aabbce0d9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:48.553120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af2c99-e816-4bf0-915e-80aabbce0d9f service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:48.570013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054831c7-7554-4d06-ac40-4b7dbca4395c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:48.570778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054831c7-7554-4d06-ac40-4b7dbca4395c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:48.571153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054831c7-7554-4d06-ac40-4b7dbca4395c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:48.571641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054831c7-7554-4d06-ac40-4b7dbca4395c admin admin] PATH_INFO: `/v3/projects/26581195363e4a018c9c06d475499691` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:48.573185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054831c7-7554-4d06-ac40-4b7dbca4395c admin admin] RBAC: Authorizing `identity:delete_project(project_id=26581195363e4a018c9c06d475499691)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:48.575233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054831c7-7554-4d06-ac40-4b7dbca4395c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:48.660639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c3000b3a-b5c8-4dc7-9d2c-df1be6343550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a50a0c4308064b25a67182b77431087b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:48.661535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c3000b3a-b5c8-4dc7-9d2c-df1be6343550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a50a0c4308064b25a67182b77431087b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:48.663074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:48.670206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c3000b3a-b5c8-4dc7-9d2c-df1be6343550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a50a0c4308064b25a67182b77431087b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:48.683926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c3000b3a-b5c8-4dc7-9d2c-df1be6343550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a50a0c4308064b25a67182b77431087b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:48.684741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c3000b3a-b5c8-4dc7-9d2c-df1be6343550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a50a0c4308064b25a67182b77431087b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:48.692092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-054831c7-7554-4d06-ac40-4b7dbca4395c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26581195363e4a018c9c06d475499691', 'request_id': 'req-054831c7-7554-4d06-ac40-4b7dbca4395c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:48.754463 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1176/2326] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:24:48 2022] DELETE /identity/v3/users/a50a0c4308064b25a67182b77431087b => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:24:48.758761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38172790-4b8a-46fa-b488-331afe274ea9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:48.759113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38172790-4b8a-46fa-b488-331afe274ea9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:48.759437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38172790-4b8a-46fa-b488-331afe274ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:48.778803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-38172790-4b8a-46fa-b488-331afe274ea9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:48.779941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-38172790-4b8a-46fa-b488-331afe274ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:48.834102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-054831c7-7554-4d06-ac40-4b7dbca4395c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26581195363e4a018c9c06d475499691', 'request_id': 'req-054831c7-7554-4d06-ac40-4b7dbca4395c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:48.841210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-054831c7-7554-4d06-ac40-4b7dbca4395c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26581195363e4a018c9c06d475499691', 'request_id': 'req-054831c7-7554-4d06-ac40-4b7dbca4395c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:48.851372 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1177/2327] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:24:48.856177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-054831c7-7554-4d06-ac40-4b7dbca4395c admin admin] The token cache is being invalidate because project 26581195363e4a018c9c06d475499691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:24:48.856360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-054831c7-7554-4d06-ac40-4b7dbca4395c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:48.857206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-054831c7-7554-4d06-ac40-4b7dbca4395c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:48.858728 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1151/2328] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:24:48 2022] DELETE /identity/v3/projects/26581195363e4a018c9c06d475499691 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:24:48.863332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38172790-4b8a-46fa-b488-331afe274ea9 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:48.865419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-38172790-4b8a-46fa-b488-331afe274ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:48.868345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054831c7-7554-4d06-ac40-4b7dbca4395c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:48.870073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-054831c7-7554-4d06-ac40-4b7dbca4395c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:48.886799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38172790-4b8a-46fa-b488-331afe274ea9 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:48.893778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659bddf-c07a-4f95-a2a0-ca8563f4ec04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:48.894785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659bddf-c07a-4f95-a2a0-ca8563f4ec04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:48.895266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659bddf-c07a-4f95-a2a0-ca8563f4ec04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:48.895708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659bddf-c07a-4f95-a2a0-ca8563f4ec04 admin admin] PATH_INFO: `/v3/users/4207db52f4f84c5895ffbad9fab99d18` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:48.897327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659bddf-c07a-4f95-a2a0-ca8563f4ec04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4207db52f4f84c5895ffbad9fab99d18)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:48.901200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659bddf-c07a-4f95-a2a0-ca8563f4ec04 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:48.950062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054831c7-7554-4d06-ac40-4b7dbca4395c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:49.004589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274b18a-43ec-44ed-af68-80e71d4933c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:49.005204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274b18a-43ec-44ed-af68-80e71d4933c2 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:49.005484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274b18a-43ec-44ed-af68-80e71d4933c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:49.005751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274b18a-43ec-44ed-af68-80e71d4933c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:49.007517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5274b18a-43ec-44ed-af68-80e71d4933c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:49.019559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274b18a-43ec-44ed-af68-80e71d4933c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:49.021263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274b18a-43ec-44ed-af68-80e71d4933c2 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:49.031151 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1152/2329] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:24:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:24:49.169522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e659bddf-c07a-4f95-a2a0-ca8563f4ec04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4207db52f4f84c5895ffbad9fab99d18'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:49.170550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e659bddf-c07a-4f95-a2a0-ca8563f4ec04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4207db52f4f84c5895ffbad9fab99d18'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:49.181604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e659bddf-c07a-4f95-a2a0-ca8563f4ec04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4207db52f4f84c5895ffbad9fab99d18'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:49.197473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e659bddf-c07a-4f95-a2a0-ca8563f4ec04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4207db52f4f84c5895ffbad9fab99d18'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:49.198241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e659bddf-c07a-4f95-a2a0-ca8563f4ec04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4207db52f4f84c5895ffbad9fab99d18'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:49.266443 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1178/2330] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:24:48 2022] DELETE /identity/v3/users/4207db52f4f84c5895ffbad9fab99d18 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:24:49.588082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274b18a-43ec-44ed-af68-80e71d4933c2 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:49.589633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5274b18a-43ec-44ed-af68-80e71d4933c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:49.607951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274b18a-43ec-44ed-af68-80e71d4933c2 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:49.680968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd59a6-23ab-4f13-a5e2-45fc2a6667e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:49.681682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd59a6-23ab-4f13-a5e2-45fc2a6667e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:49.681967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd59a6-23ab-4f13-a5e2-45fc2a6667e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:49.682273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd59a6-23ab-4f13-a5e2-45fc2a6667e1 admin admin] PATH_INFO: `/v3/projects/78742a1d089f4aa2985fc7060d5e7cb9` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:49.683424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd59a6-23ab-4f13-a5e2-45fc2a6667e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78742a1d089f4aa2985fc7060d5e7cb9)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:49.685575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd59a6-23ab-4f13-a5e2-45fc2a6667e1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:49.697693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:49.819692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d3dd59a6-23ab-4f13-a5e2-45fc2a6667e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78742a1d089f4aa2985fc7060d5e7cb9', 'request_id': 'req-d3dd59a6-23ab-4f13-a5e2-45fc2a6667e1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:49.893323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659bddf-c07a-4f95-a2a0-ca8563f4ec04 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:49.894870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e659bddf-c07a-4f95-a2a0-ca8563f4ec04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:49.897685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d3dd59a6-23ab-4f13-a5e2-45fc2a6667e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78742a1d089f4aa2985fc7060d5e7cb9', 'request_id': 'req-d3dd59a6-23ab-4f13-a5e2-45fc2a6667e1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:49.905986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d3dd59a6-23ab-4f13-a5e2-45fc2a6667e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78742a1d089f4aa2985fc7060d5e7cb9', 'request_id': 'req-d3dd59a6-23ab-4f13-a5e2-45fc2a6667e1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:49.916772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659bddf-c07a-4f95-a2a0-ca8563f4ec04 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:49.918518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d3dd59a6-23ab-4f13-a5e2-45fc2a6667e1 admin admin] The token cache is being invalidate because project 78742a1d089f4aa2985fc7060d5e7cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:24:49.918922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d3dd59a6-23ab-4f13-a5e2-45fc2a6667e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:49.919681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d3dd59a6-23ab-4f13-a5e2-45fc2a6667e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:49.925291 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1153/2331] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:24:49 2022] DELETE /identity/v3/projects/78742a1d089f4aa2985fc7060d5e7cb9 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:24:49.927078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd59a6-23ab-4f13-a5e2-45fc2a6667e1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:49.928623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d3dd59a6-23ab-4f13-a5e2-45fc2a6667e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:49.992585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86871c28-497d-41cd-ba35-656956e7e26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:49.992585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86871c28-497d-41cd-ba35-656956e7e26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:49.992585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86871c28-497d-41cd-ba35-656956e7e26e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:49.992585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86871c28-497d-41cd-ba35-656956e7e26e admin admin] PATH_INFO: `/v3/projects/f3ea07b0e4f145deaea4b51881aadef8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:49.993048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86871c28-497d-41cd-ba35-656956e7e26e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3ea07b0e4f145deaea4b51881aadef8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:49.994991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86871c28-497d-41cd-ba35-656956e7e26e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:50.004945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd59a6-23ab-4f13-a5e2-45fc2a6667e1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:50.010605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5884e-f344-47f2-92d6-a71beb380c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:50.011456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5884e-f344-47f2-92d6-a71beb380c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:50.011894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5884e-f344-47f2-92d6-a71beb380c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:50.012323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5884e-f344-47f2-92d6-a71beb380c6e admin admin] PATH_INFO: `/v3/users/8f1dc9195d284e1dbd078dc7cd92507e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:50.014242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5884e-f344-47f2-92d6-a71beb380c6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f1dc9195d284e1dbd078dc7cd92507e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:50.018827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5884e-f344-47f2-92d6-a71beb380c6e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:50.114933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-86871c28-497d-41cd-ba35-656956e7e26e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3ea07b0e4f145deaea4b51881aadef8', 'request_id': 'req-86871c28-497d-41cd-ba35-656956e7e26e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:50.121646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-86871c28-497d-41cd-ba35-656956e7e26e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3ea07b0e4f145deaea4b51881aadef8', 'request_id': 'req-86871c28-497d-41cd-ba35-656956e7e26e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:50.147685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-86871c28-497d-41cd-ba35-656956e7e26e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3ea07b0e4f145deaea4b51881aadef8', 'request_id': 'req-86871c28-497d-41cd-ba35-656956e7e26e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:50.254772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-86871c28-497d-41cd-ba35-656956e7e26e admin admin] The token cache is being invalidate because project f3ea07b0e4f145deaea4b51881aadef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:24:50.255075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-86871c28-497d-41cd-ba35-656956e7e26e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:50.255738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-86871c28-497d-41cd-ba35-656956e7e26e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:50.257696 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1179/2332] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:24:49 2022] DELETE /identity/v3/projects/f3ea07b0e4f145deaea4b51881aadef8 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:24:50.262863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e8ffe-43f4-4e38-8c98-de42ca4fb119 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:50.263220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e8ffe-43f4-4e38-8c98-de42ca4fb119 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:50.263571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e8ffe-43f4-4e38-8c98-de42ca4fb119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:50.268748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-52f5884e-f344-47f2-92d6-a71beb380c6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f1dc9195d284e1dbd078dc7cd92507e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:50.269409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-52f5884e-f344-47f2-92d6-a71beb380c6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f1dc9195d284e1dbd078dc7cd92507e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:50.279675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-52f5884e-f344-47f2-92d6-a71beb380c6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f1dc9195d284e1dbd078dc7cd92507e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:50.285692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2f7e8ffe-43f4-4e38-8c98-de42ca4fb119 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:50.286956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2f7e8ffe-43f4-4e38-8c98-de42ca4fb119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:50.294624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-52f5884e-f344-47f2-92d6-a71beb380c6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f1dc9195d284e1dbd078dc7cd92507e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:50.337363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-52f5884e-f344-47f2-92d6-a71beb380c6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f1dc9195d284e1dbd078dc7cd92507e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:50.350127 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1154/2333] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:24:49 2022] DELETE /identity/v3/users/8f1dc9195d284e1dbd078dc7cd92507e => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:24:50.358327 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1180/2334] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:24:50.363138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5620d6-7c2a-4d3e-b22b-1392d70f686b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:50.363368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5620d6-7c2a-4d3e-b22b-1392d70f686b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:50.363757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5620d6-7c2a-4d3e-b22b-1392d70f686b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:50.384784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-df5620d6-7c2a-4d3e-b22b-1392d70f686b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:50.386083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-df5620d6-7c2a-4d3e-b22b-1392d70f686b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:50.446367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:50.449618 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1155/2335] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:24:50.453864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e8ffe-43f4-4e38-8c98-de42ca4fb119 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:50.463269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e8ffe-43f4-4e38-8c98-de42ca4fb119 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:50.467904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c390c-5d72-4b65-9e3f-59bd4e4d38f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:50.468568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c390c-5d72-4b65-9e3f-59bd4e4d38f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:50.468854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c390c-5d72-4b65-9e3f-59bd4e4d38f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:50.469123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c390c-5d72-4b65-9e3f-59bd4e4d38f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:50.470187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c390c-5d72-4b65-9e3f-59bd4e4d38f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:24:50.470495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c390c-5d72-4b65-9e3f-59bd4e4d38f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:50.472090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c390c-5d72-4b65-9e3f-59bd4e4d38f9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:50.483637 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1181/2336] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:24:50.488717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5620d6-7c2a-4d3e-b22b-1392d70f686b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:50.497700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5620d6-7c2a-4d3e-b22b-1392d70f686b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:50.503044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de75424-c143-41ef-9859-58d8b2098a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:50.503635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de75424-c143-41ef-9859-58d8b2098a28 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:50.503911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de75424-c143-41ef-9859-58d8b2098a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:50.504181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de75424-c143-41ef-9859-58d8b2098a28 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:50.504814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de75424-c143-41ef-9859-58d8b2098a28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:50.506773 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de75424-c143-41ef-9859-58d8b2098a28 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:50.627120 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1156/2337] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:24:50 2022] POST /identity/v3/projects => generated 395 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:24:50.627681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c390c-5d72-4b65-9e3f-59bd4e4d38f9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:50.651316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c390c-5d72-4b65-9e3f-59bd4e4d38f9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:50.733753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68b21f-1763-4c2d-8e06-7f4d557c9cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:50.734505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68b21f-1763-4c2d-8e06-7f4d557c9cce admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:50.734796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68b21f-1763-4c2d-8e06-7f4d557c9cce admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:50.735068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68b21f-1763-4c2d-8e06-7f4d557c9cce admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:50.736308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68b21f-1763-4c2d-8e06-7f4d557c9cce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:50.738408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68b21f-1763-4c2d-8e06-7f4d557c9cce admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:50.817950 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1182/2338] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:24:50 2022] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:24:50.819265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de75424-c143-41ef-9859-58d8b2098a28 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:50.829278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de75424-c143-41ef-9859-58d8b2098a28 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:50.833921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796576f-9194-4c9c-9249-d82c4a127d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:50.834688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796576f-9194-4c9c-9249-d82c4a127d8f admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:50.834976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796576f-9194-4c9c-9249-d82c4a127d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:50.835297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796576f-9194-4c9c-9249-d82c4a127d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:50.835943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796576f-9194-4c9c-9249-d82c4a127d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:50.837540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796576f-9194-4c9c-9249-d82c4a127d8f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:50.848340 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1157/2339] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:24:50.852332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68b21f-1763-4c2d-8e06-7f4d557c9cce admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:50.862589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796576f-9194-4c9c-9249-d82c4a127d8f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:50.864134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68b21f-1763-4c2d-8e06-7f4d557c9cce admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:50.864562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9796576f-9194-4c9c-9249-d82c4a127d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:50.868248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6c3e3-761a-4c70-9989-ec22e9848b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:50.868872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6c3e3-761a-4c70-9989-ec22e9848b2d admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:50.869801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6c3e3-761a-4c70-9989-ec22e9848b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:50.870233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6c3e3-761a-4c70-9989-ec22e9848b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:50.871692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6c3e3-761a-4c70-9989-ec22e9848b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:50.873330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6c3e3-761a-4c70-9989-ec22e9848b2d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:50.882396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796576f-9194-4c9c-9249-d82c4a127d8f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:50.888407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d1ae8-e791-4d86-aab5-c04a7eaefe9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:50.889819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d1ae8-e791-4d86-aab5-c04a7eaefe9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:50.890307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d1ae8-e791-4d86-aab5-c04a7eaefe9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:50.893451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d1ae8-e791-4d86-aab5-c04a7eaefe9d admin admin] PATH_INFO: `/v3/projects/ec6ea8346e3d4c85bf11ace1a3eb098b` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:50.893451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d1ae8-e791-4d86-aab5-c04a7eaefe9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec6ea8346e3d4c85bf11ace1a3eb098b)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:50.896534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d1ae8-e791-4d86-aab5-c04a7eaefe9d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:50.917655 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1183/2340] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:24:50.919731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6c3e3-761a-4c70-9989-ec22e9848b2d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:50.933962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6c3e3-761a-4c70-9989-ec22e9848b2d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:50.938788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bc482-ec3f-47fe-a172-a2e668924880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:50.939664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bc482-ec3f-47fe-a172-a2e668924880 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:50.939949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bc482-ec3f-47fe-a172-a2e668924880 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:50.940225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bc482-ec3f-47fe-a172-a2e668924880 admin admin] PATH_INFO: `/v3/projects/d53cd3ceb4fb412e917276a06b82da88/users/bb5c75219676452896894e07d79cc57e/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:50.956579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bc482-ec3f-47fe-a172-a2e668924880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d53cd3ceb4fb412e917276a06b82da88, user_id=bb5c75219676452896894e07d79cc57e, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:50.959647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bc482-ec3f-47fe-a172-a2e668924880 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:51.071899 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1184/2341] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:24:50 2022] PUT /identity/v3/projects/d53cd3ceb4fb412e917276a06b82da88/users/bb5c75219676452896894e07d79cc57e/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:24:51.084398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac8240-f659-4a1f-b31e-ae440479396c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:51.084575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-df7d1ae8-e791-4d86-aab5-c04a7eaefe9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec6ea8346e3d4c85bf11ace1a3eb098b', 'request_id': 'req-df7d1ae8-e791-4d86-aab5-c04a7eaefe9d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:51.084730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac8240-f659-4a1f-b31e-ae440479396c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:51.084975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac8240-f659-4a1f-b31e-ae440479396c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:51.115712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-bcac8240-f659-4a1f-b31e-ae440479396c None None] MFA Rules not processed for user `bb5c75219676452896894e07d79cc57e`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:51.118675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bcac8240-f659-4a1f-b31e-ae440479396c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:51.149740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-df7d1ae8-e791-4d86-aab5-c04a7eaefe9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec6ea8346e3d4c85bf11ace1a3eb098b', 'request_id': 'req-df7d1ae8-e791-4d86-aab5-c04a7eaefe9d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:51.154951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-df7d1ae8-e791-4d86-aab5-c04a7eaefe9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec6ea8346e3d4c85bf11ace1a3eb098b', 'request_id': 'req-df7d1ae8-e791-4d86-aab5-c04a7eaefe9d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:51.185830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-df7d1ae8-e791-4d86-aab5-c04a7eaefe9d admin admin] The token cache is being invalidate because project ec6ea8346e3d4c85bf11ace1a3eb098b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:24:51.186163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-df7d1ae8-e791-4d86-aab5-c04a7eaefe9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:51.187406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-df7d1ae8-e791-4d86-aab5-c04a7eaefe9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:51.189324 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1158/2342] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:24:50 2022] DELETE /identity/v3/projects/ec6ea8346e3d4c85bf11ace1a3eb098b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:24:51.193927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81a036-3092-47ad-b388-e31faf135229 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:51.194249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81a036-3092-47ad-b388-e31faf135229 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:51.194534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81a036-3092-47ad-b388-e31faf135229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:51.225914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-cd81a036-3092-47ad-b388-e31faf135229 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:51.230625 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1185/2343] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:51 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:24:51.232588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cd81a036-3092-47ad-b388-e31faf135229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:51.245579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac8240-f659-4a1f-b31e-ae440479396c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:51.246487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bcac8240-f659-4a1f-b31e-ae440479396c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:51.314714 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1159/2344] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:24:51.322344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd60b77-7063-4e1e-b980-2c45459743f0 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:51.323362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd60b77-7063-4e1e-b980-2c45459743f0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:51.325331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd60b77-7063-4e1e-b980-2c45459743f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:51.348783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:51.352343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1dd60b77-7063-4e1e-b980-2c45459743f0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:51.356764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1dd60b77-7063-4e1e-b980-2c45459743f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:51.356989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac8240-f659-4a1f-b31e-ae440479396c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:51.364848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4203c8-9c49-48c2-a7ac-eae6e422c3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:51.365480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4203c8-9c49-48c2-a7ac-eae6e422c3cc admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:51.365856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4203c8-9c49-48c2-a7ac-eae6e422c3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:51.366282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4203c8-9c49-48c2-a7ac-eae6e422c3cc admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:51.367081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4203c8-9c49-48c2-a7ac-eae6e422c3cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:51.369070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4203c8-9c49-48c2-a7ac-eae6e422c3cc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:51.369652 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1160/2345] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:24:51.373485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd60b77-7063-4e1e-b980-2c45459743f0 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:51.405312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd60b77-7063-4e1e-b980-2c45459743f0 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:51.411340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d5c29-37de-4867-83d8-04ad5dcd22bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:51.412189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d5c29-37de-4867-83d8-04ad5dcd22bb admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:51.412490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d5c29-37de-4867-83d8-04ad5dcd22bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:51.412772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d5c29-37de-4867-83d8-04ad5dcd22bb admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:51.413653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d5c29-37de-4867-83d8-04ad5dcd22bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:24:51.413970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d5c29-37de-4867-83d8-04ad5dcd22bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:51.415941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d5c29-37de-4867-83d8-04ad5dcd22bb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:51.439060 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1161/2346] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:24:51.441140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d5c29-37de-4867-83d8-04ad5dcd22bb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:51.457279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d5c29-37de-4867-83d8-04ad5dcd22bb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:51.466757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff3297-1fce-4eb2-82e2-a439ac895fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:51.467384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff3297-1fce-4eb2-82e2-a439ac895fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:51.467660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff3297-1fce-4eb2-82e2-a439ac895fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:51.468061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff3297-1fce-4eb2-82e2-a439ac895fa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:51.476555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff3297-1fce-4eb2-82e2-a439ac895fa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:51.480855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff3297-1fce-4eb2-82e2-a439ac895fa7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:51.486845 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1186/2347] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:24:51 2022] POST /identity/v3/projects => generated 393 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:24:51.491937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4203c8-9c49-48c2-a7ac-eae6e422c3cc admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:51.573923 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1162/2348] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:24:51 2022] POST /identity/v3/projects => generated 391 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:24:51.578535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff3297-1fce-4eb2-82e2-a439ac895fa7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:51.619406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4203c8-9c49-48c2-a7ac-eae6e422c3cc admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:51.709423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff3297-1fce-4eb2-82e2-a439ac895fa7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:51.715808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4c04e-ae76-4bf6-945a-3f734a4594e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:51.717580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4c04e-ae76-4bf6-945a-3f734a4594e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:51.717966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4c04e-ae76-4bf6-945a-3f734a4594e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:51.718438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4c04e-ae76-4bf6-945a-3f734a4594e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:51.719138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4c04e-ae76-4bf6-945a-3f734a4594e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:51.722427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4c04e-ae76-4bf6-945a-3f734a4594e8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:51.736487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e5fbd-43ea-4e07-ab94-cf3080d80f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:51.736984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e5fbd-43ea-4e07-ab94-cf3080d80f68 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:51.738489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e5fbd-43ea-4e07-ab94-cf3080d80f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:51.739159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e5fbd-43ea-4e07-ab94-cf3080d80f68 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:51.740054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e5fbd-43ea-4e07-ab94-cf3080d80f68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:51.755508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e5fbd-43ea-4e07-ab94-cf3080d80f68 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:51.881010 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1163/2349] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:24:51 2022] POST /identity/v3/users => generated 296 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:24:51.886451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4c04e-ae76-4bf6-945a-3f734a4594e8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:51.910496 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1187/2350] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:24:51 2022] POST /identity/v3/users => generated 303 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:24:51.914619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e5fbd-43ea-4e07-ab94-cf3080d80f68 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:51.974079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4c04e-ae76-4bf6-945a-3f734a4594e8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:51.978940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e5fbd-43ea-4e07-ab94-cf3080d80f68 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:52.009086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97adc7c-9721-443e-b082-a39f98170767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:52.013590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24c028-cd43-48e8-be2b-8c93437b92e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:52.017590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c028-cd43-48e8-be2b-8c93437b92e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:52.017871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97adc7c-9721-443e-b082-a39f98170767 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:52.019728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97adc7c-9721-443e-b082-a39f98170767 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:52.020237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97adc7c-9721-443e-b082-a39f98170767 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:52.021882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c028-cd43-48e8-be2b-8c93437b92e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:52.023204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c028-cd43-48e8-be2b-8c93437b92e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:52.025077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97adc7c-9721-443e-b082-a39f98170767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:52.025617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24c028-cd43-48e8-be2b-8c93437b92e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:52.031532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97adc7c-9721-443e-b082-a39f98170767 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:52.034124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24c028-cd43-48e8-be2b-8c93437b92e8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:52.055109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:52.062119 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1188/2351] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:24:52.062849 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1164/2352] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:24:52.066548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24c028-cd43-48e8-be2b-8c93437b92e8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:52.069247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97adc7c-9721-443e-b082-a39f98170767 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:52.090458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24c028-cd43-48e8-be2b-8c93437b92e8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:52.096221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97adc7c-9721-443e-b082-a39f98170767 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:52.106214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad49930-00f1-4125-93df-2d6141d0c2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:52.106907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49930-00f1-4125-93df-2d6141d0c2aa admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:52.107259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49930-00f1-4125-93df-2d6141d0c2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:52.107642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49930-00f1-4125-93df-2d6141d0c2aa admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:52.108516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad49930-00f1-4125-93df-2d6141d0c2aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:52.111052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad49930-00f1-4125-93df-2d6141d0c2aa admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:52.121745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426ec57-7675-414c-8a93-64f92058a730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:52.123505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426ec57-7675-414c-8a93-64f92058a730 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:52.123791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426ec57-7675-414c-8a93-64f92058a730 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:52.124136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426ec57-7675-414c-8a93-64f92058a730 admin admin] PATH_INFO: `/v3/projects/70f9e2b381b5497292398a3d40175b03/users/ad48391d27cd4ec094e09c6fec48e1d8/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:52.129080 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1165/2353] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:24:52.130247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad49930-00f1-4125-93df-2d6141d0c2aa admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:52.143042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad49930-00f1-4125-93df-2d6141d0c2aa admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:52.149452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17f848-55e8-4ccf-8971-22bd6b377f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:52.150272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17f848-55e8-4ccf-8971-22bd6b377f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:52.150628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17f848-55e8-4ccf-8971-22bd6b377f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:52.151546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426ec57-7675-414c-8a93-64f92058a730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f9e2b381b5497292398a3d40175b03, user_id=ad48391d27cd4ec094e09c6fec48e1d8, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:52.151672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17f848-55e8-4ccf-8971-22bd6b377f83 admin admin] PATH_INFO: `/v3/projects/49d2c150feac4d03966a860ab8bafe00/users/2ccd5909fb214f71ad68704019c9e4f0/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:52.155797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426ec57-7675-414c-8a93-64f92058a730 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:52.183935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17f848-55e8-4ccf-8971-22bd6b377f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d2c150feac4d03966a860ab8bafe00, user_id=2ccd5909fb214f71ad68704019c9e4f0, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:52.193939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17f848-55e8-4ccf-8971-22bd6b377f83 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:52.212122 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1189/2354] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:24:52 2022] PUT /identity/v3/projects/70f9e2b381b5497292398a3d40175b03/users/ad48391d27cd4ec094e09c6fec48e1d8/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:24:52.215984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426ec57-7675-414c-8a93-64f92058a730 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:52.281067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426ec57-7675-414c-8a93-64f92058a730 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:52.286568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d772c-86b2-4229-b890-615345c9ad0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:52.287416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d772c-86b2-4229-b890-615345c9ad0e admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:52.287721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d772c-86b2-4229-b890-615345c9ad0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:52.287994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d772c-86b2-4229-b890-615345c9ad0e admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:52.288649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d772c-86b2-4229-b890-615345c9ad0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:52.290267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d772c-86b2-4229-b890-615345c9ad0e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:52.304069 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1190/2355] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:24:52.313219 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1166/2356] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:24:52 2022] PUT /identity/v3/projects/49d2c150feac4d03966a860ab8bafe00/users/2ccd5909fb214f71ad68704019c9e4f0/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:24:52.313391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d772c-86b2-4229-b890-615345c9ad0e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:52.314878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733e510-e43d-4aff-8f75-ed55a405b1f7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:52.315167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733e510-e43d-4aff-8f75-ed55a405b1f7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:52.315444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733e510-e43d-4aff-8f75-ed55a405b1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:52.323517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d772c-86b2-4229-b890-615345c9ad0e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:52.357004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0733e510-e43d-4aff-8f75-ed55a405b1f7 None None] MFA Rules not processed for user `2ccd5909fb214f71ad68704019c9e4f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:52.358826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0733e510-e43d-4aff-8f75-ed55a405b1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:52.395357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b559a-00eb-4725-a7a7-2b393c082a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:52.397314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b559a-00eb-4725-a7a7-2b393c082a2f admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:52.397314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b559a-00eb-4725-a7a7-2b393c082a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:52.397314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b559a-00eb-4725-a7a7-2b393c082a2f admin admin] PATH_INFO: `/v3/projects/70f9e2b381b5497292398a3d40175b03/users/ad48391d27cd4ec094e09c6fec48e1d8/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:52.399016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b559a-00eb-4725-a7a7-2b393c082a2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f9e2b381b5497292398a3d40175b03, user_id=ad48391d27cd4ec094e09c6fec48e1d8, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:52.401792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b559a-00eb-4725-a7a7-2b393c082a2f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:52.426166 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1191/2357] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:24:52 2022] PUT /identity/v3/projects/70f9e2b381b5497292398a3d40175b03/users/ad48391d27cd4ec094e09c6fec48e1d8/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:24:52.436234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f20b6-8c4e-4be9-a8ee-67bdb0e9b415 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:52.436524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f20b6-8c4e-4be9-a8ee-67bdb0e9b415 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:52.436887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f20b6-8c4e-4be9-a8ee-67bdb0e9b415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:52.482079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-210f20b6-8c4e-4be9-a8ee-67bdb0e9b415 None None] MFA Rules not processed for user `ad48391d27cd4ec094e09c6fec48e1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:52.483441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-210f20b6-8c4e-4be9-a8ee-67bdb0e9b415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:52.484964 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1167/2358] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:24:52.491888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733e510-e43d-4aff-8f75-ed55a405b1f7 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:52.508048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733e510-e43d-4aff-8f75-ed55a405b1f7 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:52.583017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b09ea9-00fa-4ab1-81d6-2de8f1403847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:52.584022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b09ea9-00fa-4ab1-81d6-2de8f1403847 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:52.584301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b09ea9-00fa-4ab1-81d6-2de8f1403847 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:52.584573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b09ea9-00fa-4ab1-81d6-2de8f1403847 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:52.585433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b09ea9-00fa-4ab1-81d6-2de8f1403847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:52.587529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b09ea9-00fa-4ab1-81d6-2de8f1403847 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:52.588112 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1192/2359] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:52 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:24:52.603648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f20b6-8c4e-4be9-a8ee-67bdb0e9b415 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:52.613153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-210f20b6-8c4e-4be9-a8ee-67bdb0e9b415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:52.700473 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1168/2360] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:24:52 2022] POST /identity/v3/projects => generated 393 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:24:52.707061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b09ea9-00fa-4ab1-81d6-2de8f1403847 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:52.773467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f20b6-8c4e-4be9-a8ee-67bdb0e9b415 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:52.859917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b09ea9-00fa-4ab1-81d6-2de8f1403847 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:52.862984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:52.870378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f63fb5-e8f6-4cf4-8097-3e7f6c331d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:52.875122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f63fb5-e8f6-4cf4-8097-3e7f6c331d97 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:52.875699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f63fb5-e8f6-4cf4-8097-3e7f6c331d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:52.876709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f63fb5-e8f6-4cf4-8097-3e7f6c331d97 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:52.878931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f63fb5-e8f6-4cf4-8097-3e7f6c331d97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:52.881149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f63fb5-e8f6-4cf4-8097-3e7f6c331d97 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:52.920987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4490660-9d19-4691-a3c8-ea0c293ff955 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:52.921628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4490660-9d19-4691-a3c8-ea0c293ff955 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:52.921908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4490660-9d19-4691-a3c8-ea0c293ff955 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:52.922215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4490660-9d19-4691-a3c8-ea0c293ff955 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:53.031682 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1169/2361] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:24:52 2022] POST /identity/v3/users => generated 303 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:24:53.035697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f63fb5-e8f6-4cf4-8097-3e7f6c331d97 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:53.057560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f63fb5-e8f6-4cf4-8097-3e7f6c331d97 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:53.068562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ac910-f26e-4a3b-960b-be1eff4f04e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:53.069296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ac910-f26e-4a3b-960b-be1eff4f04e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:53.069641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ac910-f26e-4a3b-960b-be1eff4f04e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:53.069853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4490660-9d19-4691-a3c8-ea0c293ff955 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:53.070332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ac910-f26e-4a3b-960b-be1eff4f04e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:53.070970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ac910-f26e-4a3b-960b-be1eff4f04e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:53.071526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4490660-9d19-4691-a3c8-ea0c293ff955 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:53.073609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ac910-f26e-4a3b-960b-be1eff4f04e2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:53.093453 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1193/2362] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:24:52 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:24:53.100652 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1170/2363] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:24:53.107417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4490660-9d19-4691-a3c8-ea0c293ff955 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:53.141628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4490660-9d19-4691-a3c8-ea0c293ff955 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:53.169185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d01d5a-0c38-4142-b000-4d068a59521c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:53.171447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d01d5a-0c38-4142-b000-4d068a59521c admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:53.171932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d01d5a-0c38-4142-b000-4d068a59521c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:53.172216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d01d5a-0c38-4142-b000-4d068a59521c admin admin] PATH_INFO: `/v3/projects/dc250ed4d4ca4645bbb9bd83d3d3ac9f/users/fc8e662e5b2f4e32ba368bd697294803/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:53.218445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d01d5a-0c38-4142-b000-4d068a59521c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc250ed4d4ca4645bbb9bd83d3d3ac9f, user_id=fc8e662e5b2f4e32ba368bd697294803, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:53.221441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d01d5a-0c38-4142-b000-4d068a59521c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:53.267494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44840613-9863-4747-9c30-a74949c2054c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:53.267614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44840613-9863-4747-9c30-a74949c2054c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:53.267882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44840613-9863-4747-9c30-a74949c2054c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:53.302451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-44840613-9863-4747-9c30-a74949c2054c None None] MFA Rules not processed for user `d3f1177e2cbd4ba6b659f8a714be86ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:53.303728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-44840613-9863-4747-9c30-a74949c2054c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:53.326800 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1194/2364] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:24:53 2022] PUT /identity/v3/projects/dc250ed4d4ca4645bbb9bd83d3d3ac9f/users/fc8e662e5b2f4e32ba368bd697294803/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:24:53.326800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d01d5a-0c38-4142-b000-4d068a59521c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:53.451886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d01d5a-0c38-4142-b000-4d068a59521c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:53.464540 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1171/2365] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:24:53.468770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0708b-a8aa-4038-b910-119de07f85ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:53.472479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0708b-a8aa-4038-b910-119de07f85ba admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:53.472479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0708b-a8aa-4038-b910-119de07f85ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:53.472479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0708b-a8aa-4038-b910-119de07f85ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:53.472479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0708b-a8aa-4038-b910-119de07f85ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:53.472866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0708b-a8aa-4038-b910-119de07f85ba admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:53.502286 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1195/2366] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:24:53.507573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44840613-9863-4747-9c30-a74949c2054c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:53.544221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44840613-9863-4747-9c30-a74949c2054c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:53.558111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0711c3-6dcc-49eb-8160-1fc84c148138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:53.562974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0711c3-6dcc-49eb-8160-1fc84c148138 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:53.562974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0711c3-6dcc-49eb-8160-1fc84c148138 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:53.562974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0711c3-6dcc-49eb-8160-1fc84c148138 admin admin] PATH_INFO: `/v3/projects/dc250ed4d4ca4645bbb9bd83d3d3ac9f/users/fc8e662e5b2f4e32ba368bd697294803/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:53.571342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723d153-f64e-419c-80c2-cf12cde89903 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:53.571541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0711c3-6dcc-49eb-8160-1fc84c148138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc250ed4d4ca4645bbb9bd83d3d3ac9f, user_id=fc8e662e5b2f4e32ba368bd697294803, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:53.571629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723d153-f64e-419c-80c2-cf12cde89903 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:53.571886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723d153-f64e-419c-80c2-cf12cde89903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:53.574242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0711c3-6dcc-49eb-8160-1fc84c148138 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:53.586480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:53.602081 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1172/2367] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:24:53 2022] PUT /identity/v3/projects/dc250ed4d4ca4645bbb9bd83d3d3ac9f/users/fc8e662e5b2f4e32ba368bd697294803/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:24:53.609768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0aae7-f077-4a1f-a4a2-be803c90b9ec None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:53.610261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0aae7-f077-4a1f-a4a2-be803c90b9ec None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:53.611137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4723d153-f64e-419c-80c2-cf12cde89903 None None] MFA Rules not processed for user `ba3ce7f040d24c33bcf9b97d1ef25268`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:53.612229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0aae7-f077-4a1f-a4a2-be803c90b9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:53.612355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4723d153-f64e-419c-80c2-cf12cde89903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:53.674604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9df0aae7-f077-4a1f-a4a2-be803c90b9ec None None] MFA Rules not processed for user `fc8e662e5b2f4e32ba368bd697294803`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:53.675845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9df0aae7-f077-4a1f-a4a2-be803c90b9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:53.733279 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1196/2368] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:53 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:24:53.808587 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1173/2369] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:53 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:24:53.820625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee061a-c63e-427c-99fb-6c0e0dfdfa9b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:53.821374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee061a-c63e-427c-99fb-6c0e0dfdfa9b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:53.822063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee061a-c63e-427c-99fb-6c0e0dfdfa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:53.858488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-62ee061a-c63e-427c-99fb-6c0e0dfdfa9b None None] MFA Rules not processed for user `2ccd5909fb214f71ad68704019c9e4f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:53.861079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-62ee061a-c63e-427c-99fb-6c0e0dfdfa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:53.974675 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1197/2370] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:24:54.326411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:54.350972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0aae7-f077-4a1f-a4a2-be803c90b9ec None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:54.352372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9df0aae7-f077-4a1f-a4a2-be803c90b9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:54.355362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:54.472723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0aae7-f077-4a1f-a4a2-be803c90b9ec None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:54.482169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2684642-a38d-4a4f-9d39-f16e1cc4f239 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:54.482813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2684642-a38d-4a4f-9d39-f16e1cc4f239 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:54.483097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2684642-a38d-4a4f-9d39-f16e1cc4f239 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:54.483373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2684642-a38d-4a4f-9d39-f16e1cc4f239 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:54.494429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2684642-a38d-4a4f-9d39-f16e1cc4f239 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:54.495992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2684642-a38d-4a4f-9d39-f16e1cc4f239 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:54.509555 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1174/2371] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:24:54 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:24:55.405910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:55.575844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee061a-c63e-427c-99fb-6c0e0dfdfa9b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:55.592287 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee061a-c63e-427c-99fb-6c0e0dfdfa9b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:55.599674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e76c57-ee40-44e6-8b0b-ef96516f84ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:55.600438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e76c57-ee40-44e6-8b0b-ef96516f84ed service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:55.600790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e76c57-ee40-44e6-8b0b-ef96516f84ed service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:55.601189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e76c57-ee40-44e6-8b0b-ef96516f84ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:55.736424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e76c57-ee40-44e6-8b0b-ef96516f84ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:55.855269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e76c57-ee40-44e6-8b0b-ef96516f84ed service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:55.855269 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1198/2372] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:24:55 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:24:55.856526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2684642-a38d-4a4f-9d39-f16e1cc4f239 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:55.913205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2684642-a38d-4a4f-9d39-f16e1cc4f239 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:56.060862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717292ed-98c6-4aef-8be0-9b06ee3eb824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:56.060862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717292ed-98c6-4aef-8be0-9b06ee3eb824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:56.060862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717292ed-98c6-4aef-8be0-9b06ee3eb824 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:56.060862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717292ed-98c6-4aef-8be0-9b06ee3eb824 admin admin] PATH_INFO: `/v3/users/bb5c75219676452896894e07d79cc57e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:56.061281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717292ed-98c6-4aef-8be0-9b06ee3eb824 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb5c75219676452896894e07d79cc57e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:56.061281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717292ed-98c6-4aef-8be0-9b06ee3eb824 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:56.461413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-717292ed-98c6-4aef-8be0-9b06ee3eb824 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb5c75219676452896894e07d79cc57e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:56.462970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-717292ed-98c6-4aef-8be0-9b06ee3eb824 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb5c75219676452896894e07d79cc57e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:56.478934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-717292ed-98c6-4aef-8be0-9b06ee3eb824 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb5c75219676452896894e07d79cc57e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:56.500280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-717292ed-98c6-4aef-8be0-9b06ee3eb824 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb5c75219676452896894e07d79cc57e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:56.594571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-717292ed-98c6-4aef-8be0-9b06ee3eb824 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb5c75219676452896894e07d79cc57e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:56.615231 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1175/2373] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:24:55 2022] DELETE /identity/v3/users/bb5c75219676452896894e07d79cc57e => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:24:56.617479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed766ed7-0620-4779-b7fb-359be8b23a14 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:56.617999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed766ed7-0620-4779-b7fb-359be8b23a14 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:56.618163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed766ed7-0620-4779-b7fb-359be8b23a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:56.639095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ed766ed7-0620-4779-b7fb-359be8b23a14 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:56.644702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ed766ed7-0620-4779-b7fb-359be8b23a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:56.680451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:56.794740 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1199/2374] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:24:56.814316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717292ed-98c6-4aef-8be0-9b06ee3eb824 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:56.817089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-717292ed-98c6-4aef-8be0-9b06ee3eb824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:56.881311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717292ed-98c6-4aef-8be0-9b06ee3eb824 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:56.886181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d0804-57a5-4057-8e68-fdcb207abb8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:56.886936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d0804-57a5-4057-8e68-fdcb207abb8b service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:56.887288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d0804-57a5-4057-8e68-fdcb207abb8b service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:56.887631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d0804-57a5-4057-8e68-fdcb207abb8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:56.905112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d0804-57a5-4057-8e68-fdcb207abb8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:56.906719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d0804-57a5-4057-8e68-fdcb207abb8b service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:56.918418 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1176/2375] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:24:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:24:57.496331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed766ed7-0620-4779-b7fb-359be8b23a14 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:57.497821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ed766ed7-0620-4779-b7fb-359be8b23a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:57.516960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed766ed7-0620-4779-b7fb-359be8b23a14 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:57.522827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eaf2a2-948b-4434-8065-9b39067bf6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:57.523591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaf2a2-948b-4434-8065-9b39067bf6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:57.523879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaf2a2-948b-4434-8065-9b39067bf6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:57.524147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaf2a2-948b-4434-8065-9b39067bf6ce admin admin] PATH_INFO: `/v3/projects/d53cd3ceb4fb412e917276a06b82da88` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:57.525356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eaf2a2-948b-4434-8065-9b39067bf6ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=d53cd3ceb4fb412e917276a06b82da88)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:57.527354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eaf2a2-948b-4434-8065-9b39067bf6ce admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:57.564981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:57.666820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-14eaf2a2-948b-4434-8065-9b39067bf6ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd53cd3ceb4fb412e917276a06b82da88', 'request_id': 'req-14eaf2a2-948b-4434-8065-9b39067bf6ce'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:57.674284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-14eaf2a2-948b-4434-8065-9b39067bf6ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd53cd3ceb4fb412e917276a06b82da88', 'request_id': 'req-14eaf2a2-948b-4434-8065-9b39067bf6ce'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:57.683678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-14eaf2a2-948b-4434-8065-9b39067bf6ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd53cd3ceb4fb412e917276a06b82da88', 'request_id': 'req-14eaf2a2-948b-4434-8065-9b39067bf6ce'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:57.760644 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-14eaf2a2-948b-4434-8065-9b39067bf6ce admin admin] The token cache is being invalidate because project d53cd3ceb4fb412e917276a06b82da88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:24:57.761317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-14eaf2a2-948b-4434-8065-9b39067bf6ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:57.762100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-14eaf2a2-948b-4434-8065-9b39067bf6ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:57.763706 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1200/2376] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:24:57 2022] DELETE /identity/v3/projects/d53cd3ceb4fb412e917276a06b82da88 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:24:57.768199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d0804-57a5-4057-8e68-fdcb207abb8b service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:57.778552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d0804-57a5-4057-8e68-fdcb207abb8b service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:57.837388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb169d-2cf2-4b3b-86d8-44f70b6af81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:57.838020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb169d-2cf2-4b3b-86d8-44f70b6af81f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:57.838358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb169d-2cf2-4b3b-86d8-44f70b6af81f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:57.838603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb169d-2cf2-4b3b-86d8-44f70b6af81f admin admin] PATH_INFO: `/v3/users/ad48391d27cd4ec094e09c6fec48e1d8` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:57.839769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb169d-2cf2-4b3b-86d8-44f70b6af81f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad48391d27cd4ec094e09c6fec48e1d8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:57.841697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb169d-2cf2-4b3b-86d8-44f70b6af81f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:58.075001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-37cb169d-2cf2-4b3b-86d8-44f70b6af81f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad48391d27cd4ec094e09c6fec48e1d8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:58.076477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-37cb169d-2cf2-4b3b-86d8-44f70b6af81f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad48391d27cd4ec094e09c6fec48e1d8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:58.085151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-37cb169d-2cf2-4b3b-86d8-44f70b6af81f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad48391d27cd4ec094e09c6fec48e1d8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:58.100702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-37cb169d-2cf2-4b3b-86d8-44f70b6af81f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad48391d27cd4ec094e09c6fec48e1d8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:58.182919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-37cb169d-2cf2-4b3b-86d8-44f70b6af81f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad48391d27cd4ec094e09c6fec48e1d8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:58.209428 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1177/2377] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:24:57 2022] DELETE /identity/v3/users/ad48391d27cd4ec094e09c6fec48e1d8 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:24:58.576443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:58.968131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eaf2a2-948b-4434-8065-9b39067bf6ce admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:58.976772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-14eaf2a2-948b-4434-8065-9b39067bf6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:58.994172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eaf2a2-948b-4434-8065-9b39067bf6ce admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:59.052546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59528756-dc12-46ed-b592-118ddbdcbf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:59.053265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59528756-dc12-46ed-b592-118ddbdcbf5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:59.053546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59528756-dc12-46ed-b592-118ddbdcbf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:59.053819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59528756-dc12-46ed-b592-118ddbdcbf5b admin admin] PATH_INFO: `/v3/projects/70f9e2b381b5497292398a3d40175b03` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:59.054966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59528756-dc12-46ed-b592-118ddbdcbf5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f9e2b381b5497292398a3d40175b03)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:59.056863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59528756-dc12-46ed-b592-118ddbdcbf5b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:59.198285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-59528756-dc12-46ed-b592-118ddbdcbf5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f9e2b381b5497292398a3d40175b03', 'request_id': 'req-59528756-dc12-46ed-b592-118ddbdcbf5b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:59.207065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-59528756-dc12-46ed-b592-118ddbdcbf5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f9e2b381b5497292398a3d40175b03', 'request_id': 'req-59528756-dc12-46ed-b592-118ddbdcbf5b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:59.216920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-59528756-dc12-46ed-b592-118ddbdcbf5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f9e2b381b5497292398a3d40175b03', 'request_id': 'req-59528756-dc12-46ed-b592-118ddbdcbf5b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:59.367238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-59528756-dc12-46ed-b592-118ddbdcbf5b admin admin] The token cache is being invalidate because project 70f9e2b381b5497292398a3d40175b03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:24:59.367714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-59528756-dc12-46ed-b592-118ddbdcbf5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:59.368581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-59528756-dc12-46ed-b592-118ddbdcbf5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:24:59.370417 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1201/2378] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:24:58 2022] DELETE /identity/v3/projects/70f9e2b381b5497292398a3d40175b03 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:24:59.376421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b70704-8f40-4736-9dc9-871ce2b3af1d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:59.378065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b70704-8f40-4736-9dc9-871ce2b3af1d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:59.378738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b70704-8f40-4736-9dc9-871ce2b3af1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:59.405277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-25b70704-8f40-4736-9dc9-871ce2b3af1d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:59.407462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-25b70704-8f40-4736-9dc9-871ce2b3af1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:59.577213 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1178/2379] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:24:59.587708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdc579-af0a-4712-a7ad-0e2d1ebcb01e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:59.588416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdc579-af0a-4712-a7ad-0e2d1ebcb01e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:59.590302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdc579-af0a-4712-a7ad-0e2d1ebcb01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:59.635725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-90cdc579-af0a-4712-a7ad-0e2d1ebcb01e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:24:59.637356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-90cdc579-af0a-4712-a7ad-0e2d1ebcb01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:24:59.663777 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1202/2380] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:24:59.668256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b70704-8f40-4736-9dc9-871ce2b3af1d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:59.685977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b70704-8f40-4736-9dc9-871ce2b3af1d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:59.697937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba835a-f76f-417f-9b54-3d2bb6f898c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:59.698797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba835a-f76f-417f-9b54-3d2bb6f898c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:59.699863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba835a-f76f-417f-9b54-3d2bb6f898c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:59.700307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba835a-f76f-417f-9b54-3d2bb6f898c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:59.701303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba835a-f76f-417f-9b54-3d2bb6f898c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:24:59.701847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba835a-f76f-417f-9b54-3d2bb6f898c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:59.707731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba835a-f76f-417f-9b54-3d2bb6f898c1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:59.759823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:59.779381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdc579-af0a-4712-a7ad-0e2d1ebcb01e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:24:59.779724 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1179/2381] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:24:59.783563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdc579-af0a-4712-a7ad-0e2d1ebcb01e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:24:59.793870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d6911-09d4-4a1b-89cc-5983241b96ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:24:59.794779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d6911-09d4-4a1b-89cc-5983241b96ed admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:24:59.795068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d6911-09d4-4a1b-89cc-5983241b96ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:24:59.802602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d6911-09d4-4a1b-89cc-5983241b96ed admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:24:59.802602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d6911-09d4-4a1b-89cc-5983241b96ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:24:59.802602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d6911-09d4-4a1b-89cc-5983241b96ed admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:24:59.982781 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1203/2382] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:24:59 2022] POST /identity/v3/projects => generated 385 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:24:59.985289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba835a-f76f-417f-9b54-3d2bb6f898c1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:00.002329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba835a-f76f-417f-9b54-3d2bb6f898c1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:00.111582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6d4d6-f6c3-4dfe-9fff-7dabfb4b2803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:00.112678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6d4d6-f6c3-4dfe-9fff-7dabfb4b2803 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:00.114281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6d4d6-f6c3-4dfe-9fff-7dabfb4b2803 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:00.115048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6d4d6-f6c3-4dfe-9fff-7dabfb4b2803 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:00.115799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6d4d6-f6c3-4dfe-9fff-7dabfb4b2803 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:00.118398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6d4d6-f6c3-4dfe-9fff-7dabfb4b2803 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:00.230561 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1180/2383] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:24:59 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:25:00.234506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d6911-09d4-4a1b-89cc-5983241b96ed admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:00.249608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d6911-09d4-4a1b-89cc-5983241b96ed admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:00.266559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bb821-51d9-49c8-9018-eedd722522d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:00.267183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bb821-51d9-49c8-9018-eedd722522d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:00.268081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bb821-51d9-49c8-9018-eedd722522d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:00.268425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bb821-51d9-49c8-9018-eedd722522d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:00.269319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bb821-51d9-49c8-9018-eedd722522d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:00.278807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bb821-51d9-49c8-9018-eedd722522d4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:00.315964 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1204/2384] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:25:00.317338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6d4d6-f6c3-4dfe-9fff-7dabfb4b2803 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:00.329411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6d4d6-f6c3-4dfe-9fff-7dabfb4b2803 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:00.337584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bc735-82f7-4b46-80ae-c845620ea670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:00.338286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bc735-82f7-4b46-80ae-c845620ea670 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:00.338572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bc735-82f7-4b46-80ae-c845620ea670 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:00.338846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bc735-82f7-4b46-80ae-c845620ea670 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:00.339516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bc735-82f7-4b46-80ae-c845620ea670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:00.346424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bc735-82f7-4b46-80ae-c845620ea670 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:00.366073 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1181/2385] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:25:00.370253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bb821-51d9-49c8-9018-eedd722522d4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:00.424672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bb821-51d9-49c8-9018-eedd722522d4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:00.434709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e74898-4cd2-4e88-80f7-b74638e0bbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:00.438878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e74898-4cd2-4e88-80f7-b74638e0bbdb admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:00.438878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e74898-4cd2-4e88-80f7-b74638e0bbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:00.438878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e74898-4cd2-4e88-80f7-b74638e0bbdb admin admin] PATH_INFO: `/v3/projects/59c57f8e9a0e4debae18d98918ba8c2f/users/c65ddc0af5854d7a89192d01bc5f4576/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:00.461493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e74898-4cd2-4e88-80f7-b74638e0bbdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c57f8e9a0e4debae18d98918ba8c2f, user_id=c65ddc0af5854d7a89192d01bc5f4576, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:00.464513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e74898-4cd2-4e88-80f7-b74638e0bbdb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:00.603127 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1205/2386] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:25:00 2022] PUT /identity/v3/projects/59c57f8e9a0e4debae18d98918ba8c2f/users/c65ddc0af5854d7a89192d01bc5f4576/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:25:00.604665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1228c-cb90-4739-8494-9b7c2e2dd0c5 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:00.605111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1228c-cb90-4739-8494-9b7c2e2dd0c5 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:00.605328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1228c-cb90-4739-8494-9b7c2e2dd0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:00.632122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-40e1228c-cb90-4739-8494-9b7c2e2dd0c5 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:25:00.633885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-40e1228c-cb90-4739-8494-9b7c2e2dd0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:00.727022 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1182/2387] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:25:00.758624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:00.769488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e74898-4cd2-4e88-80f7-b74638e0bbdb admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:00.772160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c6e74898-4cd2-4e88-80f7-b74638e0bbdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:00.841034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e74898-4cd2-4e88-80f7-b74638e0bbdb admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:00.844969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf15944-3d1f-4f5a-bbde-1dc8bb8379cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:00.845994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf15944-3d1f-4f5a-bbde-1dc8bb8379cb service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:00.846338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf15944-3d1f-4f5a-bbde-1dc8bb8379cb service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:00.846618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf15944-3d1f-4f5a-bbde-1dc8bb8379cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:00.857434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf15944-3d1f-4f5a-bbde-1dc8bb8379cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:00.859656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf15944-3d1f-4f5a-bbde-1dc8bb8379cb service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:00.907778 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1206/2388] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:25:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:25:01.925251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:03.315627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:10.638020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f8421-dd3d-4b58-96d8-75d14f08fa91 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:10.639555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f8421-dd3d-4b58-96d8-75d14f08fa91 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:10.643102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f8421-dd3d-4b58-96d8-75d14f08fa91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:10.712157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-442f8421-dd3d-4b58-96d8-75d14f08fa91 None None] MFA Rules not processed for user `c65ddc0af5854d7a89192d01bc5f4576`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:25:10.713455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-442f8421-dd3d-4b58-96d8-75d14f08fa91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:10.758333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:10.814132 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1183/2389] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:25:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:25:10.824276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf15944-3d1f-4f5a-bbde-1dc8bb8379cb service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:10.840951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf15944-3d1f-4f5a-bbde-1dc8bb8379cb service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:10.847083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ad84a-442f-45fc-adf8-f7e1e772cf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:10.847996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ad84a-442f-45fc-adf8-f7e1e772cf22 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:10.848428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ad84a-442f-45fc-adf8-f7e1e772cf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:10.848873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ad84a-442f-45fc-adf8-f7e1e772cf22 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:10.849671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ad84a-442f-45fc-adf8-f7e1e772cf22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:10.852398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ad84a-442f-45fc-adf8-f7e1e772cf22 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:10.958082 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1207/2390] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:25:10 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:25:10.961697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f8421-dd3d-4b58-96d8-75d14f08fa91 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:10.991262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f8421-dd3d-4b58-96d8-75d14f08fa91 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:11.095025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100b437-005f-4966-9f0a-beec30a7ded2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:11.095025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100b437-005f-4966-9f0a-beec30a7ded2 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:11.095025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100b437-005f-4966-9f0a-beec30a7ded2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:11.096475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100b437-005f-4966-9f0a-beec30a7ded2 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:11.096983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100b437-005f-4966-9f0a-beec30a7ded2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:11.103451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100b437-005f-4966-9f0a-beec30a7ded2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:11.200147 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1184/2391] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:25:10 2022] POST /identity/v3/users => generated 298 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:25:11.201494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ad84a-442f-45fc-adf8-f7e1e772cf22 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:11.220797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ad84a-442f-45fc-adf8-f7e1e772cf22 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:11.228015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65abbd4-f1e2-432a-baaa-1053f2cb7ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:11.228745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65abbd4-f1e2-432a-baaa-1053f2cb7ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:11.229251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65abbd4-f1e2-432a-baaa-1053f2cb7ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:11.229616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65abbd4-f1e2-432a-baaa-1053f2cb7ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:11.230446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65abbd4-f1e2-432a-baaa-1053f2cb7ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:11.232176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65abbd4-f1e2-432a-baaa-1053f2cb7ca5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:11.245610 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1208/2392] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:25:11.250684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100b437-005f-4966-9f0a-beec30a7ded2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:11.264540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100b437-005f-4966-9f0a-beec30a7ded2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:11.272630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b3690-8d89-4a84-883e-cb7528bd9e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:11.273767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b3690-8d89-4a84-883e-cb7528bd9e4b admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:11.274421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b3690-8d89-4a84-883e-cb7528bd9e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:11.275578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b3690-8d89-4a84-883e-cb7528bd9e4b admin admin] PATH_INFO: `/v3/projects/dca70d6b18304d5ebb73579d68dbfb76/users/eb3831e6ce63489c8315e932634ead86/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:11.324047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b3690-8d89-4a84-883e-cb7528bd9e4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dca70d6b18304d5ebb73579d68dbfb76, user_id=eb3831e6ce63489c8315e932634ead86, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:11.328348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b3690-8d89-4a84-883e-cb7528bd9e4b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:11.374102 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1185/2393] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:25:11 2022] PUT /identity/v3/projects/dca70d6b18304d5ebb73579d68dbfb76/users/eb3831e6ce63489c8315e932634ead86/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:25:11.380504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65abbd4-f1e2-432a-baaa-1053f2cb7ca5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:11.397427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65abbd4-f1e2-432a-baaa-1053f2cb7ca5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:11.495271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6aab3-25ab-437f-a20d-24eab076c673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:11.497431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6aab3-25ab-437f-a20d-24eab076c673 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:11.497431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6aab3-25ab-437f-a20d-24eab076c673 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:11.497431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6aab3-25ab-437f-a20d-24eab076c673 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:11.497805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6aab3-25ab-437f-a20d-24eab076c673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:11.511092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6aab3-25ab-437f-a20d-24eab076c673 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:11.559829 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1209/2394] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:25:11.565174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b3690-8d89-4a84-883e-cb7528bd9e4b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:11.588950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b3690-8d89-4a84-883e-cb7528bd9e4b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:11.602339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4be41-f991-4941-9b52-66de2492790e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:11.605202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4be41-f991-4941-9b52-66de2492790e admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:11.605495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4be41-f991-4941-9b52-66de2492790e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:11.605783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4be41-f991-4941-9b52-66de2492790e admin admin] PATH_INFO: `/v3/projects/dca70d6b18304d5ebb73579d68dbfb76/users/eb3831e6ce63489c8315e932634ead86/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:11.608005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4be41-f991-4941-9b52-66de2492790e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dca70d6b18304d5ebb73579d68dbfb76, user_id=eb3831e6ce63489c8315e932634ead86, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:11.610749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4be41-f991-4941-9b52-66de2492790e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:11.650849 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1186/2395] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:25:11 2022] PUT /identity/v3/projects/dca70d6b18304d5ebb73579d68dbfb76/users/eb3831e6ce63489c8315e932634ead86/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:25:21.535646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=76,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:21.641254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=56,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:23.653278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03132f4-7331-4d53-9d54-0f9eaeff0be2 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:23.657187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03132f4-7331-4d53-9d54-0f9eaeff0be2 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:23.657760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03132f4-7331-4d53-9d54-0f9eaeff0be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:23.743900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a03132f4-7331-4d53-9d54-0f9eaeff0be2 None None] MFA Rules not processed for user `eb3831e6ce63489c8315e932634ead86`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:25:23.745252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a03132f4-7331-4d53-9d54-0f9eaeff0be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:23.928785 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1210/2396] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:25:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:25:24.321864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4be41-f991-4941-9b52-66de2492790e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:24.323724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bca4be41-f991-4941-9b52-66de2492790e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:24.449998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4be41-f991-4941-9b52-66de2492790e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:24.457288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6674f3f-9783-4e2b-a082-4bc77e8c4ecf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:24.458066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6674f3f-9783-4e2b-a082-4bc77e8c4ecf service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:24.458453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6674f3f-9783-4e2b-a082-4bc77e8c4ecf service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:24.459014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6674f3f-9783-4e2b-a082-4bc77e8c4ecf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:24.571658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6674f3f-9783-4e2b-a082-4bc77e8c4ecf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:24.573646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6674f3f-9783-4e2b-a082-4bc77e8c4ecf service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:24.595769 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1187/2397] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:25:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:25:25.693487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03132f4-7331-4d53-9d54-0f9eaeff0be2 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:25.752029 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03132f4-7331-4d53-9d54-0f9eaeff0be2 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:25.769463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0e956-972a-4ce9-95d0-b3c9eeabbb72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:25.783200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0e956-972a-4ce9-95d0-b3c9eeabbb72 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:25.783833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0e956-972a-4ce9-95d0-b3c9eeabbb72 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:25.784612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0e956-972a-4ce9-95d0-b3c9eeabbb72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:25.786724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-11e0e956-972a-4ce9-95d0-b3c9eeabbb72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:25.881581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0e956-972a-4ce9-95d0-b3c9eeabbb72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:25.883589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0e956-972a-4ce9-95d0-b3c9eeabbb72 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:25.894920 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1211/2398] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:25:25 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:25:25.935819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f4c99-17b8-4cfb-865e-4d9a0d83c447 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:25.936386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f4c99-17b8-4cfb-865e-4d9a0d83c447 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:25.936499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f4c99-17b8-4cfb-865e-4d9a0d83c447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:25.958001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8e7f4c99-17b8-4cfb-865e-4d9a0d83c447 None None] MFA Rules not processed for user `2ccd5909fb214f71ad68704019c9e4f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:25:25.959586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8e7f4c99-17b8-4cfb-865e-4d9a0d83c447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:26.047184 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1188/2399] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:25:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:25:26.927463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a90dee-6241-406c-8c11-4f7c679cad14 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:26.928142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a90dee-6241-406c-8c11-4f7c679cad14 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:26.928554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a90dee-6241-406c-8c11-4f7c679cad14 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:26.931949 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1212/2400] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 27 03:25:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:25:26.959350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457398b9-13bf-466b-a3e3-7bf0b775a41a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:26.960493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457398b9-13bf-466b-a3e3-7bf0b775a41a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:26.961441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457398b9-13bf-466b-a3e3-7bf0b775a41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:26.984412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-457398b9-13bf-466b-a3e3-7bf0b775a41a None None] MFA Rules not processed for user `1a395d2414cd4da085a77ddc9b1f1caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:25:26.985641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-457398b9-13bf-466b-a3e3-7bf0b775a41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:27.027516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:27.051518 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1189/2401] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 03:25:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:25:27.062428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a90dee-6241-406c-8c11-4f7c679cad14 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:27.064182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d8a90dee-6241-406c-8c11-4f7c679cad14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:27.082591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a90dee-6241-406c-8c11-4f7c679cad14 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:27.087727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806402d-597d-406b-9989-9764beacfc6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:27.088368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806402d-597d-406b-9989-9764beacfc6f service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:27.088668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806402d-597d-406b-9989-9764beacfc6f service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:27.088985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806402d-597d-406b-9989-9764beacfc6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:27.098110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806402d-597d-406b-9989-9764beacfc6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:27.099677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806402d-597d-406b-9989-9764beacfc6f service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:27.113456 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1213/2402] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:25:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:25:29.070210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6c02a-e15f-49df-a95a-3023b7ce4f01 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:29.070952 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6c02a-e15f-49df-a95a-3023b7ce4f01 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:29.070952 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6c02a-e15f-49df-a95a-3023b7ce4f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:29.106380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c4b6c02a-e15f-49df-a95a-3023b7ce4f01 None None] MFA Rules not processed for user `c65ddc0af5854d7a89192d01bc5f4576`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:25:29.107647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c4b6c02a-e15f-49df-a95a-3023b7ce4f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:29.116085 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1190/2403] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:25:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:25:33.359577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806402d-597d-406b-9989-9764beacfc6f service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:33.361586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4806402d-597d-406b-9989-9764beacfc6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:33.451582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806402d-597d-406b-9989-9764beacfc6f service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:33.458579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326d44a-e0e2-4726-aa76-78e3d48b3b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:33.460024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326d44a-e0e2-4726-aa76-78e3d48b3b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:33.460024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326d44a-e0e2-4726-aa76-78e3d48b3b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:33.460416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326d44a-e0e2-4726-aa76-78e3d48b3b98 admin admin] PATH_INFO: `/v3/users/91d1351fcb6b4cd08f176e6d0cc5bb11` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:33.461832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326d44a-e0e2-4726-aa76-78e3d48b3b98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91d1351fcb6b4cd08f176e6d0cc5bb11)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:33.464220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326d44a-e0e2-4726-aa76-78e3d48b3b98 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:33.472074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:33.701706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a326d44a-e0e2-4726-aa76-78e3d48b3b98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91d1351fcb6b4cd08f176e6d0cc5bb11'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:33.704867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a326d44a-e0e2-4726-aa76-78e3d48b3b98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91d1351fcb6b4cd08f176e6d0cc5bb11'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:33.716535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a326d44a-e0e2-4726-aa76-78e3d48b3b98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91d1351fcb6b4cd08f176e6d0cc5bb11'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:33.738335 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a326d44a-e0e2-4726-aa76-78e3d48b3b98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91d1351fcb6b4cd08f176e6d0cc5bb11'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:33.739851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a326d44a-e0e2-4726-aa76-78e3d48b3b98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91d1351fcb6b4cd08f176e6d0cc5bb11'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:33.840790 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1214/2404] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:25:33 2022] DELETE /identity/v3/users/91d1351fcb6b4cd08f176e6d0cc5bb11 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:25:33.843439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3006d6-1274-488f-a83e-bd851fc70f85 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:33.843439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3006d6-1274-488f-a83e-bd851fc70f85 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:33.843907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3006d6-1274-488f-a83e-bd851fc70f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:33.867241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6f3006d6-1274-488f-a83e-bd851fc70f85 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:25:33.868507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6f3006d6-1274-488f-a83e-bd851fc70f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:33.897522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326d44a-e0e2-4726-aa76-78e3d48b3b98 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:33.900332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a326d44a-e0e2-4726-aa76-78e3d48b3b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:33.979750 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1191/2405] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:25:33.990362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3006d6-1274-488f-a83e-bd851fc70f85 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:33.993182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6f3006d6-1274-488f-a83e-bd851fc70f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:34.008877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326d44a-e0e2-4726-aa76-78e3d48b3b98 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:34.014249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54fc71-cf6e-49e1-bd54-b7cafafa3a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:34.015313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54fc71-cf6e-49e1-bd54-b7cafafa3a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:34.015597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54fc71-cf6e-49e1-bd54-b7cafafa3a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:34.015875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54fc71-cf6e-49e1-bd54-b7cafafa3a36 admin admin] PATH_INFO: `/v3/users/2e23378ed283426cbff623265d9bbc96` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:34.017454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54fc71-cf6e-49e1-bd54-b7cafafa3a36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e23378ed283426cbff623265d9bbc96)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:34.020674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54fc71-cf6e-49e1-bd54-b7cafafa3a36 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:34.067663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3006d6-1274-488f-a83e-bd851fc70f85 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:34.071997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65dc71-e8b7-4c9a-9c5e-c87e4d9788fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:34.077481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65dc71-e8b7-4c9a-9c5e-c87e4d9788fe service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:34.077481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65dc71-e8b7-4c9a-9c5e-c87e4d9788fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:34.077481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65dc71-e8b7-4c9a-9c5e-c87e4d9788fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:34.083347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65dc71-e8b7-4c9a-9c5e-c87e4d9788fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:34.084818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65dc71-e8b7-4c9a-9c5e-c87e4d9788fe service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:34.100296 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1192/2406] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:25:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:25:34.245624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2f54fc71-cf6e-49e1-bd54-b7cafafa3a36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e23378ed283426cbff623265d9bbc96'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:34.247298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2f54fc71-cf6e-49e1-bd54-b7cafafa3a36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e23378ed283426cbff623265d9bbc96'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:34.261242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2f54fc71-cf6e-49e1-bd54-b7cafafa3a36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e23378ed283426cbff623265d9bbc96'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:34.282057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2f54fc71-cf6e-49e1-bd54-b7cafafa3a36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e23378ed283426cbff623265d9bbc96'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:34.283846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2f54fc71-cf6e-49e1-bd54-b7cafafa3a36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e23378ed283426cbff623265d9bbc96'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:34.357483 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1215/2407] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:25:33 2022] DELETE /identity/v3/users/2e23378ed283426cbff623265d9bbc96 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:25:34.372906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65dc71-e8b7-4c9a-9c5e-c87e4d9788fe service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:34.374705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fe65dc71-e8b7-4c9a-9c5e-c87e4d9788fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:34.394002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65dc71-e8b7-4c9a-9c5e-c87e4d9788fe service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:34.468402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781bc71-3aa7-4c6b-ac4b-218d83f9b511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:34.469320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781bc71-3aa7-4c6b-ac4b-218d83f9b511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:34.469678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781bc71-3aa7-4c6b-ac4b-218d83f9b511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:34.470023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781bc71-3aa7-4c6b-ac4b-218d83f9b511 admin admin] PATH_INFO: `/v3/projects/b95729a8c8a14361b7cbf8b2b13900b2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:34.471622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781bc71-3aa7-4c6b-ac4b-218d83f9b511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b95729a8c8a14361b7cbf8b2b13900b2)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:34.476567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781bc71-3aa7-4c6b-ac4b-218d83f9b511 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:34.501450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:34.618892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d781bc71-3aa7-4c6b-ac4b-218d83f9b511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b95729a8c8a14361b7cbf8b2b13900b2', 'request_id': 'req-d781bc71-3aa7-4c6b-ac4b-218d83f9b511'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:34.685862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d781bc71-3aa7-4c6b-ac4b-218d83f9b511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b95729a8c8a14361b7cbf8b2b13900b2', 'request_id': 'req-d781bc71-3aa7-4c6b-ac4b-218d83f9b511'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:34.693642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d781bc71-3aa7-4c6b-ac4b-218d83f9b511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b95729a8c8a14361b7cbf8b2b13900b2', 'request_id': 'req-d781bc71-3aa7-4c6b-ac4b-218d83f9b511'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:34.705650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d781bc71-3aa7-4c6b-ac4b-218d83f9b511 admin admin] The token cache is being invalidate because project b95729a8c8a14361b7cbf8b2b13900b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:25:34.705948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d781bc71-3aa7-4c6b-ac4b-218d83f9b511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:34.706684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d781bc71-3aa7-4c6b-ac4b-218d83f9b511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:34.708184 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1193/2408] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:34 2022] DELETE /identity/v3/projects/b95729a8c8a14361b7cbf8b2b13900b2 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:25:34.712325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54fc71-cf6e-49e1-bd54-b7cafafa3a36 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:34.713911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2f54fc71-cf6e-49e1-bd54-b7cafafa3a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:34.724270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:34.730711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54fc71-cf6e-49e1-bd54-b7cafafa3a36 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:34.759770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781bc71-3aa7-4c6b-ac4b-218d83f9b511 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:34.761943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d781bc71-3aa7-4c6b-ac4b-218d83f9b511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:34.816066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ed8fa-12cc-4ed4-82a1-db1e48e3826b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:34.821559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ed8fa-12cc-4ed4-82a1-db1e48e3826b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:34.821559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ed8fa-12cc-4ed4-82a1-db1e48e3826b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:34.821559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ed8fa-12cc-4ed4-82a1-db1e48e3826b admin admin] PATH_INFO: `/v3/users/2ee077a3c9884bd9a2425514e67a5cf2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:34.821559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ed8fa-12cc-4ed4-82a1-db1e48e3826b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ee077a3c9884bd9a2425514e67a5cf2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:34.823357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ed8fa-12cc-4ed4-82a1-db1e48e3826b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:34.866144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781bc71-3aa7-4c6b-ac4b-218d83f9b511 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:34.871187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a8b62-4228-4f18-8289-b13d2243a384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:34.871919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a8b62-4228-4f18-8289-b13d2243a384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:34.872467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a8b62-4228-4f18-8289-b13d2243a384 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:34.872951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a8b62-4228-4f18-8289-b13d2243a384 admin admin] PATH_INFO: `/v3/projects/39f033d34ad44397bfda5cba4c041071` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:34.874465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a8b62-4228-4f18-8289-b13d2243a384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39f033d34ad44397bfda5cba4c041071)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:34.876647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a8b62-4228-4f18-8289-b13d2243a384 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:35.024197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0f0a8b62-4228-4f18-8289-b13d2243a384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39f033d34ad44397bfda5cba4c041071', 'request_id': 'req-0f0a8b62-4228-4f18-8289-b13d2243a384'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:35.025216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b91ed8fa-12cc-4ed4-82a1-db1e48e3826b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ee077a3c9884bd9a2425514e67a5cf2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:35.026140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b91ed8fa-12cc-4ed4-82a1-db1e48e3826b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ee077a3c9884bd9a2425514e67a5cf2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:35.034646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b91ed8fa-12cc-4ed4-82a1-db1e48e3826b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ee077a3c9884bd9a2425514e67a5cf2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:35.046548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b91ed8fa-12cc-4ed4-82a1-db1e48e3826b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ee077a3c9884bd9a2425514e67a5cf2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:35.047276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b91ed8fa-12cc-4ed4-82a1-db1e48e3826b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ee077a3c9884bd9a2425514e67a5cf2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:35.069200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0f0a8b62-4228-4f18-8289-b13d2243a384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39f033d34ad44397bfda5cba4c041071', 'request_id': 'req-0f0a8b62-4228-4f18-8289-b13d2243a384'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:35.076152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0f0a8b62-4228-4f18-8289-b13d2243a384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39f033d34ad44397bfda5cba4c041071', 'request_id': 'req-0f0a8b62-4228-4f18-8289-b13d2243a384'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:35.087141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0f0a8b62-4228-4f18-8289-b13d2243a384 admin admin] The token cache is being invalidate because project 39f033d34ad44397bfda5cba4c041071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:25:35.087424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0f0a8b62-4228-4f18-8289-b13d2243a384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:35.088101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0f0a8b62-4228-4f18-8289-b13d2243a384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:35.089605 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1194/2409] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:34 2022] DELETE /identity/v3/projects/39f033d34ad44397bfda5cba4c041071 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:25:35.093619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a8b62-4228-4f18-8289-b13d2243a384 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:35.095004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0f0a8b62-4228-4f18-8289-b13d2243a384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:35.142144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:35.149570 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1216/2410] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:25:34 2022] DELETE /identity/v3/users/2ee077a3c9884bd9a2425514e67a5cf2 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:25:35.171405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a8b62-4228-4f18-8289-b13d2243a384 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:35.245887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692ca4d-579f-4741-8106-a5b044f41549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:35.246728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692ca4d-579f-4741-8106-a5b044f41549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:35.247016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692ca4d-579f-4741-8106-a5b044f41549 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:35.247300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692ca4d-579f-4741-8106-a5b044f41549 admin admin] PATH_INFO: `/v3/users/ac4a306da0e940a99b3155ce3d7b2d58` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:35.248440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692ca4d-579f-4741-8106-a5b044f41549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac4a306da0e940a99b3155ce3d7b2d58)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:35.250567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692ca4d-579f-4741-8106-a5b044f41549 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:35.441203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9692ca4d-579f-4741-8106-a5b044f41549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac4a306da0e940a99b3155ce3d7b2d58'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:35.442019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9692ca4d-579f-4741-8106-a5b044f41549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac4a306da0e940a99b3155ce3d7b2d58'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:35.469839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9692ca4d-579f-4741-8106-a5b044f41549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac4a306da0e940a99b3155ce3d7b2d58'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:35.488700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9692ca4d-579f-4741-8106-a5b044f41549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac4a306da0e940a99b3155ce3d7b2d58'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:35.491559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ed8fa-12cc-4ed4-82a1-db1e48e3826b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:35.493282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b91ed8fa-12cc-4ed4-82a1-db1e48e3826b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:35.508377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ed8fa-12cc-4ed4-82a1-db1e48e3826b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:35.525504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94788b-daf5-41d1-89b5-3712dc817261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:35.526469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94788b-daf5-41d1-89b5-3712dc817261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:35.526762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94788b-daf5-41d1-89b5-3712dc817261 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:35.527195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94788b-daf5-41d1-89b5-3712dc817261 admin admin] PATH_INFO: `/v3/projects/55e16dad037842a4aea9f4516cc36775` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:35.535102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94788b-daf5-41d1-89b5-3712dc817261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55e16dad037842a4aea9f4516cc36775)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:35.539627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94788b-daf5-41d1-89b5-3712dc817261 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:35.571730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9692ca4d-579f-4741-8106-a5b044f41549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac4a306da0e940a99b3155ce3d7b2d58'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:35.583870 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1195/2411] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:25:35 2022] DELETE /identity/v3/users/ac4a306da0e940a99b3155ce3d7b2d58 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:25:35.695269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-db94788b-daf5-41d1-89b5-3712dc817261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55e16dad037842a4aea9f4516cc36775', 'request_id': 'req-db94788b-daf5-41d1-89b5-3712dc817261'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:35.704308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-db94788b-daf5-41d1-89b5-3712dc817261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55e16dad037842a4aea9f4516cc36775', 'request_id': 'req-db94788b-daf5-41d1-89b5-3712dc817261'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:35.712832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-db94788b-daf5-41d1-89b5-3712dc817261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55e16dad037842a4aea9f4516cc36775', 'request_id': 'req-db94788b-daf5-41d1-89b5-3712dc817261'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:35.817901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-db94788b-daf5-41d1-89b5-3712dc817261 admin admin] The token cache is being invalidate because project 55e16dad037842a4aea9f4516cc36775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:25:35.818519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-db94788b-daf5-41d1-89b5-3712dc817261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:35.819434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-db94788b-daf5-41d1-89b5-3712dc817261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:35.821396 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1217/2412] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:35 2022] DELETE /identity/v3/projects/55e16dad037842a4aea9f4516cc36775 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:25:35.834826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e71e83-3f31-415d-80d9-0190a4fe40c6 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:35.835111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e71e83-3f31-415d-80d9-0190a4fe40c6 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:35.835388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e71e83-3f31-415d-80d9-0190a4fe40c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:35.862761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-81e71e83-3f31-415d-80d9-0190a4fe40c6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:25:35.864158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-81e71e83-3f31-415d-80d9-0190a4fe40c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:35.932000 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1196/2413] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:25:35.940233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115df79-80b5-4388-a4f7-92ca8ea44674 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:35.941090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115df79-80b5-4388-a4f7-92ca8ea44674 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:35.941582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115df79-80b5-4388-a4f7-92ca8ea44674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:35.957374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:35.962703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e71e83-3f31-415d-80d9-0190a4fe40c6 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:35.964482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-81e71e83-3f31-415d-80d9-0190a4fe40c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:35.966421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d115df79-80b5-4388-a4f7-92ca8ea44674 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:25:35.968057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d115df79-80b5-4388-a4f7-92ca8ea44674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:35.991634 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1218/2414] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:25:35.999139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e71e83-3f31-415d-80d9-0190a4fe40c6 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:36.003760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115df79-80b5-4388-a4f7-92ca8ea44674 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:36.013058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e48c6-d439-4b14-be0c-0349673e1322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:36.014581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e48c6-d439-4b14-be0c-0349673e1322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:36.014697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115df79-80b5-4388-a4f7-92ca8ea44674 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:36.014834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e48c6-d439-4b14-be0c-0349673e1322 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:36.014834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e48c6-d439-4b14-be0c-0349673e1322 admin admin] PATH_INFO: `/v3/projects/9ec63e1dd41442f48d270aea6a917ff7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:36.016158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e48c6-d439-4b14-be0c-0349673e1322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ec63e1dd41442f48d270aea6a917ff7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:36.019511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e48c6-d439-4b14-be0c-0349673e1322 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:36.020661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e38a2-023f-4c51-856d-d2124d61c43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:36.021261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e38a2-023f-4c51-856d-d2124d61c43b admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:36.021877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e38a2-023f-4c51-856d-d2124d61c43b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:36.021877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e38a2-023f-4c51-856d-d2124d61c43b admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:36.022501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e38a2-023f-4c51-856d-d2124d61c43b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:25:36.022807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e38a2-023f-4c51-856d-d2124d61c43b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:36.024694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e38a2-023f-4c51-856d-d2124d61c43b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:36.041044 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1219/2415] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:25:36.042376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e38a2-023f-4c51-856d-d2124d61c43b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:36.053057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e38a2-023f-4c51-856d-d2124d61c43b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:36.058418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f77d4-ac56-4715-86ca-c191fbdc6680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:36.059284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f77d4-ac56-4715-86ca-c191fbdc6680 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:36.059569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f77d4-ac56-4715-86ca-c191fbdc6680 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:36.072140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f77d4-ac56-4715-86ca-c191fbdc6680 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:36.072140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f77d4-ac56-4715-86ca-c191fbdc6680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:36.072140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f77d4-ac56-4715-86ca-c191fbdc6680 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:36.162478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-774e48c6-d439-4b14-be0c-0349673e1322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ec63e1dd41442f48d270aea6a917ff7', 'request_id': 'req-774e48c6-d439-4b14-be0c-0349673e1322'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:36.178131 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1220/2416] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:25:36 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:25:36.180140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f77d4-ac56-4715-86ca-c191fbdc6680 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:36.248275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f77d4-ac56-4715-86ca-c191fbdc6680 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:36.253167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f013ae-2e7d-459b-841e-da676a15822e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:36.253789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f013ae-2e7d-459b-841e-da676a15822e admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:36.254100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f013ae-2e7d-459b-841e-da676a15822e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:36.254532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f013ae-2e7d-459b-841e-da676a15822e admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:36.255172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f013ae-2e7d-459b-841e-da676a15822e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:36.257132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f013ae-2e7d-459b-841e-da676a15822e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:36.270368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:36.303312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-774e48c6-d439-4b14-be0c-0349673e1322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ec63e1dd41442f48d270aea6a917ff7', 'request_id': 'req-774e48c6-d439-4b14-be0c-0349673e1322'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:36.310321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-774e48c6-d439-4b14-be0c-0349673e1322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ec63e1dd41442f48d270aea6a917ff7', 'request_id': 'req-774e48c6-d439-4b14-be0c-0349673e1322'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:36.323164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-774e48c6-d439-4b14-be0c-0349673e1322 admin admin] The token cache is being invalidate because project 9ec63e1dd41442f48d270aea6a917ff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:25:36.323469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-774e48c6-d439-4b14-be0c-0349673e1322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:36.324750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-774e48c6-d439-4b14-be0c-0349673e1322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:36.326348 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1197/2417] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:35 2022] DELETE /identity/v3/projects/9ec63e1dd41442f48d270aea6a917ff7 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:25:36.331777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31795f6d-5e17-4b02-b0e0-c6e9a5013d7d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:36.333262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31795f6d-5e17-4b02-b0e0-c6e9a5013d7d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:36.333262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31795f6d-5e17-4b02-b0e0-c6e9a5013d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:36.352329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-31795f6d-5e17-4b02-b0e0-c6e9a5013d7d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:25:36.353588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-31795f6d-5e17-4b02-b0e0-c6e9a5013d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:36.358444 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1221/2418] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:25:36 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:25:36.359567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f013ae-2e7d-459b-841e-da676a15822e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:36.361210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-61f013ae-2e7d-459b-841e-da676a15822e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:36.362266 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1198/2419] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:25:36.369624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195eecc2-a11f-443f-98de-ba8c589196d0 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:36.369893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195eecc2-a11f-443f-98de-ba8c589196d0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:36.373445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195eecc2-a11f-443f-98de-ba8c589196d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:36.373763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f013ae-2e7d-459b-841e-da676a15822e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:36.379217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdbed3-1bbd-41ea-a15c-13d40efa6a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:36.379796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdbed3-1bbd-41ea-a15c-13d40efa6a50 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:36.380079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdbed3-1bbd-41ea-a15c-13d40efa6a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:36.380355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdbed3-1bbd-41ea-a15c-13d40efa6a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:36.381004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bdbed3-1bbd-41ea-a15c-13d40efa6a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:36.382622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bdbed3-1bbd-41ea-a15c-13d40efa6a50 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:36.390214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-195eecc2-a11f-443f-98de-ba8c589196d0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:25:36.391454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-195eecc2-a11f-443f-98de-ba8c589196d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:36.396092 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1222/2420] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:25:36.397073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdbed3-1bbd-41ea-a15c-13d40efa6a50 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:36.402320 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1199/2421] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:25:36.404053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195eecc2-a11f-443f-98de-ba8c589196d0 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:36.407300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdbed3-1bbd-41ea-a15c-13d40efa6a50 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:36.412373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114b7bf-0509-48f2-819d-e53d27a14b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:36.412971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114b7bf-0509-48f2-819d-e53d27a14b9b admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:36.413155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195eecc2-a11f-443f-98de-ba8c589196d0 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:36.413370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114b7bf-0509-48f2-819d-e53d27a14b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:36.413660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114b7bf-0509-48f2-819d-e53d27a14b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:36.414366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114b7bf-0509-48f2-819d-e53d27a14b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:36.415966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114b7bf-0509-48f2-819d-e53d27a14b9b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:36.418041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a976a8-c42c-463b-9141-28b9b06dd995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:36.418707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a976a8-c42c-463b-9141-28b9b06dd995 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:36.418986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a976a8-c42c-463b-9141-28b9b06dd995 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:36.419258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a976a8-c42c-463b-9141-28b9b06dd995 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:36.419902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a976a8-c42c-463b-9141-28b9b06dd995 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:25:36.420371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a976a8-c42c-463b-9141-28b9b06dd995 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:36.421966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a976a8-c42c-463b-9141-28b9b06dd995 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:36.427857 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1223/2422] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:25:36.435784 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1200/2423] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:25:36.439589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114b7bf-0509-48f2-819d-e53d27a14b9b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:36.444694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a976a8-c42c-463b-9141-28b9b06dd995 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:36.451175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114b7bf-0509-48f2-819d-e53d27a14b9b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:36.455077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a976a8-c42c-463b-9141-28b9b06dd995 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:36.457685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09effd-8901-4f65-8923-7ea77793ea45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:36.458384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09effd-8901-4f65-8923-7ea77793ea45 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:36.458669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09effd-8901-4f65-8923-7ea77793ea45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:36.458940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09effd-8901-4f65-8923-7ea77793ea45 admin admin] PATH_INFO: `/v3/projects/a2ee874d160a470b96e1d50fc1131f81/users/1245e7aa1c6a420fa7ebe0c098a6396a/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:36.461430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb6971-e2fc-4a34-9d5b-a1196f928222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:36.462935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb6971-e2fc-4a34-9d5b-a1196f928222 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:36.463305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb6971-e2fc-4a34-9d5b-a1196f928222 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:36.463657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb6971-e2fc-4a34-9d5b-a1196f928222 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:36.464501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb6971-e2fc-4a34-9d5b-a1196f928222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:36.466573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb6971-e2fc-4a34-9d5b-a1196f928222 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:36.478633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09effd-8901-4f65-8923-7ea77793ea45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ee874d160a470b96e1d50fc1131f81, user_id=1245e7aa1c6a420fa7ebe0c098a6396a, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:36.482284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09effd-8901-4f65-8923-7ea77793ea45 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:36.577524 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1224/2424] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:25:36 2022] PUT /identity/v3/projects/a2ee874d160a470b96e1d50fc1131f81/users/1245e7aa1c6a420fa7ebe0c098a6396a/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:25:36.583222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44234f2c-0cd0-4790-9eb0-6f36198f7851 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:36.583514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44234f2c-0cd0-4790-9eb0-6f36198f7851 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:36.583882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44234f2c-0cd0-4790-9eb0-6f36198f7851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:36.603114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-44234f2c-0cd0-4790-9eb0-6f36198f7851 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:25:36.604239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-44234f2c-0cd0-4790-9eb0-6f36198f7851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:36.622238 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1201/2425] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:25:36 2022] POST /identity/v3/projects => generated 403 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:25:36.625164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb6971-e2fc-4a34-9d5b-a1196f928222 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:36.669810 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1225/2426] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:25:36.680162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44234f2c-0cd0-4790-9eb0-6f36198f7851 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:36.685063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-44234f2c-0cd0-4790-9eb0-6f36198f7851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:36.701615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb6971-e2fc-4a34-9d5b-a1196f928222 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:36.707909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa7b29-2511-442d-801d-aef46c4fdeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:36.707909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa7b29-2511-442d-801d-aef46c4fdeeb admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:36.708143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa7b29-2511-442d-801d-aef46c4fdeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:36.708333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa7b29-2511-442d-801d-aef46c4fdeeb admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:36.708999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa7b29-2511-442d-801d-aef46c4fdeeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:36.710976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa7b29-2511-442d-801d-aef46c4fdeeb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:36.744431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44234f2c-0cd0-4790-9eb0-6f36198f7851 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:36.793329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26f7b7-522d-4061-b9da-4d7540d4c662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:36.793977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26f7b7-522d-4061-b9da-4d7540d4c662 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:36.794293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26f7b7-522d-4061-b9da-4d7540d4c662 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:36.794584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26f7b7-522d-4061-b9da-4d7540d4c662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:36.804259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26f7b7-522d-4061-b9da-4d7540d4c662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:36.805750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26f7b7-522d-4061-b9da-4d7540d4c662 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:36.816802 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1226/2427] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:25:36.827422 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1202/2428] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:25:36 2022] POST /identity/v3/users => generated 302 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:25:36.827665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26f7b7-522d-4061-b9da-4d7540d4c662 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:36.838009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26f7b7-522d-4061-b9da-4d7540d4c662 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:36.843624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2433f-a131-48b2-8a16-5dea93b4d922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:36.844616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2433f-a131-48b2-8a16-5dea93b4d922 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:36.844911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2433f-a131-48b2-8a16-5dea93b4d922 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:36.845195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2433f-a131-48b2-8a16-5dea93b4d922 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:36.845849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2433f-a131-48b2-8a16-5dea93b4d922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:36.847615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2433f-a131-48b2-8a16-5dea93b4d922 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:36.858501 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1227/2429] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:25:36.863090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa7b29-2511-442d-801d-aef46c4fdeeb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:36.873789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa7b29-2511-442d-801d-aef46c4fdeeb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:36.884127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606f5db-7c06-48cc-8480-cf54b4e68387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:36.884127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606f5db-7c06-48cc-8480-cf54b4e68387 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:36.884127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606f5db-7c06-48cc-8480-cf54b4e68387 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:36.884127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606f5db-7c06-48cc-8480-cf54b4e68387 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:36.884522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606f5db-7c06-48cc-8480-cf54b4e68387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:36.884761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606f5db-7c06-48cc-8480-cf54b4e68387 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:36.898095 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1203/2430] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:25:36.900608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2433f-a131-48b2-8a16-5dea93b4d922 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:36.916481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:36.922941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2433f-a131-48b2-8a16-5dea93b4d922 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:36.929845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e6333-038c-4544-9762-14c4ad0153c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:36.930882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e6333-038c-4544-9762-14c4ad0153c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:36.931695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e6333-038c-4544-9762-14c4ad0153c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:36.932054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e6333-038c-4544-9762-14c4ad0153c2 admin admin] PATH_INFO: `/v3/projects/fff3d7ff6ef44232aeaff789bbd38c51/users/6944304c03aa4000a99e11107cb78cf9/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:36.957790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e6333-038c-4544-9762-14c4ad0153c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fff3d7ff6ef44232aeaff789bbd38c51, user_id=6944304c03aa4000a99e11107cb78cf9, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:36.962328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e6333-038c-4544-9762-14c4ad0153c2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:37.070543 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1228/2431] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:25:36 2022] PUT /identity/v3/projects/fff3d7ff6ef44232aeaff789bbd38c51/users/6944304c03aa4000a99e11107cb78cf9/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:25:37.082267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9d560-3c7f-4fe6-9fdc-00e3deebe4e8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:37.082820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9d560-3c7f-4fe6-9fdc-00e3deebe4e8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:37.082820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9d560-3c7f-4fe6-9fdc-00e3deebe4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:37.124804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-47e9d560-3c7f-4fe6-9fdc-00e3deebe4e8 None None] MFA Rules not processed for user `6944304c03aa4000a99e11107cb78cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:25:37.126080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-47e9d560-3c7f-4fe6-9fdc-00e3deebe4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:37.130698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:37.213704 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1204/2432] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:25:37 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:25:37.218160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e6333-038c-4544-9762-14c4ad0153c2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:37.285002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e6333-038c-4544-9762-14c4ad0153c2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:37.289848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900a33e-e26a-4fdf-8057-edf33b8fc961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:37.290515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900a33e-e26a-4fdf-8057-edf33b8fc961 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:37.290805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900a33e-e26a-4fdf-8057-edf33b8fc961 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:37.291079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900a33e-e26a-4fdf-8057-edf33b8fc961 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:37.291743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900a33e-e26a-4fdf-8057-edf33b8fc961 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:37.293657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900a33e-e26a-4fdf-8057-edf33b8fc961 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:37.406629 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1229/2433] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:25:37 2022] POST /identity/v3/projects => generated 401 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:25:37.411309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9d560-3c7f-4fe6-9fdc-00e3deebe4e8 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:37.422475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9d560-3c7f-4fe6-9fdc-00e3deebe4e8 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:37.483781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2234b4c-a493-401d-bfb0-7a529e76974e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:37.484607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2234b4c-a493-401d-bfb0-7a529e76974e admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:37.484960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2234b4c-a493-401d-bfb0-7a529e76974e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:37.485303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2234b4c-a493-401d-bfb0-7a529e76974e admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:37.486102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2234b4c-a493-401d-bfb0-7a529e76974e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:37.488143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2234b4c-a493-401d-bfb0-7a529e76974e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:37.630245 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1205/2434] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:25:37 2022] POST /identity/v3/users => generated 307 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:25:37.634679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900a33e-e26a-4fdf-8057-edf33b8fc961 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:37.650252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900a33e-e26a-4fdf-8057-edf33b8fc961 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:37.656014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc64c5-cbf4-4ab6-ac1f-f223bd88e281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:37.656858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc64c5-cbf4-4ab6-ac1f-f223bd88e281 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:37.657142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc64c5-cbf4-4ab6-ac1f-f223bd88e281 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:37.657722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc64c5-cbf4-4ab6-ac1f-f223bd88e281 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:37.658237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc64c5-cbf4-4ab6-ac1f-f223bd88e281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:37.658631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87275a42-2226-4d66-b681-5f20f9f8d3b1 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:37.659415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87275a42-2226-4d66-b681-5f20f9f8d3b1 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:37.659699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87275a42-2226-4d66-b681-5f20f9f8d3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:37.664225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc64c5-cbf4-4ab6-ac1f-f223bd88e281 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:37.671995 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1230/2435] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:25:37.676244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc64c5-cbf4-4ab6-ac1f-f223bd88e281 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:37.680495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-87275a42-2226-4d66-b681-5f20f9f8d3b1 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:25:37.682403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-87275a42-2226-4d66-b681-5f20f9f8d3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:37.687162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc64c5-cbf4-4ab6-ac1f-f223bd88e281 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:37.691935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bccffd-a690-44ef-b230-9c9821d69131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:37.692594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bccffd-a690-44ef-b230-9c9821d69131 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:37.692870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bccffd-a690-44ef-b230-9c9821d69131 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:37.693142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bccffd-a690-44ef-b230-9c9821d69131 admin admin] PATH_INFO: `/v3/projects/9fe4fc63063b4d8b9ae8e47dd20423de/users/e961803e22ea4bfab2eb4b0c9cef2c24/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:37.695445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:37.709808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bccffd-a690-44ef-b230-9c9821d69131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fe4fc63063b4d8b9ae8e47dd20423de, user_id=e961803e22ea4bfab2eb4b0c9cef2c24, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:37.714589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bccffd-a690-44ef-b230-9c9821d69131 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:37.742633 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1206/2436] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:25:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:25:37.779435 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1231/2437] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:25:37 2022] PUT /identity/v3/projects/9fe4fc63063b4d8b9ae8e47dd20423de/users/e961803e22ea4bfab2eb4b0c9cef2c24/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:25:37.782745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87275a42-2226-4d66-b681-5f20f9f8d3b1 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:37.795519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87275a42-2226-4d66-b681-5f20f9f8d3b1 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:37.858447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a582d-4d92-4f7b-b883-5bbe3afc532c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:37.859600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a582d-4d92-4f7b-b883-5bbe3afc532c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:37.860131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a582d-4d92-4f7b-b883-5bbe3afc532c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:37.860410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a582d-4d92-4f7b-b883-5bbe3afc532c admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:37.861066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a582d-4d92-4f7b-b883-5bbe3afc532c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:37.862724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a582d-4d92-4f7b-b883-5bbe3afc532c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:37.873914 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1207/2438] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:25:37.879637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bccffd-a690-44ef-b230-9c9821d69131 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:37.894440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a582d-4d92-4f7b-b883-5bbe3afc532c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:37.894613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bccffd-a690-44ef-b230-9c9821d69131 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:37.897350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-181a582d-4d92-4f7b-b883-5bbe3afc532c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:37.901344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b3fcc-e30d-4c1d-b336-26285d5bb44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:37.902290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b3fcc-e30d-4c1d-b336-26285d5bb44b admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:37.902577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b3fcc-e30d-4c1d-b336-26285d5bb44b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:37.902855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b3fcc-e30d-4c1d-b336-26285d5bb44b admin admin] PATH_INFO: `/v3/projects/9fe4fc63063b4d8b9ae8e47dd20423de/users/e961803e22ea4bfab2eb4b0c9cef2c24/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:37.905180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b3fcc-e30d-4c1d-b336-26285d5bb44b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fe4fc63063b4d8b9ae8e47dd20423de, user_id=e961803e22ea4bfab2eb4b0c9cef2c24, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:37.910773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b3fcc-e30d-4c1d-b336-26285d5bb44b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:37.924413 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1232/2439] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:25:37 2022] PUT /identity/v3/projects/9fe4fc63063b4d8b9ae8e47dd20423de/users/e961803e22ea4bfab2eb4b0c9cef2c24/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:25:37.934264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eb35c-7fb0-46af-a504-f1ef33c60c2c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:37.937350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eb35c-7fb0-46af-a504-f1ef33c60c2c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:37.937350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eb35c-7fb0-46af-a504-f1ef33c60c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:37.968855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-236eb35c-7fb0-46af-a504-f1ef33c60c2c None None] MFA Rules not processed for user `e961803e22ea4bfab2eb4b0c9cef2c24`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:25:37.970134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-236eb35c-7fb0-46af-a504-f1ef33c60c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:37.985424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:38.008811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a582d-4d92-4f7b-b883-5bbe3afc532c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:38.062067 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1233/2440] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:25:37 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:25:38.074997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236eb35c-7fb0-46af-a504-f1ef33c60c2c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:38.076712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-236eb35c-7fb0-46af-a504-f1ef33c60c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:38.084820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e962b3e-9d0e-4f9f-aab0-2f3626fbb171 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:38.086028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e962b3e-9d0e-4f9f-aab0-2f3626fbb171 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:38.086548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e962b3e-9d0e-4f9f-aab0-2f3626fbb171 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:38.088663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e962b3e-9d0e-4f9f-aab0-2f3626fbb171 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:38.167499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e962b3e-9d0e-4f9f-aab0-2f3626fbb171 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:38.169573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e962b3e-9d0e-4f9f-aab0-2f3626fbb171 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:38.185085 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1208/2441] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:25:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:25:38.194155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236eb35c-7fb0-46af-a504-f1ef33c60c2c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:38.206907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43bb10-1cdb-4084-835c-9d5668c417ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:38.206907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43bb10-1cdb-4084-835c-9d5668c417ad service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:38.206907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43bb10-1cdb-4084-835c-9d5668c417ad service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:38.206907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43bb10-1cdb-4084-835c-9d5668c417ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:38.216370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43bb10-1cdb-4084-835c-9d5668c417ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:38.226682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43bb10-1cdb-4084-835c-9d5668c417ad service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:38.269834 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1234/2442] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:25:38 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:25:38.727397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e962b3e-9d0e-4f9f-aab0-2f3626fbb171 service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:38.728853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5e962b3e-9d0e-4f9f-aab0-2f3626fbb171 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:38.754744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e962b3e-9d0e-4f9f-aab0-2f3626fbb171 service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:38.775398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e476d16-3d4d-4544-b315-ebe6cd45cb05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:38.775982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e476d16-3d4d-4544-b315-ebe6cd45cb05 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:38.776266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e476d16-3d4d-4544-b315-ebe6cd45cb05 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:38.776544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e476d16-3d4d-4544-b315-ebe6cd45cb05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:38.891326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e476d16-3d4d-4544-b315-ebe6cd45cb05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:38.892877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e476d16-3d4d-4544-b315-ebe6cd45cb05 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:38.911496 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1209/2443] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:25:38 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:25:39.023992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:39.495475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43bb10-1cdb-4084-835c-9d5668c417ad service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:39.604880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:39.658167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43bb10-1cdb-4084-835c-9d5668c417ad service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:39.666333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328590a-dce1-4caf-8a9c-870ff55674ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:39.666994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328590a-dce1-4caf-8a9c-870ff55674ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:39.667303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328590a-dce1-4caf-8a9c-870ff55674ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:39.667558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328590a-dce1-4caf-8a9c-870ff55674ad admin admin] PATH_INFO: `/v3/users/6944304c03aa4000a99e11107cb78cf9` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:39.669953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328590a-dce1-4caf-8a9c-870ff55674ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=6944304c03aa4000a99e11107cb78cf9)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:39.672267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328590a-dce1-4caf-8a9c-870ff55674ad admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:39.885357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1328590a-dce1-4caf-8a9c-870ff55674ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6944304c03aa4000a99e11107cb78cf9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:39.886185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1328590a-dce1-4caf-8a9c-870ff55674ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6944304c03aa4000a99e11107cb78cf9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:39.907541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1328590a-dce1-4caf-8a9c-870ff55674ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6944304c03aa4000a99e11107cb78cf9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:39.952206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1328590a-dce1-4caf-8a9c-870ff55674ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6944304c03aa4000a99e11107cb78cf9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:39.953496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1328590a-dce1-4caf-8a9c-870ff55674ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6944304c03aa4000a99e11107cb78cf9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:40.093953 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1235/2444] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:25:39 2022] DELETE /identity/v3/users/6944304c03aa4000a99e11107cb78cf9 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:25:40.099334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48a17b-820d-4671-a0f6-118192b8009c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:40.099849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48a17b-820d-4671-a0f6-118192b8009c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:40.099946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48a17b-820d-4671-a0f6-118192b8009c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:40.149585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-2f48a17b-820d-4671-a0f6-118192b8009c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:25:40.152828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2f48a17b-820d-4671-a0f6-118192b8009c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:40.426248 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1210/2445] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:25:40.433803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328590a-dce1-4caf-8a9c-870ff55674ad admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:40.436301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1328590a-dce1-4caf-8a9c-870ff55674ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:40.612347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328590a-dce1-4caf-8a9c-870ff55674ad admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:40.616766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac19fa3-11b7-47f2-a637-b8266c8f367f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:40.617596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac19fa3-11b7-47f2-a637-b8266c8f367f service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:40.618955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac19fa3-11b7-47f2-a637-b8266c8f367f service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:40.618955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac19fa3-11b7-47f2-a637-b8266c8f367f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:40.631574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac19fa3-11b7-47f2-a637-b8266c8f367f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:40.633290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac19fa3-11b7-47f2-a637-b8266c8f367f service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:40.667567 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1236/2446] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:25:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:25:42.362648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48a17b-820d-4671-a0f6-118192b8009c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:42.364090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2f48a17b-820d-4671-a0f6-118192b8009c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:42.394997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48a17b-820d-4671-a0f6-118192b8009c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:42.413193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a842a5-f91e-43bc-af70-003768dc7996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:42.413840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a842a5-f91e-43bc-af70-003768dc7996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:42.417416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a842a5-f91e-43bc-af70-003768dc7996 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:42.417889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a842a5-f91e-43bc-af70-003768dc7996 admin admin] PATH_INFO: `/v3/projects/fff3d7ff6ef44232aeaff789bbd38c51` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:42.421188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a842a5-f91e-43bc-af70-003768dc7996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fff3d7ff6ef44232aeaff789bbd38c51)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:42.428247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a842a5-f91e-43bc-af70-003768dc7996 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:42.617140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-84a842a5-f91e-43bc-af70-003768dc7996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fff3d7ff6ef44232aeaff789bbd38c51', 'request_id': 'req-84a842a5-f91e-43bc-af70-003768dc7996'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:42.703366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-84a842a5-f91e-43bc-af70-003768dc7996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fff3d7ff6ef44232aeaff789bbd38c51', 'request_id': 'req-84a842a5-f91e-43bc-af70-003768dc7996'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:42.718433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-84a842a5-f91e-43bc-af70-003768dc7996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fff3d7ff6ef44232aeaff789bbd38c51', 'request_id': 'req-84a842a5-f91e-43bc-af70-003768dc7996'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:42.737253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-84a842a5-f91e-43bc-af70-003768dc7996 admin admin] The token cache is being invalidate because project fff3d7ff6ef44232aeaff789bbd38c51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:25:42.737546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-84a842a5-f91e-43bc-af70-003768dc7996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:42.740534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-84a842a5-f91e-43bc-af70-003768dc7996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:42.742855 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1211/2447] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:42 2022] DELETE /identity/v3/projects/fff3d7ff6ef44232aeaff789bbd38c51 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:25:42.746966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac19fa3-11b7-47f2-a637-b8266c8f367f service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:42.760329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac19fa3-11b7-47f2-a637-b8266c8f367f service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:43.069109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dec137-21e0-4cb9-aab1-d43c77c74d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:43.069783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dec137-21e0-4cb9-aab1-d43c77c74d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:43.070090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dec137-21e0-4cb9-aab1-d43c77c74d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:43.070375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dec137-21e0-4cb9-aab1-d43c77c74d72 admin admin] PATH_INFO: `/v3/users/e961803e22ea4bfab2eb4b0c9cef2c24` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:43.072440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dec137-21e0-4cb9-aab1-d43c77c74d72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e961803e22ea4bfab2eb4b0c9cef2c24)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:43.078341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dec137-21e0-4cb9-aab1-d43c77c74d72 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:43.083676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:43.479734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-25dec137-21e0-4cb9-aab1-d43c77c74d72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e961803e22ea4bfab2eb4b0c9cef2c24'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:43.482389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-25dec137-21e0-4cb9-aab1-d43c77c74d72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e961803e22ea4bfab2eb4b0c9cef2c24'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:43.499876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-25dec137-21e0-4cb9-aab1-d43c77c74d72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e961803e22ea4bfab2eb4b0c9cef2c24'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:43.590105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-25dec137-21e0-4cb9-aab1-d43c77c74d72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e961803e22ea4bfab2eb4b0c9cef2c24'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:43.592465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-25dec137-21e0-4cb9-aab1-d43c77c74d72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e961803e22ea4bfab2eb4b0c9cef2c24'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:43.710642 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1237/2448] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:25:42 2022] DELETE /identity/v3/users/e961803e22ea4bfab2eb4b0c9cef2c24 => generated 0 bytes in 964 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:25:44.825567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a842a5-f91e-43bc-af70-003768dc7996 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:44.827879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-84a842a5-f91e-43bc-af70-003768dc7996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:44.854954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a842a5-f91e-43bc-af70-003768dc7996 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:44.974755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:45.026827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea6cde-5f49-4a03-b655-029f44524296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:45.027488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea6cde-5f49-4a03-b655-029f44524296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:45.027770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea6cde-5f49-4a03-b655-029f44524296 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:45.032172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea6cde-5f49-4a03-b655-029f44524296 admin admin] PATH_INFO: `/v3/projects/9fe4fc63063b4d8b9ae8e47dd20423de` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:45.033455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea6cde-5f49-4a03-b655-029f44524296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fe4fc63063b4d8b9ae8e47dd20423de)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:45.042686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea6cde-5f49-4a03-b655-029f44524296 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:45.307512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ecea6cde-5f49-4a03-b655-029f44524296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fe4fc63063b4d8b9ae8e47dd20423de', 'request_id': 'req-ecea6cde-5f49-4a03-b655-029f44524296'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:45.387183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ecea6cde-5f49-4a03-b655-029f44524296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fe4fc63063b4d8b9ae8e47dd20423de', 'request_id': 'req-ecea6cde-5f49-4a03-b655-029f44524296'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:45.405552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ecea6cde-5f49-4a03-b655-029f44524296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fe4fc63063b4d8b9ae8e47dd20423de', 'request_id': 'req-ecea6cde-5f49-4a03-b655-029f44524296'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:45.430300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ecea6cde-5f49-4a03-b655-029f44524296 admin admin] The token cache is being invalidate because project 9fe4fc63063b4d8b9ae8e47dd20423de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:25:45.430697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ecea6cde-5f49-4a03-b655-029f44524296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:45.431497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ecea6cde-5f49-4a03-b655-029f44524296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:45.437641 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1212/2449] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:44 2022] DELETE /identity/v3/projects/9fe4fc63063b4d8b9ae8e47dd20423de => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:25:45.439552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131fbe7-5980-468e-bd5d-7b02e6c7c765 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:45.440571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131fbe7-5980-468e-bd5d-7b02e6c7c765 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:45.440855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131fbe7-5980-468e-bd5d-7b02e6c7c765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:45.487466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2131fbe7-5980-468e-bd5d-7b02e6c7c765 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:25:45.488598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2131fbe7-5980-468e-bd5d-7b02e6c7c765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:45.630629 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1238/2450] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:25:45.637000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c154585-d5d3-40b7-ab51-0a75b4f7ef04 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:45.641239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c154585-d5d3-40b7-ab51-0a75b4f7ef04 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:45.641828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c154585-d5d3-40b7-ab51-0a75b4f7ef04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:45.707084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6c154585-d5d3-40b7-ab51-0a75b4f7ef04 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:25:45.708956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6c154585-d5d3-40b7-ab51-0a75b4f7ef04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:45.734160 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1213/2451] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:25:45.739138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131fbe7-5980-468e-bd5d-7b02e6c7c765 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:45.754468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131fbe7-5980-468e-bd5d-7b02e6c7c765 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:45.772946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66ec04-2b27-488a-8939-11afe748d712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:45.773983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66ec04-2b27-488a-8939-11afe748d712 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:45.778413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66ec04-2b27-488a-8939-11afe748d712 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:45.778818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66ec04-2b27-488a-8939-11afe748d712 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:45.781529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66ec04-2b27-488a-8939-11afe748d712 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:25:45.782120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66ec04-2b27-488a-8939-11afe748d712 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:45.786821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66ec04-2b27-488a-8939-11afe748d712 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:45.810488 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1239/2452] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:25:45.812954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c154585-d5d3-40b7-ab51-0a75b4f7ef04 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:45.832538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c154585-d5d3-40b7-ab51-0a75b4f7ef04 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:45.844341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ae98c-1193-43d0-be3e-fac7afe7fb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:45.845051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ae98c-1193-43d0-be3e-fac7afe7fb82 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:45.845342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ae98c-1193-43d0-be3e-fac7afe7fb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:45.845626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ae98c-1193-43d0-be3e-fac7afe7fb82 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:45.846347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ae98c-1193-43d0-be3e-fac7afe7fb82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:45.850305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ae98c-1193-43d0-be3e-fac7afe7fb82 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:46.003281 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1214/2453] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:25:45 2022] POST /identity/v3/projects => generated 407 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:25:46.007495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66ec04-2b27-488a-8939-11afe748d712 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:46.022751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66ec04-2b27-488a-8939-11afe748d712 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:46.296518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093962a0-7858-400f-8260-fa305bfefb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:46.298922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093962a0-7858-400f-8260-fa305bfefb1c admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:46.300554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093962a0-7858-400f-8260-fa305bfefb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:46.313962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093962a0-7858-400f-8260-fa305bfefb1c admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:46.317895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093962a0-7858-400f-8260-fa305bfefb1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:46.330586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093962a0-7858-400f-8260-fa305bfefb1c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:46.435657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:46.448943 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1240/2454] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:25:46 2022] POST /identity/v3/users => generated 304 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:25:46.450552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ae98c-1193-43d0-be3e-fac7afe7fb82 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:46.475398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ae98c-1193-43d0-be3e-fac7afe7fb82 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:46.489075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f0c00-3913-4846-aa2a-e41f12eca43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:46.489889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f0c00-3913-4846-aa2a-e41f12eca43d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:46.492073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f0c00-3913-4846-aa2a-e41f12eca43d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:46.492269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f0c00-3913-4846-aa2a-e41f12eca43d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:46.493064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f0c00-3913-4846-aa2a-e41f12eca43d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:46.494954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f0c00-3913-4846-aa2a-e41f12eca43d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:46.542129 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1215/2455] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:25:46.545899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093962a0-7858-400f-8260-fa305bfefb1c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:46.569856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093962a0-7858-400f-8260-fa305bfefb1c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:46.592143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73482ca-e80c-4512-b31d-39695b0cf706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:46.602499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73482ca-e80c-4512-b31d-39695b0cf706 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:46.602499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73482ca-e80c-4512-b31d-39695b0cf706 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:46.602499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73482ca-e80c-4512-b31d-39695b0cf706 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:46.602499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73482ca-e80c-4512-b31d-39695b0cf706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:46.605276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73482ca-e80c-4512-b31d-39695b0cf706 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:46.627363 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1241/2456] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:25:46.629046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f0c00-3913-4846-aa2a-e41f12eca43d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:46.652097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f0c00-3913-4846-aa2a-e41f12eca43d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:46.660142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e7ede-68e9-4604-8b40-915b28405002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:46.661763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e7ede-68e9-4604-8b40-915b28405002 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:46.662900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e7ede-68e9-4604-8b40-915b28405002 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:46.663350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e7ede-68e9-4604-8b40-915b28405002 admin admin] PATH_INFO: `/v3/projects/b2ae060395764d6599a182638513bed9/users/debcb19de6304ccc8bb18e4e03633181/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:46.683058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e7ede-68e9-4604-8b40-915b28405002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2ae060395764d6599a182638513bed9, user_id=debcb19de6304ccc8bb18e4e03633181, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:46.685859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e7ede-68e9-4604-8b40-915b28405002 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:46.809030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4e4ba-02ce-4ba8-a269-9eff3d84fff5 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:46.809346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4e4ba-02ce-4ba8-a269-9eff3d84fff5 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:46.809692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4e4ba-02ce-4ba8-a269-9eff3d84fff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:46.866132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2af4e4ba-02ce-4ba8-a269-9eff3d84fff5 None None] MFA Rules not processed for user `1245e7aa1c6a420fa7ebe0c098a6396a`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:25:46.867694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2af4e4ba-02ce-4ba8-a269-9eff3d84fff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:46.958055 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1242/2457] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:25:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:25:47.082311 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1216/2458] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:25:46 2022] PUT /identity/v3/projects/b2ae060395764d6599a182638513bed9/users/debcb19de6304ccc8bb18e4e03633181/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:25:47.091127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b408e9f-1120-4218-9b67-c6d6d95d05f2 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:47.091504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b408e9f-1120-4218-9b67-c6d6d95d05f2 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:47.091786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b408e9f-1120-4218-9b67-c6d6d95d05f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:47.134806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1b408e9f-1120-4218-9b67-c6d6d95d05f2 None None] MFA Rules not processed for user `debcb19de6304ccc8bb18e4e03633181`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:25:47.136189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1b408e9f-1120-4218-9b67-c6d6d95d05f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:47.359100 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1243/2459] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:25:47 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:25:47.364410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e7ede-68e9-4604-8b40-915b28405002 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:47.531839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:47.615789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e7ede-68e9-4604-8b40-915b28405002 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:47.633137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b3af2-05bf-4f93-9ba7-93894cd48203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:47.633137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b3af2-05bf-4f93-9ba7-93894cd48203 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:47.633137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b3af2-05bf-4f93-9ba7-93894cd48203 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:47.633137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b3af2-05bf-4f93-9ba7-93894cd48203 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:47.633568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b3af2-05bf-4f93-9ba7-93894cd48203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:47.634221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b3af2-05bf-4f93-9ba7-93894cd48203 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:47.748947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b408e9f-1120-4218-9b67-c6d6d95d05f2 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:47.751197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1b408e9f-1120-4218-9b67-c6d6d95d05f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:47.835275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:47.882493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b408e9f-1120-4218-9b67-c6d6d95d05f2 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:47.911535 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1217/2460] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:25:47 2022] POST /identity/v3/projects => generated 409 bytes in 547 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:25:47.913248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b3af2-05bf-4f93-9ba7-93894cd48203 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:47.923780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f479b9-5263-4387-a8ef-ae05e947ecba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:47.925038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f479b9-5263-4387-a8ef-ae05e947ecba service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:47.925320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f479b9-5263-4387-a8ef-ae05e947ecba service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:47.931371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f479b9-5263-4387-a8ef-ae05e947ecba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:48.024859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f479b9-5263-4387-a8ef-ae05e947ecba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:48.027087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f479b9-5263-4387-a8ef-ae05e947ecba service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:48.051348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b3af2-05bf-4f93-9ba7-93894cd48203 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:48.057493 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1244/2461] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:25:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:25:48.080403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a273f-530a-4aad-a9a6-cdccf0e06bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:48.083119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a273f-530a-4aad-a9a6-cdccf0e06bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:48.084072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a273f-530a-4aad-a9a6-cdccf0e06bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:48.084452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a273f-530a-4aad-a9a6-cdccf0e06bf7 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:48.087743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a273f-530a-4aad-a9a6-cdccf0e06bf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:48.097132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a273f-530a-4aad-a9a6-cdccf0e06bf7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:48.240256 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1218/2462] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:25:47 2022] POST /identity/v3/users => generated 311 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:25:48.244979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f479b9-5263-4387-a8ef-ae05e947ecba service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:48.266351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f479b9-5263-4387-a8ef-ae05e947ecba service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:48.281368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e78f1-700e-41d1-994b-1020b17572fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:48.282003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e78f1-700e-41d1-994b-1020b17572fd admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:48.282313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e78f1-700e-41d1-994b-1020b17572fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:48.282594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e78f1-700e-41d1-994b-1020b17572fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:48.283302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e78f1-700e-41d1-994b-1020b17572fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:48.290419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e78f1-700e-41d1-994b-1020b17572fd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:48.319983 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1245/2463] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:25:48.322566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a273f-530a-4aad-a9a6-cdccf0e06bf7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:48.337352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a273f-530a-4aad-a9a6-cdccf0e06bf7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:48.342807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58275fcc-e136-4de3-90f4-26f5bd95b9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:48.343740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58275fcc-e136-4de3-90f4-26f5bd95b9c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:48.344181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58275fcc-e136-4de3-90f4-26f5bd95b9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:48.344606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58275fcc-e136-4de3-90f4-26f5bd95b9c9 admin admin] PATH_INFO: `/v3/projects/d63acd3e6b3544759e412f95a428a4ec/users/6b37b5b692944acebc314deff793444b/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:48.363777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58275fcc-e136-4de3-90f4-26f5bd95b9c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63acd3e6b3544759e412f95a428a4ec, user_id=6b37b5b692944acebc314deff793444b, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:48.366925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58275fcc-e136-4de3-90f4-26f5bd95b9c9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:48.460578 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1219/2464] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:25:48 2022] PUT /identity/v3/projects/d63acd3e6b3544759e412f95a428a4ec/users/6b37b5b692944acebc314deff793444b/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:25:48.466372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e78f1-700e-41d1-994b-1020b17572fd admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:48.482769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e78f1-700e-41d1-994b-1020b17572fd admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:48.619713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bd4d9-9a0c-4823-92af-8fc50719b4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:48.620351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bd4d9-9a0c-4823-92af-8fc50719b4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:48.620633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bd4d9-9a0c-4823-92af-8fc50719b4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:48.620904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bd4d9-9a0c-4823-92af-8fc50719b4d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:48.621566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291bd4d9-9a0c-4823-92af-8fc50719b4d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:48.623207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291bd4d9-9a0c-4823-92af-8fc50719b4d1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:48.659505 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1246/2465] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:25:48.660615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58275fcc-e136-4de3-90f4-26f5bd95b9c9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:48.677821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58275fcc-e136-4de3-90f4-26f5bd95b9c9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:48.692684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f31f17-ddf0-4b6f-a274-58492da254bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:48.693788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f31f17-ddf0-4b6f-a274-58492da254bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:48.695153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f31f17-ddf0-4b6f-a274-58492da254bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:48.695683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f31f17-ddf0-4b6f-a274-58492da254bd admin admin] PATH_INFO: `/v3/projects/d63acd3e6b3544759e412f95a428a4ec/users/6b37b5b692944acebc314deff793444b/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:48.701960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f31f17-ddf0-4b6f-a274-58492da254bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63acd3e6b3544759e412f95a428a4ec, user_id=6b37b5b692944acebc314deff793444b, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:48.714051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f31f17-ddf0-4b6f-a274-58492da254bd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:48.769765 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1220/2466] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:25:48 2022] PUT /identity/v3/projects/d63acd3e6b3544759e412f95a428a4ec/users/6b37b5b692944acebc314deff793444b/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:25:48.773538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f71b0-938a-4fde-a840-dc21715a622d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:48.773538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f71b0-938a-4fde-a840-dc21715a622d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:48.773538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f71b0-938a-4fde-a840-dc21715a622d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:48.840568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0a6f71b0-938a-4fde-a840-dc21715a622d None None] MFA Rules not processed for user `6b37b5b692944acebc314deff793444b`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:25:48.842132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0a6f71b0-938a-4fde-a840-dc21715a622d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:49.000755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:49.032846 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1247/2467] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:25:48 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:25:50.223720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f31f17-ddf0-4b6f-a274-58492da254bd admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:50.227367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-00f31f17-ddf0-4b6f-a274-58492da254bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:50.334026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:50.468244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f31f17-ddf0-4b6f-a274-58492da254bd admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:50.475671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac47ed-b129-4c2f-9220-cc104c543664 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:50.476372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac47ed-b129-4c2f-9220-cc104c543664 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:50.476651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac47ed-b129-4c2f-9220-cc104c543664 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:50.476926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac47ed-b129-4c2f-9220-cc104c543664 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:50.491519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac47ed-b129-4c2f-9220-cc104c543664 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:50.493161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac47ed-b129-4c2f-9220-cc104c543664 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:50.508923 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1221/2468] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:25:50 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:25:51.151952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f71b0-938a-4fde-a840-dc21715a622d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:51.190594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f71b0-938a-4fde-a840-dc21715a622d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:51.214384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3b11b-ecd0-40d8-9771-3e8ae28c553d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:51.215611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3b11b-ecd0-40d8-9771-3e8ae28c553d service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:51.216377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3b11b-ecd0-40d8-9771-3e8ae28c553d service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:51.221679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3b11b-ecd0-40d8-9771-3e8ae28c553d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:51.349131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3b11b-ecd0-40d8-9771-3e8ae28c553d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:51.350810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3b11b-ecd0-40d8-9771-3e8ae28c553d service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:51.378739 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1248/2469] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:25:51 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:25:54.140885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac47ed-b129-4c2f-9220-cc104c543664 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:54.378792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac47ed-b129-4c2f-9220-cc104c543664 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:54.409591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260620eb-cadf-4d65-9be6-14bdacdaa82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:54.410402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260620eb-cadf-4d65-9be6-14bdacdaa82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:54.410686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260620eb-cadf-4d65-9be6-14bdacdaa82d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:54.411024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260620eb-cadf-4d65-9be6-14bdacdaa82d admin admin] PATH_INFO: `/v3/users/debcb19de6304ccc8bb18e4e03633181` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:54.412911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260620eb-cadf-4d65-9be6-14bdacdaa82d admin admin] RBAC: Authorizing `identity:delete_user(user_id=debcb19de6304ccc8bb18e4e03633181)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:54.415266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260620eb-cadf-4d65-9be6-14bdacdaa82d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:54.993721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-260620eb-cadf-4d65-9be6-14bdacdaa82d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'debcb19de6304ccc8bb18e4e03633181'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:54.994907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-260620eb-cadf-4d65-9be6-14bdacdaa82d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'debcb19de6304ccc8bb18e4e03633181'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:55.022608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-260620eb-cadf-4d65-9be6-14bdacdaa82d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'debcb19de6304ccc8bb18e4e03633181'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:55.065702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-260620eb-cadf-4d65-9be6-14bdacdaa82d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'debcb19de6304ccc8bb18e4e03633181'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:55.166783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-260620eb-cadf-4d65-9be6-14bdacdaa82d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'debcb19de6304ccc8bb18e4e03633181'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:55.176935 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1222/2470] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:25:54 2022] DELETE /identity/v3/users/debcb19de6304ccc8bb18e4e03633181 => generated 0 bytes in 1036 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:25:55.181392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2524e-3e50-496e-89da-feb705d5cef6 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:55.181870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2524e-3e50-496e-89da-feb705d5cef6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:55.181953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2524e-3e50-496e-89da-feb705d5cef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:55.278736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-77c2524e-3e50-496e-89da-feb705d5cef6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:25:55.279982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-77c2524e-3e50-496e-89da-feb705d5cef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:55.419493 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1249/2471] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:25:55.452893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260620eb-cadf-4d65-9be6-14bdacdaa82d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:55.454866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-260620eb-cadf-4d65-9be6-14bdacdaa82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:55.534141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:55.670135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260620eb-cadf-4d65-9be6-14bdacdaa82d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:55.680420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b802e-575d-41a4-a5e7-afdfd755ad85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:55.681911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b802e-575d-41a4-a5e7-afdfd755ad85 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:55.682226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b802e-575d-41a4-a5e7-afdfd755ad85 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:55.682514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b802e-575d-41a4-a5e7-afdfd755ad85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:55.705881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b802e-575d-41a4-a5e7-afdfd755ad85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:55.708006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b802e-575d-41a4-a5e7-afdfd755ad85 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:55.732782 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1223/2472] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:25:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:25:56.541301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2524e-3e50-496e-89da-feb705d5cef6 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:56.543266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-77c2524e-3e50-496e-89da-feb705d5cef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:56.568100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2524e-3e50-496e-89da-feb705d5cef6 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:56.573451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d9259-ac07-4b49-8aa6-ec07663d0f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:56.574331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d9259-ac07-4b49-8aa6-ec07663d0f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:56.574789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d9259-ac07-4b49-8aa6-ec07663d0f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:56.575256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d9259-ac07-4b49-8aa6-ec07663d0f2e admin admin] PATH_INFO: `/v3/projects/b2ae060395764d6599a182638513bed9` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:56.576588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d9259-ac07-4b49-8aa6-ec07663d0f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2ae060395764d6599a182638513bed9)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:56.578773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d9259-ac07-4b49-8aa6-ec07663d0f2e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:56.756492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7e5d9259-ac07-4b49-8aa6-ec07663d0f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2ae060395764d6599a182638513bed9', 'request_id': 'req-7e5d9259-ac07-4b49-8aa6-ec07663d0f2e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:56.766339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7e5d9259-ac07-4b49-8aa6-ec07663d0f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2ae060395764d6599a182638513bed9', 'request_id': 'req-7e5d9259-ac07-4b49-8aa6-ec07663d0f2e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:56.790955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7e5d9259-ac07-4b49-8aa6-ec07663d0f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2ae060395764d6599a182638513bed9', 'request_id': 'req-7e5d9259-ac07-4b49-8aa6-ec07663d0f2e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:56.902238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7e5d9259-ac07-4b49-8aa6-ec07663d0f2e admin admin] The token cache is being invalidate because project b2ae060395764d6599a182638513bed9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:25:56.902830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7e5d9259-ac07-4b49-8aa6-ec07663d0f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:56.908585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7e5d9259-ac07-4b49-8aa6-ec07663d0f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:56.911307 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1250/2473] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:56 2022] DELETE /identity/v3/projects/b2ae060395764d6599a182638513bed9 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:25:56.915374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b802e-575d-41a4-a5e7-afdfd755ad85 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:56.932081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b802e-575d-41a4-a5e7-afdfd755ad85 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:57.063940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf6341-d65c-4dc2-8ba1-7de3a47a146e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:57.064856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf6341-d65c-4dc2-8ba1-7de3a47a146e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:57.066309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf6341-d65c-4dc2-8ba1-7de3a47a146e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:57.066595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf6341-d65c-4dc2-8ba1-7de3a47a146e admin admin] PATH_INFO: `/v3/users/6b37b5b692944acebc314deff793444b` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:57.070084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf6341-d65c-4dc2-8ba1-7de3a47a146e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b37b5b692944acebc314deff793444b)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:57.073587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf6341-d65c-4dc2-8ba1-7de3a47a146e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:57.361342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e0cf6341-d65c-4dc2-8ba1-7de3a47a146e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b37b5b692944acebc314deff793444b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:57.365164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e0cf6341-d65c-4dc2-8ba1-7de3a47a146e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b37b5b692944acebc314deff793444b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:57.381100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e0cf6341-d65c-4dc2-8ba1-7de3a47a146e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b37b5b692944acebc314deff793444b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:57.407009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e0cf6341-d65c-4dc2-8ba1-7de3a47a146e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b37b5b692944acebc314deff793444b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:57.509964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e0cf6341-d65c-4dc2-8ba1-7de3a47a146e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b37b5b692944acebc314deff793444b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:57.518472 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1224/2474] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:25:56 2022] DELETE /identity/v3/users/6b37b5b692944acebc314deff793444b => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:25:58.776450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d9259-ac07-4b49-8aa6-ec07663d0f2e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:58.778667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7e5d9259-ac07-4b49-8aa6-ec07663d0f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:58.789217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:58.802745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d9259-ac07-4b49-8aa6-ec07663d0f2e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:58.989056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eef07b-d9b5-4f26-834c-7ae4cdb07070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:58.990193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eef07b-d9b5-4f26-834c-7ae4cdb07070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:58.990642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eef07b-d9b5-4f26-834c-7ae4cdb07070 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:58.991073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eef07b-d9b5-4f26-834c-7ae4cdb07070 admin admin] PATH_INFO: `/v3/projects/d63acd3e6b3544759e412f95a428a4ec` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:58.993369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eef07b-d9b5-4f26-834c-7ae4cdb07070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d63acd3e6b3544759e412f95a428a4ec)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:59.005427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eef07b-d9b5-4f26-834c-7ae4cdb07070 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:59.224925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-67eef07b-d9b5-4f26-834c-7ae4cdb07070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd63acd3e6b3544759e412f95a428a4ec', 'request_id': 'req-67eef07b-d9b5-4f26-834c-7ae4cdb07070'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:59.242315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-67eef07b-d9b5-4f26-834c-7ae4cdb07070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd63acd3e6b3544759e412f95a428a4ec', 'request_id': 'req-67eef07b-d9b5-4f26-834c-7ae4cdb07070'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:59.249124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-67eef07b-d9b5-4f26-834c-7ae4cdb07070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd63acd3e6b3544759e412f95a428a4ec', 'request_id': 'req-67eef07b-d9b5-4f26-834c-7ae4cdb07070'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:59.361448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-67eef07b-d9b5-4f26-834c-7ae4cdb07070 admin admin] The token cache is being invalidate because project d63acd3e6b3544759e412f95a428a4ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:25:59.364392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-67eef07b-d9b5-4f26-834c-7ae4cdb07070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:59.367136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-67eef07b-d9b5-4f26-834c-7ae4cdb07070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:25:59.372421 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1251/2475] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:58 2022] DELETE /identity/v3/projects/d63acd3e6b3544759e412f95a428a4ec => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:25:59.374129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773ec40-b450-41e5-962f-3b930c42ed63 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:59.374626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773ec40-b450-41e5-962f-3b930c42ed63 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:59.374731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773ec40-b450-41e5-962f-3b930c42ed63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:59.510688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e773ec40-b450-41e5-962f-3b930c42ed63 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:25:59.512221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e773ec40-b450-41e5-962f-3b930c42ed63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:59.527843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:59.630020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eef07b-d9b5-4f26-834c-7ae4cdb07070 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:59.630020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-67eef07b-d9b5-4f26-834c-7ae4cdb07070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:59.643243 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1225/2476] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:25:59.646668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d58dd-e849-472a-9821-fe512a4f9be0 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:59.646968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d58dd-e849-472a-9821-fe512a4f9be0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:59.647569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d58dd-e849-472a-9821-fe512a4f9be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:59.684984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5d8d58dd-e849-472a-9821-fe512a4f9be0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:25:59.689320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5d8d58dd-e849-472a-9821-fe512a4f9be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:25:59.712436 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1226/2477] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:25:59.714196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d58dd-e849-472a-9821-fe512a4f9be0 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:59.739572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d58dd-e849-472a-9821-fe512a4f9be0 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:59.747528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05ccfc-d5df-4f35-b7b3-27b7d6fbe06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:59.748426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05ccfc-d5df-4f35-b7b3-27b7d6fbe06c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:59.748817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05ccfc-d5df-4f35-b7b3-27b7d6fbe06c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:59.749227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05ccfc-d5df-4f35-b7b3-27b7d6fbe06c admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:59.750104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05ccfc-d5df-4f35-b7b3-27b7d6fbe06c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:25:59.755588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05ccfc-d5df-4f35-b7b3-27b7d6fbe06c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:59.767462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05ccfc-d5df-4f35-b7b3-27b7d6fbe06c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:59.802851 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1227/2478] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:25:59.804136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05ccfc-d5df-4f35-b7b3-27b7d6fbe06c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:25:59.835444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05ccfc-d5df-4f35-b7b3-27b7d6fbe06c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:59.843128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19126a5-4fc7-45f3-adbc-9b78f6a4025b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:59.844084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19126a5-4fc7-45f3-adbc-9b78f6a4025b admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:59.845012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19126a5-4fc7-45f3-adbc-9b78f6a4025b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:59.845012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19126a5-4fc7-45f3-adbc-9b78f6a4025b admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:59.846636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19126a5-4fc7-45f3-adbc-9b78f6a4025b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:25:59.848767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19126a5-4fc7-45f3-adbc-9b78f6a4025b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:25:59.936807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eef07b-d9b5-4f26-834c-7ae4cdb07070 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:25:59.974208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e892b94-d515-478a-a57f-52f360eaded0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:25:59.974382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e892b94-d515-478a-a57f-52f360eaded0 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:25:59.978498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e892b94-d515-478a-a57f-52f360eaded0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:25:59.981683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e892b94-d515-478a-a57f-52f360eaded0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:25:59.995618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3e892b94-d515-478a-a57f-52f360eaded0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:00.027207 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1228/2479] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:25:59 2022] POST /identity/v3/projects => generated 395 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:26:00.028472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19126a5-4fc7-45f3-adbc-9b78f6a4025b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:00.146013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:00.225679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e892b94-d515-478a-a57f-52f360eaded0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:00.227597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e892b94-d515-478a-a57f-52f360eaded0 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:00.238291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19126a5-4fc7-45f3-adbc-9b78f6a4025b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:00.247818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bafa7-7ab7-46d8-9743-6d5d2ff4933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:00.248442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bafa7-7ab7-46d8-9743-6d5d2ff4933a admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:00.248719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bafa7-7ab7-46d8-9743-6d5d2ff4933a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:00.248990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bafa7-7ab7-46d8-9743-6d5d2ff4933a admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:00.249622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27bafa7-7ab7-46d8-9743-6d5d2ff4933a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:00.251187 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1252/2480] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:25:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:26:00.252065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e892b94-d515-478a-a57f-52f360eaded0 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:00.254299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27bafa7-7ab7-46d8-9743-6d5d2ff4933a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:00.269867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3e892b94-d515-478a-a57f-52f360eaded0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:00.386871 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1229/2481] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:26:00 2022] POST /identity/v3/users => generated 298 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:26:00.393205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bafa7-7ab7-46d8-9743-6d5d2ff4933a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:00.422243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bafa7-7ab7-46d8-9743-6d5d2ff4933a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:00.440741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e892b94-d515-478a-a57f-52f360eaded0 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:00.441464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c3f58-0171-407c-a6ad-6ce91a7df549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:00.443944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c3f58-0171-407c-a6ad-6ce91a7df549 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:00.445437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c3f58-0171-407c-a6ad-6ce91a7df549 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:00.446023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c3f58-0171-407c-a6ad-6ce91a7df549 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:00.448651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c3f58-0171-407c-a6ad-6ce91a7df549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:00.453605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c3f58-0171-407c-a6ad-6ce91a7df549 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:00.483308 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1230/2482] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:26:00.485719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c3f58-0171-407c-a6ad-6ce91a7df549 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:00.501854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c3f58-0171-407c-a6ad-6ce91a7df549 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:00.524849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d340e64-d8b7-4b20-aec6-c0ba96c14e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:00.526062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d340e64-d8b7-4b20-aec6-c0ba96c14e11 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:00.526062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d340e64-d8b7-4b20-aec6-c0ba96c14e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:00.526330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d340e64-d8b7-4b20-aec6-c0ba96c14e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:00.526764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d340e64-d8b7-4b20-aec6-c0ba96c14e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:00.528396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d340e64-d8b7-4b20-aec6-c0ba96c14e11 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:00.544700 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1231/2483] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:26:00.547620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d340e64-d8b7-4b20-aec6-c0ba96c14e11 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:00.556382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d27ee-7fcf-465b-ae39-f79adaca067c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:00.558773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d27ee-7fcf-465b-ae39-f79adaca067c service glance] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:00.560234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d27ee-7fcf-465b-ae39-f79adaca067c service glance] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:00.560768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d27ee-7fcf-465b-ae39-f79adaca067c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:00.563023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5f4d27ee-7fcf-465b-ae39-f79adaca067c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:00.566710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d340e64-d8b7-4b20-aec6-c0ba96c14e11 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:00.578233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4338ab-32c1-4e93-bf96-0f96572986a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:00.579062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4338ab-32c1-4e93-bf96-0f96572986a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:00.579444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4338ab-32c1-4e93-bf96-0f96572986a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:00.580087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4338ab-32c1-4e93-bf96-0f96572986a1 admin admin] PATH_INFO: `/v3/projects/b720f330b6864a0aaa60dddf7ef7570f/users/8c19104d65844f11944b25dfd602ddca/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:00.611924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4338ab-32c1-4e93-bf96-0f96572986a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b720f330b6864a0aaa60dddf7ef7570f, user_id=8c19104d65844f11944b25dfd602ddca, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:00.710145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4338ab-32c1-4e93-bf96-0f96572986a1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:00.710255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d27ee-7fcf-465b-ae39-f79adaca067c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:00.710255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d27ee-7fcf-465b-ae39-f79adaca067c service glance] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:00.710255 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1253/2484] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:00.864761 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1232/2485] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:26:00 2022] PUT /identity/v3/projects/b720f330b6864a0aaa60dddf7ef7570f/users/8c19104d65844f11944b25dfd602ddca/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:26:00.876999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c86542-76e4-4784-8756-9f97b9cdb016 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:00.877302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c86542-76e4-4784-8756-9f97b9cdb016 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:00.877616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c86542-76e4-4784-8756-9f97b9cdb016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:00.965283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-84c86542-76e4-4784-8756-9f97b9cdb016 None None] MFA Rules not processed for user `8c19104d65844f11944b25dfd602ddca`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:00.968814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-84c86542-76e4-4784-8756-9f97b9cdb016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:01.021746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:01.094503 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1254/2486] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:00 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:01.098522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4338ab-32c1-4e93-bf96-0f96572986a1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:01.119030 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:01.200140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4338ab-32c1-4e93-bf96-0f96572986a1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:01.205355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56befdf-a960-4d33-acda-e65089b8155a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:01.206673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56befdf-a960-4d33-acda-e65089b8155a admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:01.207012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56befdf-a960-4d33-acda-e65089b8155a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:01.207357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56befdf-a960-4d33-acda-e65089b8155a admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:01.208112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56befdf-a960-4d33-acda-e65089b8155a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:01.210319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56befdf-a960-4d33-acda-e65089b8155a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:01.381116 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1233/2487] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:26:01 2022] POST /identity/v3/projects => generated 393 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:26:01.381814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c86542-76e4-4784-8756-9f97b9cdb016 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:01.399948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c86542-76e4-4784-8756-9f97b9cdb016 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:01.559352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12645672-b8ba-4c9b-a1cd-21047e9a0496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:01.560077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12645672-b8ba-4c9b-a1cd-21047e9a0496 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:01.560734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12645672-b8ba-4c9b-a1cd-21047e9a0496 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:01.561165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12645672-b8ba-4c9b-a1cd-21047e9a0496 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:01.562046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12645672-b8ba-4c9b-a1cd-21047e9a0496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:01.564249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12645672-b8ba-4c9b-a1cd-21047e9a0496 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:01.654796 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1255/2488] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:26:01 2022] POST /identity/v3/users => generated 303 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:26:01.660344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56befdf-a960-4d33-acda-e65089b8155a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:01.673941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56befdf-a960-4d33-acda-e65089b8155a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:01.680056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2563973-3e4a-4090-87bb-d4fb57408fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:01.680821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2563973-3e4a-4090-87bb-d4fb57408fda admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:01.681204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2563973-3e4a-4090-87bb-d4fb57408fda admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:01.681601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2563973-3e4a-4090-87bb-d4fb57408fda admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:01.682530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2563973-3e4a-4090-87bb-d4fb57408fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:01.684452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2563973-3e4a-4090-87bb-d4fb57408fda admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:01.700884 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1234/2489] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:26:01.702416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12645672-b8ba-4c9b-a1cd-21047e9a0496 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:01.725335 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12645672-b8ba-4c9b-a1cd-21047e9a0496 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:01.749316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12802a44-c3e9-4ee0-8eb4-8f12b46f8d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:01.750175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12802a44-c3e9-4ee0-8eb4-8f12b46f8d90 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:01.750538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12802a44-c3e9-4ee0-8eb4-8f12b46f8d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:01.750884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12802a44-c3e9-4ee0-8eb4-8f12b46f8d90 admin admin] PATH_INFO: `/v3/projects/dc2e8a6386a34178b5e4cdcff91f0db3/users/6e165deb492940ac9655bfc6810979e4/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:01.774184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12802a44-c3e9-4ee0-8eb4-8f12b46f8d90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc2e8a6386a34178b5e4cdcff91f0db3, user_id=6e165deb492940ac9655bfc6810979e4, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:01.777595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12802a44-c3e9-4ee0-8eb4-8f12b46f8d90 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:01.859196 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1256/2490] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:26:01 2022] PUT /identity/v3/projects/dc2e8a6386a34178b5e4cdcff91f0db3/users/6e165deb492940ac9655bfc6810979e4/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:01.865904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2563973-3e4a-4090-87bb-d4fb57408fda admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:01.882836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2563973-3e4a-4090-87bb-d4fb57408fda admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:01.961972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b771dbb-9f75-40e9-ba55-48455e888825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:01.963176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b771dbb-9f75-40e9-ba55-48455e888825 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:01.963617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b771dbb-9f75-40e9-ba55-48455e888825 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:01.963904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b771dbb-9f75-40e9-ba55-48455e888825 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:01.965146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b771dbb-9f75-40e9-ba55-48455e888825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:01.970009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b771dbb-9f75-40e9-ba55-48455e888825 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:01.981183 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1235/2491] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:26:01.986298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12802a44-c3e9-4ee0-8eb4-8f12b46f8d90 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:02.023247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12802a44-c3e9-4ee0-8eb4-8f12b46f8d90 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:02.028887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3216f-0c47-4368-bca4-eb49560a86ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:02.029551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3216f-0c47-4368-bca4-eb49560a86ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:02.029839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3216f-0c47-4368-bca4-eb49560a86ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:02.030156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3216f-0c47-4368-bca4-eb49560a86ca admin admin] PATH_INFO: `/v3/projects/dc2e8a6386a34178b5e4cdcff91f0db3/users/6e165deb492940ac9655bfc6810979e4/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:02.032172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3216f-0c47-4368-bca4-eb49560a86ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc2e8a6386a34178b5e4cdcff91f0db3, user_id=6e165deb492940ac9655bfc6810979e4, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:02.035402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3216f-0c47-4368-bca4-eb49560a86ca admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:02.048732 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1257/2492] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:26:01 2022] PUT /identity/v3/projects/dc2e8a6386a34178b5e4cdcff91f0db3/users/6e165deb492940ac9655bfc6810979e4/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:02.062581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e731e-d207-4635-aeaf-df126e35167c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:02.062790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e731e-d207-4635-aeaf-df126e35167c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:02.063075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e731e-d207-4635-aeaf-df126e35167c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:02.100311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8d8e731e-d207-4635-aeaf-df126e35167c None None] MFA Rules not processed for user `6e165deb492940ac9655bfc6810979e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:02.102138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8d8e731e-d207-4635-aeaf-df126e35167c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:02.226659 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1236/2493] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:02 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:02.235389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3216f-0c47-4368-bca4-eb49560a86ca admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:02.240150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-37c3216f-0c47-4368-bca4-eb49560a86ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:02.350911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3216f-0c47-4368-bca4-eb49560a86ca admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:02.356782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905570e-98b2-4098-84f2-8fba5fe3e75a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:02.357405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905570e-98b2-4098-84f2-8fba5fe3e75a service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:02.357692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905570e-98b2-4098-84f2-8fba5fe3e75a service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:02.358008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905570e-98b2-4098-84f2-8fba5fe3e75a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:02.367711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905570e-98b2-4098-84f2-8fba5fe3e75a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:02.369327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905570e-98b2-4098-84f2-8fba5fe3e75a service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:02.373941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:02.380990 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1258/2494] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:02 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:02.455144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e731e-d207-4635-aeaf-df126e35167c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:02.468310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:02.531892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e731e-d207-4635-aeaf-df126e35167c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:02.537620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd68af0-60f3-44c5-a90b-6891a2aad687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:02.543247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd68af0-60f3-44c5-a90b-6891a2aad687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:02.543247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd68af0-60f3-44c5-a90b-6891a2aad687 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:02.543247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd68af0-60f3-44c5-a90b-6891a2aad687 admin admin] PATH_INFO: `/v3/users/8c19104d65844f11944b25dfd602ddca` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:02.543247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd68af0-60f3-44c5-a90b-6891a2aad687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c19104d65844f11944b25dfd602ddca)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:02.543247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd68af0-60f3-44c5-a90b-6891a2aad687 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:02.760142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bfd68af0-60f3-44c5-a90b-6891a2aad687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c19104d65844f11944b25dfd602ddca'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:02.760819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bfd68af0-60f3-44c5-a90b-6891a2aad687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c19104d65844f11944b25dfd602ddca'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:02.772019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bfd68af0-60f3-44c5-a90b-6891a2aad687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c19104d65844f11944b25dfd602ddca'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:02.788430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bfd68af0-60f3-44c5-a90b-6891a2aad687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c19104d65844f11944b25dfd602ddca'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:02.902597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bfd68af0-60f3-44c5-a90b-6891a2aad687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c19104d65844f11944b25dfd602ddca'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:02.909744 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1237/2495] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:26:02 2022] DELETE /identity/v3/users/8c19104d65844f11944b25dfd602ddca => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:02.914587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86e9ba-851a-4db4-9642-322931572c28 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:02.914991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86e9ba-851a-4db4-9642-322931572c28 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:02.915394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86e9ba-851a-4db4-9642-322931572c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:02.934732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-cc86e9ba-851a-4db4-9642-322931572c28 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:02.935950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cc86e9ba-851a-4db4-9642-322931572c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:03.005645 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1259/2496] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:26:03.015233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd68af0-60f3-44c5-a90b-6891a2aad687 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:03.016967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bfd68af0-60f3-44c5-a90b-6891a2aad687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:03.097836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd68af0-60f3-44c5-a90b-6891a2aad687 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:03.102010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e0ca9-7d4d-4498-9d80-4a5287dcd0f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:03.102879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e0ca9-7d4d-4498-9d80-4a5287dcd0f7 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:03.103165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e0ca9-7d4d-4498-9d80-4a5287dcd0f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:03.103442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e0ca9-7d4d-4498-9d80-4a5287dcd0f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:03.116898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e0ca9-7d4d-4498-9d80-4a5287dcd0f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:03.116898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e0ca9-7d4d-4498-9d80-4a5287dcd0f7 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:03.130167 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1238/2497] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:03.479362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b757c-199d-4bae-afe5-f2d9bcf7448f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:03.479629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b757c-199d-4bae-afe5-f2d9bcf7448f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:03.479897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b757c-199d-4bae-afe5-f2d9bcf7448f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:03.511689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e98b757c-199d-4bae-afe5-f2d9bcf7448f None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:03.513969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e98b757c-199d-4bae-afe5-f2d9bcf7448f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:03.583953 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1260/2498] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:26:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:03.599624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e0ca9-7d4d-4498-9d80-4a5287dcd0f7 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:03.601856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c24e0ca9-7d4d-4498-9d80-4a5287dcd0f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:03.648048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:03.671233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b757c-199d-4bae-afe5-f2d9bcf7448f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:03.673530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e98b757c-199d-4bae-afe5-f2d9bcf7448f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:03.696675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b757c-199d-4bae-afe5-f2d9bcf7448f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:03.697385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e0ca9-7d4d-4498-9d80-4a5287dcd0f7 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:03.702586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa408a2d-9e47-49ad-a7aa-04b043f4b249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:03.703344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa408a2d-9e47-49ad-a7aa-04b043f4b249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:03.703724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa408a2d-9e47-49ad-a7aa-04b043f4b249 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:03.704093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa408a2d-9e47-49ad-a7aa-04b043f4b249 admin admin] PATH_INFO: `/v3/projects/b720f330b6864a0aaa60dddf7ef7570f` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:03.704595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca77fc1-8bcb-42a1-8cdd-9401f7ded712 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:03.705623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca77fc1-8bcb-42a1-8cdd-9401f7ded712 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:03.706744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca77fc1-8bcb-42a1-8cdd-9401f7ded712 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:03.710641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca77fc1-8bcb-42a1-8cdd-9401f7ded712 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:03.710776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa408a2d-9e47-49ad-a7aa-04b043f4b249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b720f330b6864a0aaa60dddf7ef7570f)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:03.710776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa408a2d-9e47-49ad-a7aa-04b043f4b249 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:03.716941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca77fc1-8bcb-42a1-8cdd-9401f7ded712 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:03.718960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca77fc1-8bcb-42a1-8cdd-9401f7ded712 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:03.729239 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1239/2499] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:26:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:26:03.831925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-aa408a2d-9e47-49ad-a7aa-04b043f4b249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b720f330b6864a0aaa60dddf7ef7570f', 'request_id': 'req-aa408a2d-9e47-49ad-a7aa-04b043f4b249'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:03.838707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-aa408a2d-9e47-49ad-a7aa-04b043f4b249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b720f330b6864a0aaa60dddf7ef7570f', 'request_id': 'req-aa408a2d-9e47-49ad-a7aa-04b043f4b249'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:03.845528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-aa408a2d-9e47-49ad-a7aa-04b043f4b249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b720f330b6864a0aaa60dddf7ef7570f', 'request_id': 'req-aa408a2d-9e47-49ad-a7aa-04b043f4b249'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:03.912524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-aa408a2d-9e47-49ad-a7aa-04b043f4b249 admin admin] The token cache is being invalidate because project b720f330b6864a0aaa60dddf7ef7570f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:26:03.912918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-aa408a2d-9e47-49ad-a7aa-04b043f4b249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:03.916753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-aa408a2d-9e47-49ad-a7aa-04b043f4b249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:03.919642 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1261/2500] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:03 2022] DELETE /identity/v3/projects/b720f330b6864a0aaa60dddf7ef7570f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:26:03.923813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca77fc1-8bcb-42a1-8cdd-9401f7ded712 service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:03.945564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca77fc1-8bcb-42a1-8cdd-9401f7ded712 service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:04.023951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e601e9d-dd65-4025-95ae-0580e199c60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:04.025144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e601e9d-dd65-4025-95ae-0580e199c60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:04.025601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e601e9d-dd65-4025-95ae-0580e199c60d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:04.025878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e601e9d-dd65-4025-95ae-0580e199c60d admin admin] PATH_INFO: `/v3/users/6e165deb492940ac9655bfc6810979e4` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:04.027107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e601e9d-dd65-4025-95ae-0580e199c60d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e165deb492940ac9655bfc6810979e4)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:04.029086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e601e9d-dd65-4025-95ae-0580e199c60d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:04.272481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8e601e9d-dd65-4025-95ae-0580e199c60d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e165deb492940ac9655bfc6810979e4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:04.273438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8e601e9d-dd65-4025-95ae-0580e199c60d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e165deb492940ac9655bfc6810979e4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:04.284663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8e601e9d-dd65-4025-95ae-0580e199c60d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e165deb492940ac9655bfc6810979e4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:04.300130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8e601e9d-dd65-4025-95ae-0580e199c60d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e165deb492940ac9655bfc6810979e4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:04.365586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8e601e9d-dd65-4025-95ae-0580e199c60d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e165deb492940ac9655bfc6810979e4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:04.373039 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1240/2501] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:26:03 2022] DELETE /identity/v3/users/6e165deb492940ac9655bfc6810979e4 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:04.922449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa408a2d-9e47-49ad-a7aa-04b043f4b249 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:04.924443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-aa408a2d-9e47-49ad-a7aa-04b043f4b249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:04.966860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa408a2d-9e47-49ad-a7aa-04b043f4b249 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:05.006366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:05.117857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b83128-70d7-4730-a3d4-febde760f86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:05.118739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b83128-70d7-4730-a3d4-febde760f86a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:05.119165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b83128-70d7-4730-a3d4-febde760f86a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:05.119451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b83128-70d7-4730-a3d4-febde760f86a admin admin] PATH_INFO: `/v3/projects/dc2e8a6386a34178b5e4cdcff91f0db3` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:05.120767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b83128-70d7-4730-a3d4-febde760f86a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc2e8a6386a34178b5e4cdcff91f0db3)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:05.125417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b83128-70d7-4730-a3d4-febde760f86a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:05.304657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c7b83128-70d7-4730-a3d4-febde760f86a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc2e8a6386a34178b5e4cdcff91f0db3', 'request_id': 'req-c7b83128-70d7-4730-a3d4-febde760f86a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:05.317645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c7b83128-70d7-4730-a3d4-febde760f86a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc2e8a6386a34178b5e4cdcff91f0db3', 'request_id': 'req-c7b83128-70d7-4730-a3d4-febde760f86a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:05.324762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c7b83128-70d7-4730-a3d4-febde760f86a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc2e8a6386a34178b5e4cdcff91f0db3', 'request_id': 'req-c7b83128-70d7-4730-a3d4-febde760f86a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:05.416248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ef58e-a530-4e11-82ad-a05c98fa1ac6 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:05.417296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ef58e-a530-4e11-82ad-a05c98fa1ac6 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:05.417779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ef58e-a530-4e11-82ad-a05c98fa1ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:05.425914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c7b83128-70d7-4730-a3d4-febde760f86a admin admin] The token cache is being invalidate because project dc2e8a6386a34178b5e4cdcff91f0db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:26:05.427910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c7b83128-70d7-4730-a3d4-febde760f86a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:05.427910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c7b83128-70d7-4730-a3d4-febde760f86a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:05.428986 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1262/2502] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:04 2022] DELETE /identity/v3/projects/dc2e8a6386a34178b5e4cdcff91f0db3 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:05.436194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a34cd0-da25-442b-b63d-193939b9e17a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:05.437272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a34cd0-da25-442b-b63d-193939b9e17a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:05.437557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a34cd0-da25-442b-b63d-193939b9e17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:05.472960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f86ef58e-a530-4e11-82ad-a05c98fa1ac6 None None] MFA Rules not processed for user `1d6175f2ac39494f8cba3db225150d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:05.477083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f86ef58e-a530-4e11-82ad-a05c98fa1ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:05.483380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b7a34cd0-da25-442b-b63d-193939b9e17a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:05.487326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b7a34cd0-da25-442b-b63d-193939b9e17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:05.552008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:05.615855 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1241/2503] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:05.644536 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1263/2504] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:05.645861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba4c92-12ca-443a-93c3-9e3bfd9b6ef4 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:05.646078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba4c92-12ca-443a-93c3-9e3bfd9b6ef4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:05.646299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba4c92-12ca-443a-93c3-9e3bfd9b6ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:05.705022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b8ba4c92-12ca-443a-93c3-9e3bfd9b6ef4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:05.707542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b8ba4c92-12ca-443a-93c3-9e3bfd9b6ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:05.718536 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1242/2505] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:26:05.723046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a34cd0-da25-442b-b63d-193939b9e17a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:05.738671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a34cd0-da25-442b-b63d-193939b9e17a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:05.744541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9c49f-5dac-47c7-9d61-1c3602141c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:05.745508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9c49f-5dac-47c7-9d61-1c3602141c46 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:05.751226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9c49f-5dac-47c7-9d61-1c3602141c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:05.751226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9c49f-5dac-47c7-9d61-1c3602141c46 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:05.751226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9c49f-5dac-47c7-9d61-1c3602141c46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:26:05.751226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9c49f-5dac-47c7-9d61-1c3602141c46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:05.760810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9c49f-5dac-47c7-9d61-1c3602141c46 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:05.797364 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1264/2506] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:26:05.799837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba4c92-12ca-443a-93c3-9e3bfd9b6ef4 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:05.812112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba4c92-12ca-443a-93c3-9e3bfd9b6ef4 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:05.824229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78abdda-5844-401d-b430-cdab93208f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:05.825960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78abdda-5844-401d-b430-cdab93208f42 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:05.826666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78abdda-5844-401d-b430-cdab93208f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:05.827136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78abdda-5844-401d-b430-cdab93208f42 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:05.828124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78abdda-5844-401d-b430-cdab93208f42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:05.831453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78abdda-5844-401d-b430-cdab93208f42 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:05.943092 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1243/2507] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:26:05 2022] POST /identity/v3/projects => generated 409 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:26:05.945941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9c49f-5dac-47c7-9d61-1c3602141c46 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:05.959912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9c49f-5dac-47c7-9d61-1c3602141c46 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:06.073354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:06.144514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503a546-0d6d-421c-a5f7-9a5e5bbd2b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:06.147069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503a546-0d6d-421c-a5f7-9a5e5bbd2b7c admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:06.147371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503a546-0d6d-421c-a5f7-9a5e5bbd2b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:06.147651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503a546-0d6d-421c-a5f7-9a5e5bbd2b7c admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:06.152648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503a546-0d6d-421c-a5f7-9a5e5bbd2b7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:06.154668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503a546-0d6d-421c-a5f7-9a5e5bbd2b7c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:06.304883 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1265/2508] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:26:05 2022] POST /identity/v3/users => generated 305 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:26:06.306472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78abdda-5844-401d-b430-cdab93208f42 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:06.323704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78abdda-5844-401d-b430-cdab93208f42 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:06.337327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1a815-0105-46de-9947-79133fbfe002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:06.337985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1a815-0105-46de-9947-79133fbfe002 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:06.338297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1a815-0105-46de-9947-79133fbfe002 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:06.338580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1a815-0105-46de-9947-79133fbfe002 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:06.339244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1a815-0105-46de-9947-79133fbfe002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:06.341324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1a815-0105-46de-9947-79133fbfe002 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:06.373562 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1244/2509] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:26:06.377921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503a546-0d6d-421c-a5f7-9a5e5bbd2b7c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:06.395697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503a546-0d6d-421c-a5f7-9a5e5bbd2b7c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:06.407525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16d23d-576d-4007-b3e4-b3bb19085011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:06.408168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16d23d-576d-4007-b3e4-b3bb19085011 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:06.408452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16d23d-576d-4007-b3e4-b3bb19085011 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:06.408738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16d23d-576d-4007-b3e4-b3bb19085011 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:06.410072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16d23d-576d-4007-b3e4-b3bb19085011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:06.411633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16d23d-576d-4007-b3e4-b3bb19085011 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:06.439270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1a815-0105-46de-9947-79133fbfe002 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:06.439877 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1266/2510] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:26:06.462805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1a815-0105-46de-9947-79133fbfe002 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:06.485727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eee957-45b5-499e-becb-df52872b16fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:06.485727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eee957-45b5-499e-becb-df52872b16fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:06.487778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eee957-45b5-499e-becb-df52872b16fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:06.488074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eee957-45b5-499e-becb-df52872b16fc admin admin] PATH_INFO: `/v3/projects/ba57de09ea74467396f82dcf36761480/users/27ed0670f5264d81b3fc2542eea5467f/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:06.557220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eee957-45b5-499e-becb-df52872b16fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba57de09ea74467396f82dcf36761480, user_id=27ed0670f5264d81b3fc2542eea5467f, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:06.560001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eee957-45b5-499e-becb-df52872b16fc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:06.668763 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1245/2511] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:26:06 2022] PUT /identity/v3/projects/ba57de09ea74467396f82dcf36761480/users/27ed0670f5264d81b3fc2542eea5467f/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:06.681178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e3bb0-9594-4832-90f0-bc9fd7bf2cf3 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:06.682706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e3bb0-9594-4832-90f0-bc9fd7bf2cf3 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:06.683141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e3bb0-9594-4832-90f0-bc9fd7bf2cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:06.790149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a73e3bb0-9594-4832-90f0-bc9fd7bf2cf3 None None] MFA Rules not processed for user `27ed0670f5264d81b3fc2542eea5467f`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:06.798178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a73e3bb0-9594-4832-90f0-bc9fd7bf2cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:06.805908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eee957-45b5-499e-becb-df52872b16fc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:06.809327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-75eee957-45b5-499e-becb-df52872b16fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:07.004529 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1267/2512] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:06 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:07.005424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e3bb0-9594-4832-90f0-bc9fd7bf2cf3 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:07.006759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a73e3bb0-9594-4832-90f0-bc9fd7bf2cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:07.026566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eee957-45b5-499e-becb-df52872b16fc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:07.041972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70746b5d-0eee-4634-804f-f0326b8af863 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:07.042642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70746b5d-0eee-4634-804f-f0326b8af863 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:07.042927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70746b5d-0eee-4634-804f-f0326b8af863 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:07.043198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70746b5d-0eee-4634-804f-f0326b8af863 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:07.049407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-70746b5d-0eee-4634-804f-f0326b8af863 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:07.081563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70746b5d-0eee-4634-804f-f0326b8af863 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:07.083251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70746b5d-0eee-4634-804f-f0326b8af863 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:07.131448 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1246/2513] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:07.132451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70746b5d-0eee-4634-804f-f0326b8af863 service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:07.237074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e3bb0-9594-4832-90f0-bc9fd7bf2cf3 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:07.249020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1245f5-6054-47a9-9c43-b5f5c181fc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:07.250054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1245f5-6054-47a9-9c43-b5f5c181fc9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:07.251010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1245f5-6054-47a9-9c43-b5f5c181fc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:07.252025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1245f5-6054-47a9-9c43-b5f5c181fc9f admin admin] PATH_INFO: `/v3/users/2ccd5909fb214f71ad68704019c9e4f0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:07.254626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1245f5-6054-47a9-9c43-b5f5c181fc9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ccd5909fb214f71ad68704019c9e4f0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:07.256573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1245f5-6054-47a9-9c43-b5f5c181fc9f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:07.356968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70746b5d-0eee-4634-804f-f0326b8af863 service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:07.361831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ceae69-371f-442d-8468-6170d1f4458c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:07.362572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ceae69-371f-442d-8468-6170d1f4458c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:07.362853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ceae69-371f-442d-8468-6170d1f4458c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:07.363125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ceae69-371f-442d-8468-6170d1f4458c admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:07.363768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ceae69-371f-442d-8468-6170d1f4458c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:07.365721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ceae69-371f-442d-8468-6170d1f4458c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:07.394867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:07.497673 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1247/2514] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:26:07 2022] POST /identity/v3/projects => generated 411 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:26:07.498627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ceae69-371f-442d-8468-6170d1f4458c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:07.529661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:07.535123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c1245f5-6054-47a9-9c43-b5f5c181fc9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ccd5909fb214f71ad68704019c9e4f0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:07.538457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c1245f5-6054-47a9-9c43-b5f5c181fc9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ccd5909fb214f71ad68704019c9e4f0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:07.562896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c1245f5-6054-47a9-9c43-b5f5c181fc9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ccd5909fb214f71ad68704019c9e4f0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:07.599125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c1245f5-6054-47a9-9c43-b5f5c181fc9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ccd5909fb214f71ad68704019c9e4f0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:07.600127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c1245f5-6054-47a9-9c43-b5f5c181fc9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ccd5909fb214f71ad68704019c9e4f0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:07.661410 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1268/2515] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:26:07 2022] DELETE /identity/v3/users/2ccd5909fb214f71ad68704019c9e4f0 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:07.666641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454a9e8-39b2-4b52-a896-73806377df4e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:07.668374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454a9e8-39b2-4b52-a896-73806377df4e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:07.668969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454a9e8-39b2-4b52-a896-73806377df4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:07.688527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ceae69-371f-442d-8468-6170d1f4458c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:07.723820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7454a9e8-39b2-4b52-a896-73806377df4e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:07.726329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7454a9e8-39b2-4b52-a896-73806377df4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:07.826861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bd3f9-ad22-48ea-97a1-7653cddd051f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:07.827888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bd3f9-ad22-48ea-97a1-7653cddd051f admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:07.828172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bd3f9-ad22-48ea-97a1-7653cddd051f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:07.828729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bd3f9-ad22-48ea-97a1-7653cddd051f admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:07.829428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bd3f9-ad22-48ea-97a1-7653cddd051f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:07.831800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bd3f9-ad22-48ea-97a1-7653cddd051f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:07.847395 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1269/2516] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:07.876672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454a9e8-39b2-4b52-a896-73806377df4e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:07.884230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7454a9e8-39b2-4b52-a896-73806377df4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:07.996900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454a9e8-39b2-4b52-a896-73806377df4e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:08.016719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a38a9-155c-42a3-8ee0-c1489423ed67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:08.017633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a38a9-155c-42a3-8ee0-c1489423ed67 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:08.018547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a38a9-155c-42a3-8ee0-c1489423ed67 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:08.018902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a38a9-155c-42a3-8ee0-c1489423ed67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:08.020441 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1248/2517] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:26:07 2022] POST /identity/v3/users => generated 312 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:26:08.024182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bd3f9-ad22-48ea-97a1-7653cddd051f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:08.029363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b62bd3f9-ad22-48ea-97a1-7653cddd051f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:08.042730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a38a9-155c-42a3-8ee0-c1489423ed67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:08.044461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a38a9-155c-42a3-8ee0-c1489423ed67 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:08.050753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bd3f9-ad22-48ea-97a1-7653cddd051f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:08.059791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb35d49-78c5-4d49-85c4-119b09bfc280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:08.060563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb35d49-78c5-4d49-85c4-119b09bfc280 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:08.060906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb35d49-78c5-4d49-85c4-119b09bfc280 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:08.061245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb35d49-78c5-4d49-85c4-119b09bfc280 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:08.062406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb35d49-78c5-4d49-85c4-119b09bfc280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:08.064275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb35d49-78c5-4d49-85c4-119b09bfc280 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:08.068741 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1270/2518] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:08.092107 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1249/2519] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:26:08.092445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a38a9-155c-42a3-8ee0-c1489423ed67 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:08.103658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a38a9-155c-42a3-8ee0-c1489423ed67 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:08.119028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a442e1-7f51-4813-92db-7b946e776939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:08.119721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a442e1-7f51-4813-92db-7b946e776939 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:08.120010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a442e1-7f51-4813-92db-7b946e776939 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:08.120295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a442e1-7f51-4813-92db-7b946e776939 admin admin] PATH_INFO: `/v3/projects/26d595e9c1ba430cb825e41001c96744/users/0964ab9d4f294398a0c92e2b0fb9fa30/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:08.165074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a442e1-7f51-4813-92db-7b946e776939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d595e9c1ba430cb825e41001c96744, user_id=0964ab9d4f294398a0c92e2b0fb9fa30, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:08.168553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a442e1-7f51-4813-92db-7b946e776939 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:08.293432 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1271/2520] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:26:08 2022] PUT /identity/v3/projects/26d595e9c1ba430cb825e41001c96744/users/0964ab9d4f294398a0c92e2b0fb9fa30/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:26:08.309526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb35d49-78c5-4d49-85c4-119b09bfc280 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:08.328347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb35d49-78c5-4d49-85c4-119b09bfc280 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:08.464230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144da59-7f5f-4639-ae26-c9b146fd4a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:08.465324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144da59-7f5f-4639-ae26-c9b146fd4a25 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:08.465822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144da59-7f5f-4639-ae26-c9b146fd4a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:08.466355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144da59-7f5f-4639-ae26-c9b146fd4a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:08.466877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a442e1-7f51-4813-92db-7b946e776939 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:08.467427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144da59-7f5f-4639-ae26-c9b146fd4a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:08.468618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c2a442e1-7f51-4813-92db-7b946e776939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:08.470066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144da59-7f5f-4639-ae26-c9b146fd4a25 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:08.484893 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1250/2521] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:26:08.489003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a442e1-7f51-4813-92db-7b946e776939 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:08.497283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144da59-7f5f-4639-ae26-c9b146fd4a25 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:08.504996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2301b3-9bef-464e-a080-7676f641f042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:08.505680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2301b3-9bef-464e-a080-7676f641f042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:08.505972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2301b3-9bef-464e-a080-7676f641f042 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:08.506282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2301b3-9bef-464e-a080-7676f641f042 admin admin] PATH_INFO: `/v3/projects/49d2c150feac4d03966a860ab8bafe00` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:08.508090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2301b3-9bef-464e-a080-7676f641f042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d2c150feac4d03966a860ab8bafe00)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:08.510067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2301b3-9bef-464e-a080-7676f641f042 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:08.521362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144da59-7f5f-4639-ae26-c9b146fd4a25 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:08.525726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78eeb6-7e5e-4528-8021-93c65d5c5c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:08.526558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78eeb6-7e5e-4528-8021-93c65d5c5c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:08.526907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78eeb6-7e5e-4528-8021-93c65d5c5c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:08.527255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78eeb6-7e5e-4528-8021-93c65d5c5c10 admin admin] PATH_INFO: `/v3/projects/26d595e9c1ba430cb825e41001c96744/users/0964ab9d4f294398a0c92e2b0fb9fa30/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:08.529690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78eeb6-7e5e-4528-8021-93c65d5c5c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d595e9c1ba430cb825e41001c96744, user_id=0964ab9d4f294398a0c92e2b0fb9fa30, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:08.533421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78eeb6-7e5e-4528-8021-93c65d5c5c10 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:08.550549 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1251/2522] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:26:08 2022] PUT /identity/v3/projects/26d595e9c1ba430cb825e41001c96744/users/0964ab9d4f294398a0c92e2b0fb9fa30/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:08.561702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adbf32-cfe7-435a-8e13-f15fb24bb71d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:08.562624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adbf32-cfe7-435a-8e13-f15fb24bb71d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:08.562624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adbf32-cfe7-435a-8e13-f15fb24bb71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:08.576494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:08.604938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-46adbf32-cfe7-435a-8e13-f15fb24bb71d None None] MFA Rules not processed for user `0964ab9d4f294398a0c92e2b0fb9fa30`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:08.604938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-46adbf32-cfe7-435a-8e13-f15fb24bb71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:08.680701 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1252/2523] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:08 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:26:08.692829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adbf32-cfe7-435a-8e13-f15fb24bb71d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:08.704767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:08.744369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7a2301b3-9bef-464e-a080-7676f641f042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d2c150feac4d03966a860ab8bafe00', 'request_id': 'req-7a2301b3-9bef-464e-a080-7676f641f042'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:08.760569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7a2301b3-9bef-464e-a080-7676f641f042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d2c150feac4d03966a860ab8bafe00', 'request_id': 'req-7a2301b3-9bef-464e-a080-7676f641f042'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:08.770819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7a2301b3-9bef-464e-a080-7676f641f042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d2c150feac4d03966a860ab8bafe00', 'request_id': 'req-7a2301b3-9bef-464e-a080-7676f641f042'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:08.814062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adbf32-cfe7-435a-8e13-f15fb24bb71d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:08.857384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7a2301b3-9bef-464e-a080-7676f641f042 admin admin] The token cache is being invalidate because project 49d2c150feac4d03966a860ab8bafe00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:26:08.858398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7a2301b3-9bef-464e-a080-7676f641f042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:08.859756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7a2301b3-9bef-464e-a080-7676f641f042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:08.862422 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1272/2524] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:08 2022] DELETE /identity/v3/projects/49d2c150feac4d03966a860ab8bafe00 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:08.863453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2301b3-9bef-464e-a080-7676f641f042 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:08.865589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7a2301b3-9bef-464e-a080-7676f641f042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:08.895366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c590e-3a20-4d96-9833-e4e96901a0bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:08.895366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c590e-3a20-4d96-9833-e4e96901a0bf service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:08.895366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c590e-3a20-4d96-9833-e4e96901a0bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:08.895366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c590e-3a20-4d96-9833-e4e96901a0bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:08.911304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7e1c590e-3a20-4d96-9833-e4e96901a0bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:08.943929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c590e-3a20-4d96-9833-e4e96901a0bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:08.945413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c590e-3a20-4d96-9833-e4e96901a0bf service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:08.962341 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1253/2525] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:08.963042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c590e-3a20-4d96-9833-e4e96901a0bf service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:08.965470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7e1c590e-3a20-4d96-9833-e4e96901a0bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:09.027177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2301b3-9bef-464e-a080-7676f641f042 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:09.045034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d880d28-16b5-47fa-97f6-1a7c3beba8b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:09.045944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d880d28-16b5-47fa-97f6-1a7c3beba8b1 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:09.046259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d880d28-16b5-47fa-97f6-1a7c3beba8b1 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:09.046544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d880d28-16b5-47fa-97f6-1a7c3beba8b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:09.052406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2d880d28-16b5-47fa-97f6-1a7c3beba8b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:09.141140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:09.186793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c590e-3a20-4d96-9833-e4e96901a0bf service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:09.209326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e245c-02dd-4e10-8d6e-6bfaea8cedd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:09.210264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e245c-02dd-4e10-8d6e-6bfaea8cedd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:09.210958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e245c-02dd-4e10-8d6e-6bfaea8cedd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:09.211421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e245c-02dd-4e10-8d6e-6bfaea8cedd5 admin admin] PATH_INFO: `/v3/users/fc8e662e5b2f4e32ba368bd697294803` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:09.212892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e245c-02dd-4e10-8d6e-6bfaea8cedd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc8e662e5b2f4e32ba368bd697294803)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:09.215130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e245c-02dd-4e10-8d6e-6bfaea8cedd5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:09.252181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d880d28-16b5-47fa-97f6-1a7c3beba8b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:09.254614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d880d28-16b5-47fa-97f6-1a7c3beba8b1 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:09.292439 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1273/2526] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:08 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:09.508760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-179e245c-02dd-4e10-8d6e-6bfaea8cedd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc8e662e5b2f4e32ba368bd697294803'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:09.513245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-179e245c-02dd-4e10-8d6e-6bfaea8cedd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc8e662e5b2f4e32ba368bd697294803'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:09.537532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-179e245c-02dd-4e10-8d6e-6bfaea8cedd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc8e662e5b2f4e32ba368bd697294803'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:09.577664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-179e245c-02dd-4e10-8d6e-6bfaea8cedd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc8e662e5b2f4e32ba368bd697294803'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:09.659703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-179e245c-02dd-4e10-8d6e-6bfaea8cedd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc8e662e5b2f4e32ba368bd697294803'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:09.668743 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1254/2527] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:26:08 2022] DELETE /identity/v3/users/fc8e662e5b2f4e32ba368bd697294803 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:10.168706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d880d28-16b5-47fa-97f6-1a7c3beba8b1 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:10.202719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d880d28-16b5-47fa-97f6-1a7c3beba8b1 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:10.287203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:10.316090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054cf3f-eb39-42b4-b06f-62dcbefe09d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:10.319165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054cf3f-eb39-42b4-b06f-62dcbefe09d6 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:10.322396 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054cf3f-eb39-42b4-b06f-62dcbefe09d6 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:10.324727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054cf3f-eb39-42b4-b06f-62dcbefe09d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:10.327677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6054cf3f-eb39-42b4-b06f-62dcbefe09d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:10.423797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054cf3f-eb39-42b4-b06f-62dcbefe09d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:10.428963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054cf3f-eb39-42b4-b06f-62dcbefe09d6 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:10.461713 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1274/2528] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:10 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:10.516320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e245c-02dd-4e10-8d6e-6bfaea8cedd5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:10.516320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-179e245c-02dd-4e10-8d6e-6bfaea8cedd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:10.529391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5d812-2359-4641-b68f-52bfadd0a985 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:10.529618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5d812-2359-4641-b68f-52bfadd0a985 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:10.529996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5d812-2359-4641-b68f-52bfadd0a985 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:10.531616 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1275/2529] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 27 03:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:26:10.543242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41d38e-b44b-4bf8-82b2-a4a4e5ef2ac8 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:10.543537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41d38e-b44b-4bf8-82b2-a4a4e5ef2ac8 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:10.544307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41d38e-b44b-4bf8-82b2-a4a4e5ef2ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:10.604862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9e41d38e-b44b-4bf8-82b2-a4a4e5ef2ac8 None None] MFA Rules not processed for user `1a395d2414cd4da085a77ddc9b1f1caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:10.606265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9e41d38e-b44b-4bf8-82b2-a4a4e5ef2ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:10.683507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e245c-02dd-4e10-8d6e-6bfaea8cedd5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:10.688883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c21010-0b15-4bd4-b0fb-a443758f1f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:10.689711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c21010-0b15-4bd4-b0fb-a443758f1f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:10.691195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c21010-0b15-4bd4-b0fb-a443758f1f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:10.691858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c21010-0b15-4bd4-b0fb-a443758f1f5d admin admin] PATH_INFO: `/v3/users/27ed0670f5264d81b3fc2542eea5467f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:10.692837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c21010-0b15-4bd4-b0fb-a443758f1f5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=27ed0670f5264d81b3fc2542eea5467f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:10.695686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c21010-0b15-4bd4-b0fb-a443758f1f5d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:10.710919 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1276/2530] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 03:26:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:26:10.712189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41d38e-b44b-4bf8-82b2-a4a4e5ef2ac8 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:10.714783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9e41d38e-b44b-4bf8-82b2-a4a4e5ef2ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:10.747696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41d38e-b44b-4bf8-82b2-a4a4e5ef2ac8 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:10.761699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7a915-7123-4c96-a8fe-f320615f0d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:10.762720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7a915-7123-4c96-a8fe-f320615f0d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:10.763074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7a915-7123-4c96-a8fe-f320615f0d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:10.763416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7a915-7123-4c96-a8fe-f320615f0d64 admin admin] PATH_INFO: `/v3/projects/dc250ed4d4ca4645bbb9bd83d3d3ac9f` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:10.764889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7a915-7123-4c96-a8fe-f320615f0d64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc250ed4d4ca4645bbb9bd83d3d3ac9f)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:10.766963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7a915-7123-4c96-a8fe-f320615f0d64 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:10.938219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-57c21010-0b15-4bd4-b0fb-a443758f1f5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27ed0670f5264d81b3fc2542eea5467f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:10.938759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-57c21010-0b15-4bd4-b0fb-a443758f1f5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27ed0670f5264d81b3fc2542eea5467f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:10.954750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-57c21010-0b15-4bd4-b0fb-a443758f1f5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27ed0670f5264d81b3fc2542eea5467f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:10.977816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cae7a915-7123-4c96-a8fe-f320615f0d64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc250ed4d4ca4645bbb9bd83d3d3ac9f', 'request_id': 'req-cae7a915-7123-4c96-a8fe-f320615f0d64'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:10.989281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cae7a915-7123-4c96-a8fe-f320615f0d64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc250ed4d4ca4645bbb9bd83d3d3ac9f', 'request_id': 'req-cae7a915-7123-4c96-a8fe-f320615f0d64'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:11.004746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cae7a915-7123-4c96-a8fe-f320615f0d64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc250ed4d4ca4645bbb9bd83d3d3ac9f', 'request_id': 'req-cae7a915-7123-4c96-a8fe-f320615f0d64'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:11.008955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:11.018072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-57c21010-0b15-4bd4-b0fb-a443758f1f5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27ed0670f5264d81b3fc2542eea5467f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:11.114740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cae7a915-7123-4c96-a8fe-f320615f0d64 admin admin] The token cache is being invalidate because project dc250ed4d4ca4645bbb9bd83d3d3ac9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:26:11.115271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cae7a915-7123-4c96-a8fe-f320615f0d64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:11.116313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cae7a915-7123-4c96-a8fe-f320615f0d64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:11.118940 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1277/2531] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:10 2022] DELETE /identity/v3/projects/dc250ed4d4ca4645bbb9bd83d3d3ac9f => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:11.120060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7a915-7123-4c96-a8fe-f320615f0d64 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:11.123139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cae7a915-7123-4c96-a8fe-f320615f0d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:11.161612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:11.240641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-57c21010-0b15-4bd4-b0fb-a443758f1f5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27ed0670f5264d81b3fc2542eea5467f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:11.247648 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1255/2532] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:26:10 2022] DELETE /identity/v3/users/27ed0670f5264d81b3fc2542eea5467f => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:11.248582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c21010-0b15-4bd4-b0fb-a443758f1f5d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:11.251064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-57c21010-0b15-4bd4-b0fb-a443758f1f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:11.308235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7a915-7123-4c96-a8fe-f320615f0d64 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:11.376790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c21010-0b15-4bd4-b0fb-a443758f1f5d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:11.389520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fee6a0-543a-4c73-8303-918c41732482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:11.392491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fee6a0-543a-4c73-8303-918c41732482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:11.392787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fee6a0-543a-4c73-8303-918c41732482 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:11.393076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fee6a0-543a-4c73-8303-918c41732482 admin admin] PATH_INFO: `/v3/users/1245e7aa1c6a420fa7ebe0c098a6396a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:11.394404 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fee6a0-543a-4c73-8303-918c41732482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1245e7aa1c6a420fa7ebe0c098a6396a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:11.396609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fee6a0-543a-4c73-8303-918c41732482 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:11.408938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee5738-01b0-4337-8388-c6f992cb5c5b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:11.409888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee5738-01b0-4337-8388-c6f992cb5c5b service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:11.410196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee5738-01b0-4337-8388-c6f992cb5c5b service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:11.410419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee5738-01b0-4337-8388-c6f992cb5c5b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:11.412682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-32ee5738-01b0-4337-8388-c6f992cb5c5b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:11.429451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee5738-01b0-4337-8388-c6f992cb5c5b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:11.431429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee5738-01b0-4337-8388-c6f992cb5c5b service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:11.443800 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1278/2533] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:11.445136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620c2f5-7cd4-40ad-a579-012ccf15cff3 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:11.445563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620c2f5-7cd4-40ad-a579-012ccf15cff3 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:11.446537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620c2f5-7cd4-40ad-a579-012ccf15cff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:11.482982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2620c2f5-7cd4-40ad-a579-012ccf15cff3 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:11.484235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2620c2f5-7cd4-40ad-a579-012ccf15cff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:11.500863 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1279/2534] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:11.503635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4923c7-de29-4a90-86b5-a554c14410d5 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:11.504314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4923c7-de29-4a90-86b5-a554c14410d5 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:11.504640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4923c7-de29-4a90-86b5-a554c14410d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:11.561831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4b4923c7-de29-4a90-86b5-a554c14410d5 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:11.561831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4b4923c7-de29-4a90-86b5-a554c14410d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:11.561831 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1280/2535] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:11.561831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4592e35-c00e-473d-8a97-caa1d79a2c62 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:11.562309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4592e35-c00e-473d-8a97-caa1d79a2c62 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:11.562606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4592e35-c00e-473d-8a97-caa1d79a2c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:11.587325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e4592e35-c00e-473d-8a97-caa1d79a2c62 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:11.595864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e4592e35-c00e-473d-8a97-caa1d79a2c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:11.605982 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1281/2536] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:11.613404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4592e35-c00e-473d-8a97-caa1d79a2c62 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:11.625123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4592e35-c00e-473d-8a97-caa1d79a2c62 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:11.634944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-61fee6a0-543a-4c73-8303-918c41732482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1245e7aa1c6a420fa7ebe0c098a6396a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:11.638610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-61fee6a0-543a-4c73-8303-918c41732482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1245e7aa1c6a420fa7ebe0c098a6396a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:11.645920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3f2ba-22a7-44c4-bebf-51a283da0f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:11.648234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3f2ba-22a7-44c4-bebf-51a283da0f47 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:11.648695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3f2ba-22a7-44c4-bebf-51a283da0f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:11.649162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3f2ba-22a7-44c4-bebf-51a283da0f47 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:11.651132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e3f2ba-22a7-44c4-bebf-51a283da0f47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:26:11.651613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e3f2ba-22a7-44c4-bebf-51a283da0f47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:11.653445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e3f2ba-22a7-44c4-bebf-51a283da0f47 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:11.657688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-61fee6a0-543a-4c73-8303-918c41732482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1245e7aa1c6a420fa7ebe0c098a6396a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:11.687268 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1282/2537] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:26:11.688398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3f2ba-22a7-44c4-bebf-51a283da0f47 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:11.691053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d6e3f2ba-22a7-44c4-bebf-51a283da0f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:11.710088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-61fee6a0-543a-4c73-8303-918c41732482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1245e7aa1c6a420fa7ebe0c098a6396a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:11.775765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-61fee6a0-543a-4c73-8303-918c41732482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1245e7aa1c6a420fa7ebe0c098a6396a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:11.775974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3f2ba-22a7-44c4-bebf-51a283da0f47 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:11.781522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c601e7-a33b-4e22-9c2d-89ccaae0c3d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:11.782269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c601e7-a33b-4e22-9c2d-89ccaae0c3d4 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:11.782560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c601e7-a33b-4e22-9c2d-89ccaae0c3d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:11.782839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c601e7-a33b-4e22-9c2d-89ccaae0c3d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:11.785665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-87c601e7-a33b-4e22-9c2d-89ccaae0c3d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:11.796401 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1256/2538] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:26:11 2022] DELETE /identity/v3/users/1245e7aa1c6a420fa7ebe0c098a6396a => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:11.798600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fee6a0-543a-4c73-8303-918c41732482 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:11.807776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-61fee6a0-543a-4c73-8303-918c41732482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:11.819621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c601e7-a33b-4e22-9c2d-89ccaae0c3d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:11.822388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c601e7-a33b-4e22-9c2d-89ccaae0c3d4 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:11.851806 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1283/2539] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:11.969200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fee6a0-543a-4c73-8303-918c41732482 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:11.975603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974cdca-63b1-4e13-b273-5d15c1b9b8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:11.976336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974cdca-63b1-4e13-b273-5d15c1b9b8a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:11.977344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974cdca-63b1-4e13-b273-5d15c1b9b8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:11.977705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974cdca-63b1-4e13-b273-5d15c1b9b8a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:11.978498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974cdca-63b1-4e13-b273-5d15c1b9b8a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:11.982576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974cdca-63b1-4e13-b273-5d15c1b9b8a8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:12.145485 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1257/2540] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:26:11 2022] POST /identity/v3/projects => generated 377 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:26:12.145584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c601e7-a33b-4e22-9c2d-89ccaae0c3d4 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:12.155882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c601e7-a33b-4e22-9c2d-89ccaae0c3d4 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:12.176532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974cdca-63b1-4e13-b273-5d15c1b9b8a8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:12.178858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9974cdca-63b1-4e13-b273-5d15c1b9b8a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:12.224667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:12.282697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974cdca-63b1-4e13-b273-5d15c1b9b8a8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:12.285532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a8f3d-c688-44fb-968a-e4a0a157f47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:12.286211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a8f3d-c688-44fb-968a-e4a0a157f47f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:12.288625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a8f3d-c688-44fb-968a-e4a0a157f47f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:12.288625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a8f3d-c688-44fb-968a-e4a0a157f47f admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:12.288625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a8f3d-c688-44fb-968a-e4a0a157f47f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:12.289797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a8f3d-c688-44fb-968a-e4a0a157f47f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:12.293102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa13b8-d83a-4f7b-a3f4-f33ab0643ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:12.293789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa13b8-d83a-4f7b-a3f4-f33ab0643ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:12.294103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa13b8-d83a-4f7b-a3f4-f33ab0643ded admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:12.294385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa13b8-d83a-4f7b-a3f4-f33ab0643ded admin admin] PATH_INFO: `/v3/projects/a2ee874d160a470b96e1d50fc1131f81` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:12.295638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa13b8-d83a-4f7b-a3f4-f33ab0643ded admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2ee874d160a470b96e1d50fc1131f81)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:12.297673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa13b8-d83a-4f7b-a3f4-f33ab0643ded admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:12.416189 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1284/2541] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:26:12 2022] POST /identity/v3/users => generated 289 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:26:12.418095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a8f3d-c688-44fb-968a-e4a0a157f47f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:12.431964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:12.436934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a8f3d-c688-44fb-968a-e4a0a157f47f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:12.452212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5aa13b8-d83a-4f7b-a3f4-f33ab0643ded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ee874d160a470b96e1d50fc1131f81', 'request_id': 'req-a5aa13b8-d83a-4f7b-a3f4-f33ab0643ded'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:12.512999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a33962-7411-417e-bc82-98d03000f4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:12.513698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a33962-7411-417e-bc82-98d03000f4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:12.514020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a33962-7411-417e-bc82-98d03000f4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:12.514284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a33962-7411-417e-bc82-98d03000f4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:12.520025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a33962-7411-417e-bc82-98d03000f4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:12.520025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a33962-7411-417e-bc82-98d03000f4f5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:12.529366 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1285/2542] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:26:12.530288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a33962-7411-417e-bc82-98d03000f4f5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:12.538924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5aa13b8-d83a-4f7b-a3f4-f33ab0643ded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ee874d160a470b96e1d50fc1131f81', 'request_id': 'req-a5aa13b8-d83a-4f7b-a3f4-f33ab0643ded'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:12.551489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5aa13b8-d83a-4f7b-a3f4-f33ab0643ded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ee874d160a470b96e1d50fc1131f81', 'request_id': 'req-a5aa13b8-d83a-4f7b-a3f4-f33ab0643ded'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:12.580547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5aa13b8-d83a-4f7b-a3f4-f33ab0643ded admin admin] The token cache is being invalidate because project a2ee874d160a470b96e1d50fc1131f81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:26:12.580882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5aa13b8-d83a-4f7b-a3f4-f33ab0643ded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:12.582547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5aa13b8-d83a-4f7b-a3f4-f33ab0643ded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:12.590101 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1258/2543] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:12 2022] DELETE /identity/v3/projects/a2ee874d160a470b96e1d50fc1131f81 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:26:12.591061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa13b8-d83a-4f7b-a3f4-f33ab0643ded admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:12.595215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a5aa13b8-d83a-4f7b-a3f4-f33ab0643ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:12.611028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a33962-7411-417e-bc82-98d03000f4f5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:12.615930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2ce34-9fb7-4a08-8f81-91d297f666a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:12.616555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2ce34-9fb7-4a08-8f81-91d297f666a0 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:12.616844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2ce34-9fb7-4a08-8f81-91d297f666a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:12.617119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2ce34-9fb7-4a08-8f81-91d297f666a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:12.618534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa13b8-d83a-4f7b-a3f4-f33ab0643ded admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:12.619059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9be2ce34-9fb7-4a08-8f81-91d297f666a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:12.625130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c68046-2b79-473e-a6d4-4dafbd03e5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:12.628524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c68046-2b79-473e-a6d4-4dafbd03e5ca admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:12.628888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c68046-2b79-473e-a6d4-4dafbd03e5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:12.629237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c68046-2b79-473e-a6d4-4dafbd03e5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:12.629980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c68046-2b79-473e-a6d4-4dafbd03e5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:12.631625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2ce34-9fb7-4a08-8f81-91d297f666a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:12.633430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2ce34-9fb7-4a08-8f81-91d297f666a0 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:12.639262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c68046-2b79-473e-a6d4-4dafbd03e5ca admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:12.643790 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1286/2544] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:12.646073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed2b68-29a4-44c3-b3aa-37e038141f9f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:12.646584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed2b68-29a4-44c3-b3aa-37e038141f9f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:12.647096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed2b68-29a4-44c3-b3aa-37e038141f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:12.672122 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1259/2545] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:26:12.673923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c68046-2b79-473e-a6d4-4dafbd03e5ca admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:12.690583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-78ed2b68-29a4-44c3-b3aa-37e038141f9f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:12.692567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-78ed2b68-29a4-44c3-b3aa-37e038141f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:12.700642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c68046-2b79-473e-a6d4-4dafbd03e5ca admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:12.709044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc5af9-c4b1-4915-a4d6-71f5de7bdee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:12.710965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc5af9-c4b1-4915-a4d6-71f5de7bdee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:12.711557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc5af9-c4b1-4915-a4d6-71f5de7bdee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:12.711557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc5af9-c4b1-4915-a4d6-71f5de7bdee1 admin admin] PATH_INFO: `/v3/projects/719aefbc2ab2403a9430215011cee458/users/0a1ad10d402846199297f49a6aa0f47c/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:12.722459 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1287/2546] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:12.732822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe8543-1c66-478c-a33e-69cdfaf1eb6a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:12.732822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe8543-1c66-478c-a33e-69cdfaf1eb6a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:12.732822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe8543-1c66-478c-a33e-69cdfaf1eb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:12.755219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc5af9-c4b1-4915-a4d6-71f5de7bdee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=719aefbc2ab2403a9430215011cee458, user_id=0a1ad10d402846199297f49a6aa0f47c, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:12.760718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc5af9-c4b1-4915-a4d6-71f5de7bdee1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:12.772583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b7fe8543-1c66-478c-a33e-69cdfaf1eb6a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:12.775332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b7fe8543-1c66-478c-a33e-69cdfaf1eb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:12.786837 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1288/2547] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:12.793949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe8543-1c66-478c-a33e-69cdfaf1eb6a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:12.811113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe8543-1c66-478c-a33e-69cdfaf1eb6a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:12.817323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017e9bc-ebf8-4b1a-88e7-a655ed88b3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:12.818244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017e9bc-ebf8-4b1a-88e7-a655ed88b3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:12.818632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017e9bc-ebf8-4b1a-88e7-a655ed88b3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:12.819029 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017e9bc-ebf8-4b1a-88e7-a655ed88b3d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:12.819816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017e9bc-ebf8-4b1a-88e7-a655ed88b3d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:26:12.820219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017e9bc-ebf8-4b1a-88e7-a655ed88b3d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:12.822255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017e9bc-ebf8-4b1a-88e7-a655ed88b3d8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:12.839191 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1289/2548] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:26:12.843978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017e9bc-ebf8-4b1a-88e7-a655ed88b3d8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:12.863254 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1260/2549] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:26:12 2022] PUT /identity/v3/projects/719aefbc2ab2403a9430215011cee458/users/0a1ad10d402846199297f49a6aa0f47c/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:26:12.864366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc5af9-c4b1-4915-a4d6-71f5de7bdee1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:12.873825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5ccc5af9-c4b1-4915-a4d6-71f5de7bdee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:12.879236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017e9bc-ebf8-4b1a-88e7-a655ed88b3d8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:13.019251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefde94-54ea-4d6e-84e6-62b1a0257d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:13.020451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefde94-54ea-4d6e-84e6-62b1a0257d67 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:13.020816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefde94-54ea-4d6e-84e6-62b1a0257d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:13.021183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefde94-54ea-4d6e-84e6-62b1a0257d67 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:13.022336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fefde94-54ea-4d6e-84e6-62b1a0257d67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:13.030589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fefde94-54ea-4d6e-84e6-62b1a0257d67 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:13.033268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc5af9-c4b1-4915-a4d6-71f5de7bdee1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:13.044991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3348270-ff52-4c72-ac86-51fa23190011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:13.046080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3348270-ff52-4c72-ac86-51fa23190011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:13.046522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3348270-ff52-4c72-ac86-51fa23190011 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:13.046954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3348270-ff52-4c72-ac86-51fa23190011 admin admin] PATH_INFO: `/v3/projects/ba57de09ea74467396f82dcf36761480` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:13.049476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3348270-ff52-4c72-ac86-51fa23190011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba57de09ea74467396f82dcf36761480)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:13.052967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3348270-ff52-4c72-ac86-51fa23190011 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:13.084904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:13.146670 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1290/2550] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:26:12 2022] POST /identity/v3/projects => generated 391 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:26:13.149123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f90b1-7cb8-487c-ad3d-7aa10161606b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:13.149669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f90b1-7cb8-487c-ad3d-7aa10161606b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:13.150351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f90b1-7cb8-487c-ad3d-7aa10161606b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:13.189672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b3348270-ff52-4c72-ac86-51fa23190011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba57de09ea74467396f82dcf36761480', 'request_id': 'req-b3348270-ff52-4c72-ac86-51fa23190011'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:13.197736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-380f90b1-7cb8-487c-ad3d-7aa10161606b None None] MFA Rules not processed for user `0a1ad10d402846199297f49a6aa0f47c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:13.199012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-380f90b1-7cb8-487c-ad3d-7aa10161606b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:13.252422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b3348270-ff52-4c72-ac86-51fa23190011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba57de09ea74467396f82dcf36761480', 'request_id': 'req-b3348270-ff52-4c72-ac86-51fa23190011'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:13.261333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b3348270-ff52-4c72-ac86-51fa23190011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba57de09ea74467396f82dcf36761480', 'request_id': 'req-b3348270-ff52-4c72-ac86-51fa23190011'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:13.267735 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1291/2551] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:13.269767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f90b1-7cb8-487c-ad3d-7aa10161606b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:13.287130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b3348270-ff52-4c72-ac86-51fa23190011 admin admin] The token cache is being invalidate because project ba57de09ea74467396f82dcf36761480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:26:13.287544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b3348270-ff52-4c72-ac86-51fa23190011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:13.288902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b3348270-ff52-4c72-ac86-51fa23190011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:13.291304 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1261/2552] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:12 2022] DELETE /identity/v3/projects/ba57de09ea74467396f82dcf36761480 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:13.292102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3348270-ff52-4c72-ac86-51fa23190011 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:13.297745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b3348270-ff52-4c72-ac86-51fa23190011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:13.371242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f90b1-7cb8-487c-ad3d-7aa10161606b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:13.376472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8fac4-9209-4546-be96-824b29ecacb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:13.377312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8fac4-9209-4546-be96-824b29ecacb8 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:13.378337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8fac4-9209-4546-be96-824b29ecacb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:13.378801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8fac4-9209-4546-be96-824b29ecacb8 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:13.379589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8fac4-9209-4546-be96-824b29ecacb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:13.382091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8fac4-9209-4546-be96-824b29ecacb8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:13.386667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3348270-ff52-4c72-ac86-51fa23190011 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:13.392438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e62e1-5b7c-4d1f-b0e5-cae550ca8b9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:13.393068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e62e1-5b7c-4d1f-b0e5-cae550ca8b9b service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:13.393942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e62e1-5b7c-4d1f-b0e5-cae550ca8b9b service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:13.394299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e62e1-5b7c-4d1f-b0e5-cae550ca8b9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:13.396122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5d2e62e1-5b7c-4d1f-b0e5-cae550ca8b9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:13.407707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e62e1-5b7c-4d1f-b0e5-cae550ca8b9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:13.410225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e62e1-5b7c-4d1f-b0e5-cae550ca8b9b service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:13.419658 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1262/2553] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:13.420443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e62e1-5b7c-4d1f-b0e5-cae550ca8b9b service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:13.421820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5d2e62e1-5b7c-4d1f-b0e5-cae550ca8b9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:13.440899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e62e1-5b7c-4d1f-b0e5-cae550ca8b9b service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:13.447308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56984a2-e9a4-476b-98c5-07bc839f1bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:13.450594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56984a2-e9a4-476b-98c5-07bc839f1bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:13.450594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56984a2-e9a4-476b-98c5-07bc839f1bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:13.450594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56984a2-e9a4-476b-98c5-07bc839f1bb4 admin admin] PATH_INFO: `/v3/users/0964ab9d4f294398a0c92e2b0fb9fa30` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:13.452733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56984a2-e9a4-476b-98c5-07bc839f1bb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0964ab9d4f294398a0c92e2b0fb9fa30)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:13.454996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56984a2-e9a4-476b-98c5-07bc839f1bb4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:13.483271 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1292/2554] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:26:13 2022] POST /identity/v3/users => generated 296 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:26:13.489005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8fac4-9209-4546-be96-824b29ecacb8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:13.492370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-95f8fac4-9209-4546-be96-824b29ecacb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:13.509757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8fac4-9209-4546-be96-824b29ecacb8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:13.516072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b18a8-a934-4ebf-9626-32d0efbed1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:13.516839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b18a8-a934-4ebf-9626-32d0efbed1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:13.517298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b18a8-a934-4ebf-9626-32d0efbed1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:13.517652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b18a8-a934-4ebf-9626-32d0efbed1b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:13.518475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b18a8-a934-4ebf-9626-32d0efbed1b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:13.520276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b18a8-a934-4ebf-9626-32d0efbed1b0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:13.538828 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1293/2555] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:26:13.540411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b18a8-a934-4ebf-9626-32d0efbed1b0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:13.554080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b18a8-a934-4ebf-9626-32d0efbed1b0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:13.559781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45ecbc-bc20-40a5-a064-5f23a733a5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:13.560678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45ecbc-bc20-40a5-a064-5f23a733a5df admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:13.561166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45ecbc-bc20-40a5-a064-5f23a733a5df admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:13.567133 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45ecbc-bc20-40a5-a064-5f23a733a5df admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:13.567133 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45ecbc-bc20-40a5-a064-5f23a733a5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:13.567133 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45ecbc-bc20-40a5-a064-5f23a733a5df admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:13.584101 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1294/2556] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:26:13.588916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45ecbc-bc20-40a5-a064-5f23a733a5df admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:13.601318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45ecbc-bc20-40a5-a064-5f23a733a5df admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:13.607213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc73b5-18e3-4c26-9e52-70a5d7d75e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:13.608381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc73b5-18e3-4c26-9e52-70a5d7d75e3a admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:13.608724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc73b5-18e3-4c26-9e52-70a5d7d75e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:13.609007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc73b5-18e3-4c26-9e52-70a5d7d75e3a admin admin] PATH_INFO: `/v3/projects/a02bbe0ff0c54ac5bc82af370b6f8ea8/users/24b378191855485d91a08b567f6d6776/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:13.631742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc73b5-18e3-4c26-9e52-70a5d7d75e3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02bbe0ff0c54ac5bc82af370b6f8ea8, user_id=24b378191855485d91a08b567f6d6776, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:13.638466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc73b5-18e3-4c26-9e52-70a5d7d75e3a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:13.724900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e56984a2-e9a4-476b-98c5-07bc839f1bb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0964ab9d4f294398a0c92e2b0fb9fa30'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:13.726015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e56984a2-e9a4-476b-98c5-07bc839f1bb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0964ab9d4f294398a0c92e2b0fb9fa30'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:13.734521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e56984a2-e9a4-476b-98c5-07bc839f1bb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0964ab9d4f294398a0c92e2b0fb9fa30'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:13.753301 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1295/2557] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:26:13 2022] PUT /identity/v3/projects/a02bbe0ff0c54ac5bc82af370b6f8ea8/users/24b378191855485d91a08b567f6d6776/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:13.758084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c71de7-b982-45f1-96e3-b1e130005302 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:13.758470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c71de7-b982-45f1-96e3-b1e130005302 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:13.758849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c71de7-b982-45f1-96e3-b1e130005302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:13.759145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e56984a2-e9a4-476b-98c5-07bc839f1bb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0964ab9d4f294398a0c92e2b0fb9fa30'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:13.788838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f5c71de7-b982-45f1-96e3-b1e130005302 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:13.790711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f5c71de7-b982-45f1-96e3-b1e130005302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:13.848496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e56984a2-e9a4-476b-98c5-07bc839f1bb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0964ab9d4f294398a0c92e2b0fb9fa30'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:13.856926 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1263/2558] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:26:13 2022] DELETE /identity/v3/users/0964ab9d4f294398a0c92e2b0fb9fa30 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:13.858564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b78d1d-c5e9-45a0-ad6e-b5cef22d1e93 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:13.858564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b78d1d-c5e9-45a0-ad6e-b5cef22d1e93 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:13.858802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b78d1d-c5e9-45a0-ad6e-b5cef22d1e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:13.876125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:13.883995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-55b78d1d-c5e9-45a0-ad6e-b5cef22d1e93 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:13.885443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-55b78d1d-c5e9-45a0-ad6e-b5cef22d1e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:13.913067 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1296/2559] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:13.942390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c71de7-b982-45f1-96e3-b1e130005302 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:13.943844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f5c71de7-b982-45f1-96e3-b1e130005302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:13.967385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:13.975833 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1264/2560] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:26:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:13.991794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b78d1d-c5e9-45a0-ad6e-b5cef22d1e93 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:13.993282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-55b78d1d-c5e9-45a0-ad6e-b5cef22d1e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:14.078121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c71de7-b982-45f1-96e3-b1e130005302 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:14.144916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b78d1d-c5e9-45a0-ad6e-b5cef22d1e93 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:14.155595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d16f42-7d34-4038-9a7b-adae22a77a45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:14.156313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d16f42-7d34-4038-9a7b-adae22a77a45 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:14.156593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d16f42-7d34-4038-9a7b-adae22a77a45 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:14.157274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d16f42-7d34-4038-9a7b-adae22a77a45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:14.167989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014cb22-03db-4a31-b9b5-1c81405f4e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:14.168925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014cb22-03db-4a31-b9b5-1c81405f4e8c service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:14.169392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014cb22-03db-4a31-b9b5-1c81405f4e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:14.169831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014cb22-03db-4a31-b9b5-1c81405f4e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:14.171988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d16f42-7d34-4038-9a7b-adae22a77a45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:14.173787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d16f42-7d34-4038-9a7b-adae22a77a45 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:14.185672 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1265/2561] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:26:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 03:26:14.267705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014cb22-03db-4a31-b9b5-1c81405f4e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:14.270359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014cb22-03db-4a31-b9b5-1c81405f4e8c service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:14.283621 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1297/2562] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:26:14.578247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:14.669432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bc4e3-30cb-4108-abd6-cd28263b83b2 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:14.672012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bc4e3-30cb-4108-abd6-cd28263b83b2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:14.672012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bc4e3-30cb-4108-abd6-cd28263b83b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:14.700526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:14.737829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-047bc4e3-30cb-4108-abd6-cd28263b83b2 None None] MFA Rules not processed for user `0a1ad10d402846199297f49a6aa0f47c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:14.746103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-047bc4e3-30cb-4108-abd6-cd28263b83b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:14.955806 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1266/2563] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:15.423106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014cb22-03db-4a31-b9b5-1c81405f4e8c service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:15.425209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7014cb22-03db-4a31-b9b5-1c81405f4e8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:15.505038 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bc4e3-30cb-4108-abd6-cd28263b83b2 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:15.506414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-047bc4e3-30cb-4108-abd6-cd28263b83b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:15.530537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bc4e3-30cb-4108-abd6-cd28263b83b2 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:15.542688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e5823-6a70-4eea-b46c-6aba0a92790c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:15.543437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e5823-6a70-4eea-b46c-6aba0a92790c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:15.543726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e5823-6a70-4eea-b46c-6aba0a92790c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:15.544003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e5823-6a70-4eea-b46c-6aba0a92790c admin admin] PATH_INFO: `/v3/projects/26d595e9c1ba430cb825e41001c96744` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:15.548598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e5823-6a70-4eea-b46c-6aba0a92790c admin admin] RBAC: Authorizing `identity:delete_project(project_id=26d595e9c1ba430cb825e41001c96744)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:15.552503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e5823-6a70-4eea-b46c-6aba0a92790c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:15.655000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014cb22-03db-4a31-b9b5-1c81405f4e8c service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:15.673509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098b007-2a5c-486b-827d-5eb64397f2ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:15.674185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098b007-2a5c-486b-827d-5eb64397f2ae service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:15.674478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098b007-2a5c-486b-827d-5eb64397f2ae service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:15.675315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098b007-2a5c-486b-827d-5eb64397f2ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:15.677153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a098b007-2a5c-486b-827d-5eb64397f2ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:15.708882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098b007-2a5c-486b-827d-5eb64397f2ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:15.710554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098b007-2a5c-486b-827d-5eb64397f2ae service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:15.716613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:15.733515 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1298/2564] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:15.734931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4aae0-56f9-4f8c-bee1-d27f8af124dc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:15.735836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4aae0-56f9-4f8c-bee1-d27f8af124dc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:15.736122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4aae0-56f9-4f8c-bee1-d27f8af124dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:15.737325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2d7e5823-6a70-4eea-b46c-6aba0a92790c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26d595e9c1ba430cb825e41001c96744', 'request_id': 'req-2d7e5823-6a70-4eea-b46c-6aba0a92790c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:15.777587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b1d4aae0-56f9-4f8c-bee1-d27f8af124dc None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:15.778851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b1d4aae0-56f9-4f8c-bee1-d27f8af124dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:15.835032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2d7e5823-6a70-4eea-b46c-6aba0a92790c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26d595e9c1ba430cb825e41001c96744', 'request_id': 'req-2d7e5823-6a70-4eea-b46c-6aba0a92790c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:15.845046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2d7e5823-6a70-4eea-b46c-6aba0a92790c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26d595e9c1ba430cb825e41001c96744', 'request_id': 'req-2d7e5823-6a70-4eea-b46c-6aba0a92790c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:15.879179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2d7e5823-6a70-4eea-b46c-6aba0a92790c admin admin] The token cache is being invalidate because project 26d595e9c1ba430cb825e41001c96744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:26:15.879826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2d7e5823-6a70-4eea-b46c-6aba0a92790c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:15.897309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2d7e5823-6a70-4eea-b46c-6aba0a92790c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:15.902683 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1267/2565] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:15 2022] DELETE /identity/v3/projects/26d595e9c1ba430cb825e41001c96744 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:26:15.907226 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1299/2566] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:26:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:15.919709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fbbcf-54bc-469d-bad6-5ded0a73d04c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:15.919709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fbbcf-54bc-469d-bad6-5ded0a73d04c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:15.919709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fbbcf-54bc-469d-bad6-5ded0a73d04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:15.924128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4aae0-56f9-4f8c-bee1-d27f8af124dc None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:15.925820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b1d4aae0-56f9-4f8c-bee1-d27f8af124dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:15.988206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-214fbbcf-54bc-469d-bad6-5ded0a73d04c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:15.988206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-214fbbcf-54bc-469d-bad6-5ded0a73d04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:16.111473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4aae0-56f9-4f8c-bee1-d27f8af124dc None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:16.122451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaef44f-2ea0-4788-a25b-09a6248e7aec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:16.123217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaef44f-2ea0-4788-a25b-09a6248e7aec service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:16.123562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaef44f-2ea0-4788-a25b-09a6248e7aec service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:16.123851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaef44f-2ea0-4788-a25b-09a6248e7aec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:16.136107 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1268/2567] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:16.145017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b225c3-7d70-4d2d-8dde-381287ca6467 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:16.145302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b225c3-7d70-4d2d-8dde-381287ca6467 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:16.145576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b225c3-7d70-4d2d-8dde-381287ca6467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:16.149269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaef44f-2ea0-4788-a25b-09a6248e7aec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:16.153118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaef44f-2ea0-4788-a25b-09a6248e7aec service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:16.172785 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1300/2568] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:26:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:26:16.212146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-22b225c3-7d70-4d2d-8dde-381287ca6467 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:16.215029 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-22b225c3-7d70-4d2d-8dde-381287ca6467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:16.235962 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1269/2569] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:16.239758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaef44f-2ea0-4788-a25b-09a6248e7aec service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:16.244953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:16.255148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaef44f-2ea0-4788-a25b-09a6248e7aec service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:16.267355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63058ece-d3ff-4558-9931-62fbe24393f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:16.268008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63058ece-d3ff-4558-9931-62fbe24393f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:16.268285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63058ece-d3ff-4558-9931-62fbe24393f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:16.269117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63058ece-d3ff-4558-9931-62fbe24393f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:16.269794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63058ece-d3ff-4558-9931-62fbe24393f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:26:16.270599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63058ece-d3ff-4558-9931-62fbe24393f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:16.271768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63058ece-d3ff-4558-9931-62fbe24393f4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:16.299897 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1301/2570] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:26:16.303590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b225c3-7d70-4d2d-8dde-381287ca6467 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:16.318976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b225c3-7d70-4d2d-8dde-381287ca6467 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:16.336701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1780353-2368-4f69-991d-f0877e25030f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:16.336701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1780353-2368-4f69-991d-f0877e25030f admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:16.336701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1780353-2368-4f69-991d-f0877e25030f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:16.336701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1780353-2368-4f69-991d-f0877e25030f admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:16.338322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1780353-2368-4f69-991d-f0877e25030f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:16.338322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1780353-2368-4f69-991d-f0877e25030f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:16.485509 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1270/2571] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:26:16 2022] POST /identity/v3/projects => generated 403 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:26:16.486976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63058ece-d3ff-4558-9931-62fbe24393f4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:16.497690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63058ece-d3ff-4558-9931-62fbe24393f4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:16.602371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877eaf6a-319a-4d78-85fe-c3ac5a6716a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:16.603082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877eaf6a-319a-4d78-85fe-c3ac5a6716a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:16.603403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877eaf6a-319a-4d78-85fe-c3ac5a6716a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:16.603715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877eaf6a-319a-4d78-85fe-c3ac5a6716a4 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:16.604470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877eaf6a-319a-4d78-85fe-c3ac5a6716a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:16.606714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877eaf6a-319a-4d78-85fe-c3ac5a6716a4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:16.627313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1780353-2368-4f69-991d-f0877e25030f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:16.629763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b1780353-2368-4f69-991d-f0877e25030f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:16.647315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1780353-2368-4f69-991d-f0877e25030f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:16.652828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a875941-0f1c-4cff-95aa-7b75af1cf21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:16.653616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a875941-0f1c-4cff-95aa-7b75af1cf21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:16.653911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a875941-0f1c-4cff-95aa-7b75af1cf21c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:16.654216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a875941-0f1c-4cff-95aa-7b75af1cf21c admin admin] PATH_INFO: `/v3/users/0a1ad10d402846199297f49a6aa0f47c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:16.655397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a875941-0f1c-4cff-95aa-7b75af1cf21c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a1ad10d402846199297f49a6aa0f47c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:16.657629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a875941-0f1c-4cff-95aa-7b75af1cf21c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:16.734568 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1302/2572] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:26:16 2022] POST /identity/v3/users => generated 302 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:26:16.735807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877eaf6a-319a-4d78-85fe-c3ac5a6716a4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:16.748634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877eaf6a-319a-4d78-85fe-c3ac5a6716a4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:16.756079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a18cfc-8111-40b0-a697-162c9d2affa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:16.758354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a18cfc-8111-40b0-a697-162c9d2affa2 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:16.758354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a18cfc-8111-40b0-a697-162c9d2affa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:16.758354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a18cfc-8111-40b0-a697-162c9d2affa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:16.758354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a18cfc-8111-40b0-a697-162c9d2affa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:16.760651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a18cfc-8111-40b0-a697-162c9d2affa2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:16.778782 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1303/2573] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:26:16.779937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a18cfc-8111-40b0-a697-162c9d2affa2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:16.790668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a18cfc-8111-40b0-a697-162c9d2affa2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:16.796087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035ca72-d928-4172-b1d3-88ea0256c63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:16.796832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035ca72-d928-4172-b1d3-88ea0256c63b admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:16.797187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035ca72-d928-4172-b1d3-88ea0256c63b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:16.797537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035ca72-d928-4172-b1d3-88ea0256c63b admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:16.798316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035ca72-d928-4172-b1d3-88ea0256c63b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:16.800977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035ca72-d928-4172-b1d3-88ea0256c63b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:16.824802 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1304/2574] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:26:16.825769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035ca72-d928-4172-b1d3-88ea0256c63b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:16.858540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035ca72-d928-4172-b1d3-88ea0256c63b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:16.865255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dc3f6-175a-41be-ab6c-576485f1fc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:16.866245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dc3f6-175a-41be-ab6c-576485f1fc65 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:16.866942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dc3f6-175a-41be-ab6c-576485f1fc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:16.867498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dc3f6-175a-41be-ab6c-576485f1fc65 admin admin] PATH_INFO: `/v3/projects/24d25f38f998435da07701bf996f14f3/users/1cd71bf0f4f843d88ca6cbe82bd0c100/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:16.901319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7a875941-0f1c-4cff-95aa-7b75af1cf21c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a1ad10d402846199297f49a6aa0f47c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:16.902995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7a875941-0f1c-4cff-95aa-7b75af1cf21c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a1ad10d402846199297f49a6aa0f47c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:16.921390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7a875941-0f1c-4cff-95aa-7b75af1cf21c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a1ad10d402846199297f49a6aa0f47c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:16.933219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1dc3f6-175a-41be-ab6c-576485f1fc65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d25f38f998435da07701bf996f14f3, user_id=1cd71bf0f4f843d88ca6cbe82bd0c100, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:16.933364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:16.943856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1dc3f6-175a-41be-ab6c-576485f1fc65 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:16.953319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7a875941-0f1c-4cff-95aa-7b75af1cf21c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a1ad10d402846199297f49a6aa0f47c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:17.039795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7a875941-0f1c-4cff-95aa-7b75af1cf21c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a1ad10d402846199297f49a6aa0f47c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:17.052097 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1271/2575] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:26:16 2022] DELETE /identity/v3/users/0a1ad10d402846199297f49a6aa0f47c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:26:17.055790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74bfb8-699a-4716-9948-781cafff7432 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:17.056447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74bfb8-699a-4716-9948-781cafff7432 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:17.056951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74bfb8-699a-4716-9948-781cafff7432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:17.087497 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1305/2576] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:26:16 2022] PUT /identity/v3/projects/24d25f38f998435da07701bf996f14f3/users/1cd71bf0f4f843d88ca6cbe82bd0c100/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:17.100737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-fa74bfb8-699a-4716-9948-781cafff7432 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:17.101045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0a0d9-0ae2-467d-925f-ddd804b910d0 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:17.101368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0a0d9-0ae2-467d-925f-ddd804b910d0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:17.101943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0a0d9-0ae2-467d-925f-ddd804b910d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:17.102602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fa74bfb8-699a-4716-9948-781cafff7432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:17.147063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a9a0a0d9-0ae2-467d-925f-ddd804b910d0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:17.149639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a9a0a0d9-0ae2-467d-925f-ddd804b910d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:17.230867 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1272/2577] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:17.241540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74bfb8-699a-4716-9948-781cafff7432 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:17.245473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fa74bfb8-699a-4716-9948-781cafff7432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:17.286535 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1306/2578] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:17.296992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0a0d9-0ae2-467d-925f-ddd804b910d0 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:17.298755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a9a0a0d9-0ae2-467d-925f-ddd804b910d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:17.348336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:17.372660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74bfb8-699a-4716-9948-781cafff7432 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:17.382324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3bc35-b112-41aa-99f6-9cec10086426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:17.383272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3bc35-b112-41aa-99f6-9cec10086426 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:17.383629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3bc35-b112-41aa-99f6-9cec10086426 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:17.384016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3bc35-b112-41aa-99f6-9cec10086426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:17.409970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3bc35-b112-41aa-99f6-9cec10086426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:17.415694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0a0d9-0ae2-467d-925f-ddd804b910d0 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:17.417277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3bc35-b112-41aa-99f6-9cec10086426 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:17.424291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dbfae-89d4-4acd-80c7-6bbc78b65b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:17.424817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dbfae-89d4-4acd-80c7-6bbc78b65b4f service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:17.425107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dbfae-89d4-4acd-80c7-6bbc78b65b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:17.425388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dbfae-89d4-4acd-80c7-6bbc78b65b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:17.437182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265dbfae-89d4-4acd-80c7-6bbc78b65b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:17.439734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265dbfae-89d4-4acd-80c7-6bbc78b65b4f service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:17.446082 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1273/2579] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:17.452744 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1307/2580] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:26:18.301299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3bc35-b112-41aa-99f6-9cec10086426 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:18.302960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e8e3bc35-b112-41aa-99f6-9cec10086426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:18.320517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3bc35-b112-41aa-99f6-9cec10086426 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:18.339906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939022b-f8a3-4b50-ad5e-cf4efa8b71ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:18.341503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939022b-f8a3-4b50-ad5e-cf4efa8b71ac service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:18.342069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939022b-f8a3-4b50-ad5e-cf4efa8b71ac service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:18.342512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939022b-f8a3-4b50-ad5e-cf4efa8b71ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:18.344977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8939022b-f8a3-4b50-ad5e-cf4efa8b71ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:18.509206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939022b-f8a3-4b50-ad5e-cf4efa8b71ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:18.510924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939022b-f8a3-4b50-ad5e-cf4efa8b71ac service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:18.535606 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1274/2581] 10.222.0.20 () {60 vars in 1396 bytes} [Thu Oct 27 03:26:18 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:18.713619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dbfae-89d4-4acd-80c7-6bbc78b65b4f service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:18.717419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-265dbfae-89d4-4acd-80c7-6bbc78b65b4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:18.769652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dbfae-89d4-4acd-80c7-6bbc78b65b4f service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:18.783588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d46ca1-5e3c-4180-b7b0-eeffd8ddb735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:18.785616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d46ca1-5e3c-4180-b7b0-eeffd8ddb735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:18.787707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d46ca1-5e3c-4180-b7b0-eeffd8ddb735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:18.787707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d46ca1-5e3c-4180-b7b0-eeffd8ddb735 admin admin] PATH_INFO: `/v3/projects/719aefbc2ab2403a9430215011cee458` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:18.787707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d46ca1-5e3c-4180-b7b0-eeffd8ddb735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=719aefbc2ab2403a9430215011cee458)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:18.790731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d46ca1-5e3c-4180-b7b0-eeffd8ddb735 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:18.938434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-62d46ca1-5e3c-4180-b7b0-eeffd8ddb735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '719aefbc2ab2403a9430215011cee458', 'request_id': 'req-62d46ca1-5e3c-4180-b7b0-eeffd8ddb735'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:18.960588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-62d46ca1-5e3c-4180-b7b0-eeffd8ddb735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '719aefbc2ab2403a9430215011cee458', 'request_id': 'req-62d46ca1-5e3c-4180-b7b0-eeffd8ddb735'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:18.968764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-62d46ca1-5e3c-4180-b7b0-eeffd8ddb735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '719aefbc2ab2403a9430215011cee458', 'request_id': 'req-62d46ca1-5e3c-4180-b7b0-eeffd8ddb735'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:19.080071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-62d46ca1-5e3c-4180-b7b0-eeffd8ddb735 admin admin] The token cache is being invalidate because project 719aefbc2ab2403a9430215011cee458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:26:19.080640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-62d46ca1-5e3c-4180-b7b0-eeffd8ddb735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:19.084042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-62d46ca1-5e3c-4180-b7b0-eeffd8ddb735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:19.088450 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1308/2582] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:18 2022] DELETE /identity/v3/projects/719aefbc2ab2403a9430215011cee458 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:19.094945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c8f28-98bf-40f6-9910-340f55d8ffb0 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:19.097065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c8f28-98bf-40f6-9910-340f55d8ffb0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:19.097833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c8f28-98bf-40f6-9910-340f55d8ffb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:19.127510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ed3c8f28-98bf-40f6-9910-340f55d8ffb0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:19.129703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ed3c8f28-98bf-40f6-9910-340f55d8ffb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:19.152566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:19.312633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8928c58-8fac-43cf-a99d-5f5e357f4984 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:19.313237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8928c58-8fac-43cf-a99d-5f5e357f4984 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:19.314019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8928c58-8fac-43cf-a99d-5f5e357f4984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:19.322545 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1275/2583] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:19.346338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e8928c58-8fac-43cf-a99d-5f5e357f4984 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:19.348579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e8928c58-8fac-43cf-a99d-5f5e357f4984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:19.362958 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1309/2584] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:19.364249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c8f28-98bf-40f6-9910-340f55d8ffb0 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:19.392192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c8f28-98bf-40f6-9910-340f55d8ffb0 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:19.410778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daa48b-093a-443b-a5de-6b65e627cc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:19.411426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daa48b-093a-443b-a5de-6b65e627cc97 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:19.411712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daa48b-093a-443b-a5de-6b65e627cc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:19.412190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daa48b-093a-443b-a5de-6b65e627cc97 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:19.413666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daa48b-093a-443b-a5de-6b65e627cc97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:26:19.414192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daa48b-093a-443b-a5de-6b65e627cc97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:19.416676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daa48b-093a-443b-a5de-6b65e627cc97 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:19.451987 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1276/2585] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:26:19.455728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8928c58-8fac-43cf-a99d-5f5e357f4984 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:19.468577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8928c58-8fac-43cf-a99d-5f5e357f4984 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:19.488351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e268590-565a-4ff2-955a-631efe4c966e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:19.489251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e268590-565a-4ff2-955a-631efe4c966e admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:19.489546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e268590-565a-4ff2-955a-631efe4c966e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:19.490179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e268590-565a-4ff2-955a-631efe4c966e admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:19.490962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e268590-565a-4ff2-955a-631efe4c966e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:19.495211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e268590-565a-4ff2-955a-631efe4c966e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:19.633945 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1310/2586] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:26:19 2022] POST /identity/v3/projects => generated 395 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:26:19.635060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daa48b-093a-443b-a5de-6b65e627cc97 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:19.648413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daa48b-093a-443b-a5de-6b65e627cc97 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:19.772952 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276bcfa0-847d-4f58-8935-8a661d143b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:19.773615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bcfa0-847d-4f58-8935-8a661d143b67 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:19.781533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bcfa0-847d-4f58-8935-8a661d143b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:19.781533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bcfa0-847d-4f58-8935-8a661d143b67 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:19.781533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276bcfa0-847d-4f58-8935-8a661d143b67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:19.783146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276bcfa0-847d-4f58-8935-8a661d143b67 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:19.934459 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1277/2587] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:26:19 2022] POST /identity/v3/users => generated 298 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:26:19.943078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276bcfa0-847d-4f58-8935-8a661d143b67 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:19.946460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e268590-565a-4ff2-955a-631efe4c966e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:19.955122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0e268590-565a-4ff2-955a-631efe4c966e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:19.962693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276bcfa0-847d-4f58-8935-8a661d143b67 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:19.975716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5c969-a21e-411f-a0b7-fa66bf1ea349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:19.976499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5c969-a21e-411f-a0b7-fa66bf1ea349 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:19.976868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5c969-a21e-411f-a0b7-fa66bf1ea349 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:19.977240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5c969-a21e-411f-a0b7-fa66bf1ea349 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:19.978990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5c969-a21e-411f-a0b7-fa66bf1ea349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:19.980741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5c969-a21e-411f-a0b7-fa66bf1ea349 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:20.013509 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1278/2588] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:26:20.017328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5c969-a21e-411f-a0b7-fa66bf1ea349 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:20.031566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5c969-a21e-411f-a0b7-fa66bf1ea349 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:20.039266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4124614-9a7a-4eed-a7e3-2149f076da87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:20.040548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4124614-9a7a-4eed-a7e3-2149f076da87 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:20.041051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4124614-9a7a-4eed-a7e3-2149f076da87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:20.041487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4124614-9a7a-4eed-a7e3-2149f076da87 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:20.042578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4124614-9a7a-4eed-a7e3-2149f076da87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:20.045212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4124614-9a7a-4eed-a7e3-2149f076da87 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:20.086524 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1279/2589] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:26:20.089580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4124614-9a7a-4eed-a7e3-2149f076da87 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:20.113784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4124614-9a7a-4eed-a7e3-2149f076da87 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:20.137754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c0820-7c9b-42d4-8dcb-f7bb43bd709e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:20.138410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c0820-7c9b-42d4-8dcb-f7bb43bd709e admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:20.140522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c0820-7c9b-42d4-8dcb-f7bb43bd709e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:20.142584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c0820-7c9b-42d4-8dcb-f7bb43bd709e admin admin] PATH_INFO: `/v3/projects/f1cee634bb1f4bb0a47f33a49f24ccdf/users/8e8640291c8745609faae41bdd731c17/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:20.196705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e268590-565a-4ff2-955a-631efe4c966e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:20.200300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c0820-7c9b-42d4-8dcb-f7bb43bd709e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1cee634bb1f4bb0a47f33a49f24ccdf, user_id=8e8640291c8745609faae41bdd731c17, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:20.212975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c0820-7c9b-42d4-8dcb-f7bb43bd709e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:20.223778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987b572-655d-42df-9243-15b8bb608753 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:20.226261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987b572-655d-42df-9243-15b8bb608753 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:20.226397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987b572-655d-42df-9243-15b8bb608753 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:20.226644 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987b572-655d-42df-9243-15b8bb608753 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:20.235983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7987b572-655d-42df-9243-15b8bb608753 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:20.254308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987b572-655d-42df-9243-15b8bb608753 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:20.255990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987b572-655d-42df-9243-15b8bb608753 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:20.271104 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1311/2590] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:20.311579 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1280/2591] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:26:20 2022] PUT /identity/v3/projects/f1cee634bb1f4bb0a47f33a49f24ccdf/users/8e8640291c8745609faae41bdd731c17/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:20.317171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2de751-0607-4450-b401-9b9115231676 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:20.317612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2de751-0607-4450-b401-9b9115231676 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:20.317933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2de751-0607-4450-b401-9b9115231676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:20.361321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-cc2de751-0607-4450-b401-9b9115231676 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:20.363993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cc2de751-0607-4450-b401-9b9115231676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:20.388889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:20.535456 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1312/2592] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:20.586076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c0820-7c9b-42d4-8dcb-f7bb43bd709e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:20.586076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-487c0820-7c9b-42d4-8dcb-f7bb43bd709e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:20.680099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c0820-7c9b-42d4-8dcb-f7bb43bd709e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:20.688354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab162c83-c2d1-4e0e-bf7a-a2ba67561052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:20.689542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab162c83-c2d1-4e0e-bf7a-a2ba67561052 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:20.689980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab162c83-c2d1-4e0e-bf7a-a2ba67561052 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:20.690526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab162c83-c2d1-4e0e-bf7a-a2ba67561052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:20.701064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab162c83-c2d1-4e0e-bf7a-a2ba67561052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:20.702846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab162c83-c2d1-4e0e-bf7a-a2ba67561052 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:20.715426 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1281/2593] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:20.978723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:25.680859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2de751-0607-4450-b401-9b9115231676 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:25.861217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2de751-0607-4450-b401-9b9115231676 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:25.875076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a70af-3839-4564-8d07-6b9fe0479978 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:25.875849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a70af-3839-4564-8d07-6b9fe0479978 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:25.876136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a70af-3839-4564-8d07-6b9fe0479978 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:25.877330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a70af-3839-4564-8d07-6b9fe0479978 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:25.883510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-734a70af-3839-4564-8d07-6b9fe0479978 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:25.904517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a70af-3839-4564-8d07-6b9fe0479978 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:25.905713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a70af-3839-4564-8d07-6b9fe0479978 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:25.928852 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1313/2594] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:27.946480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3be1ba-d5e9-4a4a-ac93-870a40a2501b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:27.947352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3be1ba-d5e9-4a4a-ac93-870a40a2501b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:27.952174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3be1ba-d5e9-4a4a-ac93-870a40a2501b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:28.005071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6c3be1ba-d5e9-4a4a-ac93-870a40a2501b None None] MFA Rules not processed for user `24b378191855485d91a08b567f6d6776`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:28.006632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6c3be1ba-d5e9-4a4a-ac93-870a40a2501b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:28.126467 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1282/2595] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:26:28.171918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a70af-3839-4564-8d07-6b9fe0479978 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:28.189518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a70af-3839-4564-8d07-6b9fe0479978 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:28.207693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fc6c5-33ef-4f0a-a4b6-8a6c70b4f2e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:28.214546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fc6c5-33ef-4f0a-a4b6-8a6c70b4f2e1 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:28.214546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fc6c5-33ef-4f0a-a4b6-8a6c70b4f2e1 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:28.214546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fc6c5-33ef-4f0a-a4b6-8a6c70b4f2e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:28.229827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fc6c5-33ef-4f0a-a4b6-8a6c70b4f2e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:28.231641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fc6c5-33ef-4f0a-a4b6-8a6c70b4f2e1 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:28.255640 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1314/2596] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:28 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:29.776297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d880b85-2e00-4912-98a7-06bd666fe89f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:29.776894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d880b85-2e00-4912-98a7-06bd666fe89f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:29.776894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d880b85-2e00-4912-98a7-06bd666fe89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:29.859394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4d880b85-2e00-4912-98a7-06bd666fe89f None None] MFA Rules not processed for user `1cd71bf0f4f843d88ca6cbe82bd0c100`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:29.860685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4d880b85-2e00-4912-98a7-06bd666fe89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:30.009618 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1283/2597] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:29 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:30.019651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fc6c5-33ef-4f0a-a4b6-8a6c70b4f2e1 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:30.021280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7d5fc6c5-33ef-4f0a-a4b6-8a6c70b4f2e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:30.046773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fc6c5-33ef-4f0a-a4b6-8a6c70b4f2e1 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:30.061107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903b7c4-c3e6-4ef3-93b3-4dc8613ee449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:30.062074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903b7c4-c3e6-4ef3-93b3-4dc8613ee449 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:30.062756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903b7c4-c3e6-4ef3-93b3-4dc8613ee449 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:30.070826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903b7c4-c3e6-4ef3-93b3-4dc8613ee449 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:30.072155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903b7c4-c3e6-4ef3-93b3-4dc8613ee449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:30.074678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903b7c4-c3e6-4ef3-93b3-4dc8613ee449 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:30.245290 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1315/2598] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:26:30 2022] POST /identity/v3/projects => generated 403 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:26:30.258655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d880b85-2e00-4912-98a7-06bd666fe89f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:30.279169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d880b85-2e00-4912-98a7-06bd666fe89f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:30.419819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73974a0e-400e-4b07-93b6-08ea1179183c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:30.421403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73974a0e-400e-4b07-93b6-08ea1179183c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:30.421694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73974a0e-400e-4b07-93b6-08ea1179183c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:30.421965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73974a0e-400e-4b07-93b6-08ea1179183c admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:30.422846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73974a0e-400e-4b07-93b6-08ea1179183c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:30.425702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73974a0e-400e-4b07-93b6-08ea1179183c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:30.570079 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1284/2599] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:26:30 2022] POST /identity/v3/users => generated 308 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:26:30.570212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903b7c4-c3e6-4ef3-93b3-4dc8613ee449 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:30.588850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903b7c4-c3e6-4ef3-93b3-4dc8613ee449 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:30.594772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729124a3-f116-43cc-8d1f-69e6883a503f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:30.595411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729124a3-f116-43cc-8d1f-69e6883a503f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:30.595697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729124a3-f116-43cc-8d1f-69e6883a503f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:30.595972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729124a3-f116-43cc-8d1f-69e6883a503f admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:30.597163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729124a3-f116-43cc-8d1f-69e6883a503f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:30.599018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729124a3-f116-43cc-8d1f-69e6883a503f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:30.621915 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1316/2600] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:26:30.626492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73974a0e-400e-4b07-93b6-08ea1179183c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:30.636131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:30.644756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73974a0e-400e-4b07-93b6-08ea1179183c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:30.666974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e000f0f-6503-41c4-85c4-1cacfaa363d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:30.667868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e000f0f-6503-41c4-85c4-1cacfaa363d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:30.668287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e000f0f-6503-41c4-85c4-1cacfaa363d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:30.668667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e000f0f-6503-41c4-85c4-1cacfaa363d9 admin admin] PATH_INFO: `/v3/projects/ea69e0d07f7e49bbadcf406b8093c231/users/f2d8c2e266484f55b6a04ddfb4894922/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:30.707306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e000f0f-6503-41c4-85c4-1cacfaa363d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea69e0d07f7e49bbadcf406b8093c231, user_id=f2d8c2e266484f55b6a04ddfb4894922, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:30.710286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e000f0f-6503-41c4-85c4-1cacfaa363d9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:30.843642 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1285/2601] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:26:30 2022] PUT /identity/v3/projects/ea69e0d07f7e49bbadcf406b8093c231/users/f2d8c2e266484f55b6a04ddfb4894922/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:30.846372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729124a3-f116-43cc-8d1f-69e6883a503f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:30.864118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729124a3-f116-43cc-8d1f-69e6883a503f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:30.999673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:31.015633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4a11e-0116-4248-b8f1-e499f85a535e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:31.016540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4a11e-0116-4248-b8f1-e499f85a535e admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:31.016984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4a11e-0116-4248-b8f1-e499f85a535e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:31.017565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4a11e-0116-4248-b8f1-e499f85a535e admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:31.018405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4a11e-0116-4248-b8f1-e499f85a535e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:31.020714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4a11e-0116-4248-b8f1-e499f85a535e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:31.045154 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1317/2602] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:26:31.049137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e000f0f-6503-41c4-85c4-1cacfaa363d9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:31.062272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e000f0f-6503-41c4-85c4-1cacfaa363d9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:31.075897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d2ab1-6ae9-407a-8cf2-f565c0737f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:31.076732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d2ab1-6ae9-407a-8cf2-f565c0737f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:31.077127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d2ab1-6ae9-407a-8cf2-f565c0737f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:31.077514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d2ab1-6ae9-407a-8cf2-f565c0737f74 admin admin] PATH_INFO: `/v3/projects/ea69e0d07f7e49bbadcf406b8093c231/users/f2d8c2e266484f55b6a04ddfb4894922/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:31.092595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d2ab1-6ae9-407a-8cf2-f565c0737f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea69e0d07f7e49bbadcf406b8093c231, user_id=f2d8c2e266484f55b6a04ddfb4894922, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:31.097098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d2ab1-6ae9-407a-8cf2-f565c0737f74 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:31.114719 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1286/2603] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:26:31 2022] PUT /identity/v3/projects/ea69e0d07f7e49bbadcf406b8093c231/users/f2d8c2e266484f55b6a04ddfb4894922/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:38.791703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9615a-bf96-4cf4-a6ec-f1a49a4574e1 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:38.792080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9615a-bf96-4cf4-a6ec-f1a49a4574e1 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:38.792215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9615a-bf96-4cf4-a6ec-f1a49a4574e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:38.803322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d2ab1-6ae9-407a-8cf2-f565c0737f74 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:38.807468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b43d2ab1-6ae9-407a-8cf2-f565c0737f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:38.884098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-29d9615a-bf96-4cf4-a6ec-f1a49a4574e1 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:38.886375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-29d9615a-bf96-4cf4-a6ec-f1a49a4574e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:38.993134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d2ab1-6ae9-407a-8cf2-f565c0737f74 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:39.005113 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc520198-d36c-4451-84ca-e7d775e3e712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:39.012266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc520198-d36c-4451-84ca-e7d775e3e712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:39.013783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc520198-d36c-4451-84ca-e7d775e3e712 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:39.015330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc520198-d36c-4451-84ca-e7d775e3e712 admin admin] PATH_INFO: `/v3/users/24b378191855485d91a08b567f6d6776` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:39.020272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc520198-d36c-4451-84ca-e7d775e3e712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24b378191855485d91a08b567f6d6776)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:39.026722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc520198-d36c-4451-84ca-e7d775e3e712 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:39.116141 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1318/2604] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:26:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:39.122594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9615a-bf96-4cf4-a6ec-f1a49a4574e1 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:39.122594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-29d9615a-bf96-4cf4-a6ec-f1a49a4574e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:39.160770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9615a-bf96-4cf4-a6ec-f1a49a4574e1 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:39.178814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ce06d-075c-4854-8f10-025bf84206c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:39.186012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ce06d-075c-4854-8f10-025bf84206c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:39.186865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ce06d-075c-4854-8f10-025bf84206c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:39.187340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ce06d-075c-4854-8f10-025bf84206c7 admin admin] PATH_INFO: `/v3/users/d3f1177e2cbd4ba6b659f8a714be86ac` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:39.188900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ce06d-075c-4854-8f10-025bf84206c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3f1177e2cbd4ba6b659f8a714be86ac)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:39.193171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ce06d-075c-4854-8f10-025bf84206c7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:39.290733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fc520198-d36c-4451-84ca-e7d775e3e712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24b378191855485d91a08b567f6d6776'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:39.292443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fc520198-d36c-4451-84ca-e7d775e3e712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24b378191855485d91a08b567f6d6776'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:39.308728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fc520198-d36c-4451-84ca-e7d775e3e712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24b378191855485d91a08b567f6d6776'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:39.338361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fc520198-d36c-4451-84ca-e7d775e3e712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24b378191855485d91a08b567f6d6776'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:39.452696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fc520198-d36c-4451-84ca-e7d775e3e712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24b378191855485d91a08b567f6d6776'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:39.461493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1e9ce06d-075c-4854-8f10-025bf84206c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3f1177e2cbd4ba6b659f8a714be86ac'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:39.461741 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1287/2605] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:26:38 2022] DELETE /identity/v3/users/24b378191855485d91a08b567f6d6776 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:26:39.462448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1e9ce06d-075c-4854-8f10-025bf84206c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3f1177e2cbd4ba6b659f8a714be86ac'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:39.463199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc520198-d36c-4451-84ca-e7d775e3e712 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:39.465567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fc520198-d36c-4451-84ca-e7d775e3e712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:39.480797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1e9ce06d-075c-4854-8f10-025bf84206c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3f1177e2cbd4ba6b659f8a714be86ac'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:39.515166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1e9ce06d-075c-4854-8f10-025bf84206c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3f1177e2cbd4ba6b659f8a714be86ac'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:39.517741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1e9ce06d-075c-4854-8f10-025bf84206c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3f1177e2cbd4ba6b659f8a714be86ac'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:39.594067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:39.608868 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1319/2606] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:26:39 2022] DELETE /identity/v3/users/d3f1177e2cbd4ba6b659f8a714be86ac => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:39.615011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5a70c-2592-484a-b6fd-3519d948d69c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:39.615285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5a70c-2592-484a-b6fd-3519d948d69c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:39.615620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5a70c-2592-484a-b6fd-3519d948d69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:39.632702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc520198-d36c-4451-84ca-e7d775e3e712 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:39.660962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1cd5a70c-2592-484a-b6fd-3519d948d69c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:39.663282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1cd5a70c-2592-484a-b6fd-3519d948d69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:39.773691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ae612-530e-44fa-a274-383fe2cd990a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:39.774477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ae612-530e-44fa-a274-383fe2cd990a service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:39.775661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ae612-530e-44fa-a274-383fe2cd990a service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:39.776449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ae612-530e-44fa-a274-383fe2cd990a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:39.781056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-730ae612-530e-44fa-a274-383fe2cd990a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:39.805607 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1320/2607] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:39.832207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5a70c-2592-484a-b6fd-3519d948d69c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:39.839209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1cd5a70c-2592-484a-b6fd-3519d948d69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:39.854186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:39.988553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ae612-530e-44fa-a274-383fe2cd990a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:39.993449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ae612-530e-44fa-a274-383fe2cd990a service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:40.003534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5a70c-2592-484a-b6fd-3519d948d69c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:40.008830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a7581-d046-4871-8e9d-6c973dc6908e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:40.009803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a7581-d046-4871-8e9d-6c973dc6908e service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:40.010423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a7581-d046-4871-8e9d-6c973dc6908e service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:40.010908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a7581-d046-4871-8e9d-6c973dc6908e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:40.031923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a7581-d046-4871-8e9d-6c973dc6908e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:40.037483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a7581-d046-4871-8e9d-6c973dc6908e service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:40.042513 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1288/2608] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:26:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:26:40.068655 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1321/2609] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:40.207106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ae612-530e-44fa-a274-383fe2cd990a service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:40.215545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-730ae612-530e-44fa-a274-383fe2cd990a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:40.267847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ae612-530e-44fa-a274-383fe2cd990a service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:40.292606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3fd43-3954-499c-bf09-993fbaa54594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:40.293279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3fd43-3954-499c-bf09-993fbaa54594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:40.293561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3fd43-3954-499c-bf09-993fbaa54594 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:40.293885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3fd43-3954-499c-bf09-993fbaa54594 admin admin] PATH_INFO: `/v3/projects/a02bbe0ff0c54ac5bc82af370b6f8ea8` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:40.297422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3fd43-3954-499c-bf09-993fbaa54594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a02bbe0ff0c54ac5bc82af370b6f8ea8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:40.299790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3fd43-3954-499c-bf09-993fbaa54594 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:40.534313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2ac3fd43-3954-499c-bf09-993fbaa54594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a02bbe0ff0c54ac5bc82af370b6f8ea8', 'request_id': 'req-2ac3fd43-3954-499c-bf09-993fbaa54594'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:40.600825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2ac3fd43-3954-499c-bf09-993fbaa54594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a02bbe0ff0c54ac5bc82af370b6f8ea8', 'request_id': 'req-2ac3fd43-3954-499c-bf09-993fbaa54594'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:40.617133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2ac3fd43-3954-499c-bf09-993fbaa54594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a02bbe0ff0c54ac5bc82af370b6f8ea8', 'request_id': 'req-2ac3fd43-3954-499c-bf09-993fbaa54594'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:40.665248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2ac3fd43-3954-499c-bf09-993fbaa54594 admin admin] The token cache is being invalidate because project a02bbe0ff0c54ac5bc82af370b6f8ea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:26:40.668927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2ac3fd43-3954-499c-bf09-993fbaa54594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:40.669456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2ac3fd43-3954-499c-bf09-993fbaa54594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:40.677858 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1289/2610] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:40 2022] DELETE /identity/v3/projects/a02bbe0ff0c54ac5bc82af370b6f8ea8 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:40.679590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cef26-9c76-425a-93f3-69adfd4ebf97 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:40.679883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cef26-9c76-425a-93f3-69adfd4ebf97 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:40.680166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cef26-9c76-425a-93f3-69adfd4ebf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:40.758844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e75cef26-9c76-425a-93f3-69adfd4ebf97 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:40.760123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e75cef26-9c76-425a-93f3-69adfd4ebf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:40.832850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3fd43-3954-499c-bf09-993fbaa54594 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:40.834405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2ac3fd43-3954-499c-bf09-993fbaa54594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:40.900496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:41.025809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3fd43-3954-499c-bf09-993fbaa54594 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:41.036324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1ee66-cb88-4b36-b3a3-6b3710d45dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:41.037242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1ee66-cb88-4b36-b3a3-6b3710d45dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:41.037759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1ee66-cb88-4b36-b3a3-6b3710d45dab admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:41.041158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1ee66-cb88-4b36-b3a3-6b3710d45dab admin admin] PATH_INFO: `/v3/projects/48e708fb3bdd45bc976db7bd92af09c8` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:41.055115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1ee66-cb88-4b36-b3a3-6b3710d45dab admin admin] RBAC: Authorizing `identity:delete_project(project_id=48e708fb3bdd45bc976db7bd92af09c8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:41.081232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1ee66-cb88-4b36-b3a3-6b3710d45dab admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:41.154099 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1322/2611] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:41.156690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0e2fe-870b-49f0-830c-2048e7ef52ae None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:41.156980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0e2fe-870b-49f0-830c-2048e7ef52ae None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:41.157659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0e2fe-870b-49f0-830c-2048e7ef52ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:41.229407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0df0e2fe-870b-49f0-830c-2048e7ef52ae None None] MFA Rules not processed for user `8e8640291c8745609faae41bdd731c17`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:41.231634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0df0e2fe-870b-49f0-830c-2048e7ef52ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:41.294813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-08a1ee66-cb88-4b36-b3a3-6b3710d45dab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48e708fb3bdd45bc976db7bd92af09c8', 'request_id': 'req-08a1ee66-cb88-4b36-b3a3-6b3710d45dab'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:41.372255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-08a1ee66-cb88-4b36-b3a3-6b3710d45dab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48e708fb3bdd45bc976db7bd92af09c8', 'request_id': 'req-08a1ee66-cb88-4b36-b3a3-6b3710d45dab'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:41.380019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-08a1ee66-cb88-4b36-b3a3-6b3710d45dab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48e708fb3bdd45bc976db7bd92af09c8', 'request_id': 'req-08a1ee66-cb88-4b36-b3a3-6b3710d45dab'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:41.405860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-08a1ee66-cb88-4b36-b3a3-6b3710d45dab admin admin] The token cache is being invalidate because project 48e708fb3bdd45bc976db7bd92af09c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:26:41.406328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-08a1ee66-cb88-4b36-b3a3-6b3710d45dab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:41.407126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-08a1ee66-cb88-4b36-b3a3-6b3710d45dab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:41.412649 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1323/2612] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:41 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:41.414710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f7eba-e203-4e64-bb23-3622fbc581a0 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:41.416693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f7eba-e203-4e64-bb23-3622fbc581a0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:41.417140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f7eba-e203-4e64-bb23-3622fbc581a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:41.421650 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1290/2613] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:40 2022] DELETE /identity/v3/projects/48e708fb3bdd45bc976db7bd92af09c8 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:41.424627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dff440-68a2-4d1f-ae0d-e93952f53fc3 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:41.425170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dff440-68a2-4d1f-ae0d-e93952f53fc3 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:41.425542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dff440-68a2-4d1f-ae0d-e93952f53fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:41.474510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-42dff440-68a2-4d1f-ae0d-e93952f53fc3 None None] MFA Rules not processed for user `8e8640291c8745609faae41bdd731c17`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:41.485281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-42dff440-68a2-4d1f-ae0d-e93952f53fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:41.501299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ca1f7eba-e203-4e64-bb23-3622fbc581a0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:41.502575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ca1f7eba-e203-4e64-bb23-3622fbc581a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:41.602442 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1291/2614] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:41 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:41.603549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dff440-68a2-4d1f-ae0d-e93952f53fc3 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:41.605209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-42dff440-68a2-4d1f-ae0d-e93952f53fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:41.626424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:41.676694 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1324/2615] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:41.677719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f7eba-e203-4e64-bb23-3622fbc581a0 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:41.679603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ca1f7eba-e203-4e64-bb23-3622fbc581a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:41.715606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:41.755561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dff440-68a2-4d1f-ae0d-e93952f53fc3 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:41.769708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af61cc-d993-4eba-a400-221801b5c79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:41.772074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af61cc-d993-4eba-a400-221801b5c79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:41.772460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af61cc-d993-4eba-a400-221801b5c79e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:41.772836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af61cc-d993-4eba-a400-221801b5c79e admin admin] PATH_INFO: `/v3/users/4e8002bf6ca34327b2d4faa37f93c6ac` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:41.776625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af61cc-d993-4eba-a400-221801b5c79e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e8002bf6ca34327b2d4faa37f93c6ac)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:41.780510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af61cc-d993-4eba-a400-221801b5c79e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:41.869524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f7eba-e203-4e64-bb23-3622fbc581a0 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:41.880920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505ce6e-adbd-45a5-9dd6-22b6b2ed7c5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:41.881618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505ce6e-adbd-45a5-9dd6-22b6b2ed7c5d service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:41.881910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505ce6e-adbd-45a5-9dd6-22b6b2ed7c5d service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:41.882227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505ce6e-adbd-45a5-9dd6-22b6b2ed7c5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:41.886454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2505ce6e-adbd-45a5-9dd6-22b6b2ed7c5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:41.914054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505ce6e-adbd-45a5-9dd6-22b6b2ed7c5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:41.916215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505ce6e-adbd-45a5-9dd6-22b6b2ed7c5d service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:41.948535 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1325/2616] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:41 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:41.949093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505ce6e-adbd-45a5-9dd6-22b6b2ed7c5d service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:41.998427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505ce6e-adbd-45a5-9dd6-22b6b2ed7c5d service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:42.019955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f504c-bb83-4480-81d8-6c98b18c6875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:42.020770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f504c-bb83-4480-81d8-6c98b18c6875 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:42.021217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f504c-bb83-4480-81d8-6c98b18c6875 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:42.021644 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f504c-bb83-4480-81d8-6c98b18c6875 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:42.022348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f504c-bb83-4480-81d8-6c98b18c6875 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:26:42.022706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f504c-bb83-4480-81d8-6c98b18c6875 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:42.028456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f504c-bb83-4480-81d8-6c98b18c6875 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:42.054515 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1326/2617] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:26:42.057146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-47af61cc-d993-4eba-a400-221801b5c79e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e8002bf6ca34327b2d4faa37f93c6ac'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:42.058808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f504c-bb83-4480-81d8-6c98b18c6875 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:42.060214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-47af61cc-d993-4eba-a400-221801b5c79e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e8002bf6ca34327b2d4faa37f93c6ac'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:42.061514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-324f504c-bb83-4480-81d8-6c98b18c6875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:42.086226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-47af61cc-d993-4eba-a400-221801b5c79e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e8002bf6ca34327b2d4faa37f93c6ac'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:42.093210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f504c-bb83-4480-81d8-6c98b18c6875 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:42.103912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068f996-d584-41c5-87c2-7b541d56faa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:42.104498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068f996-d584-41c5-87c2-7b541d56faa2 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:42.105286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068f996-d584-41c5-87c2-7b541d56faa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:42.105575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068f996-d584-41c5-87c2-7b541d56faa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:42.106548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068f996-d584-41c5-87c2-7b541d56faa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:42.109687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068f996-d584-41c5-87c2-7b541d56faa2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:42.125058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-47af61cc-d993-4eba-a400-221801b5c79e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e8002bf6ca34327b2d4faa37f93c6ac'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:42.236124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-47af61cc-d993-4eba-a400-221801b5c79e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e8002bf6ca34327b2d4faa37f93c6ac'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:42.247495 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1292/2618] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:26:41 2022] DELETE /identity/v3/users/4e8002bf6ca34327b2d4faa37f93c6ac => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:42.357712 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1327/2619] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:26:42 2022] POST /identity/v3/projects => generated 387 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:26:42.359279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af61cc-d993-4eba-a400-221801b5c79e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:42.639670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af61cc-d993-4eba-a400-221801b5c79e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:42.871118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7ec6f-a289-4dc7-9a92-b59831044490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:42.872654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7ec6f-a289-4dc7-9a92-b59831044490 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:42.873623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7ec6f-a289-4dc7-9a92-b59831044490 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:42.874567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7ec6f-a289-4dc7-9a92-b59831044490 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:42.875965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7ec6f-a289-4dc7-9a92-b59831044490 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:42.883229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7ec6f-a289-4dc7-9a92-b59831044490 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:42.985794 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1293/2620] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:26:42 2022] POST /identity/v3/users => generated 294 bytes in 628 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:26:42.989848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068f996-d584-41c5-87c2-7b541d56faa2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:43.005627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7ec6f-a289-4dc7-9a92-b59831044490 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:43.008753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f2a7ec6f-a289-4dc7-9a92-b59831044490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:43.028126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:43.035056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068f996-d584-41c5-87c2-7b541d56faa2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:43.066641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b9042-e793-4844-bb5c-f12d92536bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:43.070852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b9042-e793-4844-bb5c-f12d92536bcb admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:43.071140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b9042-e793-4844-bb5c-f12d92536bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:43.071420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b9042-e793-4844-bb5c-f12d92536bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:43.076106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b9042-e793-4844-bb5c-f12d92536bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:43.091305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b9042-e793-4844-bb5c-f12d92536bcb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:43.139958 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1328/2621] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:26:43.150672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b9042-e793-4844-bb5c-f12d92536bcb admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:43.193663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b9042-e793-4844-bb5c-f12d92536bcb admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:43.212176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c24dcb-ce86-4e7a-ae6e-ff9b959fb980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:43.212917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c24dcb-ce86-4e7a-ae6e-ff9b959fb980 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:43.216151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c24dcb-ce86-4e7a-ae6e-ff9b959fb980 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:43.216601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c24dcb-ce86-4e7a-ae6e-ff9b959fb980 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:43.218027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c24dcb-ce86-4e7a-ae6e-ff9b959fb980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:43.220305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c24dcb-ce86-4e7a-ae6e-ff9b959fb980 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:43.252063 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1329/2622] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:26:43.255005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c24dcb-ce86-4e7a-ae6e-ff9b959fb980 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:43.258868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-40c24dcb-ce86-4e7a-ae6e-ff9b959fb980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:43.262873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7ec6f-a289-4dc7-9a92-b59831044490 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:43.280353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea2c68-9d7e-4ad1-ad96-eb097103bc36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:43.281245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea2c68-9d7e-4ad1-ad96-eb097103bc36 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:43.284597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea2c68-9d7e-4ad1-ad96-eb097103bc36 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:43.285251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea2c68-9d7e-4ad1-ad96-eb097103bc36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:43.292884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-23ea2c68-9d7e-4ad1-ad96-eb097103bc36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:43.300093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c24dcb-ce86-4e7a-ae6e-ff9b959fb980 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:43.316803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32c022-426f-410f-b7e3-0e83fd31b9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:43.317688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32c022-426f-410f-b7e3-0e83fd31b9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:43.319157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32c022-426f-410f-b7e3-0e83fd31b9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:43.319546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32c022-426f-410f-b7e3-0e83fd31b9f9 admin admin] PATH_INFO: `/v3/projects/333b6e5cda4e482ab1ce3f241ec6cfe9` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:43.322067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32c022-426f-410f-b7e3-0e83fd31b9f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=333b6e5cda4e482ab1ce3f241ec6cfe9)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:43.328469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32c022-426f-410f-b7e3-0e83fd31b9f9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:43.330155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea2c68-9d7e-4ad1-ad96-eb097103bc36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:43.336226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea2c68-9d7e-4ad1-ad96-eb097103bc36 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:43.372113 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1294/2623] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:43.373271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea2c68-9d7e-4ad1-ad96-eb097103bc36 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:43.422511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea2c68-9d7e-4ad1-ad96-eb097103bc36 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:43.441488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a25bd1-0e09-4ea6-834d-d7594a0a2e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:43.441488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a25bd1-0e09-4ea6-834d-d7594a0a2e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:43.441488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a25bd1-0e09-4ea6-834d-d7594a0a2e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:43.441803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a25bd1-0e09-4ea6-834d-d7594a0a2e6a admin admin] PATH_INFO: `/v3/projects/d91a511e7db64d808db2e7616f31a9bb/users/fa3d85835ef3482cac69763d3d957181/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:43.493513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a25bd1-0e09-4ea6-834d-d7594a0a2e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91a511e7db64d808db2e7616f31a9bb, user_id=fa3d85835ef3482cac69763d3d957181, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:43.497617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a25bd1-0e09-4ea6-834d-d7594a0a2e6a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:43.520432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7d32c022-426f-410f-b7e3-0e83fd31b9f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '333b6e5cda4e482ab1ce3f241ec6cfe9', 'request_id': 'req-7d32c022-426f-410f-b7e3-0e83fd31b9f9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:43.530551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7d32c022-426f-410f-b7e3-0e83fd31b9f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '333b6e5cda4e482ab1ce3f241ec6cfe9', 'request_id': 'req-7d32c022-426f-410f-b7e3-0e83fd31b9f9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:43.542023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7d32c022-426f-410f-b7e3-0e83fd31b9f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '333b6e5cda4e482ab1ce3f241ec6cfe9', 'request_id': 'req-7d32c022-426f-410f-b7e3-0e83fd31b9f9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:43.544705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:43.586736 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1295/2624] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:26:43 2022] PUT /identity/v3/projects/d91a511e7db64d808db2e7616f31a9bb/users/fa3d85835ef3482cac69763d3d957181/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:43.592045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a1c23-dfec-4e7a-a443-5a94021a6982 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:43.594732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a1c23-dfec-4e7a-a443-5a94021a6982 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:43.595204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a1c23-dfec-4e7a-a443-5a94021a6982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:43.650234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-976a1c23-dfec-4e7a-a443-5a94021a6982 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:43.651603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7d32c022-426f-410f-b7e3-0e83fd31b9f9 admin admin] The token cache is being invalidate because project 333b6e5cda4e482ab1ce3f241ec6cfe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:26:43.651771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-976a1c23-dfec-4e7a-a443-5a94021a6982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:43.652310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7d32c022-426f-410f-b7e3-0e83fd31b9f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:43.653180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7d32c022-426f-410f-b7e3-0e83fd31b9f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:43.659525 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1330/2625] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:43 2022] DELETE /identity/v3/projects/333b6e5cda4e482ab1ce3f241ec6cfe9 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:43.661319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ba787-5cca-4c79-ac28-c2a68a90ff2e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:43.661799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ba787-5cca-4c79-ac28-c2a68a90ff2e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:43.662472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ba787-5cca-4c79-ac28-c2a68a90ff2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:43.715553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f68ba787-5cca-4c79-ac28-c2a68a90ff2e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:43.717949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f68ba787-5cca-4c79-ac28-c2a68a90ff2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:43.842098 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1296/2626] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:43.857992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a1c23-dfec-4e7a-a443-5a94021a6982 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:43.859641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-976a1c23-dfec-4e7a-a443-5a94021a6982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:43.901568 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1331/2627] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:43.913334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ab70c-6965-46ca-b486-14aad1ca263b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:43.913334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ab70c-6965-46ca-b486-14aad1ca263b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:43.913334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ab70c-6965-46ca-b486-14aad1ca263b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:43.998985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c80ab70c-6965-46ca-b486-14aad1ca263b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:44.002816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c80ab70c-6965-46ca-b486-14aad1ca263b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:44.024222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a1c23-dfec-4e7a-a443-5a94021a6982 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:44.038913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128bc5d-00c1-4e04-a1f8-88fde4ac78e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:44.039805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128bc5d-00c1-4e04-a1f8-88fde4ac78e4 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:44.040287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128bc5d-00c1-4e04-a1f8-88fde4ac78e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:44.040654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128bc5d-00c1-4e04-a1f8-88fde4ac78e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:44.060616 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1332/2628] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:44.063947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128bc5d-00c1-4e04-a1f8-88fde4ac78e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:44.065240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128bc5d-00c1-4e04-a1f8-88fde4ac78e4 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:44.073557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ab70c-6965-46ca-b486-14aad1ca263b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:44.081972 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1297/2629] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:44.134391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ab70c-6965-46ca-b486-14aad1ca263b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:44.154379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9e711-be9e-4389-b3e6-4a75e0fe26ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:44.155027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9e711-be9e-4389-b3e6-4a75e0fe26ba admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:44.155309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9e711-be9e-4389-b3e6-4a75e0fe26ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:44.155581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9e711-be9e-4389-b3e6-4a75e0fe26ba admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:44.156260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea9e711-be9e-4389-b3e6-4a75e0fe26ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:26:44.156568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea9e711-be9e-4389-b3e6-4a75e0fe26ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:44.158239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea9e711-be9e-4389-b3e6-4a75e0fe26ba admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:44.225202 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1333/2630] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:26:44.234324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128bc5d-00c1-4e04-a1f8-88fde4ac78e4 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:44.252583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128bc5d-00c1-4e04-a1f8-88fde4ac78e4 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:44.275597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bca0c-c86e-4f09-ac7b-e30c257a3fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:44.276569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bca0c-c86e-4f09-ac7b-e30c257a3fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:44.276766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bca0c-c86e-4f09-ac7b-e30c257a3fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:44.287830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bca0c-c86e-4f09-ac7b-e30c257a3fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:44.288561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bca0c-c86e-4f09-ac7b-e30c257a3fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:44.304808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bca0c-c86e-4f09-ac7b-e30c257a3fb1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:44.502419 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1298/2631] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:26:44 2022] POST /identity/v3/projects => generated 393 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:26:44.506383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9e711-be9e-4389-b3e6-4a75e0fe26ba admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:44.521516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9e711-be9e-4389-b3e6-4a75e0fe26ba admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:44.671968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a5bf5-51f7-4944-babb-36d92456eae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:44.672611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a5bf5-51f7-4944-babb-36d92456eae9 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:44.672899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a5bf5-51f7-4944-babb-36d92456eae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:44.673178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a5bf5-51f7-4944-babb-36d92456eae9 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:44.673826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a5bf5-51f7-4944-babb-36d92456eae9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:44.685250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a5bf5-51f7-4944-babb-36d92456eae9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:44.853371 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1334/2632] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:26:44 2022] POST /identity/v3/users => generated 297 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:26:44.856045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bca0c-c86e-4f09-ac7b-e30c257a3fb1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:44.887808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:44.904648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bca0c-c86e-4f09-ac7b-e30c257a3fb1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:44.925048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2aaf38-a23e-4cb7-b88b-e0623c2cfd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:44.930136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aaf38-a23e-4cb7-b88b-e0623c2cfd33 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:44.931129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aaf38-a23e-4cb7-b88b-e0623c2cfd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:44.932052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aaf38-a23e-4cb7-b88b-e0623c2cfd33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:44.934233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2aaf38-a23e-4cb7-b88b-e0623c2cfd33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:44.937080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2aaf38-a23e-4cb7-b88b-e0623c2cfd33 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:44.974394 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1299/2633] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:26:44.975093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a5bf5-51f7-4944-babb-36d92456eae9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:45.003769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a5bf5-51f7-4944-babb-36d92456eae9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:45.018980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb86cbc-1528-4967-bc43-7b6d4d51b8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:45.020084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb86cbc-1528-4967-bc43-7b6d4d51b8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:45.020573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb86cbc-1528-4967-bc43-7b6d4d51b8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:45.023846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb86cbc-1528-4967-bc43-7b6d4d51b8c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:45.023846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb86cbc-1528-4967-bc43-7b6d4d51b8c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:45.025328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb86cbc-1528-4967-bc43-7b6d4d51b8c6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:45.055487 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1335/2634] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:26:45.060168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2aaf38-a23e-4cb7-b88b-e0623c2cfd33 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:45.079248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2aaf38-a23e-4cb7-b88b-e0623c2cfd33 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:45.110953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3169c-28fe-41ce-8749-1001f3d4f03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:45.115640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3169c-28fe-41ce-8749-1001f3d4f03b admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:45.115995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3169c-28fe-41ce-8749-1001f3d4f03b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:45.116284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3169c-28fe-41ce-8749-1001f3d4f03b admin admin] PATH_INFO: `/v3/projects/e3abedd135814be5b8c75451d4e726e1/users/5441265fc78c416e8483d83625be08d5/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:45.193392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3169c-28fe-41ce-8749-1001f3d4f03b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3abedd135814be5b8c75451d4e726e1, user_id=5441265fc78c416e8483d83625be08d5, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:45.246313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3169c-28fe-41ce-8749-1001f3d4f03b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:45.391526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380246ee-0844-4a8b-b7d6-7cd98f81ac6e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:45.391826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380246ee-0844-4a8b-b7d6-7cd98f81ac6e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:45.392105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380246ee-0844-4a8b-b7d6-7cd98f81ac6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:45.399255 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1300/2635] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:26:45 2022] PUT /identity/v3/projects/e3abedd135814be5b8c75451d4e726e1/users/5441265fc78c416e8483d83625be08d5/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:45.490806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-380246ee-0844-4a8b-b7d6-7cd98f81ac6e None None] MFA Rules not processed for user `5441265fc78c416e8483d83625be08d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:45.492059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-380246ee-0844-4a8b-b7d6-7cd98f81ac6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:45.590652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:45.624105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3169c-28fe-41ce-8749-1001f3d4f03b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:45.626492 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1336/2636] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:45.869645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3169c-28fe-41ce-8749-1001f3d4f03b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:45.890210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8614c-97a7-4191-af42-667292915439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:45.894649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8614c-97a7-4191-af42-667292915439 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:45.895091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8614c-97a7-4191-af42-667292915439 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:45.898358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8614c-97a7-4191-af42-667292915439 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:45.900089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8614c-97a7-4191-af42-667292915439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:45.911011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8614c-97a7-4191-af42-667292915439 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:46.145035 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1301/2637] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:26:45 2022] POST /identity/v3/projects => generated 393 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:26:46.149046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380246ee-0844-4a8b-b7d6-7cd98f81ac6e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:46.166535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380246ee-0844-4a8b-b7d6-7cd98f81ac6e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:46.344729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ac7f5-281b-4337-b9ec-e8edff8b415f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:46.345636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ac7f5-281b-4337-b9ec-e8edff8b415f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:46.346269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ac7f5-281b-4337-b9ec-e8edff8b415f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:46.347225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ac7f5-281b-4337-b9ec-e8edff8b415f admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:46.348222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ac7f5-281b-4337-b9ec-e8edff8b415f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:46.353023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ac7f5-281b-4337-b9ec-e8edff8b415f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:46.482884 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1337/2638] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:26:46 2022] POST /identity/v3/users => generated 303 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:26:46.485276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8614c-97a7-4191-af42-667292915439 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:46.505391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8614c-97a7-4191-af42-667292915439 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:46.531569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204a5ab-7221-4c0e-9416-6b8dbe76e55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:46.539578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204a5ab-7221-4c0e-9416-6b8dbe76e55f admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:46.543249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204a5ab-7221-4c0e-9416-6b8dbe76e55f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:46.543249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204a5ab-7221-4c0e-9416-6b8dbe76e55f admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:46.544142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204a5ab-7221-4c0e-9416-6b8dbe76e55f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:46.553770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204a5ab-7221-4c0e-9416-6b8dbe76e55f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:46.637370 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1302/2639] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:26:46.641314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ac7f5-281b-4337-b9ec-e8edff8b415f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:46.657898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ac7f5-281b-4337-b9ec-e8edff8b415f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:46.682828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931bf26-3cb7-4642-ba7a-6b5f37fe7b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:46.688470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931bf26-3cb7-4642-ba7a-6b5f37fe7b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:46.688470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931bf26-3cb7-4642-ba7a-6b5f37fe7b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:46.688470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931bf26-3cb7-4642-ba7a-6b5f37fe7b22 admin admin] PATH_INFO: `/v3/projects/1d167557f4d042c28da315c93d358748/users/6598acbe4bae4c6893f5ccc4cd236af0/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:46.740980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4931bf26-3cb7-4642-ba7a-6b5f37fe7b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d167557f4d042c28da315c93d358748, user_id=6598acbe4bae4c6893f5ccc4cd236af0, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:46.757673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4931bf26-3cb7-4642-ba7a-6b5f37fe7b22 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:46.874427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204a5ab-7221-4c0e-9416-6b8dbe76e55f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:46.874865 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1338/2640] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:26:46 2022] PUT /identity/v3/projects/1d167557f4d042c28da315c93d358748/users/6598acbe4bae4c6893f5ccc4cd236af0/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:46.891185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204a5ab-7221-4c0e-9416-6b8dbe76e55f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:47.099618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f400c7-4624-4b6b-8ce1-8173e61e940f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:47.100240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f400c7-4624-4b6b-8ce1-8173e61e940f admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:47.100523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f400c7-4624-4b6b-8ce1-8173e61e940f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:47.100799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f400c7-4624-4b6b-8ce1-8173e61e940f admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:47.101463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f400c7-4624-4b6b-8ce1-8173e61e940f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:47.104716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f400c7-4624-4b6b-8ce1-8173e61e940f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:47.142434 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1303/2641] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:26:47.147504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931bf26-3cb7-4642-ba7a-6b5f37fe7b22 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:47.165015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931bf26-3cb7-4642-ba7a-6b5f37fe7b22 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:47.195827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6a347-b958-40c9-866d-027fbc542429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:47.201264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6a347-b958-40c9-866d-027fbc542429 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:47.201264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6a347-b958-40c9-866d-027fbc542429 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:47.201264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6a347-b958-40c9-866d-027fbc542429 admin admin] PATH_INFO: `/v3/projects/1d167557f4d042c28da315c93d358748/users/6598acbe4bae4c6893f5ccc4cd236af0/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:47.211883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6a347-b958-40c9-866d-027fbc542429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d167557f4d042c28da315c93d358748, user_id=6598acbe4bae4c6893f5ccc4cd236af0, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:47.216356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6a347-b958-40c9-866d-027fbc542429 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:47.277864 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1339/2642] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:26:47 2022] PUT /identity/v3/projects/1d167557f4d042c28da315c93d358748/users/6598acbe4bae4c6893f5ccc4cd236af0/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:47.281314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3b127-2748-421f-876a-498cd40f2459 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:47.281608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3b127-2748-421f-876a-498cd40f2459 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:47.281888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3b127-2748-421f-876a-498cd40f2459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:47.365533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-bba3b127-2748-421f-876a-498cd40f2459 None None] MFA Rules not processed for user `6598acbe4bae4c6893f5ccc4cd236af0`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:47.370458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bba3b127-2748-421f-876a-498cd40f2459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:47.483380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:47.599485 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1304/2643] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:47 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:47.606940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6a347-b958-40c9-866d-027fbc542429 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:47.609798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3bb6a347-b958-40c9-866d-027fbc542429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:47.815875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6a347-b958-40c9-866d-027fbc542429 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:47.828835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4bfac-15d5-469a-9371-13236c5dd36f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:47.833325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4bfac-15d5-469a-9371-13236c5dd36f service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:47.833880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4bfac-15d5-469a-9371-13236c5dd36f service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:47.835258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4bfac-15d5-469a-9371-13236c5dd36f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:47.873705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4bfac-15d5-469a-9371-13236c5dd36f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:47.875781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4bfac-15d5-469a-9371-13236c5dd36f service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:47.909816 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1340/2644] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:47 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:48.095755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3b127-2748-421f-876a-498cd40f2459 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:48.097874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bba3b127-2748-421f-876a-498cd40f2459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:48.147338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3b127-2748-421f-876a-498cd40f2459 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:48.160342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44806b-a1eb-4f61-a969-906618618492 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:48.161237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44806b-a1eb-4f61-a969-906618618492 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:48.162327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44806b-a1eb-4f61-a969-906618618492 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:48.162797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44806b-a1eb-4f61-a969-906618618492 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:48.313626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44806b-a1eb-4f61-a969-906618618492 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:48.316156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44806b-a1eb-4f61-a969-906618618492 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:48.337159 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1305/2645] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:48 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:26:48.389712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4bfac-15d5-469a-9371-13236c5dd36f service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:48.430291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:48.534947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4bfac-15d5-469a-9371-13236c5dd36f service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:48.540710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6858885-65d6-425e-9599-a497614dc8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:48.542435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6858885-65d6-425e-9599-a497614dc8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:48.542982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6858885-65d6-425e-9599-a497614dc8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:48.543482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6858885-65d6-425e-9599-a497614dc8ca admin admin] PATH_INFO: `/v3/users/5441265fc78c416e8483d83625be08d5` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:48.544940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6858885-65d6-425e-9599-a497614dc8ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=5441265fc78c416e8483d83625be08d5)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:48.547171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6858885-65d6-425e-9599-a497614dc8ca admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:48.810996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f6858885-65d6-425e-9599-a497614dc8ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5441265fc78c416e8483d83625be08d5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:48.812121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f6858885-65d6-425e-9599-a497614dc8ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5441265fc78c416e8483d83625be08d5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:48.837811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f6858885-65d6-425e-9599-a497614dc8ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5441265fc78c416e8483d83625be08d5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:48.918585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f6858885-65d6-425e-9599-a497614dc8ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5441265fc78c416e8483d83625be08d5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:48.920515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f6858885-65d6-425e-9599-a497614dc8ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5441265fc78c416e8483d83625be08d5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:49.026695 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1341/2646] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:26:48 2022] DELETE /identity/v3/users/5441265fc78c416e8483d83625be08d5 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:49.029345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23331d3-ff44-4d14-9ca8-69caca6072eb None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:49.030374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23331d3-ff44-4d14-9ca8-69caca6072eb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:49.030879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23331d3-ff44-4d14-9ca8-69caca6072eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:49.094405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a23331d3-ff44-4d14-9ca8-69caca6072eb None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:49.098621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a23331d3-ff44-4d14-9ca8-69caca6072eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:49.320531 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1306/2647] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:49.377114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6858885-65d6-425e-9599-a497614dc8ca admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:49.378705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f6858885-65d6-425e-9599-a497614dc8ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:49.580093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6858885-65d6-425e-9599-a497614dc8ca admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:49.654783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846e4a2-e620-4252-a327-5b71b1541ad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:49.669207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846e4a2-e620-4252-a327-5b71b1541ad4 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:49.672885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846e4a2-e620-4252-a327-5b71b1541ad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:49.673272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846e4a2-e620-4252-a327-5b71b1541ad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:49.712036 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846e4a2-e620-4252-a327-5b71b1541ad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:49.715343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846e4a2-e620-4252-a327-5b71b1541ad4 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:49.763891 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1342/2648] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:51.575781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23331d3-ff44-4d14-9ca8-69caca6072eb None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:51.577540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a23331d3-ff44-4d14-9ca8-69caca6072eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:51.608963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23331d3-ff44-4d14-9ca8-69caca6072eb None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:51.621388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffa361-7424-404f-8020-902d7beb19d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:51.623373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffa361-7424-404f-8020-902d7beb19d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:51.626172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffa361-7424-404f-8020-902d7beb19d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:51.626172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffa361-7424-404f-8020-902d7beb19d2 admin admin] PATH_INFO: `/v3/projects/e3abedd135814be5b8c75451d4e726e1` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:51.639039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ffa361-7424-404f-8020-902d7beb19d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3abedd135814be5b8c75451d4e726e1)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:51.642839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ffa361-7424-404f-8020-902d7beb19d2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:51.947385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-51ffa361-7424-404f-8020-902d7beb19d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3abedd135814be5b8c75451d4e726e1', 'request_id': 'req-51ffa361-7424-404f-8020-902d7beb19d2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:52.047086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-51ffa361-7424-404f-8020-902d7beb19d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3abedd135814be5b8c75451d4e726e1', 'request_id': 'req-51ffa361-7424-404f-8020-902d7beb19d2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:52.049577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:52.054686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-51ffa361-7424-404f-8020-902d7beb19d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3abedd135814be5b8c75451d4e726e1', 'request_id': 'req-51ffa361-7424-404f-8020-902d7beb19d2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:52.091693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-51ffa361-7424-404f-8020-902d7beb19d2 admin admin] The token cache is being invalidate because project e3abedd135814be5b8c75451d4e726e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:26:52.092344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-51ffa361-7424-404f-8020-902d7beb19d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:52.094443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-51ffa361-7424-404f-8020-902d7beb19d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:52.103223 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1307/2649] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:51 2022] DELETE /identity/v3/projects/e3abedd135814be5b8c75451d4e726e1 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:52.108221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846e4a2-e620-4252-a327-5b71b1541ad4 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:52.122159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846e4a2-e620-4252-a327-5b71b1541ad4 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:52.345567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a991f-2aa5-4735-a351-1e998f3b681c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:52.345856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a991f-2aa5-4735-a351-1e998f3b681c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:52.346335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a991f-2aa5-4735-a351-1e998f3b681c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:52.384981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:52.432802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80101075-c613-499b-a76e-c7f2129670ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:52.434534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80101075-c613-499b-a76e-c7f2129670ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:52.435205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80101075-c613-499b-a76e-c7f2129670ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:52.437508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80101075-c613-499b-a76e-c7f2129670ab admin admin] PATH_INFO: `/v3/users/6598acbe4bae4c6893f5ccc4cd236af0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:52.440120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80101075-c613-499b-a76e-c7f2129670ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=6598acbe4bae4c6893f5ccc4cd236af0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:52.446095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80101075-c613-499b-a76e-c7f2129670ab admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:52.464040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-3f7a991f-2aa5-4735-a351-1e998f3b681c None None] MFA Rules not processed for user `f2d8c2e266484f55b6a04ddfb4894922`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:52.468772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3f7a991f-2aa5-4735-a351-1e998f3b681c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:52.700100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-80101075-c613-499b-a76e-c7f2129670ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6598acbe4bae4c6893f5ccc4cd236af0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:52.702796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-80101075-c613-499b-a76e-c7f2129670ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6598acbe4bae4c6893f5ccc4cd236af0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:52.740245 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1308/2650] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:52 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:26:52.748635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-80101075-c613-499b-a76e-c7f2129670ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6598acbe4bae4c6893f5ccc4cd236af0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:52.784889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-80101075-c613-499b-a76e-c7f2129670ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6598acbe4bae4c6893f5ccc4cd236af0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:52.788398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-80101075-c613-499b-a76e-c7f2129670ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6598acbe4bae4c6893f5ccc4cd236af0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:52.911086 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1343/2651] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:26:52 2022] DELETE /identity/v3/users/6598acbe4bae4c6893f5ccc4cd236af0 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:55.910300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a991f-2aa5-4735-a351-1e998f3b681c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:55.915493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3f7a991f-2aa5-4735-a351-1e998f3b681c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:56.125852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a991f-2aa5-4735-a351-1e998f3b681c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:56.274499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150c836-1faf-4dd4-8e9b-cd5af3905c62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:56.275492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150c836-1faf-4dd4-8e9b-cd5af3905c62 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:56.276320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150c836-1faf-4dd4-8e9b-cd5af3905c62 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:56.277099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150c836-1faf-4dd4-8e9b-cd5af3905c62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:56.280205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0150c836-1faf-4dd4-8e9b-cd5af3905c62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:56.290143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:56.368519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150c836-1faf-4dd4-8e9b-cd5af3905c62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:56.370846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150c836-1faf-4dd4-8e9b-cd5af3905c62 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:56.424601 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1309/2652] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:26:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:58.475551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80101075-c613-499b-a76e-c7f2129670ab admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:58.477087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-80101075-c613-499b-a76e-c7f2129670ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:58.676106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80101075-c613-499b-a76e-c7f2129670ab admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:58.697262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b24a99-3251-4809-b865-ed5b769927cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:58.698999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b24a99-3251-4809-b865-ed5b769927cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:58.702007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b24a99-3251-4809-b865-ed5b769927cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:58.702596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b24a99-3251-4809-b865-ed5b769927cd admin admin] PATH_INFO: `/v3/projects/1d167557f4d042c28da315c93d358748` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:58.707892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b24a99-3251-4809-b865-ed5b769927cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d167557f4d042c28da315c93d358748)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:58.712605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b24a99-3251-4809-b865-ed5b769927cd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:58.982678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-67b24a99-3251-4809-b865-ed5b769927cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d167557f4d042c28da315c93d358748', 'request_id': 'req-67b24a99-3251-4809-b865-ed5b769927cd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:59.016476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-67b24a99-3251-4809-b865-ed5b769927cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d167557f4d042c28da315c93d358748', 'request_id': 'req-67b24a99-3251-4809-b865-ed5b769927cd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:59.053553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-67b24a99-3251-4809-b865-ed5b769927cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d167557f4d042c28da315c93d358748', 'request_id': 'req-67b24a99-3251-4809-b865-ed5b769927cd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:59.055847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:59.163839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-67b24a99-3251-4809-b865-ed5b769927cd admin admin] The token cache is being invalidate because project 1d167557f4d042c28da315c93d358748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:26:59.164143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-67b24a99-3251-4809-b865-ed5b769927cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:59.165596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-67b24a99-3251-4809-b865-ed5b769927cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:26:59.167668 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1344/2653] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:58 2022] DELETE /identity/v3/projects/1d167557f4d042c28da315c93d358748 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:26:59.173922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6488828-3c9b-4d49-98b3-12e34e44ab7d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:59.175668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6488828-3c9b-4d49-98b3-12e34e44ab7d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:59.176123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6488828-3c9b-4d49-98b3-12e34e44ab7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:59.217205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c6488828-3c9b-4d49-98b3-12e34e44ab7d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:59.223876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c6488828-3c9b-4d49-98b3-12e34e44ab7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:59.525307 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1310/2654] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:59.534132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00bfb2-2a83-4812-b349-ed5f72750b7a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:59.535151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00bfb2-2a83-4812-b349-ed5f72750b7a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:59.535379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00bfb2-2a83-4812-b349-ed5f72750b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:59.607439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-aa00bfb2-2a83-4812-b349-ed5f72750b7a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:26:59.607439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-aa00bfb2-2a83-4812-b349-ed5f72750b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:26:59.651280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6488828-3c9b-4d49-98b3-12e34e44ab7d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:59.665121 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1345/2655] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:26:59.667007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6488828-3c9b-4d49-98b3-12e34e44ab7d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:59.680038 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20feea6-f7f7-42bb-8899-4a3a322ab2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:59.681156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20feea6-f7f7-42bb-8899-4a3a322ab2fd admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:59.683312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20feea6-f7f7-42bb-8899-4a3a322ab2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:59.683859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20feea6-f7f7-42bb-8899-4a3a322ab2fd admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:59.685624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20feea6-f7f7-42bb-8899-4a3a322ab2fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:26:59.688214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20feea6-f7f7-42bb-8899-4a3a322ab2fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:59.697873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20feea6-f7f7-42bb-8899-4a3a322ab2fd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:26:59.731866 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1311/2656] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:26:59.733354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00bfb2-2a83-4812-b349-ed5f72750b7a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:26:59.751830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00bfb2-2a83-4812-b349-ed5f72750b7a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:26:59.766608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b519b8-fc87-47ad-a1c3-c4e78c61f7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:26:59.769506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b519b8-fc87-47ad-a1c3-c4e78c61f7aa admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:26:59.770129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b519b8-fc87-47ad-a1c3-c4e78c61f7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:26:59.771893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b519b8-fc87-47ad-a1c3-c4e78c61f7aa admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:26:59.774861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b519b8-fc87-47ad-a1c3-c4e78c61f7aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:26:59.782602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b519b8-fc87-47ad-a1c3-c4e78c61f7aa admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:00.247391 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1346/2657] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:26:59 2022] POST /identity/v3/projects => generated 377 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:27:00.251939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20feea6-f7f7-42bb-8899-4a3a322ab2fd admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:00.266271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20feea6-f7f7-42bb-8899-4a3a322ab2fd admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:00.368728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab30c29-d5d9-4439-a005-637f8780a067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:00.369586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab30c29-d5d9-4439-a005-637f8780a067 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:00.369870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab30c29-d5d9-4439-a005-637f8780a067 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:00.370173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab30c29-d5d9-4439-a005-637f8780a067 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:00.371042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab30c29-d5d9-4439-a005-637f8780a067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:00.373745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab30c29-d5d9-4439-a005-637f8780a067 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:00.496179 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1312/2658] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:27:00 2022] POST /identity/v3/users => generated 289 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:27:00.510638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b519b8-fc87-47ad-a1c3-c4e78c61f7aa admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:00.537102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b519b8-fc87-47ad-a1c3-c4e78c61f7aa admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:00.555737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b589a0-47c8-4fb1-9854-090dcc4156f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:00.556632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b589a0-47c8-4fb1-9854-090dcc4156f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:00.557069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b589a0-47c8-4fb1-9854-090dcc4156f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:00.557498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b589a0-47c8-4fb1-9854-090dcc4156f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:00.558366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b589a0-47c8-4fb1-9854-090dcc4156f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:00.560793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b589a0-47c8-4fb1-9854-090dcc4156f4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:00.604619 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1347/2659] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:27:00.609498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab30c29-d5d9-4439-a005-637f8780a067 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:00.642023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab30c29-d5d9-4439-a005-637f8780a067 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:00.648637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9e089-3364-4230-9b77-73d0bbe2f7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:00.649150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9e089-3364-4230-9b77-73d0bbe2f7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:00.650043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9e089-3364-4230-9b77-73d0bbe2f7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:00.650346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9e089-3364-4230-9b77-73d0bbe2f7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:00.651266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9e089-3364-4230-9b77-73d0bbe2f7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:00.653179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9e089-3364-4230-9b77-73d0bbe2f7b2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:00.676191 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1313/2660] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:27:00.681303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b589a0-47c8-4fb1-9854-090dcc4156f4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:00.699499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b589a0-47c8-4fb1-9854-090dcc4156f4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:00.719323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e25a9-4319-482a-a808-fa4922590f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:00.720368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e25a9-4319-482a-a808-fa4922590f33 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:00.720829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e25a9-4319-482a-a808-fa4922590f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:00.721274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e25a9-4319-482a-a808-fa4922590f33 admin admin] PATH_INFO: `/v3/projects/c3fc032a089f45efa4a66866a9c961c9/users/17b2717ace074a579d33c60964e6668a/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:00.750566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e25a9-4319-482a-a808-fa4922590f33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3fc032a089f45efa4a66866a9c961c9, user_id=17b2717ace074a579d33c60964e6668a, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:00.755708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e25a9-4319-482a-a808-fa4922590f33 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:00.891374 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1348/2661] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:27:00 2022] PUT /identity/v3/projects/c3fc032a089f45efa4a66866a9c961c9/users/17b2717ace074a579d33c60964e6668a/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:27:00.893400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c91688-3bb4-4449-b0c4-5f6355e31440 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:00.894637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c91688-3bb4-4449-b0c4-5f6355e31440 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:00.894982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c91688-3bb4-4449-b0c4-5f6355e31440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:00.943608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-37c91688-3bb4-4449-b0c4-5f6355e31440 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:27:00.944981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-37c91688-3bb4-4449-b0c4-5f6355e31440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:00.949492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:01.054782 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1314/2662] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:27:01.217749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e25a9-4319-482a-a808-fa4922590f33 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:01.221050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8d7e25a9-4319-482a-a808-fa4922590f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:01.371887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e25a9-4319-482a-a808-fa4922590f33 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:01.382426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b40b68-e5c5-4623-a8b4-ff31d38f722d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:01.383112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b40b68-e5c5-4623-a8b4-ff31d38f722d service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:01.383396 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b40b68-e5c5-4623-a8b4-ff31d38f722d service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:01.383669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b40b68-e5c5-4623-a8b4-ff31d38f722d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:01.406056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b40b68-e5c5-4623-a8b4-ff31d38f722d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:01.407773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b40b68-e5c5-4623-a8b4-ff31d38f722d service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:01.430526 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1349/2663] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:27:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:27:05.689415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a39da7-0605-4e7c-8c37-e6bae46eb4f0 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:05.689909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a39da7-0605-4e7c-8c37-e6bae46eb4f0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:05.689997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a39da7-0605-4e7c-8c37-e6bae46eb4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:05.758080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-95a39da7-0605-4e7c-8c37-e6bae46eb4f0 None None] MFA Rules not processed for user `fa3d85835ef3482cac69763d3d957181`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:27:05.760594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-95a39da7-0605-4e7c-8c37-e6bae46eb4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:06.012372 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1315/2664] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:27:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:27:06.023534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b40b68-e5c5-4623-a8b4-ff31d38f722d service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:06.025393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-26b40b68-e5c5-4623-a8b4-ff31d38f722d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:06.306486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b40b68-e5c5-4623-a8b4-ff31d38f722d service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:06.326960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461904da-fa6d-409d-88b2-25c207e7160a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:06.327597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461904da-fa6d-409d-88b2-25c207e7160a service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:06.327880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461904da-fa6d-409d-88b2-25c207e7160a service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:06.328159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461904da-fa6d-409d-88b2-25c207e7160a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:06.345411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461904da-fa6d-409d-88b2-25c207e7160a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:06.347136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461904da-fa6d-409d-88b2-25c207e7160a service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:06.381007 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1350/2665] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:27:06 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:27:10.604861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce65e9-e141-4a21-aa67-3e06742ee7cc None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:10.604861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce65e9-e141-4a21-aa67-3e06742ee7cc None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:10.604861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce65e9-e141-4a21-aa67-3e06742ee7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:10.650640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-94ce65e9-e141-4a21-aa67-3e06742ee7cc None None] MFA Rules not processed for user `c65ddc0af5854d7a89192d01bc5f4576`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:27:10.653070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-94ce65e9-e141-4a21-aa67-3e06742ee7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:10.779488 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1316/2666] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:27:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:27:11.810326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461904da-fa6d-409d-88b2-25c207e7160a service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:11.812369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-461904da-fa6d-409d-88b2-25c207e7160a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:11.837867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461904da-fa6d-409d-88b2-25c207e7160a service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:11.848887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59507a-0858-46b3-bae3-fd9abd68bb77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:11.850095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59507a-0858-46b3-bae3-fd9abd68bb77 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:11.852896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59507a-0858-46b3-bae3-fd9abd68bb77 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:11.853487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59507a-0858-46b3-bae3-fd9abd68bb77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:11.857719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ee59507a-0858-46b3-bae3-fd9abd68bb77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:11.887537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59507a-0858-46b3-bae3-fd9abd68bb77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:11.889969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59507a-0858-46b3-bae3-fd9abd68bb77 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:11.917043 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1351/2667] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:27:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:27:16.129586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75a370-5559-4449-8d52-7f4ccfed901d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:16.131666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75a370-5559-4449-8d52-7f4ccfed901d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:16.131666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75a370-5559-4449-8d52-7f4ccfed901d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:16.158708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9b75a370-5559-4449-8d52-7f4ccfed901d None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:27:16.161281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9b75a370-5559-4449-8d52-7f4ccfed901d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:16.266159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:16.290567 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1317/2668] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:27:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:27:16.304734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59507a-0858-46b3-bae3-fd9abd68bb77 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:16.307851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ee59507a-0858-46b3-bae3-fd9abd68bb77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:16.318382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:16.454880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59507a-0858-46b3-bae3-fd9abd68bb77 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:16.468777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c53227-7a45-49b0-809d-1d133d2d0490 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:16.469489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c53227-7a45-49b0-809d-1d133d2d0490 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:16.469842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c53227-7a45-49b0-809d-1d133d2d0490 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:16.470216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c53227-7a45-49b0-809d-1d133d2d0490 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:16.484981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c53227-7a45-49b0-809d-1d133d2d0490 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:16.487110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c53227-7a45-49b0-809d-1d133d2d0490 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:16.499872 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1352/2669] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:27:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:27:16.754622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01904db5-4700-4afe-bdde-c82e3c0324e1 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:16.765301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01904db5-4700-4afe-bdde-c82e3c0324e1 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:16.765301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01904db5-4700-4afe-bdde-c82e3c0324e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:16.819213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-01904db5-4700-4afe-bdde-c82e3c0324e1 None None] MFA Rules not processed for user `8e8640291c8745609faae41bdd731c17`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:27:16.822710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-01904db5-4700-4afe-bdde-c82e3c0324e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:17.008811 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1318/2670] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:27:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:27:20.887184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1eb6c-0bdf-4be8-a43e-eaa0523c7452 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:20.887701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1eb6c-0bdf-4be8-a43e-eaa0523c7452 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:20.887802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1eb6c-0bdf-4be8-a43e-eaa0523c7452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:20.930962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c4e1eb6c-0bdf-4be8-a43e-eaa0523c7452 None None] MFA Rules not processed for user `1d6175f2ac39494f8cba3db225150d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:27:20.935034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c4e1eb6c-0bdf-4be8-a43e-eaa0523c7452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:21.060953 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1353/2671] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:27:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:27:21.129185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b610b1-f6ad-4aca-aa66-032a0fac24d2 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:21.129724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b610b1-f6ad-4aca-aa66-032a0fac24d2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:21.129724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b610b1-f6ad-4aca-aa66-032a0fac24d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:21.215599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d6b610b1-f6ad-4aca-aa66-032a0fac24d2 None None] MFA Rules not processed for user `17b2717ace074a579d33c60964e6668a`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:27:21.217784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d6b610b1-f6ad-4aca-aa66-032a0fac24d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:21.346568 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1319/2672] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:27:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:27:21.493187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1eb6c-0bdf-4be8-a43e-eaa0523c7452 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:21.495084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c4e1eb6c-0bdf-4be8-a43e-eaa0523c7452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:21.522758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1eb6c-0bdf-4be8-a43e-eaa0523c7452 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:21.535140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d529be-4de7-443e-a588-b25fa18b3192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:21.536155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d529be-4de7-443e-a588-b25fa18b3192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:21.536735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d529be-4de7-443e-a588-b25fa18b3192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:21.537263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d529be-4de7-443e-a588-b25fa18b3192 admin admin] PATH_INFO: `/v3/users/1cd71bf0f4f843d88ca6cbe82bd0c100` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:21.541596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d529be-4de7-443e-a588-b25fa18b3192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cd71bf0f4f843d88ca6cbe82bd0c100)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:21.547199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d529be-4de7-443e-a588-b25fa18b3192 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:21.812972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-74d529be-4de7-443e-a588-b25fa18b3192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cd71bf0f4f843d88ca6cbe82bd0c100'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:21.813991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-74d529be-4de7-443e-a588-b25fa18b3192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cd71bf0f4f843d88ca6cbe82bd0c100'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:21.825373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-74d529be-4de7-443e-a588-b25fa18b3192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cd71bf0f4f843d88ca6cbe82bd0c100'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:21.849912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b610b1-f6ad-4aca-aa66-032a0fac24d2 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:21.852369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d6b610b1-f6ad-4aca-aa66-032a0fac24d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:21.868477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-74d529be-4de7-443e-a588-b25fa18b3192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cd71bf0f4f843d88ca6cbe82bd0c100'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:21.869460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-74d529be-4de7-443e-a588-b25fa18b3192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cd71bf0f4f843d88ca6cbe82bd0c100'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:21.886331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b610b1-f6ad-4aca-aa66-032a0fac24d2 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:21.895051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a786767-3639-4ada-aef5-8eea6ed9e8ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:21.897467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a786767-3639-4ada-aef5-8eea6ed9e8ec service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:21.898729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a786767-3639-4ada-aef5-8eea6ed9e8ec service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:21.899207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a786767-3639-4ada-aef5-8eea6ed9e8ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:21.901775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9a786767-3639-4ada-aef5-8eea6ed9e8ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:21.920874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a786767-3639-4ada-aef5-8eea6ed9e8ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:21.923626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a786767-3639-4ada-aef5-8eea6ed9e8ec service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:21.935456 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1354/2673] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:27:21 2022] DELETE /identity/v3/users/1cd71bf0f4f843d88ca6cbe82bd0c100 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:27:21.952332 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1320/2674] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:27:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:27:22.497134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d529be-4de7-443e-a588-b25fa18b3192 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:22.502852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-74d529be-4de7-443e-a588-b25fa18b3192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:22.536572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:22.681932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d529be-4de7-443e-a588-b25fa18b3192 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:22.687617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b1df5-5fcc-4f21-876d-31901723048e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:22.689144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b1df5-5fcc-4f21-876d-31901723048e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:22.689537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b1df5-5fcc-4f21-876d-31901723048e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:22.689925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b1df5-5fcc-4f21-876d-31901723048e admin admin] PATH_INFO: `/v3/projects/24d25f38f998435da07701bf996f14f3` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:22.700607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b1df5-5fcc-4f21-876d-31901723048e admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d25f38f998435da07701bf996f14f3)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:22.707436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b1df5-5fcc-4f21-876d-31901723048e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:22.928888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e23b1df5-5fcc-4f21-876d-31901723048e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d25f38f998435da07701bf996f14f3', 'request_id': 'req-e23b1df5-5fcc-4f21-876d-31901723048e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:22.952569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e23b1df5-5fcc-4f21-876d-31901723048e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d25f38f998435da07701bf996f14f3', 'request_id': 'req-e23b1df5-5fcc-4f21-876d-31901723048e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:22.974499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e23b1df5-5fcc-4f21-876d-31901723048e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d25f38f998435da07701bf996f14f3', 'request_id': 'req-e23b1df5-5fcc-4f21-876d-31901723048e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:23.066181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e23b1df5-5fcc-4f21-876d-31901723048e admin admin] The token cache is being invalidate because project 24d25f38f998435da07701bf996f14f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:27:23.066867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e23b1df5-5fcc-4f21-876d-31901723048e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:23.068865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e23b1df5-5fcc-4f21-876d-31901723048e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:23.071561 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1355/2675] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:27:22 2022] DELETE /identity/v3/projects/24d25f38f998435da07701bf996f14f3 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:27:23.075740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a786767-3639-4ada-aef5-8eea6ed9e8ec service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:23.087614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a786767-3639-4ada-aef5-8eea6ed9e8ec service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:23.216926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf04b4-3a68-4a56-a18e-c5b543802547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:23.218227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf04b4-3a68-4a56-a18e-c5b543802547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:23.219859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf04b4-3a68-4a56-a18e-c5b543802547 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:23.220408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf04b4-3a68-4a56-a18e-c5b543802547 admin admin] PATH_INFO: `/v3/users/f2d8c2e266484f55b6a04ddfb4894922` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:23.223117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf04b4-3a68-4a56-a18e-c5b543802547 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d8c2e266484f55b6a04ddfb4894922)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:23.226754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf04b4-3a68-4a56-a18e-c5b543802547 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:23.265938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:23.508143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1ccf04b4-3a68-4a56-a18e-c5b543802547 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d8c2e266484f55b6a04ddfb4894922'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:23.516840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1ccf04b4-3a68-4a56-a18e-c5b543802547 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d8c2e266484f55b6a04ddfb4894922'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:23.531528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1ccf04b4-3a68-4a56-a18e-c5b543802547 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d8c2e266484f55b6a04ddfb4894922'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:23.562569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1ccf04b4-3a68-4a56-a18e-c5b543802547 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d8c2e266484f55b6a04ddfb4894922'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:23.682309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1ccf04b4-3a68-4a56-a18e-c5b543802547 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d8c2e266484f55b6a04ddfb4894922'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:23.689597 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1321/2676] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:27:23 2022] DELETE /identity/v3/users/f2d8c2e266484f55b6a04ddfb4894922 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:27:24.504921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b1df5-5fcc-4f21-876d-31901723048e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:24.504921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e23b1df5-5fcc-4f21-876d-31901723048e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:24.530642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b1df5-5fcc-4f21-876d-31901723048e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:24.644671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23593903-b40c-4c8a-add0-1507128b36a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:24.645684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23593903-b40c-4c8a-add0-1507128b36a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:24.648562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23593903-b40c-4c8a-add0-1507128b36a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:24.649080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23593903-b40c-4c8a-add0-1507128b36a5 admin admin] PATH_INFO: `/v3/projects/ea69e0d07f7e49bbadcf406b8093c231` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:24.653027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23593903-b40c-4c8a-add0-1507128b36a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea69e0d07f7e49bbadcf406b8093c231)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:24.655949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23593903-b40c-4c8a-add0-1507128b36a5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:24.819323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:24.835145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-23593903-b40c-4c8a-add0-1507128b36a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea69e0d07f7e49bbadcf406b8093c231', 'request_id': 'req-23593903-b40c-4c8a-add0-1507128b36a5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:24.844702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-23593903-b40c-4c8a-add0-1507128b36a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea69e0d07f7e49bbadcf406b8093c231', 'request_id': 'req-23593903-b40c-4c8a-add0-1507128b36a5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:24.876142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-23593903-b40c-4c8a-add0-1507128b36a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea69e0d07f7e49bbadcf406b8093c231', 'request_id': 'req-23593903-b40c-4c8a-add0-1507128b36a5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:25.013237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-23593903-b40c-4c8a-add0-1507128b36a5 admin admin] The token cache is being invalidate because project ea69e0d07f7e49bbadcf406b8093c231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:27:25.013604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-23593903-b40c-4c8a-add0-1507128b36a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:25.019462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-23593903-b40c-4c8a-add0-1507128b36a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:25.024432 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1356/2677] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:27:24 2022] DELETE /identity/v3/projects/ea69e0d07f7e49bbadcf406b8093c231 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:27:25.025726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01385d02-85ad-48ee-9686-106e4da93d29 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:25.026219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01385d02-85ad-48ee-9686-106e4da93d29 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:25.026310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01385d02-85ad-48ee-9686-106e4da93d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:25.077218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-01385d02-85ad-48ee-9686-106e4da93d29 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:27:25.079868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-01385d02-85ad-48ee-9686-106e4da93d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:25.207524 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1322/2678] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:27:25.218832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d109c-515d-4acb-86f5-9c614e1b7aea None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:25.219131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d109c-515d-4acb-86f5-9c614e1b7aea None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:25.219462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d109c-515d-4acb-86f5-9c614e1b7aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:25.246208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f14d109c-515d-4acb-86f5-9c614e1b7aea None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:27:25.247780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f14d109c-515d-4acb-86f5-9c614e1b7aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:25.258947 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1357/2679] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:27:25.263217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01385d02-85ad-48ee-9686-106e4da93d29 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:25.279326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01385d02-85ad-48ee-9686-106e4da93d29 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:25.297012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95c75f-dc11-428e-91e4-679890ea0d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:25.298495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95c75f-dc11-428e-91e4-679890ea0d77 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:25.300759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95c75f-dc11-428e-91e4-679890ea0d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:25.301244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95c75f-dc11-428e-91e4-679890ea0d77 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:25.302189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95c75f-dc11-428e-91e4-679890ea0d77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:27:25.303162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95c75f-dc11-428e-91e4-679890ea0d77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:25.306824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95c75f-dc11-428e-91e4-679890ea0d77 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:25.345767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d109c-515d-4acb-86f5-9c614e1b7aea None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:25.346010 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1323/2680] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:27:25.371759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d109c-515d-4acb-86f5-9c614e1b7aea None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:25.389237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad31d2-7d18-4eef-9505-308226612c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:25.389801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad31d2-7d18-4eef-9505-308226612c0c admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:25.392525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad31d2-7d18-4eef-9505-308226612c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:25.392845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad31d2-7d18-4eef-9505-308226612c0c admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:25.394749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad31d2-7d18-4eef-9505-308226612c0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:25.400777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad31d2-7d18-4eef-9505-308226612c0c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:25.587309 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1358/2681] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:27:25 2022] POST /identity/v3/projects => generated 377 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:27:25.591774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95c75f-dc11-428e-91e4-679890ea0d77 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:25.608489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95c75f-dc11-428e-91e4-679890ea0d77 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:25.764510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93caaa3-a9fe-473b-971f-07976311e473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:25.766001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93caaa3-a9fe-473b-971f-07976311e473 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:25.767236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93caaa3-a9fe-473b-971f-07976311e473 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:25.767671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93caaa3-a9fe-473b-971f-07976311e473 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:25.770002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93caaa3-a9fe-473b-971f-07976311e473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:25.772230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93caaa3-a9fe-473b-971f-07976311e473 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:25.900396 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad31d2-7d18-4eef-9505-308226612c0c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:25.901166 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1324/2682] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:27:25 2022] POST /identity/v3/users => generated 289 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:27:25.919722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad31d2-7d18-4eef-9505-308226612c0c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:25.932938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323b6f5-c1bd-46ac-bcaf-0f04f43991e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:25.933887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323b6f5-c1bd-46ac-bcaf-0f04f43991e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:25.935028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323b6f5-c1bd-46ac-bcaf-0f04f43991e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:25.935489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323b6f5-c1bd-46ac-bcaf-0f04f43991e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:25.937564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323b6f5-c1bd-46ac-bcaf-0f04f43991e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:25.941373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323b6f5-c1bd-46ac-bcaf-0f04f43991e7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:25.970295 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1359/2683] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:27:25.971124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93caaa3-a9fe-473b-971f-07976311e473 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:25.990612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93caaa3-a9fe-473b-971f-07976311e473 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:26.011654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44b9d9-69b3-4f6b-a12b-6857758ce31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:26.014373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44b9d9-69b3-4f6b-a12b-6857758ce31e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:26.015255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44b9d9-69b3-4f6b-a12b-6857758ce31e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:26.015537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44b9d9-69b3-4f6b-a12b-6857758ce31e admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:26.020033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44b9d9-69b3-4f6b-a12b-6857758ce31e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:26.022992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44b9d9-69b3-4f6b-a12b-6857758ce31e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:26.027308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:26.044241 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1325/2684] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:27:26.044483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323b6f5-c1bd-46ac-bcaf-0f04f43991e7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:26.057770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323b6f5-c1bd-46ac-bcaf-0f04f43991e7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:26.064166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f0688-ca1f-4e11-8c98-719f61295d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:26.065040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f0688-ca1f-4e11-8c98-719f61295d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:26.065488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f0688-ca1f-4e11-8c98-719f61295d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:26.065952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f0688-ca1f-4e11-8c98-719f61295d06 admin admin] PATH_INFO: `/v3/projects/2c8510a519f14deea6f35a437419e161/users/c13e05e253c94aadb1c089128ff35be5/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:26.086159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f0688-ca1f-4e11-8c98-719f61295d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8510a519f14deea6f35a437419e161, user_id=c13e05e253c94aadb1c089128ff35be5, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:26.089407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f0688-ca1f-4e11-8c98-719f61295d06 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:26.203410 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1360/2685] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:27:26 2022] PUT /identity/v3/projects/2c8510a519f14deea6f35a437419e161/users/c13e05e253c94aadb1c089128ff35be5/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:27:26.215158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec299c-f368-452d-8c17-932059a3fdd9 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:26.215881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec299c-f368-452d-8c17-932059a3fdd9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:26.216238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec299c-f368-452d-8c17-932059a3fdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:26.323361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-88ec299c-f368-452d-8c17-932059a3fdd9 None None] MFA Rules not processed for user `c13e05e253c94aadb1c089128ff35be5`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:27:26.324664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-88ec299c-f368-452d-8c17-932059a3fdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:26.476737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de8f78-2bc9-4ebc-9ac4-5e91c014d45f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:26.477233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de8f78-2bc9-4ebc-9ac4-5e91c014d45f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:26.479601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de8f78-2bc9-4ebc-9ac4-5e91c014d45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:26.491715 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1326/2686] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:27:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:27:26.498092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec299c-f368-452d-8c17-932059a3fdd9 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:26.509560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-72de8f78-2bc9-4ebc-9ac4-5e91c014d45f None None] MFA Rules not processed for user `8c93886c5818439690564c2299a4f3ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:27:26.510870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-72de8f78-2bc9-4ebc-9ac4-5e91c014d45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:26.641345 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1361/2687] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:27:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:27:26.665388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec299c-f368-452d-8c17-932059a3fdd9 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:26.671626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d859693-7cb0-4162-a3a7-4e2c390cfac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:26.672254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d859693-7cb0-4162-a3a7-4e2c390cfac1 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:26.672538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d859693-7cb0-4162-a3a7-4e2c390cfac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:26.672819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d859693-7cb0-4162-a3a7-4e2c390cfac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:26.673536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d859693-7cb0-4162-a3a7-4e2c390cfac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:26.678603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d859693-7cb0-4162-a3a7-4e2c390cfac1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:26.808015 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1327/2688] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:27:26 2022] POST /identity/v3/projects => generated 377 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:27:26.808179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de8f78-2bc9-4ebc-9ac4-5e91c014d45f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:26.828341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de8f78-2bc9-4ebc-9ac4-5e91c014d45f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:26.938106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2a387-f788-4dc7-945e-c2411212dcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:26.938961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2a387-f788-4dc7-945e-c2411212dcc7 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:26.939402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2a387-f788-4dc7-945e-c2411212dcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:26.939780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2a387-f788-4dc7-945e-c2411212dcc7 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:26.941241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2a387-f788-4dc7-945e-c2411212dcc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:26.947007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2a387-f788-4dc7-945e-c2411212dcc7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:27.060630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:27.068142 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1362/2689] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:27:26 2022] POST /identity/v3/users => generated 295 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:27:27.072323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d859693-7cb0-4162-a3a7-4e2c390cfac1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:27.087383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d859693-7cb0-4162-a3a7-4e2c390cfac1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:27.107020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9eb76-501d-4a89-a0a5-b3daf9070e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:27.109540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9eb76-501d-4a89-a0a5-b3daf9070e93 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:27.109911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9eb76-501d-4a89-a0a5-b3daf9070e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:27.110505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9eb76-501d-4a89-a0a5-b3daf9070e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:27.112500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9eb76-501d-4a89-a0a5-b3daf9070e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:27.118866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9eb76-501d-4a89-a0a5-b3daf9070e93 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:27.146900 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1328/2690] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:27:27.149234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2a387-f788-4dc7-945e-c2411212dcc7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:27.165250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2a387-f788-4dc7-945e-c2411212dcc7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:27.177520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea403b12-4001-4b76-8fab-601b759067a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:27.197286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea403b12-4001-4b76-8fab-601b759067a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:27.202879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea403b12-4001-4b76-8fab-601b759067a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:27.202879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea403b12-4001-4b76-8fab-601b759067a0 admin admin] PATH_INFO: `/v3/projects/cec0773722a6496381499feb8801a027/users/438be975095541f5860849f8ed01af51/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:27.251599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea403b12-4001-4b76-8fab-601b759067a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec0773722a6496381499feb8801a027, user_id=438be975095541f5860849f8ed01af51, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:27.259277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea403b12-4001-4b76-8fab-601b759067a0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:27.353798 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1363/2691] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:27:27 2022] PUT /identity/v3/projects/cec0773722a6496381499feb8801a027/users/438be975095541f5860849f8ed01af51/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:27:27.361722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9eb76-501d-4a89-a0a5-b3daf9070e93 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:27.375228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9eb76-501d-4a89-a0a5-b3daf9070e93 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:27.530061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b7a97-dec9-438f-a24b-9140797ded24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:27.530061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b7a97-dec9-438f-a24b-9140797ded24 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:27.530061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b7a97-dec9-438f-a24b-9140797ded24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:27.530061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b7a97-dec9-438f-a24b-9140797ded24 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:27.530716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b7a97-dec9-438f-a24b-9140797ded24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:27.530716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b7a97-dec9-438f-a24b-9140797ded24 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:27.533098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:27.580873 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1329/2692] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:27:27.582795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea403b12-4001-4b76-8fab-601b759067a0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:27.598693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea403b12-4001-4b76-8fab-601b759067a0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:27.619317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f3231-e3e1-4c8e-9be1-f951c657f617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:27.620021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f3231-e3e1-4c8e-9be1-f951c657f617 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:27.620451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f3231-e3e1-4c8e-9be1-f951c657f617 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:27.620734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f3231-e3e1-4c8e-9be1-f951c657f617 admin admin] PATH_INFO: `/v3/projects/cec0773722a6496381499feb8801a027/users/438be975095541f5860849f8ed01af51/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:27.624243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f3231-e3e1-4c8e-9be1-f951c657f617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec0773722a6496381499feb8801a027, user_id=438be975095541f5860849f8ed01af51, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:27.627606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f3231-e3e1-4c8e-9be1-f951c657f617 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:27.657550 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1364/2693] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:27:27 2022] PUT /identity/v3/projects/cec0773722a6496381499feb8801a027/users/438be975095541f5860849f8ed01af51/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:27:27.660280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ba886-d078-45a2-bc17-102e675835cd None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:27.660600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ba886-d078-45a2-bc17-102e675835cd None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:27.661783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ba886-d078-45a2-bc17-102e675835cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:27.754273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-327ba886-d078-45a2-bc17-102e675835cd None None] MFA Rules not processed for user `438be975095541f5860849f8ed01af51`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:27:27.760235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-327ba886-d078-45a2-bc17-102e675835cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:27.890137 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1330/2694] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:27:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:27:27.900752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fc94a-4b39-4a0e-94bb-b69fafb7583c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:27.901369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fc94a-4b39-4a0e-94bb-b69fafb7583c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:27.901948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fc94a-4b39-4a0e-94bb-b69fafb7583c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:27.934900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9a3fc94a-4b39-4a0e-94bb-b69fafb7583c None None] MFA Rules not processed for user `c13e05e253c94aadb1c089128ff35be5`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:27:27.950571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9a3fc94a-4b39-4a0e-94bb-b69fafb7583c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:28.093821 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1365/2695] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:27:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:27:28.939807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfc893-6a97-4aec-b844-a58cb3918591 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:28.940767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfc893-6a97-4aec-b844-a58cb3918591 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:28.941443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfc893-6a97-4aec-b844-a58cb3918591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:28.996293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1acfc893-6a97-4aec-b844-a58cb3918591 None None] MFA Rules not processed for user `17b2717ace074a579d33c60964e6668a`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:27:29.001746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1acfc893-6a97-4aec-b844-a58cb3918591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:29.142920 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1331/2696] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:27:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:27:29.340845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fc94a-4b39-4a0e-94bb-b69fafb7583c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:29.345085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9a3fc94a-4b39-4a0e-94bb-b69fafb7583c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:29.495357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fc94a-4b39-4a0e-94bb-b69fafb7583c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:29.501840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f124cf3-faf0-44e3-9d9e-ad80fcb182aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:29.502516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f124cf3-faf0-44e3-9d9e-ad80fcb182aa service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:29.502802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f124cf3-faf0-44e3-9d9e-ad80fcb182aa service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:29.503083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f124cf3-faf0-44e3-9d9e-ad80fcb182aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:29.533386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f124cf3-faf0-44e3-9d9e-ad80fcb182aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:29.536213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f124cf3-faf0-44e3-9d9e-ad80fcb182aa service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:29.547297 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1366/2697] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:27:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:27:30.531009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edac045-9635-4a9d-9469-20c07eb863ff None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:30.531826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edac045-9635-4a9d-9469-20c07eb863ff None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:30.531826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edac045-9635-4a9d-9469-20c07eb863ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:30.690311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-2edac045-9635-4a9d-9469-20c07eb863ff None None] MFA Rules not processed for user `c13e05e253c94aadb1c089128ff35be5`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:27:30.690311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2edac045-9635-4a9d-9469-20c07eb863ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:30.690311 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1332/2698] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:27:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:27:34.611782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a9508-4f7d-49bc-916c-4c1224213631 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:34.612912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a9508-4f7d-49bc-916c-4c1224213631 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:34.613357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a9508-4f7d-49bc-916c-4c1224213631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:34.640682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d16a9508-4f7d-49bc-916c-4c1224213631 None None] MFA Rules not processed for user `ba3ce7f040d24c33bcf9b97d1ef25268`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:27:34.642489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d16a9508-4f7d-49bc-916c-4c1224213631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:34.762674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:34.791677 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1367/2699] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:27:34 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:27:38.218774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edac045-9635-4a9d-9469-20c07eb863ff None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:38.220476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2edac045-9635-4a9d-9469-20c07eb863ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:38.397542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edac045-9635-4a9d-9469-20c07eb863ff None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:38.405472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bef18-725f-4cf0-b2fc-ed1a8f3ec1d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:38.413557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bef18-725f-4cf0-b2fc-ed1a8f3ec1d4 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:38.413557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bef18-725f-4cf0-b2fc-ed1a8f3ec1d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:38.413557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bef18-725f-4cf0-b2fc-ed1a8f3ec1d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:38.413557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-be3bef18-725f-4cf0-b2fc-ed1a8f3ec1d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:38.444455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:38.515177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bef18-725f-4cf0-b2fc-ed1a8f3ec1d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:38.517141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bef18-725f-4cf0-b2fc-ed1a8f3ec1d4 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:38.529743 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1333/2700] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:27:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:27:45.132397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:47.457245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a9508-4f7d-49bc-916c-4c1224213631 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:47.459640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d16a9508-4f7d-49bc-916c-4c1224213631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:47.557779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a9508-4f7d-49bc-916c-4c1224213631 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:47.563201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5504bf-b5bc-4699-b806-6c6c52f8de46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:47.564071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5504bf-b5bc-4699-b806-6c6c52f8de46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:47.564455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5504bf-b5bc-4699-b806-6c6c52f8de46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:47.564980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5504bf-b5bc-4699-b806-6c6c52f8de46 admin admin] PATH_INFO: `/v3/users/fa3d85835ef3482cac69763d3d957181` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:47.567248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5504bf-b5bc-4699-b806-6c6c52f8de46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3d85835ef3482cac69763d3d957181)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:47.570634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5504bf-b5bc-4699-b806-6c6c52f8de46 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:47.773369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8a5504bf-b5bc-4699-b806-6c6c52f8de46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3d85835ef3482cac69763d3d957181'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:47.774068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8a5504bf-b5bc-4699-b806-6c6c52f8de46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3d85835ef3482cac69763d3d957181'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:47.782675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8a5504bf-b5bc-4699-b806-6c6c52f8de46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3d85835ef3482cac69763d3d957181'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:47.807137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8a5504bf-b5bc-4699-b806-6c6c52f8de46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3d85835ef3482cac69763d3d957181'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:47.807879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8a5504bf-b5bc-4699-b806-6c6c52f8de46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3d85835ef3482cac69763d3d957181'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:47.888212 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1368/2701] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:27:47 2022] DELETE /identity/v3/users/fa3d85835ef3482cac69763d3d957181 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:27:48.266973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bef18-725f-4cf0-b2fc-ed1a8f3ec1d4 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:48.283886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bef18-725f-4cf0-b2fc-ed1a8f3ec1d4 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:48.418656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681d720-c4d5-4a34-9abe-c8c9e9557408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:48.419294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681d720-c4d5-4a34-9abe-c8c9e9557408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:48.419914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681d720-c4d5-4a34-9abe-c8c9e9557408 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:48.420450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681d720-c4d5-4a34-9abe-c8c9e9557408 admin admin] PATH_INFO: `/v3/projects/d91a511e7db64d808db2e7616f31a9bb` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:48.421814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681d720-c4d5-4a34-9abe-c8c9e9557408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d91a511e7db64d808db2e7616f31a9bb)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:48.424280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681d720-c4d5-4a34-9abe-c8c9e9557408 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:48.609850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c681d720-c4d5-4a34-9abe-c8c9e9557408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd91a511e7db64d808db2e7616f31a9bb', 'request_id': 'req-c681d720-c4d5-4a34-9abe-c8c9e9557408'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:48.693021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c681d720-c4d5-4a34-9abe-c8c9e9557408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd91a511e7db64d808db2e7616f31a9bb', 'request_id': 'req-c681d720-c4d5-4a34-9abe-c8c9e9557408'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:48.702347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c681d720-c4d5-4a34-9abe-c8c9e9557408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd91a511e7db64d808db2e7616f31a9bb', 'request_id': 'req-c681d720-c4d5-4a34-9abe-c8c9e9557408'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:48.728878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c681d720-c4d5-4a34-9abe-c8c9e9557408 admin admin] The token cache is being invalidate because project d91a511e7db64d808db2e7616f31a9bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:27:48.729739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c681d720-c4d5-4a34-9abe-c8c9e9557408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:48.730182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c681d720-c4d5-4a34-9abe-c8c9e9557408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:48.732711 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1334/2702] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:27:48 2022] DELETE /identity/v3/projects/d91a511e7db64d808db2e7616f31a9bb => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:27:48.738100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112907c-f23c-411c-928e-e244b8aecd5e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:48.738647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112907c-f23c-411c-928e-e244b8aecd5e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:48.742126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112907c-f23c-411c-928e-e244b8aecd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:48.766344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8112907c-f23c-411c-928e-e244b8aecd5e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:27:48.771907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8112907c-f23c-411c-928e-e244b8aecd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:48.846085 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1369/2703] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:27:48.853002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331a2d9-a28d-436a-92b2-a6ca5cd5b316 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:48.853860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331a2d9-a28d-436a-92b2-a6ca5cd5b316 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:48.854181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331a2d9-a28d-436a-92b2-a6ca5cd5b316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:48.879275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f331a2d9-a28d-436a-92b2-a6ca5cd5b316 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:27:48.880643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f331a2d9-a28d-436a-92b2-a6ca5cd5b316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:48.890069 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1335/2704] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:27:48.893629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112907c-f23c-411c-928e-e244b8aecd5e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:48.917378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112907c-f23c-411c-928e-e244b8aecd5e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:48.928518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19fc053-f33a-4952-a68a-d761b27aa27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:48.929279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fc053-f33a-4952-a68a-d761b27aa27e admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:48.929574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fc053-f33a-4952-a68a-d761b27aa27e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:48.929854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fc053-f33a-4952-a68a-d761b27aa27e admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:48.930577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19fc053-f33a-4952-a68a-d761b27aa27e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:27:48.930895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19fc053-f33a-4952-a68a-d761b27aa27e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:48.932856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19fc053-f33a-4952-a68a-d761b27aa27e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:48.951356 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1370/2705] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:27:48.952456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331a2d9-a28d-436a-92b2-a6ca5cd5b316 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:48.963752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331a2d9-a28d-436a-92b2-a6ca5cd5b316 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:48.969278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307397b7-3b89-4f94-9605-6b610c0a4a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:48.969904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307397b7-3b89-4f94-9605-6b610c0a4a4b admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:48.970227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307397b7-3b89-4f94-9605-6b610c0a4a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:48.970500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307397b7-3b89-4f94-9605-6b610c0a4a4b admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:48.971146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307397b7-3b89-4f94-9605-6b610c0a4a4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:48.973189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307397b7-3b89-4f94-9605-6b610c0a4a4b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:49.082074 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1336/2706] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:27:48 2022] POST /identity/v3/projects => generated 399 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:27:49.084887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19fc053-f33a-4952-a68a-d761b27aa27e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:49.110903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19fc053-f33a-4952-a68a-d761b27aa27e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:49.120964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:49.218093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ffe4d-4462-4083-9981-9346d61a3122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:49.219263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ffe4d-4462-4083-9981-9346d61a3122 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:49.219743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ffe4d-4462-4083-9981-9346d61a3122 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:49.220170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ffe4d-4462-4083-9981-9346d61a3122 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:49.220829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ffe4d-4462-4083-9981-9346d61a3122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:49.223946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ffe4d-4462-4083-9981-9346d61a3122 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:49.321946 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1371/2707] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:27:49 2022] POST /identity/v3/users => generated 300 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:27:49.326373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307397b7-3b89-4f94-9605-6b610c0a4a4b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:49.344145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307397b7-3b89-4f94-9605-6b610c0a4a4b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:49.350113 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cf416-2beb-4537-831b-85f14f969912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:49.350738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cf416-2beb-4537-831b-85f14f969912 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:49.351026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cf416-2beb-4537-831b-85f14f969912 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:49.351305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cf416-2beb-4537-831b-85f14f969912 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:49.351968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3cf416-2beb-4537-831b-85f14f969912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:49.355154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3cf416-2beb-4537-831b-85f14f969912 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:49.372936 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1337/2708] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:27:49.375140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ffe4d-4462-4083-9981-9346d61a3122 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:49.385526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ffe4d-4462-4083-9981-9346d61a3122 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:49.397044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab20cf5-cfec-4a48-a3e0-f97bc395fab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:49.397687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab20cf5-cfec-4a48-a3e0-f97bc395fab8 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:49.397978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab20cf5-cfec-4a48-a3e0-f97bc395fab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:49.398294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab20cf5-cfec-4a48-a3e0-f97bc395fab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:49.399093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab20cf5-cfec-4a48-a3e0-f97bc395fab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:49.400766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab20cf5-cfec-4a48-a3e0-f97bc395fab8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:49.414092 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1372/2709] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:27:49.417914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cf416-2beb-4537-831b-85f14f969912 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:49.424868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:49.430359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cf416-2beb-4537-831b-85f14f969912 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:49.435681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bec71-652c-49c1-92ca-403f3a8b4045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:49.437091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bec71-652c-49c1-92ca-403f3a8b4045 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:49.437330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bec71-652c-49c1-92ca-403f3a8b4045 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:49.437611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bec71-652c-49c1-92ca-403f3a8b4045 admin admin] PATH_INFO: `/v3/projects/1f7dfa065e7b4497a76e6b7bb02f5e2f/users/98252f131a4e4d8ba7e1e340dafbeea3/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:49.462927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bec71-652c-49c1-92ca-403f3a8b4045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f7dfa065e7b4497a76e6b7bb02f5e2f, user_id=98252f131a4e4d8ba7e1e340dafbeea3, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:49.465752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bec71-652c-49c1-92ca-403f3a8b4045 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:49.569245 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1338/2710] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:27:49 2022] PUT /identity/v3/projects/1f7dfa065e7b4497a76e6b7bb02f5e2f/users/98252f131a4e4d8ba7e1e340dafbeea3/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:27:49.580868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7199879-fd3c-4e45-8aa9-19db85ef4790 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:49.581156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7199879-fd3c-4e45-8aa9-19db85ef4790 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:49.581990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7199879-fd3c-4e45-8aa9-19db85ef4790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:49.615953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e7199879-fd3c-4e45-8aa9-19db85ef4790 None None] MFA Rules not processed for user `98252f131a4e4d8ba7e1e340dafbeea3`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:27:49.617207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e7199879-fd3c-4e45-8aa9-19db85ef4790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:49.735029 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1373/2711] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:27:49 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:27:52.412813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bec71-652c-49c1-92ca-403f3a8b4045 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:52.415263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6a0bec71-652c-49c1-92ca-403f3a8b4045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:52.515497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bec71-652c-49c1-92ca-403f3a8b4045 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:52.523750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a991b9-4dae-4f4a-9645-21b5717a0ad8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:52.523750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a991b9-4dae-4f4a-9645-21b5717a0ad8 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:52.523750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a991b9-4dae-4f4a-9645-21b5717a0ad8 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:52.524149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a991b9-4dae-4f4a-9645-21b5717a0ad8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:52.532872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a991b9-4dae-4f4a-9645-21b5717a0ad8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:52.535073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a991b9-4dae-4f4a-9645-21b5717a0ad8 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:52.545681 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1339/2712] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:27:52 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:27:54.401999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7199879-fd3c-4e45-8aa9-19db85ef4790 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:54.502153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7199879-fd3c-4e45-8aa9-19db85ef4790 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:54.510314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dddc66-fd03-4bff-bc3e-3632f8d7d3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:54.511061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dddc66-fd03-4bff-bc3e-3632f8d7d3fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:54.511619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dddc66-fd03-4bff-bc3e-3632f8d7d3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:54.512244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dddc66-fd03-4bff-bc3e-3632f8d7d3fb admin admin] PATH_INFO: `/v3/users/98252f131a4e4d8ba7e1e340dafbeea3` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:54.517778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dddc66-fd03-4bff-bc3e-3632f8d7d3fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=98252f131a4e4d8ba7e1e340dafbeea3)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:54.520971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dddc66-fd03-4bff-bc3e-3632f8d7d3fb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:54.541347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:54.761852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-89dddc66-fd03-4bff-bc3e-3632f8d7d3fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98252f131a4e4d8ba7e1e340dafbeea3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:54.762763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-89dddc66-fd03-4bff-bc3e-3632f8d7d3fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98252f131a4e4d8ba7e1e340dafbeea3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:54.786483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-89dddc66-fd03-4bff-bc3e-3632f8d7d3fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98252f131a4e4d8ba7e1e340dafbeea3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:54.800042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-89dddc66-fd03-4bff-bc3e-3632f8d7d3fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98252f131a4e4d8ba7e1e340dafbeea3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:54.801387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-89dddc66-fd03-4bff-bc3e-3632f8d7d3fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98252f131a4e4d8ba7e1e340dafbeea3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:54.894569 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1374/2713] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:27:54 2022] DELETE /identity/v3/users/98252f131a4e4d8ba7e1e340dafbeea3 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:27:54.901160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bfd72-3ea9-4734-bb53-2d4e15a7fd17 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:54.901160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bfd72-3ea9-4734-bb53-2d4e15a7fd17 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:54.901160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bfd72-3ea9-4734-bb53-2d4e15a7fd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:54.966979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-fd7bfd72-3ea9-4734-bb53-2d4e15a7fd17 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:27:54.974679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fd7bfd72-3ea9-4734-bb53-2d4e15a7fd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:55.126077 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1340/2714] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:27:55.135350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dddc66-fd03-4bff-bc3e-3632f8d7d3fb admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:55.136985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-89dddc66-fd03-4bff-bc3e-3632f8d7d3fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:55.272450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dddc66-fd03-4bff-bc3e-3632f8d7d3fb admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:55.277630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a3243-1d69-4ca7-8c6c-f895e416c923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:55.278351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a3243-1d69-4ca7-8c6c-f895e416c923 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:55.279044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a3243-1d69-4ca7-8c6c-f895e416c923 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:55.279907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a3243-1d69-4ca7-8c6c-f895e416c923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:55.292637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a3243-1d69-4ca7-8c6c-f895e416c923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:55.294588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a3243-1d69-4ca7-8c6c-f895e416c923 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:55.313163 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1375/2715] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:27:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:27:56.477096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bfd72-3ea9-4734-bb53-2d4e15a7fd17 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:56.478829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fd7bfd72-3ea9-4734-bb53-2d4e15a7fd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:56.518388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bfd72-3ea9-4734-bb53-2d4e15a7fd17 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:56.533403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372dee7-57d2-4dc5-8e2c-1d30d5c773ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:56.534388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372dee7-57d2-4dc5-8e2c-1d30d5c773ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:56.534893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372dee7-57d2-4dc5-8e2c-1d30d5c773ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:56.535349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372dee7-57d2-4dc5-8e2c-1d30d5c773ad admin admin] PATH_INFO: `/v3/projects/1f7dfa065e7b4497a76e6b7bb02f5e2f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:56.538344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372dee7-57d2-4dc5-8e2c-1d30d5c773ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f7dfa065e7b4497a76e6b7bb02f5e2f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:56.542710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372dee7-57d2-4dc5-8e2c-1d30d5c773ad admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:56.776201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8372dee7-57d2-4dc5-8e2c-1d30d5c773ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f7dfa065e7b4497a76e6b7bb02f5e2f', 'request_id': 'req-8372dee7-57d2-4dc5-8e2c-1d30d5c773ad'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:56.870423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8372dee7-57d2-4dc5-8e2c-1d30d5c773ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f7dfa065e7b4497a76e6b7bb02f5e2f', 'request_id': 'req-8372dee7-57d2-4dc5-8e2c-1d30d5c773ad'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:56.882932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8372dee7-57d2-4dc5-8e2c-1d30d5c773ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f7dfa065e7b4497a76e6b7bb02f5e2f', 'request_id': 'req-8372dee7-57d2-4dc5-8e2c-1d30d5c773ad'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:56.892778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:56.910606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8372dee7-57d2-4dc5-8e2c-1d30d5c773ad admin admin] The token cache is being invalidate because project 1f7dfa065e7b4497a76e6b7bb02f5e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:27:56.911555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8372dee7-57d2-4dc5-8e2c-1d30d5c773ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:56.912628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8372dee7-57d2-4dc5-8e2c-1d30d5c773ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:27:56.915288 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1341/2716] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:27:56 2022] DELETE /identity/v3/projects/1f7dfa065e7b4497a76e6b7bb02f5e2f => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:27:56.919990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7eafc7-8ffb-4a33-8cb6-e06a47db0c57 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:56.924376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7eafc7-8ffb-4a33-8cb6-e06a47db0c57 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:56.924738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7eafc7-8ffb-4a33-8cb6-e06a47db0c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:56.998762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-bb7eafc7-8ffb-4a33-8cb6-e06a47db0c57 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:27:57.002920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bb7eafc7-8ffb-4a33-8cb6-e06a47db0c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:57.092408 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1376/2717] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:27:57.101780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39c4d2-4be5-422c-a0dd-2e53cbccbc58 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:57.103231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39c4d2-4be5-422c-a0dd-2e53cbccbc58 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:57.103766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39c4d2-4be5-422c-a0dd-2e53cbccbc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:57.158121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-dc39c4d2-4be5-422c-a0dd-2e53cbccbc58 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:27:57.166601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dc39c4d2-4be5-422c-a0dd-2e53cbccbc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:57.178930 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1342/2718] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:27:57.183048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7eafc7-8ffb-4a33-8cb6-e06a47db0c57 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:57.196202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7eafc7-8ffb-4a33-8cb6-e06a47db0c57 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:57.211565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf31ab-7731-4c26-a284-462e2e593ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:57.212274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf31ab-7731-4c26-a284-462e2e593ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:57.213192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf31ab-7731-4c26-a284-462e2e593ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:57.214172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf31ab-7731-4c26-a284-462e2e593ae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:57.217690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf31ab-7731-4c26-a284-462e2e593ae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:27:57.218258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf31ab-7731-4c26-a284-462e2e593ae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:57.221171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf31ab-7731-4c26-a284-462e2e593ae7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:57.252850 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1377/2719] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:27:57.254445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39c4d2-4be5-422c-a0dd-2e53cbccbc58 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:57.265688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39c4d2-4be5-422c-a0dd-2e53cbccbc58 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:57.287636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccea83-1391-4a64-adb4-0c9fc1300340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:57.288648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccea83-1391-4a64-adb4-0c9fc1300340 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:57.289774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccea83-1391-4a64-adb4-0c9fc1300340 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:57.290315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccea83-1391-4a64-adb4-0c9fc1300340 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:57.291191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccea83-1391-4a64-adb4-0c9fc1300340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:57.293732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccea83-1391-4a64-adb4-0c9fc1300340 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:57.461121 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1343/2720] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:27:57 2022] POST /identity/v3/projects => generated 373 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:27:57.461909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf31ab-7731-4c26-a284-462e2e593ae7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:57.482392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf31ab-7731-4c26-a284-462e2e593ae7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:57.585727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:57.723115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265e9d1-47ec-4f05-83a5-1899a5a39a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:57.727045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265e9d1-47ec-4f05-83a5-1899a5a39a94 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:57.729694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265e9d1-47ec-4f05-83a5-1899a5a39a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:57.729985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265e9d1-47ec-4f05-83a5-1899a5a39a94 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:57.730718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265e9d1-47ec-4f05-83a5-1899a5a39a94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:57.750657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265e9d1-47ec-4f05-83a5-1899a5a39a94 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:57.878752 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1378/2721] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:27:57 2022] POST /identity/v3/users => generated 287 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:27:57.882630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccea83-1391-4a64-adb4-0c9fc1300340 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:57.903376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccea83-1391-4a64-adb4-0c9fc1300340 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:57.919571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e5647-8027-4660-ac31-60abf6483fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:57.920240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e5647-8027-4660-ac31-60abf6483fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:57.920528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e5647-8027-4660-ac31-60abf6483fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:57.920803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e5647-8027-4660-ac31-60abf6483fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:57.921463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e5647-8027-4660-ac31-60abf6483fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:57.924301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e5647-8027-4660-ac31-60abf6483fc4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:57.952534 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1344/2722] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:27:57.957003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265e9d1-47ec-4f05-83a5-1899a5a39a94 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:57.980395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265e9d1-47ec-4f05-83a5-1899a5a39a94 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:57.991458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11caecee-613e-44d8-b6f8-90e4fb21d739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:57.994986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caecee-613e-44d8-b6f8-90e4fb21d739 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:57.995287 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caecee-613e-44d8-b6f8-90e4fb21d739 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:57.995566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caecee-613e-44d8-b6f8-90e4fb21d739 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:58.011860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11caecee-613e-44d8-b6f8-90e4fb21d739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:58.017905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11caecee-613e-44d8-b6f8-90e4fb21d739 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:58.055164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e5647-8027-4660-ac31-60abf6483fc4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:58.060591 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1379/2723] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:27:58.076593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e5647-8027-4660-ac31-60abf6483fc4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:58.089370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0f325-9aba-4606-905c-557984442699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:58.092808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0f325-9aba-4606-905c-557984442699 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:58.096788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0f325-9aba-4606-905c-557984442699 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:58.096788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0f325-9aba-4606-905c-557984442699 admin admin] PATH_INFO: `/v3/projects/9552b0b0c0754795aa7b6708e3690cbe/users/1626c3182d854631aef482ab2c7f06d1/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:58.127825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0f325-9aba-4606-905c-557984442699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9552b0b0c0754795aa7b6708e3690cbe, user_id=1626c3182d854631aef482ab2c7f06d1, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:58.131169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0f325-9aba-4606-905c-557984442699 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:58.266510 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1345/2724] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:27:58 2022] PUT /identity/v3/projects/9552b0b0c0754795aa7b6708e3690cbe/users/1626c3182d854631aef482ab2c7f06d1/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:27:58.277504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37604a24-7ac1-4cd2-a388-94a15d47642a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:58.282005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37604a24-7ac1-4cd2-a388-94a15d47642a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:58.282005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37604a24-7ac1-4cd2-a388-94a15d47642a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:58.386859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-37604a24-7ac1-4cd2-a388-94a15d47642a None None] MFA Rules not processed for user `1626c3182d854631aef482ab2c7f06d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:27:58.388358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-37604a24-7ac1-4cd2-a388-94a15d47642a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:58.485608 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1380/2725] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:27:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:27:58.809522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0f325-9aba-4606-905c-557984442699 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:27:58.830821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-22a0f325-9aba-4606-905c-557984442699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:59.056959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0f325-9aba-4606-905c-557984442699 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:27:59.071340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b89be1-6120-4527-965a-1ad47109ef50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:27:59.072083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b89be1-6120-4527-965a-1ad47109ef50 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:59.072442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b89be1-6120-4527-965a-1ad47109ef50 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:59.073138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b89be1-6120-4527-965a-1ad47109ef50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:59.088328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b89be1-6120-4527-965a-1ad47109ef50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:27:59.090074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b89be1-6120-4527-965a-1ad47109ef50 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:27:59.125789 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1346/2726] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:27:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:27:59.544299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5ed02-5004-4b53-9460-93617d8bb705 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:27:59.544914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5ed02-5004-4b53-9460-93617d8bb705 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:27:59.544914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5ed02-5004-4b53-9460-93617d8bb705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:27:59.581995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-67e5ed02-5004-4b53-9460-93617d8bb705 None None] MFA Rules not processed for user `c13e05e253c94aadb1c089128ff35be5`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:27:59.582947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-67e5ed02-5004-4b53-9460-93617d8bb705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:27:59.732352 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1381/2727] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:27:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:28:00.815332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97a045-72b7-494f-bf0b-05a97f66d98f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:00.816342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97a045-72b7-494f-bf0b-05a97f66d98f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:00.816904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97a045-72b7-494f-bf0b-05a97f66d98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:00.854523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6f97a045-72b7-494f-bf0b-05a97f66d98f None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:00.856031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6f97a045-72b7-494f-bf0b-05a97f66d98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:01.009049 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1347/2728] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:28:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:28:01.036706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5ed02-5004-4b53-9460-93617d8bb705 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:01.038402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-67e5ed02-5004-4b53-9460-93617d8bb705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:01.141842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:01.262853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5ed02-5004-4b53-9460-93617d8bb705 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:01.298066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221d2fc-3b17-4579-acbf-351feb1095aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:01.298066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221d2fc-3b17-4579-acbf-351feb1095aa service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:01.298066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221d2fc-3b17-4579-acbf-351feb1095aa service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:01.298066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221d2fc-3b17-4579-acbf-351feb1095aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:01.311744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221d2fc-3b17-4579-acbf-351feb1095aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:01.314067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221d2fc-3b17-4579-acbf-351feb1095aa service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:01.335500 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1382/2729] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:28:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 03:28:02.518382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97a045-72b7-494f-bf0b-05a97f66d98f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:02.600789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:02.832032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97a045-72b7-494f-bf0b-05a97f66d98f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:02.832032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e93dc-0714-40a1-a5e1-f48adc70f37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:02.832032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e93dc-0714-40a1-a5e1-f48adc70f37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:02.832032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e93dc-0714-40a1-a5e1-f48adc70f37a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:02.832434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e93dc-0714-40a1-a5e1-f48adc70f37a admin admin] PATH_INFO: `/v3/users/1626c3182d854631aef482ab2c7f06d1` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:02.835367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e93dc-0714-40a1-a5e1-f48adc70f37a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1626c3182d854631aef482ab2c7f06d1)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:02.861615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e93dc-0714-40a1-a5e1-f48adc70f37a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:03.478741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-af1e93dc-0714-40a1-a5e1-f48adc70f37a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1626c3182d854631aef482ab2c7f06d1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:03.480960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-af1e93dc-0714-40a1-a5e1-f48adc70f37a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1626c3182d854631aef482ab2c7f06d1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:03.535433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-af1e93dc-0714-40a1-a5e1-f48adc70f37a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1626c3182d854631aef482ab2c7f06d1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:03.603259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-af1e93dc-0714-40a1-a5e1-f48adc70f37a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1626c3182d854631aef482ab2c7f06d1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:03.739346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-af1e93dc-0714-40a1-a5e1-f48adc70f37a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1626c3182d854631aef482ab2c7f06d1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:03.750541 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1348/2730] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:28:02 2022] DELETE /identity/v3/users/1626c3182d854631aef482ab2c7f06d1 => generated 0 bytes in 1230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:28:03.752554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64542c90-0b22-47cd-b5eb-e38a088d929a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:03.752953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64542c90-0b22-47cd-b5eb-e38a088d929a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:03.753083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64542c90-0b22-47cd-b5eb-e38a088d929a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:03.782724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-64542c90-0b22-47cd-b5eb-e38a088d929a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:03.787433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-64542c90-0b22-47cd-b5eb-e38a088d929a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:04.111382 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1383/2731] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:28:04.122097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e93dc-0714-40a1-a5e1-f48adc70f37a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:04.124046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-af1e93dc-0714-40a1-a5e1-f48adc70f37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:04.318208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e93dc-0714-40a1-a5e1-f48adc70f37a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:04.343542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b0071-443a-45df-a476-ec3086df04eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:04.344199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b0071-443a-45df-a476-ec3086df04eb service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:04.344487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b0071-443a-45df-a476-ec3086df04eb service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:04.344767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b0071-443a-45df-a476-ec3086df04eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:04.360972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b0071-443a-45df-a476-ec3086df04eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:04.362567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b0071-443a-45df-a476-ec3086df04eb service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:04.388429 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1349/2732] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:28:06.893127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64542c90-0b22-47cd-b5eb-e38a088d929a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:06.895260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-64542c90-0b22-47cd-b5eb-e38a088d929a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:06.916458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64542c90-0b22-47cd-b5eb-e38a088d929a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:06.928108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c58330-bc00-4e9c-9d38-11ac333d9e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:06.928800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c58330-bc00-4e9c-9d38-11ac333d9e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:06.930278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c58330-bc00-4e9c-9d38-11ac333d9e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:06.930585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c58330-bc00-4e9c-9d38-11ac333d9e61 admin admin] PATH_INFO: `/v3/projects/9552b0b0c0754795aa7b6708e3690cbe` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:06.934216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c58330-bc00-4e9c-9d38-11ac333d9e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9552b0b0c0754795aa7b6708e3690cbe)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:06.939841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c58330-bc00-4e9c-9d38-11ac333d9e61 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:07.199690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a4c58330-bc00-4e9c-9d38-11ac333d9e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9552b0b0c0754795aa7b6708e3690cbe', 'request_id': 'req-a4c58330-bc00-4e9c-9d38-11ac333d9e61'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:07.212230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a4c58330-bc00-4e9c-9d38-11ac333d9e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9552b0b0c0754795aa7b6708e3690cbe', 'request_id': 'req-a4c58330-bc00-4e9c-9d38-11ac333d9e61'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:07.224776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a4c58330-bc00-4e9c-9d38-11ac333d9e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9552b0b0c0754795aa7b6708e3690cbe', 'request_id': 'req-a4c58330-bc00-4e9c-9d38-11ac333d9e61'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:07.335346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a4c58330-bc00-4e9c-9d38-11ac333d9e61 admin admin] The token cache is being invalidate because project 9552b0b0c0754795aa7b6708e3690cbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:28:07.335666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a4c58330-bc00-4e9c-9d38-11ac333d9e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:07.337423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a4c58330-bc00-4e9c-9d38-11ac333d9e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:07.339797 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1384/2733] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:06 2022] DELETE /identity/v3/projects/9552b0b0c0754795aa7b6708e3690cbe => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:28:07.345894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b144ec4-bc51-4355-87a2-81a2fe92ed8f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:07.346570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b144ec4-bc51-4355-87a2-81a2fe92ed8f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:07.346570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b144ec4-bc51-4355-87a2-81a2fe92ed8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:07.399351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4b144ec4-bc51-4355-87a2-81a2fe92ed8f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:07.400662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4b144ec4-bc51-4355-87a2-81a2fe92ed8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:07.503864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:07.561680 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1350/2734] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:28:07.570757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bfd9a-c600-4572-8111-271401c036c9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:07.571369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bfd9a-c600-4572-8111-271401c036c9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:07.571815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bfd9a-c600-4572-8111-271401c036c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:07.613362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-152bfd9a-c600-4572-8111-271401c036c9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:07.616921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-152bfd9a-c600-4572-8111-271401c036c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:07.643360 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1385/2735] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:28:07.648610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b144ec4-bc51-4355-87a2-81a2fe92ed8f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:07.669716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b144ec4-bc51-4355-87a2-81a2fe92ed8f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:07.695442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dddd3-db93-428b-a44b-1132db650649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:07.697518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dddd3-db93-428b-a44b-1132db650649 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:07.698015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dddd3-db93-428b-a44b-1132db650649 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:07.700138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dddd3-db93-428b-a44b-1132db650649 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:07.701178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dddd3-db93-428b-a44b-1132db650649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:28:07.701705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dddd3-db93-428b-a44b-1132db650649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:07.706463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dddd3-db93-428b-a44b-1132db650649 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:07.747919 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1351/2736] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:28:07.752143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bfd9a-c600-4572-8111-271401c036c9 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:07.767006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bfd9a-c600-4572-8111-271401c036c9 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:07.783343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae9a0a-41e7-4ae9-84d6-0745a4fa9c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:07.786092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae9a0a-41e7-4ae9-84d6-0745a4fa9c23 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:07.786092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae9a0a-41e7-4ae9-84d6-0745a4fa9c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:07.786092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae9a0a-41e7-4ae9-84d6-0745a4fa9c23 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:07.786092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae9a0a-41e7-4ae9-84d6-0745a4fa9c23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:07.791618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae9a0a-41e7-4ae9-84d6-0745a4fa9c23 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:08.015794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dddd3-db93-428b-a44b-1132db650649 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:08.026644 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1386/2737] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:28:07 2022] POST /identity/v3/projects => generated 391 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:28:08.031008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dddd3-db93-428b-a44b-1132db650649 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:08.157872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742ec95-c0b1-40d1-b5fa-c3150c6b1c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:08.162610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742ec95-c0b1-40d1-b5fa-c3150c6b1c1d admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:08.167636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742ec95-c0b1-40d1-b5fa-c3150c6b1c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:08.167636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742ec95-c0b1-40d1-b5fa-c3150c6b1c1d admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:08.184303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742ec95-c0b1-40d1-b5fa-c3150c6b1c1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:08.194815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742ec95-c0b1-40d1-b5fa-c3150c6b1c1d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:08.370591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae9a0a-41e7-4ae9-84d6-0745a4fa9c23 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:08.370894 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1352/2738] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:28:08 2022] POST /identity/v3/users => generated 296 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:28:08.378626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae9a0a-41e7-4ae9-84d6-0745a4fa9c23 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:08.400699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf2fe5-f9ac-4fba-aba6-dd4b8838324a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:08.401352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf2fe5-f9ac-4fba-aba6-dd4b8838324a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:08.401635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf2fe5-f9ac-4fba-aba6-dd4b8838324a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:08.401908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf2fe5-f9ac-4fba-aba6-dd4b8838324a admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:08.402661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf2fe5-f9ac-4fba-aba6-dd4b8838324a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:08.407355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf2fe5-f9ac-4fba-aba6-dd4b8838324a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:08.439272 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1387/2739] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:28:08.449781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742ec95-c0b1-40d1-b5fa-c3150c6b1c1d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:08.513011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742ec95-c0b1-40d1-b5fa-c3150c6b1c1d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:08.543876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed03c5-1ce2-49c0-ba06-cb51b60fa491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:08.543876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed03c5-1ce2-49c0-ba06-cb51b60fa491 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:08.543876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed03c5-1ce2-49c0-ba06-cb51b60fa491 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:08.543876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed03c5-1ce2-49c0-ba06-cb51b60fa491 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:08.544827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed03c5-1ce2-49c0-ba06-cb51b60fa491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:08.551214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed03c5-1ce2-49c0-ba06-cb51b60fa491 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:08.586702 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1353/2740] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:28:08.591293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf2fe5-f9ac-4fba-aba6-dd4b8838324a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:08.608075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf2fe5-f9ac-4fba-aba6-dd4b8838324a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:08.622307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c9cfc-5436-4581-8d26-4a936c324560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:08.623262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c9cfc-5436-4581-8d26-4a936c324560 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:08.623737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c9cfc-5436-4581-8d26-4a936c324560 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:08.624184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c9cfc-5436-4581-8d26-4a936c324560 admin admin] PATH_INFO: `/v3/projects/16b0b534b9eb463aab0f13e838578da2/users/071401bed74d48fe8ae2dbdb98aa81cc/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:09.039974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:09.055612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c9cfc-5436-4581-8d26-4a936c324560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16b0b534b9eb463aab0f13e838578da2, user_id=071401bed74d48fe8ae2dbdb98aa81cc, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:09.058341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c9cfc-5436-4581-8d26-4a936c324560 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:09.221092 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1388/2741] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:28:08 2022] PUT /identity/v3/projects/16b0b534b9eb463aab0f13e838578da2/users/071401bed74d48fe8ae2dbdb98aa81cc/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:28:09.231979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ad9da-c85d-4e4b-a345-f1ebc306cb59 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:09.233587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ad9da-c85d-4e4b-a345-f1ebc306cb59 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:09.234085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ad9da-c85d-4e4b-a345-f1ebc306cb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:09.303845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-779ad9da-c85d-4e4b-a345-f1ebc306cb59 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:09.305401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-779ad9da-c85d-4e4b-a345-f1ebc306cb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:09.485195 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1354/2742] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:28:09.509547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c9cfc-5436-4581-8d26-4a936c324560 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:09.511466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5f7c9cfc-5436-4581-8d26-4a936c324560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:09.639856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c9cfc-5436-4581-8d26-4a936c324560 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:09.647887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3c751-d078-4fc8-9b39-7f391d02ef27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:09.648939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3c751-d078-4fc8-9b39-7f391d02ef27 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:09.649242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3c751-d078-4fc8-9b39-7f391d02ef27 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:09.649519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3c751-d078-4fc8-9b39-7f391d02ef27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:09.672616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3c751-d078-4fc8-9b39-7f391d02ef27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:09.673989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3c751-d078-4fc8-9b39-7f391d02ef27 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:09.701706 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1389/2743] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:28:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:28:19.471552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=77,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:19.911234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=31,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:21.460805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ad9da-c85d-4e4b-a345-f1ebc306cb59 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:21.463078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-779ad9da-c85d-4e4b-a345-f1ebc306cb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:21.684503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ad9da-c85d-4e4b-a345-f1ebc306cb59 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:21.689675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fe064-162b-4989-8126-65a5e1d21a40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:21.690573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fe064-162b-4989-8126-65a5e1d21a40 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:21.691074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fe064-162b-4989-8126-65a5e1d21a40 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:21.691522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fe064-162b-4989-8126-65a5e1d21a40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:21.696602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-845fe064-162b-4989-8126-65a5e1d21a40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:21.903416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845fe064-162b-4989-8126-65a5e1d21a40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:21.906527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845fe064-162b-4989-8126-65a5e1d21a40 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:21.923612 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1355/2744] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:28:21 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:28:23.178995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3c751-d078-4fc8-9b39-7f391d02ef27 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:23.192217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3ed3c751-d078-4fc8-9b39-7f391d02ef27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:23.328472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3c751-d078-4fc8-9b39-7f391d02ef27 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:23.351430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2f042-1122-4e37-8e51-6933edb1d20e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:23.352372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2f042-1122-4e37-8e51-6933edb1d20e service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:23.352753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2f042-1122-4e37-8e51-6933edb1d20e service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:23.353188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2f042-1122-4e37-8e51-6933edb1d20e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:23.355447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f6f2f042-1122-4e37-8e51-6933edb1d20e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:23.497167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2f042-1122-4e37-8e51-6933edb1d20e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:23.499093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2f042-1122-4e37-8e51-6933edb1d20e service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:23.535188 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1390/2745] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:28:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:28:27.348573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2ea7e-647a-4101-97f4-b1c78cbf322d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:27.349147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2ea7e-647a-4101-97f4-b1c78cbf322d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:27.349147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2ea7e-647a-4101-97f4-b1c78cbf322d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:27.401540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-53f2ea7e-647a-4101-97f4-b1c78cbf322d None None] MFA Rules not processed for user `071401bed74d48fe8ae2dbdb98aa81cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:27.402819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-53f2ea7e-647a-4101-97f4-b1c78cbf322d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:27.557410 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1356/2746] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:28:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:28:27.559402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eabc95-4b10-4f7d-8721-7a3aa779213b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:27.559866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eabc95-4b10-4f7d-8721-7a3aa779213b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:27.560072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eabc95-4b10-4f7d-8721-7a3aa779213b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:27.620985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-82eabc95-4b10-4f7d-8721-7a3aa779213b None None] MFA Rules not processed for user `071401bed74d48fe8ae2dbdb98aa81cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:27.627258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-82eabc95-4b10-4f7d-8721-7a3aa779213b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:27.667504 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1391/2747] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:28:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:28:27.679741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2ea7e-647a-4101-97f4-b1c78cbf322d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:27.681335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-53f2ea7e-647a-4101-97f4-b1c78cbf322d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:27.758858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2ea7e-647a-4101-97f4-b1c78cbf322d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:27.777129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d779a6-2555-4709-894a-62a992d4b65d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:27.780778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d779a6-2555-4709-894a-62a992d4b65d service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:27.781354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d779a6-2555-4709-894a-62a992d4b65d service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:27.781876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d779a6-2555-4709-894a-62a992d4b65d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:27.802871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d779a6-2555-4709-894a-62a992d4b65d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:27.807636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d779a6-2555-4709-894a-62a992d4b65d service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:27.846592 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1357/2748] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:28:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:28:28.740530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eabc95-4b10-4f7d-8721-7a3aa779213b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:28.742098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-82eabc95-4b10-4f7d-8721-7a3aa779213b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:28.767305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eabc95-4b10-4f7d-8721-7a3aa779213b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:28.783544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be79e1-a392-4399-8fb4-82af1eeef8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:28.785281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be79e1-a392-4399-8fb4-82af1eeef8a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:28.785780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be79e1-a392-4399-8fb4-82af1eeef8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:28.786294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be79e1-a392-4399-8fb4-82af1eeef8a9 admin admin] PATH_INFO: `/v3/users/c65ddc0af5854d7a89192d01bc5f4576` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:28.790763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be79e1-a392-4399-8fb4-82af1eeef8a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c65ddc0af5854d7a89192d01bc5f4576)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:28.793023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be79e1-a392-4399-8fb4-82af1eeef8a9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:29.017758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-39be79e1-a392-4399-8fb4-82af1eeef8a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c65ddc0af5854d7a89192d01bc5f4576'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:29.021027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-39be79e1-a392-4399-8fb4-82af1eeef8a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c65ddc0af5854d7a89192d01bc5f4576'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:29.033241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-39be79e1-a392-4399-8fb4-82af1eeef8a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c65ddc0af5854d7a89192d01bc5f4576'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:29.065511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-39be79e1-a392-4399-8fb4-82af1eeef8a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c65ddc0af5854d7a89192d01bc5f4576'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:29.068804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-39be79e1-a392-4399-8fb4-82af1eeef8a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c65ddc0af5854d7a89192d01bc5f4576'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:29.162858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:29.169447 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1392/2749] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:28:28 2022] DELETE /identity/v3/users/c65ddc0af5854d7a89192d01bc5f4576 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:28:29.778303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d779a6-2555-4709-894a-62a992d4b65d service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:29.852089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d779a6-2555-4709-894a-62a992d4b65d service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:29.990068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:30.035324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657b924-f05c-487b-96ed-0c5c29a44f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:30.083219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657b924-f05c-487b-96ed-0c5c29a44f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:30.083219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657b924-f05c-487b-96ed-0c5c29a44f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:30.083219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657b924-f05c-487b-96ed-0c5c29a44f01 admin admin] PATH_INFO: `/v3/projects/59c57f8e9a0e4debae18d98918ba8c2f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:30.083219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657b924-f05c-487b-96ed-0c5c29a44f01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59c57f8e9a0e4debae18d98918ba8c2f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:30.083219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657b924-f05c-487b-96ed-0c5c29a44f01 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:30.430361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a657b924-f05c-487b-96ed-0c5c29a44f01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59c57f8e9a0e4debae18d98918ba8c2f', 'request_id': 'req-a657b924-f05c-487b-96ed-0c5c29a44f01'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:30.546940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a657b924-f05c-487b-96ed-0c5c29a44f01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59c57f8e9a0e4debae18d98918ba8c2f', 'request_id': 'req-a657b924-f05c-487b-96ed-0c5c29a44f01'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:30.562180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a657b924-f05c-487b-96ed-0c5c29a44f01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59c57f8e9a0e4debae18d98918ba8c2f', 'request_id': 'req-a657b924-f05c-487b-96ed-0c5c29a44f01'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:30.610493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a657b924-f05c-487b-96ed-0c5c29a44f01 admin admin] The token cache is being invalidate because project 59c57f8e9a0e4debae18d98918ba8c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:28:30.618728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a657b924-f05c-487b-96ed-0c5c29a44f01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:30.619932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a657b924-f05c-487b-96ed-0c5c29a44f01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:30.628697 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1358/2750] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:29 2022] DELETE /identity/v3/projects/59c57f8e9a0e4debae18d98918ba8c2f => generated 0 bytes in 848 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:28:30.629906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be79e1-a392-4399-8fb4-82af1eeef8a9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:30.631613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-39be79e1-a392-4399-8fb4-82af1eeef8a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:30.682869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be79e1-a392-4399-8fb4-82af1eeef8a9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:30.947276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8359d-f1fb-4148-8bc1-82715cfd436c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:30.947955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8359d-f1fb-4148-8bc1-82715cfd436c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:30.948240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8359d-f1fb-4148-8bc1-82715cfd436c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:30.948518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8359d-f1fb-4148-8bc1-82715cfd436c admin admin] PATH_INFO: `/v3/users/eb3831e6ce63489c8315e932634ead86` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:30.958510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8359d-f1fb-4148-8bc1-82715cfd436c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb3831e6ce63489c8315e932634ead86)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:30.960030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8359d-f1fb-4148-8bc1-82715cfd436c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:31.265142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cbb8359d-f1fb-4148-8bc1-82715cfd436c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb3831e6ce63489c8315e932634ead86'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:31.267178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cbb8359d-f1fb-4148-8bc1-82715cfd436c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb3831e6ce63489c8315e932634ead86'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:31.300272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cbb8359d-f1fb-4148-8bc1-82715cfd436c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb3831e6ce63489c8315e932634ead86'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:31.346393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cbb8359d-f1fb-4148-8bc1-82715cfd436c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb3831e6ce63489c8315e932634ead86'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:31.355612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cbb8359d-f1fb-4148-8bc1-82715cfd436c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb3831e6ce63489c8315e932634ead86'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:31.462972 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1393/2751] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:28:30 2022] DELETE /identity/v3/users/eb3831e6ce63489c8315e932634ead86 => generated 0 bytes in 834 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:28:32.120796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657b924-f05c-487b-96ed-0c5c29a44f01 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:32.124724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a657b924-f05c-487b-96ed-0c5c29a44f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:32.167860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657b924-f05c-487b-96ed-0c5c29a44f01 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:32.344997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a461c-f3bc-4de7-90fa-d307b2d40819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:32.345991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a461c-f3bc-4de7-90fa-d307b2d40819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:32.346543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a461c-f3bc-4de7-90fa-d307b2d40819 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:32.347623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a461c-f3bc-4de7-90fa-d307b2d40819 admin admin] PATH_INFO: `/v3/projects/dca70d6b18304d5ebb73579d68dbfb76` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:32.349130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a461c-f3bc-4de7-90fa-d307b2d40819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dca70d6b18304d5ebb73579d68dbfb76)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:32.363226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a461c-f3bc-4de7-90fa-d307b2d40819 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:32.544933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3b3a461c-f3bc-4de7-90fa-d307b2d40819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dca70d6b18304d5ebb73579d68dbfb76', 'request_id': 'req-3b3a461c-f3bc-4de7-90fa-d307b2d40819'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:32.626938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3b3a461c-f3bc-4de7-90fa-d307b2d40819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dca70d6b18304d5ebb73579d68dbfb76', 'request_id': 'req-3b3a461c-f3bc-4de7-90fa-d307b2d40819'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:32.635952 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3b3a461c-f3bc-4de7-90fa-d307b2d40819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dca70d6b18304d5ebb73579d68dbfb76', 'request_id': 'req-3b3a461c-f3bc-4de7-90fa-d307b2d40819'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:32.639107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:32.685587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3b3a461c-f3bc-4de7-90fa-d307b2d40819 admin admin] The token cache is being invalidate because project dca70d6b18304d5ebb73579d68dbfb76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:28:32.700039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3b3a461c-f3bc-4de7-90fa-d307b2d40819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:32.700039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3b3a461c-f3bc-4de7-90fa-d307b2d40819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:32.700274 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1359/2752] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:32 2022] DELETE /identity/v3/projects/dca70d6b18304d5ebb73579d68dbfb76 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:28:32.701035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5efd21-78dd-47b7-9e2d-178ba1af414b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:32.701491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5efd21-78dd-47b7-9e2d-178ba1af414b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:32.701599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5efd21-78dd-47b7-9e2d-178ba1af414b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:32.771758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-5d5efd21-78dd-47b7-9e2d-178ba1af414b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:32.775818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5d5efd21-78dd-47b7-9e2d-178ba1af414b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:33.007371 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1394/2753] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:28:33.014877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f4193-394b-49d2-add2-15cc1c9dfe08 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:33.015168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f4193-394b-49d2-add2-15cc1c9dfe08 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:33.015446 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f4193-394b-49d2-add2-15cc1c9dfe08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:33.049503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4f6f4193-394b-49d2-add2-15cc1c9dfe08 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:33.051325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4f6f4193-394b-49d2-add2-15cc1c9dfe08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:33.086184 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1360/2754] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:28:33.094545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5efd21-78dd-47b7-9e2d-178ba1af414b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:33.109970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5efd21-78dd-47b7-9e2d-178ba1af414b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:33.118804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48daab-ac50-463e-ac87-6110997a2758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:33.122930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48daab-ac50-463e-ac87-6110997a2758 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:33.122930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48daab-ac50-463e-ac87-6110997a2758 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:33.122930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48daab-ac50-463e-ac87-6110997a2758 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:33.122930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48daab-ac50-463e-ac87-6110997a2758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:28:33.122930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48daab-ac50-463e-ac87-6110997a2758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:33.122930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48daab-ac50-463e-ac87-6110997a2758 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:33.145360 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1395/2755] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:28:33.149833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f4193-394b-49d2-add2-15cc1c9dfe08 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:33.162079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f4193-394b-49d2-add2-15cc1c9dfe08 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:33.177139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7a5a8-979e-42a1-b3a1-9a96b5caa4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:33.177777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7a5a8-979e-42a1-b3a1-9a96b5caa4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:33.178076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7a5a8-979e-42a1-b3a1-9a96b5caa4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:33.178354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7a5a8-979e-42a1-b3a1-9a96b5caa4c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:33.179008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7a5a8-979e-42a1-b3a1-9a96b5caa4c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:33.181006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7a5a8-979e-42a1-b3a1-9a96b5caa4c7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:33.384569 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1361/2756] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:28:33 2022] POST /identity/v3/projects => generated 379 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:28:33.386528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48daab-ac50-463e-ac87-6110997a2758 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:33.394682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:33.399389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48daab-ac50-463e-ac87-6110997a2758 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:33.618695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c54224-a122-439c-8f9d-6820b7f72140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:33.619528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c54224-a122-439c-8f9d-6820b7f72140 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:33.620123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c54224-a122-439c-8f9d-6820b7f72140 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:33.620256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c54224-a122-439c-8f9d-6820b7f72140 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:33.621105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c54224-a122-439c-8f9d-6820b7f72140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:33.629936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c54224-a122-439c-8f9d-6820b7f72140 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:33.773860 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1396/2757] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:28:33 2022] POST /identity/v3/users => generated 290 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:28:33.783295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7a5a8-979e-42a1-b3a1-9a96b5caa4c7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:33.829948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7a5a8-979e-42a1-b3a1-9a96b5caa4c7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:33.894589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551fec4-a36d-4b53-a08d-c3c429c8ad0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:33.894589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551fec4-a36d-4b53-a08d-c3c429c8ad0d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:33.894589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551fec4-a36d-4b53-a08d-c3c429c8ad0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:33.894589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551fec4-a36d-4b53-a08d-c3c429c8ad0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:33.895219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551fec4-a36d-4b53-a08d-c3c429c8ad0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:33.897794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551fec4-a36d-4b53-a08d-c3c429c8ad0d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:33.945257 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1362/2758] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:28:33.948979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c54224-a122-439c-8f9d-6820b7f72140 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:33.967408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c54224-a122-439c-8f9d-6820b7f72140 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:34.021031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f70b15-c10b-4c59-bdbc-48c68f9e1ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:34.022161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f70b15-c10b-4c59-bdbc-48c68f9e1ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:34.022814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f70b15-c10b-4c59-bdbc-48c68f9e1ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:34.023250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f70b15-c10b-4c59-bdbc-48c68f9e1ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:34.024221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f70b15-c10b-4c59-bdbc-48c68f9e1ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:34.026292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f70b15-c10b-4c59-bdbc-48c68f9e1ab0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:34.057227 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1397/2759] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:28:34.061539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551fec4-a36d-4b53-a08d-c3c429c8ad0d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:34.090952 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551fec4-a36d-4b53-a08d-c3c429c8ad0d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:34.105372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40081442-f84e-4e15-8b29-48be09ab07bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:34.106003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40081442-f84e-4e15-8b29-48be09ab07bb admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:34.106314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40081442-f84e-4e15-8b29-48be09ab07bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:34.106595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40081442-f84e-4e15-8b29-48be09ab07bb admin admin] PATH_INFO: `/v3/projects/82cc9f48070a442db552098a12c0705e/users/790b3cd664d74806bf52d6360ac7763f/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:34.200869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40081442-f84e-4e15-8b29-48be09ab07bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=82cc9f48070a442db552098a12c0705e, user_id=790b3cd664d74806bf52d6360ac7763f, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:34.208968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40081442-f84e-4e15-8b29-48be09ab07bb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:34.346650 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1363/2760] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:28:34 2022] PUT /identity/v3/projects/82cc9f48070a442db552098a12c0705e/users/790b3cd664d74806bf52d6360ac7763f/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:28:34.359706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6d1b6-25aa-4602-b3d6-5f314a665f39 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:34.359916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6d1b6-25aa-4602-b3d6-5f314a665f39 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:34.360168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6d1b6-25aa-4602-b3d6-5f314a665f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:34.419054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-31d6d1b6-25aa-4602-b3d6-5f314a665f39 None None] MFA Rules not processed for user `790b3cd664d74806bf52d6360ac7763f`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:34.420332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-31d6d1b6-25aa-4602-b3d6-5f314a665f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:34.452912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148b94a-32f9-4faf-9817-778918262d35 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:34.453056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148b94a-32f9-4faf-9817-778918262d35 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:34.453342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148b94a-32f9-4faf-9817-778918262d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:34.485334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d148b94a-32f9-4faf-9817-778918262d35 None None] MFA Rules not processed for user `1d6175f2ac39494f8cba3db225150d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:34.489494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d148b94a-32f9-4faf-9817-778918262d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:34.600281 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1398/2761] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:28:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:28:34.631270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6d1b6-25aa-4602-b3d6-5f314a665f39 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:34.632834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-31d6d1b6-25aa-4602-b3d6-5f314a665f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:34.669269 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1364/2762] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:28:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:28:34.746427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6d1b6-25aa-4602-b3d6-5f314a665f39 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:34.752874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7718d-0564-4df5-a150-7a1a7f93f1a1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:34.756070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7718d-0564-4df5-a150-7a1a7f93f1a1 service glance] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:34.756560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7718d-0564-4df5-a150-7a1a7f93f1a1 service glance] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:34.757148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7718d-0564-4df5-a150-7a1a7f93f1a1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:34.768661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7718d-0564-4df5-a150-7a1a7f93f1a1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:34.770573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7718d-0564-4df5-a150-7a1a7f93f1a1 service glance] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:34.806874 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1399/2763] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:28:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:28:35.274059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8fd95-dd34-4898-996d-70c1bf6fbe8f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:35.281263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8fd95-dd34-4898-996d-70c1bf6fbe8f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:35.281599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8fd95-dd34-4898-996d-70c1bf6fbe8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:35.322472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-36b8fd95-dd34-4898-996d-70c1bf6fbe8f None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:35.324192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-36b8fd95-dd34-4898-996d-70c1bf6fbe8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:35.498953 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1365/2764] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:28:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:28:35.517623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7718d-0564-4df5-a150-7a1a7f93f1a1 service glance] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:35.521254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6bf7718d-0564-4df5-a150-7a1a7f93f1a1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:35.562314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:35.762986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7718d-0564-4df5-a150-7a1a7f93f1a1 service glance] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:35.775400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373ec44-a931-4d6d-a0dd-283a7ee6d23e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:35.776049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373ec44-a931-4d6d-a0dd-283a7ee6d23e service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:35.776332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373ec44-a931-4d6d-a0dd-283a7ee6d23e service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:35.776604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373ec44-a931-4d6d-a0dd-283a7ee6d23e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:35.833515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373ec44-a931-4d6d-a0dd-283a7ee6d23e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:35.848917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373ec44-a931-4d6d-a0dd-283a7ee6d23e service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:35.875516 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1400/2765] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:28:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:28:40.821245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444d37d-5f49-412c-902d-df9b94777008 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:40.821753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444d37d-5f49-412c-902d-df9b94777008 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:40.821846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444d37d-5f49-412c-902d-df9b94777008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:40.848728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-2444d37d-5f49-412c-902d-df9b94777008 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:40.850848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2444d37d-5f49-412c-902d-df9b94777008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:40.860689 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1366/2766] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:28:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:28:40.875991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373ec44-a931-4d6d-a0dd-283a7ee6d23e service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:40.889011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373ec44-a931-4d6d-a0dd-283a7ee6d23e service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:40.902459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433d1fc-ee2b-43f8-a6eb-abc7ba3594c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:40.903385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433d1fc-ee2b-43f8-a6eb-abc7ba3594c2 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:40.903736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433d1fc-ee2b-43f8-a6eb-abc7ba3594c2 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:40.904471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433d1fc-ee2b-43f8-a6eb-abc7ba3594c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:40.927386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1433d1fc-ee2b-43f8-a6eb-abc7ba3594c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:40.929193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1433d1fc-ee2b-43f8-a6eb-abc7ba3594c2 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:40.961498 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1401/2767] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:28:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:28:41.217095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444d37d-5f49-412c-902d-df9b94777008 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:41.218278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2444d37d-5f49-412c-902d-df9b94777008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:41.341963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:41.435106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444d37d-5f49-412c-902d-df9b94777008 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:41.452249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c710c8-91d7-4443-b236-3c2958fbb261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:41.453361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c710c8-91d7-4443-b236-3c2958fbb261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:41.453976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c710c8-91d7-4443-b236-3c2958fbb261 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:41.454467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c710c8-91d7-4443-b236-3c2958fbb261 admin admin] PATH_INFO: `/v3/users/8e8640291c8745609faae41bdd731c17` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:41.462964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c710c8-91d7-4443-b236-3c2958fbb261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e8640291c8745609faae41bdd731c17)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:41.470466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c710c8-91d7-4443-b236-3c2958fbb261 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:41.710251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-66c710c8-91d7-4443-b236-3c2958fbb261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e8640291c8745609faae41bdd731c17'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:41.711318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-66c710c8-91d7-4443-b236-3c2958fbb261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e8640291c8745609faae41bdd731c17'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:41.724125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-66c710c8-91d7-4443-b236-3c2958fbb261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e8640291c8745609faae41bdd731c17'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:41.747451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-66c710c8-91d7-4443-b236-3c2958fbb261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e8640291c8745609faae41bdd731c17'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:41.830453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-66c710c8-91d7-4443-b236-3c2958fbb261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e8640291c8745609faae41bdd731c17'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:41.841832 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1367/2768] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:28:41 2022] DELETE /identity/v3/users/8e8640291c8745609faae41bdd731c17 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:28:42.393316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433d1fc-ee2b-43f8-a6eb-abc7ba3594c2 service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:42.416157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433d1fc-ee2b-43f8-a6eb-abc7ba3594c2 service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:42.610330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00cc06-e257-4e53-92f8-9c694165924b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:42.611197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00cc06-e257-4e53-92f8-9c694165924b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:42.611686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00cc06-e257-4e53-92f8-9c694165924b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:42.612113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00cc06-e257-4e53-92f8-9c694165924b admin admin] PATH_INFO: `/v3/projects/f1cee634bb1f4bb0a47f33a49f24ccdf` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:42.614727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00cc06-e257-4e53-92f8-9c694165924b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1cee634bb1f4bb0a47f33a49f24ccdf)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:42.616833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00cc06-e257-4e53-92f8-9c694165924b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:42.834376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-eb00cc06-e257-4e53-92f8-9c694165924b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'request_id': 'req-eb00cc06-e257-4e53-92f8-9c694165924b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:42.863667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-eb00cc06-e257-4e53-92f8-9c694165924b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'request_id': 'req-eb00cc06-e257-4e53-92f8-9c694165924b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:42.897035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-eb00cc06-e257-4e53-92f8-9c694165924b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'request_id': 'req-eb00cc06-e257-4e53-92f8-9c694165924b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:42.974826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-eb00cc06-e257-4e53-92f8-9c694165924b admin admin] The token cache is being invalidate because project f1cee634bb1f4bb0a47f33a49f24ccdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:28:42.975230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-eb00cc06-e257-4e53-92f8-9c694165924b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:42.979321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-eb00cc06-e257-4e53-92f8-9c694165924b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:42.982499 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1402/2769] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:42 2022] DELETE /identity/v3/projects/f1cee634bb1f4bb0a47f33a49f24ccdf => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:28:42.988535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928f8a3-fdb3-4eb4-aed2-8ae43e96a5b2 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:42.990108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928f8a3-fdb3-4eb4-aed2-8ae43e96a5b2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:42.990580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928f8a3-fdb3-4eb4-aed2-8ae43e96a5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:43.085789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c928f8a3-fdb3-4eb4-aed2-8ae43e96a5b2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:43.089960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c928f8a3-fdb3-4eb4-aed2-8ae43e96a5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:43.273501 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1368/2770] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:28:43.281397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599a153-a20b-40cd-8f79-b5fbd93d56f6 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:43.281821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599a153-a20b-40cd-8f79-b5fbd93d56f6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:43.282265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599a153-a20b-40cd-8f79-b5fbd93d56f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:43.339251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b599a153-a20b-40cd-8f79-b5fbd93d56f6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:43.340650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b599a153-a20b-40cd-8f79-b5fbd93d56f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:43.371685 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1403/2771] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:28:43.376371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928f8a3-fdb3-4eb4-aed2-8ae43e96a5b2 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:43.400519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928f8a3-fdb3-4eb4-aed2-8ae43e96a5b2 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:43.420432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad92fd7-697a-46c9-885a-e9e0aa5b783a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:43.421093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad92fd7-697a-46c9-885a-e9e0aa5b783a admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:43.421469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad92fd7-697a-46c9-885a-e9e0aa5b783a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:43.421754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad92fd7-697a-46c9-885a-e9e0aa5b783a admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:43.422984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad92fd7-697a-46c9-885a-e9e0aa5b783a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:28:43.423383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad92fd7-697a-46c9-885a-e9e0aa5b783a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:43.426624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad92fd7-697a-46c9-885a-e9e0aa5b783a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:43.457044 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1369/2772] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:28:43.460361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599a153-a20b-40cd-8f79-b5fbd93d56f6 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:43.477873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599a153-a20b-40cd-8f79-b5fbd93d56f6 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:43.501452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe33a14-52c3-4834-9ffd-8e832560410e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:43.502129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe33a14-52c3-4834-9ffd-8e832560410e admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:43.502546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe33a14-52c3-4834-9ffd-8e832560410e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:43.502826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe33a14-52c3-4834-9ffd-8e832560410e admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:43.507877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe33a14-52c3-4834-9ffd-8e832560410e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:43.510087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe33a14-52c3-4834-9ffd-8e832560410e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:43.544465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:43.618027 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1404/2773] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:28:43 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:28:43.620075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad92fd7-697a-46c9-885a-e9e0aa5b783a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:43.644530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad92fd7-697a-46c9-885a-e9e0aa5b783a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:43.720380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:43.753743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f17a6-2fa7-47b3-a857-39eb8a0b55c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:43.754425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f17a6-2fa7-47b3-a857-39eb8a0b55c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:43.754711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f17a6-2fa7-47b3-a857-39eb8a0b55c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:43.755183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f17a6-2fa7-47b3-a857-39eb8a0b55c5 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:43.756531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f17a6-2fa7-47b3-a857-39eb8a0b55c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:43.760981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f17a6-2fa7-47b3-a857-39eb8a0b55c5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:43.897321 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1370/2774] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:28:43 2022] POST /identity/v3/users => generated 292 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:28:43.901410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe33a14-52c3-4834-9ffd-8e832560410e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:43.915435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe33a14-52c3-4834-9ffd-8e832560410e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:43.940446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059a32c-35c7-4c8a-8854-b3f6e0042c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:43.942936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059a32c-35c7-4c8a-8854-b3f6e0042c8f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:43.944163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059a32c-35c7-4c8a-8854-b3f6e0042c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:43.944830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059a32c-35c7-4c8a-8854-b3f6e0042c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:43.946620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059a32c-35c7-4c8a-8854-b3f6e0042c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:43.961682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059a32c-35c7-4c8a-8854-b3f6e0042c8f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:44.008926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f17a6-2fa7-47b3-a857-39eb8a0b55c5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:44.020344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f17a6-2fa7-47b3-a857-39eb8a0b55c5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:44.022759 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1405/2775] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:28:44.042585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82bb48-e137-4f7e-81d9-46e771d85de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:44.043545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82bb48-e137-4f7e-81d9-46e771d85de8 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:44.044125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82bb48-e137-4f7e-81d9-46e771d85de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:44.044658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82bb48-e137-4f7e-81d9-46e771d85de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:44.045497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82bb48-e137-4f7e-81d9-46e771d85de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:44.047454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82bb48-e137-4f7e-81d9-46e771d85de8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:44.076674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059a32c-35c7-4c8a-8854-b3f6e0042c8f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:44.086220 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1371/2776] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:28:44.093179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059a32c-35c7-4c8a-8854-b3f6e0042c8f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:44.111582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3a58f-381c-4da7-b6f2-c49ab89aa88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:44.113579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3a58f-381c-4da7-b6f2-c49ab89aa88a admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:44.114262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3a58f-381c-4da7-b6f2-c49ab89aa88a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:44.114711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3a58f-381c-4da7-b6f2-c49ab89aa88a admin admin] PATH_INFO: `/v3/projects/9aedac4560a949d496d6c36006b387c6/users/aba6e49374474d17b5e63709eb5fbb7b/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:44.158383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3a58f-381c-4da7-b6f2-c49ab89aa88a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aedac4560a949d496d6c36006b387c6, user_id=aba6e49374474d17b5e63709eb5fbb7b, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:44.164094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3a58f-381c-4da7-b6f2-c49ab89aa88a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:44.301738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396a4f0-ca12-41ea-8255-d2ceab4798d8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:44.302595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396a4f0-ca12-41ea-8255-d2ceab4798d8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:44.303093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396a4f0-ca12-41ea-8255-d2ceab4798d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:44.306586 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1406/2777] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:28:44 2022] PUT /identity/v3/projects/9aedac4560a949d496d6c36006b387c6/users/aba6e49374474d17b5e63709eb5fbb7b/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:28:44.347308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9396a4f0-ca12-41ea-8255-d2ceab4798d8 None None] MFA Rules not processed for user `aba6e49374474d17b5e63709eb5fbb7b`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:44.351486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9396a4f0-ca12-41ea-8255-d2ceab4798d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:44.575012 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1372/2778] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:28:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:28:45.195670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3a58f-381c-4da7-b6f2-c49ab89aa88a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:45.198569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7fe3a58f-381c-4da7-b6f2-c49ab89aa88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:45.395349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3a58f-381c-4da7-b6f2-c49ab89aa88a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:45.395349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105fc30-9c08-427d-85a5-39f3f25910ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:45.395349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105fc30-9c08-427d-85a5-39f3f25910ed service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:45.395349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105fc30-9c08-427d-85a5-39f3f25910ed service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:45.396807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105fc30-9c08-427d-85a5-39f3f25910ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:45.396807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9105fc30-9c08-427d-85a5-39f3f25910ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:45.526916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105fc30-9c08-427d-85a5-39f3f25910ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:45.526916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105fc30-9c08-427d-85a5-39f3f25910ed service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:45.550968 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1407/2779] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:28:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:28:45.950911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396a4f0-ca12-41ea-8255-d2ceab4798d8 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:45.953783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9396a4f0-ca12-41ea-8255-d2ceab4798d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:45.979268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396a4f0-ca12-41ea-8255-d2ceab4798d8 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:45.998598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc6bb7-dce9-4642-874e-13893e06f55a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:45.999976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc6bb7-dce9-4642-874e-13893e06f55a service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:46.000081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc6bb7-dce9-4642-874e-13893e06f55a service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:46.000358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc6bb7-dce9-4642-874e-13893e06f55a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:46.020807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc6bb7-dce9-4642-874e-13893e06f55a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:46.026574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc6bb7-dce9-4642-874e-13893e06f55a service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:46.063531 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1373/2780] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:28:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:28:51.210550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf560b-0a4f-4bc9-957c-a6081ed3cec1 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:51.211211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf560b-0a4f-4bc9-957c-a6081ed3cec1 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:51.211211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf560b-0a4f-4bc9-957c-a6081ed3cec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:51.241335 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d0bf560b-0a4f-4bc9-957c-a6081ed3cec1 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:51.242718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d0bf560b-0a4f-4bc9-957c-a6081ed3cec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:51.346143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:51.363195 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1408/2781] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:28:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:28:51.391886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc6bb7-dce9-4642-874e-13893e06f55a service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:51.396313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-55bc6bb7-dce9-4642-874e-13893e06f55a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:51.602211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc6bb7-dce9-4642-874e-13893e06f55a service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:51.608200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03830265-094e-49f8-8098-16190982e8dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:51.608820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03830265-094e-49f8-8098-16190982e8dc service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:51.609101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03830265-094e-49f8-8098-16190982e8dc service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:51.610902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03830265-094e-49f8-8098-16190982e8dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:51.682762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03830265-094e-49f8-8098-16190982e8dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:51.690289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03830265-094e-49f8-8098-16190982e8dc service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:51.715347 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1374/2782] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:28:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:28:52.402925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf560b-0a4f-4bc9-957c-a6081ed3cec1 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:52.508051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf560b-0a4f-4bc9-957c-a6081ed3cec1 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:52.516425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa8a7a-e4f3-45dc-af67-1450b58de2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:52.520497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa8a7a-e4f3-45dc-af67-1450b58de2f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:52.520986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa8a7a-e4f3-45dc-af67-1450b58de2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:52.521452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa8a7a-e4f3-45dc-af67-1450b58de2f3 admin admin] PATH_INFO: `/v3/users/aba6e49374474d17b5e63709eb5fbb7b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:52.524275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa8a7a-e4f3-45dc-af67-1450b58de2f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba6e49374474d17b5e63709eb5fbb7b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:52.529314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa8a7a-e4f3-45dc-af67-1450b58de2f3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:52.814683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-abfa8a7a-e4f3-45dc-af67-1450b58de2f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba6e49374474d17b5e63709eb5fbb7b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:52.817333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-abfa8a7a-e4f3-45dc-af67-1450b58de2f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba6e49374474d17b5e63709eb5fbb7b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:52.834300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-abfa8a7a-e4f3-45dc-af67-1450b58de2f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba6e49374474d17b5e63709eb5fbb7b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:52.870440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-abfa8a7a-e4f3-45dc-af67-1450b58de2f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba6e49374474d17b5e63709eb5fbb7b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:52.872455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-abfa8a7a-e4f3-45dc-af67-1450b58de2f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba6e49374474d17b5e63709eb5fbb7b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:52.969606 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1409/2783] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:28:52 2022] DELETE /identity/v3/users/aba6e49374474d17b5e63709eb5fbb7b => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:28:52.971704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851650d-b9e8-4791-a06f-1c6c1e2df40e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:52.972283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851650d-b9e8-4791-a06f-1c6c1e2df40e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:52.972538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851650d-b9e8-4791-a06f-1c6c1e2df40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:52.996420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa8a7a-e4f3-45dc-af67-1450b58de2f3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:52.998435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-abfa8a7a-e4f3-45dc-af67-1450b58de2f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:53.014371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6851650d-b9e8-4791-a06f-1c6c1e2df40e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:53.017633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6851650d-b9e8-4791-a06f-1c6c1e2df40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:53.052800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:53.145322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa8a7a-e4f3-45dc-af67-1450b58de2f3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:53.172382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4552f7-c951-42d4-89f9-0ac80a4aa175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:53.172936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4552f7-c951-42d4-89f9-0ac80a4aa175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:53.173337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4552f7-c951-42d4-89f9-0ac80a4aa175 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:53.173485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4552f7-c951-42d4-89f9-0ac80a4aa175 admin admin] PATH_INFO: `/v3/users/790b3cd664d74806bf52d6360ac7763f` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:53.180129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4552f7-c951-42d4-89f9-0ac80a4aa175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=790b3cd664d74806bf52d6360ac7763f)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:53.181582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4552f7-c951-42d4-89f9-0ac80a4aa175 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:53.226550 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1375/2784] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:28:53.238555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:53.303576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851650d-b9e8-4791-a06f-1c6c1e2df40e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:53.306567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6851650d-b9e8-4791-a06f-1c6c1e2df40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:53.510712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851650d-b9e8-4791-a06f-1c6c1e2df40e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:53.523155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9320d-8bcc-4a2e-869f-fe285765577b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:53.523840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9320d-8bcc-4a2e-869f-fe285765577b service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:53.524333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9320d-8bcc-4a2e-869f-fe285765577b service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:53.526911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9320d-8bcc-4a2e-869f-fe285765577b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:53.543258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9320d-8bcc-4a2e-869f-fe285765577b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:53.545497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9320d-8bcc-4a2e-869f-fe285765577b service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:53.558069 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1376/2785] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:28:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:28:53.712373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c4552f7-c951-42d4-89f9-0ac80a4aa175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '790b3cd664d74806bf52d6360ac7763f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:53.713805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c4552f7-c951-42d4-89f9-0ac80a4aa175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '790b3cd664d74806bf52d6360ac7763f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:53.732334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c4552f7-c951-42d4-89f9-0ac80a4aa175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '790b3cd664d74806bf52d6360ac7763f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:53.756870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c4552f7-c951-42d4-89f9-0ac80a4aa175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '790b3cd664d74806bf52d6360ac7763f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:53.758740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c4552f7-c951-42d4-89f9-0ac80a4aa175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '790b3cd664d74806bf52d6360ac7763f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:53.866345 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1410/2786] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:28:52 2022] DELETE /identity/v3/users/790b3cd664d74806bf52d6360ac7763f => generated 0 bytes in 868 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:28:53.869372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9a052-e4ee-4207-9a09-b4e42bf56a5b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:53.869701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9a052-e4ee-4207-9a09-b4e42bf56a5b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:53.870091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9a052-e4ee-4207-9a09-b4e42bf56a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:53.926507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b1b9a052-e4ee-4207-9a09-b4e42bf56a5b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:53.930133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b1b9a052-e4ee-4207-9a09-b4e42bf56a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:54.125277 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1377/2787] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:28:54.153866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4552f7-c951-42d4-89f9-0ac80a4aa175 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:54.155416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4c4552f7-c951-42d4-89f9-0ac80a4aa175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:54.269063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4552f7-c951-42d4-89f9-0ac80a4aa175 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:54.274620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7817fd2-3f7b-4f43-9b6e-1fdc5e50a3b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:54.275517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7817fd2-3f7b-4f43-9b6e-1fdc5e50a3b6 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:54.275855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7817fd2-3f7b-4f43-9b6e-1fdc5e50a3b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:54.276132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7817fd2-3f7b-4f43-9b6e-1fdc5e50a3b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:54.288303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7817fd2-3f7b-4f43-9b6e-1fdc5e50a3b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:54.289763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7817fd2-3f7b-4f43-9b6e-1fdc5e50a3b6 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:54.301255 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1411/2788] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:28:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:28:54.539296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9a052-e4ee-4207-9a09-b4e42bf56a5b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:54.540793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b1b9a052-e4ee-4207-9a09-b4e42bf56a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:54.555447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9a052-e4ee-4207-9a09-b4e42bf56a5b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:54.563053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fe461-a5dd-4535-9f90-d3dae2bef329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:54.563714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fe461-a5dd-4535-9f90-d3dae2bef329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:54.564000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fe461-a5dd-4535-9f90-d3dae2bef329 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:54.564278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fe461-a5dd-4535-9f90-d3dae2bef329 admin admin] PATH_INFO: `/v3/projects/9aedac4560a949d496d6c36006b387c6` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:54.565443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591fe461-a5dd-4535-9f90-d3dae2bef329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aedac4560a949d496d6c36006b387c6)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:54.569340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591fe461-a5dd-4535-9f90-d3dae2bef329 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:54.717317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-591fe461-a5dd-4535-9f90-d3dae2bef329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aedac4560a949d496d6c36006b387c6', 'request_id': 'req-591fe461-a5dd-4535-9f90-d3dae2bef329'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:54.791096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-591fe461-a5dd-4535-9f90-d3dae2bef329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aedac4560a949d496d6c36006b387c6', 'request_id': 'req-591fe461-a5dd-4535-9f90-d3dae2bef329'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:54.799583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-591fe461-a5dd-4535-9f90-d3dae2bef329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aedac4560a949d496d6c36006b387c6', 'request_id': 'req-591fe461-a5dd-4535-9f90-d3dae2bef329'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:54.800766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:54.812589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-591fe461-a5dd-4535-9f90-d3dae2bef329 admin admin] The token cache is being invalidate because project 9aedac4560a949d496d6c36006b387c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:28:54.812883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-591fe461-a5dd-4535-9f90-d3dae2bef329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:54.813612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-591fe461-a5dd-4535-9f90-d3dae2bef329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:54.818177 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1378/2789] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:54 2022] DELETE /identity/v3/projects/9aedac4560a949d496d6c36006b387c6 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:28:54.821731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30875960-c089-4fc6-92f6-3791d00b9add None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:54.822241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30875960-c089-4fc6-92f6-3791d00b9add None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:54.822729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30875960-c089-4fc6-92f6-3791d00b9add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:54.846213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-30875960-c089-4fc6-92f6-3791d00b9add None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:54.848403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-30875960-c089-4fc6-92f6-3791d00b9add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:54.933855 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1412/2790] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:28:54.945456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad07e43-ce01-43de-8d7f-dfa134c9806b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:54.945786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad07e43-ce01-43de-8d7f-dfa134c9806b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:54.946219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad07e43-ce01-43de-8d7f-dfa134c9806b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:54.968931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1ad07e43-ce01-43de-8d7f-dfa134c9806b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:54.970330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1ad07e43-ce01-43de-8d7f-dfa134c9806b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:54.980859 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1379/2791] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:28:54.986333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30875960-c089-4fc6-92f6-3791d00b9add None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:54.999301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30875960-c089-4fc6-92f6-3791d00b9add None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:55.004521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8be59-8fcd-4437-a41b-df574572cc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:55.005259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8be59-8fcd-4437-a41b-df574572cc3f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:55.005957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8be59-8fcd-4437-a41b-df574572cc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:55.006440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8be59-8fcd-4437-a41b-df574572cc3f admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:55.007178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8be59-8fcd-4437-a41b-df574572cc3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:28:55.007557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8be59-8fcd-4437-a41b-df574572cc3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:55.009238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8be59-8fcd-4437-a41b-df574572cc3f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:55.022787 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1413/2792] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:28:55.027044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad07e43-ce01-43de-8d7f-dfa134c9806b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:55.038286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad07e43-ce01-43de-8d7f-dfa134c9806b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:55.044699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bcefc-7c7e-46ef-90bd-5d85299423eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:55.046264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bcefc-7c7e-46ef-90bd-5d85299423eb admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:55.046808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bcefc-7c7e-46ef-90bd-5d85299423eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:55.047310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bcefc-7c7e-46ef-90bd-5d85299423eb admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:55.048191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598bcefc-7c7e-46ef-90bd-5d85299423eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:55.050916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598bcefc-7c7e-46ef-90bd-5d85299423eb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:55.176755 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1380/2793] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:28:55 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:28:55.191569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8be59-8fcd-4437-a41b-df574572cc3f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:55.202485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8be59-8fcd-4437-a41b-df574572cc3f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:55.223163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bcefc-7c7e-46ef-90bd-5d85299423eb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:55.223163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-598bcefc-7c7e-46ef-90bd-5d85299423eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:55.253958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:55.289889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbd956-3126-4616-b8ca-145104120ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:55.290308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbd956-3126-4616-b8ca-145104120ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:55.290589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbd956-3126-4616-b8ca-145104120ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:55.290860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbd956-3126-4616-b8ca-145104120ea1 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:55.291667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbd956-3126-4616-b8ca-145104120ea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:55.294417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbd956-3126-4616-b8ca-145104120ea1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:55.302079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bcefc-7c7e-46ef-90bd-5d85299423eb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:55.315073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086029b1-d4a9-4729-be58-e4451dc7aa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:55.315073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086029b1-d4a9-4729-be58-e4451dc7aa6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:55.315073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086029b1-d4a9-4729-be58-e4451dc7aa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:55.315073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086029b1-d4a9-4729-be58-e4451dc7aa6a admin admin] PATH_INFO: `/v3/projects/82cc9f48070a442db552098a12c0705e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:55.315468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086029b1-d4a9-4729-be58-e4451dc7aa6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=82cc9f48070a442db552098a12c0705e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:55.317684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086029b1-d4a9-4729-be58-e4451dc7aa6a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:55.418130 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1414/2794] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:28:55 2022] POST /identity/v3/users => generated 291 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:28:55.419641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbd956-3126-4616-b8ca-145104120ea1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:55.445830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbd956-3126-4616-b8ca-145104120ea1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:55.451159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-086029b1-d4a9-4729-be58-e4451dc7aa6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82cc9f48070a442db552098a12c0705e', 'request_id': 'req-086029b1-d4a9-4729-be58-e4451dc7aa6a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:55.528979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-086029b1-d4a9-4729-be58-e4451dc7aa6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82cc9f48070a442db552098a12c0705e', 'request_id': 'req-086029b1-d4a9-4729-be58-e4451dc7aa6a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:55.536249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-086029b1-d4a9-4729-be58-e4451dc7aa6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82cc9f48070a442db552098a12c0705e', 'request_id': 'req-086029b1-d4a9-4729-be58-e4451dc7aa6a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:55.541047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195554d-5658-41c5-927e-83f5d98197d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:55.542164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195554d-5658-41c5-927e-83f5d98197d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:55.542692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195554d-5658-41c5-927e-83f5d98197d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:55.543193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195554d-5658-41c5-927e-83f5d98197d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:55.544073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195554d-5658-41c5-927e-83f5d98197d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:55.546078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195554d-5658-41c5-927e-83f5d98197d1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:55.547831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-086029b1-d4a9-4729-be58-e4451dc7aa6a admin admin] The token cache is being invalidate because project 82cc9f48070a442db552098a12c0705e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:28:55.548130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-086029b1-d4a9-4729-be58-e4451dc7aa6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:55.553386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-086029b1-d4a9-4729-be58-e4451dc7aa6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:55.558574 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1381/2795] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:55 2022] DELETE /identity/v3/projects/82cc9f48070a442db552098a12c0705e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:28:55.559935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67adbf-6759-4894-93d5-b80eb3d0876f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:55.560231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67adbf-6759-4894-93d5-b80eb3d0876f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:55.560580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67adbf-6759-4894-93d5-b80eb3d0876f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:55.569535 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1415/2796] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:28:55.574917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195554d-5658-41c5-927e-83f5d98197d1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:55.577273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f195554d-5658-41c5-927e-83f5d98197d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:55.600375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195554d-5658-41c5-927e-83f5d98197d1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:55.612253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd73665-a8ce-46e8-923b-da2e4933e4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:55.613716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd73665-a8ce-46e8-923b-da2e4933e4cc admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:55.614192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd73665-a8ce-46e8-923b-da2e4933e4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:55.614632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd73665-a8ce-46e8-923b-da2e4933e4cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:55.615466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd73665-a8ce-46e8-923b-da2e4933e4cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:55.616084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-aa67adbf-6759-4894-93d5-b80eb3d0876f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:55.618179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd73665-a8ce-46e8-923b-da2e4933e4cc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:55.618476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-aa67adbf-6759-4894-93d5-b80eb3d0876f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:55.632837 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1416/2797] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:28:55.637195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd73665-a8ce-46e8-923b-da2e4933e4cc admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:55.642585 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1382/2798] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:28:55.650170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77300f71-32a6-409c-8867-b65808cc6346 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:55.650691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77300f71-32a6-409c-8867-b65808cc6346 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:55.651073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77300f71-32a6-409c-8867-b65808cc6346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:55.663935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd73665-a8ce-46e8-923b-da2e4933e4cc admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:55.671337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150dfe9-c239-4ae3-b764-9e7e017a5116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:55.672405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150dfe9-c239-4ae3-b764-9e7e017a5116 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:55.672860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150dfe9-c239-4ae3-b764-9e7e017a5116 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:55.673466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150dfe9-c239-4ae3-b764-9e7e017a5116 admin admin] PATH_INFO: `/v3/projects/92082c8718aa41bf96cd84d682d75954/users/421d14944da74570a53d620ea205449d/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:55.708153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150dfe9-c239-4ae3-b764-9e7e017a5116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92082c8718aa41bf96cd84d682d75954, user_id=421d14944da74570a53d620ea205449d, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:55.711603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150dfe9-c239-4ae3-b764-9e7e017a5116 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:55.723641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-77300f71-32a6-409c-8867-b65808cc6346 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:55.728812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-77300f71-32a6-409c-8867-b65808cc6346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:55.739964 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1383/2799] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:28:55.741435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77300f71-32a6-409c-8867-b65808cc6346 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:55.752789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77300f71-32a6-409c-8867-b65808cc6346 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:55.760855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d79e9c-1cbb-4459-aeed-57429c34197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:55.761611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d79e9c-1cbb-4459-aeed-57429c34197b admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:55.761980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d79e9c-1cbb-4459-aeed-57429c34197b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:55.762692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d79e9c-1cbb-4459-aeed-57429c34197b admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:55.763576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d79e9c-1cbb-4459-aeed-57429c34197b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:28:55.763948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d79e9c-1cbb-4459-aeed-57429c34197b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:55.766611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d79e9c-1cbb-4459-aeed-57429c34197b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:55.776169 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1417/2800] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:28:55 2022] PUT /identity/v3/projects/92082c8718aa41bf96cd84d682d75954/users/421d14944da74570a53d620ea205449d/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:28:55.781445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b3b5f-9d09-4c87-8cc7-1eaeb45edaeb None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:55.781811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b3b5f-9d09-4c87-8cc7-1eaeb45edaeb None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:55.782204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b3b5f-9d09-4c87-8cc7-1eaeb45edaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:55.805788 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1384/2801] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:28:55.807266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d79e9c-1cbb-4459-aeed-57429c34197b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:55.815043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-796b3b5f-9d09-4c87-8cc7-1eaeb45edaeb None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:55.817354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-796b3b5f-9d09-4c87-8cc7-1eaeb45edaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:55.827635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d79e9c-1cbb-4459-aeed-57429c34197b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:55.863420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:55.942010 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1418/2802] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:28:55.947707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072e8a6-866f-4fff-8f23-b80fd6ec8f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:55.950376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072e8a6-866f-4fff-8f23-b80fd6ec8f3c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:55.950850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072e8a6-866f-4fff-8f23-b80fd6ec8f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:55.951303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072e8a6-866f-4fff-8f23-b80fd6ec8f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:55.952124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072e8a6-866f-4fff-8f23-b80fd6ec8f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:55.955772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072e8a6-866f-4fff-8f23-b80fd6ec8f3c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:55.958452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b3b5f-9d09-4c87-8cc7-1eaeb45edaeb None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:55.960190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-796b3b5f-9d09-4c87-8cc7-1eaeb45edaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:56.010080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:56.061026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b3b5f-9d09-4c87-8cc7-1eaeb45edaeb None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:56.069806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb81044-44c3-4d34-97b3-352817df39af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:56.070552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb81044-44c3-4d34-97b3-352817df39af service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:56.070902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb81044-44c3-4d34-97b3-352817df39af service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:56.071259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb81044-44c3-4d34-97b3-352817df39af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:56.087262 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1385/2803] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:28:55 2022] POST /identity/v3/projects => generated 377 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:28:56.095328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072e8a6-866f-4fff-8f23-b80fd6ec8f3c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:56.104753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb81044-44c3-4d34-97b3-352817df39af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:56.109084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb81044-44c3-4d34-97b3-352817df39af service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:56.134715 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1419/2804] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:28:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:28:56.214892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072e8a6-866f-4fff-8f23-b80fd6ec8f3c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:56.219915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d33fd-af63-432c-aca8-ed0ae05df642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:56.220292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d33fd-af63-432c-aca8-ed0ae05df642 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:56.220568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d33fd-af63-432c-aca8-ed0ae05df642 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:56.220875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d33fd-af63-432c-aca8-ed0ae05df642 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:56.221489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d33fd-af63-432c-aca8-ed0ae05df642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:56.224009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d33fd-af63-432c-aca8-ed0ae05df642 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:56.297684 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1386/2805] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:28:56 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:28:56.298511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb81044-44c3-4d34-97b3-352817df39af service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:56.310649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb81044-44c3-4d34-97b3-352817df39af service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:56.316920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b019f5-7cb2-4aa6-8a4d-b5ce5e3d49ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:56.317814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b019f5-7cb2-4aa6-8a4d-b5ce5e3d49ce admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:56.318133 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b019f5-7cb2-4aa6-8a4d-b5ce5e3d49ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:56.323867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b019f5-7cb2-4aa6-8a4d-b5ce5e3d49ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:56.323867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b019f5-7cb2-4aa6-8a4d-b5ce5e3d49ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:56.323867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b019f5-7cb2-4aa6-8a4d-b5ce5e3d49ce admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:56.335081 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1420/2806] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:28:56.336517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d33fd-af63-432c-aca8-ed0ae05df642 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:56.356196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d33fd-af63-432c-aca8-ed0ae05df642 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:56.372253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3ae52-7c0a-4e52-bcd6-22d3f0cee8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:56.372905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3ae52-7c0a-4e52-bcd6-22d3f0cee8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:56.373670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3ae52-7c0a-4e52-bcd6-22d3f0cee8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:56.373670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3ae52-7c0a-4e52-bcd6-22d3f0cee8b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:56.374140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3ae52-7c0a-4e52-bcd6-22d3f0cee8b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:56.375770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3ae52-7c0a-4e52-bcd6-22d3f0cee8b8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:56.391527 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1387/2807] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:28:56.392686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b019f5-7cb2-4aa6-8a4d-b5ce5e3d49ce admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:56.404622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b019f5-7cb2-4aa6-8a4d-b5ce5e3d49ce admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:56.410227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988628b-6815-46f1-9bad-eb9d49029496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:56.410959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988628b-6815-46f1-9bad-eb9d49029496 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:56.411304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988628b-6815-46f1-9bad-eb9d49029496 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:56.411644 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988628b-6815-46f1-9bad-eb9d49029496 admin admin] PATH_INFO: `/v3/projects/c6cf048b56734ee5a3f766aaab718a78/users/f7a2be43968c4bf5a0713d4dac955a60/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:56.429494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988628b-6815-46f1-9bad-eb9d49029496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6cf048b56734ee5a3f766aaab718a78, user_id=f7a2be43968c4bf5a0713d4dac955a60, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:56.431857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988628b-6815-46f1-9bad-eb9d49029496 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:56.499516 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1421/2808] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:28:56 2022] PUT /identity/v3/projects/c6cf048b56734ee5a3f766aaab718a78/users/f7a2be43968c4bf5a0713d4dac955a60/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:28:56.510133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604cc33-5264-4939-978f-024374cd8a34 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:56.510534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604cc33-5264-4939-978f-024374cd8a34 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:56.510885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604cc33-5264-4939-978f-024374cd8a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:56.540778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5604cc33-5264-4939-978f-024374cd8a34 None None] MFA Rules not processed for user `f7a2be43968c4bf5a0713d4dac955a60`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:56.542005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5604cc33-5264-4939-978f-024374cd8a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:56.610888 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1388/2809] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:28:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:28:56.621813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988628b-6815-46f1-9bad-eb9d49029496 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:56.623978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a988628b-6815-46f1-9bad-eb9d49029496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:56.707634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988628b-6815-46f1-9bad-eb9d49029496 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:56.713528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956e48e-5ab0-42b3-964f-f784b2232670 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:56.714205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956e48e-5ab0-42b3-964f-f784b2232670 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:56.714496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956e48e-5ab0-42b3-964f-f784b2232670 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:56.714772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956e48e-5ab0-42b3-964f-f784b2232670 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:56.723911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956e48e-5ab0-42b3-964f-f784b2232670 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:56.725586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956e48e-5ab0-42b3-964f-f784b2232670 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:56.735700 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1422/2810] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:28:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:28:56.801836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604cc33-5264-4939-978f-024374cd8a34 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:56.824736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:56.893758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604cc33-5264-4939-978f-024374cd8a34 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:56.899838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2abc7-1a21-442b-9f87-938068f253ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:56.900451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2abc7-1a21-442b-9f87-938068f253ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:56.900743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2abc7-1a21-442b-9f87-938068f253ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:56.901026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2abc7-1a21-442b-9f87-938068f253ec admin admin] PATH_INFO: `/v3/users/f7a2be43968c4bf5a0713d4dac955a60` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:56.902330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2abc7-1a21-442b-9f87-938068f253ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7a2be43968c4bf5a0713d4dac955a60)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:56.904517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2abc7-1a21-442b-9f87-938068f253ec admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:57.147960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-35b2abc7-1a21-442b-9f87-938068f253ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7a2be43968c4bf5a0713d4dac955a60'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:57.149891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-35b2abc7-1a21-442b-9f87-938068f253ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7a2be43968c4bf5a0713d4dac955a60'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:57.164702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-35b2abc7-1a21-442b-9f87-938068f253ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7a2be43968c4bf5a0713d4dac955a60'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:57.222899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-35b2abc7-1a21-442b-9f87-938068f253ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7a2be43968c4bf5a0713d4dac955a60'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:57.347947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-35b2abc7-1a21-442b-9f87-938068f253ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7a2be43968c4bf5a0713d4dac955a60'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:57.366612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf9e77-e058-438a-a8bd-aa1988d61905 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:57.367069 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1389/2811] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:28:56 2022] DELETE /identity/v3/users/f7a2be43968c4bf5a0713d4dac955a60 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:28:57.367586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf9e77-e058-438a-a8bd-aa1988d61905 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:57.368132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf9e77-e058-438a-a8bd-aa1988d61905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:57.406445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0bdf9e77-e058-438a-a8bd-aa1988d61905 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:57.407706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0bdf9e77-e058-438a-a8bd-aa1988d61905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:57.506341 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1423/2812] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:28:57.519409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2abc7-1a21-442b-9f87-938068f253ec admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:57.522219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-35b2abc7-1a21-442b-9f87-938068f253ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:57.670548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2abc7-1a21-442b-9f87-938068f253ec admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:57.670548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a4a28-87f9-4c60-accb-703c5406bb8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:57.670548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a4a28-87f9-4c60-accb-703c5406bb8d service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:57.670548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a4a28-87f9-4c60-accb-703c5406bb8d service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:57.670995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a4a28-87f9-4c60-accb-703c5406bb8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:57.685309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a4a28-87f9-4c60-accb-703c5406bb8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:57.686982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a4a28-87f9-4c60-accb-703c5406bb8d service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:57.698227 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1390/2813] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:28:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:28:57.798463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf9e77-e058-438a-a8bd-aa1988d61905 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:57.800171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0bdf9e77-e058-438a-a8bd-aa1988d61905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:57.818622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:57.888069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf9e77-e058-438a-a8bd-aa1988d61905 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:57.895805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f78ef5-e50f-4f89-882d-31c8a5a057da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:57.896288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f78ef5-e50f-4f89-882d-31c8a5a057da service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:57.896575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f78ef5-e50f-4f89-882d-31c8a5a057da service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:57.896951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f78ef5-e50f-4f89-882d-31c8a5a057da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:57.898819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f3f78ef5-e50f-4f89-882d-31c8a5a057da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:58.027161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f78ef5-e50f-4f89-882d-31c8a5a057da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:58.028931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f78ef5-e50f-4f89-882d-31c8a5a057da service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:58.042394 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1424/2814] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:28:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:28:59.403908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a4a28-87f9-4c60-accb-703c5406bb8d service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:59.405355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9f8a4a28-87f9-4c60-accb-703c5406bb8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:59.437835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a4a28-87f9-4c60-accb-703c5406bb8d service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:59.453035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186a12f-ccc9-4020-9ce4-653664bfe7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:59.453035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186a12f-ccc9-4020-9ce4-653664bfe7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:59.453035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186a12f-ccc9-4020-9ce4-653664bfe7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:59.453035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186a12f-ccc9-4020-9ce4-653664bfe7a4 admin admin] PATH_INFO: `/v3/projects/c6cf048b56734ee5a3f766aaab718a78` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:59.454338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186a12f-ccc9-4020-9ce4-653664bfe7a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6cf048b56734ee5a3f766aaab718a78)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:59.458070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186a12f-ccc9-4020-9ce4-653664bfe7a4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:59.551382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f78ef5-e50f-4f89-882d-31c8a5a057da service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:59.552841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f3f78ef5-e50f-4f89-882d-31c8a5a057da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:59.589580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:59.630823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b186a12f-ccc9-4020-9ce4-653664bfe7a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6cf048b56734ee5a3f766aaab718a78', 'request_id': 'req-b186a12f-ccc9-4020-9ce4-653664bfe7a4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:59.708375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b186a12f-ccc9-4020-9ce4-653664bfe7a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6cf048b56734ee5a3f766aaab718a78', 'request_id': 'req-b186a12f-ccc9-4020-9ce4-653664bfe7a4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:59.714274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b186a12f-ccc9-4020-9ce4-653664bfe7a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6cf048b56734ee5a3f766aaab718a78', 'request_id': 'req-b186a12f-ccc9-4020-9ce4-653664bfe7a4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:59.739588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b186a12f-ccc9-4020-9ce4-653664bfe7a4 admin admin] The token cache is being invalidate because project c6cf048b56734ee5a3f766aaab718a78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:28:59.740255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b186a12f-ccc9-4020-9ce4-653664bfe7a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:59.742714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b186a12f-ccc9-4020-9ce4-653664bfe7a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:28:59.744051 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1391/2815] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:59 2022] DELETE /identity/v3/projects/c6cf048b56734ee5a3f766aaab718a78 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:28:59.748935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f78ef5-e50f-4f89-882d-31c8a5a057da service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:59.749532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953547fd-e02f-4a12-91a5-a490894066b9 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:59.750597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953547fd-e02f-4a12-91a5-a490894066b9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:59.751044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953547fd-e02f-4a12-91a5-a490894066b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:59.788124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:59.789057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-953547fd-e02f-4a12-91a5-a490894066b9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:28:59.808974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-953547fd-e02f-4a12-91a5-a490894066b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:59.877581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a98410-57b1-4a86-9b96-f80b4bd5a1c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:59.878775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a98410-57b1-4a86-9b96-f80b4bd5a1c0 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:59.879488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a98410-57b1-4a86-9b96-f80b4bd5a1c0 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:59.879488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a98410-57b1-4a86-9b96-f80b4bd5a1c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:59.898941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e7a98410-57b1-4a86-9b96-f80b4bd5a1c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:59.916290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a98410-57b1-4a86-9b96-f80b4bd5a1c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:28:59.918628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a98410-57b1-4a86-9b96-f80b4bd5a1c0 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:28:59.948644 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1425/2816] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:28:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:28:59.950535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a98410-57b1-4a86-9b96-f80b4bd5a1c0 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:28:59.953271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e7a98410-57b1-4a86-9b96-f80b4bd5a1c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:28:59.960226 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1392/2817] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:28:59.968093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccbe67-e7ec-4661-9fc3-8d26a8ffdcec None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:28:59.968498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccbe67-e7ec-4661-9fc3-8d26a8ffdcec None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:28:59.968954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccbe67-e7ec-4661-9fc3-8d26a8ffdcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:28:59.985597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a98410-57b1-4a86-9b96-f80b4bd5a1c0 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:28:59.998051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784be46-74d5-45fa-a0d1-302c0b1bd470 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:28:59.999386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784be46-74d5-45fa-a0d1-302c0b1bd470 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:00.000983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-90ccbe67-e7ec-4661-9fc3-8d26a8ffdcec None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:29:00.001358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784be46-74d5-45fa-a0d1-302c0b1bd470 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:00.002139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784be46-74d5-45fa-a0d1-302c0b1bd470 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:00.005388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3784be46-74d5-45fa-a0d1-302c0b1bd470 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:00.006064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-90ccbe67-e7ec-4661-9fc3-8d26a8ffdcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:00.026885 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1393/2818] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:29:00.030792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784be46-74d5-45fa-a0d1-302c0b1bd470 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:00.031438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccbe67-e7ec-4661-9fc3-8d26a8ffdcec None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:00.033097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784be46-74d5-45fa-a0d1-302c0b1bd470 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:00.046285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccbe67-e7ec-4661-9fc3-8d26a8ffdcec None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:00.049024 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1426/2819] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:28:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:29:00.054782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af6fec-5ad0-49a7-acb5-f00db109ab7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:00.055606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af6fec-5ad0-49a7-acb5-f00db109ab7d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:00.056153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af6fec-5ad0-49a7-acb5-f00db109ab7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:00.056555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af6fec-5ad0-49a7-acb5-f00db109ab7d admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:00.057323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af6fec-5ad0-49a7-acb5-f00db109ab7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:29:00.057751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af6fec-5ad0-49a7-acb5-f00db109ab7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:00.059651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af6fec-5ad0-49a7-acb5-f00db109ab7d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:00.085673 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1394/2820] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:29:00.087834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784be46-74d5-45fa-a0d1-302c0b1bd470 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:00.105031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784be46-74d5-45fa-a0d1-302c0b1bd470 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:00.112033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3e965-f286-4965-8381-2cd610ef74a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:00.113371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3e965-f286-4965-8381-2cd610ef74a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:00.113509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3e965-f286-4965-8381-2cd610ef74a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:00.113785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3e965-f286-4965-8381-2cd610ef74a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:00.114548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3e965-f286-4965-8381-2cd610ef74a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:00.117054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3e965-f286-4965-8381-2cd610ef74a5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:00.307517 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1427/2821] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:29:00 2022] POST /identity/v3/projects => generated 397 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:29:00.309219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af6fec-5ad0-49a7-acb5-f00db109ab7d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:00.322020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af6fec-5ad0-49a7-acb5-f00db109ab7d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:00.488484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25881e7c-280b-4b9e-aa6d-ad91d2eb55e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:00.489180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25881e7c-280b-4b9e-aa6d-ad91d2eb55e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:00.489393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25881e7c-280b-4b9e-aa6d-ad91d2eb55e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:00.489973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25881e7c-280b-4b9e-aa6d-ad91d2eb55e6 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:00.490925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25881e7c-280b-4b9e-aa6d-ad91d2eb55e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:00.494929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25881e7c-280b-4b9e-aa6d-ad91d2eb55e6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:00.581572 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1395/2822] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:29:00 2022] POST /identity/v3/users => generated 299 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:29:00.584924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3e965-f286-4965-8381-2cd610ef74a5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:00.599563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3e965-f286-4965-8381-2cd610ef74a5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:00.605326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe1cea-b71c-437f-9ed0-8c73c6ac43f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:00.606315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe1cea-b71c-437f-9ed0-8c73c6ac43f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:00.606766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe1cea-b71c-437f-9ed0-8c73c6ac43f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:00.607224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe1cea-b71c-437f-9ed0-8c73c6ac43f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:00.608394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe1cea-b71c-437f-9ed0-8c73c6ac43f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:00.610474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe1cea-b71c-437f-9ed0-8c73c6ac43f9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:00.627070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25881e7c-280b-4b9e-aa6d-ad91d2eb55e6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:00.627498 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1428/2823] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:29:00.638846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25881e7c-280b-4b9e-aa6d-ad91d2eb55e6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:00.647534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4ac15-23c6-480c-aae1-e43408bbaa7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:00.648165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4ac15-23c6-480c-aae1-e43408bbaa7e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:00.648455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4ac15-23c6-480c-aae1-e43408bbaa7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:00.648733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4ac15-23c6-480c-aae1-e43408bbaa7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:00.649584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4ac15-23c6-480c-aae1-e43408bbaa7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:00.651248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4ac15-23c6-480c-aae1-e43408bbaa7e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:00.664938 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1396/2824] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:29:00.669404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe1cea-b71c-437f-9ed0-8c73c6ac43f9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:00.680937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe1cea-b71c-437f-9ed0-8c73c6ac43f9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:00.686562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50452fcd-c4d0-44d0-81c9-1c4cd907790b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:00.686746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50452fcd-c4d0-44d0-81c9-1c4cd907790b admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:00.686956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50452fcd-c4d0-44d0-81c9-1c4cd907790b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:00.687244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50452fcd-c4d0-44d0-81c9-1c4cd907790b admin admin] PATH_INFO: `/v3/projects/d3388bf820a843ca8a09898ef14093f2/users/fba9d6d7bae4487fbc1ea124661df8b3/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:00.710985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50452fcd-c4d0-44d0-81c9-1c4cd907790b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3388bf820a843ca8a09898ef14093f2, user_id=fba9d6d7bae4487fbc1ea124661df8b3, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:00.713819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50452fcd-c4d0-44d0-81c9-1c4cd907790b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:00.820627 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1429/2825] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:29:00 2022] PUT /identity/v3/projects/d3388bf820a843ca8a09898ef14093f2/users/fba9d6d7bae4487fbc1ea124661df8b3/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:29:00.831941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae996796-b653-4e1d-a235-abf589e1d228 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:00.832235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae996796-b653-4e1d-a235-abf589e1d228 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:00.832549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae996796-b653-4e1d-a235-abf589e1d228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:00.879751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ae996796-b653-4e1d-a235-abf589e1d228 None None] MFA Rules not processed for user `fba9d6d7bae4487fbc1ea124661df8b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:29:00.883891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ae996796-b653-4e1d-a235-abf589e1d228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:01.009569 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1397/2826] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:29:00 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:29:01.365085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50452fcd-c4d0-44d0-81c9-1c4cd907790b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:01.367766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-50452fcd-c4d0-44d0-81c9-1c4cd907790b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:01.484697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50452fcd-c4d0-44d0-81c9-1c4cd907790b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:01.502525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b089a-ad92-4191-9408-8d8af93e0167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:01.503949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b089a-ad92-4191-9408-8d8af93e0167 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:01.504436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b089a-ad92-4191-9408-8d8af93e0167 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:01.504919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b089a-ad92-4191-9408-8d8af93e0167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:01.506162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae996796-b653-4e1d-a235-abf589e1d228 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:01.508366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ae996796-b653-4e1d-a235-abf589e1d228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:01.531871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b089a-ad92-4191-9408-8d8af93e0167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:01.533558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b089a-ad92-4191-9408-8d8af93e0167 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:01.554541 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1430/2827] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:29:01 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:29:01.571753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:01.634438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae996796-b653-4e1d-a235-abf589e1d228 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:01.647421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb23405-c44b-42ad-9c74-76ff0f48273e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:01.648133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb23405-c44b-42ad-9c74-76ff0f48273e service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:01.648478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb23405-c44b-42ad-9c74-76ff0f48273e service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:01.648757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb23405-c44b-42ad-9c74-76ff0f48273e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:01.659781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7cb23405-c44b-42ad-9c74-76ff0f48273e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:01.671628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0c1ef-0aea-4212-a2c2-6d6c22689140 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:01.672574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0c1ef-0aea-4212-a2c2-6d6c22689140 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:01.674897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0c1ef-0aea-4212-a2c2-6d6c22689140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:01.707453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb23405-c44b-42ad-9c74-76ff0f48273e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:01.718838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb23405-c44b-42ad-9c74-76ff0f48273e service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:01.749090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-81a0c1ef-0aea-4212-a2c2-6d6c22689140 None None] MFA Rules not processed for user `fba9d6d7bae4487fbc1ea124661df8b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:29:01.750380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-81a0c1ef-0aea-4212-a2c2-6d6c22689140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:01.769860 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1398/2828] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:29:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:29:01.783194 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1431/2829] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:29:01 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:29:01.843994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb23405-c44b-42ad-9c74-76ff0f48273e service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:01.864817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb23405-c44b-42ad-9c74-76ff0f48273e service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:01.875129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be588a-d373-49f0-a225-da1121a31369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:01.875129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be588a-d373-49f0-a225-da1121a31369 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:01.875129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be588a-d373-49f0-a225-da1121a31369 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:01.875129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be588a-d373-49f0-a225-da1121a31369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:01.875880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-72be588a-d373-49f0-a225-da1121a31369 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:01.897089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be588a-d373-49f0-a225-da1121a31369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:01.901426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be588a-d373-49f0-a225-da1121a31369 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:01.927423 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1399/2830] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:29:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:29:03.289509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0c1ef-0aea-4212-a2c2-6d6c22689140 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:03.353209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:03.424780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0c1ef-0aea-4212-a2c2-6d6c22689140 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:03.437444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ee612-c688-4cee-a31d-95948b5afed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:03.438301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ee612-c688-4cee-a31d-95948b5afed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:03.438587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ee612-c688-4cee-a31d-95948b5afed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:03.438863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ee612-c688-4cee-a31d-95948b5afed8 admin admin] PATH_INFO: `/v3/users/fba9d6d7bae4487fbc1ea124661df8b3` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:03.440046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ee612-c688-4cee-a31d-95948b5afed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fba9d6d7bae4487fbc1ea124661df8b3)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:03.442267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ee612-c688-4cee-a31d-95948b5afed8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:03.724941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-408ee612-c688-4cee-a31d-95948b5afed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fba9d6d7bae4487fbc1ea124661df8b3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:03.726779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-408ee612-c688-4cee-a31d-95948b5afed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fba9d6d7bae4487fbc1ea124661df8b3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:03.750945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-408ee612-c688-4cee-a31d-95948b5afed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fba9d6d7bae4487fbc1ea124661df8b3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:03.823691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-408ee612-c688-4cee-a31d-95948b5afed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fba9d6d7bae4487fbc1ea124661df8b3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:03.824743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-408ee612-c688-4cee-a31d-95948b5afed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fba9d6d7bae4487fbc1ea124661df8b3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:03.944569 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1432/2831] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:29:03 2022] DELETE /identity/v3/users/fba9d6d7bae4487fbc1ea124661df8b3 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:29:03.948821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb78e3-2997-46f8-8a80-9b9a2fc69022 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:03.949362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb78e3-2997-46f8-8a80-9b9a2fc69022 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:03.949468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb78e3-2997-46f8-8a80-9b9a2fc69022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:03.988880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f6fb78e3-2997-46f8-8a80-9b9a2fc69022 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:29:03.994676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f6fb78e3-2997-46f8-8a80-9b9a2fc69022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:04.073086 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1400/2832] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:29:04.088179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ee612-c688-4cee-a31d-95948b5afed8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:04.090290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-408ee612-c688-4cee-a31d-95948b5afed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:04.201070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ee612-c688-4cee-a31d-95948b5afed8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:04.209665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf721e04-217b-417e-8191-1d4a1e34be04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:04.211733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf721e04-217b-417e-8191-1d4a1e34be04 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:04.212022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf721e04-217b-417e-8191-1d4a1e34be04 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:04.212495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf721e04-217b-417e-8191-1d4a1e34be04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:04.231374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf721e04-217b-417e-8191-1d4a1e34be04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:04.234064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf721e04-217b-417e-8191-1d4a1e34be04 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:04.251784 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1433/2833] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:29:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:29:04.442454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb78e3-2997-46f8-8a80-9b9a2fc69022 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:04.444965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f6fb78e3-2997-46f8-8a80-9b9a2fc69022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:04.533120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:04.575403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb78e3-2997-46f8-8a80-9b9a2fc69022 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:04.588765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92ed79-b7d6-4471-80c8-368222290c8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:04.591413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92ed79-b7d6-4471-80c8-368222290c8e service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:04.592160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92ed79-b7d6-4471-80c8-368222290c8e service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:04.592610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92ed79-b7d6-4471-80c8-368222290c8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:04.596783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ca92ed79-b7d6-4471-80c8-368222290c8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:04.729825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92ed79-b7d6-4471-80c8-368222290c8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:04.732003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92ed79-b7d6-4471-80c8-368222290c8e service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:04.767425 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1401/2834] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:29:04 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:29:05.770352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf721e04-217b-417e-8191-1d4a1e34be04 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:05.772481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bf721e04-217b-417e-8191-1d4a1e34be04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:05.805649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf721e04-217b-417e-8191-1d4a1e34be04 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:05.837036 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf84937-062f-428e-952a-56bbb0376d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:05.839525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf84937-062f-428e-952a-56bbb0376d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:05.839525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf84937-062f-428e-952a-56bbb0376d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:05.839525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf84937-062f-428e-952a-56bbb0376d35 admin admin] PATH_INFO: `/v3/projects/d3388bf820a843ca8a09898ef14093f2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:05.839525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf84937-062f-428e-952a-56bbb0376d35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3388bf820a843ca8a09898ef14093f2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:05.841326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf84937-062f-428e-952a-56bbb0376d35 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:06.049202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:06.053721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0cf84937-062f-428e-952a-56bbb0376d35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3388bf820a843ca8a09898ef14093f2', 'request_id': 'req-0cf84937-062f-428e-952a-56bbb0376d35'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:06.062372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0cf84937-062f-428e-952a-56bbb0376d35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3388bf820a843ca8a09898ef14093f2', 'request_id': 'req-0cf84937-062f-428e-952a-56bbb0376d35'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:06.076204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0cf84937-062f-428e-952a-56bbb0376d35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3388bf820a843ca8a09898ef14093f2', 'request_id': 'req-0cf84937-062f-428e-952a-56bbb0376d35'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:06.163991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0cf84937-062f-428e-952a-56bbb0376d35 admin admin] The token cache is being invalidate because project d3388bf820a843ca8a09898ef14093f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:29:06.164356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0cf84937-062f-428e-952a-56bbb0376d35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:06.165205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0cf84937-062f-428e-952a-56bbb0376d35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:06.170813 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1434/2835] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:29:05 2022] DELETE /identity/v3/projects/d3388bf820a843ca8a09898ef14093f2 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:29:06.172691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a765d7-60ba-40bc-a1f3-472b47a48d49 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:06.173193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a765d7-60ba-40bc-a1f3-472b47a48d49 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:06.173398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a765d7-60ba-40bc-a1f3-472b47a48d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:06.213587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c8a765d7-60ba-40bc-a1f3-472b47a48d49 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:29:06.215036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c8a765d7-60ba-40bc-a1f3-472b47a48d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:06.404585 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1402/2836] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:29:06.413194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e9f1f-bf22-4e8e-a9b4-6eb0b0b9e366 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:06.414579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e9f1f-bf22-4e8e-a9b4-6eb0b0b9e366 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:06.415084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e9f1f-bf22-4e8e-a9b4-6eb0b0b9e366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:06.458421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4d8e9f1f-bf22-4e8e-a9b4-6eb0b0b9e366 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:29:06.459637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4d8e9f1f-bf22-4e8e-a9b4-6eb0b0b9e366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:06.475721 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1435/2837] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:29:06.480219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a765d7-60ba-40bc-a1f3-472b47a48d49 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:06.527986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a765d7-60ba-40bc-a1f3-472b47a48d49 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:06.549838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42a26f-2536-4eae-a512-cb929a90ad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:06.551491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42a26f-2536-4eae-a512-cb929a90ad49 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:06.552440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42a26f-2536-4eae-a512-cb929a90ad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:06.554638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42a26f-2536-4eae-a512-cb929a90ad49 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:06.558733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42a26f-2536-4eae-a512-cb929a90ad49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:29:06.563026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42a26f-2536-4eae-a512-cb929a90ad49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:06.565276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42a26f-2536-4eae-a512-cb929a90ad49 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:06.618177 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1403/2838] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:29:06.622938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e9f1f-bf22-4e8e-a9b4-6eb0b0b9e366 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:06.636623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e9f1f-bf22-4e8e-a9b4-6eb0b0b9e366 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:06.657350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5312e-6e7d-4f6e-a8cd-13beb246e2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:06.658142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5312e-6e7d-4f6e-a8cd-13beb246e2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:06.658559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5312e-6e7d-4f6e-a8cd-13beb246e2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:06.658903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5312e-6e7d-4f6e-a8cd-13beb246e2b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:06.659719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5312e-6e7d-4f6e-a8cd-13beb246e2b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:06.665696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5312e-6e7d-4f6e-a8cd-13beb246e2b0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:06.794225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42a26f-2536-4eae-a512-cb929a90ad49 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:06.805138 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1436/2839] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:29:06 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:29:06.813580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42a26f-2536-4eae-a512-cb929a90ad49 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:07.021906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be477730-171b-4cec-a117-7cab2ed36cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:07.022566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be477730-171b-4cec-a117-7cab2ed36cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:07.022847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be477730-171b-4cec-a117-7cab2ed36cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:07.023120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be477730-171b-4cec-a117-7cab2ed36cb4 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:07.023778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be477730-171b-4cec-a117-7cab2ed36cb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:07.026280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be477730-171b-4cec-a117-7cab2ed36cb4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:07.053452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:07.136836 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1404/2840] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:29:06 2022] POST /identity/v3/users => generated 293 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:29:07.140772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5312e-6e7d-4f6e-a8cd-13beb246e2b0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:07.158743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5312e-6e7d-4f6e-a8cd-13beb246e2b0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:07.174319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983c47e-0557-475b-9a16-f4e9c9cc25c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:07.175222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983c47e-0557-475b-9a16-f4e9c9cc25c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:07.176579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983c47e-0557-475b-9a16-f4e9c9cc25c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:07.177897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983c47e-0557-475b-9a16-f4e9c9cc25c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:07.178817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983c47e-0557-475b-9a16-f4e9c9cc25c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:07.184400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983c47e-0557-475b-9a16-f4e9c9cc25c4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:07.195148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6307fb-22c9-468e-9e90-47b2454fc109 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:07.201557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6307fb-22c9-468e-9e90-47b2454fc109 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:07.201557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6307fb-22c9-468e-9e90-47b2454fc109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:07.227069 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1437/2841] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:29:07.230997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983c47e-0557-475b-9a16-f4e9c9cc25c4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:07.261260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983c47e-0557-475b-9a16-f4e9c9cc25c4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:07.266992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9d6307fb-22c9-468e-9e90-47b2454fc109 None None] MFA Rules not processed for user `421d14944da74570a53d620ea205449d`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:29:07.269467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9d6307fb-22c9-468e-9e90-47b2454fc109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:07.273539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b8663-1afe-45c0-98bb-bc71674f2f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:07.278233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b8663-1afe-45c0-98bb-bc71674f2f14 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:07.278540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b8663-1afe-45c0-98bb-bc71674f2f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:07.281903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b8663-1afe-45c0-98bb-bc71674f2f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:07.282657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b8663-1afe-45c0-98bb-bc71674f2f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:07.295106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b8663-1afe-45c0-98bb-bc71674f2f14 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:07.319204 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1438/2842] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:29:07.324448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b8663-1afe-45c0-98bb-bc71674f2f14 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:07.347514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b8663-1afe-45c0-98bb-bc71674f2f14 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:07.361099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3d759-5d60-4670-a21b-e237df0c39da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:07.361992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3d759-5d60-4670-a21b-e237df0c39da admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:07.362306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3d759-5d60-4670-a21b-e237df0c39da admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:07.364512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3d759-5d60-4670-a21b-e237df0c39da admin admin] PATH_INFO: `/v3/projects/5514904d799d4f5dae454193e70d85f6/users/9ce351a48282492e8cd69b9a5a05f545/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:07.397184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3d759-5d60-4670-a21b-e237df0c39da admin admin] RBAC: Authorizing `identity:create_grant(project_id=5514904d799d4f5dae454193e70d85f6, user_id=9ce351a48282492e8cd69b9a5a05f545, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:07.408230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3d759-5d60-4670-a21b-e237df0c39da admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:07.483250 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1405/2843] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:29:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:29:07.495880 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1439/2844] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:29:07 2022] PUT /identity/v3/projects/5514904d799d4f5dae454193e70d85f6/users/9ce351a48282492e8cd69b9a5a05f545/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:29:07.501143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d93531-6682-41be-978a-5aa735cf8c0b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:07.501490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d93531-6682-41be-978a-5aa735cf8c0b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:07.501771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d93531-6682-41be-978a-5aa735cf8c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:07.564514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d8d93531-6682-41be-978a-5aa735cf8c0b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:29:07.569367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d8d93531-6682-41be-978a-5aa735cf8c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:07.749885 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1406/2845] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:29:07.765594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3d759-5d60-4670-a21b-e237df0c39da admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:07.767540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9ce3d759-5d60-4670-a21b-e237df0c39da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:07.909899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3d759-5d60-4670-a21b-e237df0c39da admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:07.920800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384c766-41ff-4842-b0b9-60a66cb0d64e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:07.922864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384c766-41ff-4842-b0b9-60a66cb0d64e service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:07.923153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384c766-41ff-4842-b0b9-60a66cb0d64e service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:07.925546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384c766-41ff-4842-b0b9-60a66cb0d64e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:07.970851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384c766-41ff-4842-b0b9-60a66cb0d64e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:07.980454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384c766-41ff-4842-b0b9-60a66cb0d64e service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:08.013032 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1440/2846] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:29:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:29:08.423087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d93531-6682-41be-978a-5aa735cf8c0b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:08.431727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d8d93531-6682-41be-978a-5aa735cf8c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:08.439454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384c766-41ff-4842-b0b9-60a66cb0d64e service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:08.442139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a384c766-41ff-4842-b0b9-60a66cb0d64e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:08.547996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d93531-6682-41be-978a-5aa735cf8c0b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:08.564742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8cbf49-6ed7-40af-a9f7-1d43ac25de7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:08.566365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cbf49-6ed7-40af-a9f7-1d43ac25de7d service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:08.567206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cbf49-6ed7-40af-a9f7-1d43ac25de7d service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:08.567837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cbf49-6ed7-40af-a9f7-1d43ac25de7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:08.570428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5e8cbf49-6ed7-40af-a9f7-1d43ac25de7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:08.571366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:08.589233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8cbf49-6ed7-40af-a9f7-1d43ac25de7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:08.591451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8cbf49-6ed7-40af-a9f7-1d43ac25de7d service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:08.605668 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1407/2847] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:29:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:29:08.623591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384c766-41ff-4842-b0b9-60a66cb0d64e service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:08.642647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7de9f8-dc86-44f7-abc0-7594603022bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:08.643290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7de9f8-dc86-44f7-abc0-7594603022bf service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:08.643577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7de9f8-dc86-44f7-abc0-7594603022bf service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:08.643883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7de9f8-dc86-44f7-abc0-7594603022bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:08.820141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7de9f8-dc86-44f7-abc0-7594603022bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:08.822518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7de9f8-dc86-44f7-abc0-7594603022bf service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:08.841467 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1441/2848] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:29:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:29:09.037023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8cbf49-6ed7-40af-a9f7-1d43ac25de7d service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:09.038928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5e8cbf49-6ed7-40af-a9f7-1d43ac25de7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:09.058389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8cbf49-6ed7-40af-a9f7-1d43ac25de7d service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:09.064835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5ace2-44a2-4b1a-92b9-cf86ea25fe69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:09.066640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5ace2-44a2-4b1a-92b9-cf86ea25fe69 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:09.067128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5ace2-44a2-4b1a-92b9-cf86ea25fe69 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:09.067598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5ace2-44a2-4b1a-92b9-cf86ea25fe69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:09.071709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-68d5ace2-44a2-4b1a-92b9-cf86ea25fe69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:09.094456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5ace2-44a2-4b1a-92b9-cf86ea25fe69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:09.095918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5ace2-44a2-4b1a-92b9-cf86ea25fe69 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:09.101507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:09.110899 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1408/2849] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:29:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:29:09.135347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7de9f8-dc86-44f7-abc0-7594603022bf service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:09.147492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7de9f8-dc86-44f7-abc0-7594603022bf service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:09.154205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3fe5a-5f2d-48c2-96ad-b008b6492f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:09.154726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3fe5a-5f2d-48c2-96ad-b008b6492f8c service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:09.155013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3fe5a-5f2d-48c2-96ad-b008b6492f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:09.156610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3fe5a-5f2d-48c2-96ad-b008b6492f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:09.158206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5ac3fe5a-5f2d-48c2-96ad-b008b6492f8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:09.180650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3fe5a-5f2d-48c2-96ad-b008b6492f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:09.184347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3fe5a-5f2d-48c2-96ad-b008b6492f8c service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:09.195346 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1442/2850] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:29:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:29:11.800907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5ace2-44a2-4b1a-92b9-cf86ea25fe69 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:11.800907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-68d5ace2-44a2-4b1a-92b9-cf86ea25fe69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:11.831952 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5ace2-44a2-4b1a-92b9-cf86ea25fe69 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:11.846744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf2c58-d2c7-4649-b0e8-ae0f6352dafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:11.847680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf2c58-d2c7-4649-b0e8-ae0f6352dafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:11.848125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf2c58-d2c7-4649-b0e8-ae0f6352dafa admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:11.848559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf2c58-d2c7-4649-b0e8-ae0f6352dafa admin admin] PATH_INFO: `/v3/users/17b2717ace074a579d33c60964e6668a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:11.850768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf2c58-d2c7-4649-b0e8-ae0f6352dafa admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b2717ace074a579d33c60964e6668a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:11.853033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf2c58-d2c7-4649-b0e8-ae0f6352dafa admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:12.153536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-99bf2c58-d2c7-4649-b0e8-ae0f6352dafa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b2717ace074a579d33c60964e6668a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:12.155175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-99bf2c58-d2c7-4649-b0e8-ae0f6352dafa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b2717ace074a579d33c60964e6668a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:12.195345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-99bf2c58-d2c7-4649-b0e8-ae0f6352dafa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b2717ace074a579d33c60964e6668a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:12.238982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-99bf2c58-d2c7-4649-b0e8-ae0f6352dafa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b2717ace074a579d33c60964e6668a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:12.371809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-99bf2c58-d2c7-4649-b0e8-ae0f6352dafa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b2717ace074a579d33c60964e6668a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:12.392438 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1409/2851] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:29:11 2022] DELETE /identity/v3/users/17b2717ace074a579d33c60964e6668a => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:29:12.595775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e5acc-3ea6-4520-b895-294df8d889c1 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:12.596816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e5acc-3ea6-4520-b895-294df8d889c1 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:12.597792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e5acc-3ea6-4520-b895-294df8d889c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:12.652276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-929e5acc-3ea6-4520-b895-294df8d889c1 None None] MFA Rules not processed for user `421d14944da74570a53d620ea205449d`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:29:12.654724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-929e5acc-3ea6-4520-b895-294df8d889c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:12.824528 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1443/2852] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:29:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:29:13.657053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf2c58-d2c7-4649-b0e8-ae0f6352dafa admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:13.657053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-99bf2c58-d2c7-4649-b0e8-ae0f6352dafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:13.825524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf2c58-d2c7-4649-b0e8-ae0f6352dafa admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:13.840650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181effe-2551-4bbc-bd07-2a9ee1889e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:13.842176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181effe-2551-4bbc-bd07-2a9ee1889e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:13.846597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181effe-2551-4bbc-bd07-2a9ee1889e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:13.847533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181effe-2551-4bbc-bd07-2a9ee1889e39 admin admin] PATH_INFO: `/v3/projects/c3fc032a089f45efa4a66866a9c961c9` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:13.849174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181effe-2551-4bbc-bd07-2a9ee1889e39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3fc032a089f45efa4a66866a9c961c9)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:13.851670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181effe-2551-4bbc-bd07-2a9ee1889e39 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:14.039699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6181effe-2551-4bbc-bd07-2a9ee1889e39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3fc032a089f45efa4a66866a9c961c9', 'request_id': 'req-6181effe-2551-4bbc-bd07-2a9ee1889e39'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:14.139434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6181effe-2551-4bbc-bd07-2a9ee1889e39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3fc032a089f45efa4a66866a9c961c9', 'request_id': 'req-6181effe-2551-4bbc-bd07-2a9ee1889e39'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:14.154734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6181effe-2551-4bbc-bd07-2a9ee1889e39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3fc032a089f45efa4a66866a9c961c9', 'request_id': 'req-6181effe-2551-4bbc-bd07-2a9ee1889e39'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:14.169500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:14.209382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6181effe-2551-4bbc-bd07-2a9ee1889e39 admin admin] The token cache is being invalidate because project c3fc032a089f45efa4a66866a9c961c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:29:14.209382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6181effe-2551-4bbc-bd07-2a9ee1889e39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:14.209382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6181effe-2551-4bbc-bd07-2a9ee1889e39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:14.209382 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1410/2853] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:29:13 2022] DELETE /identity/v3/projects/c3fc032a089f45efa4a66866a9c961c9 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:29:14.213269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68427d-2553-4667-be24-94a86a960730 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:14.213668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68427d-2553-4667-be24-94a86a960730 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:14.213821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68427d-2553-4667-be24-94a86a960730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:14.248653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3f68427d-2553-4667-be24-94a86a960730 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:29:14.249887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3f68427d-2553-4667-be24-94a86a960730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:14.376628 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1444/2854] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:29:14.384204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ab06d-4ff7-4ae3-b6a7-3a22dd096417 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:14.384709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ab06d-4ff7-4ae3-b6a7-3a22dd096417 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:14.385144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ab06d-4ff7-4ae3-b6a7-3a22dd096417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:14.419385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-717ab06d-4ff7-4ae3-b6a7-3a22dd096417 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:29:14.423980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-717ab06d-4ff7-4ae3-b6a7-3a22dd096417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:14.445617 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1411/2855] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:29:14.446963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68427d-2553-4667-be24-94a86a960730 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:14.462715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68427d-2553-4667-be24-94a86a960730 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:14.474939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c827a-e876-4615-a983-6882ca0c6965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:14.476051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c827a-e876-4615-a983-6882ca0c6965 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:14.477183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c827a-e876-4615-a983-6882ca0c6965 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:14.477515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c827a-e876-4615-a983-6882ca0c6965 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:14.479272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c827a-e876-4615-a983-6882ca0c6965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:29:14.479773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c827a-e876-4615-a983-6882ca0c6965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:14.484930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c827a-e876-4615-a983-6882ca0c6965 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:14.520865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ab06d-4ff7-4ae3-b6a7-3a22dd096417 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:14.533295 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1445/2856] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:29:14.537573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ab06d-4ff7-4ae3-b6a7-3a22dd096417 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:14.558067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d7470-b315-468b-bce8-dffedb806067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:14.558758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d7470-b315-468b-bce8-dffedb806067 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:14.559875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d7470-b315-468b-bce8-dffedb806067 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:14.559875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d7470-b315-468b-bce8-dffedb806067 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:14.560169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d7470-b315-468b-bce8-dffedb806067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:14.570789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d7470-b315-468b-bce8-dffedb806067 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:14.701172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c827a-e876-4615-a983-6882ca0c6965 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:14.711344 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1412/2857] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:29:14 2022] POST /identity/v3/projects => generated 375 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:29:14.721496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c827a-e876-4615-a983-6882ca0c6965 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:14.772663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:14.922605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b346a2-2c02-48ca-b04b-ea3ec33938b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:14.925877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b346a2-2c02-48ca-b04b-ea3ec33938b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:14.925877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b346a2-2c02-48ca-b04b-ea3ec33938b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:14.925877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b346a2-2c02-48ca-b04b-ea3ec33938b3 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:14.926551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b346a2-2c02-48ca-b04b-ea3ec33938b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:14.928719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b346a2-2c02-48ca-b04b-ea3ec33938b3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:15.051486 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1446/2858] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:29:14 2022] POST /identity/v3/users => generated 288 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:29:15.055441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d7470-b315-468b-bce8-dffedb806067 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:15.079993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d7470-b315-468b-bce8-dffedb806067 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:15.089880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77388b7a-28b6-4d7c-8a5d-6ebe27edbeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:15.090865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77388b7a-28b6-4d7c-8a5d-6ebe27edbeb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:15.091135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77388b7a-28b6-4d7c-8a5d-6ebe27edbeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:15.091756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77388b7a-28b6-4d7c-8a5d-6ebe27edbeb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:15.092692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77388b7a-28b6-4d7c-8a5d-6ebe27edbeb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:15.097107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77388b7a-28b6-4d7c-8a5d-6ebe27edbeb2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:15.126877 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1413/2859] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:29:15.131704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b346a2-2c02-48ca-b04b-ea3ec33938b3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:15.149670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b346a2-2c02-48ca-b04b-ea3ec33938b3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:15.163478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ea1d0-574c-4a21-a89c-832ab21a416b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:15.164789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ea1d0-574c-4a21-a89c-832ab21a416b admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:15.164789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ea1d0-574c-4a21-a89c-832ab21a416b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:15.164789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ea1d0-574c-4a21-a89c-832ab21a416b admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:15.165352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ea1d0-574c-4a21-a89c-832ab21a416b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:15.169358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ea1d0-574c-4a21-a89c-832ab21a416b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:15.205737 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1447/2860] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:29:15.214473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77388b7a-28b6-4d7c-8a5d-6ebe27edbeb2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:15.231705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77388b7a-28b6-4d7c-8a5d-6ebe27edbeb2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:15.246648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed331907-4fc3-4ab6-b1a2-42e7431acb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:15.247728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed331907-4fc3-4ab6-b1a2-42e7431acb9e admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:15.249368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed331907-4fc3-4ab6-b1a2-42e7431acb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:15.249866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed331907-4fc3-4ab6-b1a2-42e7431acb9e admin admin] PATH_INFO: `/v3/projects/3e9ede68f63747d59153a46412033856/users/94897f20beb94dbd8e7eff6ecba30026/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:15.305251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed331907-4fc3-4ab6-b1a2-42e7431acb9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9ede68f63747d59153a46412033856, user_id=94897f20beb94dbd8e7eff6ecba30026, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:15.308115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed331907-4fc3-4ab6-b1a2-42e7431acb9e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:15.412697 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1414/2861] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:29:15 2022] PUT /identity/v3/projects/3e9ede68f63747d59153a46412033856/users/94897f20beb94dbd8e7eff6ecba30026/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:29:15.418580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40db500-2d45-4290-a912-3d2a5a943020 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:15.419433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40db500-2d45-4290-a912-3d2a5a943020 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:15.419433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40db500-2d45-4290-a912-3d2a5a943020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:15.497323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f40db500-2d45-4290-a912-3d2a5a943020 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:29:15.500203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f40db500-2d45-4290-a912-3d2a5a943020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:15.739527 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1448/2862] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:29:15.823571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed331907-4fc3-4ab6-b1a2-42e7431acb9e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:15.826520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ed331907-4fc3-4ab6-b1a2-42e7431acb9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:16.004209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed331907-4fc3-4ab6-b1a2-42e7431acb9e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:16.018714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c9199-08dd-4d44-a129-b314fb791f03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:16.024390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c9199-08dd-4d44-a129-b314fb791f03 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:16.024685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c9199-08dd-4d44-a129-b314fb791f03 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:16.024968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c9199-08dd-4d44-a129-b314fb791f03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:16.067359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c9199-08dd-4d44-a129-b314fb791f03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:16.075183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c9199-08dd-4d44-a129-b314fb791f03 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:16.114341 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1415/2863] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:29:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:29:18.676365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163870e2-dc51-410a-87e5-13a16bcb8aa9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:18.676862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163870e2-dc51-410a-87e5-13a16bcb8aa9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:18.677057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163870e2-dc51-410a-87e5-13a16bcb8aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:18.718581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-163870e2-dc51-410a-87e5-13a16bcb8aa9 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:29:18.719961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-163870e2-dc51-410a-87e5-13a16bcb8aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:18.855889 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1449/2864] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:29:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:29:18.889144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c9199-08dd-4d44-a129-b314fb791f03 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:18.891101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a41c9199-08dd-4d44-a129-b314fb791f03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:19.008058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c9199-08dd-4d44-a129-b314fb791f03 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:19.019852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a29ac-5414-45c5-a241-e560cc89a46b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:19.020383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a29ac-5414-45c5-a241-e560cc89a46b service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:19.020666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a29ac-5414-45c5-a241-e560cc89a46b service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:19.020956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a29ac-5414-45c5-a241-e560cc89a46b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:19.031832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a29ac-5414-45c5-a241-e560cc89a46b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:19.033556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a29ac-5414-45c5-a241-e560cc89a46b service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:19.044597 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1416/2865] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:29:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:29:20.435338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346ac14-b7b5-4e87-bad8-7a045c3e4992 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:20.435909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346ac14-b7b5-4e87-bad8-7a045c3e4992 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:20.436132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346ac14-b7b5-4e87-bad8-7a045c3e4992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:20.484540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1346ac14-b7b5-4e87-bad8-7a045c3e4992 None None] MFA Rules not processed for user `9ce351a48282492e8cd69b9a5a05f545`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:29:20.488307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1346ac14-b7b5-4e87-bad8-7a045c3e4992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:20.539989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:20.639521 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1450/2866] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:29:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:29:20.975744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a29ac-5414-45c5-a241-e560cc89a46b service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:20.978470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-763a29ac-5414-45c5-a241-e560cc89a46b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:21.040049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:21.153869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a29ac-5414-45c5-a241-e560cc89a46b service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:21.162853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffaa31-1791-44ec-8987-202f4af82029 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:21.163714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffaa31-1791-44ec-8987-202f4af82029 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:21.164467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffaa31-1791-44ec-8987-202f4af82029 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:21.164874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffaa31-1791-44ec-8987-202f4af82029 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:21.177710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffaa31-1791-44ec-8987-202f4af82029 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:21.192578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffaa31-1791-44ec-8987-202f4af82029 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:21.209050 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1417/2867] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:29:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:29:21.898502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec8cb8-f4ff-4da5-97f5-5a29f66c5609 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:21.898960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec8cb8-f4ff-4da5-97f5-5a29f66c5609 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:21.899089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec8cb8-f4ff-4da5-97f5-5a29f66c5609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:21.939177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-73ec8cb8-f4ff-4da5-97f5-5a29f66c5609 None None] MFA Rules not processed for user `1d6175f2ac39494f8cba3db225150d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:29:21.940477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-73ec8cb8-f4ff-4da5-97f5-5a29f66c5609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:22.072004 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1451/2868] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:29:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:29:27.654761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da3e9f-b0f6-47af-93f5-b6515189846b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:27.657080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da3e9f-b0f6-47af-93f5-b6515189846b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:27.657351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da3e9f-b0f6-47af-93f5-b6515189846b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:27.700762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-33da3e9f-b0f6-47af-93f5-b6515189846b None None] MFA Rules not processed for user `9ce351a48282492e8cd69b9a5a05f545`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:29:27.701960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-33da3e9f-b0f6-47af-93f5-b6515189846b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:27.741571 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1418/2869] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:29:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:29:30.777774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867012d-dd1a-437a-94f0-33f43d00a0cb None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:30.778430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867012d-dd1a-437a-94f0-33f43d00a0cb None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:30.778430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867012d-dd1a-437a-94f0-33f43d00a0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:30.826171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3867012d-dd1a-437a-94f0-33f43d00a0cb None None] MFA Rules not processed for user `94897f20beb94dbd8e7eff6ecba30026`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:29:30.827735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3867012d-dd1a-437a-94f0-33f43d00a0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:30.977995 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1452/2870] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:29:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:29:31.455083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da3e9f-b0f6-47af-93f5-b6515189846b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:31.457774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-33da3e9f-b0f6-47af-93f5-b6515189846b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:31.503850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da3e9f-b0f6-47af-93f5-b6515189846b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:31.522887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd67ede-f8cc-4fac-b885-f9a4b755b5de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:31.523535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd67ede-f8cc-4fac-b885-f9a4b755b5de service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:31.523818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd67ede-f8cc-4fac-b885-f9a4b755b5de service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:31.524095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd67ede-f8cc-4fac-b885-f9a4b755b5de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:31.544101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd67ede-f8cc-4fac-b885-f9a4b755b5de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:31.547214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd67ede-f8cc-4fac-b885-f9a4b755b5de service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:31.587931 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1419/2871] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:29:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:29:39.345763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c60506-91d4-439c-a93b-af725aa0dcc6 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:39.347639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c60506-91d4-439c-a93b-af725aa0dcc6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:39.348286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c60506-91d4-439c-a93b-af725aa0dcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:39.372449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-76c60506-91d4-439c-a93b-af725aa0dcc6 None None] MFA Rules not processed for user `94897f20beb94dbd8e7eff6ecba30026`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:29:39.374132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-76c60506-91d4-439c-a93b-af725aa0dcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:39.385999 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1453/2872] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:29:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:29:41.559988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=39 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:44.553382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd67ede-f8cc-4fac-b885-f9a4b755b5de service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:44.561140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1cd67ede-f8cc-4fac-b885-f9a4b755b5de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:44.587637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd67ede-f8cc-4fac-b885-f9a4b755b5de service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:44.593654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46112d1-544b-4c70-be76-f1da953d7f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:44.594703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46112d1-544b-4c70-be76-f1da953d7f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:44.595091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46112d1-544b-4c70-be76-f1da953d7f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:44.595537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46112d1-544b-4c70-be76-f1da953d7f0d admin admin] PATH_INFO: `/v3/users/071401bed74d48fe8ae2dbdb98aa81cc` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:44.597633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46112d1-544b-4c70-be76-f1da953d7f0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=071401bed74d48fe8ae2dbdb98aa81cc)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:44.599981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46112d1-544b-4c70-be76-f1da953d7f0d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:44.845877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e46112d1-544b-4c70-be76-f1da953d7f0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '071401bed74d48fe8ae2dbdb98aa81cc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:44.846693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e46112d1-544b-4c70-be76-f1da953d7f0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '071401bed74d48fe8ae2dbdb98aa81cc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:44.866376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e46112d1-544b-4c70-be76-f1da953d7f0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '071401bed74d48fe8ae2dbdb98aa81cc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:44.883658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e46112d1-544b-4c70-be76-f1da953d7f0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '071401bed74d48fe8ae2dbdb98aa81cc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:45.009018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e46112d1-544b-4c70-be76-f1da953d7f0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '071401bed74d48fe8ae2dbdb98aa81cc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:45.020946 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1420/2873] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:29:44 2022] DELETE /identity/v3/users/071401bed74d48fe8ae2dbdb98aa81cc => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:29:45.797795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c60506-91d4-439c-a93b-af725aa0dcc6 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:45.832205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c60506-91d4-439c-a93b-af725aa0dcc6 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:45.937188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:45.962157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87580be6-03f9-4394-bccc-c20489533c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:45.962576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87580be6-03f9-4394-bccc-c20489533c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:45.962871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87580be6-03f9-4394-bccc-c20489533c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:45.963136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87580be6-03f9-4394-bccc-c20489533c63 admin admin] PATH_INFO: `/v3/projects/16b0b534b9eb463aab0f13e838578da2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:45.964352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87580be6-03f9-4394-bccc-c20489533c63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16b0b534b9eb463aab0f13e838578da2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:45.966313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87580be6-03f9-4394-bccc-c20489533c63 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:46.169452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-87580be6-03f9-4394-bccc-c20489533c63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16b0b534b9eb463aab0f13e838578da2', 'request_id': 'req-87580be6-03f9-4394-bccc-c20489533c63'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:46.190196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-87580be6-03f9-4394-bccc-c20489533c63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16b0b534b9eb463aab0f13e838578da2', 'request_id': 'req-87580be6-03f9-4394-bccc-c20489533c63'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:46.209639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-87580be6-03f9-4394-bccc-c20489533c63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16b0b534b9eb463aab0f13e838578da2', 'request_id': 'req-87580be6-03f9-4394-bccc-c20489533c63'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:46.351653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-87580be6-03f9-4394-bccc-c20489533c63 admin admin] The token cache is being invalidate because project 16b0b534b9eb463aab0f13e838578da2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:29:46.351944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-87580be6-03f9-4394-bccc-c20489533c63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:46.352642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-87580be6-03f9-4394-bccc-c20489533c63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:29:46.354792 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1454/2874] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:29:45 2022] DELETE /identity/v3/projects/16b0b534b9eb463aab0f13e838578da2 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:29:46.359530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bc567-ccc6-4cea-82c0-72568cbea074 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:46.360054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bc567-ccc6-4cea-82c0-72568cbea074 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:46.360293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bc567-ccc6-4cea-82c0-72568cbea074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:46.391466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d14bc567-ccc6-4cea-82c0-72568cbea074 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:29:46.391466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d14bc567-ccc6-4cea-82c0-72568cbea074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:46.564734 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1421/2875] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:29:46.566843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a4d43-f747-4708-bbce-6fa26c92fd62 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:46.567780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a4d43-f747-4708-bbce-6fa26c92fd62 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:46.568326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a4d43-f747-4708-bbce-6fa26c92fd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:46.611855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e68a4d43-f747-4708-bbce-6fa26c92fd62 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:29:46.617832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e68a4d43-f747-4708-bbce-6fa26c92fd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:46.640894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bc567-ccc6-4cea-82c0-72568cbea074 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:46.647083 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1455/2876] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:29:46.661616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bc567-ccc6-4cea-82c0-72568cbea074 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:46.677440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200384c-f627-4c10-b3ab-8cd5bd11ebb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:46.680212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200384c-f627-4c10-b3ab-8cd5bd11ebb8 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:46.681389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200384c-f627-4c10-b3ab-8cd5bd11ebb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:46.681676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200384c-f627-4c10-b3ab-8cd5bd11ebb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:46.683097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200384c-f627-4c10-b3ab-8cd5bd11ebb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:29:46.683790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200384c-f627-4c10-b3ab-8cd5bd11ebb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:46.687131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200384c-f627-4c10-b3ab-8cd5bd11ebb8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:46.707003 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1422/2877] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:29:46.711267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a4d43-f747-4708-bbce-6fa26c92fd62 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:46.722566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a4d43-f747-4708-bbce-6fa26c92fd62 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:46.727652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025028ee-af87-4dc4-9593-aee10a91020f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:46.728385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025028ee-af87-4dc4-9593-aee10a91020f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:46.728734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025028ee-af87-4dc4-9593-aee10a91020f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:46.729072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025028ee-af87-4dc4-9593-aee10a91020f admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:46.729805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025028ee-af87-4dc4-9593-aee10a91020f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:46.731965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025028ee-af87-4dc4-9593-aee10a91020f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:47.024149 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1456/2878] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:29:46 2022] POST /identity/v3/projects => generated 399 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:29:47.026275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200384c-f627-4c10-b3ab-8cd5bd11ebb8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:47.040106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200384c-f627-4c10-b3ab-8cd5bd11ebb8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:47.164452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a7188-acae-4058-ba41-fc0cf5f7124c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:47.167173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a7188-acae-4058-ba41-fc0cf5f7124c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:47.167173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a7188-acae-4058-ba41-fc0cf5f7124c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:47.167411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a7188-acae-4058-ba41-fc0cf5f7124c admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:47.167894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a7188-acae-4058-ba41-fc0cf5f7124c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:47.170783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a7188-acae-4058-ba41-fc0cf5f7124c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:47.193593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:47.351047 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1423/2879] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:29:47 2022] POST /identity/v3/users => generated 300 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:29:47.354799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025028ee-af87-4dc4-9593-aee10a91020f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:47.376842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025028ee-af87-4dc4-9593-aee10a91020f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:47.392707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de72041-6e9d-41f6-8959-bcd0517c86bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:47.393686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de72041-6e9d-41f6-8959-bcd0517c86bb admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:47.394167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de72041-6e9d-41f6-8959-bcd0517c86bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:47.394617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de72041-6e9d-41f6-8959-bcd0517c86bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:47.395447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de72041-6e9d-41f6-8959-bcd0517c86bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:47.397229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de72041-6e9d-41f6-8959-bcd0517c86bb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:47.418019 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1457/2880] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:29:47.422249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a7188-acae-4058-ba41-fc0cf5f7124c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:47.439958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a7188-acae-4058-ba41-fc0cf5f7124c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:47.453940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a49ca1-84f8-4732-8c18-520dd7c1539a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:47.453940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a49ca1-84f8-4732-8c18-520dd7c1539a admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:47.453940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a49ca1-84f8-4732-8c18-520dd7c1539a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:47.453940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a49ca1-84f8-4732-8c18-520dd7c1539a admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:47.454453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a49ca1-84f8-4732-8c18-520dd7c1539a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:47.455433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a49ca1-84f8-4732-8c18-520dd7c1539a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:47.484383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de72041-6e9d-41f6-8959-bcd0517c86bb admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:47.484609 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1424/2881] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:29:47.500107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de72041-6e9d-41f6-8959-bcd0517c86bb admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:47.514167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ba501-436b-47f0-9719-75e6a5c430c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:47.515183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ba501-436b-47f0-9719-75e6a5c430c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:47.515634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ba501-436b-47f0-9719-75e6a5c430c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:47.516085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ba501-436b-47f0-9719-75e6a5c430c3 admin admin] PATH_INFO: `/v3/projects/561891c49901486c9d7651688f88b0eb/users/c3e64f7f0501454fa8474aa61c9a8c5b/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:47.552609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ba501-436b-47f0-9719-75e6a5c430c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=561891c49901486c9d7651688f88b0eb, user_id=c3e64f7f0501454fa8474aa61c9a8c5b, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:47.555720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ba501-436b-47f0-9719-75e6a5c430c3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:47.699572 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1458/2882] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:29:47 2022] PUT /identity/v3/projects/561891c49901486c9d7651688f88b0eb/users/c3e64f7f0501454fa8474aa61c9a8c5b/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:29:47.703996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc6153-5fa3-419a-88d9-81b2ec0364b6 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:47.705913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc6153-5fa3-419a-88d9-81b2ec0364b6 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:47.705913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc6153-5fa3-419a-88d9-81b2ec0364b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:47.760440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-20fc6153-5fa3-419a-88d9-81b2ec0364b6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:29:47.763162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-20fc6153-5fa3-419a-88d9-81b2ec0364b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:47.900893 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1425/2883] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:29:47.918794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ba501-436b-47f0-9719-75e6a5c430c3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:29:47.922641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-451ba501-436b-47f0-9719-75e6a5c430c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:48.057492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ba501-436b-47f0-9719-75e6a5c430c3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:29:48.063632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c044b2-de16-4517-8b44-c6938d79096f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:29:48.064286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c044b2-de16-4517-8b44-c6938d79096f service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:48.064779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c044b2-de16-4517-8b44-c6938d79096f service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:48.065060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c044b2-de16-4517-8b44-c6938d79096f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:48.097563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c044b2-de16-4517-8b44-c6938d79096f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:29:48.097990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c044b2-de16-4517-8b44-c6938d79096f service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:29:48.121582 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1459/2884] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:29:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:29:51.620564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab378b1-6af7-4c7d-b095-ca7895b36903 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:29:51.621391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab378b1-6af7-4c7d-b095-ca7895b36903 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:29:51.621823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab378b1-6af7-4c7d-b095-ca7895b36903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:29:51.644155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-7ab378b1-6af7-4c7d-b095-ca7895b36903 None None] MFA Rules not processed for user `421d14944da74570a53d620ea205449d`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:29:51.645799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7ab378b1-6af7-4c7d-b095-ca7895b36903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:29:51.724079 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1426/2885] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:29:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:29:58.111036 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:01.715094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:INSERT=3,keystone:SELECT=59 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:02.094370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351b8d4-e793-4cfc-9220-ed5581d70335 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:02.095172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351b8d4-e793-4cfc-9220-ed5581d70335 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:02.095468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351b8d4-e793-4cfc-9220-ed5581d70335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:02.166107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f351b8d4-e793-4cfc-9220-ed5581d70335 None None] MFA Rules not processed for user `c3e64f7f0501454fa8474aa61c9a8c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:30:02.168633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f351b8d4-e793-4cfc-9220-ed5581d70335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:02.255989 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1460/2886] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:30:02 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:30:02.266509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635b28f-6e6a-476b-aaf5-87894dafee8e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:02.267093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635b28f-6e6a-476b-aaf5-87894dafee8e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:02.267550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635b28f-6e6a-476b-aaf5-87894dafee8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:02.311132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5635b28f-6e6a-476b-aaf5-87894dafee8e None None] MFA Rules not processed for user `c3e64f7f0501454fa8474aa61c9a8c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:30:02.313211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5635b28f-6e6a-476b-aaf5-87894dafee8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:02.336265 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1427/2887] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:30:02 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:30:02.365281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351b8d4-e793-4cfc-9220-ed5581d70335 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:02.367018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f351b8d4-e793-4cfc-9220-ed5581d70335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:02.463011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351b8d4-e793-4cfc-9220-ed5581d70335 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:02.469857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95eff4-ff03-4b11-98ee-c98f5380e9ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:02.470694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95eff4-ff03-4b11-98ee-c98f5380e9ca service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:02.471163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95eff4-ff03-4b11-98ee-c98f5380e9ca service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:02.471621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95eff4-ff03-4b11-98ee-c98f5380e9ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:02.482778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95eff4-ff03-4b11-98ee-c98f5380e9ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:02.484850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95eff4-ff03-4b11-98ee-c98f5380e9ca service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:02.510022 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1461/2888] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:30:02 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:30:06.036530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635b28f-6e6a-476b-aaf5-87894dafee8e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:06.054643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635b28f-6e6a-476b-aaf5-87894dafee8e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:06.058918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5c87c-e131-4c36-b865-57009b6e4607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:06.059604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5c87c-e131-4c36-b865-57009b6e4607 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:06.059825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5c87c-e131-4c36-b865-57009b6e4607 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:06.060104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5c87c-e131-4c36-b865-57009b6e4607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:06.062090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-40e5c87c-e131-4c36-b865-57009b6e4607 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:06.108222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5c87c-e131-4c36-b865-57009b6e4607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:06.110321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5c87c-e131-4c36-b865-57009b6e4607 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:06.129184 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1428/2889] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:30:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:30:12.491426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=66 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:16.120150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=9 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:20.055492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95eff4-ff03-4b11-98ee-c98f5380e9ca service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:20.056942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3d95eff4-ff03-4b11-98ee-c98f5380e9ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:20.086940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95eff4-ff03-4b11-98ee-c98f5380e9ca service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:20.105673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7aa4da-34e1-4980-9bd0-494163d7eef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:20.106567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7aa4da-34e1-4980-9bd0-494163d7eef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:20.107010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7aa4da-34e1-4980-9bd0-494163d7eef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:20.110211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7aa4da-34e1-4980-9bd0-494163d7eef0 admin admin] PATH_INFO: `/v3/users/1d6175f2ac39494f8cba3db225150d6c` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:20.114135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7aa4da-34e1-4980-9bd0-494163d7eef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d6175f2ac39494f8cba3db225150d6c)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:20.126391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7aa4da-34e1-4980-9bd0-494163d7eef0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:20.430871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1b7aa4da-34e1-4980-9bd0-494163d7eef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d6175f2ac39494f8cba3db225150d6c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:20.431562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1b7aa4da-34e1-4980-9bd0-494163d7eef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d6175f2ac39494f8cba3db225150d6c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:20.448389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1b7aa4da-34e1-4980-9bd0-494163d7eef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d6175f2ac39494f8cba3db225150d6c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:20.466687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1b7aa4da-34e1-4980-9bd0-494163d7eef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d6175f2ac39494f8cba3db225150d6c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:20.468360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1b7aa4da-34e1-4980-9bd0-494163d7eef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d6175f2ac39494f8cba3db225150d6c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:20.544277 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1462/2890] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:30:20 2022] DELETE /identity/v3/users/1d6175f2ac39494f8cba3db225150d6c => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:30:21.114550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5c87c-e131-4c36-b865-57009b6e4607 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:21.138802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5c87c-e131-4c36-b865-57009b6e4607 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:21.208235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58e411-be78-4636-b56c-75c2da029ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:21.213970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58e411-be78-4636-b56c-75c2da029ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:21.213970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58e411-be78-4636-b56c-75c2da029ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:21.213970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58e411-be78-4636-b56c-75c2da029ab9 admin admin] PATH_INFO: `/v3/projects/ae78c307a1504172828e668f915a3677` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:21.213970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58e411-be78-4636-b56c-75c2da029ab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae78c307a1504172828e668f915a3677)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:21.213970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58e411-be78-4636-b56c-75c2da029ab9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:21.423581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fc58e411-be78-4636-b56c-75c2da029ab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae78c307a1504172828e668f915a3677', 'request_id': 'req-fc58e411-be78-4636-b56c-75c2da029ab9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:21.522839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fc58e411-be78-4636-b56c-75c2da029ab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae78c307a1504172828e668f915a3677', 'request_id': 'req-fc58e411-be78-4636-b56c-75c2da029ab9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:21.536244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fc58e411-be78-4636-b56c-75c2da029ab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae78c307a1504172828e668f915a3677', 'request_id': 'req-fc58e411-be78-4636-b56c-75c2da029ab9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:21.550202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fc58e411-be78-4636-b56c-75c2da029ab9 admin admin] The token cache is being invalidate because project ae78c307a1504172828e668f915a3677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:30:21.550699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fc58e411-be78-4636-b56c-75c2da029ab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:21.551474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fc58e411-be78-4636-b56c-75c2da029ab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:21.553292 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1429/2891] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:30:21 2022] DELETE /identity/v3/projects/ae78c307a1504172828e668f915a3677 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:30:21.558364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c047d-cd9d-4b0c-91d4-638efc9624b5 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:21.558871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c047d-cd9d-4b0c-91d4-638efc9624b5 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:21.559138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c047d-cd9d-4b0c-91d4-638efc9624b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:21.587516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e39c047d-cd9d-4b0c-91d4-638efc9624b5 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:30:21.589165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e39c047d-cd9d-4b0c-91d4-638efc9624b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:21.653141 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1463/2892] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:30:21.661069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb795aa2-6e31-4d6b-8dae-8a4a922d211a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:21.661535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb795aa2-6e31-4d6b-8dae-8a4a922d211a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:21.661878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb795aa2-6e31-4d6b-8dae-8a4a922d211a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:21.710724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-cb795aa2-6e31-4d6b-8dae-8a4a922d211a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:30:21.714222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cb795aa2-6e31-4d6b-8dae-8a4a922d211a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:21.742668 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1430/2893] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:30:21.743257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c047d-cd9d-4b0c-91d4-638efc9624b5 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:21.757442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c047d-cd9d-4b0c-91d4-638efc9624b5 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:21.780458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f570d-55be-4454-b3ca-ff32ae0abe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:21.782411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f570d-55be-4454-b3ca-ff32ae0abe7b admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:21.783498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f570d-55be-4454-b3ca-ff32ae0abe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:21.788784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f570d-55be-4454-b3ca-ff32ae0abe7b admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:21.789745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f570d-55be-4454-b3ca-ff32ae0abe7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:30:21.790168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f570d-55be-4454-b3ca-ff32ae0abe7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:21.792517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f570d-55be-4454-b3ca-ff32ae0abe7b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:21.811254 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1464/2894] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:30:21.816414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb795aa2-6e31-4d6b-8dae-8a4a922d211a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:21.830350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb795aa2-6e31-4d6b-8dae-8a4a922d211a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:21.837809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08388bc-d64b-45fe-85b8-b278b127bda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:21.838715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08388bc-d64b-45fe-85b8-b278b127bda8 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:21.839193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08388bc-d64b-45fe-85b8-b278b127bda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:21.839886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08388bc-d64b-45fe-85b8-b278b127bda8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:21.840908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08388bc-d64b-45fe-85b8-b278b127bda8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:21.843061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08388bc-d64b-45fe-85b8-b278b127bda8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:21.994196 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1431/2895] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:30:21 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:30:21.998371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f570d-55be-4454-b3ca-ff32ae0abe7b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:22.010965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f570d-55be-4454-b3ca-ff32ae0abe7b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:22.105265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5ea68-49f3-4857-90c9-8178f3315619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:22.106452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5ea68-49f3-4857-90c9-8178f3315619 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:22.106890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5ea68-49f3-4857-90c9-8178f3315619 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:22.107242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5ea68-49f3-4857-90c9-8178f3315619 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:22.107938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5ea68-49f3-4857-90c9-8178f3315619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:22.110267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5ea68-49f3-4857-90c9-8178f3315619 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:22.120992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:22.270093 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1465/2896] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:30:21 2022] POST /identity/v3/users => generated 292 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:30:22.274435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08388bc-d64b-45fe-85b8-b278b127bda8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:22.288918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08388bc-d64b-45fe-85b8-b278b127bda8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:22.301697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee23b7-027e-47d1-9442-232654bdf60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:22.301697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee23b7-027e-47d1-9442-232654bdf60d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:22.301697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee23b7-027e-47d1-9442-232654bdf60d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:22.301697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee23b7-027e-47d1-9442-232654bdf60d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:22.302175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee23b7-027e-47d1-9442-232654bdf60d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:22.302728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee23b7-027e-47d1-9442-232654bdf60d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:22.313915 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1432/2897] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:30:22.317721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5ea68-49f3-4857-90c9-8178f3315619 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:22.332817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5ea68-49f3-4857-90c9-8178f3315619 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:22.338175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c5640-0f3f-4950-b1cc-85e1c3430a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:22.338894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c5640-0f3f-4950-b1cc-85e1c3430a3f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:22.339276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c5640-0f3f-4950-b1cc-85e1c3430a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:22.339651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c5640-0f3f-4950-b1cc-85e1c3430a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:22.340437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c5640-0f3f-4950-b1cc-85e1c3430a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:22.342315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c5640-0f3f-4950-b1cc-85e1c3430a3f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:22.356448 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1466/2898] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:30:22.360684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee23b7-027e-47d1-9442-232654bdf60d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:22.377053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee23b7-027e-47d1-9442-232654bdf60d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:22.383031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361fa2bc-a47e-42a2-9b4b-02891b6f87ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:22.383713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361fa2bc-a47e-42a2-9b4b-02891b6f87ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:22.383997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361fa2bc-a47e-42a2-9b4b-02891b6f87ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:22.384276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361fa2bc-a47e-42a2-9b4b-02891b6f87ea admin admin] PATH_INFO: `/v3/projects/ccd0392257a0419dbfa569c8816ece2b/users/42cd1938c86a4f389a2ec0fba9beff36/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:22.400279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361fa2bc-a47e-42a2-9b4b-02891b6f87ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd0392257a0419dbfa569c8816ece2b, user_id=42cd1938c86a4f389a2ec0fba9beff36, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:22.403184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361fa2bc-a47e-42a2-9b4b-02891b6f87ea admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:22.524000 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1433/2899] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:30:22 2022] PUT /identity/v3/projects/ccd0392257a0419dbfa569c8816ece2b/users/42cd1938c86a4f389a2ec0fba9beff36/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:30:22.525379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ec247-89c5-44e0-968a-96376ed4e723 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:22.525670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ec247-89c5-44e0-968a-96376ed4e723 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:22.525949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ec247-89c5-44e0-968a-96376ed4e723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:22.627580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-876ec247-89c5-44e0-968a-96376ed4e723 None None] MFA Rules not processed for user `42cd1938c86a4f389a2ec0fba9beff36`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:30:22.631213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-876ec247-89c5-44e0-968a-96376ed4e723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:22.778860 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1467/2900] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:30:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:30:22.787102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efca98-0c00-4098-a169-15fbc1a1af2e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:22.787383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efca98-0c00-4098-a169-15fbc1a1af2e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:22.787659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efca98-0c00-4098-a169-15fbc1a1af2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:22.814545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-99efca98-0c00-4098-a169-15fbc1a1af2e None None] MFA Rules not processed for user `42cd1938c86a4f389a2ec0fba9beff36`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:30:22.817679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-99efca98-0c00-4098-a169-15fbc1a1af2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:22.834396 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1434/2901] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:30:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:30:23.256639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ec247-89c5-44e0-968a-96376ed4e723 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:23.258310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-876ec247-89c5-44e0-968a-96376ed4e723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:23.349268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ec247-89c5-44e0-968a-96376ed4e723 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:23.356192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b9483-872c-4f13-864b-c8d73f3b668d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:23.356808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b9483-872c-4f13-864b-c8d73f3b668d service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:23.357638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b9483-872c-4f13-864b-c8d73f3b668d service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:23.357920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b9483-872c-4f13-864b-c8d73f3b668d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:23.367465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b9483-872c-4f13-864b-c8d73f3b668d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:23.369113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b9483-872c-4f13-864b-c8d73f3b668d service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:23.379257 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1468/2902] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:30:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:30:29.903211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efca98-0c00-4098-a169-15fbc1a1af2e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:29.904976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-99efca98-0c00-4098-a169-15fbc1a1af2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:29.975569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:30.051536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b9483-872c-4f13-864b-c8d73f3b668d service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:30.057581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3b7b9483-872c-4f13-864b-c8d73f3b668d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:30.172245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efca98-0c00-4098-a169-15fbc1a1af2e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:30.202866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dc34a-0f29-4a3e-aab4-6a0111765895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:30.207488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dc34a-0f29-4a3e-aab4-6a0111765895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:30.208118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dc34a-0f29-4a3e-aab4-6a0111765895 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:30.208896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dc34a-0f29-4a3e-aab4-6a0111765895 admin admin] PATH_INFO: `/v3/users/c13e05e253c94aadb1c089128ff35be5` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:30.211499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1dc34a-0f29-4a3e-aab4-6a0111765895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c13e05e253c94aadb1c089128ff35be5)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:30.226396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1dc34a-0f29-4a3e-aab4-6a0111765895 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:30.229927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b9483-872c-4f13-864b-c8d73f3b668d service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:30.244136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefc3f4-b55c-4a3b-8410-0d8853fb09c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:30.244622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefc3f4-b55c-4a3b-8410-0d8853fb09c4 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:30.244980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefc3f4-b55c-4a3b-8410-0d8853fb09c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:30.245403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefc3f4-b55c-4a3b-8410-0d8853fb09c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:30.247719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4cefc3f4-b55c-4a3b-8410-0d8853fb09c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:30.264577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:30.268621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefc3f4-b55c-4a3b-8410-0d8853fb09c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:30.271348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefc3f4-b55c-4a3b-8410-0d8853fb09c4 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:30.288509 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1469/2903] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:30:30.525296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-de1dc34a-0f29-4a3e-aab4-6a0111765895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c13e05e253c94aadb1c089128ff35be5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:30.526772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-de1dc34a-0f29-4a3e-aab4-6a0111765895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c13e05e253c94aadb1c089128ff35be5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:30.548072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-de1dc34a-0f29-4a3e-aab4-6a0111765895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c13e05e253c94aadb1c089128ff35be5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:30.569862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-de1dc34a-0f29-4a3e-aab4-6a0111765895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c13e05e253c94aadb1c089128ff35be5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:30.731678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-de1dc34a-0f29-4a3e-aab4-6a0111765895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c13e05e253c94aadb1c089128ff35be5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:30.752934 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1435/2904] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:30:29 2022] DELETE /identity/v3/users/c13e05e253c94aadb1c089128ff35be5 => generated 0 bytes in 838 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:30:30.756106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b9608-ce5a-4d19-8289-fed77860ade6 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:30.767569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b9608-ce5a-4d19-8289-fed77860ade6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:30.770150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b9608-ce5a-4d19-8289-fed77860ade6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:30.797999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-625b9608-ce5a-4d19-8289-fed77860ade6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:30:30.801711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-625b9608-ce5a-4d19-8289-fed77860ade6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:30.915660 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1470/2905] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:30:30.947378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dc34a-0f29-4a3e-aab4-6a0111765895 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:30.949180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-de1dc34a-0f29-4a3e-aab4-6a0111765895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:31.054184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dc34a-0f29-4a3e-aab4-6a0111765895 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:31.060183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5d5c6-22d0-4408-bdb9-4a4705cfd459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:31.061177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5d5c6-22d0-4408-bdb9-4a4705cfd459 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:31.061297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5d5c6-22d0-4408-bdb9-4a4705cfd459 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:31.061685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5d5c6-22d0-4408-bdb9-4a4705cfd459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:31.077565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5d5c6-22d0-4408-bdb9-4a4705cfd459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:31.079633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5d5c6-22d0-4408-bdb9-4a4705cfd459 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:31.092549 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1436/2906] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:30:32.492573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b9608-ce5a-4d19-8289-fed77860ade6 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:32.495140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-625b9608-ce5a-4d19-8289-fed77860ade6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:32.516836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b9608-ce5a-4d19-8289-fed77860ade6 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:32.528001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e0c2c-2e48-492f-b567-d040509177f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:32.532447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e0c2c-2e48-492f-b567-d040509177f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:32.535557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e0c2c-2e48-492f-b567-d040509177f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:32.535557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e0c2c-2e48-492f-b567-d040509177f2 admin admin] PATH_INFO: `/v3/projects/2c8510a519f14deea6f35a437419e161` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:32.540152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e0c2c-2e48-492f-b567-d040509177f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c8510a519f14deea6f35a437419e161)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:32.547776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e0c2c-2e48-492f-b567-d040509177f2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:32.729549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-169e0c2c-2e48-492f-b567-d040509177f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c8510a519f14deea6f35a437419e161', 'request_id': 'req-169e0c2c-2e48-492f-b567-d040509177f2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:32.737299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-169e0c2c-2e48-492f-b567-d040509177f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c8510a519f14deea6f35a437419e161', 'request_id': 'req-169e0c2c-2e48-492f-b567-d040509177f2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:32.752595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-169e0c2c-2e48-492f-b567-d040509177f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c8510a519f14deea6f35a437419e161', 'request_id': 'req-169e0c2c-2e48-492f-b567-d040509177f2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:32.854430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-169e0c2c-2e48-492f-b567-d040509177f2 admin admin] The token cache is being invalidate because project 2c8510a519f14deea6f35a437419e161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:30:32.854965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-169e0c2c-2e48-492f-b567-d040509177f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:32.857265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-169e0c2c-2e48-492f-b567-d040509177f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:32.890584 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1471/2907] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:30:32 2022] DELETE /identity/v3/projects/2c8510a519f14deea6f35a437419e161 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:30:32.898186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5d5c6-22d0-4408-bdb9-4a4705cfd459 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:32.952211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5d5c6-22d0-4408-bdb9-4a4705cfd459 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:33.073469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:33.099488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafbc52-5823-4526-bf0a-ea461ec161c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:33.100456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafbc52-5823-4526-bf0a-ea461ec161c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:33.104376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafbc52-5823-4526-bf0a-ea461ec161c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:33.104870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafbc52-5823-4526-bf0a-ea461ec161c0 admin admin] PATH_INFO: `/v3/users/438be975095541f5860849f8ed01af51` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:33.106480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eafbc52-5823-4526-bf0a-ea461ec161c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=438be975095541f5860849f8ed01af51)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:33.108623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eafbc52-5823-4526-bf0a-ea461ec161c0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:33.363627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4eafbc52-5823-4526-bf0a-ea461ec161c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '438be975095541f5860849f8ed01af51'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:33.369162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4eafbc52-5823-4526-bf0a-ea461ec161c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '438be975095541f5860849f8ed01af51'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:33.387538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4eafbc52-5823-4526-bf0a-ea461ec161c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '438be975095541f5860849f8ed01af51'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:33.430705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4eafbc52-5823-4526-bf0a-ea461ec161c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '438be975095541f5860849f8ed01af51'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:33.514871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4eafbc52-5823-4526-bf0a-ea461ec161c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '438be975095541f5860849f8ed01af51'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:33.529658 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1437/2908] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:30:32 2022] DELETE /identity/v3/users/438be975095541f5860849f8ed01af51 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:30:35.108026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e0c2c-2e48-492f-b567-d040509177f2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:35.109865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-169e0c2c-2e48-492f-b567-d040509177f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:35.174025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e0c2c-2e48-492f-b567-d040509177f2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:35.319213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdd6d8-49ca-4b0b-8255-829f61ee7a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:35.319925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdd6d8-49ca-4b0b-8255-829f61ee7a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:35.320975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdd6d8-49ca-4b0b-8255-829f61ee7a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:35.321666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdd6d8-49ca-4b0b-8255-829f61ee7a55 admin admin] PATH_INFO: `/v3/projects/cec0773722a6496381499feb8801a027` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:35.327859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bdd6d8-49ca-4b0b-8255-829f61ee7a55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cec0773722a6496381499feb8801a027)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:35.334117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bdd6d8-49ca-4b0b-8255-829f61ee7a55 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:35.379284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:35.503792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c1bdd6d8-49ca-4b0b-8255-829f61ee7a55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cec0773722a6496381499feb8801a027', 'request_id': 'req-c1bdd6d8-49ca-4b0b-8255-829f61ee7a55'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:35.519227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c1bdd6d8-49ca-4b0b-8255-829f61ee7a55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cec0773722a6496381499feb8801a027', 'request_id': 'req-c1bdd6d8-49ca-4b0b-8255-829f61ee7a55'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:35.540426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c1bdd6d8-49ca-4b0b-8255-829f61ee7a55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cec0773722a6496381499feb8801a027', 'request_id': 'req-c1bdd6d8-49ca-4b0b-8255-829f61ee7a55'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:35.673456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c1bdd6d8-49ca-4b0b-8255-829f61ee7a55 admin admin] The token cache is being invalidate because project cec0773722a6496381499feb8801a027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:30:35.674185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c1bdd6d8-49ca-4b0b-8255-829f61ee7a55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:35.675765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c1bdd6d8-49ca-4b0b-8255-829f61ee7a55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:35.678880 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1472/2909] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:30:35 2022] DELETE /identity/v3/projects/cec0773722a6496381499feb8801a027 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:30:35.685313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f42222-0f3f-4403-9cb9-0c68199445df None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:35.685764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f42222-0f3f-4403-9cb9-0c68199445df None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:35.685863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f42222-0f3f-4403-9cb9-0c68199445df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:35.749131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-19f42222-0f3f-4403-9cb9-0c68199445df None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:30:35.750552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-19f42222-0f3f-4403-9cb9-0c68199445df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:35.914876 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1438/2910] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:30:35.924506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2304f0-5a9f-431f-8898-023a720f8269 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:35.925584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2304f0-5a9f-431f-8898-023a720f8269 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:35.926011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2304f0-5a9f-431f-8898-023a720f8269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:35.965709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6a2304f0-5a9f-431f-8898-023a720f8269 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:30:35.968616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6a2304f0-5a9f-431f-8898-023a720f8269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:35.984333 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1473/2911] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:30:35.985796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f42222-0f3f-4403-9cb9-0c68199445df None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:36.001385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f42222-0f3f-4403-9cb9-0c68199445df None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:36.016093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b5b51-e47a-4f2d-b7c6-a1386732e018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:36.018879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b5b51-e47a-4f2d-b7c6-a1386732e018 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:36.019487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b5b51-e47a-4f2d-b7c6-a1386732e018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:36.019967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b5b51-e47a-4f2d-b7c6-a1386732e018 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:36.020835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b5b51-e47a-4f2d-b7c6-a1386732e018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:30:36.021608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b5b51-e47a-4f2d-b7c6-a1386732e018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:36.023660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b5b51-e47a-4f2d-b7c6-a1386732e018 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:36.047320 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1439/2912] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:30:36.052153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2304f0-5a9f-431f-8898-023a720f8269 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:36.067211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2304f0-5a9f-431f-8898-023a720f8269 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:36.085756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86027c-95e8-4a2f-8ca0-d812a55f8176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:36.089056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86027c-95e8-4a2f-8ca0-d812a55f8176 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:36.089440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86027c-95e8-4a2f-8ca0-d812a55f8176 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:36.090165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86027c-95e8-4a2f-8ca0-d812a55f8176 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:36.096397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86027c-95e8-4a2f-8ca0-d812a55f8176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:36.096397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86027c-95e8-4a2f-8ca0-d812a55f8176 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:36.276217 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1474/2913] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:30:36 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:30:36.277643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b5b51-e47a-4f2d-b7c6-a1386732e018 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:36.299605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b5b51-e47a-4f2d-b7c6-a1386732e018 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:36.453395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:36.478883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d6a86-cd3d-4910-b83f-c15bb32f8561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:36.479935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d6a86-cd3d-4910-b83f-c15bb32f8561 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:36.480438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d6a86-cd3d-4910-b83f-c15bb32f8561 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:36.480933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d6a86-cd3d-4910-b83f-c15bb32f8561 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:36.482545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d6a86-cd3d-4910-b83f-c15bb32f8561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:36.485187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d6a86-cd3d-4910-b83f-c15bb32f8561 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:36.657820 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1440/2914] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:30:36 2022] POST /identity/v3/users => generated 293 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:30:36.662331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86027c-95e8-4a2f-8ca0-d812a55f8176 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:36.679433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86027c-95e8-4a2f-8ca0-d812a55f8176 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:36.707200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e5d94-f705-449e-8794-a47c1d4a6f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:36.708303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e5d94-f705-449e-8794-a47c1d4a6f0a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:36.708792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e5d94-f705-449e-8794-a47c1d4a6f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:36.709272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e5d94-f705-449e-8794-a47c1d4a6f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:36.712578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e5d94-f705-449e-8794-a47c1d4a6f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:36.730365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e5d94-f705-449e-8794-a47c1d4a6f0a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:36.759193 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1475/2915] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:30:36.759946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d6a86-cd3d-4910-b83f-c15bb32f8561 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:36.777324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d6a86-cd3d-4910-b83f-c15bb32f8561 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:36.788318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b99e9-a6a7-4567-bb8a-d96611d0e12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:36.789104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b99e9-a6a7-4567-bb8a-d96611d0e12a admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:36.790485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b99e9-a6a7-4567-bb8a-d96611d0e12a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:36.792117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b99e9-a6a7-4567-bb8a-d96611d0e12a admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:36.793061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b99e9-a6a7-4567-bb8a-d96611d0e12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:36.795272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b99e9-a6a7-4567-bb8a-d96611d0e12a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:36.831850 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1441/2916] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:30:36.836547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e5d94-f705-449e-8794-a47c1d4a6f0a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:36.860683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e5d94-f705-449e-8794-a47c1d4a6f0a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:36.878868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf812c8-d73f-498d-99cc-0e2a508d49eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:36.879558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf812c8-d73f-498d-99cc-0e2a508d49eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:36.879839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf812c8-d73f-498d-99cc-0e2a508d49eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:36.880120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf812c8-d73f-498d-99cc-0e2a508d49eb admin admin] PATH_INFO: `/v3/projects/f5ee48e200624711b629a12b20c7d282/users/ed44bf20b3464a53a3e3f6c9cd61cde3/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:36.922950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf812c8-d73f-498d-99cc-0e2a508d49eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ee48e200624711b629a12b20c7d282, user_id=ed44bf20b3464a53a3e3f6c9cd61cde3, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:36.926814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf812c8-d73f-498d-99cc-0e2a508d49eb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:37.077062 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1476/2917] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:30:36 2022] PUT /identity/v3/projects/f5ee48e200624711b629a12b20c7d282/users/ed44bf20b3464a53a3e3f6c9cd61cde3/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:30:37.082058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07aead7-f4f4-414b-ac1f-56c87dba0c3f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:37.082666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07aead7-f4f4-414b-ac1f-56c87dba0c3f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:37.083164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07aead7-f4f4-414b-ac1f-56c87dba0c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:37.131072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c07aead7-f4f4-414b-ac1f-56c87dba0c3f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:30:37.139036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c07aead7-f4f4-414b-ac1f-56c87dba0c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:37.326330 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1442/2918] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:30:37.356582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf812c8-d73f-498d-99cc-0e2a508d49eb admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:37.363639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4bf812c8-d73f-498d-99cc-0e2a508d49eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:37.484412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf812c8-d73f-498d-99cc-0e2a508d49eb admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:37.489641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ef53d-a142-462f-b660-f61552014464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:37.490332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ef53d-a142-462f-b660-f61552014464 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:37.490614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ef53d-a142-462f-b660-f61552014464 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:37.490887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ef53d-a142-462f-b660-f61552014464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:37.514973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ef53d-a142-462f-b660-f61552014464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:37.516511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ef53d-a142-462f-b660-f61552014464 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:37.563616 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1477/2919] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:30:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:30:41.709840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07aead7-f4f4-414b-ac1f-56c87dba0c3f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:41.711393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c07aead7-f4f4-414b-ac1f-56c87dba0c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:41.808508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ef53d-a142-462f-b660-f61552014464 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:41.810913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2e4ef53d-a142-462f-b660-f61552014464 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:41.838331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ef53d-a142-462f-b660-f61552014464 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:41.840724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07aead7-f4f4-414b-ac1f-56c87dba0c3f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:41.855420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e5c21-b897-47f5-8dba-39669c8372af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:41.859487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e5c21-b897-47f5-8dba-39669c8372af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:41.859664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822fec93-f3fd-4788-b744-7edecbe0225e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:41.860452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fec93-f3fd-4788-b744-7edecbe0225e service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:41.861149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e5c21-b897-47f5-8dba-39669c8372af admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:41.862672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e5c21-b897-47f5-8dba-39669c8372af admin admin] PATH_INFO: `/v3/users/c3e64f7f0501454fa8474aa61c9a8c5b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:41.863705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fec93-f3fd-4788-b744-7edecbe0225e service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:41.864979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fec93-f3fd-4788-b744-7edecbe0225e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:41.871987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e5c21-b897-47f5-8dba-39669c8372af admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3e64f7f0501454fa8474aa61c9a8c5b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:41.876429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-822fec93-f3fd-4788-b744-7edecbe0225e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:41.878810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e5c21-b897-47f5-8dba-39669c8372af admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:41.927787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822fec93-f3fd-4788-b744-7edecbe0225e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:41.931264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822fec93-f3fd-4788-b744-7edecbe0225e service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:42.001261 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1443/2920] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:30:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:30:42.228024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:42.241249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-998e5c21-b897-47f5-8dba-39669c8372af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3e64f7f0501454fa8474aa61c9a8c5b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:42.241965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-998e5c21-b897-47f5-8dba-39669c8372af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3e64f7f0501454fa8474aa61c9a8c5b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:42.254814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-998e5c21-b897-47f5-8dba-39669c8372af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3e64f7f0501454fa8474aa61c9a8c5b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:42.290400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-998e5c21-b897-47f5-8dba-39669c8372af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3e64f7f0501454fa8474aa61c9a8c5b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:42.291006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-998e5c21-b897-47f5-8dba-39669c8372af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3e64f7f0501454fa8474aa61c9a8c5b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:42.526711 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1478/2921] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:30:41 2022] DELETE /identity/v3/users/c3e64f7f0501454fa8474aa61c9a8c5b => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:30:44.558943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822fec93-f3fd-4788-b744-7edecbe0225e service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:44.575404 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822fec93-f3fd-4788-b744-7edecbe0225e service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:44.704930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:44.718639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88de4bf-dc87-4090-b930-76470ece3c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:44.719529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88de4bf-dc87-4090-b930-76470ece3c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:44.719955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88de4bf-dc87-4090-b930-76470ece3c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:44.720432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88de4bf-dc87-4090-b930-76470ece3c76 admin admin] PATH_INFO: `/v3/projects/561891c49901486c9d7651688f88b0eb` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:44.722763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88de4bf-dc87-4090-b930-76470ece3c76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=561891c49901486c9d7651688f88b0eb)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:44.725497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88de4bf-dc87-4090-b930-76470ece3c76 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:44.946555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a88de4bf-dc87-4090-b930-76470ece3c76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '561891c49901486c9d7651688f88b0eb', 'request_id': 'req-a88de4bf-dc87-4090-b930-76470ece3c76'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:45.041253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a88de4bf-dc87-4090-b930-76470ece3c76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '561891c49901486c9d7651688f88b0eb', 'request_id': 'req-a88de4bf-dc87-4090-b930-76470ece3c76'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:45.057903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a88de4bf-dc87-4090-b930-76470ece3c76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '561891c49901486c9d7651688f88b0eb', 'request_id': 'req-a88de4bf-dc87-4090-b930-76470ece3c76'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:45.113610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a88de4bf-dc87-4090-b930-76470ece3c76 admin admin] The token cache is being invalidate because project 561891c49901486c9d7651688f88b0eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:30:45.114585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a88de4bf-dc87-4090-b930-76470ece3c76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:45.117598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a88de4bf-dc87-4090-b930-76470ece3c76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:45.127165 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1444/2922] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:30:44 2022] DELETE /identity/v3/projects/561891c49901486c9d7651688f88b0eb => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:30:45.128843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0854d80-3bd9-4841-a76f-545787be15fc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:45.129320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0854d80-3bd9-4841-a76f-545787be15fc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:45.129436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0854d80-3bd9-4841-a76f-545787be15fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:45.196381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f0854d80-3bd9-4841-a76f-545787be15fc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:30:45.197627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f0854d80-3bd9-4841-a76f-545787be15fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:45.362008 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1479/2923] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:30:45.370304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b6ccf-bbd7-495b-9f3f-cbedafa432e2 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:45.370783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b6ccf-bbd7-495b-9f3f-cbedafa432e2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:45.371198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b6ccf-bbd7-495b-9f3f-cbedafa432e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:45.396013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-955b6ccf-bbd7-495b-9f3f-cbedafa432e2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:30:45.397861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-955b6ccf-bbd7-495b-9f3f-cbedafa432e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:45.408694 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1445/2924] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:30:45.413241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0854d80-3bd9-4841-a76f-545787be15fc None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:45.431873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0854d80-3bd9-4841-a76f-545787be15fc None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:45.442695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed65070-36d0-4ee2-beaf-75b651987368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:45.443679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed65070-36d0-4ee2-beaf-75b651987368 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:45.443949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed65070-36d0-4ee2-beaf-75b651987368 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:45.444272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed65070-36d0-4ee2-beaf-75b651987368 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:45.445102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed65070-36d0-4ee2-beaf-75b651987368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:30:45.445465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed65070-36d0-4ee2-beaf-75b651987368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:45.447170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed65070-36d0-4ee2-beaf-75b651987368 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:45.463692 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1480/2925] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:30:45.467827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b6ccf-bbd7-495b-9f3f-cbedafa432e2 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:45.480486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b6ccf-bbd7-495b-9f3f-cbedafa432e2 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:45.487098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc795a55-0e78-489e-941a-d4a6230677d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:45.487801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc795a55-0e78-489e-941a-d4a6230677d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:45.488460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc795a55-0e78-489e-941a-d4a6230677d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:45.489275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc795a55-0e78-489e-941a-d4a6230677d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:45.490162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc795a55-0e78-489e-941a-d4a6230677d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:45.496163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc795a55-0e78-489e-941a-d4a6230677d4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:45.640723 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1446/2926] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:30:45 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:30:45.645224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed65070-36d0-4ee2-beaf-75b651987368 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:45.657473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed65070-36d0-4ee2-beaf-75b651987368 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:45.760161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acea401-06ab-4e60-b415-f7e79fef246c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:45.760866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acea401-06ab-4e60-b415-f7e79fef246c admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:45.761275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acea401-06ab-4e60-b415-f7e79fef246c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:45.761627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acea401-06ab-4e60-b415-f7e79fef246c admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:45.762406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acea401-06ab-4e60-b415-f7e79fef246c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:45.765206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acea401-06ab-4e60-b415-f7e79fef246c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:45.918860 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1481/2927] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:30:45 2022] POST /identity/v3/users => generated 289 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:30:45.923063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc795a55-0e78-489e-941a-d4a6230677d4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:45.943435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc795a55-0e78-489e-941a-d4a6230677d4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:45.962221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73992a1-b4c9-4e4c-83cb-7a012b7ee316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:45.962856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73992a1-b4c9-4e4c-83cb-7a012b7ee316 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:45.963141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73992a1-b4c9-4e4c-83cb-7a012b7ee316 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:45.963416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73992a1-b4c9-4e4c-83cb-7a012b7ee316 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:45.964080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73992a1-b4c9-4e4c-83cb-7a012b7ee316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:45.976351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73992a1-b4c9-4e4c-83cb-7a012b7ee316 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:46.027524 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1447/2928] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:30:46.030112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acea401-06ab-4e60-b415-f7e79fef246c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:46.043363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acea401-06ab-4e60-b415-f7e79fef246c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:46.058330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129d1a4-b002-43db-b5c8-239190a4e0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:46.059052 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129d1a4-b002-43db-b5c8-239190a4e0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:46.059342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129d1a4-b002-43db-b5c8-239190a4e0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:46.059621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129d1a4-b002-43db-b5c8-239190a4e0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:46.060286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129d1a4-b002-43db-b5c8-239190a4e0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:46.062222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129d1a4-b002-43db-b5c8-239190a4e0c2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:46.089200 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1482/2929] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:30:46.090483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73992a1-b4c9-4e4c-83cb-7a012b7ee316 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:46.115529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73992a1-b4c9-4e4c-83cb-7a012b7ee316 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:46.131439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b6075-74d1-4161-b2c9-52fe05f9087f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:46.134416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b6075-74d1-4161-b2c9-52fe05f9087f admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:46.145645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b6075-74d1-4161-b2c9-52fe05f9087f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:46.146972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b6075-74d1-4161-b2c9-52fe05f9087f admin admin] PATH_INFO: `/v3/projects/20d87abf835a4104b40056b9eec2d6b6/users/0533917bc5aa4e23802a43b1eb534bd0/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:46.191322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b6075-74d1-4161-b2c9-52fe05f9087f admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d87abf835a4104b40056b9eec2d6b6, user_id=0533917bc5aa4e23802a43b1eb534bd0, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:46.204754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b6075-74d1-4161-b2c9-52fe05f9087f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:46.296798 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1448/2930] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:30:46 2022] PUT /identity/v3/projects/20d87abf835a4104b40056b9eec2d6b6/users/0533917bc5aa4e23802a43b1eb534bd0/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:30:46.308585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ecc47-3e95-4e8d-b0d0-e4636ac2f5fb None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:46.309721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ecc47-3e95-4e8d-b0d0-e4636ac2f5fb None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:46.310227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ecc47-3e95-4e8d-b0d0-e4636ac2f5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:46.361084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a09ecc47-3e95-4e8d-b0d0-e4636ac2f5fb None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:30:46.365353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a09ecc47-3e95-4e8d-b0d0-e4636ac2f5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:46.426195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:46.552718 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1483/2931] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:30:46.629314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b6075-74d1-4161-b2c9-52fe05f9087f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:46.631121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-077b6075-74d1-4161-b2c9-52fe05f9087f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:46.845881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b6075-74d1-4161-b2c9-52fe05f9087f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:46.860103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e158a-8d51-4a7d-9283-8a4f9a4c58ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:46.860966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e158a-8d51-4a7d-9283-8a4f9a4c58ad service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:46.862508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e158a-8d51-4a7d-9283-8a4f9a4c58ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:46.862820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e158a-8d51-4a7d-9283-8a4f9a4c58ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:46.888370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e158a-8d51-4a7d-9283-8a4f9a4c58ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:46.895955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e158a-8d51-4a7d-9283-8a4f9a4c58ad service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:46.911837 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1449/2932] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:30:51.291634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a64dad-7be4-495d-93dc-6edcf2c2400a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:51.292150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a64dad-7be4-495d-93dc-6edcf2c2400a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:51.292422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a64dad-7be4-495d-93dc-6edcf2c2400a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:51.341071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e6a64dad-7be4-495d-93dc-6edcf2c2400a None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:30:51.345689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e6a64dad-7be4-495d-93dc-6edcf2c2400a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:51.583127 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1484/2933] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:30:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:30:51.818622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e158a-8d51-4a7d-9283-8a4f9a4c58ad service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:51.820899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-648e158a-8d51-4a7d-9283-8a4f9a4c58ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:51.926553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:52.042082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e158a-8d51-4a7d-9283-8a4f9a4c58ad service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:52.063819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9dc099-2732-46ba-b911-05951025ec83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:52.064623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9dc099-2732-46ba-b911-05951025ec83 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:52.065013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9dc099-2732-46ba-b911-05951025ec83 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:52.065949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9dc099-2732-46ba-b911-05951025ec83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:52.094428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9dc099-2732-46ba-b911-05951025ec83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:52.096150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9dc099-2732-46ba-b911-05951025ec83 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:52.142920 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1450/2934] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:30:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:56.018378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a64dad-7be4-495d-93dc-6edcf2c2400a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:56.019861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e6a64dad-7be4-495d-93dc-6edcf2c2400a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:56.052379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a64dad-7be4-495d-93dc-6edcf2c2400a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:56.068233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbfce5-20e9-4ff0-b112-bbaaf3a14b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:56.076747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbfce5-20e9-4ff0-b112-bbaaf3a14b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:56.077062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbfce5-20e9-4ff0-b112-bbaaf3a14b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:56.077357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbfce5-20e9-4ff0-b112-bbaaf3a14b52 admin admin] PATH_INFO: `/v3/users/8c93886c5818439690564c2299a4f3ee` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:56.079034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbfce5-20e9-4ff0-b112-bbaaf3a14b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c93886c5818439690564c2299a4f3ee)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:56.082693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbfce5-20e9-4ff0-b112-bbaaf3a14b52 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:56.446860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-81dbfce5-20e9-4ff0-b112-bbaaf3a14b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c93886c5818439690564c2299a4f3ee'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:56.453283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-81dbfce5-20e9-4ff0-b112-bbaaf3a14b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c93886c5818439690564c2299a4f3ee'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:56.492039 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-81dbfce5-20e9-4ff0-b112-bbaaf3a14b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c93886c5818439690564c2299a4f3ee'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:56.540645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469cb1b-613a-4dbd-9215-02b8e6cd45eb None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:56.541622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469cb1b-613a-4dbd-9215-02b8e6cd45eb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:56.542108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469cb1b-613a-4dbd-9215-02b8e6cd45eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:56.544559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-81dbfce5-20e9-4ff0-b112-bbaaf3a14b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c93886c5818439690564c2299a4f3ee'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:56.545520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-81dbfce5-20e9-4ff0-b112-bbaaf3a14b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c93886c5818439690564c2299a4f3ee'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:56.603154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-7469cb1b-613a-4dbd-9215-02b8e6cd45eb None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:30:56.604409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7469cb1b-613a-4dbd-9215-02b8e6cd45eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:56.624127 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1451/2935] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:30:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:30:56.637011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469cb1b-613a-4dbd-9215-02b8e6cd45eb None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:56.638943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7469cb1b-613a-4dbd-9215-02b8e6cd45eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:56.661184 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1485/2936] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:30:56 2022] DELETE /identity/v3/users/8c93886c5818439690564c2299a4f3ee => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:30:56.722470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469cb1b-613a-4dbd-9215-02b8e6cd45eb None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:57.023932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a0d19-643b-4e9c-8c91-f947ae226933 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:57.027454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a0d19-643b-4e9c-8c91-f947ae226933 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:57.027863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a0d19-643b-4e9c-8c91-f947ae226933 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:57.028433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a0d19-643b-4e9c-8c91-f947ae226933 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:57.155932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a0d19-643b-4e9c-8c91-f947ae226933 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:57.158170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a0d19-643b-4e9c-8c91-f947ae226933 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:57.179778 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1452/2937] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:30:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 03:30:57.381483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbfce5-20e9-4ff0-b112-bbaaf3a14b52 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:57.394095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-81dbfce5-20e9-4ff0-b112-bbaaf3a14b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:57.532122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:57.593969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbfce5-20e9-4ff0-b112-bbaaf3a14b52 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:57.611139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a058ee-587d-4310-93b7-78e521a83f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:57.611803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a058ee-587d-4310-93b7-78e521a83f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:57.612186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a058ee-587d-4310-93b7-78e521a83f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:57.612467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a058ee-587d-4310-93b7-78e521a83f38 admin admin] PATH_INFO: `/v3/projects/aaee7e66f16e4ed5b49394311bd2803a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:57.617456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a058ee-587d-4310-93b7-78e521a83f38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaee7e66f16e4ed5b49394311bd2803a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:57.623412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a058ee-587d-4310-93b7-78e521a83f38 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:57.870822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d8a058ee-587d-4310-93b7-78e521a83f38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaee7e66f16e4ed5b49394311bd2803a', 'request_id': 'req-d8a058ee-587d-4310-93b7-78e521a83f38'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:57.879392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d8a058ee-587d-4310-93b7-78e521a83f38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaee7e66f16e4ed5b49394311bd2803a', 'request_id': 'req-d8a058ee-587d-4310-93b7-78e521a83f38'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:57.885836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d8a058ee-587d-4310-93b7-78e521a83f38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaee7e66f16e4ed5b49394311bd2803a', 'request_id': 'req-d8a058ee-587d-4310-93b7-78e521a83f38'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:57.973544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d8a058ee-587d-4310-93b7-78e521a83f38 admin admin] The token cache is being invalidate because project aaee7e66f16e4ed5b49394311bd2803a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:30:57.973886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d8a058ee-587d-4310-93b7-78e521a83f38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:57.976326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d8a058ee-587d-4310-93b7-78e521a83f38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:57.984712 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1486/2938] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:30:57 2022] DELETE /identity/v3/projects/aaee7e66f16e4ed5b49394311bd2803a => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:30:57.984898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a0d19-643b-4e9c-8c91-f947ae226933 service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:57.999808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a0d19-643b-4e9c-8c91-f947ae226933 service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:58.237999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:58.280814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f320b-700a-497d-a83d-b3b62daf7e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:58.281499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f320b-700a-497d-a83d-b3b62daf7e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:58.281786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f320b-700a-497d-a83d-b3b62daf7e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:58.282085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f320b-700a-497d-a83d-b3b62daf7e0c admin admin] PATH_INFO: `/v3/users/ba89e0f8634941819e688be6aa9fde02` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:58.284669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f320b-700a-497d-a83d-b3b62daf7e0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba89e0f8634941819e688be6aa9fde02)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:58.292843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f320b-700a-497d-a83d-b3b62daf7e0c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:58.531046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab903930-d7e4-4e14-a4a9-59a7f774beb6 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:58.531680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab903930-d7e4-4e14-a4a9-59a7f774beb6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:58.531771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab903930-d7e4-4e14-a4a9-59a7f774beb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:58.587680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-749f320b-700a-497d-a83d-b3b62daf7e0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba89e0f8634941819e688be6aa9fde02'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:58.590003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-749f320b-700a-497d-a83d-b3b62daf7e0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba89e0f8634941819e688be6aa9fde02'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:58.618304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-749f320b-700a-497d-a83d-b3b62daf7e0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba89e0f8634941819e688be6aa9fde02'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:58.653000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ab903930-d7e4-4e14-a4a9-59a7f774beb6 None None] MFA Rules not processed for user `ed44bf20b3464a53a3e3f6c9cd61cde3`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:30:58.664194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ab903930-d7e4-4e14-a4a9-59a7f774beb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:58.695971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-749f320b-700a-497d-a83d-b3b62daf7e0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba89e0f8634941819e688be6aa9fde02'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:58.779825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-749f320b-700a-497d-a83d-b3b62daf7e0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba89e0f8634941819e688be6aa9fde02'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:30:58.792539 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1453/2939] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:30:57 2022] DELETE /identity/v3/users/ba89e0f8634941819e688be6aa9fde02 => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:30:58.807356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f320b-700a-497d-a83d-b3b62daf7e0c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:58.809149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-749f320b-700a-497d-a83d-b3b62daf7e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:30:58.816954 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1487/2940] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:30:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:30:58.943527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f320b-700a-497d-a83d-b3b62daf7e0c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:58.959926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73eae9-5933-4c96-a22a-4ca8f8d9077a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:58.960807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73eae9-5933-4c96-a22a-4ca8f8d9077a admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:58.961193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73eae9-5933-4c96-a22a-4ca8f8d9077a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:58.961574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73eae9-5933-4c96-a22a-4ca8f8d9077a admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:58.962575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73eae9-5933-4c96-a22a-4ca8f8d9077a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:58.964643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73eae9-5933-4c96-a22a-4ca8f8d9077a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:59.091250 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1454/2941] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:30:58 2022] POST /identity/v3/projects => generated 383 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:30:59.095782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab903930-d7e4-4e14-a4a9-59a7f774beb6 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:59.115100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab903930-d7e4-4e14-a4a9-59a7f774beb6 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:59.295439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716acb7-5738-4216-a909-d74dd7377cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:59.296443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716acb7-5738-4216-a909-d74dd7377cad admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:59.296738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716acb7-5738-4216-a909-d74dd7377cad admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:59.301234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716acb7-5738-4216-a909-d74dd7377cad admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:59.301234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716acb7-5738-4216-a909-d74dd7377cad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:59.302257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716acb7-5738-4216-a909-d74dd7377cad admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:59.328606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:59.438206 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1488/2942] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:30:59 2022] POST /identity/v3/users => generated 298 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:30:59.439838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73eae9-5933-4c96-a22a-4ca8f8d9077a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:59.460604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73eae9-5933-4c96-a22a-4ca8f8d9077a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:59.474870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8127312-9c58-4c21-a498-247b8a2f3a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:59.475511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8127312-9c58-4c21-a498-247b8a2f3a38 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:59.475800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8127312-9c58-4c21-a498-247b8a2f3a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:59.476080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8127312-9c58-4c21-a498-247b8a2f3a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:59.476747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8127312-9c58-4c21-a498-247b8a2f3a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:59.488601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8127312-9c58-4c21-a498-247b8a2f3a38 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:59.533021 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1455/2943] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:30:59.535024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716acb7-5738-4216-a909-d74dd7377cad admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:59.567423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716acb7-5738-4216-a909-d74dd7377cad admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:59.586734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f75ac-6357-484e-888d-220d56ebfbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:30:59.587468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f75ac-6357-484e-888d-220d56ebfbf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:30:59.587886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f75ac-6357-484e-888d-220d56ebfbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:30:59.588081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f75ac-6357-484e-888d-220d56ebfbf4 admin admin] PATH_INFO: `/v3/projects/ed477088c7b64a7eb8f88cc336b56e32/users/613aedf1b66d48e4b4cad5e3da6ccbcb/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:30:59.666576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f75ac-6357-484e-888d-220d56ebfbf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed477088c7b64a7eb8f88cc336b56e32, user_id=613aedf1b66d48e4b4cad5e3da6ccbcb, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:30:59.669585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f75ac-6357-484e-888d-220d56ebfbf4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:30:59.776998 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1489/2944] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:30:59 2022] PUT /identity/v3/projects/ed477088c7b64a7eb8f88cc336b56e32/users/613aedf1b66d48e4b4cad5e3da6ccbcb/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:30:59.777177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8127312-9c58-4c21-a498-247b8a2f3a38 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:30:59.830053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8127312-9c58-4c21-a498-247b8a2f3a38 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:30:59.953540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:00.006708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bf81e-379f-451e-9f27-eec396655673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:00.007330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bf81e-379f-451e-9f27-eec396655673 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:00.007624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bf81e-379f-451e-9f27-eec396655673 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:00.007923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bf81e-379f-451e-9f27-eec396655673 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:00.011314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bf81e-379f-451e-9f27-eec396655673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:00.013054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bf81e-379f-451e-9f27-eec396655673 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:00.054893 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1456/2945] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:31:00.055582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f75ac-6357-484e-888d-220d56ebfbf4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:00.073648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f75ac-6357-484e-888d-220d56ebfbf4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:00.094056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff7bac-90df-400d-bcb6-aeaf415e39b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:00.097647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff7bac-90df-400d-bcb6-aeaf415e39b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:00.099180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff7bac-90df-400d-bcb6-aeaf415e39b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:00.099584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff7bac-90df-400d-bcb6-aeaf415e39b3 admin admin] PATH_INFO: `/v3/projects/ed477088c7b64a7eb8f88cc336b56e32/users/613aedf1b66d48e4b4cad5e3da6ccbcb/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:00.107447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff7bac-90df-400d-bcb6-aeaf415e39b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed477088c7b64a7eb8f88cc336b56e32, user_id=613aedf1b66d48e4b4cad5e3da6ccbcb, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:00.117305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff7bac-90df-400d-bcb6-aeaf415e39b3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:00.163938 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1490/2946] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:31:00 2022] PUT /identity/v3/projects/ed477088c7b64a7eb8f88cc336b56e32/users/613aedf1b66d48e4b4cad5e3da6ccbcb/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:31:00.311406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bf81e-379f-451e-9f27-eec396655673 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:00.313572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b28bf81e-379f-451e-9f27-eec396655673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:00.347109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bf81e-379f-451e-9f27-eec396655673 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:00.533434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb8d0b-7f31-422a-a39f-96b9b0f7f84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:00.534913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb8d0b-7f31-422a-a39f-96b9b0f7f84e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:00.535203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb8d0b-7f31-422a-a39f-96b9b0f7f84e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:00.535816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb8d0b-7f31-422a-a39f-96b9b0f7f84e admin admin] PATH_INFO: `/v3/projects/311879be1cc24060b2cb934481150ae0` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:00.538837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb8d0b-7f31-422a-a39f-96b9b0f7f84e admin admin] RBAC: Authorizing `identity:delete_project(project_id=311879be1cc24060b2cb934481150ae0)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:00.542136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb8d0b-7f31-422a-a39f-96b9b0f7f84e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:00.764735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b1cb8d0b-7f31-422a-a39f-96b9b0f7f84e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '311879be1cc24060b2cb934481150ae0', 'request_id': 'req-b1cb8d0b-7f31-422a-a39f-96b9b0f7f84e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:00.835544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff7bac-90df-400d-bcb6-aeaf415e39b3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:00.837490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5eff7bac-90df-400d-bcb6-aeaf415e39b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:00.859966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b1cb8d0b-7f31-422a-a39f-96b9b0f7f84e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '311879be1cc24060b2cb934481150ae0', 'request_id': 'req-b1cb8d0b-7f31-422a-a39f-96b9b0f7f84e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:00.870695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b1cb8d0b-7f31-422a-a39f-96b9b0f7f84e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '311879be1cc24060b2cb934481150ae0', 'request_id': 'req-b1cb8d0b-7f31-422a-a39f-96b9b0f7f84e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:00.900602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b1cb8d0b-7f31-422a-a39f-96b9b0f7f84e admin admin] The token cache is being invalidate because project 311879be1cc24060b2cb934481150ae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:31:00.901264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b1cb8d0b-7f31-422a-a39f-96b9b0f7f84e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:00.902855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b1cb8d0b-7f31-422a-a39f-96b9b0f7f84e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:00.910932 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1457/2947] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:31:00 2022] DELETE /identity/v3/projects/311879be1cc24060b2cb934481150ae0 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:31:00.916015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bccad9-07e3-4706-ab67-df3b629bbac0 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:00.918318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bccad9-07e3-4706-ab67-df3b629bbac0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:00.918870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bccad9-07e3-4706-ab67-df3b629bbac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:00.990900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e6bccad9-07e3-4706-ab67-df3b629bbac0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:00.999672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e6bccad9-07e3-4706-ab67-df3b629bbac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:01.088894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff7bac-90df-400d-bcb6-aeaf415e39b3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:01.207271 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1458/2948] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:31:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:31:01.216543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b625e-f4d2-40e7-98df-01fcf9d9e90c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:01.216952 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b625e-f4d2-40e7-98df-01fcf9d9e90c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:01.217560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b625e-f4d2-40e7-98df-01fcf9d9e90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:01.286649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d9d3c-c4c3-46ea-bf8f-68e9b20677d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:01.287881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d9d3c-c4c3-46ea-bf8f-68e9b20677d8 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:01.288167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d9d3c-c4c3-46ea-bf8f-68e9b20677d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:01.288442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d9d3c-c4c3-46ea-bf8f-68e9b20677d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:01.290518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-426d9d3c-c4c3-46ea-bf8f-68e9b20677d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:01.326934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5d7b625e-f4d2-40e7-98df-01fcf9d9e90c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:01.328180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5d7b625e-f4d2-40e7-98df-01fcf9d9e90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:01.368235 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1459/2949] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:31:01.373890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b625e-f4d2-40e7-98df-01fcf9d9e90c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:01.397166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:01.405936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b625e-f4d2-40e7-98df-01fcf9d9e90c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:01.427117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164efb01-6af1-4db4-b3bd-ee41c9f64f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:01.427907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164efb01-6af1-4db4-b3bd-ee41c9f64f5b admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:01.428208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164efb01-6af1-4db4-b3bd-ee41c9f64f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:01.428490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164efb01-6af1-4db4-b3bd-ee41c9f64f5b admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:01.429167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164efb01-6af1-4db4-b3bd-ee41c9f64f5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:31:01.429494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164efb01-6af1-4db4-b3bd-ee41c9f64f5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:01.431215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164efb01-6af1-4db4-b3bd-ee41c9f64f5b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:01.490227 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1460/2950] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:31:01.497135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164efb01-6af1-4db4-b3bd-ee41c9f64f5b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:01.532642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164efb01-6af1-4db4-b3bd-ee41c9f64f5b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:01.553771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3cb73-7497-4637-9021-f9b82819f729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:01.560479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3cb73-7497-4637-9021-f9b82819f729 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:01.562537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3cb73-7497-4637-9021-f9b82819f729 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:01.564257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3cb73-7497-4637-9021-f9b82819f729 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:01.567418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3cb73-7497-4637-9021-f9b82819f729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:01.590719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3cb73-7497-4637-9021-f9b82819f729 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:01.680945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d9d3c-c4c3-46ea-bf8f-68e9b20677d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:01.685621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d9d3c-c4c3-46ea-bf8f-68e9b20677d8 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:01.741481 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1491/2951] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:31:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 906 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:31:01.744750 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1461/2952] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:31:01 2022] POST /identity/v3/projects => generated 375 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:31:01.749129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d9d3c-c4c3-46ea-bf8f-68e9b20677d8 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:01.796766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d9d3c-c4c3-46ea-bf8f-68e9b20677d8 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:01.831985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:01.953707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4a36f-a47f-4e9e-a36c-64d124ce40f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:01.956204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4a36f-a47f-4e9e-a36c-64d124ce40f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:01.957339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4a36f-a47f-4e9e-a36c-64d124ce40f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:01.957809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4a36f-a47f-4e9e-a36c-64d124ce40f9 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:01.958818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4a36f-a47f-4e9e-a36c-64d124ce40f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:01.961710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4a36f-a47f-4e9e-a36c-64d124ce40f9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:02.096857 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1492/2953] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:31:01 2022] POST /identity/v3/users => generated 288 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:31:02.097057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3cb73-7497-4637-9021-f9b82819f729 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:02.117319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3cb73-7497-4637-9021-f9b82819f729 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:02.138706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8b1cc-38a3-4d39-a78a-19ef906bff81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:02.139346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8b1cc-38a3-4d39-a78a-19ef906bff81 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:02.139626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8b1cc-38a3-4d39-a78a-19ef906bff81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:02.139904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8b1cc-38a3-4d39-a78a-19ef906bff81 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:02.140558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8b1cc-38a3-4d39-a78a-19ef906bff81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:02.148293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8b1cc-38a3-4d39-a78a-19ef906bff81 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:02.230877 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1462/2954] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:31:02.234598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4a36f-a47f-4e9e-a36c-64d124ce40f9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:02.257955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4a36f-a47f-4e9e-a36c-64d124ce40f9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:02.264036 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36539c-9217-44c4-b6a7-e48d929ee9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:02.265463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36539c-9217-44c4-b6a7-e48d929ee9df admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:02.266100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36539c-9217-44c4-b6a7-e48d929ee9df admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:02.266599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36539c-9217-44c4-b6a7-e48d929ee9df admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:02.269796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36539c-9217-44c4-b6a7-e48d929ee9df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:02.274124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36539c-9217-44c4-b6a7-e48d929ee9df admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:02.296197 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1493/2955] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:31:02.296960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8b1cc-38a3-4d39-a78a-19ef906bff81 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:02.311659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8b1cc-38a3-4d39-a78a-19ef906bff81 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:02.325963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2c2de-9f3d-4919-b02a-341f2cfe728c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:02.328532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2c2de-9f3d-4919-b02a-341f2cfe728c admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:02.329095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2c2de-9f3d-4919-b02a-341f2cfe728c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:02.333489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2c2de-9f3d-4919-b02a-341f2cfe728c admin admin] PATH_INFO: `/v3/projects/c9275103326d404cbda943a3e112e5d8/users/9b411a700c2a4d5896e212a1559e5219/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:02.410896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2c2de-9f3d-4919-b02a-341f2cfe728c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9275103326d404cbda943a3e112e5d8, user_id=9b411a700c2a4d5896e212a1559e5219, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:02.417870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2c2de-9f3d-4919-b02a-341f2cfe728c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:02.570837 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1463/2956] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:31:02 2022] PUT /identity/v3/projects/c9275103326d404cbda943a3e112e5d8/users/9b411a700c2a4d5896e212a1559e5219/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:31:02.585137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae9790-931c-4f06-99ab-e6e1cee6ebe0 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:02.585444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae9790-931c-4f06-99ab-e6e1cee6ebe0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:02.586286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae9790-931c-4f06-99ab-e6e1cee6ebe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:02.675773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-84ae9790-931c-4f06-99ab-e6e1cee6ebe0 None None] MFA Rules not processed for user `9b411a700c2a4d5896e212a1559e5219`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:02.677028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-84ae9790-931c-4f06-99ab-e6e1cee6ebe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:02.867161 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1494/2957] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:31:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:31:02.871603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2c2de-9f3d-4919-b02a-341f2cfe728c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:03.022828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2c2de-9f3d-4919-b02a-341f2cfe728c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:03.035306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba096204-6732-4219-aa45-4e3fe606b47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:03.035985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba096204-6732-4219-aa45-4e3fe606b47f admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:03.036213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba096204-6732-4219-aa45-4e3fe606b47f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:03.036493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba096204-6732-4219-aa45-4e3fe606b47f admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:03.037150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba096204-6732-4219-aa45-4e3fe606b47f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:03.039474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba096204-6732-4219-aa45-4e3fe606b47f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:03.219678 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1464/2958] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:31:02 2022] POST /identity/v3/projects => generated 375 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:31:03.224944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae9790-931c-4f06-99ab-e6e1cee6ebe0 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:03.251773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae9790-931c-4f06-99ab-e6e1cee6ebe0 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:03.370082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56efeb-7176-47d1-9b7a-34d233a3e121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:03.370984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56efeb-7176-47d1-9b7a-34d233a3e121 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:03.371430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56efeb-7176-47d1-9b7a-34d233a3e121 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:03.371876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56efeb-7176-47d1-9b7a-34d233a3e121 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:03.372700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56efeb-7176-47d1-9b7a-34d233a3e121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:03.374895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56efeb-7176-47d1-9b7a-34d233a3e121 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:03.488562 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1495/2959] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:31:03 2022] POST /identity/v3/users => generated 294 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:31:03.499278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba096204-6732-4219-aa45-4e3fe606b47f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:03.520426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba096204-6732-4219-aa45-4e3fe606b47f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:03.530724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c465b2f-84c1-41b1-b7b3-f0f30dd2abc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:03.531359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c465b2f-84c1-41b1-b7b3-f0f30dd2abc1 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:03.531646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c465b2f-84c1-41b1-b7b3-f0f30dd2abc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:03.531922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c465b2f-84c1-41b1-b7b3-f0f30dd2abc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:03.532586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c465b2f-84c1-41b1-b7b3-f0f30dd2abc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:03.535032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c465b2f-84c1-41b1-b7b3-f0f30dd2abc1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:03.565717 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1465/2960] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:31:03.569654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56efeb-7176-47d1-9b7a-34d233a3e121 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:03.583912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56efeb-7176-47d1-9b7a-34d233a3e121 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:03.599752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c465b2f-84c1-41b1-b7b3-f0f30dd2abc1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:03.602513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2c465b2f-84c1-41b1-b7b3-f0f30dd2abc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:03.608464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb326d8-c158-4ea4-8dcf-590a2d4580ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:03.609060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb326d8-c158-4ea4-8dcf-590a2d4580ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:03.609342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb326d8-c158-4ea4-8dcf-590a2d4580ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:03.609617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb326d8-c158-4ea4-8dcf-590a2d4580ee admin admin] PATH_INFO: `/v3/projects/032e80a47f804f6b82d1c39b9dfe1d4c/users/1ef3a69e0b69460a81e42f9a583e5b61/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:03.642561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c465b2f-84c1-41b1-b7b3-f0f30dd2abc1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:03.644769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:03.669090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31adf94-f5c0-427f-8bff-9b4dd886467d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:03.669752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31adf94-f5c0-427f-8bff-9b4dd886467d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:03.670055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31adf94-f5c0-427f-8bff-9b4dd886467d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:03.670349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31adf94-f5c0-427f-8bff-9b4dd886467d admin admin] PATH_INFO: `/v3/users/421d14944da74570a53d620ea205449d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:03.671978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31adf94-f5c0-427f-8bff-9b4dd886467d admin admin] RBAC: Authorizing `identity:delete_user(user_id=421d14944da74570a53d620ea205449d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:03.673941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31adf94-f5c0-427f-8bff-9b4dd886467d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:03.676122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb326d8-c158-4ea4-8dcf-590a2d4580ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=032e80a47f804f6b82d1c39b9dfe1d4c, user_id=1ef3a69e0b69460a81e42f9a583e5b61, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:03.678864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb326d8-c158-4ea4-8dcf-590a2d4580ee admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:03.837353 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1496/2961] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:31:03 2022] PUT /identity/v3/projects/032e80a47f804f6b82d1c39b9dfe1d4c/users/1ef3a69e0b69460a81e42f9a583e5b61/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:31:03.838123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb326d8-c158-4ea4-8dcf-590a2d4580ee admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:03.975518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c31adf94-f5c0-427f-8bff-9b4dd886467d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '421d14944da74570a53d620ea205449d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:03.981793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c31adf94-f5c0-427f-8bff-9b4dd886467d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '421d14944da74570a53d620ea205449d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:04.003584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c31adf94-f5c0-427f-8bff-9b4dd886467d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '421d14944da74570a53d620ea205449d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:04.032656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:04.064355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c31adf94-f5c0-427f-8bff-9b4dd886467d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '421d14944da74570a53d620ea205449d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:04.085531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb326d8-c158-4ea4-8dcf-590a2d4580ee admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:04.091676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b2d05-bf52-4e1b-9f67-9e36dd70186d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:04.092003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b2d05-bf52-4e1b-9f67-9e36dd70186d admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:04.092426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b2d05-bf52-4e1b-9f67-9e36dd70186d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:04.092845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b2d05-bf52-4e1b-9f67-9e36dd70186d admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:04.093709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b2d05-bf52-4e1b-9f67-9e36dd70186d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:04.095523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b2d05-bf52-4e1b-9f67-9e36dd70186d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:04.124414 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1497/2962] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:31:04.129042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b2d05-bf52-4e1b-9f67-9e36dd70186d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:04.140325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c31adf94-f5c0-427f-8bff-9b4dd886467d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '421d14944da74570a53d620ea205449d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:04.147408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c22b2d05-bf52-4e1b-9f67-9e36dd70186d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:04.149080 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1466/2963] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:31:03 2022] DELETE /identity/v3/users/421d14944da74570a53d620ea205449d => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:31:04.183991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b2d05-bf52-4e1b-9f67-9e36dd70186d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:04.410803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795364b-ae06-4106-89f7-758b117dc0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:04.414697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795364b-ae06-4106-89f7-758b117dc0c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:04.415262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795364b-ae06-4106-89f7-758b117dc0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:04.415671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795364b-ae06-4106-89f7-758b117dc0c1 admin admin] PATH_INFO: `/v3/projects/032e80a47f804f6b82d1c39b9dfe1d4c/users/1ef3a69e0b69460a81e42f9a583e5b61/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:04.422953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795364b-ae06-4106-89f7-758b117dc0c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=032e80a47f804f6b82d1c39b9dfe1d4c, user_id=1ef3a69e0b69460a81e42f9a583e5b61, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:04.425680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795364b-ae06-4106-89f7-758b117dc0c1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:04.471894 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1498/2964] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:31:04 2022] PUT /identity/v3/projects/032e80a47f804f6b82d1c39b9dfe1d4c/users/1ef3a69e0b69460a81e42f9a583e5b61/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:31:04.483513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa78a8-d1a8-4848-ab21-36f6ec8e670a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:04.484098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa78a8-d1a8-4848-ab21-36f6ec8e670a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:04.484589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa78a8-d1a8-4848-ab21-36f6ec8e670a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:04.641882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a5aa78a8-d1a8-4848-ab21-36f6ec8e670a None None] MFA Rules not processed for user `1ef3a69e0b69460a81e42f9a583e5b61`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:04.648117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a5aa78a8-d1a8-4848-ab21-36f6ec8e670a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:04.879530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795364b-ae06-4106-89f7-758b117dc0c1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:04.887433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3795364b-ae06-4106-89f7-758b117dc0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:04.930090 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1467/2965] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:31:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:31:04.937739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa78a8-d1a8-4848-ab21-36f6ec8e670a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:04.979059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa78a8-d1a8-4848-ab21-36f6ec8e670a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:04.992464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef45058-3c2a-424a-9eec-bfd0d5992e58 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef3a69e0b69460a81e42f9a583e5b61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '032e80a47f804f6b82d1c39b9dfe1d4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:04.993419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef45058-3c2a-424a-9eec-bfd0d5992e58 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:04.994497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef45058-3c2a-424a-9eec-bfd0d5992e58 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:04.996069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef45058-3c2a-424a-9eec-bfd0d5992e58 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:04.997670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef45058-3c2a-424a-9eec-bfd0d5992e58 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:31:04.998513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef45058-3c2a-424a-9eec-bfd0d5992e58 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:05.003782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef45058-3c2a-424a-9eec-bfd0d5992e58 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:05.044617 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1468/2966] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:31:05.045917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef45058-3c2a-424a-9eec-bfd0d5992e58 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:05.092558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef45058-3c2a-424a-9eec-bfd0d5992e58 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:05.118313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795364b-ae06-4106-89f7-758b117dc0c1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:05.175913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768a05b-2b09-4a3d-ae95-e26c9e6edad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:05.175913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768a05b-2b09-4a3d-ae95-e26c9e6edad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:05.175913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768a05b-2b09-4a3d-ae95-e26c9e6edad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:05.176444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518577fe-603c-4660-aef3-ced0a9fb55a6 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef3a69e0b69460a81e42f9a583e5b61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '032e80a47f804f6b82d1c39b9dfe1d4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:05.176444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518577fe-603c-4660-aef3-ced0a9fb55a6 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:05.176444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518577fe-603c-4660-aef3-ced0a9fb55a6 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:05.176718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518577fe-603c-4660-aef3-ced0a9fb55a6 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:05.176718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518577fe-603c-4660-aef3-ced0a9fb55a6 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:05.176880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768a05b-2b09-4a3d-ae95-e26c9e6edad3 admin admin] PATH_INFO: `/v3/projects/92082c8718aa41bf96cd84d682d75954` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:05.176964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518577fe-603c-4660-aef3-ced0a9fb55a6 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:05.177065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768a05b-2b09-4a3d-ae95-e26c9e6edad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92082c8718aa41bf96cd84d682d75954)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:05.177065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768a05b-2b09-4a3d-ae95-e26c9e6edad3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:05.206240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:05.330014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d768a05b-2b09-4a3d-ae95-e26c9e6edad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92082c8718aa41bf96cd84d682d75954', 'request_id': 'req-d768a05b-2b09-4a3d-ae95-e26c9e6edad3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:05.337952 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1469/2967] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:31:05 2022] POST /identity/v3/projects => generated 371 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:31:05.339048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518577fe-603c-4660-aef3-ced0a9fb55a6 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:05.348650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d768a05b-2b09-4a3d-ae95-e26c9e6edad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92082c8718aa41bf96cd84d682d75954', 'request_id': 'req-d768a05b-2b09-4a3d-ae95-e26c9e6edad3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:05.357314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d768a05b-2b09-4a3d-ae95-e26c9e6edad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92082c8718aa41bf96cd84d682d75954', 'request_id': 'req-d768a05b-2b09-4a3d-ae95-e26c9e6edad3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:05.464433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d768a05b-2b09-4a3d-ae95-e26c9e6edad3 admin admin] The token cache is being invalidate because project 92082c8718aa41bf96cd84d682d75954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:31:05.465844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d768a05b-2b09-4a3d-ae95-e26c9e6edad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:05.468131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d768a05b-2b09-4a3d-ae95-e26c9e6edad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:05.479992 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1499/2968] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:31:04 2022] DELETE /identity/v3/projects/92082c8718aa41bf96cd84d682d75954 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:31:05.500193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518577fe-603c-4660-aef3-ced0a9fb55a6 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:05.502126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a49350-921e-4b8d-beb1-e5466ad859ee None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:05.503630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a49350-921e-4b8d-beb1-e5466ad859ee None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:05.504595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a49350-921e-4b8d-beb1-e5466ad859ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:05.529688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a8fb1-8000-40da-8b41-e465726858ea tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef3a69e0b69460a81e42f9a583e5b61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '032e80a47f804f6b82d1c39b9dfe1d4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:05.530363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a8fb1-8000-40da-8b41-e465726858ea tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:05.530647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a8fb1-8000-40da-8b41-e465726858ea tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:05.530931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a8fb1-8000-40da-8b41-e465726858ea tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:05.531612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a8fb1-8000-40da-8b41-e465726858ea tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:31:05.531928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a8fb1-8000-40da-8b41-e465726858ea tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:05.533586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a8fb1-8000-40da-8b41-e465726858ea tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:05.590113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-32a49350-921e-4b8d-beb1-e5466ad859ee None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:05.593722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-32a49350-921e-4b8d-beb1-e5466ad859ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:05.604647 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1470/2969] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:31:05.822465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e2c4e-84a9-4d68-a17a-a1f483c46bbb None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:05.823526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e2c4e-84a9-4d68-a17a-a1f483c46bbb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:05.824087 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1500/2970] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:31:05.824464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e2c4e-84a9-4d68-a17a-a1f483c46bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:05.873155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-633e2c4e-84a9-4d68-a17a-a1f483c46bbb None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:05.875526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-633e2c4e-84a9-4d68-a17a-a1f483c46bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:05.888367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a49350-921e-4b8d-beb1-e5466ad859ee None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:05.890023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-32a49350-921e-4b8d-beb1-e5466ad859ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:05.897423 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1471/2971] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:31:05.901726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e2c4e-84a9-4d68-a17a-a1f483c46bbb None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:05.927349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e2c4e-84a9-4d68-a17a-a1f483c46bbb None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:05.957407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b21ef-bde2-4ac8-b305-0d68bd0910bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:05.958441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b21ef-bde2-4ac8-b305-0d68bd0910bd admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:05.958873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b21ef-bde2-4ac8-b305-0d68bd0910bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:05.959387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b21ef-bde2-4ac8-b305-0d68bd0910bd admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:05.960221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b21ef-bde2-4ac8-b305-0d68bd0910bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:31:05.961322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b21ef-bde2-4ac8-b305-0d68bd0910bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:05.967190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b21ef-bde2-4ac8-b305-0d68bd0910bd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:06.021390 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1472/2972] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:31:06.026118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b21ef-bde2-4ac8-b305-0d68bd0910bd admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:06.047202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a49350-921e-4b8d-beb1-e5466ad859ee None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:06.050399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:06.055369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bdead-09ca-4340-963e-b07aa187b3d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:06.057236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bdead-09ca-4340-963e-b07aa187b3d6 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:06.057520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bdead-09ca-4340-963e-b07aa187b3d6 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:06.058687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bdead-09ca-4340-963e-b07aa187b3d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:06.062074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b21ef-bde2-4ac8-b305-0d68bd0910bd admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:06.062207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-448bdead-09ca-4340-963e-b07aa187b3d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:06.084089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800eafb9-03bb-4b30-b6d3-e33039c841f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:06.084861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800eafb9-03bb-4b30-b6d3-e33039c841f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:06.085151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800eafb9-03bb-4b30-b6d3-e33039c841f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:06.085430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800eafb9-03bb-4b30-b6d3-e33039c841f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:06.086150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800eafb9-03bb-4b30-b6d3-e33039c841f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:06.088556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800eafb9-03bb-4b30-b6d3-e33039c841f6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:06.096275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bdead-09ca-4340-963e-b07aa187b3d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:06.097960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bdead-09ca-4340-963e-b07aa187b3d6 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:06.167249 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1501/2973] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:31:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:31:06.210250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab836788-e33a-495d-b0ec-87260fff6d57 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:06.210250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab836788-e33a-495d-b0ec-87260fff6d57 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:06.210454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab836788-e33a-495d-b0ec-87260fff6d57 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:06.212142 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1502/2974] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:31:06.217496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab836788-e33a-495d-b0ec-87260fff6d57 None None] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:31:06.251777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab836788-e33a-495d-b0ec-87260fff6d57 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:06.255958 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1473/2975] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:31:06 2022] POST /identity/v3/projects => generated 383 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:31:06.260034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800eafb9-03bb-4b30-b6d3-e33039c841f6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:06.277890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab836788-e33a-495d-b0ec-87260fff6d57 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:06.348849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:06.406252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800eafb9-03bb-4b30-b6d3-e33039c841f6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:06.419528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88b4d2-a590-416b-bddb-611ec58874ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:06.421227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88b4d2-a590-416b-bddb-611ec58874ae admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:06.421725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88b4d2-a590-416b-bddb-611ec58874ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:06.422286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88b4d2-a590-416b-bddb-611ec58874ae admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:06.428182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88b4d2-a590-416b-bddb-611ec58874ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:06.430890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459cab8-2f40-49c0-b666-052923efd769 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef3a69e0b69460a81e42f9a583e5b61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '032e80a47f804f6b82d1c39b9dfe1d4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:06.431988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459cab8-2f40-49c0-b666-052923efd769 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:06.431988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459cab8-2f40-49c0-b666-052923efd769 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:06.432175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459cab8-2f40-49c0-b666-052923efd769 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] PATH_INFO: `/v3/projects/a270e2227807437c882f38d60d53fcdc` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:06.436734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459cab8-2f40-49c0-b666-052923efd769 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Authorizing `identity:get_project(project_id=a270e2227807437c882f38d60d53fcdc)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:06.438874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459cab8-2f40-49c0-b666-052923efd769 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:06.440699 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1503/2976] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:31:06 2022] GET /identity/v3/projects/a270e2227807437c882f38d60d53fcdc => generated 371 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:31:06.452931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88b4d2-a590-416b-bddb-611ec58874ae admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:06.598081 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1474/2977] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:31:06 2022] POST /identity/v3/users => generated 292 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:31:06.600123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459cab8-2f40-49c0-b666-052923efd769 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:06.662646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459cab8-2f40-49c0-b666-052923efd769 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:06.691506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987a9b5-8f53-4111-bc25-6369daadd1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:06.698710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987a9b5-8f53-4111-bc25-6369daadd1ea admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:06.699060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987a9b5-8f53-4111-bc25-6369daadd1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:06.699338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987a9b5-8f53-4111-bc25-6369daadd1ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:06.700053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987a9b5-8f53-4111-bc25-6369daadd1ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:06.701682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987a9b5-8f53-4111-bc25-6369daadd1ea admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:06.772785 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1504/2978] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:31:06.776928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88b4d2-a590-416b-bddb-611ec58874ae admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:06.792474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88b4d2-a590-416b-bddb-611ec58874ae admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:06.803782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d081ac2-6a9a-43cd-802d-ab9467c2b3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:06.804621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d081ac2-6a9a-43cd-802d-ab9467c2b3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:06.805069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d081ac2-6a9a-43cd-802d-ab9467c2b3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:06.805865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d081ac2-6a9a-43cd-802d-ab9467c2b3c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:06.806422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d081ac2-6a9a-43cd-802d-ab9467c2b3c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:06.808250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d081ac2-6a9a-43cd-802d-ab9467c2b3c7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:06.838913 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1475/2979] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:31:06.841985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987a9b5-8f53-4111-bc25-6369daadd1ea admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:06.856970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987a9b5-8f53-4111-bc25-6369daadd1ea admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:06.937637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e52333-95e1-4d77-9d5f-6c81073aa6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:06.938616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e52333-95e1-4d77-9d5f-6c81073aa6c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:06.939087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e52333-95e1-4d77-9d5f-6c81073aa6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:06.939539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e52333-95e1-4d77-9d5f-6c81073aa6c7 admin admin] PATH_INFO: `/v3/projects/9ebe1ca8678d43c38731d15b0bf99cfa/users/4ba8b60cf1164a388f626b0708556775/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:06.981520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e52333-95e1-4d77-9d5f-6c81073aa6c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ebe1ca8678d43c38731d15b0bf99cfa, user_id=4ba8b60cf1164a388f626b0708556775, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:06.984055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e52333-95e1-4d77-9d5f-6c81073aa6c7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:07.064476 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1505/2980] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:31:06 2022] PUT /identity/v3/projects/9ebe1ca8678d43c38731d15b0bf99cfa/users/4ba8b60cf1164a388f626b0708556775/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:31:07.071661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25abb95-6962-43c1-a4d5-f95c284edb13 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:07.072407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25abb95-6962-43c1-a4d5-f95c284edb13 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:07.073097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25abb95-6962-43c1-a4d5-f95c284edb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:07.187429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f25abb95-6962-43c1-a4d5-f95c284edb13 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:07.190600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f25abb95-6962-43c1-a4d5-f95c284edb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:07.486197 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1476/2981] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:31:07.496312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e52333-95e1-4d77-9d5f-6c81073aa6c7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:07.498156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-01e52333-95e1-4d77-9d5f-6c81073aa6c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:07.529498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54f92c-a7c0-4dc7-b9d0-aa0ad0b74581 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:07.529805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54f92c-a7c0-4dc7-b9d0-aa0ad0b74581 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:07.530068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54f92c-a7c0-4dc7-b9d0-aa0ad0b74581 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:07.531809 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1477/2982] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:31:07.537593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54f92c-a7c0-4dc7-b9d0-aa0ad0b74581 None None] Authenticating service token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:31:07.713680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e52333-95e1-4d77-9d5f-6c81073aa6c7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:07.734256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42547eb-d29f-4a33-bc2d-a2d360be217f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:07.735693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42547eb-d29f-4a33-bc2d-a2d360be217f service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:07.739863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42547eb-d29f-4a33-bc2d-a2d360be217f service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:07.739863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42547eb-d29f-4a33-bc2d-a2d360be217f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:07.759170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:07.782938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42547eb-d29f-4a33-bc2d-a2d360be217f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:07.784831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42547eb-d29f-4a33-bc2d-a2d360be217f service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:07.814847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54f92c-a7c0-4dc7-b9d0-aa0ad0b74581 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:07.834422 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1506/2983] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:31:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:31:08.017540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54f92c-a7c0-4dc7-b9d0-aa0ad0b74581 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:08.025650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca68d00-c082-40e3-b394-94e96bda52bf tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef3a69e0b69460a81e42f9a583e5b61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '032e80a47f804f6b82d1c39b9dfe1d4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:08.026365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca68d00-c082-40e3-b394-94e96bda52bf tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:08.026753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca68d00-c082-40e3-b394-94e96bda52bf tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:08.027138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca68d00-c082-40e3-b394-94e96bda52bf tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] PATH_INFO: `/v3/projects/a270e2227807437c882f38d60d53fcdc` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:08.028471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca68d00-c082-40e3-b394-94e96bda52bf tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Authorizing `identity:get_project(project_id=a270e2227807437c882f38d60d53fcdc)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:08.034598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca68d00-c082-40e3-b394-94e96bda52bf tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:08.050620 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1478/2984] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:31:07 2022] GET /identity/v3/projects/a270e2227807437c882f38d60d53fcdc => generated 371 bytes in 505 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:31:08.119317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42547eb-d29f-4a33-bc2d-a2d360be217f service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:08.136994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42547eb-d29f-4a33-bc2d-a2d360be217f service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:08.169616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c33e35-28f8-42c5-a241-977fb8c38175 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef3a69e0b69460a81e42f9a583e5b61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '032e80a47f804f6b82d1c39b9dfe1d4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:08.170314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c33e35-28f8-42c5-a241-977fb8c38175 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:08.175528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c33e35-28f8-42c5-a241-977fb8c38175 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:08.176963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c33e35-28f8-42c5-a241-977fb8c38175 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:08.177694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c33e35-28f8-42c5-a241-977fb8c38175 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:31:08.186512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c33e35-28f8-42c5-a241-977fb8c38175 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:08.189262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c33e35-28f8-42c5-a241-977fb8c38175 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:08.263878 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1507/2985] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:31:08.273529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca68d00-c082-40e3-b394-94e96bda52bf tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:08.296951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca68d00-c082-40e3-b394-94e96bda52bf tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:08.303043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c8531-1d42-40bd-bef8-08011c61499b tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef3a69e0b69460a81e42f9a583e5b61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '032e80a47f804f6b82d1c39b9dfe1d4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:08.303674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c8531-1d42-40bd-bef8-08011c61499b tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:08.303955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c8531-1d42-40bd-bef8-08011c61499b tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:08.304232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c8531-1d42-40bd-bef8-08011c61499b tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:08.304894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c8531-1d42-40bd-bef8-08011c61499b tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:08.307042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c8531-1d42-40bd-bef8-08011c61499b tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:08.470173 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1479/2986] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:31:08 2022] POST /identity/v3/users => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:31:08.475780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c33e35-28f8-42c5-a241-977fb8c38175 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:08.497418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c33e35-28f8-42c5-a241-977fb8c38175 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:08.525199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb8c73-349f-4700-9243-d1b313f6d625 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef3a69e0b69460a81e42f9a583e5b61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '032e80a47f804f6b82d1c39b9dfe1d4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:08.527098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb8c73-349f-4700-9243-d1b313f6d625 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:08.528079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb8c73-349f-4700-9243-d1b313f6d625 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:08.528079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb8c73-349f-4700-9243-d1b313f6d625 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:08.530873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb8c73-349f-4700-9243-d1b313f6d625 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:31:08.531462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb8c73-349f-4700-9243-d1b313f6d625 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:08.533444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb8c73-349f-4700-9243-d1b313f6d625 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:08.619494 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1508/2987] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:31:09.271916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646e040-5c8b-440f-b74d-1baa63b7db7f None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:09.272906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646e040-5c8b-440f-b74d-1baa63b7db7f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:09.273447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646e040-5c8b-440f-b74d-1baa63b7db7f None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:09.275752 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1480/2988] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:31:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:31:09.281537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb8c73-349f-4700-9243-d1b313f6d625 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:31:09.311643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb8c73-349f-4700-9243-d1b313f6d625 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:09.334380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb8c73-349f-4700-9243-d1b313f6d625 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:09.364255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd54ae2-9161-45db-a3e3-910a7fea6d7c tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef3a69e0b69460a81e42f9a583e5b61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '032e80a47f804f6b82d1c39b9dfe1d4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:09.365174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd54ae2-9161-45db-a3e3-910a7fea6d7c tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:09.367137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd54ae2-9161-45db-a3e3-910a7fea6d7c tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:09.368274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd54ae2-9161-45db-a3e3-910a7fea6d7c tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] PATH_INFO: `/v3/projects/a270e2227807437c882f38d60d53fcdc` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:09.370559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd54ae2-9161-45db-a3e3-910a7fea6d7c tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Authorizing `identity:get_project(project_id=a270e2227807437c882f38d60d53fcdc)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:09.373563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd54ae2-9161-45db-a3e3-910a7fea6d7c tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:09.389288 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1509/2989] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:31:09 2022] GET /identity/v3/projects/a270e2227807437c882f38d60d53fcdc => generated 371 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:31:09.938972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f01132-b03b-4cd3-883a-006257df6953 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:09.943159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f01132-b03b-4cd3-883a-006257df6953 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:09.943853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f01132-b03b-4cd3-883a-006257df6953 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:09.945871 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1481/2990] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:31:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:31:09.951521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd54ae2-9161-45db-a3e3-910a7fea6d7c tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:31:09.976529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd54ae2-9161-45db-a3e3-910a7fea6d7c tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:10.012462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd54ae2-9161-45db-a3e3-910a7fea6d7c tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:10.032994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40493584-0b30-416a-8810-42f2fdd74722 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef3a69e0b69460a81e42f9a583e5b61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '032e80a47f804f6b82d1c39b9dfe1d4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:10.035208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40493584-0b30-416a-8810-42f2fdd74722 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:10.035552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40493584-0b30-416a-8810-42f2fdd74722 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:10.038648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40493584-0b30-416a-8810-42f2fdd74722 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] PATH_INFO: `/v3/projects/a270e2227807437c882f38d60d53fcdc` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:10.043518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40493584-0b30-416a-8810-42f2fdd74722 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Authorizing `identity:get_project(project_id=a270e2227807437c882f38d60d53fcdc)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:10.045492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40493584-0b30-416a-8810-42f2fdd74722 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:10.055282 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1510/2991] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:31:09 2022] GET /identity/v3/projects/a270e2227807437c882f38d60d53fcdc => generated 371 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:31:10.128296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f01132-b03b-4cd3-883a-006257df6953 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:10.156157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f01132-b03b-4cd3-883a-006257df6953 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:10.170342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ae8dc-e493-40e3-a7ba-ed527a08c14a tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef3a69e0b69460a81e42f9a583e5b61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '032e80a47f804f6b82d1c39b9dfe1d4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:10.172204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ae8dc-e493-40e3-a7ba-ed527a08c14a tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:10.172443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ae8dc-e493-40e3-a7ba-ed527a08c14a tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:10.173888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ae8dc-e493-40e3-a7ba-ed527a08c14a tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] PATH_INFO: `/v3/users/55e9346cddfc414ca368940e6b1bbc2a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:10.215411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ae8dc-e493-40e3-a7ba-ed527a08c14a tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Authorizing `identity:delete_user(user_id=55e9346cddfc414ca368940e6b1bbc2a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:10.219957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ae8dc-e493-40e3-a7ba-ed527a08c14a tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:10.445429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ec3ae8dc-e493-40e3-a7ba-ed527a08c14a tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e9346cddfc414ca368940e6b1bbc2a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:10.450316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ec3ae8dc-e493-40e3-a7ba-ed527a08c14a tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e9346cddfc414ca368940e6b1bbc2a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:10.473949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ec3ae8dc-e493-40e3-a7ba-ed527a08c14a tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e9346cddfc414ca368940e6b1bbc2a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:10.504748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ec3ae8dc-e493-40e3-a7ba-ed527a08c14a tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e9346cddfc414ca368940e6b1bbc2a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:10.629215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ec3ae8dc-e493-40e3-a7ba-ed527a08c14a tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e9346cddfc414ca368940e6b1bbc2a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:10.649812 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1482/2992] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:31:10 2022] DELETE /identity/v3/users/55e9346cddfc414ca368940e6b1bbc2a => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:31:10.654131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40493584-0b30-416a-8810-42f2fdd74722 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:10.656450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-40493584-0b30-416a-8810-42f2fdd74722 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:10.708143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40493584-0b30-416a-8810-42f2fdd74722 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:10.954444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:10.973746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff25fa7-6711-4b81-8edb-caa7a41836ef tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef3a69e0b69460a81e42f9a583e5b61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '032e80a47f804f6b82d1c39b9dfe1d4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:10.974448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff25fa7-6711-4b81-8edb-caa7a41836ef tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:10.974738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff25fa7-6711-4b81-8edb-caa7a41836ef tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:10.975184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff25fa7-6711-4b81-8edb-caa7a41836ef tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] PATH_INFO: `/v3/projects/a270e2227807437c882f38d60d53fcdc` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:10.977238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff25fa7-6711-4b81-8edb-caa7a41836ef tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a270e2227807437c882f38d60d53fcdc)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:10.982487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff25fa7-6711-4b81-8edb-caa7a41836ef tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:11.156921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1ff25fa7-6711-4b81-8edb-caa7a41836ef tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a270e2227807437c882f38d60d53fcdc', 'request_id': 'req-1ff25fa7-6711-4b81-8edb-caa7a41836ef'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:11.171536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1ff25fa7-6711-4b81-8edb-caa7a41836ef tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a270e2227807437c882f38d60d53fcdc', 'request_id': 'req-1ff25fa7-6711-4b81-8edb-caa7a41836ef'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:11.200391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1ff25fa7-6711-4b81-8edb-caa7a41836ef tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a270e2227807437c882f38d60d53fcdc', 'request_id': 'req-1ff25fa7-6711-4b81-8edb-caa7a41836ef'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:11.307546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1ff25fa7-6711-4b81-8edb-caa7a41836ef tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] The token cache is being invalidate because project a270e2227807437c882f38d60d53fcdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:31:11.307849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1ff25fa7-6711-4b81-8edb-caa7a41836ef tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:11.308568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1ff25fa7-6711-4b81-8edb-caa7a41836ef tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:11.310187 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1511/2993] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:31:10 2022] DELETE /identity/v3/projects/a270e2227807437c882f38d60d53fcdc => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:31:11.319078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ae8dc-e493-40e3-a7ba-ed527a08c14a tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:11.320812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ec3ae8dc-e493-40e3-a7ba-ed527a08c14a tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:11.448993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:11.493505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ae8dc-e493-40e3-a7ba-ed527a08c14a tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:11.652922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076577e0-7348-41d7-85c8-bdffec167b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:11.655598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076577e0-7348-41d7-85c8-bdffec167b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:11.656096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076577e0-7348-41d7-85c8-bdffec167b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:11.660505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076577e0-7348-41d7-85c8-bdffec167b80 admin admin] PATH_INFO: `/v3/users/9b411a700c2a4d5896e212a1559e5219` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:11.662014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076577e0-7348-41d7-85c8-bdffec167b80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b411a700c2a4d5896e212a1559e5219)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:11.665597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076577e0-7348-41d7-85c8-bdffec167b80 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:11.731202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbf41b-27f3-49b9-8731-61145fb03d4d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:11.731727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbf41b-27f3-49b9-8731-61145fb03d4d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:11.732663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbf41b-27f3-49b9-8731-61145fb03d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:11.838271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-eabbf41b-27f3-49b9-8731-61145fb03d4d None None] MFA Rules not processed for user `0533917bc5aa4e23802a43b1eb534bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:11.841712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-eabbf41b-27f3-49b9-8731-61145fb03d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:11.936930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-076577e0-7348-41d7-85c8-bdffec167b80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b411a700c2a4d5896e212a1559e5219'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:11.937714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-076577e0-7348-41d7-85c8-bdffec167b80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b411a700c2a4d5896e212a1559e5219'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:11.964931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-076577e0-7348-41d7-85c8-bdffec167b80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b411a700c2a4d5896e212a1559e5219'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:12.016425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-076577e0-7348-41d7-85c8-bdffec167b80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b411a700c2a4d5896e212a1559e5219'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:12.083797 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1512/2994] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:31:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:31:12.085320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6b20e-7680-44db-ac12-b5ef9a46f102 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:12.085617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6b20e-7680-44db-ac12-b5ef9a46f102 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:12.085897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6b20e-7680-44db-ac12-b5ef9a46f102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:12.134727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-5eb6b20e-7680-44db-ac12-b5ef9a46f102 None None] MFA Rules not processed for user `0533917bc5aa4e23802a43b1eb534bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:12.136010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5eb6b20e-7680-44db-ac12-b5ef9a46f102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:12.152919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-076577e0-7348-41d7-85c8-bdffec167b80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b411a700c2a4d5896e212a1559e5219'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:12.170017 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1483/2995] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:31:11 2022] DELETE /identity/v3/users/9b411a700c2a4d5896e212a1559e5219 => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:31:12.171956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6ce96-9f56-4d81-a77a-ed4d1358a9f9 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:12.172512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6ce96-9f56-4d81-a77a-ed4d1358a9f9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:12.177729 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1513/2996] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:31:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:31:12.183390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6ce96-9f56-4d81-a77a-ed4d1358a9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:12.184212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6b20e-7680-44db-ac12-b5ef9a46f102 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:12.186742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5eb6b20e-7680-44db-ac12-b5ef9a46f102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:12.221958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b5c6ce96-9f56-4d81-a77a-ed4d1358a9f9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:12.228051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b5c6ce96-9f56-4d81-a77a-ed4d1358a9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:12.451574 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1484/2997] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:31:12.472613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6ce96-9f56-4d81-a77a-ed4d1358a9f9 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:12.475931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b5c6ce96-9f56-4d81-a77a-ed4d1358a9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:12.501695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6b20e-7680-44db-ac12-b5ef9a46f102 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:12.506335 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:12.514840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:12.664529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6ce96-9f56-4d81-a77a-ed4d1358a9f9 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:12.673379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1c0ac-b0ea-4c1d-a0ab-0cba706e3c59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:12.674250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1c0ac-b0ea-4c1d-a0ab-0cba706e3c59 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:12.675184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1c0ac-b0ea-4c1d-a0ab-0cba706e3c59 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:12.675449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc31976-7881-429a-b896-f925d843cbba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:12.675668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1c0ac-b0ea-4c1d-a0ab-0cba706e3c59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:12.676091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc31976-7881-429a-b896-f925d843cbba service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:12.676378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc31976-7881-429a-b896-f925d843cbba service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:12.676655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc31976-7881-429a-b896-f925d843cbba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:12.706445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc31976-7881-429a-b896-f925d843cbba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:12.710892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc31976-7881-429a-b896-f925d843cbba service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:12.740103 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1485/2998] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:31:12.836012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1c0ac-b0ea-4c1d-a0ab-0cba706e3c59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:12.868273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1c0ac-b0ea-4c1d-a0ab-0cba706e3c59 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:12.906800 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1514/2999] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:31:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:31:14.362525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc31976-7881-429a-b896-f925d843cbba service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:14.364666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2bc31976-7881-429a-b896-f925d843cbba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:14.390379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc31976-7881-429a-b896-f925d843cbba service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:14.404089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b4331-9314-4d59-9391-6aa4584a13ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:14.405129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b4331-9314-4d59-9391-6aa4584a13ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:14.409788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b4331-9314-4d59-9391-6aa4584a13ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:14.409788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b4331-9314-4d59-9391-6aa4584a13ae admin admin] PATH_INFO: `/v3/projects/c9275103326d404cbda943a3e112e5d8` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:14.413211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b4331-9314-4d59-9391-6aa4584a13ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9275103326d404cbda943a3e112e5d8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:14.417298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b4331-9314-4d59-9391-6aa4584a13ae admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:14.654668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-377b4331-9314-4d59-9391-6aa4584a13ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9275103326d404cbda943a3e112e5d8', 'request_id': 'req-377b4331-9314-4d59-9391-6aa4584a13ae'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:14.762420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-377b4331-9314-4d59-9391-6aa4584a13ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9275103326d404cbda943a3e112e5d8', 'request_id': 'req-377b4331-9314-4d59-9391-6aa4584a13ae'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:14.774372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-377b4331-9314-4d59-9391-6aa4584a13ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9275103326d404cbda943a3e112e5d8', 'request_id': 'req-377b4331-9314-4d59-9391-6aa4584a13ae'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:14.811815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-377b4331-9314-4d59-9391-6aa4584a13ae admin admin] The token cache is being invalidate because project c9275103326d404cbda943a3e112e5d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:31:14.812391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-377b4331-9314-4d59-9391-6aa4584a13ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:14.814428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-377b4331-9314-4d59-9391-6aa4584a13ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:14.821641 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1486/3000] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:31:14 2022] DELETE /identity/v3/projects/c9275103326d404cbda943a3e112e5d8 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:31:14.823016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1c0ac-b0ea-4c1d-a0ab-0cba706e3c59 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:14.848096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1c0ac-b0ea-4c1d-a0ab-0cba706e3c59 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:15.108755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd69257-e795-402b-bf00-319d215a7e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:15.114568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd69257-e795-402b-bf00-319d215a7e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:15.114996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd69257-e795-402b-bf00-319d215a7e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:15.115894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd69257-e795-402b-bf00-319d215a7e62 admin admin] PATH_INFO: `/v3/users/1ef3a69e0b69460a81e42f9a583e5b61` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:15.117561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd69257-e795-402b-bf00-319d215a7e62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ef3a69e0b69460a81e42f9a583e5b61)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:15.120192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd69257-e795-402b-bf00-319d215a7e62 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:15.444390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:15.458014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dfd69257-e795-402b-bf00-319d215a7e62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ef3a69e0b69460a81e42f9a583e5b61'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:15.464366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dfd69257-e795-402b-bf00-319d215a7e62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ef3a69e0b69460a81e42f9a583e5b61'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:15.489808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dfd69257-e795-402b-bf00-319d215a7e62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ef3a69e0b69460a81e42f9a583e5b61'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:15.545680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dfd69257-e795-402b-bf00-319d215a7e62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ef3a69e0b69460a81e42f9a583e5b61'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:15.547601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dfd69257-e795-402b-bf00-319d215a7e62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ef3a69e0b69460a81e42f9a583e5b61'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:15.659953 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1515/3001] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:31:14 2022] DELETE /identity/v3/users/1ef3a69e0b69460a81e42f9a583e5b61 => generated 0 bytes in 835 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:31:17.600763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b4331-9314-4d59-9391-6aa4584a13ae admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:17.602281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-377b4331-9314-4d59-9391-6aa4584a13ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:17.637483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b4331-9314-4d59-9391-6aa4584a13ae admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:17.900937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa9d8a-2d01-461c-9954-5dc80d2eea6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:17.903573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa9d8a-2d01-461c-9954-5dc80d2eea6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:17.905381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa9d8a-2d01-461c-9954-5dc80d2eea6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:17.905719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa9d8a-2d01-461c-9954-5dc80d2eea6e admin admin] PATH_INFO: `/v3/projects/032e80a47f804f6b82d1c39b9dfe1d4c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:17.907665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa9d8a-2d01-461c-9954-5dc80d2eea6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=032e80a47f804f6b82d1c39b9dfe1d4c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:17.923029 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa9d8a-2d01-461c-9954-5dc80d2eea6e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:18.131010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:18.155532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-27fa9d8a-2d01-461c-9954-5dc80d2eea6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '032e80a47f804f6b82d1c39b9dfe1d4c', 'request_id': 'req-27fa9d8a-2d01-461c-9954-5dc80d2eea6e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:18.229165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-27fa9d8a-2d01-461c-9954-5dc80d2eea6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '032e80a47f804f6b82d1c39b9dfe1d4c', 'request_id': 'req-27fa9d8a-2d01-461c-9954-5dc80d2eea6e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:18.237711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-27fa9d8a-2d01-461c-9954-5dc80d2eea6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '032e80a47f804f6b82d1c39b9dfe1d4c', 'request_id': 'req-27fa9d8a-2d01-461c-9954-5dc80d2eea6e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:18.291589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-27fa9d8a-2d01-461c-9954-5dc80d2eea6e admin admin] The token cache is being invalidate because project 032e80a47f804f6b82d1c39b9dfe1d4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:31:18.293863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-27fa9d8a-2d01-461c-9954-5dc80d2eea6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:18.295810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-27fa9d8a-2d01-461c-9954-5dc80d2eea6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:18.307323 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1487/3002] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:31:17 2022] DELETE /identity/v3/projects/032e80a47f804f6b82d1c39b9dfe1d4c => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:31:18.313709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720549cd-4902-4de0-86a9-8d564025703c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:18.314252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720549cd-4902-4de0-86a9-8d564025703c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:18.314346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720549cd-4902-4de0-86a9-8d564025703c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:18.385623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-720549cd-4902-4de0-86a9-8d564025703c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:18.387193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-720549cd-4902-4de0-86a9-8d564025703c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:18.606819 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1516/3003] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:31:18.608568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14725845-f346-48e6-9bb0-6e9c257c3bbd None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:18.608568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14725845-f346-48e6-9bb0-6e9c257c3bbd None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:18.609108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14725845-f346-48e6-9bb0-6e9c257c3bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:18.687164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-14725845-f346-48e6-9bb0-6e9c257c3bbd None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:18.688429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-14725845-f346-48e6-9bb0-6e9c257c3bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:18.716070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720549cd-4902-4de0-86a9-8d564025703c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:18.725500 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1488/3004] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:31:18.732512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720549cd-4902-4de0-86a9-8d564025703c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:18.741304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e1f99-a0e7-4e55-bd2f-a840ab16787c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:18.741946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e1f99-a0e7-4e55-bd2f-a840ab16787c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:18.742270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e1f99-a0e7-4e55-bd2f-a840ab16787c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:18.746848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e1f99-a0e7-4e55-bd2f-a840ab16787c admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:18.747593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e1f99-a0e7-4e55-bd2f-a840ab16787c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:31:18.747915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e1f99-a0e7-4e55-bd2f-a840ab16787c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:18.749591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e1f99-a0e7-4e55-bd2f-a840ab16787c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:18.787126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14725845-f346-48e6-9bb0-6e9c257c3bbd None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:18.805690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14725845-f346-48e6-9bb0-6e9c257c3bbd None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:18.807820 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1517/3005] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:31:18.820869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276c824-b28f-48c1-bb77-9b81d2c72534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:18.821521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276c824-b28f-48c1-bb77-9b81d2c72534 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:18.821809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276c824-b28f-48c1-bb77-9b81d2c72534 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:18.822139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276c824-b28f-48c1-bb77-9b81d2c72534 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:18.822864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276c824-b28f-48c1-bb77-9b81d2c72534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:18.824856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276c824-b28f-48c1-bb77-9b81d2c72534 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:19.001794 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1489/3006] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:31:18 2022] POST /identity/v3/projects => generated 375 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:31:19.006908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e1f99-a0e7-4e55-bd2f-a840ab16787c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:19.026216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e1f99-a0e7-4e55-bd2f-a840ab16787c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:19.272965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5d854-eb59-4160-8a54-3076946e9876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:19.273736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5d854-eb59-4160-8a54-3076946e9876 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:19.274522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5d854-eb59-4160-8a54-3076946e9876 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:19.274747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5d854-eb59-4160-8a54-3076946e9876 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:19.275413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5d854-eb59-4160-8a54-3076946e9876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:19.277645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5d854-eb59-4160-8a54-3076946e9876 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:19.419809 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1518/3007] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:31:19 2022] POST /identity/v3/users => generated 288 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:31:19.421615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276c824-b28f-48c1-bb77-9b81d2c72534 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:19.433902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276c824-b28f-48c1-bb77-9b81d2c72534 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:19.443226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c88a4d-75e8-4402-a934-b0a1ff603cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:19.444180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c88a4d-75e8-4402-a934-b0a1ff603cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:19.444616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c88a4d-75e8-4402-a934-b0a1ff603cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:19.445082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c88a4d-75e8-4402-a934-b0a1ff603cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:19.445989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c88a4d-75e8-4402-a934-b0a1ff603cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:19.448147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c88a4d-75e8-4402-a934-b0a1ff603cd2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:19.471746 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1490/3008] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:31:19.475706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5d854-eb59-4160-8a54-3076946e9876 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:19.490107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5d854-eb59-4160-8a54-3076946e9876 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:19.502980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b5511-e52f-4437-80b9-a6cb1c7a07fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:19.503642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b5511-e52f-4437-80b9-a6cb1c7a07fc admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:19.503933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b5511-e52f-4437-80b9-a6cb1c7a07fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:19.504235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b5511-e52f-4437-80b9-a6cb1c7a07fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:19.504923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b5511-e52f-4437-80b9-a6cb1c7a07fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:19.506619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b5511-e52f-4437-80b9-a6cb1c7a07fc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:19.541759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c88a4d-75e8-4402-a934-b0a1ff603cd2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:19.550473 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1519/3009] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:31:19.556677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c88a4d-75e8-4402-a934-b0a1ff603cd2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:19.571413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7ee11-ffaf-4145-8e31-1f518e62bc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:19.572372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7ee11-ffaf-4145-8e31-1f518e62bc88 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:19.572811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7ee11-ffaf-4145-8e31-1f518e62bc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:19.573239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7ee11-ffaf-4145-8e31-1f518e62bc88 admin admin] PATH_INFO: `/v3/projects/7e1c2fc2755040e4b6fcf82534d67e1c/users/46a1244a7e994427a6ff0625743956e3/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:19.609640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7ee11-ffaf-4145-8e31-1f518e62bc88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1c2fc2755040e4b6fcf82534d67e1c, user_id=46a1244a7e994427a6ff0625743956e3, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:19.613421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7ee11-ffaf-4145-8e31-1f518e62bc88 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:19.716890 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1491/3010] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:31:19 2022] PUT /identity/v3/projects/7e1c2fc2755040e4b6fcf82534d67e1c/users/46a1244a7e994427a6ff0625743956e3/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:31:19.806787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb25164-9a98-4146-8a91-d59bfd620f66 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:19.807082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb25164-9a98-4146-8a91-d59bfd620f66 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:19.807364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb25164-9a98-4146-8a91-d59bfd620f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:19.962725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4fb25164-9a98-4146-8a91-d59bfd620f66 None None] MFA Rules not processed for user `46a1244a7e994427a6ff0625743956e3`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:19.964847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4fb25164-9a98-4146-8a91-d59bfd620f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:20.007761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:20.139207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7ee11-ffaf-4145-8e31-1f518e62bc88 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:20.141836 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1520/3011] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:31:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:31:20.235702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7ee11-ffaf-4145-8e31-1f518e62bc88 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:20.246797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a82efc-ebd3-469a-9312-fbbcf9b7446f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:20.247768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a82efc-ebd3-469a-9312-fbbcf9b7446f admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:20.397485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a82efc-ebd3-469a-9312-fbbcf9b7446f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:20.397485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a82efc-ebd3-469a-9312-fbbcf9b7446f admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:20.397485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a82efc-ebd3-469a-9312-fbbcf9b7446f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:20.397485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a82efc-ebd3-469a-9312-fbbcf9b7446f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:20.518217 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1492/3012] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:31:20 2022] POST /identity/v3/projects => generated 375 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:31:20.522352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb25164-9a98-4146-8a91-d59bfd620f66 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:20.555435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb25164-9a98-4146-8a91-d59bfd620f66 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:20.649058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df42e5e-6208-4964-b32c-307eadc8820b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:20.649901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df42e5e-6208-4964-b32c-307eadc8820b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:20.650377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df42e5e-6208-4964-b32c-307eadc8820b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:20.737936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0df42e5e-6208-4964-b32c-307eadc8820b None None] MFA Rules not processed for user `613aedf1b66d48e4b4cad5e3da6ccbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:20.739474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0df42e5e-6208-4964-b32c-307eadc8820b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:20.776454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b338c3-1929-49e3-aa24-b46382d79555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:20.777372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b338c3-1929-49e3-aa24-b46382d79555 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:20.778253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b338c3-1929-49e3-aa24-b46382d79555 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:20.778707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b338c3-1929-49e3-aa24-b46382d79555 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:20.779504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b338c3-1929-49e3-aa24-b46382d79555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:20.781597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b338c3-1929-49e3-aa24-b46382d79555 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:20.823144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:20.904369 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1521/3013] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:31:20 2022] POST /identity/v3/users => generated 294 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:31:20.908067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b338c3-1929-49e3-aa24-b46382d79555 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:20.914074 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1493/3014] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:31:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:31:20.939740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b338c3-1929-49e3-aa24-b46382d79555 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:20.956399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b0159-f057-4223-8229-191d87aa69e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:20.957284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b0159-f057-4223-8229-191d87aa69e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:20.957711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b0159-f057-4223-8229-191d87aa69e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:20.958161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b0159-f057-4223-8229-191d87aa69e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:20.958973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b0159-f057-4223-8229-191d87aa69e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:20.961277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b0159-f057-4223-8229-191d87aa69e8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:20.978788 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1522/3015] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:31:20.983478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df42e5e-6208-4964-b32c-307eadc8820b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:21.005334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df42e5e-6208-4964-b32c-307eadc8820b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:21.019601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ce691-0e87-4995-85bc-9a388445c203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:21.027098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ce691-0e87-4995-85bc-9a388445c203 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:21.027098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ce691-0e87-4995-85bc-9a388445c203 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:21.027098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ce691-0e87-4995-85bc-9a388445c203 admin admin] PATH_INFO: `/v3/projects/1ead8249989a4e68b0ea86e4c9574349/users/1386f8a5945345048f7f0aa8b75567f4/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:21.036273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b0159-f057-4223-8229-191d87aa69e8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:21.042478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c80b0159-f057-4223-8229-191d87aa69e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:21.071952 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ce691-0e87-4995-85bc-9a388445c203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ead8249989a4e68b0ea86e4c9574349, user_id=1386f8a5945345048f7f0aa8b75567f4, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:21.074759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ce691-0e87-4995-85bc-9a388445c203 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:21.161073 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1494/3016] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:31:20 2022] PUT /identity/v3/projects/1ead8249989a4e68b0ea86e4c9574349/users/1386f8a5945345048f7f0aa8b75567f4/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:31:21.164782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ce691-0e87-4995-85bc-9a388445c203 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:21.242847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b0159-f057-4223-8229-191d87aa69e8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:21.295684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:21.339138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51bfd1-eac5-4527-a4ba-1c44878f20db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:21.339292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51bfd1-eac5-4527-a4ba-1c44878f20db service glance] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:21.339502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51bfd1-eac5-4527-a4ba-1c44878f20db service glance] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:21.339748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51bfd1-eac5-4527-a4ba-1c44878f20db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:21.344874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ae51bfd1-eac5-4527-a4ba-1c44878f20db service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:21.369891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ce691-0e87-4995-85bc-9a388445c203 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:21.382483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dd9b6-9e73-4217-9db3-06c1d1c05548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:21.384942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dd9b6-9e73-4217-9db3-06c1d1c05548 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:21.384942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dd9b6-9e73-4217-9db3-06c1d1c05548 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:21.384942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dd9b6-9e73-4217-9db3-06c1d1c05548 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:21.384942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822dd9b6-9e73-4217-9db3-06c1d1c05548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:21.385908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822dd9b6-9e73-4217-9db3-06c1d1c05548 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:21.414257 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1495/3017] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:31:21.416651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dd9b6-9e73-4217-9db3-06c1d1c05548 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:21.433084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dd9b6-9e73-4217-9db3-06c1d1c05548 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:21.443738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d8fa8-4553-40c0-887c-922a79d18394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:21.444765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d8fa8-4553-40c0-887c-922a79d18394 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:21.445288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d8fa8-4553-40c0-887c-922a79d18394 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:21.445784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d8fa8-4553-40c0-887c-922a79d18394 admin admin] PATH_INFO: `/v3/projects/1ead8249989a4e68b0ea86e4c9574349/users/1386f8a5945345048f7f0aa8b75567f4/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:21.449938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d8fa8-4553-40c0-887c-922a79d18394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ead8249989a4e68b0ea86e4c9574349, user_id=1386f8a5945345048f7f0aa8b75567f4, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:21.454107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d8fa8-4553-40c0-887c-922a79d18394 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:21.479306 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1496/3018] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:31:21 2022] PUT /identity/v3/projects/1ead8249989a4e68b0ea86e4c9574349/users/1386f8a5945345048f7f0aa8b75567f4/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:31:21.481349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca98b8-dc5c-4a33-b57b-4d43f83cdb04 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:21.481881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca98b8-dc5c-4a33-b57b-4d43f83cdb04 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:21.482490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca98b8-dc5c-4a33-b57b-4d43f83cdb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:21.514224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51bfd1-eac5-4527-a4ba-1c44878f20db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:21.515988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51bfd1-eac5-4527-a4ba-1c44878f20db service glance] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:21.521593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-7dca98b8-dc5c-4a33-b57b-4d43f83cdb04 None None] MFA Rules not processed for user `1386f8a5945345048f7f0aa8b75567f4`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:21.527406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7dca98b8-dc5c-4a33-b57b-4d43f83cdb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:21.541025 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1523/3019] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:31:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:31:21.629142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51bfd1-eac5-4527-a4ba-1c44878f20db service glance] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:21.639735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51bfd1-eac5-4527-a4ba-1c44878f20db service glance] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:21.656282 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1497/3020] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:31:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:31:21.674931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec4f62-d2ac-4613-82c1-74feff51ab01 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:21.675473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec4f62-d2ac-4613-82c1-74feff51ab01 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:21.676009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec4f62-d2ac-4613-82c1-74feff51ab01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:21.703860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6bec4f62-d2ac-4613-82c1-74feff51ab01 None None] MFA Rules not processed for user `46a1244a7e994427a6ff0625743956e3`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:21.717351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6bec4f62-d2ac-4613-82c1-74feff51ab01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:21.755759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:21.767637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd628e-c247-4c2b-88b6-a70be8a96dbd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:21.768585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd628e-c247-4c2b-88b6-a70be8a96dbd service glance] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:21.769047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd628e-c247-4c2b-88b6-a70be8a96dbd service glance] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:21.769395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd628e-c247-4c2b-88b6-a70be8a96dbd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:21.820039 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1498/3021] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:31:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:31:21.845252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd628e-c247-4c2b-88b6-a70be8a96dbd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:21.846783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd628e-c247-4c2b-88b6-a70be8a96dbd service glance] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:21.857150 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1524/3022] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:31:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:31:22.061223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec4f62-d2ac-4613-82c1-74feff51ab01 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:22.062888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6bec4f62-d2ac-4613-82c1-74feff51ab01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:22.089550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd628e-c247-4c2b-88b6-a70be8a96dbd service glance] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:22.091687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-44bd628e-c247-4c2b-88b6-a70be8a96dbd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:22.204252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:22.268881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd628e-c247-4c2b-88b6-a70be8a96dbd service glance] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:22.298886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febca964-c13f-4d47-a964-c93bd56d9ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:22.300289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febca964-c13f-4d47-a964-c93bd56d9ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:22.300573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febca964-c13f-4d47-a964-c93bd56d9ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:22.300852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febca964-c13f-4d47-a964-c93bd56d9ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:22.306539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-febca964-c13f-4d47-a964-c93bd56d9ad1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:22.520377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec4f62-d2ac-4613-82c1-74feff51ab01 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:22.550946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febca964-c13f-4d47-a964-c93bd56d9ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:22.552907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febca964-c13f-4d47-a964-c93bd56d9ad1 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:22.563162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287c0a3-3c2d-42b1-ad5c-a473c4ce9840 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:22.565282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287c0a3-3c2d-42b1-ad5c-a473c4ce9840 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:22.566806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287c0a3-3c2d-42b1-ad5c-a473c4ce9840 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:22.568875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287c0a3-3c2d-42b1-ad5c-a473c4ce9840 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:22.574541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1287c0a3-3c2d-42b1-ad5c-a473c4ce9840 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:22.608148 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1525/3023] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:31:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:31:22.615822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287c0a3-3c2d-42b1-ad5c-a473c4ce9840 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:22.625573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287c0a3-3c2d-42b1-ad5c-a473c4ce9840 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:22.679479 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1499/3024] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:31:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:31:23.832174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febca964-c13f-4d47-a964-c93bd56d9ad1 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:23.834114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-febca964-c13f-4d47-a964-c93bd56d9ad1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:23.886958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febca964-c13f-4d47-a964-c93bd56d9ad1 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:23.896474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287c0a3-3c2d-42b1-ad5c-a473c4ce9840 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:23.897890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1287c0a3-3c2d-42b1-ad5c-a473c4ce9840 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:23.901676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb6221-fa03-4c6f-baa1-69fa6d657c26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:23.911665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb6221-fa03-4c6f-baa1-69fa6d657c26 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:23.911665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb6221-fa03-4c6f-baa1-69fa6d657c26 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:23.911665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb6221-fa03-4c6f-baa1-69fa6d657c26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:23.911665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fbcb6221-fa03-4c6f-baa1-69fa6d657c26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:23.933785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb6221-fa03-4c6f-baa1-69fa6d657c26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:23.943822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb6221-fa03-4c6f-baa1-69fa6d657c26 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:23.976683 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1526/3025] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:31:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:31:24.092868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081679f-5b0b-44a6-9893-b1c607ec7303 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:24.093410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081679f-5b0b-44a6-9893-b1c607ec7303 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:24.093900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081679f-5b0b-44a6-9893-b1c607ec7303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:24.171033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f081679f-5b0b-44a6-9893-b1c607ec7303 None None] MFA Rules not processed for user `4ba8b60cf1164a388f626b0708556775`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:24.174341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f081679f-5b0b-44a6-9893-b1c607ec7303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:24.304562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287c0a3-3c2d-42b1-ad5c-a473c4ce9840 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:24.338801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a3898-371b-483e-b305-7d3ed1e210c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:24.339393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a3898-371b-483e-b305-7d3ed1e210c0 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:24.339683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a3898-371b-483e-b305-7d3ed1e210c0 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:24.344346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a3898-371b-483e-b305-7d3ed1e210c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:24.361199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a18a3898-371b-483e-b305-7d3ed1e210c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:24.418331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a3898-371b-483e-b305-7d3ed1e210c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:24.420279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a3898-371b-483e-b305-7d3ed1e210c0 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:24.432894 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1527/3026] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:31:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:31:24.434475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081679f-5b0b-44a6-9893-b1c607ec7303 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:24.458297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081679f-5b0b-44a6-9893-b1c607ec7303 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:24.464666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aeb48b-cc68-4dc4-917c-340f30466283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:24.465678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeb48b-cc68-4dc4-917c-340f30466283 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:24.466227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeb48b-cc68-4dc4-917c-340f30466283 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:24.466710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeb48b-cc68-4dc4-917c-340f30466283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:24.468813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-04aeb48b-cc68-4dc4-917c-340f30466283 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:24.474188 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1500/3027] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:31:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:31:24.475198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a3898-371b-483e-b305-7d3ed1e210c0 service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:24.495098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aeb48b-cc68-4dc4-917c-340f30466283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:24.496920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aeb48b-cc68-4dc4-917c-340f30466283 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:24.522561 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1528/3028] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:31:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:31:24.525160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea9f92-1e52-45f7-8d5f-ad063ecaf2b8 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:24.525277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a3898-371b-483e-b305-7d3ed1e210c0 service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:24.526308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea9f92-1e52-45f7-8d5f-ad063ecaf2b8 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:24.526800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea9f92-1e52-45f7-8d5f-ad063ecaf2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:24.554725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72f22e-26b4-4cc6-8cae-a3996090b0f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:24.555190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72f22e-26b4-4cc6-8cae-a3996090b0f3 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:24.555443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72f22e-26b4-4cc6-8cae-a3996090b0f3 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:24.555731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72f22e-26b4-4cc6-8cae-a3996090b0f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:24.574125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4dea9f92-1e52-45f7-8d5f-ad063ecaf2b8 None None] MFA Rules not processed for user `4ba8b60cf1164a388f626b0708556775`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:24.576063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4dea9f92-1e52-45f7-8d5f-ad063ecaf2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:24.586827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72f22e-26b4-4cc6-8cae-a3996090b0f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:24.588464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72f22e-26b4-4cc6-8cae-a3996090b0f3 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:24.600233 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1529/3029] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:31:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:31:24.649293 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1501/3030] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:31:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:31:25.075612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea9f92-1e52-45f7-8d5f-ad063ecaf2b8 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:25.102908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea9f92-1e52-45f7-8d5f-ad063ecaf2b8 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:25.129810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce7aa2-794f-4036-8012-b820a7e6f10d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:25.130780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce7aa2-794f-4036-8012-b820a7e6f10d service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:25.134893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce7aa2-794f-4036-8012-b820a7e6f10d service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:25.134893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce7aa2-794f-4036-8012-b820a7e6f10d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:25.173605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce7aa2-794f-4036-8012-b820a7e6f10d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:25.175851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce7aa2-794f-4036-8012-b820a7e6f10d service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:25.230669 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1530/3031] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:31:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:31:27.382884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72f22e-26b4-4cc6-8cae-a3996090b0f3 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:27.429719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72f22e-26b4-4cc6-8cae-a3996090b0f3 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:27.477011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27494dd4-d7a0-4179-a3ed-ffac27faecd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:27.480234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27494dd4-d7a0-4179-a3ed-ffac27faecd5 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:27.490355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27494dd4-d7a0-4179-a3ed-ffac27faecd5 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:27.498279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27494dd4-d7a0-4179-a3ed-ffac27faecd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:27.505939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-27494dd4-d7a0-4179-a3ed-ffac27faecd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:27.552664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27494dd4-d7a0-4179-a3ed-ffac27faecd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:27.554242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27494dd4-d7a0-4179-a3ed-ffac27faecd5 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:27.577452 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1502/3032] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:31:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:31:29.553969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98a8c3-511c-4c8a-86b2-86910cf56fe0 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:29.554437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98a8c3-511c-4c8a-86b2-86910cf56fe0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:29.554516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98a8c3-511c-4c8a-86b2-86910cf56fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:29.660264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:29.741133 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-dc98a8c3-511c-4c8a-86b2-86910cf56fe0 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:29.743846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-dc98a8c3-511c-4c8a-86b2-86910cf56fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:29.973920 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1531/3033] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:31:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:31:29.998621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27494dd4-d7a0-4179-a3ed-ffac27faecd5 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:30.002651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-27494dd4-d7a0-4179-a3ed-ffac27faecd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:30.027343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:30.144776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27494dd4-d7a0-4179-a3ed-ffac27faecd5 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:30.152139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd64031-cb42-4475-b939-64fb5e1ba06c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:30.153244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd64031-cb42-4475-b939-64fb5e1ba06c service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:30.153754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd64031-cb42-4475-b939-64fb5e1ba06c service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:30.154292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd64031-cb42-4475-b939-64fb5e1ba06c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:30.169404 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd64031-cb42-4475-b939-64fb5e1ba06c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:30.171716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd64031-cb42-4475-b939-64fb5e1ba06c service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:30.216683 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1503/3034] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:31:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 03:31:33.349135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c85d2-870d-4daf-bbb7-325c70be250c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:33.350238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c85d2-870d-4daf-bbb7-325c70be250c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:33.350722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c85d2-870d-4daf-bbb7-325c70be250c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:33.409270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-810c85d2-870d-4daf-bbb7-325c70be250c None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:33.411689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-810c85d2-870d-4daf-bbb7-325c70be250c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:33.437528 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1532/3035] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:31:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:31:33.453457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd64031-cb42-4475-b939-64fb5e1ba06c service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:33.470089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd64031-cb42-4475-b939-64fb5e1ba06c service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:33.482482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b32b2f-9e07-4692-b8b9-d9d920039743 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:33.487564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b32b2f-9e07-4692-b8b9-d9d920039743 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:33.487855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b32b2f-9e07-4692-b8b9-d9d920039743 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:33.488315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b32b2f-9e07-4692-b8b9-d9d920039743 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:33.508577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b32b2f-9e07-4692-b8b9-d9d920039743 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:33.512981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b32b2f-9e07-4692-b8b9-d9d920039743 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:33.547178 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1504/3036] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:31:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:31:34.966060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c85d2-870d-4daf-bbb7-325c70be250c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:34.968799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-810c85d2-870d-4daf-bbb7-325c70be250c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:34.989838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c85d2-870d-4daf-bbb7-325c70be250c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:35.008848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50978c37-bd0c-4b03-a15e-202263ad60cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:35.009689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50978c37-bd0c-4b03-a15e-202263ad60cb service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:35.011812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50978c37-bd0c-4b03-a15e-202263ad60cb service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:35.012312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50978c37-bd0c-4b03-a15e-202263ad60cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:35.035259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-50978c37-bd0c-4b03-a15e-202263ad60cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:35.060583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50978c37-bd0c-4b03-a15e-202263ad60cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:35.062361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50978c37-bd0c-4b03-a15e-202263ad60cb service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:35.117224 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1533/3037] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:31:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:31:36.258716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73270b-c955-4781-ae9e-8f2f71eb2afa None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:36.259283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73270b-c955-4781-ae9e-8f2f71eb2afa None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:36.259381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73270b-c955-4781-ae9e-8f2f71eb2afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:36.307150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-2b73270b-c955-4781-ae9e-8f2f71eb2afa None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:36.321903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2b73270b-c955-4781-ae9e-8f2f71eb2afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:36.342070 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1505/3038] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:31:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:31:36.372823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50978c37-bd0c-4b03-a15e-202263ad60cb service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:36.396207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50978c37-bd0c-4b03-a15e-202263ad60cb service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:36.407497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7faba2-a6c8-40f5-ae60-927d7e95b670 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:36.410998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7faba2-a6c8-40f5-ae60-927d7e95b670 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:36.411754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7faba2-a6c8-40f5-ae60-927d7e95b670 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:36.412251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7faba2-a6c8-40f5-ae60-927d7e95b670 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:36.435346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7faba2-a6c8-40f5-ae60-927d7e95b670 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:36.437766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7faba2-a6c8-40f5-ae60-927d7e95b670 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:36.459220 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1534/3039] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:31:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:31:46.292244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=46 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:46.449566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=47 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:50.993870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73270b-c955-4781-ae9e-8f2f71eb2afa None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:51.031393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73270b-c955-4781-ae9e-8f2f71eb2afa None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:51.040683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e48adc-e148-4435-a928-0fa0e92d6a5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:51.040683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e48adc-e148-4435-a928-0fa0e92d6a5a service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:51.040683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e48adc-e148-4435-a928-0fa0e92d6a5a service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:51.040683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e48adc-e148-4435-a928-0fa0e92d6a5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:51.059949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e48adc-e148-4435-a928-0fa0e92d6a5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:51.066114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e48adc-e148-4435-a928-0fa0e92d6a5a service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:51.097228 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1506/3040] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:31:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:31:52.092316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7faba2-a6c8-40f5-ae60-927d7e95b670 service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:52.109118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7faba2-a6c8-40f5-ae60-927d7e95b670 service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:52.127681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d35d5b-68a5-4cd2-89cd-265857e97ec9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:52.130963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d35d5b-68a5-4cd2-89cd-265857e97ec9 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:52.131281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d35d5b-68a5-4cd2-89cd-265857e97ec9 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:52.133675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d35d5b-68a5-4cd2-89cd-265857e97ec9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:52.144459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-06d35d5b-68a5-4cd2-89cd-265857e97ec9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:52.210402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d35d5b-68a5-4cd2-89cd-265857e97ec9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:52.213149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d35d5b-68a5-4cd2-89cd-265857e97ec9 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:52.243296 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1535/3041] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:31:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:31:52.345308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e48adc-e148-4435-a928-0fa0e92d6a5a service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:52.347003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-81e48adc-e148-4435-a928-0fa0e92d6a5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:52.382449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e48adc-e148-4435-a928-0fa0e92d6a5a service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:52.403504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c9c5d-d5b7-47a2-b682-709a2acd4d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:52.404182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c9c5d-d5b7-47a2-b682-709a2acd4d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:52.404470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c9c5d-d5b7-47a2-b682-709a2acd4d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:52.406102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c9c5d-d5b7-47a2-b682-709a2acd4d1c admin admin] PATH_INFO: `/v3/users/ba3ce7f040d24c33bcf9b97d1ef25268` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:52.407790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c9c5d-d5b7-47a2-b682-709a2acd4d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba3ce7f040d24c33bcf9b97d1ef25268)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:52.418468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c9c5d-d5b7-47a2-b682-709a2acd4d1c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:52.774743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-756c9c5d-d5b7-47a2-b682-709a2acd4d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba3ce7f040d24c33bcf9b97d1ef25268'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:52.775813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-756c9c5d-d5b7-47a2-b682-709a2acd4d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba3ce7f040d24c33bcf9b97d1ef25268'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:52.789176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-756c9c5d-d5b7-47a2-b682-709a2acd4d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba3ce7f040d24c33bcf9b97d1ef25268'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:52.823099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-756c9c5d-d5b7-47a2-b682-709a2acd4d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba3ce7f040d24c33bcf9b97d1ef25268'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:52.919890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-756c9c5d-d5b7-47a2-b682-709a2acd4d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba3ce7f040d24c33bcf9b97d1ef25268'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:52.939399 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1507/3042] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:31:52 2022] DELETE /identity/v3/users/ba3ce7f040d24c33bcf9b97d1ef25268 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:31:53.251626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d35d5b-68a5-4cd2-89cd-265857e97ec9 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:53.263190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d35d5b-68a5-4cd2-89cd-265857e97ec9 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:53.337827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987f731-d196-40a5-a764-0ff6a044934f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:53.337827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987f731-d196-40a5-a764-0ff6a044934f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:53.337827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987f731-d196-40a5-a764-0ff6a044934f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:53.337827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987f731-d196-40a5-a764-0ff6a044934f admin admin] PATH_INFO: `/v3/projects/3b1cf79289db4d7883d93ec3fe908d66` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:53.338938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987f731-d196-40a5-a764-0ff6a044934f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b1cf79289db4d7883d93ec3fe908d66)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:53.338938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987f731-d196-40a5-a764-0ff6a044934f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:53.446956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b987f731-d196-40a5-a764-0ff6a044934f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b1cf79289db4d7883d93ec3fe908d66', 'request_id': 'req-b987f731-d196-40a5-a764-0ff6a044934f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:53.456876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b987f731-d196-40a5-a764-0ff6a044934f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b1cf79289db4d7883d93ec3fe908d66', 'request_id': 'req-b987f731-d196-40a5-a764-0ff6a044934f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:53.463840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b987f731-d196-40a5-a764-0ff6a044934f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b1cf79289db4d7883d93ec3fe908d66', 'request_id': 'req-b987f731-d196-40a5-a764-0ff6a044934f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:54.330784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b987f731-d196-40a5-a764-0ff6a044934f admin admin] The token cache is being invalidate because project 3b1cf79289db4d7883d93ec3fe908d66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:31:54.331431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b987f731-d196-40a5-a764-0ff6a044934f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:54.331817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b987f731-d196-40a5-a764-0ff6a044934f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:54.333357 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1536/3043] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:31:53 2022] DELETE /identity/v3/projects/3b1cf79289db4d7883d93ec3fe908d66 => generated 0 bytes in 1083 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:31:54.337502 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c9c5d-d5b7-47a2-b682-709a2acd4d1c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:54.338935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-756c9c5d-d5b7-47a2-b682-709a2acd4d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:54.353581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c9c5d-d5b7-47a2-b682-709a2acd4d1c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:54.435797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df1e5e-dad4-4b15-a2d3-f3de631525ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:54.436435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df1e5e-dad4-4b15-a2d3-f3de631525ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:54.436720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df1e5e-dad4-4b15-a2d3-f3de631525ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:54.437000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df1e5e-dad4-4b15-a2d3-f3de631525ef admin admin] PATH_INFO: `/v3/users/4a882b983a3b48bfada30b64b7002993` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:54.438260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df1e5e-dad4-4b15-a2d3-f3de631525ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a882b983a3b48bfada30b64b7002993)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:54.440336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df1e5e-dad4-4b15-a2d3-f3de631525ef admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:54.703947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-21df1e5e-dad4-4b15-a2d3-f3de631525ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a882b983a3b48bfada30b64b7002993'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:54.704753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-21df1e5e-dad4-4b15-a2d3-f3de631525ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a882b983a3b48bfada30b64b7002993'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:54.716496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-21df1e5e-dad4-4b15-a2d3-f3de631525ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a882b983a3b48bfada30b64b7002993'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:54.724343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:54.734863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-21df1e5e-dad4-4b15-a2d3-f3de631525ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a882b983a3b48bfada30b64b7002993'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:54.815518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-21df1e5e-dad4-4b15-a2d3-f3de631525ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a882b983a3b48bfada30b64b7002993'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:54.828320 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1508/3044] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:31:54 2022] DELETE /identity/v3/users/4a882b983a3b48bfada30b64b7002993 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:31:55.295232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987f731-d196-40a5-a764-0ff6a044934f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:55.297255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b987f731-d196-40a5-a764-0ff6a044934f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:55.333190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987f731-d196-40a5-a764-0ff6a044934f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:55.437084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c340a-a5ae-4743-86b1-bce1cf3388d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:55.439424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c340a-a5ae-4743-86b1-bce1cf3388d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:55.439867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c340a-a5ae-4743-86b1-bce1cf3388d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:55.440177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c340a-a5ae-4743-86b1-bce1cf3388d5 admin admin] PATH_INFO: `/v3/projects/cfecc4615ae34ec1af0db5272f29aae5` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:55.441613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c340a-a5ae-4743-86b1-bce1cf3388d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfecc4615ae34ec1af0db5272f29aae5)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:55.444583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c340a-a5ae-4743-86b1-bce1cf3388d5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:55.489478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:55.602904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df1e5e-dad4-4b15-a2d3-f3de631525ef admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:55.604329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-21df1e5e-dad4-4b15-a2d3-f3de631525ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:55.685402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df1e5e-dad4-4b15-a2d3-f3de631525ef admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:55.691385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc547e-58e5-4e98-aab7-9077f115b443 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:55.691987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc547e-58e5-4e98-aab7-9077f115b443 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:55.692269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc547e-58e5-4e98-aab7-9077f115b443 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:55.692665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc547e-58e5-4e98-aab7-9077f115b443 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:55.695821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a8fc547e-58e5-4e98-aab7-9077f115b443 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:55.742311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-571c340a-a5ae-4743-86b1-bce1cf3388d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfecc4615ae34ec1af0db5272f29aae5', 'request_id': 'req-571c340a-a5ae-4743-86b1-bce1cf3388d5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:55.750585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-571c340a-a5ae-4743-86b1-bce1cf3388d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfecc4615ae34ec1af0db5272f29aae5', 'request_id': 'req-571c340a-a5ae-4743-86b1-bce1cf3388d5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:55.757260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-571c340a-a5ae-4743-86b1-bce1cf3388d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfecc4615ae34ec1af0db5272f29aae5', 'request_id': 'req-571c340a-a5ae-4743-86b1-bce1cf3388d5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:55.769690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc547e-58e5-4e98-aab7-9077f115b443 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:55.771566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc547e-58e5-4e98-aab7-9077f115b443 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:55.781154 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1509/3045] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:31:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:31:55.888328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-571c340a-a5ae-4743-86b1-bce1cf3388d5 admin admin] The token cache is being invalidate because project cfecc4615ae34ec1af0db5272f29aae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:31:55.888735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-571c340a-a5ae-4743-86b1-bce1cf3388d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:55.889427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-571c340a-a5ae-4743-86b1-bce1cf3388d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:31:55.891013 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1537/3046] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:31:55 2022] DELETE /identity/v3/projects/cfecc4615ae34ec1af0db5272f29aae5 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:31:55.896770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc9494-fbc0-4fd8-8f14-d03254443c46 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:55.897355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc9494-fbc0-4fd8-8f14-d03254443c46 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:55.897612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc9494-fbc0-4fd8-8f14-d03254443c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:55.919996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-65dc9494-fbc0-4fd8-8f14-d03254443c46 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:55.921359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-65dc9494-fbc0-4fd8-8f14-d03254443c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:56.002019 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1510/3047] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:31:56.010729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee2af9-898c-4b18-871e-f11f5254368c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:56.011106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee2af9-898c-4b18-871e-f11f5254368c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:56.011445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee2af9-898c-4b18-871e-f11f5254368c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:56.031484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7fee2af9-898c-4b18-871e-f11f5254368c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:56.032697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7fee2af9-898c-4b18-871e-f11f5254368c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:56.041834 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1538/3048] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:31:56.046218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc9494-fbc0-4fd8-8f14-d03254443c46 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:56.057328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc9494-fbc0-4fd8-8f14-d03254443c46 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:56.062163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c2d0d-6918-4634-a8cf-4f57899fe551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:56.062799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c2d0d-6918-4634-a8cf-4f57899fe551 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:56.063098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c2d0d-6918-4634-a8cf-4f57899fe551 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:56.063575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c2d0d-6918-4634-a8cf-4f57899fe551 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:56.064445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c2d0d-6918-4634-a8cf-4f57899fe551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:31:56.064757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c2d0d-6918-4634-a8cf-4f57899fe551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:56.066384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c2d0d-6918-4634-a8cf-4f57899fe551 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:56.081267 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1511/3049] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:31:56.086073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee2af9-898c-4b18-871e-f11f5254368c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:56.100535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee2af9-898c-4b18-871e-f11f5254368c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:56.103882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762456f-f3e2-419d-8564-4a6da140efd2 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:56.104181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762456f-f3e2-419d-8564-4a6da140efd2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:56.104769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762456f-f3e2-419d-8564-4a6da140efd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:56.106866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ffb25-6ef4-4221-ada8-882238d98c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:56.108102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ffb25-6ef4-4221-ada8-882238d98c0b admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:56.108509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ffb25-6ef4-4221-ada8-882238d98c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:56.108794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ffb25-6ef4-4221-ada8-882238d98c0b admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:56.109639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ffb25-6ef4-4221-ada8-882238d98c0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:56.113115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ffb25-6ef4-4221-ada8-882238d98c0b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:56.114150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:56.131388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b762456f-f3e2-419d-8564-4a6da140efd2 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:56.132902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b762456f-f3e2-419d-8564-4a6da140efd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:56.190749 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1512/3050] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:31:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:31:56.202672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762456f-f3e2-419d-8564-4a6da140efd2 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:56.204033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b762456f-f3e2-419d-8564-4a6da140efd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:56.278083 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1539/3051] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:31:56 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:31:56.278256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762456f-f3e2-419d-8564-4a6da140efd2 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:56.279129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ffb25-6ef4-4221-ada8-882238d98c0b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:56.350931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e97fc7-8126-4ce3-81e4-1d2325efea5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:56.351542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e97fc7-8126-4ce3-81e4-1d2325efea5a service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:56.351824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e97fc7-8126-4ce3-81e4-1d2325efea5a service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:56.352095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e97fc7-8126-4ce3-81e4-1d2325efea5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:56.352892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ffb25-6ef4-4221-ada8-882238d98c0b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:56.358101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a42e74-6a67-4580-8fbb-3fcd59ee97f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:56.358946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a42e74-6a67-4580-8fbb-3fcd59ee97f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:56.359412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a42e74-6a67-4580-8fbb-3fcd59ee97f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:56.359739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a42e74-6a67-4580-8fbb-3fcd59ee97f2 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:56.360524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a42e74-6a67-4580-8fbb-3fcd59ee97f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:56.364034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a42e74-6a67-4580-8fbb-3fcd59ee97f2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:56.424230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e97fc7-8126-4ce3-81e4-1d2325efea5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:56.425935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e97fc7-8126-4ce3-81e4-1d2325efea5a service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:56.435310 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1513/3052] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:31:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 03:31:56.468694 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1540/3053] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:31:56 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:31:56.473386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e97fc7-8126-4ce3-81e4-1d2325efea5a service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:56.485108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e97fc7-8126-4ce3-81e4-1d2325efea5a service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:56.489824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fbcf1-4dbb-46e5-80db-ce41d4e5147d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:56.490495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fbcf1-4dbb-46e5-80db-ce41d4e5147d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:56.490829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fbcf1-4dbb-46e5-80db-ce41d4e5147d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:56.491190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fbcf1-4dbb-46e5-80db-ce41d4e5147d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:56.491923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fbcf1-4dbb-46e5-80db-ce41d4e5147d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:56.493580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fbcf1-4dbb-46e5-80db-ce41d4e5147d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:56.507138 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1514/3054] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:31:56.508297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a42e74-6a67-4580-8fbb-3fcd59ee97f2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:56.519463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a42e74-6a67-4580-8fbb-3fcd59ee97f2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:56.524426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada5a58-0116-449f-a266-5e33c55114b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:56.525044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada5a58-0116-449f-a266-5e33c55114b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:56.527567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada5a58-0116-449f-a266-5e33c55114b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:56.527567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada5a58-0116-449f-a266-5e33c55114b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:56.527567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada5a58-0116-449f-a266-5e33c55114b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:56.527838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada5a58-0116-449f-a266-5e33c55114b2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:56.539267 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1541/3055] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:31:56.543517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fbcf1-4dbb-46e5-80db-ce41d4e5147d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:56.569288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:56.574998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fbcf1-4dbb-46e5-80db-ce41d4e5147d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:56.583686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef385d-23ec-48da-8b06-950c4e5774e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:56.584775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef385d-23ec-48da-8b06-950c4e5774e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:56.585204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef385d-23ec-48da-8b06-950c4e5774e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:56.585667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef385d-23ec-48da-8b06-950c4e5774e6 admin admin] PATH_INFO: `/v3/projects/fecf7f9ae0304ca6b65b95e3a32826a2/users/cc9cd9003dd043b59884af6585493383/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:56.612170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef385d-23ec-48da-8b06-950c4e5774e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fecf7f9ae0304ca6b65b95e3a32826a2, user_id=cc9cd9003dd043b59884af6585493383, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:56.616698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef385d-23ec-48da-8b06-950c4e5774e6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:56.717307 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1515/3056] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:31:56 2022] PUT /identity/v3/projects/fecf7f9ae0304ca6b65b95e3a32826a2/users/cc9cd9003dd043b59884af6585493383/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:31:56.729244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440be5b-ce6d-4a49-a73b-4764a7244e3b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:56.729770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440be5b-ce6d-4a49-a73b-4764a7244e3b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:56.730262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440be5b-ce6d-4a49-a73b-4764a7244e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:56.770628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d440be5b-ce6d-4a49-a73b-4764a7244e3b None None] MFA Rules not processed for user `cc9cd9003dd043b59884af6585493383`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:56.772140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d440be5b-ce6d-4a49-a73b-4764a7244e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:56.848177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:56.885668 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1542/3057] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:31:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:31:56.889919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef385d-23ec-48da-8b06-950c4e5774e6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:57.057198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef385d-23ec-48da-8b06-950c4e5774e6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:57.065226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81915b90-2f0b-49b9-bf22-dfa6b71de66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:57.065226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81915b90-2f0b-49b9-bf22-dfa6b71de66b admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:57.065226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81915b90-2f0b-49b9-bf22-dfa6b71de66b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:57.065226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81915b90-2f0b-49b9-bf22-dfa6b71de66b admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:57.071495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81915b90-2f0b-49b9-bf22-dfa6b71de66b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:57.072933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81915b90-2f0b-49b9-bf22-dfa6b71de66b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:57.204210 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1516/3058] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:31:56 2022] POST /identity/v3/projects => generated 375 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:31:57.206154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440be5b-ce6d-4a49-a73b-4764a7244e3b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:57.230259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440be5b-ce6d-4a49-a73b-4764a7244e3b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:57.477568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac1599-f046-40e6-af89-2a3e461c1512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:57.478499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac1599-f046-40e6-af89-2a3e461c1512 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:57.478790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac1599-f046-40e6-af89-2a3e461c1512 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:57.479071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac1599-f046-40e6-af89-2a3e461c1512 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:57.479721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac1599-f046-40e6-af89-2a3e461c1512 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:57.498888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac1599-f046-40e6-af89-2a3e461c1512 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:57.639081 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1543/3059] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:31:57 2022] POST /identity/v3/users => generated 294 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:31:57.645539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81915b90-2f0b-49b9-bf22-dfa6b71de66b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:57.663626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81915b90-2f0b-49b9-bf22-dfa6b71de66b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:57.674745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b34bb-c723-40e6-87f3-3a134a110f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:57.676393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b34bb-c723-40e6-87f3-3a134a110f36 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:57.676850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b34bb-c723-40e6-87f3-3a134a110f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:57.677271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b34bb-c723-40e6-87f3-3a134a110f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:57.678710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b34bb-c723-40e6-87f3-3a134a110f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:57.682188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b34bb-c723-40e6-87f3-3a134a110f36 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:57.699966 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1517/3060] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:31:57.704766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac1599-f046-40e6-af89-2a3e461c1512 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:57.723465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac1599-f046-40e6-af89-2a3e461c1512 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:57.732274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6045d-cec5-4d92-b498-e89372182012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:57.733728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6045d-cec5-4d92-b498-e89372182012 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:57.735101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6045d-cec5-4d92-b498-e89372182012 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:57.735538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6045d-cec5-4d92-b498-e89372182012 admin admin] PATH_INFO: `/v3/projects/58e7c3f2bbe341189793cb491e85998a/users/521177e28585427abc7f27deabfc9486/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:57.766328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6045d-cec5-4d92-b498-e89372182012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e7c3f2bbe341189793cb491e85998a, user_id=521177e28585427abc7f27deabfc9486, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:57.770297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6045d-cec5-4d92-b498-e89372182012 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:57.910360 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1544/3061] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:31:57 2022] PUT /identity/v3/projects/58e7c3f2bbe341189793cb491e85998a/users/521177e28585427abc7f27deabfc9486/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:31:57.914462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b34bb-c723-40e6-87f3-3a134a110f36 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:57.934865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b34bb-c723-40e6-87f3-3a134a110f36 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:58.113023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c1162-a56e-4679-9df2-75c9dc73e838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:58.113646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c1162-a56e-4679-9df2-75c9dc73e838 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:58.113936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c1162-a56e-4679-9df2-75c9dc73e838 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:58.114248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c1162-a56e-4679-9df2-75c9dc73e838 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:58.119501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c1162-a56e-4679-9df2-75c9dc73e838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:58.122999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c1162-a56e-4679-9df2-75c9dc73e838 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:58.160024 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1518/3062] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:31:58.168160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6045d-cec5-4d92-b498-e89372182012 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:58.197295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6045d-cec5-4d92-b498-e89372182012 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:58.226240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84483d5-088a-498e-8c8a-75ed9a9604a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:58.226937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84483d5-088a-498e-8c8a-75ed9a9604a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:58.227297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84483d5-088a-498e-8c8a-75ed9a9604a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:58.227547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84483d5-088a-498e-8c8a-75ed9a9604a7 admin admin] PATH_INFO: `/v3/projects/58e7c3f2bbe341189793cb491e85998a/users/521177e28585427abc7f27deabfc9486/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:58.234931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84483d5-088a-498e-8c8a-75ed9a9604a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e7c3f2bbe341189793cb491e85998a, user_id=521177e28585427abc7f27deabfc9486, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:58.238397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84483d5-088a-498e-8c8a-75ed9a9604a7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:58.265067 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1545/3063] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:31:58 2022] PUT /identity/v3/projects/58e7c3f2bbe341189793cb491e85998a/users/521177e28585427abc7f27deabfc9486/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:31:58.276482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3204a-fb4e-40aa-9d13-0e311d107e02 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:58.276771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3204a-fb4e-40aa-9d13-0e311d107e02 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:58.277048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3204a-fb4e-40aa-9d13-0e311d107e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:58.336098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8bb3204a-fb4e-40aa-9d13-0e311d107e02 None None] MFA Rules not processed for user `521177e28585427abc7f27deabfc9486`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:31:58.337349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8bb3204a-fb4e-40aa-9d13-0e311d107e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:58.364920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:58.500458 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1519/3064] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:31:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:31:58.508398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84483d5-088a-498e-8c8a-75ed9a9604a7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:58.525254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84483d5-088a-498e-8c8a-75ed9a9604a7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:58.531472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc011c3-26da-4640-904f-0bb5fb2fcdd6 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521177e28585427abc7f27deabfc9486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e7c3f2bbe341189793cb491e85998a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:58.532902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc011c3-26da-4640-904f-0bb5fb2fcdd6 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:58.533992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc011c3-26da-4640-904f-0bb5fb2fcdd6 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:58.534446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc011c3-26da-4640-904f-0bb5fb2fcdd6 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:58.536765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc011c3-26da-4640-904f-0bb5fb2fcdd6 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:31:58.537245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc011c3-26da-4640-904f-0bb5fb2fcdd6 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:58.539386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc011c3-26da-4640-904f-0bb5fb2fcdd6 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:58.561314 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1546/3065] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:31:58.562603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3204a-fb4e-40aa-9d13-0e311d107e02 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:58.573661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3204a-fb4e-40aa-9d13-0e311d107e02 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:58.579703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514be42-4228-49f1-9780-04f44f09c482 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521177e28585427abc7f27deabfc9486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e7c3f2bbe341189793cb491e85998a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:58.580935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514be42-4228-49f1-9780-04f44f09c482 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:58.581483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514be42-4228-49f1-9780-04f44f09c482 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:58.581837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514be42-4228-49f1-9780-04f44f09c482 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:58.582586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514be42-4228-49f1-9780-04f44f09c482 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:58.585234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514be42-4228-49f1-9780-04f44f09c482 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:58.715503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc011c3-26da-4640-904f-0bb5fb2fcdd6 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:58.716808 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1520/3066] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:31:58 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:31:58.729839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc011c3-26da-4640-904f-0bb5fb2fcdd6 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:58.827659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49944531-2cb0-46b6-b3ab-45a8fc7f612e tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521177e28585427abc7f27deabfc9486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e7c3f2bbe341189793cb491e85998a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:58.828308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49944531-2cb0-46b6-b3ab-45a8fc7f612e tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:58.828653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49944531-2cb0-46b6-b3ab-45a8fc7f612e tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:58.828935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49944531-2cb0-46b6-b3ab-45a8fc7f612e tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:58.829605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49944531-2cb0-46b6-b3ab-45a8fc7f612e tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:31:58.831575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49944531-2cb0-46b6-b3ab-45a8fc7f612e tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:58.842140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49944531-2cb0-46b6-b3ab-45a8fc7f612e tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:58.873030 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1547/3067] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:31:59.394832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514be42-4228-49f1-9780-04f44f09c482 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:59.396818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1514be42-4228-49f1-9780-04f44f09c482 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:31:59.542358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514be42-4228-49f1-9780-04f44f09c482 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:59.551055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3145a-1782-4847-bd8d-759f434cf84b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:59.551703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3145a-1782-4847-bd8d-759f434cf84b service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:59.551990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3145a-1782-4847-bd8d-759f434cf84b service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:59.578711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3145a-1782-4847-bd8d-759f434cf84b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:59.609821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3145a-1782-4847-bd8d-759f434cf84b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:59.613740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3145a-1782-4847-bd8d-759f434cf84b service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:59.646744 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1521/3068] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:31:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:31:59.676273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427914cb-1180-4d98-bd15-86b149a29f62 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:59.676806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427914cb-1180-4d98-bd15-86b149a29f62 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:59.676806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427914cb-1180-4d98-bd15-86b149a29f62 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:59.678202 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1548/3069] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:31:59.687565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3145a-1782-4847-bd8d-759f434cf84b service nova] Authenticating service token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:31:59.702105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3145a-1782-4847-bd8d-759f434cf84b service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:31:59.727840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3145a-1782-4847-bd8d-759f434cf84b service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:31:59.733095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988aa94-ca0d-481b-8b94-9f85bcf3c19b tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521177e28585427abc7f27deabfc9486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e7c3f2bbe341189793cb491e85998a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:31:59.733949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988aa94-ca0d-481b-8b94-9f85bcf3c19b tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:31:59.734422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988aa94-ca0d-481b-8b94-9f85bcf3c19b tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:31:59.734892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988aa94-ca0d-481b-8b94-9f85bcf3c19b tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] PATH_INFO: `/v3/projects/2fb7e30be426453ea5ed12eea8228a1e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:31:59.736351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988aa94-ca0d-481b-8b94-9f85bcf3c19b tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Authorizing `identity:get_project(project_id=2fb7e30be426453ea5ed12eea8228a1e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:31:59.739035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988aa94-ca0d-481b-8b94-9f85bcf3c19b tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:31:59.741073 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1522/3070] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:31:59 2022] GET /identity/v3/projects/2fb7e30be426453ea5ed12eea8228a1e => generated 371 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:32:00.192320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4fc15-017c-4b51-9568-2aca2dd7061b None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:00.198679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4fc15-017c-4b51-9568-2aca2dd7061b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:00.199385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4fc15-017c-4b51-9568-2aca2dd7061b None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:00.200943 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1549/3071] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:32:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:32:00.207137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988aa94-ca0d-481b-8b94-9f85bcf3c19b tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Authenticating service token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:32:00.214966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2988aa94-ca0d-481b-8b94-9f85bcf3c19b tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:00.235423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988aa94-ca0d-481b-8b94-9f85bcf3c19b tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:00.270390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988aa94-ca0d-481b-8b94-9f85bcf3c19b tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:00.278463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d221a-261f-40e0-ab1a-9535127af610 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521177e28585427abc7f27deabfc9486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e7c3f2bbe341189793cb491e85998a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:00.279541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d221a-261f-40e0-ab1a-9535127af610 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:00.280203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d221a-261f-40e0-ab1a-9535127af610 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:00.280649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d221a-261f-40e0-ab1a-9535127af610 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] PATH_INFO: `/v3/projects/2fb7e30be426453ea5ed12eea8228a1e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:00.283352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d221a-261f-40e0-ab1a-9535127af610 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Authorizing `identity:get_project(project_id=2fb7e30be426453ea5ed12eea8228a1e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:00.286816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d221a-261f-40e0-ab1a-9535127af610 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:00.293906 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1523/3072] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:32:00 2022] GET /identity/v3/projects/2fb7e30be426453ea5ed12eea8228a1e => generated 371 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:32:00.365876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4fc15-017c-4b51-9568-2aca2dd7061b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:00.387951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4fc15-017c-4b51-9568-2aca2dd7061b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:00.404267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950809a2-c637-46bf-8101-9ed095af98fb tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521177e28585427abc7f27deabfc9486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e7c3f2bbe341189793cb491e85998a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:00.405155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950809a2-c637-46bf-8101-9ed095af98fb tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:00.405443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950809a2-c637-46bf-8101-9ed095af98fb tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:00.405722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950809a2-c637-46bf-8101-9ed095af98fb tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:00.406460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950809a2-c637-46bf-8101-9ed095af98fb tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:32:00.406774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950809a2-c637-46bf-8101-9ed095af98fb tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:00.413750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950809a2-c637-46bf-8101-9ed095af98fb tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:00.433796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d221a-261f-40e0-ab1a-9535127af610 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:00.436710 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1550/3073] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:32:00.445784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d221a-261f-40e0-ab1a-9535127af610 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:00.473049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97afed-58bf-4297-948f-7ee9d4081558 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521177e28585427abc7f27deabfc9486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e7c3f2bbe341189793cb491e85998a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:00.473679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97afed-58bf-4297-948f-7ee9d4081558 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:00.473972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97afed-58bf-4297-948f-7ee9d4081558 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:00.474304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97afed-58bf-4297-948f-7ee9d4081558 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:00.474936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97afed-58bf-4297-948f-7ee9d4081558 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:00.477676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97afed-58bf-4297-948f-7ee9d4081558 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:00.587416 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1524/3074] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:32:00 2022] POST /identity/v3/users => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:32:00.601423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950809a2-c637-46bf-8101-9ed095af98fb tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:00.615562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950809a2-c637-46bf-8101-9ed095af98fb tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:00.622969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38bd7d-f7c1-4007-b20e-6d8647fb790b tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521177e28585427abc7f27deabfc9486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e7c3f2bbe341189793cb491e85998a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:00.623676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38bd7d-f7c1-4007-b20e-6d8647fb790b tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:00.623961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38bd7d-f7c1-4007-b20e-6d8647fb790b tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:00.624241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38bd7d-f7c1-4007-b20e-6d8647fb790b tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:00.624970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38bd7d-f7c1-4007-b20e-6d8647fb790b tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:32:00.625288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38bd7d-f7c1-4007-b20e-6d8647fb790b tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:00.627292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38bd7d-f7c1-4007-b20e-6d8647fb790b tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:00.629104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:00.643029 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1551/3075] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:32:00.662680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708a427-f330-438b-94ed-0dbc4538f5c0 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:00.662969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708a427-f330-438b-94ed-0dbc4538f5c0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:00.664067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708a427-f330-438b-94ed-0dbc4538f5c0 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:00.665834 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1525/3076] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:32:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:32:00.672923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38bd7d-f7c1-4007-b20e-6d8647fb790b tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:32:00.711145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38bd7d-f7c1-4007-b20e-6d8647fb790b tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:00.722933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38bd7d-f7c1-4007-b20e-6d8647fb790b tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:00.728378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e41921-004c-440b-8bb1-b7da6d24fe5a tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521177e28585427abc7f27deabfc9486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e7c3f2bbe341189793cb491e85998a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:00.729057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e41921-004c-440b-8bb1-b7da6d24fe5a tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:00.729340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e41921-004c-440b-8bb1-b7da6d24fe5a tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:00.729623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e41921-004c-440b-8bb1-b7da6d24fe5a tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] PATH_INFO: `/v3/projects/2fb7e30be426453ea5ed12eea8228a1e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:00.730917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e41921-004c-440b-8bb1-b7da6d24fe5a tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Authorizing `identity:get_project(project_id=2fb7e30be426453ea5ed12eea8228a1e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:00.733292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e41921-004c-440b-8bb1-b7da6d24fe5a tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:00.735165 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1552/3077] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:32:00 2022] GET /identity/v3/projects/2fb7e30be426453ea5ed12eea8228a1e => generated 371 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:32:00.862091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708a427-f330-438b-94ed-0dbc4538f5c0 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:00.863534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e708a427-f330-438b-94ed-0dbc4538f5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:00.911835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:00.943104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708a427-f330-438b-94ed-0dbc4538f5c0 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:00.948317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbc22b-a621-4979-b713-ef0006d6b83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:00.949048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbc22b-a621-4979-b713-ef0006d6b83f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:00.949369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbc22b-a621-4979-b713-ef0006d6b83f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:00.949675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbc22b-a621-4979-b713-ef0006d6b83f admin admin] PATH_INFO: `/v3/users/46a1244a7e994427a6ff0625743956e3` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:00.951006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbc22b-a621-4979-b713-ef0006d6b83f admin admin] RBAC: Authorizing `identity:delete_user(user_id=46a1244a7e994427a6ff0625743956e3)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:00.953271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbc22b-a621-4979-b713-ef0006d6b83f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:01.246389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50032584-9a57-4972-9d13-d9679f9ea35d None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:01.246673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50032584-9a57-4972-9d13-d9679f9ea35d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:01.246942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50032584-9a57-4972-9d13-d9679f9ea35d None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:01.248461 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1553/3078] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:32:01.253653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50032584-9a57-4972-9d13-d9679f9ea35d None None] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:32:01.275124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50032584-9a57-4972-9d13-d9679f9ea35d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:01.290966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50032584-9a57-4972-9d13-d9679f9ea35d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:01.325906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d340091-1b12-43d5-af69-c5ab8eadee55 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521177e28585427abc7f27deabfc9486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e7c3f2bbe341189793cb491e85998a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:01.326602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d340091-1b12-43d5-af69-c5ab8eadee55 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:01.326884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d340091-1b12-43d5-af69-c5ab8eadee55 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:01.327314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d340091-1b12-43d5-af69-c5ab8eadee55 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] PATH_INFO: `/v3/projects/2fb7e30be426453ea5ed12eea8228a1e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:01.337214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d340091-1b12-43d5-af69-c5ab8eadee55 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Authorizing `identity:get_project(project_id=2fb7e30be426453ea5ed12eea8228a1e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:01.339364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d340091-1b12-43d5-af69-c5ab8eadee55 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:01.341305 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1554/3079] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:32:01 2022] GET /identity/v3/projects/2fb7e30be426453ea5ed12eea8228a1e => generated 371 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:32:01.381649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d340091-1b12-43d5-af69-c5ab8eadee55 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:01.393032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d340091-1b12-43d5-af69-c5ab8eadee55 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:01.406814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed812a-c194-46b8-a6c3-60ef0d1f8e68 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521177e28585427abc7f27deabfc9486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e7c3f2bbe341189793cb491e85998a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:01.409341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed812a-c194-46b8-a6c3-60ef0d1f8e68 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:01.409957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed812a-c194-46b8-a6c3-60ef0d1f8e68 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:01.416206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed812a-c194-46b8-a6c3-60ef0d1f8e68 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] PATH_INFO: `/v3/users/027f4bd05226471ebe0fc946da3b5d78` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:01.467667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed812a-c194-46b8-a6c3-60ef0d1f8e68 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Authorizing `identity:delete_user(user_id=027f4bd05226471ebe0fc946da3b5d78)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:01.474182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed812a-c194-46b8-a6c3-60ef0d1f8e68 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:01.484128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-75fbc22b-a621-4979-b713-ef0006d6b83f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46a1244a7e994427a6ff0625743956e3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:01.485290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-75fbc22b-a621-4979-b713-ef0006d6b83f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46a1244a7e994427a6ff0625743956e3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:01.507707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-75fbc22b-a621-4979-b713-ef0006d6b83f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46a1244a7e994427a6ff0625743956e3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:01.544869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-75fbc22b-a621-4979-b713-ef0006d6b83f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46a1244a7e994427a6ff0625743956e3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:01.716787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-75fbc22b-a621-4979-b713-ef0006d6b83f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46a1244a7e994427a6ff0625743956e3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:01.726396 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1526/3080] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:32:00 2022] DELETE /identity/v3/users/46a1244a7e994427a6ff0625743956e3 => generated 0 bytes in 865 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:32:01.730798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6052a65-5f41-4215-b431-602aa9bcd52d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:01.731277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6052a65-5f41-4215-b431-602aa9bcd52d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:01.731694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6052a65-5f41-4215-b431-602aa9bcd52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:01.763738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-94ed812a-c194-46b8-a6c3-60ef0d1f8e68 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '027f4bd05226471ebe0fc946da3b5d78'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:01.765353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-94ed812a-c194-46b8-a6c3-60ef0d1f8e68 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '027f4bd05226471ebe0fc946da3b5d78'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:01.776739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e6052a65-5f41-4215-b431-602aa9bcd52d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:01.779860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e6052a65-5f41-4215-b431-602aa9bcd52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:01.786132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-94ed812a-c194-46b8-a6c3-60ef0d1f8e68 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '027f4bd05226471ebe0fc946da3b5d78'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:01.828857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-94ed812a-c194-46b8-a6c3-60ef0d1f8e68 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '027f4bd05226471ebe0fc946da3b5d78'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:01.830061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-94ed812a-c194-46b8-a6c3-60ef0d1f8e68 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '027f4bd05226471ebe0fc946da3b5d78'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:01.896811 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1527/3081] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:01.914189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6052a65-5f41-4215-b431-602aa9bcd52d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:01.918416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e6052a65-5f41-4215-b431-602aa9bcd52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:01.926769 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1555/3082] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:32:01 2022] DELETE /identity/v3/users/027f4bd05226471ebe0fc946da3b5d78 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:32:01.932961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed812a-c194-46b8-a6c3-60ef0d1f8e68 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:01.934693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-94ed812a-c194-46b8-a6c3-60ef0d1f8e68 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:02.059355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6052a65-5f41-4215-b431-602aa9bcd52d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:02.087076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:02.121214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed812a-c194-46b8-a6c3-60ef0d1f8e68 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:02.129615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63d44a-1a29-4e29-824f-b1cff873f846 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521177e28585427abc7f27deabfc9486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e7c3f2bbe341189793cb491e85998a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:02.130336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63d44a-1a29-4e29-824f-b1cff873f846 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:02.130623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63d44a-1a29-4e29-824f-b1cff873f846 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:02.130901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63d44a-1a29-4e29-824f-b1cff873f846 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] PATH_INFO: `/v3/projects/2fb7e30be426453ea5ed12eea8228a1e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:02.132505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63d44a-1a29-4e29-824f-b1cff873f846 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2fb7e30be426453ea5ed12eea8228a1e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:02.134652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63d44a-1a29-4e29-824f-b1cff873f846 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:02.199454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad6707-0371-4763-8f19-9476cabdfebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:02.200096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad6707-0371-4763-8f19-9476cabdfebf service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:02.200386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad6707-0371-4763-8f19-9476cabdfebf service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:02.200668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad6707-0371-4763-8f19-9476cabdfebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:02.288169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad6707-0371-4763-8f19-9476cabdfebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:02.290157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad6707-0371-4763-8f19-9476cabdfebf service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:02.305148 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1528/3083] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:32:02.311329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:02.328815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1d63d44a-1a29-4e29-824f-b1cff873f846 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fb7e30be426453ea5ed12eea8228a1e', 'request_id': 'req-1d63d44a-1a29-4e29-824f-b1cff873f846'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:02.343451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1d63d44a-1a29-4e29-824f-b1cff873f846 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fb7e30be426453ea5ed12eea8228a1e', 'request_id': 'req-1d63d44a-1a29-4e29-824f-b1cff873f846'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:02.358151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1d63d44a-1a29-4e29-824f-b1cff873f846 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fb7e30be426453ea5ed12eea8228a1e', 'request_id': 'req-1d63d44a-1a29-4e29-824f-b1cff873f846'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:02.416956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae804e8-9185-4e00-9c9d-1f455f01f214 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:02.417340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae804e8-9185-4e00-9c9d-1f455f01f214 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:02.417537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae804e8-9185-4e00-9c9d-1f455f01f214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:02.444698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4ae804e8-9185-4e00-9c9d-1f455f01f214 None None] MFA Rules not processed for user `ed44bf20b3464a53a3e3f6c9cd61cde3`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:02.446196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4ae804e8-9185-4e00-9c9d-1f455f01f214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:02.458228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1d63d44a-1a29-4e29-824f-b1cff873f846 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] The token cache is being invalidate because project 2fb7e30be426453ea5ed12eea8228a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:32:02.459565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1d63d44a-1a29-4e29-824f-b1cff873f846 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:02.461396 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1d63d44a-1a29-4e29-824f-b1cff873f846 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:02.470186 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1556/3084] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:32:01 2022] DELETE /identity/v3/projects/2fb7e30be426453ea5ed12eea8228a1e => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:32:02.472130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63d44a-1a29-4e29-824f-b1cff873f846 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:02.476475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1d63d44a-1a29-4e29-824f-b1cff873f846 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:02.555532 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1529/3085] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:02.599356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63d44a-1a29-4e29-824f-b1cff873f846 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:02.615607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a6397-bd20-48d0-bb1d-6b1deb72363c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:02.616298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a6397-bd20-48d0-bb1d-6b1deb72363c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:02.616552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a6397-bd20-48d0-bb1d-6b1deb72363c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:02.617035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a6397-bd20-48d0-bb1d-6b1deb72363c admin admin] PATH_INFO: `/v3/users/cc9cd9003dd043b59884af6585493383` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:02.619496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a6397-bd20-48d0-bb1d-6b1deb72363c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc9cd9003dd043b59884af6585493383)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:02.621613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a6397-bd20-48d0-bb1d-6b1deb72363c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:02.800069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae804e8-9185-4e00-9c9d-1f455f01f214 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:02.802060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4ae804e8-9185-4e00-9c9d-1f455f01f214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:02.832774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae804e8-9185-4e00-9c9d-1f455f01f214 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:02.848646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb7e7d-a666-4e06-b80c-e4e1014c93e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:02.853048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb7e7d-a666-4e06-b80c-e4e1014c93e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:02.854395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb7e7d-a666-4e06-b80c-e4e1014c93e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:02.855877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb7e7d-a666-4e06-b80c-e4e1014c93e0 admin admin] PATH_INFO: `/v3/projects/7e1c2fc2755040e4b6fcf82534d67e1c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:02.859913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb7e7d-a666-4e06-b80c-e4e1014c93e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e1c2fc2755040e4b6fcf82534d67e1c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:02.867451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb7e7d-a666-4e06-b80c-e4e1014c93e0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:03.035446 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1cbb7e7d-a666-4e06-b80c-e4e1014c93e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e1c2fc2755040e4b6fcf82534d67e1c', 'request_id': 'req-1cbb7e7d-a666-4e06-b80c-e4e1014c93e0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:03.047751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e39a6397-bd20-48d0-bb1d-6b1deb72363c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc9cd9003dd043b59884af6585493383'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:03.049134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e39a6397-bd20-48d0-bb1d-6b1deb72363c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc9cd9003dd043b59884af6585493383'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:03.058990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e39a6397-bd20-48d0-bb1d-6b1deb72363c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc9cd9003dd043b59884af6585493383'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:03.086475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e39a6397-bd20-48d0-bb1d-6b1deb72363c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc9cd9003dd043b59884af6585493383'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:03.087247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e39a6397-bd20-48d0-bb1d-6b1deb72363c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc9cd9003dd043b59884af6585493383'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:03.123296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1cbb7e7d-a666-4e06-b80c-e4e1014c93e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e1c2fc2755040e4b6fcf82534d67e1c', 'request_id': 'req-1cbb7e7d-a666-4e06-b80c-e4e1014c93e0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:03.127354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1cbb7e7d-a666-4e06-b80c-e4e1014c93e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e1c2fc2755040e4b6fcf82534d67e1c', 'request_id': 'req-1cbb7e7d-a666-4e06-b80c-e4e1014c93e0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:03.144637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:03.163597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1cbb7e7d-a666-4e06-b80c-e4e1014c93e0 admin admin] The token cache is being invalidate because project 7e1c2fc2755040e4b6fcf82534d67e1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:32:03.165675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1cbb7e7d-a666-4e06-b80c-e4e1014c93e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:03.166658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1cbb7e7d-a666-4e06-b80c-e4e1014c93e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:03.174723 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1530/3086] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:32:02 2022] DELETE /identity/v3/projects/7e1c2fc2755040e4b6fcf82534d67e1c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:32:03.176062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb7e7d-a666-4e06-b80c-e4e1014c93e0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:03.185957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1cbb7e7d-a666-4e06-b80c-e4e1014c93e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:03.275329 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1557/3087] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:32:02 2022] DELETE /identity/v3/users/cc9cd9003dd043b59884af6585493383 => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:32:03.280316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd35ed9-b9bb-4cd9-acb8-19da3e79dfef None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:03.280855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd35ed9-b9bb-4cd9-acb8-19da3e79dfef None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:03.281720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd35ed9-b9bb-4cd9-acb8-19da3e79dfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:03.321844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb7e7d-a666-4e06-b80c-e4e1014c93e0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:03.326543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7fd35ed9-b9bb-4cd9-acb8-19da3e79dfef None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:03.328258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7fd35ed9-b9bb-4cd9-acb8-19da3e79dfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:03.449809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:03.464437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fbb9b-96fd-4865-9cf0-a6c5f3f80802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:03.465904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fbb9b-96fd-4865-9cf0-a6c5f3f80802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:03.466678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fbb9b-96fd-4865-9cf0-a6c5f3f80802 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:03.467224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fbb9b-96fd-4865-9cf0-a6c5f3f80802 admin admin] PATH_INFO: `/v3/users/1386f8a5945345048f7f0aa8b75567f4` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:03.472094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2fbb9b-96fd-4865-9cf0-a6c5f3f80802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1386f8a5945345048f7f0aa8b75567f4)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:03.477781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2fbb9b-96fd-4865-9cf0-a6c5f3f80802 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:03.487369 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1558/3088] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:03.505326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd35ed9-b9bb-4cd9-acb8-19da3e79dfef None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:03.510104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7fd35ed9-b9bb-4cd9-acb8-19da3e79dfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:03.612668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd35ed9-b9bb-4cd9-acb8-19da3e79dfef None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:03.618328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a142fc-648d-42b5-ba3c-51f4b8c07bfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:03.624329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a142fc-648d-42b5-ba3c-51f4b8c07bfb service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:03.625415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a142fc-648d-42b5-ba3c-51f4b8c07bfb service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:03.625790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a142fc-648d-42b5-ba3c-51f4b8c07bfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:03.644276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a142fc-648d-42b5-ba3c-51f4b8c07bfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:03.649750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a142fc-648d-42b5-ba3c-51f4b8c07bfb service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:03.668115 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1559/3089] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:32:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:32:03.669219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a142fc-648d-42b5-ba3c-51f4b8c07bfb service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:03.672441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f6a142fc-648d-42b5-ba3c-51f4b8c07bfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:03.686482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a142fc-648d-42b5-ba3c-51f4b8c07bfb service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:03.690801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d1a87-81e6-4548-8279-9001ff30cd9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:03.691423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d1a87-81e6-4548-8279-9001ff30cd9d service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:03.691710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d1a87-81e6-4548-8279-9001ff30cd9d service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:03.692263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d1a87-81e6-4548-8279-9001ff30cd9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:03.694184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c54d1a87-81e6-4548-8279-9001ff30cd9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:03.738005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1a2fbb9b-96fd-4865-9cf0-a6c5f3f80802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1386f8a5945345048f7f0aa8b75567f4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:03.741479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1a2fbb9b-96fd-4865-9cf0-a6c5f3f80802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1386f8a5945345048f7f0aa8b75567f4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:03.747043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d1a87-81e6-4548-8279-9001ff30cd9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:03.749704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d1a87-81e6-4548-8279-9001ff30cd9d service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:03.760156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1a2fbb9b-96fd-4865-9cf0-a6c5f3f80802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1386f8a5945345048f7f0aa8b75567f4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:03.772917 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1560/3090] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:32:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:32:03.783954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1a2fbb9b-96fd-4865-9cf0-a6c5f3f80802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1386f8a5945345048f7f0aa8b75567f4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:03.877645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1a2fbb9b-96fd-4865-9cf0-a6c5f3f80802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1386f8a5945345048f7f0aa8b75567f4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:03.905427 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1531/3091] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:32:03 2022] DELETE /identity/v3/users/1386f8a5945345048f7f0aa8b75567f4 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:32:05.235985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d1a87-81e6-4548-8279-9001ff30cd9d service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:05.237114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c54d1a87-81e6-4548-8279-9001ff30cd9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:05.278921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fbb9b-96fd-4865-9cf0-a6c5f3f80802 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:05.286864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1a2fbb9b-96fd-4865-9cf0-a6c5f3f80802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:05.307607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d1a87-81e6-4548-8279-9001ff30cd9d service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:05.381651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:05.517319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fbb9b-96fd-4865-9cf0-a6c5f3f80802 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:05.534690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed78c0-b89e-4752-a4ab-390849b4c273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:05.535423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed78c0-b89e-4752-a4ab-390849b4c273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:05.535973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed78c0-b89e-4752-a4ab-390849b4c273 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:05.536249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed78c0-b89e-4752-a4ab-390849b4c273 admin admin] PATH_INFO: `/v3/projects/1ead8249989a4e68b0ea86e4c9574349` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:05.537999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed78c0-b89e-4752-a4ab-390849b4c273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ead8249989a4e68b0ea86e4c9574349)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:05.540063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed78c0-b89e-4752-a4ab-390849b4c273 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:05.569532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5edbe-70f1-4047-9b67-4c02693a0d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:05.569532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5edbe-70f1-4047-9b67-4c02693a0d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:05.569532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5edbe-70f1-4047-9b67-4c02693a0d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:05.569532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5edbe-70f1-4047-9b67-4c02693a0d83 admin admin] PATH_INFO: `/v3/projects/fecf7f9ae0304ca6b65b95e3a32826a2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:05.570997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5edbe-70f1-4047-9b67-4c02693a0d83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fecf7f9ae0304ca6b65b95e3a32826a2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:05.575487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5edbe-70f1-4047-9b67-4c02693a0d83 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:05.772111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-17ed78c0-b89e-4752-a4ab-390849b4c273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ead8249989a4e68b0ea86e4c9574349', 'request_id': 'req-17ed78c0-b89e-4752-a4ab-390849b4c273'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:05.792166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-38f5edbe-70f1-4047-9b67-4c02693a0d83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fecf7f9ae0304ca6b65b95e3a32826a2', 'request_id': 'req-38f5edbe-70f1-4047-9b67-4c02693a0d83'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:05.809732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-38f5edbe-70f1-4047-9b67-4c02693a0d83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fecf7f9ae0304ca6b65b95e3a32826a2', 'request_id': 'req-38f5edbe-70f1-4047-9b67-4c02693a0d83'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:05.822270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-38f5edbe-70f1-4047-9b67-4c02693a0d83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fecf7f9ae0304ca6b65b95e3a32826a2', 'request_id': 'req-38f5edbe-70f1-4047-9b67-4c02693a0d83'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:05.895757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-17ed78c0-b89e-4752-a4ab-390849b4c273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ead8249989a4e68b0ea86e4c9574349', 'request_id': 'req-17ed78c0-b89e-4752-a4ab-390849b4c273'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:05.899084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-17ed78c0-b89e-4752-a4ab-390849b4c273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ead8249989a4e68b0ea86e4c9574349', 'request_id': 'req-17ed78c0-b89e-4752-a4ab-390849b4c273'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:05.937816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-17ed78c0-b89e-4752-a4ab-390849b4c273 admin admin] The token cache is being invalidate because project 1ead8249989a4e68b0ea86e4c9574349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:32:05.940488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-17ed78c0-b89e-4752-a4ab-390849b4c273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:05.945384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-17ed78c0-b89e-4752-a4ab-390849b4c273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:05.949648 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1532/3092] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:32:05 2022] DELETE /identity/v3/projects/1ead8249989a4e68b0ea86e4c9574349 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:32:05.961398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d7867-7dcd-47cb-a084-294e9fed2312 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:05.962178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d7867-7dcd-47cb-a084-294e9fed2312 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:05.962681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d7867-7dcd-47cb-a084-294e9fed2312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:05.988906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-891d7867-7dcd-47cb-a084-294e9fed2312 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:05.990473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-891d7867-7dcd-47cb-a084-294e9fed2312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:05.994505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-38f5edbe-70f1-4047-9b67-4c02693a0d83 admin admin] The token cache is being invalidate because project fecf7f9ae0304ca6b65b95e3a32826a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:32:05.995015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-38f5edbe-70f1-4047-9b67-4c02693a0d83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:05.995887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-38f5edbe-70f1-4047-9b67-4c02693a0d83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:06.000281 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1561/3093] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:32:05 2022] DELETE /identity/v3/projects/fecf7f9ae0304ca6b65b95e3a32826a2 => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:32:06.005277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f6f73-0db9-4593-a34e-e51ab37edb5a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:06.005917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f6f73-0db9-4593-a34e-e51ab37edb5a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:06.006525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f6f73-0db9-4593-a34e-e51ab37edb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:06.029848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:06.039861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-867f6f73-0db9-4593-a34e-e51ab37edb5a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:06.041567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-867f6f73-0db9-4593-a34e-e51ab37edb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:06.126074 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1533/3094] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:32:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:06.134142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d7867-7dcd-47cb-a084-294e9fed2312 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:06.134142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-891d7867-7dcd-47cb-a084-294e9fed2312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:06.245472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:06.269178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d7867-7dcd-47cb-a084-294e9fed2312 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:06.279942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10833f-d49c-4f41-9424-d48a994cf0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:06.282106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10833f-d49c-4f41-9424-d48a994cf0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:06.282440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10833f-d49c-4f41-9424-d48a994cf0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:06.284337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10833f-d49c-4f41-9424-d48a994cf0e8 admin admin] PATH_INFO: `/v3/users/521177e28585427abc7f27deabfc9486` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:06.287537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10833f-d49c-4f41-9424-d48a994cf0e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=521177e28585427abc7f27deabfc9486)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:06.291438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10833f-d49c-4f41-9424-d48a994cf0e8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:06.416646 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1562/3095] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:06.418243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f6f73-0db9-4593-a34e-e51ab37edb5a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:06.424372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-867f6f73-0db9-4593-a34e-e51ab37edb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:06.585134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f6f73-0db9-4593-a34e-e51ab37edb5a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:06.598549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360105a-6d1f-46c2-8efe-0eed69f84cf7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:06.599365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360105a-6d1f-46c2-8efe-0eed69f84cf7 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:06.599667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360105a-6d1f-46c2-8efe-0eed69f84cf7 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:06.599956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360105a-6d1f-46c2-8efe-0eed69f84cf7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:06.614125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ae10833f-d49c-4f41-9424-d48a994cf0e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '521177e28585427abc7f27deabfc9486'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:06.615959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ae10833f-d49c-4f41-9424-d48a994cf0e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '521177e28585427abc7f27deabfc9486'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:06.618477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360105a-6d1f-46c2-8efe-0eed69f84cf7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:06.621384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360105a-6d1f-46c2-8efe-0eed69f84cf7 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:06.646631 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1563/3096] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:32:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:32:06.648979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c409b-e2f9-4308-ac90-5dea5a04c1c5 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:06.650114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c409b-e2f9-4308-ac90-5dea5a04c1c5 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:06.650833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c409b-e2f9-4308-ac90-5dea5a04c1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:06.680044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ae10833f-d49c-4f41-9424-d48a994cf0e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '521177e28585427abc7f27deabfc9486'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:06.698966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c37c409b-e2f9-4308-ac90-5dea5a04c1c5 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:06.700213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c37c409b-e2f9-4308-ac90-5dea5a04c1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:06.708598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ae10833f-d49c-4f41-9424-d48a994cf0e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '521177e28585427abc7f27deabfc9486'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:06.732375 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1564/3097] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:06.738439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c409b-e2f9-4308-ac90-5dea5a04c1c5 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:06.753571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c409b-e2f9-4308-ac90-5dea5a04c1c5 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:06.759441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079399d-f4a7-4d6b-84be-8ca224d5c163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:06.762229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079399d-f4a7-4d6b-84be-8ca224d5c163 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:06.762633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079399d-f4a7-4d6b-84be-8ca224d5c163 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:06.763027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079399d-f4a7-4d6b-84be-8ca224d5c163 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:06.763875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079399d-f4a7-4d6b-84be-8ca224d5c163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:32:06.764279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079399d-f4a7-4d6b-84be-8ca224d5c163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:06.766062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079399d-f4a7-4d6b-84be-8ca224d5c163 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:06.803606 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1565/3098] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:32:06.803606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079399d-f4a7-4d6b-84be-8ca224d5c163 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:06.824797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079399d-f4a7-4d6b-84be-8ca224d5c163 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:06.833423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897c46f-886a-4021-98ae-e8aa077009b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:06.834454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897c46f-886a-4021-98ae-e8aa077009b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:06.835172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897c46f-886a-4021-98ae-e8aa077009b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:06.836566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897c46f-886a-4021-98ae-e8aa077009b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:06.839118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897c46f-886a-4021-98ae-e8aa077009b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:06.841546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897c46f-886a-4021-98ae-e8aa077009b6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:06.855896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ae10833f-d49c-4f41-9424-d48a994cf0e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '521177e28585427abc7f27deabfc9486'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:06.865719 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1534/3099] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:32:06 2022] DELETE /identity/v3/users/521177e28585427abc7f27deabfc9486 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:32:06.980096 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1566/3100] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:32:06 2022] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:32:06.984211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10833f-d49c-4f41-9424-d48a994cf0e8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:07.223258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10833f-d49c-4f41-9424-d48a994cf0e8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:07.353669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46763460-9e0d-4a78-b976-a1adfc51c748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:07.458382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46763460-9e0d-4a78-b976-a1adfc51c748 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:07.458382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46763460-9e0d-4a78-b976-a1adfc51c748 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:07.458382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46763460-9e0d-4a78-b976-a1adfc51c748 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:07.458382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46763460-9e0d-4a78-b976-a1adfc51c748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:07.458382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46763460-9e0d-4a78-b976-a1adfc51c748 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:07.932069 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1535/3101] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:32:06 2022] POST /identity/v3/users => generated 286 bytes in 948 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:32:07.935199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897c46f-886a-4021-98ae-e8aa077009b6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:07.959220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897c46f-886a-4021-98ae-e8aa077009b6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:07.964918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7da4c-858e-43a3-8b6e-fc2444d74d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:07.965283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7da4c-858e-43a3-8b6e-fc2444d74d91 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:07.966403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7da4c-858e-43a3-8b6e-fc2444d74d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:07.966846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7da4c-858e-43a3-8b6e-fc2444d74d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:07.967672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7da4c-858e-43a3-8b6e-fc2444d74d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:07.969595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7da4c-858e-43a3-8b6e-fc2444d74d91 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:07.999903 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1567/3102] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:32:08.003130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46763460-9e0d-4a78-b976-a1adfc51c748 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:08.015577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46763460-9e0d-4a78-b976-a1adfc51c748 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:08.025179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60309d-e74b-4a0d-bacd-cd6f25a6b507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:08.026231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60309d-e74b-4a0d-bacd-cd6f25a6b507 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:08.027094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60309d-e74b-4a0d-bacd-cd6f25a6b507 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:08.027537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60309d-e74b-4a0d-bacd-cd6f25a6b507 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:08.028380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60309d-e74b-4a0d-bacd-cd6f25a6b507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:08.030252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60309d-e74b-4a0d-bacd-cd6f25a6b507 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:08.066768 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1536/3103] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:32:08.071381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7da4c-858e-43a3-8b6e-fc2444d74d91 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:08.084160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7da4c-858e-43a3-8b6e-fc2444d74d91 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:08.090349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e82ef-b954-4112-93e9-bb0ef218e808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:08.091989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e82ef-b954-4112-93e9-bb0ef218e808 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:08.092462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e82ef-b954-4112-93e9-bb0ef218e808 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:08.092920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e82ef-b954-4112-93e9-bb0ef218e808 admin admin] PATH_INFO: `/v3/projects/e3602ac01e5849aea009920376e40ee6/users/75cb83a284ef40baaa7038fd73519d0c/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:08.119811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e82ef-b954-4112-93e9-bb0ef218e808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3602ac01e5849aea009920376e40ee6, user_id=75cb83a284ef40baaa7038fd73519d0c, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:08.123423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e82ef-b954-4112-93e9-bb0ef218e808 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:08.235190 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1568/3104] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:32:08 2022] PUT /identity/v3/projects/e3602ac01e5849aea009920376e40ee6/users/75cb83a284ef40baaa7038fd73519d0c/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:32:08.245652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d9761-9c45-42e2-97cc-120148ff6e53 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:08.246667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d9761-9c45-42e2-97cc-120148ff6e53 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:08.247201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d9761-9c45-42e2-97cc-120148ff6e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:08.298400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b00d9761-9c45-42e2-97cc-120148ff6e53 None None] MFA Rules not processed for user `75cb83a284ef40baaa7038fd73519d0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:08.300134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b00d9761-9c45-42e2-97cc-120148ff6e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:08.442951 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1537/3105] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:08.474400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e82ef-b954-4112-93e9-bb0ef218e808 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:08.477001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8b0e82ef-b954-4112-93e9-bb0ef218e808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:08.564999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:08.688799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e82ef-b954-4112-93e9-bb0ef218e808 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:08.707699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef62b1-9149-4d5c-8ad3-f80d5cf8d5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:08.708426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef62b1-9149-4d5c-8ad3-f80d5cf8d5ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:08.708712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef62b1-9149-4d5c-8ad3-f80d5cf8d5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:08.708994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef62b1-9149-4d5c-8ad3-f80d5cf8d5ec admin admin] PATH_INFO: `/v3/projects/58e7c3f2bbe341189793cb491e85998a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:08.711779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef62b1-9149-4d5c-8ad3-f80d5cf8d5ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=58e7c3f2bbe341189793cb491e85998a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:08.716153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef62b1-9149-4d5c-8ad3-f80d5cf8d5ec admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:08.744432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:08.946977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-06ef62b1-9149-4d5c-8ad3-f80d5cf8d5ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58e7c3f2bbe341189793cb491e85998a', 'request_id': 'req-06ef62b1-9149-4d5c-8ad3-f80d5cf8d5ec'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:08.976053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-06ef62b1-9149-4d5c-8ad3-f80d5cf8d5ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58e7c3f2bbe341189793cb491e85998a', 'request_id': 'req-06ef62b1-9149-4d5c-8ad3-f80d5cf8d5ec'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:08.998456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-06ef62b1-9149-4d5c-8ad3-f80d5cf8d5ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58e7c3f2bbe341189793cb491e85998a', 'request_id': 'req-06ef62b1-9149-4d5c-8ad3-f80d5cf8d5ec'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:09.050842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d9761-9c45-42e2-97cc-120148ff6e53 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:09.057565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b00d9761-9c45-42e2-97cc-120148ff6e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:09.131150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-06ef62b1-9149-4d5c-8ad3-f80d5cf8d5ec admin admin] The token cache is being invalidate because project 58e7c3f2bbe341189793cb491e85998a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:32:09.141258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-06ef62b1-9149-4d5c-8ad3-f80d5cf8d5ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:09.141258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-06ef62b1-9149-4d5c-8ad3-f80d5cf8d5ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:09.141258 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1569/3106] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:32:08 2022] DELETE /identity/v3/projects/58e7c3f2bbe341189793cb491e85998a => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:32:09.142918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d33d5-af10-4ff4-8be1-a7ecc67782cc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:09.143273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d33d5-af10-4ff4-8be1-a7ecc67782cc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:09.143560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d33d5-af10-4ff4-8be1-a7ecc67782cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:09.206572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-525d33d5-af10-4ff4-8be1-a7ecc67782cc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:09.207950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-525d33d5-af10-4ff4-8be1-a7ecc67782cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:09.369561 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1570/3107] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:32:09.378525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1e57e-3297-4da0-88a1-f2c7e9300879 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:09.379128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1e57e-3297-4da0-88a1-f2c7e9300879 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:09.379570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1e57e-3297-4da0-88a1-f2c7e9300879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:09.427930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-74e1e57e-3297-4da0-88a1-f2c7e9300879 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:09.429582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-74e1e57e-3297-4da0-88a1-f2c7e9300879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:09.433074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d9761-9c45-42e2-97cc-120148ff6e53 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:09.441726 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1571/3108] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:32:09.446824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1e57e-3297-4da0-88a1-f2c7e9300879 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:09.470192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1e57e-3297-4da0-88a1-f2c7e9300879 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:09.492534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc3c1b-5a67-4521-9213-34985de63417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:09.493584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc3c1b-5a67-4521-9213-34985de63417 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:09.494110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc3c1b-5a67-4521-9213-34985de63417 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:09.494606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc3c1b-5a67-4521-9213-34985de63417 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:09.495503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc3c1b-5a67-4521-9213-34985de63417 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:32:09.497692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc3c1b-5a67-4521-9213-34985de63417 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:09.501950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc3c1b-5a67-4521-9213-34985de63417 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:09.531254 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1572/3109] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:32:09.536673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc3c1b-5a67-4521-9213-34985de63417 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:09.604383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc3c1b-5a67-4521-9213-34985de63417 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:09.623596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638aea2f-cb4b-4c74-af40-1aaabf610189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:09.624505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aea2f-cb4b-4c74-af40-1aaabf610189 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:09.625658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aea2f-cb4b-4c74-af40-1aaabf610189 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:09.626350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aea2f-cb4b-4c74-af40-1aaabf610189 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:09.629339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638aea2f-cb4b-4c74-af40-1aaabf610189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:09.633310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638aea2f-cb4b-4c74-af40-1aaabf610189 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:09.656988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1865a8-f57e-467f-b6c9-9af0527dfc2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:09.658695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1865a8-f57e-467f-b6c9-9af0527dfc2b service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:09.659306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1865a8-f57e-467f-b6c9-9af0527dfc2b service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:09.659961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1865a8-f57e-467f-b6c9-9af0527dfc2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:09.664846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8b1865a8-f57e-467f-b6c9-9af0527dfc2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:09.793090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1865a8-f57e-467f-b6c9-9af0527dfc2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:09.795107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1865a8-f57e-467f-b6c9-9af0527dfc2b service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:09.816698 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1538/3110] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:32:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 767 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:32:09.852187 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1573/3111] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:32:09 2022] POST /identity/v3/projects => generated 401 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:32:09.858075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638aea2f-cb4b-4c74-af40-1aaabf610189 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:09.883691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:10.049313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638aea2f-cb4b-4c74-af40-1aaabf610189 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:10.073628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:10.090762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b52a2f-2283-47f0-8a52-52822351ef42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:10.091687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b52a2f-2283-47f0-8a52-52822351ef42 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:10.092127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b52a2f-2283-47f0-8a52-52822351ef42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:10.092600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b52a2f-2283-47f0-8a52-52822351ef42 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:10.093920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b52a2f-2283-47f0-8a52-52822351ef42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:10.100292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b52a2f-2283-47f0-8a52-52822351ef42 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:10.238884 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1574/3112] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:32:09 2022] POST /identity/v3/users => generated 301 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:32:10.243355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1865a8-f57e-467f-b6c9-9af0527dfc2b service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:10.257278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1865a8-f57e-467f-b6c9-9af0527dfc2b service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:10.265855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ff6b2-95c3-4559-8e1a-df7cad57b9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:10.266783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ff6b2-95c3-4559-8e1a-df7cad57b9eb admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:10.267346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ff6b2-95c3-4559-8e1a-df7cad57b9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:10.268551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ff6b2-95c3-4559-8e1a-df7cad57b9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:10.270653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ff6b2-95c3-4559-8e1a-df7cad57b9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:10.276312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ff6b2-95c3-4559-8e1a-df7cad57b9eb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:10.305849 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1539/3113] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:32:10.308901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b52a2f-2283-47f0-8a52-52822351ef42 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:10.322965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b52a2f-2283-47f0-8a52-52822351ef42 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:10.334692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8eed1-6a57-4da6-8d80-e21c31941872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:10.339882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8eed1-6a57-4da6-8d80-e21c31941872 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:10.340210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8eed1-6a57-4da6-8d80-e21c31941872 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:10.340498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8eed1-6a57-4da6-8d80-e21c31941872 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:10.347399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8eed1-6a57-4da6-8d80-e21c31941872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:10.363012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8eed1-6a57-4da6-8d80-e21c31941872 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:10.379643 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1575/3114] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:32:10.381089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ff6b2-95c3-4559-8e1a-df7cad57b9eb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:10.393895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ff6b2-95c3-4559-8e1a-df7cad57b9eb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:10.420912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f516e-5606-4efb-b53b-c9b4642b56f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:10.420912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f516e-5606-4efb-b53b-c9b4642b56f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:10.427758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f516e-5606-4efb-b53b-c9b4642b56f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:10.427991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f516e-5606-4efb-b53b-c9b4642b56f3 admin admin] PATH_INFO: `/v3/projects/f710dd9fc15b46578dd67cdfb4bb121e/users/90cf87b409a94da385c0dc9b39884665/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:10.478489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f516e-5606-4efb-b53b-c9b4642b56f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f710dd9fc15b46578dd67cdfb4bb121e, user_id=90cf87b409a94da385c0dc9b39884665, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:10.481742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f516e-5606-4efb-b53b-c9b4642b56f3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:10.599720 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1540/3115] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:32:10 2022] PUT /identity/v3/projects/f710dd9fc15b46578dd67cdfb4bb121e/users/90cf87b409a94da385c0dc9b39884665/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:32:10.605127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5b755-1a54-4e16-a04f-fddd21c6d533 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:10.606430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5b755-1a54-4e16-a04f-fddd21c6d533 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:10.606716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5b755-1a54-4e16-a04f-fddd21c6d533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:10.680723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-32b5b755-1a54-4e16-a04f-fddd21c6d533 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:10.685163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-32b5b755-1a54-4e16-a04f-fddd21c6d533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:10.748825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f516e-5606-4efb-b53b-c9b4642b56f3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:10.751131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cc3f516e-5606-4efb-b53b-c9b4642b56f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:10.913228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f516e-5606-4efb-b53b-c9b4642b56f3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:10.913431 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1576/3116] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:10.923495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e17941-a49c-47a3-ae24-95e4e3790d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:10.930552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e17941-a49c-47a3-ae24-95e4e3790d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:10.930552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e17941-a49c-47a3-ae24-95e4e3790d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:10.930552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e17941-a49c-47a3-ae24-95e4e3790d58 admin admin] PATH_INFO: `/v3/users/4ba8b60cf1164a388f626b0708556775` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:10.932062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e17941-a49c-47a3-ae24-95e4e3790d58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba8b60cf1164a388f626b0708556775)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:10.934699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e17941-a49c-47a3-ae24-95e4e3790d58 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:10.979243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5b755-1a54-4e16-a04f-fddd21c6d533 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:10.980729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-32b5b755-1a54-4e16-a04f-fddd21c6d533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:11.131037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5b755-1a54-4e16-a04f-fddd21c6d533 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:11.138374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59984dbc-46b6-4d73-98a9-ae795d298f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:11.149465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59984dbc-46b6-4d73-98a9-ae795d298f6d service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:11.149465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59984dbc-46b6-4d73-98a9-ae795d298f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:11.149465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59984dbc-46b6-4d73-98a9-ae795d298f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:11.166905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59984dbc-46b6-4d73-98a9-ae795d298f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:11.177153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59984dbc-46b6-4d73-98a9-ae795d298f6d service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:11.192709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-05e17941-a49c-47a3-ae24-95e4e3790d58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba8b60cf1164a388f626b0708556775'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:11.193926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-05e17941-a49c-47a3-ae24-95e4e3790d58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba8b60cf1164a388f626b0708556775'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:11.226005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-05e17941-a49c-47a3-ae24-95e4e3790d58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba8b60cf1164a388f626b0708556775'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:11.227061 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1577/3117] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:32:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:32:11.273894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-05e17941-a49c-47a3-ae24-95e4e3790d58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba8b60cf1164a388f626b0708556775'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:11.415336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-05e17941-a49c-47a3-ae24-95e4e3790d58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba8b60cf1164a388f626b0708556775'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:11.422381 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1541/3118] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:32:10 2022] DELETE /identity/v3/users/4ba8b60cf1164a388f626b0708556775 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:32:12.641897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59984dbc-46b6-4d73-98a9-ae795d298f6d service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:12.668321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59984dbc-46b6-4d73-98a9-ae795d298f6d service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:12.731925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:12.790062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33c32d-2ba9-4ad1-a624-e311f933cdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:12.790641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33c32d-2ba9-4ad1-a624-e311f933cdcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:12.790926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33c32d-2ba9-4ad1-a624-e311f933cdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:12.791203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33c32d-2ba9-4ad1-a624-e311f933cdcc admin admin] PATH_INFO: `/v3/projects/9ebe1ca8678d43c38731d15b0bf99cfa` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:12.792474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33c32d-2ba9-4ad1-a624-e311f933cdcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ebe1ca8678d43c38731d15b0bf99cfa)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:12.794959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33c32d-2ba9-4ad1-a624-e311f933cdcc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:12.985060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6f33c32d-2ba9-4ad1-a624-e311f933cdcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ebe1ca8678d43c38731d15b0bf99cfa', 'request_id': 'req-6f33c32d-2ba9-4ad1-a624-e311f933cdcc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:13.000722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6f33c32d-2ba9-4ad1-a624-e311f933cdcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ebe1ca8678d43c38731d15b0bf99cfa', 'request_id': 'req-6f33c32d-2ba9-4ad1-a624-e311f933cdcc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:13.015411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6f33c32d-2ba9-4ad1-a624-e311f933cdcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ebe1ca8678d43c38731d15b0bf99cfa', 'request_id': 'req-6f33c32d-2ba9-4ad1-a624-e311f933cdcc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:13.154061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6f33c32d-2ba9-4ad1-a624-e311f933cdcc admin admin] The token cache is being invalidate because project 9ebe1ca8678d43c38731d15b0bf99cfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:32:13.154370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6f33c32d-2ba9-4ad1-a624-e311f933cdcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:13.159226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6f33c32d-2ba9-4ad1-a624-e311f933cdcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:13.169095 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1578/3119] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:32:12 2022] DELETE /identity/v3/projects/9ebe1ca8678d43c38731d15b0bf99cfa => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:32:13.170990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cc6a6-34c3-49d3-9c2b-f86c81a44bae None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:13.171964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cc6a6-34c3-49d3-9c2b-f86c81a44bae None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:13.171964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cc6a6-34c3-49d3-9c2b-f86c81a44bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:13.227580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0d8cc6a6-34c3-49d3-9c2b-f86c81a44bae None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:13.229046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0d8cc6a6-34c3-49d3-9c2b-f86c81a44bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:13.254508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:13.421920 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1542/3120] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:13.534118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b527f-dc5e-4b78-bec9-895c776c6300 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:13.534533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b527f-dc5e-4b78-bec9-895c776c6300 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:13.534819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b527f-dc5e-4b78-bec9-895c776c6300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:13.572663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9b9b527f-dc5e-4b78-bec9-895c776c6300 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:13.574355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9b9b527f-dc5e-4b78-bec9-895c776c6300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:13.590699 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1579/3121] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:13.593979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cc6a6-34c3-49d3-9c2b-f86c81a44bae None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:13.608766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cc6a6-34c3-49d3-9c2b-f86c81a44bae None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:13.620228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dc991-71a2-4370-b865-b49d06dfcc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:13.620902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dc991-71a2-4370-b865-b49d06dfcc90 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:13.622159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dc991-71a2-4370-b865-b49d06dfcc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:13.622159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dc991-71a2-4370-b865-b49d06dfcc90 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:13.622159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50dc991-71a2-4370-b865-b49d06dfcc90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:32:13.622552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50dc991-71a2-4370-b865-b49d06dfcc90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:13.624051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50dc991-71a2-4370-b865-b49d06dfcc90 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:13.652283 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1543/3122] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:32:13.656333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b527f-dc5e-4b78-bec9-895c776c6300 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:13.668566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b527f-dc5e-4b78-bec9-895c776c6300 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:13.681909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c35d0-a092-40e2-83fd-bd78bde69fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:13.682586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c35d0-a092-40e2-83fd-bd78bde69fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:13.682944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c35d0-a092-40e2-83fd-bd78bde69fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:13.683230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c35d0-a092-40e2-83fd-bd78bde69fb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:13.684070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c35d0-a092-40e2-83fd-bd78bde69fb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:13.686017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c35d0-a092-40e2-83fd-bd78bde69fb6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:13.905098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dc991-71a2-4370-b865-b49d06dfcc90 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:13.907077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b50dc991-71a2-4370-b865-b49d06dfcc90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:13.925987 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1580/3123] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:32:13 2022] POST /identity/v3/projects => generated 381 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:32:13.926265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dc991-71a2-4370-b865-b49d06dfcc90 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:13.929535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c35d0-a092-40e2-83fd-bd78bde69fb6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:14.039329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d7e3c-2b48-46bd-abc6-f15d97e6377c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:14.041096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d7e3c-2b48-46bd-abc6-f15d97e6377c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:14.042405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d7e3c-2b48-46bd-abc6-f15d97e6377c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:14.044694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d7e3c-2b48-46bd-abc6-f15d97e6377c admin admin] PATH_INFO: `/v3/users/75cb83a284ef40baaa7038fd73519d0c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:14.050061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d7e3c-2b48-46bd-abc6-f15d97e6377c admin admin] RBAC: Authorizing `identity:delete_user(user_id=75cb83a284ef40baaa7038fd73519d0c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:14.055819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d7e3c-2b48-46bd-abc6-f15d97e6377c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:14.162070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c35d0-a092-40e2-83fd-bd78bde69fb6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:14.187397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61a5d3-9371-4c7c-8e8a-e8a5fe344dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:14.187727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61a5d3-9371-4c7c-8e8a-e8a5fe344dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:14.188370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61a5d3-9371-4c7c-8e8a-e8a5fe344dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:14.188370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61a5d3-9371-4c7c-8e8a-e8a5fe344dd6 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:14.188905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61a5d3-9371-4c7c-8e8a-e8a5fe344dd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:14.193926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61a5d3-9371-4c7c-8e8a-e8a5fe344dd6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:14.323745 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1581/3124] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:32:13 2022] POST /identity/v3/users => generated 291 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:32:14.324821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61a5d3-9371-4c7c-8e8a-e8a5fe344dd6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:14.359618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61a5d3-9371-4c7c-8e8a-e8a5fe344dd6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:14.370108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4d2d7e3c-2b48-46bd-abc6-f15d97e6377c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75cb83a284ef40baaa7038fd73519d0c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:14.371019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4d2d7e3c-2b48-46bd-abc6-f15d97e6377c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75cb83a284ef40baaa7038fd73519d0c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:14.377213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ba3d9-2a94-4641-984e-5c103b6749ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:14.377849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ba3d9-2a94-4641-984e-5c103b6749ab admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:14.378161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ba3d9-2a94-4641-984e-5c103b6749ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:14.378472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ba3d9-2a94-4641-984e-5c103b6749ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:14.379094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ba3d9-2a94-4641-984e-5c103b6749ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:14.380812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ba3d9-2a94-4641-984e-5c103b6749ab admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:14.388162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4d2d7e3c-2b48-46bd-abc6-f15d97e6377c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75cb83a284ef40baaa7038fd73519d0c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:14.419138 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1582/3125] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:32:14.420093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ba3d9-2a94-4641-984e-5c103b6749ab admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:14.432140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-126ba3d9-2a94-4641-984e-5c103b6749ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:14.437117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4d2d7e3c-2b48-46bd-abc6-f15d97e6377c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75cb83a284ef40baaa7038fd73519d0c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:14.465893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ba3d9-2a94-4641-984e-5c103b6749ab admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:14.479304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbdd73-f616-47f3-96ce-92a6fcba394b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:14.480193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbdd73-f616-47f3-96ce-92a6fcba394b admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:14.480306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbdd73-f616-47f3-96ce-92a6fcba394b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:14.480506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbdd73-f616-47f3-96ce-92a6fcba394b admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:14.481170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbdd73-f616-47f3-96ce-92a6fcba394b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:14.482993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbdd73-f616-47f3-96ce-92a6fcba394b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:14.500638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:14.510681 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1583/3126] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:32:14.511835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbdd73-f616-47f3-96ce-92a6fcba394b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:14.529219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4d2d7e3c-2b48-46bd-abc6-f15d97e6377c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75cb83a284ef40baaa7038fd73519d0c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:14.534263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbdd73-f616-47f3-96ce-92a6fcba394b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:14.541148 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1544/3127] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:32:13 2022] DELETE /identity/v3/users/75cb83a284ef40baaa7038fd73519d0c => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:32:14.542514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f518e2-9c58-49b6-80bd-97d0c1dd54c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:14.543208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f518e2-9c58-49b6-80bd-97d0c1dd54c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:14.543491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f518e2-9c58-49b6-80bd-97d0c1dd54c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:14.543779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f518e2-9c58-49b6-80bd-97d0c1dd54c7 admin admin] PATH_INFO: `/v3/projects/da001b5c2a244160b5b5aa053eb318fd/users/f8f391fe67b54a91a9519b3cde83f86c/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:14.544004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2de17b-f1a5-405e-b6b2-d299b2290d2f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:14.544234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2de17b-f1a5-405e-b6b2-d299b2290d2f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:14.544576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2de17b-f1a5-405e-b6b2-d299b2290d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:14.581332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f518e2-9c58-49b6-80bd-97d0c1dd54c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da001b5c2a244160b5b5aa053eb318fd, user_id=f8f391fe67b54a91a9519b3cde83f86c, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:14.584363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f518e2-9c58-49b6-80bd-97d0c1dd54c7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:14.601425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-cd2de17b-f1a5-405e-b6b2-d299b2290d2f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:14.603781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cd2de17b-f1a5-405e-b6b2-d299b2290d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:14.747796 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1545/3128] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:14.765124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:14.772399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2de17b-f1a5-405e-b6b2-d299b2290d2f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:14.772399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cd2de17b-f1a5-405e-b6b2-d299b2290d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:14.773835 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1584/3129] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:32:14 2022] PUT /identity/v3/projects/da001b5c2a244160b5b5aa053eb318fd/users/f8f391fe67b54a91a9519b3cde83f86c/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:32:14.781106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a40e17-58f2-48b5-8ac1-39c41df6211d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:14.782829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a40e17-58f2-48b5-8ac1-39c41df6211d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:14.784098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a40e17-58f2-48b5-8ac1-39c41df6211d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:14.874462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-37a40e17-58f2-48b5-8ac1-39c41df6211d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:14.875734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-37a40e17-58f2-48b5-8ac1-39c41df6211d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:14.908095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2de17b-f1a5-405e-b6b2-d299b2290d2f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:15.016036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1df661-0e96-4434-95a3-d3a70a6db145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:15.017027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1df661-0e96-4434-95a3-d3a70a6db145 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:15.017545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1df661-0e96-4434-95a3-d3a70a6db145 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:15.017833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1df661-0e96-4434-95a3-d3a70a6db145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:15.075693 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1585/3130] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:15.092477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a40e17-58f2-48b5-8ac1-39c41df6211d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:15.118944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a40e17-58f2-48b5-8ac1-39c41df6211d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:15.119542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1df661-0e96-4434-95a3-d3a70a6db145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:15.121031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1df661-0e96-4434-95a3-d3a70a6db145 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:15.129297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca1c22-6e59-4ab8-bd90-885ee7466390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:15.132790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca1c22-6e59-4ab8-bd90-885ee7466390 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:15.142111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca1c22-6e59-4ab8-bd90-885ee7466390 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:15.142111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca1c22-6e59-4ab8-bd90-885ee7466390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:15.170695 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1546/3131] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:32:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:32:15.188192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca1c22-6e59-4ab8-bd90-885ee7466390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:15.192636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca1c22-6e59-4ab8-bd90-885ee7466390 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:15.232992 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1586/3132] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:32:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:32:16.667521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122caef6-f3fd-4484-b069-57265edc61e4 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:16.668080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122caef6-f3fd-4484-b069-57265edc61e4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:16.668080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122caef6-f3fd-4484-b069-57265edc61e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:16.734995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-122caef6-f3fd-4484-b069-57265edc61e4 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:16.742189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-122caef6-f3fd-4484-b069-57265edc61e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:16.775777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:16.868052 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1547/3133] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:32:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:16.925214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca1c22-6e59-4ab8-bd90-885ee7466390 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:16.925708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-33ca1c22-6e59-4ab8-bd90-885ee7466390 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:17.138475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca1c22-6e59-4ab8-bd90-885ee7466390 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:17.164275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b974a5-c3b5-4172-8089-36a34d029554 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:17.164842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122caef6-f3fd-4484-b069-57265edc61e4 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:17.164969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b974a5-c3b5-4172-8089-36a34d029554 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:17.165197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b974a5-c3b5-4172-8089-36a34d029554 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:17.165480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b974a5-c3b5-4172-8089-36a34d029554 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:17.167026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-122caef6-f3fd-4484-b069-57265edc61e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:17.205456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122caef6-f3fd-4484-b069-57265edc61e4 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:17.205909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b974a5-c3b5-4172-8089-36a34d029554 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:17.207685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b974a5-c3b5-4172-8089-36a34d029554 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:17.224071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c3c34-15df-4c2c-a5fb-f2dbf20c6893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:17.224734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c3c34-15df-4c2c-a5fb-f2dbf20c6893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:17.225011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c3c34-15df-4c2c-a5fb-f2dbf20c6893 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:17.225288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c3c34-15df-4c2c-a5fb-f2dbf20c6893 admin admin] PATH_INFO: `/v3/projects/e3602ac01e5849aea009920376e40ee6` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:17.228028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c3c34-15df-4c2c-a5fb-f2dbf20c6893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3602ac01e5849aea009920376e40ee6)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:17.229256 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1587/3134] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:32:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:32:17.230204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c3c34-15df-4c2c-a5fb-f2dbf20c6893 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:17.491037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7b0c3c34-15df-4c2c-a5fb-f2dbf20c6893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3602ac01e5849aea009920376e40ee6', 'request_id': 'req-7b0c3c34-15df-4c2c-a5fb-f2dbf20c6893'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:17.625988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7b0c3c34-15df-4c2c-a5fb-f2dbf20c6893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3602ac01e5849aea009920376e40ee6', 'request_id': 'req-7b0c3c34-15df-4c2c-a5fb-f2dbf20c6893'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:17.644732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7b0c3c34-15df-4c2c-a5fb-f2dbf20c6893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3602ac01e5849aea009920376e40ee6', 'request_id': 'req-7b0c3c34-15df-4c2c-a5fb-f2dbf20c6893'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:17.696662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7b0c3c34-15df-4c2c-a5fb-f2dbf20c6893 admin admin] The token cache is being invalidate because project e3602ac01e5849aea009920376e40ee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:32:17.697310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7b0c3c34-15df-4c2c-a5fb-f2dbf20c6893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:17.697632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7b0c3c34-15df-4c2c-a5fb-f2dbf20c6893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:17.699763 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1548/3135] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:32:17 2022] DELETE /identity/v3/projects/e3602ac01e5849aea009920376e40ee6 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:32:17.704628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29d1f0-8712-4f11-a70d-ecd500e9eb85 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:17.705123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29d1f0-8712-4f11-a70d-ecd500e9eb85 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:17.710582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29d1f0-8712-4f11-a70d-ecd500e9eb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:17.740377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4d29d1f0-8712-4f11-a70d-ecd500e9eb85 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:17.742008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4d29d1f0-8712-4f11-a70d-ecd500e9eb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:17.931934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:17.949545 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1588/3136] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:17.959501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe489d8f-6c5a-4935-a9ec-0349bc822c10 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:17.964299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe489d8f-6c5a-4935-a9ec-0349bc822c10 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:17.964299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe489d8f-6c5a-4935-a9ec-0349bc822c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:18.004904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-fe489d8f-6c5a-4935-a9ec-0349bc822c10 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:18.006218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fe489d8f-6c5a-4935-a9ec-0349bc822c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:18.029913 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1549/3137] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:18.031893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29d1f0-8712-4f11-a70d-ecd500e9eb85 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:18.044962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29d1f0-8712-4f11-a70d-ecd500e9eb85 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:18.073060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1e988-c0b1-4257-8dfa-09ac1c6b7044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:18.073700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1e988-c0b1-4257-8dfa-09ac1c6b7044 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:18.073986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1e988-c0b1-4257-8dfa-09ac1c6b7044 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:18.084115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1e988-c0b1-4257-8dfa-09ac1c6b7044 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:18.084115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1e988-c0b1-4257-8dfa-09ac1c6b7044 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:32:18.084115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1e988-c0b1-4257-8dfa-09ac1c6b7044 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:18.084115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1e988-c0b1-4257-8dfa-09ac1c6b7044 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:18.107902 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1589/3138] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:32:18.112531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe489d8f-6c5a-4935-a9ec-0349bc822c10 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:18.125070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe489d8f-6c5a-4935-a9ec-0349bc822c10 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:18.140771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1331e9-5093-40ff-8f80-1cddd327ab32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:18.141616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1331e9-5093-40ff-8f80-1cddd327ab32 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:18.142071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1331e9-5093-40ff-8f80-1cddd327ab32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:18.143049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1331e9-5093-40ff-8f80-1cddd327ab32 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:18.143919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1331e9-5093-40ff-8f80-1cddd327ab32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:18.146328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1331e9-5093-40ff-8f80-1cddd327ab32 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:18.289819 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1550/3139] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:32:18 2022] POST /identity/v3/projects => generated 413 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:32:18.294052 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1e988-c0b1-4257-8dfa-09ac1c6b7044 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:18.313853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1e988-c0b1-4257-8dfa-09ac1c6b7044 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:18.495449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b9fe9-7eeb-4145-aab6-fea3ac700c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:18.496942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b9fe9-7eeb-4145-aab6-fea3ac700c28 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:18.497271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b9fe9-7eeb-4145-aab6-fea3ac700c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:18.498133 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b9fe9-7eeb-4145-aab6-fea3ac700c28 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:18.498284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b9fe9-7eeb-4145-aab6-fea3ac700c28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:18.507837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b9fe9-7eeb-4145-aab6-fea3ac700c28 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:18.708903 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1590/3140] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:32:18 2022] POST /identity/v3/users => generated 307 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:32:18.713519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1331e9-5093-40ff-8f80-1cddd327ab32 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:18.728139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1331e9-5093-40ff-8f80-1cddd327ab32 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:18.737078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9af5e-5ad2-46c3-bef4-9c5954ade05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:18.738151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9af5e-5ad2-46c3-bef4-9c5954ade05f admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:18.738658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9af5e-5ad2-46c3-bef4-9c5954ade05f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:18.739140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9af5e-5ad2-46c3-bef4-9c5954ade05f admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:18.740147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9af5e-5ad2-46c3-bef4-9c5954ade05f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:18.743312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9af5e-5ad2-46c3-bef4-9c5954ade05f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:18.759289 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1551/3141] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:32:18.763969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b9fe9-7eeb-4145-aab6-fea3ac700c28 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:18.777716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b9fe9-7eeb-4145-aab6-fea3ac700c28 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:18.784930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6147aac-25e5-449d-9e0a-fc03260f8097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:18.786126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6147aac-25e5-449d-9e0a-fc03260f8097 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:18.786242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6147aac-25e5-449d-9e0a-fc03260f8097 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:18.786646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6147aac-25e5-449d-9e0a-fc03260f8097 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:18.787116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6147aac-25e5-449d-9e0a-fc03260f8097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:18.790021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6147aac-25e5-449d-9e0a-fc03260f8097 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:18.807834 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1591/3142] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:32:18.812381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9af5e-5ad2-46c3-bef4-9c5954ade05f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:18.838658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9af5e-5ad2-46c3-bef4-9c5954ade05f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:18.857460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a712c3-d3af-40bc-875a-0742c6e74697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:18.858568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a712c3-d3af-40bc-875a-0742c6e74697 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:18.859039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a712c3-d3af-40bc-875a-0742c6e74697 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:18.860316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a712c3-d3af-40bc-875a-0742c6e74697 admin admin] PATH_INFO: `/v3/projects/dd32721d34bc40679303d6f47daae25c/users/cd284264ddc64d58baee15e337d5fcc6/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:18.882971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a712c3-d3af-40bc-875a-0742c6e74697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd32721d34bc40679303d6f47daae25c, user_id=cd284264ddc64d58baee15e337d5fcc6, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:18.887135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a712c3-d3af-40bc-875a-0742c6e74697 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:19.355752 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1552/3143] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:32:18 2022] PUT /identity/v3/projects/dd32721d34bc40679303d6f47daae25c/users/cd284264ddc64d58baee15e337d5fcc6/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:32:19.362889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e7085-cd85-469c-af5f-23de8f9c35a2 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:19.363429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e7085-cd85-469c-af5f-23de8f9c35a2 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:19.364429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e7085-cd85-469c-af5f-23de8f9c35a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:19.395534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d64e7085-cd85-469c-af5f-23de8f9c35a2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:19.396917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d64e7085-cd85-469c-af5f-23de8f9c35a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:19.568821 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1592/3144] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:19.580368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a712c3-d3af-40bc-875a-0742c6e74697 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:19.582215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e7a712c3-d3af-40bc-875a-0742c6e74697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:19.717888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:19.734350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a712c3-d3af-40bc-875a-0742c6e74697 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:19.745906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d601c6d-31b9-4b1f-b726-02eb8d3d2fb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:19.751210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d601c6d-31b9-4b1f-b726-02eb8d3d2fb7 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:19.751210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d601c6d-31b9-4b1f-b726-02eb8d3d2fb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:19.751210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d601c6d-31b9-4b1f-b726-02eb8d3d2fb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:19.768195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d601c6d-31b9-4b1f-b726-02eb8d3d2fb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:19.772186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d601c6d-31b9-4b1f-b726-02eb8d3d2fb7 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:19.798554 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1553/3145] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:32:28.437030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940900c9-d13d-4bb4-860a-c076e8de0ce2 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:28.443930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940900c9-d13d-4bb4-860a-c076e8de0ce2 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:28.443930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940900c9-d13d-4bb4-860a-c076e8de0ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:28.510608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-940900c9-d13d-4bb4-860a-c076e8de0ce2 None None] MFA Rules not processed for user `0533917bc5aa4e23802a43b1eb534bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:28.513290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-940900c9-d13d-4bb4-860a-c076e8de0ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:28.664423 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1593/3146] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:29.114483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c208d64-3b5a-4861-9c2e-db54413e4f1e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:29.115691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c208d64-3b5a-4861-9c2e-db54413e4f1e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:29.116146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c208d64-3b5a-4861-9c2e-db54413e4f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:29.166106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8c208d64-3b5a-4861-9c2e-db54413e4f1e None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:29.167711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8c208d64-3b5a-4861-9c2e-db54413e4f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:29.453648 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1554/3147] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:32:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:29.469627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940900c9-d13d-4bb4-860a-c076e8de0ce2 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:29.471227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-940900c9-d13d-4bb4-860a-c076e8de0ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:29.478969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:29.699489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940900c9-d13d-4bb4-860a-c076e8de0ce2 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:29.719444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2945d-d498-4503-b3e8-94df47554de5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:29.719444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2945d-d498-4503-b3e8-94df47554de5 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:29.719444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2945d-d498-4503-b3e8-94df47554de5 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:29.719444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2945d-d498-4503-b3e8-94df47554de5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:29.727771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2945d-d498-4503-b3e8-94df47554de5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:29.729898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2945d-d498-4503-b3e8-94df47554de5 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:29.763482 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1594/3148] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:32:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:32:32.235116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8a259-87bf-4ce7-8d80-4339a1e035cf None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:32.242554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8a259-87bf-4ce7-8d80-4339a1e035cf None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:32.243089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8a259-87bf-4ce7-8d80-4339a1e035cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:32.348624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-51d8a259-87bf-4ce7-8d80-4339a1e035cf None None] MFA Rules not processed for user `f8f391fe67b54a91a9519b3cde83f86c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:32.349977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-51d8a259-87bf-4ce7-8d80-4339a1e035cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:32.510435 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1555/3149] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:32.520773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356e14d-af6d-4015-becf-c2bd51e2c68f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:32.521163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356e14d-af6d-4015-becf-c2bd51e2c68f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:32.521387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356e14d-af6d-4015-becf-c2bd51e2c68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:32.549237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d356e14d-af6d-4015-becf-c2bd51e2c68f None None] MFA Rules not processed for user `f8f391fe67b54a91a9519b3cde83f86c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:32.549237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d356e14d-af6d-4015-becf-c2bd51e2c68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:32.562022 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1595/3150] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:32:32.863994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228230fc-c116-44b6-ac12-e1e8e180ac4b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:32.864562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228230fc-c116-44b6-ac12-e1e8e180ac4b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:32.865029 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228230fc-c116-44b6-ac12-e1e8e180ac4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:32.935901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-228230fc-c116-44b6-ac12-e1e8e180ac4b None None] MFA Rules not processed for user `90cf87b409a94da385c0dc9b39884665`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:32.939419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-228230fc-c116-44b6-ac12-e1e8e180ac4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:33.140702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b276e-c33c-49d3-a2b7-98de7f20b211 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:33.140995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b276e-c33c-49d3-a2b7-98de7f20b211 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:33.141269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b276e-c33c-49d3-a2b7-98de7f20b211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:33.186280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-224b276e-c33c-49d3-a2b7-98de7f20b211 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:33.188311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-224b276e-c33c-49d3-a2b7-98de7f20b211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:33.210624 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1596/3151] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:32:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:32:33.222862 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1556/3152] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:32 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:33.246186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b276e-c33c-49d3-a2b7-98de7f20b211 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:33.281427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b276e-c33c-49d3-a2b7-98de7f20b211 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:33.291097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270a113-3e64-4aea-8d7b-9113b10e361f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:33.292053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270a113-3e64-4aea-8d7b-9113b10e361f service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:33.296732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270a113-3e64-4aea-8d7b-9113b10e361f service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:33.296732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270a113-3e64-4aea-8d7b-9113b10e361f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:33.308071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270a113-3e64-4aea-8d7b-9113b10e361f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:33.309930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270a113-3e64-4aea-8d7b-9113b10e361f service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:33.358815 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1597/3153] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:32:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:32:35.292844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88994ae5-be38-4057-a7e4-ae2d57078cbc None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:35.293353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88994ae5-be38-4057-a7e4-ae2d57078cbc None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:35.293448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88994ae5-be38-4057-a7e4-ae2d57078cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:35.387430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:35.394377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-88994ae5-be38-4057-a7e4-ae2d57078cbc None None] MFA Rules not processed for user `cd284264ddc64d58baee15e337d5fcc6`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:35.398899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-88994ae5-be38-4057-a7e4-ae2d57078cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:35.578058 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1557/3154] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:35 2022] POST /identity/v3/auth/tokens => generated 3290 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:35.589960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249aa847-1c9a-4424-85cd-dab9a2980727 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:35.590930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249aa847-1c9a-4424-85cd-dab9a2980727 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:35.591362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249aa847-1c9a-4424-85cd-dab9a2980727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:35.629356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-249aa847-1c9a-4424-85cd-dab9a2980727 None None] MFA Rules not processed for user `cd284264ddc64d58baee15e337d5fcc6`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:35.631713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-249aa847-1c9a-4424-85cd-dab9a2980727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:35.645828 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1598/3155] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:35 2022] POST /identity/v3/auth/tokens => generated 3290 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:36.001432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88994ae5-be38-4057-a7e4-ae2d57078cbc None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:36.001432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-88994ae5-be38-4057-a7e4-ae2d57078cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:36.011867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249aa847-1c9a-4424-85cd-dab9a2980727 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:36.013513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-249aa847-1c9a-4424-85cd-dab9a2980727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:36.154829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88994ae5-be38-4057-a7e4-ae2d57078cbc None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:36.168538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce88106-3c90-47e5-a84b-220c24e8dc93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:36.170832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce88106-3c90-47e5-a84b-220c24e8dc93 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:36.171159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce88106-3c90-47e5-a84b-220c24e8dc93 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:36.171438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce88106-3c90-47e5-a84b-220c24e8dc93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:36.185098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce88106-3c90-47e5-a84b-220c24e8dc93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:36.187137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce88106-3c90-47e5-a84b-220c24e8dc93 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:36.194641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249aa847-1c9a-4424-85cd-dab9a2980727 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:36.207492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636d781-eb69-42b3-9dd7-0cc0c009d63b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:36.207492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636d781-eb69-42b3-9dd7-0cc0c009d63b service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:36.207492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636d781-eb69-42b3-9dd7-0cc0c009d63b service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:36.207492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636d781-eb69-42b3-9dd7-0cc0c009d63b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:36.207956 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1558/3156] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:32:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:32:36.235414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636d781-eb69-42b3-9dd7-0cc0c009d63b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:36.238199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636d781-eb69-42b3-9dd7-0cc0c009d63b service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:36.260950 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1599/3157] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:32:36 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:32:36.919635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce88106-3c90-47e5-a84b-220c24e8dc93 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:36.921035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af2b45-a616-4c7a-95fc-e178e5284eaf None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:36.922228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af2b45-a616-4c7a-95fc-e178e5284eaf None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:36.922689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af2b45-a616-4c7a-95fc-e178e5284eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:36.931684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce88106-3c90-47e5-a84b-220c24e8dc93 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:36.946645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f8fbe-190b-417a-8272-6af8bf25e592 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:36.947664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f8fbe-190b-417a-8272-6af8bf25e592 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:36.948205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f8fbe-190b-417a-8272-6af8bf25e592 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:36.948688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f8fbe-190b-417a-8272-6af8bf25e592 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:36.966939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f8fbe-190b-417a-8272-6af8bf25e592 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:36.968140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-01af2b45-a616-4c7a-95fc-e178e5284eaf None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:36.969306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f8fbe-190b-417a-8272-6af8bf25e592 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:36.974646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-01af2b45-a616-4c7a-95fc-e178e5284eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:37.003200 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1559/3158] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:32:36 2022] GET /identity/v3/auth/tokens => generated 3290 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:32:37.012927 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1600/3159] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:32:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:37.025251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f8fbe-190b-417a-8272-6af8bf25e592 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:37.055525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f8fbe-190b-417a-8272-6af8bf25e592 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:37.075743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46316002-d598-484a-8a40-a19d38ebe0f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:37.076609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46316002-d598-484a-8a40-a19d38ebe0f4 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:37.077126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46316002-d598-484a-8a40-a19d38ebe0f4 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:37.077470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46316002-d598-484a-8a40-a19d38ebe0f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:37.107926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46316002-d598-484a-8a40-a19d38ebe0f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:37.110013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46316002-d598-484a-8a40-a19d38ebe0f4 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:37.121406 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1560/3160] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:32:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:32:37.777775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af2b45-a616-4c7a-95fc-e178e5284eaf None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:37.831350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af2b45-a616-4c7a-95fc-e178e5284eaf None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:37.840645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac45ea-7740-4198-b985-39d9c3d7926c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:37.842234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac45ea-7740-4198-b985-39d9c3d7926c service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:37.843417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac45ea-7740-4198-b985-39d9c3d7926c service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:37.849306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac45ea-7740-4198-b985-39d9c3d7926c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:37.854725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1bac45ea-7740-4198-b985-39d9c3d7926c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:37.877133 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac45ea-7740-4198-b985-39d9c3d7926c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:37.879066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac45ea-7740-4198-b985-39d9c3d7926c service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:37.904406 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1601/3161] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:32:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:32:38.596818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affc56d-722a-40e4-b767-4845680fe7e3 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:38.597359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affc56d-722a-40e4-b767-4845680fe7e3 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:38.597359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affc56d-722a-40e4-b767-4845680fe7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:38.654231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9affc56d-722a-40e4-b767-4845680fe7e3 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:38.655784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9affc56d-722a-40e4-b767-4845680fe7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:38.665052 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1561/3162] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:32:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:38.679084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac45ea-7740-4198-b985-39d9c3d7926c service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:38.699075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac45ea-7740-4198-b985-39d9c3d7926c service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:38.715043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb11f1-543f-4e18-9a45-4a218956576a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:38.716838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb11f1-543f-4e18-9a45-4a218956576a service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:38.718181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb11f1-543f-4e18-9a45-4a218956576a service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:38.721283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb11f1-543f-4e18-9a45-4a218956576a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:38.745768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb11f1-543f-4e18-9a45-4a218956576a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:38.749739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb11f1-543f-4e18-9a45-4a218956576a service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:38.807522 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1602/3163] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:32:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:32:44.406175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affc56d-722a-40e4-b767-4845680fe7e3 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:44.408598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9affc56d-722a-40e4-b767-4845680fe7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:44.428569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affc56d-722a-40e4-b767-4845680fe7e3 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:44.436685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750d19b-b105-4ee4-a919-ebc0555f339d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:44.437614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750d19b-b105-4ee4-a919-ebc0555f339d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:44.438140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750d19b-b105-4ee4-a919-ebc0555f339d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:44.439516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750d19b-b105-4ee4-a919-ebc0555f339d admin admin] PATH_INFO: `/v3/users/42cd1938c86a4f389a2ec0fba9beff36` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:44.441142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750d19b-b105-4ee4-a919-ebc0555f339d admin admin] RBAC: Authorizing `identity:delete_user(user_id=42cd1938c86a4f389a2ec0fba9beff36)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:44.443744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750d19b-b105-4ee4-a919-ebc0555f339d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:44.782643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3750d19b-b105-4ee4-a919-ebc0555f339d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42cd1938c86a4f389a2ec0fba9beff36'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:44.783628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3750d19b-b105-4ee4-a919-ebc0555f339d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42cd1938c86a4f389a2ec0fba9beff36'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:44.788349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:44.818810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3750d19b-b105-4ee4-a919-ebc0555f339d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42cd1938c86a4f389a2ec0fba9beff36'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:44.867742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3750d19b-b105-4ee4-a919-ebc0555f339d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42cd1938c86a4f389a2ec0fba9beff36'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:44.998298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3750d19b-b105-4ee4-a919-ebc0555f339d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42cd1938c86a4f389a2ec0fba9beff36'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:45.008307 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1562/3164] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:32:44 2022] DELETE /identity/v3/users/42cd1938c86a4f389a2ec0fba9beff36 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:32:45.013032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd4a79-6695-4c39-bd28-a0a144b84dcf None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:45.013552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd4a79-6695-4c39-bd28-a0a144b84dcf None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:45.013930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd4a79-6695-4c39-bd28-a0a144b84dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:45.050248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-49fd4a79-6695-4c39-bd28-a0a144b84dcf None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:45.051577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-49fd4a79-6695-4c39-bd28-a0a144b84dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:45.080575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:45.200155 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1603/3165] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:45.283918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750d19b-b105-4ee4-a919-ebc0555f339d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:45.285457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3750d19b-b105-4ee4-a919-ebc0555f339d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:45.533572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750d19b-b105-4ee4-a919-ebc0555f339d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:45.538004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202e437-fe46-4b00-8945-006232693cc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:45.543698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202e437-fe46-4b00-8945-006232693cc6 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:45.543698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202e437-fe46-4b00-8945-006232693cc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:45.543698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202e437-fe46-4b00-8945-006232693cc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:45.550662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202e437-fe46-4b00-8945-006232693cc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:45.554440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202e437-fe46-4b00-8945-006232693cc6 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:45.567975 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1563/3166] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:32:46.751494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd4a79-6695-4c39-bd28-a0a144b84dcf None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:46.754807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-49fd4a79-6695-4c39-bd28-a0a144b84dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:46.786117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd4a79-6695-4c39-bd28-a0a144b84dcf None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:46.804291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23baa782-786b-438e-a700-3e2eeb9cadf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:46.804683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23baa782-786b-438e-a700-3e2eeb9cadf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:46.805223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23baa782-786b-438e-a700-3e2eeb9cadf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:46.805675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23baa782-786b-438e-a700-3e2eeb9cadf4 admin admin] PATH_INFO: `/v3/projects/ccd0392257a0419dbfa569c8816ece2b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:46.807069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23baa782-786b-438e-a700-3e2eeb9cadf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd0392257a0419dbfa569c8816ece2b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:46.809173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23baa782-786b-438e-a700-3e2eeb9cadf4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:47.024054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-23baa782-786b-438e-a700-3e2eeb9cadf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd0392257a0419dbfa569c8816ece2b', 'request_id': 'req-23baa782-786b-438e-a700-3e2eeb9cadf4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:47.040544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-23baa782-786b-438e-a700-3e2eeb9cadf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd0392257a0419dbfa569c8816ece2b', 'request_id': 'req-23baa782-786b-438e-a700-3e2eeb9cadf4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:47.048880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-23baa782-786b-438e-a700-3e2eeb9cadf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd0392257a0419dbfa569c8816ece2b', 'request_id': 'req-23baa782-786b-438e-a700-3e2eeb9cadf4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:47.127958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-23baa782-786b-438e-a700-3e2eeb9cadf4 admin admin] The token cache is being invalidate because project ccd0392257a0419dbfa569c8816ece2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:32:47.128570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-23baa782-786b-438e-a700-3e2eeb9cadf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:47.129828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-23baa782-786b-438e-a700-3e2eeb9cadf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:47.136583 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1604/3167] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:32:46 2022] DELETE /identity/v3/projects/ccd0392257a0419dbfa569c8816ece2b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:32:47.138013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0aa566-1dc6-4f27-ae77-62c6d53c2df9 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:47.138485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0aa566-1dc6-4f27-ae77-62c6d53c2df9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:47.138640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0aa566-1dc6-4f27-ae77-62c6d53c2df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:47.180475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-3e0aa566-1dc6-4f27-ae77-62c6d53c2df9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:47.181734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3e0aa566-1dc6-4f27-ae77-62c6d53c2df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:47.412698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156f1a5-34e8-4af8-89dc-9bab56ff6ab3 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:47.413415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156f1a5-34e8-4af8-89dc-9bab56ff6ab3 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:47.413944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156f1a5-34e8-4af8-89dc-9bab56ff6ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:47.426591 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1564/3168] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:32:47.444037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a156f1a5-34e8-4af8-89dc-9bab56ff6ab3 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:47.445778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a156f1a5-34e8-4af8-89dc-9bab56ff6ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:47.464524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0aa566-1dc6-4f27-ae77-62c6d53c2df9 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:47.477011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0aa566-1dc6-4f27-ae77-62c6d53c2df9 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:47.477660 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1605/3169] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:47.484426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14921880-9553-4d1b-b5e8-b0dfb0a61d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:47.485322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14921880-9553-4d1b-b5e8-b0dfb0a61d45 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:47.486607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14921880-9553-4d1b-b5e8-b0dfb0a61d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:47.487111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14921880-9553-4d1b-b5e8-b0dfb0a61d45 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:47.487982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14921880-9553-4d1b-b5e8-b0dfb0a61d45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:32:47.488518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14921880-9553-4d1b-b5e8-b0dfb0a61d45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:47.494059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14921880-9553-4d1b-b5e8-b0dfb0a61d45 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:47.520913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156f1a5-34e8-4af8-89dc-9bab56ff6ab3 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:47.528596 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1565/3170] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:32:47.531946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156f1a5-34e8-4af8-89dc-9bab56ff6ab3 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:47.537459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdc451-2484-4720-b583-127b5a7458e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:47.538375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdc451-2484-4720-b583-127b5a7458e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:47.538720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdc451-2484-4720-b583-127b5a7458e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:47.538999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdc451-2484-4720-b583-127b5a7458e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:47.539646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdc451-2484-4720-b583-127b5a7458e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:47.541591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdc451-2484-4720-b583-127b5a7458e4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:47.645316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14921880-9553-4d1b-b5e8-b0dfb0a61d45 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:47.654148 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1606/3171] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:32:47 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:32:47.656573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14921880-9553-4d1b-b5e8-b0dfb0a61d45 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:47.797553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:47.811143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79611cc-0269-4cdb-b4f4-43a922765bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:47.811775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79611cc-0269-4cdb-b4f4-43a922765bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:47.812061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79611cc-0269-4cdb-b4f4-43a922765bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:47.812402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79611cc-0269-4cdb-b4f4-43a922765bd5 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:47.813809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79611cc-0269-4cdb-b4f4-43a922765bd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:47.815970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79611cc-0269-4cdb-b4f4-43a922765bd5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:47.917639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdc451-2484-4720-b583-127b5a7458e4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:47.932755 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1566/3172] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:32:47 2022] POST /identity/v3/users => generated 294 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:32:47.937007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdc451-2484-4720-b583-127b5a7458e4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:47.943441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bd258-a751-40cb-80ff-156d9a693d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:47.944070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bd258-a751-40cb-80ff-156d9a693d78 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:47.944363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bd258-a751-40cb-80ff-156d9a693d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:47.944748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bd258-a751-40cb-80ff-156d9a693d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:47.945624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bd258-a751-40cb-80ff-156d9a693d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:47.947503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bd258-a751-40cb-80ff-156d9a693d78 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:47.964610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79611cc-0269-4cdb-b4f4-43a922765bd5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:47.990113 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1607/3173] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:32:47.993137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79611cc-0269-4cdb-b4f4-43a922765bd5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:47.998628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86403f61-b109-40c2-bee3-ebcaecc05c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:47.999699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86403f61-b109-40c2-bee3-ebcaecc05c0c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:47.999997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86403f61-b109-40c2-bee3-ebcaecc05c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:48.000369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86403f61-b109-40c2-bee3-ebcaecc05c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:48.001041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86403f61-b109-40c2-bee3-ebcaecc05c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:48.003046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86403f61-b109-40c2-bee3-ebcaecc05c0c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:48.020758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bd258-a751-40cb-80ff-156d9a693d78 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:48.026353 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1567/3174] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:32:48.035454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bd258-a751-40cb-80ff-156d9a693d78 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:48.045796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcaadd-6a14-4204-ac70-e3812f48638e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:48.046628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcaadd-6a14-4204-ac70-e3812f48638e admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:48.047199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcaadd-6a14-4204-ac70-e3812f48638e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:48.048215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcaadd-6a14-4204-ac70-e3812f48638e admin admin] PATH_INFO: `/v3/projects/296abb4b5dde441da95f4d09089f348e/users/0d9053ce63864308b29190f9f51bd85f/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:48.068084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcaadd-6a14-4204-ac70-e3812f48638e admin admin] RBAC: Authorizing `identity:create_grant(project_id=296abb4b5dde441da95f4d09089f348e, user_id=0d9053ce63864308b29190f9f51bd85f, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:48.085258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcaadd-6a14-4204-ac70-e3812f48638e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:48.174152 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1608/3175] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:32:48 2022] PUT /identity/v3/projects/296abb4b5dde441da95f4d09089f348e/users/0d9053ce63864308b29190f9f51bd85f/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:32:48.179945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a4d7e-76fd-4a99-982b-7c7248d41184 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:48.180732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a4d7e-76fd-4a99-982b-7c7248d41184 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:48.181151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a4d7e-76fd-4a99-982b-7c7248d41184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:48.250078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-132a4d7e-76fd-4a99-982b-7c7248d41184 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:48.251375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-132a4d7e-76fd-4a99-982b-7c7248d41184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:48.384913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcaadd-6a14-4204-ac70-e3812f48638e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:48.388945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f5fcaadd-6a14-4204-ac70-e3812f48638e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:48.389079 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1568/3176] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:48.410061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcaadd-6a14-4204-ac70-e3812f48638e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:48.413449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a4d7e-76fd-4a99-982b-7c7248d41184 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:48.415469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-132a4d7e-76fd-4a99-982b-7c7248d41184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:48.424555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec615873-bf50-4add-b04d-660d8a9d0821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:48.425231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec615873-bf50-4add-b04d-660d8a9d0821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:48.425690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec615873-bf50-4add-b04d-660d8a9d0821 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:48.426140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec615873-bf50-4add-b04d-660d8a9d0821 admin admin] PATH_INFO: `/v3/users/90cf87b409a94da385c0dc9b39884665` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:48.431866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec615873-bf50-4add-b04d-660d8a9d0821 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90cf87b409a94da385c0dc9b39884665)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:48.434088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec615873-bf50-4add-b04d-660d8a9d0821 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:48.542414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a4d7e-76fd-4a99-982b-7c7248d41184 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:48.550269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b349758-152f-4825-b652-d62f82aee91c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:48.551268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b349758-152f-4825-b652-d62f82aee91c service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:48.551727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b349758-152f-4825-b652-d62f82aee91c service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:48.552185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b349758-152f-4825-b652-d62f82aee91c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:48.576342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b349758-152f-4825-b652-d62f82aee91c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:48.578119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b349758-152f-4825-b652-d62f82aee91c service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:48.584354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:48.600940 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1569/3177] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:32:48.764446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ec615873-bf50-4add-b04d-660d8a9d0821 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90cf87b409a94da385c0dc9b39884665'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:48.765265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ec615873-bf50-4add-b04d-660d8a9d0821 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90cf87b409a94da385c0dc9b39884665'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:48.778441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ec615873-bf50-4add-b04d-660d8a9d0821 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90cf87b409a94da385c0dc9b39884665'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:48.810547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ec615873-bf50-4add-b04d-660d8a9d0821 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90cf87b409a94da385c0dc9b39884665'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:48.811825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ec615873-bf50-4add-b04d-660d8a9d0821 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90cf87b409a94da385c0dc9b39884665'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:48.938251 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1609/3178] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:32:48 2022] DELETE /identity/v3/users/90cf87b409a94da385c0dc9b39884665 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:32:50.333570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b349758-152f-4825-b652-d62f82aee91c service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:50.347346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b349758-152f-4825-b652-d62f82aee91c service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:50.447056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280a87a-d3d1-4d6a-a1f3-c912f2b6a989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:50.448694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280a87a-d3d1-4d6a-a1f3-c912f2b6a989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:50.449513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280a87a-d3d1-4d6a-a1f3-c912f2b6a989 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:50.450129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280a87a-d3d1-4d6a-a1f3-c912f2b6a989 admin admin] PATH_INFO: `/v3/projects/f710dd9fc15b46578dd67cdfb4bb121e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:50.453238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280a87a-d3d1-4d6a-a1f3-c912f2b6a989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f710dd9fc15b46578dd67cdfb4bb121e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:50.458129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280a87a-d3d1-4d6a-a1f3-c912f2b6a989 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:50.487093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:50.635256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3280a87a-d3d1-4d6a-a1f3-c912f2b6a989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f710dd9fc15b46578dd67cdfb4bb121e', 'request_id': 'req-3280a87a-d3d1-4d6a-a1f3-c912f2b6a989'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:50.706315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3280a87a-d3d1-4d6a-a1f3-c912f2b6a989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f710dd9fc15b46578dd67cdfb4bb121e', 'request_id': 'req-3280a87a-d3d1-4d6a-a1f3-c912f2b6a989'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:50.713262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3280a87a-d3d1-4d6a-a1f3-c912f2b6a989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f710dd9fc15b46578dd67cdfb4bb121e', 'request_id': 'req-3280a87a-d3d1-4d6a-a1f3-c912f2b6a989'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:50.724939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3280a87a-d3d1-4d6a-a1f3-c912f2b6a989 admin admin] The token cache is being invalidate because project f710dd9fc15b46578dd67cdfb4bb121e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:32:50.725231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3280a87a-d3d1-4d6a-a1f3-c912f2b6a989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:50.725909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3280a87a-d3d1-4d6a-a1f3-c912f2b6a989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:50.728524 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1570/3179] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:32:50 2022] DELETE /identity/v3/projects/f710dd9fc15b46578dd67cdfb4bb121e => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:32:50.733558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f55af5-42ae-44b5-a9eb-c0379fe522fe None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:50.734525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f55af5-42ae-44b5-a9eb-c0379fe522fe None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:50.735037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f55af5-42ae-44b5-a9eb-c0379fe522fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:50.772263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-19f55af5-42ae-44b5-a9eb-c0379fe522fe None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:50.773961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-19f55af5-42ae-44b5-a9eb-c0379fe522fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:50.887767 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1610/3180] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:50.897015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8beb0-a972-44b8-8a70-c621ea5516a9 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:50.897314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8beb0-a972-44b8-8a70-c621ea5516a9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:50.897621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8beb0-a972-44b8-8a70-c621ea5516a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:50.925688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-81f8beb0-a972-44b8-8a70-c621ea5516a9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:50.927110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-81f8beb0-a972-44b8-8a70-c621ea5516a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:50.953404 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1571/3181] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:50.958412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f55af5-42ae-44b5-a9eb-c0379fe522fe None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:50.976733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f55af5-42ae-44b5-a9eb-c0379fe522fe None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:50.983353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7216a0-0abb-44ab-a99f-fba139d8b428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:50.984314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7216a0-0abb-44ab-a99f-fba139d8b428 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:50.985101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7216a0-0abb-44ab-a99f-fba139d8b428 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:50.986243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7216a0-0abb-44ab-a99f-fba139d8b428 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:50.987182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7216a0-0abb-44ab-a99f-fba139d8b428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:32:50.987711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7216a0-0abb-44ab-a99f-fba139d8b428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:50.990231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7216a0-0abb-44ab-a99f-fba139d8b428 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:51.007655 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1611/3182] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:32:51.011959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8beb0-a972-44b8-8a70-c621ea5516a9 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:51.022889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8beb0-a972-44b8-8a70-c621ea5516a9 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:51.029629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185094c-cddb-4696-ba64-d1223324bfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:51.031675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185094c-cddb-4696-ba64-d1223324bfee admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:51.031963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185094c-cddb-4696-ba64-d1223324bfee admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:51.032568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185094c-cddb-4696-ba64-d1223324bfee admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:51.033276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185094c-cddb-4696-ba64-d1223324bfee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:51.035861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185094c-cddb-4696-ba64-d1223324bfee admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:51.133526 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1572/3183] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:32:51 2022] POST /identity/v3/projects => generated 393 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:32:51.135290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7216a0-0abb-44ab-a99f-fba139d8b428 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:51.147129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7216a0-0abb-44ab-a99f-fba139d8b428 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:51.318450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b18737-09be-4107-9571-364987a2a493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:51.319239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b18737-09be-4107-9571-364987a2a493 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:51.319640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b18737-09be-4107-9571-364987a2a493 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:51.320023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b18737-09be-4107-9571-364987a2a493 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:51.320831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b18737-09be-4107-9571-364987a2a493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:51.322904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b18737-09be-4107-9571-364987a2a493 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:51.467976 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1612/3184] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:32:51 2022] POST /identity/v3/users => generated 297 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:32:51.472895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185094c-cddb-4696-ba64-d1223324bfee admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:51.503103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185094c-cddb-4696-ba64-d1223324bfee admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:51.508868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c2171-1805-467b-8fbf-afa85e24ed86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:51.509816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c2171-1805-467b-8fbf-afa85e24ed86 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:51.511317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c2171-1805-467b-8fbf-afa85e24ed86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:51.512736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c2171-1805-467b-8fbf-afa85e24ed86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:51.513804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c2171-1805-467b-8fbf-afa85e24ed86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:51.516249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c2171-1805-467b-8fbf-afa85e24ed86 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:51.560679 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1573/3185] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:32:51.565138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b18737-09be-4107-9571-364987a2a493 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:51.585560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b18737-09be-4107-9571-364987a2a493 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:51.596448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed435736-acec-4b9c-a10d-bf0c3e2ced6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:51.597114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed435736-acec-4b9c-a10d-bf0c3e2ced6a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:51.597395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed435736-acec-4b9c-a10d-bf0c3e2ced6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:51.597666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed435736-acec-4b9c-a10d-bf0c3e2ced6a admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:51.598370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed435736-acec-4b9c-a10d-bf0c3e2ced6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:51.599986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed435736-acec-4b9c-a10d-bf0c3e2ced6a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:51.631119 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1613/3186] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:32:51.631802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c2171-1805-467b-8fbf-afa85e24ed86 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:51.649631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c2171-1805-467b-8fbf-afa85e24ed86 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:51.664914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d5aec-a322-46c8-8dc5-c5462c3e50c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:51.665626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d5aec-a322-46c8-8dc5-c5462c3e50c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:51.668507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d5aec-a322-46c8-8dc5-c5462c3e50c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:51.668507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d5aec-a322-46c8-8dc5-c5462c3e50c2 admin admin] PATH_INFO: `/v3/projects/70e4000d770f4a2faadfe358ac12d8c8/users/f49b3fec8ed549ce89cba8b043c3c414/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:51.723572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d5aec-a322-46c8-8dc5-c5462c3e50c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70e4000d770f4a2faadfe358ac12d8c8, user_id=f49b3fec8ed549ce89cba8b043c3c414, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:51.728503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d5aec-a322-46c8-8dc5-c5462c3e50c2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:51.764760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b16bd-0c5f-4d68-abe3-051c053687e5 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:51.765336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b16bd-0c5f-4d68-abe3-051c053687e5 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:51.765336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b16bd-0c5f-4d68-abe3-051c053687e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:51.799784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ae6b16bd-0c5f-4d68-abe3-051c053687e5 None None] MFA Rules not processed for user `94897f20beb94dbd8e7eff6ecba30026`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:51.801116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ae6b16bd-0c5f-4d68-abe3-051c053687e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:51.821895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:51.854961 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1574/3187] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:32:51 2022] PUT /identity/v3/projects/70e4000d770f4a2faadfe358ac12d8c8/users/f49b3fec8ed549ce89cba8b043c3c414/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:32:51.874691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea995c8-5cdc-474f-ab6a-a3dfd9dbb267 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:51.874804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea995c8-5cdc-474f-ab6a-a3dfd9dbb267 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:51.875560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea995c8-5cdc-474f-ab6a-a3dfd9dbb267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:51.931093 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1614/3188] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:32:51.960440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9ea995c8-5cdc-474f-ab6a-a3dfd9dbb267 None None] MFA Rules not processed for user `f49b3fec8ed549ce89cba8b043c3c414`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:51.961978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9ea995c8-5cdc-474f-ab6a-a3dfd9dbb267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:52.144387 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1575/3189] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:52.792710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b16bd-0c5f-4d68-abe3-051c053687e5 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:52.794500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ae6b16bd-0c5f-4d68-abe3-051c053687e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:52.905986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b16bd-0c5f-4d68-abe3-051c053687e5 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:53.002890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ece798-9560-4b5b-bccc-4bcc69f606d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:53.003557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ece798-9560-4b5b-bccc-4bcc69f606d6 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:53.003808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ece798-9560-4b5b-bccc-4bcc69f606d6 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:53.004087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ece798-9560-4b5b-bccc-4bcc69f606d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:53.019547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ece798-9560-4b5b-bccc-4bcc69f606d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:53.021633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ece798-9560-4b5b-bccc-4bcc69f606d6 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:53.047857 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1615/3190] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:32:52 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:32:54.640380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea995c8-5cdc-474f-ab6a-a3dfd9dbb267 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:54.755654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:54.830640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea995c8-5cdc-474f-ab6a-a3dfd9dbb267 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:54.858175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e472a42-1ca3-4eba-8bd4-36917b9cc011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:54.859239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e472a42-1ca3-4eba-8bd4-36917b9cc011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:54.859598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e472a42-1ca3-4eba-8bd4-36917b9cc011 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:54.860087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e472a42-1ca3-4eba-8bd4-36917b9cc011 admin admin] PATH_INFO: `/v3/users/f49b3fec8ed549ce89cba8b043c3c414` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:54.861806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e472a42-1ca3-4eba-8bd4-36917b9cc011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f49b3fec8ed549ce89cba8b043c3c414)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:54.864079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e472a42-1ca3-4eba-8bd4-36917b9cc011 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:55.211388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e472a42-1ca3-4eba-8bd4-36917b9cc011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f49b3fec8ed549ce89cba8b043c3c414'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:55.213905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e472a42-1ca3-4eba-8bd4-36917b9cc011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f49b3fec8ed549ce89cba8b043c3c414'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:55.226798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e472a42-1ca3-4eba-8bd4-36917b9cc011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f49b3fec8ed549ce89cba8b043c3c414'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:55.247324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e472a42-1ca3-4eba-8bd4-36917b9cc011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f49b3fec8ed549ce89cba8b043c3c414'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:55.348013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e472a42-1ca3-4eba-8bd4-36917b9cc011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f49b3fec8ed549ce89cba8b043c3c414'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:55.357041 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1576/3191] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:32:54 2022] DELETE /identity/v3/users/f49b3fec8ed549ce89cba8b043c3c414 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:32:55.361778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e526a9-8502-4582-bfc3-9f9bd47fbf98 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:55.362740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e526a9-8502-4582-bfc3-9f9bd47fbf98 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:55.380906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e526a9-8502-4582-bfc3-9f9bd47fbf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:55.398020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-18e526a9-8502-4582-bfc3-9f9bd47fbf98 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:55.399618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-18e526a9-8502-4582-bfc3-9f9bd47fbf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:55.496441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:55.526378 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1616/3192] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:55.554598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e472a42-1ca3-4eba-8bd4-36917b9cc011 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:55.556421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1e472a42-1ca3-4eba-8bd4-36917b9cc011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:55.781657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e472a42-1ca3-4eba-8bd4-36917b9cc011 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:55.796791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba345128-63b0-4f44-86d5-48f3ff0e5a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:55.797427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba345128-63b0-4f44-86d5-48f3ff0e5a45 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:55.797705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba345128-63b0-4f44-86d5-48f3ff0e5a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:55.797978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba345128-63b0-4f44-86d5-48f3ff0e5a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:55.833324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba345128-63b0-4f44-86d5-48f3ff0e5a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:55.849334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba345128-63b0-4f44-86d5-48f3ff0e5a45 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:55.892972 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1577/3193] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:32:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:32:57.911390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e526a9-8502-4582-bfc3-9f9bd47fbf98 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:57.913281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-18e526a9-8502-4582-bfc3-9f9bd47fbf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:57.934190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e526a9-8502-4582-bfc3-9f9bd47fbf98 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:57.957347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e3d80-856a-4856-aa54-c9d9ee4dba1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:57.960477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e3d80-856a-4856-aa54-c9d9ee4dba1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:57.960956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e3d80-856a-4856-aa54-c9d9ee4dba1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:57.961456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e3d80-856a-4856-aa54-c9d9ee4dba1a admin admin] PATH_INFO: `/v3/projects/70e4000d770f4a2faadfe358ac12d8c8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:57.967275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e3d80-856a-4856-aa54-c9d9ee4dba1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=70e4000d770f4a2faadfe358ac12d8c8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:57.970672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e3d80-856a-4856-aa54-c9d9ee4dba1a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:58.166073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-331e3d80-856a-4856-aa54-c9d9ee4dba1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70e4000d770f4a2faadfe358ac12d8c8', 'request_id': 'req-331e3d80-856a-4856-aa54-c9d9ee4dba1a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:58.186555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-331e3d80-856a-4856-aa54-c9d9ee4dba1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70e4000d770f4a2faadfe358ac12d8c8', 'request_id': 'req-331e3d80-856a-4856-aa54-c9d9ee4dba1a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:58.200662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-331e3d80-856a-4856-aa54-c9d9ee4dba1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70e4000d770f4a2faadfe358ac12d8c8', 'request_id': 'req-331e3d80-856a-4856-aa54-c9d9ee4dba1a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:58.363342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-331e3d80-856a-4856-aa54-c9d9ee4dba1a admin admin] The token cache is being invalidate because project 70e4000d770f4a2faadfe358ac12d8c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:32:58.365179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-331e3d80-856a-4856-aa54-c9d9ee4dba1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:58.366229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-331e3d80-856a-4856-aa54-c9d9ee4dba1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:32:58.367976 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1617/3194] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:32:57 2022] DELETE /identity/v3/projects/70e4000d770f4a2faadfe358ac12d8c8 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:32:58.373023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95a990-0e30-4f54-9fdb-43e67860aba0 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:58.374176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95a990-0e30-4f54-9fdb-43e67860aba0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:58.374700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95a990-0e30-4f54-9fdb-43e67860aba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:58.423718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4a95a990-0e30-4f54-9fdb-43e67860aba0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:58.425050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4a95a990-0e30-4f54-9fdb-43e67860aba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:58.534217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:58.555547 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1578/3195] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:58.563649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789d2db-c87a-4d3c-bb28-25cb096c8ec7 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:58.563941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789d2db-c87a-4d3c-bb28-25cb096c8ec7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:58.564223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789d2db-c87a-4d3c-bb28-25cb096c8ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:58.605830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a789d2db-c87a-4d3c-bb28-25cb096c8ec7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:58.608190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a789d2db-c87a-4d3c-bb28-25cb096c8ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:58.626595 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1618/3196] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:58.631184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95a990-0e30-4f54-9fdb-43e67860aba0 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:58.652169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95a990-0e30-4f54-9fdb-43e67860aba0 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:58.661165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47332a-a14f-435c-a1b0-2939a1d01ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:58.662430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47332a-a14f-435c-a1b0-2939a1d01ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:58.662918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47332a-a14f-435c-a1b0-2939a1d01ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:58.663357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47332a-a14f-435c-a1b0-2939a1d01ad7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:58.664229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47332a-a14f-435c-a1b0-2939a1d01ad7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:32:58.664893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47332a-a14f-435c-a1b0-2939a1d01ad7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:58.667184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47332a-a14f-435c-a1b0-2939a1d01ad7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:58.718775 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1579/3197] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:32:58.723907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789d2db-c87a-4d3c-bb28-25cb096c8ec7 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:58.741006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789d2db-c87a-4d3c-bb28-25cb096c8ec7 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:58.761196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11484c8-0260-4129-927a-86414ba98db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:58.762625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11484c8-0260-4129-927a-86414ba98db7 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:58.763037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11484c8-0260-4129-927a-86414ba98db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:58.763419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11484c8-0260-4129-927a-86414ba98db7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:58.765314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11484c8-0260-4129-927a-86414ba98db7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:58.768248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11484c8-0260-4129-927a-86414ba98db7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:58.888430 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1619/3198] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:32:58 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:32:58.893554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47332a-a14f-435c-a1b0-2939a1d01ad7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:58.930916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47332a-a14f-435c-a1b0-2939a1d01ad7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:59.119106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bf315-2774-429a-8852-bcf4a19b4c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:59.120178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bf315-2774-429a-8852-bcf4a19b4c53 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:59.121087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bf315-2774-429a-8852-bcf4a19b4c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:59.121535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bf315-2774-429a-8852-bcf4a19b4c53 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:59.122855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bf315-2774-429a-8852-bcf4a19b4c53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:59.128011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bf315-2774-429a-8852-bcf4a19b4c53 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:59.343714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11484c8-0260-4129-927a-86414ba98db7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:59.345923 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1580/3199] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:32:58 2022] POST /identity/v3/users => generated 291 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:32:59.359668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11484c8-0260-4129-927a-86414ba98db7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:59.378935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9d0a5-bf56-46ce-83f6-b2f812c3a95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:59.379715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9d0a5-bf56-46ce-83f6-b2f812c3a95f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:59.380554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9d0a5-bf56-46ce-83f6-b2f812c3a95f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:59.381004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9d0a5-bf56-46ce-83f6-b2f812c3a95f admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:59.382977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9d0a5-bf56-46ce-83f6-b2f812c3a95f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:59.385524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9d0a5-bf56-46ce-83f6-b2f812c3a95f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:59.398695 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1620/3200] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:32:59.402587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bf315-2774-429a-8852-bcf4a19b4c53 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:59.414988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bf315-2774-429a-8852-bcf4a19b4c53 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:59.442854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c1a0b-471f-428a-a234-fba89f371ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:59.443728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c1a0b-471f-428a-a234-fba89f371ada admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:59.444173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c1a0b-471f-428a-a234-fba89f371ada admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:59.444617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c1a0b-471f-428a-a234-fba89f371ada admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:59.445595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c1a0b-471f-428a-a234-fba89f371ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:59.447523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c1a0b-471f-428a-a234-fba89f371ada admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:59.479802 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1581/3201] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:32:59.483924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9d0a5-bf56-46ce-83f6-b2f812c3a95f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:59.503862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9d0a5-bf56-46ce-83f6-b2f812c3a95f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:32:59.526320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c80f56-8de1-4338-9acc-2bdf107cabb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:32:59.531218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c80f56-8de1-4338-9acc-2bdf107cabb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:59.531218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c80f56-8de1-4338-9acc-2bdf107cabb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:59.531218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c80f56-8de1-4338-9acc-2bdf107cabb3 admin admin] PATH_INFO: `/v3/projects/d2c1020a13864ca8b5199427528d650d/users/45f7471db101458fa692a73173bb42a1/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:59.549175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c80f56-8de1-4338-9acc-2bdf107cabb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c1020a13864ca8b5199427528d650d, user_id=45f7471db101458fa692a73173bb42a1, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:32:59.553012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c80f56-8de1-4338-9acc-2bdf107cabb3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:32:59.661164 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1621/3202] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:32:59 2022] PUT /identity/v3/projects/d2c1020a13864ca8b5199427528d650d/users/45f7471db101458fa692a73173bb42a1/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:32:59.674867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059466e-8a9e-4056-ad66-96cd8fc09f85 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:32:59.675233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059466e-8a9e-4056-ad66-96cd8fc09f85 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:32:59.675539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059466e-8a9e-4056-ad66-96cd8fc09f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:32:59.715163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5059466e-8a9e-4056-ad66-96cd8fc09f85 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:32:59.716546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5059466e-8a9e-4056-ad66-96cd8fc09f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:32:59.856957 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1582/3203] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:32:59.882853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c80f56-8de1-4338-9acc-2bdf107cabb3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:32:59.885623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b2c80f56-8de1-4338-9acc-2bdf107cabb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:00.072551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c80f56-8de1-4338-9acc-2bdf107cabb3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:00.082007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44754fa-ab02-4877-bdb3-0d1e7c6d62cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:00.083349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44754fa-ab02-4877-bdb3-0d1e7c6d62cd service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:00.083613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44754fa-ab02-4877-bdb3-0d1e7c6d62cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:00.083899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44754fa-ab02-4877-bdb3-0d1e7c6d62cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:00.129047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44754fa-ab02-4877-bdb3-0d1e7c6d62cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:00.131132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44754fa-ab02-4877-bdb3-0d1e7c6d62cd service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:00.146772 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1622/3204] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:32:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:33:04.090927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ff46e-bf69-48e4-9927-8543745cde4d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:04.091452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ff46e-bf69-48e4-9927-8543745cde4d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:04.091828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ff46e-bf69-48e4-9927-8543745cde4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:04.148706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-be1ff46e-bf69-48e4-9927-8543745cde4d None None] MFA Rules not processed for user `0d9053ce63864308b29190f9f51bd85f`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:33:04.150133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-be1ff46e-bf69-48e4-9927-8543745cde4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:04.273048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:04.300449 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1583/3205] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:33:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:33:04.300827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44754fa-ab02-4877-bdb3-0d1e7c6d62cd service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:04.302340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c44754fa-ab02-4877-bdb3-0d1e7c6d62cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:04.311193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:04.317905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44754fa-ab02-4877-bdb3-0d1e7c6d62cd service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:04.331454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175e73d-2a76-4aab-b051-eece0b7de8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:04.333927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175e73d-2a76-4aab-b051-eece0b7de8ae admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:04.335424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175e73d-2a76-4aab-b051-eece0b7de8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:04.336198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175e73d-2a76-4aab-b051-eece0b7de8ae admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:04.337105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175e73d-2a76-4aab-b051-eece0b7de8ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:04.341867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175e73d-2a76-4aab-b051-eece0b7de8ae admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:04.487942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ff46e-bf69-48e4-9927-8543745cde4d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:04.494825 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1623/3206] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:33:04 2022] POST /identity/v3/projects => generated 387 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:33:04.503276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ff46e-bf69-48e4-9927-8543745cde4d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:04.596675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed4ea5-e955-4858-8bb4-eef7e3e0968f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:04.597705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed4ea5-e955-4858-8bb4-eef7e3e0968f admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:04.598501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed4ea5-e955-4858-8bb4-eef7e3e0968f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:04.599362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed4ea5-e955-4858-8bb4-eef7e3e0968f admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:04.600869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed4ea5-e955-4858-8bb4-eef7e3e0968f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:04.603838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed4ea5-e955-4858-8bb4-eef7e3e0968f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:04.720751 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1584/3207] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:33:04 2022] POST /identity/v3/users => generated 300 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:33:04.724995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175e73d-2a76-4aab-b051-eece0b7de8ae admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:04.759302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175e73d-2a76-4aab-b051-eece0b7de8ae admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:04.796792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafa379-b472-4d4f-aa28-5810fdd7bb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:04.797023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafa379-b472-4d4f-aa28-5810fdd7bb96 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:04.797305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafa379-b472-4d4f-aa28-5810fdd7bb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:04.797573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafa379-b472-4d4f-aa28-5810fdd7bb96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:04.805822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dafa379-b472-4d4f-aa28-5810fdd7bb96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:04.813581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dafa379-b472-4d4f-aa28-5810fdd7bb96 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:04.853939 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1624/3208] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:33:04.863044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed4ea5-e955-4858-8bb4-eef7e3e0968f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:04.880642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed4ea5-e955-4858-8bb4-eef7e3e0968f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:04.894915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f604664-9b38-495b-bd17-130cc9abe7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:04.895605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f604664-9b38-495b-bd17-130cc9abe7d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:04.895888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f604664-9b38-495b-bd17-130cc9abe7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:04.896158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f604664-9b38-495b-bd17-130cc9abe7d4 admin admin] PATH_INFO: `/v3/projects/00c2da28bc064d778f1ecaa1bb5c1ad8/users/d46f5d960c594409bc8fd7221e89c463/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:04.938855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f604664-9b38-495b-bd17-130cc9abe7d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00c2da28bc064d778f1ecaa1bb5c1ad8, user_id=d46f5d960c594409bc8fd7221e89c463, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:04.941067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f604664-9b38-495b-bd17-130cc9abe7d4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:05.028275 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1585/3209] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:33:04 2022] PUT /identity/v3/projects/00c2da28bc064d778f1ecaa1bb5c1ad8/users/d46f5d960c594409bc8fd7221e89c463/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:33:05.033037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafa379-b472-4d4f-aa28-5810fdd7bb96 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:05.113466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafa379-b472-4d4f-aa28-5810fdd7bb96 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:05.260317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f84635-cd80-4af4-8e50-e8142af88715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:05.267307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f84635-cd80-4af4-8e50-e8142af88715 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:05.267307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f84635-cd80-4af4-8e50-e8142af88715 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:05.267307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f84635-cd80-4af4-8e50-e8142af88715 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:05.267307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f84635-cd80-4af4-8e50-e8142af88715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:05.267307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f84635-cd80-4af4-8e50-e8142af88715 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:05.277694 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1625/3210] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:33:05.282355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f604664-9b38-495b-bd17-130cc9abe7d4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:05.301424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f604664-9b38-495b-bd17-130cc9abe7d4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:05.310750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb148310-6ff5-42b5-a352-ac0279843293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:05.314268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb148310-6ff5-42b5-a352-ac0279843293 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:05.314821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb148310-6ff5-42b5-a352-ac0279843293 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:05.315256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb148310-6ff5-42b5-a352-ac0279843293 admin admin] PATH_INFO: `/v3/projects/00c2da28bc064d778f1ecaa1bb5c1ad8/users/d46f5d960c594409bc8fd7221e89c463/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:05.323059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb148310-6ff5-42b5-a352-ac0279843293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00c2da28bc064d778f1ecaa1bb5c1ad8, user_id=d46f5d960c594409bc8fd7221e89c463, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:05.330861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb148310-6ff5-42b5-a352-ac0279843293 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:05.395119 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1586/3211] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:33:05 2022] PUT /identity/v3/projects/00c2da28bc064d778f1ecaa1bb5c1ad8/users/d46f5d960c594409bc8fd7221e89c463/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:33:11.533290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f84635-cd80-4af4-8e50-e8142af88715 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:11.535785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e9f84635-cd80-4af4-8e50-e8142af88715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:11.552258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f84635-cd80-4af4-8e50-e8142af88715 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:11.641510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a6425-e34f-41fd-9c44-8d5480092ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:11.643139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a6425-e34f-41fd-9c44-8d5480092ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:11.643423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a6425-e34f-41fd-9c44-8d5480092ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:11.643697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a6425-e34f-41fd-9c44-8d5480092ac2 admin admin] PATH_INFO: `/v3/users/9ce351a48282492e8cd69b9a5a05f545` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:11.647857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a6425-e34f-41fd-9c44-8d5480092ac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ce351a48282492e8cd69b9a5a05f545)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:11.650378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a6425-e34f-41fd-9c44-8d5480092ac2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:11.840028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a91a6425-e34f-41fd-9c44-8d5480092ac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce351a48282492e8cd69b9a5a05f545'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:11.842272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a91a6425-e34f-41fd-9c44-8d5480092ac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce351a48282492e8cd69b9a5a05f545'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:11.851525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a91a6425-e34f-41fd-9c44-8d5480092ac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce351a48282492e8cd69b9a5a05f545'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:11.861220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:11.868074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a91a6425-e34f-41fd-9c44-8d5480092ac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce351a48282492e8cd69b9a5a05f545'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:11.869997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a91a6425-e34f-41fd-9c44-8d5480092ac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce351a48282492e8cd69b9a5a05f545'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:12.014807 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1626/3212] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:33:11 2022] DELETE /identity/v3/users/9ce351a48282492e8cd69b9a5a05f545 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:33:12.510684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb148310-6ff5-42b5-a352-ac0279843293 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:12.512801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-eb148310-6ff5-42b5-a352-ac0279843293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:12.539203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb148310-6ff5-42b5-a352-ac0279843293 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:12.648910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5cc71-5a6b-4924-8216-df2c586248e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:12.650196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5cc71-5a6b-4924-8216-df2c586248e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:12.650692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5cc71-5a6b-4924-8216-df2c586248e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:12.651212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5cc71-5a6b-4924-8216-df2c586248e8 admin admin] PATH_INFO: `/v3/projects/5514904d799d4f5dae454193e70d85f6` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:12.652632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5cc71-5a6b-4924-8216-df2c586248e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5514904d799d4f5dae454193e70d85f6)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:12.656088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5cc71-5a6b-4924-8216-df2c586248e8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:12.809440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:12.812629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ccc5cc71-5a6b-4924-8216-df2c586248e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5514904d799d4f5dae454193e70d85f6', 'request_id': 'req-ccc5cc71-5a6b-4924-8216-df2c586248e8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:12.895039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ccc5cc71-5a6b-4924-8216-df2c586248e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5514904d799d4f5dae454193e70d85f6', 'request_id': 'req-ccc5cc71-5a6b-4924-8216-df2c586248e8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:12.925554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ccc5cc71-5a6b-4924-8216-df2c586248e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5514904d799d4f5dae454193e70d85f6', 'request_id': 'req-ccc5cc71-5a6b-4924-8216-df2c586248e8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:12.955747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ccc5cc71-5a6b-4924-8216-df2c586248e8 admin admin] The token cache is being invalidate because project 5514904d799d4f5dae454193e70d85f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:33:12.957022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ccc5cc71-5a6b-4924-8216-df2c586248e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:12.958457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ccc5cc71-5a6b-4924-8216-df2c586248e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:12.964623 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1587/3213] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:33:12 2022] DELETE /identity/v3/projects/5514904d799d4f5dae454193e70d85f6 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:33:12.967535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbca4d-eac7-4124-bae5-57f43c30f596 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:12.968015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbca4d-eac7-4124-bae5-57f43c30f596 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:12.968125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbca4d-eac7-4124-bae5-57f43c30f596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:13.004374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4adbca4d-eac7-4124-bae5-57f43c30f596 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:33:13.005659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4adbca4d-eac7-4124-bae5-57f43c30f596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:13.131186 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1627/3214] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:33:13.138748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea20549-6093-4461-80ed-75f40ffa3807 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:13.139048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea20549-6093-4461-80ed-75f40ffa3807 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:13.139677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea20549-6093-4461-80ed-75f40ffa3807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:13.172831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1ea20549-6093-4461-80ed-75f40ffa3807 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:33:13.174266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1ea20549-6093-4461-80ed-75f40ffa3807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:13.208159 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1588/3215] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:33:13.211320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbca4d-eac7-4124-bae5-57f43c30f596 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:13.224057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbca4d-eac7-4124-bae5-57f43c30f596 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:13.230220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b040d-cf49-4961-880f-8ef414eafa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:13.230992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b040d-cf49-4961-880f-8ef414eafa10 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:13.231433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b040d-cf49-4961-880f-8ef414eafa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:13.231746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b040d-cf49-4961-880f-8ef414eafa10 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:13.232511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b040d-cf49-4961-880f-8ef414eafa10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:33:13.232916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b040d-cf49-4961-880f-8ef414eafa10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:13.234862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b040d-cf49-4961-880f-8ef414eafa10 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:13.266509 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1628/3216] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:33:13.271479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea20549-6093-4461-80ed-75f40ffa3807 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:13.288014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea20549-6093-4461-80ed-75f40ffa3807 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:13.294968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1644d3e-046a-40a0-bea7-80dbea99c0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:13.295722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1644d3e-046a-40a0-bea7-80dbea99c0ce admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:13.296112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1644d3e-046a-40a0-bea7-80dbea99c0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:13.296624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1644d3e-046a-40a0-bea7-80dbea99c0ce admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:13.297393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1644d3e-046a-40a0-bea7-80dbea99c0ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:13.299740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1644d3e-046a-40a0-bea7-80dbea99c0ce admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:13.427519 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1589/3217] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:33:13 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:33:13.432729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b040d-cf49-4961-880f-8ef414eafa10 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:13.452656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b040d-cf49-4961-880f-8ef414eafa10 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:13.570265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc9dcf-f050-40f3-b870-cb3c5901d449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:13.571119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc9dcf-f050-40f3-b870-cb3c5901d449 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:13.571414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc9dcf-f050-40f3-b870-cb3c5901d449 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:13.571751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc9dcf-f050-40f3-b870-cb3c5901d449 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:13.572402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc9dcf-f050-40f3-b870-cb3c5901d449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:13.585717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc9dcf-f050-40f3-b870-cb3c5901d449 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:13.722271 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1629/3218] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:33:13 2022] POST /identity/v3/users => generated 288 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:33:13.725230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1644d3e-046a-40a0-bea7-80dbea99c0ce admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:13.737750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1644d3e-046a-40a0-bea7-80dbea99c0ce admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:13.742844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87d74c-dc4f-4474-8293-bed8d8f93323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:13.744304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87d74c-dc4f-4474-8293-bed8d8f93323 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:13.744893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87d74c-dc4f-4474-8293-bed8d8f93323 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:13.745373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87d74c-dc4f-4474-8293-bed8d8f93323 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:13.746273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87d74c-dc4f-4474-8293-bed8d8f93323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:13.749070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87d74c-dc4f-4474-8293-bed8d8f93323 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:13.760733 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1590/3219] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:33:13.764583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc9dcf-f050-40f3-b870-cb3c5901d449 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:13.784623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc9dcf-f050-40f3-b870-cb3c5901d449 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:13.791246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cfb9a-4358-4176-ae59-475ec0cec9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:13.793560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cfb9a-4358-4176-ae59-475ec0cec9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:13.793560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cfb9a-4358-4176-ae59-475ec0cec9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:13.793560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cfb9a-4358-4176-ae59-475ec0cec9e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:13.793560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093cfb9a-4358-4176-ae59-475ec0cec9e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:13.795542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093cfb9a-4358-4176-ae59-475ec0cec9e8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:13.821906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87d74c-dc4f-4474-8293-bed8d8f93323 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:13.822473 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1630/3220] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:33:13.833837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87d74c-dc4f-4474-8293-bed8d8f93323 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:13.841332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e91310-2dea-4b31-879e-53883a3440cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:13.842656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e91310-2dea-4b31-879e-53883a3440cf admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:13.842937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e91310-2dea-4b31-879e-53883a3440cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:13.847410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e91310-2dea-4b31-879e-53883a3440cf admin admin] PATH_INFO: `/v3/projects/2057593072c14804ab70fe4bdea2c17c/users/881f054c84d04ceaa17a5817816022d4/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:13.866447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e91310-2dea-4b31-879e-53883a3440cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2057593072c14804ab70fe4bdea2c17c, user_id=881f054c84d04ceaa17a5817816022d4, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:13.870051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e91310-2dea-4b31-879e-53883a3440cf admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:13.995254 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1591/3221] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:33:13 2022] PUT /identity/v3/projects/2057593072c14804ab70fe4bdea2c17c/users/881f054c84d04ceaa17a5817816022d4/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:33:14.000185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0255c6-cfa7-4422-aa97-c8610314d41f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:14.000785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0255c6-cfa7-4422-aa97-c8610314d41f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:14.000785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0255c6-cfa7-4422-aa97-c8610314d41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:14.043341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ca0255c6-cfa7-4422-aa97-c8610314d41f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:33:14.044603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ca0255c6-cfa7-4422-aa97-c8610314d41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:14.156522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:14.218904 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1631/3222] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:33:14.249238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e91310-2dea-4b31-879e-53883a3440cf admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:14.254890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c4e91310-2dea-4b31-879e-53883a3440cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:14.427026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e91310-2dea-4b31-879e-53883a3440cf admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:14.431642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe80f1-4ac5-4d41-8d8e-3d48c0c18c2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:14.432404 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe80f1-4ac5-4d41-8d8e-3d48c0c18c2b service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:14.432789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe80f1-4ac5-4d41-8d8e-3d48c0c18c2b service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:14.433167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe80f1-4ac5-4d41-8d8e-3d48c0c18c2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:14.456740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe80f1-4ac5-4d41-8d8e-3d48c0c18c2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:14.458963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe80f1-4ac5-4d41-8d8e-3d48c0c18c2b service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:14.475460 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1592/3223] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:33:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:33:15.322260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19958078-b567-49a9-9e34-48851934469a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:15.322795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19958078-b567-49a9-9e34-48851934469a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:15.322795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19958078-b567-49a9-9e34-48851934469a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:15.390452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-19958078-b567-49a9-9e34-48851934469a None None] MFA Rules not processed for user `45f7471db101458fa692a73173bb42a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:33:15.393401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-19958078-b567-49a9-9e34-48851934469a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:15.607576 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1632/3224] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:33:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:33:15.611464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917df96-1e00-4c01-96b5-6196b4999371 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:15.611975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917df96-1e00-4c01-96b5-6196b4999371 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:15.612072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917df96-1e00-4c01-96b5-6196b4999371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:15.659546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1917df96-1e00-4c01-96b5-6196b4999371 None None] MFA Rules not processed for user `45f7471db101458fa692a73173bb42a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:33:15.661495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1917df96-1e00-4c01-96b5-6196b4999371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:15.677180 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1593/3225] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:33:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:33:15.725484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19958078-b567-49a9-9e34-48851934469a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:15.728747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-19958078-b567-49a9-9e34-48851934469a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:15.777374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19958078-b567-49a9-9e34-48851934469a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:15.784709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe57ebc-4ed2-471c-8dc1-70cb016cc1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:15.785369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe57ebc-4ed2-471c-8dc1-70cb016cc1a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:15.785650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe57ebc-4ed2-471c-8dc1-70cb016cc1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:15.785923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe57ebc-4ed2-471c-8dc1-70cb016cc1a9 admin admin] PATH_INFO: `/v3/users/f8f391fe67b54a91a9519b3cde83f86c` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:15.788001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe57ebc-4ed2-471c-8dc1-70cb016cc1a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8f391fe67b54a91a9519b3cde83f86c)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:15.789955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe57ebc-4ed2-471c-8dc1-70cb016cc1a9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:16.072806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fbe57ebc-4ed2-471c-8dc1-70cb016cc1a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8f391fe67b54a91a9519b3cde83f86c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:16.073761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fbe57ebc-4ed2-471c-8dc1-70cb016cc1a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8f391fe67b54a91a9519b3cde83f86c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:16.091152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fbe57ebc-4ed2-471c-8dc1-70cb016cc1a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8f391fe67b54a91a9519b3cde83f86c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:16.132427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fbe57ebc-4ed2-471c-8dc1-70cb016cc1a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8f391fe67b54a91a9519b3cde83f86c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:16.133872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fbe57ebc-4ed2-471c-8dc1-70cb016cc1a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8f391fe67b54a91a9519b3cde83f86c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:16.250671 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1633/3226] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:33:15 2022] DELETE /identity/v3/users/f8f391fe67b54a91a9519b3cde83f86c => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:33:16.439218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917df96-1e00-4c01-96b5-6196b4999371 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:16.441030 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1917df96-1e00-4c01-96b5-6196b4999371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:16.651928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917df96-1e00-4c01-96b5-6196b4999371 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:16.667190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:16.815933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ef25b-9755-410f-a6ed-6961c249449d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:16.823020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ef25b-9755-410f-a6ed-6961c249449d service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:16.823020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ef25b-9755-410f-a6ed-6961c249449d service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:16.823020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ef25b-9755-410f-a6ed-6961c249449d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:16.823020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9c6ef25b-9755-410f-a6ed-6961c249449d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:16.986855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ef25b-9755-410f-a6ed-6961c249449d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:16.988756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ef25b-9755-410f-a6ed-6961c249449d service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:17.009918 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1594/3227] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:33:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:33:17.367655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe57ebc-4ed2-471c-8dc1-70cb016cc1a9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:17.369430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fbe57ebc-4ed2-471c-8dc1-70cb016cc1a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:17.488189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:17.510407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe57ebc-4ed2-471c-8dc1-70cb016cc1a9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:17.520181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f55bf-ee46-4bc5-8826-dafd557aaee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:17.520673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f55bf-ee46-4bc5-8826-dafd557aaee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:17.521477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f55bf-ee46-4bc5-8826-dafd557aaee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:17.521856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f55bf-ee46-4bc5-8826-dafd557aaee6 admin admin] PATH_INFO: `/v3/projects/da001b5c2a244160b5b5aa053eb318fd` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:17.523342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f55bf-ee46-4bc5-8826-dafd557aaee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da001b5c2a244160b5b5aa053eb318fd)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:17.525969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f55bf-ee46-4bc5-8826-dafd557aaee6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:17.702140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-404f55bf-ee46-4bc5-8826-dafd557aaee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da001b5c2a244160b5b5aa053eb318fd', 'request_id': 'req-404f55bf-ee46-4bc5-8826-dafd557aaee6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:17.738466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-404f55bf-ee46-4bc5-8826-dafd557aaee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da001b5c2a244160b5b5aa053eb318fd', 'request_id': 'req-404f55bf-ee46-4bc5-8826-dafd557aaee6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:17.748711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-404f55bf-ee46-4bc5-8826-dafd557aaee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da001b5c2a244160b5b5aa053eb318fd', 'request_id': 'req-404f55bf-ee46-4bc5-8826-dafd557aaee6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:17.829518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-404f55bf-ee46-4bc5-8826-dafd557aaee6 admin admin] The token cache is being invalidate because project da001b5c2a244160b5b5aa053eb318fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:33:17.830181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-404f55bf-ee46-4bc5-8826-dafd557aaee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:17.831035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-404f55bf-ee46-4bc5-8826-dafd557aaee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:17.836955 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1634/3228] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:33:17 2022] DELETE /identity/v3/projects/da001b5c2a244160b5b5aa053eb318fd => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:33:17.838083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed7907-1694-4076-a1c4-f0fe5bc29ec7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:17.838558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed7907-1694-4076-a1c4-f0fe5bc29ec7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:17.838639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed7907-1694-4076-a1c4-f0fe5bc29ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:17.878693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-95ed7907-1694-4076-a1c4-f0fe5bc29ec7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:33:17.879836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-95ed7907-1694-4076-a1c4-f0fe5bc29ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:17.998300 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1595/3229] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:33:17.998454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e6755-ffa8-4b41-823e-7a266755629c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:17.998454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e6755-ffa8-4b41-823e-7a266755629c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:17.998454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e6755-ffa8-4b41-823e-7a266755629c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:18.032918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-487e6755-ffa8-4b41-823e-7a266755629c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:33:18.032918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-487e6755-ffa8-4b41-823e-7a266755629c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:18.054147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed7907-1694-4076-a1c4-f0fe5bc29ec7 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:18.056297 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1635/3230] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:33:18.117396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed7907-1694-4076-a1c4-f0fe5bc29ec7 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:18.128600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35cc8a-6dff-4159-8b65-528413f05430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:18.129760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35cc8a-6dff-4159-8b65-528413f05430 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:18.130150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35cc8a-6dff-4159-8b65-528413f05430 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:18.131673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35cc8a-6dff-4159-8b65-528413f05430 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:18.131673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35cc8a-6dff-4159-8b65-528413f05430 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:33:18.132152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35cc8a-6dff-4159-8b65-528413f05430 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:18.133906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35cc8a-6dff-4159-8b65-528413f05430 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:18.166552 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1596/3231] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:33:18.171251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e6755-ffa8-4b41-823e-7a266755629c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:18.183334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e6755-ffa8-4b41-823e-7a266755629c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:18.187968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bf077-875e-4e49-b3ef-0a77b339c94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:18.188769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bf077-875e-4e49-b3ef-0a77b339c94f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:18.189792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bf077-875e-4e49-b3ef-0a77b339c94f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:18.190152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bf077-875e-4e49-b3ef-0a77b339c94f admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:18.191322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bf077-875e-4e49-b3ef-0a77b339c94f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:18.192789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bf077-875e-4e49-b3ef-0a77b339c94f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:18.315737 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1636/3232] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:33:18 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:33:18.320470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35cc8a-6dff-4159-8b65-528413f05430 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:18.335468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35cc8a-6dff-4159-8b65-528413f05430 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:18.389856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:18.440298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ebc7b-93eb-4d12-8b29-d4ecf40dbe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:18.440298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ebc7b-93eb-4d12-8b29-d4ecf40dbe73 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:18.440298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ebc7b-93eb-4d12-8b29-d4ecf40dbe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:18.440298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ebc7b-93eb-4d12-8b29-d4ecf40dbe73 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:18.440709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ebc7b-93eb-4d12-8b29-d4ecf40dbe73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:18.445220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ebc7b-93eb-4d12-8b29-d4ecf40dbe73 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:18.636706 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1597/3233] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:33:18 2022] POST /identity/v3/users => generated 291 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:33:18.647253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bf077-875e-4e49-b3ef-0a77b339c94f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:18.661983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bf077-875e-4e49-b3ef-0a77b339c94f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:18.672518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac583f-768c-4f1c-851a-b38438b4c8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:18.674489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac583f-768c-4f1c-851a-b38438b4c8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:18.674787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac583f-768c-4f1c-851a-b38438b4c8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:18.675050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac583f-768c-4f1c-851a-b38438b4c8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:18.676372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac583f-768c-4f1c-851a-b38438b4c8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:18.680811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac583f-768c-4f1c-851a-b38438b4c8a9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:18.708364 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1637/3234] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:33:18.712483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ebc7b-93eb-4d12-8b29-d4ecf40dbe73 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:18.728978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ebc7b-93eb-4d12-8b29-d4ecf40dbe73 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:18.739743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704f7c5-a997-4915-97a0-15c204d7f39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:18.741590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704f7c5-a997-4915-97a0-15c204d7f39a admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:18.742219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704f7c5-a997-4915-97a0-15c204d7f39a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:18.743095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704f7c5-a997-4915-97a0-15c204d7f39a admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:18.744214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704f7c5-a997-4915-97a0-15c204d7f39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:18.748466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704f7c5-a997-4915-97a0-15c204d7f39a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:18.763247 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1598/3235] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:33:18.767543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac583f-768c-4f1c-851a-b38438b4c8a9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:18.782020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac583f-768c-4f1c-851a-b38438b4c8a9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:18.790762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd5c87-5fcc-4eff-ab39-8a5ad4c4083d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:18.791775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd5c87-5fcc-4eff-ab39-8a5ad4c4083d admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:18.792062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd5c87-5fcc-4eff-ab39-8a5ad4c4083d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:18.792387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd5c87-5fcc-4eff-ab39-8a5ad4c4083d admin admin] PATH_INFO: `/v3/projects/5fbe72eaad79489ba74b04819eaf8d64/users/3bab1bbeb309491e94394b1137e9f3bd/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:18.822128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd5c87-5fcc-4eff-ab39-8a5ad4c4083d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fbe72eaad79489ba74b04819eaf8d64, user_id=3bab1bbeb309491e94394b1137e9f3bd, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:18.826789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd5c87-5fcc-4eff-ab39-8a5ad4c4083d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:18.915698 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1638/3236] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:33:18 2022] PUT /identity/v3/projects/5fbe72eaad79489ba74b04819eaf8d64/users/3bab1bbeb309491e94394b1137e9f3bd/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:33:18.921135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3beca2-1065-49d1-8588-6a1b632e7ea2 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:18.922005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3beca2-1065-49d1-8588-6a1b632e7ea2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:18.922458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3beca2-1065-49d1-8588-6a1b632e7ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:18.963324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-be3beca2-1065-49d1-8588-6a1b632e7ea2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:33:18.964852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-be3beca2-1065-49d1-8588-6a1b632e7ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:19.137404 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1599/3237] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:33:19.161402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd5c87-5fcc-4eff-ab39-8a5ad4c4083d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:19.165458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-23fd5c87-5fcc-4eff-ab39-8a5ad4c4083d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:19.325110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd5c87-5fcc-4eff-ab39-8a5ad4c4083d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:19.336369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ee991-d9b3-4e1f-b636-d7a65b6179ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:19.337009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ee991-d9b3-4e1f-b636-d7a65b6179ca service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:19.337388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ee991-d9b3-4e1f-b636-d7a65b6179ca service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:19.337654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ee991-d9b3-4e1f-b636-d7a65b6179ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:19.357828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ee991-d9b3-4e1f-b636-d7a65b6179ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:19.361535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ee991-d9b3-4e1f-b636-d7a65b6179ca service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:19.395174 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1639/3238] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:33:23.469319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54a6d1-04a1-454c-b65a-78669b4b97b3 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:23.469916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54a6d1-04a1-454c-b65a-78669b4b97b3 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:23.470438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54a6d1-04a1-454c-b65a-78669b4b97b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:23.546426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-2b54a6d1-04a1-454c-b65a-78669b4b97b3 None None] MFA Rules not processed for user `d46f5d960c594409bc8fd7221e89c463`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:33:23.548154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2b54a6d1-04a1-454c-b65a-78669b4b97b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:23.781952 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1600/3239] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:33:23 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:33:23.795874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ee991-d9b3-4e1f-b636-d7a65b6179ca service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:23.798983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a63ee991-d9b3-4e1f-b636-d7a65b6179ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:23.865493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:23.928891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ee991-d9b3-4e1f-b636-d7a65b6179ca service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:23.934325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdd3c7-c4da-421e-80ec-25abf56309a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:23.935337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdd3c7-c4da-421e-80ec-25abf56309a6 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:23.935834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdd3c7-c4da-421e-80ec-25abf56309a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:23.936380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdd3c7-c4da-421e-80ec-25abf56309a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:23.939056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b3cdd3c7-c4da-421e-80ec-25abf56309a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:24.058339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdd3c7-c4da-421e-80ec-25abf56309a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:24.061698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdd3c7-c4da-421e-80ec-25abf56309a6 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:24.092228 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1640/3240] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:33:23 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:33:33.768570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:34.323872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=38 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:34.481429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaa877-d1e1-4210-9fcf-197c1a6e0c95 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:34.481709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaa877-d1e1-4210-9fcf-197c1a6e0c95 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:34.487047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaa877-d1e1-4210-9fcf-197c1a6e0c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:34.555575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-00eaa877-d1e1-4210-9fcf-197c1a6e0c95 None None] MFA Rules not processed for user `881f054c84d04ceaa17a5817816022d4`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:33:34.557037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-00eaa877-d1e1-4210-9fcf-197c1a6e0c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:34.759911 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1601/3241] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:33:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:33:34.790925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdd3c7-c4da-421e-80ec-25abf56309a6 service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:34.792656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b3cdd3c7-c4da-421e-80ec-25abf56309a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:34.828004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdd3c7-c4da-421e-80ec-25abf56309a6 service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:34.837835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f615d6a-529d-4415-9c9b-d5bf445a448b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:34.843880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f615d6a-529d-4415-9c9b-d5bf445a448b service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:34.843880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f615d6a-529d-4415-9c9b-d5bf445a448b service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:34.843880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f615d6a-529d-4415-9c9b-d5bf445a448b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:34.869214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f615d6a-529d-4415-9c9b-d5bf445a448b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:34.872143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f615d6a-529d-4415-9c9b-d5bf445a448b service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:34.886936 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1641/3242] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:33:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:33:37.771919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59d1ae-4306-4de6-b2e4-dffe35d3b9dc None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:37.771919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59d1ae-4306-4de6-b2e4-dffe35d3b9dc None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:37.771919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59d1ae-4306-4de6-b2e4-dffe35d3b9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:37.888645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ab59d1ae-4306-4de6-b2e4-dffe35d3b9dc None None] MFA Rules not processed for user `3bab1bbeb309491e94394b1137e9f3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:33:37.890289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ab59d1ae-4306-4de6-b2e4-dffe35d3b9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:38.074521 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1602/3243] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:33:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:33:38.503362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f615d6a-529d-4415-9c9b-d5bf445a448b service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:38.506205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4f615d6a-529d-4415-9c9b-d5bf445a448b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:38.640449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f615d6a-529d-4415-9c9b-d5bf445a448b service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:38.661969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c47168-9665-4e00-9a3f-0d80f7f04312 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:38.664310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c47168-9665-4e00-9a3f-0d80f7f04312 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:38.664310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c47168-9665-4e00-9a3f-0d80f7f04312 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:38.664310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c47168-9665-4e00-9a3f-0d80f7f04312 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:38.692678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c47168-9665-4e00-9a3f-0d80f7f04312 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:38.695962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c47168-9665-4e00-9a3f-0d80f7f04312 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:38.732552 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1642/3244] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:33:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:33:40.861620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aae629-8cf1-420b-b69b-ed2da3f1a5e4 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:40.866832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aae629-8cf1-420b-b69b-ed2da3f1a5e4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:40.867706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aae629-8cf1-420b-b69b-ed2da3f1a5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:40.901662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-38aae629-8cf1-420b-b69b-ed2da3f1a5e4 None None] MFA Rules not processed for user `881f054c84d04ceaa17a5817816022d4`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:33:40.903015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-38aae629-8cf1-420b-b69b-ed2da3f1a5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:40.928012 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1603/3245] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:33:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:33:48.708284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=40 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:50.887047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=67 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:50.927701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ce032-4f31-403a-b2c8-75db449f9bbf None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:50.930397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ce032-4f31-403a-b2c8-75db449f9bbf None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:50.930397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ce032-4f31-403a-b2c8-75db449f9bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:50.980241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-103ce032-4f31-403a-b2c8-75db449f9bbf None None] MFA Rules not processed for user `94897f20beb94dbd8e7eff6ecba30026`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:33:50.983318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-103ce032-4f31-403a-b2c8-75db449f9bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:51.136607 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1643/3246] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:33:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:33:52.729919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aae629-8cf1-420b-b69b-ed2da3f1a5e4 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:52.754892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aae629-8cf1-420b-b69b-ed2da3f1a5e4 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:52.767327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf3a52-56a7-4651-90da-fbbeacef1132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:52.774373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ce032-4f31-403a-b2c8-75db449f9bbf None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:52.776230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-103ce032-4f31-403a-b2c8-75db449f9bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:52.791832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf3a52-56a7-4651-90da-fbbeacef1132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:52.794596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf3a52-56a7-4651-90da-fbbeacef1132 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:52.795030 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf3a52-56a7-4651-90da-fbbeacef1132 admin admin] PATH_INFO: `/v3/users/3bab1bbeb309491e94394b1137e9f3bd` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:52.800558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf3a52-56a7-4651-90da-fbbeacef1132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bab1bbeb309491e94394b1137e9f3bd)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:52.806304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf3a52-56a7-4651-90da-fbbeacef1132 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:52.813757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ce032-4f31-403a-b2c8-75db449f9bbf None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:52.840267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f01ed2-661f-4a8c-b17b-5c3dec6e478a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:52.840946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f01ed2-661f-4a8c-b17b-5c3dec6e478a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:52.841237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f01ed2-661f-4a8c-b17b-5c3dec6e478a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:52.841521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f01ed2-661f-4a8c-b17b-5c3dec6e478a admin admin] PATH_INFO: `/v3/users/cd284264ddc64d58baee15e337d5fcc6` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:52.848267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f01ed2-661f-4a8c-b17b-5c3dec6e478a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd284264ddc64d58baee15e337d5fcc6)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:52.856259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f01ed2-661f-4a8c-b17b-5c3dec6e478a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:53.096555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-aacf3a52-56a7-4651-90da-fbbeacef1132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bab1bbeb309491e94394b1137e9f3bd'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:53.097279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-aacf3a52-56a7-4651-90da-fbbeacef1132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bab1bbeb309491e94394b1137e9f3bd'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:53.113951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-aacf3a52-56a7-4651-90da-fbbeacef1132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bab1bbeb309491e94394b1137e9f3bd'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:53.129607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c3f01ed2-661f-4a8c-b17b-5c3dec6e478a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd284264ddc64d58baee15e337d5fcc6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:53.131174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c3f01ed2-661f-4a8c-b17b-5c3dec6e478a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd284264ddc64d58baee15e337d5fcc6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:53.142230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-aacf3a52-56a7-4651-90da-fbbeacef1132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bab1bbeb309491e94394b1137e9f3bd'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:53.153125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c3f01ed2-661f-4a8c-b17b-5c3dec6e478a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd284264ddc64d58baee15e337d5fcc6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:53.183554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c3f01ed2-661f-4a8c-b17b-5c3dec6e478a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd284264ddc64d58baee15e337d5fcc6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:53.187500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c3f01ed2-661f-4a8c-b17b-5c3dec6e478a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd284264ddc64d58baee15e337d5fcc6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:53.250027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-aacf3a52-56a7-4651-90da-fbbeacef1132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bab1bbeb309491e94394b1137e9f3bd'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:53.258252 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1604/3247] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:33:52 2022] DELETE /identity/v3/users/3bab1bbeb309491e94394b1137e9f3bd => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:33:53.368622 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1644/3248] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:33:52 2022] DELETE /identity/v3/users/cd284264ddc64d58baee15e337d5fcc6 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:33:54.094142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf3a52-56a7-4651-90da-fbbeacef1132 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:54.096321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-aacf3a52-56a7-4651-90da-fbbeacef1132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:54.353229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf3a52-56a7-4651-90da-fbbeacef1132 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:54.495409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926f04b-9827-44d3-9d20-e99a7f02e382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:54.496082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926f04b-9827-44d3-9d20-e99a7f02e382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:54.496362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926f04b-9827-44d3-9d20-e99a7f02e382 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:54.496635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926f04b-9827-44d3-9d20-e99a7f02e382 admin admin] PATH_INFO: `/v3/projects/5fbe72eaad79489ba74b04819eaf8d64` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:54.502427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926f04b-9827-44d3-9d20-e99a7f02e382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fbe72eaad79489ba74b04819eaf8d64)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:54.509232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926f04b-9827-44d3-9d20-e99a7f02e382 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:54.562789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:54.652360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4926f04b-9827-44d3-9d20-e99a7f02e382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fbe72eaad79489ba74b04819eaf8d64', 'request_id': 'req-4926f04b-9827-44d3-9d20-e99a7f02e382'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:54.736044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4926f04b-9827-44d3-9d20-e99a7f02e382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fbe72eaad79489ba74b04819eaf8d64', 'request_id': 'req-4926f04b-9827-44d3-9d20-e99a7f02e382'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:54.744814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4926f04b-9827-44d3-9d20-e99a7f02e382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fbe72eaad79489ba74b04819eaf8d64', 'request_id': 'req-4926f04b-9827-44d3-9d20-e99a7f02e382'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:54.760139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4926f04b-9827-44d3-9d20-e99a7f02e382 admin admin] The token cache is being invalidate because project 5fbe72eaad79489ba74b04819eaf8d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:33:54.760949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4926f04b-9827-44d3-9d20-e99a7f02e382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:54.761812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4926f04b-9827-44d3-9d20-e99a7f02e382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:54.769742 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1605/3249] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:33:54 2022] DELETE /identity/v3/projects/5fbe72eaad79489ba74b04819eaf8d64 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:33:54.770996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abdf02-117a-4c59-b88f-d74c588dcef0 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:54.771468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abdf02-117a-4c59-b88f-d74c588dcef0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:54.771642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abdf02-117a-4c59-b88f-d74c588dcef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:54.851269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-32abdf02-117a-4c59-b88f-d74c588dcef0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:33:54.855847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-32abdf02-117a-4c59-b88f-d74c588dcef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:55.053645 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1645/3250] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:33:55.062571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001ed83-4b1d-42af-aca4-3a04d90f92f5 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:55.065650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001ed83-4b1d-42af-aca4-3a04d90f92f5 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:55.066126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001ed83-4b1d-42af-aca4-3a04d90f92f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:55.131175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1001ed83-4b1d-42af-aca4-3a04d90f92f5 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:33:55.133273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1001ed83-4b1d-42af-aca4-3a04d90f92f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:55.157206 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1606/3251] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:33:55.158608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abdf02-117a-4c59-b88f-d74c588dcef0 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:55.170074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abdf02-117a-4c59-b88f-d74c588dcef0 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:55.202269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9134a9-0066-4527-8674-c99d6ffc74e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:55.209730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9134a9-0066-4527-8674-c99d6ffc74e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:55.209730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9134a9-0066-4527-8674-c99d6ffc74e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:55.209730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9134a9-0066-4527-8674-c99d6ffc74e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:55.209730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9134a9-0066-4527-8674-c99d6ffc74e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:33:55.209730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9134a9-0066-4527-8674-c99d6ffc74e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:55.209730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9134a9-0066-4527-8674-c99d6ffc74e0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:55.223539 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1646/3252] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:33:55.228534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001ed83-4b1d-42af-aca4-3a04d90f92f5 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:55.248548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001ed83-4b1d-42af-aca4-3a04d90f92f5 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:55.260315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7122d-1598-4370-a7bd-78a52f886bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:55.260908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7122d-1598-4370-a7bd-78a52f886bbf admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:55.261190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7122d-1598-4370-a7bd-78a52f886bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:55.261464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7122d-1598-4370-a7bd-78a52f886bbf admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:55.263705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7122d-1598-4370-a7bd-78a52f886bbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:55.269997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7122d-1598-4370-a7bd-78a52f886bbf admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:55.393567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9134a9-0066-4527-8674-c99d6ffc74e0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:55.399678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5a9134a9-0066-4527-8674-c99d6ffc74e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:55.411145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:55.416105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9134a9-0066-4527-8674-c99d6ffc74e0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:55.427552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adffd1a-3c0d-46d5-9077-16b66351991c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:55.428226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adffd1a-3c0d-46d5-9077-16b66351991c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:55.428613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adffd1a-3c0d-46d5-9077-16b66351991c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:55.428994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adffd1a-3c0d-46d5-9077-16b66351991c admin admin] PATH_INFO: `/v3/projects/dd32721d34bc40679303d6f47daae25c` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:55.430354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adffd1a-3c0d-46d5-9077-16b66351991c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd32721d34bc40679303d6f47daae25c)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:55.432433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adffd1a-3c0d-46d5-9077-16b66351991c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:55.474525 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1607/3253] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:33:55 2022] POST /identity/v3/projects => generated 381 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:33:55.480803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7122d-1598-4370-a7bd-78a52f886bbf admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:55.641080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5adffd1a-3c0d-46d5-9077-16b66351991c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd32721d34bc40679303d6f47daae25c', 'request_id': 'req-5adffd1a-3c0d-46d5-9077-16b66351991c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:55.646976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7122d-1598-4370-a7bd-78a52f886bbf admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:55.655328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5adffd1a-3c0d-46d5-9077-16b66351991c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd32721d34bc40679303d6f47daae25c', 'request_id': 'req-5adffd1a-3c0d-46d5-9077-16b66351991c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:55.658314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5adffd1a-3c0d-46d5-9077-16b66351991c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd32721d34bc40679303d6f47daae25c', 'request_id': 'req-5adffd1a-3c0d-46d5-9077-16b66351991c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:55.756972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5adffd1a-3c0d-46d5-9077-16b66351991c admin admin] The token cache is being invalidate because project dd32721d34bc40679303d6f47daae25c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:33:55.757270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5adffd1a-3c0d-46d5-9077-16b66351991c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:55.760392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5adffd1a-3c0d-46d5-9077-16b66351991c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:33:55.770397 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1647/3254] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:33:55 2022] DELETE /identity/v3/projects/dd32721d34bc40679303d6f47daae25c => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:33:55.776930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a8385-c336-4d47-bf98-786fdda5d6eb None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:55.777547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a8385-c336-4d47-bf98-786fdda5d6eb None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:55.777547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a8385-c336-4d47-bf98-786fdda5d6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:55.784512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b475c7-e1bb-4398-818c-0394f41aa8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:55.791169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b475c7-e1bb-4398-818c-0394f41aa8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:55.791169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b475c7-e1bb-4398-818c-0394f41aa8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:55.791169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b475c7-e1bb-4398-818c-0394f41aa8f4 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:55.791169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b475c7-e1bb-4398-818c-0394f41aa8f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:55.791169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b475c7-e1bb-4398-818c-0394f41aa8f4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:55.825557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2f5a8385-c336-4d47-bf98-786fdda5d6eb None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:33:55.829555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2f5a8385-c336-4d47-bf98-786fdda5d6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:55.858153 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1648/3255] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:33:55.868072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90ca03-06bf-4515-a546-e556e06f12bc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:55.868584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90ca03-06bf-4515-a546-e556e06f12bc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:55.869062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90ca03-06bf-4515-a546-e556e06f12bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:55.905895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-bc90ca03-06bf-4515-a546-e556e06f12bc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:33:55.908414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bc90ca03-06bf-4515-a546-e556e06f12bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:55.919980 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1608/3256] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:33:55 2022] POST /identity/v3/users => generated 291 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:33:55.924433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b475c7-e1bb-4398-818c-0394f41aa8f4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:55.926243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-86b475c7-e1bb-4398-818c-0394f41aa8f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:55.944000 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1649/3257] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:33:55.944000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90ca03-06bf-4515-a546-e556e06f12bc None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:55.948334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b475c7-e1bb-4398-818c-0394f41aa8f4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:55.963875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1697b-d33d-40a5-854c-64bbf9a16b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:55.964630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1697b-d33d-40a5-854c-64bbf9a16b14 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:55.965123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1697b-d33d-40a5-854c-64bbf9a16b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:55.965458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1697b-d33d-40a5-854c-64bbf9a16b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:55.972827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90ca03-06bf-4515-a546-e556e06f12bc None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:55.975710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1697b-d33d-40a5-854c-64bbf9a16b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:55.978702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1697b-d33d-40a5-854c-64bbf9a16b14 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:55.980867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f386746-dff5-4bba-af22-5e6f6487076f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:55.985507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f386746-dff5-4bba-af22-5e6f6487076f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:55.985507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f386746-dff5-4bba-af22-5e6f6487076f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:55.985507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f386746-dff5-4bba-af22-5e6f6487076f admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:55.985507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f386746-dff5-4bba-af22-5e6f6487076f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:33:55.985507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f386746-dff5-4bba-af22-5e6f6487076f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:55.987432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f386746-dff5-4bba-af22-5e6f6487076f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:56.012830 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1650/3258] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:33:56.016940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f386746-dff5-4bba-af22-5e6f6487076f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:56.022416 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1609/3259] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:33:56.025999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1697b-d33d-40a5-854c-64bbf9a16b14 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:56.042553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f386746-dff5-4bba-af22-5e6f6487076f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:56.043552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1697b-d33d-40a5-854c-64bbf9a16b14 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:56.051094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4125a59-6f12-4495-9ded-a9094eed6a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:56.051982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4125a59-6f12-4495-9ded-a9094eed6a0d admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:56.052472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4125a59-6f12-4495-9ded-a9094eed6a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:56.052940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4125a59-6f12-4495-9ded-a9094eed6a0d admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:56.057544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9621e0-a692-4427-b8e3-a40e08129927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:56.058536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9621e0-a692-4427-b8e3-a40e08129927 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:56.059234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9621e0-a692-4427-b8e3-a40e08129927 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:56.059872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9621e0-a692-4427-b8e3-a40e08129927 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:56.060744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9621e0-a692-4427-b8e3-a40e08129927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:56.060856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4125a59-6f12-4495-9ded-a9094eed6a0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:56.062975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4125a59-6f12-4495-9ded-a9094eed6a0d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:56.063472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9621e0-a692-4427-b8e3-a40e08129927 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:56.084808 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1610/3260] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:33:56.089448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9621e0-a692-4427-b8e3-a40e08129927 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:56.103231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9621e0-a692-4427-b8e3-a40e08129927 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:56.123187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca451f62-9acb-478f-afb5-7312137e3cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:56.124591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca451f62-9acb-478f-afb5-7312137e3cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:56.125055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca451f62-9acb-478f-afb5-7312137e3cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:56.125568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca451f62-9acb-478f-afb5-7312137e3cc9 admin admin] PATH_INFO: `/v3/projects/dbbc26f2331d47e5863e8dbf1952906c/users/fcff40b520f749f2b4bca5eed0923504/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:56.145564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca451f62-9acb-478f-afb5-7312137e3cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbbc26f2331d47e5863e8dbf1952906c, user_id=fcff40b520f749f2b4bca5eed0923504, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:56.149927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca451f62-9acb-478f-afb5-7312137e3cc9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:56.181191 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1651/3261] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:33:56 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:33:56.198477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4125a59-6f12-4495-9ded-a9094eed6a0d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:56.235571 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1611/3262] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:33:56 2022] PUT /identity/v3/projects/dbbc26f2331d47e5863e8dbf1952906c/users/fcff40b520f749f2b4bca5eed0923504/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:33:56.241677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0816fb4-d4f1-4c2e-832e-ebf980e8b45e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:56.242324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0816fb4-d4f1-4c2e-832e-ebf980e8b45e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:56.242772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0816fb4-d4f1-4c2e-832e-ebf980e8b45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:56.285109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b0816fb4-d4f1-4c2e-832e-ebf980e8b45e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:33:56.287066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b0816fb4-d4f1-4c2e-832e-ebf980e8b45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:56.318547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:56.364710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4125a59-6f12-4495-9ded-a9094eed6a0d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:56.444187 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1612/3263] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:33:56.470576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0816fb4-d4f1-4c2e-832e-ebf980e8b45e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:56.472416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b0816fb4-d4f1-4c2e-832e-ebf980e8b45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:56.538593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535b384-e04b-439a-811f-d001b198d30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:56.538898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535b384-e04b-439a-811f-d001b198d30d admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:56.538987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535b384-e04b-439a-811f-d001b198d30d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:56.539237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535b384-e04b-439a-811f-d001b198d30d admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:56.539854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535b384-e04b-439a-811f-d001b198d30d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:56.541863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535b384-e04b-439a-811f-d001b198d30d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:56.597277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0816fb4-d4f1-4c2e-832e-ebf980e8b45e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:56.604085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24d7f2-4243-4d16-8666-a988f89d22c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:56.604303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24d7f2-4243-4d16-8666-a988f89d22c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:56.604613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24d7f2-4243-4d16-8666-a988f89d22c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:56.604980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24d7f2-4243-4d16-8666-a988f89d22c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:56.619742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24d7f2-4243-4d16-8666-a988f89d22c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:56.621305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24d7f2-4243-4d16-8666-a988f89d22c1 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:56.648190 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1652/3264] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:33:56 2022] POST /identity/v3/users => generated 294 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:33:56.650671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535b384-e04b-439a-811f-d001b198d30d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:56.666621 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1613/3265] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:33:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:33:56.690135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535b384-e04b-439a-811f-d001b198d30d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:56.710456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a435fc-4b01-4847-b4fb-62c203ee9503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:56.711086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a435fc-4b01-4847-b4fb-62c203ee9503 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:56.711523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a435fc-4b01-4847-b4fb-62c203ee9503 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:56.711803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a435fc-4b01-4847-b4fb-62c203ee9503 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:56.712652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a435fc-4b01-4847-b4fb-62c203ee9503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:56.725854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a435fc-4b01-4847-b4fb-62c203ee9503 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:56.773048 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1653/3266] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:33:56.776327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24d7f2-4243-4d16-8666-a988f89d22c1 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:56.788141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24d7f2-4243-4d16-8666-a988f89d22c1 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:56.794115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85776ee1-d8a4-4e19-8df8-b8e81d4b9964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:56.794826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85776ee1-d8a4-4e19-8df8-b8e81d4b9964 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:56.797492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85776ee1-d8a4-4e19-8df8-b8e81d4b9964 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:56.797926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85776ee1-d8a4-4e19-8df8-b8e81d4b9964 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:56.800811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85776ee1-d8a4-4e19-8df8-b8e81d4b9964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:56.805663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85776ee1-d8a4-4e19-8df8-b8e81d4b9964 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:56.824871 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1614/3267] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:33:56.829180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a435fc-4b01-4847-b4fb-62c203ee9503 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:56.842590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a435fc-4b01-4847-b4fb-62c203ee9503 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:56.855596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfc9d8-4662-4a7c-9e8d-9c58d16a85c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:56.856817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfc9d8-4662-4a7c-9e8d-9c58d16a85c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:56.857107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfc9d8-4662-4a7c-9e8d-9c58d16a85c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:56.859306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfc9d8-4662-4a7c-9e8d-9c58d16a85c4 admin admin] PATH_INFO: `/v3/projects/1073b41a231e4e68be36732b22fcc154/users/bab3c739ff0749488193af39cb7ced21/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:56.939937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfc9d8-4662-4a7c-9e8d-9c58d16a85c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1073b41a231e4e68be36732b22fcc154, user_id=bab3c739ff0749488193af39cb7ced21, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:56.950438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfc9d8-4662-4a7c-9e8d-9c58d16a85c4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:57.086314 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1654/3268] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:33:56 2022] PUT /identity/v3/projects/1073b41a231e4e68be36732b22fcc154/users/bab3c739ff0749488193af39cb7ced21/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:33:57.091624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731d793-b596-4d05-9cd9-9e29559de3ab None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:57.091830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731d793-b596-4d05-9cd9-9e29559de3ab None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:57.092199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731d793-b596-4d05-9cd9-9e29559de3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:57.140509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9731d793-b596-4d05-9cd9-9e29559de3ab None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:33:57.144490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9731d793-b596-4d05-9cd9-9e29559de3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:57.359681 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1615/3269] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:33:57.392085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfc9d8-4662-4a7c-9e8d-9c58d16a85c4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:33:57.394460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a1dfc9d8-4662-4a7c-9e8d-9c58d16a85c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:33:57.548727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfc9d8-4662-4a7c-9e8d-9c58d16a85c4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:33:57.555544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d40cd-a20e-4383-8899-cfbc982624eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:33:57.562164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d40cd-a20e-4383-8899-cfbc982624eb service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:33:57.562164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d40cd-a20e-4383-8899-cfbc982624eb service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:33:57.562164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d40cd-a20e-4383-8899-cfbc982624eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:33:57.610421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d40cd-a20e-4383-8899-cfbc982624eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:33:57.612919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d40cd-a20e-4383-8899-cfbc982624eb service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:33:57.642219 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1655/3270] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:33:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:33:58.044311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:03.951565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731d793-b596-4d05-9cd9-9e29559de3ab None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:03.953098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9731d793-b596-4d05-9cd9-9e29559de3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:03.977949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:03.986232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731d793-b596-4d05-9cd9-9e29559de3ab None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:04.013184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27b4d6-0576-4ad7-99a1-07803275e440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:04.014057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27b4d6-0576-4ad7-99a1-07803275e440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:04.014498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27b4d6-0576-4ad7-99a1-07803275e440 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:04.014935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27b4d6-0576-4ad7-99a1-07803275e440 admin admin] PATH_INFO: `/v3/users/45f7471db101458fa692a73173bb42a1` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:04.018941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27b4d6-0576-4ad7-99a1-07803275e440 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45f7471db101458fa692a73173bb42a1)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:04.022893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27b4d6-0576-4ad7-99a1-07803275e440 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:04.306307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ea27b4d6-0576-4ad7-99a1-07803275e440 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45f7471db101458fa692a73173bb42a1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:04.307307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ea27b4d6-0576-4ad7-99a1-07803275e440 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45f7471db101458fa692a73173bb42a1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:04.328292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ea27b4d6-0576-4ad7-99a1-07803275e440 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45f7471db101458fa692a73173bb42a1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:04.385187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ea27b4d6-0576-4ad7-99a1-07803275e440 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45f7471db101458fa692a73173bb42a1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:04.603599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ea27b4d6-0576-4ad7-99a1-07803275e440 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45f7471db101458fa692a73173bb42a1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:04.618394 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1616/3271] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:34:03 2022] DELETE /identity/v3/users/45f7471db101458fa692a73173bb42a1 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:34:06.214407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d40cd-a20e-4383-8899-cfbc982624eb service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:06.238984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d40cd-a20e-4383-8899-cfbc982624eb service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:06.388617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089b80b-f529-40c3-874e-540e03c2b93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:06.390083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089b80b-f529-40c3-874e-540e03c2b93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:06.390838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089b80b-f529-40c3-874e-540e03c2b93b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:06.391327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089b80b-f529-40c3-874e-540e03c2b93b admin admin] PATH_INFO: `/v3/projects/d2c1020a13864ca8b5199427528d650d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:06.393398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089b80b-f529-40c3-874e-540e03c2b93b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c1020a13864ca8b5199427528d650d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:06.399303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089b80b-f529-40c3-874e-540e03c2b93b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:06.658809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:06.671493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b089b80b-f529-40c3-874e-540e03c2b93b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c1020a13864ca8b5199427528d650d', 'request_id': 'req-b089b80b-f529-40c3-874e-540e03c2b93b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:06.695935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b089b80b-f529-40c3-874e-540e03c2b93b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c1020a13864ca8b5199427528d650d', 'request_id': 'req-b089b80b-f529-40c3-874e-540e03c2b93b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:06.708032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b089b80b-f529-40c3-874e-540e03c2b93b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c1020a13864ca8b5199427528d650d', 'request_id': 'req-b089b80b-f529-40c3-874e-540e03c2b93b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:06.810585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27b4d6-0576-4ad7-99a1-07803275e440 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:06.812052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ea27b4d6-0576-4ad7-99a1-07803275e440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:06.863828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b089b80b-f529-40c3-874e-540e03c2b93b admin admin] The token cache is being invalidate because project d2c1020a13864ca8b5199427528d650d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:34:06.868543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b089b80b-f529-40c3-874e-540e03c2b93b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:06.879444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b089b80b-f529-40c3-874e-540e03c2b93b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:06.879444 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1656/3272] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:34:06 2022] DELETE /identity/v3/projects/d2c1020a13864ca8b5199427528d650d => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:34:06.879444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019ff03-419f-4b93-9146-bb715901c518 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:06.879444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019ff03-419f-4b93-9146-bb715901c518 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:06.879444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019ff03-419f-4b93-9146-bb715901c518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:06.923922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2019ff03-419f-4b93-9146-bb715901c518 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:06.925436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2019ff03-419f-4b93-9146-bb715901c518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:06.990077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27b4d6-0576-4ad7-99a1-07803275e440 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:07.083896 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1657/3273] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:07.083896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf723e-5ca5-4a1a-8c6a-fe14f40ba77c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:07.083896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf723e-5ca5-4a1a-8c6a-fe14f40ba77c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:07.083896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf723e-5ca5-4a1a-8c6a-fe14f40ba77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:07.115258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-eecf723e-5ca5-4a1a-8c6a-fe14f40ba77c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:07.116909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-eecf723e-5ca5-4a1a-8c6a-fe14f40ba77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:07.141667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21907b-6cc1-4689-a1ca-07b7a52b7720 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:07.142270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21907b-6cc1-4689-a1ca-07b7a52b7720 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:07.142562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21907b-6cc1-4689-a1ca-07b7a52b7720 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:07.142845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21907b-6cc1-4689-a1ca-07b7a52b7720 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:07.149624 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1658/3274] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:07.150661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ed21907b-6cc1-4689-a1ca-07b7a52b7720 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:07.150817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf723e-5ca5-4a1a-8c6a-fe14f40ba77c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:07.172300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21907b-6cc1-4689-a1ca-07b7a52b7720 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:07.177714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf723e-5ca5-4a1a-8c6a-fe14f40ba77c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:07.178176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21907b-6cc1-4689-a1ca-07b7a52b7720 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:07.186254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f560a-9db5-467e-869f-cbd82d097d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:07.186930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f560a-9db5-467e-869f-cbd82d097d20 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:07.187220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f560a-9db5-467e-869f-cbd82d097d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:07.188493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f560a-9db5-467e-869f-cbd82d097d20 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:07.188937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f560a-9db5-467e-869f-cbd82d097d20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:34:07.189254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f560a-9db5-467e-869f-cbd82d097d20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:07.191368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f560a-9db5-467e-869f-cbd82d097d20 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:07.213979 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1617/3275] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:34:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:34:07.229878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21907b-6cc1-4689-a1ca-07b7a52b7720 service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:07.230384 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1659/3276] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:34:07.264797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21907b-6cc1-4689-a1ca-07b7a52b7720 service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:07.278567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51366f-c0e0-4b61-aaba-0fab15df6b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:07.279527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51366f-c0e0-4b61-aaba-0fab15df6b30 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:07.280007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51366f-c0e0-4b61-aaba-0fab15df6b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:07.280509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51366f-c0e0-4b61-aaba-0fab15df6b30 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:07.282355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51366f-c0e0-4b61-aaba-0fab15df6b30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:07.295970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51366f-c0e0-4b61-aaba-0fab15df6b30 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:07.316312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:07.539560 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1618/3277] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:34:07 2022] POST /identity/v3/projects => generated 385 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:34:07.543951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f560a-9db5-467e-869f-cbd82d097d20 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:07.558196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f560a-9db5-467e-869f-cbd82d097d20 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:07.684042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadddea-8bbc-4af6-afa5-76e42a5b78e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:07.684760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadddea-8bbc-4af6-afa5-76e42a5b78e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:07.685043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadddea-8bbc-4af6-afa5-76e42a5b78e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:07.685331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadddea-8bbc-4af6-afa5-76e42a5b78e9 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:07.685990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fadddea-8bbc-4af6-afa5-76e42a5b78e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:07.693101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fadddea-8bbc-4af6-afa5-76e42a5b78e9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:07.897474 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1660/3278] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:34:07 2022] POST /identity/v3/users => generated 293 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:34:07.898248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51366f-c0e0-4b61-aaba-0fab15df6b30 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:07.910588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51366f-c0e0-4b61-aaba-0fab15df6b30 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:07.916470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17800b1-4dc6-4c5d-bd64-aec93bff1df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:07.917296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17800b1-4dc6-4c5d-bd64-aec93bff1df6 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:07.917752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17800b1-4dc6-4c5d-bd64-aec93bff1df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:07.918206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17800b1-4dc6-4c5d-bd64-aec93bff1df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:07.919014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17800b1-4dc6-4c5d-bd64-aec93bff1df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:07.920782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17800b1-4dc6-4c5d-bd64-aec93bff1df6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:07.936941 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1619/3279] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:34:07.939692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadddea-8bbc-4af6-afa5-76e42a5b78e9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:07.963030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadddea-8bbc-4af6-afa5-76e42a5b78e9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:07.987522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7a9d0-c320-44d8-8ecb-90999955de17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:07.988340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7a9d0-c320-44d8-8ecb-90999955de17 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:07.988794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7a9d0-c320-44d8-8ecb-90999955de17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:07.989220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7a9d0-c320-44d8-8ecb-90999955de17 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:07.990135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7a9d0-c320-44d8-8ecb-90999955de17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:07.991932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7a9d0-c320-44d8-8ecb-90999955de17 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:08.008270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17800b1-4dc6-4c5d-bd64-aec93bff1df6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:08.008745 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1661/3280] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:34:08.021471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17800b1-4dc6-4c5d-bd64-aec93bff1df6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:08.030219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d5609-7c3c-44ea-9724-952430a0e331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:08.031231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d5609-7c3c-44ea-9724-952430a0e331 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:08.031753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d5609-7c3c-44ea-9724-952430a0e331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:08.032233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d5609-7c3c-44ea-9724-952430a0e331 admin admin] PATH_INFO: `/v3/projects/98d371ab6648425eac2cf1702f2789dc/users/ae7845f6759c4dcabcc1516a72484174/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:08.055433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d5609-7c3c-44ea-9724-952430a0e331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d371ab6648425eac2cf1702f2789dc, user_id=ae7845f6759c4dcabcc1516a72484174, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:08.060559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d5609-7c3c-44ea-9724-952430a0e331 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:08.200501 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1620/3281] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:34:08 2022] PUT /identity/v3/projects/98d371ab6648425eac2cf1702f2789dc/users/ae7845f6759c4dcabcc1516a72484174/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:34:08.212362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913f086-cf64-4bb8-94c6-d247a4eefbee None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:08.212654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913f086-cf64-4bb8-94c6-d247a4eefbee None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:08.212932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913f086-cf64-4bb8-94c6-d247a4eefbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:08.258864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a913f086-cf64-4bb8-94c6-d247a4eefbee None None] MFA Rules not processed for user `ae7845f6759c4dcabcc1516a72484174`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:08.261022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a913f086-cf64-4bb8-94c6-d247a4eefbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:08.319692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d5609-7c3c-44ea-9724-952430a0e331 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:08.322756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-064d5609-7c3c-44ea-9724-952430a0e331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:08.408568 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1662/3282] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:34:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:08.422613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913f086-cf64-4bb8-94c6-d247a4eefbee None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:08.425210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a913f086-cf64-4bb8-94c6-d247a4eefbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:08.468465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d5609-7c3c-44ea-9724-952430a0e331 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:08.482973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb709c23-b7b5-4429-880f-023bd59d1737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:08.483779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb709c23-b7b5-4429-880f-023bd59d1737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:08.484179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb709c23-b7b5-4429-880f-023bd59d1737 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:08.485088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb709c23-b7b5-4429-880f-023bd59d1737 admin admin] PATH_INFO: `/v3/users/0533917bc5aa4e23802a43b1eb534bd0` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:08.486740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb709c23-b7b5-4429-880f-023bd59d1737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0533917bc5aa4e23802a43b1eb534bd0)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:08.490228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb709c23-b7b5-4429-880f-023bd59d1737 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:08.547935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913f086-cf64-4bb8-94c6-d247a4eefbee None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:08.561138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a597b87-a866-4ce8-aca1-38b1bff06ea9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:08.561866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a597b87-a866-4ce8-aca1-38b1bff06ea9 service glance] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:08.562333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a597b87-a866-4ce8-aca1-38b1bff06ea9 service glance] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:08.563514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a597b87-a866-4ce8-aca1-38b1bff06ea9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:08.580996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a597b87-a866-4ce8-aca1-38b1bff06ea9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:08.593397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a597b87-a866-4ce8-aca1-38b1bff06ea9 service glance] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:08.657906 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1663/3283] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:34:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:34:08.901238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb709c23-b7b5-4429-880f-023bd59d1737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0533917bc5aa4e23802a43b1eb534bd0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:08.904734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb709c23-b7b5-4429-880f-023bd59d1737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0533917bc5aa4e23802a43b1eb534bd0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:08.926534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb709c23-b7b5-4429-880f-023bd59d1737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0533917bc5aa4e23802a43b1eb534bd0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:08.962112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb709c23-b7b5-4429-880f-023bd59d1737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0533917bc5aa4e23802a43b1eb534bd0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:09.097942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb709c23-b7b5-4429-880f-023bd59d1737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0533917bc5aa4e23802a43b1eb534bd0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:09.107672 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1621/3284] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:34:08 2022] DELETE /identity/v3/users/0533917bc5aa4e23802a43b1eb534bd0 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:34:09.483213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320471aa-24ca-45e7-8866-84900117ef91 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:09.486127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320471aa-24ca-45e7-8866-84900117ef91 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:09.486595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320471aa-24ca-45e7-8866-84900117ef91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:09.521967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-320471aa-24ca-45e7-8866-84900117ef91 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:09.523181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-320471aa-24ca-45e7-8866-84900117ef91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:09.646351 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1664/3285] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:34:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:09.825292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb709c23-b7b5-4429-880f-023bd59d1737 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:09.829509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bb709c23-b7b5-4429-880f-023bd59d1737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:09.867445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320471aa-24ca-45e7-8866-84900117ef91 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:09.869475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-320471aa-24ca-45e7-8866-84900117ef91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:09.941097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb709c23-b7b5-4429-880f-023bd59d1737 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:09.947094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1affdb-0472-4072-a4e5-da1d7c107d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:09.947949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1affdb-0472-4072-a4e5-da1d7c107d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:09.948533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1affdb-0472-4072-a4e5-da1d7c107d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:09.948968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1affdb-0472-4072-a4e5-da1d7c107d92 admin admin] PATH_INFO: `/v3/projects/20d87abf835a4104b40056b9eec2d6b6` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:09.951251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1affdb-0472-4072-a4e5-da1d7c107d92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20d87abf835a4104b40056b9eec2d6b6)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:09.953370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1affdb-0472-4072-a4e5-da1d7c107d92 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:09.989981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320471aa-24ca-45e7-8866-84900117ef91 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:09.998300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f4c93-8077-4eee-972a-2331d32b31e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:09.999203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f4c93-8077-4eee-972a-2331d32b31e2 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:09.999682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f4c93-8077-4eee-972a-2331d32b31e2 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:09.999982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f4c93-8077-4eee-972a-2331d32b31e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:10.011612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f4c93-8077-4eee-972a-2331d32b31e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:10.013086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f4c93-8077-4eee-972a-2331d32b31e2 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:10.033064 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1665/3286] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:34:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:34:10.179432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76503cc2-5688-4427-a29d-04dc2c74b68a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:10.186008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76503cc2-5688-4427-a29d-04dc2c74b68a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:10.186008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76503cc2-5688-4427-a29d-04dc2c74b68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:10.202999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ce1affdb-0472-4072-a4e5-da1d7c107d92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20d87abf835a4104b40056b9eec2d6b6', 'request_id': 'req-ce1affdb-0472-4072-a4e5-da1d7c107d92'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:10.256052 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-76503cc2-5688-4427-a29d-04dc2c74b68a None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:10.257974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-76503cc2-5688-4427-a29d-04dc2c74b68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:10.384967 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1666/3287] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:34:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:10.402602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76503cc2-5688-4427-a29d-04dc2c74b68a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:10.424841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ce1affdb-0472-4072-a4e5-da1d7c107d92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20d87abf835a4104b40056b9eec2d6b6', 'request_id': 'req-ce1affdb-0472-4072-a4e5-da1d7c107d92'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:10.446340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ce1affdb-0472-4072-a4e5-da1d7c107d92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20d87abf835a4104b40056b9eec2d6b6', 'request_id': 'req-ce1affdb-0472-4072-a4e5-da1d7c107d92'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:10.491549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:10.500463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ce1affdb-0472-4072-a4e5-da1d7c107d92 admin admin] The token cache is being invalidate because project 20d87abf835a4104b40056b9eec2d6b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:34:10.503883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ce1affdb-0472-4072-a4e5-da1d7c107d92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:10.506223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ce1affdb-0472-4072-a4e5-da1d7c107d92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:10.514153 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1622/3288] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:34:09 2022] DELETE /identity/v3/projects/20d87abf835a4104b40056b9eec2d6b6 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:34:10.521661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8113e-1f5a-436c-85ba-387b7034b18d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:10.522515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8113e-1f5a-436c-85ba-387b7034b18d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:10.523013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8113e-1f5a-436c-85ba-387b7034b18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:10.576374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4bc8113e-1f5a-436c-85ba-387b7034b18d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:10.578838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4bc8113e-1f5a-436c-85ba-387b7034b18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:10.613795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76503cc2-5688-4427-a29d-04dc2c74b68a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:10.638907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0baa05-d828-48e4-a70d-795bc7d323b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:10.639850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0baa05-d828-48e4-a70d-795bc7d323b3 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:10.640334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0baa05-d828-48e4-a70d-795bc7d323b3 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:10.641588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0baa05-d828-48e4-a70d-795bc7d323b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:10.645062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cb0baa05-d828-48e4-a70d-795bc7d323b3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:10.662499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0baa05-d828-48e4-a70d-795bc7d323b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:10.665923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0baa05-d828-48e4-a70d-795bc7d323b3 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:10.679773 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1667/3289] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:34:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 03:34:10.710542 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1623/3290] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:10.719389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05718b2e-2fb4-49ef-9251-4deef1bc8d51 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:10.719610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05718b2e-2fb4-49ef-9251-4deef1bc8d51 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:10.720006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05718b2e-2fb4-49ef-9251-4deef1bc8d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:10.749226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-05718b2e-2fb4-49ef-9251-4deef1bc8d51 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:10.750534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-05718b2e-2fb4-49ef-9251-4deef1bc8d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:10.779044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8113e-1f5a-436c-85ba-387b7034b18d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:10.791369 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1668/3291] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:10.800982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8113e-1f5a-436c-85ba-387b7034b18d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:10.811117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543a855-6686-4e2f-b2da-76f032db3ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:10.813407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a855-6686-4e2f-b2da-76f032db3ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:10.813910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a855-6686-4e2f-b2da-76f032db3ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:10.817965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a855-6686-4e2f-b2da-76f032db3ef2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:10.817965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543a855-6686-4e2f-b2da-76f032db3ef2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:34:10.817965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543a855-6686-4e2f-b2da-76f032db3ef2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:10.819229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543a855-6686-4e2f-b2da-76f032db3ef2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:10.839825 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1624/3292] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:34:10.844179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05718b2e-2fb4-49ef-9251-4deef1bc8d51 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:10.855786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05718b2e-2fb4-49ef-9251-4deef1bc8d51 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:10.860809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc14f9-4f83-4379-bc96-351ff34c1faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:10.861473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc14f9-4f83-4379-bc96-351ff34c1faf admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:10.861762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc14f9-4f83-4379-bc96-351ff34c1faf admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:10.862142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc14f9-4f83-4379-bc96-351ff34c1faf admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:10.862800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc14f9-4f83-4379-bc96-351ff34c1faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:10.865222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc14f9-4f83-4379-bc96-351ff34c1faf admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:11.022209 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1669/3293] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:34:10 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:34:11.027492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543a855-6686-4e2f-b2da-76f032db3ef2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:11.061831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543a855-6686-4e2f-b2da-76f032db3ef2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:11.146895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:11.213891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682aace-e12b-423c-88a8-8ec0e8cd3875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:11.216457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682aace-e12b-423c-88a8-8ec0e8cd3875 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:11.216915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682aace-e12b-423c-88a8-8ec0e8cd3875 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:11.218732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682aace-e12b-423c-88a8-8ec0e8cd3875 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:11.220884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682aace-e12b-423c-88a8-8ec0e8cd3875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:11.227525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682aace-e12b-423c-88a8-8ec0e8cd3875 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:11.362566 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1625/3294] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:34:11 2022] POST /identity/v3/users => generated 289 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:34:11.367255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc14f9-4f83-4379-bc96-351ff34c1faf admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:11.401282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc14f9-4f83-4379-bc96-351ff34c1faf admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:11.444495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11095b4a-ab68-49fb-96d4-1e8800d884f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:11.445199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11095b4a-ab68-49fb-96d4-1e8800d884f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:11.445400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11095b4a-ab68-49fb-96d4-1e8800d884f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:11.445672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11095b4a-ab68-49fb-96d4-1e8800d884f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:11.446679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11095b4a-ab68-49fb-96d4-1e8800d884f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:11.448545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11095b4a-ab68-49fb-96d4-1e8800d884f7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:11.460599 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1670/3295] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:34:11.465297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682aace-e12b-423c-88a8-8ec0e8cd3875 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:11.491122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682aace-e12b-423c-88a8-8ec0e8cd3875 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:11.507527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefff77e-fb9b-4b9c-99a6-7c3bf95bc6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:11.508454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefff77e-fb9b-4b9c-99a6-7c3bf95bc6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:11.508924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefff77e-fb9b-4b9c-99a6-7c3bf95bc6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:11.509358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefff77e-fb9b-4b9c-99a6-7c3bf95bc6b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:11.510239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefff77e-fb9b-4b9c-99a6-7c3bf95bc6b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:11.512125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefff77e-fb9b-4b9c-99a6-7c3bf95bc6b4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:11.538690 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1626/3296] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:34:11.542413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11095b4a-ab68-49fb-96d4-1e8800d884f7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:11.560164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11095b4a-ab68-49fb-96d4-1e8800d884f7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:11.574235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26b9f1-74c3-47d1-ab53-e80b80912f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:11.575272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26b9f1-74c3-47d1-ab53-e80b80912f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:11.575788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26b9f1-74c3-47d1-ab53-e80b80912f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:11.576607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26b9f1-74c3-47d1-ab53-e80b80912f7c admin admin] PATH_INFO: `/v3/projects/8bb5d291069d4329a90123e327fe9c59/users/f9c32b7626594ff888970c7f3227bb20/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:11.613634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26b9f1-74c3-47d1-ab53-e80b80912f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb5d291069d4329a90123e327fe9c59, user_id=f9c32b7626594ff888970c7f3227bb20, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:11.619107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26b9f1-74c3-47d1-ab53-e80b80912f7c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:11.737439 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1671/3297] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:34:11 2022] PUT /identity/v3/projects/8bb5d291069d4329a90123e327fe9c59/users/f9c32b7626594ff888970c7f3227bb20/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:34:11.744398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effe9a3-02e9-49e2-9540-0f15d2d5410a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:11.744943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effe9a3-02e9-49e2-9540-0f15d2d5410a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:11.745347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effe9a3-02e9-49e2-9540-0f15d2d5410a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:11.779761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1effe9a3-02e9-49e2-9540-0f15d2d5410a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:11.781962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1effe9a3-02e9-49e2-9540-0f15d2d5410a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:11.937616 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1627/3298] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:12.048908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26b9f1-74c3-47d1-ab53-e80b80912f7c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:12.051071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fa26b9f1-74c3-47d1-ab53-e80b80912f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:12.211482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26b9f1-74c3-47d1-ab53-e80b80912f7c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:12.248792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1ddcd-7789-478a-80a0-f4d680a27897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:12.256399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1ddcd-7789-478a-80a0-f4d680a27897 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:12.256902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1ddcd-7789-478a-80a0-f4d680a27897 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:12.259681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1ddcd-7789-478a-80a0-f4d680a27897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:12.310948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1ddcd-7789-478a-80a0-f4d680a27897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:12.313505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1ddcd-7789-478a-80a0-f4d680a27897 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:12.356692 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1672/3299] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:34:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:34:12.540819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:12.953947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0acff-1997-4148-9f64-c6b9efed45fb None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:12.954809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0acff-1997-4148-9f64-c6b9efed45fb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:12.955275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0acff-1997-4148-9f64-c6b9efed45fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:12.998193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-23e0acff-1997-4148-9f64-c6b9efed45fb None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:12.999005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9233a-242d-45eb-8da5-02c437302c92 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:12.999853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9233a-242d-45eb-8da5-02c437302c92 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:13.001569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9233a-242d-45eb-8da5-02c437302c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:13.002616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-23e0acff-1997-4148-9f64-c6b9efed45fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:13.066799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-46e9233a-242d-45eb-8da5-02c437302c92 None None] MFA Rules not processed for user `bab3c739ff0749488193af39cb7ced21`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:13.068180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-46e9233a-242d-45eb-8da5-02c437302c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:13.096785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:13.142639 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1628/3300] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:34:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 27 03:34:13.149453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0acff-1997-4148-9f64-c6b9efed45fb None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:13.151482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-23e0acff-1997-4148-9f64-c6b9efed45fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:13.194490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:13.287524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0acff-1997-4148-9f64-c6b9efed45fb None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:13.311449 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1673/3301] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:34:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:13.316274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673efc3c-70e5-4eff-be5b-1d7589348943 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:13.320004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673efc3c-70e5-4eff-be5b-1d7589348943 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:13.325461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673efc3c-70e5-4eff-be5b-1d7589348943 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:13.327616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673efc3c-70e5-4eff-be5b-1d7589348943 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:13.334642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9233a-242d-45eb-8da5-02c437302c92 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:13.336383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-46e9233a-242d-45eb-8da5-02c437302c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:13.358436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673efc3c-70e5-4eff-be5b-1d7589348943 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:13.367046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673efc3c-70e5-4eff-be5b-1d7589348943 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:13.386743 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1629/3302] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:34:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 03:34:13.711730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9233a-242d-45eb-8da5-02c437302c92 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:13.745271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb1aea-2843-4d80-b5b7-2fc813c66174 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:13.748447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb1aea-2843-4d80-b5b7-2fc813c66174 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:13.748735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb1aea-2843-4d80-b5b7-2fc813c66174 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:13.749016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb1aea-2843-4d80-b5b7-2fc813c66174 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:13.773500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb1aea-2843-4d80-b5b7-2fc813c66174 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:13.777416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb1aea-2843-4d80-b5b7-2fc813c66174 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:13.798422 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1674/3303] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:34:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:34:15.870742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5a35a-debb-4e3e-b029-24dd2936f4f4 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:15.871592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5a35a-debb-4e3e-b029-24dd2936f4f4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:15.872665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5a35a-debb-4e3e-b029-24dd2936f4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:15.890905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:15.927305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-74e5a35a-debb-4e3e-b029-24dd2936f4f4 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:15.932814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-74e5a35a-debb-4e3e-b029-24dd2936f4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:15.953442 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1630/3304] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:34:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:15.970699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb1aea-2843-4d80-b5b7-2fc813c66174 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:15.988892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb1aea-2843-4d80-b5b7-2fc813c66174 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:16.009945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56c9b6-a2fc-4c06-830a-3af33bbbb21d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:16.010842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56c9b6-a2fc-4c06-830a-3af33bbbb21d service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:16.012664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56c9b6-a2fc-4c06-830a-3af33bbbb21d service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:16.013119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56c9b6-a2fc-4c06-830a-3af33bbbb21d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:16.034266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56c9b6-a2fc-4c06-830a-3af33bbbb21d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:16.036318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56c9b6-a2fc-4c06-830a-3af33bbbb21d service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:16.068635 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1675/3305] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:34:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:34:16.965535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f1ca1-c476-4d49-a511-8555f9cb51d5 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:16.966592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f1ca1-c476-4d49-a511-8555f9cb51d5 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:16.967128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f1ca1-c476-4d49-a511-8555f9cb51d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:17.034364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-468f1ca1-c476-4d49-a511-8555f9cb51d5 None None] MFA Rules not processed for user `fcff40b520f749f2b4bca5eed0923504`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:17.035940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-468f1ca1-c476-4d49-a511-8555f9cb51d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:17.174526 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1631/3306] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:34:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:17.179260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d3791-5f0d-44e6-8134-e49127fa39e5 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:17.179769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d3791-5f0d-44e6-8134-e49127fa39e5 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:17.179913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d3791-5f0d-44e6-8134-e49127fa39e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:17.245539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9e1d3791-5f0d-44e6-8134-e49127fa39e5 None None] MFA Rules not processed for user `fcff40b520f749f2b4bca5eed0923504`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:17.247454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9e1d3791-5f0d-44e6-8134-e49127fa39e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:17.267889 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1676/3307] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:34:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:17.427845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510d789-3af8-4fbb-ac04-71743bfa5647 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:17.428243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510d789-3af8-4fbb-ac04-71743bfa5647 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:17.428928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510d789-3af8-4fbb-ac04-71743bfa5647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:17.434018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d3791-5f0d-44e6-8134-e49127fa39e5 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:17.436701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9e1d3791-5f0d-44e6-8134-e49127fa39e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:17.474088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d3791-5f0d-44e6-8134-e49127fa39e5 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:17.481382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-7510d789-3af8-4fbb-ac04-71743bfa5647 None None] MFA Rules not processed for user `ae7845f6759c4dcabcc1516a72484174`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:17.486600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7510d789-3af8-4fbb-ac04-71743bfa5647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:17.488312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb481ef-a438-48da-98e2-2fda616bd50a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:17.488947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb481ef-a438-48da-98e2-2fda616bd50a service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:17.489407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb481ef-a438-48da-98e2-2fda616bd50a service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:17.489834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb481ef-a438-48da-98e2-2fda616bd50a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:17.523664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb481ef-a438-48da-98e2-2fda616bd50a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:17.525570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb481ef-a438-48da-98e2-2fda616bd50a service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:17.554176 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1677/3308] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:34:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:34:17.627404 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1632/3309] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:34:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:19.401027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385856b-8944-4e4f-adac-4fa68702274a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:19.401604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385856b-8944-4e4f-adac-4fa68702274a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:19.401960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385856b-8944-4e4f-adac-4fa68702274a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:19.477738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3385856b-8944-4e4f-adac-4fa68702274a None None] MFA Rules not processed for user `ae7845f6759c4dcabcc1516a72484174`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:19.485567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3385856b-8944-4e4f-adac-4fa68702274a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:19.515344 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1678/3310] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:34:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:27.608850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=59 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:29.023247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4ca4b-11d7-4691-aa2a-0453e2e17b5c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:29.023862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4ca4b-11d7-4691-aa2a-0453e2e17b5c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:29.023862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4ca4b-11d7-4691-aa2a-0453e2e17b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:29.159303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5bd4ca4b-11d7-4691-aa2a-0453e2e17b5c None None] MFA Rules not processed for user `f9c32b7626594ff888970c7f3227bb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:29.160631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5bd4ca4b-11d7-4691-aa2a-0453e2e17b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:29.402355 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1633/3311] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:34:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:29.408436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4d2c4-da9f-4a0c-8167-bef821e5dc6b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:29.409335 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4d2c4-da9f-4a0c-8167-bef821e5dc6b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:29.409806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4d2c4-da9f-4a0c-8167-bef821e5dc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:29.446707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-51a4d2c4-da9f-4a0c-8167-bef821e5dc6b None None] MFA Rules not processed for user `f9c32b7626594ff888970c7f3227bb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:29.448250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-51a4d2c4-da9f-4a0c-8167-bef821e5dc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:29.457720 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1679/3312] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:34:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:29.785473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4ca4b-11d7-4691-aa2a-0453e2e17b5c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:29.811341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4ca4b-11d7-4691-aa2a-0453e2e17b5c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:29.825526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d283d-4fad-4e31-89c8-d15ff6cca444 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:29.826196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d283d-4fad-4e31-89c8-d15ff6cca444 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:29.826483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d283d-4fad-4e31-89c8-d15ff6cca444 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:29.826760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d283d-4fad-4e31-89c8-d15ff6cca444 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:29.877781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d283d-4fad-4e31-89c8-d15ff6cca444 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:29.881888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d283d-4fad-4e31-89c8-d15ff6cca444 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:29.906824 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1634/3313] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:34:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:34:33.471027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4d2c4-da9f-4a0c-8167-bef821e5dc6b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:33.474944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:33.488291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4d2c4-da9f-4a0c-8167-bef821e5dc6b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:33.506677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075af24-0612-4e78-8446-876905c06f21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:33.507562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075af24-0612-4e78-8446-876905c06f21 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:33.507847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075af24-0612-4e78-8446-876905c06f21 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:33.508121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075af24-0612-4e78-8446-876905c06f21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:33.510112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7075af24-0612-4e78-8446-876905c06f21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:33.621636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075af24-0612-4e78-8446-876905c06f21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:33.623341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075af24-0612-4e78-8446-876905c06f21 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:33.639332 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1680/3314] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:34:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:34:33.916466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d283d-4fad-4e31-89c8-d15ff6cca444 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:33.919662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-086d283d-4fad-4e31-89c8-d15ff6cca444 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:34.095149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d283d-4fad-4e31-89c8-d15ff6cca444 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:34.101646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2db12e-0392-429f-a329-e2bb76bcf484 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:34.102884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2db12e-0392-429f-a329-e2bb76bcf484 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:34.104417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2db12e-0392-429f-a329-e2bb76bcf484 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:34.104919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2db12e-0392-429f-a329-e2bb76bcf484 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:34.109260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fa2db12e-0392-429f-a329-e2bb76bcf484 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:34.141088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2db12e-0392-429f-a329-e2bb76bcf484 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:34.143135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2db12e-0392-429f-a329-e2bb76bcf484 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:34.157436 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1635/3315] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:34:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:34:41.577215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8fc09-345c-4c50-be89-7e91cbfab85d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:41.577760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8fc09-345c-4c50-be89-7e91cbfab85d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:41.577760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8fc09-345c-4c50-be89-7e91cbfab85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:41.602814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-17a8fc09-345c-4c50-be89-7e91cbfab85d None None] MFA Rules not processed for user `0d9053ce63864308b29190f9f51bd85f`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:41.604182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-17a8fc09-345c-4c50-be89-7e91cbfab85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:41.695291 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1681/3316] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:34:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:41.705296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c334b-91c9-48c0-b6ac-99998453a693 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:41.705745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c334b-91c9-48c0-b6ac-99998453a693 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:41.706065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c334b-91c9-48c0-b6ac-99998453a693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:41.731904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-510c334b-91c9-48c0-b6ac-99998453a693 None None] MFA Rules not processed for user `0d9053ce63864308b29190f9f51bd85f`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:41.733239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-510c334b-91c9-48c0-b6ac-99998453a693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:41.741910 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1636/3317] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:34:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:34:43.850442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8fc09-345c-4c50-be89-7e91cbfab85d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:43.852134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-17a8fc09-345c-4c50-be89-7e91cbfab85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:43.867595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8fc09-345c-4c50-be89-7e91cbfab85d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:43.873613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a24ebe-7284-400d-97dc-63e6a94f4500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:43.875061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a24ebe-7284-400d-97dc-63e6a94f4500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:43.876011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a24ebe-7284-400d-97dc-63e6a94f4500 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:43.876355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a24ebe-7284-400d-97dc-63e6a94f4500 admin admin] PATH_INFO: `/v3/users/ed44bf20b3464a53a3e3f6c9cd61cde3` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:43.877856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a24ebe-7284-400d-97dc-63e6a94f4500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed44bf20b3464a53a3e3f6c9cd61cde3)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:43.880079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a24ebe-7284-400d-97dc-63e6a94f4500 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:44.051352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-54a24ebe-7284-400d-97dc-63e6a94f4500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed44bf20b3464a53a3e3f6c9cd61cde3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:44.052038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-54a24ebe-7284-400d-97dc-63e6a94f4500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed44bf20b3464a53a3e3f6c9cd61cde3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:44.078565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-54a24ebe-7284-400d-97dc-63e6a94f4500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed44bf20b3464a53a3e3f6c9cd61cde3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:44.116231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-54a24ebe-7284-400d-97dc-63e6a94f4500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed44bf20b3464a53a3e3f6c9cd61cde3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:44.117518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-54a24ebe-7284-400d-97dc-63e6a94f4500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed44bf20b3464a53a3e3f6c9cd61cde3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:44.199138 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1682/3318] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:34:43 2022] DELETE /identity/v3/users/ed44bf20b3464a53a3e3f6c9cd61cde3 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:34:45.179788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c334b-91c9-48c0-b6ac-99998453a693 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:45.195739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c334b-91c9-48c0-b6ac-99998453a693 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:45.276089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba0204-36c4-4abc-85f1-2e0cb244ca0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:45.278786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba0204-36c4-4abc-85f1-2e0cb244ca0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:45.279509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba0204-36c4-4abc-85f1-2e0cb244ca0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:45.280764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba0204-36c4-4abc-85f1-2e0cb244ca0d admin admin] PATH_INFO: `/v3/projects/f5ee48e200624711b629a12b20c7d282` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:45.282800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba0204-36c4-4abc-85f1-2e0cb244ca0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5ee48e200624711b629a12b20c7d282)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:45.286671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba0204-36c4-4abc-85f1-2e0cb244ca0d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:45.288818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:45.412012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5eba0204-36c4-4abc-85f1-2e0cb244ca0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5ee48e200624711b629a12b20c7d282', 'request_id': 'req-5eba0204-36c4-4abc-85f1-2e0cb244ca0d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:45.488276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5eba0204-36c4-4abc-85f1-2e0cb244ca0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5ee48e200624711b629a12b20c7d282', 'request_id': 'req-5eba0204-36c4-4abc-85f1-2e0cb244ca0d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:45.496613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5eba0204-36c4-4abc-85f1-2e0cb244ca0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5ee48e200624711b629a12b20c7d282', 'request_id': 'req-5eba0204-36c4-4abc-85f1-2e0cb244ca0d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:45.518484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5eba0204-36c4-4abc-85f1-2e0cb244ca0d admin admin] The token cache is being invalidate because project f5ee48e200624711b629a12b20c7d282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:34:45.519115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5eba0204-36c4-4abc-85f1-2e0cb244ca0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:45.520006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5eba0204-36c4-4abc-85f1-2e0cb244ca0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:45.526553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a24ebe-7284-400d-97dc-63e6a94f4500 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:45.527759 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1637/3319] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:34:45 2022] DELETE /identity/v3/projects/f5ee48e200624711b629a12b20c7d282 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:34:45.528989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-54a24ebe-7284-400d-97dc-63e6a94f4500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:45.554756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a24ebe-7284-400d-97dc-63e6a94f4500 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:45.572982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:45.671482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da21b3-29b6-4987-9ec1-433e97eac700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:45.671777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da21b3-29b6-4987-9ec1-433e97eac700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:45.672073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da21b3-29b6-4987-9ec1-433e97eac700 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:45.672286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da21b3-29b6-4987-9ec1-433e97eac700 admin admin] PATH_INFO: `/v3/users/613aedf1b66d48e4b4cad5e3da6ccbcb` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:45.693862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da21b3-29b6-4987-9ec1-433e97eac700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=613aedf1b66d48e4b4cad5e3da6ccbcb)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:45.693862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da21b3-29b6-4987-9ec1-433e97eac700 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:45.871257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-26da21b3-29b6-4987-9ec1-433e97eac700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '613aedf1b66d48e4b4cad5e3da6ccbcb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:45.872108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-26da21b3-29b6-4987-9ec1-433e97eac700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '613aedf1b66d48e4b4cad5e3da6ccbcb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:45.912543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-26da21b3-29b6-4987-9ec1-433e97eac700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '613aedf1b66d48e4b4cad5e3da6ccbcb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:45.926897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-26da21b3-29b6-4987-9ec1-433e97eac700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '613aedf1b66d48e4b4cad5e3da6ccbcb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:45.927696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-26da21b3-29b6-4987-9ec1-433e97eac700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '613aedf1b66d48e4b4cad5e3da6ccbcb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:46.031489 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1683/3320] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:34:45 2022] DELETE /identity/v3/users/613aedf1b66d48e4b4cad5e3da6ccbcb => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:34:46.368863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba0204-36c4-4abc-85f1-2e0cb244ca0d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:46.370594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5eba0204-36c4-4abc-85f1-2e0cb244ca0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:46.385888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba0204-36c4-4abc-85f1-2e0cb244ca0d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:46.451872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e931ef-3f71-42fd-8e55-035f36ccc902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:46.453229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e931ef-3f71-42fd-8e55-035f36ccc902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:46.453478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e931ef-3f71-42fd-8e55-035f36ccc902 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:46.453800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e931ef-3f71-42fd-8e55-035f36ccc902 admin admin] PATH_INFO: `/v3/projects/ed477088c7b64a7eb8f88cc336b56e32` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:46.455170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e931ef-3f71-42fd-8e55-035f36ccc902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed477088c7b64a7eb8f88cc336b56e32)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:46.457402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e931ef-3f71-42fd-8e55-035f36ccc902 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:46.573098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-46e931ef-3f71-42fd-8e55-035f36ccc902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed477088c7b64a7eb8f88cc336b56e32', 'request_id': 'req-46e931ef-3f71-42fd-8e55-035f36ccc902'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:46.654376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-46e931ef-3f71-42fd-8e55-035f36ccc902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed477088c7b64a7eb8f88cc336b56e32', 'request_id': 'req-46e931ef-3f71-42fd-8e55-035f36ccc902'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:46.668014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-46e931ef-3f71-42fd-8e55-035f36ccc902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed477088c7b64a7eb8f88cc336b56e32', 'request_id': 'req-46e931ef-3f71-42fd-8e55-035f36ccc902'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:46.690406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-46e931ef-3f71-42fd-8e55-035f36ccc902 admin admin] The token cache is being invalidate because project ed477088c7b64a7eb8f88cc336b56e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:34:46.691234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-46e931ef-3f71-42fd-8e55-035f36ccc902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:46.691566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-46e931ef-3f71-42fd-8e55-035f36ccc902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:46.693409 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1638/3321] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:34:46 2022] DELETE /identity/v3/projects/ed477088c7b64a7eb8f88cc336b56e32 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:34:46.700181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fce88d-19e0-4889-a22e-90a0e86b7bb7 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:46.701259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fce88d-19e0-4889-a22e-90a0e86b7bb7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:46.701259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fce88d-19e0-4889-a22e-90a0e86b7bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:46.727600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-20fce88d-19e0-4889-a22e-90a0e86b7bb7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:46.727600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-20fce88d-19e0-4889-a22e-90a0e86b7bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:46.805328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e931ef-3f71-42fd-8e55-035f36ccc902 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:46.807416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-46e931ef-3f71-42fd-8e55-035f36ccc902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:46.814369 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1684/3322] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:46.821862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355437d-ae16-43e8-9852-8bf8d885ef40 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:46.822426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355437d-ae16-43e8-9852-8bf8d885ef40 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:46.824131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355437d-ae16-43e8-9852-8bf8d885ef40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:46.850995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:46.865575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2355437d-ae16-43e8-9852-8bf8d885ef40 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:46.871028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2355437d-ae16-43e8-9852-8bf8d885ef40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:46.894082 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1685/3323] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:46.897034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355437d-ae16-43e8-9852-8bf8d885ef40 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:46.919969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355437d-ae16-43e8-9852-8bf8d885ef40 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:46.935363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eea437-67a3-43e7-aa7b-8c865d2b0619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:46.937796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eea437-67a3-43e7-aa7b-8c865d2b0619 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:46.938113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eea437-67a3-43e7-aa7b-8c865d2b0619 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:46.941249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eea437-67a3-43e7-aa7b-8c865d2b0619 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:46.941965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eea437-67a3-43e7-aa7b-8c865d2b0619 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:34:46.942311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eea437-67a3-43e7-aa7b-8c865d2b0619 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:46.946145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eea437-67a3-43e7-aa7b-8c865d2b0619 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:46.958445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e931ef-3f71-42fd-8e55-035f36ccc902 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:46.967039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2847e13-31d8-4aa3-913d-078b5388b54e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:46.967694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2847e13-31d8-4aa3-913d-078b5388b54e service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:46.968489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2847e13-31d8-4aa3-913d-078b5388b54e service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:46.970397 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1686/3324] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:34:46.971125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2847e13-31d8-4aa3-913d-078b5388b54e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:46.976121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a2847e13-31d8-4aa3-913d-078b5388b54e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:46.977988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eea437-67a3-43e7-aa7b-8c865d2b0619 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:47.002353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eea437-67a3-43e7-aa7b-8c865d2b0619 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:47.018181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cda253-b98b-4e23-a287-b6a0a33c6ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:47.019082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cda253-b98b-4e23-a287-b6a0a33c6ebf admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:47.019364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cda253-b98b-4e23-a287-b6a0a33c6ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:47.019636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cda253-b98b-4e23-a287-b6a0a33c6ebf admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:47.020328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cda253-b98b-4e23-a287-b6a0a33c6ebf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:47.023253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cda253-b98b-4e23-a287-b6a0a33c6ebf admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:47.051059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:47.104337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2847e13-31d8-4aa3-913d-078b5388b54e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:47.105825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2847e13-31d8-4aa3-913d-078b5388b54e service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:47.119726 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1639/3325] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:34:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:34:47.172286 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1687/3326] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:34:46 2022] POST /identity/v3/projects => generated 395 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:34:47.174206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2847e13-31d8-4aa3-913d-078b5388b54e service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:47.200532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2847e13-31d8-4aa3-913d-078b5388b54e service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:47.349329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead51388-4265-46fe-80ae-2fccfa99c780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:47.350689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead51388-4265-46fe-80ae-2fccfa99c780 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:47.351177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead51388-4265-46fe-80ae-2fccfa99c780 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:47.358198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead51388-4265-46fe-80ae-2fccfa99c780 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:47.358198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead51388-4265-46fe-80ae-2fccfa99c780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:47.358198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead51388-4265-46fe-80ae-2fccfa99c780 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:47.454633 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1640/3327] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:34:47 2022] POST /identity/v3/users => generated 298 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:34:47.458828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cda253-b98b-4e23-a287-b6a0a33c6ebf admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:47.471641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cda253-b98b-4e23-a287-b6a0a33c6ebf admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:47.476552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25869e-3a1b-42a1-b7ae-bc6e3791ed52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:47.481976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25869e-3a1b-42a1-b7ae-bc6e3791ed52 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:47.481976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25869e-3a1b-42a1-b7ae-bc6e3791ed52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:47.481976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25869e-3a1b-42a1-b7ae-bc6e3791ed52 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:47.481976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25869e-3a1b-42a1-b7ae-bc6e3791ed52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:47.481976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25869e-3a1b-42a1-b7ae-bc6e3791ed52 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:47.496612 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1688/3328] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:34:47.498330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead51388-4265-46fe-80ae-2fccfa99c780 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:47.509832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead51388-4265-46fe-80ae-2fccfa99c780 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:47.515488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7323095-b42f-4589-bf63-cbf5b8fe0a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:47.516460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7323095-b42f-4589-bf63-cbf5b8fe0a18 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:47.516746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7323095-b42f-4589-bf63-cbf5b8fe0a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:47.517267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7323095-b42f-4589-bf63-cbf5b8fe0a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:47.518519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7323095-b42f-4589-bf63-cbf5b8fe0a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:47.520156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7323095-b42f-4589-bf63-cbf5b8fe0a18 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:47.544704 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1641/3329] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:34:47.547355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25869e-3a1b-42a1-b7ae-bc6e3791ed52 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:47.568531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25869e-3a1b-42a1-b7ae-bc6e3791ed52 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:47.596895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069f4b3-a1ce-4a7b-a576-0b4320e7e2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:47.598349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069f4b3-a1ce-4a7b-a576-0b4320e7e2fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:47.598658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069f4b3-a1ce-4a7b-a576-0b4320e7e2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:47.599046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069f4b3-a1ce-4a7b-a576-0b4320e7e2fe admin admin] PATH_INFO: `/v3/projects/876747742e6a4efea6b788a8e8cf800c/users/dd22f08cc08e4e1283dd2e3ffc9190f2/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:47.625501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069f4b3-a1ce-4a7b-a576-0b4320e7e2fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=876747742e6a4efea6b788a8e8cf800c, user_id=dd22f08cc08e4e1283dd2e3ffc9190f2, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:47.632653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069f4b3-a1ce-4a7b-a576-0b4320e7e2fe admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:47.731836 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1689/3330] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:34:47 2022] PUT /identity/v3/projects/876747742e6a4efea6b788a8e8cf800c/users/dd22f08cc08e4e1283dd2e3ffc9190f2/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:34:47.744071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f98ef9-3271-42b3-b40f-ff3b58434e24 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:47.744368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f98ef9-3271-42b3-b40f-ff3b58434e24 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:47.744652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f98ef9-3271-42b3-b40f-ff3b58434e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:47.780598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-90f98ef9-3271-42b3-b40f-ff3b58434e24 None None] MFA Rules not processed for user `dd22f08cc08e4e1283dd2e3ffc9190f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:47.782413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-90f98ef9-3271-42b3-b40f-ff3b58434e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:47.834370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:47.893108 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1642/3331] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:34:47 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:48.226136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069f4b3-a1ce-4a7b-a576-0b4320e7e2fe admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:48.228343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e069f4b3-a1ce-4a7b-a576-0b4320e7e2fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:48.338343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069f4b3-a1ce-4a7b-a576-0b4320e7e2fe admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:48.345450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042cffd-cf16-4874-b239-c1805b365027 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:48.346454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042cffd-cf16-4874-b239-c1805b365027 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:48.346966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042cffd-cf16-4874-b239-c1805b365027 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:48.347454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042cffd-cf16-4874-b239-c1805b365027 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:48.357480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042cffd-cf16-4874-b239-c1805b365027 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:48.359557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042cffd-cf16-4874-b239-c1805b365027 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:48.375067 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1690/3332] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:34:48 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:34:48.876037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f98ef9-3271-42b3-b40f-ff3b58434e24 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:48.948843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f98ef9-3271-42b3-b40f-ff3b58434e24 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:48.954549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da511415-7318-48c6-a80c-629c4cd3ab3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:48.955412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da511415-7318-48c6-a80c-629c4cd3ab3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:48.955930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da511415-7318-48c6-a80c-629c4cd3ab3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:48.956339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da511415-7318-48c6-a80c-629c4cd3ab3a admin admin] PATH_INFO: `/v3/users/dd22f08cc08e4e1283dd2e3ffc9190f2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:48.957585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da511415-7318-48c6-a80c-629c4cd3ab3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd22f08cc08e4e1283dd2e3ffc9190f2)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:48.959697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da511415-7318-48c6-a80c-629c4cd3ab3a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:49.158325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-da511415-7318-48c6-a80c-629c4cd3ab3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd22f08cc08e4e1283dd2e3ffc9190f2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:49.159787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-da511415-7318-48c6-a80c-629c4cd3ab3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd22f08cc08e4e1283dd2e3ffc9190f2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:49.169612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-da511415-7318-48c6-a80c-629c4cd3ab3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd22f08cc08e4e1283dd2e3ffc9190f2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:49.202661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-da511415-7318-48c6-a80c-629c4cd3ab3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd22f08cc08e4e1283dd2e3ffc9190f2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:49.317396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-da511415-7318-48c6-a80c-629c4cd3ab3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd22f08cc08e4e1283dd2e3ffc9190f2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:49.327673 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1643/3333] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:34:48 2022] DELETE /identity/v3/users/dd22f08cc08e4e1283dd2e3ffc9190f2 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:34:49.329601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d1131-5245-4f38-b551-4e45eafd2eae None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:49.329601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d1131-5245-4f38-b551-4e45eafd2eae None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:49.330225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d1131-5245-4f38-b551-4e45eafd2eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:49.350635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e93d1131-5245-4f38-b551-4e45eafd2eae None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:49.352028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e93d1131-5245-4f38-b551-4e45eafd2eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:49.437629 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1691/3334] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:49.450378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da511415-7318-48c6-a80c-629c4cd3ab3a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:49.452369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-da511415-7318-48c6-a80c-629c4cd3ab3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:49.559054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:49.574465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da511415-7318-48c6-a80c-629c4cd3ab3a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:49.588233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f0dee-e1e6-40b7-9d67-40c003f27876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:49.589097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f0dee-e1e6-40b7-9d67-40c003f27876 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:49.589422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f0dee-e1e6-40b7-9d67-40c003f27876 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:49.591379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f0dee-e1e6-40b7-9d67-40c003f27876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:49.613835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f0dee-e1e6-40b7-9d67-40c003f27876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:49.615587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f0dee-e1e6-40b7-9d67-40c003f27876 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:49.630143 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1644/3335] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:34:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:34:51.039941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d1131-5245-4f38-b551-4e45eafd2eae None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:51.041987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e93d1131-5245-4f38-b551-4e45eafd2eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:51.063226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d1131-5245-4f38-b551-4e45eafd2eae None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:51.073375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3a4a3-f99a-425c-a6ae-d1dea166044f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:51.073375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3a4a3-f99a-425c-a6ae-d1dea166044f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:51.073375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3a4a3-f99a-425c-a6ae-d1dea166044f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:51.073375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3a4a3-f99a-425c-a6ae-d1dea166044f admin admin] PATH_INFO: `/v3/projects/876747742e6a4efea6b788a8e8cf800c` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:51.073889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3a4a3-f99a-425c-a6ae-d1dea166044f admin admin] RBAC: Authorizing `identity:delete_project(project_id=876747742e6a4efea6b788a8e8cf800c)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:51.078113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3a4a3-f99a-425c-a6ae-d1dea166044f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:51.261627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:51.272014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a4d3a4a3-f99a-425c-a6ae-d1dea166044f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '876747742e6a4efea6b788a8e8cf800c', 'request_id': 'req-a4d3a4a3-f99a-425c-a6ae-d1dea166044f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:51.298428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a4d3a4a3-f99a-425c-a6ae-d1dea166044f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '876747742e6a4efea6b788a8e8cf800c', 'request_id': 'req-a4d3a4a3-f99a-425c-a6ae-d1dea166044f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:51.339360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a4d3a4a3-f99a-425c-a6ae-d1dea166044f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '876747742e6a4efea6b788a8e8cf800c', 'request_id': 'req-a4d3a4a3-f99a-425c-a6ae-d1dea166044f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:51.438109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a4d3a4a3-f99a-425c-a6ae-d1dea166044f admin admin] The token cache is being invalidate because project 876747742e6a4efea6b788a8e8cf800c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:34:51.438418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a4d3a4a3-f99a-425c-a6ae-d1dea166044f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:51.442459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a4d3a4a3-f99a-425c-a6ae-d1dea166044f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:34:51.451928 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1692/3336] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:34:51 2022] DELETE /identity/v3/projects/876747742e6a4efea6b788a8e8cf800c => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:34:51.455334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7c61f-35c5-4645-8018-78244f049f83 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:51.456852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7c61f-35c5-4645-8018-78244f049f83 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:51.456852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7c61f-35c5-4645-8018-78244f049f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:51.508293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-06d7c61f-35c5-4645-8018-78244f049f83 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:51.512384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-06d7c61f-35c5-4645-8018-78244f049f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:51.594419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46750707-9a8f-4a6a-adea-f4e8d86d9f0d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:51.594817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46750707-9a8f-4a6a-adea-f4e8d86d9f0d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:51.595204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46750707-9a8f-4a6a-adea-f4e8d86d9f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:51.629387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-46750707-9a8f-4a6a-adea-f4e8d86d9f0d None None] MFA Rules not processed for user `881f054c84d04ceaa17a5817816022d4`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:51.631203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-46750707-9a8f-4a6a-adea-f4e8d86d9f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:51.799142 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1645/3337] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:51.802635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86680c08-ddec-4e8a-b5b2-007619b5fec5 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:51.802960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86680c08-ddec-4e8a-b5b2-007619b5fec5 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:51.803231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86680c08-ddec-4e8a-b5b2-007619b5fec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:51.846498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-86680c08-ddec-4e8a-b5b2-007619b5fec5 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:51.853833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-86680c08-ddec-4e8a-b5b2-007619b5fec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:51.870452 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1646/3338] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:51.870452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86680c08-ddec-4e8a-b5b2-007619b5fec5 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:51.879327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86680c08-ddec-4e8a-b5b2-007619b5fec5 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:51.885402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470c2ed-0a8c-4e47-afbe-31ffdf8d5f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:51.886262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470c2ed-0a8c-4e47-afbe-31ffdf8d5f20 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:51.888151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470c2ed-0a8c-4e47-afbe-31ffdf8d5f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:51.888436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470c2ed-0a8c-4e47-afbe-31ffdf8d5f20 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:51.889351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470c2ed-0a8c-4e47-afbe-31ffdf8d5f20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:34:51.889660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470c2ed-0a8c-4e47-afbe-31ffdf8d5f20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:51.892363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470c2ed-0a8c-4e47-afbe-31ffdf8d5f20 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:51.899646 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1693/3339] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:34:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:51.928830 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1647/3340] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:34:51.929189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46750707-9a8f-4a6a-adea-f4e8d86d9f0d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:51.947690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46750707-9a8f-4a6a-adea-f4e8d86d9f0d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:51.961023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518a595-5b54-4cd3-8261-0b23a8eed173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:51.961737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518a595-5b54-4cd3-8261-0b23a8eed173 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:51.962305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518a595-5b54-4cd3-8261-0b23a8eed173 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:51.962713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518a595-5b54-4cd3-8261-0b23a8eed173 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:51.965523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518a595-5b54-4cd3-8261-0b23a8eed173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:51.971679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518a595-5b54-4cd3-8261-0b23a8eed173 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:52.126522 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1694/3341] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:34:51 2022] POST /identity/v3/projects => generated 397 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:34:52.128838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470c2ed-0a8c-4e47-afbe-31ffdf8d5f20 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:52.141470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470c2ed-0a8c-4e47-afbe-31ffdf8d5f20 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:52.276072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed92d0-06eb-46e1-910a-296c87d6e999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:52.277260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed92d0-06eb-46e1-910a-296c87d6e999 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:52.277747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed92d0-06eb-46e1-910a-296c87d6e999 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:52.278319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed92d0-06eb-46e1-910a-296c87d6e999 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:52.280041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed92d0-06eb-46e1-910a-296c87d6e999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:52.283679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed92d0-06eb-46e1-910a-296c87d6e999 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:52.416432 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1648/3342] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:34:52 2022] POST /identity/v3/users => generated 299 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:34:52.418873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518a595-5b54-4cd3-8261-0b23a8eed173 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:52.438528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518a595-5b54-4cd3-8261-0b23a8eed173 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:52.445110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2f39f-ccb0-4e6e-9183-9b19c83bccb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:52.447553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2f39f-ccb0-4e6e-9183-9b19c83bccb1 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:52.449033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2f39f-ccb0-4e6e-9183-9b19c83bccb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:52.449389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2f39f-ccb0-4e6e-9183-9b19c83bccb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:52.451497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2f39f-ccb0-4e6e-9183-9b19c83bccb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:52.460694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2f39f-ccb0-4e6e-9183-9b19c83bccb1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:52.486153 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1695/3343] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:34:52.487786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed92d0-06eb-46e1-910a-296c87d6e999 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:52.509100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed92d0-06eb-46e1-910a-296c87d6e999 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:52.560184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0059e-3ce7-4904-a9b5-dbd1ecbe028d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:52.560475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0059e-3ce7-4904-a9b5-dbd1ecbe028d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:52.562071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0059e-3ce7-4904-a9b5-dbd1ecbe028d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:52.584483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6861fb-f754-4952-918a-f1dbca825107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:52.588134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6861fb-f754-4952-918a-f1dbca825107 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:52.588630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6861fb-f754-4952-918a-f1dbca825107 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:52.589089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6861fb-f754-4952-918a-f1dbca825107 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:52.592053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6861fb-f754-4952-918a-f1dbca825107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:52.599025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6861fb-f754-4952-918a-f1dbca825107 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:52.661018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-cea0059e-3ce7-4904-a9b5-dbd1ecbe028d None None] MFA Rules not processed for user `f9c32b7626594ff888970c7f3227bb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:52.668726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cea0059e-3ce7-4904-a9b5-dbd1ecbe028d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:52.675765 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1649/3344] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:34:52.676078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bebb01-1289-4722-85bf-af592e69a0c7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:52.685387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bebb01-1289-4722-85bf-af592e69a0c7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:52.685387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bebb01-1289-4722-85bf-af592e69a0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:52.784333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-02bebb01-1289-4722-85bf-af592e69a0c7 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:52.788153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-02bebb01-1289-4722-85bf-af592e69a0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:52.852018 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1696/3345] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:34:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:52.852018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0059e-3ce7-4904-a9b5-dbd1ecbe028d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:52.910440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0059e-3ce7-4904-a9b5-dbd1ecbe028d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:52.939822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea4206-ca00-4085-82f2-2b46fbda97bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:52.940521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea4206-ca00-4085-82f2-2b46fbda97bf admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:52.940805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea4206-ca00-4085-82f2-2b46fbda97bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:52.941082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea4206-ca00-4085-82f2-2b46fbda97bf admin admin] PATH_INFO: `/v3/projects/2e58f30136ed4a4d9bff48e9b4cde5a8/users/5c36bef85ac34b4983a79e03c56965c5/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:52.944147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:52.976278 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1650/3346] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:34:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:52.991617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea4206-ca00-4085-82f2-2b46fbda97bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e58f30136ed4a4d9bff48e9b4cde5a8, user_id=5c36bef85ac34b4983a79e03c56965c5, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:52.996434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bebb01-1289-4722-85bf-af592e69a0c7 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:52.996434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-02bebb01-1289-4722-85bf-af592e69a0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:52.998966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea4206-ca00-4085-82f2-2b46fbda97bf admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:53.096917 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1697/3347] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:34:52 2022] PUT /identity/v3/projects/2e58f30136ed4a4d9bff48e9b4cde5a8/users/5c36bef85ac34b4983a79e03c56965c5/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:34:53.102506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bfecc-36ed-46ce-910c-d31b06f557c7 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:53.102801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bfecc-36ed-46ce-910c-d31b06f557c7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:53.103085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bfecc-36ed-46ce-910c-d31b06f557c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:53.156941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7b1bfecc-36ed-46ce-910c-d31b06f557c7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:34:53.159205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7b1bfecc-36ed-46ce-910c-d31b06f557c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:53.185164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bebb01-1289-4722-85bf-af592e69a0c7 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:53.294622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:53.312554 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1698/3348] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:34:53.334893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bfecc-36ed-46ce-910c-d31b06f557c7 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:34:53.337878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7b1bfecc-36ed-46ce-910c-d31b06f557c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:34:53.360302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81692d-7c53-4e8b-93ef-536d33580b53 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:53.361200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81692d-7c53-4e8b-93ef-536d33580b53 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:53.361643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81692d-7c53-4e8b-93ef-536d33580b53 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:53.362218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81692d-7c53-4e8b-93ef-536d33580b53 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:53.461869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bfecc-36ed-46ce-910c-d31b06f557c7 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:34:53.464739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81692d-7c53-4e8b-93ef-536d33580b53 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:53.466448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81692d-7c53-4e8b-93ef-536d33580b53 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:53.467620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942dc8bb-b980-41e1-9f7d-d1db57e74817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:34:53.468704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dc8bb-b980-41e1-9f7d-d1db57e74817 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:34:53.469250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dc8bb-b980-41e1-9f7d-d1db57e74817 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:34:53.469717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dc8bb-b980-41e1-9f7d-d1db57e74817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:34:53.487431 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1651/3349] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:34:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 03:34:53.501463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942dc8bb-b980-41e1-9f7d-d1db57e74817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:34:53.506264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942dc8bb-b980-41e1-9f7d-d1db57e74817 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:34:53.535761 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1699/3350] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:35:03.297414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81692d-7c53-4e8b-93ef-536d33580b53 service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:03.300457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4a81692d-7c53-4e8b-93ef-536d33580b53 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:03.355242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81692d-7c53-4e8b-93ef-536d33580b53 service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:03.380604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f7743-3291-4796-ae23-b8c70f2c2c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:03.381284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f7743-3291-4796-ae23-b8c70f2c2c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:03.381571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f7743-3291-4796-ae23-b8c70f2c2c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:03.381856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f7743-3291-4796-ae23-b8c70f2c2c0e admin admin] PATH_INFO: `/v3/users/bab3c739ff0749488193af39cb7ced21` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:03.392296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f7743-3291-4796-ae23-b8c70f2c2c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bab3c739ff0749488193af39cb7ced21)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:03.398919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f7743-3291-4796-ae23-b8c70f2c2c0e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:03.683831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:03.737258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2a6f7743-3291-4796-ae23-b8c70f2c2c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bab3c739ff0749488193af39cb7ced21'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:03.739083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2a6f7743-3291-4796-ae23-b8c70f2c2c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bab3c739ff0749488193af39cb7ced21'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:03.761511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2a6f7743-3291-4796-ae23-b8c70f2c2c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bab3c739ff0749488193af39cb7ced21'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:03.796269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2a6f7743-3291-4796-ae23-b8c70f2c2c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bab3c739ff0749488193af39cb7ced21'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:03.941578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2a6f7743-3291-4796-ae23-b8c70f2c2c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bab3c739ff0749488193af39cb7ced21'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:03.973367 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1652/3351] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:35:03 2022] DELETE /identity/v3/users/bab3c739ff0749488193af39cb7ced21 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:35:04.165881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=43 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:05.688141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942dc8bb-b980-41e1-9f7d-d1db57e74817 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:05.711721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942dc8bb-b980-41e1-9f7d-d1db57e74817 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:05.932892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0555232-9995-4469-a609-a9625e2c4465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:05.933567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0555232-9995-4469-a609-a9625e2c4465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:05.933858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0555232-9995-4469-a609-a9625e2c4465 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:05.934162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0555232-9995-4469-a609-a9625e2c4465 admin admin] PATH_INFO: `/v3/projects/1073b41a231e4e68be36732b22fcc154` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:05.937261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0555232-9995-4469-a609-a9625e2c4465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1073b41a231e4e68be36732b22fcc154)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:05.948613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0555232-9995-4469-a609-a9625e2c4465 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:06.203821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a0555232-9995-4469-a609-a9625e2c4465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1073b41a231e4e68be36732b22fcc154', 'request_id': 'req-a0555232-9995-4469-a609-a9625e2c4465'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:06.225619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a0555232-9995-4469-a609-a9625e2c4465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1073b41a231e4e68be36732b22fcc154', 'request_id': 'req-a0555232-9995-4469-a609-a9625e2c4465'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:06.247980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a0555232-9995-4469-a609-a9625e2c4465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1073b41a231e4e68be36732b22fcc154', 'request_id': 'req-a0555232-9995-4469-a609-a9625e2c4465'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:06.341643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a0555232-9995-4469-a609-a9625e2c4465 admin admin] The token cache is being invalidate because project 1073b41a231e4e68be36732b22fcc154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:35:06.342257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a0555232-9995-4469-a609-a9625e2c4465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:06.343744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a0555232-9995-4469-a609-a9625e2c4465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:06.347242 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1700/3352] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:05 2022] DELETE /identity/v3/projects/1073b41a231e4e68be36732b22fcc154 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:35:06.358334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7632a-1142-461c-bb1c-8ecdeb621b75 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:06.358926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7632a-1142-461c-bb1c-8ecdeb621b75 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:06.358926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7632a-1142-461c-bb1c-8ecdeb621b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:06.416322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-bdc7632a-1142-461c-bb1c-8ecdeb621b75 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:06.424929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bdc7632a-1142-461c-bb1c-8ecdeb621b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:06.764776 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1653/3353] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:35:06.772003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6fa37-4b41-46b5-b4e2-f35f808c75e8 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:06.772551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6fa37-4b41-46b5-b4e2-f35f808c75e8 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:06.772650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6fa37-4b41-46b5-b4e2-f35f808c75e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:06.861037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7fa6fa37-4b41-46b5-b4e2-f35f808c75e8 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:06.861037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7fa6fa37-4b41-46b5-b4e2-f35f808c75e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:06.927201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7632a-1142-461c-bb1c-8ecdeb621b75 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:06.940673 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1701/3354] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:35:06.945281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7632a-1142-461c-bb1c-8ecdeb621b75 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:06.969327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae4b88-baa7-4de3-8cce-1708946164a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:06.972881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae4b88-baa7-4de3-8cce-1708946164a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:06.973190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae4b88-baa7-4de3-8cce-1708946164a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:06.973551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae4b88-baa7-4de3-8cce-1708946164a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:06.981778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae4b88-baa7-4de3-8cce-1708946164a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:35:06.982889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae4b88-baa7-4de3-8cce-1708946164a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:06.993659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae4b88-baa7-4de3-8cce-1708946164a8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:07.050194 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1654/3355] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:35:07.055506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6fa37-4b41-46b5-b4e2-f35f808c75e8 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:07.078183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6fa37-4b41-46b5-b4e2-f35f808c75e8 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:07.104406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862973e8-3f85-4427-933b-24cc2a1e406b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:07.107559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862973e8-3f85-4427-933b-24cc2a1e406b admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:07.110167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862973e8-3f85-4427-933b-24cc2a1e406b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:07.112821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862973e8-3f85-4427-933b-24cc2a1e406b admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:07.114478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862973e8-3f85-4427-933b-24cc2a1e406b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:07.125838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862973e8-3f85-4427-933b-24cc2a1e406b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:07.378086 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1702/3356] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:35:07 2022] POST /identity/v3/projects => generated 361 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:35:07.382351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae4b88-baa7-4de3-8cce-1708946164a8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:07.400059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae4b88-baa7-4de3-8cce-1708946164a8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:07.551603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e998a-bcec-471f-879e-0925b0364e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:07.552337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e998a-bcec-471f-879e-0925b0364e85 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:07.552690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e998a-bcec-471f-879e-0925b0364e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:07.553639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e998a-bcec-471f-879e-0925b0364e85 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:07.554478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e998a-bcec-471f-879e-0925b0364e85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:07.557592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e998a-bcec-471f-879e-0925b0364e85 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:07.649788 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1655/3357] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:35:07 2022] POST /identity/v3/users => generated 281 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:35:07.653508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862973e8-3f85-4427-933b-24cc2a1e406b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:07.671752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862973e8-3f85-4427-933b-24cc2a1e406b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:07.688445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b2f7f-ed1f-47d5-bb07-9684b7f32242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:07.689417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b2f7f-ed1f-47d5-bb07-9684b7f32242 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:07.689919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b2f7f-ed1f-47d5-bb07-9684b7f32242 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:07.690415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b2f7f-ed1f-47d5-bb07-9684b7f32242 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:07.691268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b2f7f-ed1f-47d5-bb07-9684b7f32242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:07.693116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b2f7f-ed1f-47d5-bb07-9684b7f32242 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:07.712501 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1703/3358] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:35:07.717495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e998a-bcec-471f-879e-0925b0364e85 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:07.733639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e998a-bcec-471f-879e-0925b0364e85 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:07.766487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2339ae9-779f-4fe7-a365-55ffc2dd2295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:07.767256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2339ae9-779f-4fe7-a365-55ffc2dd2295 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:07.767614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2339ae9-779f-4fe7-a365-55ffc2dd2295 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:07.767935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2339ae9-779f-4fe7-a365-55ffc2dd2295 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:07.768619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2339ae9-779f-4fe7-a365-55ffc2dd2295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:07.771089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2339ae9-779f-4fe7-a365-55ffc2dd2295 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:07.787007 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1656/3359] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:35:07.792803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b2f7f-ed1f-47d5-bb07-9684b7f32242 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:07.804554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b2f7f-ed1f-47d5-bb07-9684b7f32242 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:07.821099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a585270-c42a-4c98-b42b-bc35e7a24598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:07.822195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a585270-c42a-4c98-b42b-bc35e7a24598 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:07.822689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a585270-c42a-4c98-b42b-bc35e7a24598 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:07.823192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a585270-c42a-4c98-b42b-bc35e7a24598 admin admin] PATH_INFO: `/v3/projects/89b582f7c57f4b2bbb2a4a2ea013f4de/users/52be5f02ec9040bc93c165bbbbfbcfb2/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:07.857061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a585270-c42a-4c98-b42b-bc35e7a24598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b582f7c57f4b2bbb2a4a2ea013f4de, user_id=52be5f02ec9040bc93c165bbbbfbcfb2, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:07.860395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a585270-c42a-4c98-b42b-bc35e7a24598 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:07.952408 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1704/3360] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:35:07 2022] PUT /identity/v3/projects/89b582f7c57f4b2bbb2a4a2ea013f4de/users/52be5f02ec9040bc93c165bbbbfbcfb2/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:35:07.965443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b4a89-2cda-48ac-b955-e5ed14e31304 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:07.965646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b4a89-2cda-48ac-b955-e5ed14e31304 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:07.966175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b4a89-2cda-48ac-b955-e5ed14e31304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:08.072561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-574b4a89-2cda-48ac-b955-e5ed14e31304 None None] MFA Rules not processed for user `52be5f02ec9040bc93c165bbbbfbcfb2`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:08.078162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-574b4a89-2cda-48ac-b955-e5ed14e31304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:08.111995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:08.366372 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1657/3361] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:35:09.475690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a585270-c42a-4c98-b42b-bc35e7a24598 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:09.477619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7a585270-c42a-4c98-b42b-bc35e7a24598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:09.569134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:09.723843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a585270-c42a-4c98-b42b-bc35e7a24598 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:09.754654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a85ef-12ee-408d-8e31-bacd4c302e87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:09.755302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a85ef-12ee-408d-8e31-bacd4c302e87 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:09.755588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a85ef-12ee-408d-8e31-bacd4c302e87 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:09.758728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a85ef-12ee-408d-8e31-bacd4c302e87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:09.791350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a85ef-12ee-408d-8e31-bacd4c302e87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:09.793607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a85ef-12ee-408d-8e31-bacd4c302e87 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:09.828535 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1705/3362] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:35:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:35:09.957355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b4a89-2cda-48ac-b955-e5ed14e31304 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:10.252473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b4a89-2cda-48ac-b955-e5ed14e31304 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:10.272273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f966a80-6b7f-43ae-baae-862ce2958329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:10.272948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f966a80-6b7f-43ae-baae-862ce2958329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:10.273232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f966a80-6b7f-43ae-baae-862ce2958329 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:10.273623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f966a80-6b7f-43ae-baae-862ce2958329 admin admin] PATH_INFO: `/v3/users/52be5f02ec9040bc93c165bbbbfbcfb2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:10.284318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f966a80-6b7f-43ae-baae-862ce2958329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52be5f02ec9040bc93c165bbbbfbcfb2)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:10.295150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f966a80-6b7f-43ae-baae-862ce2958329 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:10.608293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0f966a80-6b7f-43ae-baae-862ce2958329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52be5f02ec9040bc93c165bbbbfbcfb2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:10.617508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0f966a80-6b7f-43ae-baae-862ce2958329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52be5f02ec9040bc93c165bbbbfbcfb2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:10.681753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0f966a80-6b7f-43ae-baae-862ce2958329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52be5f02ec9040bc93c165bbbbfbcfb2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:10.776948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0f966a80-6b7f-43ae-baae-862ce2958329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52be5f02ec9040bc93c165bbbbfbcfb2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:10.876670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0f966a80-6b7f-43ae-baae-862ce2958329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52be5f02ec9040bc93c165bbbbfbcfb2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:10.885812 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1658/3363] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:35:09 2022] DELETE /identity/v3/users/52be5f02ec9040bc93c165bbbbfbcfb2 => generated 0 bytes in 930 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:35:10.892045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e1d12-1f49-45c5-b31a-4bc1c20a09ac None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:10.892635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e1d12-1f49-45c5-b31a-4bc1c20a09ac None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:10.892905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e1d12-1f49-45c5-b31a-4bc1c20a09ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:10.995933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-920e1d12-1f49-45c5-b31a-4bc1c20a09ac None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:11.004193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-920e1d12-1f49-45c5-b31a-4bc1c20a09ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:11.406067 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1706/3364] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 512 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:35:11.511554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f966a80-6b7f-43ae-baae-862ce2958329 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:11.512140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0f966a80-6b7f-43ae-baae-862ce2958329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:11.623099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:11.681435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f966a80-6b7f-43ae-baae-862ce2958329 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:11.692640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b2abd-2256-4bca-862d-f838fe042075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:11.693530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b2abd-2256-4bca-862d-f838fe042075 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:11.693865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b2abd-2256-4bca-862d-f838fe042075 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:11.694475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b2abd-2256-4bca-862d-f838fe042075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:11.715573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b2abd-2256-4bca-862d-f838fe042075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:11.717048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b2abd-2256-4bca-862d-f838fe042075 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:11.755979 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1659/3365] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:35:13.481721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e1d12-1f49-45c5-b31a-4bc1c20a09ac None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:13.483842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-920e1d12-1f49-45c5-b31a-4bc1c20a09ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:13.514943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e1d12-1f49-45c5-b31a-4bc1c20a09ac None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:13.538224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51285c46-fee2-4442-9052-39d11e7edded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:13.539541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51285c46-fee2-4442-9052-39d11e7edded admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:13.540053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51285c46-fee2-4442-9052-39d11e7edded admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:13.540546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51285c46-fee2-4442-9052-39d11e7edded admin admin] PATH_INFO: `/v3/projects/89b582f7c57f4b2bbb2a4a2ea013f4de` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:13.547147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51285c46-fee2-4442-9052-39d11e7edded admin admin] RBAC: Authorizing `identity:delete_project(project_id=89b582f7c57f4b2bbb2a4a2ea013f4de)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:13.549413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51285c46-fee2-4442-9052-39d11e7edded admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:13.748364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-51285c46-fee2-4442-9052-39d11e7edded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89b582f7c57f4b2bbb2a4a2ea013f4de', 'request_id': 'req-51285c46-fee2-4442-9052-39d11e7edded'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:13.762997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-51285c46-fee2-4442-9052-39d11e7edded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89b582f7c57f4b2bbb2a4a2ea013f4de', 'request_id': 'req-51285c46-fee2-4442-9052-39d11e7edded'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:13.782596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-51285c46-fee2-4442-9052-39d11e7edded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89b582f7c57f4b2bbb2a4a2ea013f4de', 'request_id': 'req-51285c46-fee2-4442-9052-39d11e7edded'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:13.863553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-51285c46-fee2-4442-9052-39d11e7edded admin admin] The token cache is being invalidate because project 89b582f7c57f4b2bbb2a4a2ea013f4de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:35:13.863940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-51285c46-fee2-4442-9052-39d11e7edded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:13.864634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-51285c46-fee2-4442-9052-39d11e7edded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:13.870775 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1707/3366] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:13 2022] DELETE /identity/v3/projects/89b582f7c57f4b2bbb2a4a2ea013f4de => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:35:13.871943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cd947-a724-4ced-b016-347d1c2be862 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:13.872799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cd947-a724-4ced-b016-347d1c2be862 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:13.873302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cd947-a724-4ced-b016-347d1c2be862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:13.926334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9a3cd947-a724-4ced-b016-347d1c2be862 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:13.927925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9a3cd947-a724-4ced-b016-347d1c2be862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:14.132027 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1660/3367] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:35:14.133472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967a3a9-80c1-4314-bff7-134106a8c32a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:14.134011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967a3a9-80c1-4314-bff7-134106a8c32a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:14.134563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967a3a9-80c1-4314-bff7-134106a8c32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:14.179103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a967a3a9-80c1-4314-bff7-134106a8c32a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:14.180745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a967a3a9-80c1-4314-bff7-134106a8c32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:14.206569 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1708/3368] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:35:14.212539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cd947-a724-4ced-b016-347d1c2be862 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:14.229557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cd947-a724-4ced-b016-347d1c2be862 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:14.244338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ec6df-60e7-40f1-8513-c7248b3de482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:14.245169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ec6df-60e7-40f1-8513-c7248b3de482 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:14.245614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ec6df-60e7-40f1-8513-c7248b3de482 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:14.246067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ec6df-60e7-40f1-8513-c7248b3de482 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:14.246938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ec6df-60e7-40f1-8513-c7248b3de482 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:35:14.247454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ec6df-60e7-40f1-8513-c7248b3de482 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:14.249448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ec6df-60e7-40f1-8513-c7248b3de482 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:14.302293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967a3a9-80c1-4314-bff7-134106a8c32a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:14.302486 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1661/3369] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:35:14.327831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967a3a9-80c1-4314-bff7-134106a8c32a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:14.339071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e4d34-84ad-4bad-9809-d228a1a03493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:14.339973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e4d34-84ad-4bad-9809-d228a1a03493 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:14.341997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e4d34-84ad-4bad-9809-d228a1a03493 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:14.342527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e4d34-84ad-4bad-9809-d228a1a03493 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:14.344004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e4d34-84ad-4bad-9809-d228a1a03493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:14.350770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e4d34-84ad-4bad-9809-d228a1a03493 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:14.532000 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1709/3370] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:35:14 2022] POST /identity/v3/projects => generated 383 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:35:14.537266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ec6df-60e7-40f1-8513-c7248b3de482 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:14.552982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ec6df-60e7-40f1-8513-c7248b3de482 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:14.709580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ccaa3-80c2-49da-8224-fb8596f33e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:14.710254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ccaa3-80c2-49da-8224-fb8596f33e69 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:14.710546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ccaa3-80c2-49da-8224-fb8596f33e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:14.710845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ccaa3-80c2-49da-8224-fb8596f33e69 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:14.711488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ccaa3-80c2-49da-8224-fb8596f33e69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:14.713501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ccaa3-80c2-49da-8224-fb8596f33e69 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:14.899919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e4d34-84ad-4bad-9809-d228a1a03493 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:14.904197 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1662/3371] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:35:14 2022] POST /identity/v3/users => generated 292 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:35:14.924919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e4d34-84ad-4bad-9809-d228a1a03493 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:14.958821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66693ec-278a-4fbf-abab-e36694fd2848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:14.959823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66693ec-278a-4fbf-abab-e36694fd2848 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:14.960282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66693ec-278a-4fbf-abab-e36694fd2848 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:14.960715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66693ec-278a-4fbf-abab-e36694fd2848 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:14.961539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66693ec-278a-4fbf-abab-e36694fd2848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:14.963424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66693ec-278a-4fbf-abab-e36694fd2848 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:14.965165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:14.993526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ccaa3-80c2-49da-8224-fb8596f33e69 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:14.995105 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1710/3372] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:35:15.058349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ccaa3-80c2-49da-8224-fb8596f33e69 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:15.058349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042854b7-0c2c-4fb8-957e-b6f867d74c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:15.058349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042854b7-0c2c-4fb8-957e-b6f867d74c19 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:15.058349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042854b7-0c2c-4fb8-957e-b6f867d74c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:15.058725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042854b7-0c2c-4fb8-957e-b6f867d74c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:15.058725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042854b7-0c2c-4fb8-957e-b6f867d74c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:15.058725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042854b7-0c2c-4fb8-957e-b6f867d74c19 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:15.059010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66693ec-278a-4fbf-abab-e36694fd2848 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:15.059129 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1663/3373] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:35:15.068168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66693ec-278a-4fbf-abab-e36694fd2848 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:15.082254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d85fbb-3d59-4b5e-aed5-ec87aafa2656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:15.083251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d85fbb-3d59-4b5e-aed5-ec87aafa2656 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:15.083735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d85fbb-3d59-4b5e-aed5-ec87aafa2656 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:15.084179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d85fbb-3d59-4b5e-aed5-ec87aafa2656 admin admin] PATH_INFO: `/v3/projects/e3a1ba64cf9c47d5bdae52477338099e/users/8d5d3f1bf1af4cd6884297b207597fcc/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:15.125594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d85fbb-3d59-4b5e-aed5-ec87aafa2656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a1ba64cf9c47d5bdae52477338099e, user_id=8d5d3f1bf1af4cd6884297b207597fcc, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:15.136490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d85fbb-3d59-4b5e-aed5-ec87aafa2656 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:15.398342 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1711/3374] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:35:15 2022] PUT /identity/v3/projects/e3a1ba64cf9c47d5bdae52477338099e/users/8d5d3f1bf1af4cd6884297b207597fcc/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:35:15.405041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb1ec7-8cc0-4ce7-883e-a1c230d9e8cb None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:15.405413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb1ec7-8cc0-4ce7-883e-a1c230d9e8cb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:15.405645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb1ec7-8cc0-4ce7-883e-a1c230d9e8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:15.456353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-51bb1ec7-8cc0-4ce7-883e-a1c230d9e8cb None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:15.459970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-51bb1ec7-8cc0-4ce7-883e-a1c230d9e8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:15.546799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:15.658546 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1664/3375] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:35:15.757498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d85fbb-3d59-4b5e-aed5-ec87aafa2656 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:15.759975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e2d85fbb-3d59-4b5e-aed5-ec87aafa2656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:16.001198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d85fbb-3d59-4b5e-aed5-ec87aafa2656 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:16.012689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e7e9f-c6bc-4aa7-a5aa-28d0f6243c88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:16.015516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e7e9f-c6bc-4aa7-a5aa-28d0f6243c88 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:16.015791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e7e9f-c6bc-4aa7-a5aa-28d0f6243c88 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:16.016972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e7e9f-c6bc-4aa7-a5aa-28d0f6243c88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:16.043277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e7e9f-c6bc-4aa7-a5aa-28d0f6243c88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:16.046814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e7e9f-c6bc-4aa7-a5aa-28d0f6243c88 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:16.060872 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1712/3376] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:35:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:35:17.382344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb1ec7-8cc0-4ce7-883e-a1c230d9e8cb None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:17.385751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-51bb1ec7-8cc0-4ce7-883e-a1c230d9e8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:17.440185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb1ec7-8cc0-4ce7-883e-a1c230d9e8cb None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:17.454024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5529a8a-0e3a-452a-886b-60664be1d865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:17.456133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5529a8a-0e3a-452a-886b-60664be1d865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:17.456541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5529a8a-0e3a-452a-886b-60664be1d865 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:17.457134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5529a8a-0e3a-452a-886b-60664be1d865 admin admin] PATH_INFO: `/v3/users/fcff40b520f749f2b4bca5eed0923504` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:17.459728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5529a8a-0e3a-452a-886b-60664be1d865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcff40b520f749f2b4bca5eed0923504)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:17.465561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5529a8a-0e3a-452a-886b-60664be1d865 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:17.819671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b5529a8a-0e3a-452a-886b-60664be1d865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcff40b520f749f2b4bca5eed0923504'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:17.823140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b5529a8a-0e3a-452a-886b-60664be1d865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcff40b520f749f2b4bca5eed0923504'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:17.847493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b5529a8a-0e3a-452a-886b-60664be1d865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcff40b520f749f2b4bca5eed0923504'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:17.864429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b5529a8a-0e3a-452a-886b-60664be1d865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcff40b520f749f2b4bca5eed0923504'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:17.957081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b5529a8a-0e3a-452a-886b-60664be1d865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcff40b520f749f2b4bca5eed0923504'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:17.969787 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1665/3377] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:35:17 2022] DELETE /identity/v3/users/fcff40b520f749f2b4bca5eed0923504 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:35:19.169794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e7e9f-c6bc-4aa7-a5aa-28d0f6243c88 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:19.186169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e7e9f-c6bc-4aa7-a5aa-28d0f6243c88 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:19.320422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd4c97-b002-469c-86c5-6c3908191e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:19.321104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd4c97-b002-469c-86c5-6c3908191e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:19.321552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd4c97-b002-469c-86c5-6c3908191e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:19.321842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd4c97-b002-469c-86c5-6c3908191e57 admin admin] PATH_INFO: `/v3/projects/dbbc26f2331d47e5863e8dbf1952906c` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:19.323105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd4c97-b002-469c-86c5-6c3908191e57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbbc26f2331d47e5863e8dbf1952906c)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:19.325075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd4c97-b002-469c-86c5-6c3908191e57 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:19.531445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cfcd4c97-b002-469c-86c5-6c3908191e57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbbc26f2331d47e5863e8dbf1952906c', 'request_id': 'req-cfcd4c97-b002-469c-86c5-6c3908191e57'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:19.551171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cfcd4c97-b002-469c-86c5-6c3908191e57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbbc26f2331d47e5863e8dbf1952906c', 'request_id': 'req-cfcd4c97-b002-469c-86c5-6c3908191e57'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:19.558378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cfcd4c97-b002-469c-86c5-6c3908191e57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbbc26f2331d47e5863e8dbf1952906c', 'request_id': 'req-cfcd4c97-b002-469c-86c5-6c3908191e57'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:19.687882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cfcd4c97-b002-469c-86c5-6c3908191e57 admin admin] The token cache is being invalidate because project dbbc26f2331d47e5863e8dbf1952906c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:35:19.688187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cfcd4c97-b002-469c-86c5-6c3908191e57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:19.690915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cfcd4c97-b002-469c-86c5-6c3908191e57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:35:19.692945 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1713/3378] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:19 2022] DELETE /identity/v3/projects/dbbc26f2331d47e5863e8dbf1952906c => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:35:19.700367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c94c03-ae11-472e-b34b-93fcbc560b97 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:19.700367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c94c03-ae11-472e-b34b-93fcbc560b97 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:19.700367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c94c03-ae11-472e-b34b-93fcbc560b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:19.738803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-15c94c03-ae11-472e-b34b-93fcbc560b97 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:19.740383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-15c94c03-ae11-472e-b34b-93fcbc560b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:19.912101 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1666/3379] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:35:19.923114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da31f7d-bce7-419f-b0a8-23e403676a26 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:19.923366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da31f7d-bce7-419f-b0a8-23e403676a26 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:19.923611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da31f7d-bce7-419f-b0a8-23e403676a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:19.939809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:19.977456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6da31f7d-bce7-419f-b0a8-23e403676a26 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:19.981717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6da31f7d-bce7-419f-b0a8-23e403676a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:20.014401 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1714/3380] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:35:20.018658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c94c03-ae11-472e-b34b-93fcbc560b97 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:20.037111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c94c03-ae11-472e-b34b-93fcbc560b97 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:20.055151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce35c0-f3e9-470d-86ea-27499253e01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:20.055788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce35c0-f3e9-470d-86ea-27499253e01e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:20.056074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce35c0-f3e9-470d-86ea-27499253e01e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:20.056348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce35c0-f3e9-470d-86ea-27499253e01e admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:20.057021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce35c0-f3e9-470d-86ea-27499253e01e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:35:20.057332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce35c0-f3e9-470d-86ea-27499253e01e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:20.059096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce35c0-f3e9-470d-86ea-27499253e01e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:20.101931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da31f7d-bce7-419f-b0a8-23e403676a26 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:20.107864 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1667/3381] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:35:20.112779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da31f7d-bce7-419f-b0a8-23e403676a26 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:20.126789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f29fde-a5cd-4bfc-b4dd-9897dedfceb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:20.127437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f29fde-a5cd-4bfc-b4dd-9897dedfceb1 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:20.127725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f29fde-a5cd-4bfc-b4dd-9897dedfceb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:20.128001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f29fde-a5cd-4bfc-b4dd-9897dedfceb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:20.128647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f29fde-a5cd-4bfc-b4dd-9897dedfceb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:20.130649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f29fde-a5cd-4bfc-b4dd-9897dedfceb1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:20.278008 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1715/3382] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:35:20 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:35:20.282576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce35c0-f3e9-470d-86ea-27499253e01e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:20.317549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce35c0-f3e9-470d-86ea-27499253e01e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:20.493286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:20.531792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa180648-4f2b-4cd2-8673-8673b7ee1f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:20.532598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa180648-4f2b-4cd2-8673-8673b7ee1f4d admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:20.532882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa180648-4f2b-4cd2-8673-8673b7ee1f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:20.533182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa180648-4f2b-4cd2-8673-8673b7ee1f4d admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:20.534014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa180648-4f2b-4cd2-8673-8673b7ee1f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:20.536849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa180648-4f2b-4cd2-8673-8673b7ee1f4d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:20.637885 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1668/3383] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:35:20 2022] POST /identity/v3/users => generated 292 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:35:20.639093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f29fde-a5cd-4bfc-b4dd-9897dedfceb1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:20.655452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f29fde-a5cd-4bfc-b4dd-9897dedfceb1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:20.670010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76f4eb-0d3d-4f78-8da7-35060d5bc7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:20.670762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76f4eb-0d3d-4f78-8da7-35060d5bc7fc admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:20.671051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76f4eb-0d3d-4f78-8da7-35060d5bc7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:20.671330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76f4eb-0d3d-4f78-8da7-35060d5bc7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:20.672049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76f4eb-0d3d-4f78-8da7-35060d5bc7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:20.673696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76f4eb-0d3d-4f78-8da7-35060d5bc7fc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:20.701422 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1716/3384] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:35:20.703242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa180648-4f2b-4cd2-8673-8673b7ee1f4d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:20.717890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa180648-4f2b-4cd2-8673-8673b7ee1f4d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:20.730049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b545e76-543f-4bc0-bf9a-d391b9cd8f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:20.730948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b545e76-543f-4bc0-bf9a-d391b9cd8f71 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:20.731393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b545e76-543f-4bc0-bf9a-d391b9cd8f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:20.731939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b545e76-543f-4bc0-bf9a-d391b9cd8f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:20.732777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b545e76-543f-4bc0-bf9a-d391b9cd8f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:20.734642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b545e76-543f-4bc0-bf9a-d391b9cd8f71 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:20.762303 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1669/3385] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:35:20.766775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76f4eb-0d3d-4f78-8da7-35060d5bc7fc admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:20.779460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76f4eb-0d3d-4f78-8da7-35060d5bc7fc admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:20.799767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2617c7-5f13-4b99-b47f-0e997cf64e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:20.800508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2617c7-5f13-4b99-b47f-0e997cf64e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:20.801007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2617c7-5f13-4b99-b47f-0e997cf64e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:20.801331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2617c7-5f13-4b99-b47f-0e997cf64e14 admin admin] PATH_INFO: `/v3/projects/229dcb63bc41444391544883b576ce2e/users/18036411a99e4634bfbaeae24b9f254d/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:20.830820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2617c7-5f13-4b99-b47f-0e997cf64e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=229dcb63bc41444391544883b576ce2e, user_id=18036411a99e4634bfbaeae24b9f254d, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:20.834536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2617c7-5f13-4b99-b47f-0e997cf64e14 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:20.932134 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1717/3386] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:35:20 2022] PUT /identity/v3/projects/229dcb63bc41444391544883b576ce2e/users/18036411a99e4634bfbaeae24b9f254d/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:35:20.935439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ee158-35fb-451a-8856-fb0a2e18001d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:20.935857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ee158-35fb-451a-8856-fb0a2e18001d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:20.936186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ee158-35fb-451a-8856-fb0a2e18001d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:20.999661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-280ee158-35fb-451a-8856-fb0a2e18001d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:21.000945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-280ee158-35fb-451a-8856-fb0a2e18001d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:21.168023 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1670/3387] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:35:21.207951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2617c7-5f13-4b99-b47f-0e997cf64e14 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:21.213649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ca2617c7-5f13-4b99-b47f-0e997cf64e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:21.415621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2617c7-5f13-4b99-b47f-0e997cf64e14 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:21.433338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57b513-3d37-4f19-88cb-2acf5e1c827c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:21.433976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57b513-3d37-4f19-88cb-2acf5e1c827c service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:21.440933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57b513-3d37-4f19-88cb-2acf5e1c827c service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:21.441970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57b513-3d37-4f19-88cb-2acf5e1c827c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:21.490468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57b513-3d37-4f19-88cb-2acf5e1c827c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:21.492522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57b513-3d37-4f19-88cb-2acf5e1c827c service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:21.507018 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1718/3388] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:35:21.617208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8f745-b38e-4ed5-a9ca-589ddc21f26d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:21.617418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8f745-b38e-4ed5-a9ca-589ddc21f26d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:21.617661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8f745-b38e-4ed5-a9ca-589ddc21f26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:21.713607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-45b8f745-b38e-4ed5-a9ca-589ddc21f26d None None] MFA Rules not processed for user `5c36bef85ac34b4983a79e03c56965c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:21.716943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-45b8f745-b38e-4ed5-a9ca-589ddc21f26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:21.860711 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1671/3389] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:21 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:35:21.870568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a5f34-de80-4126-b78f-245444f3a6e9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:21.871113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a5f34-de80-4126-b78f-245444f3a6e9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:21.871413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a5f34-de80-4126-b78f-245444f3a6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:21.940686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c35a5f34-de80-4126-b78f-245444f3a6e9 None None] MFA Rules not processed for user `5c36bef85ac34b4983a79e03c56965c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:21.941998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c35a5f34-de80-4126-b78f-245444f3a6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:21.972815 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1719/3390] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:21 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:35:22.469031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8f745-b38e-4ed5-a9ca-589ddc21f26d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:22.471213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-45b8f745-b38e-4ed5-a9ca-589ddc21f26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:22.625299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:22.689215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8f745-b38e-4ed5-a9ca-589ddc21f26d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:22.698481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195500a-7925-42ad-9048-aa81df25fcc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:22.699130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195500a-7925-42ad-9048-aa81df25fcc3 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:22.700563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195500a-7925-42ad-9048-aa81df25fcc3 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:22.700563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195500a-7925-42ad-9048-aa81df25fcc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:22.738076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195500a-7925-42ad-9048-aa81df25fcc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:22.740503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195500a-7925-42ad-9048-aa81df25fcc3 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:22.760932 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1672/3391] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:35:22 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:35:29.470374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619a62f-8be2-4a43-ad46-e5f59fd13b6a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:29.475567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619a62f-8be2-4a43-ad46-e5f59fd13b6a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:29.475567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619a62f-8be2-4a43-ad46-e5f59fd13b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:29.507690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3619a62f-8be2-4a43-ad46-e5f59fd13b6a None None] MFA Rules not processed for user `f9c32b7626594ff888970c7f3227bb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:29.509206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3619a62f-8be2-4a43-ad46-e5f59fd13b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:29.580585 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1720/3392] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:35:32.751418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=14 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:34.361906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a262718-b33b-4ef8-bae9-eedc6fd3076e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:34.365512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a262718-b33b-4ef8-bae9-eedc6fd3076e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:34.365512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a262718-b33b-4ef8-bae9-eedc6fd3076e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:34.447176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8a262718-b33b-4ef8-bae9-eedc6fd3076e None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:34.451820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8a262718-b33b-4ef8-bae9-eedc6fd3076e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:34.591722 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1673/3393] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:35:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:35:34.594552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619a62f-8be2-4a43-ad46-e5f59fd13b6a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:34.594552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3619a62f-8be2-4a43-ad46-e5f59fd13b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:34.675509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:34.719970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619a62f-8be2-4a43-ad46-e5f59fd13b6a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:34.728969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e45dc1-f820-4df3-849a-4c077c2ffaba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:34.729680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e45dc1-f820-4df3-849a-4c077c2ffaba service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:34.730013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e45dc1-f820-4df3-849a-4c077c2ffaba service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:34.730488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e45dc1-f820-4df3-849a-4c077c2ffaba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:34.744226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e45dc1-f820-4df3-849a-4c077c2ffaba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:34.747520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e45dc1-f820-4df3-849a-4c077c2ffaba service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:34.759812 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1721/3394] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:35:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 03:35:36.570224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05aaf0-fa2d-4336-9cfc-7f30f6b9de56 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:36.570224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05aaf0-fa2d-4336-9cfc-7f30f6b9de56 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:36.570224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05aaf0-fa2d-4336-9cfc-7f30f6b9de56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:36.644732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9d05aaf0-fa2d-4336-9cfc-7f30f6b9de56 None None] MFA Rules not processed for user `f9c32b7626594ff888970c7f3227bb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:36.645989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9d05aaf0-fa2d-4336-9cfc-7f30f6b9de56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:36.686764 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1674/3395] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:35:37.801575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b32664-453e-415e-b7f9-abb4be2612db None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:37.803964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b32664-453e-415e-b7f9-abb4be2612db None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:37.805046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b32664-453e-415e-b7f9-abb4be2612db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:37.874068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a2b32664-453e-415e-b7f9-abb4be2612db None None] MFA Rules not processed for user `8d5d3f1bf1af4cd6884297b207597fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:37.884880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a2b32664-453e-415e-b7f9-abb4be2612db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:38.129508 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1722/3396] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:35:38.469894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05aaf0-fa2d-4336-9cfc-7f30f6b9de56 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:38.497750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05aaf0-fa2d-4336-9cfc-7f30f6b9de56 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:38.524569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce17900-f5f2-446a-9757-c2c2e64e862a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:38.525292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce17900-f5f2-446a-9757-c2c2e64e862a service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:38.525651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce17900-f5f2-446a-9757-c2c2e64e862a service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:38.526005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce17900-f5f2-446a-9757-c2c2e64e862a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:38.546326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce17900-f5f2-446a-9757-c2c2e64e862a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:38.568074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce17900-f5f2-446a-9757-c2c2e64e862a service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:38.622133 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1675/3397] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:35:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:35:42.731159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ae43f-f431-43df-9649-aa893688ae28 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:42.731677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ae43f-f431-43df-9649-aa893688ae28 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:42.732001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ae43f-f431-43df-9649-aa893688ae28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:42.859369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e25ae43f-f431-43df-9649-aa893688ae28 None None] MFA Rules not processed for user `18036411a99e4634bfbaeae24b9f254d`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:42.865715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e25ae43f-f431-43df-9649-aa893688ae28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:43.122552 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1723/3398] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:35:43.140153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce17900-f5f2-446a-9757-c2c2e64e862a service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:43.141668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5ce17900-f5f2-446a-9757-c2c2e64e862a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:43.196307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce17900-f5f2-446a-9757-c2c2e64e862a service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:43.226351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddd420-e0db-4fc0-a48a-adef37c2b732 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:43.226794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddd420-e0db-4fc0-a48a-adef37c2b732 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:43.230229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddd420-e0db-4fc0-a48a-adef37c2b732 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:43.230518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddd420-e0db-4fc0-a48a-adef37c2b732 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:43.278675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddd420-e0db-4fc0-a48a-adef37c2b732 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:43.287565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddd420-e0db-4fc0-a48a-adef37c2b732 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:43.340453 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1676/3399] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:35:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:35:43.950534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700d45e-4b86-47a6-9acd-2e9afdcb58b2 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:43.951711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700d45e-4b86-47a6-9acd-2e9afdcb58b2 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:43.952270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700d45e-4b86-47a6-9acd-2e9afdcb58b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:43.978826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e700d45e-4b86-47a6-9acd-2e9afdcb58b2 None None] MFA Rules not processed for user `f9c32b7626594ff888970c7f3227bb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:43.980671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e700d45e-4b86-47a6-9acd-2e9afdcb58b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:43.990114 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1724/3400] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:35:45.080014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e74ad-72e7-41ad-bc34-1d04f8e9af6e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:45.080515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e74ad-72e7-41ad-bc34-1d04f8e9af6e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:45.080714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e74ad-72e7-41ad-bc34-1d04f8e9af6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:45.130522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-2b3e74ad-72e7-41ad-bc34-1d04f8e9af6e None None] MFA Rules not processed for user `f9c32b7626594ff888970c7f3227bb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:45.135109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2b3e74ad-72e7-41ad-bc34-1d04f8e9af6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:45.155160 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1677/3401] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:35:45.729211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c08b5-923b-44a2-bf9e-33127c61c49b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:45.729688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c08b5-923b-44a2-bf9e-33127c61c49b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:45.729795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c08b5-923b-44a2-bf9e-33127c61c49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:45.778768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6a1c08b5-923b-44a2-bf9e-33127c61c49b None None] MFA Rules not processed for user `8d5d3f1bf1af4cd6884297b207597fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:45.780606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6a1c08b5-923b-44a2-bf9e-33127c61c49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:45.829856 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1725/3402] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:35:46.175480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4752db-86af-40ee-9e48-2125ed6ed240 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:46.175992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4752db-86af-40ee-9e48-2125ed6ed240 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:46.177567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4752db-86af-40ee-9e48-2125ed6ed240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:46.241688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6f4752db-86af-40ee-9e48-2125ed6ed240 None None] MFA Rules not processed for user `f9c32b7626594ff888970c7f3227bb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:46.244215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6f4752db-86af-40ee-9e48-2125ed6ed240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:46.261762 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1678/3403] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:35:48.635236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473905a-06b9-41de-bf3c-e0cdb1590960 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:48.640006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473905a-06b9-41de-bf3c-e0cdb1590960 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:48.640006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473905a-06b9-41de-bf3c-e0cdb1590960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:48.688394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a473905a-06b9-41de-bf3c-e0cdb1590960 None None] MFA Rules not processed for user `f9c32b7626594ff888970c7f3227bb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:48.689849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a473905a-06b9-41de-bf3c-e0cdb1590960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:48.745409 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1726/3404] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:35:49.835192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44b532-ec91-48f4-8ca2-73522e7d4b8d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:49.836224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44b532-ec91-48f4-8ca2-73522e7d4b8d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:49.836508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44b532-ec91-48f4-8ca2-73522e7d4b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:49.864969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4c44b532-ec91-48f4-8ca2-73522e7d4b8d None None] MFA Rules not processed for user `f9c32b7626594ff888970c7f3227bb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:49.866453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4c44b532-ec91-48f4-8ca2-73522e7d4b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:49.879405 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1679/3405] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:35:50.554857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57554c24-c7d4-47e5-8a95-71116d5aa810 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:50.555370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57554c24-c7d4-47e5-8a95-71116d5aa810 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:50.555471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57554c24-c7d4-47e5-8a95-71116d5aa810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:50.593001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:50.611261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-57554c24-c7d4-47e5-8a95-71116d5aa810 None None] MFA Rules not processed for user `f9c32b7626594ff888970c7f3227bb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:50.613990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-57554c24-c7d4-47e5-8a95-71116d5aa810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:50.630872 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1727/3406] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:35:51.168584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f37e7-01bc-412a-a11f-8781b3035084 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:51.169166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f37e7-01bc-412a-a11f-8781b3035084 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:51.169166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f37e7-01bc-412a-a11f-8781b3035084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:51.215917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-056f37e7-01bc-412a-a11f-8781b3035084 None None] MFA Rules not processed for user `18036411a99e4634bfbaeae24b9f254d`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:51.222978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-056f37e7-01bc-412a-a11f-8781b3035084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:51.226349 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1680/3407] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:35:51.922731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57554c24-c7d4-47e5-8a95-71116d5aa810 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:35:51.925869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-57554c24-c7d4-47e5-8a95-71116d5aa810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:52.144073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57554c24-c7d4-47e5-8a95-71116d5aa810 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:35:52.153857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b3319-1fc3-4f25-bc99-c60a2b34752b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:35:52.157100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b3319-1fc3-4f25-bc99-c60a2b34752b service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:52.157516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b3319-1fc3-4f25-bc99-c60a2b34752b service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:52.157903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b3319-1fc3-4f25-bc99-c60a2b34752b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:52.162207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c94b3319-1fc3-4f25-bc99-c60a2b34752b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:52.189730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b3319-1fc3-4f25-bc99-c60a2b34752b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:35:52.192212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b3319-1fc3-4f25-bc99-c60a2b34752b service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:35:52.206135 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1728/3408] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:35:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:35:52.569707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfd932-0100-4099-b453-7e52abd72dd9 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:52.570224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfd932-0100-4099-b453-7e52abd72dd9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:52.570332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfd932-0100-4099-b453-7e52abd72dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:52.636476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-bebfd932-0100-4099-b453-7e52abd72dd9 None None] MFA Rules not processed for user `f9c32b7626594ff888970c7f3227bb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:52.644556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bebfd932-0100-4099-b453-7e52abd72dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:52.663244 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1681/3409] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:35:55.363662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a90943-5c0f-4d47-9c86-faa6cc1c0533 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:35:55.364216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a90943-5c0f-4d47-9c86-faa6cc1c0533 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:35:55.365940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a90943-5c0f-4d47-9c86-faa6cc1c0533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:35:55.408926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c6a90943-5c0f-4d47-9c86-faa6cc1c0533 None None] MFA Rules not processed for user `f9c32b7626594ff888970c7f3227bb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:35:55.412873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c6a90943-5c0f-4d47-9c86-faa6cc1c0533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:35:55.432922 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1729/3410] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:35:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:36:01.177998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfd932-0100-4099-b453-7e52abd72dd9 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:01.209418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfd932-0100-4099-b453-7e52abd72dd9 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:01.218008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5422a-1ba8-42d3-b5c9-95eecba040e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:01.218697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5422a-1ba8-42d3-b5c9-95eecba040e3 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:01.218981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5422a-1ba8-42d3-b5c9-95eecba040e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:01.219276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5422a-1ba8-42d3-b5c9-95eecba040e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:01.221514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0ae5422a-1ba8-42d3-b5c9-95eecba040e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:01.236611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5422a-1ba8-42d3-b5c9-95eecba040e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:01.238083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5422a-1ba8-42d3-b5c9-95eecba040e3 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:01.249587 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1682/3411] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:36:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:36:01.782521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a90943-5c0f-4d47-9c86-faa6cc1c0533 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:01.784705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c6a90943-5c0f-4d47-9c86-faa6cc1c0533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:01.844556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a90943-5c0f-4d47-9c86-faa6cc1c0533 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:01.851160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6206ff7-c563-45b3-b85a-ab26b9edea3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:01.852094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6206ff7-c563-45b3-b85a-ab26b9edea3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:01.852381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6206ff7-c563-45b3-b85a-ab26b9edea3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:01.852660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6206ff7-c563-45b3-b85a-ab26b9edea3b admin admin] PATH_INFO: `/v3/users/881f054c84d04ceaa17a5817816022d4` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:01.854016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6206ff7-c563-45b3-b85a-ab26b9edea3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=881f054c84d04ceaa17a5817816022d4)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:01.856439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6206ff7-c563-45b3-b85a-ab26b9edea3b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:02.048069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b6206ff7-c563-45b3-b85a-ab26b9edea3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '881f054c84d04ceaa17a5817816022d4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:36:02.048742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b6206ff7-c563-45b3-b85a-ab26b9edea3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '881f054c84d04ceaa17a5817816022d4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:36:02.058247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b6206ff7-c563-45b3-b85a-ab26b9edea3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '881f054c84d04ceaa17a5817816022d4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:36:02.071979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b6206ff7-c563-45b3-b85a-ab26b9edea3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '881f054c84d04ceaa17a5817816022d4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:36:02.072695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b6206ff7-c563-45b3-b85a-ab26b9edea3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '881f054c84d04ceaa17a5817816022d4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:36:02.148405 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1730/3412] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:36:01 2022] DELETE /identity/v3/users/881f054c84d04ceaa17a5817816022d4 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:36:02.568210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5422a-1ba8-42d3-b5c9-95eecba040e3 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:02.577685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5422a-1ba8-42d3-b5c9-95eecba040e3 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:02.718979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cf82e-166e-43ee-82ac-cc1f5c9919a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:02.720233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cf82e-166e-43ee-82ac-cc1f5c9919a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:02.720722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cf82e-166e-43ee-82ac-cc1f5c9919a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:02.721004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cf82e-166e-43ee-82ac-cc1f5c9919a5 admin admin] PATH_INFO: `/v3/projects/2057593072c14804ab70fe4bdea2c17c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:02.722243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003cf82e-166e-43ee-82ac-cc1f5c9919a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2057593072c14804ab70fe4bdea2c17c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:02.724505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003cf82e-166e-43ee-82ac-cc1f5c9919a5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:02.763030 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:03.061613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-003cf82e-166e-43ee-82ac-cc1f5c9919a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2057593072c14804ab70fe4bdea2c17c', 'request_id': 'req-003cf82e-166e-43ee-82ac-cc1f5c9919a5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:36:03.150265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-003cf82e-166e-43ee-82ac-cc1f5c9919a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2057593072c14804ab70fe4bdea2c17c', 'request_id': 'req-003cf82e-166e-43ee-82ac-cc1f5c9919a5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:36:03.158734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-003cf82e-166e-43ee-82ac-cc1f5c9919a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2057593072c14804ab70fe4bdea2c17c', 'request_id': 'req-003cf82e-166e-43ee-82ac-cc1f5c9919a5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:36:03.176947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-003cf82e-166e-43ee-82ac-cc1f5c9919a5 admin admin] The token cache is being invalidate because project 2057593072c14804ab70fe4bdea2c17c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:36:03.177228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-003cf82e-166e-43ee-82ac-cc1f5c9919a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:36:03.178095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-003cf82e-166e-43ee-82ac-cc1f5c9919a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:36:03.180200 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1683/3413] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:02 2022] DELETE /identity/v3/projects/2057593072c14804ab70fe4bdea2c17c => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:36:03.185117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f6efe-6e10-4608-838d-1cc9e0578137 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:03.185662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f6efe-6e10-4608-838d-1cc9e0578137 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:03.185776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f6efe-6e10-4608-838d-1cc9e0578137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:03.190893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:03.258284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-563f6efe-6e10-4608-838d-1cc9e0578137 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:36:03.259425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-563f6efe-6e10-4608-838d-1cc9e0578137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:03.351257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89d062-2939-4434-81c3-9e50344a0665 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:03.351553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89d062-2939-4434-81c3-9e50344a0665 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:03.351836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89d062-2939-4434-81c3-9e50344a0665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:03.367223 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1731/3414] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:36:03.376435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e47f99-a366-453b-94f1-0cc05992bcf1 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:03.384611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e47f99-a366-453b-94f1-0cc05992bcf1 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:03.384611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e47f99-a366-453b-94f1-0cc05992bcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:03.386657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4f89d062-2939-4434-81c3-9e50344a0665 None None] MFA Rules not processed for user `f9c32b7626594ff888970c7f3227bb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:36:03.388099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4f89d062-2939-4434-81c3-9e50344a0665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:03.406361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-17e47f99-a366-453b-94f1-0cc05992bcf1 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:36:03.407899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-17e47f99-a366-453b-94f1-0cc05992bcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:03.421058 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1732/3415] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:36:03.424906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e47f99-a366-453b-94f1-0cc05992bcf1 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:03.442965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e47f99-a366-453b-94f1-0cc05992bcf1 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:03.451128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985dba4-deef-40ac-be51-d938380a54e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:03.452801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985dba4-deef-40ac-be51-d938380a54e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:03.453262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985dba4-deef-40ac-be51-d938380a54e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:03.454239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985dba4-deef-40ac-be51-d938380a54e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:03.454921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985dba4-deef-40ac-be51-d938380a54e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:36:03.455227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985dba4-deef-40ac-be51-d938380a54e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:03.457849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985dba4-deef-40ac-be51-d938380a54e2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:03.477080 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1684/3416] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:36:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:36:03.489792 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1733/3417] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:36:03.494325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89d062-2939-4434-81c3-9e50344a0665 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:03.506024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89d062-2939-4434-81c3-9e50344a0665 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:03.511135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec6085-44d1-4387-ba9a-080c19a7b5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:03.511772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec6085-44d1-4387-ba9a-080c19a7b5ad admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:03.512057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec6085-44d1-4387-ba9a-080c19a7b5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:03.512469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec6085-44d1-4387-ba9a-080c19a7b5ad admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:03.513118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec6085-44d1-4387-ba9a-080c19a7b5ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:03.515636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec6085-44d1-4387-ba9a-080c19a7b5ad admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:03.658756 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1685/3418] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:36:03 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:36:03.660422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985dba4-deef-40ac-be51-d938380a54e2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:03.678084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985dba4-deef-40ac-be51-d938380a54e2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:03.753451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901323d1-c019-4397-b853-7576c08cf288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:03.754094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901323d1-c019-4397-b853-7576c08cf288 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:03.754618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901323d1-c019-4397-b853-7576c08cf288 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:03.754780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901323d1-c019-4397-b853-7576c08cf288 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:03.755304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901323d1-c019-4397-b853-7576c08cf288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:03.757327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901323d1-c019-4397-b853-7576c08cf288 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:03.815853 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1734/3419] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:36:03 2022] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:36:03.820000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec6085-44d1-4387-ba9a-080c19a7b5ad admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:03.831366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec6085-44d1-4387-ba9a-080c19a7b5ad admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:03.840248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4d1d1-d023-4599-b65f-0cf1fefaf957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:03.840809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4d1d1-d023-4599-b65f-0cf1fefaf957 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:03.841095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4d1d1-d023-4599-b65f-0cf1fefaf957 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:03.841372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4d1d1-d023-4599-b65f-0cf1fefaf957 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:03.842083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4d1d1-d023-4599-b65f-0cf1fefaf957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:03.843721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4d1d1-d023-4599-b65f-0cf1fefaf957 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:03.857254 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1686/3420] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:36:03.860421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901323d1-c019-4397-b853-7576c08cf288 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:03.871878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901323d1-c019-4397-b853-7576c08cf288 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:03.876805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143395a8-5381-4f22-8da8-cdb3911a80a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:03.877423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143395a8-5381-4f22-8da8-cdb3911a80a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:03.877701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143395a8-5381-4f22-8da8-cdb3911a80a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:03.877971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143395a8-5381-4f22-8da8-cdb3911a80a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:03.878691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143395a8-5381-4f22-8da8-cdb3911a80a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:03.880419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143395a8-5381-4f22-8da8-cdb3911a80a4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:03.891312 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1735/3421] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:36:03.895531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4d1d1-d023-4599-b65f-0cf1fefaf957 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:03.908282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4d1d1-d023-4599-b65f-0cf1fefaf957 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:03.917139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2a82f-9f77-43c7-b677-988edd4967eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:03.917816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2a82f-9f77-43c7-b677-988edd4967eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:03.918528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2a82f-9f77-43c7-b677-988edd4967eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:03.918528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2a82f-9f77-43c7-b677-988edd4967eb admin admin] PATH_INFO: `/v3/projects/1ec987ba67f94da4bbdadc3835e56d7d/users/88497702ee824799952e4bcd583ee367/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:03.945312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2a82f-9f77-43c7-b677-988edd4967eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ec987ba67f94da4bbdadc3835e56d7d, user_id=88497702ee824799952e4bcd583ee367, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:03.946020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acceac69-1115-4a82-8240-4e2b825c4f49 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:03.946339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acceac69-1115-4a82-8240-4e2b825c4f49 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:03.946616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acceac69-1115-4a82-8240-4e2b825c4f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:03.949110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2a82f-9f77-43c7-b677-988edd4967eb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:03.980741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-acceac69-1115-4a82-8240-4e2b825c4f49 None None] MFA Rules not processed for user `f9c32b7626594ff888970c7f3227bb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:36:03.982144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-acceac69-1115-4a82-8240-4e2b825c4f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:04.013556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:04.050510 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1736/3422] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:36:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:36:04.062437 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1687/3423] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:36:03 2022] PUT /identity/v3/projects/1ec987ba67f94da4bbdadc3835e56d7d/users/88497702ee824799952e4bcd583ee367/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:36:04.068092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651de51d-b5ae-4945-aae4-056543b8cb1e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:04.068526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651de51d-b5ae-4945-aae4-056543b8cb1e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:04.069074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651de51d-b5ae-4945-aae4-056543b8cb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:04.089800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-651de51d-b5ae-4945-aae4-056543b8cb1e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:36:04.092527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-651de51d-b5ae-4945-aae4-056543b8cb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:04.177244 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1737/3424] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:36:04.190189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2a82f-9f77-43c7-b677-988edd4967eb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:04.198589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1cf2a82f-9f77-43c7-b677-988edd4967eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:04.257319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:04.275697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2a82f-9f77-43c7-b677-988edd4967eb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:04.279555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2b3b5-3384-41c5-a99b-b9f91dfcfae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:04.280197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2b3b5-3384-41c5-a99b-b9f91dfcfae6 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:04.280481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2b3b5-3384-41c5-a99b-b9f91dfcfae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:04.280757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2b3b5-3384-41c5-a99b-b9f91dfcfae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:04.290356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2b3b5-3384-41c5-a99b-b9f91dfcfae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:04.291794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2b3b5-3384-41c5-a99b-b9f91dfcfae6 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:04.301340 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1688/3425] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:36:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:36:08.690629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c02c4f-a202-4fcc-8897-922d7a0acd30 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:08.691214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c02c4f-a202-4fcc-8897-922d7a0acd30 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:08.691590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c02c4f-a202-4fcc-8897-922d7a0acd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:08.746418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-08c02c4f-a202-4fcc-8897-922d7a0acd30 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:36:08.748535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-08c02c4f-a202-4fcc-8897-922d7a0acd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:08.841278 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1738/3426] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:36:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:36:08.841876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2b3b5-3384-41c5-a99b-b9f91dfcfae6 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:08.843417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9fa2b3b5-3384-41c5-a99b-b9f91dfcfae6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:09.009479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2b3b5-3384-41c5-a99b-b9f91dfcfae6 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:09.018564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973d4df-e542-4114-b406-183ef789c9aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:09.020194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973d4df-e542-4114-b406-183ef789c9aa service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:09.021039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973d4df-e542-4114-b406-183ef789c9aa service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:09.021377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973d4df-e542-4114-b406-183ef789c9aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:09.037524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973d4df-e542-4114-b406-183ef789c9aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:09.040808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973d4df-e542-4114-b406-183ef789c9aa service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:09.071574 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1689/3427] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:36:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 03:36:15.814220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9db8a-d92d-4098-90a8-90b54fb6b3d6 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:15.815123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9db8a-d92d-4098-90a8-90b54fb6b3d6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:15.815605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9db8a-d92d-4098-90a8-90b54fb6b3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:15.870597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f0d9db8a-d92d-4098-90a8-90b54fb6b3d6 None None] MFA Rules not processed for user `5c36bef85ac34b4983a79e03c56965c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:36:15.871046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f0d9db8a-d92d-4098-90a8-90b54fb6b3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:16.035635 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1739/3428] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:36:15 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:36:16.105463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e87048-2a87-42e4-a7d3-9d9466e55746 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:16.106007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e87048-2a87-42e4-a7d3-9d9466e55746 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:16.106007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e87048-2a87-42e4-a7d3-9d9466e55746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:16.204143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-15e87048-2a87-42e4-a7d3-9d9466e55746 None None] MFA Rules not processed for user `88497702ee824799952e4bcd583ee367`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:36:16.206253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-15e87048-2a87-42e4-a7d3-9d9466e55746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:16.373676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9db8a-d92d-4098-90a8-90b54fb6b3d6 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:16.387667 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1690/3429] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:36:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:36:16.392225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9db8a-d92d-4098-90a8-90b54fb6b3d6 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:16.402363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd93b4-9bfa-4e78-9c0c-de9d2127d28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:16.402999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd93b4-9bfa-4e78-9c0c-de9d2127d28e admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:16.403284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd93b4-9bfa-4e78-9c0c-de9d2127d28e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:16.403561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd93b4-9bfa-4e78-9c0c-de9d2127d28e admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:16.404396 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd93b4-9bfa-4e78-9c0c-de9d2127d28e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:16.416978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd93b4-9bfa-4e78-9c0c-de9d2127d28e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:16.459642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:16.531510 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1740/3430] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:36:16 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:36:16.535195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e87048-2a87-42e4-a7d3-9d9466e55746 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:16.551908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e87048-2a87-42e4-a7d3-9d9466e55746 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:16.715618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:16.740174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373926ab-8218-4723-919d-3631f0023c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:16.741095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373926ab-8218-4723-919d-3631f0023c9a admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:16.741589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373926ab-8218-4723-919d-3631f0023c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:16.742450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373926ab-8218-4723-919d-3631f0023c9a admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:16.744721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373926ab-8218-4723-919d-3631f0023c9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:16.755535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373926ab-8218-4723-919d-3631f0023c9a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:16.928257 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1691/3431] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:36:16 2022] POST /identity/v3/users => generated 295 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:36:16.992947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd93b4-9bfa-4e78-9c0c-de9d2127d28e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:17.016775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd93b4-9bfa-4e78-9c0c-de9d2127d28e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:17.050962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a2bc9-ba92-406f-81a9-e3a27d2dda4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:17.052975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a2bc9-ba92-406f-81a9-e3a27d2dda4b admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:17.053653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a2bc9-ba92-406f-81a9-e3a27d2dda4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:17.054506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a2bc9-ba92-406f-81a9-e3a27d2dda4b admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:17.057318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a2bc9-ba92-406f-81a9-e3a27d2dda4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:17.060822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a2bc9-ba92-406f-81a9-e3a27d2dda4b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:17.084583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373926ab-8218-4723-919d-3631f0023c9a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:17.092394 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1741/3432] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:36:17.099474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373926ab-8218-4723-919d-3631f0023c9a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:17.108497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863e546-b02d-45b1-91dd-5ac5c1c31ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:17.109875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863e546-b02d-45b1-91dd-5ac5c1c31ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:17.110396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863e546-b02d-45b1-91dd-5ac5c1c31ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:17.111232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863e546-b02d-45b1-91dd-5ac5c1c31ae4 admin admin] PATH_INFO: `/v3/projects/088fd91527c748c89e358ed7959c131a/users/c2cdc3a79fb74382ba64bc3b1b9b3415/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:17.136883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863e546-b02d-45b1-91dd-5ac5c1c31ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=088fd91527c748c89e358ed7959c131a, user_id=c2cdc3a79fb74382ba64bc3b1b9b3415, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:17.140844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863e546-b02d-45b1-91dd-5ac5c1c31ae4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:17.414359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a2bc9-ba92-406f-81a9-e3a27d2dda4b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:17.416953 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1692/3433] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:36:17 2022] PUT /identity/v3/projects/088fd91527c748c89e358ed7959c131a/users/c2cdc3a79fb74382ba64bc3b1b9b3415/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:36:17.439728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a2bc9-ba92-406f-81a9-e3a27d2dda4b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:17.582641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585f3db-666a-4081-ab5c-3a2bdea2a3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:17.583274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585f3db-666a-4081-ab5c-3a2bdea2a3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:17.583560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585f3db-666a-4081-ab5c-3a2bdea2a3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:17.583903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585f3db-666a-4081-ab5c-3a2bdea2a3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:17.584562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585f3db-666a-4081-ab5c-3a2bdea2a3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:17.586194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585f3db-666a-4081-ab5c-3a2bdea2a3d5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:17.602476 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1742/3434] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:36:17.603457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863e546-b02d-45b1-91dd-5ac5c1c31ae4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:17.617736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863e546-b02d-45b1-91dd-5ac5c1c31ae4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:17.624992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0daac-37ab-48b7-bbc6-c4238fd9becf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:17.626218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0daac-37ab-48b7-bbc6-c4238fd9becf admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:17.626516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0daac-37ab-48b7-bbc6-c4238fd9becf admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:17.626787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0daac-37ab-48b7-bbc6-c4238fd9becf admin admin] PATH_INFO: `/v3/projects/088fd91527c748c89e358ed7959c131a/users/c2cdc3a79fb74382ba64bc3b1b9b3415/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:17.628801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0daac-37ab-48b7-bbc6-c4238fd9becf admin admin] RBAC: Authorizing `identity:create_grant(project_id=088fd91527c748c89e358ed7959c131a, user_id=c2cdc3a79fb74382ba64bc3b1b9b3415, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:17.631529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0daac-37ab-48b7-bbc6-c4238fd9becf admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:17.666604 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1693/3435] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:36:17 2022] PUT /identity/v3/projects/088fd91527c748c89e358ed7959c131a/users/c2cdc3a79fb74382ba64bc3b1b9b3415/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:36:20.698707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3559adc-dea0-4147-a5e3-5298251da499 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:20.699235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3559adc-dea0-4147-a5e3-5298251da499 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:20.701798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3559adc-dea0-4147-a5e3-5298251da499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:20.739262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b3559adc-dea0-4147-a5e3-5298251da499 None None] MFA Rules not processed for user `f9c32b7626594ff888970c7f3227bb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:36:20.754790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b3559adc-dea0-4147-a5e3-5298251da499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:20.876006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0daac-37ab-48b7-bbc6-c4238fd9becf admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:20.878207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-14e0daac-37ab-48b7-bbc6-c4238fd9becf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:20.960708 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1743/3436] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:36:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:36:21.117373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0daac-37ab-48b7-bbc6-c4238fd9becf admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:21.138594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c3497-d1d1-4489-8e06-1ee50c0e75db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:21.139692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c3497-d1d1-4489-8e06-1ee50c0e75db service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:21.141454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c3497-d1d1-4489-8e06-1ee50c0e75db service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:21.143415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c3497-d1d1-4489-8e06-1ee50c0e75db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:21.153785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-022c3497-d1d1-4489-8e06-1ee50c0e75db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:21.347802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c3497-d1d1-4489-8e06-1ee50c0e75db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:21.349380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c3497-d1d1-4489-8e06-1ee50c0e75db service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:21.370658 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1694/3437] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:36:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:36:25.487092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3559adc-dea0-4147-a5e3-5298251da499 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:25.488781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b3559adc-dea0-4147-a5e3-5298251da499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:25.523675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3559adc-dea0-4147-a5e3-5298251da499 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:25.531291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7d810-a3d9-49df-8963-02a3f01c1dc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:25.532451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7d810-a3d9-49df-8963-02a3f01c1dc7 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:25.532969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7d810-a3d9-49df-8963-02a3f01c1dc7 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:25.533487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7d810-a3d9-49df-8963-02a3f01c1dc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:25.535782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c4e7d810-a3d9-49df-8963-02a3f01c1dc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:25.571174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7d810-a3d9-49df-8963-02a3f01c1dc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:25.573295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7d810-a3d9-49df-8963-02a3f01c1dc7 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:25.600699 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1744/3438] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:36:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:36:26.390392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c3497-d1d1-4489-8e06-1ee50c0e75db service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:26.391997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-022c3497-d1d1-4489-8e06-1ee50c0e75db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:26.425768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c3497-d1d1-4489-8e06-1ee50c0e75db service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:26.439637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d9503-b78c-446a-858d-9176b841b614 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:26.440596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d9503-b78c-446a-858d-9176b841b614 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:26.441059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d9503-b78c-446a-858d-9176b841b614 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:26.441537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d9503-b78c-446a-858d-9176b841b614 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:26.443618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b19d9503-b78c-446a-858d-9176b841b614 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:26.472609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d9503-b78c-446a-858d-9176b841b614 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:26.474542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d9503-b78c-446a-858d-9176b841b614 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:26.541442 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1695/3439] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:36:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:36:30.212583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b00703-51ae-4bcf-adf9-9c5197308536 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:30.213336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b00703-51ae-4bcf-adf9-9c5197308536 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:30.213336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b00703-51ae-4bcf-adf9-9c5197308536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:30.246027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-87b00703-51ae-4bcf-adf9-9c5197308536 None None] MFA Rules not processed for user `c2cdc3a79fb74382ba64bc3b1b9b3415`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:36:30.248128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-87b00703-51ae-4bcf-adf9-9c5197308536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:30.327099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:30.332385 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1745/3440] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:36:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:36:30.345752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d9503-b78c-446a-858d-9176b841b614 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:30.348066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b19d9503-b78c-446a-858d-9176b841b614 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:30.431381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:30.436866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d9503-b78c-446a-858d-9176b841b614 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:30.440748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46198be5-f9fb-4831-abb1-f4933808f8eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:30.441364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46198be5-f9fb-4831-abb1-f4933808f8eb service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:30.441636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46198be5-f9fb-4831-abb1-f4933808f8eb service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:30.441921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46198be5-f9fb-4831-abb1-f4933808f8eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:30.509154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46198be5-f9fb-4831-abb1-f4933808f8eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:30.510647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46198be5-f9fb-4831-abb1-f4933808f8eb service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:30.521020 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1696/3441] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:36:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:36:30.979706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b00703-51ae-4bcf-adf9-9c5197308536 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:30.992104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b00703-51ae-4bcf-adf9-9c5197308536 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:30.996657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa445ec-0f76-4b82-86e3-898ff0071dd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:30.997495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa445ec-0f76-4b82-86e3-898ff0071dd4 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:30.997969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa445ec-0f76-4b82-86e3-898ff0071dd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:30.998429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa445ec-0f76-4b82-86e3-898ff0071dd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:31.001039 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-caa445ec-0f76-4b82-86e3-898ff0071dd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:31.030811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa445ec-0f76-4b82-86e3-898ff0071dd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:31.032451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa445ec-0f76-4b82-86e3-898ff0071dd4 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:31.043526 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1746/3442] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:36:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:36:32.824850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c1008-128f-4e12-803e-e6b43a04d334 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:32.825417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c1008-128f-4e12-803e-e6b43a04d334 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:32.825417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c1008-128f-4e12-803e-e6b43a04d334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:32.864040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-377c1008-128f-4e12-803e-e6b43a04d334 None None] MFA Rules not processed for user `94897f20beb94dbd8e7eff6ecba30026`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:36:32.865870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-377c1008-128f-4e12-803e-e6b43a04d334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:32.956711 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1697/3443] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:36:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:36:34.128971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa445ec-0f76-4b82-86e3-898ff0071dd4 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:34.131648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-caa445ec-0f76-4b82-86e3-898ff0071dd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:34.284845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa445ec-0f76-4b82-86e3-898ff0071dd4 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:34.291435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63af91-df6f-4c1e-8cec-89b6ee686133 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:34.292940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63af91-df6f-4c1e-8cec-89b6ee686133 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:34.292940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63af91-df6f-4c1e-8cec-89b6ee686133 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:34.292940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63af91-df6f-4c1e-8cec-89b6ee686133 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:34.295154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1f63af91-df6f-4c1e-8cec-89b6ee686133 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:34.315056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63af91-df6f-4c1e-8cec-89b6ee686133 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:34.316949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63af91-df6f-4c1e-8cec-89b6ee686133 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:34.331626 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1747/3444] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:36:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:36:36.447047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17745e-806e-4a1c-bfee-12f85354196d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:36.447047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17745e-806e-4a1c-bfee-12f85354196d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:36.447047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17745e-806e-4a1c-bfee-12f85354196d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:36.475000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5f17745e-806e-4a1c-bfee-12f85354196d None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:36:36.482489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5f17745e-806e-4a1c-bfee-12f85354196d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:36.586523 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1698/3445] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:36:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:36:36.597277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63af91-df6f-4c1e-8cec-89b6ee686133 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:36.718555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63af91-df6f-4c1e-8cec-89b6ee686133 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:36.725630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5fd26-3846-4181-a1ee-0b0367d8d618 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:36.726373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5fd26-3846-4181-a1ee-0b0367d8d618 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:36.726753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5fd26-3846-4181-a1ee-0b0367d8d618 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:36.727038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5fd26-3846-4181-a1ee-0b0367d8d618 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:36.741139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5fd26-3846-4181-a1ee-0b0367d8d618 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:36.743277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5fd26-3846-4181-a1ee-0b0367d8d618 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:36.754067 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1748/3446] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:36:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:36:38.369001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af890207-e384-4af8-960e-07770061ef42 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:38.369545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af890207-e384-4af8-960e-07770061ef42 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:38.369545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af890207-e384-4af8-960e-07770061ef42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:38.424096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-af890207-e384-4af8-960e-07770061ef42 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:36:38.425514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-af890207-e384-4af8-960e-07770061ef42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:38.445947 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1699/3447] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:36:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:36:38.468004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5fd26-3846-4181-a1ee-0b0367d8d618 service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:38.483373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5fd26-3846-4181-a1ee-0b0367d8d618 service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:38.498550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbce3c5-fc8e-4747-9b51-1a9605f14b80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:38.500145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbce3c5-fc8e-4747-9b51-1a9605f14b80 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:38.501636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbce3c5-fc8e-4747-9b51-1a9605f14b80 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:38.502842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbce3c5-fc8e-4747-9b51-1a9605f14b80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:38.517404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbce3c5-fc8e-4747-9b51-1a9605f14b80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:38.521166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbce3c5-fc8e-4747-9b51-1a9605f14b80 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:38.572881 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1749/3448] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:36:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:36:39.894849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af890207-e384-4af8-960e-07770061ef42 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:39.914871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af890207-e384-4af8-960e-07770061ef42 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:39.924083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255cbea-2e18-4d7b-a5f1-ca676fbdb8ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:39.924974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255cbea-2e18-4d7b-a5f1-ca676fbdb8ac service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:39.925488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255cbea-2e18-4d7b-a5f1-ca676fbdb8ac service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:39.925959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255cbea-2e18-4d7b-a5f1-ca676fbdb8ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:39.928266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8255cbea-2e18-4d7b-a5f1-ca676fbdb8ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:39.941494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255cbea-2e18-4d7b-a5f1-ca676fbdb8ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:39.943436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255cbea-2e18-4d7b-a5f1-ca676fbdb8ac service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:39.956176 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1700/3449] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:36:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:36:40.053677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af3fcc-0e82-4ba1-a296-8f2eab46c81a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:40.054217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af3fcc-0e82-4ba1-a296-8f2eab46c81a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:40.054309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af3fcc-0e82-4ba1-a296-8f2eab46c81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:40.076595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f3af3fcc-0e82-4ba1-a296-8f2eab46c81a None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:36:40.077827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f3af3fcc-0e82-4ba1-a296-8f2eab46c81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:40.087502 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1750/3450] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:36:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:36:40.101092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255cbea-2e18-4d7b-a5f1-ca676fbdb8ac service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:40.115461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255cbea-2e18-4d7b-a5f1-ca676fbdb8ac service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:40.123472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee99b2-6a89-4310-bc87-00445421e7a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:40.124441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee99b2-6a89-4310-bc87-00445421e7a5 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:40.124959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee99b2-6a89-4310-bc87-00445421e7a5 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:40.125750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee99b2-6a89-4310-bc87-00445421e7a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:40.143917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee99b2-6a89-4310-bc87-00445421e7a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:40.145532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee99b2-6a89-4310-bc87-00445421e7a5 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:40.157052 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1701/3451] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:36:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:36:43.302666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d27d5f-f087-4ba7-92f0-0b68bc0935d0 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:43.302666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d27d5f-f087-4ba7-92f0-0b68bc0935d0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:43.302666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d27d5f-f087-4ba7-92f0-0b68bc0935d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:43.308843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d4d27d5f-f087-4ba7-92f0-0b68bc0935d0 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:36:43.310365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d4d27d5f-f087-4ba7-92f0-0b68bc0935d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:43.321384 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1751/3452] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:36:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:36:43.334611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee99b2-6a89-4310-bc87-00445421e7a5 service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:43.348980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee99b2-6a89-4310-bc87-00445421e7a5 service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:43.355217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897a8f4-0992-4914-9085-fde3ec20b994 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:43.356210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897a8f4-0992-4914-9085-fde3ec20b994 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:43.357452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897a8f4-0992-4914-9085-fde3ec20b994 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:43.357980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897a8f4-0992-4914-9085-fde3ec20b994 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:43.369120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:43.373942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897a8f4-0992-4914-9085-fde3ec20b994 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:43.377840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897a8f4-0992-4914-9085-fde3ec20b994 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:43.405920 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1702/3453] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:36:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:36:49.726599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee82050-de0f-4ac6-8404-9adfbdcd6366 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:49.727706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee82050-de0f-4ac6-8404-9adfbdcd6366 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:49.728263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee82050-de0f-4ac6-8404-9adfbdcd6366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:49.771835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-5ee82050-de0f-4ac6-8404-9adfbdcd6366 None None] MFA Rules not processed for user `5c36bef85ac34b4983a79e03c56965c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:36:49.777131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5ee82050-de0f-4ac6-8404-9adfbdcd6366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:49.845974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:49.897812 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1752/3454] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:36:49 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:36:53.706854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:54.114069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca115ecc-a3b9-4fd1-b6d5-3c464f8a87d4 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:54.114365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca115ecc-a3b9-4fd1-b6d5-3c464f8a87d4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:54.114648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca115ecc-a3b9-4fd1-b6d5-3c464f8a87d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:54.158768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ca115ecc-a3b9-4fd1-b6d5-3c464f8a87d4 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:36:54.160003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ca115ecc-a3b9-4fd1-b6d5-3c464f8a87d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:54.212082 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1703/3455] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:36:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:36:54.242144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee82050-de0f-4ac6-8404-9adfbdcd6366 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:54.264994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee82050-de0f-4ac6-8404-9adfbdcd6366 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:54.273181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7de7c-30b1-4d96-909b-84fe55260ed3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:54.274432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7de7c-30b1-4d96-909b-84fe55260ed3 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:54.274887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7de7c-30b1-4d96-909b-84fe55260ed3 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:54.275595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7de7c-30b1-4d96-909b-84fe55260ed3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:54.291013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7de7c-30b1-4d96-909b-84fe55260ed3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:54.293233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7de7c-30b1-4d96-909b-84fe55260ed3 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:54.304952 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1753/3456] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:36:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:36:55.052491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebd449-dc77-4c97-b62a-ff004cb1e67a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:55.053082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebd449-dc77-4c97-b62a-ff004cb1e67a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:55.053317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebd449-dc77-4c97-b62a-ff004cb1e67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:55.098769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-fbebd449-dc77-4c97-b62a-ff004cb1e67a None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:36:55.101505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fbebd449-dc77-4c97-b62a-ff004cb1e67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:55.115512 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1704/3457] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:36:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:36:55.133852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7de7c-30b1-4d96-909b-84fe55260ed3 service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:55.158948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7de7c-30b1-4d96-909b-84fe55260ed3 service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:55.173155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38684a5a-fcba-4843-b207-98956930abdb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:55.174317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38684a5a-fcba-4843-b207-98956930abdb service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:55.174831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38684a5a-fcba-4843-b207-98956930abdb service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:55.175316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38684a5a-fcba-4843-b207-98956930abdb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:55.205354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38684a5a-fcba-4843-b207-98956930abdb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:55.212672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38684a5a-fcba-4843-b207-98956930abdb service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:55.242211 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1754/3458] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:36:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:36:56.506710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29c362-5426-446e-9b86-e9f4441d4681 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:56.507290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29c362-5426-446e-9b86-e9f4441d4681 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:56.507290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29c362-5426-446e-9b86-e9f4441d4681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:56.537870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-3e29c362-5426-446e-9b86-e9f4441d4681 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:36:56.540766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3e29c362-5426-446e-9b86-e9f4441d4681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:56.549654 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1705/3459] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:36:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:36:56.568304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38684a5a-fcba-4843-b207-98956930abdb service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:56.585441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38684a5a-fcba-4843-b207-98956930abdb service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:56.593680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2e619-0b31-4333-b1b9-a9b236df3d98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:56.598369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2e619-0b31-4333-b1b9-a9b236df3d98 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:56.598369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2e619-0b31-4333-b1b9-a9b236df3d98 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:56.598369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2e619-0b31-4333-b1b9-a9b236df3d98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:56.606258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2e619-0b31-4333-b1b9-a9b236df3d98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:56.609677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2e619-0b31-4333-b1b9-a9b236df3d98 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:56.626960 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1755/3460] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:36:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:36:56.930188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29c362-5426-446e-9b86-e9f4441d4681 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:56.942857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29c362-5426-446e-9b86-e9f4441d4681 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:56.960867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72797682-81b4-4f76-9fa8-c53f9fef0828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:56.961440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72797682-81b4-4f76-9fa8-c53f9fef0828 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:56.961731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72797682-81b4-4f76-9fa8-c53f9fef0828 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:56.962014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72797682-81b4-4f76-9fa8-c53f9fef0828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:56.991801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-72797682-81b4-4f76-9fa8-c53f9fef0828 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:57.039817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72797682-81b4-4f76-9fa8-c53f9fef0828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:57.041910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72797682-81b4-4f76-9fa8-c53f9fef0828 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:57.062624 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1706/3461] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:36:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:36:57.182129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2e619-0b31-4333-b1b9-a9b236df3d98 service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:57.183811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-97b2e619-0b31-4333-b1b9-a9b236df3d98 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:57.375158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae652ab-8c55-4eb0-8144-bc8393d5a9ea None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:57.375711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae652ab-8c55-4eb0-8144-bc8393d5a9ea None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:57.376212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae652ab-8c55-4eb0-8144-bc8393d5a9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:57.438784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2e619-0b31-4333-b1b9-a9b236df3d98 service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:57.444373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd69e24-22ae-4a11-9f3a-d73de0493604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:57.445257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd69e24-22ae-4a11-9f3a-d73de0493604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:57.445708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd69e24-22ae-4a11-9f3a-d73de0493604 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:57.446197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd69e24-22ae-4a11-9f3a-d73de0493604 admin admin] PATH_INFO: `/v3/users/ae7845f6759c4dcabcc1516a72484174` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:57.447561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd69e24-22ae-4a11-9f3a-d73de0493604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae7845f6759c4dcabcc1516a72484174)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:57.449773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd69e24-22ae-4a11-9f3a-d73de0493604 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:57.463945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-3ae652ab-8c55-4eb0-8144-bc8393d5a9ea None None] MFA Rules not processed for user `94897f20beb94dbd8e7eff6ecba30026`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:36:57.470226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3ae652ab-8c55-4eb0-8144-bc8393d5a9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:57.516016 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1707/3462] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:36:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:36:57.699876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0dd69e24-22ae-4a11-9f3a-d73de0493604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae7845f6759c4dcabcc1516a72484174'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:36:57.702436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0dd69e24-22ae-4a11-9f3a-d73de0493604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae7845f6759c4dcabcc1516a72484174'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:36:57.715316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0dd69e24-22ae-4a11-9f3a-d73de0493604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae7845f6759c4dcabcc1516a72484174'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:36:57.736690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0dd69e24-22ae-4a11-9f3a-d73de0493604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae7845f6759c4dcabcc1516a72484174'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:36:57.737518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0dd69e24-22ae-4a11-9f3a-d73de0493604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae7845f6759c4dcabcc1516a72484174'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:36:57.867968 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1756/3463] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:36:57 2022] DELETE /identity/v3/users/ae7845f6759c4dcabcc1516a72484174 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:36:57.869653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad63b7-30cb-41dd-9851-32e6756a84a9 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:57.870306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad63b7-30cb-41dd-9851-32e6756a84a9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:57.870306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad63b7-30cb-41dd-9851-32e6756a84a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:57.920052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-83ad63b7-30cb-41dd-9851-32e6756a84a9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:36:57.927438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-83ad63b7-30cb-41dd-9851-32e6756a84a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:58.032284 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1708/3464] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:36:58.061200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd69e24-22ae-4a11-9f3a-d73de0493604 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:58.064855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0dd69e24-22ae-4a11-9f3a-d73de0493604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:58.125350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:58.198297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd69e24-22ae-4a11-9f3a-d73de0493604 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:58.204920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301f254-c2c7-4513-8f1d-2c116b97b194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:58.205899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301f254-c2c7-4513-8f1d-2c116b97b194 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:58.206209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301f254-c2c7-4513-8f1d-2c116b97b194 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:58.206594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301f254-c2c7-4513-8f1d-2c116b97b194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:58.236319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301f254-c2c7-4513-8f1d-2c116b97b194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:58.237924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301f254-c2c7-4513-8f1d-2c116b97b194 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:58.261016 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1757/3465] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:36:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:36:59.363590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad63b7-30cb-41dd-9851-32e6756a84a9 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:36:59.365887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-83ad63b7-30cb-41dd-9851-32e6756a84a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:36:59.386358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad63b7-30cb-41dd-9851-32e6756a84a9 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:36:59.394406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e707777-59f9-401c-a4ba-e136120022db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:36:59.395309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e707777-59f9-401c-a4ba-e136120022db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:36:59.395770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e707777-59f9-401c-a4ba-e136120022db admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:36:59.396237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e707777-59f9-401c-a4ba-e136120022db admin admin] PATH_INFO: `/v3/projects/98d371ab6648425eac2cf1702f2789dc` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:36:59.397560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e707777-59f9-401c-a4ba-e136120022db admin admin] RBAC: Authorizing `identity:delete_project(project_id=98d371ab6648425eac2cf1702f2789dc)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:36:59.400476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e707777-59f9-401c-a4ba-e136120022db admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:36:59.795106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3e707777-59f9-401c-a4ba-e136120022db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98d371ab6648425eac2cf1702f2789dc', 'request_id': 'req-3e707777-59f9-401c-a4ba-e136120022db'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:36:59.995713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3e707777-59f9-401c-a4ba-e136120022db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98d371ab6648425eac2cf1702f2789dc', 'request_id': 'req-3e707777-59f9-401c-a4ba-e136120022db'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:00.004570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3e707777-59f9-401c-a4ba-e136120022db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98d371ab6648425eac2cf1702f2789dc', 'request_id': 'req-3e707777-59f9-401c-a4ba-e136120022db'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:00.049110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3e707777-59f9-401c-a4ba-e136120022db admin admin] The token cache is being invalidate because project 98d371ab6648425eac2cf1702f2789dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:37:00.049662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3e707777-59f9-401c-a4ba-e136120022db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:00.052067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3e707777-59f9-401c-a4ba-e136120022db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:00.061275 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1709/3466] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:59 2022] DELETE /identity/v3/projects/98d371ab6648425eac2cf1702f2789dc => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:37:00.084674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9befd-5011-452a-b667-f3e44a8da10d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:00.085556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9befd-5011-452a-b667-f3e44a8da10d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:00.086002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9befd-5011-452a-b667-f3e44a8da10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:00.141198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3fb9befd-5011-452a-b667-f3e44a8da10d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:00.141198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3fb9befd-5011-452a-b667-f3e44a8da10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:00.294830 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1758/3467] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:37:00.302655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283fd17-236b-4010-bcdd-624305a37790 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:00.302951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283fd17-236b-4010-bcdd-624305a37790 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:00.303232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283fd17-236b-4010-bcdd-624305a37790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:00.342718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d283fd17-236b-4010-bcdd-624305a37790 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:00.344395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d283fd17-236b-4010-bcdd-624305a37790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:00.364264 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1710/3468] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:37:00.364902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9befd-5011-452a-b667-f3e44a8da10d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:00.380512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9befd-5011-452a-b667-f3e44a8da10d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:00.395178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82aaaa9-b216-42eb-8981-3ed34c1a6ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:00.409470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82aaaa9-b216-42eb-8981-3ed34c1a6ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:00.409470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82aaaa9-b216-42eb-8981-3ed34c1a6ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:00.409470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82aaaa9-b216-42eb-8981-3ed34c1a6ec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:00.409470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82aaaa9-b216-42eb-8981-3ed34c1a6ec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:37:00.409470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82aaaa9-b216-42eb-8981-3ed34c1a6ec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:00.409470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82aaaa9-b216-42eb-8981-3ed34c1a6ec7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:00.427491 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1759/3469] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:37:00.430829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283fd17-236b-4010-bcdd-624305a37790 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:00.459435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283fd17-236b-4010-bcdd-624305a37790 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:00.473885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f7d99-41f4-4ee7-9453-c74a35b52711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:00.474886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f7d99-41f4-4ee7-9453-c74a35b52711 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:00.475402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f7d99-41f4-4ee7-9453-c74a35b52711 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:00.475875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f7d99-41f4-4ee7-9453-c74a35b52711 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:00.477259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f7d99-41f4-4ee7-9453-c74a35b52711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:00.480264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f7d99-41f4-4ee7-9453-c74a35b52711 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:00.660331 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1711/3470] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:37:00 2022] POST /identity/v3/projects => generated 371 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:37:00.664871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82aaaa9-b216-42eb-8981-3ed34c1a6ec7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:00.697241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82aaaa9-b216-42eb-8981-3ed34c1a6ec7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:00.828982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36c9e1-7900-4073-9ad8-8129c8005aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:00.829811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36c9e1-7900-4073-9ad8-8129c8005aee admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:00.830246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36c9e1-7900-4073-9ad8-8129c8005aee admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:00.830624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36c9e1-7900-4073-9ad8-8129c8005aee admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:00.831505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36c9e1-7900-4073-9ad8-8129c8005aee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:00.833960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36c9e1-7900-4073-9ad8-8129c8005aee admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:00.944846 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1760/3471] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:37:00 2022] POST /identity/v3/users => generated 286 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:37:00.949251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f7d99-41f4-4ee7-9453-c74a35b52711 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:00.978009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f7d99-41f4-4ee7-9453-c74a35b52711 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:00.984307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ad28f-e99b-4aa5-8e1f-ceccf5859bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:00.984956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ad28f-e99b-4aa5-8e1f-ceccf5859bbb admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:00.985346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ad28f-e99b-4aa5-8e1f-ceccf5859bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:00.985630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ad28f-e99b-4aa5-8e1f-ceccf5859bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:00.986857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ad28f-e99b-4aa5-8e1f-ceccf5859bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:00.989698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ad28f-e99b-4aa5-8e1f-ceccf5859bbb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:01.022433 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1712/3472] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:37:01.023469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36c9e1-7900-4073-9ad8-8129c8005aee admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:01.038567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36c9e1-7900-4073-9ad8-8129c8005aee admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:01.049407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8eb941-41b3-4af8-b74d-fe2f2439d773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:01.050461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8eb941-41b3-4af8-b74d-fe2f2439d773 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:01.050991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8eb941-41b3-4af8-b74d-fe2f2439d773 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:01.051929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8eb941-41b3-4af8-b74d-fe2f2439d773 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:01.052837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8eb941-41b3-4af8-b74d-fe2f2439d773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:01.054775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8eb941-41b3-4af8-b74d-fe2f2439d773 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:01.076890 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1761/3473] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:37:01.081057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ad28f-e99b-4aa5-8e1f-ceccf5859bbb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:01.098567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:01.108805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ad28f-e99b-4aa5-8e1f-ceccf5859bbb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:01.127616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eea9bc-83dd-4dd3-9ece-938a50fbf91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:01.128325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eea9bc-83dd-4dd3-9ece-938a50fbf91b admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:01.128612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eea9bc-83dd-4dd3-9ece-938a50fbf91b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:01.128894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eea9bc-83dd-4dd3-9ece-938a50fbf91b admin admin] PATH_INFO: `/v3/projects/b5d9e5de2b66480fafc7aadead985426/users/e5c7cc81e5fc448581de55b810df0d1b/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:01.168138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eea9bc-83dd-4dd3-9ece-938a50fbf91b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d9e5de2b66480fafc7aadead985426, user_id=e5c7cc81e5fc448581de55b810df0d1b, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:01.170887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eea9bc-83dd-4dd3-9ece-938a50fbf91b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:01.307509 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1713/3474] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:37:01 2022] PUT /identity/v3/projects/b5d9e5de2b66480fafc7aadead985426/users/e5c7cc81e5fc448581de55b810df0d1b/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:37:01.310312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd28a25-ce15-431e-b27b-668dbe8b9b44 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:01.310999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd28a25-ce15-431e-b27b-668dbe8b9b44 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:01.310999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd28a25-ce15-431e-b27b-668dbe8b9b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:01.385965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8bd28a25-ce15-431e-b27b-668dbe8b9b44 None None] MFA Rules not processed for user `e5c7cc81e5fc448581de55b810df0d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:01.389102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8bd28a25-ce15-431e-b27b-668dbe8b9b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:01.432546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:01.513950 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1762/3475] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:37:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:37:01.531704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eea9bc-83dd-4dd3-9ece-938a50fbf91b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:01.536291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c1eea9bc-83dd-4dd3-9ece-938a50fbf91b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:01.662485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eea9bc-83dd-4dd3-9ece-938a50fbf91b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:01.677515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a3a83-b8fa-419c-b57d-44155739504f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:01.679793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a3a83-b8fa-419c-b57d-44155739504f service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:01.683122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a3a83-b8fa-419c-b57d-44155739504f service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:01.683432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a3a83-b8fa-419c-b57d-44155739504f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:01.704771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a3a83-b8fa-419c-b57d-44155739504f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:01.708159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a3a83-b8fa-419c-b57d-44155739504f service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:01.738219 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1714/3476] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:37:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:37:05.447569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd28a25-ce15-431e-b27b-668dbe8b9b44 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:05.700374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd28a25-ce15-431e-b27b-668dbe8b9b44 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:05.717571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a0e7c-2dda-43d9-a992-3a199389c3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:05.718339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a0e7c-2dda-43d9-a992-3a199389c3ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:05.719953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a0e7c-2dda-43d9-a992-3a199389c3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:05.720115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a0e7c-2dda-43d9-a992-3a199389c3ad admin admin] PATH_INFO: `/v3/users/e5c7cc81e5fc448581de55b810df0d1b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:05.725065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a0e7c-2dda-43d9-a992-3a199389c3ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5c7cc81e5fc448581de55b810df0d1b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:05.727919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a0e7c-2dda-43d9-a992-3a199389c3ad admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:06.056912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0d8a0e7c-2dda-43d9-a992-3a199389c3ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5c7cc81e5fc448581de55b810df0d1b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:06.060245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0d8a0e7c-2dda-43d9-a992-3a199389c3ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5c7cc81e5fc448581de55b810df0d1b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:06.086441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0d8a0e7c-2dda-43d9-a992-3a199389c3ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5c7cc81e5fc448581de55b810df0d1b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:06.135139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0d8a0e7c-2dda-43d9-a992-3a199389c3ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5c7cc81e5fc448581de55b810df0d1b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:06.136034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0d8a0e7c-2dda-43d9-a992-3a199389c3ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5c7cc81e5fc448581de55b810df0d1b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:06.351422 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1763/3477] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:37:05 2022] DELETE /identity/v3/users/e5c7cc81e5fc448581de55b810df0d1b => generated 0 bytes in 905 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:37:06.356105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd482d53-80dd-42e4-8266-61578248176a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:06.356105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd482d53-80dd-42e4-8266-61578248176a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:06.356679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd482d53-80dd-42e4-8266-61578248176a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:06.416447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-dd482d53-80dd-42e4-8266-61578248176a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:06.418983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dd482d53-80dd-42e4-8266-61578248176a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:06.601661 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1715/3478] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:37:06.618990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a0e7c-2dda-43d9-a992-3a199389c3ad admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:06.621136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0d8a0e7c-2dda-43d9-a992-3a199389c3ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:06.751794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:06.792825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a0e7c-2dda-43d9-a992-3a199389c3ad admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:06.814287 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da891e-2428-4db8-8fe8-030177e2272e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:06.815021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da891e-2428-4db8-8fe8-030177e2272e service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:06.815307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da891e-2428-4db8-8fe8-030177e2272e service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:06.816257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da891e-2428-4db8-8fe8-030177e2272e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:06.831128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da891e-2428-4db8-8fe8-030177e2272e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:06.843420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da891e-2428-4db8-8fe8-030177e2272e service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:06.848927 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1764/3479] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:37:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:37:07.622577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd482d53-80dd-42e4-8266-61578248176a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:07.624936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dd482d53-80dd-42e4-8266-61578248176a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:07.647198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd482d53-80dd-42e4-8266-61578248176a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:07.659350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582b2b3-ae82-404c-946c-6ecd16e17310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:07.660367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582b2b3-ae82-404c-946c-6ecd16e17310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:07.663100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582b2b3-ae82-404c-946c-6ecd16e17310 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:07.673932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582b2b3-ae82-404c-946c-6ecd16e17310 admin admin] PATH_INFO: `/v3/projects/b5d9e5de2b66480fafc7aadead985426` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:07.673932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582b2b3-ae82-404c-946c-6ecd16e17310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5d9e5de2b66480fafc7aadead985426)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:07.675900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582b2b3-ae82-404c-946c-6ecd16e17310 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:07.886014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d582b2b3-ae82-404c-946c-6ecd16e17310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5d9e5de2b66480fafc7aadead985426', 'request_id': 'req-d582b2b3-ae82-404c-946c-6ecd16e17310'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:08.018792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d582b2b3-ae82-404c-946c-6ecd16e17310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5d9e5de2b66480fafc7aadead985426', 'request_id': 'req-d582b2b3-ae82-404c-946c-6ecd16e17310'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:08.029319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d582b2b3-ae82-404c-946c-6ecd16e17310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5d9e5de2b66480fafc7aadead985426', 'request_id': 'req-d582b2b3-ae82-404c-946c-6ecd16e17310'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:08.031418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:08.053761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d582b2b3-ae82-404c-946c-6ecd16e17310 admin admin] The token cache is being invalidate because project b5d9e5de2b66480fafc7aadead985426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:37:08.056094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d582b2b3-ae82-404c-946c-6ecd16e17310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:08.062087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d582b2b3-ae82-404c-946c-6ecd16e17310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:08.073242 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1716/3480] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:37:07 2022] DELETE /identity/v3/projects/b5d9e5de2b66480fafc7aadead985426 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:37:08.077880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b3ecf-8c5d-4905-90ab-07a8faa5f786 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:08.078430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b3ecf-8c5d-4905-90ab-07a8faa5f786 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:08.078536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b3ecf-8c5d-4905-90ab-07a8faa5f786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:08.118792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c83b3ecf-8c5d-4905-90ab-07a8faa5f786 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:08.120051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c83b3ecf-8c5d-4905-90ab-07a8faa5f786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:08.229764 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1765/3481] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:37:08.231558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059584c-90ad-4d89-939a-bf6c6f91b92c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:08.232096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059584c-90ad-4d89-939a-bf6c6f91b92c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:08.232671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059584c-90ad-4d89-939a-bf6c6f91b92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:08.290306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4059584c-90ad-4d89-939a-bf6c6f91b92c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:08.293315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4059584c-90ad-4d89-939a-bf6c6f91b92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:08.320239 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1717/3482] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:37:08.321756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b3ecf-8c5d-4905-90ab-07a8faa5f786 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:08.346225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b3ecf-8c5d-4905-90ab-07a8faa5f786 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:08.358848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a698db-a1d5-47ac-b663-7873821fd18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:08.360401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a698db-a1d5-47ac-b663-7873821fd18f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:08.361236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a698db-a1d5-47ac-b663-7873821fd18f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:08.361817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a698db-a1d5-47ac-b663-7873821fd18f admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:08.364385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a698db-a1d5-47ac-b663-7873821fd18f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:37:08.365974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a698db-a1d5-47ac-b663-7873821fd18f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:08.370859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a698db-a1d5-47ac-b663-7873821fd18f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:08.402557 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1766/3483] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:37:08.407458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059584c-90ad-4d89-939a-bf6c6f91b92c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:08.418140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059584c-90ad-4d89-939a-bf6c6f91b92c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:08.426059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb59c2-78a1-4e06-8ecb-64b06c76120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:08.427091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb59c2-78a1-4e06-8ecb-64b06c76120e admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:08.427407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb59c2-78a1-4e06-8ecb-64b06c76120e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:08.445490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb59c2-78a1-4e06-8ecb-64b06c76120e admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:08.445490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb59c2-78a1-4e06-8ecb-64b06c76120e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:08.453028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb59c2-78a1-4e06-8ecb-64b06c76120e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:08.611230 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1718/3484] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:37:08 2022] POST /identity/v3/projects => generated 375 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:37:08.612666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a698db-a1d5-47ac-b663-7873821fd18f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:08.626508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a698db-a1d5-47ac-b663-7873821fd18f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:08.727584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab806f-af12-44fe-b109-4938398f8449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:08.728314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab806f-af12-44fe-b109-4938398f8449 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:08.728666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab806f-af12-44fe-b109-4938398f8449 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:08.729044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab806f-af12-44fe-b109-4938398f8449 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:08.730129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab806f-af12-44fe-b109-4938398f8449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:08.733086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab806f-af12-44fe-b109-4938398f8449 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:08.832452 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1767/3485] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:37:08 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:37:08.833861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb59c2-78a1-4e06-8ecb-64b06c76120e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:08.844819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb59c2-78a1-4e06-8ecb-64b06c76120e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:08.850636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9502687-4ad4-4643-be63-e485507584b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:08.851561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9502687-4ad4-4643-be63-e485507584b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:08.851846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9502687-4ad4-4643-be63-e485507584b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:08.852122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9502687-4ad4-4643-be63-e485507584b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:08.853187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9502687-4ad4-4643-be63-e485507584b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:08.854889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9502687-4ad4-4643-be63-e485507584b5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:08.869476 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1719/3486] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:37:08.874134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab806f-af12-44fe-b109-4938398f8449 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:08.885312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab806f-af12-44fe-b109-4938398f8449 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:08.892450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243fc7f-cd33-45d3-ad22-6fff4805c03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:08.892963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243fc7f-cd33-45d3-ad22-6fff4805c03f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:08.893243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243fc7f-cd33-45d3-ad22-6fff4805c03f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:08.893521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243fc7f-cd33-45d3-ad22-6fff4805c03f admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:08.894209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243fc7f-cd33-45d3-ad22-6fff4805c03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:08.895829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243fc7f-cd33-45d3-ad22-6fff4805c03f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:08.910075 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1768/3487] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:37:08.912310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9502687-4ad4-4643-be63-e485507584b5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:08.929375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9502687-4ad4-4643-be63-e485507584b5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:08.934949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f1a1e-02c0-4264-9d93-0d1e5c76e613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:08.935754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f1a1e-02c0-4264-9d93-0d1e5c76e613 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:08.936397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f1a1e-02c0-4264-9d93-0d1e5c76e613 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:08.936911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f1a1e-02c0-4264-9d93-0d1e5c76e613 admin admin] PATH_INFO: `/v3/projects/c52caa270c8d4a0385ddcc13dae2fa90/users/6d8f1c7482ad4bf0896165c50f70ad95/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:08.955274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f1a1e-02c0-4264-9d93-0d1e5c76e613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c52caa270c8d4a0385ddcc13dae2fa90, user_id=6d8f1c7482ad4bf0896165c50f70ad95, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:08.958276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f1a1e-02c0-4264-9d93-0d1e5c76e613 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:09.049642 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1720/3488] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:37:08 2022] PUT /identity/v3/projects/c52caa270c8d4a0385ddcc13dae2fa90/users/6d8f1c7482ad4bf0896165c50f70ad95/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:37:09.133643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f7595-23a6-4a04-b0ae-ad98b93099fb None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:09.135214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f7595-23a6-4a04-b0ae-ad98b93099fb None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:09.135648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f7595-23a6-4a04-b0ae-ad98b93099fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:09.166814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-273f7595-23a6-4a04-b0ae-ad98b93099fb None None] MFA Rules not processed for user `6d8f1c7482ad4bf0896165c50f70ad95`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:09.170200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-273f7595-23a6-4a04-b0ae-ad98b93099fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:09.224245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:09.256443 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1769/3489] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:37:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:37:09.274805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f1a1e-02c0-4264-9d93-0d1e5c76e613 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:09.276964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f7595-23a6-4a04-b0ae-ad98b93099fb None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:09.278973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-273f7595-23a6-4a04-b0ae-ad98b93099fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:09.280831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6a9f1a1e-02c0-4264-9d93-0d1e5c76e613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:09.372829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f7595-23a6-4a04-b0ae-ad98b93099fb None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:09.378705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046a35a-8b77-4473-ba5a-d6c84ea68d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:09.379361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046a35a-8b77-4473-ba5a-d6c84ea68d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:09.379627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046a35a-8b77-4473-ba5a-d6c84ea68d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:09.379900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046a35a-8b77-4473-ba5a-d6c84ea68d7d admin admin] PATH_INFO: `/v3/users/8d5d3f1bf1af4cd6884297b207597fcc` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:09.381081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046a35a-8b77-4473-ba5a-d6c84ea68d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d5d3f1bf1af4cd6884297b207597fcc)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:09.383077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046a35a-8b77-4473-ba5a-d6c84ea68d7d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:09.398191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f1a1e-02c0-4264-9d93-0d1e5c76e613 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:09.404315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e712de-d6c5-49fb-b55f-eb8946114433 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:09.404923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e712de-d6c5-49fb-b55f-eb8946114433 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:09.405205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e712de-d6c5-49fb-b55f-eb8946114433 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:09.405481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e712de-d6c5-49fb-b55f-eb8946114433 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:09.415763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e712de-d6c5-49fb-b55f-eb8946114433 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:09.416127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e712de-d6c5-49fb-b55f-eb8946114433 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:09.426012 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1721/3490] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:37:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:37:09.689276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8046a35a-8b77-4473-ba5a-d6c84ea68d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d5d3f1bf1af4cd6884297b207597fcc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:09.689985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8046a35a-8b77-4473-ba5a-d6c84ea68d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d5d3f1bf1af4cd6884297b207597fcc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:09.697114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8046a35a-8b77-4473-ba5a-d6c84ea68d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d5d3f1bf1af4cd6884297b207597fcc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:09.710611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8046a35a-8b77-4473-ba5a-d6c84ea68d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d5d3f1bf1af4cd6884297b207597fcc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:09.711298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8046a35a-8b77-4473-ba5a-d6c84ea68d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d5d3f1bf1af4cd6884297b207597fcc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:09.839365 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1770/3491] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:37:09 2022] DELETE /identity/v3/users/8d5d3f1bf1af4cd6884297b207597fcc => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:37:10.247940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e712de-d6c5-49fb-b55f-eb8946114433 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:10.259610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e712de-d6c5-49fb-b55f-eb8946114433 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:10.345077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8815a9b-7112-4529-8ff6-899dbfc64476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:10.345711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8815a9b-7112-4529-8ff6-899dbfc64476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:10.346318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8815a9b-7112-4529-8ff6-899dbfc64476 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:10.346428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8815a9b-7112-4529-8ff6-899dbfc64476 admin admin] PATH_INFO: `/v3/projects/e3a1ba64cf9c47d5bdae52477338099e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:10.347509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8815a9b-7112-4529-8ff6-899dbfc64476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3a1ba64cf9c47d5bdae52477338099e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:10.349418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8815a9b-7112-4529-8ff6-899dbfc64476 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:10.361560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:10.501197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c8815a9b-7112-4529-8ff6-899dbfc64476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3a1ba64cf9c47d5bdae52477338099e', 'request_id': 'req-c8815a9b-7112-4529-8ff6-899dbfc64476'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:10.568368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c8815a9b-7112-4529-8ff6-899dbfc64476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3a1ba64cf9c47d5bdae52477338099e', 'request_id': 'req-c8815a9b-7112-4529-8ff6-899dbfc64476'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:10.576097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c8815a9b-7112-4529-8ff6-899dbfc64476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3a1ba64cf9c47d5bdae52477338099e', 'request_id': 'req-c8815a9b-7112-4529-8ff6-899dbfc64476'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:10.588668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c8815a9b-7112-4529-8ff6-899dbfc64476 admin admin] The token cache is being invalidate because project e3a1ba64cf9c47d5bdae52477338099e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:37:10.588958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c8815a9b-7112-4529-8ff6-899dbfc64476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:10.589620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c8815a9b-7112-4529-8ff6-899dbfc64476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:10.591528 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1722/3492] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:37:10 2022] DELETE /identity/v3/projects/e3a1ba64cf9c47d5bdae52477338099e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:37:10.596437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48029d97-6c12-4d86-94e2-d043892cf961 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:10.597645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48029d97-6c12-4d86-94e2-d043892cf961 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:10.598195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48029d97-6c12-4d86-94e2-d043892cf961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:10.621473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-48029d97-6c12-4d86-94e2-d043892cf961 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:10.623465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-48029d97-6c12-4d86-94e2-d043892cf961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:10.708698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:10.720020 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1771/3493] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:37:10.727858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a149b-51df-4400-ba0f-f8f5ce67bdae None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:10.728150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a149b-51df-4400-ba0f-f8f5ce67bdae None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:10.728422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a149b-51df-4400-ba0f-f8f5ce67bdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:10.755515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8f1a149b-51df-4400-ba0f-f8f5ce67bdae None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:10.756622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8f1a149b-51df-4400-ba0f-f8f5ce67bdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:10.765564 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1723/3494] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:37:10.770087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48029d97-6c12-4d86-94e2-d043892cf961 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:10.780733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48029d97-6c12-4d86-94e2-d043892cf961 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:10.786000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfedff3-cd20-4410-a2f8-5dad2584b314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:10.786856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfedff3-cd20-4410-a2f8-5dad2584b314 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:10.787299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfedff3-cd20-4410-a2f8-5dad2584b314 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:10.787748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfedff3-cd20-4410-a2f8-5dad2584b314 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:10.788899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfedff3-cd20-4410-a2f8-5dad2584b314 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:37:10.789247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfedff3-cd20-4410-a2f8-5dad2584b314 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:10.791162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfedff3-cd20-4410-a2f8-5dad2584b314 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:10.804052 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1772/3495] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:37:10.808471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a149b-51df-4400-ba0f-f8f5ce67bdae None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:10.819083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a149b-51df-4400-ba0f-f8f5ce67bdae None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:10.824829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cba3f2-ecac-4166-859d-67354e6eb6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:10.825425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cba3f2-ecac-4166-859d-67354e6eb6a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:10.825702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cba3f2-ecac-4166-859d-67354e6eb6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:10.826200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cba3f2-ecac-4166-859d-67354e6eb6a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:10.827035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cba3f2-ecac-4166-859d-67354e6eb6a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:10.829372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cba3f2-ecac-4166-859d-67354e6eb6a5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:10.975741 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1724/3496] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:37:10 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:37:10.979962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfedff3-cd20-4410-a2f8-5dad2584b314 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:10.991459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfedff3-cd20-4410-a2f8-5dad2584b314 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:11.055615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc2abd-c0a5-4ae2-aff7-59097f7e80ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:11.056254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc2abd-c0a5-4ae2-aff7-59097f7e80ba admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:11.056549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc2abd-c0a5-4ae2-aff7-59097f7e80ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:11.056837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc2abd-c0a5-4ae2-aff7-59097f7e80ba admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:11.057488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc2abd-c0a5-4ae2-aff7-59097f7e80ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:11.059821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc2abd-c0a5-4ae2-aff7-59097f7e80ba admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:11.171232 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1773/3497] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:37:10 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:37:11.175687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cba3f2-ecac-4166-859d-67354e6eb6a5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:11.216200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cba3f2-ecac-4166-859d-67354e6eb6a5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:11.227391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba293df-2be1-4ace-9aa9-f433168ae97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:11.228906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba293df-2be1-4ace-9aa9-f433168ae97e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:11.229636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba293df-2be1-4ace-9aa9-f433168ae97e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:11.230157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba293df-2be1-4ace-9aa9-f433168ae97e admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:11.231216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba293df-2be1-4ace-9aa9-f433168ae97e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:11.233643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba293df-2be1-4ace-9aa9-f433168ae97e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:11.260484 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1725/3498] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:37:11.262008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc2abd-c0a5-4ae2-aff7-59097f7e80ba admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:11.274283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc2abd-c0a5-4ae2-aff7-59097f7e80ba admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:11.286867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70099021-b44c-4394-b95d-b7ee8e9ddf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:11.287911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70099021-b44c-4394-b95d-b7ee8e9ddf68 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:11.288373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70099021-b44c-4394-b95d-b7ee8e9ddf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:11.288807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70099021-b44c-4394-b95d-b7ee8e9ddf68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:11.289626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70099021-b44c-4394-b95d-b7ee8e9ddf68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:11.291793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70099021-b44c-4394-b95d-b7ee8e9ddf68 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:11.306770 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1774/3499] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:37:11.310951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba293df-2be1-4ace-9aa9-f433168ae97e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:11.326287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba293df-2be1-4ace-9aa9-f433168ae97e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:11.332720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e59a6-ace9-46a8-b8c6-011eae4e47f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:11.336184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e59a6-ace9-46a8-b8c6-011eae4e47f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:11.336184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e59a6-ace9-46a8-b8c6-011eae4e47f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:11.336184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e59a6-ace9-46a8-b8c6-011eae4e47f4 admin admin] PATH_INFO: `/v3/projects/911997e881754ce390af17919f29b4ab/users/b1cc79af058b4c35b3c572448fac86a7/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:11.352115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e59a6-ace9-46a8-b8c6-011eae4e47f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=911997e881754ce390af17919f29b4ab, user_id=b1cc79af058b4c35b3c572448fac86a7, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:11.355587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e59a6-ace9-46a8-b8c6-011eae4e47f4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:11.494170 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1726/3500] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:37:11 2022] PUT /identity/v3/projects/911997e881754ce390af17919f29b4ab/users/b1cc79af058b4c35b3c572448fac86a7/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:37:11.499388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3da43-e448-4600-b84e-ab4c8b6d8788 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:11.499685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3da43-e448-4600-b84e-ab4c8b6d8788 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:11.499959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3da43-e448-4600-b84e-ab4c8b6d8788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:11.519029 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f8d3da43-e448-4600-b84e-ab4c8b6d8788 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:11.520142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f8d3da43-e448-4600-b84e-ab4c8b6d8788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:11.578644 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1775/3501] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:37:11.588641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e59a6-ace9-46a8-b8c6-011eae4e47f4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:11.590606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b55e59a6-ace9-46a8-b8c6-011eae4e47f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:11.649929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e59a6-ace9-46a8-b8c6-011eae4e47f4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:11.653582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4101d-0075-475a-a363-72838b99a34a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:11.654227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4101d-0075-475a-a363-72838b99a34a service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:11.654511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4101d-0075-475a-a363-72838b99a34a service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:11.654786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4101d-0075-475a-a363-72838b99a34a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:11.663678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4101d-0075-475a-a363-72838b99a34a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:11.665117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4101d-0075-475a-a363-72838b99a34a service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:11.675681 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1727/3502] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:37:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:37:13.020993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3da43-e448-4600-b84e-ab4c8b6d8788 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:13.023494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f8d3da43-e448-4600-b84e-ab4c8b6d8788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:13.043025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3da43-e448-4600-b84e-ab4c8b6d8788 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:13.048249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47176de6-9773-4ed5-89fb-35f96a912b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:13.048915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47176de6-9773-4ed5-89fb-35f96a912b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:13.049200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47176de6-9773-4ed5-89fb-35f96a912b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:13.049478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47176de6-9773-4ed5-89fb-35f96a912b72 admin admin] PATH_INFO: `/v3/users/6d8f1c7482ad4bf0896165c50f70ad95` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:13.050667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47176de6-9773-4ed5-89fb-35f96a912b72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d8f1c7482ad4bf0896165c50f70ad95)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:13.052598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47176de6-9773-4ed5-89fb-35f96a912b72 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:13.276104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-47176de6-9773-4ed5-89fb-35f96a912b72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d8f1c7482ad4bf0896165c50f70ad95'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:13.276781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-47176de6-9773-4ed5-89fb-35f96a912b72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d8f1c7482ad4bf0896165c50f70ad95'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:13.286374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-47176de6-9773-4ed5-89fb-35f96a912b72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d8f1c7482ad4bf0896165c50f70ad95'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:13.298756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:13.300822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-47176de6-9773-4ed5-89fb-35f96a912b72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d8f1c7482ad4bf0896165c50f70ad95'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:13.301600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-47176de6-9773-4ed5-89fb-35f96a912b72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d8f1c7482ad4bf0896165c50f70ad95'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:13.451391 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1776/3503] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:37:13 2022] DELETE /identity/v3/users/6d8f1c7482ad4bf0896165c50f70ad95 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:37:13.456613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638fcfe-d1a7-4f77-85a1-0ad9bd4855c4 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:13.459142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638fcfe-d1a7-4f77-85a1-0ad9bd4855c4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:13.459142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638fcfe-d1a7-4f77-85a1-0ad9bd4855c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:13.510401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1638fcfe-d1a7-4f77-85a1-0ad9bd4855c4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:13.512363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1638fcfe-d1a7-4f77-85a1-0ad9bd4855c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:13.582229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:13.629788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47176de6-9773-4ed5-89fb-35f96a912b72 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:13.631379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-47176de6-9773-4ed5-89fb-35f96a912b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:13.672172 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1728/3504] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:37:13.693575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638fcfe-d1a7-4f77-85a1-0ad9bd4855c4 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:13.695625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1638fcfe-d1a7-4f77-85a1-0ad9bd4855c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:13.771813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47176de6-9773-4ed5-89fb-35f96a912b72 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:13.786105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b8699-07fb-4b88-ae77-b0e5b87ef91c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:13.787071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b8699-07fb-4b88-ae77-b0e5b87ef91c service glance] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:13.787521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b8699-07fb-4b88-ae77-b0e5b87ef91c service glance] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:13.787973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b8699-07fb-4b88-ae77-b0e5b87ef91c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:13.798708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bd6b8699-07fb-4b88-ae77-b0e5b87ef91c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:13.804445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638fcfe-d1a7-4f77-85a1-0ad9bd4855c4 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:13.814754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e3d06-089c-4ce5-a2c8-15269bc10e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:13.818851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e3d06-089c-4ce5-a2c8-15269bc10e6b service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:13.821749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e3d06-089c-4ce5-a2c8-15269bc10e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:13.821749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e3d06-089c-4ce5-a2c8-15269bc10e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:13.838350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e3d06-089c-4ce5-a2c8-15269bc10e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:13.841903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e3d06-089c-4ce5-a2c8-15269bc10e6b service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:13.866264 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1729/3505] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:37:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:37:13.933548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b8699-07fb-4b88-ae77-b0e5b87ef91c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:13.935520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b8699-07fb-4b88-ae77-b0e5b87ef91c service glance] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:13.952628 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1777/3506] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:37:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:37:14.316121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e3d06-089c-4ce5-a2c8-15269bc10e6b service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:14.338427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8b9e3d06-089c-4ce5-a2c8-15269bc10e6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:14.343945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e3d06-089c-4ce5-a2c8-15269bc10e6b service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:14.371127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d69f99-941c-4c11-9f80-5f9fb6e7deff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:14.373703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d69f99-941c-4c11-9f80-5f9fb6e7deff service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:14.373703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d69f99-941c-4c11-9f80-5f9fb6e7deff service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:14.373703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d69f99-941c-4c11-9f80-5f9fb6e7deff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:14.388560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-76d69f99-941c-4c11-9f80-5f9fb6e7deff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:14.410891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d69f99-941c-4c11-9f80-5f9fb6e7deff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:14.412401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d69f99-941c-4c11-9f80-5f9fb6e7deff service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:14.435268 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1730/3507] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:37:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:37:15.859634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b8699-07fb-4b88-ae77-b0e5b87ef91c service glance] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:15.862575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bd6b8699-07fb-4b88-ae77-b0e5b87ef91c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:15.884865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b8699-07fb-4b88-ae77-b0e5b87ef91c service glance] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:15.890213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80604616-e1b0-4b54-8238-634491b90f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:15.891160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80604616-e1b0-4b54-8238-634491b90f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:15.891593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80604616-e1b0-4b54-8238-634491b90f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:15.891923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80604616-e1b0-4b54-8238-634491b90f01 admin admin] PATH_INFO: `/v3/projects/c52caa270c8d4a0385ddcc13dae2fa90` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:15.895469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80604616-e1b0-4b54-8238-634491b90f01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c52caa270c8d4a0385ddcc13dae2fa90)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:15.899626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80604616-e1b0-4b54-8238-634491b90f01 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:16.129822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-80604616-e1b0-4b54-8238-634491b90f01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c52caa270c8d4a0385ddcc13dae2fa90', 'request_id': 'req-80604616-e1b0-4b54-8238-634491b90f01'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:16.137205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-80604616-e1b0-4b54-8238-634491b90f01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c52caa270c8d4a0385ddcc13dae2fa90', 'request_id': 'req-80604616-e1b0-4b54-8238-634491b90f01'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:16.146852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-80604616-e1b0-4b54-8238-634491b90f01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c52caa270c8d4a0385ddcc13dae2fa90', 'request_id': 'req-80604616-e1b0-4b54-8238-634491b90f01'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:16.255780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:16.261499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-80604616-e1b0-4b54-8238-634491b90f01 admin admin] The token cache is being invalidate because project c52caa270c8d4a0385ddcc13dae2fa90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:37:16.261499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-80604616-e1b0-4b54-8238-634491b90f01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:16.261954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-80604616-e1b0-4b54-8238-634491b90f01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:16.263835 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1778/3508] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:37:15 2022] DELETE /identity/v3/projects/c52caa270c8d4a0385ddcc13dae2fa90 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:37:16.269008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49ae5a-560a-4347-8245-95257b80907f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:16.269622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49ae5a-560a-4347-8245-95257b80907f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:16.269622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49ae5a-560a-4347-8245-95257b80907f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:16.306729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0d49ae5a-560a-4347-8245-95257b80907f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:16.308010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0d49ae5a-560a-4347-8245-95257b80907f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:16.409046 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1731/3509] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:37:16.411134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fc89a-b6f2-4975-95c0-21ad85531fe4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:16.411679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fc89a-b6f2-4975-95c0-21ad85531fe4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:16.412149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fc89a-b6f2-4975-95c0-21ad85531fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:16.445958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2c0fc89a-b6f2-4975-95c0-21ad85531fe4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:16.448357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2c0fc89a-b6f2-4975-95c0-21ad85531fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:16.481634 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1779/3510] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:37:16.483199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49ae5a-560a-4347-8245-95257b80907f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:16.503635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49ae5a-560a-4347-8245-95257b80907f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:16.515430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d90128-7f05-4df0-976b-c2b0d6d0dac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:16.516538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d90128-7f05-4df0-976b-c2b0d6d0dac4 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:16.516965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d90128-7f05-4df0-976b-c2b0d6d0dac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:16.517415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d90128-7f05-4df0-976b-c2b0d6d0dac4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:16.518382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d90128-7f05-4df0-976b-c2b0d6d0dac4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:37:16.518796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d90128-7f05-4df0-976b-c2b0d6d0dac4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:16.523203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d90128-7f05-4df0-976b-c2b0d6d0dac4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:16.555830 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1732/3511] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:37:16.557013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fc89a-b6f2-4975-95c0-21ad85531fe4 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:16.569427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fc89a-b6f2-4975-95c0-21ad85531fe4 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:16.581731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e417de-57dd-4b14-b476-becc6f343661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:16.582603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e417de-57dd-4b14-b476-becc6f343661 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:16.583045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e417de-57dd-4b14-b476-becc6f343661 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:16.583151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e417de-57dd-4b14-b476-becc6f343661 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:16.583786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e417de-57dd-4b14-b476-becc6f343661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:16.585711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e417de-57dd-4b14-b476-becc6f343661 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:16.681920 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1780/3512] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:37:16 2022] POST /identity/v3/projects => generated 403 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:37:16.686905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d90128-7f05-4df0-976b-c2b0d6d0dac4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:16.702636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d90128-7f05-4df0-976b-c2b0d6d0dac4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:16.810240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:16.827519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297154f-e0a1-4959-93de-243ed6025f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:16.828204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297154f-e0a1-4959-93de-243ed6025f35 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:16.828490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297154f-e0a1-4959-93de-243ed6025f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:16.828767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297154f-e0a1-4959-93de-243ed6025f35 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:16.829410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297154f-e0a1-4959-93de-243ed6025f35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:16.834850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297154f-e0a1-4959-93de-243ed6025f35 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:17.020894 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1733/3513] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:37:16 2022] POST /identity/v3/users => generated 302 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:37:17.022067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e417de-57dd-4b14-b476-becc6f343661 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:17.036827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e417de-57dd-4b14-b476-becc6f343661 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:17.049839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72059119-d50b-43a5-b760-f6c915a022f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:17.050873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72059119-d50b-43a5-b760-f6c915a022f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:17.059735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72059119-d50b-43a5-b760-f6c915a022f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:17.059735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72059119-d50b-43a5-b760-f6c915a022f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:17.059735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72059119-d50b-43a5-b760-f6c915a022f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:17.059735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72059119-d50b-43a5-b760-f6c915a022f7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:17.075357 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1781/3514] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:37:17.079478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297154f-e0a1-4959-93de-243ed6025f35 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:17.095331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297154f-e0a1-4959-93de-243ed6025f35 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:17.111705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14a894-cfdd-432e-85d7-cbcc7bfab011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:17.112562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14a894-cfdd-432e-85d7-cbcc7bfab011 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:17.113045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14a894-cfdd-432e-85d7-cbcc7bfab011 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:17.113490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14a894-cfdd-432e-85d7-cbcc7bfab011 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:17.114691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b14a894-cfdd-432e-85d7-cbcc7bfab011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:17.117720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b14a894-cfdd-432e-85d7-cbcc7bfab011 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:17.133670 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1734/3515] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:37:17.135499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72059119-d50b-43a5-b760-f6c915a022f7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:17.153966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72059119-d50b-43a5-b760-f6c915a022f7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:17.159956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e7e06-29ed-4eda-b92f-9020a7a611ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:17.160913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e7e06-29ed-4eda-b92f-9020a7a611ab admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:17.162104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e7e06-29ed-4eda-b92f-9020a7a611ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:17.162581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e7e06-29ed-4eda-b92f-9020a7a611ab admin admin] PATH_INFO: `/v3/projects/3ab3d7ec4d294c8fbbb0c19559accba1/users/cbfbad32b0c64e98a852e16cc3acd654/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:17.229869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e7e06-29ed-4eda-b92f-9020a7a611ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ab3d7ec4d294c8fbbb0c19559accba1, user_id=cbfbad32b0c64e98a852e16cc3acd654, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:17.250974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e7e06-29ed-4eda-b92f-9020a7a611ab admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:17.335701 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1782/3516] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:37:17 2022] PUT /identity/v3/projects/3ab3d7ec4d294c8fbbb0c19559accba1/users/cbfbad32b0c64e98a852e16cc3acd654/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:37:17.343098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82255b95-400c-4013-9802-8649b213b889 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:17.343656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82255b95-400c-4013-9802-8649b213b889 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:17.343781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82255b95-400c-4013-9802-8649b213b889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:17.384809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-82255b95-400c-4013-9802-8649b213b889 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:17.388277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-82255b95-400c-4013-9802-8649b213b889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:17.512361 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1735/3517] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:37:17.546696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e7e06-29ed-4eda-b92f-9020a7a611ab admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:17.549587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-317e7e06-29ed-4eda-b92f-9020a7a611ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:17.663475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e7e06-29ed-4eda-b92f-9020a7a611ab admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:17.676403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72321e50-d44f-4cdd-a10d-93ad58cb72b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:17.677745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72321e50-d44f-4cdd-a10d-93ad58cb72b1 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:17.679878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72321e50-d44f-4cdd-a10d-93ad58cb72b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:17.679878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72321e50-d44f-4cdd-a10d-93ad58cb72b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:17.700750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72321e50-d44f-4cdd-a10d-93ad58cb72b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:17.706862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72321e50-d44f-4cdd-a10d-93ad58cb72b1 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:17.749540 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1783/3518] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:37:20.861419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fd315-3b1b-423b-a2ad-15ad2ad386b7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:20.861836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fd315-3b1b-423b-a2ad-15ad2ad386b7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:20.862080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fd315-3b1b-423b-a2ad-15ad2ad386b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:20.906608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a60fd315-3b1b-423b-a2ad-15ad2ad386b7 None None] MFA Rules not processed for user `18036411a99e4634bfbaeae24b9f254d`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:20.908310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a60fd315-3b1b-423b-a2ad-15ad2ad386b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:21.004916 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1736/3519] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:37:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:37:21.835541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72321e50-d44f-4cdd-a10d-93ad58cb72b1 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:21.842285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-72321e50-d44f-4cdd-a10d-93ad58cb72b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:21.873999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72321e50-d44f-4cdd-a10d-93ad58cb72b1 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:21.893995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a9cbb-b447-4f63-a839-625e7a914ae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:21.894666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a9cbb-b447-4f63-a839-625e7a914ae0 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:21.894967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a9cbb-b447-4f63-a839-625e7a914ae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:21.895235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a9cbb-b447-4f63-a839-625e7a914ae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:21.901337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ea9a9cbb-b447-4f63-a839-625e7a914ae0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:21.920885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a9cbb-b447-4f63-a839-625e7a914ae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:21.922644 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a9cbb-b447-4f63-a839-625e7a914ae0 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:21.942390 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1784/3520] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:37:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:37:24.723717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68956ec-e407-420d-be7a-f9a817db061e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:24.725168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68956ec-e407-420d-be7a-f9a817db061e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:24.725624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68956ec-e407-420d-be7a-f9a817db061e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:24.776109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b68956ec-e407-420d-be7a-f9a817db061e None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:24.778465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b68956ec-e407-420d-be7a-f9a817db061e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:24.892845 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1737/3521] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:37:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:37:24.927993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a9cbb-b447-4f63-a839-625e7a914ae0 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:24.929770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ea9a9cbb-b447-4f63-a839-625e7a914ae0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:25.036868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a9cbb-b447-4f63-a839-625e7a914ae0 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:25.044839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e0bd3-bc20-4228-af97-42ccaa679d5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:25.045688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e0bd3-bc20-4228-af97-42ccaa679d5b service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:25.046164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e0bd3-bc20-4228-af97-42ccaa679d5b service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:25.046718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e0bd3-bc20-4228-af97-42ccaa679d5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:25.058070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e0bd3-bc20-4228-af97-42ccaa679d5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:25.060932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e0bd3-bc20-4228-af97-42ccaa679d5b service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:25.072376 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1785/3522] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:37:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:37:27.387526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d80ea3-94b3-482a-b84b-fe84ceca1f25 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:27.388001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d80ea3-94b3-482a-b84b-fe84ceca1f25 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:27.388095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d80ea3-94b3-482a-b84b-fe84ceca1f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:27.469761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c3d80ea3-94b3-482a-b84b-fe84ceca1f25 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:27.474883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c3d80ea3-94b3-482a-b84b-fe84ceca1f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:27.505113 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1738/3523] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:37:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:37:27.518087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e0bd3-bc20-4228-af97-42ccaa679d5b service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:27.537572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e0bd3-bc20-4228-af97-42ccaa679d5b service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:27.553894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641906a-3c97-4721-87fb-2c0eb21a9415 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:27.556064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641906a-3c97-4721-87fb-2c0eb21a9415 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:27.557222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641906a-3c97-4721-87fb-2c0eb21a9415 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:27.557521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641906a-3c97-4721-87fb-2c0eb21a9415 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:27.581607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641906a-3c97-4721-87fb-2c0eb21a9415 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:27.584615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641906a-3c97-4721-87fb-2c0eb21a9415 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:27.602336 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1786/3524] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:37:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:37:32.209617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40765d3c-90ba-4810-9b6a-0f4e5b2ccc88 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:32.210644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40765d3c-90ba-4810-9b6a-0f4e5b2ccc88 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:32.211510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40765d3c-90ba-4810-9b6a-0f4e5b2ccc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:32.216973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574d2d1-931b-4d91-8427-052b6c48708c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:32.218017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574d2d1-931b-4d91-8427-052b6c48708c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:32.218781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574d2d1-931b-4d91-8427-052b6c48708c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:32.229892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:32.271364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-40765d3c-90ba-4810-9b6a-0f4e5b2ccc88 None None] MFA Rules not processed for user `88497702ee824799952e4bcd583ee367`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:32.271364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-40765d3c-90ba-4810-9b6a-0f4e5b2ccc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:32.316796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:32.331675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2574d2d1-931b-4d91-8427-052b6c48708c None None] MFA Rules not processed for user `b1cc79af058b4c35b3c572448fac86a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:32.334773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2574d2d1-931b-4d91-8427-052b6c48708c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:32.446647 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1739/3525] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:37:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:37:32.460744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07916f3-93a8-4a5c-a15c-54b1e202dedf None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:32.461034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07916f3-93a8-4a5c-a15c-54b1e202dedf None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:32.461317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07916f3-93a8-4a5c-a15c-54b1e202dedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:32.544966 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1787/3526] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:37:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:37:32.551390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a07916f3-93a8-4a5c-a15c-54b1e202dedf None None] MFA Rules not processed for user `88497702ee824799952e4bcd583ee367`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:32.552440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4932e4a-0c1a-4347-b62a-87a545059fae None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:32.552719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4932e4a-0c1a-4347-b62a-87a545059fae None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:32.552860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a07916f3-93a8-4a5c-a15c-54b1e202dedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:32.553016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4932e4a-0c1a-4347-b62a-87a545059fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:32.604459 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1740/3527] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:37:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:37:32.608878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f4932e4a-0c1a-4347-b62a-87a545059fae None None] MFA Rules not processed for user `b1cc79af058b4c35b3c572448fac86a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:32.610332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f4932e4a-0c1a-4347-b62a-87a545059fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:32.630201 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1788/3528] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:37:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:37:33.135519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07916f3-93a8-4a5c-a15c-54b1e202dedf None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:33.137021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a07916f3-93a8-4a5c-a15c-54b1e202dedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:33.457289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07916f3-93a8-4a5c-a15c-54b1e202dedf None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:33.457289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61088e-0c59-49df-ad98-41a864bd314b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:33.457289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61088e-0c59-49df-ad98-41a864bd314b service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:33.457289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61088e-0c59-49df-ad98-41a864bd314b service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:33.458731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61088e-0c59-49df-ad98-41a864bd314b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:33.491033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61088e-0c59-49df-ad98-41a864bd314b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:33.499807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61088e-0c59-49df-ad98-41a864bd314b service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:33.535646 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1741/3529] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:37:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:37:38.768865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6d04f-9a7a-4183-a458-fbff70dd6eb8 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:38.770007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6d04f-9a7a-4183-a458-fbff70dd6eb8 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:38.770531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6d04f-9a7a-4183-a458-fbff70dd6eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:38.832299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-eeb6d04f-9a7a-4183-a458-fbff70dd6eb8 None None] MFA Rules not processed for user `cbfbad32b0c64e98a852e16cc3acd654`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:38.838243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-eeb6d04f-9a7a-4183-a458-fbff70dd6eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:38.937125 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1789/3530] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:37:38 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:37:39.143883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61088e-0c59-49df-ad98-41a864bd314b service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:39.163580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7d61088e-0c59-49df-ad98-41a864bd314b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:39.214091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61088e-0c59-49df-ad98-41a864bd314b service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:39.232624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628b335-f8db-4947-a111-e648e835b1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:39.233684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628b335-f8db-4947-a111-e648e835b1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:39.234215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628b335-f8db-4947-a111-e648e835b1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:39.234689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628b335-f8db-4947-a111-e648e835b1fd admin admin] PATH_INFO: `/v3/users/5c36bef85ac34b4983a79e03c56965c5` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:39.236117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628b335-f8db-4947-a111-e648e835b1fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c36bef85ac34b4983a79e03c56965c5)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:39.238421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628b335-f8db-4947-a111-e648e835b1fd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:39.527057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5628b335-f8db-4947-a111-e648e835b1fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c36bef85ac34b4983a79e03c56965c5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:39.531789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5628b335-f8db-4947-a111-e648e835b1fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c36bef85ac34b4983a79e03c56965c5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:39.557641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5628b335-f8db-4947-a111-e648e835b1fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c36bef85ac34b4983a79e03c56965c5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:39.585898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5628b335-f8db-4947-a111-e648e835b1fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c36bef85ac34b4983a79e03c56965c5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:39.697945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5628b335-f8db-4947-a111-e648e835b1fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c36bef85ac34b4983a79e03c56965c5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:39.706100 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1742/3531] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:37:39 2022] DELETE /identity/v3/users/5c36bef85ac34b4983a79e03c56965c5 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:37:40.159102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6d04f-9a7a-4183-a458-fbff70dd6eb8 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:40.185947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6d04f-9a7a-4183-a458-fbff70dd6eb8 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:40.305945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600a430-b990-4d8d-aacd-24bc0c5032a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:40.309508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600a430-b990-4d8d-aacd-24bc0c5032a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:40.309779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600a430-b990-4d8d-aacd-24bc0c5032a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:40.310076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600a430-b990-4d8d-aacd-24bc0c5032a7 admin admin] PATH_INFO: `/v3/projects/2e58f30136ed4a4d9bff48e9b4cde5a8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:40.313572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600a430-b990-4d8d-aacd-24bc0c5032a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e58f30136ed4a4d9bff48e9b4cde5a8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:40.316645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600a430-b990-4d8d-aacd-24bc0c5032a7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:40.358051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:40.509570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e600a430-b990-4d8d-aacd-24bc0c5032a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'request_id': 'req-e600a430-b990-4d8d-aacd-24bc0c5032a7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:40.525497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e600a430-b990-4d8d-aacd-24bc0c5032a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'request_id': 'req-e600a430-b990-4d8d-aacd-24bc0c5032a7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:40.535836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e600a430-b990-4d8d-aacd-24bc0c5032a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'request_id': 'req-e600a430-b990-4d8d-aacd-24bc0c5032a7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:40.619524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e600a430-b990-4d8d-aacd-24bc0c5032a7 admin admin] The token cache is being invalidate because project 2e58f30136ed4a4d9bff48e9b4cde5a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:37:40.620229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e600a430-b990-4d8d-aacd-24bc0c5032a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:40.621705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e600a430-b990-4d8d-aacd-24bc0c5032a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:37:40.627573 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1790/3532] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:37:40 2022] DELETE /identity/v3/projects/2e58f30136ed4a4d9bff48e9b4cde5a8 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:37:40.633128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dac859-c405-4992-bfb4-c1f21a5b855f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:40.638712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dac859-c405-4992-bfb4-c1f21a5b855f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:40.638712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dac859-c405-4992-bfb4-c1f21a5b855f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:40.694652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-82dac859-c405-4992-bfb4-c1f21a5b855f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:40.696455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-82dac859-c405-4992-bfb4-c1f21a5b855f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:40.716612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:40.868200 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1743/3533] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:37:40.876866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58bc81-e5de-431e-8d7d-c02ef650411d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:40.877554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58bc81-e5de-431e-8d7d-c02ef650411d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:40.878102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58bc81-e5de-431e-8d7d-c02ef650411d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:40.905324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8c58bc81-e5de-431e-8d7d-c02ef650411d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:40.907005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8c58bc81-e5de-431e-8d7d-c02ef650411d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:40.932404 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1791/3534] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:37:40.937178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dac859-c405-4992-bfb4-c1f21a5b855f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:40.957434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dac859-c405-4992-bfb4-c1f21a5b855f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:40.963053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005da3f-82ea-4c13-aa6d-814d0892fc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:40.963974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005da3f-82ea-4c13-aa6d-814d0892fc10 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:40.964491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005da3f-82ea-4c13-aa6d-814d0892fc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:40.965516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005da3f-82ea-4c13-aa6d-814d0892fc10 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:40.966546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005da3f-82ea-4c13-aa6d-814d0892fc10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:37:40.967261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005da3f-82ea-4c13-aa6d-814d0892fc10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:40.972262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005da3f-82ea-4c13-aa6d-814d0892fc10 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:40.993255 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1744/3535] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:37:40.998101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58bc81-e5de-431e-8d7d-c02ef650411d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:41.011312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58bc81-e5de-431e-8d7d-c02ef650411d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:41.024409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ee21b-cc69-4720-8d6d-7d242a9bd760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:41.025211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ee21b-cc69-4720-8d6d-7d242a9bd760 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:41.025574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ee21b-cc69-4720-8d6d-7d242a9bd760 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:41.028734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ee21b-cc69-4720-8d6d-7d242a9bd760 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:41.029766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ee21b-cc69-4720-8d6d-7d242a9bd760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:41.032844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ee21b-cc69-4720-8d6d-7d242a9bd760 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:41.180256 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1792/3536] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:37:40 2022] POST /identity/v3/projects => generated 397 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:37:41.187974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005da3f-82ea-4c13-aa6d-814d0892fc10 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:41.209276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005da3f-82ea-4c13-aa6d-814d0892fc10 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:41.367396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80090d-8151-42bb-bb85-021f2f084f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:41.368067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80090d-8151-42bb-bb85-021f2f084f74 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:41.368253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80090d-8151-42bb-bb85-021f2f084f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:41.368472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80090d-8151-42bb-bb85-021f2f084f74 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:41.369128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80090d-8151-42bb-bb85-021f2f084f74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:41.380933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80090d-8151-42bb-bb85-021f2f084f74 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:41.486338 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1745/3537] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:37:41 2022] POST /identity/v3/users => generated 299 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:37:41.490932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ee21b-cc69-4720-8d6d-7d242a9bd760 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:41.513194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ee21b-cc69-4720-8d6d-7d242a9bd760 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:41.529341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230c5e9-6a3b-43fd-ac1d-157e46f3cf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:41.534146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230c5e9-6a3b-43fd-ac1d-157e46f3cf26 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:41.534146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230c5e9-6a3b-43fd-ac1d-157e46f3cf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:41.534146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230c5e9-6a3b-43fd-ac1d-157e46f3cf26 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:41.534146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230c5e9-6a3b-43fd-ac1d-157e46f3cf26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:41.541404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230c5e9-6a3b-43fd-ac1d-157e46f3cf26 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:41.570787 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1793/3538] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:37:41.572985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80090d-8151-42bb-bb85-021f2f084f74 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:41.593768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80090d-8151-42bb-bb85-021f2f084f74 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:41.611854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e167e5-a5d6-4982-8ee6-84498a99447e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:41.613160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e167e5-a5d6-4982-8ee6-84498a99447e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:41.614436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e167e5-a5d6-4982-8ee6-84498a99447e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:41.619324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e167e5-a5d6-4982-8ee6-84498a99447e admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:41.619324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e167e5-a5d6-4982-8ee6-84498a99447e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:41.622903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e167e5-a5d6-4982-8ee6-84498a99447e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:41.663509 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1746/3539] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:37:41.664840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230c5e9-6a3b-43fd-ac1d-157e46f3cf26 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:41.688795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230c5e9-6a3b-43fd-ac1d-157e46f3cf26 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:41.703406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5623695-1309-4018-b673-fb2f0ba37d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:41.706067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5623695-1309-4018-b673-fb2f0ba37d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:41.707077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5623695-1309-4018-b673-fb2f0ba37d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:41.707677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5623695-1309-4018-b673-fb2f0ba37d1c admin admin] PATH_INFO: `/v3/projects/d60717661c654932ba6adb856af896b6/users/f3bdefb00cb847f5bd55a2e42dc0b277/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:41.757500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5623695-1309-4018-b673-fb2f0ba37d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60717661c654932ba6adb856af896b6, user_id=f3bdefb00cb847f5bd55a2e42dc0b277, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:41.767105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5623695-1309-4018-b673-fb2f0ba37d1c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:41.887529 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1794/3540] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:37:41 2022] PUT /identity/v3/projects/d60717661c654932ba6adb856af896b6/users/f3bdefb00cb847f5bd55a2e42dc0b277/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:37:41.889691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ca1ff-2741-41fb-b29e-fd32efa64d47 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:41.889985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ca1ff-2741-41fb-b29e-fd32efa64d47 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:41.890335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ca1ff-2741-41fb-b29e-fd32efa64d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:41.939101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1e1ca1ff-2741-41fb-b29e-fd32efa64d47 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:41.940302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1e1ca1ff-2741-41fb-b29e-fd32efa64d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:42.055990 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1747/3541] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:37:42.070717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5623695-1309-4018-b673-fb2f0ba37d1c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:42.073969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c5623695-1309-4018-b673-fb2f0ba37d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:42.223801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5623695-1309-4018-b673-fb2f0ba37d1c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:42.239845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e862ccd-f171-43be-9bcd-0457e7dfaac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:42.240572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e862ccd-f171-43be-9bcd-0457e7dfaac1 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:42.240895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e862ccd-f171-43be-9bcd-0457e7dfaac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:42.241348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e862ccd-f171-43be-9bcd-0457e7dfaac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:42.264571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e862ccd-f171-43be-9bcd-0457e7dfaac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:42.266085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e862ccd-f171-43be-9bcd-0457e7dfaac1 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:42.300536 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1795/3542] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:37:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:37:44.116738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ca1ff-2741-41fb-b29e-fd32efa64d47 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:44.139779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ca1ff-2741-41fb-b29e-fd32efa64d47 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:44.144588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49d5fb-ed68-4e19-8e40-8181d1c6a536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:44.145495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49d5fb-ed68-4e19-8e40-8181d1c6a536 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:44.145954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49d5fb-ed68-4e19-8e40-8181d1c6a536 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:44.146455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49d5fb-ed68-4e19-8e40-8181d1c6a536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:44.160507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0e49d5fb-ed68-4e19-8e40-8181d1c6a536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:44.174072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49d5fb-ed68-4e19-8e40-8181d1c6a536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:44.176027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49d5fb-ed68-4e19-8e40-8181d1c6a536 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:44.201919 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1748/3543] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:37:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:37:45.640022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e862ccd-f171-43be-9bcd-0457e7dfaac1 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:45.642259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0e862ccd-f171-43be-9bcd-0457e7dfaac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:45.722476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:45.753903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e862ccd-f171-43be-9bcd-0457e7dfaac1 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:45.761738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48ee5e-3cbb-4b50-943b-0d5fd9bc0466 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:45.762716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48ee5e-3cbb-4b50-943b-0d5fd9bc0466 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:45.763171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48ee5e-3cbb-4b50-943b-0d5fd9bc0466 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:45.763620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48ee5e-3cbb-4b50-943b-0d5fd9bc0466 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:45.767249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ef48ee5e-3cbb-4b50-943b-0d5fd9bc0466 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:45.855983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48ee5e-3cbb-4b50-943b-0d5fd9bc0466 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:45.859278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48ee5e-3cbb-4b50-943b-0d5fd9bc0466 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:45.891421 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1796/3544] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:37:45 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:37:50.278600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd8693-77f4-4760-bf0d-bf0c6cdb04a7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:50.279221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd8693-77f4-4760-bf0d-bf0c6cdb04a7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:50.279221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd8693-77f4-4760-bf0d-bf0c6cdb04a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:50.351626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-25dd8693-77f4-4760-bf0d-bf0c6cdb04a7 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:50.353171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-25dd8693-77f4-4760-bf0d-bf0c6cdb04a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:50.378252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:50.458573 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1749/3545] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:37:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:37:50.476903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48ee5e-3cbb-4b50-943b-0d5fd9bc0466 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:50.503384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ef48ee5e-3cbb-4b50-943b-0d5fd9bc0466 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:50.565338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48ee5e-3cbb-4b50-943b-0d5fd9bc0466 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:50.570673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a66376-ee12-48ef-8cd0-b944d8deb987 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:50.571538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a66376-ee12-48ef-8cd0-b944d8deb987 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:50.571824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a66376-ee12-48ef-8cd0-b944d8deb987 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:50.572102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a66376-ee12-48ef-8cd0-b944d8deb987 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:50.581495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a66376-ee12-48ef-8cd0-b944d8deb987 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:50.583771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a66376-ee12-48ef-8cd0-b944d8deb987 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:50.595737 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1797/3546] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:37:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:37:50.724651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd8693-77f4-4760-bf0d-bf0c6cdb04a7 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:50.774264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd8693-77f4-4760-bf0d-bf0c6cdb04a7 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:50.787456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e14694-ec2d-41df-b088-2252fbc452c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:50.789253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e14694-ec2d-41df-b088-2252fbc452c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:50.790631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e14694-ec2d-41df-b088-2252fbc452c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:50.791765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e14694-ec2d-41df-b088-2252fbc452c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:50.800095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-82e14694-ec2d-41df-b088-2252fbc452c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:50.842048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e14694-ec2d-41df-b088-2252fbc452c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:50.847424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e14694-ec2d-41df-b088-2252fbc452c5 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:50.872856 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1750/3547] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:37:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:37:54.119851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c07b92-3b23-41bd-bc12-c2b0d2747d73 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:54.120388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c07b92-3b23-41bd-bc12-c2b0d2747d73 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:54.120388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c07b92-3b23-41bd-bc12-c2b0d2747d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:54.180386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-13c07b92-3b23-41bd-bc12-c2b0d2747d73 None None] MFA Rules not processed for user `f3bdefb00cb847f5bd55a2e42dc0b277`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:37:54.182292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-13c07b92-3b23-41bd-bc12-c2b0d2747d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:37:54.337201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:54.343254 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1798/3548] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:37:54 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:37:54.526415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e14694-ec2d-41df-b088-2252fbc452c5 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:37:54.553296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e14694-ec2d-41df-b088-2252fbc452c5 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:37:54.560646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181d96b-1dc4-469b-adec-5be0cb5524b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:37:54.561577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181d96b-1dc4-469b-adec-5be0cb5524b4 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:37:54.561982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181d96b-1dc4-469b-adec-5be0cb5524b4 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:37:54.562401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181d96b-1dc4-469b-adec-5be0cb5524b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:37:54.571806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181d96b-1dc4-469b-adec-5be0cb5524b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:37:54.573589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181d96b-1dc4-469b-adec-5be0cb5524b4 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:37:54.587851 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1751/3549] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:37:54 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:38:04.581190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=33 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:05.665278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c07b92-3b23-41bd-bc12-c2b0d2747d73 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:05.687442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c07b92-3b23-41bd-bc12-c2b0d2747d73 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:05.708168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d515e-ea04-4b94-9fa5-3fb87b560bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:05.711022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d515e-ea04-4b94-9fa5-3fb87b560bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:05.711316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d515e-ea04-4b94-9fa5-3fb87b560bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:05.711792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d515e-ea04-4b94-9fa5-3fb87b560bd6 admin admin] PATH_INFO: `/v3/users/f3bdefb00cb847f5bd55a2e42dc0b277` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:05.715463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d515e-ea04-4b94-9fa5-3fb87b560bd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3bdefb00cb847f5bd55a2e42dc0b277)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:05.717622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d515e-ea04-4b94-9fa5-3fb87b560bd6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:06.024388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6f4d515e-ea04-4b94-9fa5-3fb87b560bd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3bdefb00cb847f5bd55a2e42dc0b277'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:06.025148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6f4d515e-ea04-4b94-9fa5-3fb87b560bd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3bdefb00cb847f5bd55a2e42dc0b277'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:06.038636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6f4d515e-ea04-4b94-9fa5-3fb87b560bd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3bdefb00cb847f5bd55a2e42dc0b277'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:06.067685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6f4d515e-ea04-4b94-9fa5-3fb87b560bd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3bdefb00cb847f5bd55a2e42dc0b277'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:06.068834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6f4d515e-ea04-4b94-9fa5-3fb87b560bd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3bdefb00cb847f5bd55a2e42dc0b277'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:06.228883 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1799/3550] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:38:05 2022] DELETE /identity/v3/users/f3bdefb00cb847f5bd55a2e42dc0b277 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:38:07.288945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181d96b-1dc4-469b-adec-5be0cb5524b4 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:07.304089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181d96b-1dc4-469b-adec-5be0cb5524b4 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:07.413045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e2eec-d062-4928-859a-399bdff9afab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:07.415352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e2eec-d062-4928-859a-399bdff9afab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:07.417466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e2eec-d062-4928-859a-399bdff9afab admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:07.417999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e2eec-d062-4928-859a-399bdff9afab admin admin] PATH_INFO: `/v3/projects/d60717661c654932ba6adb856af896b6` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:07.419777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e2eec-d062-4928-859a-399bdff9afab admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60717661c654932ba6adb856af896b6)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:07.422834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e2eec-d062-4928-859a-399bdff9afab admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:07.599686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-111e2eec-d062-4928-859a-399bdff9afab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60717661c654932ba6adb856af896b6', 'request_id': 'req-111e2eec-d062-4928-859a-399bdff9afab'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:07.694008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-111e2eec-d062-4928-859a-399bdff9afab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60717661c654932ba6adb856af896b6', 'request_id': 'req-111e2eec-d062-4928-859a-399bdff9afab'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:07.708875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-111e2eec-d062-4928-859a-399bdff9afab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60717661c654932ba6adb856af896b6', 'request_id': 'req-111e2eec-d062-4928-859a-399bdff9afab'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:07.738070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-111e2eec-d062-4928-859a-399bdff9afab admin admin] The token cache is being invalidate because project d60717661c654932ba6adb856af896b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:38:07.738483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-111e2eec-d062-4928-859a-399bdff9afab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:07.739368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-111e2eec-d062-4928-859a-399bdff9afab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:07.743545 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1752/3551] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:38:07 2022] DELETE /identity/v3/projects/d60717661c654932ba6adb856af896b6 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:38:07.749758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11003b-d331-48cf-b266-5a965e9ca884 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:07.750351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11003b-d331-48cf-b266-5a965e9ca884 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:07.750351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11003b-d331-48cf-b266-5a965e9ca884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:07.788715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-de11003b-d331-48cf-b266-5a965e9ca884 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:38:07.790257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-de11003b-d331-48cf-b266-5a965e9ca884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:07.933640 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1800/3552] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:38:07.940972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1802be6-58e8-4be8-adb2-0f2c2a0940cb None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:07.940972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1802be6-58e8-4be8-adb2-0f2c2a0940cb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:07.940972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1802be6-58e8-4be8-adb2-0f2c2a0940cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:08.007174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b1802be6-58e8-4be8-adb2-0f2c2a0940cb None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:38:08.008609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b1802be6-58e8-4be8-adb2-0f2c2a0940cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:08.026195 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1753/3553] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:38:08.031416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11003b-d331-48cf-b266-5a965e9ca884 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:08.075986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11003b-d331-48cf-b266-5a965e9ca884 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:08.086537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fb80a-0f5e-4261-910f-c2b036849da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:08.087409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fb80a-0f5e-4261-910f-c2b036849da4 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:08.087799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fb80a-0f5e-4261-910f-c2b036849da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:08.088381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fb80a-0f5e-4261-910f-c2b036849da4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:08.089640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fb80a-0f5e-4261-910f-c2b036849da4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:38:08.092539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fb80a-0f5e-4261-910f-c2b036849da4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:08.092932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fb80a-0f5e-4261-910f-c2b036849da4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:08.118847 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1801/3554] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:38:08.121022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1802be6-58e8-4be8-adb2-0f2c2a0940cb None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:08.131631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1802be6-58e8-4be8-adb2-0f2c2a0940cb None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:08.137752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2daae-2606-49e6-a0c9-f39179073deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:08.138516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2daae-2606-49e6-a0c9-f39179073deb admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:08.138870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2daae-2606-49e6-a0c9-f39179073deb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:08.139217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2daae-2606-49e6-a0c9-f39179073deb admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:08.140050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2daae-2606-49e6-a0c9-f39179073deb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:08.142369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2daae-2606-49e6-a0c9-f39179073deb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:08.244653 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1754/3555] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:38:08 2022] POST /identity/v3/projects => generated 389 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:38:08.250936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fb80a-0f5e-4261-910f-c2b036849da4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:08.281452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fb80a-0f5e-4261-910f-c2b036849da4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:08.402295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718229b5-fcc7-4ed5-8140-09c7dbf4456a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:08.403146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718229b5-fcc7-4ed5-8140-09c7dbf4456a admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:08.403671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718229b5-fcc7-4ed5-8140-09c7dbf4456a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:08.404060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718229b5-fcc7-4ed5-8140-09c7dbf4456a admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:08.404851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718229b5-fcc7-4ed5-8140-09c7dbf4456a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:08.406948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718229b5-fcc7-4ed5-8140-09c7dbf4456a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:08.429458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:08.559104 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1802/3556] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:38:08 2022] POST /identity/v3/users => generated 295 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:38:08.563357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2daae-2606-49e6-a0c9-f39179073deb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:08.584846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2daae-2606-49e6-a0c9-f39179073deb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:08.593116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fcbe3-70a3-499c-b6aa-f66712b8000d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:08.594127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fcbe3-70a3-499c-b6aa-f66712b8000d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:08.596301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fcbe3-70a3-499c-b6aa-f66712b8000d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:08.596301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fcbe3-70a3-499c-b6aa-f66712b8000d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:08.596301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39fcbe3-70a3-499c-b6aa-f66712b8000d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:08.599563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39fcbe3-70a3-499c-b6aa-f66712b8000d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:08.619821 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1755/3557] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:38:08.626148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718229b5-fcc7-4ed5-8140-09c7dbf4456a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:08.643425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718229b5-fcc7-4ed5-8140-09c7dbf4456a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:08.652406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2abe05-54c8-45a9-8e11-3d13cc19f43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:08.654948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2abe05-54c8-45a9-8e11-3d13cc19f43a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:08.656036 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2abe05-54c8-45a9-8e11-3d13cc19f43a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:08.657215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2abe05-54c8-45a9-8e11-3d13cc19f43a admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:08.658228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2abe05-54c8-45a9-8e11-3d13cc19f43a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:08.678946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2abe05-54c8-45a9-8e11-3d13cc19f43a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:08.715101 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1803/3558] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:38:08.719186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fcbe3-70a3-499c-b6aa-f66712b8000d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:08.742721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fcbe3-70a3-499c-b6aa-f66712b8000d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:08.750962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4cc17-e7b7-4323-96d8-ee820ff1ac42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:08.751657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4cc17-e7b7-4323-96d8-ee820ff1ac42 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:08.752406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4cc17-e7b7-4323-96d8-ee820ff1ac42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:08.752406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4cc17-e7b7-4323-96d8-ee820ff1ac42 admin admin] PATH_INFO: `/v3/projects/93732dbf56414de2b7667e1e70262a32/users/51be346b3c5448c28ac57f5c1ffe50bc/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:08.783085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4cc17-e7b7-4323-96d8-ee820ff1ac42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93732dbf56414de2b7667e1e70262a32, user_id=51be346b3c5448c28ac57f5c1ffe50bc, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:08.783085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4cc17-e7b7-4323-96d8-ee820ff1ac42 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:08.881620 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1756/3559] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:38:08 2022] PUT /identity/v3/projects/93732dbf56414de2b7667e1e70262a32/users/51be346b3c5448c28ac57f5c1ffe50bc/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:38:08.886776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d6711-8584-40f3-a3bf-c39707367c07 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:08.887860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d6711-8584-40f3-a3bf-c39707367c07 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:08.888601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d6711-8584-40f3-a3bf-c39707367c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:08.977925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b49d6711-8584-40f3-a3bf-c39707367c07 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:38:08.980780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b49d6711-8584-40f3-a3bf-c39707367c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:09.129661 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1804/3560] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:38:09.139707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4cc17-e7b7-4323-96d8-ee820ff1ac42 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:09.141673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-30c4cc17-e7b7-4323-96d8-ee820ff1ac42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:09.183276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:09.242239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4cc17-e7b7-4323-96d8-ee820ff1ac42 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:09.249445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc735f30-94f0-455e-858e-f4ddbe9c118c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:09.250105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc735f30-94f0-455e-858e-f4ddbe9c118c service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:09.250449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc735f30-94f0-455e-858e-f4ddbe9c118c service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:09.253896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc735f30-94f0-455e-858e-f4ddbe9c118c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:09.262808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc735f30-94f0-455e-858e-f4ddbe9c118c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:09.264455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc735f30-94f0-455e-858e-f4ddbe9c118c service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:09.290182 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1757/3561] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:38:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:38:12.123653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d6711-8584-40f3-a3bf-c39707367c07 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:12.126374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b49d6711-8584-40f3-a3bf-c39707367c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:12.146716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d6711-8584-40f3-a3bf-c39707367c07 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:12.163521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472e9d3-3b7c-4cc5-95fd-d8c4790eac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:12.164501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472e9d3-3b7c-4cc5-95fd-d8c4790eac71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:12.165001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472e9d3-3b7c-4cc5-95fd-d8c4790eac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:12.165491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472e9d3-3b7c-4cc5-95fd-d8c4790eac71 admin admin] PATH_INFO: `/v3/users/cbfbad32b0c64e98a852e16cc3acd654` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:12.167249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472e9d3-3b7c-4cc5-95fd-d8c4790eac71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbfbad32b0c64e98a852e16cc3acd654)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:12.169689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472e9d3-3b7c-4cc5-95fd-d8c4790eac71 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:12.523289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7472e9d3-3b7c-4cc5-95fd-d8c4790eac71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbfbad32b0c64e98a852e16cc3acd654'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:12.524773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7472e9d3-3b7c-4cc5-95fd-d8c4790eac71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbfbad32b0c64e98a852e16cc3acd654'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:12.546544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7472e9d3-3b7c-4cc5-95fd-d8c4790eac71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbfbad32b0c64e98a852e16cc3acd654'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:12.571569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7472e9d3-3b7c-4cc5-95fd-d8c4790eac71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbfbad32b0c64e98a852e16cc3acd654'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:12.572460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7472e9d3-3b7c-4cc5-95fd-d8c4790eac71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbfbad32b0c64e98a852e16cc3acd654'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:12.657167 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1805/3562] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:38:12 2022] DELETE /identity/v3/users/cbfbad32b0c64e98a852e16cc3acd654 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:38:13.956239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc735f30-94f0-455e-858e-f4ddbe9c118c service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:13.974249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc735f30-94f0-455e-858e-f4ddbe9c118c service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:14.176979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790e1ed-2e19-4543-9159-4f34324359e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:14.177650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790e1ed-2e19-4543-9159-4f34324359e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:14.177931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790e1ed-2e19-4543-9159-4f34324359e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:14.178257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790e1ed-2e19-4543-9159-4f34324359e0 admin admin] PATH_INFO: `/v3/projects/3ab3d7ec4d294c8fbbb0c19559accba1` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:14.191593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790e1ed-2e19-4543-9159-4f34324359e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ab3d7ec4d294c8fbbb0c19559accba1)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:14.209247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790e1ed-2e19-4543-9159-4f34324359e0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:14.574564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e790e1ed-2e19-4543-9159-4f34324359e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ab3d7ec4d294c8fbbb0c19559accba1', 'request_id': 'req-e790e1ed-2e19-4543-9159-4f34324359e0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:14.663712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e790e1ed-2e19-4543-9159-4f34324359e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ab3d7ec4d294c8fbbb0c19559accba1', 'request_id': 'req-e790e1ed-2e19-4543-9159-4f34324359e0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:14.676288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e790e1ed-2e19-4543-9159-4f34324359e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ab3d7ec4d294c8fbbb0c19559accba1', 'request_id': 'req-e790e1ed-2e19-4543-9159-4f34324359e0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:14.713674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e790e1ed-2e19-4543-9159-4f34324359e0 admin admin] The token cache is being invalidate because project 3ab3d7ec4d294c8fbbb0c19559accba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:38:14.714706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e790e1ed-2e19-4543-9159-4f34324359e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:14.717320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e790e1ed-2e19-4543-9159-4f34324359e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:14.723702 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1758/3563] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:38:13 2022] DELETE /identity/v3/projects/3ab3d7ec4d294c8fbbb0c19559accba1 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:38:14.728625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5e80a-7476-41b6-9236-4ffc0ef92f57 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:14.729130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5e80a-7476-41b6-9236-4ffc0ef92f57 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:14.729130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5e80a-7476-41b6-9236-4ffc0ef92f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:14.814559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-bac5e80a-7476-41b6-9236-4ffc0ef92f57 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:38:14.815832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bac5e80a-7476-41b6-9236-4ffc0ef92f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:14.947477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:14.967817 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1806/3564] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:38:14.977507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e37972-93de-42ff-8052-60f4abc960ae None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:14.977507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e37972-93de-42ff-8052-60f4abc960ae None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:14.977507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e37972-93de-42ff-8052-60f4abc960ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:15.004948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-84e37972-93de-42ff-8052-60f4abc960ae None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:38:15.007227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-84e37972-93de-42ff-8052-60f4abc960ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:15.021105 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1759/3565] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:38:15.023501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5e80a-7476-41b6-9236-4ffc0ef92f57 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:15.045765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5e80a-7476-41b6-9236-4ffc0ef92f57 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:15.083180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0a7e5-1e08-4600-b7c6-178b9f900635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:15.086237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0a7e5-1e08-4600-b7c6-178b9f900635 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:15.086597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0a7e5-1e08-4600-b7c6-178b9f900635 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:15.086932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0a7e5-1e08-4600-b7c6-178b9f900635 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:15.089798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0a7e5-1e08-4600-b7c6-178b9f900635 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:38:15.090132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0a7e5-1e08-4600-b7c6-178b9f900635 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:15.097020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0a7e5-1e08-4600-b7c6-178b9f900635 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:15.174642 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1807/3566] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:38:15.178953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e37972-93de-42ff-8052-60f4abc960ae None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:15.202939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e37972-93de-42ff-8052-60f4abc960ae None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:15.248801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7580d-3f08-4a1e-adef-652c004e2afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:15.249712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7580d-3f08-4a1e-adef-652c004e2afc admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:15.250218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7580d-3f08-4a1e-adef-652c004e2afc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:15.250590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7580d-3f08-4a1e-adef-652c004e2afc admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:15.251358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7580d-3f08-4a1e-adef-652c004e2afc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:15.255341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7580d-3f08-4a1e-adef-652c004e2afc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:15.325929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027f1e0-c9c5-493f-9e28-e961e6ffdbda None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:15.329202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027f1e0-c9c5-493f-9e28-e961e6ffdbda None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:15.329202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027f1e0-c9c5-493f-9e28-e961e6ffdbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:15.384297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c027f1e0-c9c5-493f-9e28-e961e6ffdbda None None] MFA Rules not processed for user `b1cc79af058b4c35b3c572448fac86a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:38:15.387751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c027f1e0-c9c5-493f-9e28-e961e6ffdbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:15.485032 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1760/3567] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:38:15 2022] POST /identity/v3/projects => generated 365 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:38:15.488858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7580d-3f08-4a1e-adef-652c004e2afc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:15.563232 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1808/3568] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:38:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:38:15.621267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:15.681290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7580d-3f08-4a1e-adef-652c004e2afc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:15.692594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b4eae-b065-4efd-a742-2850f075d625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:15.693549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b4eae-b065-4efd-a742-2850f075d625 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:15.694026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b4eae-b065-4efd-a742-2850f075d625 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:15.694516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b4eae-b065-4efd-a742-2850f075d625 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:15.695361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b4eae-b065-4efd-a742-2850f075d625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:15.697588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b4eae-b065-4efd-a742-2850f075d625 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:15.903572 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1761/3569] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:38:15 2022] POST /identity/v3/users => generated 283 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:38:15.907848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027f1e0-c9c5-493f-9e28-e961e6ffdbda None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:15.930574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027f1e0-c9c5-493f-9e28-e961e6ffdbda None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:15.944646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d9508-04d0-4709-91a1-af572f18578f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:15.950957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d9508-04d0-4709-91a1-af572f18578f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:15.950957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d9508-04d0-4709-91a1-af572f18578f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:15.950957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d9508-04d0-4709-91a1-af572f18578f admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:15.950957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d9508-04d0-4709-91a1-af572f18578f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:15.954317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d9508-04d0-4709-91a1-af572f18578f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:15.970631 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1809/3570] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:38:15.974745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b4eae-b065-4efd-a742-2850f075d625 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:15.994362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b4eae-b065-4efd-a742-2850f075d625 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:16.004335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45e3ef-3250-45e5-b403-572ca99911cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:16.013861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45e3ef-3250-45e5-b403-572ca99911cf admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:16.013861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45e3ef-3250-45e5-b403-572ca99911cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:16.013861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45e3ef-3250-45e5-b403-572ca99911cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:16.013861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45e3ef-3250-45e5-b403-572ca99911cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:16.013861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45e3ef-3250-45e5-b403-572ca99911cf admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:16.032434 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1762/3571] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:38:16.035709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d9508-04d0-4709-91a1-af572f18578f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:16.050469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d9508-04d0-4709-91a1-af572f18578f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:16.062644 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f88780-329d-4ce8-9bde-524504601aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:16.063627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f88780-329d-4ce8-9bde-524504601aa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:16.064247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f88780-329d-4ce8-9bde-524504601aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:16.064697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f88780-329d-4ce8-9bde-524504601aa6 admin admin] PATH_INFO: `/v3/projects/4840257127594149b03c0aa3ab94b486/users/3e8e0bc10d3f451c8837c1f1e4d86eaa/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:16.095533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f88780-329d-4ce8-9bde-524504601aa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4840257127594149b03c0aa3ab94b486, user_id=3e8e0bc10d3f451c8837c1f1e4d86eaa, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:16.100886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f88780-329d-4ce8-9bde-524504601aa6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:16.243597 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1810/3572] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:38:16 2022] PUT /identity/v3/projects/4840257127594149b03c0aa3ab94b486/users/3e8e0bc10d3f451c8837c1f1e4d86eaa/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:38:16.247709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6ef0a-807d-43ae-996a-3bef12132916 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:16.248102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6ef0a-807d-43ae-996a-3bef12132916 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:16.248555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6ef0a-807d-43ae-996a-3bef12132916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:16.290613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-62f6ef0a-807d-43ae-996a-3bef12132916 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:38:16.294337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-62f6ef0a-807d-43ae-996a-3bef12132916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:16.440996 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1763/3573] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:38:16.487330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f88780-329d-4ce8-9bde-524504601aa6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:16.489490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c2f88780-329d-4ce8-9bde-524504601aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:16.644728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f88780-329d-4ce8-9bde-524504601aa6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:16.659147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa580f3-ce21-49fb-bf56-2d3e29e64949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:16.660115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa580f3-ce21-49fb-bf56-2d3e29e64949 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:16.661845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa580f3-ce21-49fb-bf56-2d3e29e64949 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:16.662288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa580f3-ce21-49fb-bf56-2d3e29e64949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:16.687264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa580f3-ce21-49fb-bf56-2d3e29e64949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:16.692676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa580f3-ce21-49fb-bf56-2d3e29e64949 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:16.729451 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1811/3574] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:38:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:38:23.553620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6c581-39e9-4588-b228-204ce7064d95 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:23.554275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6c581-39e9-4588-b228-204ce7064d95 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:23.554275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6c581-39e9-4588-b228-204ce7064d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:23.622418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4ee6c581-39e9-4588-b228-204ce7064d95 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:38:23.628453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4ee6c581-39e9-4588-b228-204ce7064d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:23.750707 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1764/3575] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:38:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:38:23.770483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa580f3-ce21-49fb-bf56-2d3e29e64949 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:23.772481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5aa580f3-ce21-49fb-bf56-2d3e29e64949 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:23.888778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:23.944068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa580f3-ce21-49fb-bf56-2d3e29e64949 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:23.958970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a870162-343a-47c7-9b0c-f1ad17778be9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:23.958970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a870162-343a-47c7-9b0c-f1ad17778be9 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:23.958970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a870162-343a-47c7-9b0c-f1ad17778be9 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:23.958970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a870162-343a-47c7-9b0c-f1ad17778be9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:23.967078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a870162-343a-47c7-9b0c-f1ad17778be9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:23.969643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a870162-343a-47c7-9b0c-f1ad17778be9 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:23.998929 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1812/3576] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:38:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:38:24.250751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c06d3-50d3-4356-a770-f8803e32ede5 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:24.250997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c06d3-50d3-4356-a770-f8803e32ede5 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:24.251187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c06d3-50d3-4356-a770-f8803e32ede5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:24.340600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-395c06d3-50d3-4356-a770-f8803e32ede5 None None] MFA Rules not processed for user `51be346b3c5448c28ac57f5c1ffe50bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:38:24.345961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-395c06d3-50d3-4356-a770-f8803e32ede5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:24.468248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:24.526074 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1765/3577] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:38:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:38:24.532612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800469a5-e8c8-490d-a68b-e4e62b8a39ef None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:24.532913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800469a5-e8c8-490d-a68b-e4e62b8a39ef None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:24.535638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800469a5-e8c8-490d-a68b-e4e62b8a39ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:24.585148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-800469a5-e8c8-490d-a68b-e4e62b8a39ef None None] MFA Rules not processed for user `51be346b3c5448c28ac57f5c1ffe50bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:38:24.588501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-800469a5-e8c8-490d-a68b-e4e62b8a39ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:24.644346 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1813/3578] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:38:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:38:24.799023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9cca1-07e9-47a1-966e-9ea7f485f354 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:24.799563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9cca1-07e9-47a1-966e-9ea7f485f354 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:24.799563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9cca1-07e9-47a1-966e-9ea7f485f354 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:24.800943 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1766/3579] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:38:24.809467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf33c1b-a07f-4b5a-8544-b07be5cc0b1a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:24.810375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf33c1b-a07f-4b5a-8544-b07be5cc0b1a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:24.810652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf33c1b-a07f-4b5a-8544-b07be5cc0b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:24.914920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4bf33c1b-a07f-4b5a-8544-b07be5cc0b1a None None] MFA Rules not processed for user `9b359391fbc34c259d987e42e8826c86`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:38:24.921732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4bf33c1b-a07f-4b5a-8544-b07be5cc0b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:24.924852 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1814/3580] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:38:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:38:24.938634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9cca1-07e9-47a1-966e-9ea7f485f354 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:24.941414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f7a9cca1-07e9-47a1-966e-9ea7f485f354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:24.973317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9cca1-07e9-47a1-966e-9ea7f485f354 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:24.984180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9fdc0-e1cf-4596-813f-aafe99c57378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:24.985122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9fdc0-e1cf-4596-813f-aafe99c57378 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:24.985416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9fdc0-e1cf-4596-813f-aafe99c57378 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:24.985985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9fdc0-e1cf-4596-813f-aafe99c57378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:24.998023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9fdc0-e1cf-4596-813f-aafe99c57378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:24.999795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9fdc0-e1cf-4596-813f-aafe99c57378 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:25.011606 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1767/3581] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:38:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:38:25.960642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf33c1b-a07f-4b5a-8544-b07be5cc0b1a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:25.962299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4bf33c1b-a07f-4b5a-8544-b07be5cc0b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:26.154065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf33c1b-a07f-4b5a-8544-b07be5cc0b1a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:26.180926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabd950-2f82-491a-8c98-79fa9cbe9032 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:26.181572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabd950-2f82-491a-8c98-79fa9cbe9032 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:26.181852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabd950-2f82-491a-8c98-79fa9cbe9032 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:26.182151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabd950-2f82-491a-8c98-79fa9cbe9032 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:26.211594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcabd950-2f82-491a-8c98-79fa9cbe9032 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:26.216176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcabd950-2f82-491a-8c98-79fa9cbe9032 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:26.230901 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1815/3582] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:38:25 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:38:27.538589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9fdc0-e1cf-4596-813f-aafe99c57378 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:27.540134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-adb9fdc0-e1cf-4596-813f-aafe99c57378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:27.629703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9fdc0-e1cf-4596-813f-aafe99c57378 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:27.635468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff7caf-055a-4c32-a146-2901e308474d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:27.636122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff7caf-055a-4c32-a146-2901e308474d service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:27.636408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff7caf-055a-4c32-a146-2901e308474d service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:27.636757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff7caf-055a-4c32-a146-2901e308474d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:27.638602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ceff7caf-055a-4c32-a146-2901e308474d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:27.652542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff7caf-055a-4c32-a146-2901e308474d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:27.654304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff7caf-055a-4c32-a146-2901e308474d service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:27.668393 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1768/3583] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:38:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:38:33.769725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7639f85-b849-426a-a627-cffd79a45c1f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:33.770750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7639f85-b849-426a-a627-cffd79a45c1f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:33.771268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7639f85-b849-426a-a627-cffd79a45c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:33.834825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d7639f85-b849-426a-a627-cffd79a45c1f None None] MFA Rules not processed for user `3e8e0bc10d3f451c8837c1f1e4d86eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:38:33.836311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d7639f85-b849-426a-a627-cffd79a45c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:33.928865 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1816/3584] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:38:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:38:33.944083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff7caf-055a-4c32-a146-2901e308474d service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:33.946355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ceff7caf-055a-4c32-a146-2901e308474d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:33.971265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff7caf-055a-4c32-a146-2901e308474d service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:33.978316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b013b6-c12f-4804-9561-781f0d348594 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:33.979335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b013b6-c12f-4804-9561-781f0d348594 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:33.979823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b013b6-c12f-4804-9561-781f0d348594 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:33.980322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b013b6-c12f-4804-9561-781f0d348594 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:33.990733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b013b6-c12f-4804-9561-781f0d348594 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:33.992611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b013b6-c12f-4804-9561-781f0d348594 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:34.003989 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1769/3585] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:38:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:38:38.627286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd302e-067a-4ec8-b1d7-a93d3d679e84 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:38.627724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd302e-067a-4ec8-b1d7-a93d3d679e84 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:38.627843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd302e-067a-4ec8-b1d7-a93d3d679e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:38.662623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-bccd302e-067a-4ec8-b1d7-a93d3d679e84 None None] MFA Rules not processed for user `3e8e0bc10d3f451c8837c1f1e4d86eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:38:38.664040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bccd302e-067a-4ec8-b1d7-a93d3d679e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:38.675108 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1817/3586] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:38:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:38:43.998832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=51 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:46.206407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b013b6-c12f-4804-9561-781f0d348594 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:46.208777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f2b013b6-c12f-4804-9561-781f0d348594 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:46.233728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b013b6-c12f-4804-9561-781f0d348594 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:46.256291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadf9a2-ff96-4ed2-a6d3-29ab7f253e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:46.261871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadf9a2-ff96-4ed2-a6d3-29ab7f253e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:46.263053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadf9a2-ff96-4ed2-a6d3-29ab7f253e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:46.263515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadf9a2-ff96-4ed2-a6d3-29ab7f253e98 admin admin] PATH_INFO: `/v3/users/f9c32b7626594ff888970c7f3227bb20` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:46.270224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadf9a2-ff96-4ed2-a6d3-29ab7f253e98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9c32b7626594ff888970c7f3227bb20)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:46.276714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadf9a2-ff96-4ed2-a6d3-29ab7f253e98 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:46.597844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8eadf9a2-ff96-4ed2-a6d3-29ab7f253e98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9c32b7626594ff888970c7f3227bb20'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:46.597844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8eadf9a2-ff96-4ed2-a6d3-29ab7f253e98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9c32b7626594ff888970c7f3227bb20'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:46.628878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8eadf9a2-ff96-4ed2-a6d3-29ab7f253e98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9c32b7626594ff888970c7f3227bb20'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:46.654448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8eadf9a2-ff96-4ed2-a6d3-29ab7f253e98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9c32b7626594ff888970c7f3227bb20'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:46.798500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8eadf9a2-ff96-4ed2-a6d3-29ab7f253e98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9c32b7626594ff888970c7f3227bb20'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:46.808132 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1770/3587] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:38:46 2022] DELETE /identity/v3/users/f9c32b7626594ff888970c7f3227bb20 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:38:47.223276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd302e-067a-4ec8-b1d7-a93d3d679e84 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:47.235936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd302e-067a-4ec8-b1d7-a93d3d679e84 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:47.262750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:47.343349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c940d-a156-4234-addd-c7d4e6f09ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:47.344054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c940d-a156-4234-addd-c7d4e6f09ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:47.344562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c940d-a156-4234-addd-c7d4e6f09ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:47.345026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c940d-a156-4234-addd-c7d4e6f09ab4 admin admin] PATH_INFO: `/v3/projects/8bb5d291069d4329a90123e327fe9c59` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:47.351979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c940d-a156-4234-addd-c7d4e6f09ab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bb5d291069d4329a90123e327fe9c59)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:47.356344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c940d-a156-4234-addd-c7d4e6f09ab4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:47.492431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-717c940d-a156-4234-addd-c7d4e6f09ab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bb5d291069d4329a90123e327fe9c59', 'request_id': 'req-717c940d-a156-4234-addd-c7d4e6f09ab4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:47.501715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-717c940d-a156-4234-addd-c7d4e6f09ab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bb5d291069d4329a90123e327fe9c59', 'request_id': 'req-717c940d-a156-4234-addd-c7d4e6f09ab4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:47.508264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-717c940d-a156-4234-addd-c7d4e6f09ab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bb5d291069d4329a90123e327fe9c59', 'request_id': 'req-717c940d-a156-4234-addd-c7d4e6f09ab4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:47.603141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-717c940d-a156-4234-addd-c7d4e6f09ab4 admin admin] The token cache is being invalidate because project 8bb5d291069d4329a90123e327fe9c59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:38:47.603438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-717c940d-a156-4234-addd-c7d4e6f09ab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:47.604344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-717c940d-a156-4234-addd-c7d4e6f09ab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:47.606609 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1818/3588] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:38:47 2022] DELETE /identity/v3/projects/8bb5d291069d4329a90123e327fe9c59 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:38:47.612251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1c010-3ec4-4868-b897-2e59244b23e6 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:47.612788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1c010-3ec4-4868-b897-2e59244b23e6 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:47.612788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1c010-3ec4-4868-b897-2e59244b23e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:47.703350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-21b1c010-3ec4-4868-b897-2e59244b23e6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:38:47.705180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-21b1c010-3ec4-4868-b897-2e59244b23e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:47.815023 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1771/3589] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:38:47.822685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc94fd-112d-420b-8301-4d4ea6e0c4ac None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:47.827536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc94fd-112d-420b-8301-4d4ea6e0c4ac None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:47.827536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc94fd-112d-420b-8301-4d4ea6e0c4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:47.871562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d6fc94fd-112d-420b-8301-4d4ea6e0c4ac None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:38:47.875169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d6fc94fd-112d-420b-8301-4d4ea6e0c4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:47.897380 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1819/3590] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:38:47.904678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1c010-3ec4-4868-b897-2e59244b23e6 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:47.919676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1c010-3ec4-4868-b897-2e59244b23e6 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:47.927685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d350d-bd70-4914-8e87-b21aed117d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:47.927685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d350d-bd70-4914-8e87-b21aed117d10 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:47.927962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d350d-bd70-4914-8e87-b21aed117d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:47.928084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d350d-bd70-4914-8e87-b21aed117d10 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:47.928668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d350d-bd70-4914-8e87-b21aed117d10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:38:47.928974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d350d-bd70-4914-8e87-b21aed117d10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:47.930637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d350d-bd70-4914-8e87-b21aed117d10 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:47.965030 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1772/3591] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:38:47.976222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc94fd-112d-420b-8301-4d4ea6e0c4ac None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:47.986290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc94fd-112d-420b-8301-4d4ea6e0c4ac None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:47.992274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875168d-5c0f-4945-8db8-76d435e362b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:47.993490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875168d-5c0f-4945-8db8-76d435e362b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:47.994122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875168d-5c0f-4945-8db8-76d435e362b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:47.994603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875168d-5c0f-4945-8db8-76d435e362b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:48.002302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875168d-5c0f-4945-8db8-76d435e362b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:48.002302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875168d-5c0f-4945-8db8-76d435e362b1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:48.116075 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1820/3592] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:38:47 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:38:48.119978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d350d-bd70-4914-8e87-b21aed117d10 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:48.143344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d350d-bd70-4914-8e87-b21aed117d10 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:48.268918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2193e0d-19fd-4137-98cd-ad611bbecc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:48.269758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2193e0d-19fd-4137-98cd-ad611bbecc15 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:48.270998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2193e0d-19fd-4137-98cd-ad611bbecc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:48.275118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2193e0d-19fd-4137-98cd-ad611bbecc15 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:48.275118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2193e0d-19fd-4137-98cd-ad611bbecc15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:48.275118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2193e0d-19fd-4137-98cd-ad611bbecc15 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:48.286936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:48.367831 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1773/3593] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:38:48 2022] POST /identity/v3/users => generated 294 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:38:48.373159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875168d-5c0f-4945-8db8-76d435e362b1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:48.386384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875168d-5c0f-4945-8db8-76d435e362b1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:48.391635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59477812-c83a-406e-88d5-b1027a8ad1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:48.396092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59477812-c83a-406e-88d5-b1027a8ad1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:48.396092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59477812-c83a-406e-88d5-b1027a8ad1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:48.396092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59477812-c83a-406e-88d5-b1027a8ad1b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:48.396092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59477812-c83a-406e-88d5-b1027a8ad1b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:48.396092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59477812-c83a-406e-88d5-b1027a8ad1b3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:48.408615 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1821/3594] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:38:48.412630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2193e0d-19fd-4137-98cd-ad611bbecc15 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:48.423685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2193e0d-19fd-4137-98cd-ad611bbecc15 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:48.428659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f656c-fd5c-4777-92b7-e6ac0ca0ddee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:48.429379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f656c-fd5c-4777-92b7-e6ac0ca0ddee admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:48.429895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f656c-fd5c-4777-92b7-e6ac0ca0ddee admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:48.430310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f656c-fd5c-4777-92b7-e6ac0ca0ddee admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:48.431067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f656c-fd5c-4777-92b7-e6ac0ca0ddee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:48.433319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f656c-fd5c-4777-92b7-e6ac0ca0ddee admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:48.451375 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1774/3595] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:38:48.451510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59477812-c83a-406e-88d5-b1027a8ad1b3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:48.462570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59477812-c83a-406e-88d5-b1027a8ad1b3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:48.468524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54559287-8f61-4853-b8f6-881c715ec2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:48.469675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54559287-8f61-4853-b8f6-881c715ec2b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:48.470239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54559287-8f61-4853-b8f6-881c715ec2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:48.476234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54559287-8f61-4853-b8f6-881c715ec2b4 admin admin] PATH_INFO: `/v3/projects/d6329c923a934a37961e791aa62efe07/users/f33d50d9c0b643549e9468c5a4386cb8/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:48.489249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54559287-8f61-4853-b8f6-881c715ec2b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6329c923a934a37961e791aa62efe07, user_id=f33d50d9c0b643549e9468c5a4386cb8, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:48.491971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54559287-8f61-4853-b8f6-881c715ec2b4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:48.575490 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1822/3596] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:38:48 2022] PUT /identity/v3/projects/d6329c923a934a37961e791aa62efe07/users/f33d50d9c0b643549e9468c5a4386cb8/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:38:48.580427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbea36-49d8-4d67-86c0-e4582c045cfe None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:48.580714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbea36-49d8-4d67-86c0-e4582c045cfe None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:48.581042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbea36-49d8-4d67-86c0-e4582c045cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:48.602468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0abbea36-49d8-4d67-86c0-e4582c045cfe None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:38:48.603893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0abbea36-49d8-4d67-86c0-e4582c045cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:48.672065 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1775/3597] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:38:48.681883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54559287-8f61-4853-b8f6-881c715ec2b4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:48.684270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-54559287-8f61-4853-b8f6-881c715ec2b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:48.739966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:48.743861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54559287-8f61-4853-b8f6-881c715ec2b4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:48.749847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770643f-5687-4140-bac2-6621a524d96b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:48.749847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770643f-5687-4140-bac2-6621a524d96b service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:48.749847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770643f-5687-4140-bac2-6621a524d96b service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:48.749847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770643f-5687-4140-bac2-6621a524d96b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:48.759057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770643f-5687-4140-bac2-6621a524d96b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:48.760495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770643f-5687-4140-bac2-6621a524d96b service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:48.769979 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1823/3598] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:38:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:38:49.513760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939eb75-be28-4966-8b71-8af21f0064d6 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:49.514076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939eb75-be28-4966-8b71-8af21f0064d6 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:49.514392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939eb75-be28-4966-8b71-8af21f0064d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:49.544255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5939eb75-be28-4966-8b71-8af21f0064d6 None None] MFA Rules not processed for user `f33d50d9c0b643549e9468c5a4386cb8`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:38:49.545725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5939eb75-be28-4966-8b71-8af21f0064d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:49.630218 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1776/3599] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:38:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:38:49.637636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db27eb0-d992-4c6d-b1f3-a11d79e1d0fd None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:49.638234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db27eb0-d992-4c6d-b1f3-a11d79e1d0fd None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:49.638462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db27eb0-d992-4c6d-b1f3-a11d79e1d0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:49.659718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3db27eb0-d992-4c6d-b1f3-a11d79e1d0fd None None] MFA Rules not processed for user `f33d50d9c0b643549e9468c5a4386cb8`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:38:49.661338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3db27eb0-d992-4c6d-b1f3-a11d79e1d0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:49.669888 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1824/3600] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:38:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:38:49.681723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939eb75-be28-4966-8b71-8af21f0064d6 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:49.683354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5939eb75-be28-4966-8b71-8af21f0064d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:49.789060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939eb75-be28-4966-8b71-8af21f0064d6 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:49.797612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21948301-726a-4b90-ba96-d69b696a3b75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:49.798392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21948301-726a-4b90-ba96-d69b696a3b75 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:49.798735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21948301-726a-4b90-ba96-d69b696a3b75 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:49.799072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21948301-726a-4b90-ba96-d69b696a3b75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:49.804292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:49.816373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21948301-726a-4b90-ba96-d69b696a3b75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:49.818786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21948301-726a-4b90-ba96-d69b696a3b75 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:49.831458 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1777/3601] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:38:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:38:51.418889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db27eb0-d992-4c6d-b1f3-a11d79e1d0fd None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:51.430326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db27eb0-d992-4c6d-b1f3-a11d79e1d0fd None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:51.437540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7dfed1-ccf2-4fc6-8954-afd6d66f4047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:51.438594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dfed1-ccf2-4fc6-8954-afd6d66f4047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:51.438875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dfed1-ccf2-4fc6-8954-afd6d66f4047 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:51.439444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dfed1-ccf2-4fc6-8954-afd6d66f4047 admin admin] PATH_INFO: `/v3/users/f33d50d9c0b643549e9468c5a4386cb8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:51.440461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7dfed1-ccf2-4fc6-8954-afd6d66f4047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f33d50d9c0b643549e9468c5a4386cb8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:51.442513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7dfed1-ccf2-4fc6-8954-afd6d66f4047 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:51.696814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8b7dfed1-ccf2-4fc6-8954-afd6d66f4047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f33d50d9c0b643549e9468c5a4386cb8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:51.698731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8b7dfed1-ccf2-4fc6-8954-afd6d66f4047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f33d50d9c0b643549e9468c5a4386cb8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:51.736946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8b7dfed1-ccf2-4fc6-8954-afd6d66f4047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f33d50d9c0b643549e9468c5a4386cb8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:51.801060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8b7dfed1-ccf2-4fc6-8954-afd6d66f4047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f33d50d9c0b643549e9468c5a4386cb8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:51.801854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8b7dfed1-ccf2-4fc6-8954-afd6d66f4047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f33d50d9c0b643549e9468c5a4386cb8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:51.903978 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1825/3602] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:38:51 2022] DELETE /identity/v3/users/f33d50d9c0b643549e9468c5a4386cb8 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:38:52.460959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21948301-726a-4b90-ba96-d69b696a3b75 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:52.498960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21948301-726a-4b90-ba96-d69b696a3b75 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:52.656419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe95fb-ce85-4573-a282-ec6437bb0e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:52.656997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe95fb-ce85-4573-a282-ec6437bb0e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:52.657354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe95fb-ce85-4573-a282-ec6437bb0e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:52.657631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe95fb-ce85-4573-a282-ec6437bb0e86 admin admin] PATH_INFO: `/v3/projects/d6329c923a934a37961e791aa62efe07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:52.659990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe95fb-ce85-4573-a282-ec6437bb0e86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6329c923a934a37961e791aa62efe07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:52.665413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe95fb-ce85-4573-a282-ec6437bb0e86 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:52.820027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-00fe95fb-ce85-4573-a282-ec6437bb0e86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6329c923a934a37961e791aa62efe07', 'request_id': 'req-00fe95fb-ce85-4573-a282-ec6437bb0e86'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:52.897623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-00fe95fb-ce85-4573-a282-ec6437bb0e86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6329c923a934a37961e791aa62efe07', 'request_id': 'req-00fe95fb-ce85-4573-a282-ec6437bb0e86'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:52.906136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-00fe95fb-ce85-4573-a282-ec6437bb0e86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6329c923a934a37961e791aa62efe07', 'request_id': 'req-00fe95fb-ce85-4573-a282-ec6437bb0e86'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:52.917498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-00fe95fb-ce85-4573-a282-ec6437bb0e86 admin admin] The token cache is being invalidate because project d6329c923a934a37961e791aa62efe07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:38:52.917824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-00fe95fb-ce85-4573-a282-ec6437bb0e86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:52.918714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-00fe95fb-ce85-4573-a282-ec6437bb0e86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:38:52.920215 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1778/3603] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:38:52 2022] DELETE /identity/v3/projects/d6329c923a934a37961e791aa62efe07 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:38:52.925313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f2c47-7f09-49e0-9def-c6a90ea6bfb5 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:52.925824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f2c47-7f09-49e0-9def-c6a90ea6bfb5 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:52.925943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f2c47-7f09-49e0-9def-c6a90ea6bfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:52.954998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e78f2c47-7f09-49e0-9def-c6a90ea6bfb5 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:38:52.956530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e78f2c47-7f09-49e0-9def-c6a90ea6bfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:53.047356 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1826/3604] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:38:53.048378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49a869-e397-479f-9431-770c3c22abce None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:53.048665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49a869-e397-479f-9431-770c3c22abce None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:53.048941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49a869-e397-479f-9431-770c3c22abce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:53.097321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-aa49a869-e397-479f-9431-770c3c22abce None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:38:53.103016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-aa49a869-e397-479f-9431-770c3c22abce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:53.115049 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1779/3605] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:38:53.116791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f2c47-7f09-49e0-9def-c6a90ea6bfb5 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:53.133331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f2c47-7f09-49e0-9def-c6a90ea6bfb5 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:53.140110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d696c6-54dc-4d4f-8f9a-0ff9066a7017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:53.141057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d696c6-54dc-4d4f-8f9a-0ff9066a7017 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:53.141670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d696c6-54dc-4d4f-8f9a-0ff9066a7017 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:53.142254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d696c6-54dc-4d4f-8f9a-0ff9066a7017 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:53.143189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d696c6-54dc-4d4f-8f9a-0ff9066a7017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:38:53.143716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d696c6-54dc-4d4f-8f9a-0ff9066a7017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:53.145864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d696c6-54dc-4d4f-8f9a-0ff9066a7017 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:53.195512 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1827/3606] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:38:53.196571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49a869-e397-479f-9431-770c3c22abce None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:53.211151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49a869-e397-479f-9431-770c3c22abce None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:53.227480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c10d41-77b1-42c7-8a3c-edf7f2c3e594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:53.228125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c10d41-77b1-42c7-8a3c-edf7f2c3e594 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:53.228408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c10d41-77b1-42c7-8a3c-edf7f2c3e594 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:53.228681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c10d41-77b1-42c7-8a3c-edf7f2c3e594 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:53.229847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c10d41-77b1-42c7-8a3c-edf7f2c3e594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:53.231927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c10d41-77b1-42c7-8a3c-edf7f2c3e594 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:53.386246 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1780/3607] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:38:53 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:38:53.390226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d696c6-54dc-4d4f-8f9a-0ff9066a7017 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:53.404674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d696c6-54dc-4d4f-8f9a-0ff9066a7017 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:53.513836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:53.551490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751a1e7-af60-4a3f-a650-5c25e05ca60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:53.556677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751a1e7-af60-4a3f-a650-5c25e05ca60d admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:53.556677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751a1e7-af60-4a3f-a650-5c25e05ca60d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:53.556677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751a1e7-af60-4a3f-a650-5c25e05ca60d admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:53.556677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751a1e7-af60-4a3f-a650-5c25e05ca60d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:53.556677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751a1e7-af60-4a3f-a650-5c25e05ca60d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:53.735027 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1828/3608] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:38:53 2022] POST /identity/v3/users => generated 289 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:38:53.743120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c10d41-77b1-42c7-8a3c-edf7f2c3e594 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:53.773781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c10d41-77b1-42c7-8a3c-edf7f2c3e594 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:53.784001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2de53-47b1-4dc1-9d18-de95a3b70d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:53.785645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2de53-47b1-4dc1-9d18-de95a3b70d1c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:53.786148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2de53-47b1-4dc1-9d18-de95a3b70d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:53.786872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2de53-47b1-4dc1-9d18-de95a3b70d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:53.787718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2de53-47b1-4dc1-9d18-de95a3b70d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:53.789969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2de53-47b1-4dc1-9d18-de95a3b70d1c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:53.802567 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1781/3609] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:38:53.806124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751a1e7-af60-4a3f-a650-5c25e05ca60d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:53.829726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751a1e7-af60-4a3f-a650-5c25e05ca60d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:53.844310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0efcd-18ea-4d79-9316-2b26d3cf28c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:53.851390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0efcd-18ea-4d79-9316-2b26d3cf28c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:53.851854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0efcd-18ea-4d79-9316-2b26d3cf28c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:53.852142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0efcd-18ea-4d79-9316-2b26d3cf28c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:53.852840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0efcd-18ea-4d79-9316-2b26d3cf28c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:53.854685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0efcd-18ea-4d79-9316-2b26d3cf28c2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:53.870257 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1829/3610] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:38:53.874003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2de53-47b1-4dc1-9d18-de95a3b70d1c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:53.891024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2de53-47b1-4dc1-9d18-de95a3b70d1c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:53.899495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407494c-893d-488c-8e9c-1d4b505f2020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:53.900486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407494c-893d-488c-8e9c-1d4b505f2020 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:53.900658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407494c-893d-488c-8e9c-1d4b505f2020 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:53.901902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407494c-893d-488c-8e9c-1d4b505f2020 admin admin] PATH_INFO: `/v3/projects/38450368ef5c4e68ac3c19c7a0a1ce65/users/5ffc2b1c410149e884a47240b5425e57/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:53.953103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407494c-893d-488c-8e9c-1d4b505f2020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38450368ef5c4e68ac3c19c7a0a1ce65, user_id=5ffc2b1c410149e884a47240b5425e57, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:53.982129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407494c-893d-488c-8e9c-1d4b505f2020 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:54.098385 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1782/3611] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:38:53 2022] PUT /identity/v3/projects/38450368ef5c4e68ac3c19c7a0a1ce65/users/5ffc2b1c410149e884a47240b5425e57/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:38:54.105204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e4a1b-0d7b-415b-b03c-83b0ff002b39 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:54.110123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e4a1b-0d7b-415b-b03c-83b0ff002b39 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:54.110123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e4a1b-0d7b-415b-b03c-83b0ff002b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:54.152729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e54e4a1b-0d7b-415b-b03c-83b0ff002b39 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:38:54.154640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e54e4a1b-0d7b-415b-b03c-83b0ff002b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:54.232948 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1830/3612] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:38:54.247356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407494c-893d-488c-8e9c-1d4b505f2020 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:54.249102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8407494c-893d-488c-8e9c-1d4b505f2020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:54.273658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:54.364891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407494c-893d-488c-8e9c-1d4b505f2020 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:54.368896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d97c6c-0e9e-4aa3-a5b1-a50aba99519c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:54.369611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d97c6c-0e9e-4aa3-a5b1-a50aba99519c service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:54.369894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d97c6c-0e9e-4aa3-a5b1-a50aba99519c service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:54.370195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d97c6c-0e9e-4aa3-a5b1-a50aba99519c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:54.388918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d97c6c-0e9e-4aa3-a5b1-a50aba99519c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:54.394584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d97c6c-0e9e-4aa3-a5b1-a50aba99519c service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:54.409004 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1783/3613] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:38:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:38:58.492958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e4a1b-0d7b-415b-b03c-83b0ff002b39 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:38:58.496889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e54e4a1b-0d7b-415b-b03c-83b0ff002b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:58.517297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e4a1b-0d7b-415b-b03c-83b0ff002b39 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:38:58.529120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895647f9-4f2a-4629-a784-cce3825584d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:38:58.529566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895647f9-4f2a-4629-a784-cce3825584d6 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:38:58.529851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895647f9-4f2a-4629-a784-cce3825584d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:38:58.530197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895647f9-4f2a-4629-a784-cce3825584d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:38:58.533514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-895647f9-4f2a-4629-a784-cce3825584d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:38:58.549969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895647f9-4f2a-4629-a784-cce3825584d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:38:58.551492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895647f9-4f2a-4629-a784-cce3825584d6 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:38:58.566236 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1831/3614] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:38:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:39:04.908727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=17 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:05.150199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105f4cd-870b-4108-8305-e1018847fda6 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:05.151417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105f4cd-870b-4108-8305-e1018847fda6 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:05.151921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105f4cd-870b-4108-8305-e1018847fda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:05.253061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-7105f4cd-870b-4108-8305-e1018847fda6 None None] MFA Rules not processed for user `5ffc2b1c410149e884a47240b5425e57`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:39:05.254311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7105f4cd-870b-4108-8305-e1018847fda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:05.446657 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1784/3615] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:39:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:39:05.456174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895647f9-4f2a-4629-a784-cce3825584d6 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:05.457702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-895647f9-4f2a-4629-a784-cce3825584d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:05.653099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895647f9-4f2a-4629-a784-cce3825584d6 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:05.662532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708746e-bd68-461d-9a9f-eb5e101310aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:05.666547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708746e-bd68-461d-9a9f-eb5e101310aa service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:05.667421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708746e-bd68-461d-9a9f-eb5e101310aa service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:05.667910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708746e-bd68-461d-9a9f-eb5e101310aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:05.688587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708746e-bd68-461d-9a9f-eb5e101310aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:05.699148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708746e-bd68-461d-9a9f-eb5e101310aa service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:05.715337 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1832/3616] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:39:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:39:06.463761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105f4cd-870b-4108-8305-e1018847fda6 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:06.466118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7105f4cd-870b-4108-8305-e1018847fda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:06.498952 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105f4cd-870b-4108-8305-e1018847fda6 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:06.521077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cc20b-cd70-4f81-9bfa-5f2aecf656c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:06.522098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cc20b-cd70-4f81-9bfa-5f2aecf656c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:06.522539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cc20b-cd70-4f81-9bfa-5f2aecf656c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:06.522981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cc20b-cd70-4f81-9bfa-5f2aecf656c5 admin admin] PATH_INFO: `/v3/users/51be346b3c5448c28ac57f5c1ffe50bc` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:06.524437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cc20b-cd70-4f81-9bfa-5f2aecf656c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51be346b3c5448c28ac57f5c1ffe50bc)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:06.528852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cc20b-cd70-4f81-9bfa-5f2aecf656c5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:06.706070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dcbfc-bb3e-46d8-bf5c-680f6d7bb9e0 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:06.706692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dcbfc-bb3e-46d8-bf5c-680f6d7bb9e0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:06.706852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dcbfc-bb3e-46d8-bf5c-680f6d7bb9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:06.762312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d51dcbfc-bb3e-46d8-bf5c-680f6d7bb9e0 None None] MFA Rules not processed for user `18036411a99e4634bfbaeae24b9f254d`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:39:06.762312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d51dcbfc-bb3e-46d8-bf5c-680f6d7bb9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:06.802874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d78cc20b-cd70-4f81-9bfa-5f2aecf656c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51be346b3c5448c28ac57f5c1ffe50bc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:06.806101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d78cc20b-cd70-4f81-9bfa-5f2aecf656c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51be346b3c5448c28ac57f5c1ffe50bc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:06.819904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:06.828650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d78cc20b-cd70-4f81-9bfa-5f2aecf656c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51be346b3c5448c28ac57f5c1ffe50bc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:06.871597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d78cc20b-cd70-4f81-9bfa-5f2aecf656c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51be346b3c5448c28ac57f5c1ffe50bc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:06.878301 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1833/3617] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:39:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:39:06.973738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d78cc20b-cd70-4f81-9bfa-5f2aecf656c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51be346b3c5448c28ac57f5c1ffe50bc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:06.983029 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1785/3618] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:39:06 2022] DELETE /identity/v3/users/51be346b3c5448c28ac57f5c1ffe50bc => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:39:07.669008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51dcbfc-bb3e-46d8-bf5c-680f6d7bb9e0 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:07.670548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d51dcbfc-bb3e-46d8-bf5c-680f6d7bb9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:07.690758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51dcbfc-bb3e-46d8-bf5c-680f6d7bb9e0 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:07.717473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cc20b-cd70-4f81-9bfa-5f2aecf656c5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:07.721084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d78cc20b-cd70-4f81-9bfa-5f2aecf656c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:07.855572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55415d55-3f7d-44b6-9444-22e7386be05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:07.856811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55415d55-3f7d-44b6-9444-22e7386be05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:07.857082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55415d55-3f7d-44b6-9444-22e7386be05d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:07.857495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55415d55-3f7d-44b6-9444-22e7386be05d admin admin] PATH_INFO: `/v3/projects/93732dbf56414de2b7667e1e70262a32` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:07.859526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55415d55-3f7d-44b6-9444-22e7386be05d admin admin] RBAC: Authorizing `identity:delete_project(project_id=93732dbf56414de2b7667e1e70262a32)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:07.865319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55415d55-3f7d-44b6-9444-22e7386be05d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:07.897692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:07.953794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cc20b-cd70-4f81-9bfa-5f2aecf656c5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:07.964624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbc768-18c8-4b96-a9ff-71967a9d14d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:07.964624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbc768-18c8-4b96-a9ff-71967a9d14d7 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:07.964624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbc768-18c8-4b96-a9ff-71967a9d14d7 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:07.964914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbc768-18c8-4b96-a9ff-71967a9d14d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:07.967698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-94fbc768-18c8-4b96-a9ff-71967a9d14d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:08.008346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-55415d55-3f7d-44b6-9444-22e7386be05d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93732dbf56414de2b7667e1e70262a32', 'request_id': 'req-55415d55-3f7d-44b6-9444-22e7386be05d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:08.009191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbc768-18c8-4b96-a9ff-71967a9d14d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:08.012763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbc768-18c8-4b96-a9ff-71967a9d14d7 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:08.018693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-55415d55-3f7d-44b6-9444-22e7386be05d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93732dbf56414de2b7667e1e70262a32', 'request_id': 'req-55415d55-3f7d-44b6-9444-22e7386be05d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:08.029710 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1786/3619] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:39:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:39:08.033379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbc768-18c8-4b96-a9ff-71967a9d14d7 service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:08.036626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-94fbc768-18c8-4b96-a9ff-71967a9d14d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:08.050834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-55415d55-3f7d-44b6-9444-22e7386be05d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93732dbf56414de2b7667e1e70262a32', 'request_id': 'req-55415d55-3f7d-44b6-9444-22e7386be05d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:08.078599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbc768-18c8-4b96-a9ff-71967a9d14d7 service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:08.168313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-55415d55-3f7d-44b6-9444-22e7386be05d admin admin] The token cache is being invalidate because project 93732dbf56414de2b7667e1e70262a32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:39:08.168880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-55415d55-3f7d-44b6-9444-22e7386be05d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:08.171105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-55415d55-3f7d-44b6-9444-22e7386be05d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:08.180525 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1834/3620] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:39:07 2022] DELETE /identity/v3/projects/93732dbf56414de2b7667e1e70262a32 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:39:08.181385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28cf7a-7d30-499d-b311-f7cb271cafeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:08.181385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28cf7a-7d30-499d-b311-f7cb271cafeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:08.181385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28cf7a-7d30-499d-b311-f7cb271cafeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:08.181385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28cf7a-7d30-499d-b311-f7cb271cafeb admin admin] PATH_INFO: `/v3/users/94897f20beb94dbd8e7eff6ecba30026` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:08.182578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c5bf8-6994-4fcb-ae57-48ab09628418 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:08.182578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c5bf8-6994-4fcb-ae57-48ab09628418 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:08.182694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28cf7a-7d30-499d-b311-f7cb271cafeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=94897f20beb94dbd8e7eff6ecba30026)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:08.182755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c5bf8-6994-4fcb-ae57-48ab09628418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:08.192450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28cf7a-7d30-499d-b311-f7cb271cafeb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:08.234419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-be3c5bf8-6994-4fcb-ae57-48ab09628418 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:39:08.235691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-be3c5bf8-6994-4fcb-ae57-48ab09628418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:08.246521 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1835/3621] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:39:08.255522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509d722-6d0e-449f-83dd-ea1886ae8e13 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:08.255986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509d722-6d0e-449f-83dd-ea1886ae8e13 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:08.256401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509d722-6d0e-449f-83dd-ea1886ae8e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:08.280868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e509d722-6d0e-449f-83dd-ea1886ae8e13 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:39:08.282270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e509d722-6d0e-449f-83dd-ea1886ae8e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:08.299717 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1836/3622] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:39:08.300888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509d722-6d0e-449f-83dd-ea1886ae8e13 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:08.317460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509d722-6d0e-449f-83dd-ea1886ae8e13 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:08.323980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e82d09-2791-4b95-a433-d1f077ad2ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:08.325315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e82d09-2791-4b95-a433-d1f077ad2ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:08.325741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e82d09-2791-4b95-a433-d1f077ad2ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:08.326223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e82d09-2791-4b95-a433-d1f077ad2ed2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:08.330874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e82d09-2791-4b95-a433-d1f077ad2ed2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:39:08.331352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e82d09-2791-4b95-a433-d1f077ad2ed2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:08.333552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e82d09-2791-4b95-a433-d1f077ad2ed2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:08.355302 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1837/3623] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:39:08.359064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e82d09-2791-4b95-a433-d1f077ad2ed2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:08.371796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e82d09-2791-4b95-a433-d1f077ad2ed2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:08.377006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de265f89-1cbe-4878-a440-8045a4ce18f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:08.377625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de265f89-1cbe-4878-a440-8045a4ce18f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:08.377909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de265f89-1cbe-4878-a440-8045a4ce18f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:08.378228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de265f89-1cbe-4878-a440-8045a4ce18f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:08.379169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de265f89-1cbe-4878-a440-8045a4ce18f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:08.381254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de265f89-1cbe-4878-a440-8045a4ce18f1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:08.488569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ef28cf7a-7d30-499d-b311-f7cb271cafeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94897f20beb94dbd8e7eff6ecba30026'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:08.490776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ef28cf7a-7d30-499d-b311-f7cb271cafeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94897f20beb94dbd8e7eff6ecba30026'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:08.509844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ef28cf7a-7d30-499d-b311-f7cb271cafeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94897f20beb94dbd8e7eff6ecba30026'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:08.514955 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1838/3624] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:39:08 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:39:08.520360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de265f89-1cbe-4878-a440-8045a4ce18f1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:08.524703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-de265f89-1cbe-4878-a440-8045a4ce18f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:08.531819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ef28cf7a-7d30-499d-b311-f7cb271cafeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94897f20beb94dbd8e7eff6ecba30026'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:08.568591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:08.639203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de265f89-1cbe-4878-a440-8045a4ce18f1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:08.645750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ef28cf7a-7d30-499d-b311-f7cb271cafeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94897f20beb94dbd8e7eff6ecba30026'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:08.656514 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1787/3625] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:39:08 2022] DELETE /identity/v3/users/94897f20beb94dbd8e7eff6ecba30026 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:39:08.659754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ed4d8-3016-43ee-bc8a-7d6131513717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:08.660523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ed4d8-3016-43ee-bc8a-7d6131513717 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:08.660968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ed4d8-3016-43ee-bc8a-7d6131513717 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:08.661567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ed4d8-3016-43ee-bc8a-7d6131513717 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:08.662350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ed4d8-3016-43ee-bc8a-7d6131513717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:08.664889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ed4d8-3016-43ee-bc8a-7d6131513717 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:08.763333 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1839/3626] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:39:08 2022] POST /identity/v3/users => generated 288 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:39:08.767850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28cf7a-7d30-499d-b311-f7cb271cafeb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:08.915678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:08.937859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28cf7a-7d30-499d-b311-f7cb271cafeb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:08.951437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323eef8f-6ac3-49f1-a24f-fe9eca70985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:08.952310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323eef8f-6ac3-49f1-a24f-fe9eca70985b admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:08.954618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323eef8f-6ac3-49f1-a24f-fe9eca70985b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:08.955039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323eef8f-6ac3-49f1-a24f-fe9eca70985b admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:08.957400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323eef8f-6ac3-49f1-a24f-fe9eca70985b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:08.961889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323eef8f-6ac3-49f1-a24f-fe9eca70985b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:08.980001 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1788/3627] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:39:08.987539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ed4d8-3016-43ee-bc8a-7d6131513717 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:09.003291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ed4d8-3016-43ee-bc8a-7d6131513717 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:09.016870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd4ad9-d0c9-4fca-a39b-37787ee9e588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:09.017660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd4ad9-d0c9-4fca-a39b-37787ee9e588 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:09.018062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd4ad9-d0c9-4fca-a39b-37787ee9e588 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:09.018455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd4ad9-d0c9-4fca-a39b-37787ee9e588 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:09.019343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd4ad9-d0c9-4fca-a39b-37787ee9e588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:09.022282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd4ad9-d0c9-4fca-a39b-37787ee9e588 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:09.053219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323eef8f-6ac3-49f1-a24f-fe9eca70985b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:09.062163 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1840/3628] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:39:09.069130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323eef8f-6ac3-49f1-a24f-fe9eca70985b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:09.089791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcecd4-e048-446b-b21d-1194654a155a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:09.091323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcecd4-e048-446b-b21d-1194654a155a admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:09.093589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcecd4-e048-446b-b21d-1194654a155a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:09.094052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcecd4-e048-446b-b21d-1194654a155a admin admin] PATH_INFO: `/v3/projects/41e4481a955a4c98a44cffcc89af6eb4/users/15f467c14d5241f2b147e4b88fb05916/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:09.145764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fcecd4-e048-446b-b21d-1194654a155a admin admin] RBAC: Authorizing `identity:create_grant(project_id=41e4481a955a4c98a44cffcc89af6eb4, user_id=15f467c14d5241f2b147e4b88fb05916, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:09.152572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fcecd4-e048-446b-b21d-1194654a155a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:09.183706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd4ad9-d0c9-4fca-a39b-37787ee9e588 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:09.185903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e9bd4ad9-d0c9-4fca-a39b-37787ee9e588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:09.206742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd4ad9-d0c9-4fca-a39b-37787ee9e588 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:09.212785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00faac2-b743-4794-b221-b203af1dc8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:09.214434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00faac2-b743-4794-b221-b203af1dc8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:09.214893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00faac2-b743-4794-b221-b203af1dc8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:09.216254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00faac2-b743-4794-b221-b203af1dc8ca admin admin] PATH_INFO: `/v3/projects/3e9ede68f63747d59153a46412033856` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:09.231321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00faac2-b743-4794-b221-b203af1dc8ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e9ede68f63747d59153a46412033856)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:09.238533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00faac2-b743-4794-b221-b203af1dc8ca admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:09.303750 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1789/3629] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:39:09 2022] PUT /identity/v3/projects/41e4481a955a4c98a44cffcc89af6eb4/users/15f467c14d5241f2b147e4b88fb05916/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:39:09.309086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445faec-c47f-4a5a-bc54-fd50b339ebf6 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:09.309382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445faec-c47f-4a5a-bc54-fd50b339ebf6 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:09.309816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445faec-c47f-4a5a-bc54-fd50b339ebf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:09.384481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e445faec-c47f-4a5a-bc54-fd50b339ebf6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:39:09.389251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e445faec-c47f-4a5a-bc54-fd50b339ebf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:09.391334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a00faac2-b743-4794-b221-b203af1dc8ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e9ede68f63747d59153a46412033856', 'request_id': 'req-a00faac2-b743-4794-b221-b203af1dc8ca'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:09.411197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a00faac2-b743-4794-b221-b203af1dc8ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e9ede68f63747d59153a46412033856', 'request_id': 'req-a00faac2-b743-4794-b221-b203af1dc8ca'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:09.431842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a00faac2-b743-4794-b221-b203af1dc8ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e9ede68f63747d59153a46412033856', 'request_id': 'req-a00faac2-b743-4794-b221-b203af1dc8ca'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:09.511202 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1790/3630] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:39:09.522460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445faec-c47f-4a5a-bc54-fd50b339ebf6 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:09.523907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e445faec-c47f-4a5a-bc54-fd50b339ebf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:09.590196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a00faac2-b743-4794-b221-b203af1dc8ca admin admin] The token cache is being invalidate because project 3e9ede68f63747d59153a46412033856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:39:09.590944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a00faac2-b743-4794-b221-b203af1dc8ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:09.592857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a00faac2-b743-4794-b221-b203af1dc8ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:09.602984 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1841/3631] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:39:09 2022] DELETE /identity/v3/projects/3e9ede68f63747d59153a46412033856 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:39:09.609306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa0f7e-cccd-4e0d-9b91-616a56e4387a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:09.614576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa0f7e-cccd-4e0d-9b91-616a56e4387a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:09.614576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa0f7e-cccd-4e0d-9b91-616a56e4387a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:09.674890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9afa0f7e-cccd-4e0d-9b91-616a56e4387a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:39:09.678582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9afa0f7e-cccd-4e0d-9b91-616a56e4387a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:09.708840 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1842/3632] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:39:09.709278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445faec-c47f-4a5a-bc54-fd50b339ebf6 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:09.710494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a30ee4-b944-4760-9f06-abd38385b94a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:09.710795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a30ee4-b944-4760-9f06-abd38385b94a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:09.711165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a30ee4-b944-4760-9f06-abd38385b94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:09.721261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86ecae-7e42-4335-886f-e665b4b7645e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:09.721911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86ecae-7e42-4335-886f-e665b4b7645e service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:09.722233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86ecae-7e42-4335-886f-e665b4b7645e service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:09.722527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86ecae-7e42-4335-886f-e665b4b7645e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:09.724461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8e86ecae-7e42-4335-886f-e665b4b7645e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:09.755439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86ecae-7e42-4335-886f-e665b4b7645e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:09.756182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-28a30ee4-b944-4760-9f06-abd38385b94a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:39:09.756925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86ecae-7e42-4335-886f-e665b4b7645e service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:09.761875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-28a30ee4-b944-4760-9f06-abd38385b94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:09.777746 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1791/3633] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:39:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:39:09.791478 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1843/3634] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:39:09.804077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86ecae-7e42-4335-886f-e665b4b7645e service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:09.813871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86ecae-7e42-4335-886f-e665b4b7645e service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:09.831427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f44c19-733a-44c1-a7c4-3ba52e664cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:09.834652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f44c19-733a-44c1-a7c4-3ba52e664cfc admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:09.834652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f44c19-733a-44c1-a7c4-3ba52e664cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:09.834652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f44c19-733a-44c1-a7c4-3ba52e664cfc admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:09.834652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f44c19-733a-44c1-a7c4-3ba52e664cfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:39:09.834652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f44c19-733a-44c1-a7c4-3ba52e664cfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:09.835320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f44c19-733a-44c1-a7c4-3ba52e664cfc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:09.849769 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1792/3635] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:39:09.853932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a30ee4-b944-4760-9f06-abd38385b94a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:09.875731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a30ee4-b944-4760-9f06-abd38385b94a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:09.892993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e16d23-1ce0-43ec-9002-741b35c5cacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:09.895034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e16d23-1ce0-43ec-9002-741b35c5cacd admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:09.895469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e16d23-1ce0-43ec-9002-741b35c5cacd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:09.895887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e16d23-1ce0-43ec-9002-741b35c5cacd admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:09.897571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e16d23-1ce0-43ec-9002-741b35c5cacd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:09.904229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e16d23-1ce0-43ec-9002-741b35c5cacd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:09.982324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e9e43-5ee1-4ffe-a52d-681ac886e80e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:09.982646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e9e43-5ee1-4ffe-a52d-681ac886e80e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:09.982930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e9e43-5ee1-4ffe-a52d-681ac886e80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:10.011601 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1844/3636] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:39:09 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:39:10.014220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e16d23-1ce0-43ec-9002-741b35c5cacd admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:10.065035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-218e9e43-5ee1-4ffe-a52d-681ac886e80e None None] MFA Rules not processed for user `5ffc2b1c410149e884a47240b5425e57`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:39:10.066525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-218e9e43-5ee1-4ffe-a52d-681ac886e80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:10.079870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:10.118469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e16d23-1ce0-43ec-9002-741b35c5cacd admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:10.137536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa612ad-4c0d-48f9-8942-0a07516ddcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:10.140830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa612ad-4c0d-48f9-8942-0a07516ddcd4 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:10.141337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa612ad-4c0d-48f9-8942-0a07516ddcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:10.141820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa612ad-4c0d-48f9-8942-0a07516ddcd4 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:10.143246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa612ad-4c0d-48f9-8942-0a07516ddcd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:10.151281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa612ad-4c0d-48f9-8942-0a07516ddcd4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:10.217709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:10.229889 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1793/3637] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:39:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:39:10.352181 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1845/3638] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:39:10 2022] POST /identity/v3/users => generated 294 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:39:10.355981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e9e43-5ee1-4ffe-a52d-681ac886e80e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:10.372628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e9e43-5ee1-4ffe-a52d-681ac886e80e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:10.394574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9210984-e1e6-42b4-985b-f74745566087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:10.399722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9210984-e1e6-42b4-985b-f74745566087 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:10.400709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9210984-e1e6-42b4-985b-f74745566087 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:10.410363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9210984-e1e6-42b4-985b-f74745566087 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:10.410363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9210984-e1e6-42b4-985b-f74745566087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:10.411250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9210984-e1e6-42b4-985b-f74745566087 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:10.431202 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1794/3639] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:39:10.435312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa612ad-4c0d-48f9-8942-0a07516ddcd4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:10.453876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa612ad-4c0d-48f9-8942-0a07516ddcd4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:10.463015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9364b-c7a8-4d9e-a720-2402f8155d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:10.471047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9364b-c7a8-4d9e-a720-2402f8155d6a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:10.471047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9364b-c7a8-4d9e-a720-2402f8155d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:10.471047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9364b-c7a8-4d9e-a720-2402f8155d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:10.471047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9364b-c7a8-4d9e-a720-2402f8155d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:10.475332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9364b-c7a8-4d9e-a720-2402f8155d6a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:10.496470 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1846/3640] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:39:10.500294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9210984-e1e6-42b4-985b-f74745566087 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:10.513120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9210984-e1e6-42b4-985b-f74745566087 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:10.531802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99013895-7b42-4fc5-8755-d35e37fc258e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:10.535350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99013895-7b42-4fc5-8755-d35e37fc258e admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:10.536747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99013895-7b42-4fc5-8755-d35e37fc258e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:10.537676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99013895-7b42-4fc5-8755-d35e37fc258e admin admin] PATH_INFO: `/v3/projects/c48bca00e4d445918f030bf885424b40/users/b74e8d6facd1460ab31a3ce4b24dd315/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:10.573707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99013895-7b42-4fc5-8755-d35e37fc258e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48bca00e4d445918f030bf885424b40, user_id=b74e8d6facd1460ab31a3ce4b24dd315, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:10.582519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99013895-7b42-4fc5-8755-d35e37fc258e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:10.729151 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1795/3641] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:39:10 2022] PUT /identity/v3/projects/c48bca00e4d445918f030bf885424b40/users/b74e8d6facd1460ab31a3ce4b24dd315/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:39:10.734427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e86987-4e5f-4ebc-b47d-117665fcf4f2 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:10.734970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e86987-4e5f-4ebc-b47d-117665fcf4f2 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:10.735269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e86987-4e5f-4ebc-b47d-117665fcf4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:10.785115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-62e86987-4e5f-4ebc-b47d-117665fcf4f2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:39:10.786593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-62e86987-4e5f-4ebc-b47d-117665fcf4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:10.939586 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1847/3642] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:39:10.969854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99013895-7b42-4fc5-8755-d35e37fc258e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:10.971380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-99013895-7b42-4fc5-8755-d35e37fc258e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:11.141251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99013895-7b42-4fc5-8755-d35e37fc258e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:11.145085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f22d3-1d5a-4e4e-b30f-fbdba12ec19e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:11.145847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f22d3-1d5a-4e4e-b30f-fbdba12ec19e service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:11.146369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f22d3-1d5a-4e4e-b30f-fbdba12ec19e service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:11.146924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f22d3-1d5a-4e4e-b30f-fbdba12ec19e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:11.159255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f22d3-1d5a-4e4e-b30f-fbdba12ec19e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:11.160926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f22d3-1d5a-4e4e-b30f-fbdba12ec19e service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:11.174968 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1796/3643] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:39:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:39:11.673799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e86987-4e5f-4ebc-b47d-117665fcf4f2 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:11.675409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-62e86987-4e5f-4ebc-b47d-117665fcf4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:11.828441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e86987-4e5f-4ebc-b47d-117665fcf4f2 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:11.834014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0414d7-0e8f-4967-af03-fb5a8192292b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:11.834786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0414d7-0e8f-4967-af03-fb5a8192292b service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:11.835139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0414d7-0e8f-4967-af03-fb5a8192292b service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:11.835427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0414d7-0e8f-4967-af03-fb5a8192292b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:11.854282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ef0414d7-0e8f-4967-af03-fb5a8192292b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:11.879576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0414d7-0e8f-4967-af03-fb5a8192292b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:11.881203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0414d7-0e8f-4967-af03-fb5a8192292b service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:11.905092 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1848/3644] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:39:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:39:18.748195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efba65-3885-44d8-94bc-4c6112a5377e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:18.748753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efba65-3885-44d8-94bc-4c6112a5377e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:18.748753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efba65-3885-44d8-94bc-4c6112a5377e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:18.778068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-15efba65-3885-44d8-94bc-4c6112a5377e None None] MFA Rules not processed for user `b1cc79af058b4c35b3c572448fac86a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:39:18.780175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-15efba65-3885-44d8-94bc-4c6112a5377e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:18.893544 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1797/3645] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:39:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:39:21.044309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0414d7-0e8f-4967-af03-fb5a8192292b service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:21.046101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ef0414d7-0e8f-4967-af03-fb5a8192292b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:21.068096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0414d7-0e8f-4967-af03-fb5a8192292b service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:21.079893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ea1ca-9c76-4dd1-92ca-745d5edd3968 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:21.081229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ea1ca-9c76-4dd1-92ca-745d5edd3968 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:21.081683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ea1ca-9c76-4dd1-92ca-745d5edd3968 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:21.083428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ea1ca-9c76-4dd1-92ca-745d5edd3968 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:21.084720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-278ea1ca-9c76-4dd1-92ca-745d5edd3968 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:21.111478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ea1ca-9c76-4dd1-92ca-745d5edd3968 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:21.115789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ea1ca-9c76-4dd1-92ca-745d5edd3968 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:21.141874 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1849/3646] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:39:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:39:21.356464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc27c6-7ef7-4f8d-a51c-7d70e5174703 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:21.357022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc27c6-7ef7-4f8d-a51c-7d70e5174703 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:21.358162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc27c6-7ef7-4f8d-a51c-7d70e5174703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:21.419716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-97fc27c6-7ef7-4f8d-a51c-7d70e5174703 None None] MFA Rules not processed for user `b1cc79af058b4c35b3c572448fac86a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:39:21.422106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-97fc27c6-7ef7-4f8d-a51c-7d70e5174703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:21.444183 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1798/3647] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:39:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:39:23.641867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402544f1-4b96-40e6-bd41-6aacf7ba6ead None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:23.642348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402544f1-4b96-40e6-bd41-6aacf7ba6ead None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:23.642648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402544f1-4b96-40e6-bd41-6aacf7ba6ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:23.705132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-402544f1-4b96-40e6-bd41-6aacf7ba6ead None None] MFA Rules not processed for user `15f467c14d5241f2b147e4b88fb05916`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:39:23.706403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-402544f1-4b96-40e6-bd41-6aacf7ba6ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:23.791380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:23.839253 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1850/3648] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:39:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:39:23.963211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc27c6-7ef7-4f8d-a51c-7d70e5174703 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:23.965354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-97fc27c6-7ef7-4f8d-a51c-7d70e5174703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:24.108663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:24.198739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc27c6-7ef7-4f8d-a51c-7d70e5174703 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:24.212041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446e943-e196-4a31-ac33-58c469fc5666 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:24.212785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446e943-e196-4a31-ac33-58c469fc5666 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:24.212986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446e943-e196-4a31-ac33-58c469fc5666 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:24.215795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446e943-e196-4a31-ac33-58c469fc5666 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:24.238810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446e943-e196-4a31-ac33-58c469fc5666 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:24.240430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446e943-e196-4a31-ac33-58c469fc5666 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:24.276053 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1799/3649] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:39:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:39:24.936808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10910c-9e85-4435-9088-a4a1f3cca907 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:24.937712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10910c-9e85-4435-9088-a4a1f3cca907 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:24.938216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10910c-9e85-4435-9088-a4a1f3cca907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:25.030498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8b10910c-9e85-4435-9088-a4a1f3cca907 None None] MFA Rules not processed for user `b74e8d6facd1460ab31a3ce4b24dd315`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:39:25.031751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8b10910c-9e85-4435-9088-a4a1f3cca907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:25.204095 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1851/3650] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:39:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:39:25.412848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446e943-e196-4a31-ac33-58c469fc5666 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:25.433424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446e943-e196-4a31-ac33-58c469fc5666 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:25.443276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7451a-0b1b-4b1a-bd0b-a60a9ebcdd4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:25.444094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7451a-0b1b-4b1a-bd0b-a60a9ebcdd4c service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:25.444526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7451a-0b1b-4b1a-bd0b-a60a9ebcdd4c service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:25.446081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7451a-0b1b-4b1a-bd0b-a60a9ebcdd4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:25.454597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7451a-0b1b-4b1a-bd0b-a60a9ebcdd4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:25.456450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7451a-0b1b-4b1a-bd0b-a60a9ebcdd4c service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:25.483646 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1800/3651] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:39:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:39:27.211447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d43b91-4491-40c7-9333-7c5eb3059ba2 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:27.212039 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d43b91-4491-40c7-9333-7c5eb3059ba2 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:27.212039 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d43b91-4491-40c7-9333-7c5eb3059ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:27.236013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-79d43b91-4491-40c7-9333-7c5eb3059ba2 None None] MFA Rules not processed for user `15f467c14d5241f2b147e4b88fb05916`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:39:27.237452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-79d43b91-4491-40c7-9333-7c5eb3059ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:27.250570 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1852/3652] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:39:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:39:31.067915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5bca0-c325-4838-81d7-7b2ed485b5df None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:31.068369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5bca0-c325-4838-81d7-7b2ed485b5df None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:31.068547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5bca0-c325-4838-81d7-7b2ed485b5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:31.091507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-30e5bca0-c325-4838-81d7-7b2ed485b5df None None] MFA Rules not processed for user `b74e8d6facd1460ab31a3ce4b24dd315`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:39:31.093667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-30e5bca0-c325-4838-81d7-7b2ed485b5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:31.114289 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1801/3653] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:39:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:39:37.230587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=47 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:41.084628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=26 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:45.111387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f3f8e-cfc2-4bbb-a32e-497b61131ff2 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:45.114776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f3f8e-cfc2-4bbb-a32e-497b61131ff2 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:45.114776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f3f8e-cfc2-4bbb-a32e-497b61131ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:45.131610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e39f3f8e-cfc2-4bbb-a32e-497b61131ff2 None None] MFA Rules not processed for user `b1cc79af058b4c35b3c572448fac86a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:39:45.132814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e39f3f8e-cfc2-4bbb-a32e-497b61131ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:45.141073 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1853/3654] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:39:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:39:47.705358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5bca0-c325-4838-81d7-7b2ed485b5df None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:47.718851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5bca0-c325-4838-81d7-7b2ed485b5df None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:47.724852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db2e51-3f64-4d16-8053-89f247303daf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:47.725464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db2e51-3f64-4d16-8053-89f247303daf service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:47.725780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db2e51-3f64-4d16-8053-89f247303daf service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:47.726187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db2e51-3f64-4d16-8053-89f247303daf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:47.728115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a7db2e51-3f64-4d16-8053-89f247303daf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:47.741516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db2e51-3f64-4d16-8053-89f247303daf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:47.743400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db2e51-3f64-4d16-8053-89f247303daf service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:47.754746 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1802/3655] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:39:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:39:49.209290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f3f8e-cfc2-4bbb-a32e-497b61131ff2 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:49.212033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e39f3f8e-cfc2-4bbb-a32e-497b61131ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:49.231492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f3f8e-cfc2-4bbb-a32e-497b61131ff2 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:49.240439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59f763-c905-4747-b523-12204b5a3f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:49.243391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59f763-c905-4747-b523-12204b5a3f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:49.243684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59f763-c905-4747-b523-12204b5a3f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:49.246192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59f763-c905-4747-b523-12204b5a3f6c admin admin] PATH_INFO: `/v3/users/3e8e0bc10d3f451c8837c1f1e4d86eaa` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:49.247591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59f763-c905-4747-b523-12204b5a3f6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e8e0bc10d3f451c8837c1f1e4d86eaa)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:49.249822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59f763-c905-4747-b523-12204b5a3f6c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:49.572048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9c59f763-c905-4747-b523-12204b5a3f6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e8e0bc10d3f451c8837c1f1e4d86eaa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:49.573460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9c59f763-c905-4747-b523-12204b5a3f6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e8e0bc10d3f451c8837c1f1e4d86eaa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:49.583514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9c59f763-c905-4747-b523-12204b5a3f6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e8e0bc10d3f451c8837c1f1e4d86eaa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:49.599401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9c59f763-c905-4747-b523-12204b5a3f6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e8e0bc10d3f451c8837c1f1e4d86eaa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:49.600964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9c59f763-c905-4747-b523-12204b5a3f6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e8e0bc10d3f451c8837c1f1e4d86eaa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:49.708669 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1854/3656] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:39:49 2022] DELETE /identity/v3/users/3e8e0bc10d3f451c8837c1f1e4d86eaa => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:39:50.121561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db2e51-3f64-4d16-8053-89f247303daf service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:50.134960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db2e51-3f64-4d16-8053-89f247303daf service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:50.234584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1bb6e-4665-4767-90a3-6cbdcac3f8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:50.235659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1bb6e-4665-4767-90a3-6cbdcac3f8d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:50.236143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1bb6e-4665-4767-90a3-6cbdcac3f8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:50.236615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1bb6e-4665-4767-90a3-6cbdcac3f8d8 admin admin] PATH_INFO: `/v3/projects/4840257127594149b03c0aa3ab94b486` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:50.238786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1bb6e-4665-4767-90a3-6cbdcac3f8d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4840257127594149b03c0aa3ab94b486)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:50.241874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1bb6e-4665-4767-90a3-6cbdcac3f8d8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:50.393915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dde1bb6e-4665-4767-90a3-6cbdcac3f8d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4840257127594149b03c0aa3ab94b486', 'request_id': 'req-dde1bb6e-4665-4767-90a3-6cbdcac3f8d8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:50.578725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dde1bb6e-4665-4767-90a3-6cbdcac3f8d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4840257127594149b03c0aa3ab94b486', 'request_id': 'req-dde1bb6e-4665-4767-90a3-6cbdcac3f8d8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:50.587438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dde1bb6e-4665-4767-90a3-6cbdcac3f8d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4840257127594149b03c0aa3ab94b486', 'request_id': 'req-dde1bb6e-4665-4767-90a3-6cbdcac3f8d8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:50.615269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dde1bb6e-4665-4767-90a3-6cbdcac3f8d8 admin admin] The token cache is being invalidate because project 4840257127594149b03c0aa3ab94b486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:39:50.615629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dde1bb6e-4665-4767-90a3-6cbdcac3f8d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:50.616446 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dde1bb6e-4665-4767-90a3-6cbdcac3f8d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:50.623512 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1803/3657] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:39:50 2022] DELETE /identity/v3/projects/4840257127594149b03c0aa3ab94b486 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:39:50.625353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4d698-fe37-4a18-9326-a4ed51a313cb None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:50.625808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4d698-fe37-4a18-9326-a4ed51a313cb None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:50.625950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4d698-fe37-4a18-9326-a4ed51a313cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:50.653176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-cbc4d698-fe37-4a18-9326-a4ed51a313cb None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:39:50.655086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cbc4d698-fe37-4a18-9326-a4ed51a313cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:50.734861 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1855/3658] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:39:50.743759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a33f62-a16a-4242-8400-caea345abdf3 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:50.744101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a33f62-a16a-4242-8400-caea345abdf3 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:50.744638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a33f62-a16a-4242-8400-caea345abdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:50.765284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f8a33f62-a16a-4242-8400-caea345abdf3 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:39:50.766666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f8a33f62-a16a-4242-8400-caea345abdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:50.775163 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1804/3659] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:39:50.779838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4d698-fe37-4a18-9326-a4ed51a313cb None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:50.790079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4d698-fe37-4a18-9326-a4ed51a313cb None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:50.796175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebbe88-d966-43c0-ae49-3d6d3c528310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:50.796877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebbe88-d966-43c0-ae49-3d6d3c528310 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:50.797175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebbe88-d966-43c0-ae49-3d6d3c528310 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:50.797455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebbe88-d966-43c0-ae49-3d6d3c528310 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:50.798149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebbe88-d966-43c0-ae49-3d6d3c528310 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:39:50.798576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebbe88-d966-43c0-ae49-3d6d3c528310 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:50.800244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebbe88-d966-43c0-ae49-3d6d3c528310 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:50.814309 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1856/3660] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:39:50.819048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a33f62-a16a-4242-8400-caea345abdf3 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:50.829932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a33f62-a16a-4242-8400-caea345abdf3 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:50.836605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41adee8-e703-4389-b40b-40271e97faa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:50.837478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41adee8-e703-4389-b40b-40271e97faa4 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:50.839960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41adee8-e703-4389-b40b-40271e97faa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:50.839960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41adee8-e703-4389-b40b-40271e97faa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:50.840260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41adee8-e703-4389-b40b-40271e97faa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:50.842699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41adee8-e703-4389-b40b-40271e97faa4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:50.984793 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1805/3661] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:39:50 2022] POST /identity/v3/projects => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:39:50.985787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebbe88-d966-43c0-ae49-3d6d3c528310 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:50.998246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebbe88-d966-43c0-ae49-3d6d3c528310 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:51.056197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:51.069627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3639b99-2692-41a7-b215-61a2c67e7d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:51.070234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3639b99-2692-41a7-b215-61a2c67e7d5e admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:51.070521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3639b99-2692-41a7-b215-61a2c67e7d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:51.070801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3639b99-2692-41a7-b215-61a2c67e7d5e admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:51.071430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3639b99-2692-41a7-b215-61a2c67e7d5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:51.073429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3639b99-2692-41a7-b215-61a2c67e7d5e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:51.180203 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1857/3662] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:39:50 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:39:51.185462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41adee8-e703-4389-b40b-40271e97faa4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:51.201071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41adee8-e703-4389-b40b-40271e97faa4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:51.206726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fa8db-6456-4415-9584-fd311ec2fcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:51.207649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fa8db-6456-4415-9584-fd311ec2fcf9 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:51.207949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fa8db-6456-4415-9584-fd311ec2fcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:51.208216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fa8db-6456-4415-9584-fd311ec2fcf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:51.208875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fa8db-6456-4415-9584-fd311ec2fcf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:51.210553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fa8db-6456-4415-9584-fd311ec2fcf9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:51.221581 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1806/3663] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:39:51.225697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3639b99-2692-41a7-b215-61a2c67e7d5e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:51.239883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3639b99-2692-41a7-b215-61a2c67e7d5e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:51.245534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc889d3a-d6aa-4e8f-ab99-740808351092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:51.246408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc889d3a-d6aa-4e8f-ab99-740808351092 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:51.246850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc889d3a-d6aa-4e8f-ab99-740808351092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:51.247274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc889d3a-d6aa-4e8f-ab99-740808351092 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:51.248077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc889d3a-d6aa-4e8f-ab99-740808351092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:51.250590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc889d3a-d6aa-4e8f-ab99-740808351092 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:51.273417 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1858/3664] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:39:51.274643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fa8db-6456-4415-9584-fd311ec2fcf9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:51.287264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fa8db-6456-4415-9584-fd311ec2fcf9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:51.296370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568dea9b-dbcc-4247-ad1a-9e2b58838713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:51.297064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568dea9b-dbcc-4247-ad1a-9e2b58838713 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:51.297350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568dea9b-dbcc-4247-ad1a-9e2b58838713 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:51.297632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568dea9b-dbcc-4247-ad1a-9e2b58838713 admin admin] PATH_INFO: `/v3/projects/05672dc7b53747988fde6abc4adb2ef1/users/eba500c7bb654a649a57bb8c96aa8bf0/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:51.317537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568dea9b-dbcc-4247-ad1a-9e2b58838713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05672dc7b53747988fde6abc4adb2ef1, user_id=eba500c7bb654a649a57bb8c96aa8bf0, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:51.323147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568dea9b-dbcc-4247-ad1a-9e2b58838713 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:51.445802 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1807/3665] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:39:51 2022] PUT /identity/v3/projects/05672dc7b53747988fde6abc4adb2ef1/users/eba500c7bb654a649a57bb8c96aa8bf0/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:39:51.448375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adfee3-c023-4280-b80f-5eedcdf5202d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:51.448839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adfee3-c023-4280-b80f-5eedcdf5202d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:51.449102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adfee3-c023-4280-b80f-5eedcdf5202d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:51.481788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-29adfee3-c023-4280-b80f-5eedcdf5202d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:39:51.481788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-29adfee3-c023-4280-b80f-5eedcdf5202d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:51.587233 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1859/3666] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:39:51.609747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568dea9b-dbcc-4247-ad1a-9e2b58838713 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:51.611958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-568dea9b-dbcc-4247-ad1a-9e2b58838713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:51.639208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:51.738894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568dea9b-dbcc-4247-ad1a-9e2b58838713 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:51.747189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8b65b-61c9-41b7-834c-92afece7f312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:51.748233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8b65b-61c9-41b7-834c-92afece7f312 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:51.748806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8b65b-61c9-41b7-834c-92afece7f312 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:51.749185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8b65b-61c9-41b7-834c-92afece7f312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:51.767304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8b65b-61c9-41b7-834c-92afece7f312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:51.776242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8b65b-61c9-41b7-834c-92afece7f312 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:51.799816 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1808/3667] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:39:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:39:58.831216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adfee3-c023-4280-b80f-5eedcdf5202d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:58.833277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-29adfee3-c023-4280-b80f-5eedcdf5202d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:39:58.855644 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adfee3-c023-4280-b80f-5eedcdf5202d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:58.862458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bd175-d291-42e5-9b1c-a7be075f2fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:58.863614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bd175-d291-42e5-9b1c-a7be075f2fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:58.863967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bd175-d291-42e5-9b1c-a7be075f2fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:58.864507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bd175-d291-42e5-9b1c-a7be075f2fa0 admin admin] PATH_INFO: `/v3/users/15f467c14d5241f2b147e4b88fb05916` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:58.866047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bd175-d291-42e5-9b1c-a7be075f2fa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15f467c14d5241f2b147e4b88fb05916)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:58.869501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bd175-d291-42e5-9b1c-a7be075f2fa0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:59.106799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ee5bd175-d291-42e5-9b1c-a7be075f2fa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15f467c14d5241f2b147e4b88fb05916'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:59.107760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ee5bd175-d291-42e5-9b1c-a7be075f2fa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15f467c14d5241f2b147e4b88fb05916'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:59.132198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ee5bd175-d291-42e5-9b1c-a7be075f2fa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15f467c14d5241f2b147e4b88fb05916'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:59.160539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ee5bd175-d291-42e5-9b1c-a7be075f2fa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15f467c14d5241f2b147e4b88fb05916'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:59.161635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ee5bd175-d291-42e5-9b1c-a7be075f2fa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15f467c14d5241f2b147e4b88fb05916'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:59.280102 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1860/3668] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:39:58 2022] DELETE /identity/v3/users/15f467c14d5241f2b147e4b88fb05916 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:39:59.652886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8b65b-61c9-41b7-834c-92afece7f312 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:39:59.667808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8b65b-61c9-41b7-834c-92afece7f312 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:39:59.747075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115eb57-5a13-4e93-a678-b0e39ce5fb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:39:59.748237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115eb57-5a13-4e93-a678-b0e39ce5fb5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:59.748237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115eb57-5a13-4e93-a678-b0e39ce5fb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:59.748443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115eb57-5a13-4e93-a678-b0e39ce5fb5b admin admin] PATH_INFO: `/v3/projects/41e4481a955a4c98a44cffcc89af6eb4` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:39:59.749436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115eb57-5a13-4e93-a678-b0e39ce5fb5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=41e4481a955a4c98a44cffcc89af6eb4)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:39:59.754557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115eb57-5a13-4e93-a678-b0e39ce5fb5b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:39:59.876098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6115eb57-5a13-4e93-a678-b0e39ce5fb5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41e4481a955a4c98a44cffcc89af6eb4', 'request_id': 'req-6115eb57-5a13-4e93-a678-b0e39ce5fb5b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:59.961776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6115eb57-5a13-4e93-a678-b0e39ce5fb5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41e4481a955a4c98a44cffcc89af6eb4', 'request_id': 'req-6115eb57-5a13-4e93-a678-b0e39ce5fb5b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:59.973014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6115eb57-5a13-4e93-a678-b0e39ce5fb5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41e4481a955a4c98a44cffcc89af6eb4', 'request_id': 'req-6115eb57-5a13-4e93-a678-b0e39ce5fb5b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:39:59.975422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009fd04-c614-4ebe-90a4-3789ec91d4c8 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:39:59.975978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009fd04-c614-4ebe-90a4-3789ec91d4c8 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:39:59.976263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009fd04-c614-4ebe-90a4-3789ec91d4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:00.009160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6115eb57-5a13-4e93-a678-b0e39ce5fb5b admin admin] The token cache is being invalidate because project 41e4481a955a4c98a44cffcc89af6eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:40:00.009357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6115eb57-5a13-4e93-a678-b0e39ce5fb5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:40:00.010784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6115eb57-5a13-4e93-a678-b0e39ce5fb5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:40:00.015357 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1809/3669] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:39:59 2022] DELETE /identity/v3/projects/41e4481a955a4c98a44cffcc89af6eb4 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:40:00.020731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d597c42-27db-4aec-a28c-7e1849c9fdba None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:00.020937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d597c42-27db-4aec-a28c-7e1849c9fdba None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:00.021147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d597c42-27db-4aec-a28c-7e1849c9fdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:00.022330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d009fd04-c614-4ebe-90a4-3789ec91d4c8 None None] MFA Rules not processed for user `eba500c7bb654a649a57bb8c96aa8bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:40:00.026743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d009fd04-c614-4ebe-90a4-3789ec91d4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:00.055957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1d597c42-27db-4aec-a28c-7e1849c9fdba None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:40:00.057223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1d597c42-27db-4aec-a28c-7e1849c9fdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:00.077631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:00.115539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:00.128490 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1861/3670] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:39:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:40:00.144297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20f54e-8305-42d2-a7ed-a5a4c7d950dc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:00.144958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20f54e-8305-42d2-a7ed-a5a4c7d950dc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:00.150102 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1810/3671] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:40:00.151242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20f54e-8305-42d2-a7ed-a5a4c7d950dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:00.156542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfbe4e-0629-48c8-a168-3f11e1979621 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:00.158888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfbe4e-0629-48c8-a168-3f11e1979621 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:00.163276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfbe4e-0629-48c8-a168-3f11e1979621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:00.177952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8a20f54e-8305-42d2-a7ed-a5a4c7d950dc None None] MFA Rules not processed for user `eba500c7bb654a649a57bb8c96aa8bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:40:00.179252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8a20f54e-8305-42d2-a7ed-a5a4c7d950dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:00.188584 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1862/3672] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:40:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:40:00.189997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f5bfbe4e-0629-48c8-a168-3f11e1979621 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:40:00.191314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f5bfbe4e-0629-48c8-a168-3f11e1979621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:00.201544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20f54e-8305-42d2-a7ed-a5a4c7d950dc None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:00.202654 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1811/3673] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:40:00.205470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8a20f54e-8305-42d2-a7ed-a5a4c7d950dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:00.211652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfbe4e-0629-48c8-a168-3f11e1979621 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:00.223133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfbe4e-0629-48c8-a168-3f11e1979621 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:00.231072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cf0b9-61a2-430d-85a7-b1c2ebc45cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:00.231866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cf0b9-61a2-430d-85a7-b1c2ebc45cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:00.232896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cf0b9-61a2-430d-85a7-b1c2ebc45cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:00.232896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cf0b9-61a2-430d-85a7-b1c2ebc45cb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:00.233133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cf0b9-61a2-430d-85a7-b1c2ebc45cb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:40:00.233433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cf0b9-61a2-430d-85a7-b1c2ebc45cb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:00.235441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cf0b9-61a2-430d-85a7-b1c2ebc45cb7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:00.253054 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1812/3674] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:40:00.254359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cf0b9-61a2-430d-85a7-b1c2ebc45cb7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:00.265225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cf0b9-61a2-430d-85a7-b1c2ebc45cb7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:00.270367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543cf42-343b-4f4f-ac7e-8d2556a8c232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:00.270973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543cf42-343b-4f4f-ac7e-8d2556a8c232 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:00.271361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543cf42-343b-4f4f-ac7e-8d2556a8c232 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:00.271534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543cf42-343b-4f4f-ac7e-8d2556a8c232 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:00.272163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543cf42-343b-4f4f-ac7e-8d2556a8c232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:00.274294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543cf42-343b-4f4f-ac7e-8d2556a8c232 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:00.306202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20f54e-8305-42d2-a7ed-a5a4c7d950dc None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:00.313104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b715e51-2114-4904-b9d9-fefc477b8486 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:00.313731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b715e51-2114-4904-b9d9-fefc477b8486 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:00.314019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b715e51-2114-4904-b9d9-fefc477b8486 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:00.314330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b715e51-2114-4904-b9d9-fefc477b8486 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:00.323609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b715e51-2114-4904-b9d9-fefc477b8486 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:00.325330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b715e51-2114-4904-b9d9-fefc477b8486 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:00.334547 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1863/3675] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:40:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:40:00.363513 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1813/3676] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:40:00 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:40:00.367856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b715e51-2114-4904-b9d9-fefc477b8486 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:00.379888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b715e51-2114-4904-b9d9-fefc477b8486 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:00.451523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1837f-fd18-4573-bf9e-3a41e5a2dc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:00.455571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1837f-fd18-4573-bf9e-3a41e5a2dc3d admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:00.455571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1837f-fd18-4573-bf9e-3a41e5a2dc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:00.455571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1837f-fd18-4573-bf9e-3a41e5a2dc3d admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:00.455571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1837f-fd18-4573-bf9e-3a41e5a2dc3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:00.455571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1837f-fd18-4573-bf9e-3a41e5a2dc3d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:00.545291 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1864/3677] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:40:00 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:40:00.549484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543cf42-343b-4f4f-ac7e-8d2556a8c232 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:00.560970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543cf42-343b-4f4f-ac7e-8d2556a8c232 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:00.565782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c039b-fa10-41ee-aaca-a29ae49351f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:00.566449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c039b-fa10-41ee-aaca-a29ae49351f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:00.566731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c039b-fa10-41ee-aaca-a29ae49351f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:00.567038 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c039b-fa10-41ee-aaca-a29ae49351f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:00.567694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c039b-fa10-41ee-aaca-a29ae49351f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:00.569288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c039b-fa10-41ee-aaca-a29ae49351f8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:00.580383 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1814/3678] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:40:00.584632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1837f-fd18-4573-bf9e-3a41e5a2dc3d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:00.602434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1837f-fd18-4573-bf9e-3a41e5a2dc3d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:00.609594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21615475-76bd-4ffc-89be-0d01e491f370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:00.610266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21615475-76bd-4ffc-89be-0d01e491f370 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:00.610555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21615475-76bd-4ffc-89be-0d01e491f370 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:00.610893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21615475-76bd-4ffc-89be-0d01e491f370 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:00.616370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21615475-76bd-4ffc-89be-0d01e491f370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:00.616370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21615475-76bd-4ffc-89be-0d01e491f370 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:00.628680 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1865/3679] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:40:00.630089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c039b-fa10-41ee-aaca-a29ae49351f8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:00.643224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c039b-fa10-41ee-aaca-a29ae49351f8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:00.648436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993aa06-bc5a-4f97-a634-4fa0e5e0d0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:00.649363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993aa06-bc5a-4f97-a634-4fa0e5e0d0df admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:00.649476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993aa06-bc5a-4f97-a634-4fa0e5e0d0df admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:00.649823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993aa06-bc5a-4f97-a634-4fa0e5e0d0df admin admin] PATH_INFO: `/v3/projects/bf22fab0894144d095b92e8e61d4de9d/users/d68306e38a3945a29ecd3ec026cbcee0/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:00.666720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993aa06-bc5a-4f97-a634-4fa0e5e0d0df admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf22fab0894144d095b92e8e61d4de9d, user_id=d68306e38a3945a29ecd3ec026cbcee0, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:00.669906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993aa06-bc5a-4f97-a634-4fa0e5e0d0df admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:00.840652 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1815/3680] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:40:00 2022] PUT /identity/v3/projects/bf22fab0894144d095b92e8e61d4de9d/users/d68306e38a3945a29ecd3ec026cbcee0/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:40:00.851991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b0c4e-5100-453e-9239-2972d741c53f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:00.852371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b0c4e-5100-453e-9239-2972d741c53f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:00.852536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b0c4e-5100-453e-9239-2972d741c53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:00.884446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-862b0c4e-5100-453e-9239-2972d741c53f None None] MFA Rules not processed for user `d68306e38a3945a29ecd3ec026cbcee0`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:40:00.885713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-862b0c4e-5100-453e-9239-2972d741c53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:00.904889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:00.954658 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1866/3681] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:40:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:40:00.965207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027b55c-bf6d-46d5-bcda-76f84e760008 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:00.965500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027b55c-bf6d-46d5-bcda-76f84e760008 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:00.965780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027b55c-bf6d-46d5-bcda-76f84e760008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:00.988600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a027b55c-bf6d-46d5-bcda-76f84e760008 None None] MFA Rules not processed for user `d68306e38a3945a29ecd3ec026cbcee0`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:40:00.989830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a027b55c-bf6d-46d5-bcda-76f84e760008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:00.998106 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1816/3682] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:40:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:40:01.008517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b0c4e-5100-453e-9239-2972d741c53f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:01.010080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-862b0c4e-5100-453e-9239-2972d741c53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:01.089418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b0c4e-5100-453e-9239-2972d741c53f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:01.095113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7915d44-1975-42fd-8528-2c177ebbec37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:01.098730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7915d44-1975-42fd-8528-2c177ebbec37 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:01.098730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7915d44-1975-42fd-8528-2c177ebbec37 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:01.098730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7915d44-1975-42fd-8528-2c177ebbec37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:01.104789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7915d44-1975-42fd-8528-2c177ebbec37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:01.106395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7915d44-1975-42fd-8528-2c177ebbec37 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:01.115402 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1867/3683] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:40:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:40:10.982567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=42,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:11.224233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=52 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:21.763605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c3ab9-f31a-4f58-b3cb-7bd540477c1f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:21.764224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c3ab9-f31a-4f58-b3cb-7bd540477c1f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:21.764224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c3ab9-f31a-4f58-b3cb-7bd540477c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:21.784651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f82c3ab9-f31a-4f58-b3cb-7bd540477c1f None None] MFA Rules not processed for user `eba500c7bb654a649a57bb8c96aa8bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:40:21.786105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f82c3ab9-f31a-4f58-b3cb-7bd540477c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:21.840837 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1817/3684] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:40:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:40:26.941996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7915d44-1975-42fd-8528-2c177ebbec37 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:26.990656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7915d44-1975-42fd-8528-2c177ebbec37 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:27.003769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e82952-b69c-483f-8d92-0402718b9030 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:27.005397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e82952-b69c-483f-8d92-0402718b9030 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:27.007014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e82952-b69c-483f-8d92-0402718b9030 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:27.007462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e82952-b69c-483f-8d92-0402718b9030 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:27.021884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-40e82952-b69c-483f-8d92-0402718b9030 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:27.170410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e82952-b69c-483f-8d92-0402718b9030 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:27.172375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e82952-b69c-483f-8d92-0402718b9030 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:27.207613 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1868/3685] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:40:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:40:31.837511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=25 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:34.107547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714a21f-53f0-41b3-8375-79b158e29464 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:34.109191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714a21f-53f0-41b3-8375-79b158e29464 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:34.109647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714a21f-53f0-41b3-8375-79b158e29464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:34.140218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9714a21f-53f0-41b3-8375-79b158e29464 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:40:34.141459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9714a21f-53f0-41b3-8375-79b158e29464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:34.212931 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1818/3686] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:40:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:40:34.443125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e82952-b69c-483f-8d92-0402718b9030 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:34.447309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-40e82952-b69c-483f-8d92-0402718b9030 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:34.578763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e82952-b69c-483f-8d92-0402718b9030 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:34.584363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ad65a-1d61-4cd2-a834-846e62ac53f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:34.586367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ad65a-1d61-4cd2-a834-846e62ac53f7 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:34.586367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ad65a-1d61-4cd2-a834-846e62ac53f7 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:34.586367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ad65a-1d61-4cd2-a834-846e62ac53f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:34.594865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ad65a-1d61-4cd2-a834-846e62ac53f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:34.596441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ad65a-1d61-4cd2-a834-846e62ac53f7 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:34.606194 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1869/3687] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:40:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:40:44.207725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=25 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:44.224665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72129522-b3c6-4cc7-a130-343a618cf620 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:44.225189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72129522-b3c6-4cc7-a130-343a618cf620 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:44.225727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72129522-b3c6-4cc7-a130-343a618cf620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:44.292994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-72129522-b3c6-4cc7-a130-343a618cf620 None None] MFA Rules not processed for user `18036411a99e4634bfbaeae24b9f254d`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:40:44.297959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-72129522-b3c6-4cc7-a130-343a618cf620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:44.439665 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1819/3688] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:40:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:40:44.458458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ad65a-1d61-4cd2-a834-846e62ac53f7 service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:44.495027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ad65a-1d61-4cd2-a834-846e62ac53f7 service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:44.514642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2498a9-5a67-4779-b7e7-3e76d3002993 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:44.515518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2498a9-5a67-4779-b7e7-3e76d3002993 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:44.515976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2498a9-5a67-4779-b7e7-3e76d3002993 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:44.516401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2498a9-5a67-4779-b7e7-3e76d3002993 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:44.518561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ab2498a9-5a67-4779-b7e7-3e76d3002993 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:44.548110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2498a9-5a67-4779-b7e7-3e76d3002993 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:44.549813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2498a9-5a67-4779-b7e7-3e76d3002993 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:44.591158 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1870/3689] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:40:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:40:51.895994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21057ffd-0839-48d5-85c6-a34e1743b2c2 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:51.896549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21057ffd-0839-48d5-85c6-a34e1743b2c2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:51.896549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21057ffd-0839-48d5-85c6-a34e1743b2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:51.948201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-21057ffd-0839-48d5-85c6-a34e1743b2c2 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:40:51.949946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-21057ffd-0839-48d5-85c6-a34e1743b2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:51.966834 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1820/3690] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:40:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:40:52.018646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2498a9-5a67-4779-b7e7-3e76d3002993 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:52.025891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=67 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:52.052543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2498a9-5a67-4779-b7e7-3e76d3002993 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:52.063560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d4eb5-bc19-463f-941c-ebf7577a4280 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:52.064105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d4eb5-bc19-463f-941c-ebf7577a4280 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:52.064775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d4eb5-bc19-463f-941c-ebf7577a4280 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:52.065215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d4eb5-bc19-463f-941c-ebf7577a4280 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:52.096305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d4eb5-bc19-463f-941c-ebf7577a4280 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:52.096855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21057ffd-0839-48d5-85c6-a34e1743b2c2 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:52.099645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d4eb5-bc19-463f-941c-ebf7577a4280 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:52.130531 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1871/3691] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:40:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:40:52.278842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21057ffd-0839-48d5-85c6-a34e1743b2c2 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:52.283856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8671161-8899-4149-99ea-2c84be4efcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:52.284680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8671161-8899-4149-99ea-2c84be4efcf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:52.285671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8671161-8899-4149-99ea-2c84be4efcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:52.286133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8671161-8899-4149-99ea-2c84be4efcf7 admin admin] PATH_INFO: `/v3/users/d68306e38a3945a29ecd3ec026cbcee0` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:52.287473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8671161-8899-4149-99ea-2c84be4efcf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d68306e38a3945a29ecd3ec026cbcee0)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:52.289749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8671161-8899-4149-99ea-2c84be4efcf7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:52.620962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f8671161-8899-4149-99ea-2c84be4efcf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd68306e38a3945a29ecd3ec026cbcee0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:40:52.621892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f8671161-8899-4149-99ea-2c84be4efcf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd68306e38a3945a29ecd3ec026cbcee0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:40:52.639159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f8671161-8899-4149-99ea-2c84be4efcf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd68306e38a3945a29ecd3ec026cbcee0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:40:52.664474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f8671161-8899-4149-99ea-2c84be4efcf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd68306e38a3945a29ecd3ec026cbcee0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:40:52.760046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f8671161-8899-4149-99ea-2c84be4efcf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd68306e38a3945a29ecd3ec026cbcee0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:40:52.769834 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1821/3692] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:40:52 2022] DELETE /identity/v3/users/d68306e38a3945a29ecd3ec026cbcee0 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:40:52.775350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac112f5-2c32-4031-ac15-6197fb31bb09 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:52.775943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac112f5-2c32-4031-ac15-6197fb31bb09 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:52.776494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac112f5-2c32-4031-ac15-6197fb31bb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:52.824587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-eac112f5-2c32-4031-ac15-6197fb31bb09 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:40:52.828146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-eac112f5-2c32-4031-ac15-6197fb31bb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:53.168469 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1872/3693] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:40:53.176728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8671161-8899-4149-99ea-2c84be4efcf7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:53.179046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f8671161-8899-4149-99ea-2c84be4efcf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:53.260005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:53.445550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8671161-8899-4149-99ea-2c84be4efcf7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:53.458733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae5e24-ad9c-452e-b9dd-f0f278efac28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:53.459406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae5e24-ad9c-452e-b9dd-f0f278efac28 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:53.462877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae5e24-ad9c-452e-b9dd-f0f278efac28 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:53.462877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae5e24-ad9c-452e-b9dd-f0f278efac28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:53.516580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae5e24-ad9c-452e-b9dd-f0f278efac28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:53.529277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae5e24-ad9c-452e-b9dd-f0f278efac28 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:53.569796 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1822/3694] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:40:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:40:54.522454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac112f5-2c32-4031-ac15-6197fb31bb09 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:54.524967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-eac112f5-2c32-4031-ac15-6197fb31bb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:54.545665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac112f5-2c32-4031-ac15-6197fb31bb09 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:54.580230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf6f03-6c9d-4b7a-b5e7-500df671022b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:54.582905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf6f03-6c9d-4b7a-b5e7-500df671022b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:54.583389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf6f03-6c9d-4b7a-b5e7-500df671022b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:54.583926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf6f03-6c9d-4b7a-b5e7-500df671022b admin admin] PATH_INFO: `/v3/projects/bf22fab0894144d095b92e8e61d4de9d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:54.585408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf6f03-6c9d-4b7a-b5e7-500df671022b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf22fab0894144d095b92e8e61d4de9d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:54.593382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf6f03-6c9d-4b7a-b5e7-500df671022b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:54.758011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-16bf6f03-6c9d-4b7a-b5e7-500df671022b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf22fab0894144d095b92e8e61d4de9d', 'request_id': 'req-16bf6f03-6c9d-4b7a-b5e7-500df671022b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:40:54.777611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-16bf6f03-6c9d-4b7a-b5e7-500df671022b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf22fab0894144d095b92e8e61d4de9d', 'request_id': 'req-16bf6f03-6c9d-4b7a-b5e7-500df671022b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:40:54.787569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-16bf6f03-6c9d-4b7a-b5e7-500df671022b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf22fab0894144d095b92e8e61d4de9d', 'request_id': 'req-16bf6f03-6c9d-4b7a-b5e7-500df671022b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:40:54.915576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-16bf6f03-6c9d-4b7a-b5e7-500df671022b admin admin] The token cache is being invalidate because project bf22fab0894144d095b92e8e61d4de9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:40:54.915876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-16bf6f03-6c9d-4b7a-b5e7-500df671022b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:40:54.916713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-16bf6f03-6c9d-4b7a-b5e7-500df671022b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:40:54.922510 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1873/3695] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:40:54 2022] DELETE /identity/v3/projects/bf22fab0894144d095b92e8e61d4de9d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:40:54.924193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ff380-9d15-416e-98c1-a7cce6e820cc None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:54.924694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ff380-9d15-416e-98c1-a7cce6e820cc None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:54.924787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ff380-9d15-416e-98c1-a7cce6e820cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:54.968071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-362ff380-9d15-416e-98c1-a7cce6e820cc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:40:54.969408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-362ff380-9d15-416e-98c1-a7cce6e820cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:55.105282 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1823/3696] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:40:55.113548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d10bf-321b-4ffa-94a0-642445248536 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:55.113848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d10bf-321b-4ffa-94a0-642445248536 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:55.114204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d10bf-321b-4ffa-94a0-642445248536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:55.183143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-293d10bf-321b-4ffa-94a0-642445248536 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:40:55.184371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-293d10bf-321b-4ffa-94a0-642445248536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:55.217550 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1874/3697] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:40:55.222268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ff380-9d15-416e-98c1-a7cce6e820cc None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:55.243455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ff380-9d15-416e-98c1-a7cce6e820cc None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:55.258781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d4e2a-bb2c-4ed2-9b2c-e27b62c2b8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:55.258781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d4e2a-bb2c-4ed2-9b2c-e27b62c2b8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:55.258781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d4e2a-bb2c-4ed2-9b2c-e27b62c2b8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:55.258781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d4e2a-bb2c-4ed2-9b2c-e27b62c2b8a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:55.259373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d4e2a-bb2c-4ed2-9b2c-e27b62c2b8a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:40:55.259373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d4e2a-bb2c-4ed2-9b2c-e27b62c2b8a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:55.261381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d4e2a-bb2c-4ed2-9b2c-e27b62c2b8a7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:55.279488 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1824/3698] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:40:55.283565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d10bf-321b-4ffa-94a0-642445248536 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:55.300274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d10bf-321b-4ffa-94a0-642445248536 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:55.345958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b02b2-9ee9-4ee1-9315-859072260c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:55.346621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b02b2-9ee9-4ee1-9315-859072260c13 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:55.349271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b02b2-9ee9-4ee1-9315-859072260c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:55.349768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b02b2-9ee9-4ee1-9315-859072260c13 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:55.350683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b02b2-9ee9-4ee1-9315-859072260c13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:55.357746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b02b2-9ee9-4ee1-9315-859072260c13 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:55.498434 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1875/3699] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:40:55 2022] POST /identity/v3/projects => generated 363 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:40:55.502460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d4e2a-bb2c-4ed2-9b2c-e27b62c2b8a7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:55.515662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d4e2a-bb2c-4ed2-9b2c-e27b62c2b8a7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:55.712021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049de77-7d78-477e-8d79-06ddaa7ab913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:55.715934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049de77-7d78-477e-8d79-06ddaa7ab913 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:55.716233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049de77-7d78-477e-8d79-06ddaa7ab913 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:55.716519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049de77-7d78-477e-8d79-06ddaa7ab913 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:55.719137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049de77-7d78-477e-8d79-06ddaa7ab913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:55.721130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049de77-7d78-477e-8d79-06ddaa7ab913 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:55.895204 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1825/3700] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:40:55 2022] POST /identity/v3/users => generated 282 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:40:55.896606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b02b2-9ee9-4ee1-9315-859072260c13 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:55.915471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b02b2-9ee9-4ee1-9315-859072260c13 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:55.926671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9432abd-5a83-44f5-b7a1-d819529ea407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:55.927876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9432abd-5a83-44f5-b7a1-d819529ea407 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:55.929677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9432abd-5a83-44f5-b7a1-d819529ea407 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:55.931300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9432abd-5a83-44f5-b7a1-d819529ea407 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:55.933052 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9432abd-5a83-44f5-b7a1-d819529ea407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:55.938151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9432abd-5a83-44f5-b7a1-d819529ea407 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:55.970342 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1876/3701] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:40:55.971433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049de77-7d78-477e-8d79-06ddaa7ab913 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:55.984359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049de77-7d78-477e-8d79-06ddaa7ab913 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:55.994001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f18c8-7aec-46b6-a18c-558405baec45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:55.996076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f18c8-7aec-46b6-a18c-558405baec45 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:56.003535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f18c8-7aec-46b6-a18c-558405baec45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:56.003535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f18c8-7aec-46b6-a18c-558405baec45 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:56.003535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f18c8-7aec-46b6-a18c-558405baec45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:56.003535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f18c8-7aec-46b6-a18c-558405baec45 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:56.018284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9432abd-5a83-44f5-b7a1-d819529ea407 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:56.018957 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1826/3702] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:40:56.040686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9432abd-5a83-44f5-b7a1-d819529ea407 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:56.046230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71caff5d-68d4-4796-9cd1-e0adacff15ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:56.047312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caff5d-68d4-4796-9cd1-e0adacff15ab admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:56.047759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caff5d-68d4-4796-9cd1-e0adacff15ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:56.048221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caff5d-68d4-4796-9cd1-e0adacff15ab admin admin] PATH_INFO: `/v3/projects/13ff89cf3090446693a050dc83fc2aa0/users/36b3153de6c9425196160ca3e3bfb5d0/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:56.065755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71caff5d-68d4-4796-9cd1-e0adacff15ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ff89cf3090446693a050dc83fc2aa0, user_id=36b3153de6c9425196160ca3e3bfb5d0, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:56.069333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71caff5d-68d4-4796-9cd1-e0adacff15ab admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:56.166789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21de3f-3d33-483b-9518-c8bc84480625 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:56.167083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21de3f-3d33-483b-9518-c8bc84480625 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:56.167367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21de3f-3d33-483b-9518-c8bc84480625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:56.170599 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1877/3703] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:40:56 2022] PUT /identity/v3/projects/13ff89cf3090446693a050dc83fc2aa0/users/36b3153de6c9425196160ca3e3bfb5d0/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:40:56.234661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ee21de3f-3d33-483b-9518-c8bc84480625 None None] MFA Rules not processed for user `36b3153de6c9425196160ca3e3bfb5d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:40:56.240307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ee21de3f-3d33-483b-9518-c8bc84480625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:56.287191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:56.406457 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1827/3704] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:40:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:40:56.697268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71caff5d-68d4-4796-9cd1-e0adacff15ab admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:56.699055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-71caff5d-68d4-4796-9cd1-e0adacff15ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:56.730453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:56.870417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71caff5d-68d4-4796-9cd1-e0adacff15ab admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:56.877064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493a0d8-5126-4940-8c7b-3189c5415e39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:56.877697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493a0d8-5126-4940-8c7b-3189c5415e39 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:56.878090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493a0d8-5126-4940-8c7b-3189c5415e39 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:56.878514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493a0d8-5126-4940-8c7b-3189c5415e39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:56.889033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493a0d8-5126-4940-8c7b-3189c5415e39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:56.890684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493a0d8-5126-4940-8c7b-3189c5415e39 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:56.920519 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1878/3705] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:40:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:40:56.927917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febe9cc-c1ff-4b88-837e-a1541ec0419e None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:56.927917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febe9cc-c1ff-4b88-837e-a1541ec0419e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:56.927917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febe9cc-c1ff-4b88-837e-a1541ec0419e None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:56.928902 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1828/3706] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:40:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:40:56.934697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493a0d8-5126-4940-8c7b-3189c5415e39 service nova] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:40:56.948432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493a0d8-5126-4940-8c7b-3189c5415e39 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:56.965109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493a0d8-5126-4940-8c7b-3189c5415e39 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:56.981210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cdaba-f5f0-4de7-801f-696367545e98 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b3153de6c9425196160ca3e3bfb5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ff89cf3090446693a050dc83fc2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:56.983684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cdaba-f5f0-4de7-801f-696367545e98 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:56.983975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cdaba-f5f0-4de7-801f-696367545e98 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:56.986255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cdaba-f5f0-4de7-801f-696367545e98 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] PATH_INFO: `/v3/projects/13ff89cf3090446693a050dc83fc2aa0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:56.991078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38cdaba-f5f0-4de7-801f-696367545e98 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] RBAC: Authorizing `identity:get_project(project_id=13ff89cf3090446693a050dc83fc2aa0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:56.998027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38cdaba-f5f0-4de7-801f-696367545e98 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:57.023957 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1879/3707] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:40:56 2022] GET /identity/v3/projects/13ff89cf3090446693a050dc83fc2aa0 => generated 363 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:40:57.045185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d35b39-de60-4527-8306-071b303ea455 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:57.045728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d35b39-de60-4527-8306-071b303ea455 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:57.046191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d35b39-de60-4527-8306-071b303ea455 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:57.047671 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1829/3708] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:40:57.057572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cdaba-f5f0-4de7-801f-696367545e98 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:40:57.060200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e38cdaba-f5f0-4de7-801f-696367545e98 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:57.088681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cdaba-f5f0-4de7-801f-696367545e98 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:57.099000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cdaba-f5f0-4de7-801f-696367545e98 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:57.104696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ee3b7-14b0-48f9-92e5-dffd6941d8f4 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b3153de6c9425196160ca3e3bfb5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ff89cf3090446693a050dc83fc2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:57.105742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ee3b7-14b0-48f9-92e5-dffd6941d8f4 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:57.106368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ee3b7-14b0-48f9-92e5-dffd6941d8f4 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:57.106803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ee3b7-14b0-48f9-92e5-dffd6941d8f4 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] PATH_INFO: `/v3/projects/13ff89cf3090446693a050dc83fc2aa0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:57.108251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ee3b7-14b0-48f9-92e5-dffd6941d8f4 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] RBAC: Authorizing `identity:get_project(project_id=13ff89cf3090446693a050dc83fc2aa0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:57.110302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ee3b7-14b0-48f9-92e5-dffd6941d8f4 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:57.112158 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1880/3709] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:40:57 2022] GET /identity/v3/projects/13ff89cf3090446693a050dc83fc2aa0 => generated 363 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:40:57.164011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d515e93-dc1b-4958-87b3-2fb329fbb8ee None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:57.164573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d515e93-dc1b-4958-87b3-2fb329fbb8ee None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:57.165091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d515e93-dc1b-4958-87b3-2fb329fbb8ee None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:57.167536 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1830/3710] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:40:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:40:57.175983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ee3b7-14b0-48f9-92e5-dffd6941d8f4 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:40:57.199729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ee3b7-14b0-48f9-92e5-dffd6941d8f4 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:57.221032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ee3b7-14b0-48f9-92e5-dffd6941d8f4 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:57.230082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36083f71-ede0-464f-8e42-2c3f7857c816 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b3153de6c9425196160ca3e3bfb5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ff89cf3090446693a050dc83fc2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:57.230992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36083f71-ede0-464f-8e42-2c3f7857c816 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:57.238086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36083f71-ede0-464f-8e42-2c3f7857c816 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:57.238629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36083f71-ede0-464f-8e42-2c3f7857c816 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] PATH_INFO: `/v3/projects/13ff89cf3090446693a050dc83fc2aa0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:57.240277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36083f71-ede0-464f-8e42-2c3f7857c816 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] RBAC: Authorizing `identity:get_project(project_id=13ff89cf3090446693a050dc83fc2aa0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:57.247990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36083f71-ede0-464f-8e42-2c3f7857c816 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:57.250412 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1881/3711] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:40:57 2022] GET /identity/v3/projects/13ff89cf3090446693a050dc83fc2aa0 => generated 363 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:40:57.294191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a1e43-0f26-42b6-a243-ac54f77797e8 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:57.294475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a1e43-0f26-42b6-a243-ac54f77797e8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:57.294934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a1e43-0f26-42b6-a243-ac54f77797e8 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:57.296755 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1831/3712] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:40:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:40:57.307130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36083f71-ede0-464f-8e42-2c3f7857c816 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:40:57.338725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36083f71-ede0-464f-8e42-2c3f7857c816 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:57.371053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36083f71-ede0-464f-8e42-2c3f7857c816 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:57.380905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea04cb-32e5-4a7f-b2fd-ef20d1f89b29 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b3153de6c9425196160ca3e3bfb5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ff89cf3090446693a050dc83fc2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:57.381568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea04cb-32e5-4a7f-b2fd-ef20d1f89b29 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:57.381858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea04cb-32e5-4a7f-b2fd-ef20d1f89b29 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:57.382174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea04cb-32e5-4a7f-b2fd-ef20d1f89b29 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] PATH_INFO: `/v3/projects/13ff89cf3090446693a050dc83fc2aa0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:57.386808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea04cb-32e5-4a7f-b2fd-ef20d1f89b29 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] RBAC: Authorizing `identity:get_project(project_id=13ff89cf3090446693a050dc83fc2aa0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:57.388970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea04cb-32e5-4a7f-b2fd-ef20d1f89b29 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:57.397339 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1882/3713] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:40:57 2022] GET /identity/v3/projects/13ff89cf3090446693a050dc83fc2aa0 => generated 363 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:40:57.465332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9f55c-5420-4077-8903-840400469d90 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:57.465828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9f55c-5420-4077-8903-840400469d90 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:57.466299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9f55c-5420-4077-8903-840400469d90 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:57.467819 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1832/3714] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:40:57.475321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea04cb-32e5-4a7f-b2fd-ef20d1f89b29 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] Authenticating service token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 03:40:57.518214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea04cb-32e5-4a7f-b2fd-ef20d1f89b29 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:57.544239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea04cb-32e5-4a7f-b2fd-ef20d1f89b29 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:57.552477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5fca2-87dc-46ad-be09-ebc48aa671db tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b3153de6c9425196160ca3e3bfb5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ff89cf3090446693a050dc83fc2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:57.553378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5fca2-87dc-46ad-be09-ebc48aa671db tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:57.553814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5fca2-87dc-46ad-be09-ebc48aa671db tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:57.554302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5fca2-87dc-46ad-be09-ebc48aa671db tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] PATH_INFO: `/v3/projects/13ff89cf3090446693a050dc83fc2aa0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:57.559337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5fca2-87dc-46ad-be09-ebc48aa671db tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] RBAC: Authorizing `identity:get_project(project_id=13ff89cf3090446693a050dc83fc2aa0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:57.561742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5fca2-87dc-46ad-be09-ebc48aa671db tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:57.572822 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1883/3715] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 03:40:57 2022] GET /identity/v3/projects/13ff89cf3090446693a050dc83fc2aa0 => generated 363 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:40:57.642260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9f55c-5420-4077-8903-840400469d90 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:57.853147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9f55c-5420-4077-8903-840400469d90 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:57.860408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa2921-b8da-47b3-9456-a378e093b6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:57.861211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa2921-b8da-47b3-9456-a378e093b6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:57.861583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa2921-b8da-47b3-9456-a378e093b6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:57.861956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa2921-b8da-47b3-9456-a378e093b6ce admin admin] PATH_INFO: `/v3/users/36b3153de6c9425196160ca3e3bfb5d0` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:57.882070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa2921-b8da-47b3-9456-a378e093b6ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=36b3153de6c9425196160ca3e3bfb5d0)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:57.895591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa2921-b8da-47b3-9456-a378e093b6ce admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:58.209297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cbfa2921-b8da-47b3-9456-a378e093b6ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36b3153de6c9425196160ca3e3bfb5d0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:40:58.212236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cbfa2921-b8da-47b3-9456-a378e093b6ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36b3153de6c9425196160ca3e3bfb5d0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:40:58.232741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cbfa2921-b8da-47b3-9456-a378e093b6ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36b3153de6c9425196160ca3e3bfb5d0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:40:58.289163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cbfa2921-b8da-47b3-9456-a378e093b6ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36b3153de6c9425196160ca3e3bfb5d0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:40:58.355807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cbfa2921-b8da-47b3-9456-a378e093b6ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36b3153de6c9425196160ca3e3bfb5d0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:40:58.372945 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1833/3716] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:40:57 2022] DELETE /identity/v3/users/36b3153de6c9425196160ca3e3bfb5d0 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:40:58.374443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae2f55-3b26-4b49-986b-c31999a01d45 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:58.375711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae2f55-3b26-4b49-986b-c31999a01d45 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:58.376188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae2f55-3b26-4b49-986b-c31999a01d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:58.417381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-55ae2f55-3b26-4b49-986b-c31999a01d45 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:40:58.420209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-55ae2f55-3b26-4b49-986b-c31999a01d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:58.453565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cceaf-212e-49f2-bc24-d8d91f2b2f5b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:58.454350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cceaf-212e-49f2-bc24-d8d91f2b2f5b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:58.454819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cceaf-212e-49f2-bc24-d8d91f2b2f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:58.508138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f17cceaf-212e-49f2-bc24-d8d91f2b2f5b None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:40:58.509618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f17cceaf-212e-49f2-bc24-d8d91f2b2f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:58.598574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:58.630331 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1884/3717] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:40:58.643370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae2f55-3b26-4b49-986b-c31999a01d45 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:58.645390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-55ae2f55-3b26-4b49-986b-c31999a01d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:58.662339 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1834/3718] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:40:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:40:58.668865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cceaf-212e-49f2-bc24-d8d91f2b2f5b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:40:58.670774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f17cceaf-212e-49f2-bc24-d8d91f2b2f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:40:58.808332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae2f55-3b26-4b49-986b-c31999a01d45 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:58.819096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83045f1-e43e-4d11-81ef-3356daf784c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:58.821614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83045f1-e43e-4d11-81ef-3356daf784c4 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:58.822011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83045f1-e43e-4d11-81ef-3356daf784c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:58.823670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83045f1-e43e-4d11-81ef-3356daf784c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:58.844273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:58.851910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83045f1-e43e-4d11-81ef-3356daf784c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:58.865498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cceaf-212e-49f2-bc24-d8d91f2b2f5b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:40:58.869532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83045f1-e43e-4d11-81ef-3356daf784c4 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:58.879409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a010b-2b5b-4016-b0ed-285c806219f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:40:58.882293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a010b-2b5b-4016-b0ed-285c806219f3 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:40:58.884179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a010b-2b5b-4016-b0ed-285c806219f3 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:40:58.884664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a010b-2b5b-4016-b0ed-285c806219f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:40:58.885462 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1885/3719] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:40:58.938458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a010b-2b5b-4016-b0ed-285c806219f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:40:58.943211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a010b-2b5b-4016-b0ed-285c806219f3 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:40:58.986325 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1835/3720] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:40:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:41:00.032992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83045f1-e43e-4d11-81ef-3356daf784c4 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:00.034767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c83045f1-e43e-4d11-81ef-3356daf784c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:00.050557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83045f1-e43e-4d11-81ef-3356daf784c4 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:00.088654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca538ab-55b8-4beb-9e59-ffed24be4c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:00.089147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca538ab-55b8-4beb-9e59-ffed24be4c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:00.089445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca538ab-55b8-4beb-9e59-ffed24be4c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:00.089909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca538ab-55b8-4beb-9e59-ffed24be4c16 admin admin] PATH_INFO: `/v3/projects/13ff89cf3090446693a050dc83fc2aa0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:00.099861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca538ab-55b8-4beb-9e59-ffed24be4c16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ff89cf3090446693a050dc83fc2aa0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:00.101009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca538ab-55b8-4beb-9e59-ffed24be4c16 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:00.401936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1ca538ab-55b8-4beb-9e59-ffed24be4c16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ff89cf3090446693a050dc83fc2aa0', 'request_id': 'req-1ca538ab-55b8-4beb-9e59-ffed24be4c16'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:00.412254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1ca538ab-55b8-4beb-9e59-ffed24be4c16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ff89cf3090446693a050dc83fc2aa0', 'request_id': 'req-1ca538ab-55b8-4beb-9e59-ffed24be4c16'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:00.420104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1ca538ab-55b8-4beb-9e59-ffed24be4c16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ff89cf3090446693a050dc83fc2aa0', 'request_id': 'req-1ca538ab-55b8-4beb-9e59-ffed24be4c16'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:00.499574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1ca538ab-55b8-4beb-9e59-ffed24be4c16 admin admin] The token cache is being invalidate because project 13ff89cf3090446693a050dc83fc2aa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:41:00.499872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1ca538ab-55b8-4beb-9e59-ffed24be4c16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:00.500657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1ca538ab-55b8-4beb-9e59-ffed24be4c16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:00.511569 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1886/3721] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:41:00 2022] DELETE /identity/v3/projects/13ff89cf3090446693a050dc83fc2aa0 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:00.512067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84676442-7d55-4968-8b3f-b81ea70b4726 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:00.518180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84676442-7d55-4968-8b3f-b81ea70b4726 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:00.518180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84676442-7d55-4968-8b3f-b81ea70b4726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:00.526897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca538ab-55b8-4beb-9e59-ffed24be4c16 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:00.531678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1ca538ab-55b8-4beb-9e59-ffed24be4c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:00.561503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-84676442-7d55-4968-8b3f-b81ea70b4726 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:00.563124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-84676442-7d55-4968-8b3f-b81ea70b4726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:00.705293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca538ab-55b8-4beb-9e59-ffed24be4c16 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:00.717704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8ee65-fadb-428f-b63c-885b38aaa657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:00.719192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8ee65-fadb-428f-b63c-885b38aaa657 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:00.719477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8ee65-fadb-428f-b63c-885b38aaa657 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:00.719756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8ee65-fadb-428f-b63c-885b38aaa657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:00.732230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4dd8ee65-fadb-428f-b63c-885b38aaa657 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:00.753528 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1836/3722] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:00.756805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0df60-166a-498f-b3da-b9d4c8dfd0ce None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:00.757100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0df60-166a-498f-b3da-b9d4c8dfd0ce None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:00.757382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0df60-166a-498f-b3da-b9d4c8dfd0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:00.803112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-75f0df60-166a-498f-b3da-b9d4c8dfd0ce None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:00.809267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-75f0df60-166a-498f-b3da-b9d4c8dfd0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:00.835541 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1837/3723] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:00.837197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0df60-166a-498f-b3da-b9d4c8dfd0ce None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:00.856614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0df60-166a-498f-b3da-b9d4c8dfd0ce None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:00.867549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74647532-54d2-4725-b8d2-d9104c65fb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:00.868184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74647532-54d2-4725-b8d2-d9104c65fb39 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:00.868468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74647532-54d2-4725-b8d2-d9104c65fb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:00.872702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74647532-54d2-4725-b8d2-d9104c65fb39 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:00.873434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74647532-54d2-4725-b8d2-d9104c65fb39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:41:00.873755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74647532-54d2-4725-b8d2-d9104c65fb39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:00.875453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74647532-54d2-4725-b8d2-d9104c65fb39 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:00.908260 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1838/3724] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:00.909189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74647532-54d2-4725-b8d2-d9104c65fb39 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:00.918186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8ee65-fadb-428f-b63c-885b38aaa657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:00.919655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8ee65-fadb-428f-b63c-885b38aaa657 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:00.930938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74647532-54d2-4725-b8d2-d9104c65fb39 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:00.942228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b34af2-5f62-4e4c-b0e7-1db2044cedbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:00.942860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b34af2-5f62-4e4c-b0e7-1db2044cedbe admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:00.943145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b34af2-5f62-4e4c-b0e7-1db2044cedbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:00.943425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b34af2-5f62-4e4c-b0e7-1db2044cedbe admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:00.945260 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1887/3725] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:41:00.945463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b34af2-5f62-4e4c-b0e7-1db2044cedbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:00.948181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b34af2-5f62-4e4c-b0e7-1db2044cedbe admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:01.061723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8ee65-fadb-428f-b63c-885b38aaa657 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:01.069847 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1839/3726] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:41:00 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:01.076346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8ee65-fadb-428f-b63c-885b38aaa657 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:01.105052 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:01.236485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d6c9e-1c2d-4b00-8658-e5cd446d9699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:01.237840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d6c9e-1c2d-4b00-8658-e5cd446d9699 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:01.238981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d6c9e-1c2d-4b00-8658-e5cd446d9699 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:01.239348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d6c9e-1c2d-4b00-8658-e5cd446d9699 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:01.250151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d6c9e-1c2d-4b00-8658-e5cd446d9699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:01.255877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d6c9e-1c2d-4b00-8658-e5cd446d9699 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:01.424669 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1888/3727] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:41:01 2022] POST /identity/v3/users => generated 287 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:01.428819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b34af2-5f62-4e4c-b0e7-1db2044cedbe admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:01.453596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b34af2-5f62-4e4c-b0e7-1db2044cedbe admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:01.480560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756acde-6e6c-468a-8298-8675cde23c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:01.482821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756acde-6e6c-468a-8298-8675cde23c2d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:01.483123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756acde-6e6c-468a-8298-8675cde23c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:01.483410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756acde-6e6c-468a-8298-8675cde23c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:01.486191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756acde-6e6c-468a-8298-8675cde23c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:01.487879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756acde-6e6c-468a-8298-8675cde23c2d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:01.531274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d6c9e-1c2d-4b00-8658-e5cd446d9699 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:01.546261 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1840/3728] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:41:01.549314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d6c9e-1c2d-4b00-8658-e5cd446d9699 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:01.569535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897f724-4326-4948-b0ba-7dce12ba38d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:01.570269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897f724-4326-4948-b0ba-7dce12ba38d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:01.575372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897f724-4326-4948-b0ba-7dce12ba38d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:01.575372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897f724-4326-4948-b0ba-7dce12ba38d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:01.575372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897f724-4326-4948-b0ba-7dce12ba38d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:01.575372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897f724-4326-4948-b0ba-7dce12ba38d6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:01.596618 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1889/3729] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:41:01.599546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756acde-6e6c-468a-8298-8675cde23c2d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:01.631668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756acde-6e6c-468a-8298-8675cde23c2d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:01.647348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283a7d5-13c2-4018-bac5-ef282bf876f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:01.648445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283a7d5-13c2-4018-bac5-ef282bf876f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:01.649095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283a7d5-13c2-4018-bac5-ef282bf876f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:01.649600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283a7d5-13c2-4018-bac5-ef282bf876f7 admin admin] PATH_INFO: `/v3/projects/35f5298f2bce42758be2373c640881fe/users/7e74c5f19f2245d18d8dbb31c916e5e9/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:01.685205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283a7d5-13c2-4018-bac5-ef282bf876f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f5298f2bce42758be2373c640881fe, user_id=7e74c5f19f2245d18d8dbb31c916e5e9, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:01.695354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283a7d5-13c2-4018-bac5-ef282bf876f7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:01.707301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:01.825651 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1841/3730] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:41:01 2022] PUT /identity/v3/projects/35f5298f2bce42758be2373c640881fe/users/7e74c5f19f2245d18d8dbb31c916e5e9/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:01.847678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c507c9-285c-4510-96b1-acaddeea7420 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:01.848416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c507c9-285c-4510-96b1-acaddeea7420 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:01.848845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c507c9-285c-4510-96b1-acaddeea7420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:01.932642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-65c507c9-285c-4510-96b1-acaddeea7420 None None] MFA Rules not processed for user `7e74c5f19f2245d18d8dbb31c916e5e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:01.934237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-65c507c9-285c-4510-96b1-acaddeea7420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:02.054073 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1890/3731] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:02.067664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283a7d5-13c2-4018-bac5-ef282bf876f7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:02.069987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c283a7d5-13c2-4018-bac5-ef282bf876f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:02.248455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283a7d5-13c2-4018-bac5-ef282bf876f7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:02.268856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c5aff-8681-4d17-8734-a2fc1dd55b91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:02.269601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c5aff-8681-4d17-8734-a2fc1dd55b91 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:02.269951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c5aff-8681-4d17-8734-a2fc1dd55b91 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:02.270322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c5aff-8681-4d17-8734-a2fc1dd55b91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:02.288693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c5aff-8681-4d17-8734-a2fc1dd55b91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:02.290396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c5aff-8681-4d17-8734-a2fc1dd55b91 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:02.326528 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1842/3732] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:41:02.816343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c507c9-285c-4510-96b1-acaddeea7420 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:02.818629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-65c507c9-285c-4510-96b1-acaddeea7420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:02.973714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c5aff-8681-4d17-8734-a2fc1dd55b91 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:02.979661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-015c5aff-8681-4d17-8734-a2fc1dd55b91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:02.996496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c507c9-285c-4510-96b1-acaddeea7420 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:02.999007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c5aff-8681-4d17-8734-a2fc1dd55b91 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:03.007242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2d816-6899-4a84-9068-756cf7507c8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:03.007882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2d816-6899-4a84-9068-756cf7507c8f service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:03.008285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2d816-6899-4a84-9068-756cf7507c8f service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:03.008996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2d816-6899-4a84-9068-756cf7507c8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:03.011330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125ca17-f6f7-4e80-85e4-79b2d434f2d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:03.012191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125ca17-f6f7-4e80-85e4-79b2d434f2d7 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:03.013145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c6e2d816-6899-4a84-9068-756cf7507c8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:03.014712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125ca17-f6f7-4e80-85e4-79b2d434f2d7 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:03.015079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125ca17-f6f7-4e80-85e4-79b2d434f2d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:03.017995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8125ca17-f6f7-4e80-85e4-79b2d434f2d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:03.042452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2d816-6899-4a84-9068-756cf7507c8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:03.046157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2d816-6899-4a84-9068-756cf7507c8f service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:03.047162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125ca17-f6f7-4e80-85e4-79b2d434f2d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:03.053551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125ca17-f6f7-4e80-85e4-79b2d434f2d7 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:03.072623 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1891/3733] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:41:03.073641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2d816-6899-4a84-9068-756cf7507c8f service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:03.074619 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1843/3734] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:41:03.075376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c6e2d816-6899-4a84-9068-756cf7507c8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:03.113948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:03.236164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2d816-6899-4a84-9068-756cf7507c8f service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:03.242991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e0789-c62a-4b9c-96e3-45530629701f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:03.243763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e0789-c62a-4b9c-96e3-45530629701f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:03.244104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e0789-c62a-4b9c-96e3-45530629701f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:03.244626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e0789-c62a-4b9c-96e3-45530629701f admin admin] PATH_INFO: `/v3/users/eba500c7bb654a649a57bb8c96aa8bf0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:03.245880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e0789-c62a-4b9c-96e3-45530629701f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eba500c7bb654a649a57bb8c96aa8bf0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:03.248097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e0789-c62a-4b9c-96e3-45530629701f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:03.502065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6b7e0789-c62a-4b9c-96e3-45530629701f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eba500c7bb654a649a57bb8c96aa8bf0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:03.504130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6b7e0789-c62a-4b9c-96e3-45530629701f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eba500c7bb654a649a57bb8c96aa8bf0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:03.528947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6b7e0789-c62a-4b9c-96e3-45530629701f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eba500c7bb654a649a57bb8c96aa8bf0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:03.575093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6b7e0789-c62a-4b9c-96e3-45530629701f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eba500c7bb654a649a57bb8c96aa8bf0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:03.577736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6b7e0789-c62a-4b9c-96e3-45530629701f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eba500c7bb654a649a57bb8c96aa8bf0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:03.692483 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1892/3735] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:41:03 2022] DELETE /identity/v3/users/eba500c7bb654a649a57bb8c96aa8bf0 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:04.307372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125ca17-f6f7-4e80-85e4-79b2d434f2d7 service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:04.323024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125ca17-f6f7-4e80-85e4-79b2d434f2d7 service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:04.475385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed09c1-0eb9-400b-a72d-15dced007550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:04.476305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed09c1-0eb9-400b-a72d-15dced007550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:04.476907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed09c1-0eb9-400b-a72d-15dced007550 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:04.477444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed09c1-0eb9-400b-a72d-15dced007550 admin admin] PATH_INFO: `/v3/projects/05672dc7b53747988fde6abc4adb2ef1` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:04.479420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed09c1-0eb9-400b-a72d-15dced007550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05672dc7b53747988fde6abc4adb2ef1)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:04.481755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed09c1-0eb9-400b-a72d-15dced007550 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:04.676576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61facf-e220-48ca-a73d-7f3af512de82 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:04.677126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61facf-e220-48ca-a73d-7f3af512de82 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:04.677213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61facf-e220-48ca-a73d-7f3af512de82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:04.714212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4e61facf-e220-48ca-a73d-7f3af512de82 None None] MFA Rules not processed for user `b1cc79af058b4c35b3c572448fac86a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:04.715784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4e61facf-e220-48ca-a73d-7f3af512de82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:04.723489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-37ed09c1-0eb9-400b-a72d-15dced007550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05672dc7b53747988fde6abc4adb2ef1', 'request_id': 'req-37ed09c1-0eb9-400b-a72d-15dced007550'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:04.789403 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1893/3736] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:41:04.834333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-37ed09c1-0eb9-400b-a72d-15dced007550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05672dc7b53747988fde6abc4adb2ef1', 'request_id': 'req-37ed09c1-0eb9-400b-a72d-15dced007550'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:04.845715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-37ed09c1-0eb9-400b-a72d-15dced007550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05672dc7b53747988fde6abc4adb2ef1', 'request_id': 'req-37ed09c1-0eb9-400b-a72d-15dced007550'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:04.864387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:04.889654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-37ed09c1-0eb9-400b-a72d-15dced007550 admin admin] The token cache is being invalidate because project 05672dc7b53747988fde6abc4adb2ef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:41:04.890120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-37ed09c1-0eb9-400b-a72d-15dced007550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:04.890654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-37ed09c1-0eb9-400b-a72d-15dced007550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:04.896010 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1844/3737] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:41:04 2022] DELETE /identity/v3/projects/05672dc7b53747988fde6abc4adb2ef1 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:04.899588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d25c2-be2c-4700-a366-ab57579a1c89 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:04.900046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d25c2-be2c-4700-a366-ab57579a1c89 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:04.900499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d25c2-be2c-4700-a366-ab57579a1c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:04.943271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-991d25c2-be2c-4700-a366-ab57579a1c89 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:04.944614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-991d25c2-be2c-4700-a366-ab57579a1c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:05.032502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:05.077892 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1894/3738] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:05.085900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7f7f3-568f-413a-b69f-b6dccc27b6ca None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:05.086738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7f7f3-568f-413a-b69f-b6dccc27b6ca None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:05.087013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7f7f3-568f-413a-b69f-b6dccc27b6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:05.129278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e5f7f7f3-568f-413a-b69f-b6dccc27b6ca None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:05.130573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e5f7f7f3-568f-413a-b69f-b6dccc27b6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:05.145896 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1845/3739] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:05.150975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d25c2-be2c-4700-a366-ab57579a1c89 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:05.172516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d25c2-be2c-4700-a366-ab57579a1c89 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:05.189144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f49d5-3d43-4510-95b5-3087a8f71f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:05.189749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f49d5-3d43-4510-95b5-3087a8f71f01 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:05.190053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f49d5-3d43-4510-95b5-3087a8f71f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:05.190341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f49d5-3d43-4510-95b5-3087a8f71f01 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:05.191023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f49d5-3d43-4510-95b5-3087a8f71f01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:41:05.191331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f49d5-3d43-4510-95b5-3087a8f71f01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:05.193042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f49d5-3d43-4510-95b5-3087a8f71f01 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:05.236476 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1895/3740] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:05.240770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7f7f3-568f-413a-b69f-b6dccc27b6ca None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:05.255440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7f7f3-568f-413a-b69f-b6dccc27b6ca None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:05.266220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b836c4-3272-4ceb-a8b5-7f4d01c7dff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:05.267262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b836c4-3272-4ceb-a8b5-7f4d01c7dff7 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:05.269067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b836c4-3272-4ceb-a8b5-7f4d01c7dff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:05.269460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b836c4-3272-4ceb-a8b5-7f4d01c7dff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:05.270304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b836c4-3272-4ceb-a8b5-7f4d01c7dff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:05.279629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b836c4-3272-4ceb-a8b5-7f4d01c7dff7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:05.411088 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1846/3741] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:41:05 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:05.415839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f49d5-3d43-4510-95b5-3087a8f71f01 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:05.433281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f49d5-3d43-4510-95b5-3087a8f71f01 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:05.596023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1000e7-ef39-4961-b5a6-45391a8e9acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:05.596654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1000e7-ef39-4961-b5a6-45391a8e9acc admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:05.597025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1000e7-ef39-4961-b5a6-45391a8e9acc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:05.597310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1000e7-ef39-4961-b5a6-45391a8e9acc admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:05.597955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1000e7-ef39-4961-b5a6-45391a8e9acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:05.600594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1000e7-ef39-4961-b5a6-45391a8e9acc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:05.732891 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1896/3742] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:41:05 2022] POST /identity/v3/users => generated 290 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:05.738302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b836c4-3272-4ceb-a8b5-7f4d01c7dff7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:05.755646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b836c4-3272-4ceb-a8b5-7f4d01c7dff7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:05.780393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24becef4-3258-45bb-8cf8-4d124faa6c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:05.780393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24becef4-3258-45bb-8cf8-4d124faa6c4c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:05.780631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24becef4-3258-45bb-8cf8-4d124faa6c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:05.780780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24becef4-3258-45bb-8cf8-4d124faa6c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:05.781399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24becef4-3258-45bb-8cf8-4d124faa6c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:05.783096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24becef4-3258-45bb-8cf8-4d124faa6c4c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:05.808118 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1847/3743] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:41:05.812242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1000e7-ef39-4961-b5a6-45391a8e9acc admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:05.826138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1000e7-ef39-4961-b5a6-45391a8e9acc admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:05.831460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5bb8f5-bee9-4a2d-9309-92c07d8bf99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:05.832152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bb8f5-bee9-4a2d-9309-92c07d8bf99b admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:05.832459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bb8f5-bee9-4a2d-9309-92c07d8bf99b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:05.832725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bb8f5-bee9-4a2d-9309-92c07d8bf99b admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:05.833395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5bb8f5-bee9-4a2d-9309-92c07d8bf99b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:05.835065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5bb8f5-bee9-4a2d-9309-92c07d8bf99b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:05.848745 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1897/3744] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:41:05.853394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24becef4-3258-45bb-8cf8-4d124faa6c4c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:05.882463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24becef4-3258-45bb-8cf8-4d124faa6c4c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:05.902728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c2504-931a-4277-bc6f-0c59cbbc528f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:05.903433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c2504-931a-4277-bc6f-0c59cbbc528f admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:05.903717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c2504-931a-4277-bc6f-0c59cbbc528f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:05.906453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c2504-931a-4277-bc6f-0c59cbbc528f admin admin] PATH_INFO: `/v3/projects/f139e1ec9338495c94d9df2cc3652247/users/6bc4279c64ba4b52aefd967ce73f9530/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:05.942678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c2504-931a-4277-bc6f-0c59cbbc528f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f139e1ec9338495c94d9df2cc3652247, user_id=6bc4279c64ba4b52aefd967ce73f9530, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:05.953401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c2504-931a-4277-bc6f-0c59cbbc528f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:06.115970 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1848/3745] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:41:05 2022] PUT /identity/v3/projects/f139e1ec9338495c94d9df2cc3652247/users/6bc4279c64ba4b52aefd967ce73f9530/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:06.132461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee016b-bf0d-46f3-8d84-93d7db88f124 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:06.133380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee016b-bf0d-46f3-8d84-93d7db88f124 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:06.133682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee016b-bf0d-46f3-8d84-93d7db88f124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:06.199088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-83ee016b-bf0d-46f3-8d84-93d7db88f124 None None] MFA Rules not processed for user `6bc4279c64ba4b52aefd967ce73f9530`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:06.200763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-83ee016b-bf0d-46f3-8d84-93d7db88f124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:06.350418 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1898/3746] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:06.364242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ed519-ac42-4fc2-b069-ee554637c379 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:06.364586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ed519-ac42-4fc2-b069-ee554637c379 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:06.364812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ed519-ac42-4fc2-b069-ee554637c379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:06.419586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-797ed519-ac42-4fc2-b069-ee554637c379 None None] MFA Rules not processed for user `6bc4279c64ba4b52aefd967ce73f9530`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:06.423965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-797ed519-ac42-4fc2-b069-ee554637c379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:06.449124 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1849/3747] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:06.603723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee016b-bf0d-46f3-8d84-93d7db88f124 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:06.606013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-83ee016b-bf0d-46f3-8d84-93d7db88f124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:06.711769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:06.796459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee016b-bf0d-46f3-8d84-93d7db88f124 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:06.819134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7132b9-f077-4827-83fb-6aa14254da68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:06.819870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7132b9-f077-4827-83fb-6aa14254da68 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:06.820167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7132b9-f077-4827-83fb-6aa14254da68 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:06.820495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7132b9-f077-4827-83fb-6aa14254da68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:06.841258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7132b9-f077-4827-83fb-6aa14254da68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:06.841958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7132b9-f077-4827-83fb-6aa14254da68 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:06.875926 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1899/3748] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:41:10.694357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ed519-ac42-4fc2-b069-ee554637c379 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:10.696949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-797ed519-ac42-4fc2-b069-ee554637c379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:10.915542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ed519-ac42-4fc2-b069-ee554637c379 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:10.930323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12426e-e568-4801-ae41-1ed057c33668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:10.933900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12426e-e568-4801-ae41-1ed057c33668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:10.933900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12426e-e568-4801-ae41-1ed057c33668 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:10.933900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12426e-e568-4801-ae41-1ed057c33668 admin admin] PATH_INFO: `/v3/users/7e74c5f19f2245d18d8dbb31c916e5e9` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:10.940941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12426e-e568-4801-ae41-1ed057c33668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e74c5f19f2245d18d8dbb31c916e5e9)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:10.944195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12426e-e568-4801-ae41-1ed057c33668 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:11.251853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6f12426e-e568-4801-ae41-1ed057c33668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e74c5f19f2245d18d8dbb31c916e5e9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:11.257321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6f12426e-e568-4801-ae41-1ed057c33668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e74c5f19f2245d18d8dbb31c916e5e9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:11.288707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6f12426e-e568-4801-ae41-1ed057c33668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e74c5f19f2245d18d8dbb31c916e5e9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:11.333814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6f12426e-e568-4801-ae41-1ed057c33668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e74c5f19f2245d18d8dbb31c916e5e9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:11.485640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6f12426e-e568-4801-ae41-1ed057c33668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e74c5f19f2245d18d8dbb31c916e5e9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:11.513326 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1850/3749] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:41:10 2022] DELETE /identity/v3/users/7e74c5f19f2245d18d8dbb31c916e5e9 => generated 0 bytes in 824 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:11.517751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1970f7b-6776-4fe9-b31d-a0ca29e4ed5b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:11.525378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1970f7b-6776-4fe9-b31d-a0ca29e4ed5b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:11.525378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1970f7b-6776-4fe9-b31d-a0ca29e4ed5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:11.567132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f1970f7b-6776-4fe9-b31d-a0ca29e4ed5b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:11.568696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f1970f7b-6776-4fe9-b31d-a0ca29e4ed5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:11.714870 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1900/3750] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:11.776471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12426e-e568-4801-ae41-1ed057c33668 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:11.779947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6f12426e-e568-4801-ae41-1ed057c33668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:11.799886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:11.945629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12426e-e568-4801-ae41-1ed057c33668 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:11.962195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1695b51-ce43-49bc-9f99-8f52f0c57b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:11.966403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1695b51-ce43-49bc-9f99-8f52f0c57b39 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:11.966403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1695b51-ce43-49bc-9f99-8f52f0c57b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:11.966403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1695b51-ce43-49bc-9f99-8f52f0c57b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:11.999911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1695b51-ce43-49bc-9f99-8f52f0c57b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:12.001691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1695b51-ce43-49bc-9f99-8f52f0c57b39 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:12.041494 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1851/3751] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:41:14.039970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1970f7b-6776-4fe9-b31d-a0ca29e4ed5b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:14.041482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f1970f7b-6776-4fe9-b31d-a0ca29e4ed5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:14.065427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1970f7b-6776-4fe9-b31d-a0ca29e4ed5b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:14.080079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c8b71-a928-402f-a961-d8fde6043e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:14.093973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c8b71-a928-402f-a961-d8fde6043e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:14.094296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c8b71-a928-402f-a961-d8fde6043e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:14.094581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c8b71-a928-402f-a961-d8fde6043e69 admin admin] PATH_INFO: `/v3/projects/35f5298f2bce42758be2373c640881fe` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:14.096337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c8b71-a928-402f-a961-d8fde6043e69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35f5298f2bce42758be2373c640881fe)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:14.098463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c8b71-a928-402f-a961-d8fde6043e69 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:14.353683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f59c8b71-a928-402f-a961-d8fde6043e69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35f5298f2bce42758be2373c640881fe', 'request_id': 'req-f59c8b71-a928-402f-a961-d8fde6043e69'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:14.377467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f59c8b71-a928-402f-a961-d8fde6043e69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35f5298f2bce42758be2373c640881fe', 'request_id': 'req-f59c8b71-a928-402f-a961-d8fde6043e69'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:14.390266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f59c8b71-a928-402f-a961-d8fde6043e69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35f5298f2bce42758be2373c640881fe', 'request_id': 'req-f59c8b71-a928-402f-a961-d8fde6043e69'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:14.874771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f59c8b71-a928-402f-a961-d8fde6043e69 admin admin] The token cache is being invalidate because project 35f5298f2bce42758be2373c640881fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:41:14.875265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f59c8b71-a928-402f-a961-d8fde6043e69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:14.876686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f59c8b71-a928-402f-a961-d8fde6043e69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:14.879702 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1901/3752] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:41:14 2022] DELETE /identity/v3/projects/35f5298f2bce42758be2373c640881fe => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:14.888380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cbfb9-d1a6-4926-9693-497d749db119 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:14.889681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cbfb9-d1a6-4926-9693-497d749db119 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:14.891033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cbfb9-d1a6-4926-9693-497d749db119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:14.923724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-425cbfb9-d1a6-4926-9693-497d749db119 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:14.925298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-425cbfb9-d1a6-4926-9693-497d749db119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:15.084695 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1852/3753] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:15.085689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d29f4-a6d2-4dc9-93e9-000e2edd5b90 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:15.086763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d29f4-a6d2-4dc9-93e9-000e2edd5b90 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:15.086946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d29f4-a6d2-4dc9-93e9-000e2edd5b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:15.128584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-af3d29f4-a6d2-4dc9-93e9-000e2edd5b90 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:15.137096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-af3d29f4-a6d2-4dc9-93e9-000e2edd5b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:15.160781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cbfb9-d1a6-4926-9693-497d749db119 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:15.192832 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1902/3754] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:15.200543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cbfb9-d1a6-4926-9693-497d749db119 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:15.220757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5857174-e7da-4279-814e-d37091c32c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:15.220757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5857174-e7da-4279-814e-d37091c32c14 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:15.220757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5857174-e7da-4279-814e-d37091c32c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:15.220757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5857174-e7da-4279-814e-d37091c32c14 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:15.221151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5857174-e7da-4279-814e-d37091c32c14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:41:15.221780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5857174-e7da-4279-814e-d37091c32c14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:15.223933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5857174-e7da-4279-814e-d37091c32c14 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:15.242782 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1853/3755] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:15.246836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d29f4-a6d2-4dc9-93e9-000e2edd5b90 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:15.257196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d29f4-a6d2-4dc9-93e9-000e2edd5b90 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:15.263896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b2e48-3956-45cd-89a1-e8cbb11a3732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:15.264820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b2e48-3956-45cd-89a1-e8cbb11a3732 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:15.266657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b2e48-3956-45cd-89a1-e8cbb11a3732 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:15.266657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b2e48-3956-45cd-89a1-e8cbb11a3732 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:15.266657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b2e48-3956-45cd-89a1-e8cbb11a3732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:15.271495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b2e48-3956-45cd-89a1-e8cbb11a3732 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:15.447790 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1903/3756] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:41:15 2022] POST /identity/v3/projects => generated 391 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:15.448944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5857174-e7da-4279-814e-d37091c32c14 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:15.467490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5857174-e7da-4279-814e-d37091c32c14 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:15.617416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a290a5-6e5a-4f67-b33c-4ad0d739cc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:15.618070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a290a5-6e5a-4f67-b33c-4ad0d739cc44 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:15.618358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a290a5-6e5a-4f67-b33c-4ad0d739cc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:15.618633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a290a5-6e5a-4f67-b33c-4ad0d739cc44 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:15.619278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a290a5-6e5a-4f67-b33c-4ad0d739cc44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:15.625037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a290a5-6e5a-4f67-b33c-4ad0d739cc44 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:15.739700 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1854/3757] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:41:15 2022] POST /identity/v3/users => generated 296 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:41:15.747266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b2e48-3956-45cd-89a1-e8cbb11a3732 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:15.771895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b2e48-3956-45cd-89a1-e8cbb11a3732 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:15.780972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db011239-3c3e-4ed1-9f55-3db146567ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:15.781600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db011239-3c3e-4ed1-9f55-3db146567ffc admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:15.782095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db011239-3c3e-4ed1-9f55-3db146567ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:15.782611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db011239-3c3e-4ed1-9f55-3db146567ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:15.783410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db011239-3c3e-4ed1-9f55-3db146567ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:15.785172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db011239-3c3e-4ed1-9f55-3db146567ffc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:15.815130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a290a5-6e5a-4f67-b33c-4ad0d739cc44 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:15.827508 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1904/3758] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:41:15.840532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a290a5-6e5a-4f67-b33c-4ad0d739cc44 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:15.851362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d2862-d1a5-4816-9999-4278a894f355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:15.852640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d2862-d1a5-4816-9999-4278a894f355 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:15.853041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d2862-d1a5-4816-9999-4278a894f355 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:15.853421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d2862-d1a5-4816-9999-4278a894f355 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:15.854308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d2862-d1a5-4816-9999-4278a894f355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:15.857712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d2862-d1a5-4816-9999-4278a894f355 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:15.875798 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1855/3759] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:41:15.876618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db011239-3c3e-4ed1-9f55-3db146567ffc admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:15.888083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:15.896432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db011239-3c3e-4ed1-9f55-3db146567ffc admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:15.905619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a58d72-b9d2-464e-b142-a117ced80c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:15.908523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a58d72-b9d2-464e-b142-a117ced80c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:15.908931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a58d72-b9d2-464e-b142-a117ced80c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:15.909279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a58d72-b9d2-464e-b142-a117ced80c7a admin admin] PATH_INFO: `/v3/projects/e499ada7055149d1b1cf6dfd01268b99/users/3ac947191ec44ea486e354b75d4c403b/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:15.933898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a58d72-b9d2-464e-b142-a117ced80c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e499ada7055149d1b1cf6dfd01268b99, user_id=3ac947191ec44ea486e354b75d4c403b, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:15.937055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a58d72-b9d2-464e-b142-a117ced80c7a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:16.076379 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1905/3760] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:41:15 2022] PUT /identity/v3/projects/e499ada7055149d1b1cf6dfd01268b99/users/3ac947191ec44ea486e354b75d4c403b/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:16.087094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d7f0d-0cb0-4fa1-8d43-4e1af5cb326e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:16.087658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d7f0d-0cb0-4fa1-8d43-4e1af5cb326e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:16.087658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d7f0d-0cb0-4fa1-8d43-4e1af5cb326e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:16.140042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:16.145645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6b2d7f0d-0cb0-4fa1-8d43-4e1af5cb326e None None] MFA Rules not processed for user `3ac947191ec44ea486e354b75d4c403b`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:16.149255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6b2d7f0d-0cb0-4fa1-8d43-4e1af5cb326e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:16.286718 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1856/3761] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:16.288225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a58d72-b9d2-464e-b142-a117ced80c7a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:16.423532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a58d72-b9d2-464e-b142-a117ced80c7a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:16.439582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b95035-0f4c-421f-ac63-674b9fb2b624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:16.440423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b95035-0f4c-421f-ac63-674b9fb2b624 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:16.440757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b95035-0f4c-421f-ac63-674b9fb2b624 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:16.441094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b95035-0f4c-421f-ac63-674b9fb2b624 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:16.441911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b95035-0f4c-421f-ac63-674b9fb2b624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:16.448248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b95035-0f4c-421f-ac63-674b9fb2b624 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:16.539490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb0125-8a1d-4be7-8f28-ef1f503ddb8a None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:16.539886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb0125-8a1d-4be7-8f28-ef1f503ddb8a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:16.540268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb0125-8a1d-4be7-8f28-ef1f503ddb8a None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:16.541902 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1857/3762] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 03:41:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 03:41:16.556332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a4648-731b-4cb6-8a7f-47389eae378a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:16.556332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a4648-731b-4cb6-8a7f-47389eae378a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:16.556332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a4648-731b-4cb6-8a7f-47389eae378a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:16.587928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ec5a4648-731b-4cb6-8a7f-47389eae378a None None] MFA Rules not processed for user `9b359391fbc34c259d987e42e8826c86`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:16.589433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ec5a4648-731b-4cb6-8a7f-47389eae378a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:16.637176 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1906/3763] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:41:16 2022] POST /identity/v3/projects => generated 391 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:16.641877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b95035-0f4c-421f-ac63-674b9fb2b624 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:16.749890 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1858/3764] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:41:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:16.816404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b95035-0f4c-421f-ac63-674b9fb2b624 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:16.819438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a4648-731b-4cb6-8a7f-47389eae378a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:16.821063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ec5a4648-731b-4cb6-8a7f-47389eae378a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:16.823856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9ee55-841d-4d5d-bf08-dc393eb3e84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:16.833682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9ee55-841d-4d5d-bf08-dc393eb3e84c admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:16.833682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9ee55-841d-4d5d-bf08-dc393eb3e84c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:16.833682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9ee55-841d-4d5d-bf08-dc393eb3e84c admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:16.833682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9ee55-841d-4d5d-bf08-dc393eb3e84c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:16.833682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9ee55-841d-4d5d-bf08-dc393eb3e84c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:16.834548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a4648-731b-4cb6-8a7f-47389eae378a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:16.942459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31391e94-ccaa-4ba8-a67a-07b040f7d026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:16.954225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31391e94-ccaa-4ba8-a67a-07b040f7d026 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:16.954225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31391e94-ccaa-4ba8-a67a-07b040f7d026 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:16.954225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31391e94-ccaa-4ba8-a67a-07b040f7d026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:16.954225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31391e94-ccaa-4ba8-a67a-07b040f7d026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:16.954871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31391e94-ccaa-4ba8-a67a-07b040f7d026 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:16.965408 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1859/3765] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:41:17.019478 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1907/3766] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:41:16 2022] POST /identity/v3/users => generated 302 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:17.021249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31391e94-ccaa-4ba8-a67a-07b040f7d026 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:17.078492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31391e94-ccaa-4ba8-a67a-07b040f7d026 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:17.087971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ec618-0d1c-4cb5-8b5f-0cc73a520530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:17.089686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ec618-0d1c-4cb5-8b5f-0cc73a520530 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:17.090657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ec618-0d1c-4cb5-8b5f-0cc73a520530 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:17.091682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ec618-0d1c-4cb5-8b5f-0cc73a520530 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:17.093196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ec618-0d1c-4cb5-8b5f-0cc73a520530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:17.095577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ec618-0d1c-4cb5-8b5f-0cc73a520530 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:17.121447 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1860/3767] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:41:17.123175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9ee55-841d-4d5d-bf08-dc393eb3e84c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:17.144229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9ee55-841d-4d5d-bf08-dc393eb3e84c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:17.165198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d986b4-6506-4bbd-81ee-a886fb9dbeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:17.166497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d986b4-6506-4bbd-81ee-a886fb9dbeda admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:17.166950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d986b4-6506-4bbd-81ee-a886fb9dbeda admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:17.175021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d986b4-6506-4bbd-81ee-a886fb9dbeda admin admin] PATH_INFO: `/v3/projects/dc91d55d4ed64f5593d2648e1a4e2178/users/aee9ed7afbaa4e4eb167c914316d54c0/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:17.189948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d986b4-6506-4bbd-81ee-a886fb9dbeda admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc91d55d4ed64f5593d2648e1a4e2178, user_id=aee9ed7afbaa4e4eb167c914316d54c0, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:17.206153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d986b4-6506-4bbd-81ee-a886fb9dbeda admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:17.327448 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1908/3768] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:41:17 2022] PUT /identity/v3/projects/dc91d55d4ed64f5593d2648e1a4e2178/users/aee9ed7afbaa4e4eb167c914316d54c0/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:17.331327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ec618-0d1c-4cb5-8b5f-0cc73a520530 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:17.353889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ec618-0d1c-4cb5-8b5f-0cc73a520530 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:17.470306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:17.486342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7e7c5-5ffb-4333-a493-aae0b29ce259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:17.486888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7e7c5-5ffb-4333-a493-aae0b29ce259 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:17.487179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7e7c5-5ffb-4333-a493-aae0b29ce259 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:17.487454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7e7c5-5ffb-4333-a493-aae0b29ce259 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:17.488115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7e7c5-5ffb-4333-a493-aae0b29ce259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:17.489737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7e7c5-5ffb-4333-a493-aae0b29ce259 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:17.502077 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1861/3769] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:41:17.504432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d986b4-6506-4bbd-81ee-a886fb9dbeda admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:17.519441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d986b4-6506-4bbd-81ee-a886fb9dbeda admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:17.526180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c35baa-c939-47ed-9e4f-94861824d1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:17.526866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c35baa-c939-47ed-9e4f-94861824d1f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:17.527148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c35baa-c939-47ed-9e4f-94861824d1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:17.527421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c35baa-c939-47ed-9e4f-94861824d1f4 admin admin] PATH_INFO: `/v3/projects/dc91d55d4ed64f5593d2648e1a4e2178/users/aee9ed7afbaa4e4eb167c914316d54c0/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:17.531688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c35baa-c939-47ed-9e4f-94861824d1f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc91d55d4ed64f5593d2648e1a4e2178, user_id=aee9ed7afbaa4e4eb167c914316d54c0, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:17.534532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c35baa-c939-47ed-9e4f-94861824d1f4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:17.567177 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1909/3770] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:41:17 2022] PUT /identity/v3/projects/dc91d55d4ed64f5593d2648e1a4e2178/users/aee9ed7afbaa4e4eb167c914316d54c0/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:17.578372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb0f6c-ab57-4acb-8174-eaf04200535b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:17.578663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb0f6c-ab57-4acb-8174-eaf04200535b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:17.578934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb0f6c-ab57-4acb-8174-eaf04200535b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:17.625940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-83cb0f6c-ab57-4acb-8174-eaf04200535b None None] MFA Rules not processed for user `aee9ed7afbaa4e4eb167c914316d54c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:17.627761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-83cb0f6c-ab57-4acb-8174-eaf04200535b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:17.751479 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1862/3771] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:17 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:17.756465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c35baa-c939-47ed-9e4f-94861824d1f4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:17.772598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c35baa-c939-47ed-9e4f-94861824d1f4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:17.780235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50159c2b-a436-47ed-abd1-4ff4b9a83ca8 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:17.781980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50159c2b-a436-47ed-abd1-4ff4b9a83ca8 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:17.782766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50159c2b-a436-47ed-abd1-4ff4b9a83ca8 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:17.784966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50159c2b-a436-47ed-abd1-4ff4b9a83ca8 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:17.786980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50159c2b-a436-47ed-abd1-4ff4b9a83ca8 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:17.788287 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-50159c2b-a436-47ed-abd1-4ff4b9a83ca8 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:41:17.788287 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:41:17.788287 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:41:17.790353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50159c2b-a436-47ed-abd1-4ff4b9a83ca8 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:17.983954 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1910/3772] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:41:17 2022] POST /identity/v3/domains => generated 276 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:17.989388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb0f6c-ab57-4acb-8174-eaf04200535b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:18.005583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb0f6c-ab57-4acb-8174-eaf04200535b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:18.089630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9845f4e-cbb2-485d-8b5a-8de0beedb419 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:18.090490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9845f4e-cbb2-485d-8b5a-8de0beedb419 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:18.090861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9845f4e-cbb2-485d-8b5a-8de0beedb419 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:18.091205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9845f4e-cbb2-485d-8b5a-8de0beedb419 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/2c7eb7a3f91b42689f7dce50d2e9daba/config` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:18.091975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9845f4e-cbb2-485d-8b5a-8de0beedb419 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=2c7eb7a3f91b42689f7dce50d2e9daba)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:18.093376 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-b9845f4e-cbb2-485d-8b5a-8de0beedb419 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:41:18.093376 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:41:18.093376 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:41:18.094208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9845f4e-cbb2-485d-8b5a-8de0beedb419 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:18.234672 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1863/3773] 10.222.0.20 () {60 vars in 1269 bytes} [Thu Oct 27 03:41:17 2022] PUT /identity/v3/domains/2c7eb7a3f91b42689f7dce50d2e9daba/config => generated 138 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:18.238631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50159c2b-a436-47ed-abd1-4ff4b9a83ca8 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:18.247594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:18.251813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50159c2b-a436-47ed-abd1-4ff4b9a83ca8 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:18.257449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66545ad7-cc56-424a-bde5-d6075cd29bfb tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:18.260896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66545ad7-cc56-424a-bde5-d6075cd29bfb tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:18.260896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66545ad7-cc56-424a-bde5-d6075cd29bfb tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:18.260896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66545ad7-cc56-424a-bde5-d6075cd29bfb tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/2c7eb7a3f91b42689f7dce50d2e9daba/config/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:18.260896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66545ad7-cc56-424a-bde5-d6075cd29bfb tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2c7eb7a3f91b42689f7dce50d2e9daba, group=identity)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:18.261443 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-66545ad7-cc56-424a-bde5-d6075cd29bfb tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:41:18.261443 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:41:18.261443 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:41:18.262398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66545ad7-cc56-424a-bde5-d6075cd29bfb tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:18.269771 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1911/3774] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 03:41:18 2022] GET /identity/v3/domains/2c7eb7a3f91b42689f7dce50d2e9daba/config/identity => generated 45 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:18.275279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9845f4e-cbb2-485d-8b5a-8de0beedb419 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:18.285700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9845f4e-cbb2-485d-8b5a-8de0beedb419 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:18.291383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06238cd-4e5d-450b-8510-a36a84014022 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:18.291923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06238cd-4e5d-450b-8510-a36a84014022 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:18.292212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06238cd-4e5d-450b-8510-a36a84014022 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:18.292493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06238cd-4e5d-450b-8510-a36a84014022 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/2c7eb7a3f91b42689f7dce50d2e9daba/config/identity/driver` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:18.293922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06238cd-4e5d-450b-8510-a36a84014022 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2c7eb7a3f91b42689f7dce50d2e9daba, group=identity, option=driver)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:18.294989 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-f06238cd-4e5d-450b-8510-a36a84014022 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:41:18.294989 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:41:18.294989 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:41:18.295889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06238cd-4e5d-450b-8510-a36a84014022 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:18.302342 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1864/3775] 10.222.0.20 () {58 vars in 1296 bytes} [Thu Oct 27 03:41:18 2022] GET /identity/v3/domains/2c7eb7a3f91b42689f7dce50d2e9daba/config/identity/driver => generated 31 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:18.307564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66545ad7-cc56-424a-bde5-d6075cd29bfb tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:18.316778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66545ad7-cc56-424a-bde5-d6075cd29bfb tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:18.323466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2289d-2d1c-4e04-8580-95334b598b77 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:18.324111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2289d-2d1c-4e04-8580-95334b598b77 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:18.324396 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2289d-2d1c-4e04-8580-95334b598b77 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:18.324703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2289d-2d1c-4e04-8580-95334b598b77 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/2c7eb7a3f91b42689f7dce50d2e9daba/config/ldap` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:18.325816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2289d-2d1c-4e04-8580-95334b598b77 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2c7eb7a3f91b42689f7dce50d2e9daba, group=ldap)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:18.327456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2289d-2d1c-4e04-8580-95334b598b77 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:18.332918 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1912/3776] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:41:18 2022] GET /identity/v3/domains/2c7eb7a3f91b42689f7dce50d2e9daba/config/ldap => generated 106 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:18.337064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06238cd-4e5d-450b-8510-a36a84014022 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:18.348959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06238cd-4e5d-450b-8510-a36a84014022 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:18.354735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673b670-2155-479c-9227-585b2f826ff1 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:18.355409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673b670-2155-479c-9227-585b2f826ff1 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:18.355699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673b670-2155-479c-9227-585b2f826ff1 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:18.355979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673b670-2155-479c-9227-585b2f826ff1 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/2c7eb7a3f91b42689f7dce50d2e9daba/config/ldap/url` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:18.357185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673b670-2155-479c-9227-585b2f826ff1 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2c7eb7a3f91b42689f7dce50d2e9daba, group=ldap, option=url)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:18.358893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673b670-2155-479c-9227-585b2f826ff1 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:18.364526 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1865/3777] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 03:41:18 2022] GET /identity/v3/domains/2c7eb7a3f91b42689f7dce50d2e9daba/config/ldap/url => generated 46 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 27 03:41:18.371054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2289d-2d1c-4e04-8580-95334b598b77 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:18.379275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2289d-2d1c-4e04-8580-95334b598b77 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:18.385574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6fc28-9aa8-4d59-9088-359b73c3e7f0 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:18.386495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6fc28-9aa8-4d59-9088-359b73c3e7f0 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:18.386780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6fc28-9aa8-4d59-9088-359b73c3e7f0 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:18.387197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6fc28-9aa8-4d59-9088-359b73c3e7f0 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/2c7eb7a3f91b42689f7dce50d2e9daba/config/ldap/user_tree_dn` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:18.388381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6fc28-9aa8-4d59-9088-359b73c3e7f0 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2c7eb7a3f91b42689f7dce50d2e9daba, group=ldap, option=user_tree_dn)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:18.389988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6fc28-9aa8-4d59-9088-359b73c3e7f0 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:18.396724 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1913/3778] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:41:18 2022] GET /identity/v3/domains/2c7eb7a3f91b42689f7dce50d2e9daba/config/ldap/user_tree_dn => generated 63 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:18.402873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673b670-2155-479c-9227-585b2f826ff1 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:18.413244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673b670-2155-479c-9227-585b2f826ff1 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:18.419198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c2786-0298-474c-bd70-dfd8434a16df tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:18.419858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c2786-0298-474c-bd70-dfd8434a16df tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:18.420172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c2786-0298-474c-bd70-dfd8434a16df tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:18.422757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c2786-0298-474c-bd70-dfd8434a16df tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/2c7eb7a3f91b42689f7dce50d2e9daba/config` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:18.422757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c2786-0298-474c-bd70-dfd8434a16df tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=2c7eb7a3f91b42689f7dce50d2e9daba)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:18.422757 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-519c2786-0298-474c-bd70-dfd8434a16df tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:41:18.422757 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:41:18.422757 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:41:18.423204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c2786-0298-474c-bd70-dfd8434a16df tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:18.519807 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1866/3779] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:41:18 2022] DELETE /identity/v3/domains/2c7eb7a3f91b42689f7dce50d2e9daba/config => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:18.524450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6fc28-9aa8-4d59-9088-359b73c3e7f0 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:18.535774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6fc28-9aa8-4d59-9088-359b73c3e7f0 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:18.541708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c16a51-8b7d-4ba1-aa1f-a8f15b7b0b97 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:18.542486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c16a51-8b7d-4ba1-aa1f-a8f15b7b0b97 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:18.543108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c16a51-8b7d-4ba1-aa1f-a8f15b7b0b97 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:18.543464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c16a51-8b7d-4ba1-aa1f-a8f15b7b0b97 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/2c7eb7a3f91b42689f7dce50d2e9daba` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:18.544820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c16a51-8b7d-4ba1-aa1f-a8f15b7b0b97 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2c7eb7a3f91b42689f7dce50d2e9daba)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:18.545907 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-c2c16a51-8b7d-4ba1-aa1f-a8f15b7b0b97 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:41:18.545907 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:41:18.545907 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:41:18.547043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c16a51-8b7d-4ba1-aa1f-a8f15b7b0b97 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:18.569561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c2c16a51-8b7d-4ba1-aa1f-a8f15b7b0b97 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2c7eb7a3f91b42689f7dce50d2e9daba'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:18.570519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c2c16a51-8b7d-4ba1-aa1f-a8f15b7b0b97 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2c7eb7a3f91b42689f7dce50d2e9daba'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:18.719232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c2c16a51-8b7d-4ba1-aa1f-a8f15b7b0b97 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2c7eb7a3f91b42689f7dce50d2e9daba'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:18.720534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c2c16a51-8b7d-4ba1-aa1f-a8f15b7b0b97 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2c7eb7a3f91b42689f7dce50d2e9daba'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:18.730252 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1914/3780] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:41:18 2022] PATCH /identity/v3/domains/2c7eb7a3f91b42689f7dce50d2e9daba => generated 277 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:18.734026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c2786-0298-474c-bd70-dfd8434a16df tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:18.736366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-519c2786-0298-474c-bd70-dfd8434a16df tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:18.753670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c2786-0298-474c-bd70-dfd8434a16df tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:18.762177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:18.839136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6b496-4af9-400c-8e20-fe8673dbcd67 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:18.843964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6b496-4af9-400c-8e20-fe8673dbcd67 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:18.843964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6b496-4af9-400c-8e20-fe8673dbcd67 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:18.843964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6b496-4af9-400c-8e20-fe8673dbcd67 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/2c7eb7a3f91b42689f7dce50d2e9daba` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:18.852846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6b496-4af9-400c-8e20-fe8673dbcd67 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2c7eb7a3f91b42689f7dce50d2e9daba)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:18.854028 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-a1f6b496-4af9-400c-8e20-fe8673dbcd67 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:41:18.854028 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:41:18.854028 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:41:18.854969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6b496-4af9-400c-8e20-fe8673dbcd67 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:18.884595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a1f6b496-4af9-400c-8e20-fe8673dbcd67 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2c7eb7a3f91b42689f7dce50d2e9daba'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:18.906693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a1f6b496-4af9-400c-8e20-fe8673dbcd67 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2c7eb7a3f91b42689f7dce50d2e9daba'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:19.074484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a1f6b496-4af9-400c-8e20-fe8673dbcd67 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c7eb7a3f91b42689f7dce50d2e9daba', 'request_id': 'req-a1f6b496-4af9-400c-8e20-fe8673dbcd67'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:19.214336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a1f6b496-4af9-400c-8e20-fe8673dbcd67 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c7eb7a3f91b42689f7dce50d2e9daba', 'request_id': 'req-a1f6b496-4af9-400c-8e20-fe8673dbcd67'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:19.214336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a1f6b496-4af9-400c-8e20-fe8673dbcd67 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c7eb7a3f91b42689f7dce50d2e9daba', 'request_id': 'req-a1f6b496-4af9-400c-8e20-fe8673dbcd67'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:19.214336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a1f6b496-4af9-400c-8e20-fe8673dbcd67 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] The token cache is being invalidate because project 2c7eb7a3f91b42689f7dce50d2e9daba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:41:19.215200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a1f6b496-4af9-400c-8e20-fe8673dbcd67 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:19.215200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a1f6b496-4af9-400c-8e20-fe8673dbcd67 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:19.220177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a1f6b496-4af9-400c-8e20-fe8673dbcd67 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2c7eb7a3f91b42689f7dce50d2e9daba', 'request_id': 'req-a1f6b496-4af9-400c-8e20-fe8673dbcd67'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:19.220890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a1f6b496-4af9-400c-8e20-fe8673dbcd67 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2c7eb7a3f91b42689f7dce50d2e9daba', 'request_id': 'req-a1f6b496-4af9-400c-8e20-fe8673dbcd67'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:19.221655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a1f6b496-4af9-400c-8e20-fe8673dbcd67 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2c7eb7a3f91b42689f7dce50d2e9daba', 'request_id': 'req-a1f6b496-4af9-400c-8e20-fe8673dbcd67'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:19.231901 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1867/3781] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:41:18 2022] DELETE /identity/v3/domains/2c7eb7a3f91b42689f7dce50d2e9daba => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:19.237260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c16a51-8b7d-4ba1-aa1f-a8f15b7b0b97 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:19.247500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c16a51-8b7d-4ba1-aa1f-a8f15b7b0b97 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:19.315310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7de0be-ddfd-4904-b41d-e017e1e889da tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:19.315856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7de0be-ddfd-4904-b41d-e017e1e889da tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:19.316145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7de0be-ddfd-4904-b41d-e017e1e889da tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:19.316429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7de0be-ddfd-4904-b41d-e017e1e889da tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:19.317249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7de0be-ddfd-4904-b41d-e017e1e889da tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:19.319122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7de0be-ddfd-4904-b41d-e017e1e889da tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:19.459746 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1915/3782] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:41:19 2022] POST /identity/v3/domains => generated 275 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:41:19.463865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6b496-4af9-400c-8e20-fe8673dbcd67 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:19.465335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a1f6b496-4af9-400c-8e20-fe8673dbcd67 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:19.479118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6b496-4af9-400c-8e20-fe8673dbcd67 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:19.542635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c082db-34bb-476a-a5f5-e5fccf82ca32 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:19.543661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c082db-34bb-476a-a5f5-e5fccf82ca32 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:19.544022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c082db-34bb-476a-a5f5-e5fccf82ca32 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:19.544416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c082db-34bb-476a-a5f5-e5fccf82ca32 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/8f0d963c23c941cc91a984df87d5244f/config` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:19.545391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c082db-34bb-476a-a5f5-e5fccf82ca32 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=8f0d963c23c941cc91a984df87d5244f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:19.547364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c082db-34bb-476a-a5f5-e5fccf82ca32 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:19.646442 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1868/3783] 10.222.0.20 () {60 vars in 1269 bytes} [Thu Oct 27 03:41:19 2022] PUT /identity/v3/domains/8f0d963c23c941cc91a984df87d5244f/config => generated 138 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:41:19.647509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7de0be-ddfd-4904-b41d-e017e1e889da tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:19.662568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7de0be-ddfd-4904-b41d-e017e1e889da tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:19.668601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30075ac4-acd8-45f7-bcfe-86e999c9f6a7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:19.669561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30075ac4-acd8-45f7-bcfe-86e999c9f6a7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:19.670154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30075ac4-acd8-45f7-bcfe-86e999c9f6a7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:19.671184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30075ac4-acd8-45f7-bcfe-86e999c9f6a7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/8f0d963c23c941cc91a984df87d5244f/config` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:19.673108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30075ac4-acd8-45f7-bcfe-86e999c9f6a7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=8f0d963c23c941cc91a984df87d5244f)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:19.674330 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-30075ac4-acd8-45f7-bcfe-86e999c9f6a7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:41:19.674330 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:41:19.674330 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:41:19.675472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30075ac4-acd8-45f7-bcfe-86e999c9f6a7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:19.824605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c082db-34bb-476a-a5f5-e5fccf82ca32 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:19.838186 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1916/3784] 10.222.0.20 () {60 vars in 1271 bytes} [Thu Oct 27 03:41:19 2022] PATCH /identity/v3/domains/8f0d963c23c941cc91a984df87d5244f/config => generated 141 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:19.838957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c082db-34bb-476a-a5f5-e5fccf82ca32 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:19.845653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b847297-6b00-4cbf-835b-d5c99f816707 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:19.847020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b847297-6b00-4cbf-835b-d5c99f816707 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:19.847643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b847297-6b00-4cbf-835b-d5c99f816707 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:19.848411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b847297-6b00-4cbf-835b-d5c99f816707 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/8f0d963c23c941cc91a984df87d5244f/config` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:19.850330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b847297-6b00-4cbf-835b-d5c99f816707 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=8f0d963c23c941cc91a984df87d5244f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:19.852316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b847297-6b00-4cbf-835b-d5c99f816707 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:19.869889 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1869/3785] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:41:19 2022] GET /identity/v3/domains/8f0d963c23c941cc91a984df87d5244f/config => generated 141 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:19.871973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30075ac4-acd8-45f7-bcfe-86e999c9f6a7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:19.883947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30075ac4-acd8-45f7-bcfe-86e999c9f6a7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:19.889760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef77f5a-f5a8-447c-afb8-bdb4cb697d12 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:19.890525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef77f5a-f5a8-447c-afb8-bdb4cb697d12 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:19.890973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef77f5a-f5a8-447c-afb8-bdb4cb697d12 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:19.892266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef77f5a-f5a8-447c-afb8-bdb4cb697d12 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/8f0d963c23c941cc91a984df87d5244f/config` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:19.892893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef77f5a-f5a8-447c-afb8-bdb4cb697d12 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=8f0d963c23c941cc91a984df87d5244f)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:19.893922 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-0ef77f5a-f5a8-447c-afb8-bdb4cb697d12 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:41:19.893922 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:41:19.893922 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:41:19.895582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef77f5a-f5a8-447c-afb8-bdb4cb697d12 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:19.983298 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1917/3786] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:41:19 2022] DELETE /identity/v3/domains/8f0d963c23c941cc91a984df87d5244f/config => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:19.987593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b847297-6b00-4cbf-835b-d5c99f816707 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:20.004463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b847297-6b00-4cbf-835b-d5c99f816707 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:20.010196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b127539-8189-4c6f-91dc-d3258d574020 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:20.010933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b127539-8189-4c6f-91dc-d3258d574020 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:20.011289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b127539-8189-4c6f-91dc-d3258d574020 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:20.011639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b127539-8189-4c6f-91dc-d3258d574020 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/8f0d963c23c941cc91a984df87d5244f/config` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:20.012845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b127539-8189-4c6f-91dc-d3258d574020 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=8f0d963c23c941cc91a984df87d5244f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:20.014566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b127539-8189-4c6f-91dc-d3258d574020 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:20.056089 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-5b127539-8189-4c6f-91dc-d3258d574020 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Could not find any options in domain configuration for domain 8f0d963c23c941cc91a984df87d5244f.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 8f0d963c23c941cc91a984df87d5244f. Oct 27 03:41:20.056089 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:41:20.056089 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:41:20.056089 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:41:20.056089 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:41:20.056089 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:41:20.056089 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:41:20.056089 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:41:20.056089 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:41:20.056089 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:41:20.056089 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:41:20.056089 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:41:20.056089 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 27 03:41:20.057133 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 27 03:41:20.057133 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 27 03:41:20.057133 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 27 03:41:20.057133 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:41:20.057133 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:41:20.057133 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 27 03:41:20.057133 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 27 03:41:20.057133 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 8f0d963c23c941cc91a984df87d5244f. Oct 27 03:41:20.057133 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:41:20.058492 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1870/3787] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:41:19 2022] GET /identity/v3/domains/8f0d963c23c941cc91a984df87d5244f/config => generated 151 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:41:20.063015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef77f5a-f5a8-447c-afb8-bdb4cb697d12 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:20.073861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef77f5a-f5a8-447c-afb8-bdb4cb697d12 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:20.079028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f2506-ae2c-4db1-9274-b3d14e9c09d8 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:20.079696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f2506-ae2c-4db1-9274-b3d14e9c09d8 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:20.079987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f2506-ae2c-4db1-9274-b3d14e9c09d8 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:20.080564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f2506-ae2c-4db1-9274-b3d14e9c09d8 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/8f0d963c23c941cc91a984df87d5244f/config` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:20.081177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f2506-ae2c-4db1-9274-b3d14e9c09d8 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=8f0d963c23c941cc91a984df87d5244f)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:20.082925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f2506-ae2c-4db1-9274-b3d14e9c09d8 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:20.090242 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1918/3788] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:41:20 2022] DELETE /identity/v3/domains/8f0d963c23c941cc91a984df87d5244f/config => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:20.094745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b127539-8189-4c6f-91dc-d3258d574020 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:20.107887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b127539-8189-4c6f-91dc-d3258d574020 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:20.113260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737ff6a-4530-43a1-8b5a-f6bf1e50a2fa tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:20.114085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737ff6a-4530-43a1-8b5a-f6bf1e50a2fa tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:20.114793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737ff6a-4530-43a1-8b5a-f6bf1e50a2fa tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:20.115126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737ff6a-4530-43a1-8b5a-f6bf1e50a2fa tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/8f0d963c23c941cc91a984df87d5244f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:20.117577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737ff6a-4530-43a1-8b5a-f6bf1e50a2fa tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8f0d963c23c941cc91a984df87d5244f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:20.118688 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-9737ff6a-4530-43a1-8b5a-f6bf1e50a2fa tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:41:20.118688 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:41:20.118688 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:41:20.119722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737ff6a-4530-43a1-8b5a-f6bf1e50a2fa tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:20.145545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9737ff6a-4530-43a1-8b5a-f6bf1e50a2fa tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8f0d963c23c941cc91a984df87d5244f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:20.146416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9737ff6a-4530-43a1-8b5a-f6bf1e50a2fa tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8f0d963c23c941cc91a984df87d5244f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:20.282330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9737ff6a-4530-43a1-8b5a-f6bf1e50a2fa tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8f0d963c23c941cc91a984df87d5244f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:20.283184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9737ff6a-4530-43a1-8b5a-f6bf1e50a2fa tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8f0d963c23c941cc91a984df87d5244f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:20.286638 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1871/3789] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:41:20 2022] PATCH /identity/v3/domains/8f0d963c23c941cc91a984df87d5244f => generated 276 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:20.291211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f2506-ae2c-4db1-9274-b3d14e9c09d8 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:20.293586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-205f2506-ae2c-4db1-9274-b3d14e9c09d8 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:20.312418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f2506-ae2c-4db1-9274-b3d14e9c09d8 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:20.393915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb33c54-da3c-4733-8ea7-077e3638a6d3 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:20.394509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb33c54-da3c-4733-8ea7-077e3638a6d3 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:20.394793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb33c54-da3c-4733-8ea7-077e3638a6d3 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:20.395068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb33c54-da3c-4733-8ea7-077e3638a6d3 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/8f0d963c23c941cc91a984df87d5244f` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:20.405990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb33c54-da3c-4733-8ea7-077e3638a6d3 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8f0d963c23c941cc91a984df87d5244f)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:20.407022 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-7bb33c54-da3c-4733-8ea7-077e3638a6d3 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:41:20.407022 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:41:20.407022 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:41:20.407964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb33c54-da3c-4733-8ea7-077e3638a6d3 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:20.433232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7bb33c54-da3c-4733-8ea7-077e3638a6d3 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8f0d963c23c941cc91a984df87d5244f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:20.451495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7bb33c54-da3c-4733-8ea7-077e3638a6d3 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8f0d963c23c941cc91a984df87d5244f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:20.542256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:20.593604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7bb33c54-da3c-4733-8ea7-077e3638a6d3 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f0d963c23c941cc91a984df87d5244f', 'request_id': 'req-7bb33c54-da3c-4733-8ea7-077e3638a6d3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:20.605778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7bb33c54-da3c-4733-8ea7-077e3638a6d3 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f0d963c23c941cc91a984df87d5244f', 'request_id': 'req-7bb33c54-da3c-4733-8ea7-077e3638a6d3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:20.612565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7bb33c54-da3c-4733-8ea7-077e3638a6d3 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f0d963c23c941cc91a984df87d5244f', 'request_id': 'req-7bb33c54-da3c-4733-8ea7-077e3638a6d3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:20.693552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7bb33c54-da3c-4733-8ea7-077e3638a6d3 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] The token cache is being invalidate because project 8f0d963c23c941cc91a984df87d5244f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:41:20.693552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7bb33c54-da3c-4733-8ea7-077e3638a6d3 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:20.693552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7bb33c54-da3c-4733-8ea7-077e3638a6d3 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:20.705134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7bb33c54-da3c-4733-8ea7-077e3638a6d3 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8f0d963c23c941cc91a984df87d5244f', 'request_id': 'req-7bb33c54-da3c-4733-8ea7-077e3638a6d3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:20.705850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7bb33c54-da3c-4733-8ea7-077e3638a6d3 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8f0d963c23c941cc91a984df87d5244f', 'request_id': 'req-7bb33c54-da3c-4733-8ea7-077e3638a6d3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:20.706571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7bb33c54-da3c-4733-8ea7-077e3638a6d3 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8f0d963c23c941cc91a984df87d5244f', 'request_id': 'req-7bb33c54-da3c-4733-8ea7-077e3638a6d3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:20.722142 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1919/3790] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:41:20 2022] DELETE /identity/v3/domains/8f0d963c23c941cc91a984df87d5244f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:20.724912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737ff6a-4530-43a1-8b5a-f6bf1e50a2fa tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:20.736155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737ff6a-4530-43a1-8b5a-f6bf1e50a2fa tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:20.808766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74b567-f1bf-45e5-80b4-cf03344df4a7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:20.809416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74b567-f1bf-45e5-80b4-cf03344df4a7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:20.809829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74b567-f1bf-45e5-80b4-cf03344df4a7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:20.809962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74b567-f1bf-45e5-80b4-cf03344df4a7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:20.816182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74b567-f1bf-45e5-80b4-cf03344df4a7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:20.816182 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-dc74b567-f1bf-45e5-80b4-cf03344df4a7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:41:20.816182 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:41:20.816182 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:41:20.816182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74b567-f1bf-45e5-80b4-cf03344df4a7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:20.949293 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1872/3791] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:41:20 2022] POST /identity/v3/domains => generated 277 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:20.953299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb33c54-da3c-4733-8ea7-077e3638a6d3 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:20.954809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7bb33c54-da3c-4733-8ea7-077e3638a6d3 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:20.969569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb33c54-da3c-4733-8ea7-077e3638a6d3 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:21.034102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62609d-8cac-4e1e-874a-c5bdec45d1dd tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:21.034766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62609d-8cac-4e1e-874a-c5bdec45d1dd tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:21.035055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62609d-8cac-4e1e-874a-c5bdec45d1dd tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:21.035492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62609d-8cac-4e1e-874a-c5bdec45d1dd tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/5546a966c7b04118b7413b933e374356/config` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:21.036251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62609d-8cac-4e1e-874a-c5bdec45d1dd tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=5546a966c7b04118b7413b933e374356)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:21.037363 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-2c62609d-8cac-4e1e-874a-c5bdec45d1dd tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:41:21.037363 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:41:21.037363 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:41:21.038268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62609d-8cac-4e1e-874a-c5bdec45d1dd tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:21.146902 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1920/3792] 10.222.0.20 () {60 vars in 1269 bytes} [Thu Oct 27 03:41:20 2022] PUT /identity/v3/domains/5546a966c7b04118b7413b933e374356/config => generated 138 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:41:21.151206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74b567-f1bf-45e5-80b4-cf03344df4a7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:21.161959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74b567-f1bf-45e5-80b4-cf03344df4a7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:21.167439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35e5f1-822f-43a8-a6b2-6f6f45eb2285 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:21.168421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35e5f1-822f-43a8-a6b2-6f6f45eb2285 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:21.168954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35e5f1-822f-43a8-a6b2-6f6f45eb2285 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:21.169242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35e5f1-822f-43a8-a6b2-6f6f45eb2285 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/5546a966c7b04118b7413b933e374356/config/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:21.170280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35e5f1-822f-43a8-a6b2-6f6f45eb2285 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=5546a966c7b04118b7413b933e374356, group=identity)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:21.173708 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-5e35e5f1-822f-43a8-a6b2-6f6f45eb2285 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:41:21.173708 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:41:21.173708 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:41:21.174669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35e5f1-822f-43a8-a6b2-6f6f45eb2285 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:21.312670 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1873/3793] 10.222.0.20 () {60 vars in 1297 bytes} [Thu Oct 27 03:41:21 2022] PATCH /identity/v3/domains/5546a966c7b04118b7413b933e374356/config/identity => generated 176 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:21.322807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62609d-8cac-4e1e-874a-c5bdec45d1dd tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:21.333841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62609d-8cac-4e1e-874a-c5bdec45d1dd tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:21.347825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adf6d2-83ff-4a4c-912c-d920388b8df7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:21.348666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adf6d2-83ff-4a4c-912c-d920388b8df7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:21.349157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adf6d2-83ff-4a4c-912c-d920388b8df7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:21.349598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adf6d2-83ff-4a4c-912c-d920388b8df7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/5546a966c7b04118b7413b933e374356/config/identity/driver` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:21.353291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adf6d2-83ff-4a4c-912c-d920388b8df7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=5546a966c7b04118b7413b933e374356, group=identity, option=driver)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:21.355107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adf6d2-83ff-4a4c-912c-d920388b8df7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:21.485759 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1921/3794] 10.222.0.20 () {60 vars in 1318 bytes} [Thu Oct 27 03:41:21 2022] PATCH /identity/v3/domains/5546a966c7b04118b7413b933e374356/config/identity/driver => generated 176 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:21.489713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35e5f1-822f-43a8-a6b2-6f6f45eb2285 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:21.501120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35e5f1-822f-43a8-a6b2-6f6f45eb2285 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:21.509779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035bbe4-6802-475e-b04c-5cf5ce5105ff tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:21.512729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035bbe4-6802-475e-b04c-5cf5ce5105ff tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:21.512729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035bbe4-6802-475e-b04c-5cf5ce5105ff tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:21.512729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035bbe4-6802-475e-b04c-5cf5ce5105ff tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/5546a966c7b04118b7413b933e374356/config/identity/driver` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:21.512729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035bbe4-6802-475e-b04c-5cf5ce5105ff tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=5546a966c7b04118b7413b933e374356, group=identity, option=driver)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:21.513732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035bbe4-6802-475e-b04c-5cf5ce5105ff tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:21.572541 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1874/3795] 10.222.0.20 () {58 vars in 1299 bytes} [Thu Oct 27 03:41:21 2022] DELETE /identity/v3/domains/5546a966c7b04118b7413b933e374356/config/identity/driver => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:21.576745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adf6d2-83ff-4a4c-912c-d920388b8df7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:21.587828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adf6d2-83ff-4a4c-912c-d920388b8df7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:21.594696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a37c1c-d5f5-4078-a280-e97552a5f110 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:21.596102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a37c1c-d5f5-4078-a280-e97552a5f110 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:21.596760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a37c1c-d5f5-4078-a280-e97552a5f110 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:21.597272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a37c1c-d5f5-4078-a280-e97552a5f110 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/5546a966c7b04118b7413b933e374356/config/identity/driver` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:21.598981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a37c1c-d5f5-4078-a280-e97552a5f110 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=5546a966c7b04118b7413b933e374356, group=identity, option=driver)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:21.601417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a37c1c-d5f5-4078-a280-e97552a5f110 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:21.612685 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-10a37c1c-d5f5-4078-a280-e97552a5f110 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Could not find option driver in group identity in domain configuration for domain 5546a966c7b04118b7413b933e374356.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 5546a966c7b04118b7413b933e374356. Oct 27 03:41:21.612685 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:41:21.612685 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:41:21.612685 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:41:21.612685 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:41:21.612685 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:41:21.612685 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:41:21.612685 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:41:21.612685 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:41:21.612685 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:41:21.612685 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:41:21.612685 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:41:21.612685 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 27 03:41:21.613505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 27 03:41:21.613505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 27 03:41:21.613505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 27 03:41:21.613505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:41:21.613505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:41:21.613505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 27 03:41:21.613505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 27 03:41:21.613505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 5546a966c7b04118b7413b933e374356. Oct 27 03:41:21.613505 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:41:21.615925 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1922/3796] 10.222.0.20 () {58 vars in 1296 bytes} [Thu Oct 27 03:41:21 2022] GET /identity/v3/domains/5546a966c7b04118b7413b933e374356/config/identity/driver => generated 171 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 27 03:41:21.621027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035bbe4-6802-475e-b04c-5cf5ce5105ff tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:21.632222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035bbe4-6802-475e-b04c-5cf5ce5105ff tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:21.645354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351861e-c053-4beb-aec1-bc424148b7af tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:21.647196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351861e-c053-4beb-aec1-bc424148b7af tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:21.647575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351861e-c053-4beb-aec1-bc424148b7af tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:21.647937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351861e-c053-4beb-aec1-bc424148b7af tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/5546a966c7b04118b7413b933e374356/config/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:21.649519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351861e-c053-4beb-aec1-bc424148b7af tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=5546a966c7b04118b7413b933e374356, group=identity)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:21.651644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351861e-c053-4beb-aec1-bc424148b7af tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:21.780319 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1875/3797] 10.222.0.20 () {58 vars in 1278 bytes} [Thu Oct 27 03:41:21 2022] DELETE /identity/v3/domains/5546a966c7b04118b7413b933e374356/config/identity => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:21.781380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a37c1c-d5f5-4078-a280-e97552a5f110 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:21.801798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a37c1c-d5f5-4078-a280-e97552a5f110 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:21.815284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9e32f-d15b-4d6b-a381-91c0cb98a9ea tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:21.816013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9e32f-d15b-4d6b-a381-91c0cb98a9ea tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:21.816306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9e32f-d15b-4d6b-a381-91c0cb98a9ea tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:21.816589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9e32f-d15b-4d6b-a381-91c0cb98a9ea tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/5546a966c7b04118b7413b933e374356/config/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:21.817922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9e32f-d15b-4d6b-a381-91c0cb98a9ea tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=5546a966c7b04118b7413b933e374356, group=identity)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:21.819602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9e32f-d15b-4d6b-a381-91c0cb98a9ea tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:21.845907 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-d4a9e32f-d15b-4d6b-a381-91c0cb98a9ea tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Could not find group identity in domain configuration for domain 5546a966c7b04118b7413b933e374356.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 5546a966c7b04118b7413b933e374356. Oct 27 03:41:21.845907 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:41:21.845907 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:41:21.845907 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:41:21.845907 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:41:21.845907 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:41:21.845907 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:41:21.845907 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:41:21.845907 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:41:21.845907 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:41:21.845907 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:41:21.845907 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:41:21.845907 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 27 03:41:21.846808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 27 03:41:21.846808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 27 03:41:21.846808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 27 03:41:21.846808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:41:21.846808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:41:21.846808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 27 03:41:21.846808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 27 03:41:21.846808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 5546a966c7b04118b7413b933e374356. Oct 27 03:41:21.846808 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:41:21.851503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351861e-c053-4beb-aec1-bc424148b7af tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:21.851932 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1923/3798] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 03:41:21 2022] GET /identity/v3/domains/5546a966c7b04118b7413b933e374356/config/identity => generated 154 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:41:21.862022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351861e-c053-4beb-aec1-bc424148b7af tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:21.864525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:21.892812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19d9ef-9a71-4c52-bed8-29a76dc2664f tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:21.895233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19d9ef-9a71-4c52-bed8-29a76dc2664f tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:21.895700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19d9ef-9a71-4c52-bed8-29a76dc2664f tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:21.896145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19d9ef-9a71-4c52-bed8-29a76dc2664f tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/5546a966c7b04118b7413b933e374356/config` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:21.903780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19d9ef-9a71-4c52-bed8-29a76dc2664f tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=5546a966c7b04118b7413b933e374356)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:21.903780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19d9ef-9a71-4c52-bed8-29a76dc2664f tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:21.992903 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1876/3799] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:41:21 2022] DELETE /identity/v3/domains/5546a966c7b04118b7413b933e374356/config => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:21.997086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9e32f-d15b-4d6b-a381-91c0cb98a9ea tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:22.007976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9e32f-d15b-4d6b-a381-91c0cb98a9ea tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:22.013404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d792fa-4156-4436-9e4c-b4a3692b5dbb tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:22.014299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d792fa-4156-4436-9e4c-b4a3692b5dbb tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:22.014680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d792fa-4156-4436-9e4c-b4a3692b5dbb tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:22.014971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d792fa-4156-4436-9e4c-b4a3692b5dbb tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/5546a966c7b04118b7413b933e374356` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:22.016275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d792fa-4156-4436-9e4c-b4a3692b5dbb tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5546a966c7b04118b7413b933e374356)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:22.017996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d792fa-4156-4436-9e4c-b4a3692b5dbb tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:22.046862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e9d792fa-4156-4436-9e4c-b4a3692b5dbb tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5546a966c7b04118b7413b933e374356'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:22.048496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e9d792fa-4156-4436-9e4c-b4a3692b5dbb tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5546a966c7b04118b7413b933e374356'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:22.178074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e9d792fa-4156-4436-9e4c-b4a3692b5dbb tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5546a966c7b04118b7413b933e374356'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:22.179249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e9d792fa-4156-4436-9e4c-b4a3692b5dbb tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5546a966c7b04118b7413b933e374356'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:22.193611 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1924/3800] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:41:21 2022] PATCH /identity/v3/domains/5546a966c7b04118b7413b933e374356 => generated 278 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:22.196329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19d9ef-9a71-4c52-bed8-29a76dc2664f tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:22.198557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8f19d9ef-9a71-4c52-bed8-29a76dc2664f tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:22.214585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19d9ef-9a71-4c52-bed8-29a76dc2664f tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:22.306858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c0016-bf70-4216-9400-523339c6fb66 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:22.307637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c0016-bf70-4216-9400-523339c6fb66 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:22.308296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c0016-bf70-4216-9400-523339c6fb66 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:22.308653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c0016-bf70-4216-9400-523339c6fb66 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/5546a966c7b04118b7413b933e374356` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:22.326508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c0016-bf70-4216-9400-523339c6fb66 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5546a966c7b04118b7413b933e374356)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:22.330546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c0016-bf70-4216-9400-523339c6fb66 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:22.344579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d792fa-4156-4436-9e4c-b4a3692b5dbb tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:22.346143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e9d792fa-4156-4436-9e4c-b4a3692b5dbb tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:22.368619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e60c0016-bf70-4216-9400-523339c6fb66 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5546a966c7b04118b7413b933e374356'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:22.380312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e60c0016-bf70-4216-9400-523339c6fb66 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5546a966c7b04118b7413b933e374356'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:22.456191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d792fa-4156-4436-9e4c-b4a3692b5dbb tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:22.461053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f5e63-0598-4ad3-98d9-3794ccb36349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:22.461683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f5e63-0598-4ad3-98d9-3794ccb36349 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:22.461967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f5e63-0598-4ad3-98d9-3794ccb36349 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:22.462276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f5e63-0598-4ad3-98d9-3794ccb36349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:22.464041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a31f5e63-0598-4ad3-98d9-3794ccb36349 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:22.535552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f5e63-0598-4ad3-98d9-3794ccb36349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:22.537127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f5e63-0598-4ad3-98d9-3794ccb36349 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:22.544796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e60c0016-bf70-4216-9400-523339c6fb66 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5546a966c7b04118b7413b933e374356', 'request_id': 'req-e60c0016-bf70-4216-9400-523339c6fb66'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:22.549894 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1925/3801] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:41:22.550972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f5e63-0598-4ad3-98d9-3794ccb36349 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:22.552349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a31f5e63-0598-4ad3-98d9-3794ccb36349 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:22.644154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e60c0016-bf70-4216-9400-523339c6fb66 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5546a966c7b04118b7413b933e374356', 'request_id': 'req-e60c0016-bf70-4216-9400-523339c6fb66'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:22.648723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f5e63-0598-4ad3-98d9-3794ccb36349 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:22.655387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e60c0016-bf70-4216-9400-523339c6fb66 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5546a966c7b04118b7413b933e374356', 'request_id': 'req-e60c0016-bf70-4216-9400-523339c6fb66'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:22.670919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e60c0016-bf70-4216-9400-523339c6fb66 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] The token cache is being invalidate because project 5546a966c7b04118b7413b933e374356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:41:22.672391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e60c0016-bf70-4216-9400-523339c6fb66 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:22.673868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e60c0016-bf70-4216-9400-523339c6fb66 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:22.684625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e60c0016-bf70-4216-9400-523339c6fb66 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5546a966c7b04118b7413b933e374356', 'request_id': 'req-e60c0016-bf70-4216-9400-523339c6fb66'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:22.685671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e60c0016-bf70-4216-9400-523339c6fb66 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5546a966c7b04118b7413b933e374356', 'request_id': 'req-e60c0016-bf70-4216-9400-523339c6fb66'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:22.686359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e60c0016-bf70-4216-9400-523339c6fb66 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5546a966c7b04118b7413b933e374356', 'request_id': 'req-e60c0016-bf70-4216-9400-523339c6fb66'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:22.718342 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1877/3802] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:41:22 2022] DELETE /identity/v3/domains/5546a966c7b04118b7413b933e374356 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:22.723692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c0016-bf70-4216-9400-523339c6fb66 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:22.725178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e60c0016-bf70-4216-9400-523339c6fb66 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:22.753651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cba8e-38d2-48ee-bc10-bd04d9fadb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:22.763797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cba8e-38d2-48ee-bc10-bd04d9fadb7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:22.763797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cba8e-38d2-48ee-bc10-bd04d9fadb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:22.763797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cba8e-38d2-48ee-bc10-bd04d9fadb7f admin admin] PATH_INFO: `/v3/users/6bc4279c64ba4b52aefd967ce73f9530` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:22.763797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cba8e-38d2-48ee-bc10-bd04d9fadb7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bc4279c64ba4b52aefd967ce73f9530)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:22.763797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cba8e-38d2-48ee-bc10-bd04d9fadb7f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:22.808179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c0016-bf70-4216-9400-523339c6fb66 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:22.813731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a2506-0e84-421b-841a-ff65d7750df4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:22.814464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a2506-0e84-421b-841a-ff65d7750df4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:22.814799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a2506-0e84-421b-841a-ff65d7750df4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:22.815228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a2506-0e84-421b-841a-ff65d7750df4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:22.816026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a2506-0e84-421b-841a-ff65d7750df4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:22.817046 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-871a2506-0e84-421b-841a-ff65d7750df4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:41:22.817046 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:41:22.817046 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:41:22.817971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a2506-0e84-421b-841a-ff65d7750df4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:22.832321 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1878/3803] 10.222.0.20 () {58 vars in 1173 bytes} [Thu Oct 27 03:41:22 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:41:22.835330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a2506-0e84-421b-841a-ff65d7750df4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:22.860063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a2506-0e84-421b-841a-ff65d7750df4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:22.868505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54241f-abf3-4204-bb04-f59bd62eaa85 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:22.869235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54241f-abf3-4204-bb04-f59bd62eaa85 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:22.869593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54241f-abf3-4204-bb04-f59bd62eaa85 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:22.869944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54241f-abf3-4204-bb04-f59bd62eaa85 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:22.870673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54241f-abf3-4204-bb04-f59bd62eaa85 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:22.872361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54241f-abf3-4204-bb04-f59bd62eaa85 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:22.873707 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1879/3804] 10.222.0.20 () {58 vars in 1200 bytes} [Thu Oct 27 03:41:22 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 27 03:41:22.877905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54241f-abf3-4204-bb04-f59bd62eaa85 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:22.893096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54241f-abf3-4204-bb04-f59bd62eaa85 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:22.898874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf117bb-694f-4d21-a385-1522fe9bbdde tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:22.899894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf117bb-694f-4d21-a385-1522fe9bbdde tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:22.900501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf117bb-694f-4d21-a385-1522fe9bbdde tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:22.901256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf117bb-694f-4d21-a385-1522fe9bbdde tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:22.901495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf117bb-694f-4d21-a385-1522fe9bbdde tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:22.903367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf117bb-694f-4d21-a385-1522fe9bbdde tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:22.904814 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1880/3805] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 03:41:22 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:22.910403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf117bb-694f-4d21-a385-1522fe9bbdde tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:22.933135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf117bb-694f-4d21-a385-1522fe9bbdde tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:22.944302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c509b33-280d-49ae-9d68-d23f4e3ab6a9 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:22.945314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c509b33-280d-49ae-9d68-d23f4e3ab6a9 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:22.945748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c509b33-280d-49ae-9d68-d23f4e3ab6a9 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:22.949312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c509b33-280d-49ae-9d68-d23f4e3ab6a9 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:22.949312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c509b33-280d-49ae-9d68-d23f4e3ab6a9 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:22.949312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c509b33-280d-49ae-9d68-d23f4e3ab6a9 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:22.954742 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1881/3806] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:41:22 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:22.955883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c509b33-280d-49ae-9d68-d23f4e3ab6a9 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:22.973159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c509b33-280d-49ae-9d68-d23f4e3ab6a9 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:22.991353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a178ce2-d303-4cd2-9731-1e5e296aafa7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:22.992949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a73cba8e-38d2-48ee-bc10-bd04d9fadb7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bc4279c64ba4b52aefd967ce73f9530'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:22.994158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a178ce2-d303-4cd2-9731-1e5e296aafa7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:22.994621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a73cba8e-38d2-48ee-bc10-bd04d9fadb7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bc4279c64ba4b52aefd967ce73f9530'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:22.995048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a178ce2-d303-4cd2-9731-1e5e296aafa7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:22.996296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a178ce2-d303-4cd2-9731-1e5e296aafa7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:22.997464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a178ce2-d303-4cd2-9731-1e5e296aafa7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:22.999361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a178ce2-d303-4cd2-9731-1e5e296aafa7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.004200 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1882/3807] 10.222.0.20 () {58 vars in 1188 bytes} [Thu Oct 27 03:41:22 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:41:23.011543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a178ce2-d303-4cd2-9731-1e5e296aafa7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.015021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a73cba8e-38d2-48ee-bc10-bd04d9fadb7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bc4279c64ba4b52aefd967ce73f9530'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:23.015909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7a178ce2-d303-4cd2-9731-1e5e296aafa7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:23.044817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a73cba8e-38d2-48ee-bc10-bd04d9fadb7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bc4279c64ba4b52aefd967ce73f9530'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:23.046298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a178ce2-d303-4cd2-9731-1e5e296aafa7 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.047877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a73cba8e-38d2-48ee-bc10-bd04d9fadb7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bc4279c64ba4b52aefd967ce73f9530'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:23.058683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371b171-d074-4b8d-9183-61dac506a5c9 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.059579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371b171-d074-4b8d-9183-61dac506a5c9 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.060193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371b171-d074-4b8d-9183-61dac506a5c9 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.065958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371b171-d074-4b8d-9183-61dac506a5c9 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.065958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371b171-d074-4b8d-9183-61dac506a5c9 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.065958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371b171-d074-4b8d-9183-61dac506a5c9 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.065958 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1883/3808] 10.222.0.20 () {58 vars in 1200 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:23.068855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371b171-d074-4b8d-9183-61dac506a5c9 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.080743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371b171-d074-4b8d-9183-61dac506a5c9 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.088670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc0a37-068d-4e6d-aedf-4983078ba76f tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.089401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc0a37-068d-4e6d-aedf-4983078ba76f tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.089790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc0a37-068d-4e6d-aedf-4983078ba76f tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.090154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc0a37-068d-4e6d-aedf-4983078ba76f tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.090757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc0a37-068d-4e6d-aedf-4983078ba76f tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.094605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc0a37-068d-4e6d-aedf-4983078ba76f tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.099094 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1884/3809] 10.222.0.20 () {58 vars in 1203 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 27 03:41:23.100690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc0a37-068d-4e6d-aedf-4983078ba76f tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.115878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc0a37-068d-4e6d-aedf-4983078ba76f tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.121867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24806c48-3e2a-4207-b65a-5019056ecc90 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.122642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24806c48-3e2a-4207-b65a-5019056ecc90 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.123259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24806c48-3e2a-4207-b65a-5019056ecc90 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.123631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24806c48-3e2a-4207-b65a-5019056ecc90 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.124116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24806c48-3e2a-4207-b65a-5019056ecc90 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.126987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24806c48-3e2a-4207-b65a-5019056ecc90 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.128279 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1885/3810] 10.222.0.20 () {58 vars in 1209 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:23.132735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24806c48-3e2a-4207-b65a-5019056ecc90 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.153911 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1926/3811] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:41:22 2022] DELETE /identity/v3/users/6bc4279c64ba4b52aefd967ce73f9530 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:23.156261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a2c7a-81cd-40d3-8ee4-2cd9825ac8cd None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.156603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a2c7a-81cd-40d3-8ee4-2cd9825ac8cd None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.157803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a2c7a-81cd-40d3-8ee4-2cd9825ac8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.166939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24806c48-3e2a-4207-b65a-5019056ecc90 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.204493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1e1a2c7a-81cd-40d3-8ee4-2cd9825ac8cd None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:23.205883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1e1a2c7a-81cd-40d3-8ee4-2cd9825ac8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:23.266721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487df04a-2e7c-4077-95de-60e7b9cb309b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.268196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487df04a-2e7c-4077-95de-60e7b9cb309b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.268700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487df04a-2e7c-4077-95de-60e7b9cb309b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.269404 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487df04a-2e7c-4077-95de-60e7b9cb309b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.270192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487df04a-2e7c-4077-95de-60e7b9cb309b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.272252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487df04a-2e7c-4077-95de-60e7b9cb309b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.274779 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1886/3812] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:23.278450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487df04a-2e7c-4077-95de-60e7b9cb309b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.280505 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1927/3813] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:23.290574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a2c7a-81cd-40d3-8ee4-2cd9825ac8cd None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.291732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487df04a-2e7c-4077-95de-60e7b9cb309b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.291953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1e1a2c7a-81cd-40d3-8ee4-2cd9825ac8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:23.298092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa8271-1e3f-4f1f-8818-ee862ab82f01 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.299561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa8271-1e3f-4f1f-8818-ee862ab82f01 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.300371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa8271-1e3f-4f1f-8818-ee862ab82f01 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.300831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa8271-1e3f-4f1f-8818-ee862ab82f01 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.301660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa8271-1e3f-4f1f-8818-ee862ab82f01 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.303526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa8271-1e3f-4f1f-8818-ee862ab82f01 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.305983 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1887/3814] 10.222.0.20 () {58 vars in 1218 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:23.309695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa8271-1e3f-4f1f-8818-ee862ab82f01 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.335400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa8271-1e3f-4f1f-8818-ee862ab82f01 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.342336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656213c4-d35f-4f86-9fb6-bcff15a4366e tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.345015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:23.345132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656213c4-d35f-4f86-9fb6-bcff15a4366e tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.345873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656213c4-d35f-4f86-9fb6-bcff15a4366e tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.346133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656213c4-d35f-4f86-9fb6-bcff15a4366e tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.346710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656213c4-d35f-4f86-9fb6-bcff15a4366e tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.365840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656213c4-d35f-4f86-9fb6-bcff15a4366e tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.365840 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1888/3815] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:23.365840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656213c4-d35f-4f86-9fb6-bcff15a4366e tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.365840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656213c4-d35f-4f86-9fb6-bcff15a4366e tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.367778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a2c7a-81cd-40d3-8ee4-2cd9825ac8cd None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.370469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a896b10-babb-4f80-b686-cee12e6c8927 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.371096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a896b10-babb-4f80-b686-cee12e6c8927 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.371355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a896b10-babb-4f80-b686-cee12e6c8927 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.372210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a896b10-babb-4f80-b686-cee12e6c8927 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.372334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4682c4-16dd-4ee1-8587-1789c39761cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.372425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a896b10-babb-4f80-b686-cee12e6c8927 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.372499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4682c4-16dd-4ee1-8587-1789c39761cd service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.372688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4682c4-16dd-4ee1-8587-1789c39761cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.372890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4682c4-16dd-4ee1-8587-1789c39761cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.373809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a896b10-babb-4f80-b686-cee12e6c8927 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.374987 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1889/3816] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 27 03:41:23.378937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a896b10-babb-4f80-b686-cee12e6c8927 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.386157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4682c4-16dd-4ee1-8587-1789c39761cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.387777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4682c4-16dd-4ee1-8587-1789c39761cd service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.391262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a896b10-babb-4f80-b686-cee12e6c8927 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.398006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51303682-a688-4b4f-b6e5-fdd72e9dcd4a tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.398698 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1928/3817] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:41:23.398826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51303682-a688-4b4f-b6e5-fdd72e9dcd4a tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.411269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51303682-a688-4b4f-b6e5-fdd72e9dcd4a tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.411269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51303682-a688-4b4f-b6e5-fdd72e9dcd4a tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.411269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51303682-a688-4b4f-b6e5-fdd72e9dcd4a tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.411269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51303682-a688-4b4f-b6e5-fdd72e9dcd4a tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.411269 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1890/3818] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:23.412586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4682c4-16dd-4ee1-8587-1789c39761cd service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.452864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4682c4-16dd-4ee1-8587-1789c39761cd service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.460142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31622a16-a691-4422-bf26-688c278b3a03 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.461358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31622a16-a691-4422-bf26-688c278b3a03 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.461659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31622a16-a691-4422-bf26-688c278b3a03 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.461952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31622a16-a691-4422-bf26-688c278b3a03 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.462791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31622a16-a691-4422-bf26-688c278b3a03 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.463893 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-31622a16-a691-4422-bf26-688c278b3a03 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:41:23.463893 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:41:23.463893 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:41:23.464866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31622a16-a691-4422-bf26-688c278b3a03 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.469140 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1929/3819] 10.222.0.20 () {58 vars in 1227 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 27 03:41:23.470380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51303682-a688-4b4f-b6e5-fdd72e9dcd4a tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.483059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51303682-a688-4b4f-b6e5-fdd72e9dcd4a tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.489134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d21e95-eee5-4416-b035-57632f3e7c09 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.489563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d21e95-eee5-4416-b035-57632f3e7c09 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.489852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d21e95-eee5-4416-b035-57632f3e7c09 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.490285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d21e95-eee5-4416-b035-57632f3e7c09 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.490800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d21e95-eee5-4416-b035-57632f3e7c09 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.493347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d21e95-eee5-4416-b035-57632f3e7c09 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.497712 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1891/3820] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:23.499632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31622a16-a691-4422-bf26-688c278b3a03 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.518190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31622a16-a691-4422-bf26-688c278b3a03 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.526356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bcb79-eadc-425d-8c88-9b4a9be1463c tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.527249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bcb79-eadc-425d-8c88-9b4a9be1463c tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.527767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bcb79-eadc-425d-8c88-9b4a9be1463c tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.528749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bcb79-eadc-425d-8c88-9b4a9be1463c tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.529449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97bcb79-eadc-425d-8c88-9b4a9be1463c tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.532134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97bcb79-eadc-425d-8c88-9b4a9be1463c tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.535577 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1930/3821] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:23.539589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d21e95-eee5-4416-b035-57632f3e7c09 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.552984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d21e95-eee5-4416-b035-57632f3e7c09 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.557583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f82b5-13c7-4f1f-b9b4-fcf3a49909e4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.558568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f82b5-13c7-4f1f-b9b4-fcf3a49909e4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.558860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f82b5-13c7-4f1f-b9b4-fcf3a49909e4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.559188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f82b5-13c7-4f1f-b9b4-fcf3a49909e4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.559792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f82b5-13c7-4f1f-b9b4-fcf3a49909e4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.561721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f82b5-13c7-4f1f-b9b4-fcf3a49909e4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.565953 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1892/3822] 10.222.0.20 () {58 vars in 1242 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:23.567227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bcb79-eadc-425d-8c88-9b4a9be1463c tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.578846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bcb79-eadc-425d-8c88-9b4a9be1463c tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.583750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b29c0f-a730-4dfa-bf1a-c7cf49c21737 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.584592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b29c0f-a730-4dfa-bf1a-c7cf49c21737 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.584881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b29c0f-a730-4dfa-bf1a-c7cf49c21737 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.585160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b29c0f-a730-4dfa-bf1a-c7cf49c21737 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.586481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b29c0f-a730-4dfa-bf1a-c7cf49c21737 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.588088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b29c0f-a730-4dfa-bf1a-c7cf49c21737 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.589300 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1931/3823] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:23.593558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f82b5-13c7-4f1f-b9b4-fcf3a49909e4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.604553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f82b5-13c7-4f1f-b9b4-fcf3a49909e4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.609316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b710a8-a04c-4e1f-b593-df30929016ae tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.610244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b710a8-a04c-4e1f-b593-df30929016ae tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.610352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b710a8-a04c-4e1f-b593-df30929016ae tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.610609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b710a8-a04c-4e1f-b593-df30929016ae tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.611221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b710a8-a04c-4e1f-b593-df30929016ae tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.613059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b710a8-a04c-4e1f-b593-df30929016ae tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.613964 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1893/3824] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 27 03:41:23.618412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b29c0f-a730-4dfa-bf1a-c7cf49c21737 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.629836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b29c0f-a730-4dfa-bf1a-c7cf49c21737 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.636207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705746e-2f4e-4244-9e34-5ad56165aead tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.637100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705746e-2f4e-4244-9e34-5ad56165aead tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.637538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705746e-2f4e-4244-9e34-5ad56165aead tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.638646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705746e-2f4e-4244-9e34-5ad56165aead tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.639086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705746e-2f4e-4244-9e34-5ad56165aead tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.640754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705746e-2f4e-4244-9e34-5ad56165aead tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.646412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b710a8-a04c-4e1f-b593-df30929016ae tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.646646 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1932/3825] 10.222.0.20 () {58 vars in 1269 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:23.673755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b710a8-a04c-4e1f-b593-df30929016ae tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.685240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e350ed-4aaa-481a-ba7b-ec919f1f49f2 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.686400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e350ed-4aaa-481a-ba7b-ec919f1f49f2 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.687223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e350ed-4aaa-481a-ba7b-ec919f1f49f2 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.687876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e350ed-4aaa-481a-ba7b-ec919f1f49f2 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.688766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e350ed-4aaa-481a-ba7b-ec919f1f49f2 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.690802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e350ed-4aaa-481a-ba7b-ec919f1f49f2 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.697087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705746e-2f4e-4244-9e34-5ad56165aead tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.701870 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1894/3826] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:23.712070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705746e-2f4e-4244-9e34-5ad56165aead tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.717631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72fed8-2782-4a8b-b829-a3a1c6ad8278 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.718446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72fed8-2782-4a8b-b829-a3a1c6ad8278 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.718970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72fed8-2782-4a8b-b829-a3a1c6ad8278 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.719317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72fed8-2782-4a8b-b829-a3a1c6ad8278 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.719992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72fed8-2782-4a8b-b829-a3a1c6ad8278 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.721672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72fed8-2782-4a8b-b829-a3a1c6ad8278 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.723245 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1933/3827] 10.222.0.20 () {58 vars in 1257 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:23.729511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e350ed-4aaa-481a-ba7b-ec919f1f49f2 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.744612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e350ed-4aaa-481a-ba7b-ec919f1f49f2 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.750724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c7ad2-fc74-489b-9454-92ddfd11ed92 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.756349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c7ad2-fc74-489b-9454-92ddfd11ed92 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.756349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c7ad2-fc74-489b-9454-92ddfd11ed92 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.756349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c7ad2-fc74-489b-9454-92ddfd11ed92 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.756349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c7ad2-fc74-489b-9454-92ddfd11ed92 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.756819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c7ad2-fc74-489b-9454-92ddfd11ed92 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.761876 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1895/3828] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:23.763559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72fed8-2782-4a8b-b829-a3a1c6ad8278 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.780460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87,keystone:DELETE=8,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:23.789192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72fed8-2782-4a8b-b829-a3a1c6ad8278 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.796111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affddb01-a6e7-42a5-abab-fa26f898d3f0 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.797354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affddb01-a6e7-42a5-abab-fa26f898d3f0 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.797952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affddb01-a6e7-42a5-abab-fa26f898d3f0 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.798570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affddb01-a6e7-42a5-abab-fa26f898d3f0 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.799493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affddb01-a6e7-42a5-abab-fa26f898d3f0 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.801299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affddb01-a6e7-42a5-abab-fa26f898d3f0 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.806780 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1934/3829] 10.222.0.20 () {58 vars in 1242 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:23.808158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c7ad2-fc74-489b-9454-92ddfd11ed92 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.820774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c7ad2-fc74-489b-9454-92ddfd11ed92 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.826590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44a57a-856e-4184-9d3f-1748cd008f73 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.827583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44a57a-856e-4184-9d3f-1748cd008f73 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.828052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44a57a-856e-4184-9d3f-1748cd008f73 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.828731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44a57a-856e-4184-9d3f-1748cd008f73 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.829630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44a57a-856e-4184-9d3f-1748cd008f73 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.831559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44a57a-856e-4184-9d3f-1748cd008f73 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.837394 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1896/3830] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:23.838383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affddb01-a6e7-42a5-abab-fa26f898d3f0 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.850327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affddb01-a6e7-42a5-abab-fa26f898d3f0 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.856063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e185d6f-9bc3-4e07-a7dc-da2c510aeeab tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.856926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e185d6f-9bc3-4e07-a7dc-da2c510aeeab tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.857218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e185d6f-9bc3-4e07-a7dc-da2c510aeeab tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.857498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e185d6f-9bc3-4e07-a7dc-da2c510aeeab tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.858297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e185d6f-9bc3-4e07-a7dc-da2c510aeeab tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.859958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e185d6f-9bc3-4e07-a7dc-da2c510aeeab tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.861362 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1935/3831] 10.222.0.20 () {58 vars in 1254 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:23.865583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44a57a-856e-4184-9d3f-1748cd008f73 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.892992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44a57a-856e-4184-9d3f-1748cd008f73 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.904844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e01549-a1cb-416f-ba57-47fa5fd3b819 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.906302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e01549-a1cb-416f-ba57-47fa5fd3b819 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.906850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e01549-a1cb-416f-ba57-47fa5fd3b819 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.907280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e01549-a1cb-416f-ba57-47fa5fd3b819 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.908555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e01549-a1cb-416f-ba57-47fa5fd3b819 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.911747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e01549-a1cb-416f-ba57-47fa5fd3b819 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.918452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e185d6f-9bc3-4e07-a7dc-da2c510aeeab tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.925245 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1897/3832] 10.222.0.20 () {58 vars in 1290 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:23.931483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e185d6f-9bc3-4e07-a7dc-da2c510aeeab tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.937288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889160c4-2888-466f-851c-74c4010c9e4b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.938235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889160c4-2888-466f-851c-74c4010c9e4b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.939096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889160c4-2888-466f-851c-74c4010c9e4b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.939096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889160c4-2888-466f-851c-74c4010c9e4b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.939441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889160c4-2888-466f-851c-74c4010c9e4b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.941119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889160c4-2888-466f-851c-74c4010c9e4b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.942542 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1936/3833] 10.222.0.20 () {58 vars in 1257 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:23.947219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e01549-a1cb-416f-ba57-47fa5fd3b819 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.960056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e01549-a1cb-416f-ba57-47fa5fd3b819 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:23.971292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496b7a2-6de6-48fb-ad69-3d1af4b33789 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:23.971292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496b7a2-6de6-48fb-ad69-3d1af4b33789 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:23.971292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496b7a2-6de6-48fb-ad69-3d1af4b33789 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:23.971597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496b7a2-6de6-48fb-ad69-3d1af4b33789 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:23.971597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496b7a2-6de6-48fb-ad69-3d1af4b33789 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:23.971597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496b7a2-6de6-48fb-ad69-3d1af4b33789 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:23.974204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889160c4-2888-466f-851c-74c4010c9e4b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:23.976240 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1898/3834] 10.222.0.20 () {58 vars in 1266 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:23.977073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-889160c4-2888-466f-851c-74c4010c9e4b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:23.977390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496b7a2-6de6-48fb-ad69-3d1af4b33789 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.002502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889160c4-2888-466f-851c-74c4010c9e4b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.006903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496b7a2-6de6-48fb-ad69-3d1af4b33789 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.014047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02bbd7-0a30-49aa-9332-6730a59bd7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.014047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02bbd7-0a30-49aa-9332-6730a59bd7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.014047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02bbd7-0a30-49aa-9332-6730a59bd7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.014047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02bbd7-0a30-49aa-9332-6730a59bd7b9 admin admin] PATH_INFO: `/v3/projects/f139e1ec9338495c94d9df2cc3652247` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.014380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02bbd7-0a30-49aa-9332-6730a59bd7b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f139e1ec9338495c94d9df2cc3652247)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.014380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02bbd7-0a30-49aa-9332-6730a59bd7b9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.014877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0778aee-c340-43bb-a93b-8cf130e3f75d tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.016116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0778aee-c340-43bb-a93b-8cf130e3f75d tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.016500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0778aee-c340-43bb-a93b-8cf130e3f75d tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.016875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0778aee-c340-43bb-a93b-8cf130e3f75d tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.017641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0778aee-c340-43bb-a93b-8cf130e3f75d tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.019546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0778aee-c340-43bb-a93b-8cf130e3f75d tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.020972 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1899/3835] 10.222.0.20 () {58 vars in 1308 bytes} [Thu Oct 27 03:41:23 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:24.026193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0778aee-c340-43bb-a93b-8cf130e3f75d tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.039660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0778aee-c340-43bb-a93b-8cf130e3f75d tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.045215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa60163-9e37-47c9-94eb-b8f38db22501 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.046074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa60163-9e37-47c9-94eb-b8f38db22501 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.046481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa60163-9e37-47c9-94eb-b8f38db22501 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.046863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa60163-9e37-47c9-94eb-b8f38db22501 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.047565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa60163-9e37-47c9-94eb-b8f38db22501 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.050689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa60163-9e37-47c9-94eb-b8f38db22501 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.052002 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1900/3836] 10.222.0.20 () {58 vars in 1290 bytes} [Thu Oct 27 03:41:24 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:24.057639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa60163-9e37-47c9-94eb-b8f38db22501 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.068491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa60163-9e37-47c9-94eb-b8f38db22501 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.076036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e6637-fa37-4edf-b2b6-1a326d870851 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.076995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e6637-fa37-4edf-b2b6-1a326d870851 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.077500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e6637-fa37-4edf-b2b6-1a326d870851 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.077994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e6637-fa37-4edf-b2b6-1a326d870851 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.078904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e6637-fa37-4edf-b2b6-1a326d870851 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.080896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e6637-fa37-4edf-b2b6-1a326d870851 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.082191 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1901/3837] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:41:24 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 27 03:41:24.086989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e6637-fa37-4edf-b2b6-1a326d870851 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.097924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e6637-fa37-4edf-b2b6-1a326d870851 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.102923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254112d-cab8-4518-882b-aff82f427082 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.103563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254112d-cab8-4518-882b-aff82f427082 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.103956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254112d-cab8-4518-882b-aff82f427082 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.104240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254112d-cab8-4518-882b-aff82f427082 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.104936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254112d-cab8-4518-882b-aff82f427082 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.106554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254112d-cab8-4518-882b-aff82f427082 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.107713 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1902/3838] 10.222.0.20 () {58 vars in 1227 bytes} [Thu Oct 27 03:41:24 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:24.111218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254112d-cab8-4518-882b-aff82f427082 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.121090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254112d-cab8-4518-882b-aff82f427082 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.151543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90d92d-4142-431c-973f-2923e03a6eee tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.152942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90d92d-4142-431c-973f-2923e03a6eee tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.154083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90d92d-4142-431c-973f-2923e03a6eee tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.155052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90d92d-4142-431c-973f-2923e03a6eee tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.156013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90d92d-4142-431c-973f-2923e03a6eee tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.160826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90d92d-4142-431c-973f-2923e03a6eee tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.162766 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1903/3839] 10.222.0.20 () {58 vars in 1242 bytes} [Thu Oct 27 03:41:24 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:24.170383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90d92d-4142-431c-973f-2923e03a6eee tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.191931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90d92d-4142-431c-973f-2923e03a6eee tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.194786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-de02bbd7-0a30-49aa-9332-6730a59bd7b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f139e1ec9338495c94d9df2cc3652247', 'request_id': 'req-de02bbd7-0a30-49aa-9332-6730a59bd7b9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:24.210497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-de02bbd7-0a30-49aa-9332-6730a59bd7b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f139e1ec9338495c94d9df2cc3652247', 'request_id': 'req-de02bbd7-0a30-49aa-9332-6730a59bd7b9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:24.223527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-de02bbd7-0a30-49aa-9332-6730a59bd7b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f139e1ec9338495c94d9df2cc3652247', 'request_id': 'req-de02bbd7-0a30-49aa-9332-6730a59bd7b9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:24.268803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:24.310824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c06a3-c532-4aef-9af6-42f0652f6566 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.311892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c06a3-c532-4aef-9af6-42f0652f6566 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.311892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c06a3-c532-4aef-9af6-42f0652f6566 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.312091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c06a3-c532-4aef-9af6-42f0652f6566 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.312610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c06a3-c532-4aef-9af6-42f0652f6566 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.318470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c06a3-c532-4aef-9af6-42f0652f6566 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.323015 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1904/3840] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:41:24 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:24.337790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-de02bbd7-0a30-49aa-9332-6730a59bd7b9 admin admin] The token cache is being invalidate because project f139e1ec9338495c94d9df2cc3652247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:41:24.338115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-de02bbd7-0a30-49aa-9332-6730a59bd7b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:24.338832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-de02bbd7-0a30-49aa-9332-6730a59bd7b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:24.339325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c06a3-c532-4aef-9af6-42f0652f6566 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.341344 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1937/3841] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:41:23 2022] DELETE /identity/v3/projects/f139e1ec9338495c94d9df2cc3652247 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:41:24.351175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a142971-68e8-44d2-85e3-965d9716d651 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.351472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a142971-68e8-44d2-85e3-965d9716d651 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.352160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a142971-68e8-44d2-85e3-965d9716d651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.352364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-463c06a3-c532-4aef-9af6-42f0652f6566 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:24.384716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c06a3-c532-4aef-9af6-42f0652f6566 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.397330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e0e74-968d-493c-8169-c99204d2d5ec tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.397897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e0e74-968d-493c-8169-c99204d2d5ec tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.398252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e0e74-968d-493c-8169-c99204d2d5ec tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.398554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e0e74-968d-493c-8169-c99204d2d5ec tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.399258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e0e74-968d-493c-8169-c99204d2d5ec tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.400944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e0e74-968d-493c-8169-c99204d2d5ec tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.402074 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1905/3842] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:41:24 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:24.405196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2a142971-68e8-44d2-85e3-965d9716d651 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:24.405196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2a142971-68e8-44d2-85e3-965d9716d651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:24.406107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e0e74-968d-493c-8169-c99204d2d5ec tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.427203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e0e74-968d-493c-8169-c99204d2d5ec tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.428936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491a742-21de-4f5c-b7d4-1092890228f5 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.430357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491a742-21de-4f5c-b7d4-1092890228f5 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.430798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491a742-21de-4f5c-b7d4-1092890228f5 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.431260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491a742-21de-4f5c-b7d4-1092890228f5 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.432011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491a742-21de-4f5c-b7d4-1092890228f5 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.435280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491a742-21de-4f5c-b7d4-1092890228f5 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.441244 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1906/3843] 10.222.0.20 () {58 vars in 1254 bytes} [Thu Oct 27 03:41:24 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:24.447019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491a742-21de-4f5c-b7d4-1092890228f5 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.461060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:24.467054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491a742-21de-4f5c-b7d4-1092890228f5 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.479414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3dd5af-74b0-4425-8b09-9200bb52e5c2 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.481210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3dd5af-74b0-4425-8b09-9200bb52e5c2 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.481780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3dd5af-74b0-4425-8b09-9200bb52e5c2 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.482606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3dd5af-74b0-4425-8b09-9200bb52e5c2 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.483391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3dd5af-74b0-4425-8b09-9200bb52e5c2 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.485192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3dd5af-74b0-4425-8b09-9200bb52e5c2 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.489860 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1907/3844] 10.222.0.20 () {58 vars in 1257 bytes} [Thu Oct 27 03:41:24 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:24.491128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3dd5af-74b0-4425-8b09-9200bb52e5c2 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.502631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3dd5af-74b0-4425-8b09-9200bb52e5c2 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.508857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc5f63-360f-45d0-bc79-142b030b1e09 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.509783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc5f63-360f-45d0-bc79-142b030b1e09 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.510288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc5f63-360f-45d0-bc79-142b030b1e09 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.510877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc5f63-360f-45d0-bc79-142b030b1e09 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.511722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc5f63-360f-45d0-bc79-142b030b1e09 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.513605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc5f63-360f-45d0-bc79-142b030b1e09 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.518272 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1908/3845] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:41:24 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:24.520476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc5f63-360f-45d0-bc79-142b030b1e09 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.532889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc5f63-360f-45d0-bc79-142b030b1e09 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.541309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac2401-22e4-47de-a5cc-da439c535f02 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.541990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac2401-22e4-47de-a5cc-da439c535f02 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.542329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac2401-22e4-47de-a5cc-da439c535f02 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.542579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac2401-22e4-47de-a5cc-da439c535f02 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.543445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac2401-22e4-47de-a5cc-da439c535f02 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.545096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac2401-22e4-47de-a5cc-da439c535f02 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.546422 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1909/3846] 10.222.0.20 () {58 vars in 1257 bytes} [Thu Oct 27 03:41:24 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:24.550865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac2401-22e4-47de-a5cc-da439c535f02 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.559312 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1938/3847] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:24.562535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca59c1f-99ac-4e78-b662-a703a78fd5f4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.562833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca59c1f-99ac-4e78-b662-a703a78fd5f4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.562937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac2401-22e4-47de-a5cc-da439c535f02 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.563110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca59c1f-99ac-4e78-b662-a703a78fd5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.568021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b75e7-1b2c-4dcd-9ed5-2afdc2b22533 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.568694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b75e7-1b2c-4dcd-9ed5-2afdc2b22533 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.569089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b75e7-1b2c-4dcd-9ed5-2afdc2b22533 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.569340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b75e7-1b2c-4dcd-9ed5-2afdc2b22533 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.569993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b75e7-1b2c-4dcd-9ed5-2afdc2b22533 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.572315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b75e7-1b2c-4dcd-9ed5-2afdc2b22533 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.576338 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1910/3848] 10.222.0.20 () {58 vars in 1293 bytes} [Thu Oct 27 03:41:24 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:24.577475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b75e7-1b2c-4dcd-9ed5-2afdc2b22533 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.600071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0ca59c1f-99ac-4e78-b662-a703a78fd5f4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:24.600071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0ca59c1f-99ac-4e78-b662-a703a78fd5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:24.600899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b75e7-1b2c-4dcd-9ed5-2afdc2b22533 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.606431 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1939/3849] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:41:24.610713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca59c1f-99ac-4e78-b662-a703a78fd5f4 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.623581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca59c1f-99ac-4e78-b662-a703a78fd5f4 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.627163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15bf34-e243-4091-997a-f0d6b0e52f84 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.635370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15bf34-e243-4091-997a-f0d6b0e52f84 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.635370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15bf34-e243-4091-997a-f0d6b0e52f84 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.635370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15bf34-e243-4091-997a-f0d6b0e52f84 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.635370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15bf34-e243-4091-997a-f0d6b0e52f84 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.635703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15bf34-e243-4091-997a-f0d6b0e52f84 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.635784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8b817-1833-4002-8f97-8eb05da05ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.635888 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1911/3850] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:41:24 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 27 03:41:24.636678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15bf34-e243-4091-997a-f0d6b0e52f84 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.637573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8b817-1833-4002-8f97-8eb05da05ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.638184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8b817-1833-4002-8f97-8eb05da05ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.638961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8b817-1833-4002-8f97-8eb05da05ba0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.640371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8b817-1833-4002-8f97-8eb05da05ba0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:41:24.640864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8b817-1833-4002-8f97-8eb05da05ba0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.642701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8b817-1833-4002-8f97-8eb05da05ba0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.649046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15bf34-e243-4091-997a-f0d6b0e52f84 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.655116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acf740-74c1-4f46-ad37-9c67dd7447d4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.655784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acf740-74c1-4f46-ad37-9c67dd7447d4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.656074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acf740-74c1-4f46-ad37-9c67dd7447d4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.656364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acf740-74c1-4f46-ad37-9c67dd7447d4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.657126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32acf740-74c1-4f46-ad37-9c67dd7447d4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.657236 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1940/3851] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:24.658620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32acf740-74c1-4f46-ad37-9c67dd7447d4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.659762 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1912/3852] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:41:24 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 27 03:41:24.661557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8b817-1833-4002-8f97-8eb05da05ba0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.665377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acf740-74c1-4f46-ad37-9c67dd7447d4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.673603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8b817-1833-4002-8f97-8eb05da05ba0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.684182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acf740-74c1-4f46-ad37-9c67dd7447d4 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.684350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c52a95-b84b-4315-9d2e-8505948a4674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.684350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c52a95-b84b-4315-9d2e-8505948a4674 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.684350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c52a95-b84b-4315-9d2e-8505948a4674 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.684350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c52a95-b84b-4315-9d2e-8505948a4674 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.684689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c52a95-b84b-4315-9d2e-8505948a4674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.684835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c52a95-b84b-4315-9d2e-8505948a4674 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.685614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b73a59-d726-48ac-a4da-402b0516a669 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.686402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b73a59-d726-48ac-a4da-402b0516a669 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.686755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b73a59-d726-48ac-a4da-402b0516a669 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.687135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b73a59-d726-48ac-a4da-402b0516a669 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.687864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b73a59-d726-48ac-a4da-402b0516a669 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.689987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b73a59-d726-48ac-a4da-402b0516a669 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.692853 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1913/3853] 10.222.0.20 () {58 vars in 1212 bytes} [Thu Oct 27 03:41:24 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 27 03:41:24.696919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b73a59-d726-48ac-a4da-402b0516a669 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.719858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b73a59-d726-48ac-a4da-402b0516a669 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.725848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d8ddc-0a9d-4a72-b48e-b740dd5d5f55 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.727275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d8ddc-0a9d-4a72-b48e-b740dd5d5f55 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.727643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d8ddc-0a9d-4a72-b48e-b740dd5d5f55 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.727928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d8ddc-0a9d-4a72-b48e-b740dd5d5f55 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.728522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d8ddc-0a9d-4a72-b48e-b740dd5d5f55 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.730233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d8ddc-0a9d-4a72-b48e-b740dd5d5f55 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.732659 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1914/3854] 10.222.0.20 () {58 vars in 1227 bytes} [Thu Oct 27 03:41:24 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 27 03:41:24.736028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d8ddc-0a9d-4a72-b48e-b740dd5d5f55 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.747916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d8ddc-0a9d-4a72-b48e-b740dd5d5f55 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.754163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65855c87-4150-443a-8b3a-a8db69dbca83 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.754845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65855c87-4150-443a-8b3a-a8db69dbca83 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.755132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65855c87-4150-443a-8b3a-a8db69dbca83 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.755392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65855c87-4150-443a-8b3a-a8db69dbca83 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.755986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65855c87-4150-443a-8b3a-a8db69dbca83 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.757632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65855c87-4150-443a-8b3a-a8db69dbca83 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.761859 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1915/3855] 10.222.0.20 () {58 vars in 1215 bytes} [Thu Oct 27 03:41:24 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 27 03:41:24.762921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65855c87-4150-443a-8b3a-a8db69dbca83 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.774260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65855c87-4150-443a-8b3a-a8db69dbca83 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.779366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28cadb-6859-4552-8bbb-f7fbd2463d16 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.780024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28cadb-6859-4552-8bbb-f7fbd2463d16 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.780312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28cadb-6859-4552-8bbb-f7fbd2463d16 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.780595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28cadb-6859-4552-8bbb-f7fbd2463d16 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.781186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28cadb-6859-4552-8bbb-f7fbd2463d16 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.782842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28cadb-6859-4552-8bbb-f7fbd2463d16 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.783943 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1916/3856] 10.222.0.20 () {58 vars in 1218 bytes} [Thu Oct 27 03:41:24 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:24.787808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28cadb-6859-4552-8bbb-f7fbd2463d16 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.802195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28cadb-6859-4552-8bbb-f7fbd2463d16 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.803117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885a959-42e2-4031-a44a-45feb14d1ac6 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.803742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885a959-42e2-4031-a44a-45feb14d1ac6 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.804034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885a959-42e2-4031-a44a-45feb14d1ac6 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.804373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885a959-42e2-4031-a44a-45feb14d1ac6 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.805465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885a959-42e2-4031-a44a-45feb14d1ac6 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.807093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885a959-42e2-4031-a44a-45feb14d1ac6 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.808166 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1917/3857] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:41:24 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 27 03:41:24.811837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885a959-42e2-4031-a44a-45feb14d1ac6 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.822332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885a959-42e2-4031-a44a-45feb14d1ac6 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.828551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb8c48-b028-4fe1-ad42-a750a16e4c18 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.829948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb8c48-b028-4fe1-ad42-a750a16e4c18 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.829948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb8c48-b028-4fe1-ad42-a750a16e4c18 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.829948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb8c48-b028-4fe1-ad42-a750a16e4c18 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.830782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb8c48-b028-4fe1-ad42-a750a16e4c18 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.835044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb8c48-b028-4fe1-ad42-a750a16e4c18 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.836469 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1918/3858] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:41:24 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 27 03:41:24.838435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb8c48-b028-4fe1-ad42-a750a16e4c18 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.844258 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1941/3859] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:41:24 2022] POST /identity/v3/projects => generated 391 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:24.846360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c52a95-b84b-4315-9d2e-8505948a4674 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.865632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb8c48-b028-4fe1-ad42-a750a16e4c18 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.935040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c52a95-b84b-4315-9d2e-8505948a4674 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:24.946265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923219e-6f38-4ba0-9582-87ec596728ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.946915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923219e-6f38-4ba0-9582-87ec596728ad admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.947168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923219e-6f38-4ba0-9582-87ec596728ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.947451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923219e-6f38-4ba0-9582-87ec596728ad admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.948081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923219e-6f38-4ba0-9582-87ec596728ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.952260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923219e-6f38-4ba0-9582-87ec596728ad admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.966700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df80fe-cd52-481b-99ab-ec9f72ac2c30 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:24.967435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df80fe-cd52-481b-99ab-ec9f72ac2c30 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:24.967837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df80fe-cd52-481b-99ab-ec9f72ac2c30 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:24.968202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df80fe-cd52-481b-99ab-ec9f72ac2c30 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:24.968862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df80fe-cd52-481b-99ab-ec9f72ac2c30 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:24.970821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df80fe-cd52-481b-99ab-ec9f72ac2c30 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:24.974963 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1919/3860] 10.222.0.20 () {58 vars in 1260 bytes} [Thu Oct 27 03:41:24 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:24.974963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df80fe-cd52-481b-99ab-ec9f72ac2c30 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:24.977443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-77df80fe-cd52-481b-99ab-ec9f72ac2c30 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:25.073884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df80fe-cd52-481b-99ab-ec9f72ac2c30 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:25.077743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a32d58-8205-47d2-bcad-df2c296be4ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:25.078453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a32d58-8205-47d2-bcad-df2c296be4ba service glance] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:25.078799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a32d58-8205-47d2-bcad-df2c296be4ba service glance] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:25.079139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a32d58-8205-47d2-bcad-df2c296be4ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:25.081005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-16a32d58-8205-47d2-bcad-df2c296be4ba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:25.098684 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1942/3861] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:41:24 2022] POST /identity/v3/users => generated 296 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:25.098684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923219e-6f38-4ba0-9582-87ec596728ad admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:25.108797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923219e-6f38-4ba0-9582-87ec596728ad admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:25.114246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70843e49-9ad5-437d-acbd-fba582a91b0b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:25.114733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70843e49-9ad5-437d-acbd-fba582a91b0b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:25.115138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70843e49-9ad5-437d-acbd-fba582a91b0b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:25.115503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70843e49-9ad5-437d-acbd-fba582a91b0b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:25.116265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70843e49-9ad5-437d-acbd-fba582a91b0b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:25.118104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70843e49-9ad5-437d-acbd-fba582a91b0b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:25.121371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:25.123163 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1943/3862] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:41:25 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:25.125073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70843e49-9ad5-437d-acbd-fba582a91b0b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:25.136012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70843e49-9ad5-437d-acbd-fba582a91b0b tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:25.141551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cfcb8-bfe7-4754-87c0-15a4e7cad63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:25.142180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cfcb8-bfe7-4754-87c0-15a4e7cad63e admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:25.142463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cfcb8-bfe7-4754-87c0-15a4e7cad63e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:25.142739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cfcb8-bfe7-4754-87c0-15a4e7cad63e admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:25.143374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84cfcb8-bfe7-4754-87c0-15a4e7cad63e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:25.144951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84cfcb8-bfe7-4754-87c0-15a4e7cad63e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:25.155112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:25.156955 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1944/3863] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:41:25.156955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cfcb8-bfe7-4754-87c0-15a4e7cad63e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:25.161910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a32d58-8205-47d2-bcad-df2c296be4ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:25.163596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a32d58-8205-47d2-bcad-df2c296be4ba service glance] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:25.173460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cfcb8-bfe7-4754-87c0-15a4e7cad63e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:25.193430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37b25b-3ff7-4155-b5fe-0dab91f363c0 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:25.194461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37b25b-3ff7-4155-b5fe-0dab91f363c0 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:25.194873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37b25b-3ff7-4155-b5fe-0dab91f363c0 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:25.197489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37b25b-3ff7-4155-b5fe-0dab91f363c0 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:25.198185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37b25b-3ff7-4155-b5fe-0dab91f363c0 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:25.200088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37b25b-3ff7-4155-b5fe-0dab91f363c0 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:25.201346 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1945/3864] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:41:25 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:25.202285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37b25b-3ff7-4155-b5fe-0dab91f363c0 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:25.206807 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1920/3865] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:41:25.207980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a32d58-8205-47d2-bcad-df2c296be4ba service glance] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:25.212858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:25.217669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37b25b-3ff7-4155-b5fe-0dab91f363c0 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:25.223576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a32d58-8205-47d2-bcad-df2c296be4ba service glance] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:25.224502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014422d-aa4e-4c45-a593-1b971ccff82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:25.225830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014422d-aa4e-4c45-a593-1b971ccff82b admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:25.226850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014422d-aa4e-4c45-a593-1b971ccff82b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:25.227279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014422d-aa4e-4c45-a593-1b971ccff82b admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:25.227940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4014422d-aa4e-4c45-a593-1b971ccff82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:25.230026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4014422d-aa4e-4c45-a593-1b971ccff82b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:25.230936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943d1dd-cf42-4164-b49b-fa20fb78ceca tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:25.232227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943d1dd-cf42-4164-b49b-fa20fb78ceca tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:25.232546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943d1dd-cf42-4164-b49b-fa20fb78ceca tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:25.232941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943d1dd-cf42-4164-b49b-fa20fb78ceca tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:25.233640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943d1dd-cf42-4164-b49b-fa20fb78ceca tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:25.236246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943d1dd-cf42-4164-b49b-fa20fb78ceca tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:25.237945 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1921/3866] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:41:25 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:41:25.242851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943d1dd-cf42-4164-b49b-fa20fb78ceca tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:25.249096 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1946/3867] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:41:25.252802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014422d-aa4e-4c45-a593-1b971ccff82b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:25.254801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943d1dd-cf42-4164-b49b-fa20fb78ceca tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:25.259774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b3fcb-13c3-480b-b1f7-4e5708d8c5ce tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:25.260436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b3fcb-13c3-480b-b1f7-4e5708d8c5ce tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:25.260727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b3fcb-13c3-480b-b1f7-4e5708d8c5ce tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:25.261011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b3fcb-13c3-480b-b1f7-4e5708d8c5ce tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:25.261642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b3fcb-13c3-480b-b1f7-4e5708d8c5ce tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:25.263326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b3fcb-13c3-480b-b1f7-4e5708d8c5ce tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:25.264573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014422d-aa4e-4c45-a593-1b971ccff82b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:25.264705 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1922/3868] 10.222.0.20 () {58 vars in 1278 bytes} [Thu Oct 27 03:41:25 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 27 03:41:25.281445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ce1cc-33b0-415e-b829-763d3de20ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:25.282283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ce1cc-33b0-415e-b829-763d3de20ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:25.282577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ce1cc-33b0-415e-b829-763d3de20ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:25.282711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b3fcb-13c3-480b-b1f7-4e5708d8c5ce tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:25.282856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ce1cc-33b0-415e-b829-763d3de20ebf admin admin] PATH_INFO: `/v3/projects/e1f3ed7ef6c648c9ac771fbaadde1d0c/users/43172c9e71704c869a25181574d67b35/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:25.297259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b3fcb-13c3-480b-b1f7-4e5708d8c5ce tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:25.303424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e095b-f05c-411c-aa69-bdf15e215583 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:25.304051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e095b-f05c-411c-aa69-bdf15e215583 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:25.304872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e095b-f05c-411c-aa69-bdf15e215583 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:25.305154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e095b-f05c-411c-aa69-bdf15e215583 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/5546a966c7b04118b7413b933e374356` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:25.305890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ce1cc-33b0-415e-b829-763d3de20ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1f3ed7ef6c648c9ac771fbaadde1d0c, user_id=43172c9e71704c869a25181574d67b35, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:25.309983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ce1cc-33b0-415e-b829-763d3de20ebf admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:25.314162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e095b-f05c-411c-aa69-bdf15e215583 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:41:25.340936 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-c81e095b-f05c-411c-aa69-bdf15e215583 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Could not find domain: 5546a966c7b04118b7413b933e374356.: keystone.exception.DomainNotFound: Could not find domain: 5546a966c7b04118b7413b933e374356. Oct 27 03:41:25.340936 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:41:25.340936 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 27 03:41:25.340936 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 27 03:41:25.340936 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:41:25.340936 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:41:25.340936 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:41:25.340936 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:41:25.340936 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 5546a966c7b04118b7413b933e374356. Oct 27 03:41:25.340936 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:41:25.340936 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:41:25.340936 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:41:25.340936 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:41:25.340936 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:41:25.340936 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:41:25.342546 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:41:25.342546 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:41:25.342546 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:41:25.342546 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:41:25.342546 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:41:25.342546 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:41:25.342546 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:41:25.342546 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:41:25.342546 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 27 03:41:25.342546 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 27 03:41:25.342546 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:41:25.342546 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:41:25.342546 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:41:25.342546 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:41:25.342546 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:41:25.342546 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:41:25.343657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:41:25.343657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:41:25.343657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:41:25.343657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:41:25.343657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:41:25.343657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:41:25.343657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:41:25.343657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:41:25.343657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:41:25.343657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:41:25.343657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:41:25.343657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:41:25.343657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:41:25.343657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:41:25.343657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 27 03:41:25.343657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:41:25.343657 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 5546a966c7b04118b7413b933e374356. Oct 27 03:41:25.344847 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:41:25.345253 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1923/3869] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:41:25 2022] PATCH /identity/v3/domains/5546a966c7b04118b7413b933e374356 => generated 112 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:41:25.347394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e095b-f05c-411c-aa69-bdf15e215583 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:25.358794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e095b-f05c-411c-aa69-bdf15e215583 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:25.363609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f158f-f8a5-45a6-ab7c-623a8964d152 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:25.364291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f158f-f8a5-45a6-ab7c-623a8964d152 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:25.364597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f158f-f8a5-45a6-ab7c-623a8964d152 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:25.364863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f158f-f8a5-45a6-ab7c-623a8964d152 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/8f0d963c23c941cc91a984df87d5244f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:25.372474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f158f-f8a5-45a6-ab7c-623a8964d152 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:41:25.377891 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-a55f158f-f8a5-45a6-ab7c-623a8964d152 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Could not find domain: 8f0d963c23c941cc91a984df87d5244f.: keystone.exception.DomainNotFound: Could not find domain: 8f0d963c23c941cc91a984df87d5244f. Oct 27 03:41:25.377891 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:41:25.377891 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 27 03:41:25.377891 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 27 03:41:25.377891 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:41:25.377891 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:41:25.377891 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:41:25.377891 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:41:25.377891 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8f0d963c23c941cc91a984df87d5244f. Oct 27 03:41:25.377891 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:41:25.377891 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:41:25.377891 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:41:25.377891 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:41:25.377891 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:41:25.377891 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:41:25.378993 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:41:25.378993 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:41:25.378993 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:41:25.378993 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:41:25.378993 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:41:25.378993 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:41:25.378993 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:41:25.378993 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:41:25.378993 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 27 03:41:25.378993 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 27 03:41:25.378993 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:41:25.378993 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:41:25.378993 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:41:25.378993 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:41:25.378993 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:41:25.378993 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:41:25.380039 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:41:25.380039 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:41:25.380039 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:41:25.380039 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:41:25.380039 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:41:25.380039 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:41:25.380039 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:41:25.380039 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:41:25.380039 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:41:25.380039 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:41:25.380039 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:41:25.380039 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:41:25.380039 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:41:25.380039 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:41:25.380039 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 27 03:41:25.380039 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:41:25.380039 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8f0d963c23c941cc91a984df87d5244f. Oct 27 03:41:25.381143 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:41:25.381143 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1924/3870] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:41:25 2022] PATCH /identity/v3/domains/8f0d963c23c941cc91a984df87d5244f => generated 112 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 27 03:41:25.386107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f158f-f8a5-45a6-ab7c-623a8964d152 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:25.387475 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1947/3871] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:41:25 2022] PUT /identity/v3/projects/e1f3ed7ef6c648c9ac771fbaadde1d0c/users/43172c9e71704c869a25181574d67b35/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:25.392207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ed1a2-4fa0-476d-896d-ca8da52ff546 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:25.392500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ed1a2-4fa0-476d-896d-ca8da52ff546 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:25.392783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ed1a2-4fa0-476d-896d-ca8da52ff546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:25.401780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f158f-f8a5-45a6-ab7c-623a8964d152 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:25.411836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-087ed1a2-4fa0-476d-896d-ca8da52ff546 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:25.413109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-087ed1a2-4fa0-476d-896d-ca8da52ff546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:25.469551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2813ef-f675-4be1-b75d-745e1da5cf38 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee9ed7afbaa4e4eb167c914316d54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc91d55d4ed64f5593d2648e1a4e2178', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:25.470235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2813ef-f675-4be1-b75d-745e1da5cf38 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:25.470524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2813ef-f675-4be1-b75d-745e1da5cf38 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:25.471028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2813ef-f675-4be1-b75d-745e1da5cf38 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] PATH_INFO: `/v3/domains/2c7eb7a3f91b42689f7dce50d2e9daba` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:25.479365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2813ef-f675-4be1-b75d-745e1da5cf38 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:41:25.484401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-5e2813ef-f675-4be1-b75d-745e1da5cf38 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Could not find domain: 2c7eb7a3f91b42689f7dce50d2e9daba.: keystone.exception.DomainNotFound: Could not find domain: 2c7eb7a3f91b42689f7dce50d2e9daba. Oct 27 03:41:25.484401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:41:25.484401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 27 03:41:25.484401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 27 03:41:25.484401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:41:25.484401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:41:25.484401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:41:25.484401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:41:25.484401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2c7eb7a3f91b42689f7dce50d2e9daba. Oct 27 03:41:25.484401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:41:25.484401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:41:25.484401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:41:25.484401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:41:25.484401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:41:25.484401 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:41:25.485485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:41:25.485485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:41:25.485485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:41:25.485485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:41:25.485485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:41:25.485485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:41:25.485485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:41:25.485485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:41:25.485485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 27 03:41:25.485485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 27 03:41:25.485485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:41:25.485485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:41:25.485485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:41:25.485485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:41:25.485485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:41:25.485485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:41:25.486585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:41:25.486585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:41:25.486585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:41:25.486585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:41:25.486585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:41:25.486585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:41:25.486585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:41:25.486585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:41:25.486585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:41:25.486585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:41:25.486585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:41:25.486585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:41:25.486585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:41:25.486585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:41:25.486585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 27 03:41:25.486585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:41:25.486585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 2c7eb7a3f91b42689f7dce50d2e9daba. Oct 27 03:41:25.487613 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:41:25.487613 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1925/3872] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:41:25 2022] PATCH /identity/v3/domains/2c7eb7a3f91b42689f7dce50d2e9daba => generated 112 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:41:25.487613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2813ef-f675-4be1-b75d-745e1da5cf38 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:25.488359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5e2813ef-f675-4be1-b75d-745e1da5cf38 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:25.489966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:25.493367 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1948/3873] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:41:25.494400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ed1a2-4fa0-476d-896d-ca8da52ff546 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:25.496619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-087ed1a2-4fa0-476d-896d-ca8da52ff546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:25.507850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ed1a2-4fa0-476d-896d-ca8da52ff546 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:25.512607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa06bc-a361-406f-bd4f-fa5070948bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:25.513234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa06bc-a361-406f-bd4f-fa5070948bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:25.513513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa06bc-a361-406f-bd4f-fa5070948bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:25.513787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa06bc-a361-406f-bd4f-fa5070948bb2 admin admin] PATH_INFO: `/v3/users/3ac947191ec44ea486e354b75d4c403b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:25.514968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa06bc-a361-406f-bd4f-fa5070948bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ac947191ec44ea486e354b75d4c403b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:25.516891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa06bc-a361-406f-bd4f-fa5070948bb2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:25.548079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:25.562795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2813ef-f675-4be1-b75d-745e1da5cf38 tempest-DomainConfigurationTestJSON-1603777984 tempest-DomainConfigurationTestJSON-1603777984-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:25.567925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8729a-9c66-47a8-a145-5b04464316d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:25.568618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8729a-9c66-47a8-a145-5b04464316d5 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:25.568935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8729a-9c66-47a8-a145-5b04464316d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:25.569188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8729a-9c66-47a8-a145-5b04464316d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:25.571121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-09e8729a-9c66-47a8-a145-5b04464316d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:25.583066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8729a-9c66-47a8-a145-5b04464316d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:25.584581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8729a-9c66-47a8-a145-5b04464316d5 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:25.594648 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1926/3874] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:41:25.595520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8729a-9c66-47a8-a145-5b04464316d5 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:25.597103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-09e8729a-9c66-47a8-a145-5b04464316d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:25.610489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8729a-9c66-47a8-a145-5b04464316d5 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:25.613128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d67b2d-607e-45ba-b2ff-e7f116cdf184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:25.613758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d67b2d-607e-45ba-b2ff-e7f116cdf184 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:25.614055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d67b2d-607e-45ba-b2ff-e7f116cdf184 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:25.614357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d67b2d-607e-45ba-b2ff-e7f116cdf184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:25.625463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d67b2d-607e-45ba-b2ff-e7f116cdf184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:25.627038 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d67b2d-607e-45ba-b2ff-e7f116cdf184 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:25.644501 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1927/3875] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:41:25.739452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-caaa06bc-a361-406f-bd4f-fa5070948bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ac947191ec44ea486e354b75d4c403b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:25.740264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-caaa06bc-a361-406f-bd4f-fa5070948bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ac947191ec44ea486e354b75d4c403b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:25.742805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d67b2d-607e-45ba-b2ff-e7f116cdf184 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:25.748308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-caaa06bc-a361-406f-bd4f-fa5070948bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ac947191ec44ea486e354b75d4c403b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:25.759378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d67b2d-607e-45ba-b2ff-e7f116cdf184 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:25.771674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f04e3-1917-4569-afd6-fd9926ed270c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:25.771977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-caaa06bc-a361-406f-bd4f-fa5070948bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ac947191ec44ea486e354b75d4c403b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:25.772304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f04e3-1917-4569-afd6-fd9926ed270c service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:25.772705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-caaa06bc-a361-406f-bd4f-fa5070948bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ac947191ec44ea486e354b75d4c403b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:25.772815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f04e3-1917-4569-afd6-fd9926ed270c service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:25.773004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f04e3-1917-4569-afd6-fd9926ed270c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:25.775616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f01f04e3-1917-4569-afd6-fd9926ed270c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:25.786414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:25.870682 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1949/3876] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:41:25 2022] DELETE /identity/v3/users/3ac947191ec44ea486e354b75d4c403b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:25.875034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d681e-d2d4-412a-8897-01e744af5106 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:25.875542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d681e-d2d4-412a-8897-01e744af5106 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:25.876016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d681e-d2d4-412a-8897-01e744af5106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:25.886895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f04e3-1917-4569-afd6-fd9926ed270c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:25.888281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f04e3-1917-4569-afd6-fd9926ed270c service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:25.904035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-893d681e-d2d4-412a-8897-01e744af5106 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:25.905456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-893d681e-d2d4-412a-8897-01e744af5106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:25.909875 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1928/3877] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:41:25.979726 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1950/3878] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:41:25.994630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f04e3-1917-4569-afd6-fd9926ed270c service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:25.996361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f01f04e3-1917-4569-afd6-fd9926ed270c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:26.013779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f04e3-1917-4569-afd6-fd9926ed270c service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:26.123305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947385d-70b9-4e7e-a8d0-c48d25c1dee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:26.125192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947385d-70b9-4e7e-a8d0-c48d25c1dee5 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:26.126874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947385d-70b9-4e7e-a8d0-c48d25c1dee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:26.127385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947385d-70b9-4e7e-a8d0-c48d25c1dee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:26.171997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947385d-70b9-4e7e-a8d0-c48d25c1dee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:26.173704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947385d-70b9-4e7e-a8d0-c48d25c1dee5 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:26.194661 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1929/3879] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:41:26.884870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d681e-d2d4-412a-8897-01e744af5106 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:26.884870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-893d681e-d2d4-412a-8897-01e744af5106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:26.896954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d681e-d2d4-412a-8897-01e744af5106 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:26.905296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284051dc-6386-4f5e-9d19-8665f0faf39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:26.907205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284051dc-6386-4f5e-9d19-8665f0faf39b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:26.907613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284051dc-6386-4f5e-9d19-8665f0faf39b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:26.907962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284051dc-6386-4f5e-9d19-8665f0faf39b admin admin] PATH_INFO: `/v3/projects/e499ada7055149d1b1cf6dfd01268b99` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:26.909366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284051dc-6386-4f5e-9d19-8665f0faf39b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e499ada7055149d1b1cf6dfd01268b99)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:26.911437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284051dc-6386-4f5e-9d19-8665f0faf39b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:26.939538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:27.023948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-284051dc-6386-4f5e-9d19-8665f0faf39b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e499ada7055149d1b1cf6dfd01268b99', 'request_id': 'req-284051dc-6386-4f5e-9d19-8665f0faf39b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:27.037693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-284051dc-6386-4f5e-9d19-8665f0faf39b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e499ada7055149d1b1cf6dfd01268b99', 'request_id': 'req-284051dc-6386-4f5e-9d19-8665f0faf39b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:27.044432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-284051dc-6386-4f5e-9d19-8665f0faf39b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e499ada7055149d1b1cf6dfd01268b99', 'request_id': 'req-284051dc-6386-4f5e-9d19-8665f0faf39b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:27.170651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-284051dc-6386-4f5e-9d19-8665f0faf39b admin admin] The token cache is being invalidate because project e499ada7055149d1b1cf6dfd01268b99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:41:27.170950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-284051dc-6386-4f5e-9d19-8665f0faf39b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:27.175400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-284051dc-6386-4f5e-9d19-8665f0faf39b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:27.179716 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1951/3880] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:41:26 2022] DELETE /identity/v3/projects/e499ada7055149d1b1cf6dfd01268b99 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:27.184016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947385d-70b9-4e7e-a8d0-c48d25c1dee5 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:27.204884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947385d-70b9-4e7e-a8d0-c48d25c1dee5 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:27.281683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ca40c-8510-47e0-8eee-01a463d125d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:27.282442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ca40c-8510-47e0-8eee-01a463d125d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:27.282728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ca40c-8510-47e0-8eee-01a463d125d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:27.284053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ca40c-8510-47e0-8eee-01a463d125d3 admin admin] PATH_INFO: `/v3/users/aee9ed7afbaa4e4eb167c914316d54c0` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:27.284778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ca40c-8510-47e0-8eee-01a463d125d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aee9ed7afbaa4e4eb167c914316d54c0)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:27.289508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ca40c-8510-47e0-8eee-01a463d125d3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:27.296192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:27.597809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1a1ca40c-8510-47e0-8eee-01a463d125d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aee9ed7afbaa4e4eb167c914316d54c0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:27.605136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1a1ca40c-8510-47e0-8eee-01a463d125d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aee9ed7afbaa4e4eb167c914316d54c0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:27.635394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1a1ca40c-8510-47e0-8eee-01a463d125d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aee9ed7afbaa4e4eb167c914316d54c0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:27.686778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1a1ca40c-8510-47e0-8eee-01a463d125d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aee9ed7afbaa4e4eb167c914316d54c0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:27.770615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1a1ca40c-8510-47e0-8eee-01a463d125d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aee9ed7afbaa4e4eb167c914316d54c0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:27.779661 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1930/3881] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:41:27 2022] DELETE /identity/v3/users/aee9ed7afbaa4e4eb167c914316d54c0 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:28.657170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284051dc-6386-4f5e-9d19-8665f0faf39b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:28.659375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-284051dc-6386-4f5e-9d19-8665f0faf39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:28.720233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284051dc-6386-4f5e-9d19-8665f0faf39b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:28.829839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa248628-0219-4fca-a5a9-6e4877d17f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:28.830757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa248628-0219-4fca-a5a9-6e4877d17f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:28.831216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa248628-0219-4fca-a5a9-6e4877d17f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:28.831659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa248628-0219-4fca-a5a9-6e4877d17f4d admin admin] PATH_INFO: `/v3/projects/dc91d55d4ed64f5593d2648e1a4e2178` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:28.833137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa248628-0219-4fca-a5a9-6e4877d17f4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc91d55d4ed64f5593d2648e1a4e2178)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:28.836182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa248628-0219-4fca-a5a9-6e4877d17f4d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:28.993842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-aa248628-0219-4fca-a5a9-6e4877d17f4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc91d55d4ed64f5593d2648e1a4e2178', 'request_id': 'req-aa248628-0219-4fca-a5a9-6e4877d17f4d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:29.013374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-aa248628-0219-4fca-a5a9-6e4877d17f4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc91d55d4ed64f5593d2648e1a4e2178', 'request_id': 'req-aa248628-0219-4fca-a5a9-6e4877d17f4d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:29.022678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-aa248628-0219-4fca-a5a9-6e4877d17f4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc91d55d4ed64f5593d2648e1a4e2178', 'request_id': 'req-aa248628-0219-4fca-a5a9-6e4877d17f4d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:29.098866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-aa248628-0219-4fca-a5a9-6e4877d17f4d admin admin] The token cache is being invalidate because project dc91d55d4ed64f5593d2648e1a4e2178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:41:29.099532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-aa248628-0219-4fca-a5a9-6e4877d17f4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:29.100711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-aa248628-0219-4fca-a5a9-6e4877d17f4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:29.104071 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1952/3882] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:41:28 2022] DELETE /identity/v3/projects/dc91d55d4ed64f5593d2648e1a4e2178 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:29.109008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266e90f-5b01-42ed-b022-21b657fa8c37 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:29.109510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266e90f-5b01-42ed-b022-21b657fa8c37 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:29.109790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266e90f-5b01-42ed-b022-21b657fa8c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:29.142086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d266e90f-5b01-42ed-b022-21b657fa8c37 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:29.143464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d266e90f-5b01-42ed-b022-21b657fa8c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:29.268641 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1931/3883] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:41:29.270257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba6b3b-f8c1-488b-8b74-24412c666adf None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:29.271388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba6b3b-f8c1-488b-8b74-24412c666adf None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:29.272938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba6b3b-f8c1-488b-8b74-24412c666adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:29.297475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-17ba6b3b-f8c1-488b-8b74-24412c666adf None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:29.298758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-17ba6b3b-f8c1-488b-8b74-24412c666adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:29.307994 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1953/3884] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:29.312293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266e90f-5b01-42ed-b022-21b657fa8c37 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:29.323015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266e90f-5b01-42ed-b022-21b657fa8c37 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:29.327833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37d57d-e3d8-45d9-87a0-76ec896fa42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:29.328463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37d57d-e3d8-45d9-87a0-76ec896fa42b admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:29.328746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37d57d-e3d8-45d9-87a0-76ec896fa42b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:29.329131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37d57d-e3d8-45d9-87a0-76ec896fa42b admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:29.329748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37d57d-e3d8-45d9-87a0-76ec896fa42b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:41:29.330147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37d57d-e3d8-45d9-87a0-76ec896fa42b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:29.331823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37d57d-e3d8-45d9-87a0-76ec896fa42b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:29.361612 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1932/3885] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:29.362919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba6b3b-f8c1-488b-8b74-24412c666adf None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:29.375050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba6b3b-f8c1-488b-8b74-24412c666adf None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:29.380415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08164e-a2d5-4166-a75f-617cd1eb6341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:29.381337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08164e-a2d5-4166-a75f-617cd1eb6341 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:29.381624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08164e-a2d5-4166-a75f-617cd1eb6341 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:29.385724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08164e-a2d5-4166-a75f-617cd1eb6341 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:29.385724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08164e-a2d5-4166-a75f-617cd1eb6341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:29.385908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08164e-a2d5-4166-a75f-617cd1eb6341 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:29.540691 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1954/3886] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:41:29 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:29.546833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37d57d-e3d8-45d9-87a0-76ec896fa42b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:29.585986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37d57d-e3d8-45d9-87a0-76ec896fa42b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:29.754960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64696ec3-1fac-4a02-bfea-3e85d590ccd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:29.755494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64696ec3-1fac-4a02-bfea-3e85d590ccd8 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:29.755784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64696ec3-1fac-4a02-bfea-3e85d590ccd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:29.756125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64696ec3-1fac-4a02-bfea-3e85d590ccd8 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:29.756781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64696ec3-1fac-4a02-bfea-3e85d590ccd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:29.761490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64696ec3-1fac-4a02-bfea-3e85d590ccd8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:29.868716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:29.881958 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1933/3887] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:41:29 2022] POST /identity/v3/users => generated 289 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:41:29.887338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08164e-a2d5-4166-a75f-617cd1eb6341 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:29.905003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08164e-a2d5-4166-a75f-617cd1eb6341 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:29.919410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67d67f-73f6-4c2d-946f-4b6bddb842cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:29.923566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67d67f-73f6-4c2d-946f-4b6bddb842cf admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:29.923566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67d67f-73f6-4c2d-946f-4b6bddb842cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:29.923566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67d67f-73f6-4c2d-946f-4b6bddb842cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:29.923566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67d67f-73f6-4c2d-946f-4b6bddb842cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:29.923566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67d67f-73f6-4c2d-946f-4b6bddb842cf admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:29.939978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:29.949238 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1955/3888] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:41:29.950021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64696ec3-1fac-4a02-bfea-3e85d590ccd8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:29.970151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64696ec3-1fac-4a02-bfea-3e85d590ccd8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:29.985036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1a091-1779-4f1b-a70f-cc1539872896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:29.985716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1a091-1779-4f1b-a70f-cc1539872896 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:29.986858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1a091-1779-4f1b-a70f-cc1539872896 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:29.986961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1a091-1779-4f1b-a70f-cc1539872896 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:29.996646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1a091-1779-4f1b-a70f-cc1539872896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:29.998494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1a091-1779-4f1b-a70f-cc1539872896 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:30.011907 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1934/3889] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:41:30.016301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67d67f-73f6-4c2d-946f-4b6bddb842cf admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:30.032758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67d67f-73f6-4c2d-946f-4b6bddb842cf admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:30.048596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca19ad-b038-420f-9ab7-2cdadc65b686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:30.049300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca19ad-b038-420f-9ab7-2cdadc65b686 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:30.049588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca19ad-b038-420f-9ab7-2cdadc65b686 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:30.049866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca19ad-b038-420f-9ab7-2cdadc65b686 admin admin] PATH_INFO: `/v3/projects/3a050e5b20b3440a9ac82b8819a6008f/users/4e56aa7f828146f2a930fa236236bd1c/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:30.107547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca19ad-b038-420f-9ab7-2cdadc65b686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a050e5b20b3440a9ac82b8819a6008f, user_id=4e56aa7f828146f2a930fa236236bd1c, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:30.110518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca19ad-b038-420f-9ab7-2cdadc65b686 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:30.212202 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1956/3890] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:41:30 2022] PUT /identity/v3/projects/3a050e5b20b3440a9ac82b8819a6008f/users/4e56aa7f828146f2a930fa236236bd1c/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:30.224137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a5b0b-1bde-4703-9934-c2e214268013 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:30.224656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a5b0b-1bde-4703-9934-c2e214268013 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:30.224956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a5b0b-1bde-4703-9934-c2e214268013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:30.262833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-132a5b0b-1bde-4703-9934-c2e214268013 None None] MFA Rules not processed for user `4e56aa7f828146f2a930fa236236bd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:30.264417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-132a5b0b-1bde-4703-9934-c2e214268013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:30.383110 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1935/3891] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:30.387841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca19ad-b038-420f-9ab7-2cdadc65b686 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:30.507068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca19ad-b038-420f-9ab7-2cdadc65b686 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:30.525749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213685fd-6284-460e-a24e-db931bee9ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:30.526639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213685fd-6284-460e-a24e-db931bee9ade admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:30.527021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213685fd-6284-460e-a24e-db931bee9ade admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:30.527401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213685fd-6284-460e-a24e-db931bee9ade admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:30.528142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213685fd-6284-460e-a24e-db931bee9ade admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:30.532310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213685fd-6284-460e-a24e-db931bee9ade admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:30.650298 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1957/3892] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:41:30 2022] POST /identity/v3/projects => generated 375 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:30.651494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a5b0b-1bde-4703-9934-c2e214268013 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:30.664403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a5b0b-1bde-4703-9934-c2e214268013 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:30.745856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d801bed-1564-4449-86c0-a1482da7f002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:30.748032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d801bed-1564-4449-86c0-a1482da7f002 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:30.748499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d801bed-1564-4449-86c0-a1482da7f002 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:30.748925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d801bed-1564-4449-86c0-a1482da7f002 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:30.751901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d801bed-1564-4449-86c0-a1482da7f002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:30.756663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d801bed-1564-4449-86c0-a1482da7f002 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:30.897005 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1936/3893] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:41:30 2022] POST /identity/v3/users => generated 294 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:41:30.898406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213685fd-6284-460e-a24e-db931bee9ade admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:30.910586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213685fd-6284-460e-a24e-db931bee9ade admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:30.918683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d24fc5-dfb8-40bb-987e-49b7e2acc690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:30.919719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d24fc5-dfb8-40bb-987e-49b7e2acc690 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:30.920202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d24fc5-dfb8-40bb-987e-49b7e2acc690 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:30.920789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d24fc5-dfb8-40bb-987e-49b7e2acc690 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:30.922571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d24fc5-dfb8-40bb-987e-49b7e2acc690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:30.925056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d24fc5-dfb8-40bb-987e-49b7e2acc690 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:30.958315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d801bed-1564-4449-86c0-a1482da7f002 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:30.959011 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1958/3894] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:41:30.975302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d801bed-1564-4449-86c0-a1482da7f002 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:30.987037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f327d7d-eaf6-49eb-8895-490c0839338e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:30.988007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f327d7d-eaf6-49eb-8895-490c0839338e admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:30.988291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f327d7d-eaf6-49eb-8895-490c0839338e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:30.988565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f327d7d-eaf6-49eb-8895-490c0839338e admin admin] PATH_INFO: `/v3/projects/c05d7d0fa0d34d84a02b673db5fd3d37/users/43800d115df5478090645f0241b22947/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:31.027584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f327d7d-eaf6-49eb-8895-490c0839338e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05d7d0fa0d34d84a02b673db5fd3d37, user_id=43800d115df5478090645f0241b22947, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:31.030362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f327d7d-eaf6-49eb-8895-490c0839338e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:31.147357 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1937/3895] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:41:30 2022] PUT /identity/v3/projects/c05d7d0fa0d34d84a02b673db5fd3d37/users/43800d115df5478090645f0241b22947/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:31.158407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d24fc5-dfb8-40bb-987e-49b7e2acc690 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:31.169597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d24fc5-dfb8-40bb-987e-49b7e2acc690 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:31.298230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf315ac4-0beb-49a3-8a0d-222109c017c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:31.299046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf315ac4-0beb-49a3-8a0d-222109c017c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:31.299425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf315ac4-0beb-49a3-8a0d-222109c017c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:31.299799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf315ac4-0beb-49a3-8a0d-222109c017c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:31.300551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf315ac4-0beb-49a3-8a0d-222109c017c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:31.309189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf315ac4-0beb-49a3-8a0d-222109c017c7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:31.326959 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1959/3896] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:41:31.331008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f327d7d-eaf6-49eb-8895-490c0839338e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:31.348598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f327d7d-eaf6-49eb-8895-490c0839338e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:31.361474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b3211-5b00-4db0-bb39-36d3e0449378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:31.362484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b3211-5b00-4db0-bb39-36d3e0449378 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:31.362895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b3211-5b00-4db0-bb39-36d3e0449378 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:31.363281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b3211-5b00-4db0-bb39-36d3e0449378 admin admin] PATH_INFO: `/v3/projects/c05d7d0fa0d34d84a02b673db5fd3d37/users/43800d115df5478090645f0241b22947/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:31.369855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b3211-5b00-4db0-bb39-36d3e0449378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05d7d0fa0d34d84a02b673db5fd3d37, user_id=43800d115df5478090645f0241b22947, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:31.373088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b3211-5b00-4db0-bb39-36d3e0449378 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:31.411769 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1938/3897] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:41:31 2022] PUT /identity/v3/projects/c05d7d0fa0d34d84a02b673db5fd3d37/users/43800d115df5478090645f0241b22947/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:31.413387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3909dc-4151-4d3f-8236-982b43aa74c1 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:31.416643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3909dc-4151-4d3f-8236-982b43aa74c1 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:31.416643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3909dc-4151-4d3f-8236-982b43aa74c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:31.477541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0c3909dc-4151-4d3f-8236-982b43aa74c1 None None] MFA Rules not processed for user `43800d115df5478090645f0241b22947`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:31.479686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0c3909dc-4151-4d3f-8236-982b43aa74c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:31.589292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:31.691976 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1960/3898] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:41:31.698718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b3211-5b00-4db0-bb39-36d3e0449378 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:31.715226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b3211-5b00-4db0-bb39-36d3e0449378 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:31.720778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660becc-6b45-42a7-861f-5628ea7a9704 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43800d115df5478090645f0241b22947', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c05d7d0fa0d34d84a02b673db5fd3d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:31.721718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660becc-6b45-42a7-861f-5628ea7a9704 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:31.726686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660becc-6b45-42a7-861f-5628ea7a9704 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:31.726686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660becc-6b45-42a7-861f-5628ea7a9704 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:31.726686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660becc-6b45-42a7-861f-5628ea7a9704 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:31.726686 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-3660becc-6b45-42a7-861f-5628ea7a9704 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:41:31.726686 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:41:31.726686 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:41:31.727228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660becc-6b45-42a7-861f-5628ea7a9704 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:31.819785 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1939/3899] 10.222.0.20 () {60 vars in 1185 bytes} [Thu Oct 27 03:41:31 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:31.824146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3909dc-4151-4d3f-8236-982b43aa74c1 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:31.840881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3909dc-4151-4d3f-8236-982b43aa74c1 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:31.852243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259aa02-21f2-4c63-a8cc-8674e1791177 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43800d115df5478090645f0241b22947', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c05d7d0fa0d34d84a02b673db5fd3d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:31.853244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259aa02-21f2-4c63-a8cc-8674e1791177 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:31.853649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259aa02-21f2-4c63-a8cc-8674e1791177 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:31.854104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259aa02-21f2-4c63-a8cc-8674e1791177 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/ea43668b43e44c789c72aa8a34e3eca6` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:31.855139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259aa02-21f2-4c63-a8cc-8674e1791177 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=ea43668b43e44c789c72aa8a34e3eca6)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:31.856330 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-8259aa02-21f2-4c63-a8cc-8674e1791177 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:41:31.856330 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:41:31.856330 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:41:31.857553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259aa02-21f2-4c63-a8cc-8674e1791177 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:31.887549 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1961/3900] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:41:31 2022] GET /identity/v3/OS-OAUTH1/consumers/ea43668b43e44c789c72aa8a34e3eca6 => generated 221 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:31.889692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660becc-6b45-42a7-861f-5628ea7a9704 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:31.907240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660becc-6b45-42a7-861f-5628ea7a9704 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:31.917661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639ea90-0ff1-4df7-adb7-cde386a0db3f tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43800d115df5478090645f0241b22947', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c05d7d0fa0d34d84a02b673db5fd3d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:31.919825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639ea90-0ff1-4df7-adb7-cde386a0db3f tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:31.920121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639ea90-0ff1-4df7-adb7-cde386a0db3f tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:31.920403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639ea90-0ff1-4df7-adb7-cde386a0db3f tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/ea43668b43e44c789c72aa8a34e3eca6` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:31.926324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639ea90-0ff1-4df7-adb7-cde386a0db3f tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=ea43668b43e44c789c72aa8a34e3eca6)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:31.927734 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-1639ea90-0ff1-4df7-adb7-cde386a0db3f tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:41:31.927734 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:41:31.927734 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:41:31.929764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639ea90-0ff1-4df7-adb7-cde386a0db3f tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:31.930070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1639ea90-0ff1-4df7-adb7-cde386a0db3f tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Invalidating token cache because consumer ea43668b43e44c789c72aa8a34e3eca6 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:41:31.948023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1639ea90-0ff1-4df7-adb7-cde386a0db3f tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:31.948023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1639ea90-0ff1-4df7-adb7-cde386a0db3f tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:31.953856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:32.084177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1639ea90-0ff1-4df7-adb7-cde386a0db3f tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'ea43668b43e44c789c72aa8a34e3eca6', 'request_id': 'req-1639ea90-0ff1-4df7-adb7-cde386a0db3f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:32.181703 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1940/3901] 10.222.0.20 () {58 vars in 1266 bytes} [Thu Oct 27 03:41:31 2022] DELETE /identity/v3/OS-OAUTH1/consumers/ea43668b43e44c789c72aa8a34e3eca6 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:32.186981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259aa02-21f2-4c63-a8cc-8674e1791177 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:32.195886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8259aa02-21f2-4c63-a8cc-8674e1791177 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:32.220329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259aa02-21f2-4c63-a8cc-8674e1791177 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:32.234981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b157d-3821-40b0-9aea-1e7be255df93 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43800d115df5478090645f0241b22947', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c05d7d0fa0d34d84a02b673db5fd3d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:32.235211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b157d-3821-40b0-9aea-1e7be255df93 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:32.235353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b157d-3821-40b0-9aea-1e7be255df93 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:32.235636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b157d-3821-40b0-9aea-1e7be255df93 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:32.236310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b157d-3821-40b0-9aea-1e7be255df93 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:32.237487 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-426b157d-3821-40b0-9aea-1e7be255df93 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:41:32.237487 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:41:32.237487 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:41:32.238295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b157d-3821-40b0-9aea-1e7be255df93 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:32.339136 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1962/3902] 10.222.0.20 () {60 vars in 1185 bytes} [Thu Oct 27 03:41:32 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:32.342792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639ea90-0ff1-4df7-adb7-cde386a0db3f tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:32.356603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639ea90-0ff1-4df7-adb7-cde386a0db3f tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:32.388988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ec061-a818-4bfc-96b0-b1a077b3ea96 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43800d115df5478090645f0241b22947', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c05d7d0fa0d34d84a02b673db5fd3d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:32.389542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ec061-a818-4bfc-96b0-b1a077b3ea96 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:32.389920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ec061-a818-4bfc-96b0-b1a077b3ea96 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:32.390352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ec061-a818-4bfc-96b0-b1a077b3ea96 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a0f360099d5d4846b78f60eabbefba5b` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:32.391058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ec061-a818-4bfc-96b0-b1a077b3ea96 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=a0f360099d5d4846b78f60eabbefba5b)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:32.392233 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-d88ec061-a818-4bfc-96b0-b1a077b3ea96 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:41:32.392233 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:41:32.392233 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:41:32.395344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ec061-a818-4bfc-96b0-b1a077b3ea96 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:32.408025 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1941/3903] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:41:32 2022] GET /identity/v3/OS-OAUTH1/consumers/a0f360099d5d4846b78f60eabbefba5b => generated 220 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:32.409315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b157d-3821-40b0-9aea-1e7be255df93 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:32.424848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b157d-3821-40b0-9aea-1e7be255df93 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:32.432014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86f150-143b-4d43-89bd-2bade96dae5c tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43800d115df5478090645f0241b22947', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c05d7d0fa0d34d84a02b673db5fd3d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:32.432930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86f150-143b-4d43-89bd-2bade96dae5c tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:32.433369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86f150-143b-4d43-89bd-2bade96dae5c tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:32.433800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86f150-143b-4d43-89bd-2bade96dae5c tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a0f360099d5d4846b78f60eabbefba5b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:32.434663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86f150-143b-4d43-89bd-2bade96dae5c tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=a0f360099d5d4846b78f60eabbefba5b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:32.436059 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-5f86f150-143b-4d43-89bd-2bade96dae5c tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:41:32.436059 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:41:32.436059 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:41:32.437332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86f150-143b-4d43-89bd-2bade96dae5c tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:32.437754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5f86f150-143b-4d43-89bd-2bade96dae5c tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Invalidating token cache because consumer a0f360099d5d4846b78f60eabbefba5b has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:41:32.438234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5f86f150-143b-4d43-89bd-2bade96dae5c tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:32.439144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5f86f150-143b-4d43-89bd-2bade96dae5c tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:32.575812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5f86f150-143b-4d43-89bd-2bade96dae5c tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'a0f360099d5d4846b78f60eabbefba5b', 'request_id': 'req-5f86f150-143b-4d43-89bd-2bade96dae5c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:32.720553 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1963/3904] 10.222.0.20 () {58 vars in 1266 bytes} [Thu Oct 27 03:41:32 2022] DELETE /identity/v3/OS-OAUTH1/consumers/a0f360099d5d4846b78f60eabbefba5b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:32.725856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ec061-a818-4bfc-96b0-b1a077b3ea96 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:32.728777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d88ec061-a818-4bfc-96b0-b1a077b3ea96 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:32.744265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ec061-a818-4bfc-96b0-b1a077b3ea96 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:32.749497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a00f49-74c0-43c6-a92f-8ccc71f6ec7f tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43800d115df5478090645f0241b22947', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c05d7d0fa0d34d84a02b673db5fd3d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:32.750337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a00f49-74c0-43c6-a92f-8ccc71f6ec7f tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:32.750862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a00f49-74c0-43c6-a92f-8ccc71f6ec7f tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:32.751204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a00f49-74c0-43c6-a92f-8ccc71f6ec7f tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a0f360099d5d4846b78f60eabbefba5b` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:32.752015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a00f49-74c0-43c6-a92f-8ccc71f6ec7f tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=a0f360099d5d4846b78f60eabbefba5b)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:32.753839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a00f49-74c0-43c6-a92f-8ccc71f6ec7f tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:32.782069 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-98a00f49-74c0-43c6-a92f-8ccc71f6ec7f tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 27 03:41:32.782069 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:41:32.782069 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:41:32.782069 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:41:32.782069 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:41:32.782069 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:41:32.782069 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:41:32.782069 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:41:32.782069 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:41:32.782069 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:41:32.782069 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:41:32.782069 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:41:32.782069 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Oct 27 03:41:32.782069 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Oct 27 03:41:32.782069 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Oct 27 03:41:32.783175 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Oct 27 03:41:32.783175 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Oct 27 03:41:32.783175 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Oct 27 03:41:32.783175 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Oct 27 03:41:32.783175 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 27 03:41:32.783175 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 27 03:41:32.783175 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 27 03:41:32.783175 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 27 03:41:32.783175 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:41:32.784374 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1942/3905] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:41:32 2022] GET /identity/v3/OS-OAUTH1/consumers/a0f360099d5d4846b78f60eabbefba5b => generated 74 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:41:32.789295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86f150-143b-4d43-89bd-2bade96dae5c tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:32.801168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86f150-143b-4d43-89bd-2bade96dae5c tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:32.808379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf1bfd-d507-4539-990f-b3c7c1c8f457 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43800d115df5478090645f0241b22947', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c05d7d0fa0d34d84a02b673db5fd3d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:32.808379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf1bfd-d507-4539-990f-b3c7c1c8f457 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:32.808379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf1bfd-d507-4539-990f-b3c7c1c8f457 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:32.809078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf1bfd-d507-4539-990f-b3c7c1c8f457 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a0f360099d5d4846b78f60eabbefba5b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:32.810019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf1bfd-d507-4539-990f-b3c7c1c8f457 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=a0f360099d5d4846b78f60eabbefba5b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:32.811652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf1bfd-d507-4539-990f-b3c7c1c8f457 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:32.812048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dbdf1bfd-d507-4539-990f-b3c7c1c8f457 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Invalidating token cache because consumer a0f360099d5d4846b78f60eabbefba5b has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:41:32.812431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dbdf1bfd-d507-4539-990f-b3c7c1c8f457 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:32.813245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dbdf1bfd-d507-4539-990f-b3c7c1c8f457 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:32.838352 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-dbdf1bfd-d507-4539-990f-b3c7c1c8f457 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 27 03:41:32.838352 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:41:32.838352 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:41:32.838352 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:41:32.838352 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:41:32.838352 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:41:32.838352 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:41:32.838352 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:41:32.838352 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:41:32.838352 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:41:32.838352 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:41:32.838352 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:41:32.838352 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Oct 27 03:41:32.838352 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Oct 27 03:41:32.838352 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:41:32.839316 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:41:32.839316 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Oct 27 03:41:32.839316 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Oct 27 03:41:32.839316 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Oct 27 03:41:32.839316 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Oct 27 03:41:32.839316 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Oct 27 03:41:32.839316 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 27 03:41:32.839316 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 27 03:41:32.839316 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 27 03:41:32.839316 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 27 03:41:32.839316 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:41:32.842850 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1964/3906] 10.222.0.20 () {58 vars in 1266 bytes} [Thu Oct 27 03:41:32 2022] DELETE /identity/v3/OS-OAUTH1/consumers/a0f360099d5d4846b78f60eabbefba5b => generated 74 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:41:32.854292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a00f49-74c0-43c6-a92f-8ccc71f6ec7f tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:32.857499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-98a00f49-74c0-43c6-a92f-8ccc71f6ec7f tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:32.891182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a00f49-74c0-43c6-a92f-8ccc71f6ec7f tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:32.906264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c06d5-6c8e-4498-a21c-09da97399ca4 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43800d115df5478090645f0241b22947', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c05d7d0fa0d34d84a02b673db5fd3d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:32.906840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c06d5-6c8e-4498-a21c-09da97399ca4 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:32.907122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c06d5-6c8e-4498-a21c-09da97399ca4 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:32.907409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c06d5-6c8e-4498-a21c-09da97399ca4 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:32.908444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c06d5-6c8e-4498-a21c-09da97399ca4 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:32.910099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c06d5-6c8e-4498-a21c-09da97399ca4 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:33.033077 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1943/3907] 10.222.0.20 () {60 vars in 1185 bytes} [Thu Oct 27 03:41:32 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:33.035033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf1bfd-d507-4539-990f-b3c7c1c8f457 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:33.059860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf1bfd-d507-4539-990f-b3c7c1c8f457 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:33.069149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb7c35-4c96-455e-a0c0-1a6dc062b731 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43800d115df5478090645f0241b22947', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c05d7d0fa0d34d84a02b673db5fd3d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:33.069149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb7c35-4c96-455e-a0c0-1a6dc062b731 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:33.069149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb7c35-4c96-455e-a0c0-1a6dc062b731 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:33.069480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb7c35-4c96-455e-a0c0-1a6dc062b731 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:33.069480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb7c35-4c96-455e-a0c0-1a6dc062b731 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:33.069480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb7c35-4c96-455e-a0c0-1a6dc062b731 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:33.171947 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1965/3908] 10.222.0.20 () {60 vars in 1185 bytes} [Thu Oct 27 03:41:33 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:41:33.174155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c06d5-6c8e-4498-a21c-09da97399ca4 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:33.190656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c06d5-6c8e-4498-a21c-09da97399ca4 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:33.208395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229b43b-0896-4983-a44d-b0a055158250 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43800d115df5478090645f0241b22947', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c05d7d0fa0d34d84a02b673db5fd3d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:33.209484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229b43b-0896-4983-a44d-b0a055158250 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:33.211097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229b43b-0896-4983-a44d-b0a055158250 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:33.211626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229b43b-0896-4983-a44d-b0a055158250 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:33.225988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229b43b-0896-4983-a44d-b0a055158250 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:33.230316 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-7229b43b-0896-4983-a44d-b0a055158250 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:41:33.230316 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:41:33.230316 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:41:33.235430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229b43b-0896-4983-a44d-b0a055158250 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:33.254378 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1944/3909] 10.222.0.20 () {58 vars in 1164 bytes} [Thu Oct 27 03:41:33 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 535 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:33.259099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb7c35-4c96-455e-a0c0-1a6dc062b731 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:33.280026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb7c35-4c96-455e-a0c0-1a6dc062b731 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:33.288786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87e48f-42ae-4d59-a50a-7222e5700e43 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43800d115df5478090645f0241b22947', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c05d7d0fa0d34d84a02b673db5fd3d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:33.290276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87e48f-42ae-4d59-a50a-7222e5700e43 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:33.290715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87e48f-42ae-4d59-a50a-7222e5700e43 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:33.291166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87e48f-42ae-4d59-a50a-7222e5700e43 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/6c9d5ad6ba1542d1ae71d2ceac533b17` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:33.291917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87e48f-42ae-4d59-a50a-7222e5700e43 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=6c9d5ad6ba1542d1ae71d2ceac533b17)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:33.294138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87e48f-42ae-4d59-a50a-7222e5700e43 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:33.294585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fe87e48f-42ae-4d59-a50a-7222e5700e43 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Invalidating token cache because consumer 6c9d5ad6ba1542d1ae71d2ceac533b17 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:41:33.295064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fe87e48f-42ae-4d59-a50a-7222e5700e43 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:33.295818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fe87e48f-42ae-4d59-a50a-7222e5700e43 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:33.410269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fe87e48f-42ae-4d59-a50a-7222e5700e43 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '6c9d5ad6ba1542d1ae71d2ceac533b17', 'request_id': 'req-fe87e48f-42ae-4d59-a50a-7222e5700e43'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:33.521285 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1966/3910] 10.222.0.20 () {58 vars in 1266 bytes} [Thu Oct 27 03:41:33 2022] DELETE /identity/v3/OS-OAUTH1/consumers/6c9d5ad6ba1542d1ae71d2ceac533b17 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:41:33.527315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229b43b-0896-4983-a44d-b0a055158250 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:33.536070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7229b43b-0896-4983-a44d-b0a055158250 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:33.557927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229b43b-0896-4983-a44d-b0a055158250 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:33.576682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f8aeb-f00b-4fe3-98d5-fd4de1615d51 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43800d115df5478090645f0241b22947', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c05d7d0fa0d34d84a02b673db5fd3d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:33.577680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f8aeb-f00b-4fe3-98d5-fd4de1615d51 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:33.578160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f8aeb-f00b-4fe3-98d5-fd4de1615d51 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:33.579073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f8aeb-f00b-4fe3-98d5-fd4de1615d51 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/87d83a664fad40c8bb146d303def1b62` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:33.580570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f8aeb-f00b-4fe3-98d5-fd4de1615d51 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=87d83a664fad40c8bb146d303def1b62)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:33.583045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f8aeb-f00b-4fe3-98d5-fd4de1615d51 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:33.583534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2d5f8aeb-f00b-4fe3-98d5-fd4de1615d51 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Invalidating token cache because consumer 87d83a664fad40c8bb146d303def1b62 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:41:33.585970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2d5f8aeb-f00b-4fe3-98d5-fd4de1615d51 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:33.585970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2d5f8aeb-f00b-4fe3-98d5-fd4de1615d51 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:33.691210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2d5f8aeb-f00b-4fe3-98d5-fd4de1615d51 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '87d83a664fad40c8bb146d303def1b62', 'request_id': 'req-2d5f8aeb-f00b-4fe3-98d5-fd4de1615d51'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:33.761679 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1945/3911] 10.222.0.20 () {58 vars in 1266 bytes} [Thu Oct 27 03:41:33 2022] DELETE /identity/v3/OS-OAUTH1/consumers/87d83a664fad40c8bb146d303def1b62 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:33.767032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87e48f-42ae-4d59-a50a-7222e5700e43 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:33.779417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87e48f-42ae-4d59-a50a-7222e5700e43 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:33.785999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beae427-ae09-43cf-a34d-5e04139be48e tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43800d115df5478090645f0241b22947', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c05d7d0fa0d34d84a02b673db5fd3d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:33.786865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beae427-ae09-43cf-a34d-5e04139be48e tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:33.787253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beae427-ae09-43cf-a34d-5e04139be48e tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:33.787637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beae427-ae09-43cf-a34d-5e04139be48e tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:33.789132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beae427-ae09-43cf-a34d-5e04139be48e tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:33.791192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beae427-ae09-43cf-a34d-5e04139be48e tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:33.882646 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1967/3912] 10.222.0.20 () {60 vars in 1185 bytes} [Thu Oct 27 03:41:33 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:33.888163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f8aeb-f00b-4fe3-98d5-fd4de1615d51 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:33.891541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2d5f8aeb-f00b-4fe3-98d5-fd4de1615d51 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:33.957267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f8aeb-f00b-4fe3-98d5-fd4de1615d51 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:33.972342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515435b-061e-4b6c-a35b-1c615782bac7 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43800d115df5478090645f0241b22947', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c05d7d0fa0d34d84a02b673db5fd3d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:33.973992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515435b-061e-4b6c-a35b-1c615782bac7 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:33.974489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515435b-061e-4b6c-a35b-1c615782bac7 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:33.975465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515435b-061e-4b6c-a35b-1c615782bac7 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/fcbb5a7803e5476e9b6fc9332a33527e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:33.977214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515435b-061e-4b6c-a35b-1c615782bac7 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=fcbb5a7803e5476e9b6fc9332a33527e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:33.978679 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-b515435b-061e-4b6c-a35b-1c615782bac7 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:41:33.978679 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:41:33.978679 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:41:33.979969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515435b-061e-4b6c-a35b-1c615782bac7 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:34.081352 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1946/3913] 10.222.0.20 () {60 vars in 1285 bytes} [Thu Oct 27 03:41:33 2022] PATCH /identity/v3/OS-OAUTH1/consumers/fcbb5a7803e5476e9b6fc9332a33527e => generated 221 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:41:34.086386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beae427-ae09-43cf-a34d-5e04139be48e tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:34.104817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beae427-ae09-43cf-a34d-5e04139be48e tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:34.116034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba61b2-1874-4731-9f85-bb740f5382e6 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43800d115df5478090645f0241b22947', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c05d7d0fa0d34d84a02b673db5fd3d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:34.118759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba61b2-1874-4731-9f85-bb740f5382e6 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:34.119099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba61b2-1874-4731-9f85-bb740f5382e6 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:34.119598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba61b2-1874-4731-9f85-bb740f5382e6 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/fcbb5a7803e5476e9b6fc9332a33527e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:34.120221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba61b2-1874-4731-9f85-bb740f5382e6 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=fcbb5a7803e5476e9b6fc9332a33527e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:34.124830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba61b2-1874-4731-9f85-bb740f5382e6 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:34.138805 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1968/3914] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:41:34 2022] GET /identity/v3/OS-OAUTH1/consumers/fcbb5a7803e5476e9b6fc9332a33527e => generated 221 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:34.153204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515435b-061e-4b6c-a35b-1c615782bac7 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:34.172286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515435b-061e-4b6c-a35b-1c615782bac7 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:34.184128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6263f22-0ba8-4b0a-b1cf-7ec99f8ae0d3 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43800d115df5478090645f0241b22947', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c05d7d0fa0d34d84a02b673db5fd3d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:34.184871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6263f22-0ba8-4b0a-b1cf-7ec99f8ae0d3 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:34.185103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6263f22-0ba8-4b0a-b1cf-7ec99f8ae0d3 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:34.185365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6263f22-0ba8-4b0a-b1cf-7ec99f8ae0d3 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/fcbb5a7803e5476e9b6fc9332a33527e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:34.186602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6263f22-0ba8-4b0a-b1cf-7ec99f8ae0d3 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=fcbb5a7803e5476e9b6fc9332a33527e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:34.187940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6263f22-0ba8-4b0a-b1cf-7ec99f8ae0d3 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:34.188221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f6263f22-0ba8-4b0a-b1cf-7ec99f8ae0d3 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Invalidating token cache because consumer fcbb5a7803e5476e9b6fc9332a33527e has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:41:34.189244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f6263f22-0ba8-4b0a-b1cf-7ec99f8ae0d3 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:34.190303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f6263f22-0ba8-4b0a-b1cf-7ec99f8ae0d3 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:34.267047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f6263f22-0ba8-4b0a-b1cf-7ec99f8ae0d3 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'fcbb5a7803e5476e9b6fc9332a33527e', 'request_id': 'req-f6263f22-0ba8-4b0a-b1cf-7ec99f8ae0d3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:34.307310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920fd24-1bd2-4744-acc6-8215af89a3b9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:34.308114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920fd24-1bd2-4744-acc6-8215af89a3b9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:34.308533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920fd24-1bd2-4744-acc6-8215af89a3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:34.349109 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1947/3915] 10.222.0.20 () {58 vars in 1266 bytes} [Thu Oct 27 03:41:34 2022] DELETE /identity/v3/OS-OAUTH1/consumers/fcbb5a7803e5476e9b6fc9332a33527e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:34.357187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6263f22-0ba8-4b0a-b1cf-7ec99f8ae0d3 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:34.359006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f6263f22-0ba8-4b0a-b1cf-7ec99f8ae0d3 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:34.379582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9920fd24-1bd2-4744-acc6-8215af89a3b9 None None] MFA Rules not processed for user `43172c9e71704c869a25181574d67b35`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:34.381336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9920fd24-1bd2-4744-acc6-8215af89a3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:34.476249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6263f22-0ba8-4b0a-b1cf-7ec99f8ae0d3 tempest-OAUTHConsumersV3Test-673113303 tempest-OAUTHConsumersV3Test-673113303-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:34.481390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76500557-11c8-4b5c-8faa-778d16b24376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:34.482443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76500557-11c8-4b5c-8faa-778d16b24376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:34.483665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76500557-11c8-4b5c-8faa-778d16b24376 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:34.483766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:34.483846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76500557-11c8-4b5c-8faa-778d16b24376 admin admin] PATH_INFO: `/v3/users/4e56aa7f828146f2a930fa236236bd1c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:34.484453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76500557-11c8-4b5c-8faa-778d16b24376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e56aa7f828146f2a930fa236236bd1c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:34.486570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76500557-11c8-4b5c-8faa-778d16b24376 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:34.488994 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1969/3916] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:34.499381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662759f-0ad0-4872-b990-06bca08266cf None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:34.499680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662759f-0ad0-4872-b990-06bca08266cf None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:34.499970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662759f-0ad0-4872-b990-06bca08266cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:34.520746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d662759f-0ad0-4872-b990-06bca08266cf None None] MFA Rules not processed for user `43172c9e71704c869a25181574d67b35`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:34.521962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d662759f-0ad0-4872-b990-06bca08266cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:34.530276 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1970/3917] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:41:34.544379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662759f-0ad0-4872-b990-06bca08266cf None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:34.545983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d662759f-0ad0-4872-b990-06bca08266cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:34.643464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662759f-0ad0-4872-b990-06bca08266cf None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:34.650610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb14996-60c0-4881-811b-548582600f9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:34.655581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb14996-60c0-4881-811b-548582600f9b service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:34.655581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb14996-60c0-4881-811b-548582600f9b service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:34.655581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb14996-60c0-4881-811b-548582600f9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:34.663924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb14996-60c0-4881-811b-548582600f9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:34.665513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb14996-60c0-4881-811b-548582600f9b service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:34.676863 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1971/3918] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:34 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:41:34.687698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=11,keystone:UPDATE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:34.690909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-76500557-11c8-4b5c-8faa-778d16b24376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e56aa7f828146f2a930fa236236bd1c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:34.692450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-76500557-11c8-4b5c-8faa-778d16b24376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e56aa7f828146f2a930fa236236bd1c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:34.713862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-76500557-11c8-4b5c-8faa-778d16b24376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e56aa7f828146f2a930fa236236bd1c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:34.740453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-76500557-11c8-4b5c-8faa-778d16b24376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e56aa7f828146f2a930fa236236bd1c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:34.856647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-76500557-11c8-4b5c-8faa-778d16b24376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e56aa7f828146f2a930fa236236bd1c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:34.864538 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1948/3919] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:41:34 2022] DELETE /identity/v3/users/4e56aa7f828146f2a930fa236236bd1c => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:34.870153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed8618-dfa7-45d9-8074-323267f6346b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:34.870785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed8618-dfa7-45d9-8074-323267f6346b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:34.871352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed8618-dfa7-45d9-8074-323267f6346b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:34.908276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7fed8618-dfa7-45d9-8074-323267f6346b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:34.909538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7fed8618-dfa7-45d9-8074-323267f6346b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:35.001161 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1972/3920] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:35.024494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76500557-11c8-4b5c-8faa-778d16b24376 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:35.026129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-76500557-11c8-4b5c-8faa-778d16b24376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:35.154499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76500557-11c8-4b5c-8faa-778d16b24376 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:35.162676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003ac1f-1200-4698-ad85-b7b0e8c4e3b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:35.164016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003ac1f-1200-4698-ad85-b7b0e8c4e3b7 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:35.167748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003ac1f-1200-4698-ad85-b7b0e8c4e3b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:35.168351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003ac1f-1200-4698-ad85-b7b0e8c4e3b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:35.207992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003ac1f-1200-4698-ad85-b7b0e8c4e3b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:35.213169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003ac1f-1200-4698-ad85-b7b0e8c4e3b7 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:35.233327 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1949/3921] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:41:35.838095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed8618-dfa7-45d9-8074-323267f6346b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:35.839699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7fed8618-dfa7-45d9-8074-323267f6346b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:35.994161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aa9cd-3116-43c2-8957-f26efdb5f8c7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:35.994703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aa9cd-3116-43c2-8957-f26efdb5f8c7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:35.994952 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aa9cd-3116-43c2-8957-f26efdb5f8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:36.025235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e72aa9cd-3116-43c2-8957-f26efdb5f8c7 None None] MFA Rules not processed for user `43172c9e71704c869a25181574d67b35`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:36.026690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e72aa9cd-3116-43c2-8957-f26efdb5f8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:36.027947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed8618-dfa7-45d9-8074-323267f6346b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:36.045041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1b322-fce4-40d9-9cd2-ab2d8792f76e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:36.045927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1b322-fce4-40d9-9cd2-ab2d8792f76e service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:36.046501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1b322-fce4-40d9-9cd2-ab2d8792f76e service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:36.046940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1b322-fce4-40d9-9cd2-ab2d8792f76e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:36.050237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-24f1b322-fce4-40d9-9cd2-ab2d8792f76e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:36.077782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1b322-fce4-40d9-9cd2-ab2d8792f76e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:36.081092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1b322-fce4-40d9-9cd2-ab2d8792f76e service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:36.117779 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1973/3922] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:41:36.153973 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1950/3923] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:41:36.219540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1b322-fce4-40d9-9cd2-ab2d8792f76e service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:36.222631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-24f1b322-fce4-40d9-9cd2-ab2d8792f76e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:36.248912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1b322-fce4-40d9-9cd2-ab2d8792f76e service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:36.254121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e0a99-3b7b-448e-9e23-83f398d68bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:36.255173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e0a99-3b7b-448e-9e23-83f398d68bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:36.258531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e0a99-3b7b-448e-9e23-83f398d68bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:36.258531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e0a99-3b7b-448e-9e23-83f398d68bf5 admin admin] PATH_INFO: `/v3/projects/3a050e5b20b3440a9ac82b8819a6008f` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:36.258531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e0a99-3b7b-448e-9e23-83f398d68bf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a050e5b20b3440a9ac82b8819a6008f)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:36.259922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e0a99-3b7b-448e-9e23-83f398d68bf5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:36.261909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:36.438256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c02e0a99-3b7b-448e-9e23-83f398d68bf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a050e5b20b3440a9ac82b8819a6008f', 'request_id': 'req-c02e0a99-3b7b-448e-9e23-83f398d68bf5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:36.454733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c02e0a99-3b7b-448e-9e23-83f398d68bf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a050e5b20b3440a9ac82b8819a6008f', 'request_id': 'req-c02e0a99-3b7b-448e-9e23-83f398d68bf5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:36.470159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c02e0a99-3b7b-448e-9e23-83f398d68bf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a050e5b20b3440a9ac82b8819a6008f', 'request_id': 'req-c02e0a99-3b7b-448e-9e23-83f398d68bf5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:36.609750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c02e0a99-3b7b-448e-9e23-83f398d68bf5 admin admin] The token cache is being invalidate because project 3a050e5b20b3440a9ac82b8819a6008f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:41:36.610090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c02e0a99-3b7b-448e-9e23-83f398d68bf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:36.610823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c02e0a99-3b7b-448e-9e23-83f398d68bf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:36.616189 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1974/3924] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:41:36 2022] DELETE /identity/v3/projects/3a050e5b20b3440a9ac82b8819a6008f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:36.617773 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72aa9cd-3116-43c2-8957-f26efdb5f8c7 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:36.651838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72aa9cd-3116-43c2-8957-f26efdb5f8c7 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:36.767627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b03e5-9e43-4dbb-9449-b76dc375d8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:36.768562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b03e5-9e43-4dbb-9449-b76dc375d8ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:36.768988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b03e5-9e43-4dbb-9449-b76dc375d8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:36.769320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b03e5-9e43-4dbb-9449-b76dc375d8ff admin admin] PATH_INFO: `/v3/users/43800d115df5478090645f0241b22947` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:36.771277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b03e5-9e43-4dbb-9449-b76dc375d8ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=43800d115df5478090645f0241b22947)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:36.774998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b03e5-9e43-4dbb-9449-b76dc375d8ff admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:36.787314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:37.000909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d25b03e5-9e43-4dbb-9449-b76dc375d8ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43800d115df5478090645f0241b22947'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:37.002472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d25b03e5-9e43-4dbb-9449-b76dc375d8ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43800d115df5478090645f0241b22947'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:37.012443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d25b03e5-9e43-4dbb-9449-b76dc375d8ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43800d115df5478090645f0241b22947'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:37.027102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d25b03e5-9e43-4dbb-9449-b76dc375d8ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43800d115df5478090645f0241b22947'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:37.123820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d25b03e5-9e43-4dbb-9449-b76dc375d8ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43800d115df5478090645f0241b22947'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:37.135310 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1951/3925] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:41:36 2022] DELETE /identity/v3/users/43800d115df5478090645f0241b22947 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:37.500164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e0a99-3b7b-448e-9e23-83f398d68bf5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:37.502155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c02e0a99-3b7b-448e-9e23-83f398d68bf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:37.635300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e0a99-3b7b-448e-9e23-83f398d68bf5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:37.864513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95dcc46-04b3-444a-aa97-5ff0873c8af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:37.865450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dcc46-04b3-444a-aa97-5ff0873c8af9 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:37.881619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dcc46-04b3-444a-aa97-5ff0873c8af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:37.882178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dcc46-04b3-444a-aa97-5ff0873c8af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:37.885839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a95dcc46-04b3-444a-aa97-5ff0873c8af9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:37.975882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:37.989442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95dcc46-04b3-444a-aa97-5ff0873c8af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:37.994774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95dcc46-04b3-444a-aa97-5ff0873c8af9 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:38.010365 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1975/3926] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:41:38.382949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b03e5-9e43-4dbb-9449-b76dc375d8ff admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:38.389003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d25b03e5-9e43-4dbb-9449-b76dc375d8ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:38.458291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b03e5-9e43-4dbb-9449-b76dc375d8ff admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:38.483537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efe877-9d7b-44f7-b8fc-4488a7370829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:38.484514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efe877-9d7b-44f7-b8fc-4488a7370829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:38.485009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efe877-9d7b-44f7-b8fc-4488a7370829 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:38.485904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efe877-9d7b-44f7-b8fc-4488a7370829 admin admin] PATH_INFO: `/v3/projects/c05d7d0fa0d34d84a02b673db5fd3d37` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:38.487787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efe877-9d7b-44f7-b8fc-4488a7370829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c05d7d0fa0d34d84a02b673db5fd3d37)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:38.492494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efe877-9d7b-44f7-b8fc-4488a7370829 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:38.618220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-92efe877-9d7b-44f7-b8fc-4488a7370829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c05d7d0fa0d34d84a02b673db5fd3d37', 'request_id': 'req-92efe877-9d7b-44f7-b8fc-4488a7370829'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:38.693584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-92efe877-9d7b-44f7-b8fc-4488a7370829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c05d7d0fa0d34d84a02b673db5fd3d37', 'request_id': 'req-92efe877-9d7b-44f7-b8fc-4488a7370829'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:38.714393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-92efe877-9d7b-44f7-b8fc-4488a7370829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c05d7d0fa0d34d84a02b673db5fd3d37', 'request_id': 'req-92efe877-9d7b-44f7-b8fc-4488a7370829'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:38.749185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-92efe877-9d7b-44f7-b8fc-4488a7370829 admin admin] The token cache is being invalidate because project c05d7d0fa0d34d84a02b673db5fd3d37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:41:38.749875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-92efe877-9d7b-44f7-b8fc-4488a7370829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:38.752816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-92efe877-9d7b-44f7-b8fc-4488a7370829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:38.757300 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1952/3927] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:41:38 2022] DELETE /identity/v3/projects/c05d7d0fa0d34d84a02b673db5fd3d37 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:38.762013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74382f7e-ff94-411f-a243-2dd32da6751c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:38.762627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74382f7e-ff94-411f-a243-2dd32da6751c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:38.762736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74382f7e-ff94-411f-a243-2dd32da6751c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:38.800938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-74382f7e-ff94-411f-a243-2dd32da6751c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:38.802234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-74382f7e-ff94-411f-a243-2dd32da6751c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:38.914081 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1976/3928] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:38.921441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596ac19-b126-4ffe-b9ac-f77df5df2836 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:38.921441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596ac19-b126-4ffe-b9ac-f77df5df2836 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:38.921695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596ac19-b126-4ffe-b9ac-f77df5df2836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:38.979785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5596ac19-b126-4ffe-b9ac-f77df5df2836 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:38.982202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5596ac19-b126-4ffe-b9ac-f77df5df2836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:39.007290 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1953/3929] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:39.019446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74382f7e-ff94-411f-a243-2dd32da6751c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:39.035111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74382f7e-ff94-411f-a243-2dd32da6751c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:39.045681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f737b4-fb35-41e0-a393-e648c7218d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:39.046694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f737b4-fb35-41e0-a393-e648c7218d90 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:39.047132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f737b4-fb35-41e0-a393-e648c7218d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:39.047563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f737b4-fb35-41e0-a393-e648c7218d90 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:39.048404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f737b4-fb35-41e0-a393-e648c7218d90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:41:39.048877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f737b4-fb35-41e0-a393-e648c7218d90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:39.050896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f737b4-fb35-41e0-a393-e648c7218d90 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:39.067568 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1977/3930] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:39.073270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596ac19-b126-4ffe-b9ac-f77df5df2836 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:39.091213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596ac19-b126-4ffe-b9ac-f77df5df2836 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:39.105241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2df14-5d46-4fcd-a5a4-d22a6da70818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:39.105900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2df14-5d46-4fcd-a5a4-d22a6da70818 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:39.109828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2df14-5d46-4fcd-a5a4-d22a6da70818 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:39.110186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2df14-5d46-4fcd-a5a4-d22a6da70818 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:39.111828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2df14-5d46-4fcd-a5a4-d22a6da70818 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:39.113787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2df14-5d46-4fcd-a5a4-d22a6da70818 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:39.253387 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1954/3931] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:41:39 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:39.258244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f737b4-fb35-41e0-a393-e648c7218d90 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:39.274252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f737b4-fb35-41e0-a393-e648c7218d90 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:39.428497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53cd1b-5f19-4217-ac20-16553a79460a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:39.429652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53cd1b-5f19-4217-ac20-16553a79460a admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:39.429944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53cd1b-5f19-4217-ac20-16553a79460a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:39.430252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53cd1b-5f19-4217-ac20-16553a79460a admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:39.430898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53cd1b-5f19-4217-ac20-16553a79460a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:39.437141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53cd1b-5f19-4217-ac20-16553a79460a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:39.549552 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1978/3932] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:41:39 2022] POST /identity/v3/users => generated 289 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:39.552526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2df14-5d46-4fcd-a5a4-d22a6da70818 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:39.565051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2df14-5d46-4fcd-a5a4-d22a6da70818 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:39.580063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c507ff4-7074-4416-8a9d-96d1776f2435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:39.581440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c507ff4-7074-4416-8a9d-96d1776f2435 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:39.581732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c507ff4-7074-4416-8a9d-96d1776f2435 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:39.582011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c507ff4-7074-4416-8a9d-96d1776f2435 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:39.584530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c507ff4-7074-4416-8a9d-96d1776f2435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:39.588943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c507ff4-7074-4416-8a9d-96d1776f2435 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:39.611789 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1955/3933] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:41:39.612969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53cd1b-5f19-4217-ac20-16553a79460a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:39.643852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53cd1b-5f19-4217-ac20-16553a79460a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:39.653320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86afce1-2a3f-400f-b2fc-40f0ccc44ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:39.654689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86afce1-2a3f-400f-b2fc-40f0ccc44ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:39.655272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86afce1-2a3f-400f-b2fc-40f0ccc44ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:39.655672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86afce1-2a3f-400f-b2fc-40f0ccc44ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:39.656534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86afce1-2a3f-400f-b2fc-40f0ccc44ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:39.659208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86afce1-2a3f-400f-b2fc-40f0ccc44ca6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:39.676820 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1979/3934] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:41:39.728018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c507ff4-7074-4416-8a9d-96d1776f2435 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:39.728018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c507ff4-7074-4416-8a9d-96d1776f2435 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:39.728018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ad2b1-ab07-461c-8da0-aab9ec98727a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:39.728018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ad2b1-ab07-461c-8da0-aab9ec98727a admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:39.729675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ad2b1-ab07-461c-8da0-aab9ec98727a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:39.729675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ad2b1-ab07-461c-8da0-aab9ec98727a admin admin] PATH_INFO: `/v3/projects/e08a4aae1ebe48e98f94161bd98e4dae/users/25da8599f0074280943c3bca834f3345/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:39.778584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ad2b1-ab07-461c-8da0-aab9ec98727a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08a4aae1ebe48e98f94161bd98e4dae, user_id=25da8599f0074280943c3bca834f3345, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:39.791934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ad2b1-ab07-461c-8da0-aab9ec98727a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:39.904971 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1956/3935] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:41:39 2022] PUT /identity/v3/projects/e08a4aae1ebe48e98f94161bd98e4dae/users/25da8599f0074280943c3bca834f3345/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:39.919420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850cd28-9359-4074-a6d2-69e3e2d18f8d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:39.923180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850cd28-9359-4074-a6d2-69e3e2d18f8d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:39.923707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850cd28-9359-4074-a6d2-69e3e2d18f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:39.997575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4850cd28-9359-4074-a6d2-69e3e2d18f8d None None] MFA Rules not processed for user `25da8599f0074280943c3bca834f3345`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:39.997575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4850cd28-9359-4074-a6d2-69e3e2d18f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:40.148199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:40.209993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ad2b1-ab07-461c-8da0-aab9ec98727a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:40.212749 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1980/3936] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:40.225322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ad2b1-ab07-461c-8da0-aab9ec98727a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:40.237507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdea46-0d5a-44f2-8f0a-957edc8ae8c9 tempest-DefaultDomainTestJSON-693602160 tempest-DefaultDomainTestJSON-693602160-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25da8599f0074280943c3bca834f3345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e08a4aae1ebe48e98f94161bd98e4dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:40.238392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdea46-0d5a-44f2-8f0a-957edc8ae8c9 tempest-DefaultDomainTestJSON-693602160 tempest-DefaultDomainTestJSON-693602160-project] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:40.238668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdea46-0d5a-44f2-8f0a-957edc8ae8c9 tempest-DefaultDomainTestJSON-693602160 tempest-DefaultDomainTestJSON-693602160-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:40.238955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdea46-0d5a-44f2-8f0a-957edc8ae8c9 tempest-DefaultDomainTestJSON-693602160 tempest-DefaultDomainTestJSON-693602160-project] PATH_INFO: `/v3/domains/default` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:40.242860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdea46-0d5a-44f2-8f0a-957edc8ae8c9 tempest-DefaultDomainTestJSON-693602160 tempest-DefaultDomainTestJSON-693602160-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:40.244627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdea46-0d5a-44f2-8f0a-957edc8ae8c9 tempest-DefaultDomainTestJSON-693602160 tempest-DefaultDomainTestJSON-693602160-project] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:40.246371 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1957/3937] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:41:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:40.251663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850cd28-9359-4074-a6d2-69e3e2d18f8d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:40.392040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850cd28-9359-4074-a6d2-69e3e2d18f8d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:40.403029 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c0437-9372-4d7f-abb5-2c803d0577b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:40.407971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c0437-9372-4d7f-abb5-2c803d0577b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:40.407971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c0437-9372-4d7f-abb5-2c803d0577b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:40.407971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c0437-9372-4d7f-abb5-2c803d0577b3 admin admin] PATH_INFO: `/v3/users/25da8599f0074280943c3bca834f3345` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:40.408273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c0437-9372-4d7f-abb5-2c803d0577b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25da8599f0074280943c3bca834f3345)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:40.412048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c0437-9372-4d7f-abb5-2c803d0577b3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:40.595765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85071b5-0d31-4c4f-ab04-8da5bbc578ec None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:40.596660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85071b5-0d31-4c4f-ab04-8da5bbc578ec None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:40.597100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85071b5-0d31-4c4f-ab04-8da5bbc578ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:40.604761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=17,keystone:SELECT=79,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:40.676912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-190c0437-9372-4d7f-abb5-2c803d0577b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25da8599f0074280943c3bca834f3345'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:40.678744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-190c0437-9372-4d7f-abb5-2c803d0577b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25da8599f0074280943c3bca834f3345'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:40.718084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-190c0437-9372-4d7f-abb5-2c803d0577b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25da8599f0074280943c3bca834f3345'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:40.774277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-190c0437-9372-4d7f-abb5-2c803d0577b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25da8599f0074280943c3bca834f3345'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:40.786732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-190c0437-9372-4d7f-abb5-2c803d0577b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25da8599f0074280943c3bca834f3345'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:40.831769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d85071b5-0d31-4c4f-ab04-8da5bbc578ec None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:40.833212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d85071b5-0d31-4c4f-ab04-8da5bbc578ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:40.872029 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1981/3938] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:41:40 2022] DELETE /identity/v3/users/25da8599f0074280943c3bca834f3345 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:40.876774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55de6d9-efd6-4837-b0c2-8c4d5d8e5b05 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:40.876980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55de6d9-efd6-4837-b0c2-8c4d5d8e5b05 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:40.877315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55de6d9-efd6-4837-b0c2-8c4d5d8e5b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:40.926552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e55de6d9-efd6-4837-b0c2-8c4d5d8e5b05 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:40.930419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e55de6d9-efd6-4837-b0c2-8c4d5d8e5b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:40.999040 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1958/3939] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:41:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:41:41.009269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85071b5-0d31-4c4f-ab04-8da5bbc578ec None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:41.010768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d85071b5-0d31-4c4f-ab04-8da5bbc578ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:41.047210 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1982/3940] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:41.058059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55de6d9-efd6-4837-b0c2-8c4d5d8e5b05 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:41.060507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e55de6d9-efd6-4837-b0c2-8c4d5d8e5b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:41.098357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:41.221613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55de6d9-efd6-4837-b0c2-8c4d5d8e5b05 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:41.228484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d8414-1e67-493b-bd1f-f0178eb0dce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:41.229299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d8414-1e67-493b-bd1f-f0178eb0dce7 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:41.229744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d8414-1e67-493b-bd1f-f0178eb0dce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:41.230392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d8414-1e67-493b-bd1f-f0178eb0dce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:41.253380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85071b5-0d31-4c4f-ab04-8da5bbc578ec None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:41.272878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d8414-1e67-493b-bd1f-f0178eb0dce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:41.276981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d8414-1e67-493b-bd1f-f0178eb0dce7 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:41.299008 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1983/3941] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:41:41.382900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:41.400712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912fdd8-115d-4e77-8b5b-a3215a3805bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:41.401411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912fdd8-115d-4e77-8b5b-a3215a3805bd service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:41.401702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912fdd8-115d-4e77-8b5b-a3215a3805bd service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:41.401980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912fdd8-115d-4e77-8b5b-a3215a3805bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:41.556586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912fdd8-115d-4e77-8b5b-a3215a3805bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:41.559179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912fdd8-115d-4e77-8b5b-a3215a3805bd service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:41.588201 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1959/3942] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:41:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:41:43.225755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d8414-1e67-493b-bd1f-f0178eb0dce7 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:43.225755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b61d8414-1e67-493b-bd1f-f0178eb0dce7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:43.246663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d8414-1e67-493b-bd1f-f0178eb0dce7 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:43.284645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282e367-2f90-4480-800c-358ca123c4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:43.285493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282e367-2f90-4480-800c-358ca123c4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:43.285880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282e367-2f90-4480-800c-358ca123c4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:43.286365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282e367-2f90-4480-800c-358ca123c4c8 admin admin] PATH_INFO: `/v3/projects/e08a4aae1ebe48e98f94161bd98e4dae` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:43.291792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282e367-2f90-4480-800c-358ca123c4c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e08a4aae1ebe48e98f94161bd98e4dae)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:43.319267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282e367-2f90-4480-800c-358ca123c4c8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:43.581944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e282e367-2f90-4480-800c-358ca123c4c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08a4aae1ebe48e98f94161bd98e4dae', 'request_id': 'req-e282e367-2f90-4480-800c-358ca123c4c8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:43.594411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e282e367-2f90-4480-800c-358ca123c4c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08a4aae1ebe48e98f94161bd98e4dae', 'request_id': 'req-e282e367-2f90-4480-800c-358ca123c4c8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:43.605141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e282e367-2f90-4480-800c-358ca123c4c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08a4aae1ebe48e98f94161bd98e4dae', 'request_id': 'req-e282e367-2f90-4480-800c-358ca123c4c8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:43.704170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e282e367-2f90-4480-800c-358ca123c4c8 admin admin] The token cache is being invalidate because project e08a4aae1ebe48e98f94161bd98e4dae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:41:43.704711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e282e367-2f90-4480-800c-358ca123c4c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:43.705852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e282e367-2f90-4480-800c-358ca123c4c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:43.716030 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1984/3943] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:41:43 2022] DELETE /identity/v3/projects/e08a4aae1ebe48e98f94161bd98e4dae => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:43.717181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d45191-6758-4290-a2e4-029bd0fb1fc7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:43.717641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d45191-6758-4290-a2e4-029bd0fb1fc7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:43.717724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d45191-6758-4290-a2e4-029bd0fb1fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:43.775059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-39d45191-6758-4290-a2e4-029bd0fb1fc7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:43.776643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-39d45191-6758-4290-a2e4-029bd0fb1fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:43.872387 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1960/3944] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:43.879900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ad361-12b7-4f61-bb17-c8a9f55c5d44 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:43.880181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ad361-12b7-4f61-bb17-c8a9f55c5d44 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:43.880468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ad361-12b7-4f61-bb17-c8a9f55c5d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:43.963571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-bd0ad361-12b7-4f61-bb17-c8a9f55c5d44 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:43.964867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bd0ad361-12b7-4f61-bb17-c8a9f55c5d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:43.987423 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1985/3945] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:41:43.989025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d45191-6758-4290-a2e4-029bd0fb1fc7 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:44.019630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d45191-6758-4290-a2e4-029bd0fb1fc7 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:44.031669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd5c52-f13b-4b58-89b3-363157add585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:44.032416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd5c52-f13b-4b58-89b3-363157add585 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:44.032798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd5c52-f13b-4b58-89b3-363157add585 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:44.033492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd5c52-f13b-4b58-89b3-363157add585 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:44.034309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd5c52-f13b-4b58-89b3-363157add585 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:41:44.034732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd5c52-f13b-4b58-89b3-363157add585 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:44.036817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd5c52-f13b-4b58-89b3-363157add585 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:44.058550 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1961/3946] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:44.059195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ad361-12b7-4f61-bb17-c8a9f55c5d44 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:44.069108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ad361-12b7-4f61-bb17-c8a9f55c5d44 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:44.079652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1991b3-17a1-4093-89e9-1500ccd8cd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:44.080060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1991b3-17a1-4093-89e9-1500ccd8cd90 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:44.080368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1991b3-17a1-4093-89e9-1500ccd8cd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:44.080812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1991b3-17a1-4093-89e9-1500ccd8cd90 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:44.081700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1991b3-17a1-4093-89e9-1500ccd8cd90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:44.084140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1991b3-17a1-4093-89e9-1500ccd8cd90 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:44.211659 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1986/3947] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:41:44 2022] POST /identity/v3/projects => generated 369 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:44.213048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd5c52-f13b-4b58-89b3-363157add585 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:44.227231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd5c52-f13b-4b58-89b3-363157add585 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:44.317583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22a87b-dc48-48bc-9232-d1b66fbf9ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:44.318502 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22a87b-dc48-48bc-9232-d1b66fbf9ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:44.318956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22a87b-dc48-48bc-9232-d1b66fbf9ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:44.319234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22a87b-dc48-48bc-9232-d1b66fbf9ab6 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:44.320663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22a87b-dc48-48bc-9232-d1b66fbf9ab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:44.324983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22a87b-dc48-48bc-9232-d1b66fbf9ab6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:44.468697 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1962/3948] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:41:44 2022] POST /identity/v3/users => generated 285 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:44.472798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1991b3-17a1-4093-89e9-1500ccd8cd90 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:44.491126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1991b3-17a1-4093-89e9-1500ccd8cd90 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:44.503265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea83868-3538-481d-a869-1611f2bbad57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:44.505393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea83868-3538-481d-a869-1611f2bbad57 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:44.506537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea83868-3538-481d-a869-1611f2bbad57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:44.508455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea83868-3538-481d-a869-1611f2bbad57 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:44.510530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea83868-3538-481d-a869-1611f2bbad57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:44.517680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea83868-3538-481d-a869-1611f2bbad57 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:44.539727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22a87b-dc48-48bc-9232-d1b66fbf9ab6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:44.549994 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1987/3949] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:41:44.552551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22a87b-dc48-48bc-9232-d1b66fbf9ab6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:44.562127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e574559-6303-4933-96ea-ecdbdb84df1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:44.564789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e574559-6303-4933-96ea-ecdbdb84df1f admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:44.565137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e574559-6303-4933-96ea-ecdbdb84df1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:44.565597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e574559-6303-4933-96ea-ecdbdb84df1f admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:44.566806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e574559-6303-4933-96ea-ecdbdb84df1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:44.569384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e574559-6303-4933-96ea-ecdbdb84df1f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:44.590344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea83868-3538-481d-a869-1611f2bbad57 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:44.598324 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1963/3950] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:41:44.605329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea83868-3538-481d-a869-1611f2bbad57 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:44.621199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe27f5f-7cf2-4f64-b130-6d95642c05d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:44.622295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe27f5f-7cf2-4f64-b130-6d95642c05d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:44.622829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe27f5f-7cf2-4f64-b130-6d95642c05d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:44.623325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe27f5f-7cf2-4f64-b130-6d95642c05d4 admin admin] PATH_INFO: `/v3/projects/1f10e671f81a4c61ac314862e06555b5/users/19aa990501b443d5b7fe6295ad1384d8/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:44.659293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe27f5f-7cf2-4f64-b130-6d95642c05d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f10e671f81a4c61ac314862e06555b5, user_id=19aa990501b443d5b7fe6295ad1384d8, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:44.662391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe27f5f-7cf2-4f64-b130-6d95642c05d4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:44.771504 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1988/3951] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:41:44 2022] PUT /identity/v3/projects/1f10e671f81a4c61ac314862e06555b5/users/19aa990501b443d5b7fe6295ad1384d8/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:44.786832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636f721-0823-4e72-9522-fcc24d412c31 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:44.787368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636f721-0823-4e72-9522-fcc24d412c31 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:44.787613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636f721-0823-4e72-9522-fcc24d412c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:44.821460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:44.865656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6636f721-0823-4e72-9522-fcc24d412c31 None None] MFA Rules not processed for user `19aa990501b443d5b7fe6295ad1384d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:44.866995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6636f721-0823-4e72-9522-fcc24d412c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:45.011932 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1964/3952] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:45.018224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe27f5f-7cf2-4f64-b130-6d95642c05d4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:45.037203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe27f5f-7cf2-4f64-b130-6d95642c05d4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:45.053398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeec7b0-4c17-428a-a39e-3ca6e691c45a tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19aa990501b443d5b7fe6295ad1384d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f10e671f81a4c61ac314862e06555b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:45.054838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeec7b0-4c17-428a-a39e-3ca6e691c45a tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:45.055132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeec7b0-4c17-428a-a39e-3ca6e691c45a tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:45.055433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeec7b0-4c17-428a-a39e-3ca6e691c45a tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] PATH_INFO: `/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:45.056062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeec7b0-4c17-428a-a39e-3ca6e691c45a tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=19aa990501b443d5b7fe6295ad1384d8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:45.058155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeec7b0-4c17-428a-a39e-3ca6e691c45a tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:45.155250 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1989/3953] 10.222.0.20 () {60 vars in 1299 bytes} [Thu Oct 27 03:41:45 2022] POST /identity/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2 => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:45.160208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636f721-0823-4e72-9522-fcc24d412c31 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:45.183418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636f721-0823-4e72-9522-fcc24d412c31 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:45.206017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045906e0-dd06-457a-93c5-019b38361a28 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19aa990501b443d5b7fe6295ad1384d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f10e671f81a4c61ac314862e06555b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:45.209331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045906e0-dd06-457a-93c5-019b38361a28 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:45.211367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045906e0-dd06-457a-93c5-019b38361a28 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:45.211999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045906e0-dd06-457a-93c5-019b38361a28 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] PATH_INFO: `/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2/7c5f94e5e816480199af0501d7e434e1` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:45.222346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045906e0-dd06-457a-93c5-019b38361a28 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=19aa990501b443d5b7fe6295ad1384d8, credential_id=7c5f94e5e816480199af0501d7e434e1)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:45.230613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045906e0-dd06-457a-93c5-019b38361a28 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:45.383299 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1965/3954] 10.222.0.20 () {58 vars in 1380 bytes} [Thu Oct 27 03:41:45 2022] DELETE /identity/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2/7c5f94e5e816480199af0501d7e434e1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:45.388310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeec7b0-4c17-428a-a39e-3ca6e691c45a tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:45.407505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeec7b0-4c17-428a-a39e-3ca6e691c45a tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:45.417970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962afa54-56b8-4995-8c5f-899a70167d16 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19aa990501b443d5b7fe6295ad1384d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f10e671f81a4c61ac314862e06555b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:45.418971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962afa54-56b8-4995-8c5f-899a70167d16 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:45.419239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962afa54-56b8-4995-8c5f-899a70167d16 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:45.419559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962afa54-56b8-4995-8c5f-899a70167d16 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] PATH_INFO: `/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:45.420200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962afa54-56b8-4995-8c5f-899a70167d16 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=19aa990501b443d5b7fe6295ad1384d8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:45.421743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962afa54-56b8-4995-8c5f-899a70167d16 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:45.539188 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1990/3955] 10.222.0.20 () {60 vars in 1299 bytes} [Thu Oct 27 03:41:45 2022] POST /identity/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2 => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:45.539763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045906e0-dd06-457a-93c5-019b38361a28 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:45.553082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045906e0-dd06-457a-93c5-019b38361a28 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:45.561751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f0f54-7d91-434d-ac6e-ccdf34735851 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19aa990501b443d5b7fe6295ad1384d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f10e671f81a4c61ac314862e06555b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:45.563459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f0f54-7d91-434d-ac6e-ccdf34735851 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:45.563751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f0f54-7d91-434d-ac6e-ccdf34735851 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:45.564782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f0f54-7d91-434d-ac6e-ccdf34735851 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] PATH_INFO: `/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2/44b3d02805ed4d06a10d85dba387db16` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:45.569010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f0f54-7d91-434d-ac6e-ccdf34735851 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=19aa990501b443d5b7fe6295ad1384d8, credential_id=44b3d02805ed4d06a10d85dba387db16)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:45.570947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f0f54-7d91-434d-ac6e-ccdf34735851 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:45.680435 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1966/3956] 10.222.0.20 () {58 vars in 1380 bytes} [Thu Oct 27 03:41:45 2022] DELETE /identity/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2/44b3d02805ed4d06a10d85dba387db16 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:45.684973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962afa54-56b8-4995-8c5f-899a70167d16 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:45.706419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962afa54-56b8-4995-8c5f-899a70167d16 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:45.720850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d2b10-9c76-41d9-8573-cdb8b389e353 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19aa990501b443d5b7fe6295ad1384d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f10e671f81a4c61ac314862e06555b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:45.721604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d2b10-9c76-41d9-8573-cdb8b389e353 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:45.738603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d2b10-9c76-41d9-8573-cdb8b389e353 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:45.738902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d2b10-9c76-41d9-8573-cdb8b389e353 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] PATH_INFO: `/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2/44b3d02805ed4d06a10d85dba387db16` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:45.752122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:45.786348 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-930d2b10-9c76-41d9-8573-cdb8b389e353 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Could not find credential: c8c320aefa073d75f3c0176a7a6acfe6f7e160e4320db0ce6fc9eec4934df269.: keystone.exception.CredentialNotFound: Could not find credential: c8c320aefa073d75f3c0176a7a6acfe6f7e160e4320db0ce6fc9eec4934df269. Oct 27 03:41:45.786348 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:41:45.786348 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:41:45.786348 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:41:45.786348 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:41:45.786348 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:41:45.786348 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:41:45.786348 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:41:45.786348 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:41:45.786348 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:41:45.786348 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:41:45.786348 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:41:45.786348 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Oct 27 03:41:45.786348 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 27 03:41:45.787487 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 27 03:41:45.787487 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 27 03:41:45.787487 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Oct 27 03:41:45.787487 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Oct 27 03:41:45.787487 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:41:45.787487 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:41:45.787487 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Oct 27 03:41:45.787487 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Oct 27 03:41:45.787487 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:41:45.787487 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:41:45.787487 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:41:45.787487 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:41:45.787487 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:41:45.787487 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:41:45.787487 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:41:45.787487 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:41:45.789132 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:41:45.789132 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:41:45.789132 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:41:45.789132 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:41:45.789132 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:41:45.789132 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:41:45.789132 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Oct 27 03:41:45.789132 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Oct 27 03:41:45.789132 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Oct 27 03:41:45.789132 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Oct 27 03:41:45.789132 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Oct 27 03:41:45.789132 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Oct 27 03:41:45.789132 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: c8c320aefa073d75f3c0176a7a6acfe6f7e160e4320db0ce6fc9eec4934df269. Oct 27 03:41:45.789132 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:41:45.796359 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1991/3957] 10.222.0.20 () {58 vars in 1377 bytes} [Thu Oct 27 03:41:45 2022] GET /identity/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2/44b3d02805ed4d06a10d85dba387db16 => generated 148 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:41:45.797098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f0f54-7d91-434d-ac6e-ccdf34735851 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:45.820347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f0f54-7d91-434d-ac6e-ccdf34735851 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:45.836477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e53c9-a945-4331-9356-765b7b10b7bf tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19aa990501b443d5b7fe6295ad1384d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f10e671f81a4c61ac314862e06555b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:45.837278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e53c9-a945-4331-9356-765b7b10b7bf tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:45.837629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e53c9-a945-4331-9356-765b7b10b7bf tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:45.837912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e53c9-a945-4331-9356-765b7b10b7bf tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] PATH_INFO: `/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:45.838762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e53c9-a945-4331-9356-765b7b10b7bf tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=19aa990501b443d5b7fe6295ad1384d8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:45.840558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e53c9-a945-4331-9356-765b7b10b7bf tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:45.936626 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1967/3958] 10.222.0.20 () {60 vars in 1299 bytes} [Thu Oct 27 03:41:45 2022] POST /identity/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2 => generated 367 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:41:45.940621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d2b10-9c76-41d9-8573-cdb8b389e353 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:45.956141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d2b10-9c76-41d9-8573-cdb8b389e353 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:45.963792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485c2e1-ee2b-49d1-9b0f-7e159b61a143 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19aa990501b443d5b7fe6295ad1384d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f10e671f81a4c61ac314862e06555b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:45.965926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485c2e1-ee2b-49d1-9b0f-7e159b61a143 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:45.971616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485c2e1-ee2b-49d1-9b0f-7e159b61a143 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:45.972128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485c2e1-ee2b-49d1-9b0f-7e159b61a143 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] PATH_INFO: `/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:45.972998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485c2e1-ee2b-49d1-9b0f-7e159b61a143 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=19aa990501b443d5b7fe6295ad1384d8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:45.974841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485c2e1-ee2b-49d1-9b0f-7e159b61a143 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:46.063262 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1992/3959] 10.222.0.20 () {60 vars in 1299 bytes} [Thu Oct 27 03:41:45 2022] POST /identity/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2 => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:41:46.064550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e53c9-a945-4331-9356-765b7b10b7bf tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:46.086054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e53c9-a945-4331-9356-765b7b10b7bf tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:46.108394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11316b5-6d3d-486f-99f2-550261b01394 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19aa990501b443d5b7fe6295ad1384d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f10e671f81a4c61ac314862e06555b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:46.113097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11316b5-6d3d-486f-99f2-550261b01394 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:46.113097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11316b5-6d3d-486f-99f2-550261b01394 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:46.113097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11316b5-6d3d-486f-99f2-550261b01394 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] PATH_INFO: `/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:46.113097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11316b5-6d3d-486f-99f2-550261b01394 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=19aa990501b443d5b7fe6295ad1384d8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:46.113097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11316b5-6d3d-486f-99f2-550261b01394 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:46.151723 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1968/3960] 10.222.0.20 () {58 vars in 1278 bytes} [Thu Oct 27 03:41:46 2022] GET /identity/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2 => generated 865 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:46.152731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485c2e1-ee2b-49d1-9b0f-7e159b61a143 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:46.174502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485c2e1-ee2b-49d1-9b0f-7e159b61a143 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:46.201667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97842d-73b1-4809-ae9b-cf6d2e52b52f tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19aa990501b443d5b7fe6295ad1384d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f10e671f81a4c61ac314862e06555b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:46.203585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97842d-73b1-4809-ae9b-cf6d2e52b52f tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:46.205259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97842d-73b1-4809-ae9b-cf6d2e52b52f tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:46.205613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97842d-73b1-4809-ae9b-cf6d2e52b52f tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] PATH_INFO: `/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2/e2eff0e1d11e4ea9bf4bb501e55997b2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:46.218475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97842d-73b1-4809-ae9b-cf6d2e52b52f tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=19aa990501b443d5b7fe6295ad1384d8, credential_id=e2eff0e1d11e4ea9bf4bb501e55997b2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:46.228203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97842d-73b1-4809-ae9b-cf6d2e52b52f tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:46.342642 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1993/3961] 10.222.0.20 () {58 vars in 1380 bytes} [Thu Oct 27 03:41:46 2022] DELETE /identity/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2/e2eff0e1d11e4ea9bf4bb501e55997b2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:46.347783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11316b5-6d3d-486f-99f2-550261b01394 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:46.365317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11316b5-6d3d-486f-99f2-550261b01394 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:46.389646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf718b3-568d-41db-a533-601a42078ed7 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19aa990501b443d5b7fe6295ad1384d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f10e671f81a4c61ac314862e06555b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:46.390364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf718b3-568d-41db-a533-601a42078ed7 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:46.390660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf718b3-568d-41db-a533-601a42078ed7 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:46.390984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf718b3-568d-41db-a533-601a42078ed7 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] PATH_INFO: `/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2/b26bca7349bf430bb963f06616043aa7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:46.397097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf718b3-568d-41db-a533-601a42078ed7 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=19aa990501b443d5b7fe6295ad1384d8, credential_id=b26bca7349bf430bb963f06616043aa7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:46.400289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf718b3-568d-41db-a533-601a42078ed7 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:46.513611 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1969/3962] 10.222.0.20 () {58 vars in 1380 bytes} [Thu Oct 27 03:41:46 2022] DELETE /identity/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2/b26bca7349bf430bb963f06616043aa7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:46.518915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97842d-73b1-4809-ae9b-cf6d2e52b52f tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:46.533497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97842d-73b1-4809-ae9b-cf6d2e52b52f tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:46.552479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f62810-e319-4b80-b6e1-8387d6c83485 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19aa990501b443d5b7fe6295ad1384d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f10e671f81a4c61ac314862e06555b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:46.552479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f62810-e319-4b80-b6e1-8387d6c83485 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:46.552479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f62810-e319-4b80-b6e1-8387d6c83485 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:46.553299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f62810-e319-4b80-b6e1-8387d6c83485 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] PATH_INFO: `/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:46.553455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f62810-e319-4b80-b6e1-8387d6c83485 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=19aa990501b443d5b7fe6295ad1384d8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:46.555140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f62810-e319-4b80-b6e1-8387d6c83485 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:46.725395 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1994/3963] 10.222.0.20 () {60 vars in 1299 bytes} [Thu Oct 27 03:41:46 2022] POST /identity/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2 => generated 367 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:46.725586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf718b3-568d-41db-a533-601a42078ed7 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:46.736767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf718b3-568d-41db-a533-601a42078ed7 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:46.754332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcc260-6c98-4d21-b786-7d1f4a64d52b tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19aa990501b443d5b7fe6295ad1384d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f10e671f81a4c61ac314862e06555b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:46.755012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcc260-6c98-4d21-b786-7d1f4a64d52b tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:46.755393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcc260-6c98-4d21-b786-7d1f4a64d52b tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:46.755731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcc260-6c98-4d21-b786-7d1f4a64d52b tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] PATH_INFO: `/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2/82d1f4da62344c358443aa12273cae1c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:46.764346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdcc260-6c98-4d21-b786-7d1f4a64d52b tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=19aa990501b443d5b7fe6295ad1384d8, credential_id=82d1f4da62344c358443aa12273cae1c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:46.766083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdcc260-6c98-4d21-b786-7d1f4a64d52b tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:46.773301 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1970/3964] 10.222.0.20 () {58 vars in 1377 bytes} [Thu Oct 27 03:41:46 2022] GET /identity/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2/82d1f4da62344c358443aa12273cae1c => generated 367 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:46.776869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f62810-e319-4b80-b6e1-8387d6c83485 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:46.787447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f62810-e319-4b80-b6e1-8387d6c83485 tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:46.798330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e52879-6275-41b0-b523-09718e2cfbea tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19aa990501b443d5b7fe6295ad1384d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f10e671f81a4c61ac314862e06555b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:46.799277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e52879-6275-41b0-b523-09718e2cfbea tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:46.799771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e52879-6275-41b0-b523-09718e2cfbea tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:46.800197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e52879-6275-41b0-b523-09718e2cfbea tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] PATH_INFO: `/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2/82d1f4da62344c358443aa12273cae1c` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:46.808417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e52879-6275-41b0-b523-09718e2cfbea tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=19aa990501b443d5b7fe6295ad1384d8, credential_id=82d1f4da62344c358443aa12273cae1c)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:46.810383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e52879-6275-41b0-b523-09718e2cfbea tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:46.827928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcc260-6c98-4d21-b786-7d1f4a64d52b tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:46.845079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fbdcc260-6c98-4d21-b786-7d1f4a64d52b tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:46.949782 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1995/3965] 10.222.0.20 () {58 vars in 1380 bytes} [Thu Oct 27 03:41:46 2022] DELETE /identity/v3/users/19aa990501b443d5b7fe6295ad1384d8/credentials/OS-EC2/82d1f4da62344c358443aa12273cae1c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:46.959406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e52879-6275-41b0-b523-09718e2cfbea tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:47.113814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e52879-6275-41b0-b523-09718e2cfbea tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:47.120320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcc260-6c98-4d21-b786-7d1f4a64d52b tempest-EC2CredentialsTest-62004371 tempest-EC2CredentialsTest-62004371-project] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:47.120900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5814736-5fc2-4734-837f-9b7d723d8b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:47.121664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5814736-5fc2-4734-837f-9b7d723d8b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:47.122106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5814736-5fc2-4734-837f-9b7d723d8b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:47.122505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5814736-5fc2-4734-837f-9b7d723d8b60 admin admin] PATH_INFO: `/v3/users/19aa990501b443d5b7fe6295ad1384d8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:47.123909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5814736-5fc2-4734-837f-9b7d723d8b60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19aa990501b443d5b7fe6295ad1384d8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:47.126333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5814736-5fc2-4734-837f-9b7d723d8b60 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:47.139571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fa747-a43a-4f71-a8b8-fc57c1b7fee4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:47.140468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fa747-a43a-4f71-a8b8-fc57c1b7fee4 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:47.140954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fa747-a43a-4f71-a8b8-fc57c1b7fee4 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:47.143309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fa747-a43a-4f71-a8b8-fc57c1b7fee4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:47.146967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-492fa747-a43a-4f71-a8b8-fc57c1b7fee4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:47.195891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fa747-a43a-4f71-a8b8-fc57c1b7fee4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:47.198442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fa747-a43a-4f71-a8b8-fc57c1b7fee4 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:47.229235 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1971/3966] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:41:47.430446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d5814736-5fc2-4734-837f-9b7d723d8b60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19aa990501b443d5b7fe6295ad1384d8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:47.434478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d5814736-5fc2-4734-837f-9b7d723d8b60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19aa990501b443d5b7fe6295ad1384d8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:47.500413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d5814736-5fc2-4734-837f-9b7d723d8b60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19aa990501b443d5b7fe6295ad1384d8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:47.561999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d5814736-5fc2-4734-837f-9b7d723d8b60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19aa990501b443d5b7fe6295ad1384d8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:47.562675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d5814736-5fc2-4734-837f-9b7d723d8b60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19aa990501b443d5b7fe6295ad1384d8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:47.698377 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1996/3967] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:41:46 2022] DELETE /identity/v3/users/19aa990501b443d5b7fe6295ad1384d8 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:41:47.700486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840af002-7835-4cf0-94f9-011416398595 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:47.701221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840af002-7835-4cf0-94f9-011416398595 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:47.701732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840af002-7835-4cf0-94f9-011416398595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:47.738215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:47.755434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-840af002-7835-4cf0-94f9-011416398595 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:47.756633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-840af002-7835-4cf0-94f9-011416398595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:47.788235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5814736-5fc2-4734-837f-9b7d723d8b60 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:47.790636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d5814736-5fc2-4734-837f-9b7d723d8b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:47.844045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:47.898373 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1972/3968] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:47.912335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840af002-7835-4cf0-94f9-011416398595 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:47.914983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-840af002-7835-4cf0-94f9-011416398595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:47.951505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5814736-5fc2-4734-837f-9b7d723d8b60 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:47.976690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c6e29-5269-44a1-9d95-deba5e0e5245 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:47.977570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c6e29-5269-44a1-9d95-deba5e0e5245 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:47.978443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c6e29-5269-44a1-9d95-deba5e0e5245 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:47.978727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c6e29-5269-44a1-9d95-deba5e0e5245 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:47.981776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ed3c6e29-5269-44a1-9d95-deba5e0e5245 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:48.026333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c6e29-5269-44a1-9d95-deba5e0e5245 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:48.028152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c6e29-5269-44a1-9d95-deba5e0e5245 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:48.041972 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1997/3969] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:41:48.084380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840af002-7835-4cf0-94f9-011416398595 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:48.093020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948c7db-94f8-4669-afd6-5c271d3a0ea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:48.093650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948c7db-94f8-4669-afd6-5c271d3a0ea2 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:48.093963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948c7db-94f8-4669-afd6-5c271d3a0ea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:48.094275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948c7db-94f8-4669-afd6-5c271d3a0ea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:48.135733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948c7db-94f8-4669-afd6-5c271d3a0ea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:48.140556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948c7db-94f8-4669-afd6-5c271d3a0ea2 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:48.163782 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1973/3970] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:41:49.142004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c6e29-5269-44a1-9d95-deba5e0e5245 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:49.143311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ed3c6e29-5269-44a1-9d95-deba5e0e5245 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:49.173425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c6e29-5269-44a1-9d95-deba5e0e5245 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:49.184015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e155b53-c036-42fa-a457-7c9b00035058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:49.184015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e155b53-c036-42fa-a457-7c9b00035058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:49.184015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e155b53-c036-42fa-a457-7c9b00035058 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:49.184015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e155b53-c036-42fa-a457-7c9b00035058 admin admin] PATH_INFO: `/v3/projects/1f10e671f81a4c61ac314862e06555b5` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:49.188356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e155b53-c036-42fa-a457-7c9b00035058 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f10e671f81a4c61ac314862e06555b5)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:49.188356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e155b53-c036-42fa-a457-7c9b00035058 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:49.386461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2e155b53-c036-42fa-a457-7c9b00035058 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f10e671f81a4c61ac314862e06555b5', 'request_id': 'req-2e155b53-c036-42fa-a457-7c9b00035058'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:49.404932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2e155b53-c036-42fa-a457-7c9b00035058 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f10e671f81a4c61ac314862e06555b5', 'request_id': 'req-2e155b53-c036-42fa-a457-7c9b00035058'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:49.417992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2e155b53-c036-42fa-a457-7c9b00035058 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f10e671f81a4c61ac314862e06555b5', 'request_id': 'req-2e155b53-c036-42fa-a457-7c9b00035058'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:49.548304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2e155b53-c036-42fa-a457-7c9b00035058 admin admin] The token cache is being invalidate because project 1f10e671f81a4c61ac314862e06555b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:41:49.548607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2e155b53-c036-42fa-a457-7c9b00035058 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:49.549388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2e155b53-c036-42fa-a457-7c9b00035058 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:49.551020 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1998/3971] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:41:49 2022] DELETE /identity/v3/projects/1f10e671f81a4c61ac314862e06555b5 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:49.558600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e8cff-902e-4050-8621-eeb415ece194 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:49.559576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e8cff-902e-4050-8621-eeb415ece194 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:49.560047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e8cff-902e-4050-8621-eeb415ece194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:49.647420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d16e8cff-902e-4050-8621-eeb415ece194 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:49.652189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d16e8cff-902e-4050-8621-eeb415ece194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:49.859655 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1974/3972] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:49.864318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f93b3-45f2-4cf9-b235-548e4e285785 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:49.864743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f93b3-45f2-4cf9-b235-548e4e285785 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:49.865771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f93b3-45f2-4cf9-b235-548e4e285785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:49.919117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-632f93b3-45f2-4cf9-b235-548e4e285785 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:49.920584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-632f93b3-45f2-4cf9-b235-548e4e285785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:49.940289 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 1999/3973] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:49.945647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e8cff-902e-4050-8621-eeb415ece194 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:49.964505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e8cff-902e-4050-8621-eeb415ece194 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:49.974689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92171e0b-10cd-48df-86ac-ce1e8cc7b32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:49.975434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92171e0b-10cd-48df-86ac-ce1e8cc7b32b admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:49.976140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92171e0b-10cd-48df-86ac-ce1e8cc7b32b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:49.976331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92171e0b-10cd-48df-86ac-ce1e8cc7b32b admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:49.977405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92171e0b-10cd-48df-86ac-ce1e8cc7b32b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:41:49.978082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92171e0b-10cd-48df-86ac-ce1e8cc7b32b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:49.982322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92171e0b-10cd-48df-86ac-ce1e8cc7b32b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:50.010512 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1975/3974] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:50.012190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f93b3-45f2-4cf9-b235-548e4e285785 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:50.032083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f93b3-45f2-4cf9-b235-548e4e285785 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:50.045733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a829a5-6131-42c5-9709-22a152b3f247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:50.046393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a829a5-6131-42c5-9709-22a152b3f247 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:50.048595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a829a5-6131-42c5-9709-22a152b3f247 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:50.048744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a829a5-6131-42c5-9709-22a152b3f247 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:50.050638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a829a5-6131-42c5-9709-22a152b3f247 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:50.063781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a829a5-6131-42c5-9709-22a152b3f247 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:50.289111 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2000/3975] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:41:50 2022] POST /identity/v3/projects => generated 385 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:50.293879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92171e0b-10cd-48df-86ac-ce1e8cc7b32b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:50.313152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92171e0b-10cd-48df-86ac-ce1e8cc7b32b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:50.442152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:50.524962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa63a99-ccc2-471d-ae1f-4c022ff343bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:50.526243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa63a99-ccc2-471d-ae1f-4c022ff343bc admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:50.529318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa63a99-ccc2-471d-ae1f-4c022ff343bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:50.529460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa63a99-ccc2-471d-ae1f-4c022ff343bc admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:50.530243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa63a99-ccc2-471d-ae1f-4c022ff343bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:50.532535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa63a99-ccc2-471d-ae1f-4c022ff343bc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:50.727392 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1976/3976] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:41:50 2022] POST /identity/v3/users => generated 299 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:50.728144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a829a5-6131-42c5-9709-22a152b3f247 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:50.743370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a829a5-6131-42c5-9709-22a152b3f247 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:50.751995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e542c-9ab5-4538-b83d-fc210c0e8dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:50.753062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e542c-9ab5-4538-b83d-fc210c0e8dfd admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:50.753535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e542c-9ab5-4538-b83d-fc210c0e8dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:50.753959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e542c-9ab5-4538-b83d-fc210c0e8dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:50.755033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e542c-9ab5-4538-b83d-fc210c0e8dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:50.757171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e542c-9ab5-4538-b83d-fc210c0e8dfd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:50.786023 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2001/3977] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:41:50.786160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa63a99-ccc2-471d-ae1f-4c022ff343bc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:50.805544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa63a99-ccc2-471d-ae1f-4c022ff343bc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:50.818072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34972a-3bc8-454d-92b8-0bae056ff095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:50.819652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34972a-3bc8-454d-92b8-0bae056ff095 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:50.820608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34972a-3bc8-454d-92b8-0bae056ff095 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:50.821801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34972a-3bc8-454d-92b8-0bae056ff095 admin admin] PATH_INFO: `/v3/projects/fc0fc2c89f134bf6b2f1b91a607177dc/users/c46aa98f7c5a4f9895566b0081163934/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:50.870283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34972a-3bc8-454d-92b8-0bae056ff095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc0fc2c89f134bf6b2f1b91a607177dc, user_id=c46aa98f7c5a4f9895566b0081163934, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:50.878857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34972a-3bc8-454d-92b8-0bae056ff095 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:50.956108 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1977/3978] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:41:50 2022] PUT /identity/v3/projects/fc0fc2c89f134bf6b2f1b91a607177dc/users/c46aa98f7c5a4f9895566b0081163934/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:50.958290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e542c-9ab5-4538-b83d-fc210c0e8dfd admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:50.975509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e542c-9ab5-4538-b83d-fc210c0e8dfd admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:51.161949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:51.193772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcfbf7-341a-402d-a7d7-f8e3e9bca226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:51.204086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcfbf7-341a-402d-a7d7-f8e3e9bca226 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:51.205498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcfbf7-341a-402d-a7d7-f8e3e9bca226 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:51.205909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcfbf7-341a-402d-a7d7-f8e3e9bca226 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:51.208471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcfbf7-341a-402d-a7d7-f8e3e9bca226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:51.213316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcfbf7-341a-402d-a7d7-f8e3e9bca226 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:51.255985 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2002/3979] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:41:51.257299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34972a-3bc8-454d-92b8-0bae056ff095 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:51.283688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34972a-3bc8-454d-92b8-0bae056ff095 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:51.296359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91560a32-e7f0-4dd6-8e1f-c5fe8d57c4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:51.297046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91560a32-e7f0-4dd6-8e1f-c5fe8d57c4a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:51.297377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91560a32-e7f0-4dd6-8e1f-c5fe8d57c4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:51.297764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91560a32-e7f0-4dd6-8e1f-c5fe8d57c4a1 admin admin] PATH_INFO: `/v3/projects/fc0fc2c89f134bf6b2f1b91a607177dc/users/c46aa98f7c5a4f9895566b0081163934/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:51.311190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91560a32-e7f0-4dd6-8e1f-c5fe8d57c4a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc0fc2c89f134bf6b2f1b91a607177dc, user_id=c46aa98f7c5a4f9895566b0081163934, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:51.314532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91560a32-e7f0-4dd6-8e1f-c5fe8d57c4a1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:51.344636 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1978/3980] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:41:51 2022] PUT /identity/v3/projects/fc0fc2c89f134bf6b2f1b91a607177dc/users/c46aa98f7c5a4f9895566b0081163934/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:51.346862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94689a-ed35-42f0-a943-8ba5f3260405 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:51.347285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94689a-ed35-42f0-a943-8ba5f3260405 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:51.350617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94689a-ed35-42f0-a943-8ba5f3260405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:51.427743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9b94689a-ed35-42f0-a943-8ba5f3260405 None None] MFA Rules not processed for user `c46aa98f7c5a4f9895566b0081163934`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:51.429977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9b94689a-ed35-42f0-a943-8ba5f3260405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:51.549447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91560a32-e7f0-4dd6-8e1f-c5fe8d57c4a1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:51.554775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-91560a32-e7f0-4dd6-8e1f-c5fe8d57c4a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:51.734488 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2003/3981] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:51.738701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94689a-ed35-42f0-a943-8ba5f3260405 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:51.910795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91560a32-e7f0-4dd6-8e1f-c5fe8d57c4a1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:51.938907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b3a3e-4b51-41a3-b405-6de09826c357 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:51.939862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b3a3e-4b51-41a3-b405-6de09826c357 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:51.940290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b3a3e-4b51-41a3-b405-6de09826c357 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:51.940709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b3a3e-4b51-41a3-b405-6de09826c357 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:51.949496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c13b3a3e-4b51-41a3-b405-6de09826c357 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:52.005075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b3a3e-4b51-41a3-b405-6de09826c357 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:52.012580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b3a3e-4b51-41a3-b405-6de09826c357 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:52.055702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94689a-ed35-42f0-a943-8ba5f3260405 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:52.061853 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1979/3982] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:41:52.074524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf77f0-b397-4d25-8924-cbe22cfbebfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:52.075938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf77f0-b397-4d25-8924-cbe22cfbebfd admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:52.076443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf77f0-b397-4d25-8924-cbe22cfbebfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:52.076917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf77f0-b397-4d25-8924-cbe22cfbebfd admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:52.077836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf77f0-b397-4d25-8924-cbe22cfbebfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:52.080108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf77f0-b397-4d25-8924-cbe22cfbebfd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:52.301978 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2004/3983] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:41:51 2022] POST /identity/v3/projects => generated 387 bytes in 565 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:52.306657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b3a3e-4b51-41a3-b405-6de09826c357 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:52.330496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b3a3e-4b51-41a3-b405-6de09826c357 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:52.466455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c7ea9-6c63-4fd2-acc4-b2e0e0ea873e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:52.469744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c7ea9-6c63-4fd2-acc4-b2e0e0ea873e admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:52.470232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c7ea9-6c63-4fd2-acc4-b2e0e0ea873e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:52.470513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c7ea9-6c63-4fd2-acc4-b2e0e0ea873e admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:52.471184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c7ea9-6c63-4fd2-acc4-b2e0e0ea873e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:52.476484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c7ea9-6c63-4fd2-acc4-b2e0e0ea873e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:52.607058 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1980/3984] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:41:52 2022] POST /identity/v3/users => generated 294 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:41:52.612070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf77f0-b397-4d25-8924-cbe22cfbebfd admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:52.627732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf77f0-b397-4d25-8924-cbe22cfbebfd admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:52.634869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a839d2-8a16-447a-8e90-90c73b9df6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:52.635561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a839d2-8a16-447a-8e90-90c73b9df6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:52.635963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a839d2-8a16-447a-8e90-90c73b9df6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:52.636691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a839d2-8a16-447a-8e90-90c73b9df6c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:52.637479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a839d2-8a16-447a-8e90-90c73b9df6c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:52.639665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a839d2-8a16-447a-8e90-90c73b9df6c9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:52.660485 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2005/3985] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:41:52.662136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c7ea9-6c63-4fd2-acc4-b2e0e0ea873e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:52.673865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:52.681063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c7ea9-6c63-4fd2-acc4-b2e0e0ea873e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:52.687803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060eb961-607d-4759-9f6c-e7fce95aa554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:52.690840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060eb961-607d-4759-9f6c-e7fce95aa554 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:52.690840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060eb961-607d-4759-9f6c-e7fce95aa554 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:52.690840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060eb961-607d-4759-9f6c-e7fce95aa554 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:52.690840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060eb961-607d-4759-9f6c-e7fce95aa554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:52.695096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060eb961-607d-4759-9f6c-e7fce95aa554 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:52.734082 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1981/3986] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:41:52.745921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a839d2-8a16-447a-8e90-90c73b9df6c9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:52.762058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a839d2-8a16-447a-8e90-90c73b9df6c9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:52.774091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606f48c-de55-424f-8f44-e059f90be141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:52.774843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606f48c-de55-424f-8f44-e059f90be141 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:52.775125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606f48c-de55-424f-8f44-e059f90be141 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:52.775400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606f48c-de55-424f-8f44-e059f90be141 admin admin] PATH_INFO: `/v3/projects/d42a5c6a7a2e4786b5bc3818db117231/users/86a164ecc87d4440b33f3ce04c21c2a6/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:52.810348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606f48c-de55-424f-8f44-e059f90be141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d42a5c6a7a2e4786b5bc3818db117231, user_id=86a164ecc87d4440b33f3ce04c21c2a6, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:52.813831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606f48c-de55-424f-8f44-e059f90be141 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:52.948282 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2006/3987] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:41:52 2022] PUT /identity/v3/projects/d42a5c6a7a2e4786b5bc3818db117231/users/86a164ecc87d4440b33f3ce04c21c2a6/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:52.958812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45acc7-077c-46f7-9d0f-f047de01630d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:52.959394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45acc7-077c-46f7-9d0f-f047de01630d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:52.959394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45acc7-077c-46f7-9d0f-f047de01630d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:53.031978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9b45acc7-077c-46f7-9d0f-f047de01630d None None] MFA Rules not processed for user `86a164ecc87d4440b33f3ce04c21c2a6`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:53.031978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9b45acc7-077c-46f7-9d0f-f047de01630d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:53.137846 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1982/3988] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:53.152632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606f48c-de55-424f-8f44-e059f90be141 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:53.155172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5606f48c-de55-424f-8f44-e059f90be141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:53.201634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:53.244118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606f48c-de55-424f-8f44-e059f90be141 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:53.250381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff333b-3652-4d03-abf3-b7b25f2b379f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:53.251192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff333b-3652-4d03-abf3-b7b25f2b379f service glance] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:53.251629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff333b-3652-4d03-abf3-b7b25f2b379f service glance] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:53.252132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff333b-3652-4d03-abf3-b7b25f2b379f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:53.326379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff333b-3652-4d03-abf3-b7b25f2b379f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:53.328256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff333b-3652-4d03-abf3-b7b25f2b379f service glance] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:53.342397 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2007/3989] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:41:55.419640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45acc7-077c-46f7-9d0f-f047de01630d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:55.575762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45acc7-077c-46f7-9d0f-f047de01630d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:55.593763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd1a34-8eb7-4d65-b555-fad081084deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:55.594669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd1a34-8eb7-4d65-b555-fad081084deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:55.594961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd1a34-8eb7-4d65-b555-fad081084deb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:55.595319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd1a34-8eb7-4d65-b555-fad081084deb admin admin] PATH_INFO: `/v3/users/c46aa98f7c5a4f9895566b0081163934` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:55.597030 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd1a34-8eb7-4d65-b555-fad081084deb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c46aa98f7c5a4f9895566b0081163934)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:55.599208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd1a34-8eb7-4d65-b555-fad081084deb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:55.825067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0cbd1a34-8eb7-4d65-b555-fad081084deb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c46aa98f7c5a4f9895566b0081163934'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:55.831499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0cbd1a34-8eb7-4d65-b555-fad081084deb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c46aa98f7c5a4f9895566b0081163934'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:55.901173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0cbd1a34-8eb7-4d65-b555-fad081084deb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c46aa98f7c5a4f9895566b0081163934'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:55.941452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0cbd1a34-8eb7-4d65-b555-fad081084deb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c46aa98f7c5a4f9895566b0081163934'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:56.021831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0cbd1a34-8eb7-4d65-b555-fad081084deb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c46aa98f7c5a4f9895566b0081163934'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:56.031858 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1983/3990] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:41:55 2022] DELETE /identity/v3/users/c46aa98f7c5a4f9895566b0081163934 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:56.036495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5e29a-4e30-4f5a-a98c-414c40ab286c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:56.037447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5e29a-4e30-4f5a-a98c-414c40ab286c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:56.038545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5e29a-4e30-4f5a-a98c-414c40ab286c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:56.075627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3bf5e29a-4e30-4f5a-a98c-414c40ab286c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:56.079969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3bf5e29a-4e30-4f5a-a98c-414c40ab286c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:56.266578 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2008/3991] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:56.279318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd1a34-8eb7-4d65-b555-fad081084deb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:56.282061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0cbd1a34-8eb7-4d65-b555-fad081084deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:56.291240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:56.424219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd1a34-8eb7-4d65-b555-fad081084deb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:56.434136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7ca2a-6be9-4ff3-9fb9-8869a67c2c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:56.434774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7ca2a-6be9-4ff3-9fb9-8869a67c2c6e service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:56.435110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7ca2a-6be9-4ff3-9fb9-8869a67c2c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:56.438930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7ca2a-6be9-4ff3-9fb9-8869a67c2c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:56.463380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7ca2a-6be9-4ff3-9fb9-8869a67c2c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:56.465748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7ca2a-6be9-4ff3-9fb9-8869a67c2c6e service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:56.501497 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1984/3992] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:41:57.013575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5e29a-4e30-4f5a-a98c-414c40ab286c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:57.015185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3bf5e29a-4e30-4f5a-a98c-414c40ab286c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:57.052505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5e29a-4e30-4f5a-a98c-414c40ab286c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:57.071149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1dac7-d168-4d3a-b3d7-9ac25d91d38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:57.071964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1dac7-d168-4d3a-b3d7-9ac25d91d38f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:57.072422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1dac7-d168-4d3a-b3d7-9ac25d91d38f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:57.072881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1dac7-d168-4d3a-b3d7-9ac25d91d38f admin admin] PATH_INFO: `/v3/users/0d9053ce63864308b29190f9f51bd85f` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:57.074057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1dac7-d168-4d3a-b3d7-9ac25d91d38f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d9053ce63864308b29190f9f51bd85f)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:57.076277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1dac7-d168-4d3a-b3d7-9ac25d91d38f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:57.192218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7ca2a-6be9-4ff3-9fb9-8869a67c2c6e service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:57.193950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9cc7ca2a-6be9-4ff3-9fb9-8869a67c2c6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:57.213200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7ca2a-6be9-4ff3-9fb9-8869a67c2c6e service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:57.225134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9450a1-5d15-4a32-9cbc-19bb64828fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:57.226998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9450a1-5d15-4a32-9cbc-19bb64828fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:57.226998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9450a1-5d15-4a32-9cbc-19bb64828fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:57.226998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9450a1-5d15-4a32-9cbc-19bb64828fbe admin admin] PATH_INFO: `/v3/projects/fc0fc2c89f134bf6b2f1b91a607177dc` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:57.228159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9450a1-5d15-4a32-9cbc-19bb64828fbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc0fc2c89f134bf6b2f1b91a607177dc)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:57.230647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9450a1-5d15-4a32-9cbc-19bb64828fbe admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:57.304839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-18e1dac7-d168-4d3a-b3d7-9ac25d91d38f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d9053ce63864308b29190f9f51bd85f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:57.305952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-18e1dac7-d168-4d3a-b3d7-9ac25d91d38f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d9053ce63864308b29190f9f51bd85f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:57.313665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-18e1dac7-d168-4d3a-b3d7-9ac25d91d38f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d9053ce63864308b29190f9f51bd85f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:57.335722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:57.342115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-18e1dac7-d168-4d3a-b3d7-9ac25d91d38f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d9053ce63864308b29190f9f51bd85f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:57.342880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-18e1dac7-d168-4d3a-b3d7-9ac25d91d38f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d9053ce63864308b29190f9f51bd85f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:57.377192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1d9450a1-5d15-4a32-9cbc-19bb64828fbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc0fc2c89f134bf6b2f1b91a607177dc', 'request_id': 'req-1d9450a1-5d15-4a32-9cbc-19bb64828fbe'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:57.418861 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2009/3993] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:41:57 2022] DELETE /identity/v3/users/0d9053ce63864308b29190f9f51bd85f => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:57.500969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1d9450a1-5d15-4a32-9cbc-19bb64828fbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc0fc2c89f134bf6b2f1b91a607177dc', 'request_id': 'req-1d9450a1-5d15-4a32-9cbc-19bb64828fbe'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:57.520750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1d9450a1-5d15-4a32-9cbc-19bb64828fbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc0fc2c89f134bf6b2f1b91a607177dc', 'request_id': 'req-1d9450a1-5d15-4a32-9cbc-19bb64828fbe'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:57.523138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1d9450a1-5d15-4a32-9cbc-19bb64828fbe admin admin] The token cache is being invalidate because project fc0fc2c89f134bf6b2f1b91a607177dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:41:57.523439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1d9450a1-5d15-4a32-9cbc-19bb64828fbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:57.524104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1d9450a1-5d15-4a32-9cbc-19bb64828fbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:57.525927 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1985/3994] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:41:57 2022] DELETE /identity/v3/projects/fc0fc2c89f134bf6b2f1b91a607177dc => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:41:57.529803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1dac7-d168-4d3a-b3d7-9ac25d91d38f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:57.531318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-18e1dac7-d168-4d3a-b3d7-9ac25d91d38f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:57.632352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1dac7-d168-4d3a-b3d7-9ac25d91d38f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:57.635853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d53f2-f3f6-4fb1-8f22-73bade7a2cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:57.636709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d53f2-f3f6-4fb1-8f22-73bade7a2cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:57.636841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d53f2-f3f6-4fb1-8f22-73bade7a2cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:57.637412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d53f2-f3f6-4fb1-8f22-73bade7a2cf8 admin admin] PATH_INFO: `/v3/users/86a164ecc87d4440b33f3ce04c21c2a6` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:57.638765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d53f2-f3f6-4fb1-8f22-73bade7a2cf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a164ecc87d4440b33f3ce04c21c2a6)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:57.640994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d53f2-f3f6-4fb1-8f22-73bade7a2cf8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:57.683771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9450a1-5d15-4a32-9cbc-19bb64828fbe admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:57.685377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1d9450a1-5d15-4a32-9cbc-19bb64828fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:57.750656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9450a1-5d15-4a32-9cbc-19bb64828fbe admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:57.799504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:57.808040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cccf6-3eed-4996-aefa-b01e509a061e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:57.808747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cccf6-3eed-4996-aefa-b01e509a061e service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:57.809093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cccf6-3eed-4996-aefa-b01e509a061e service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:57.809419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cccf6-3eed-4996-aefa-b01e509a061e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:57.811279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-986cccf6-3eed-4996-aefa-b01e509a061e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:57.823453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cccf6-3eed-4996-aefa-b01e509a061e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:57.824690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cccf6-3eed-4996-aefa-b01e509a061e service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:57.834419 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1986/3995] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:41:57.835435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cccf6-3eed-4996-aefa-b01e509a061e service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:57.836813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-986cccf6-3eed-4996-aefa-b01e509a061e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:57.852968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cccf6-3eed-4996-aefa-b01e509a061e service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:57.859859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f230e94-1491-4c20-97b4-d298d6bb867e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:57.859859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f230e94-1491-4c20-97b4-d298d6bb867e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:57.859859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f230e94-1491-4c20-97b4-d298d6bb867e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:57.860214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f230e94-1491-4c20-97b4-d298d6bb867e admin admin] PATH_INFO: `/v3/projects/296abb4b5dde441da95f4d09089f348e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:57.862671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f230e94-1491-4c20-97b4-d298d6bb867e admin admin] RBAC: Authorizing `identity:delete_project(project_id=296abb4b5dde441da95f4d09089f348e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:57.866576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f230e94-1491-4c20-97b4-d298d6bb867e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:57.867580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-eb9d53f2-f3f6-4fb1-8f22-73bade7a2cf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a164ecc87d4440b33f3ce04c21c2a6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:57.869684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-eb9d53f2-f3f6-4fb1-8f22-73bade7a2cf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a164ecc87d4440b33f3ce04c21c2a6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:57.884542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-eb9d53f2-f3f6-4fb1-8f22-73bade7a2cf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a164ecc87d4440b33f3ce04c21c2a6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:57.908088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-eb9d53f2-f3f6-4fb1-8f22-73bade7a2cf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a164ecc87d4440b33f3ce04c21c2a6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:57.909255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-eb9d53f2-f3f6-4fb1-8f22-73bade7a2cf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a164ecc87d4440b33f3ce04c21c2a6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:58.003486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1f230e94-1491-4c20-97b4-d298d6bb867e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '296abb4b5dde441da95f4d09089f348e', 'request_id': 'req-1f230e94-1491-4c20-97b4-d298d6bb867e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:58.017177 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2010/3996] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:41:57 2022] DELETE /identity/v3/users/86a164ecc87d4440b33f3ce04c21c2a6 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:58.101134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1f230e94-1491-4c20-97b4-d298d6bb867e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '296abb4b5dde441da95f4d09089f348e', 'request_id': 'req-1f230e94-1491-4c20-97b4-d298d6bb867e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:58.109179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1f230e94-1491-4c20-97b4-d298d6bb867e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '296abb4b5dde441da95f4d09089f348e', 'request_id': 'req-1f230e94-1491-4c20-97b4-d298d6bb867e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:58.134342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1f230e94-1491-4c20-97b4-d298d6bb867e admin admin] The token cache is being invalidate because project 296abb4b5dde441da95f4d09089f348e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:41:58.135562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1f230e94-1491-4c20-97b4-d298d6bb867e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:58.137331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1f230e94-1491-4c20-97b4-d298d6bb867e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:58.142769 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1987/3997] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:41:57 2022] DELETE /identity/v3/projects/296abb4b5dde441da95f4d09089f348e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:58.147091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d53f2-f3f6-4fb1-8f22-73bade7a2cf8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:58.148596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-eb9d53f2-f3f6-4fb1-8f22-73bade7a2cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:58.265942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d53f2-f3f6-4fb1-8f22-73bade7a2cf8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:58.271996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ad2b5-b193-4922-a8bd-3fd110b16d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:58.273437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ad2b5-b193-4922-a8bd-3fd110b16d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:58.273727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ad2b5-b193-4922-a8bd-3fd110b16d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:58.274005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ad2b5-b193-4922-a8bd-3fd110b16d8d admin admin] PATH_INFO: `/v3/users/d46f5d960c594409bc8fd7221e89c463` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:58.276954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ad2b5-b193-4922-a8bd-3fd110b16d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d46f5d960c594409bc8fd7221e89c463)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:58.279010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ad2b5-b193-4922-a8bd-3fd110b16d8d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:58.281792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:58.339223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4d3ed-7e58-4a0c-9b21-b5967d783c26 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:58.339511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4d3ed-7e58-4a0c-9b21-b5967d783c26 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:58.339767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4d3ed-7e58-4a0c-9b21-b5967d783c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:58.362969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-47c4d3ed-7e58-4a0c-9b21-b5967d783c26 None None] MFA Rules not processed for user `b1cc79af058b4c35b3c572448fac86a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:58.364396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-47c4d3ed-7e58-4a0c-9b21-b5967d783c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:58.446182 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1988/3998] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:58.542459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c3ad2b5-b193-4922-a8bd-3fd110b16d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd46f5d960c594409bc8fd7221e89c463'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:58.546212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c3ad2b5-b193-4922-a8bd-3fd110b16d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd46f5d960c594409bc8fd7221e89c463'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:58.551866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c3ad2b5-b193-4922-a8bd-3fd110b16d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd46f5d960c594409bc8fd7221e89c463'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:58.566189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c3ad2b5-b193-4922-a8bd-3fd110b16d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd46f5d960c594409bc8fd7221e89c463'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:58.567037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c3ad2b5-b193-4922-a8bd-3fd110b16d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd46f5d960c594409bc8fd7221e89c463'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:58.610424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4d3ed-7e58-4a0c-9b21-b5967d783c26 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:58.612458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-47c4d3ed-7e58-4a0c-9b21-b5967d783c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:58.636245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4d3ed-7e58-4a0c-9b21-b5967d783c26 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:58.642296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3f08b-646c-4722-b196-d33adf4b9670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:58.642806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3f08b-646c-4722-b196-d33adf4b9670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:58.643126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3f08b-646c-4722-b196-d33adf4b9670 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:58.644114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3f08b-646c-4722-b196-d33adf4b9670 admin admin] PATH_INFO: `/v3/projects/d42a5c6a7a2e4786b5bc3818db117231` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:58.645718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3f08b-646c-4722-b196-d33adf4b9670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d42a5c6a7a2e4786b5bc3818db117231)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:58.648791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3f08b-646c-4722-b196-d33adf4b9670 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:58.681522 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2011/3999] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:41:58 2022] DELETE /identity/v3/users/d46f5d960c594409bc8fd7221e89c463 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:58.777213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1ea3f08b-646c-4722-b196-d33adf4b9670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd42a5c6a7a2e4786b5bc3818db117231', 'request_id': 'req-1ea3f08b-646c-4722-b196-d33adf4b9670'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:58.852957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1ea3f08b-646c-4722-b196-d33adf4b9670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd42a5c6a7a2e4786b5bc3818db117231', 'request_id': 'req-1ea3f08b-646c-4722-b196-d33adf4b9670'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:58.872674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1ea3f08b-646c-4722-b196-d33adf4b9670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd42a5c6a7a2e4786b5bc3818db117231', 'request_id': 'req-1ea3f08b-646c-4722-b196-d33adf4b9670'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:58.880445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:58.886314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1ea3f08b-646c-4722-b196-d33adf4b9670 admin admin] The token cache is being invalidate because project d42a5c6a7a2e4786b5bc3818db117231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:41:58.886570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1ea3f08b-646c-4722-b196-d33adf4b9670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:58.887878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1ea3f08b-646c-4722-b196-d33adf4b9670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:58.890269 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1989/4000] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:41:58 2022] DELETE /identity/v3/projects/d42a5c6a7a2e4786b5bc3818db117231 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:58.894691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed2252-ed4a-4c98-9583-1f0cbb6d0791 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:58.894989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed2252-ed4a-4c98-9583-1f0cbb6d0791 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:58.895268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed2252-ed4a-4c98-9583-1f0cbb6d0791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:58.915819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6bed2252-ed4a-4c98-9583-1f0cbb6d0791 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:58.917066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6bed2252-ed4a-4c98-9583-1f0cbb6d0791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:58.965925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3f08b-646c-4722-b196-d33adf4b9670 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:58.971294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1ea3f08b-646c-4722-b196-d33adf4b9670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:59.017512 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2012/4001] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:41:59.024975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a10b5-311f-4d1c-b6dd-297e6852c35e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:59.025264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a10b5-311f-4d1c-b6dd-297e6852c35e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:59.025537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a10b5-311f-4d1c-b6dd-297e6852c35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:59.057420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9c3a10b5-311f-4d1c-b6dd-297e6852c35e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:59.059300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9c3a10b5-311f-4d1c-b6dd-297e6852c35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:59.073190 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2013/4002] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:41:59.079214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a10b5-311f-4d1c-b6dd-297e6852c35e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:59.082164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3f08b-646c-4722-b196-d33adf4b9670 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:59.089565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261925c-cb57-4c26-9e88-aae75029283d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:59.090548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261925c-cb57-4c26-9e88-aae75029283d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:59.091010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261925c-cb57-4c26-9e88-aae75029283d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:59.091440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261925c-cb57-4c26-9e88-aae75029283d admin admin] PATH_INFO: `/v3/projects/00c2da28bc064d778f1ecaa1bb5c1ad8` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:59.091789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a10b5-311f-4d1c-b6dd-297e6852c35e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:59.093038 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261925c-cb57-4c26-9e88-aae75029283d admin admin] RBAC: Authorizing `identity:delete_project(project_id=00c2da28bc064d778f1ecaa1bb5c1ad8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:59.095648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261925c-cb57-4c26-9e88-aae75029283d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:59.097859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c9591-3eed-4251-94a4-21355a15ef09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:59.099780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c9591-3eed-4251-94a4-21355a15ef09 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:59.104896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c9591-3eed-4251-94a4-21355a15ef09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:59.104896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c9591-3eed-4251-94a4-21355a15ef09 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:59.104896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c9591-3eed-4251-94a4-21355a15ef09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:41:59.104896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c9591-3eed-4251-94a4-21355a15ef09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:59.107860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c9591-3eed-4251-94a4-21355a15ef09 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:59.128260 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2014/4003] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:59.134749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c9591-3eed-4251-94a4-21355a15ef09 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:59.148882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c9591-3eed-4251-94a4-21355a15ef09 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:59.152577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246b375-5122-4e5c-ad9e-e8dfb7326152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:59.153298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246b375-5122-4e5c-ad9e-e8dfb7326152 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:59.153644 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246b375-5122-4e5c-ad9e-e8dfb7326152 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:59.153981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246b375-5122-4e5c-ad9e-e8dfb7326152 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:59.154738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246b375-5122-4e5c-ad9e-e8dfb7326152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:59.156914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246b375-5122-4e5c-ad9e-e8dfb7326152 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:59.228122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8261925c-cb57-4c26-9e88-aae75029283d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00c2da28bc064d778f1ecaa1bb5c1ad8', 'request_id': 'req-8261925c-cb57-4c26-9e88-aae75029283d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:59.268217 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2015/4004] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:41:59 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:59.271973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246b375-5122-4e5c-ad9e-e8dfb7326152 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:59.312313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8261925c-cb57-4c26-9e88-aae75029283d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00c2da28bc064d778f1ecaa1bb5c1ad8', 'request_id': 'req-8261925c-cb57-4c26-9e88-aae75029283d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:59.322611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8261925c-cb57-4c26-9e88-aae75029283d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00c2da28bc064d778f1ecaa1bb5c1ad8', 'request_id': 'req-8261925c-cb57-4c26-9e88-aae75029283d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:59.341896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8261925c-cb57-4c26-9e88-aae75029283d admin admin] The token cache is being invalidate because project 00c2da28bc064d778f1ecaa1bb5c1ad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:41:59.342270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8261925c-cb57-4c26-9e88-aae75029283d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:59.342929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8261925c-cb57-4c26-9e88-aae75029283d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:41:59.346901 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1990/4005] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:41:58 2022] DELETE /identity/v3/projects/00c2da28bc064d778f1ecaa1bb5c1ad8 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:41:59.359281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a694a9-91ba-436d-8aad-0d6f1b8b022f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:59.360526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a694a9-91ba-436d-8aad-0d6f1b8b022f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:59.360867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a694a9-91ba-436d-8aad-0d6f1b8b022f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:59.379330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:59.386253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-49a694a9-91ba-436d-8aad-0d6f1b8b022f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:59.388098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-49a694a9-91ba-436d-8aad-0d6f1b8b022f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:59.403889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246b375-5122-4e5c-ad9e-e8dfb7326152 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:59.411370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f93e62-4413-4bbf-a7ca-99e850b88b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:59.412231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f93e62-4413-4bbf-a7ca-99e850b88b55 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:59.413749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f93e62-4413-4bbf-a7ca-99e850b88b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:59.414839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f93e62-4413-4bbf-a7ca-99e850b88b55 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:59.415999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f93e62-4413-4bbf-a7ca-99e850b88b55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:59.419854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f93e62-4413-4bbf-a7ca-99e850b88b55 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:59.473962 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1991/4006] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:41:59.482369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c16711-6625-42ac-a6a0-1b436126c292 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:59.482653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c16711-6625-42ac-a6a0-1b436126c292 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:59.487882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c16711-6625-42ac-a6a0-1b436126c292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:59.521013 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2016/4007] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:41:59 2022] POST /identity/v3/users => generated 286 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:41:59.526339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f93e62-4413-4bbf-a7ca-99e850b88b55 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:59.526568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-12c16711-6625-42ac-a6a0-1b436126c292 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:59.528065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-12c16711-6625-42ac-a6a0-1b436126c292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:59.534526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-89f93e62-4413-4bbf-a7ca-99e850b88b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:59.540538 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1992/4008] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:41:59.545445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c16711-6625-42ac-a6a0-1b436126c292 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:59.549268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f93e62-4413-4bbf-a7ca-99e850b88b55 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:59.559928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ff11f-5f4f-4395-96a2-18305205896c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:59.559928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ff11f-5f4f-4395-96a2-18305205896c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:59.559928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ff11f-5f4f-4395-96a2-18305205896c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:59.559928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ff11f-5f4f-4395-96a2-18305205896c admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:59.560231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c16711-6625-42ac-a6a0-1b436126c292 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:59.560319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ff11f-5f4f-4395-96a2-18305205896c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:59.561243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ff11f-5f4f-4395-96a2-18305205896c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:59.563463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01da78-faeb-4eae-924c-bba7b70c8a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:59.565523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01da78-faeb-4eae-924c-bba7b70c8a29 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:59.565818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01da78-faeb-4eae-924c-bba7b70c8a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:59.566152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01da78-faeb-4eae-924c-bba7b70c8a29 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:59.566830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01da78-faeb-4eae-924c-bba7b70c8a29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:41:59.567147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01da78-faeb-4eae-924c-bba7b70c8a29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:59.569050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01da78-faeb-4eae-924c-bba7b70c8a29 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:59.574791 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2017/4009] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:41:59.578153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ff11f-5f4f-4395-96a2-18305205896c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:59.592508 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1993/4010] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:41:59.593435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01da78-faeb-4eae-924c-bba7b70c8a29 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:59.611027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01da78-faeb-4eae-924c-bba7b70c8a29 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:59.618654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfdc72-e9db-4a00-917f-f1e3d85a3464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:59.619290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfdc72-e9db-4a00-917f-f1e3d85a3464 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:59.619797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfdc72-e9db-4a00-917f-f1e3d85a3464 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:59.621793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfdc72-e9db-4a00-917f-f1e3d85a3464 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:59.621793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cfdc72-e9db-4a00-917f-f1e3d85a3464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:59.621995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ff11f-5f4f-4395-96a2-18305205896c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:59.622960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cfdc72-e9db-4a00-917f-f1e3d85a3464 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:59.649469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd5d37-35df-4f98-90d8-87af81293061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:59.650184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd5d37-35df-4f98-90d8-87af81293061 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:59.650703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd5d37-35df-4f98-90d8-87af81293061 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:59.650703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd5d37-35df-4f98-90d8-87af81293061 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:59.651379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd5d37-35df-4f98-90d8-87af81293061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:59.653245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd5d37-35df-4f98-90d8-87af81293061 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:59.665836 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2018/4011] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:41:59.673895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd5d37-35df-4f98-90d8-87af81293061 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:59.683962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd5d37-35df-4f98-90d8-87af81293061 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:59.690320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266d41b-31d8-495d-9020-677ac7734064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:59.691231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266d41b-31d8-495d-9020-677ac7734064 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:59.691784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266d41b-31d8-495d-9020-677ac7734064 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:59.696775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266d41b-31d8-495d-9020-677ac7734064 admin admin] PATH_INFO: `/v3/projects/906255df6c3045fc9851983f78f686bf/users/bb0c791cce5542629a035462fc60cd4a/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:59.702083 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1994/4012] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:41:59 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:41:59.703347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfdc72-e9db-4a00-917f-f1e3d85a3464 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:59.708991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266d41b-31d8-495d-9020-677ac7734064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=906255df6c3045fc9851983f78f686bf, user_id=bb0c791cce5542629a035462fc60cd4a, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:59.713282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266d41b-31d8-495d-9020-677ac7734064 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:59.767788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfdc72-e9db-4a00-917f-f1e3d85a3464 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:59.773034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67792738-7e4c-4416-b628-f02605ad94f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:59.773642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67792738-7e4c-4416-b628-f02605ad94f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:59.774151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67792738-7e4c-4416-b628-f02605ad94f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:59.774430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67792738-7e4c-4416-b628-f02605ad94f2 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:59.779603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67792738-7e4c-4416-b628-f02605ad94f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:59.779603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67792738-7e4c-4416-b628-f02605ad94f2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:41:59.821164 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2019/4013] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:41:59 2022] PUT /identity/v3/projects/906255df6c3045fc9851983f78f686bf/users/bb0c791cce5542629a035462fc60cd4a/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:41:59.831170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dd4f2-c077-4b8e-9ab1-ac3cea8e4e43 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:59.831459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dd4f2-c077-4b8e-9ab1-ac3cea8e4e43 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:59.831737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dd4f2-c077-4b8e-9ab1-ac3cea8e4e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:59.869024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0d1dd4f2-c077-4b8e-9ab1-ac3cea8e4e43 None None] MFA Rules not processed for user `bb0c791cce5542629a035462fc60cd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:41:59.869024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0d1dd4f2-c077-4b8e-9ab1-ac3cea8e4e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:59.888741 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1995/4014] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:41:59 2022] POST /identity/v3/users => generated 294 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:41:59.889755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67792738-7e4c-4416-b628-f02605ad94f2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:59.901655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67792738-7e4c-4416-b628-f02605ad94f2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:41:59.909268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:59.969409 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2020/4015] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:41:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:41:59.980113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1dd4f2-c077-4b8e-9ab1-ac3cea8e4e43 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:41:59.981855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0d1dd4f2-c077-4b8e-9ab1-ac3cea8e4e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:41:59.993170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f87e0-a7fa-4d92-b2ee-35095e33355d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:41:59.993835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f87e0-a7fa-4d92-b2ee-35095e33355d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:41:59.994143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f87e0-a7fa-4d92-b2ee-35095e33355d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:41:59.994425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f87e0-a7fa-4d92-b2ee-35095e33355d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:41:59.995085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f87e0-a7fa-4d92-b2ee-35095e33355d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:41:59.998668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f87e0-a7fa-4d92-b2ee-35095e33355d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:00.019699 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1996/4016] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:42:00.025789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f87e0-a7fa-4d92-b2ee-35095e33355d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:00.038879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f87e0-a7fa-4d92-b2ee-35095e33355d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:00.044954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f2f84-c6ab-403e-aeb5-abea4ce1ceb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:00.045751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f2f84-c6ab-403e-aeb5-abea4ce1ceb8 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:00.046209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f2f84-c6ab-403e-aeb5-abea4ce1ceb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:00.046585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f2f84-c6ab-403e-aeb5-abea4ce1ceb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:00.047339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f2f84-c6ab-403e-aeb5-abea4ce1ceb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:00.049461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f2f84-c6ab-403e-aeb5-abea4ce1ceb8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:00.071587 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1997/4017] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:42:00.072876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1dd4f2-c077-4b8e-9ab1-ac3cea8e4e43 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:00.077595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9d164-f5a8-4a02-9168-32d059cf2b0c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:00.082872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f2f84-c6ab-403e-aeb5-abea4ce1ceb8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:00.082995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9d164-f5a8-4a02-9168-32d059cf2b0c service glance] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:00.082995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9d164-f5a8-4a02-9168-32d059cf2b0c service glance] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:00.082995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9d164-f5a8-4a02-9168-32d059cf2b0c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:00.088946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9d164-f5a8-4a02-9168-32d059cf2b0c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:00.090506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f2f84-c6ab-403e-aeb5-abea4ce1ceb8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:00.090641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9d164-f5a8-4a02-9168-32d059cf2b0c service glance] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:00.096552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9886a4-3770-4c47-a879-4ab0ebbe8100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:00.097208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9886a4-3770-4c47-a879-4ab0ebbe8100 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:00.097491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9886a4-3770-4c47-a879-4ab0ebbe8100 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:00.097766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9886a4-3770-4c47-a879-4ab0ebbe8100 admin admin] PATH_INFO: `/v3/projects/98617e3a5b6c449c88449c236a8f2ecf/users/82daefe001364499b2ee9eb7da2599be/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:00.101204 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2021/4018] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:41:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:42:00.118898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9886a4-3770-4c47-a879-4ab0ebbe8100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98617e3a5b6c449c88449c236a8f2ecf, user_id=82daefe001364499b2ee9eb7da2599be, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:00.121829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9886a4-3770-4c47-a879-4ab0ebbe8100 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:00.235519 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1998/4019] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:42:00 2022] PUT /identity/v3/projects/98617e3a5b6c449c88449c236a8f2ecf/users/82daefe001364499b2ee9eb7da2599be/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:00.241157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ee7c4-05e2-4440-9e9f-8374a756a5bc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:00.241671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ee7c4-05e2-4440-9e9f-8374a756a5bc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:00.242394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ee7c4-05e2-4440-9e9f-8374a756a5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:00.263753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-769ee7c4-05e2-4440-9e9f-8374a756a5bc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:00.264980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-769ee7c4-05e2-4440-9e9f-8374a756a5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:00.330815 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2022/4020] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:42:00.338915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9886a4-3770-4c47-a879-4ab0ebbe8100 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:00.340933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-df9886a4-3770-4c47-a879-4ab0ebbe8100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:00.409605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9886a4-3770-4c47-a879-4ab0ebbe8100 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:00.470491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ba0e9-0ee4-4bc9-8b2c-a6fb4618b330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:00.470491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ba0e9-0ee4-4bc9-8b2c-a6fb4618b330 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:00.470491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ba0e9-0ee4-4bc9-8b2c-a6fb4618b330 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:00.470491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ba0e9-0ee4-4bc9-8b2c-a6fb4618b330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:00.470935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ba0e9-0ee4-4bc9-8b2c-a6fb4618b330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:00.470935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ba0e9-0ee4-4bc9-8b2c-a6fb4618b330 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:00.470935 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 1999/4021] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:42:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:42:01.101235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:01.229290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2518d-a4ec-4f4a-9b5f-03bcd5b573c8 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:01.229586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2518d-a4ec-4f4a-9b5f-03bcd5b573c8 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:01.230826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2518d-a4ec-4f4a-9b5f-03bcd5b573c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:01.262555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-07f2518d-a4ec-4f4a-9b5f-03bcd5b573c8 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:01.263794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-07f2518d-a4ec-4f4a-9b5f-03bcd5b573c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:01.324095 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2023/4022] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:42:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:01.338906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ba0e9-0ee4-4bc9-8b2c-a6fb4618b330 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:01.338906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6d3ba0e9-0ee4-4bc9-8b2c-a6fb4618b330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:01.430286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ba0e9-0ee4-4bc9-8b2c-a6fb4618b330 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:01.435725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c318d7-2524-4be3-812f-2eab10f7446d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:01.436536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c318d7-2524-4be3-812f-2eab10f7446d service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:01.436915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c318d7-2524-4be3-812f-2eab10f7446d service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:01.437299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c318d7-2524-4be3-812f-2eab10f7446d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:01.446684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c318d7-2524-4be3-812f-2eab10f7446d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:01.448590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c318d7-2524-4be3-812f-2eab10f7446d service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:01.457271 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2000/4023] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:42:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:01.473164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:02.171297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b1858-632c-4b2c-8587-5c934d4d05a1 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:02.171585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b1858-632c-4b2c-8587-5c934d4d05a1 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:02.171866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b1858-632c-4b2c-8587-5c934d4d05a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:02.200570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-461b1858-632c-4b2c-8587-5c934d4d05a1 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:02.201983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-461b1858-632c-4b2c-8587-5c934d4d05a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:02.209616 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2024/4024] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:42:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:02.222616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c318d7-2524-4be3-812f-2eab10f7446d service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:02.235176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c318d7-2524-4be3-812f-2eab10f7446d service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:02.240400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb632dd-3d27-47ae-8bf1-25de4dba3cdf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:02.241725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb632dd-3d27-47ae-8bf1-25de4dba3cdf service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:02.242078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb632dd-3d27-47ae-8bf1-25de4dba3cdf service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:02.242363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb632dd-3d27-47ae-8bf1-25de4dba3cdf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:02.250838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb632dd-3d27-47ae-8bf1-25de4dba3cdf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:02.252521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb632dd-3d27-47ae-8bf1-25de4dba3cdf service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:02.262314 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2001/4025] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:42:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:02.465860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092a0c2-e012-4b8f-b8b8-6677f41b4178 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:02.466443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092a0c2-e012-4b8f-b8b8-6677f41b4178 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:02.469678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092a0c2-e012-4b8f-b8b8-6677f41b4178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:02.510501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f092a0c2-e012-4b8f-b8b8-6677f41b4178 None None] MFA Rules not processed for user `82daefe001364499b2ee9eb7da2599be`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:02.512180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f092a0c2-e012-4b8f-b8b8-6677f41b4178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:02.604154 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2025/4026] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:02.700384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8589f-5c10-4612-9845-7243d2f116b2 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:02.700860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8589f-5c10-4612-9845-7243d2f116b2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:02.700990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8589f-5c10-4612-9845-7243d2f116b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:02.726073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-88f8589f-5c10-4612-9845-7243d2f116b2 None None] MFA Rules not processed for user `82daefe001364499b2ee9eb7da2599be`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:02.727854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-88f8589f-5c10-4612-9845-7243d2f116b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:02.736988 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2002/4027] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:02.746389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7c3c2-12dd-4e2b-b0e8-7aab1fbe738c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:02.747061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7c3c2-12dd-4e2b-b0e8-7aab1fbe738c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:02.753297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7c3c2-12dd-4e2b-b0e8-7aab1fbe738c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:02.780299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-35e7c3c2-12dd-4e2b-b0e8-7aab1fbe738c None None] MFA Rules not processed for user `82daefe001364499b2ee9eb7da2599be`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:02.781736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-35e7c3c2-12dd-4e2b-b0e8-7aab1fbe738c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:02.797426 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2026/4028] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:02.809989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8589f-5c10-4612-9845-7243d2f116b2 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:02.817861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-88f8589f-5c10-4612-9845-7243d2f116b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:02.920517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8589f-5c10-4612-9845-7243d2f116b2 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:02.926547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d409c4d-10e7-4488-8053-6edd4d9bf748 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:02.927245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d409c4d-10e7-4488-8053-6edd4d9bf748 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:02.930010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d409c4d-10e7-4488-8053-6edd4d9bf748 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:02.930010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d409c4d-10e7-4488-8053-6edd4d9bf748 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:02.937968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d409c4d-10e7-4488-8053-6edd4d9bf748 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:02.939824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d409c4d-10e7-4488-8053-6edd4d9bf748 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:02.951964 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2003/4029] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:42:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:42:03.175015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c79c7-5ff4-4b53-9bc1-f7cd438fae7b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:03.175308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c79c7-5ff4-4b53-9bc1-f7cd438fae7b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:03.176029 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c79c7-5ff4-4b53-9bc1-f7cd438fae7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:03.211539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-fe3c79c7-5ff4-4b53-9bc1-f7cd438fae7b None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:03.212860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fe3c79c7-5ff4-4b53-9bc1-f7cd438fae7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:03.221847 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2027/4030] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:42:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:42:03.236396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d409c4d-10e7-4488-8053-6edd4d9bf748 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:03.254189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d409c4d-10e7-4488-8053-6edd4d9bf748 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:03.259976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0150805-dfbc-4012-9ae0-5b52123a9fb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:03.260734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0150805-dfbc-4012-9ae0-5b52123a9fb4 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:03.261123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0150805-dfbc-4012-9ae0-5b52123a9fb4 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:03.261502 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0150805-dfbc-4012-9ae0-5b52123a9fb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:03.274651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0150805-dfbc-4012-9ae0-5b52123a9fb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:03.276661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0150805-dfbc-4012-9ae0-5b52123a9fb4 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:03.289299 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2004/4031] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:42:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:03.739586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055271f2-1844-4ddf-8c95-3030eb1ca7c8 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:03.743935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055271f2-1844-4ddf-8c95-3030eb1ca7c8 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:03.743935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055271f2-1844-4ddf-8c95-3030eb1ca7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:03.789254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-055271f2-1844-4ddf-8c95-3030eb1ca7c8 None None] MFA Rules not processed for user `82daefe001364499b2ee9eb7da2599be`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:03.791182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-055271f2-1844-4ddf-8c95-3030eb1ca7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:03.806078 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2028/4032] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:03.847074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0150805-dfbc-4012-9ae0-5b52123a9fb4 service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:03.848759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c0150805-dfbc-4012-9ae0-5b52123a9fb4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:03.876639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0150805-dfbc-4012-9ae0-5b52123a9fb4 service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:03.883611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba361cea-298f-4802-b065-e0fac21da09e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:03.884332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba361cea-298f-4802-b065-e0fac21da09e service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:03.885222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba361cea-298f-4802-b065-e0fac21da09e service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:03.885636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba361cea-298f-4802-b065-e0fac21da09e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:03.892768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ba361cea-298f-4802-b065-e0fac21da09e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:03.930789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba361cea-298f-4802-b065-e0fac21da09e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:03.932283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba361cea-298f-4802-b065-e0fac21da09e service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:03.989970 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2005/4033] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:42:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:42:04.369343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afad2d-8a29-4e10-979f-d8863c06477b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:04.369949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afad2d-8a29-4e10-979f-d8863c06477b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:04.371110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afad2d-8a29-4e10-979f-d8863c06477b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:04.394708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-07afad2d-8a29-4e10-979f-d8863c06477b None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:04.396197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-07afad2d-8a29-4e10-979f-d8863c06477b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:04.419521 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2029/4034] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:42:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:42:04.420395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba361cea-298f-4802-b065-e0fac21da09e service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:04.436919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba361cea-298f-4802-b065-e0fac21da09e service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:04.451855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0f878-cb4e-4693-acde-87a738a92f2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:04.452594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0f878-cb4e-4693-acde-87a738a92f2d service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:04.452879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0f878-cb4e-4693-acde-87a738a92f2d service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:04.453156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0f878-cb4e-4693-acde-87a738a92f2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:04.463622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:04.466329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0f878-cb4e-4693-acde-87a738a92f2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:04.467941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0f878-cb4e-4693-acde-87a738a92f2d service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:04.476923 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2006/4035] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:42:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 03:42:04.678506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4d236-6769-4407-a8f5-a0eaa6334583 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:04.678838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4d236-6769-4407-a8f5-a0eaa6334583 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:04.679127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4d236-6769-4407-a8f5-a0eaa6334583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:04.706295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-09d4d236-6769-4407-a8f5-a0eaa6334583 None None] MFA Rules not processed for user `82daefe001364499b2ee9eb7da2599be`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:04.708595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-09d4d236-6769-4407-a8f5-a0eaa6334583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:04.722316 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2030/4036] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:05.598110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784e1e8-7303-46e3-8578-fd9f478c64b0 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:05.598622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784e1e8-7303-46e3-8578-fd9f478c64b0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:05.598843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784e1e8-7303-46e3-8578-fd9f478c64b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:05.665136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5784e1e8-7303-46e3-8578-fd9f478c64b0 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:05.666440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5784e1e8-7303-46e3-8578-fd9f478c64b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:05.677208 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2007/4037] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:42:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:05.697164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4d236-6769-4407-a8f5-a0eaa6334583 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:05.718228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4d236-6769-4407-a8f5-a0eaa6334583 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:05.737323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff2957-1e22-4146-8da3-4981bd5dde3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:05.737970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff2957-1e22-4146-8da3-4981bd5dde3e service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:05.738284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff2957-1e22-4146-8da3-4981bd5dde3e service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:05.738617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff2957-1e22-4146-8da3-4981bd5dde3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:05.763239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff2957-1e22-4146-8da3-4981bd5dde3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:05.772834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff2957-1e22-4146-8da3-4981bd5dde3e service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:05.777012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:05.793457 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2031/4038] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:42:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:06.880676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f666d7-5097-44f5-9f88-e4320f5afdb4 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:06.881164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f666d7-5097-44f5-9f88-e4320f5afdb4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:06.881253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f666d7-5097-44f5-9f88-e4320f5afdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:06.927892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f6f666d7-5097-44f5-9f88-e4320f5afdb4 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:06.929819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f6f666d7-5097-44f5-9f88-e4320f5afdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:06.941510 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2008/4039] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:42:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:42:06.954549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff2957-1e22-4146-8da3-4981bd5dde3e service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:06.974378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff2957-1e22-4146-8da3-4981bd5dde3e service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:06.984626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465aede-05a6-4d00-b972-3a977b2f383d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:06.985270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465aede-05a6-4d00-b972-3a977b2f383d service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:06.985558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465aede-05a6-4d00-b972-3a977b2f383d service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:06.985839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465aede-05a6-4d00-b972-3a977b2f383d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:06.995008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465aede-05a6-4d00-b972-3a977b2f383d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:06.996650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465aede-05a6-4d00-b972-3a977b2f383d service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:07.004654 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2032/4040] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:42:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:08.833683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1984e3-48fe-4a23-9382-8ecb0604f6ac None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:08.834167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1984e3-48fe-4a23-9382-8ecb0604f6ac None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:08.834384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1984e3-48fe-4a23-9382-8ecb0604f6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:08.874658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-af1984e3-48fe-4a23-9382-8ecb0604f6ac None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:08.874658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-af1984e3-48fe-4a23-9382-8ecb0604f6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:08.903563 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2009/4041] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:42:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:08.915653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465aede-05a6-4d00-b972-3a977b2f383d service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:08.946644 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465aede-05a6-4d00-b972-3a977b2f383d service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:08.966952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797ee78-cc4e-466d-ad63-ff52b0f1aac4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:08.968297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797ee78-cc4e-466d-ad63-ff52b0f1aac4 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:08.969058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797ee78-cc4e-466d-ad63-ff52b0f1aac4 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:08.969631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797ee78-cc4e-466d-ad63-ff52b0f1aac4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:09.001165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797ee78-cc4e-466d-ad63-ff52b0f1aac4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:09.003655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797ee78-cc4e-466d-ad63-ff52b0f1aac4 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:09.051573 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2033/4042] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:42:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:09.621479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09341b84-03b9-44f2-b5e6-1e1b399b972e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:09.626091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09341b84-03b9-44f2-b5e6-1e1b399b972e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:09.626091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09341b84-03b9-44f2-b5e6-1e1b399b972e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:09.645960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-09341b84-03b9-44f2-b5e6-1e1b399b972e None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:09.647700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-09341b84-03b9-44f2-b5e6-1e1b399b972e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:09.657794 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2010/4043] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:42:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:09.693167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797ee78-cc4e-466d-ad63-ff52b0f1aac4 service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:09.728469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797ee78-cc4e-466d-ad63-ff52b0f1aac4 service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:09.752635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d767b45-6513-439b-871c-d284431ccacc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:09.753274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d767b45-6513-439b-871c-d284431ccacc service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:09.753568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d767b45-6513-439b-871c-d284431ccacc service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:09.753822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d767b45-6513-439b-871c-d284431ccacc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:09.783879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d767b45-6513-439b-871c-d284431ccacc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:09.786691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d767b45-6513-439b-871c-d284431ccacc service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:09.793901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f560a-0d04-41c1-b362-8bc0fdd6068e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:09.794456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f560a-0d04-41c1-b362-8bc0fdd6068e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:09.798999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f560a-0d04-41c1-b362-8bc0fdd6068e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:09.809275 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2034/4044] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:42:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:09.831294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4f4f560a-0d04-41c1-b362-8bc0fdd6068e None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:09.832800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4f4f560a-0d04-41c1-b362-8bc0fdd6068e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:09.843543 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2011/4045] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:42:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:09.864038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d767b45-6513-439b-871c-d284431ccacc service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:09.880367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d767b45-6513-439b-871c-d284431ccacc service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:09.890730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362acc7a-9d02-46a0-8ff5-59c0d2996e5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:09.892545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362acc7a-9d02-46a0-8ff5-59c0d2996e5b service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:09.892991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362acc7a-9d02-46a0-8ff5-59c0d2996e5b service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:09.893432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362acc7a-9d02-46a0-8ff5-59c0d2996e5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:09.908122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362acc7a-9d02-46a0-8ff5-59c0d2996e5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:09.910272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362acc7a-9d02-46a0-8ff5-59c0d2996e5b service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:09.955415 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2035/4046] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:42:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:10.339698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70862c-9cd3-4670-b977-82da5a2cbb2e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:10.340089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70862c-9cd3-4670-b977-82da5a2cbb2e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:10.340469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70862c-9cd3-4670-b977-82da5a2cbb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:10.389615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6e70862c-9cd3-4670-b977-82da5a2cbb2e None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:10.393515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6e70862c-9cd3-4670-b977-82da5a2cbb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:10.408458 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2012/4047] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:42:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:10.431783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362acc7a-9d02-46a0-8ff5-59c0d2996e5b service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:10.453256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362acc7a-9d02-46a0-8ff5-59c0d2996e5b service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:10.467137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014605c8-a1d4-45f0-866a-a665571f737c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:10.469084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014605c8-a1d4-45f0-866a-a665571f737c service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:10.469763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014605c8-a1d4-45f0-866a-a665571f737c service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:10.470090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014605c8-a1d4-45f0-866a-a665571f737c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:10.485076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014605c8-a1d4-45f0-866a-a665571f737c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:10.488879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014605c8-a1d4-45f0-866a-a665571f737c service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:10.514152 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2036/4048] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:42:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:11.079427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e37a1-a920-491c-9079-a44ccba42ac8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:11.079924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e37a1-a920-491c-9079-a44ccba42ac8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:11.080028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e37a1-a920-491c-9079-a44ccba42ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:11.116023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-721e37a1-a920-491c-9079-a44ccba42ac8 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:11.118205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-721e37a1-a920-491c-9079-a44ccba42ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:11.129147 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2013/4049] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:42:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:11.143080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014605c8-a1d4-45f0-866a-a665571f737c service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:11.156577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014605c8-a1d4-45f0-866a-a665571f737c service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:11.164074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429963c9-025b-4e76-b1de-4f184c480e77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:11.164944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429963c9-025b-4e76-b1de-4f184c480e77 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:11.167955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429963c9-025b-4e76-b1de-4f184c480e77 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:11.167955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429963c9-025b-4e76-b1de-4f184c480e77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:11.198875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429963c9-025b-4e76-b1de-4f184c480e77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:11.200647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429963c9-025b-4e76-b1de-4f184c480e77 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:11.234337 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2037/4050] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:42:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:11.819860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebc3f1-ad85-4157-a395-c329b3aeb51d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:11.820150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebc3f1-ad85-4157-a395-c329b3aeb51d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:11.820432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebc3f1-ad85-4157-a395-c329b3aeb51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:11.858424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a5ebc3f1-ad85-4157-a395-c329b3aeb51d None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:11.859687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a5ebc3f1-ad85-4157-a395-c329b3aeb51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:11.876516 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2014/4051] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:42:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:11.892285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429963c9-025b-4e76-b1de-4f184c480e77 service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:11.908088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429963c9-025b-4e76-b1de-4f184c480e77 service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:11.924742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b4662-8db2-4ef9-85a1-8ef0a86fc79a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:11.925590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b4662-8db2-4ef9-85a1-8ef0a86fc79a service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:11.925989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b4662-8db2-4ef9-85a1-8ef0a86fc79a service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:11.926398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b4662-8db2-4ef9-85a1-8ef0a86fc79a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:11.942783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b4662-8db2-4ef9-85a1-8ef0a86fc79a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:11.944530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b4662-8db2-4ef9-85a1-8ef0a86fc79a service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:11.988304 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2038/4052] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:42:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:12.526337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61beb7-6d71-45b3-a62d-9cb60f05fca2 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:12.526842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61beb7-6d71-45b3-a62d-9cb60f05fca2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:12.526925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61beb7-6d71-45b3-a62d-9cb60f05fca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:12.555142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9f61beb7-6d71-45b3-a62d-9cb60f05fca2 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:12.556573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9f61beb7-6d71-45b3-a62d-9cb60f05fca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:12.565641 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2015/4053] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:42:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:12.579014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b4662-8db2-4ef9-85a1-8ef0a86fc79a service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:12.595335 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b4662-8db2-4ef9-85a1-8ef0a86fc79a service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:12.601740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f83b2-3342-4c9e-8f4d-2ac7e765433e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:12.602513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f83b2-3342-4c9e-8f4d-2ac7e765433e service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:12.603063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f83b2-3342-4c9e-8f4d-2ac7e765433e service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:12.603537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f83b2-3342-4c9e-8f4d-2ac7e765433e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:12.613086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f83b2-3342-4c9e-8f4d-2ac7e765433e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:12.615184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f83b2-3342-4c9e-8f4d-2ac7e765433e service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:12.625439 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2039/4054] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:42:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:12.965336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61beb7-6d71-45b3-a62d-9cb60f05fca2 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:12.986065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61beb7-6d71-45b3-a62d-9cb60f05fca2 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:12.993475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca353b8-6332-4028-bcbb-8386e9f7d4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:12.994066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca353b8-6332-4028-bcbb-8386e9f7d4ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:12.994357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca353b8-6332-4028-bcbb-8386e9f7d4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:12.994795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca353b8-6332-4028-bcbb-8386e9f7d4ea admin admin] PATH_INFO: `/v3/users/bb0c791cce5542629a035462fc60cd4a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:12.996119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca353b8-6332-4028-bcbb-8386e9f7d4ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb0c791cce5542629a035462fc60cd4a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:12.998364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca353b8-6332-4028-bcbb-8386e9f7d4ea admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:13.195138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-aca353b8-6332-4028-bcbb-8386e9f7d4ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb0c791cce5542629a035462fc60cd4a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:13.199950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-aca353b8-6332-4028-bcbb-8386e9f7d4ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb0c791cce5542629a035462fc60cd4a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:13.207818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-aca353b8-6332-4028-bcbb-8386e9f7d4ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb0c791cce5542629a035462fc60cd4a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:13.235596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-aca353b8-6332-4028-bcbb-8386e9f7d4ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb0c791cce5542629a035462fc60cd4a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:13.358228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-aca353b8-6332-4028-bcbb-8386e9f7d4ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb0c791cce5542629a035462fc60cd4a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:13.365300 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2016/4055] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:42:12 2022] DELETE /identity/v3/users/bb0c791cce5542629a035462fc60cd4a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:13.370404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0b26d-103c-499f-8f74-33e38e26ed4f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:13.370879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0b26d-103c-499f-8f74-33e38e26ed4f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:13.371156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0b26d-103c-499f-8f74-33e38e26ed4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:13.391439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8de0b26d-103c-499f-8f74-33e38e26ed4f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:13.392340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8de0b26d-103c-499f-8f74-33e38e26ed4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:13.483185 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2040/4056] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:42:13.494465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca353b8-6332-4028-bcbb-8386e9f7d4ea admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:13.498121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-aca353b8-6332-4028-bcbb-8386e9f7d4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:13.611428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca353b8-6332-4028-bcbb-8386e9f7d4ea admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:13.623251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1bd39-6ef8-4b6d-ad7c-473267d7e917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:13.629283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1bd39-6ef8-4b6d-ad7c-473267d7e917 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:13.629896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1bd39-6ef8-4b6d-ad7c-473267d7e917 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:13.631293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1bd39-6ef8-4b6d-ad7c-473267d7e917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:13.660376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1bd39-6ef8-4b6d-ad7c-473267d7e917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:13.661856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1bd39-6ef8-4b6d-ad7c-473267d7e917 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:13.676256 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2017/4057] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:42:14.401869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0b26d-103c-499f-8f74-33e38e26ed4f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:14.407605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8de0b26d-103c-499f-8f74-33e38e26ed4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:14.418060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0b26d-103c-499f-8f74-33e38e26ed4f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:14.426443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06142b50-7bdf-4ad3-9e88-abe69edc12d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:14.430246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06142b50-7bdf-4ad3-9e88-abe69edc12d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:14.434978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06142b50-7bdf-4ad3-9e88-abe69edc12d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:14.434978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06142b50-7bdf-4ad3-9e88-abe69edc12d5 admin admin] PATH_INFO: `/v3/projects/906255df6c3045fc9851983f78f686bf` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:14.434978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06142b50-7bdf-4ad3-9e88-abe69edc12d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=906255df6c3045fc9851983f78f686bf)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:14.434978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06142b50-7bdf-4ad3-9e88-abe69edc12d5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:14.559943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:14.562229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-06142b50-7bdf-4ad3-9e88-abe69edc12d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '906255df6c3045fc9851983f78f686bf', 'request_id': 'req-06142b50-7bdf-4ad3-9e88-abe69edc12d5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:14.569351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-06142b50-7bdf-4ad3-9e88-abe69edc12d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '906255df6c3045fc9851983f78f686bf', 'request_id': 'req-06142b50-7bdf-4ad3-9e88-abe69edc12d5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:14.577098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-06142b50-7bdf-4ad3-9e88-abe69edc12d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '906255df6c3045fc9851983f78f686bf', 'request_id': 'req-06142b50-7bdf-4ad3-9e88-abe69edc12d5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:14.690473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-06142b50-7bdf-4ad3-9e88-abe69edc12d5 admin admin] The token cache is being invalidate because project 906255df6c3045fc9851983f78f686bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:42:14.691080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-06142b50-7bdf-4ad3-9e88-abe69edc12d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:14.691958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-06142b50-7bdf-4ad3-9e88-abe69edc12d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:14.693999 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2041/4058] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:42:14 2022] DELETE /identity/v3/projects/906255df6c3045fc9851983f78f686bf => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:14.699926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9582e86-9a9d-462e-a910-3d5a8b33068e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:14.700980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9582e86-9a9d-462e-a910-3d5a8b33068e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:14.701438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9582e86-9a9d-462e-a910-3d5a8b33068e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:14.743435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c9582e86-9a9d-462e-a910-3d5a8b33068e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:14.750490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c9582e86-9a9d-462e-a910-3d5a8b33068e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:14.754079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:14.832399 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2018/4059] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:14.843566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325292c-13cf-4db0-b751-2070a2ad7029 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:14.843857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325292c-13cf-4db0-b751-2070a2ad7029 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:14.844135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325292c-13cf-4db0-b751-2070a2ad7029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:14.873513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2325292c-13cf-4db0-b751-2070a2ad7029 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:14.874953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2325292c-13cf-4db0-b751-2070a2ad7029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:14.896268 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2042/4060] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:14.896452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9582e86-9a9d-462e-a910-3d5a8b33068e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:14.917827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9582e86-9a9d-462e-a910-3d5a8b33068e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:14.925217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f4d3a-d7f4-4593-ab10-87c7c8032c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:14.926174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f4d3a-d7f4-4593-ab10-87c7c8032c40 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:14.926688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f4d3a-d7f4-4593-ab10-87c7c8032c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:14.927167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f4d3a-d7f4-4593-ab10-87c7c8032c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:14.929440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f4d3a-d7f4-4593-ab10-87c7c8032c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:42:14.929965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f4d3a-d7f4-4593-ab10-87c7c8032c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:14.934484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f4d3a-d7f4-4593-ab10-87c7c8032c40 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:14.952065 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2019/4061] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:42:14.956235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325292c-13cf-4db0-b751-2070a2ad7029 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:14.970301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325292c-13cf-4db0-b751-2070a2ad7029 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:14.978491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3120e9-b69e-4f75-958c-f2b5bde6da01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:14.979681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3120e9-b69e-4f75-958c-f2b5bde6da01 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:14.980389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3120e9-b69e-4f75-958c-f2b5bde6da01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:14.980890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3120e9-b69e-4f75-958c-f2b5bde6da01 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:14.982026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3120e9-b69e-4f75-958c-f2b5bde6da01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:14.984809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3120e9-b69e-4f75-958c-f2b5bde6da01 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:15.110805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f4d3a-d7f4-4593-ab10-87c7c8032c40 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:15.111190 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2043/4062] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:42:14 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:42:15.123579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f4d3a-d7f4-4593-ab10-87c7c8032c40 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:15.200196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d684b-ee53-4a48-b0a6-25a38e9c780a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:15.201162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d684b-ee53-4a48-b0a6-25a38e9c780a admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:15.203204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d684b-ee53-4a48-b0a6-25a38e9c780a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:15.203774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d684b-ee53-4a48-b0a6-25a38e9c780a admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:15.205268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d684b-ee53-4a48-b0a6-25a38e9c780a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:15.208354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d684b-ee53-4a48-b0a6-25a38e9c780a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:15.335949 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2020/4063] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:42:15 2022] POST /identity/v3/users => generated 287 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:42:15.341384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3120e9-b69e-4f75-958c-f2b5bde6da01 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:15.353319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3120e9-b69e-4f75-958c-f2b5bde6da01 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:15.362930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314796aa-6a94-487d-b90e-e99cb56365d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:15.363855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314796aa-6a94-487d-b90e-e99cb56365d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:15.364291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314796aa-6a94-487d-b90e-e99cb56365d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:15.367235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314796aa-6a94-487d-b90e-e99cb56365d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:15.367235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314796aa-6a94-487d-b90e-e99cb56365d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:15.368641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314796aa-6a94-487d-b90e-e99cb56365d3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:15.385696 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2044/4064] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:42:15.389821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d684b-ee53-4a48-b0a6-25a38e9c780a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:15.404058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d684b-ee53-4a48-b0a6-25a38e9c780a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:15.424609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3a706-76eb-4022-85de-9a47130e737e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:15.425217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3a706-76eb-4022-85de-9a47130e737e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:15.425527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3a706-76eb-4022-85de-9a47130e737e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:15.425810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3a706-76eb-4022-85de-9a47130e737e admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:15.427150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3a706-76eb-4022-85de-9a47130e737e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:15.428846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3a706-76eb-4022-85de-9a47130e737e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:15.444853 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2021/4065] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:42:15.448962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314796aa-6a94-487d-b90e-e99cb56365d3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:15.476972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314796aa-6a94-487d-b90e-e99cb56365d3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:15.483092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6de653-8dac-4b6f-8865-c97b4009638e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:15.483913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6de653-8dac-4b6f-8865-c97b4009638e admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:15.484427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6de653-8dac-4b6f-8865-c97b4009638e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:15.484781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6de653-8dac-4b6f-8865-c97b4009638e admin admin] PATH_INFO: `/v3/projects/d4eb72e2915d4e28b92ace5b297977ac/users/a27738dc568243d1ad30a583b5291052/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:15.513510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6de653-8dac-4b6f-8865-c97b4009638e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4eb72e2915d4e28b92ace5b297977ac, user_id=a27738dc568243d1ad30a583b5291052, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:15.518399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6de653-8dac-4b6f-8865-c97b4009638e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:15.593763 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2045/4066] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:42:15 2022] PUT /identity/v3/projects/d4eb72e2915d4e28b92ace5b297977ac/users/a27738dc568243d1ad30a583b5291052/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:42:15.604882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea887d7c-20b6-4d3e-8573-b1df70984873 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:15.605159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea887d7c-20b6-4d3e-8573-b1df70984873 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:15.605438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea887d7c-20b6-4d3e-8573-b1df70984873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:15.637246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ea887d7c-20b6-4d3e-8573-b1df70984873 None None] MFA Rules not processed for user `a27738dc568243d1ad30a583b5291052`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:15.638542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ea887d7c-20b6-4d3e-8573-b1df70984873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:15.739025 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2022/4067] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:15.751951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6de653-8dac-4b6f-8865-c97b4009638e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:15.754463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ed6de653-8dac-4b6f-8865-c97b4009638e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:15.818000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6de653-8dac-4b6f-8865-c97b4009638e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:15.822731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d91cf-4f1d-4973-a3fa-fde170f3a339 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:15.823426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d91cf-4f1d-4973-a3fa-fde170f3a339 service glance] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:15.823778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d91cf-4f1d-4973-a3fa-fde170f3a339 service glance] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:15.824203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d91cf-4f1d-4973-a3fa-fde170f3a339 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:15.835937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d91cf-4f1d-4973-a3fa-fde170f3a339 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:15.841826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d91cf-4f1d-4973-a3fa-fde170f3a339 service glance] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:15.850308 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2046/4068] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:42:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:42:15.958820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea887d7c-20b6-4d3e-8573-b1df70984873 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:15.968679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:16.029444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea887d7c-20b6-4d3e-8573-b1df70984873 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:16.035756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7322fe-382a-4eeb-88f6-8868927ccfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:16.041450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7322fe-382a-4eeb-88f6-8868927ccfd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:16.041450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7322fe-382a-4eeb-88f6-8868927ccfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:16.041450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7322fe-382a-4eeb-88f6-8868927ccfd6 admin admin] PATH_INFO: `/v3/users/a27738dc568243d1ad30a583b5291052` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:16.041450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7322fe-382a-4eeb-88f6-8868927ccfd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a27738dc568243d1ad30a583b5291052)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:16.042627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7322fe-382a-4eeb-88f6-8868927ccfd6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:16.228237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0b7322fe-382a-4eeb-88f6-8868927ccfd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a27738dc568243d1ad30a583b5291052'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:16.229154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0b7322fe-382a-4eeb-88f6-8868927ccfd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a27738dc568243d1ad30a583b5291052'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:16.252113 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0b7322fe-382a-4eeb-88f6-8868927ccfd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a27738dc568243d1ad30a583b5291052'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:16.267675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0b7322fe-382a-4eeb-88f6-8868927ccfd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a27738dc568243d1ad30a583b5291052'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:16.353104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0b7322fe-382a-4eeb-88f6-8868927ccfd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a27738dc568243d1ad30a583b5291052'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:16.359620 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2023/4069] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:42:15 2022] DELETE /identity/v3/users/a27738dc568243d1ad30a583b5291052 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:16.364157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7527672-a8df-40df-b07e-c669f907d182 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:16.364440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7527672-a8df-40df-b07e-c669f907d182 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:16.364750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7527672-a8df-40df-b07e-c669f907d182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:16.384756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d7527672-a8df-40df-b07e-c669f907d182 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:16.385956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d7527672-a8df-40df-b07e-c669f907d182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:16.446750 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2047/4070] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:42:16.456460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7322fe-382a-4eeb-88f6-8868927ccfd6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:16.457922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0b7322fe-382a-4eeb-88f6-8868927ccfd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:16.516993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7322fe-382a-4eeb-88f6-8868927ccfd6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:16.520761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeea576-24f7-44cf-ac0e-884b2f6333b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:16.521475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeea576-24f7-44cf-ac0e-884b2f6333b2 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:16.521711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeea576-24f7-44cf-ac0e-884b2f6333b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:16.521986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeea576-24f7-44cf-ac0e-884b2f6333b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:16.531945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeea576-24f7-44cf-ac0e-884b2f6333b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:16.533008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeea576-24f7-44cf-ac0e-884b2f6333b2 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:16.543625 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2024/4071] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:42:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:42:17.098494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7527672-a8df-40df-b07e-c669f907d182 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:17.098972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d7527672-a8df-40df-b07e-c669f907d182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:17.111427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7527672-a8df-40df-b07e-c669f907d182 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:17.118457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e6b91-37c8-467a-b64d-afbb66960146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:17.121435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e6b91-37c8-467a-b64d-afbb66960146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:17.121435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e6b91-37c8-467a-b64d-afbb66960146 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:17.121435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e6b91-37c8-467a-b64d-afbb66960146 admin admin] PATH_INFO: `/v3/projects/d4eb72e2915d4e28b92ace5b297977ac` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:17.121435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e6b91-37c8-467a-b64d-afbb66960146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4eb72e2915d4e28b92ace5b297977ac)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:17.122928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e6b91-37c8-467a-b64d-afbb66960146 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:17.138218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:17.266828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e61e6b91-37c8-467a-b64d-afbb66960146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4eb72e2915d4e28b92ace5b297977ac', 'request_id': 'req-e61e6b91-37c8-467a-b64d-afbb66960146'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:17.274305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e61e6b91-37c8-467a-b64d-afbb66960146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4eb72e2915d4e28b92ace5b297977ac', 'request_id': 'req-e61e6b91-37c8-467a-b64d-afbb66960146'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:17.280197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e61e6b91-37c8-467a-b64d-afbb66960146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4eb72e2915d4e28b92ace5b297977ac', 'request_id': 'req-e61e6b91-37c8-467a-b64d-afbb66960146'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:17.378270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e61e6b91-37c8-467a-b64d-afbb66960146 admin admin] The token cache is being invalidate because project d4eb72e2915d4e28b92ace5b297977ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:42:17.380726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e61e6b91-37c8-467a-b64d-afbb66960146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:17.381775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e61e6b91-37c8-467a-b64d-afbb66960146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:17.384026 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2048/4072] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:42:17 2022] DELETE /identity/v3/projects/d4eb72e2915d4e28b92ace5b297977ac => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:17.388836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae991a-da47-49cd-a2c9-e08f947e370b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:17.389297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae991a-da47-49cd-a2c9-e08f947e370b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:17.389683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae991a-da47-49cd-a2c9-e08f947e370b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:17.411662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-68ae991a-da47-49cd-a2c9-e08f947e370b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:17.413856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-68ae991a-da47-49cd-a2c9-e08f947e370b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:17.460051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:17.508946 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2025/4073] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:17.516876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9d090-dfd2-4b9b-a6c5-e676ca8e3868 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:17.517195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9d090-dfd2-4b9b-a6c5-e676ca8e3868 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:17.517481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9d090-dfd2-4b9b-a6c5-e676ca8e3868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:17.544278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-21e9d090-dfd2-4b9b-a6c5-e676ca8e3868 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:17.545617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-21e9d090-dfd2-4b9b-a6c5-e676ca8e3868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:17.557108 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2049/4074] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:17.558798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae991a-da47-49cd-a2c9-e08f947e370b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:17.568585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae991a-da47-49cd-a2c9-e08f947e370b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:17.573553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9111f-7a43-4f40-b70b-6d4ce3d8e3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:17.574319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9111f-7a43-4f40-b70b-6d4ce3d8e3de admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:17.574598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9111f-7a43-4f40-b70b-6d4ce3d8e3de admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:17.574982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9111f-7a43-4f40-b70b-6d4ce3d8e3de admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:17.575703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9111f-7a43-4f40-b70b-6d4ce3d8e3de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:42:17.575968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9111f-7a43-4f40-b70b-6d4ce3d8e3de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:17.577564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9111f-7a43-4f40-b70b-6d4ce3d8e3de admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:17.593242 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2026/4075] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:42:17.594435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9d090-dfd2-4b9b-a6c5-e676ca8e3868 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:17.604384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9d090-dfd2-4b9b-a6c5-e676ca8e3868 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:17.609580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cc78d-d139-401a-82e5-29da908b510a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:17.610505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cc78d-d139-401a-82e5-29da908b510a admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:17.610777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cc78d-d139-401a-82e5-29da908b510a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:17.611042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cc78d-d139-401a-82e5-29da908b510a admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:17.611663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cc78d-d139-401a-82e5-29da908b510a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:17.613602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cc78d-d139-401a-82e5-29da908b510a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:17.673144 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2050/4076] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:42:17 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:42:17.677616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9111f-7a43-4f40-b70b-6d4ce3d8e3de admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:17.688110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9111f-7a43-4f40-b70b-6d4ce3d8e3de admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:17.747953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7560f7-9634-447b-a277-6918477e7110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:17.748581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7560f7-9634-447b-a277-6918477e7110 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:17.748862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7560f7-9634-447b-a277-6918477e7110 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:17.749144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7560f7-9634-447b-a277-6918477e7110 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:17.749923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7560f7-9634-447b-a277-6918477e7110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:17.751944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7560f7-9634-447b-a277-6918477e7110 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:17.830306 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2027/4077] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:42:17 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:42:17.831639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cc78d-d139-401a-82e5-29da908b510a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:17.842370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cc78d-d139-401a-82e5-29da908b510a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:17.847748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124faa0b-f170-4372-bf1b-14d24c038e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:17.848442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124faa0b-f170-4372-bf1b-14d24c038e3c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:17.848727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124faa0b-f170-4372-bf1b-14d24c038e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:17.849009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124faa0b-f170-4372-bf1b-14d24c038e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:17.849639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124faa0b-f170-4372-bf1b-14d24c038e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:17.851405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124faa0b-f170-4372-bf1b-14d24c038e3c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:17.861474 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2051/4078] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:42:17.865470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7560f7-9634-447b-a277-6918477e7110 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:17.877343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7560f7-9634-447b-a277-6918477e7110 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:17.882804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f9de2-a720-470c-8a98-d437db0f673d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:17.883410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f9de2-a720-470c-8a98-d437db0f673d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:17.883689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f9de2-a720-470c-8a98-d437db0f673d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:17.883960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f9de2-a720-470c-8a98-d437db0f673d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:17.884603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f9de2-a720-470c-8a98-d437db0f673d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:17.886229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f9de2-a720-470c-8a98-d437db0f673d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:17.897258 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2028/4079] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:42:17.902177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124faa0b-f170-4372-bf1b-14d24c038e3c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:17.912668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124faa0b-f170-4372-bf1b-14d24c038e3c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:17.917906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889fe1d-3909-4f59-bee9-c12d2fd11c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:17.918867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889fe1d-3909-4f59-bee9-c12d2fd11c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:17.919145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889fe1d-3909-4f59-bee9-c12d2fd11c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:17.919417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889fe1d-3909-4f59-bee9-c12d2fd11c22 admin admin] PATH_INFO: `/v3/projects/86a076796a7746179d15618dc20f210d/users/eb090e1256b1470ba9a0876053582302/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:17.935185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889fe1d-3909-4f59-bee9-c12d2fd11c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86a076796a7746179d15618dc20f210d, user_id=eb090e1256b1470ba9a0876053582302, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:17.937829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889fe1d-3909-4f59-bee9-c12d2fd11c22 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:18.012141 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2052/4080] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:42:17 2022] PUT /identity/v3/projects/86a076796a7746179d15618dc20f210d/users/eb090e1256b1470ba9a0876053582302/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:18.023417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b3ebf-ca5d-468e-86fd-8db3a04450fb None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:18.023715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b3ebf-ca5d-468e-86fd-8db3a04450fb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:18.024001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b3ebf-ca5d-468e-86fd-8db3a04450fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:18.055485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-376b3ebf-ca5d-468e-86fd-8db3a04450fb None None] MFA Rules not processed for user `eb090e1256b1470ba9a0876053582302`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:18.056784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-376b3ebf-ca5d-468e-86fd-8db3a04450fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:18.139547 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2029/4081] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:18.143890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889fe1d-3909-4f59-bee9-c12d2fd11c22 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:18.226913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889fe1d-3909-4f59-bee9-c12d2fd11c22 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:18.238847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcf155-6b8a-4d4a-9831-fb16fd124ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:18.242219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcf155-6b8a-4d4a-9831-fb16fd124ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:18.242652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcf155-6b8a-4d4a-9831-fb16fd124ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:18.243025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcf155-6b8a-4d4a-9831-fb16fd124ac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:18.243781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcf155-6b8a-4d4a-9831-fb16fd124ac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:18.247410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcf155-6b8a-4d4a-9831-fb16fd124ac2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:18.365995 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2053/4082] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:42:18 2022] POST /identity/v3/projects => generated 373 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:42:18.369919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b3ebf-ca5d-468e-86fd-8db3a04450fb None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:18.383826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b3ebf-ca5d-468e-86fd-8db3a04450fb None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:18.415877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:18.487035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e5ecd-f21e-4551-abeb-2724cf93f951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:18.488338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e5ecd-f21e-4551-abeb-2724cf93f951 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:18.489122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e5ecd-f21e-4551-abeb-2724cf93f951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:18.489412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e5ecd-f21e-4551-abeb-2724cf93f951 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:18.490329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e5ecd-f21e-4551-abeb-2724cf93f951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:18.493230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e5ecd-f21e-4551-abeb-2724cf93f951 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:18.633381 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2030/4083] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:42:18 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:42:18.634261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcf155-6b8a-4d4a-9831-fb16fd124ac2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:18.653884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcf155-6b8a-4d4a-9831-fb16fd124ac2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:18.663992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90b7fd-11bb-46fe-b5a5-e309acd7a4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:18.664537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90b7fd-11bb-46fe-b5a5-e309acd7a4de admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:18.664823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90b7fd-11bb-46fe-b5a5-e309acd7a4de admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:18.665102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90b7fd-11bb-46fe-b5a5-e309acd7a4de admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:18.671458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90b7fd-11bb-46fe-b5a5-e309acd7a4de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:18.671458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90b7fd-11bb-46fe-b5a5-e309acd7a4de admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:18.694332 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2054/4084] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:42:18.697907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e5ecd-f21e-4551-abeb-2724cf93f951 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:18.708949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e5ecd-f21e-4551-abeb-2724cf93f951 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:18.715090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7076912-5c61-4bb5-af82-01fdee3042ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:18.715906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7076912-5c61-4bb5-af82-01fdee3042ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:18.716264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7076912-5c61-4bb5-af82-01fdee3042ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:18.716748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7076912-5c61-4bb5-af82-01fdee3042ac admin admin] PATH_INFO: `/v3/projects/7cd2732eaeb349e3a8fbcf3b550285d3/users/b350e096f39944aa8833ce457e1a3dc2/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:18.751127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7076912-5c61-4bb5-af82-01fdee3042ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cd2732eaeb349e3a8fbcf3b550285d3, user_id=b350e096f39944aa8833ce457e1a3dc2, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:18.753941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7076912-5c61-4bb5-af82-01fdee3042ac admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:18.863440 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2031/4085] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:42:18 2022] PUT /identity/v3/projects/7cd2732eaeb349e3a8fbcf3b550285d3/users/b350e096f39944aa8833ce457e1a3dc2/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:18.868188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90b7fd-11bb-46fe-b5a5-e309acd7a4de admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:18.881107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90b7fd-11bb-46fe-b5a5-e309acd7a4de admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:18.891797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:18.958164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ed229-2653-4de0-afb8-7b226877d05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:18.958754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ed229-2653-4de0-afb8-7b226877d05e admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:18.959036 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ed229-2653-4de0-afb8-7b226877d05e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:18.959308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ed229-2653-4de0-afb8-7b226877d05e admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:18.961235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ed229-2653-4de0-afb8-7b226877d05e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:18.963226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ed229-2653-4de0-afb8-7b226877d05e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:18.977476 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2055/4086] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:42:18.981702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7076912-5c61-4bb5-af82-01fdee3042ac admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:19.001023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7076912-5c61-4bb5-af82-01fdee3042ac admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:19.009400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9369b31-a774-41ad-9ac9-157b6bbd94cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:19.011443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9369b31-a774-41ad-9ac9-157b6bbd94cd admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:19.011927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9369b31-a774-41ad-9ac9-157b6bbd94cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:19.012547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9369b31-a774-41ad-9ac9-157b6bbd94cd admin admin] PATH_INFO: `/v3/projects/7cd2732eaeb349e3a8fbcf3b550285d3/users/b350e096f39944aa8833ce457e1a3dc2/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:19.015432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9369b31-a774-41ad-9ac9-157b6bbd94cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cd2732eaeb349e3a8fbcf3b550285d3, user_id=b350e096f39944aa8833ce457e1a3dc2, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:19.025984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9369b31-a774-41ad-9ac9-157b6bbd94cd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:19.042382 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2032/4087] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:42:18 2022] PUT /identity/v3/projects/7cd2732eaeb349e3a8fbcf3b550285d3/users/b350e096f39944aa8833ce457e1a3dc2/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:19.053867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856bc9f-0452-492a-a28f-832147171e73 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:19.055092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856bc9f-0452-492a-a28f-832147171e73 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:19.055993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856bc9f-0452-492a-a28f-832147171e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:19.087968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7856bc9f-0452-492a-a28f-832147171e73 None None] MFA Rules not processed for user `b350e096f39944aa8833ce457e1a3dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:19.089784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7856bc9f-0452-492a-a28f-832147171e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:19.213393 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2056/4088] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:19.220944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9369b31-a774-41ad-9ac9-157b6bbd94cd admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:19.241380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9369b31-a774-41ad-9ac9-157b6bbd94cd admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:19.255522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c11ebc-5a5f-4d57-a0ed-486af2965082 tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b350e096f39944aa8833ce457e1a3dc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cd2732eaeb349e3a8fbcf3b550285d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:19.256215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c11ebc-5a5f-4d57-a0ed-486af2965082 tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:19.256576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c11ebc-5a5f-4d57-a0ed-486af2965082 tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:19.256931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c11ebc-5a5f-4d57-a0ed-486af2965082 tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:19.258428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c11ebc-5a5f-4d57-a0ed-486af2965082 tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:42:19.258815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c11ebc-5a5f-4d57-a0ed-486af2965082 tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:19.261215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c11ebc-5a5f-4d57-a0ed-486af2965082 tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:19.278621 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2033/4089] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:42:19.282127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856bc9f-0452-492a-a28f-832147171e73 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:19.297733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856bc9f-0452-492a-a28f-832147171e73 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:19.323280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2ca9d-2ff4-4094-8bf5-38b38d7765cf tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b350e096f39944aa8833ce457e1a3dc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cd2732eaeb349e3a8fbcf3b550285d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:19.323997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2ca9d-2ff4-4094-8bf5-38b38d7765cf tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:19.324425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2ca9d-2ff4-4094-8bf5-38b38d7765cf tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:19.324709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2ca9d-2ff4-4094-8bf5-38b38d7765cf tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:19.325511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2ca9d-2ff4-4094-8bf5-38b38d7765cf tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:19.328084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2ca9d-2ff4-4094-8bf5-38b38d7765cf tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:19.446789 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2057/4090] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:42:19 2022] POST /identity/v3/projects => generated 350 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:42:19.451168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c11ebc-5a5f-4d57-a0ed-486af2965082 tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:19.463392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c11ebc-5a5f-4d57-a0ed-486af2965082 tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:19.535259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ffc89-5663-460d-8ff0-a96ab1765f2d tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b350e096f39944aa8833ce457e1a3dc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cd2732eaeb349e3a8fbcf3b550285d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:19.536958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ffc89-5663-460d-8ff0-a96ab1765f2d tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:19.536958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ffc89-5663-460d-8ff0-a96ab1765f2d tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:19.536958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ffc89-5663-460d-8ff0-a96ab1765f2d tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:19.537496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ffc89-5663-460d-8ff0-a96ab1765f2d tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:42:19.537898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ffc89-5663-460d-8ff0-a96ab1765f2d tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:19.539991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ffc89-5663-460d-8ff0-a96ab1765f2d tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:19.561606 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2034/4091] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:42:19.570581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2ca9d-2ff4-4094-8bf5-38b38d7765cf tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:19.572564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a6a2ca9d-2ff4-4094-8bf5-38b38d7765cf tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:19.653077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2ca9d-2ff4-4094-8bf5-38b38d7765cf tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:19.657028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61ff1b-c2e4-46d9-a87e-22183595f9a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:19.657646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61ff1b-c2e4-46d9-a87e-22183595f9a0 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:19.658134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61ff1b-c2e4-46d9-a87e-22183595f9a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:19.658416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61ff1b-c2e4-46d9-a87e-22183595f9a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:19.669484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61ff1b-c2e4-46d9-a87e-22183595f9a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:19.671361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61ff1b-c2e4-46d9-a87e-22183595f9a0 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:19.682165 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2058/4092] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:42:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:42:22.580703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ffc89-5663-460d-8ff0-a96ab1765f2d tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:22.591346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ffc89-5663-460d-8ff0-a96ab1765f2d tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:22.596230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8913e67-0832-422a-a056-107098f9acc6 tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b350e096f39944aa8833ce457e1a3dc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cd2732eaeb349e3a8fbcf3b550285d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:22.596870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8913e67-0832-422a-a056-107098f9acc6 tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:22.603511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8913e67-0832-422a-a056-107098f9acc6 tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:22.603511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8913e67-0832-422a-a056-107098f9acc6 tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] PATH_INFO: `/v3/projects/0d23204ea7df49fa9d12fd9ff68bbfd4` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:22.603511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8913e67-0832-422a-a056-107098f9acc6 tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0d23204ea7df49fa9d12fd9ff68bbfd4)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:22.603511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8913e67-0832-422a-a056-107098f9acc6 tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:22.738249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f8913e67-0832-422a-a056-107098f9acc6 tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d23204ea7df49fa9d12fd9ff68bbfd4', 'request_id': 'req-f8913e67-0832-422a-a056-107098f9acc6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:22.742297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:22.853860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f8913e67-0832-422a-a056-107098f9acc6 tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d23204ea7df49fa9d12fd9ff68bbfd4', 'request_id': 'req-f8913e67-0832-422a-a056-107098f9acc6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:22.878719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f8913e67-0832-422a-a056-107098f9acc6 tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d23204ea7df49fa9d12fd9ff68bbfd4', 'request_id': 'req-f8913e67-0832-422a-a056-107098f9acc6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:22.891950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f8913e67-0832-422a-a056-107098f9acc6 tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] The token cache is being invalidate because project 0d23204ea7df49fa9d12fd9ff68bbfd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:42:22.894478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f8913e67-0832-422a-a056-107098f9acc6 tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:22.894478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f8913e67-0832-422a-a056-107098f9acc6 tempest-QuotasNegativeTest-1928912438 tempest-QuotasNegativeTest-1928912438-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:22.895031 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2035/4093] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:42:22 2022] DELETE /identity/v3/projects/0d23204ea7df49fa9d12fd9ff68bbfd4 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:22.900722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61ff1b-c2e4-46d9-a87e-22183595f9a0 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:22.920215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:23.001799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61ff1b-c2e4-46d9-a87e-22183595f9a0 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:23.103210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37344f3e-ae09-44bc-9d8c-0ada2b4d8a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:23.104278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37344f3e-ae09-44bc-9d8c-0ada2b4d8a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:23.104533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37344f3e-ae09-44bc-9d8c-0ada2b4d8a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:23.104829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37344f3e-ae09-44bc-9d8c-0ada2b4d8a7b admin admin] PATH_INFO: `/v3/users/eb090e1256b1470ba9a0876053582302` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:23.106489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37344f3e-ae09-44bc-9d8c-0ada2b4d8a7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb090e1256b1470ba9a0876053582302)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:23.108859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37344f3e-ae09-44bc-9d8c-0ada2b4d8a7b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:23.419179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-37344f3e-ae09-44bc-9d8c-0ada2b4d8a7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb090e1256b1470ba9a0876053582302'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:23.420089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-37344f3e-ae09-44bc-9d8c-0ada2b4d8a7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb090e1256b1470ba9a0876053582302'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:23.428836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-37344f3e-ae09-44bc-9d8c-0ada2b4d8a7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb090e1256b1470ba9a0876053582302'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:23.455682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-37344f3e-ae09-44bc-9d8c-0ada2b4d8a7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb090e1256b1470ba9a0876053582302'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:23.456744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-37344f3e-ae09-44bc-9d8c-0ada2b4d8a7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb090e1256b1470ba9a0876053582302'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:23.563751 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2059/4094] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:42:22 2022] DELETE /identity/v3/users/eb090e1256b1470ba9a0876053582302 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:23.566166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf6bed-1ab5-42b2-a6f1-9188b83f7ffa None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:23.566503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf6bed-1ab5-42b2-a6f1-9188b83f7ffa None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:23.567400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf6bed-1ab5-42b2-a6f1-9188b83f7ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:23.607316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-67cf6bed-1ab5-42b2-a6f1-9188b83f7ffa None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:23.609315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-67cf6bed-1ab5-42b2-a6f1-9188b83f7ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:23.682220 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2036/4095] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:23.691821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37344f3e-ae09-44bc-9d8c-0ada2b4d8a7b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:23.694181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-37344f3e-ae09-44bc-9d8c-0ada2b4d8a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:23.761263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:23.793796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37344f3e-ae09-44bc-9d8c-0ada2b4d8a7b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:23.799479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e314f84-2a2f-4319-93fc-1459fb88060b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:23.802507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e314f84-2a2f-4319-93fc-1459fb88060b service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:23.802507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e314f84-2a2f-4319-93fc-1459fb88060b service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:23.802507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e314f84-2a2f-4319-93fc-1459fb88060b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:23.817875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e314f84-2a2f-4319-93fc-1459fb88060b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:23.820320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e314f84-2a2f-4319-93fc-1459fb88060b service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:23.848278 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2060/4096] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:42:24.407143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf6bed-1ab5-42b2-a6f1-9188b83f7ffa None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:24.408769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-67cf6bed-1ab5-42b2-a6f1-9188b83f7ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:24.434080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf6bed-1ab5-42b2-a6f1-9188b83f7ffa None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:24.441378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de500d8-118e-4352-a8ac-239d19215b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:24.448248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de500d8-118e-4352-a8ac-239d19215b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:24.448248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de500d8-118e-4352-a8ac-239d19215b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:24.448248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de500d8-118e-4352-a8ac-239d19215b04 admin admin] PATH_INFO: `/v3/projects/86a076796a7746179d15618dc20f210d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:24.449718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de500d8-118e-4352-a8ac-239d19215b04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86a076796a7746179d15618dc20f210d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:24.453804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de500d8-118e-4352-a8ac-239d19215b04 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:24.687833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3de500d8-118e-4352-a8ac-239d19215b04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86a076796a7746179d15618dc20f210d', 'request_id': 'req-3de500d8-118e-4352-a8ac-239d19215b04'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:24.791992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3de500d8-118e-4352-a8ac-239d19215b04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86a076796a7746179d15618dc20f210d', 'request_id': 'req-3de500d8-118e-4352-a8ac-239d19215b04'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:24.800538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3de500d8-118e-4352-a8ac-239d19215b04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86a076796a7746179d15618dc20f210d', 'request_id': 'req-3de500d8-118e-4352-a8ac-239d19215b04'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:24.830004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3de500d8-118e-4352-a8ac-239d19215b04 admin admin] The token cache is being invalidate because project 86a076796a7746179d15618dc20f210d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:42:24.830004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3de500d8-118e-4352-a8ac-239d19215b04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:24.831241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3de500d8-118e-4352-a8ac-239d19215b04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:24.833508 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2037/4097] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:42:24 2022] DELETE /identity/v3/projects/86a076796a7746179d15618dc20f210d => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:24.837887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e314f84-2a2f-4319-93fc-1459fb88060b service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:24.859074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e314f84-2a2f-4319-93fc-1459fb88060b service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:24.985986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a993867-4637-4073-80d6-7c47909c771f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:24.986706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a993867-4637-4073-80d6-7c47909c771f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:24.986991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a993867-4637-4073-80d6-7c47909c771f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:24.987266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a993867-4637-4073-80d6-7c47909c771f admin admin] PATH_INFO: `/v3/users/b350e096f39944aa8833ce457e1a3dc2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:24.988428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a993867-4637-4073-80d6-7c47909c771f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b350e096f39944aa8833ce457e1a3dc2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:24.990506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a993867-4637-4073-80d6-7c47909c771f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:25.221995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4a993867-4637-4073-80d6-7c47909c771f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b350e096f39944aa8833ce457e1a3dc2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:25.223143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4a993867-4637-4073-80d6-7c47909c771f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b350e096f39944aa8833ce457e1a3dc2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:25.236788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4a993867-4637-4073-80d6-7c47909c771f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b350e096f39944aa8833ce457e1a3dc2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:25.261552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4a993867-4637-4073-80d6-7c47909c771f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b350e096f39944aa8833ce457e1a3dc2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:25.263373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4a993867-4637-4073-80d6-7c47909c771f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b350e096f39944aa8833ce457e1a3dc2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:25.391831 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2061/4098] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:42:24 2022] DELETE /identity/v3/users/b350e096f39944aa8833ce457e1a3dc2 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:26.297965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de500d8-118e-4352-a8ac-239d19215b04 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:26.300140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3de500d8-118e-4352-a8ac-239d19215b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:26.327482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de500d8-118e-4352-a8ac-239d19215b04 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:26.419943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17e1ee-8bc3-404d-86e6-ce0ebb9c9f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:26.420839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17e1ee-8bc3-404d-86e6-ce0ebb9c9f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:26.421322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17e1ee-8bc3-404d-86e6-ce0ebb9c9f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:26.422088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17e1ee-8bc3-404d-86e6-ce0ebb9c9f95 admin admin] PATH_INFO: `/v3/projects/7cd2732eaeb349e3a8fbcf3b550285d3` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:26.423534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17e1ee-8bc3-404d-86e6-ce0ebb9c9f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cd2732eaeb349e3a8fbcf3b550285d3)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:26.426260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17e1ee-8bc3-404d-86e6-ce0ebb9c9f95 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:26.439582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:26.657393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7d17e1ee-8bc3-404d-86e6-ce0ebb9c9f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cd2732eaeb349e3a8fbcf3b550285d3', 'request_id': 'req-7d17e1ee-8bc3-404d-86e6-ce0ebb9c9f95'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:26.781395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7d17e1ee-8bc3-404d-86e6-ce0ebb9c9f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cd2732eaeb349e3a8fbcf3b550285d3', 'request_id': 'req-7d17e1ee-8bc3-404d-86e6-ce0ebb9c9f95'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:26.795194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7d17e1ee-8bc3-404d-86e6-ce0ebb9c9f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cd2732eaeb349e3a8fbcf3b550285d3', 'request_id': 'req-7d17e1ee-8bc3-404d-86e6-ce0ebb9c9f95'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:26.809719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7d17e1ee-8bc3-404d-86e6-ce0ebb9c9f95 admin admin] The token cache is being invalidate because project 7cd2732eaeb349e3a8fbcf3b550285d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:42:26.813146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7d17e1ee-8bc3-404d-86e6-ce0ebb9c9f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:26.813146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7d17e1ee-8bc3-404d-86e6-ce0ebb9c9f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:26.813146 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2038/4099] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:42:26 2022] DELETE /identity/v3/projects/7cd2732eaeb349e3a8fbcf3b550285d3 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:26.817435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f4f7b-1648-4f4e-8664-865a57b1848b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:26.818470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f4f7b-1648-4f4e-8664-865a57b1848b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:26.818954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f4f7b-1648-4f4e-8664-865a57b1848b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:26.848920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7a8f4f7b-1648-4f4e-8664-865a57b1848b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:26.853271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7a8f4f7b-1648-4f4e-8664-865a57b1848b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:26.951296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:26.967332 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2062/4100] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:26.973739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73144e98-9f3f-4158-9338-1fba0e12b394 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:26.973739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73144e98-9f3f-4158-9338-1fba0e12b394 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:26.973739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73144e98-9f3f-4158-9338-1fba0e12b394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:26.992756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-73144e98-9f3f-4158-9338-1fba0e12b394 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:26.993977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-73144e98-9f3f-4158-9338-1fba0e12b394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:27.003519 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2039/4101] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:27.007022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f4f7b-1648-4f4e-8664-865a57b1848b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:27.020305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f4f7b-1648-4f4e-8664-865a57b1848b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:27.025327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a58d6-0563-43af-b701-a3d509102f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:27.045487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a58d6-0563-43af-b701-a3d509102f6f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:27.045487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a58d6-0563-43af-b701-a3d509102f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:27.045487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a58d6-0563-43af-b701-a3d509102f6f admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:27.045487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a58d6-0563-43af-b701-a3d509102f6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:42:27.045487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a58d6-0563-43af-b701-a3d509102f6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:27.045487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a58d6-0563-43af-b701-a3d509102f6f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:27.046085 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2063/4102] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:42:27.048399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73144e98-9f3f-4158-9338-1fba0e12b394 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:27.059214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73144e98-9f3f-4158-9338-1fba0e12b394 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:27.064926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3db48c-34bd-42bf-9cc2-b928ee08e93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:27.069392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3db48c-34bd-42bf-9cc2-b928ee08e93e admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:27.069392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3db48c-34bd-42bf-9cc2-b928ee08e93e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:27.069392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3db48c-34bd-42bf-9cc2-b928ee08e93e admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:27.069392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3db48c-34bd-42bf-9cc2-b928ee08e93e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:27.070965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3db48c-34bd-42bf-9cc2-b928ee08e93e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:27.195746 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2040/4103] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:42:27 2022] POST /identity/v3/projects => generated 407 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:42:27.196855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a58d6-0563-43af-b701-a3d509102f6f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:27.215437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a58d6-0563-43af-b701-a3d509102f6f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:27.280306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2ca4c-b54d-456c-af0c-846b49826465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:27.282085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2ca4c-b54d-456c-af0c-846b49826465 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:27.282085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2ca4c-b54d-456c-af0c-846b49826465 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:27.282085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2ca4c-b54d-456c-af0c-846b49826465 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:27.282571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2ca4c-b54d-456c-af0c-846b49826465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:27.284773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2ca4c-b54d-456c-af0c-846b49826465 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:27.372402 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2064/4104] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:42:27 2022] POST /identity/v3/users => generated 304 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:42:27.376879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3db48c-34bd-42bf-9cc2-b928ee08e93e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:27.392560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3db48c-34bd-42bf-9cc2-b928ee08e93e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:27.399389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62db2a-e8e9-49c7-b5d6-9bd997bd1d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:27.400481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62db2a-e8e9-49c7-b5d6-9bd997bd1d5d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:27.400984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62db2a-e8e9-49c7-b5d6-9bd997bd1d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:27.402181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62db2a-e8e9-49c7-b5d6-9bd997bd1d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:27.403238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62db2a-e8e9-49c7-b5d6-9bd997bd1d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:27.405902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62db2a-e8e9-49c7-b5d6-9bd997bd1d5d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:27.427383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2ca4c-b54d-456c-af0c-846b49826465 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:27.450198 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2041/4105] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:42:27.453526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2ca4c-b54d-456c-af0c-846b49826465 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:27.469076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999bb1e-473b-4fcf-bba4-e298261716d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:27.470010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999bb1e-473b-4fcf-bba4-e298261716d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:27.470527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999bb1e-473b-4fcf-bba4-e298261716d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:27.471540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999bb1e-473b-4fcf-bba4-e298261716d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:27.471921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999bb1e-473b-4fcf-bba4-e298261716d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:27.473773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999bb1e-473b-4fcf-bba4-e298261716d2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:27.502896 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2065/4106] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:42:27.507936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62db2a-e8e9-49c7-b5d6-9bd997bd1d5d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:27.520705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62db2a-e8e9-49c7-b5d6-9bd997bd1d5d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:27.547825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159007c3-8aee-41a7-94f7-4266b846245e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:27.548803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159007c3-8aee-41a7-94f7-4266b846245e admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:27.549250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159007c3-8aee-41a7-94f7-4266b846245e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:27.549688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159007c3-8aee-41a7-94f7-4266b846245e admin admin] PATH_INFO: `/v3/projects/c5e7690a7ca04e39981b477f99edf06a/users/da6e27b3a1684d9f904ed844114d2dbf/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:27.576069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159007c3-8aee-41a7-94f7-4266b846245e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e7690a7ca04e39981b477f99edf06a, user_id=da6e27b3a1684d9f904ed844114d2dbf, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:27.579220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159007c3-8aee-41a7-94f7-4266b846245e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:27.663395 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2042/4107] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:42:27 2022] PUT /identity/v3/projects/c5e7690a7ca04e39981b477f99edf06a/users/da6e27b3a1684d9f904ed844114d2dbf/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:27.675221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97b364-a51a-4398-92db-a564139fb831 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:27.675728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97b364-a51a-4398-92db-a564139fb831 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:27.676048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97b364-a51a-4398-92db-a564139fb831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:27.724118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9d97b364-a51a-4398-92db-a564139fb831 None None] MFA Rules not processed for user `da6e27b3a1684d9f904ed844114d2dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:27.725348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9d97b364-a51a-4398-92db-a564139fb831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:27.827074 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2066/4108] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:27 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:27.832442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159007c3-8aee-41a7-94f7-4266b846245e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:27.939425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159007c3-8aee-41a7-94f7-4266b846245e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:27.948769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5d845-e967-4632-95b8-1b491875475b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:27.949461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5d845-e967-4632-95b8-1b491875475b admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:27.949847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5d845-e967-4632-95b8-1b491875475b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:27.950385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5d845-e967-4632-95b8-1b491875475b admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:27.951134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5d845-e967-4632-95b8-1b491875475b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:27.953514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5d845-e967-4632-95b8-1b491875475b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:28.082949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97b364-a51a-4398-92db-a564139fb831 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:28.083894 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2043/4109] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:42:27 2022] POST /identity/v3/projects => generated 407 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:42:28.100032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97b364-a51a-4398-92db-a564139fb831 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:28.275410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:28.298312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e022b4-1533-4f74-bb15-e534b9ac200f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:28.299715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e022b4-1533-4f74-bb15-e534b9ac200f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:28.300473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e022b4-1533-4f74-bb15-e534b9ac200f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:28.300983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e022b4-1533-4f74-bb15-e534b9ac200f admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:28.302569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e022b4-1533-4f74-bb15-e534b9ac200f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:28.306743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e022b4-1533-4f74-bb15-e534b9ac200f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:28.443268 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2067/4110] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:42:28 2022] POST /identity/v3/users => generated 310 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:42:28.447781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5d845-e967-4632-95b8-1b491875475b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:28.462404 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5d845-e967-4632-95b8-1b491875475b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:28.474960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308d777-97eb-4cb3-8154-74e8c2627bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:28.474960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308d777-97eb-4cb3-8154-74e8c2627bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:28.474960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308d777-97eb-4cb3-8154-74e8c2627bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:28.474960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308d777-97eb-4cb3-8154-74e8c2627bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:28.475266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308d777-97eb-4cb3-8154-74e8c2627bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:28.475266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308d777-97eb-4cb3-8154-74e8c2627bf6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:28.490451 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2044/4111] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:42:28.496205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e022b4-1533-4f74-bb15-e534b9ac200f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:28.523772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e022b4-1533-4f74-bb15-e534b9ac200f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:28.531030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b70df1-fd4b-4bd2-99b6-6082b9d88035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:28.532053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b70df1-fd4b-4bd2-99b6-6082b9d88035 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:28.532573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b70df1-fd4b-4bd2-99b6-6082b9d88035 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:28.533075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b70df1-fd4b-4bd2-99b6-6082b9d88035 admin admin] PATH_INFO: `/v3/projects/0cfe7a50d6ab4c33b36d367b33169875/users/f66f508a17ab45788e43d620b88845af/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:28.557257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b70df1-fd4b-4bd2-99b6-6082b9d88035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cfe7a50d6ab4c33b36d367b33169875, user_id=f66f508a17ab45788e43d620b88845af, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:28.561442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b70df1-fd4b-4bd2-99b6-6082b9d88035 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:28.720223 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2068/4112] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:42:28 2022] PUT /identity/v3/projects/0cfe7a50d6ab4c33b36d367b33169875/users/f66f508a17ab45788e43d620b88845af/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:28.724469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308d777-97eb-4cb3-8154-74e8c2627bf6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:28.738103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308d777-97eb-4cb3-8154-74e8c2627bf6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:28.739113 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:28.808954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640ca9f-97bf-4cff-adb3-71055f873fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:28.809876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640ca9f-97bf-4cff-adb3-71055f873fad admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:28.810380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640ca9f-97bf-4cff-adb3-71055f873fad admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:28.810940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640ca9f-97bf-4cff-adb3-71055f873fad admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:28.811621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640ca9f-97bf-4cff-adb3-71055f873fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:28.813598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640ca9f-97bf-4cff-adb3-71055f873fad admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:28.826871 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2045/4113] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:42:28.832584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b70df1-fd4b-4bd2-99b6-6082b9d88035 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:28.847606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b70df1-fd4b-4bd2-99b6-6082b9d88035 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:28.854178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd8db4-3d28-4ea0-8623-4a89167900a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:28.854973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd8db4-3d28-4ea0-8623-4a89167900a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:28.857217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd8db4-3d28-4ea0-8623-4a89167900a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:28.857652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd8db4-3d28-4ea0-8623-4a89167900a1 admin admin] PATH_INFO: `/v3/projects/0cfe7a50d6ab4c33b36d367b33169875/users/f66f508a17ab45788e43d620b88845af/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:28.860296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd8db4-3d28-4ea0-8623-4a89167900a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cfe7a50d6ab4c33b36d367b33169875, user_id=f66f508a17ab45788e43d620b88845af, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:28.863666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd8db4-3d28-4ea0-8623-4a89167900a1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:28.876583 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2069/4114] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:42:28 2022] PUT /identity/v3/projects/0cfe7a50d6ab4c33b36d367b33169875/users/f66f508a17ab45788e43d620b88845af/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:28.980462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8ead6-9e07-4dc8-980f-9951c76c78ce None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:28.980667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8ead6-9e07-4dc8-980f-9951c76c78ce None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:28.980931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8ead6-9e07-4dc8-980f-9951c76c78ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:29.062283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c0c8ead6-9e07-4dc8-980f-9951c76c78ce None None] MFA Rules not processed for user `f66f508a17ab45788e43d620b88845af`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:29.063696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c0c8ead6-9e07-4dc8-980f-9951c76c78ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:29.194177 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2046/4115] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:28 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:29.204990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd8db4-3d28-4ea0-8623-4a89167900a1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:29.207127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b5dd8db4-3d28-4ea0-8623-4a89167900a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:29.351255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd8db4-3d28-4ea0-8623-4a89167900a1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:29.356410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfda70-bcac-481d-8a84-f21a2e9670b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:29.357457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfda70-bcac-481d-8a84-f21a2e9670b1 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:29.357997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfda70-bcac-481d-8a84-f21a2e9670b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:29.358378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfda70-bcac-481d-8a84-f21a2e9670b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:29.436369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbfda70-bcac-481d-8a84-f21a2e9670b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:29.436369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbfda70-bcac-481d-8a84-f21a2e9670b1 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:29.448777 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2070/4116] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:42:29 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:42:30.013439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8ead6-9e07-4dc8-980f-9951c76c78ce None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:30.025967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8ead6-9e07-4dc8-980f-9951c76c78ce None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:30.030678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c434a-6fc4-4d70-a12f-c62edc15a33e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:30.031524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c434a-6fc4-4d70-a12f-c62edc15a33e service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:30.032117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c434a-6fc4-4d70-a12f-c62edc15a33e service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:30.032571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c434a-6fc4-4d70-a12f-c62edc15a33e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:30.034642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-569c434a-6fc4-4d70-a12f-c62edc15a33e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:30.185702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c434a-6fc4-4d70-a12f-c62edc15a33e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:30.198448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c434a-6fc4-4d70-a12f-c62edc15a33e service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:30.213976 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2047/4117] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:42:30.220982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfda70-bcac-481d-8a84-f21a2e9670b1 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:30.223017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bdbfda70-bcac-481d-8a84-f21a2e9670b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:30.348892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:30.380627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfda70-bcac-481d-8a84-f21a2e9670b1 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:30.396593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011f6d2-d451-4b9d-8fd2-d2f95b9610fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:30.397185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011f6d2-d451-4b9d-8fd2-d2f95b9610fe service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:30.397612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011f6d2-d451-4b9d-8fd2-d2f95b9610fe service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:30.397895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011f6d2-d451-4b9d-8fd2-d2f95b9610fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:30.419070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011f6d2-d451-4b9d-8fd2-d2f95b9610fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:30.421781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011f6d2-d451-4b9d-8fd2-d2f95b9610fe service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:30.447966 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2071/4118] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:42:30 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:42:32.015835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15c1d0-2d48-4bc9-b832-8ec58513574f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:32.016370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15c1d0-2d48-4bc9-b832-8ec58513574f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:32.019152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15c1d0-2d48-4bc9-b832-8ec58513574f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:32.049367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4e15c1d0-2d48-4bc9-b832-8ec58513574f None None] MFA Rules not processed for user `5ffc2b1c410149e884a47240b5425e57`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:32.050857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4e15c1d0-2d48-4bc9-b832-8ec58513574f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:32.071632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:32.179626 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2048/4119] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:32.920375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011f6d2-d451-4b9d-8fd2-d2f95b9610fe service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:32.935854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011f6d2-d451-4b9d-8fd2-d2f95b9610fe service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:32.940794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99aedf-c720-47aa-800e-86c461ad184f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:32.941555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99aedf-c720-47aa-800e-86c461ad184f service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:32.941940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99aedf-c720-47aa-800e-86c461ad184f service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:32.942342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99aedf-c720-47aa-800e-86c461ad184f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:32.945677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ab99aedf-c720-47aa-800e-86c461ad184f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:32.959596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99aedf-c720-47aa-800e-86c461ad184f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:32.962345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99aedf-c720-47aa-800e-86c461ad184f service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:32.977560 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2072/4120] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:42:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:42:37.057723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15c1d0-2d48-4bc9-b832-8ec58513574f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:37.057723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4e15c1d0-2d48-4bc9-b832-8ec58513574f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:37.075326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15c1d0-2d48-4bc9-b832-8ec58513574f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:37.085853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e3f68-89b9-4eb7-a62c-ebee858949f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:37.085853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e3f68-89b9-4eb7-a62c-ebee858949f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:37.085853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e3f68-89b9-4eb7-a62c-ebee858949f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:37.085853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e3f68-89b9-4eb7-a62c-ebee858949f6 admin admin] PATH_INFO: `/v3/users/b1cc79af058b4c35b3c572448fac86a7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:37.086342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e3f68-89b9-4eb7-a62c-ebee858949f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1cc79af058b4c35b3c572448fac86a7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:37.086342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e3f68-89b9-4eb7-a62c-ebee858949f6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:37.350087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-848e3f68-89b9-4eb7-a62c-ebee858949f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1cc79af058b4c35b3c572448fac86a7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:37.351211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-848e3f68-89b9-4eb7-a62c-ebee858949f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1cc79af058b4c35b3c572448fac86a7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:37.360017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-848e3f68-89b9-4eb7-a62c-ebee858949f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1cc79af058b4c35b3c572448fac86a7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:37.378413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-848e3f68-89b9-4eb7-a62c-ebee858949f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1cc79af058b4c35b3c572448fac86a7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:37.465638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-848e3f68-89b9-4eb7-a62c-ebee858949f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1cc79af058b4c35b3c572448fac86a7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:37.478642 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2049/4121] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:42:37 2022] DELETE /identity/v3/users/b1cc79af058b4c35b3c572448fac86a7 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:37.805277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99aedf-c720-47aa-800e-86c461ad184f service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:37.834098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99aedf-c720-47aa-800e-86c461ad184f service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:37.950453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117f9ce-3a92-48bc-9f67-c2ba5fab38a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:37.951435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117f9ce-3a92-48bc-9f67-c2ba5fab38a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:37.952539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117f9ce-3a92-48bc-9f67-c2ba5fab38a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:37.954130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117f9ce-3a92-48bc-9f67-c2ba5fab38a0 admin admin] PATH_INFO: `/v3/projects/911997e881754ce390af17919f29b4ab` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:37.955816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117f9ce-3a92-48bc-9f67-c2ba5fab38a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=911997e881754ce390af17919f29b4ab)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:37.960187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117f9ce-3a92-48bc-9f67-c2ba5fab38a0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:38.117896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a117f9ce-3a92-48bc-9f67-c2ba5fab38a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '911997e881754ce390af17919f29b4ab', 'request_id': 'req-a117f9ce-3a92-48bc-9f67-c2ba5fab38a0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:38.136494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a117f9ce-3a92-48bc-9f67-c2ba5fab38a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '911997e881754ce390af17919f29b4ab', 'request_id': 'req-a117f9ce-3a92-48bc-9f67-c2ba5fab38a0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:38.145062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a117f9ce-3a92-48bc-9f67-c2ba5fab38a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '911997e881754ce390af17919f29b4ab', 'request_id': 'req-a117f9ce-3a92-48bc-9f67-c2ba5fab38a0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:38.176731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e3f68-89b9-4eb7-a62c-ebee858949f6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:38.178738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-848e3f68-89b9-4eb7-a62c-ebee858949f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:38.272111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a117f9ce-3a92-48bc-9f67-c2ba5fab38a0 admin admin] The token cache is being invalidate because project 911997e881754ce390af17919f29b4ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:42:38.273498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a117f9ce-3a92-48bc-9f67-c2ba5fab38a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:38.274393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a117f9ce-3a92-48bc-9f67-c2ba5fab38a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:38.276082 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2073/4122] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:42:37 2022] DELETE /identity/v3/projects/911997e881754ce390af17919f29b4ab => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:38.281505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790f955-c85d-4132-aee4-8c4a7897bfb8 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:38.282094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790f955-c85d-4132-aee4-8c4a7897bfb8 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:38.282559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790f955-c85d-4132-aee4-8c4a7897bfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:38.291567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e3f68-89b9-4eb7-a62c-ebee858949f6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:38.304130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4790f955-c85d-4132-aee4-8c4a7897bfb8 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:38.305662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4790f955-c85d-4132-aee4-8c4a7897bfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:38.385461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746d198-ec1c-4207-a1d9-54144745050e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:38.386510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746d198-ec1c-4207-a1d9-54144745050e service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:38.387245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746d198-ec1c-4207-a1d9-54144745050e service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:38.387767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746d198-ec1c-4207-a1d9-54144745050e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:38.397431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d746d198-ec1c-4207-a1d9-54144745050e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:38.407819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:38.455975 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2074/4123] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:42:38.457152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3a67b-dc3d-4180-8b37-133f26c370ff None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:38.457439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3a67b-dc3d-4180-8b37-133f26c370ff None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:38.457719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3a67b-dc3d-4180-8b37-133f26c370ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:38.488337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:38.501806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-44f3a67b-dc3d-4180-8b37-133f26c370ff None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:38.503288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-44f3a67b-dc3d-4180-8b37-133f26c370ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:38.516279 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2075/4124] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:38.519273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3a67b-dc3d-4180-8b37-133f26c370ff None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:38.523974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746d198-ec1c-4207-a1d9-54144745050e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:38.525762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746d198-ec1c-4207-a1d9-54144745050e service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:38.530741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3a67b-dc3d-4180-8b37-133f26c370ff None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:38.539862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c19305-ad14-4a87-9a18-2f5929e24988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:38.540494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c19305-ad14-4a87-9a18-2f5929e24988 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:38.540790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c19305-ad14-4a87-9a18-2f5929e24988 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:38.541050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c19305-ad14-4a87-9a18-2f5929e24988 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:38.542100 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2050/4125] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:42:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:42:38.544815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c19305-ad14-4a87-9a18-2f5929e24988 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:42:38.544815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c19305-ad14-4a87-9a18-2f5929e24988 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:38.546241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c19305-ad14-4a87-9a18-2f5929e24988 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:38.559799 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2076/4126] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:42:38.563935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746d198-ec1c-4207-a1d9-54144745050e service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:38.581256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746d198-ec1c-4207-a1d9-54144745050e service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:38.598705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc7ba9-be8c-4508-b08a-111aa92cbf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:38.599403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc7ba9-be8c-4508-b08a-111aa92cbf8a admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:38.599691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc7ba9-be8c-4508-b08a-111aa92cbf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:38.600149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc7ba9-be8c-4508-b08a-111aa92cbf8a admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:38.601377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc7ba9-be8c-4508-b08a-111aa92cbf8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:38.607862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc7ba9-be8c-4508-b08a-111aa92cbf8a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:38.730008 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2051/4127] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:42:38 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:42:38.734337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c19305-ad14-4a87-9a18-2f5929e24988 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:38.751191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c19305-ad14-4a87-9a18-2f5929e24988 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:38.876489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d803b-3bb3-4f61-ae66-ec15851def54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:38.878543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d803b-3bb3-4f61-ae66-ec15851def54 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:38.879202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d803b-3bb3-4f61-ae66-ec15851def54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:38.879764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d803b-3bb3-4f61-ae66-ec15851def54 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:38.880671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d803b-3bb3-4f61-ae66-ec15851def54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:38.884316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d803b-3bb3-4f61-ae66-ec15851def54 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:39.004062 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2077/4128] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:42:38 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:42:39.005754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc7ba9-be8c-4508-b08a-111aa92cbf8a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:39.025197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc7ba9-be8c-4508-b08a-111aa92cbf8a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:39.038551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117c322-430c-4210-b308-38994409500d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:39.038551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117c322-430c-4210-b308-38994409500d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:39.038551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117c322-430c-4210-b308-38994409500d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:39.038551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117c322-430c-4210-b308-38994409500d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:39.041361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117c322-430c-4210-b308-38994409500d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:39.045213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117c322-430c-4210-b308-38994409500d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:39.066428 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2052/4129] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:42:39.070662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d803b-3bb3-4f61-ae66-ec15851def54 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:39.082326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d803b-3bb3-4f61-ae66-ec15851def54 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:39.088073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a77f7-e5c8-4e70-97ac-bcf629b605da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:39.088726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a77f7-e5c8-4e70-97ac-bcf629b605da admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:39.089011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a77f7-e5c8-4e70-97ac-bcf629b605da admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:39.089287 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a77f7-e5c8-4e70-97ac-bcf629b605da admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:39.090139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a77f7-e5c8-4e70-97ac-bcf629b605da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:39.096037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a77f7-e5c8-4e70-97ac-bcf629b605da admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:39.109165 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2078/4130] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:42:39.110647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117c322-430c-4210-b308-38994409500d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:39.123045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117c322-430c-4210-b308-38994409500d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:39.128288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e58ffb-2b26-490a-9ce0-11241c0ca750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:39.130532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e58ffb-2b26-490a-9ce0-11241c0ca750 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:39.130532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e58ffb-2b26-490a-9ce0-11241c0ca750 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:39.130749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e58ffb-2b26-490a-9ce0-11241c0ca750 admin admin] PATH_INFO: `/v3/projects/eb2e83a4c2af45b49c6f23de08547160/users/9454949c8d794b6093d7d4fc64d12c33/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:39.147895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e58ffb-2b26-490a-9ce0-11241c0ca750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2e83a4c2af45b49c6f23de08547160, user_id=9454949c8d794b6093d7d4fc64d12c33, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:39.150810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e58ffb-2b26-490a-9ce0-11241c0ca750 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:39.234093 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2053/4131] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:42:39 2022] PUT /identity/v3/projects/eb2e83a4c2af45b49c6f23de08547160/users/9454949c8d794b6093d7d4fc64d12c33/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:39.235246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76467b8f-b92a-45c0-b241-897d2af5197d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:39.235780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76467b8f-b92a-45c0-b241-897d2af5197d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:39.235894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76467b8f-b92a-45c0-b241-897d2af5197d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:39.263644 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-76467b8f-b92a-45c0-b241-897d2af5197d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:39.266101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-76467b8f-b92a-45c0-b241-897d2af5197d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:39.345052 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2079/4132] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:42:39.370669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e58ffb-2b26-490a-9ce0-11241c0ca750 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:39.374002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-14e58ffb-2b26-490a-9ce0-11241c0ca750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:39.482384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e58ffb-2b26-490a-9ce0-11241c0ca750 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:39.490272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61646366-e894-49ff-aedf-6a6013dc5e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:39.500890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61646366-e894-49ff-aedf-6a6013dc5e90 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:39.501089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61646366-e894-49ff-aedf-6a6013dc5e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:39.501374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61646366-e894-49ff-aedf-6a6013dc5e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:39.530677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61646366-e894-49ff-aedf-6a6013dc5e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:39.532164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61646366-e894-49ff-aedf-6a6013dc5e90 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:39.551907 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2054/4133] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:42:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:42:44.778970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76467b8f-b92a-45c0-b241-897d2af5197d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:44.781389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-76467b8f-b92a-45c0-b241-897d2af5197d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:44.798203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76467b8f-b92a-45c0-b241-897d2af5197d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:44.804709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b968e58-a825-4b31-a3e4-8d6759436cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:44.806385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b968e58-a825-4b31-a3e4-8d6759436cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:44.807105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b968e58-a825-4b31-a3e4-8d6759436cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:44.807529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b968e58-a825-4b31-a3e4-8d6759436cb1 admin admin] PATH_INFO: `/v3/users/18036411a99e4634bfbaeae24b9f254d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:44.809270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b968e58-a825-4b31-a3e4-8d6759436cb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18036411a99e4634bfbaeae24b9f254d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:44.812995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b968e58-a825-4b31-a3e4-8d6759436cb1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:45.053976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61646366-e894-49ff-aedf-6a6013dc5e90 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:45.056664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-61646366-e894-49ff-aedf-6a6013dc5e90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:45.075929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4b968e58-a825-4b31-a3e4-8d6759436cb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18036411a99e4634bfbaeae24b9f254d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:45.075929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4b968e58-a825-4b31-a3e4-8d6759436cb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18036411a99e4634bfbaeae24b9f254d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:45.079557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61646366-e894-49ff-aedf-6a6013dc5e90 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:45.089889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4b968e58-a825-4b31-a3e4-8d6759436cb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18036411a99e4634bfbaeae24b9f254d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:45.092224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:45.093416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed42dad-9a09-43f6-8df8-d625138541bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:45.094255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed42dad-9a09-43f6-8df8-d625138541bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:45.094818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed42dad-9a09-43f6-8df8-d625138541bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:45.098870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed42dad-9a09-43f6-8df8-d625138541bb admin admin] PATH_INFO: `/v3/users/da6e27b3a1684d9f904ed844114d2dbf` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:45.098870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed42dad-9a09-43f6-8df8-d625138541bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=da6e27b3a1684d9f904ed844114d2dbf)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:45.109042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4b968e58-a825-4b31-a3e4-8d6759436cb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18036411a99e4634bfbaeae24b9f254d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:45.109434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed42dad-9a09-43f6-8df8-d625138541bb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:45.110342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4b968e58-a825-4b31-a3e4-8d6759436cb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18036411a99e4634bfbaeae24b9f254d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:45.214458 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2080/4134] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:42:44 2022] DELETE /identity/v3/users/18036411a99e4634bfbaeae24b9f254d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:45.400341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:45.405893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bed42dad-9a09-43f6-8df8-d625138541bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da6e27b3a1684d9f904ed844114d2dbf'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:45.407061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bed42dad-9a09-43f6-8df8-d625138541bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da6e27b3a1684d9f904ed844114d2dbf'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:45.464437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bed42dad-9a09-43f6-8df8-d625138541bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da6e27b3a1684d9f904ed844114d2dbf'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:45.495209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bed42dad-9a09-43f6-8df8-d625138541bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da6e27b3a1684d9f904ed844114d2dbf'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:45.540585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bed42dad-9a09-43f6-8df8-d625138541bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da6e27b3a1684d9f904ed844114d2dbf'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:45.553877 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2055/4135] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:42:45 2022] DELETE /identity/v3/users/da6e27b3a1684d9f904ed844114d2dbf => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:45.557046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7df8e-1cff-48e1-8b35-dbe6944d41cc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:45.557682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7df8e-1cff-48e1-8b35-dbe6944d41cc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:45.559366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7df8e-1cff-48e1-8b35-dbe6944d41cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:45.603273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-53c7df8e-1cff-48e1-8b35-dbe6944d41cc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:45.604519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-53c7df8e-1cff-48e1-8b35-dbe6944d41cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:45.650999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed42dad-9a09-43f6-8df8-d625138541bb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:45.652498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bed42dad-9a09-43f6-8df8-d625138541bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:45.798002 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2081/4136] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:45.809155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7df8e-1cff-48e1-8b35-dbe6944d41cc None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:45.815733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-53c7df8e-1cff-48e1-8b35-dbe6944d41cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:45.832885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed42dad-9a09-43f6-8df8-d625138541bb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:45.838525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22360a63-960b-4d9b-8203-41237690508a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:45.839180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22360a63-960b-4d9b-8203-41237690508a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:45.839469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22360a63-960b-4d9b-8203-41237690508a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:45.839747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22360a63-960b-4d9b-8203-41237690508a admin admin] PATH_INFO: `/v3/projects/229dcb63bc41444391544883b576ce2e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:45.840905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22360a63-960b-4d9b-8203-41237690508a admin admin] RBAC: Authorizing `identity:delete_project(project_id=229dcb63bc41444391544883b576ce2e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:45.854547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22360a63-960b-4d9b-8203-41237690508a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:45.898574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7df8e-1cff-48e1-8b35-dbe6944d41cc None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:45.902511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc6daf-030a-44d2-81d6-4e126d7a13a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:45.903324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc6daf-030a-44d2-81d6-4e126d7a13a5 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:45.903881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc6daf-030a-44d2-81d6-4e126d7a13a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:45.904456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc6daf-030a-44d2-81d6-4e126d7a13a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:45.915819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc6daf-030a-44d2-81d6-4e126d7a13a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:45.917708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc6daf-030a-44d2-81d6-4e126d7a13a5 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:45.930022 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2082/4137] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:42:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:42:46.011452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-22360a63-960b-4d9b-8203-41237690508a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '229dcb63bc41444391544883b576ce2e', 'request_id': 'req-22360a63-960b-4d9b-8203-41237690508a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:46.089983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-22360a63-960b-4d9b-8203-41237690508a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '229dcb63bc41444391544883b576ce2e', 'request_id': 'req-22360a63-960b-4d9b-8203-41237690508a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:46.102768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-22360a63-960b-4d9b-8203-41237690508a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '229dcb63bc41444391544883b576ce2e', 'request_id': 'req-22360a63-960b-4d9b-8203-41237690508a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:46.121649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-22360a63-960b-4d9b-8203-41237690508a admin admin] The token cache is being invalidate because project 229dcb63bc41444391544883b576ce2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:42:46.122318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-22360a63-960b-4d9b-8203-41237690508a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:46.124680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-22360a63-960b-4d9b-8203-41237690508a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:46.127257 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2056/4138] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:42:45 2022] DELETE /identity/v3/projects/229dcb63bc41444391544883b576ce2e => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:42:46.132477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a6d65-118d-4bb7-ad4a-086a083b47a9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:46.132768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a6d65-118d-4bb7-ad4a-086a083b47a9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:46.139203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a6d65-118d-4bb7-ad4a-086a083b47a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:46.155343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-564a6d65-118d-4bb7-ad4a-086a083b47a9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:46.156278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-564a6d65-118d-4bb7-ad4a-086a083b47a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:46.199556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22360a63-960b-4d9b-8203-41237690508a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:46.201258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-22360a63-960b-4d9b-8203-41237690508a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:46.260258 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2083/4139] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:46.268629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b346f-8a86-45e3-aa82-a0264485f7e4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:46.269069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b346f-8a86-45e3-aa82-a0264485f7e4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:46.269466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b346f-8a86-45e3-aa82-a0264485f7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:46.292093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-118b346f-8a86-45e3-aa82-a0264485f7e4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:46.293692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-118b346f-8a86-45e3-aa82-a0264485f7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:46.298420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22360a63-960b-4d9b-8203-41237690508a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:46.303963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec2e6b-6a4f-443a-9885-59335122ee56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:46.304160 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2084/4140] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:42:46.305065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec2e6b-6a4f-443a-9885-59335122ee56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:46.305452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec2e6b-6a4f-443a-9885-59335122ee56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:46.305826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec2e6b-6a4f-443a-9885-59335122ee56 admin admin] PATH_INFO: `/v3/projects/c5e7690a7ca04e39981b477f99edf06a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:46.307882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec2e6b-6a4f-443a-9885-59335122ee56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5e7690a7ca04e39981b477f99edf06a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:46.308306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b346f-8a86-45e3-aa82-a0264485f7e4 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:46.310395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec2e6b-6a4f-443a-9885-59335122ee56 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:46.323558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b346f-8a86-45e3-aa82-a0264485f7e4 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:46.328559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096a81a-4815-4e3f-9fa1-3455a235e45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:46.329338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096a81a-4815-4e3f-9fa1-3455a235e45a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:46.329630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096a81a-4815-4e3f-9fa1-3455a235e45a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:46.329932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096a81a-4815-4e3f-9fa1-3455a235e45a admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:46.330608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096a81a-4815-4e3f-9fa1-3455a235e45a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:42:46.330912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096a81a-4815-4e3f-9fa1-3455a235e45a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:46.332538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096a81a-4815-4e3f-9fa1-3455a235e45a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:46.346492 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2085/4141] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:42:46.351399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096a81a-4815-4e3f-9fa1-3455a235e45a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:46.362806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096a81a-4815-4e3f-9fa1-3455a235e45a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:46.368829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237e3e0-cb31-49ce-be09-59f12e716e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:46.369731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237e3e0-cb31-49ce-be09-59f12e716e63 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:46.370153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237e3e0-cb31-49ce-be09-59f12e716e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:46.370529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237e3e0-cb31-49ce-be09-59f12e716e63 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:46.371266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237e3e0-cb31-49ce-be09-59f12e716e63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:46.373725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237e3e0-cb31-49ce-be09-59f12e716e63 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:46.446759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f0ec2e6b-6a4f-443a-9885-59335122ee56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e7690a7ca04e39981b477f99edf06a', 'request_id': 'req-f0ec2e6b-6a4f-443a-9885-59335122ee56'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:46.471002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:46.524194 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2086/4142] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:42:46 2022] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:42:46.528171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237e3e0-cb31-49ce-be09-59f12e716e63 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:46.540053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f0ec2e6b-6a4f-443a-9885-59335122ee56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e7690a7ca04e39981b477f99edf06a', 'request_id': 'req-f0ec2e6b-6a4f-443a-9885-59335122ee56'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:46.555794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f0ec2e6b-6a4f-443a-9885-59335122ee56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e7690a7ca04e39981b477f99edf06a', 'request_id': 'req-f0ec2e6b-6a4f-443a-9885-59335122ee56'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:46.579577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f0ec2e6b-6a4f-443a-9885-59335122ee56 admin admin] The token cache is being invalidate because project c5e7690a7ca04e39981b477f99edf06a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:42:46.580335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f0ec2e6b-6a4f-443a-9885-59335122ee56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:46.581809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f0ec2e6b-6a4f-443a-9885-59335122ee56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:46.585303 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2057/4143] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:42:46 2022] DELETE /identity/v3/projects/c5e7690a7ca04e39981b477f99edf06a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:42:46.597321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec2e6b-6a4f-443a-9885-59335122ee56 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:46.599333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f0ec2e6b-6a4f-443a-9885-59335122ee56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:46.630071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237e3e0-cb31-49ce-be09-59f12e716e63 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:46.635980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08954b0-99da-4103-a823-72088d8edcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:46.636595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08954b0-99da-4103-a823-72088d8edcac admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:46.636884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08954b0-99da-4103-a823-72088d8edcac admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:46.637158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08954b0-99da-4103-a823-72088d8edcac admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:46.637794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08954b0-99da-4103-a823-72088d8edcac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:46.641796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08954b0-99da-4103-a823-72088d8edcac admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:46.695232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec2e6b-6a4f-443a-9885-59335122ee56 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:46.700764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458d315-3256-4333-a148-cb50be55f625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:46.702128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458d315-3256-4333-a148-cb50be55f625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:46.702400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458d315-3256-4333-a148-cb50be55f625 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:46.702680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458d315-3256-4333-a148-cb50be55f625 admin admin] PATH_INFO: `/v3/users/f66f508a17ab45788e43d620b88845af` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:46.703986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458d315-3256-4333-a148-cb50be55f625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f66f508a17ab45788e43d620b88845af)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:46.706270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458d315-3256-4333-a148-cb50be55f625 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:46.775227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:46.781265 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2087/4144] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:42:46 2022] POST /identity/v3/users => generated 288 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:42:46.785277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08954b0-99da-4103-a823-72088d8edcac admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:46.787107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a08954b0-99da-4103-a823-72088d8edcac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:46.810371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08954b0-99da-4103-a823-72088d8edcac admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:46.817265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8693d5e-f9dd-4fb0-b46b-7182808c878b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:46.818753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8693d5e-f9dd-4fb0-b46b-7182808c878b admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:46.820347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8693d5e-f9dd-4fb0-b46b-7182808c878b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:46.820854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8693d5e-f9dd-4fb0-b46b-7182808c878b admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:46.821697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8693d5e-f9dd-4fb0-b46b-7182808c878b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:46.824810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8693d5e-f9dd-4fb0-b46b-7182808c878b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:46.838537 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2088/4145] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:42:46.849916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8693d5e-f9dd-4fb0-b46b-7182808c878b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:46.859766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8693d5e-f9dd-4fb0-b46b-7182808c878b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:46.875011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadb1ab-fe6f-43ce-9c9a-2736a9c314b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:46.876840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadb1ab-fe6f-43ce-9c9a-2736a9c314b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:46.876840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadb1ab-fe6f-43ce-9c9a-2736a9c314b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:46.876840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadb1ab-fe6f-43ce-9c9a-2736a9c314b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:46.878901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadb1ab-fe6f-43ce-9c9a-2736a9c314b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:46.880696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadb1ab-fe6f-43ce-9c9a-2736a9c314b9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:46.899440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9458d315-3256-4333-a148-cb50be55f625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f66f508a17ab45788e43d620b88845af'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:46.902195 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2089/4146] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:42:46.906178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9458d315-3256-4333-a148-cb50be55f625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f66f508a17ab45788e43d620b88845af'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:46.906587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadb1ab-fe6f-43ce-9c9a-2736a9c314b9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:46.909562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5dadb1ab-fe6f-43ce-9c9a-2736a9c314b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:46.921339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9458d315-3256-4333-a148-cb50be55f625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f66f508a17ab45788e43d620b88845af'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:46.940926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9458d315-3256-4333-a148-cb50be55f625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f66f508a17ab45788e43d620b88845af'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:46.949001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadb1ab-fe6f-43ce-9c9a-2736a9c314b9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:46.962138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17412e0-9d2f-4a8a-9fff-13d9d1a6317d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:46.962877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17412e0-9d2f-4a8a-9fff-13d9d1a6317d admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:46.963250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17412e0-9d2f-4a8a-9fff-13d9d1a6317d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:46.963918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17412e0-9d2f-4a8a-9fff-13d9d1a6317d admin admin] PATH_INFO: `/v3/projects/bfe0c3e569214309819d61fc0410d9e2/users/be31286e3e394c7695c25b183bd50edd/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:46.996821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9458d315-3256-4333-a148-cb50be55f625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f66f508a17ab45788e43d620b88845af'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:46.997773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17412e0-9d2f-4a8a-9fff-13d9d1a6317d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe0c3e569214309819d61fc0410d9e2, user_id=be31286e3e394c7695c25b183bd50edd, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:47.000625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17412e0-9d2f-4a8a-9fff-13d9d1a6317d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:47.009292 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2058/4147] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:42:46 2022] DELETE /identity/v3/users/f66f508a17ab45788e43d620b88845af => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:42:47.075437 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2090/4148] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:42:46 2022] PUT /identity/v3/projects/bfe0c3e569214309819d61fc0410d9e2/users/be31286e3e394c7695c25b183bd50edd/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:47.087722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c7f40-7800-48b8-a418-3d6368e6235d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:47.088073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c7f40-7800-48b8-a418-3d6368e6235d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:47.088294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c7f40-7800-48b8-a418-3d6368e6235d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:47.128000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-695c7f40-7800-48b8-a418-3d6368e6235d None None] MFA Rules not processed for user `be31286e3e394c7695c25b183bd50edd`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:47.129986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-695c7f40-7800-48b8-a418-3d6368e6235d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:47.299786 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2059/4149] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:47.312272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17412e0-9d2f-4a8a-9fff-13d9d1a6317d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:47.316312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c17412e0-9d2f-4a8a-9fff-13d9d1a6317d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:47.433693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17412e0-9d2f-4a8a-9fff-13d9d1a6317d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:47.445845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa929ac8-2264-482e-818a-d0a9d82cb82c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:47.446670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa929ac8-2264-482e-818a-d0a9d82cb82c service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:47.447409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa929ac8-2264-482e-818a-d0a9d82cb82c service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:47.448755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa929ac8-2264-482e-818a-d0a9d82cb82c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:47.459263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa929ac8-2264-482e-818a-d0a9d82cb82c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:47.461864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa929ac8-2264-482e-818a-d0a9d82cb82c service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:47.473606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c7f40-7800-48b8-a418-3d6368e6235d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:47.473606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-695c7f40-7800-48b8-a418-3d6368e6235d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:47.473833 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2091/4150] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:42:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:42:47.614368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c7f40-7800-48b8-a418-3d6368e6235d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:47.628544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcd377-2767-4154-beca-e167a5c4c88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:47.629271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcd377-2767-4154-beca-e167a5c4c88d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:47.629745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcd377-2767-4154-beca-e167a5c4c88d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:47.644310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcd377-2767-4154-beca-e167a5c4c88d admin admin] PATH_INFO: `/v3/projects/0cfe7a50d6ab4c33b36d367b33169875` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:47.644310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcd377-2767-4154-beca-e167a5c4c88d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cfe7a50d6ab4c33b36d367b33169875)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:47.644310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcd377-2767-4154-beca-e167a5c4c88d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:47.734402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:47.774739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-63fcd377-2767-4154-beca-e167a5c4c88d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cfe7a50d6ab4c33b36d367b33169875', 'request_id': 'req-63fcd377-2767-4154-beca-e167a5c4c88d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:47.818563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa929ac8-2264-482e-818a-d0a9d82cb82c service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:47.830697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa929ac8-2264-482e-818a-d0a9d82cb82c service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:47.837360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:47.843197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-63fcd377-2767-4154-beca-e167a5c4c88d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cfe7a50d6ab4c33b36d367b33169875', 'request_id': 'req-63fcd377-2767-4154-beca-e167a5c4c88d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:47.850593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-63fcd377-2767-4154-beca-e167a5c4c88d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cfe7a50d6ab4c33b36d367b33169875', 'request_id': 'req-63fcd377-2767-4154-beca-e167a5c4c88d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:47.873771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-63fcd377-2767-4154-beca-e167a5c4c88d admin admin] The token cache is being invalidate because project 0cfe7a50d6ab4c33b36d367b33169875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:42:47.874085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-63fcd377-2767-4154-beca-e167a5c4c88d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:47.876058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-63fcd377-2767-4154-beca-e167a5c4c88d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:47.885456 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2060/4151] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:42:47 2022] DELETE /identity/v3/projects/0cfe7a50d6ab4c33b36d367b33169875 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:47.887012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66a844-c127-4c73-aab2-3d9d1a503f43 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:47.887301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66a844-c127-4c73-aab2-3d9d1a503f43 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:47.890534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66a844-c127-4c73-aab2-3d9d1a503f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:47.910628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9d66a844-c127-4c73-aab2-3d9d1a503f43 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:47.911883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9d66a844-c127-4c73-aab2-3d9d1a503f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:47.990188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188404e-79ea-4c85-a1a9-dcfba2f4603a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:48.002972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188404e-79ea-4c85-a1a9-dcfba2f4603a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:48.003259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188404e-79ea-4c85-a1a9-dcfba2f4603a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:48.004436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188404e-79ea-4c85-a1a9-dcfba2f4603a admin admin] PATH_INFO: `/v3/users/be31286e3e394c7695c25b183bd50edd` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:48.006127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188404e-79ea-4c85-a1a9-dcfba2f4603a admin admin] RBAC: Authorizing `identity:delete_user(user_id=be31286e3e394c7695c25b183bd50edd)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:48.008858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188404e-79ea-4c85-a1a9-dcfba2f4603a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:48.010872 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2061/4152] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:48.018292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597e118-9dd8-4ecc-ad1c-5e4429b1a03b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:48.018629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597e118-9dd8-4ecc-ad1c-5e4429b1a03b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:48.018841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597e118-9dd8-4ecc-ad1c-5e4429b1a03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:48.044619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6597e118-9dd8-4ecc-ad1c-5e4429b1a03b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:48.045947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6597e118-9dd8-4ecc-ad1c-5e4429b1a03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:48.057061 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2062/4153] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:42:48.062405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597e118-9dd8-4ecc-ad1c-5e4429b1a03b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:48.074828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597e118-9dd8-4ecc-ad1c-5e4429b1a03b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:48.080563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f4661-82cd-4cf5-880e-e7421f3f8cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:48.081248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f4661-82cd-4cf5-880e-e7421f3f8cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:48.081532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f4661-82cd-4cf5-880e-e7421f3f8cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:48.081984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f4661-82cd-4cf5-880e-e7421f3f8cc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:48.083342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f4661-82cd-4cf5-880e-e7421f3f8cc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:42:48.083649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f4661-82cd-4cf5-880e-e7421f3f8cc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:48.086676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f4661-82cd-4cf5-880e-e7421f3f8cc0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:48.106514 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2063/4154] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:42:48.110410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f4661-82cd-4cf5-880e-e7421f3f8cc0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:48.114808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:48.136274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f4661-82cd-4cf5-880e-e7421f3f8cc0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:48.150907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28651bf0-7247-4b38-b34d-0de00142cdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:48.151699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28651bf0-7247-4b38-b34d-0de00142cdec admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:48.152086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28651bf0-7247-4b38-b34d-0de00142cdec admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:48.152459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28651bf0-7247-4b38-b34d-0de00142cdec admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:48.153174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28651bf0-7247-4b38-b34d-0de00142cdec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:48.155239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28651bf0-7247-4b38-b34d-0de00142cdec admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:48.313836 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2064/4155] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:42:48 2022] POST /identity/v3/projects => generated 393 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:42:48.317920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28651bf0-7247-4b38-b34d-0de00142cdec admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:48.345482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1188404e-79ea-4c85-a1a9-dcfba2f4603a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be31286e3e394c7695c25b183bd50edd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:48.346919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1188404e-79ea-4c85-a1a9-dcfba2f4603a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be31286e3e394c7695c25b183bd50edd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:48.373632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1188404e-79ea-4c85-a1a9-dcfba2f4603a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be31286e3e394c7695c25b183bd50edd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:48.415147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1188404e-79ea-4c85-a1a9-dcfba2f4603a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be31286e3e394c7695c25b183bd50edd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:48.416057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1188404e-79ea-4c85-a1a9-dcfba2f4603a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be31286e3e394c7695c25b183bd50edd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:48.460056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28651bf0-7247-4b38-b34d-0de00142cdec admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:48.468933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99057d-b9b6-44cd-bee8-3a4d1b34342c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:48.471170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99057d-b9b6-44cd-bee8-3a4d1b34342c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:48.473231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99057d-b9b6-44cd-bee8-3a4d1b34342c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:48.473825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99057d-b9b6-44cd-bee8-3a4d1b34342c admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:48.474722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99057d-b9b6-44cd-bee8-3a4d1b34342c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:48.480779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99057d-b9b6-44cd-bee8-3a4d1b34342c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:48.569714 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2092/4156] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:42:47 2022] DELETE /identity/v3/users/be31286e3e394c7695c25b183bd50edd => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:48.571532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e803aff-d4e1-4573-a7a5-e01c59ae4889 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:48.571937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e803aff-d4e1-4573-a7a5-e01c59ae4889 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:48.572316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e803aff-d4e1-4573-a7a5-e01c59ae4889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:48.605688 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2065/4157] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:42:48 2022] POST /identity/v3/users => generated 297 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:42:48.607193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99057d-b9b6-44cd-bee8-3a4d1b34342c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:48.610363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ba99057d-b9b6-44cd-bee8-3a4d1b34342c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:48.627703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99057d-b9b6-44cd-bee8-3a4d1b34342c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:48.635215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9e803aff-d4e1-4573-a7a5-e01c59ae4889 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:48.638023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9e803aff-d4e1-4573-a7a5-e01c59ae4889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:48.792087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9918e-386b-48e4-a1c0-092f55c10556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:48.797787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9918e-386b-48e4-a1c0-092f55c10556 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:48.798218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9918e-386b-48e4-a1c0-092f55c10556 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:48.798599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9918e-386b-48e4-a1c0-092f55c10556 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:48.799390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9918e-386b-48e4-a1c0-092f55c10556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:48.805749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9918e-386b-48e4-a1c0-092f55c10556 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:48.806827 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2093/4158] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:48.820126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e803aff-d4e1-4573-a7a5-e01c59ae4889 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:48.823176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9e803aff-d4e1-4573-a7a5-e01c59ae4889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:48.834065 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2066/4159] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:42:48.839908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9918e-386b-48e4-a1c0-092f55c10556 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:48.859863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:48.868289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9918e-386b-48e4-a1c0-092f55c10556 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:48.880914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241dfa1-3c30-4012-bcec-d6a29475f118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:48.881692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241dfa1-3c30-4012-bcec-d6a29475f118 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:48.882055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241dfa1-3c30-4012-bcec-d6a29475f118 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:48.883065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241dfa1-3c30-4012-bcec-d6a29475f118 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:48.883065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241dfa1-3c30-4012-bcec-d6a29475f118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:48.884921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241dfa1-3c30-4012-bcec-d6a29475f118 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:48.895503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:48.915050 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2067/4160] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:42:48.919494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241dfa1-3c30-4012-bcec-d6a29475f118 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:48.942539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241dfa1-3c30-4012-bcec-d6a29475f118 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:48.944880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774e086-4556-4096-9874-e46640e33cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:48.945226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e803aff-d4e1-4573-a7a5-e01c59ae4889 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:48.946273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774e086-4556-4096-9874-e46640e33cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:48.947306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774e086-4556-4096-9874-e46640e33cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:48.947306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774e086-4556-4096-9874-e46640e33cdc admin admin] PATH_INFO: `/v3/projects/2f893e7580394320a7977bd444597127/users/d7e07d4112194174afbe20e709dfba8d/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:48.949242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a5e77-41e2-4218-9758-32ae1d26cad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:48.950278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a5e77-41e2-4218-9758-32ae1d26cad0 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:48.950537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a5e77-41e2-4218-9758-32ae1d26cad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:48.951706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a5e77-41e2-4218-9758-32ae1d26cad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:48.964256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774e086-4556-4096-9874-e46640e33cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f893e7580394320a7977bd444597127, user_id=d7e07d4112194174afbe20e709dfba8d, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:48.965361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a5e77-41e2-4218-9758-32ae1d26cad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:48.967273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a5e77-41e2-4218-9758-32ae1d26cad0 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:48.967478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774e086-4556-4096-9874-e46640e33cdc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:48.994087 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2094/4161] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:42:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:42:49.060611 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2068/4162] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:42:48 2022] PUT /identity/v3/projects/2f893e7580394320a7977bd444597127/users/d7e07d4112194174afbe20e709dfba8d/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:42:49.073390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733905f-e757-465d-8aa7-346fe66be3a4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:49.073734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733905f-e757-465d-8aa7-346fe66be3a4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:49.074021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733905f-e757-465d-8aa7-346fe66be3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:49.128042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6733905f-e757-465d-8aa7-346fe66be3a4 None None] MFA Rules not processed for user `d7e07d4112194174afbe20e709dfba8d`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:49.129425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6733905f-e757-465d-8aa7-346fe66be3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:49.217931 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2095/4163] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:49.222183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774e086-4556-4096-9874-e46640e33cdc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:49.357773 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774e086-4556-4096-9874-e46640e33cdc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:49.371752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f4be1-c790-4897-84f7-53c273c33cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:49.372382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f4be1-c790-4897-84f7-53c273c33cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:49.372669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f4be1-c790-4897-84f7-53c273c33cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:49.372970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f4be1-c790-4897-84f7-53c273c33cf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:49.373605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f4be1-c790-4897-84f7-53c273c33cf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:49.375846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f4be1-c790-4897-84f7-53c273c33cf0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:49.552502 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2069/4164] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:42:49 2022] POST /identity/v3/projects => generated 391 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:42:49.556515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733905f-e757-465d-8aa7-346fe66be3a4 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:49.582372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f4be1-c790-4897-84f7-53c273c33cf0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:49.584391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b48f4be1-c790-4897-84f7-53c273c33cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:49.607328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733905f-e757-465d-8aa7-346fe66be3a4 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:49.717789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f4be1-c790-4897-84f7-53c273c33cf0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:49.723448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ae5da-e5d5-44fe-b364-fe403c6914b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:49.724096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ae5da-e5d5-44fe-b364-fe403c6914b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:49.724382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ae5da-e5d5-44fe-b364-fe403c6914b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:49.724665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ae5da-e5d5-44fe-b364-fe403c6914b3 admin admin] PATH_INFO: `/v3/projects/bfe0c3e569214309819d61fc0410d9e2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:49.726473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ae5da-e5d5-44fe-b364-fe403c6914b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe0c3e569214309819d61fc0410d9e2)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:49.787135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ae5da-e5d5-44fe-b364-fe403c6914b3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:49.798822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd519ea-6288-4e69-a26d-2c892ed33b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:49.799376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd519ea-6288-4e69-a26d-2c892ed33b9c admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:49.799659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd519ea-6288-4e69-a26d-2c892ed33b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:49.799936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd519ea-6288-4e69-a26d-2c892ed33b9c admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:49.800769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd519ea-6288-4e69-a26d-2c892ed33b9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:49.804660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd519ea-6288-4e69-a26d-2c892ed33b9c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:49.925134 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2096/4165] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:42:49 2022] POST /identity/v3/users => generated 302 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:42:49.929028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd519ea-6288-4e69-a26d-2c892ed33b9c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:49.947287 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd519ea-6288-4e69-a26d-2c892ed33b9c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:49.968974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-085ae5da-e5d5-44fe-b364-fe403c6914b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe0c3e569214309819d61fc0410d9e2', 'request_id': 'req-085ae5da-e5d5-44fe-b364-fe403c6914b3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:50.035250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-085ae5da-e5d5-44fe-b364-fe403c6914b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe0c3e569214309819d61fc0410d9e2', 'request_id': 'req-085ae5da-e5d5-44fe-b364-fe403c6914b3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:50.036763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:50.052551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-085ae5da-e5d5-44fe-b364-fe403c6914b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe0c3e569214309819d61fc0410d9e2', 'request_id': 'req-085ae5da-e5d5-44fe-b364-fe403c6914b3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:50.061981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:50.076782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-085ae5da-e5d5-44fe-b364-fe403c6914b3 admin admin] The token cache is being invalidate because project bfe0c3e569214309819d61fc0410d9e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:42:50.077321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-085ae5da-e5d5-44fe-b364-fe403c6914b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:50.079157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-085ae5da-e5d5-44fe-b364-fe403c6914b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:50.083671 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2070/4166] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:42:49 2022] DELETE /identity/v3/projects/bfe0c3e569214309819d61fc0410d9e2 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:50.085779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60513e92-5a20-4f13-86c0-cfe18a098c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:50.086497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60513e92-5a20-4f13-86c0-cfe18a098c2d admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:50.086845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60513e92-5a20-4f13-86c0-cfe18a098c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:50.087166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60513e92-5a20-4f13-86c0-cfe18a098c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:50.090559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60513e92-5a20-4f13-86c0-cfe18a098c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:50.090559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60513e92-5a20-4f13-86c0-cfe18a098c2d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:50.095595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6ea1e-f4de-4052-a3e3-6b4267a6ad13 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:50.096188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6ea1e-f4de-4052-a3e3-6b4267a6ad13 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:50.096545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6ea1e-f4de-4052-a3e3-6b4267a6ad13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:50.117030 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2097/4167] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:42:50.132092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-25f6ea1e-f4de-4052-a3e3-6b4267a6ad13 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:50.137928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60513e92-5a20-4f13-86c0-cfe18a098c2d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:50.138990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-25f6ea1e-f4de-4052-a3e3-6b4267a6ad13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:50.142306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-60513e92-5a20-4f13-86c0-cfe18a098c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:50.163702 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2071/4168] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:42:50.174152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038528a-bc50-4658-9c27-14837d4f970b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:50.174851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038528a-bc50-4658-9c27-14837d4f970b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:50.175331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038528a-bc50-4658-9c27-14837d4f970b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:50.178907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60513e92-5a20-4f13-86c0-cfe18a098c2d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:50.202693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5087cb-adb3-41e0-89a1-df9e6cf440c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:50.203631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5087cb-adb3-41e0-89a1-df9e6cf440c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:50.204248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5087cb-adb3-41e0-89a1-df9e6cf440c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:50.204748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5087cb-adb3-41e0-89a1-df9e6cf440c0 admin admin] PATH_INFO: `/v3/projects/b666cc3362c948c6a8d3d7e582846520/users/bb76d6480c684e32aa1e026d26dc87dd/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:50.227412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c038528a-bc50-4658-9c27-14837d4f970b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:50.229697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c038528a-bc50-4658-9c27-14837d4f970b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:50.246539 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2072/4169] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:50.248949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038528a-bc50-4658-9c27-14837d4f970b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:50.266494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5087cb-adb3-41e0-89a1-df9e6cf440c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b666cc3362c948c6a8d3d7e582846520, user_id=bb76d6480c684e32aa1e026d26dc87dd, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:50.269278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5087cb-adb3-41e0-89a1-df9e6cf440c0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:50.281975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038528a-bc50-4658-9c27-14837d4f970b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:50.289257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe59e65-393e-4075-b450-85149f123158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:50.290343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe59e65-393e-4075-b450-85149f123158 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:50.290830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe59e65-393e-4075-b450-85149f123158 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:50.291302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe59e65-393e-4075-b450-85149f123158 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:50.292358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe59e65-393e-4075-b450-85149f123158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:42:50.292908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe59e65-393e-4075-b450-85149f123158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:50.296440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe59e65-393e-4075-b450-85149f123158 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:50.334445 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2073/4170] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:42:50.338281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe59e65-393e-4075-b450-85149f123158 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:50.346858 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2098/4171] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:42:50 2022] PUT /identity/v3/projects/b666cc3362c948c6a8d3d7e582846520/users/bb76d6480c684e32aa1e026d26dc87dd/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:50.348256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5087cb-adb3-41e0-89a1-df9e6cf440c0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:50.364205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe59e65-393e-4075-b450-85149f123158 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:50.458413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6ab05-0a50-4dcc-b2c8-805f26acb196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:50.459146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6ab05-0a50-4dcc-b2c8-805f26acb196 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:50.460260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6ab05-0a50-4dcc-b2c8-805f26acb196 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:50.460715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6ab05-0a50-4dcc-b2c8-805f26acb196 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:50.461665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6ab05-0a50-4dcc-b2c8-805f26acb196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:50.465372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6ab05-0a50-4dcc-b2c8-805f26acb196 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:50.494583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5087cb-adb3-41e0-89a1-df9e6cf440c0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:50.530474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dff455-1c83-47e2-9da6-3516e5a148bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:50.531314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dff455-1c83-47e2-9da6-3516e5a148bb admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:50.531603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dff455-1c83-47e2-9da6-3516e5a148bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:50.531905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dff455-1c83-47e2-9da6-3516e5a148bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:50.532701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dff455-1c83-47e2-9da6-3516e5a148bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:50.542011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dff455-1c83-47e2-9da6-3516e5a148bb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:50.550862 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2074/4172] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:42:50 2022] POST /identity/v3/projects => generated 371 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:42:50.555615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6ab05-0a50-4dcc-b2c8-805f26acb196 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:50.577929 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2099/4173] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:42:50.587649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f6845-65a1-4c7a-9d2c-2cdb7c408dd0 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:50.587864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f6845-65a1-4c7a-9d2c-2cdb7c408dd0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:50.590920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f6845-65a1-4c7a-9d2c-2cdb7c408dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:50.641097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6e6f6845-65a1-4c7a-9d2c-2cdb7c408dd0 None None] MFA Rules not processed for user `9454949c8d794b6093d7d4fc64d12c33`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:50.642975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6e6f6845-65a1-4c7a-9d2c-2cdb7c408dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:50.644801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6ab05-0a50-4dcc-b2c8-805f26acb196 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:50.653034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d78911-2276-4978-a6ea-efbfc913cd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:50.653912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d78911-2276-4978-a6ea-efbfc913cd17 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:50.654209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d78911-2276-4978-a6ea-efbfc913cd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:50.654488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d78911-2276-4978-a6ea-efbfc913cd17 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:50.655130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d78911-2276-4978-a6ea-efbfc913cd17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:50.657302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d78911-2276-4978-a6ea-efbfc913cd17 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:50.731200 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2100/4174] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:50.732327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f6845-65a1-4c7a-9d2c-2cdb7c408dd0 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:50.758668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f6845-65a1-4c7a-9d2c-2cdb7c408dd0 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:50.765072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae48f0d-2c7b-4e68-bd0f-5453ec46239e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:50.766072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae48f0d-2c7b-4e68-bd0f-5453ec46239e admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:50.766460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae48f0d-2c7b-4e68-bd0f-5453ec46239e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:50.767261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae48f0d-2c7b-4e68-bd0f-5453ec46239e admin admin] PATH_INFO: `/v3/projects/b666cc3362c948c6a8d3d7e582846520/users/bb76d6480c684e32aa1e026d26dc87dd/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:50.769403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae48f0d-2c7b-4e68-bd0f-5453ec46239e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b666cc3362c948c6a8d3d7e582846520, user_id=bb76d6480c684e32aa1e026d26dc87dd, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:50.772895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae48f0d-2c7b-4e68-bd0f-5453ec46239e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:50.801315 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2101/4175] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:42:50 2022] PUT /identity/v3/projects/b666cc3362c948c6a8d3d7e582846520/users/bb76d6480c684e32aa1e026d26dc87dd/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:50.801315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ede34-34e0-4837-822a-f61d59aeb65f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:50.801315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ede34-34e0-4837-822a-f61d59aeb65f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:50.801315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ede34-34e0-4837-822a-f61d59aeb65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:50.801611 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2075/4176] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:42:50 2022] POST /identity/v3/users => generated 286 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:42:50.803714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d78911-2276-4978-a6ea-efbfc913cd17 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:50.819364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d78911-2276-4978-a6ea-efbfc913cd17 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:50.828487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-fe1ede34-34e0-4837-822a-f61d59aeb65f None None] MFA Rules not processed for user `9454949c8d794b6093d7d4fc64d12c33`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:50.832334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fe1ede34-34e0-4837-822a-f61d59aeb65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:50.862762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:50.881709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:50.915293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b5590-4ffb-49aa-afac-53b5875319ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:50.917490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b5590-4ffb-49aa-afac-53b5875319ea admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:50.917851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b5590-4ffb-49aa-afac-53b5875319ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:50.918248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b5590-4ffb-49aa-afac-53b5875319ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:50.919564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b5590-4ffb-49aa-afac-53b5875319ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:50.922109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b5590-4ffb-49aa-afac-53b5875319ea admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:50.941832 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2076/4177] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:42:50.947305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e25e9-d1a6-44e9-9b2c-574874ceb7ee None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:50.947653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e25e9-d1a6-44e9-9b2c-574874ceb7ee None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:50.947994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e25e9-d1a6-44e9-9b2c-574874ceb7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:50.950552 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2102/4178] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:50.952078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ede34-34e0-4837-822a-f61d59aeb65f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:50.982257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ede34-34e0-4837-822a-f61d59aeb65f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:50.993526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5088fa-3408-47fe-880c-348cada8afaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:50.994363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5088fa-3408-47fe-880c-348cada8afaa admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:50.995599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5088fa-3408-47fe-880c-348cada8afaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:50.995986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5088fa-3408-47fe-880c-348cada8afaa admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:50.996770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5088fa-3408-47fe-880c-348cada8afaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:51.002506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5088fa-3408-47fe-880c-348cada8afaa admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:51.016034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-887e25e9-d1a6-44e9-9b2c-574874ceb7ee None None] MFA Rules not processed for user `bb76d6480c684e32aa1e026d26dc87dd`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:51.017338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-887e25e9-d1a6-44e9-9b2c-574874ceb7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:51.018603 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2103/4179] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:42:51.022891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5088fa-3408-47fe-880c-348cada8afaa admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:51.041201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5088fa-3408-47fe-880c-348cada8afaa admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:51.048254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47698a44-5b70-499d-8845-c67e82536b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:51.049457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47698a44-5b70-499d-8845-c67e82536b0b admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:51.049748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47698a44-5b70-499d-8845-c67e82536b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:51.050061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47698a44-5b70-499d-8845-c67e82536b0b admin admin] PATH_INFO: `/v3/projects/3a7095a3d28e48b0a1550ddc7812a534/users/31a2b76d6e9746f189f717a0eb222887/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:51.080163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47698a44-5b70-499d-8845-c67e82536b0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a7095a3d28e48b0a1550ddc7812a534, user_id=31a2b76d6e9746f189f717a0eb222887, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:51.084207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47698a44-5b70-499d-8845-c67e82536b0b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:51.142457 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2077/4180] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:50 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:51.148242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e25e9-d1a6-44e9-9b2c-574874ceb7ee None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:51.151114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-887e25e9-d1a6-44e9-9b2c-574874ceb7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:51.167023 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2104/4181] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:42:51 2022] PUT /identity/v3/projects/3a7095a3d28e48b0a1550ddc7812a534/users/31a2b76d6e9746f189f717a0eb222887/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:42:51.167910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47698a44-5b70-499d-8845-c67e82536b0b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:51.177560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-47698a44-5b70-499d-8845-c67e82536b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:51.286059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47698a44-5b70-499d-8845-c67e82536b0b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:51.290394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98090885-e510-446f-818c-b7887b740fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:51.291214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98090885-e510-446f-818c-b7887b740fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:51.291850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98090885-e510-446f-818c-b7887b740fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:51.292281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98090885-e510-446f-818c-b7887b740fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:51.307292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e25e9-d1a6-44e9-9b2c-574874ceb7ee None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:51.390943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:51.414911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98090885-e510-446f-818c-b7887b740fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:51.416636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98090885-e510-446f-818c-b7887b740fa8 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:51.424364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ac6ff-a3ec-40ed-9ef8-3513a773d990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:51.424950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ac6ff-a3ec-40ed-9ef8-3513a773d990 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:51.425234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ac6ff-a3ec-40ed-9ef8-3513a773d990 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:51.425507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ac6ff-a3ec-40ed-9ef8-3513a773d990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:51.431263 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2105/4182] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:42:51 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:42:51.435055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f21bc8-a8bc-4de1-90be-d624fac3c5bc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:51.435615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f21bc8-a8bc-4de1-90be-d624fac3c5bc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:51.436347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f21bc8-a8bc-4de1-90be-d624fac3c5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:51.477442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-16f21bc8-a8bc-4de1-90be-d624fac3c5bc None None] MFA Rules not processed for user `31a2b76d6e9746f189f717a0eb222887`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:51.479700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-16f21bc8-a8bc-4de1-90be-d624fac3c5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:51.569538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ac6ff-a3ec-40ed-9ef8-3513a773d990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:51.569538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ac6ff-a3ec-40ed-9ef8-3513a773d990 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:51.578820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:51.608128 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2078/4183] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:42:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:42:51.640766 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2106/4184] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:51.646607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ac6ff-a3ec-40ed-9ef8-3513a773d990 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:51.739472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ac6ff-a3ec-40ed-9ef8-3513a773d990 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:51.745741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b2749-aba5-4e41-acaf-46c30b4141ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:51.747229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b2749-aba5-4e41-acaf-46c30b4141ee admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:51.747362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b2749-aba5-4e41-acaf-46c30b4141ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:51.747624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b2749-aba5-4e41-acaf-46c30b4141ee admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:51.748436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b2749-aba5-4e41-acaf-46c30b4141ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:51.751102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b2749-aba5-4e41-acaf-46c30b4141ee admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:51.848124 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2079/4185] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:42:51 2022] POST /identity/v3/projects => generated 371 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:42:51.853125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f21bc8-a8bc-4de1-90be-d624fac3c5bc None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:51.864362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f21bc8-a8bc-4de1-90be-d624fac3c5bc None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:52.061638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a779f-ecdd-4a01-a4ec-37feb4908e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:52.064673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a779f-ecdd-4a01-a4ec-37feb4908e09 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:52.064673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a779f-ecdd-4a01-a4ec-37feb4908e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:52.064673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a779f-ecdd-4a01-a4ec-37feb4908e09 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:52.064673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a779f-ecdd-4a01-a4ec-37feb4908e09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:52.066482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a779f-ecdd-4a01-a4ec-37feb4908e09 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:52.175491 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2107/4186] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:42:51 2022] POST /identity/v3/users => generated 292 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:42:52.180904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b2749-aba5-4e41-acaf-46c30b4141ee admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:52.207990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b2749-aba5-4e41-acaf-46c30b4141ee admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:52.219938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba4054-3e27-45eb-9f5f-a4583a58768c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:52.220585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba4054-3e27-45eb-9f5f-a4583a58768c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:52.220867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba4054-3e27-45eb-9f5f-a4583a58768c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:52.221143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba4054-3e27-45eb-9f5f-a4583a58768c admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:52.221805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba4054-3e27-45eb-9f5f-a4583a58768c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:52.230427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba4054-3e27-45eb-9f5f-a4583a58768c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:52.272730 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2080/4187] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:42:52.283191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a779f-ecdd-4a01-a4ec-37feb4908e09 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:52.301556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a779f-ecdd-4a01-a4ec-37feb4908e09 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:52.308372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae25f7-a11e-4e15-b39c-64b14e48b5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:52.309263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae25f7-a11e-4e15-b39c-64b14e48b5d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:52.309651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae25f7-a11e-4e15-b39c-64b14e48b5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:52.310024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae25f7-a11e-4e15-b39c-64b14e48b5d6 admin admin] PATH_INFO: `/v3/projects/735725f182204675906dcdb7e32cd4bf/users/ed6c780bf43f4d9cb2be3e3fb7513fa4/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:52.330718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae25f7-a11e-4e15-b39c-64b14e48b5d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=735725f182204675906dcdb7e32cd4bf, user_id=ed6c780bf43f4d9cb2be3e3fb7513fa4, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:52.334424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae25f7-a11e-4e15-b39c-64b14e48b5d6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:52.465491 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2108/4188] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:42:52 2022] PUT /identity/v3/projects/735725f182204675906dcdb7e32cd4bf/users/ed6c780bf43f4d9cb2be3e3fb7513fa4/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:52.471538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba4054-3e27-45eb-9f5f-a4583a58768c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:52.486730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba4054-3e27-45eb-9f5f-a4583a58768c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:52.565982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeafc47-3767-4f30-9a25-7967e4c4dec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:52.566870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeafc47-3767-4f30-9a25-7967e4c4dec2 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:52.567300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeafc47-3767-4f30-9a25-7967e4c4dec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:52.567604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeafc47-3767-4f30-9a25-7967e4c4dec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:52.569557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeafc47-3767-4f30-9a25-7967e4c4dec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:52.572050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeafc47-3767-4f30-9a25-7967e4c4dec2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:52.581313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:52.597102 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2081/4189] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:42:52.598594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae25f7-a11e-4e15-b39c-64b14e48b5d6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:52.616626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae25f7-a11e-4e15-b39c-64b14e48b5d6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:52.626649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e28673-2495-4036-adf4-8a9d3d102919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:52.627408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e28673-2495-4036-adf4-8a9d3d102919 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:52.627756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e28673-2495-4036-adf4-8a9d3d102919 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:52.628099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e28673-2495-4036-adf4-8a9d3d102919 admin admin] PATH_INFO: `/v3/projects/735725f182204675906dcdb7e32cd4bf/users/ed6c780bf43f4d9cb2be3e3fb7513fa4/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:52.637458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e28673-2495-4036-adf4-8a9d3d102919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=735725f182204675906dcdb7e32cd4bf, user_id=ed6c780bf43f4d9cb2be3e3fb7513fa4, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:52.637458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e28673-2495-4036-adf4-8a9d3d102919 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:52.661851 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2109/4190] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:42:52 2022] PUT /identity/v3/projects/735725f182204675906dcdb7e32cd4bf/users/ed6c780bf43f4d9cb2be3e3fb7513fa4/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:52.673786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751008a7-6ee5-4880-8221-f51f988675fb None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:52.674131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751008a7-6ee5-4880-8221-f51f988675fb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:52.674473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751008a7-6ee5-4880-8221-f51f988675fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:52.723858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-751008a7-6ee5-4880-8221-f51f988675fb None None] MFA Rules not processed for user `ed6c780bf43f4d9cb2be3e3fb7513fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:52.724968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-751008a7-6ee5-4880-8221-f51f988675fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:52.883284 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2082/4191] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:52.902898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e28673-2495-4036-adf4-8a9d3d102919 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:52.925290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e28673-2495-4036-adf4-8a9d3d102919 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:52.934051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbef894-3666-4746-bc4b-4bd724f34bc2 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6c780bf43f4d9cb2be3e3fb7513fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735725f182204675906dcdb7e32cd4bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:52.934740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbef894-3666-4746-bc4b-4bd724f34bc2 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:52.935274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbef894-3666-4746-bc4b-4bd724f34bc2 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:52.935715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbef894-3666-4746-bc4b-4bd724f34bc2 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:52.937108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbef894-3666-4746-bc4b-4bd724f34bc2 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:52.938951 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-8bbef894-3666-4746-bc4b-4bd724f34bc2 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:42:52.938951 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:42:52.938951 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:42:52.941398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbef894-3666-4746-bc4b-4bd724f34bc2 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:53.056948 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2110/4192] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:42:52 2022] POST /identity/v3/services => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:42:53.061697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751008a7-6ee5-4880-8221-f51f988675fb None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:53.077169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751008a7-6ee5-4880-8221-f51f988675fb None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:53.101026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805b470-5a65-4790-a622-6a65b2ee21a5 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6c780bf43f4d9cb2be3e3fb7513fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735725f182204675906dcdb7e32cd4bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:53.101985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805b470-5a65-4790-a622-6a65b2ee21a5 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:53.103068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805b470-5a65-4790-a622-6a65b2ee21a5 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:53.105209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805b470-5a65-4790-a622-6a65b2ee21a5 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:53.105209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805b470-5a65-4790-a622-6a65b2ee21a5 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:53.107608 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-4805b470-5a65-4790-a622-6a65b2ee21a5 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:42:53.107608 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:42:53.107608 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:42:53.109797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805b470-5a65-4790-a622-6a65b2ee21a5 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:53.215793 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2083/4193] 10.222.0.20 () {60 vars in 1213 bytes} [Thu Oct 27 03:42:53 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:42:53.227363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbef894-3666-4746-bc4b-4bd724f34bc2 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:53.240124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbef894-3666-4746-bc4b-4bd724f34bc2 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:53.246712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9b2f8-6ef2-42a3-a4ad-5c5ea1cfa6a3 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6c780bf43f4d9cb2be3e3fb7513fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735725f182204675906dcdb7e32cd4bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:53.247434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9b2f8-6ef2-42a3-a4ad-5c5ea1cfa6a3 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:53.247724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9b2f8-6ef2-42a3-a4ad-5c5ea1cfa6a3 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:53.248049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9b2f8-6ef2-42a3-a4ad-5c5ea1cfa6a3 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:53.248776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9b2f8-6ef2-42a3-a4ad-5c5ea1cfa6a3 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:53.250796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9b2f8-6ef2-42a3-a4ad-5c5ea1cfa6a3 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:53.364674 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2111/4194] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:42:53 2022] POST /identity/v3/services => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:42:53.369588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805b470-5a65-4790-a622-6a65b2ee21a5 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:53.383553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805b470-5a65-4790-a622-6a65b2ee21a5 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:53.468544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a0da4-c104-4bd1-a65f-64515f507d39 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6c780bf43f4d9cb2be3e3fb7513fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735725f182204675906dcdb7e32cd4bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:53.468544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a0da4-c104-4bd1-a65f-64515f507d39 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:53.468544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a0da4-c104-4bd1-a65f-64515f507d39 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:53.469082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a0da4-c104-4bd1-a65f-64515f507d39 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:53.476031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a0da4-c104-4bd1-a65f-64515f507d39 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:53.485104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a0da4-c104-4bd1-a65f-64515f507d39 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:53.633134 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2084/4195] 10.222.0.20 () {60 vars in 1213 bytes} [Thu Oct 27 03:42:53 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:42:53.638006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9b2f8-6ef2-42a3-a4ad-5c5ea1cfa6a3 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:53.652570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9b2f8-6ef2-42a3-a4ad-5c5ea1cfa6a3 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:53.663520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9b1eb-b95e-4a06-942a-ad7696967db5 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6c780bf43f4d9cb2be3e3fb7513fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735725f182204675906dcdb7e32cd4bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:53.663520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9b1eb-b95e-4a06-942a-ad7696967db5 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:53.663520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9b1eb-b95e-4a06-942a-ad7696967db5 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:53.663855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9b1eb-b95e-4a06-942a-ad7696967db5 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:53.663855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9b1eb-b95e-4a06-942a-ad7696967db5 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:53.663855 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-90e9b1eb-b95e-4a06-942a-ad7696967db5 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:42:53.663855 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:42:53.663855 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:42:53.663855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9b1eb-b95e-4a06-942a-ad7696967db5 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:53.675021 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2112/4196] 10.222.0.20 () {58 vars in 1191 bytes} [Thu Oct 27 03:42:53 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 764 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:42:53.676122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a0da4-c104-4bd1-a65f-64515f507d39 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:53.714376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a0da4-c104-4bd1-a65f-64515f507d39 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:53.721114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47dfe9-1940-4a5f-aad1-64b99d89207b tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6c780bf43f4d9cb2be3e3fb7513fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735725f182204675906dcdb7e32cd4bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:53.722392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47dfe9-1940-4a5f-aad1-64b99d89207b tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:53.722676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47dfe9-1940-4a5f-aad1-64b99d89207b tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:53.723134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47dfe9-1940-4a5f-aad1-64b99d89207b tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/92f0e222e64d4a6ba6a3d8682de67fd9` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:53.723729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47dfe9-1940-4a5f-aad1-64b99d89207b tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=92f0e222e64d4a6ba6a3d8682de67fd9)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:53.725295 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-7a47dfe9-1940-4a5f-aad1-64b99d89207b tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:42:53.725295 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:42:53.725295 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:42:53.726232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47dfe9-1940-4a5f-aad1-64b99d89207b tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:53.742265 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2085/4197] 10.222.0.20 () {58 vars in 1290 bytes} [Thu Oct 27 03:42:53 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/92f0e222e64d4a6ba6a3d8682de67fd9 => generated 332 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:42:53.742445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9b1eb-b95e-4a06-942a-ad7696967db5 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:53.760477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9b1eb-b95e-4a06-942a-ad7696967db5 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:53.776540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28f5c3-71e5-43a8-ba15-0cb8193fe8b7 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6c780bf43f4d9cb2be3e3fb7513fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735725f182204675906dcdb7e32cd4bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:53.791288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28f5c3-71e5-43a8-ba15-0cb8193fe8b7 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:53.791288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28f5c3-71e5-43a8-ba15-0cb8193fe8b7 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:53.791288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28f5c3-71e5-43a8-ba15-0cb8193fe8b7 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/92f0e222e64d4a6ba6a3d8682de67fd9` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:53.791871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28f5c3-71e5-43a8-ba15-0cb8193fe8b7 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=92f0e222e64d4a6ba6a3d8682de67fd9)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:53.792900 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-ac28f5c3-71e5-43a8-ba15-0cb8193fe8b7 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:42:53.792900 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:42:53.792900 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:42:53.806094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28f5c3-71e5-43a8-ba15-0cb8193fe8b7 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:53.817497 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2113/4198] 10.222.0.20 () {58 vars in 1291 bytes} [Thu Oct 27 03:42:53 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/92f0e222e64d4a6ba6a3d8682de67fd9 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:42:53.822486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47dfe9-1940-4a5f-aad1-64b99d89207b tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:53.840633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47dfe9-1940-4a5f-aad1-64b99d89207b tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:53.853122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f28bcb-eb5d-4599-bda1-a9d67b8b6a38 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6c780bf43f4d9cb2be3e3fb7513fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735725f182204675906dcdb7e32cd4bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:53.858676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f28bcb-eb5d-4599-bda1-a9d67b8b6a38 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:53.858676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f28bcb-eb5d-4599-bda1-a9d67b8b6a38 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:53.858676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f28bcb-eb5d-4599-bda1-a9d67b8b6a38 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/92f0e222e64d4a6ba6a3d8682de67fd9` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:53.858676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f28bcb-eb5d-4599-bda1-a9d67b8b6a38 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=92f0e222e64d4a6ba6a3d8682de67fd9)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:53.859017 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-34f28bcb-eb5d-4599-bda1-a9d67b8b6a38 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:42:53.859017 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:42:53.859017 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:42:53.859946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f28bcb-eb5d-4599-bda1-a9d67b8b6a38 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:53.957103 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2086/4199] 10.222.0.20 () {58 vars in 1293 bytes} [Thu Oct 27 03:42:53 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/92f0e222e64d4a6ba6a3d8682de67fd9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:53.961260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28f5c3-71e5-43a8-ba15-0cb8193fe8b7 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:53.978201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28f5c3-71e5-43a8-ba15-0cb8193fe8b7 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:53.994654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bea894-54d3-43e2-9b62-625334680d03 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6c780bf43f4d9cb2be3e3fb7513fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735725f182204675906dcdb7e32cd4bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:53.995317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bea894-54d3-43e2-9b62-625334680d03 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:53.996247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bea894-54d3-43e2-9b62-625334680d03 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:53.996247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bea894-54d3-43e2-9b62-625334680d03 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:53.996590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bea894-54d3-43e2-9b62-625334680d03 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:53.999107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bea894-54d3-43e2-9b62-625334680d03 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:54.016813 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2114/4200] 10.222.0.20 () {58 vars in 1191 bytes} [Thu Oct 27 03:42:53 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 451 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:42:54.021513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f28bcb-eb5d-4599-bda1-a9d67b8b6a38 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:54.037031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f28bcb-eb5d-4599-bda1-a9d67b8b6a38 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:54.042742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017bb4c-8975-4dab-abab-9c836a8f5d35 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6c780bf43f4d9cb2be3e3fb7513fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735725f182204675906dcdb7e32cd4bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:54.043750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017bb4c-8975-4dab-abab-9c836a8f5d35 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:54.048110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017bb4c-8975-4dab-abab-9c836a8f5d35 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:54.048110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017bb4c-8975-4dab-abab-9c836a8f5d35 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/92f0e222e64d4a6ba6a3d8682de67fd9` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:54.048110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017bb4c-8975-4dab-abab-9c836a8f5d35 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=92f0e222e64d4a6ba6a3d8682de67fd9)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:54.048110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017bb4c-8975-4dab-abab-9c836a8f5d35 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:54.077575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-8017bb4c-8975-4dab-abab-9c836a8f5d35 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Could not find Endpoint Group: 92f0e222e64d4a6ba6a3d8682de67fd9.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 92f0e222e64d4a6ba6a3d8682de67fd9. Oct 27 03:42:54.077575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:42:54.077575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:42:54.077575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:42:54.077575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:42:54.077575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:42:54.077575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:42:54.077575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:42:54.077575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:42:54.077575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:42:54.077575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:42:54.077575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:42:54.077575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Oct 27 03:42:54.077575 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Oct 27 03:42:54.078585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Oct 27 03:42:54.078585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Oct 27 03:42:54.078585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Oct 27 03:42:54.078585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Oct 27 03:42:54.078585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 92f0e222e64d4a6ba6a3d8682de67fd9. Oct 27 03:42:54.078585 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:42:54.083509 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2087/4201] 10.222.0.20 () {58 vars in 1293 bytes} [Thu Oct 27 03:42:54 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/92f0e222e64d4a6ba6a3d8682de67fd9 => generated 120 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:42:54.088630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bea894-54d3-43e2-9b62-625334680d03 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:54.102775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bea894-54d3-43e2-9b62-625334680d03 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:54.114608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ee2aa-b1ca-4bb8-8a0f-ff64f1594d71 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6c780bf43f4d9cb2be3e3fb7513fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735725f182204675906dcdb7e32cd4bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:54.116494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ee2aa-b1ca-4bb8-8a0f-ff64f1594d71 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:54.118498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ee2aa-b1ca-4bb8-8a0f-ff64f1594d71 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:54.122363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ee2aa-b1ca-4bb8-8a0f-ff64f1594d71 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] PATH_INFO: `/v3/services/7bcb6c43425e4ec4863c757298fd7c89` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:54.123361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ee2aa-b1ca-4bb8-8a0f-ff64f1594d71 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorizing `identity:delete_service(service_id=7bcb6c43425e4ec4863c757298fd7c89)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:54.126550 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-916ee2aa-b1ca-4bb8-8a0f-ff64f1594d71 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:42:54.126550 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:42:54.126550 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:42:54.127982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ee2aa-b1ca-4bb8-8a0f-ff64f1594d71 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:54.251256 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2115/4202] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:42:54 2022] DELETE /identity/v3/services/7bcb6c43425e4ec4863c757298fd7c89 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:54.258077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017bb4c-8975-4dab-abab-9c836a8f5d35 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:54.274303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017bb4c-8975-4dab-abab-9c836a8f5d35 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:54.295544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a218aa-1a00-4f5a-a5a5-8266607c1dc7 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6c780bf43f4d9cb2be3e3fb7513fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735725f182204675906dcdb7e32cd4bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:54.296843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a218aa-1a00-4f5a-a5a5-8266607c1dc7 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:54.297732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a218aa-1a00-4f5a-a5a5-8266607c1dc7 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:54.298303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a218aa-1a00-4f5a-a5a5-8266607c1dc7 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:54.300307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a218aa-1a00-4f5a-a5a5-8266607c1dc7 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:54.302411 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-65a218aa-1a00-4f5a-a5a5-8266607c1dc7 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:42:54.302411 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:42:54.302411 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:42:54.304544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a218aa-1a00-4f5a-a5a5-8266607c1dc7 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:54.387125 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2088/4203] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:42:54 2022] POST /identity/v3/services => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:42:54.391498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ee2aa-b1ca-4bb8-8a0f-ff64f1594d71 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:54.422431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ee2aa-b1ca-4bb8-8a0f-ff64f1594d71 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:54.457577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd7eea-6e2a-4995-bf4d-a5d17e115c9c tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6c780bf43f4d9cb2be3e3fb7513fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735725f182204675906dcdb7e32cd4bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:54.459816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd7eea-6e2a-4995-bf4d-a5d17e115c9c tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:54.459816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd7eea-6e2a-4995-bf4d-a5d17e115c9c tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:54.459816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd7eea-6e2a-4995-bf4d-a5d17e115c9c tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:54.460746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd7eea-6e2a-4995-bf4d-a5d17e115c9c tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:54.461937 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-b7dd7eea-6e2a-4995-bf4d-a5d17e115c9c tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:42:54.461937 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:42:54.461937 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:42:54.463141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd7eea-6e2a-4995-bf4d-a5d17e115c9c tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:54.472334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:INSERT=8,keystone:DELETE=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:54.518061 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2116/4204] 10.222.0.20 () {60 vars in 1213 bytes} [Thu Oct 27 03:42:54 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:42:54.522395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a218aa-1a00-4f5a-a5a5-8266607c1dc7 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:54.549862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a218aa-1a00-4f5a-a5a5-8266607c1dc7 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:54.569255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fb934-e3fd-482f-b6c4-8657936c93ff tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6c780bf43f4d9cb2be3e3fb7513fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735725f182204675906dcdb7e32cd4bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:54.570222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fb934-e3fd-482f-b6c4-8657936c93ff tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:54.570664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fb934-e3fd-482f-b6c4-8657936c93ff tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:54.571095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fb934-e3fd-482f-b6c4-8657936c93ff tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:54.571994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83fb934-e3fd-482f-b6c4-8657936c93ff tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:54.573805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83fb934-e3fd-482f-b6c4-8657936c93ff tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:54.654963 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2089/4205] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:42:54 2022] POST /identity/v3/services => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:42:54.659510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd7eea-6e2a-4995-bf4d-a5d17e115c9c tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:54.673874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd7eea-6e2a-4995-bf4d-a5d17e115c9c tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:54.715243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11928216-9a69-452c-96a4-8e7aa46bf607 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6c780bf43f4d9cb2be3e3fb7513fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735725f182204675906dcdb7e32cd4bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:54.716039 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11928216-9a69-452c-96a4-8e7aa46bf607 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:54.716337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11928216-9a69-452c-96a4-8e7aa46bf607 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:54.716621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11928216-9a69-452c-96a4-8e7aa46bf607 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/348142541fcb41b0ab20bb7de6b8c1ec` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:54.717307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11928216-9a69-452c-96a4-8e7aa46bf607 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=348142541fcb41b0ab20bb7de6b8c1ec)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:54.720257 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-11928216-9a69-452c-96a4-8e7aa46bf607 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:42:54.720257 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:42:54.720257 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:42:54.723044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11928216-9a69-452c-96a4-8e7aa46bf607 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:54.786595 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2117/4206] 10.222.0.20 () {60 vars in 1313 bytes} [Thu Oct 27 03:42:54 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/348142541fcb41b0ab20bb7de6b8c1ec => generated 335 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:42:54.791425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fb934-e3fd-482f-b6c4-8657936c93ff tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:54.816690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fb934-e3fd-482f-b6c4-8657936c93ff tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:54.867250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616499e-56fa-4430-a20b-6572a71fd00a tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6c780bf43f4d9cb2be3e3fb7513fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735725f182204675906dcdb7e32cd4bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:54.869649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616499e-56fa-4430-a20b-6572a71fd00a tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:54.870511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616499e-56fa-4430-a20b-6572a71fd00a tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:54.870903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616499e-56fa-4430-a20b-6572a71fd00a tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] PATH_INFO: `/v3/services/d412c019a6934dfa932d52025e218e67` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:54.871661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616499e-56fa-4430-a20b-6572a71fd00a tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d412c019a6934dfa932d52025e218e67)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:54.872810 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-8616499e-56fa-4430-a20b-6572a71fd00a tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:42:54.872810 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:42:54.872810 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:42:54.874005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616499e-56fa-4430-a20b-6572a71fd00a tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:54.975511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11928216-9a69-452c-96a4-8e7aa46bf607 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:54.976130 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2090/4207] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:42:54 2022] DELETE /identity/v3/services/d412c019a6934dfa932d52025e218e67 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:54.989213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11928216-9a69-452c-96a4-8e7aa46bf607 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:55.062355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfe63d-6183-4fdd-a5d8-1b72e0b2cd0f tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6c780bf43f4d9cb2be3e3fb7513fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735725f182204675906dcdb7e32cd4bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:55.063044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfe63d-6183-4fdd-a5d8-1b72e0b2cd0f tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:55.063331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfe63d-6183-4fdd-a5d8-1b72e0b2cd0f tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:55.063620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfe63d-6183-4fdd-a5d8-1b72e0b2cd0f tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/348142541fcb41b0ab20bb7de6b8c1ec` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:55.064266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfe63d-6183-4fdd-a5d8-1b72e0b2cd0f tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=348142541fcb41b0ab20bb7de6b8c1ec)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:55.067286 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-decfe63d-6183-4fdd-a5d8-1b72e0b2cd0f tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:42:55.067286 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:42:55.067286 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:42:55.071288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfe63d-6183-4fdd-a5d8-1b72e0b2cd0f tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:55.216193 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2118/4208] 10.222.0.20 () {58 vars in 1293 bytes} [Thu Oct 27 03:42:54 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/348142541fcb41b0ab20bb7de6b8c1ec => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:55.223931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616499e-56fa-4430-a20b-6572a71fd00a tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:55.244426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616499e-56fa-4430-a20b-6572a71fd00a tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:55.258071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8df16-f0c2-4d30-bb74-b9a4ebb22ff8 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6c780bf43f4d9cb2be3e3fb7513fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735725f182204675906dcdb7e32cd4bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:55.259279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8df16-f0c2-4d30-bb74-b9a4ebb22ff8 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:55.267803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8df16-f0c2-4d30-bb74-b9a4ebb22ff8 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:55.268365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8df16-f0c2-4d30-bb74-b9a4ebb22ff8 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] PATH_INFO: `/v3/services/62f71dc469d24e58a0e92d37b1543844` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:55.269014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8df16-f0c2-4d30-bb74-b9a4ebb22ff8 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorizing `identity:delete_service(service_id=62f71dc469d24e58a0e92d37b1543844)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:55.270724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8df16-f0c2-4d30-bb74-b9a4ebb22ff8 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:55.302814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:55.375107 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2091/4209] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:42:55 2022] DELETE /identity/v3/services/62f71dc469d24e58a0e92d37b1543844 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:55.380852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfe63d-6183-4fdd-a5d8-1b72e0b2cd0f tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:55.399913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfe63d-6183-4fdd-a5d8-1b72e0b2cd0f tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:55.446256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8691b3-b37b-4195-bf25-a0b3a8ed0365 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6c780bf43f4d9cb2be3e3fb7513fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735725f182204675906dcdb7e32cd4bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:55.447791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8691b3-b37b-4195-bf25-a0b3a8ed0365 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:55.448249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8691b3-b37b-4195-bf25-a0b3a8ed0365 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:55.448692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8691b3-b37b-4195-bf25-a0b3a8ed0365 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/79ed36123bc748c7b7aa2186d6574535` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:55.449459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8691b3-b37b-4195-bf25-a0b3a8ed0365 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=79ed36123bc748c7b7aa2186d6574535)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:55.452019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8691b3-b37b-4195-bf25-a0b3a8ed0365 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:55.580656 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2119/4210] 10.222.0.20 () {58 vars in 1293 bytes} [Thu Oct 27 03:42:55 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/79ed36123bc748c7b7aa2186d6574535 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:55.583194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8df16-f0c2-4d30-bb74-b9a4ebb22ff8 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:55.609963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8df16-f0c2-4d30-bb74-b9a4ebb22ff8 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:55.613775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f4808-f98e-427a-afc2-a813af5f5653 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6c780bf43f4d9cb2be3e3fb7513fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735725f182204675906dcdb7e32cd4bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:55.614709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f4808-f98e-427a-afc2-a813af5f5653 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:55.615209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f4808-f98e-427a-afc2-a813af5f5653 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:55.616259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f4808-f98e-427a-afc2-a813af5f5653 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] PATH_INFO: `/v3/services/7ef47bc176184a068f84559cf6e1b53b` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:55.617190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f4808-f98e-427a-afc2-a813af5f5653 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorizing `identity:delete_service(service_id=7ef47bc176184a068f84559cf6e1b53b)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:55.620317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f4808-f98e-427a-afc2-a813af5f5653 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:55.698822 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2092/4211] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:42:55 2022] DELETE /identity/v3/services/7ef47bc176184a068f84559cf6e1b53b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:42:55.702766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8691b3-b37b-4195-bf25-a0b3a8ed0365 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:55.870298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8691b3-b37b-4195-bf25-a0b3a8ed0365 tempest-EndPointGroupsTest-705655014 tempest-EndPointGroupsTest-705655014-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:55.896903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309c8a2-520a-4786-87f7-288ebcda0a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:55.898363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309c8a2-520a-4786-87f7-288ebcda0a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:55.898843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309c8a2-520a-4786-87f7-288ebcda0a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:55.899274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309c8a2-520a-4786-87f7-288ebcda0a76 admin admin] PATH_INFO: `/v3/users/31a2b76d6e9746f189f717a0eb222887` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:55.901536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309c8a2-520a-4786-87f7-288ebcda0a76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31a2b76d6e9746f189f717a0eb222887)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:55.904247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309c8a2-520a-4786-87f7-288ebcda0a76 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:56.108682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c309c8a2-520a-4786-87f7-288ebcda0a76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31a2b76d6e9746f189f717a0eb222887'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:56.111243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c309c8a2-520a-4786-87f7-288ebcda0a76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31a2b76d6e9746f189f717a0eb222887'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:56.153275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c309c8a2-520a-4786-87f7-288ebcda0a76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31a2b76d6e9746f189f717a0eb222887'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:56.217168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c309c8a2-520a-4786-87f7-288ebcda0a76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31a2b76d6e9746f189f717a0eb222887'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:56.218175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c309c8a2-520a-4786-87f7-288ebcda0a76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31a2b76d6e9746f189f717a0eb222887'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:56.319834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=84,keystone:UPDATE=1,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:56.328542 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2120/4212] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:42:55 2022] DELETE /identity/v3/users/31a2b76d6e9746f189f717a0eb222887 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:56.333456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4aee6-e04f-46d3-a578-374aa5710f46 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:56.333751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4aee6-e04f-46d3-a578-374aa5710f46 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:56.334058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4aee6-e04f-46d3-a578-374aa5710f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:56.366433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-cbf4aee6-e04f-46d3-a578-374aa5710f46 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:56.368331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cbf4aee6-e04f-46d3-a578-374aa5710f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:56.466312 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2093/4213] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:56.479955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309c8a2-520a-4786-87f7-288ebcda0a76 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:56.481756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c309c8a2-520a-4786-87f7-288ebcda0a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:56.617414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309c8a2-520a-4786-87f7-288ebcda0a76 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:56.623333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dab6c6-e235-403d-97be-5bce3597fc96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:56.625871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dab6c6-e235-403d-97be-5bce3597fc96 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:56.626358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dab6c6-e235-403d-97be-5bce3597fc96 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:56.626800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dab6c6-e235-403d-97be-5bce3597fc96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:56.639057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dab6c6-e235-403d-97be-5bce3597fc96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:56.641124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dab6c6-e235-403d-97be-5bce3597fc96 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:56.655487 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2121/4214] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:42:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:42:57.292569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4aee6-e04f-46d3-a578-374aa5710f46 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:57.294359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cbf4aee6-e04f-46d3-a578-374aa5710f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:57.309053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4aee6-e04f-46d3-a578-374aa5710f46 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:57.315417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dab6c6-e235-403d-97be-5bce3597fc96 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:57.315548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7904d40-0418-4a1b-bd6b-7cddefd5b39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:57.315887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-12dab6c6-e235-403d-97be-5bce3597fc96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:57.316495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7904d40-0418-4a1b-bd6b-7cddefd5b39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:57.317008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7904d40-0418-4a1b-bd6b-7cddefd5b39a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:57.317564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7904d40-0418-4a1b-bd6b-7cddefd5b39a admin admin] PATH_INFO: `/v3/users/d7e07d4112194174afbe20e709dfba8d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:57.319409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7904d40-0418-4a1b-bd6b-7cddefd5b39a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7e07d4112194174afbe20e709dfba8d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:57.321520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7904d40-0418-4a1b-bd6b-7cddefd5b39a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:57.332370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dab6c6-e235-403d-97be-5bce3597fc96 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:57.338607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edf4b7-1782-4d82-b0ee-c5e79b6405a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:57.362347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edf4b7-1782-4d82-b0ee-c5e79b6405a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:57.366184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edf4b7-1782-4d82-b0ee-c5e79b6405a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:57.366184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edf4b7-1782-4d82-b0ee-c5e79b6405a0 admin admin] PATH_INFO: `/v3/projects/3a7095a3d28e48b0a1550ddc7812a534` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:57.366184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1edf4b7-1782-4d82-b0ee-c5e79b6405a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a7095a3d28e48b0a1550ddc7812a534)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:57.367022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1edf4b7-1782-4d82-b0ee-c5e79b6405a0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:57.649602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d7904d40-0418-4a1b-bd6b-7cddefd5b39a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7e07d4112194174afbe20e709dfba8d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:57.650960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d7904d40-0418-4a1b-bd6b-7cddefd5b39a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7e07d4112194174afbe20e709dfba8d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:57.660809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d1edf4b7-1782-4d82-b0ee-c5e79b6405a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a7095a3d28e48b0a1550ddc7812a534', 'request_id': 'req-d1edf4b7-1782-4d82-b0ee-c5e79b6405a0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:57.661902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d7904d40-0418-4a1b-bd6b-7cddefd5b39a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7e07d4112194174afbe20e709dfba8d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:57.681780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d7904d40-0418-4a1b-bd6b-7cddefd5b39a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7e07d4112194174afbe20e709dfba8d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:57.686742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d1edf4b7-1782-4d82-b0ee-c5e79b6405a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a7095a3d28e48b0a1550ddc7812a534', 'request_id': 'req-d1edf4b7-1782-4d82-b0ee-c5e79b6405a0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:57.696428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d1edf4b7-1782-4d82-b0ee-c5e79b6405a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a7095a3d28e48b0a1550ddc7812a534', 'request_id': 'req-d1edf4b7-1782-4d82-b0ee-c5e79b6405a0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:57.802599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d7904d40-0418-4a1b-bd6b-7cddefd5b39a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7e07d4112194174afbe20e709dfba8d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:57.810804 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2094/4215] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:42:57 2022] DELETE /identity/v3/users/d7e07d4112194174afbe20e709dfba8d => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:57.824019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac434d5-fac9-4cb5-bf0c-6bcce6be6eaa None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:57.824492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac434d5-fac9-4cb5-bf0c-6bcce6be6eaa None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:57.824775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac434d5-fac9-4cb5-bf0c-6bcce6be6eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:57.850906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5ac434d5-fac9-4cb5-bf0c-6bcce6be6eaa None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:57.852334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5ac434d5-fac9-4cb5-bf0c-6bcce6be6eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:57.922586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:57.954846 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2095/4216] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:57.967381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d1edf4b7-1782-4d82-b0ee-c5e79b6405a0 admin admin] The token cache is being invalidate because project 3a7095a3d28e48b0a1550ddc7812a534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:42:57.967769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d1edf4b7-1782-4d82-b0ee-c5e79b6405a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:57.969514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac434d5-fac9-4cb5-bf0c-6bcce6be6eaa None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:57.970027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d1edf4b7-1782-4d82-b0ee-c5e79b6405a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:57.971492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5ac434d5-fac9-4cb5-bf0c-6bcce6be6eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:57.975224 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2122/4217] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:42:57 2022] DELETE /identity/v3/projects/3a7095a3d28e48b0a1550ddc7812a534 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:57.979592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edf4b7-1782-4d82-b0ee-c5e79b6405a0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:57.982744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d1edf4b7-1782-4d82-b0ee-c5e79b6405a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:58.063100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac434d5-fac9-4cb5-bf0c-6bcce6be6eaa None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:58.068442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7714ce-1d00-49e2-8990-c82e742ecc43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:58.070003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7714ce-1d00-49e2-8990-c82e742ecc43 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:58.070480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7714ce-1d00-49e2-8990-c82e742ecc43 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:58.070760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7714ce-1d00-49e2-8990-c82e742ecc43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:58.072688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5d7714ce-1d00-49e2-8990-c82e742ecc43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:58.092037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7714ce-1d00-49e2-8990-c82e742ecc43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:58.093546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7714ce-1d00-49e2-8990-c82e742ecc43 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:58.097120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edf4b7-1782-4d82-b0ee-c5e79b6405a0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:58.111835 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2096/4218] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:42:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:42:58.127954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8c147-6c4f-44d6-b8a5-e15a0fbecd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:58.127954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8c147-6c4f-44d6-b8a5-e15a0fbecd63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:58.127954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8c147-6c4f-44d6-b8a5-e15a0fbecd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:58.127954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8c147-6c4f-44d6-b8a5-e15a0fbecd63 admin admin] PATH_INFO: `/v3/users/ed6c780bf43f4d9cb2be3e3fb7513fa4` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:58.128620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8c147-6c4f-44d6-b8a5-e15a0fbecd63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed6c780bf43f4d9cb2be3e3fb7513fa4)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:58.128620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8c147-6c4f-44d6-b8a5-e15a0fbecd63 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:58.145025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:58.361631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-91c8c147-6c4f-44d6-b8a5-e15a0fbecd63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed6c780bf43f4d9cb2be3e3fb7513fa4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:58.362269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-91c8c147-6c4f-44d6-b8a5-e15a0fbecd63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed6c780bf43f4d9cb2be3e3fb7513fa4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:58.370563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-91c8c147-6c4f-44d6-b8a5-e15a0fbecd63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed6c780bf43f4d9cb2be3e3fb7513fa4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:58.383795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-91c8c147-6c4f-44d6-b8a5-e15a0fbecd63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed6c780bf43f4d9cb2be3e3fb7513fa4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:58.384548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-91c8c147-6c4f-44d6-b8a5-e15a0fbecd63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed6c780bf43f4d9cb2be3e3fb7513fa4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:58.495251 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2123/4219] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:42:57 2022] DELETE /identity/v3/users/ed6c780bf43f4d9cb2be3e3fb7513fa4 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:58.683852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7714ce-1d00-49e2-8990-c82e742ecc43 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:58.685305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5d7714ce-1d00-49e2-8990-c82e742ecc43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:58.698545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7714ce-1d00-49e2-8990-c82e742ecc43 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:58.761224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c352a-ada2-4087-80d4-25395c0a6ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:58.761851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c352a-ada2-4087-80d4-25395c0a6ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:58.762168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c352a-ada2-4087-80d4-25395c0a6ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:58.762452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c352a-ada2-4087-80d4-25395c0a6ad3 admin admin] PATH_INFO: `/v3/projects/2f893e7580394320a7977bd444597127` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:58.763573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c352a-ada2-4087-80d4-25395c0a6ad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f893e7580394320a7977bd444597127)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:58.765496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c352a-ada2-4087-80d4-25395c0a6ad3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:58.868059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5d0c352a-ada2-4087-80d4-25395c0a6ad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f893e7580394320a7977bd444597127', 'request_id': 'req-5d0c352a-ada2-4087-80d4-25395c0a6ad3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:58.957086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5d0c352a-ada2-4087-80d4-25395c0a6ad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f893e7580394320a7977bd444597127', 'request_id': 'req-5d0c352a-ada2-4087-80d4-25395c0a6ad3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:58.964139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5d0c352a-ada2-4087-80d4-25395c0a6ad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f893e7580394320a7977bd444597127', 'request_id': 'req-5d0c352a-ada2-4087-80d4-25395c0a6ad3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:58.977024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5d0c352a-ada2-4087-80d4-25395c0a6ad3 admin admin] The token cache is being invalidate because project 2f893e7580394320a7977bd444597127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:42:58.977650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5d0c352a-ada2-4087-80d4-25395c0a6ad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:58.978525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5d0c352a-ada2-4087-80d4-25395c0a6ad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:58.980221 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2097/4220] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:42:58 2022] DELETE /identity/v3/projects/2f893e7580394320a7977bd444597127 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:58.984631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8c147-6c4f-44d6-b8a5-e15a0fbecd63 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:58.986439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-91c8c147-6c4f-44d6-b8a5-e15a0fbecd63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:59.001829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8c147-6c4f-44d6-b8a5-e15a0fbecd63 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:59.060988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc621cb-c952-4604-a9c3-6dfb28ca1730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:59.061623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc621cb-c952-4604-a9c3-6dfb28ca1730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:59.061903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc621cb-c952-4604-a9c3-6dfb28ca1730 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:59.062206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc621cb-c952-4604-a9c3-6dfb28ca1730 admin admin] PATH_INFO: `/v3/users/bb76d6480c684e32aa1e026d26dc87dd` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:59.063343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc621cb-c952-4604-a9c3-6dfb28ca1730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb76d6480c684e32aa1e026d26dc87dd)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:59.065862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc621cb-c952-4604-a9c3-6dfb28ca1730 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:59.113009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c352a-ada2-4087-80d4-25395c0a6ad3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:59.114359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5d0c352a-ada2-4087-80d4-25395c0a6ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:59.130976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c352a-ada2-4087-80d4-25395c0a6ad3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:59.137727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e4831-f1b2-4195-ba5d-87f350a60f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:59.145832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e4831-f1b2-4195-ba5d-87f350a60f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:59.145832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e4831-f1b2-4195-ba5d-87f350a60f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:59.145832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e4831-f1b2-4195-ba5d-87f350a60f37 admin admin] PATH_INFO: `/v3/projects/735725f182204675906dcdb7e32cd4bf` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:59.145832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e4831-f1b2-4195-ba5d-87f350a60f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=735725f182204675906dcdb7e32cd4bf)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:59.145832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e4831-f1b2-4195-ba5d-87f350a60f37 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:59.158559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:59.228664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5fc621cb-c952-4604-a9c3-6dfb28ca1730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb76d6480c684e32aa1e026d26dc87dd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:59.229617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5fc621cb-c952-4604-a9c3-6dfb28ca1730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb76d6480c684e32aa1e026d26dc87dd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:59.282164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5fc621cb-c952-4604-a9c3-6dfb28ca1730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb76d6480c684e32aa1e026d26dc87dd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:59.282492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dd2e4831-f1b2-4195-ba5d-87f350a60f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '735725f182204675906dcdb7e32cd4bf', 'request_id': 'req-dd2e4831-f1b2-4195-ba5d-87f350a60f37'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:59.291910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5fc621cb-c952-4604-a9c3-6dfb28ca1730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb76d6480c684e32aa1e026d26dc87dd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:59.293104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5fc621cb-c952-4604-a9c3-6dfb28ca1730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb76d6480c684e32aa1e026d26dc87dd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:59.334860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dd2e4831-f1b2-4195-ba5d-87f350a60f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '735725f182204675906dcdb7e32cd4bf', 'request_id': 'req-dd2e4831-f1b2-4195-ba5d-87f350a60f37'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:59.345569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dd2e4831-f1b2-4195-ba5d-87f350a60f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '735725f182204675906dcdb7e32cd4bf', 'request_id': 'req-dd2e4831-f1b2-4195-ba5d-87f350a60f37'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:59.373112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dd2e4831-f1b2-4195-ba5d-87f350a60f37 admin admin] The token cache is being invalidate because project 735725f182204675906dcdb7e32cd4bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:42:59.376072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dd2e4831-f1b2-4195-ba5d-87f350a60f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:59.376072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dd2e4831-f1b2-4195-ba5d-87f350a60f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:42:59.383054 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2098/4221] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:42:59 2022] DELETE /identity/v3/projects/735725f182204675906dcdb7e32cd4bf => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:42:59.384614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f6d02-fcf9-4522-a31c-562dad288eff None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:59.384902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f6d02-fcf9-4522-a31c-562dad288eff None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:59.385178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f6d02-fcf9-4522-a31c-562dad288eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:59.420451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b33f6d02-fcf9-4522-a31c-562dad288eff None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:59.421732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b33f6d02-fcf9-4522-a31c-562dad288eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:59.465140 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2124/4222] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:42:58 2022] DELETE /identity/v3/users/bb76d6480c684e32aa1e026d26dc87dd => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:42:59.519202 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2099/4223] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:59.528904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c11d97-3ca5-4886-8f95-9d9196c2a723 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:59.532364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c11d97-3ca5-4886-8f95-9d9196c2a723 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:59.532364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c11d97-3ca5-4886-8f95-9d9196c2a723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:59.557372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a8c11d97-3ca5-4886-8f95-9d9196c2a723 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:42:59.565000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a8c11d97-3ca5-4886-8f95-9d9196c2a723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:59.570919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:59.681992 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2125/4224] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:42:59.685407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f6d02-fcf9-4522-a31c-562dad288eff None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:59.696475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f6d02-fcf9-4522-a31c-562dad288eff None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:59.701806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bfcd4-f095-434d-ad0c-a3a742660604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:59.702697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bfcd4-f095-434d-ad0c-a3a742660604 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:59.703293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bfcd4-f095-434d-ad0c-a3a742660604 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:59.703842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bfcd4-f095-434d-ad0c-a3a742660604 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:59.704924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1bfcd4-f095-434d-ad0c-a3a742660604 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:42:59.706819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1bfcd4-f095-434d-ad0c-a3a742660604 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:59.726256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1bfcd4-f095-434d-ad0c-a3a742660604 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:59.741153 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2100/4225] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:42:59.746077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c11d97-3ca5-4886-8f95-9d9196c2a723 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:59.759861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c11d97-3ca5-4886-8f95-9d9196c2a723 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:59.764171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2650704-e030-4613-a7d9-2e33e14bc0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:59.766250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2650704-e030-4613-a7d9-2e33e14bc0f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:59.766250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2650704-e030-4613-a7d9-2e33e14bc0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:59.766250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2650704-e030-4613-a7d9-2e33e14bc0f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:59.766250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2650704-e030-4613-a7d9-2e33e14bc0f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:59.768040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2650704-e030-4613-a7d9-2e33e14bc0f4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:42:59.846638 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2126/4226] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:42:59 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:42:59.850495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bfcd4-f095-434d-ad0c-a3a742660604 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:59.860791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bfcd4-f095-434d-ad0c-a3a742660604 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:42:59.917393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2650704-e030-4613-a7d9-2e33e14bc0f4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:42:59.919299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c2650704-e030-4613-a7d9-2e33e14bc0f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:42:59.932268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2cb10-a567-4fac-9f99-838e38ece3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:42:59.933626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2cb10-a567-4fac-9f99-838e38ece3e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:42:59.939522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2cb10-a567-4fac-9f99-838e38ece3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:42:59.939522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2cb10-a567-4fac-9f99-838e38ece3e1 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:42:59.939522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2cb10-a567-4fac-9f99-838e38ece3e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:42:59.939522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2cb10-a567-4fac-9f99-838e38ece3e1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:00.018161 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2101/4227] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:42:59 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:00.025929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2cb10-a567-4fac-9f99-838e38ece3e1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:00.026118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2650704-e030-4613-a7d9-2e33e14bc0f4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:00.026118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adcca75-d087-4e08-b737-d920d133b707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:00.027786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcca75-d087-4e08-b737-d920d133b707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:00.028239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcca75-d087-4e08-b737-d920d133b707 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:00.028825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcca75-d087-4e08-b737-d920d133b707 admin admin] PATH_INFO: `/v3/projects/b666cc3362c948c6a8d3d7e582846520` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:00.031734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adcca75-d087-4e08-b737-d920d133b707 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b666cc3362c948c6a8d3d7e582846520)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:00.035000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adcca75-d087-4e08-b737-d920d133b707 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:00.038690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2cb10-a567-4fac-9f99-838e38ece3e1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:00.046452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61605c4-3cd1-4dde-a6fc-701823bf4280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:00.048744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61605c4-3cd1-4dde-a6fc-701823bf4280 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:00.048744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61605c4-3cd1-4dde-a6fc-701823bf4280 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:00.048744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61605c4-3cd1-4dde-a6fc-701823bf4280 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:00.048744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61605c4-3cd1-4dde-a6fc-701823bf4280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:00.050014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61605c4-3cd1-4dde-a6fc-701823bf4280 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:00.070157 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2102/4228] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:00.109507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61605c4-3cd1-4dde-a6fc-701823bf4280 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:00.109507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61605c4-3cd1-4dde-a6fc-701823bf4280 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:00.109507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c544d-bd2f-4d50-8bb9-d8a274c42f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:00.109507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c544d-bd2f-4d50-8bb9-d8a274c42f35 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:00.110406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c544d-bd2f-4d50-8bb9-d8a274c42f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:00.110406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c544d-bd2f-4d50-8bb9-d8a274c42f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:00.110406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c544d-bd2f-4d50-8bb9-d8a274c42f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:00.110406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c544d-bd2f-4d50-8bb9-d8a274c42f35 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:00.110406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:00.110406 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2103/4229] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:00.110926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c544d-bd2f-4d50-8bb9-d8a274c42f35 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:00.124934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c544d-bd2f-4d50-8bb9-d8a274c42f35 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:00.129760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e95833-9995-4ec3-b7ef-a89afa26a23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:00.130548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e95833-9995-4ec3-b7ef-a89afa26a23e admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:00.130892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e95833-9995-4ec3-b7ef-a89afa26a23e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:00.131819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e95833-9995-4ec3-b7ef-a89afa26a23e admin admin] PATH_INFO: `/v3/projects/b4ac8d612b834cb99b696d93d83a9cbd/users/a8d520feb6e044038716fb5896e1d345/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:00.147297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e95833-9995-4ec3-b7ef-a89afa26a23e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ac8d612b834cb99b696d93d83a9cbd, user_id=a8d520feb6e044038716fb5896e1d345, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:00.150027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e95833-9995-4ec3-b7ef-a89afa26a23e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:00.256863 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2104/4230] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:43:00 2022] PUT /identity/v3/projects/b4ac8d612b834cb99b696d93d83a9cbd/users/a8d520feb6e044038716fb5896e1d345/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:00.258919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9adcca75-d087-4e08-b737-d920d133b707 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b666cc3362c948c6a8d3d7e582846520', 'request_id': 'req-9adcca75-d087-4e08-b737-d920d133b707'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:00.260717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f49f5-9d3d-4078-b070-d8a9d01fb2db None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:00.262326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f49f5-9d3d-4078-b070-d8a9d01fb2db None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:00.262637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f49f5-9d3d-4078-b070-d8a9d01fb2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:00.270610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9adcca75-d087-4e08-b737-d920d133b707 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b666cc3362c948c6a8d3d7e582846520', 'request_id': 'req-9adcca75-d087-4e08-b737-d920d133b707'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:00.286514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9adcca75-d087-4e08-b737-d920d133b707 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b666cc3362c948c6a8d3d7e582846520', 'request_id': 'req-9adcca75-d087-4e08-b737-d920d133b707'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:00.308019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-139f49f5-9d3d-4078-b070-d8a9d01fb2db None None] MFA Rules not processed for user `a8d520feb6e044038716fb5896e1d345`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:00.310184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-139f49f5-9d3d-4078-b070-d8a9d01fb2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:00.386161 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2105/4231] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:00.390418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f49f5-9d3d-4078-b070-d8a9d01fb2db None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:00.394407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9adcca75-d087-4e08-b737-d920d133b707 admin admin] The token cache is being invalidate because project b666cc3362c948c6a8d3d7e582846520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:00.394710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9adcca75-d087-4e08-b737-d920d133b707 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:00.406063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9adcca75-d087-4e08-b737-d920d133b707 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:00.409490 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2127/4232] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:42:59 2022] DELETE /identity/v3/projects/b666cc3362c948c6a8d3d7e582846520 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:43:00.415437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd2ffe-8a08-49d9-bedf-f0fa8c90b0dc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:00.415977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd2ffe-8a08-49d9-bedf-f0fa8c90b0dc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:00.416406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd2ffe-8a08-49d9-bedf-f0fa8c90b0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:00.444739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2efd2ffe-8a08-49d9-bedf-f0fa8c90b0dc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:00.447037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2efd2ffe-8a08-49d9-bedf-f0fa8c90b0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:00.480574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:00.483200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f49f5-9d3d-4078-b070-d8a9d01fb2db None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:00.496316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c748793-53b1-4974-9f86-c427cf3a5c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:00.498219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c748793-53b1-4974-9f86-c427cf3a5c80 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:00.498661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c748793-53b1-4974-9f86-c427cf3a5c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:00.498947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c748793-53b1-4974-9f86-c427cf3a5c80 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:00.500486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c748793-53b1-4974-9f86-c427cf3a5c80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:00.504820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c748793-53b1-4974-9f86-c427cf3a5c80 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:00.608519 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2128/4233] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:00.621027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866298d-3d57-40a9-8271-950ccf745c93 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:00.621456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866298d-3d57-40a9-8271-950ccf745c93 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:00.621748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866298d-3d57-40a9-8271-950ccf745c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:00.650775 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2106/4234] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:43:00 2022] POST /identity/v3/projects => generated 369 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:00.659275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c748793-53b1-4974-9f86-c427cf3a5c80 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:00.669473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9c748793-53b1-4974-9f86-c427cf3a5c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:00.712787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-5866298d-3d57-40a9-8271-950ccf745c93 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:00.719174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5866298d-3d57-40a9-8271-950ccf745c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:00.827706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:00.867923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c748793-53b1-4974-9f86-c427cf3a5c80 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:00.882138 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2129/4235] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:43:00.885928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866298d-3d57-40a9-8271-950ccf745c93 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:00.891278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3ac01-c298-4518-a6ac-8976e3a72df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:00.893898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3ac01-c298-4518-a6ac-8976e3a72df0 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:00.897298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3ac01-c298-4518-a6ac-8976e3a72df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:00.897690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3ac01-c298-4518-a6ac-8976e3a72df0 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:00.903357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3ac01-c298-4518-a6ac-8976e3a72df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:00.904366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866298d-3d57-40a9-8271-950ccf745c93 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:00.905361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3ac01-c298-4518-a6ac-8976e3a72df0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:00.914428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fdcf3-a5b6-4940-90be-166577e2b368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:00.915092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fdcf3-a5b6-4940-90be-166577e2b368 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:00.915574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fdcf3-a5b6-4940-90be-166577e2b368 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:00.916018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fdcf3-a5b6-4940-90be-166577e2b368 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:00.916862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787fdcf3-a5b6-4940-90be-166577e2b368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:43:00.917322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787fdcf3-a5b6-4940-90be-166577e2b368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:00.924247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787fdcf3-a5b6-4940-90be-166577e2b368 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:00.968711 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2130/4236] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:43:00.969802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fdcf3-a5b6-4940-90be-166577e2b368 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:01.007582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fdcf3-a5b6-4940-90be-166577e2b368 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:01.014768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8697c-9676-48bf-9ea6-88420bc1308a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:01.015480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8697c-9676-48bf-9ea6-88420bc1308a admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:01.020297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8697c-9676-48bf-9ea6-88420bc1308a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:01.020297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8697c-9676-48bf-9ea6-88420bc1308a admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:01.020297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8697c-9676-48bf-9ea6-88420bc1308a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:01.020297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8697c-9676-48bf-9ea6-88420bc1308a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:01.049012 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2107/4237] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:43:00 2022] POST /identity/v3/users => generated 291 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:01.053468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3ac01-c298-4518-a6ac-8976e3a72df0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:01.071341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3ac01-c298-4518-a6ac-8976e3a72df0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:01.078550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31922ae0-e2f2-4fd8-a100-b1b0f621b376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:01.079188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31922ae0-e2f2-4fd8-a100-b1b0f621b376 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:01.079469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31922ae0-e2f2-4fd8-a100-b1b0f621b376 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:01.080169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31922ae0-e2f2-4fd8-a100-b1b0f621b376 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:01.080611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31922ae0-e2f2-4fd8-a100-b1b0f621b376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:01.082907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31922ae0-e2f2-4fd8-a100-b1b0f621b376 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:01.115162 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2108/4238] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:01.119844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31922ae0-e2f2-4fd8-a100-b1b0f621b376 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:01.142257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31922ae0-e2f2-4fd8-a100-b1b0f621b376 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:01.142624 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2131/4239] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:43:00 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:01.143058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061de09-56d5-4520-9df9-b0ad1c468042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:01.143058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061de09-56d5-4520-9df9-b0ad1c468042 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:01.143058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061de09-56d5-4520-9df9-b0ad1c468042 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:01.143342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8697c-9676-48bf-9ea6-88420bc1308a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:01.143439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061de09-56d5-4520-9df9-b0ad1c468042 admin admin] PATH_INFO: `/v3/projects/d0176f021f6e414b840a06f4c964ace8/users/3b78e1c3562d47e0a07fa1b1078c2eec/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:01.177461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061de09-56d5-4520-9df9-b0ad1c468042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0176f021f6e414b840a06f4c964ace8, user_id=3b78e1c3562d47e0a07fa1b1078c2eec, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:01.182117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061de09-56d5-4520-9df9-b0ad1c468042 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:01.250827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8697c-9676-48bf-9ea6-88420bc1308a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:01.257011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e7b2c-2529-4335-a868-c46862eb1c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:01.257903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e7b2c-2529-4335-a868-c46862eb1c91 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:01.258245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e7b2c-2529-4335-a868-c46862eb1c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:01.258522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e7b2c-2529-4335-a868-c46862eb1c91 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:01.259164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e7b2c-2529-4335-a868-c46862eb1c91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:01.261118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e7b2c-2529-4335-a868-c46862eb1c91 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:01.273804 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2109/4240] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:43:01 2022] PUT /identity/v3/projects/d0176f021f6e414b840a06f4c964ace8/users/3b78e1c3562d47e0a07fa1b1078c2eec/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:43:01.277862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061de09-56d5-4520-9df9-b0ad1c468042 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:01.361532 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2132/4241] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:43:01 2022] POST /identity/v3/users => generated 290 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:43:01.369126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e7b2c-2529-4335-a868-c46862eb1c91 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:01.382510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061de09-56d5-4520-9df9-b0ad1c468042 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:01.390125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff236684-3e26-421f-9ec5-ee64cdc188cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:01.390125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff236684-3e26-421f-9ec5-ee64cdc188cc admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:01.390125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff236684-3e26-421f-9ec5-ee64cdc188cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:01.390418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e7b2c-2529-4335-a868-c46862eb1c91 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:01.390514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff236684-3e26-421f-9ec5-ee64cdc188cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:01.390605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff236684-3e26-421f-9ec5-ee64cdc188cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:01.392573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff236684-3e26-421f-9ec5-ee64cdc188cc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:01.398089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57604c1-3f15-4bed-9906-54722d4615cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:01.399027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57604c1-3f15-4bed-9906-54722d4615cb admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:01.399500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57604c1-3f15-4bed-9906-54722d4615cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:01.400458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57604c1-3f15-4bed-9906-54722d4615cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:01.401419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57604c1-3f15-4bed-9906-54722d4615cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:01.403614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57604c1-3f15-4bed-9906-54722d4615cb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:01.410183 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2110/4242] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:01.411786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff236684-3e26-421f-9ec5-ee64cdc188cc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:01.425054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff236684-3e26-421f-9ec5-ee64cdc188cc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:01.426071 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2133/4243] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:01.431928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57604c1-3f15-4bed-9906-54722d4615cb admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:01.445109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a961a1b-eafe-48f7-b4a1-a22fdb098981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:01.445801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a961a1b-eafe-48f7-b4a1-a22fdb098981 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:01.446109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a961a1b-eafe-48f7-b4a1-a22fdb098981 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:01.446408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a961a1b-eafe-48f7-b4a1-a22fdb098981 admin admin] PATH_INFO: `/v3/projects/d0176f021f6e414b840a06f4c964ace8/users/3b78e1c3562d47e0a07fa1b1078c2eec/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:01.447106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57604c1-3f15-4bed-9906-54722d4615cb admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:01.449295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a961a1b-eafe-48f7-b4a1-a22fdb098981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0176f021f6e414b840a06f4c964ace8, user_id=3b78e1c3562d47e0a07fa1b1078c2eec, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:01.456496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a961a1b-eafe-48f7-b4a1-a22fdb098981 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:01.456752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa030e3-29bf-4a94-8785-00eb8ad44a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:01.456752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa030e3-29bf-4a94-8785-00eb8ad44a5d admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:01.456752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa030e3-29bf-4a94-8785-00eb8ad44a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:01.456752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa030e3-29bf-4a94-8785-00eb8ad44a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:01.457194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa030e3-29bf-4a94-8785-00eb8ad44a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:01.460839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa030e3-29bf-4a94-8785-00eb8ad44a5d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:01.462398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:01.472619 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2134/4244] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:01.477002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa030e3-29bf-4a94-8785-00eb8ad44a5d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:01.489223 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2111/4245] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:43:01 2022] PUT /identity/v3/projects/d0176f021f6e414b840a06f4c964ace8/users/3b78e1c3562d47e0a07fa1b1078c2eec/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:01.491224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70f863-d9ad-4235-ad1d-0a1722eddfca None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:01.491526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70f863-d9ad-4235-ad1d-0a1722eddfca None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:01.491802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70f863-d9ad-4235-ad1d-0a1722eddfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:01.493378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa030e3-29bf-4a94-8785-00eb8ad44a5d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:01.529900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9f70f863-d9ad-4235-ad1d-0a1722eddfca None None] MFA Rules not processed for user `3b78e1c3562d47e0a07fa1b1078c2eec`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:01.531413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9f70f863-d9ad-4235-ad1d-0a1722eddfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:01.617739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3885b-4cd7-4c61-92bc-24a816d4f518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:01.618530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3885b-4cd7-4c61-92bc-24a816d4f518 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:01.618816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3885b-4cd7-4c61-92bc-24a816d4f518 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:01.619094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3885b-4cd7-4c61-92bc-24a816d4f518 admin admin] PATH_INFO: `/v3/projects/4f70d6a092214b1d9a605d0557246d36/users/e9a1a8d8c9004318b5d48a2036edefa9/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:01.638629 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2112/4246] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:01.644313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70f863-d9ad-4235-ad1d-0a1722eddfca None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:01.655705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70f863-d9ad-4235-ad1d-0a1722eddfca None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:01.661230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a6619-6958-4dae-8cb4-a00b83e5c7be tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:01.662819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a6619-6958-4dae-8cb4-a00b83e5c7be tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:01.663113 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a6619-6958-4dae-8cb4-a00b83e5c7be tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:01.663414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a6619-6958-4dae-8cb4-a00b83e5c7be tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:01.664218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a6619-6958-4dae-8cb4-a00b83e5c7be tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:01.666305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a6619-6958-4dae-8cb4-a00b83e5c7be tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:01.673318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:01.767870 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2113/4247] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Oct 27 03:43:01 2022] POST /identity/v3/projects => generated 329 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:01.769649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a6619-6958-4dae-8cb4-a00b83e5c7be tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:01.801473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3885b-4cd7-4c61-92bc-24a816d4f518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f70d6a092214b1d9a605d0557246d36, user_id=e9a1a8d8c9004318b5d48a2036edefa9, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:01.808021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3885b-4cd7-4c61-92bc-24a816d4f518 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:01.878135 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2135/4248] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:43:01 2022] PUT /identity/v3/projects/4f70d6a092214b1d9a605d0557246d36/users/e9a1a8d8c9004318b5d48a2036edefa9/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:01.880317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a0fe7-1410-4f8d-8fc6-fad1a38507ab None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:01.880611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a0fe7-1410-4f8d-8fc6-fad1a38507ab None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:01.880922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a0fe7-1410-4f8d-8fc6-fad1a38507ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:01.903021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a6619-6958-4dae-8cb4-a00b83e5c7be tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:01.937736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-bf4a0fe7-1410-4f8d-8fc6-fad1a38507ab None None] MFA Rules not processed for user `e9a1a8d8c9004318b5d48a2036edefa9`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:01.939026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bf4a0fe7-1410-4f8d-8fc6-fad1a38507ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:01.997732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ffa9eb-6413-4767-bf79-fa9b54c63990 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:01.998391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffa9eb-6413-4767-bf79-fa9b54c63990 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:02.000026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffa9eb-6413-4767-bf79-fa9b54c63990 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:02.000327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffa9eb-6413-4767-bf79-fa9b54c63990 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:02.001006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ffa9eb-6413-4767-bf79-fa9b54c63990 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:02.004887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ffa9eb-6413-4767-bf79-fa9b54c63990 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:02.058949 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2136/4249] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:43:02.075810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a0fe7-1410-4f8d-8fc6-fad1a38507ab None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:02.079679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bf4a0fe7-1410-4f8d-8fc6-fad1a38507ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:02.126058 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2114/4250] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:43:01 2022] POST /identity/v3/users => generated 416 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:02.127619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ffa9eb-6413-4767-bf79-fa9b54c63990 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:02.169448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ffa9eb-6413-4767-bf79-fa9b54c63990 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:02.185418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063df43-0ad9-4043-90ca-2f956265bbed tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:02.187996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063df43-0ad9-4043-90ca-2f956265bbed tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:02.188310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063df43-0ad9-4043-90ca-2f956265bbed tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:02.188925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063df43-0ad9-4043-90ca-2f956265bbed tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:02.189686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063df43-0ad9-4043-90ca-2f956265bbed tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:02.190783 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-7063df43-0ad9-4043-90ca-2f956265bbed tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:43:02.190783 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:43:02.190783 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:43:02.191735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063df43-0ad9-4043-90ca-2f956265bbed tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:02.254053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a0fe7-1410-4f8d-8fc6-fad1a38507ab None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:02.258994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad064b-fced-4259-81f3-be59e23a8124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:02.260392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad064b-fced-4259-81f3-be59e23a8124 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:02.260392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad064b-fced-4259-81f3-be59e23a8124 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:02.260392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad064b-fced-4259-81f3-be59e23a8124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:02.271392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad064b-fced-4259-81f3-be59e23a8124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:02.273539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad064b-fced-4259-81f3-be59e23a8124 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:02.285531 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2137/4251] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:43:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:43:02.312677 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2115/4252] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:43:02 2022] POST /identity/v3/roles => generated 244 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:02.317616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad064b-fced-4259-81f3-be59e23a8124 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:02.341749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad064b-fced-4259-81f3-be59e23a8124 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:02.350151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe562a-e514-4a39-90f5-5ff47bcc3d2e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:02.351672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe562a-e514-4a39-90f5-5ff47bcc3d2e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:02.352152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe562a-e514-4a39-90f5-5ff47bcc3d2e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:02.352600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe562a-e514-4a39-90f5-5ff47bcc3d2e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:02.353512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe562a-e514-4a39-90f5-5ff47bcc3d2e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:02.355763 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-38fe562a-e514-4a39-90f5-5ff47bcc3d2e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:43:02.355763 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:43:02.355763 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:43:02.357347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe562a-e514-4a39-90f5-5ff47bcc3d2e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:02.440353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:02.445128 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2138/4253] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:43:02 2022] POST /identity/v3/roles => generated 246 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:02.455701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063df43-0ad9-4043-90ca-2f956265bbed tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:02.472814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063df43-0ad9-4043-90ca-2f956265bbed tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:02.486296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37add939-6892-47b8-a1cc-1b34b1039344 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:02.486296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37add939-6892-47b8-a1cc-1b34b1039344 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:02.486296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37add939-6892-47b8-a1cc-1b34b1039344 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:02.486698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37add939-6892-47b8-a1cc-1b34b1039344 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/projects/a812104a7cc34950ac094015824e3b81/users/75525193e7ec4f3d84ac0a13efe75b14/roles/cc02a1701ceb41f28adf2133c3878ef7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:02.513354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37add939-6892-47b8-a1cc-1b34b1039344 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a812104a7cc34950ac094015824e3b81, user_id=75525193e7ec4f3d84ac0a13efe75b14, role_id=cc02a1701ceb41f28adf2133c3878ef7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:02.520381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37add939-6892-47b8-a1cc-1b34b1039344 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:02.586723 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2116/4254] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:43:02 2022] PUT /identity/v3/projects/a812104a7cc34950ac094015824e3b81/users/75525193e7ec4f3d84ac0a13efe75b14/roles/cc02a1701ceb41f28adf2133c3878ef7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:02.591835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe562a-e514-4a39-90f5-5ff47bcc3d2e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:02.618099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe562a-e514-4a39-90f5-5ff47bcc3d2e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:02.705139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f9acb-2a57-4dfb-81a9-820a6a6b2d93 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:02.705995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f9acb-2a57-4dfb-81a9-820a6a6b2d93 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:02.706410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f9acb-2a57-4dfb-81a9-820a6a6b2d93 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:02.706756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f9acb-2a57-4dfb-81a9-820a6a6b2d93 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/projects/a812104a7cc34950ac094015824e3b81/users/75525193e7ec4f3d84ac0a13efe75b14/roles/fe8b9e77031b4adfb15b659f07565a7b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:02.709645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f9acb-2a57-4dfb-81a9-820a6a6b2d93 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a812104a7cc34950ac094015824e3b81, user_id=75525193e7ec4f3d84ac0a13efe75b14, role_id=fe8b9e77031b4adfb15b659f07565a7b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:02.712413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f9acb-2a57-4dfb-81a9-820a6a6b2d93 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:02.822411 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2139/4255] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:43:02 2022] PUT /identity/v3/projects/a812104a7cc34950ac094015824e3b81/users/75525193e7ec4f3d84ac0a13efe75b14/roles/fe8b9e77031b4adfb15b659f07565a7b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:02.826349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37add939-6892-47b8-a1cc-1b34b1039344 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:02.838705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37add939-6892-47b8-a1cc-1b34b1039344 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:02.893669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:02.910784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac961cfb-db0c-4613-bf79-9f9e1a177139 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:02.911484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac961cfb-db0c-4613-bf79-9f9e1a177139 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:02.911868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac961cfb-db0c-4613-bf79-9f9e1a177139 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:02.912843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac961cfb-db0c-4613-bf79-9f9e1a177139 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:02.913584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac961cfb-db0c-4613-bf79-9f9e1a177139 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:02.915045 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-ac961cfb-db0c-4613-bf79-9f9e1a177139 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:43:02.915045 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:43:02.915045 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:43:02.917401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac961cfb-db0c-4613-bf79-9f9e1a177139 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:02.960477 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2117/4256] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:02 2022] GET /identity/v3/users => generated 8351 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:02.971418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42368238-ea8f-4078-a6b8-1becf166cc76 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:02.971931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42368238-ea8f-4078-a6b8-1becf166cc76 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:02.972268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42368238-ea8f-4078-a6b8-1becf166cc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:03.055161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-42368238-ea8f-4078-a6b8-1becf166cc76 None None] MFA Rules not processed for user `75525193e7ec4f3d84ac0a13efe75b14`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:03.056883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-42368238-ea8f-4078-a6b8-1becf166cc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:03.246662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567a483-49f4-4fc0-8acb-f685a59e8667 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:03.246793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567a483-49f4-4fc0-8acb-f685a59e8667 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:03.247014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567a483-49f4-4fc0-8acb-f685a59e8667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:03.247380 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2140/4257] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:02 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:03.279634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1567a483-49f4-4fc0-8acb-f685a59e8667 None None] MFA Rules not processed for user `75525193e7ec4f3d84ac0a13efe75b14`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:03.283564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1567a483-49f4-4fc0-8acb-f685a59e8667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:03.316423 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2118/4258] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:03 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:03.323404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42368238-ea8f-4078-a6b8-1becf166cc76 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:03.333766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42368238-ea8f-4078-a6b8-1becf166cc76 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:03.356010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fee37-208b-435f-ae9b-15c28474eb70 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75525193e7ec4f3d84ac0a13efe75b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a812104a7cc34950ac094015824e3b81', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-643750856', 'tempest-DelegatedRole-1870623030'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:03.360668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fee37-208b-435f-ae9b-15c28474eb70 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:03.360668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fee37-208b-435f-ae9b-15c28474eb70 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:03.360668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fee37-208b-435f-ae9b-15c28474eb70 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:03.360668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fee37-208b-435f-ae9b-15c28474eb70 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] RBAC: Authorizing `identity:create_trust()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:03.364723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fee37-208b-435f-ae9b-15c28474eb70 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:03.609448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567a483-49f4-4fc0-8acb-f685a59e8667 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:03.613102 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2141/4259] 10.222.0.20 () {60 vars in 1174 bytes} [Thu Oct 27 03:43:03 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:03.635543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567a483-49f4-4fc0-8acb-f685a59e8667 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:03.657865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c54042-8afe-4de9-b228-9a14631b3ba9 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:03.663905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c54042-8afe-4de9-b228-9a14631b3ba9 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:03.664424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c54042-8afe-4de9-b228-9a14631b3ba9 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:03.664866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c54042-8afe-4de9-b228-9a14631b3ba9 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:03.665878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c54042-8afe-4de9-b228-9a14631b3ba9 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:03.669592 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-c4c54042-8afe-4de9-b228-9a14631b3ba9 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:43:03.669592 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:43:03.669592 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:43:03.670455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c54042-8afe-4de9-b228-9a14631b3ba9 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:03.697623 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2119/4260] 10.222.0.20 () {58 vars in 1155 bytes} [Thu Oct 27 03:43:03 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:43:03.701567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fee37-208b-435f-ae9b-15c28474eb70 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:03.713126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:03.725149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fee37-208b-435f-ae9b-15c28474eb70 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:03.741784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ea885-457b-49cd-bdc5-af24473ca697 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75525193e7ec4f3d84ac0a13efe75b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a812104a7cc34950ac094015824e3b81', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-643750856', 'tempest-DelegatedRole-1870623030'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:03.744221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ea885-457b-49cd-bdc5-af24473ca697 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:03.751237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ea885-457b-49cd-bdc5-af24473ca697 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:03.751237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ea885-457b-49cd-bdc5-af24473ca697 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] PATH_INFO: `/v3/OS-TRUST/trusts/b81d9fd626324eb2b267328f3cdb03f2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:03.758895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ea885-457b-49cd-bdc5-af24473ca697 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] RBAC: Authorizing `identity:delete_trust(trust_id=b81d9fd626324eb2b267328f3cdb03f2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:03.760769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ea885-457b-49cd-bdc5-af24473ca697 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:03.870223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c73ea885-457b-49cd-bdc5-af24473ca697 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'b81d9fd626324eb2b267328f3cdb03f2', 'request_id': 'req-c73ea885-457b-49cd-bdc5-af24473ca697'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:03.871320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c73ea885-457b-49cd-bdc5-af24473ca697 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'b81d9fd626324eb2b267328f3cdb03f2', 'request_id': 'req-c73ea885-457b-49cd-bdc5-af24473ca697'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:03.872576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c73ea885-457b-49cd-bdc5-af24473ca697 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'b81d9fd626324eb2b267328f3cdb03f2', 'request_id': 'req-c73ea885-457b-49cd-bdc5-af24473ca697'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:03.937694 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2142/4261] 10.222.0.20 () {58 vars in 1254 bytes} [Thu Oct 27 03:43:03 2022] DELETE /identity/v3/OS-TRUST/trusts/b81d9fd626324eb2b267328f3cdb03f2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:03.938350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c54042-8afe-4de9-b228-9a14631b3ba9 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:03.940543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c4c54042-8afe-4de9-b228-9a14631b3ba9 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:03.960558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c54042-8afe-4de9-b228-9a14631b3ba9 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:03.976934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8211f-bf55-42b8-ac3b-4057148fbd63 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75525193e7ec4f3d84ac0a13efe75b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a812104a7cc34950ac094015824e3b81', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-643750856', 'tempest-DelegatedRole-1870623030'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:03.980868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8211f-bf55-42b8-ac3b-4057148fbd63 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:03.981548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8211f-bf55-42b8-ac3b-4057148fbd63 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:03.981841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8211f-bf55-42b8-ac3b-4057148fbd63 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] PATH_INFO: `/v3/OS-TRUST/trusts/b81d9fd626324eb2b267328f3cdb03f2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:04.015525 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-1ae8211f-bf55-42b8-ac3b-4057148fbd63 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] Could not find trust: b81d9fd626324eb2b267328f3cdb03f2.: keystone.exception.TrustNotFound: Could not find trust: b81d9fd626324eb2b267328f3cdb03f2. Oct 27 03:43:04.015525 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:43:04.015525 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:43:04.015525 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:43:04.015525 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:43:04.015525 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:43:04.015525 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:43:04.015525 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:43:04.015525 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:43:04.015525 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:43:04.015525 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:43:04.015525 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:43:04.015525 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 27 03:43:04.015525 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 27 03:43:04.015525 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 27 03:43:04.020094 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 27 03:43:04.020094 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 27 03:43:04.020094 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 27 03:43:04.020094 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 27 03:43:04.020094 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 27 03:43:04.020094 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:43:04.020094 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:43:04.020094 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 27 03:43:04.020094 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 27 03:43:04.020094 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 27 03:43:04.020094 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 27 03:43:04.020094 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: b81d9fd626324eb2b267328f3cdb03f2. Oct 27 03:43:04.020094 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:43:04.020094 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2120/4262] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:43:03 2022] GET /identity/v3/OS-TRUST/trusts/b81d9fd626324eb2b267328f3cdb03f2 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 27 03:43:04.022824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ea885-457b-49cd-bdc5-af24473ca697 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:04.024125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c73ea885-457b-49cd-bdc5-af24473ca697 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:04.050220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ea885-457b-49cd-bdc5-af24473ca697 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:04.056783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48515f4-8a12-4201-9692-f76c6f993d60 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:04.061771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48515f4-8a12-4201-9692-f76c6f993d60 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:04.061771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48515f4-8a12-4201-9692-f76c6f993d60 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:04.061771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48515f4-8a12-4201-9692-f76c6f993d60 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/roles/fe8b9e77031b4adfb15b659f07565a7b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:04.061771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48515f4-8a12-4201-9692-f76c6f993d60 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fe8b9e77031b4adfb15b659f07565a7b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:04.062171 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-d48515f4-8a12-4201-9692-f76c6f993d60 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:43:04.062171 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:43:04.062171 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:43:04.062171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48515f4-8a12-4201-9692-f76c6f993d60 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:04.265434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d48515f4-8a12-4201-9692-f76c6f993d60 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invalidating the token cache because role fe8b9e77031b4adfb15b659f07565a7b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:04.265891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d48515f4-8a12-4201-9692-f76c6f993d60 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:04.267090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d48515f4-8a12-4201-9692-f76c6f993d60 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:04.269538 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2143/4263] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:04 2022] DELETE /identity/v3/roles/fe8b9e77031b4adfb15b659f07565a7b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:04.274350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8211f-bf55-42b8-ac3b-4057148fbd63 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:04.277088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1ae8211f-bf55-42b8-ac3b-4057148fbd63 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:04.293881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8211f-bf55-42b8-ac3b-4057148fbd63 tempest-TrustsV3TestJSON-1054216530 tempest-user-1920065637] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:04.358843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a182587-2fde-4db0-81fe-5929d85bb642 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:04.359544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a182587-2fde-4db0-81fe-5929d85bb642 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:04.359828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a182587-2fde-4db0-81fe-5929d85bb642 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:04.360105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a182587-2fde-4db0-81fe-5929d85bb642 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/roles/cc02a1701ceb41f28adf2133c3878ef7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:04.361709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a182587-2fde-4db0-81fe-5929d85bb642 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cc02a1701ceb41f28adf2133c3878ef7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:04.362783 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-1a182587-2fde-4db0-81fe-5929d85bb642 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:43:04.362783 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:43:04.362783 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:43:04.363729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a182587-2fde-4db0-81fe-5929d85bb642 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:04.620479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1a182587-2fde-4db0-81fe-5929d85bb642 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invalidating the token cache because role cc02a1701ceb41f28adf2133c3878ef7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:04.620845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1a182587-2fde-4db0-81fe-5929d85bb642 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:04.621667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1a182587-2fde-4db0-81fe-5929d85bb642 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:04.626757 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2121/4264] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:04 2022] DELETE /identity/v3/roles/cc02a1701ceb41f28adf2133c3878ef7 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:43:04.628319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48515f4-8a12-4201-9692-f76c6f993d60 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:04.641418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48515f4-8a12-4201-9692-f76c6f993d60 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:04.707441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7bd48-37eb-46ac-9154-137fd586fbc2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:04.708701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7bd48-37eb-46ac-9154-137fd586fbc2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:04.709973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7bd48-37eb-46ac-9154-137fd586fbc2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:04.713129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7bd48-37eb-46ac-9154-137fd586fbc2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/users/75525193e7ec4f3d84ac0a13efe75b14` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:04.713129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7bd48-37eb-46ac-9154-137fd586fbc2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:delete_user(user_id=75525193e7ec4f3d84ac0a13efe75b14)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:04.714874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7bd48-37eb-46ac-9154-137fd586fbc2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:04.852634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-71c7bd48-37eb-46ac-9154-137fd586fbc2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75525193e7ec4f3d84ac0a13efe75b14'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:04.854232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-71c7bd48-37eb-46ac-9154-137fd586fbc2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75525193e7ec4f3d84ac0a13efe75b14'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:04.867843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-71c7bd48-37eb-46ac-9154-137fd586fbc2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75525193e7ec4f3d84ac0a13efe75b14'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:04.891702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-71c7bd48-37eb-46ac-9154-137fd586fbc2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75525193e7ec4f3d84ac0a13efe75b14'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:04.891702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-71c7bd48-37eb-46ac-9154-137fd586fbc2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75525193e7ec4f3d84ac0a13efe75b14'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:04.985199 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2144/4265] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:04 2022] DELETE /identity/v3/users/75525193e7ec4f3d84ac0a13efe75b14 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:04.989688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a182587-2fde-4db0-81fe-5929d85bb642 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:04.992506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1a182587-2fde-4db0-81fe-5929d85bb642 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:05.011614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a182587-2fde-4db0-81fe-5929d85bb642 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:05.129826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526f00b-a8d3-4df0-9b1c-04add07e5163 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:05.130700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526f00b-a8d3-4df0-9b1c-04add07e5163 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:05.133196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526f00b-a8d3-4df0-9b1c-04add07e5163 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:05.133557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526f00b-a8d3-4df0-9b1c-04add07e5163 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/projects/a812104a7cc34950ac094015824e3b81` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:05.135642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526f00b-a8d3-4df0-9b1c-04add07e5163 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a812104a7cc34950ac094015824e3b81)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:05.138418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526f00b-a8d3-4df0-9b1c-04add07e5163 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:05.244269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:05.374226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9526f00b-a8d3-4df0-9b1c-04add07e5163 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a812104a7cc34950ac094015824e3b81', 'request_id': 'req-9526f00b-a8d3-4df0-9b1c-04add07e5163'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:05.448818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9526f00b-a8d3-4df0-9b1c-04add07e5163 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a812104a7cc34950ac094015824e3b81', 'request_id': 'req-9526f00b-a8d3-4df0-9b1c-04add07e5163'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:05.460887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9526f00b-a8d3-4df0-9b1c-04add07e5163 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a812104a7cc34950ac094015824e3b81', 'request_id': 'req-9526f00b-a8d3-4df0-9b1c-04add07e5163'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:05.483178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9526f00b-a8d3-4df0-9b1c-04add07e5163 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] The token cache is being invalidate because project a812104a7cc34950ac094015824e3b81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:05.483481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9526f00b-a8d3-4df0-9b1c-04add07e5163 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:05.484156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9526f00b-a8d3-4df0-9b1c-04add07e5163 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:05.491978 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2122/4266] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:43:04 2022] DELETE /identity/v3/projects/a812104a7cc34950ac094015824e3b81 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:43:05.495362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7bd48-37eb-46ac-9154-137fd586fbc2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:05.497400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-71c7bd48-37eb-46ac-9154-137fd586fbc2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:05.513244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=83,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=14 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:05.536695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7bd48-37eb-46ac-9154-137fd586fbc2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:05.651541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fd8b2-92d1-49b6-95d7-6f05c6f774aa tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:05.653648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fd8b2-92d1-49b6-95d7-6f05c6f774aa tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:05.653959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fd8b2-92d1-49b6-95d7-6f05c6f774aa tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:05.654272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fd8b2-92d1-49b6-95d7-6f05c6f774aa tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:05.654984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fd8b2-92d1-49b6-95d7-6f05c6f774aa tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:05.657065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fd8b2-92d1-49b6-95d7-6f05c6f774aa tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:05.749125 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2145/4267] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Oct 27 03:43:05 2022] POST /identity/v3/projects => generated 326 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:05.754236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526f00b-a8d3-4df0-9b1c-04add07e5163 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:05.756360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9526f00b-a8d3-4df0-9b1c-04add07e5163 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:05.773194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526f00b-a8d3-4df0-9b1c-04add07e5163 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:05.842202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83146e-4b7a-4e33-bf67-28b847d41e27 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:05.842904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83146e-4b7a-4e33-bf67-28b847d41e27 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:05.843262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83146e-4b7a-4e33-bf67-28b847d41e27 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:05.843542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83146e-4b7a-4e33-bf67-28b847d41e27 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:05.844343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83146e-4b7a-4e33-bf67-28b847d41e27 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:05.846333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83146e-4b7a-4e33-bf67-28b847d41e27 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:05.944917 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2123/4268] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:43:05 2022] POST /identity/v3/users => generated 413 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:05.946215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fd8b2-92d1-49b6-95d7-6f05c6f774aa tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:05.957411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fd8b2-92d1-49b6-95d7-6f05c6f774aa tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:05.963207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7834e1-585b-4dbb-95c9-3ff70f9cba03 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:05.963923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7834e1-585b-4dbb-95c9-3ff70f9cba03 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:05.964211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7834e1-585b-4dbb-95c9-3ff70f9cba03 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:05.965718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7834e1-585b-4dbb-95c9-3ff70f9cba03 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:05.965718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7834e1-585b-4dbb-95c9-3ff70f9cba03 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:05.966827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7834e1-585b-4dbb-95c9-3ff70f9cba03 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:06.030768 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2146/4269] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:43:05 2022] POST /identity/v3/roles => generated 243 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:06.032203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83146e-4b7a-4e33-bf67-28b847d41e27 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:06.044383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83146e-4b7a-4e33-bf67-28b847d41e27 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:06.049685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88d72b-c793-4c8a-9db3-f84dd1d5bcb6 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:06.050750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88d72b-c793-4c8a-9db3-f84dd1d5bcb6 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:06.050750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88d72b-c793-4c8a-9db3-f84dd1d5bcb6 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:06.051069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88d72b-c793-4c8a-9db3-f84dd1d5bcb6 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:06.051821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88d72b-c793-4c8a-9db3-f84dd1d5bcb6 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:06.053684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88d72b-c793-4c8a-9db3-f84dd1d5bcb6 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:06.123296 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2124/4270] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:43:06 2022] POST /identity/v3/roles => generated 246 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:06.127273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7834e1-585b-4dbb-95c9-3ff70f9cba03 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:06.138450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7834e1-585b-4dbb-95c9-3ff70f9cba03 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:06.143166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3886d-986e-4958-84e8-1bc042e7eef6 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:06.143923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3886d-986e-4958-84e8-1bc042e7eef6 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:06.144203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3886d-986e-4958-84e8-1bc042e7eef6 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:06.144481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3886d-986e-4958-84e8-1bc042e7eef6 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/projects/abebf27f0c7047e0a4eceecef24675b2/users/f3ae6acfbbfa436c8f4f434f4c2c8fb2/roles/b665f1af12f341dea6f53b253cebdf35` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:06.160952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3886d-986e-4958-84e8-1bc042e7eef6 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_grant(project_id=abebf27f0c7047e0a4eceecef24675b2, user_id=f3ae6acfbbfa436c8f4f434f4c2c8fb2, role_id=b665f1af12f341dea6f53b253cebdf35)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:06.163791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3886d-986e-4958-84e8-1bc042e7eef6 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:06.243274 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2147/4271] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:43:06 2022] PUT /identity/v3/projects/abebf27f0c7047e0a4eceecef24675b2/users/f3ae6acfbbfa436c8f4f434f4c2c8fb2/roles/b665f1af12f341dea6f53b253cebdf35 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:43:06.247319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88d72b-c793-4c8a-9db3-f84dd1d5bcb6 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:06.269115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88d72b-c793-4c8a-9db3-f84dd1d5bcb6 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:06.331318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d7e04-277a-4395-ac15-c7170982b2c7 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:06.332020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d7e04-277a-4395-ac15-c7170982b2c7 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:06.332302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d7e04-277a-4395-ac15-c7170982b2c7 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:06.332620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d7e04-277a-4395-ac15-c7170982b2c7 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/projects/abebf27f0c7047e0a4eceecef24675b2/users/f3ae6acfbbfa436c8f4f434f4c2c8fb2/roles/444232c6e1ac4f6f9c50a2033a5ff705` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:06.334934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d7e04-277a-4395-ac15-c7170982b2c7 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_grant(project_id=abebf27f0c7047e0a4eceecef24675b2, user_id=f3ae6acfbbfa436c8f4f434f4c2c8fb2, role_id=444232c6e1ac4f6f9c50a2033a5ff705)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:06.337716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d7e04-277a-4395-ac15-c7170982b2c7 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:06.404190 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2125/4272] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:43:06 2022] PUT /identity/v3/projects/abebf27f0c7047e0a4eceecef24675b2/users/f3ae6acfbbfa436c8f4f434f4c2c8fb2/roles/444232c6e1ac4f6f9c50a2033a5ff705 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:06.408115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3886d-986e-4958-84e8-1bc042e7eef6 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:06.422100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3886d-986e-4958-84e8-1bc042e7eef6 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:06.508281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ef607-bf16-4ed0-af99-de24261b7d1b tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:06.509674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ef607-bf16-4ed0-af99-de24261b7d1b tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:06.509976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ef607-bf16-4ed0-af99-de24261b7d1b tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:06.510449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ef607-bf16-4ed0-af99-de24261b7d1b tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:06.511115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ef607-bf16-4ed0-af99-de24261b7d1b tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:06.513771 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-160ef607-bf16-4ed0-af99-de24261b7d1b tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:43:06.513771 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:43:06.513771 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:43:06.513771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ef607-bf16-4ed0-af99-de24261b7d1b tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:06.564553 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2148/4273] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:06 2022] GET /identity/v3/users => generated 8348 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:06.566471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3357ca-6e02-4eb0-a355-b18b1985fe9e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:06.567199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3357ca-6e02-4eb0-a355-b18b1985fe9e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:06.567681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3357ca-6e02-4eb0-a355-b18b1985fe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:06.613253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0a3357ca-6e02-4eb0-a355-b18b1985fe9e None None] MFA Rules not processed for user `f3ae6acfbbfa436c8f4f434f4c2c8fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:06.614666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0a3357ca-6e02-4eb0-a355-b18b1985fe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:06.620089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=6,keystone:SELECT=87,keystone:UPDATE=1,keystone:INSERT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:06.685948 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2126/4274] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:06 2022] POST /identity/v3/auth/tokens => generated 3275 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:06.697139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f35c0-342f-4a11-8996-473b149bc1da None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:06.698056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f35c0-342f-4a11-8996-473b149bc1da None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:06.698541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f35c0-342f-4a11-8996-473b149bc1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:06.720331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8d1f35c0-342f-4a11-8996-473b149bc1da None None] MFA Rules not processed for user `f3ae6acfbbfa436c8f4f434f4c2c8fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:06.721637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8d1f35c0-342f-4a11-8996-473b149bc1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:06.732041 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2149/4275] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:06 2022] POST /identity/v3/auth/tokens => generated 3275 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:06.733503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3357ca-6e02-4eb0-a355-b18b1985fe9e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:06.747468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3357ca-6e02-4eb0-a355-b18b1985fe9e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:06.755241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28681c-c826-4a6a-a9b2-4232991f02ce tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ae6acfbbfa436c8f4f434f4c2c8fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abebf27f0c7047e0a4eceecef24675b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-425602983', 'tempest-DelegatedRole-538962715'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:06.755241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28681c-c826-4a6a-a9b2-4232991f02ce tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:06.755241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28681c-c826-4a6a-a9b2-4232991f02ce tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:06.755589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28681c-c826-4a6a-a9b2-4232991f02ce tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:06.757148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28681c-c826-4a6a-a9b2-4232991f02ce tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] RBAC: Authorizing `identity:create_trust()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:06.759142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28681c-c826-4a6a-a9b2-4232991f02ce tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:06.960139 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2127/4276] 10.222.0.20 () {60 vars in 1174 bytes} [Thu Oct 27 03:43:06 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:43:06.964422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f35c0-342f-4a11-8996-473b149bc1da None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:06.976666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f35c0-342f-4a11-8996-473b149bc1da None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:06.983071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40333d-31bc-43f4-81d3-fd710888a524 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ae6acfbbfa436c8f4f434f4c2c8fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abebf27f0c7047e0a4eceecef24675b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-425602983', 'tempest-DelegatedRole-538962715'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:06.985385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40333d-31bc-43f4-81d3-fd710888a524 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:06.985958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40333d-31bc-43f4-81d3-fd710888a524 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:06.989711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40333d-31bc-43f4-81d3-fd710888a524 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:06.989711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40333d-31bc-43f4-81d3-fd710888a524 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:06.989711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40333d-31bc-43f4-81d3-fd710888a524 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:07.007037 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2150/4277] 10.222.0.20 () {58 vars in 1252 bytes} [Thu Oct 27 03:43:06 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=f3ae6acfbbfa436c8f4f434f4c2c8fb2 => generated 611 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:43:07.011516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28681c-c826-4a6a-a9b2-4232991f02ce tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:07.025843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28681c-c826-4a6a-a9b2-4232991f02ce tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:07.033886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbe9ed-9475-492e-b4b5-d7d12edf89b5 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ae6acfbbfa436c8f4f434f4c2c8fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abebf27f0c7047e0a4eceecef24675b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-425602983', 'tempest-DelegatedRole-538962715'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:07.035201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbe9ed-9475-492e-b4b5-d7d12edf89b5 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:07.036466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbe9ed-9475-492e-b4b5-d7d12edf89b5 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:07.038133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbe9ed-9475-492e-b4b5-d7d12edf89b5 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] PATH_INFO: `/v3/OS-TRUST/trusts/c887ae59ab234a9d81f38190f6b7b5a9` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:07.055085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbe9ed-9475-492e-b4b5-d7d12edf89b5 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] RBAC: Authorizing `identity:delete_trust(trust_id=c887ae59ab234a9d81f38190f6b7b5a9)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:07.057781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbe9ed-9475-492e-b4b5-d7d12edf89b5 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:07.127299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c4dbe9ed-9475-492e-b4b5-d7d12edf89b5 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'c887ae59ab234a9d81f38190f6b7b5a9', 'request_id': 'req-c4dbe9ed-9475-492e-b4b5-d7d12edf89b5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:07.224831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c4dbe9ed-9475-492e-b4b5-d7d12edf89b5 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'c887ae59ab234a9d81f38190f6b7b5a9', 'request_id': 'req-c4dbe9ed-9475-492e-b4b5-d7d12edf89b5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:07.226805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c4dbe9ed-9475-492e-b4b5-d7d12edf89b5 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'c887ae59ab234a9d81f38190f6b7b5a9', 'request_id': 'req-c4dbe9ed-9475-492e-b4b5-d7d12edf89b5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:07.238677 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2128/4278] 10.222.0.20 () {58 vars in 1254 bytes} [Thu Oct 27 03:43:07 2022] DELETE /identity/v3/OS-TRUST/trusts/c887ae59ab234a9d81f38190f6b7b5a9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:07.239623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40333d-31bc-43f4-81d3-fd710888a524 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:07.242470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8e40333d-31bc-43f4-81d3-fd710888a524 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:07.259300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40333d-31bc-43f4-81d3-fd710888a524 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:07.265105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80cdd12-a5f7-4966-96c6-9621d7e52cb4 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ae6acfbbfa436c8f4f434f4c2c8fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abebf27f0c7047e0a4eceecef24675b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-425602983', 'tempest-DelegatedRole-538962715'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:07.265758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cdd12-a5f7-4966-96c6-9621d7e52cb4 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:07.266061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cdd12-a5f7-4966-96c6-9621d7e52cb4 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:07.266372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cdd12-a5f7-4966-96c6-9621d7e52cb4 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] PATH_INFO: `/v3/OS-TRUST/trusts/c887ae59ab234a9d81f38190f6b7b5a9` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:07.278631 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-f80cdd12-a5f7-4966-96c6-9621d7e52cb4 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] Could not find trust: c887ae59ab234a9d81f38190f6b7b5a9.: keystone.exception.TrustNotFound: Could not find trust: c887ae59ab234a9d81f38190f6b7b5a9. Oct 27 03:43:07.278631 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:43:07.278631 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:43:07.278631 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:43:07.278631 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:43:07.278631 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:43:07.278631 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:43:07.278631 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:43:07.278631 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:43:07.278631 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:43:07.278631 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:43:07.278631 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:43:07.278631 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 27 03:43:07.278631 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 27 03:43:07.278631 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 27 03:43:07.279710 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 27 03:43:07.279710 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 27 03:43:07.279710 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 27 03:43:07.279710 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 27 03:43:07.279710 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 27 03:43:07.279710 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:43:07.279710 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:43:07.279710 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 27 03:43:07.279710 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 27 03:43:07.279710 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 27 03:43:07.279710 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 27 03:43:07.279710 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: c887ae59ab234a9d81f38190f6b7b5a9. Oct 27 03:43:07.279710 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:43:07.283201 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2151/4279] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:43:07 2022] GET /identity/v3/OS-TRUST/trusts/c887ae59ab234a9d81f38190f6b7b5a9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 27 03:43:07.284443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbe9ed-9475-492e-b4b5-d7d12edf89b5 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:07.285976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c4dbe9ed-9475-492e-b4b5-d7d12edf89b5 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:07.304134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbe9ed-9475-492e-b4b5-d7d12edf89b5 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:07.315062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c3611-ba9a-4204-a32c-1bcbac8fba17 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:07.315797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c3611-ba9a-4204-a32c-1bcbac8fba17 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:07.321220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c3611-ba9a-4204-a32c-1bcbac8fba17 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:07.321220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c3611-ba9a-4204-a32c-1bcbac8fba17 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/roles/444232c6e1ac4f6f9c50a2033a5ff705` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:07.321220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c3611-ba9a-4204-a32c-1bcbac8fba17 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:delete_role(role_id=444232c6e1ac4f6f9c50a2033a5ff705)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:07.321220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c3611-ba9a-4204-a32c-1bcbac8fba17 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:07.505982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7f1c3611-ba9a-4204-a32c-1bcbac8fba17 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invalidating the token cache because role 444232c6e1ac4f6f9c50a2033a5ff705 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:07.505982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7f1c3611-ba9a-4204-a32c-1bcbac8fba17 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:07.505982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7f1c3611-ba9a-4204-a32c-1bcbac8fba17 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:07.506338 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2129/4280] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:07 2022] DELETE /identity/v3/roles/444232c6e1ac4f6f9c50a2033a5ff705 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:07.511185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80cdd12-a5f7-4966-96c6-9621d7e52cb4 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:07.513962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f80cdd12-a5f7-4966-96c6-9621d7e52cb4 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:07.535661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80cdd12-a5f7-4966-96c6-9621d7e52cb4 tempest-TrustsV3TestJSON-5203858 tempest-user-141267544] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:07.587908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:07.659814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9874ca-6186-4a88-96b8-66591146870a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:07.660457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9874ca-6186-4a88-96b8-66591146870a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:07.660745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9874ca-6186-4a88-96b8-66591146870a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:07.661024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9874ca-6186-4a88-96b8-66591146870a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/roles/b665f1af12f341dea6f53b253cebdf35` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:07.663028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9874ca-6186-4a88-96b8-66591146870a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b665f1af12f341dea6f53b253cebdf35)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:07.665717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9874ca-6186-4a88-96b8-66591146870a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:07.925769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-af9874ca-6186-4a88-96b8-66591146870a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invalidating the token cache because role b665f1af12f341dea6f53b253cebdf35 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:07.931999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-af9874ca-6186-4a88-96b8-66591146870a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:07.931999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-af9874ca-6186-4a88-96b8-66591146870a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:07.938244 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2152/4281] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:07 2022] DELETE /identity/v3/roles/b665f1af12f341dea6f53b253cebdf35 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:07.939608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c3611-ba9a-4204-a32c-1bcbac8fba17 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:07.957376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c3611-ba9a-4204-a32c-1bcbac8fba17 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:07.971776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:08.106576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf39558-71ef-446e-b934-0eebaf77eeb2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:08.108128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf39558-71ef-446e-b934-0eebaf77eeb2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:08.108573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf39558-71ef-446e-b934-0eebaf77eeb2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:08.109006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf39558-71ef-446e-b934-0eebaf77eeb2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/users/f3ae6acfbbfa436c8f4f434f4c2c8fb2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:08.110538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf39558-71ef-446e-b934-0eebaf77eeb2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f3ae6acfbbfa436c8f4f434f4c2c8fb2)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:08.114874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf39558-71ef-446e-b934-0eebaf77eeb2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:08.261943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bdf39558-71ef-446e-b934-0eebaf77eeb2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3ae6acfbbfa436c8f4f434f4c2c8fb2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:08.263598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bdf39558-71ef-446e-b934-0eebaf77eeb2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3ae6acfbbfa436c8f4f434f4c2c8fb2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:08.279725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bdf39558-71ef-446e-b934-0eebaf77eeb2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3ae6acfbbfa436c8f4f434f4c2c8fb2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:08.311541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bdf39558-71ef-446e-b934-0eebaf77eeb2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3ae6acfbbfa436c8f4f434f4c2c8fb2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:08.414623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bdf39558-71ef-446e-b934-0eebaf77eeb2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3ae6acfbbfa436c8f4f434f4c2c8fb2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:08.425731 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2130/4282] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:07 2022] DELETE /identity/v3/users/f3ae6acfbbfa436c8f4f434f4c2c8fb2 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:08.428826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9874ca-6186-4a88-96b8-66591146870a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:08.430943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-af9874ca-6186-4a88-96b8-66591146870a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:08.456489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9874ca-6186-4a88-96b8-66591146870a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:08.625913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bba6c5-c553-4b86-a3c0-c529b9c2421e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:08.628266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bba6c5-c553-4b86-a3c0-c529b9c2421e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:08.628750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bba6c5-c553-4b86-a3c0-c529b9c2421e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:08.629301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bba6c5-c553-4b86-a3c0-c529b9c2421e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/projects/abebf27f0c7047e0a4eceecef24675b2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:08.630715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bba6c5-c553-4b86-a3c0-c529b9c2421e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:delete_project(project_id=abebf27f0c7047e0a4eceecef24675b2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:08.634222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bba6c5-c553-4b86-a3c0-c529b9c2421e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:08.920473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-95bba6c5-c553-4b86-a3c0-c529b9c2421e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abebf27f0c7047e0a4eceecef24675b2', 'request_id': 'req-95bba6c5-c553-4b86-a3c0-c529b9c2421e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:08.932989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-95bba6c5-c553-4b86-a3c0-c529b9c2421e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abebf27f0c7047e0a4eceecef24675b2', 'request_id': 'req-95bba6c5-c553-4b86-a3c0-c529b9c2421e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:08.950623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-95bba6c5-c553-4b86-a3c0-c529b9c2421e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abebf27f0c7047e0a4eceecef24675b2', 'request_id': 'req-95bba6c5-c553-4b86-a3c0-c529b9c2421e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:09.098151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-95bba6c5-c553-4b86-a3c0-c529b9c2421e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] The token cache is being invalidate because project abebf27f0c7047e0a4eceecef24675b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:09.098463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-95bba6c5-c553-4b86-a3c0-c529b9c2421e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:09.099190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-95bba6c5-c553-4b86-a3c0-c529b9c2421e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:09.101546 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2153/4283] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:43:08 2022] DELETE /identity/v3/projects/abebf27f0c7047e0a4eceecef24675b2 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:09.116261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf39558-71ef-446e-b934-0eebaf77eeb2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:09.126890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bdf39558-71ef-446e-b934-0eebaf77eeb2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:09.150491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf39558-71ef-446e-b934-0eebaf77eeb2 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:09.319834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d607ab-c375-4f2b-8666-1557af1dd46d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:09.319834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d607ab-c375-4f2b-8666-1557af1dd46d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:09.319834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d607ab-c375-4f2b-8666-1557af1dd46d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:09.320238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d607ab-c375-4f2b-8666-1557af1dd46d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:09.320238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d607ab-c375-4f2b-8666-1557af1dd46d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:09.322004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d607ab-c375-4f2b-8666-1557af1dd46d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:09.485656 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2131/4284] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Oct 27 03:43:09 2022] POST /identity/v3/projects => generated 328 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:09.489349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bba6c5-c553-4b86-a3c0-c529b9c2421e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:09.491643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-95bba6c5-c553-4b86-a3c0-c529b9c2421e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:09.508309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bba6c5-c553-4b86-a3c0-c529b9c2421e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:09.527289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:09.610162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef6507-c430-47f9-b65f-2ed78a167002 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:09.611040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef6507-c430-47f9-b65f-2ed78a167002 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:09.611671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef6507-c430-47f9-b65f-2ed78a167002 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:09.612132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef6507-c430-47f9-b65f-2ed78a167002 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:09.612913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef6507-c430-47f9-b65f-2ed78a167002 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:09.615487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef6507-c430-47f9-b65f-2ed78a167002 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:09.727339 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2154/4285] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:43:09 2022] POST /identity/v3/users => generated 413 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:09.731151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d607ab-c375-4f2b-8666-1557af1dd46d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:09.757635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d607ab-c375-4f2b-8666-1557af1dd46d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:09.776109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e23c3-37be-4ec0-bdc9-45f03eb370ab tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:09.777115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e23c3-37be-4ec0-bdc9-45f03eb370ab tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:09.777636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e23c3-37be-4ec0-bdc9-45f03eb370ab tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:09.778224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e23c3-37be-4ec0-bdc9-45f03eb370ab tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:09.779129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e23c3-37be-4ec0-bdc9-45f03eb370ab tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:09.784340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e23c3-37be-4ec0-bdc9-45f03eb370ab tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:09.851889 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2132/4286] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:43:09 2022] POST /identity/v3/roles => generated 244 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:09.855667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef6507-c430-47f9-b65f-2ed78a167002 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:09.869842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef6507-c430-47f9-b65f-2ed78a167002 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:09.876108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778c4f7-3481-4fcf-b99a-50171061fecd tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:09.876889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778c4f7-3481-4fcf-b99a-50171061fecd tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:09.877433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778c4f7-3481-4fcf-b99a-50171061fecd tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:09.877937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778c4f7-3481-4fcf-b99a-50171061fecd tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:09.879386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778c4f7-3481-4fcf-b99a-50171061fecd tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:09.881691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778c4f7-3481-4fcf-b99a-50171061fecd tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:09.890340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429a5e6-8ae2-4414-b579-331a46f8f054 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:09.890737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429a5e6-8ae2-4414-b579-331a46f8f054 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:09.891167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429a5e6-8ae2-4414-b579-331a46f8f054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:09.903948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:09.940050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-3429a5e6-8ae2-4414-b579-331a46f8f054 None None] MFA Rules not processed for user `b74e8d6facd1460ab31a3ce4b24dd315`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:09.942748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3429a5e6-8ae2-4414-b579-331a46f8f054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:09.976402 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2155/4287] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:43:09 2022] POST /identity/v3/roles => generated 246 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:09.980695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778c4f7-3481-4fcf-b99a-50171061fecd tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:10.004865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778c4f7-3481-4fcf-b99a-50171061fecd tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:10.017523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6744e2-a8dd-4af4-aaba-c1176fe9b0be tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:10.018617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6744e2-a8dd-4af4-aaba-c1176fe9b0be tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:10.019057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6744e2-a8dd-4af4-aaba-c1176fe9b0be tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:10.019489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6744e2-a8dd-4af4-aaba-c1176fe9b0be tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/projects/ed79e87b2fa444cfb4c78f9be3f6742b/users/1d805e0eff2a412b8f01156184ef68e8/roles/b048848f9da74692aa09d7f56b1d2856` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:10.054114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6744e2-a8dd-4af4-aaba-c1176fe9b0be tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ed79e87b2fa444cfb4c78f9be3f6742b, user_id=1d805e0eff2a412b8f01156184ef68e8, role_id=b048848f9da74692aa09d7f56b1d2856)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:10.059349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6744e2-a8dd-4af4-aaba-c1176fe9b0be tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:10.087222 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2133/4288] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:43:10.203807 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2156/4289] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:43:09 2022] PUT /identity/v3/projects/ed79e87b2fa444cfb4c78f9be3f6742b/users/1d805e0eff2a412b8f01156184ef68e8/roles/b048848f9da74692aa09d7f56b1d2856 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:10.208223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429a5e6-8ae2-4414-b579-331a46f8f054 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:10.231397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429a5e6-8ae2-4414-b579-331a46f8f054 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:10.468820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167daf0-3ffd-4dad-8bbb-b72a6151c9e5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:10.469591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167daf0-3ffd-4dad-8bbb-b72a6151c9e5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:10.469953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167daf0-3ffd-4dad-8bbb-b72a6151c9e5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:10.470311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167daf0-3ffd-4dad-8bbb-b72a6151c9e5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/projects/ed79e87b2fa444cfb4c78f9be3f6742b/users/1d805e0eff2a412b8f01156184ef68e8/roles/a35aade092fe4fab9cd081e87a052395` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:10.472960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167daf0-3ffd-4dad-8bbb-b72a6151c9e5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ed79e87b2fa444cfb4c78f9be3f6742b, user_id=1d805e0eff2a412b8f01156184ef68e8, role_id=a35aade092fe4fab9cd081e87a052395)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:10.477245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167daf0-3ffd-4dad-8bbb-b72a6151c9e5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:10.579148 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2134/4290] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:43:10 2022] PUT /identity/v3/projects/ed79e87b2fa444cfb4c78f9be3f6742b/users/1d805e0eff2a412b8f01156184ef68e8/roles/a35aade092fe4fab9cd081e87a052395 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:10.595286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6744e2-a8dd-4af4-aaba-c1176fe9b0be tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:10.621930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6744e2-a8dd-4af4-aaba-c1176fe9b0be tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:10.734737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0cb40-cc86-4ff5-af41-b11a359e592a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:10.735412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0cb40-cc86-4ff5-af41-b11a359e592a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:10.735697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0cb40-cc86-4ff5-af41-b11a359e592a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:10.735989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0cb40-cc86-4ff5-af41-b11a359e592a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:10.736652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0cb40-cc86-4ff5-af41-b11a359e592a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:10.738614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0cb40-cc86-4ff5-af41-b11a359e592a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:10.799179 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2157/4291] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:10 2022] GET /identity/v3/users => generated 8348 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:10.804567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0784c3d-c47d-4327-b361-6a45523300b2 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:10.804873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0784c3d-c47d-4327-b361-6a45523300b2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:10.805157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0784c3d-c47d-4327-b361-6a45523300b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:10.861114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d0784c3d-c47d-4327-b361-6a45523300b2 None None] MFA Rules not processed for user `1d805e0eff2a412b8f01156184ef68e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:10.862470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d0784c3d-c47d-4327-b361-6a45523300b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:10.949709 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2135/4292] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:10 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:10.960074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5f302-4c59-49ff-8cb0-a1925b00f698 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:10.960363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5f302-4c59-49ff-8cb0-a1925b00f698 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:10.960639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5f302-4c59-49ff-8cb0-a1925b00f698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:10.987130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1bd5f302-4c59-49ff-8cb0-a1925b00f698 None None] MFA Rules not processed for user `1d805e0eff2a412b8f01156184ef68e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:10.988500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1bd5f302-4c59-49ff-8cb0-a1925b00f698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:10.997618 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2158/4293] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:10 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:11.002268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0784c3d-c47d-4327-b361-6a45523300b2 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:11.014333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0784c3d-c47d-4327-b361-6a45523300b2 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:11.021124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a2e68-9436-4cb1-b19f-4db50fd043de tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d805e0eff2a412b8f01156184ef68e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed79e87b2fa444cfb4c78f9be3f6742b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-404674719', 'tempest-DelegatedRole-1518439870'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:11.023379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a2e68-9436-4cb1-b19f-4db50fd043de tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:11.023769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a2e68-9436-4cb1-b19f-4db50fd043de tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:11.024158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a2e68-9436-4cb1-b19f-4db50fd043de tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:11.024919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a2e68-9436-4cb1-b19f-4db50fd043de tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: Authorizing `identity:create_trust()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:11.029596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a2e68-9436-4cb1-b19f-4db50fd043de tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:11.100669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5f302-4c59-49ff-8cb0-a1925b00f698 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:11.103412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1bd5f302-4c59-49ff-8cb0-a1925b00f698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:11.206857 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2136/4294] 10.222.0.20 () {60 vars in 1174 bytes} [Thu Oct 27 03:43:11 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:11.211932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a2e68-9436-4cb1-b19f-4db50fd043de tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:11.241713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a2e68-9436-4cb1-b19f-4db50fd043de tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:11.247265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5f302-4c59-49ff-8cb0-a1925b00f698 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:11.253742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c298bf1-426e-4d95-9708-357b717e9bfd tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d805e0eff2a412b8f01156184ef68e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed79e87b2fa444cfb4c78f9be3f6742b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-404674719', 'tempest-DelegatedRole-1518439870'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:11.254286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303f1e7-6696-4e5d-85c2-a6bc98947efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:11.254923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303f1e7-6696-4e5d-85c2-a6bc98947efa service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:11.255201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303f1e7-6696-4e5d-85c2-a6bc98947efa service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:11.255472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303f1e7-6696-4e5d-85c2-a6bc98947efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:11.256535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c298bf1-426e-4d95-9708-357b717e9bfd tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:11.256928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c298bf1-426e-4d95-9708-357b717e9bfd tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:11.257163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c298bf1-426e-4d95-9708-357b717e9bfd tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] PATH_INFO: `/v3/OS-TRUST/trusts/e049880c792c4f8689ab01985f871bbe` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:11.262131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2303f1e7-6696-4e5d-85c2-a6bc98947efa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:11.265321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:11.277408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c298bf1-426e-4d95-9708-357b717e9bfd tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: Authorizing `identity:get_trust(trust_id=e049880c792c4f8689ab01985f871bbe)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:11.281048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303f1e7-6696-4e5d-85c2-a6bc98947efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:11.282608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303f1e7-6696-4e5d-85c2-a6bc98947efa service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:11.283157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c298bf1-426e-4d95-9708-357b717e9bfd tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:11.287827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:11.294435 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2159/4295] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:43:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:43:11.305863 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2137/4296] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:43:11 2022] GET /identity/v3/OS-TRUST/trusts/e049880c792c4f8689ab01985f871bbe => generated 859 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:43:11.311462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303f1e7-6696-4e5d-85c2-a6bc98947efa service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:11.334566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303f1e7-6696-4e5d-85c2-a6bc98947efa service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:11.340482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbc9fe-5279-43eb-85d7-fecba5996f11 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d805e0eff2a412b8f01156184ef68e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed79e87b2fa444cfb4c78f9be3f6742b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-404674719', 'tempest-DelegatedRole-1518439870'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:11.342483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbc9fe-5279-43eb-85d7-fecba5996f11 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:11.342483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbc9fe-5279-43eb-85d7-fecba5996f11 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:11.342812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbc9fe-5279-43eb-85d7-fecba5996f11 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] PATH_INFO: `/v3/OS-TRUST/trusts/e049880c792c4f8689ab01985f871bbe/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:11.359029 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbc9fe-5279-43eb-85d7-fecba5996f11 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=e049880c792c4f8689ab01985f871bbe)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:11.360715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbc9fe-5279-43eb-85d7-fecba5996f11 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:11.384042 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2160/4297] 10.222.0.20 () {58 vars in 1269 bytes} [Thu Oct 27 03:43:11 2022] GET /identity/v3/OS-TRUST/trusts/e049880c792c4f8689ab01985f871bbe/roles => generated 371 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:43:11.388682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c298bf1-426e-4d95-9708-357b717e9bfd tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:11.400670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c298bf1-426e-4d95-9708-357b717e9bfd tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:11.417403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90bec2-e7e9-4d81-b981-5cc54b7f61ad tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d805e0eff2a412b8f01156184ef68e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed79e87b2fa444cfb4c78f9be3f6742b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-404674719', 'tempest-DelegatedRole-1518439870'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:11.418329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90bec2-e7e9-4d81-b981-5cc54b7f61ad tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:11.419226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90bec2-e7e9-4d81-b981-5cc54b7f61ad tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:11.419694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90bec2-e7e9-4d81-b981-5cc54b7f61ad tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] PATH_INFO: `/v3/OS-TRUST/trusts/e049880c792c4f8689ab01985f871bbe/roles/b048848f9da74692aa09d7f56b1d2856` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:11.434688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90bec2-e7e9-4d81-b981-5cc54b7f61ad tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e049880c792c4f8689ab01985f871bbe, role_id=b048848f9da74692aa09d7f56b1d2856)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:11.436392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90bec2-e7e9-4d81-b981-5cc54b7f61ad tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:11.450733 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2138/4298] 10.222.0.20 () {58 vars in 1368 bytes} [Thu Oct 27 03:43:11 2022] GET /identity/v3/OS-TRUST/trusts/e049880c792c4f8689ab01985f871bbe/roles/b048848f9da74692aa09d7f56b1d2856 => generated 244 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:43:11.453401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbc9fe-5279-43eb-85d7-fecba5996f11 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:11.465882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbc9fe-5279-43eb-85d7-fecba5996f11 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:11.471349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36391de1-63ef-4d52-8f6b-f147ff641732 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d805e0eff2a412b8f01156184ef68e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed79e87b2fa444cfb4c78f9be3f6742b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-404674719', 'tempest-DelegatedRole-1518439870'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:11.472361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36391de1-63ef-4d52-8f6b-f147ff641732 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] REQUEST_METHOD: `HEAD` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:11.472854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36391de1-63ef-4d52-8f6b-f147ff641732 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:11.473357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36391de1-63ef-4d52-8f6b-f147ff641732 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] PATH_INFO: `/v3/OS-TRUST/trusts/e049880c792c4f8689ab01985f871bbe/roles/b048848f9da74692aa09d7f56b1d2856` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:11.481776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36391de1-63ef-4d52-8f6b-f147ff641732 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e049880c792c4f8689ab01985f871bbe, role_id=b048848f9da74692aa09d7f56b1d2856)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:11.484949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36391de1-63ef-4d52-8f6b-f147ff641732 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:11.513300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90bec2-e7e9-4d81-b981-5cc54b7f61ad tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:11.517734 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2161/4299] 10.222.0.20 () {58 vars in 1369 bytes} [Thu Oct 27 03:43:11 2022] HEAD /identity/v3/OS-TRUST/trusts/e049880c792c4f8689ab01985f871bbe/roles/b048848f9da74692aa09d7f56b1d2856 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 27 03:43:11.543543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90bec2-e7e9-4d81-b981-5cc54b7f61ad tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:11.561222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fc86b-177a-4675-a96b-57a1b9913d31 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d805e0eff2a412b8f01156184ef68e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed79e87b2fa444cfb4c78f9be3f6742b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-404674719', 'tempest-DelegatedRole-1518439870'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:11.562850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fc86b-177a-4675-a96b-57a1b9913d31 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:11.562850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fc86b-177a-4675-a96b-57a1b9913d31 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:11.562850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fc86b-177a-4675-a96b-57a1b9913d31 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] PATH_INFO: `/v3/OS-TRUST/trusts/e049880c792c4f8689ab01985f871bbe/roles/a35aade092fe4fab9cd081e87a052395` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:11.603532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fc86b-177a-4675-a96b-57a1b9913d31 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e049880c792c4f8689ab01985f871bbe, role_id=a35aade092fe4fab9cd081e87a052395)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:11.605065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fc86b-177a-4675-a96b-57a1b9913d31 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:11.638573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-fb6fc86b-177a-4675-a96b-57a1b9913d31 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Could not find role: a35aade092fe4fab9cd081e87a052395.: keystone.exception.RoleNotFound: Could not find role: a35aade092fe4fab9cd081e87a052395. Oct 27 03:43:11.638573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:43:11.638573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:43:11.638573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:43:11.638573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:43:11.638573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:43:11.638573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:43:11.638573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:43:11.638573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:43:11.638573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:43:11.638573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:43:11.638573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:43:11.638573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 27 03:43:11.638573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:43:11.638573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: a35aade092fe4fab9cd081e87a052395. Oct 27 03:43:11.639763 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:43:11.654491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36391de1-63ef-4d52-8f6b-f147ff641732 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:11.666238 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2139/4300] 10.222.0.20 () {58 vars in 1368 bytes} [Thu Oct 27 03:43:11 2022] GET /identity/v3/OS-TRUST/trusts/e049880c792c4f8689ab01985f871bbe/roles/a35aade092fe4fab9cd081e87a052395 => generated 110 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:43:11.668005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36391de1-63ef-4d52-8f6b-f147ff641732 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:11.673965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731a0ea-fcb8-49bd-954a-cdf91ddbf57a tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d805e0eff2a412b8f01156184ef68e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed79e87b2fa444cfb4c78f9be3f6742b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-404674719', 'tempest-DelegatedRole-1518439870'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:11.675120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731a0ea-fcb8-49bd-954a-cdf91ddbf57a tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] REQUEST_METHOD: `HEAD` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:11.675715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731a0ea-fcb8-49bd-954a-cdf91ddbf57a tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:11.676091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731a0ea-fcb8-49bd-954a-cdf91ddbf57a tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] PATH_INFO: `/v3/OS-TRUST/trusts/e049880c792c4f8689ab01985f871bbe/roles/a35aade092fe4fab9cd081e87a052395` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:11.684224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731a0ea-fcb8-49bd-954a-cdf91ddbf57a tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e049880c792c4f8689ab01985f871bbe, role_id=a35aade092fe4fab9cd081e87a052395)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:11.686816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731a0ea-fcb8-49bd-954a-cdf91ddbf57a tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:11.708368 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-8731a0ea-fcb8-49bd-954a-cdf91ddbf57a tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Could not find role: a35aade092fe4fab9cd081e87a052395.: keystone.exception.RoleNotFound: Could not find role: a35aade092fe4fab9cd081e87a052395. Oct 27 03:43:11.708368 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:43:11.708368 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:43:11.708368 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:43:11.708368 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:43:11.708368 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:43:11.708368 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:43:11.708368 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:43:11.708368 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:43:11.708368 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:43:11.708368 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:43:11.708368 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:43:11.708368 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 27 03:43:11.708368 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:43:11.708368 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: a35aade092fe4fab9cd081e87a052395. Oct 27 03:43:11.710375 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:43:11.714199 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2162/4301] 10.222.0.20 () {58 vars in 1369 bytes} [Thu Oct 27 03:43:11 2022] HEAD /identity/v3/OS-TRUST/trusts/e049880c792c4f8689ab01985f871bbe/roles/a35aade092fe4fab9cd081e87a052395 => generated 0 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 27 03:43:11.717697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fc86b-177a-4675-a96b-57a1b9913d31 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:11.737763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fc86b-177a-4675-a96b-57a1b9913d31 tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:11.745410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f06094-ee34-4401-b1a6-96b5c727852f tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d805e0eff2a412b8f01156184ef68e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed79e87b2fa444cfb4c78f9be3f6742b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-404674719', 'tempest-DelegatedRole-1518439870'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:11.756381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06094-ee34-4401-b1a6-96b5c727852f tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:11.762820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06094-ee34-4401-b1a6-96b5c727852f tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:11.763136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06094-ee34-4401-b1a6-96b5c727852f tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] PATH_INFO: `/v3/OS-TRUST/trusts/e049880c792c4f8689ab01985f871bbe` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:11.783701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f06094-ee34-4401-b1a6-96b5c727852f tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: Authorizing `identity:delete_trust(trust_id=e049880c792c4f8689ab01985f871bbe)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:11.788070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f06094-ee34-4401-b1a6-96b5c727852f tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:11.904883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-24f06094-ee34-4401-b1a6-96b5c727852f tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'e049880c792c4f8689ab01985f871bbe', 'request_id': 'req-24f06094-ee34-4401-b1a6-96b5c727852f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:12.000065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-24f06094-ee34-4401-b1a6-96b5c727852f tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e049880c792c4f8689ab01985f871bbe', 'request_id': 'req-24f06094-ee34-4401-b1a6-96b5c727852f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:12.001589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-24f06094-ee34-4401-b1a6-96b5c727852f tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e049880c792c4f8689ab01985f871bbe', 'request_id': 'req-24f06094-ee34-4401-b1a6-96b5c727852f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:12.010369 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2140/4302] 10.222.0.20 () {58 vars in 1254 bytes} [Thu Oct 27 03:43:11 2022] DELETE /identity/v3/OS-TRUST/trusts/e049880c792c4f8689ab01985f871bbe => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:12.015970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731a0ea-fcb8-49bd-954a-cdf91ddbf57a tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:12.018825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8731a0ea-fcb8-49bd-954a-cdf91ddbf57a tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:12.037911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731a0ea-fcb8-49bd-954a-cdf91ddbf57a tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:12.060061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e9198-5f61-4564-b118-c0cfb5694e3b tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d805e0eff2a412b8f01156184ef68e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed79e87b2fa444cfb4c78f9be3f6742b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-404674719', 'tempest-DelegatedRole-1518439870'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:12.060061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e9198-5f61-4564-b118-c0cfb5694e3b tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:12.060061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e9198-5f61-4564-b118-c0cfb5694e3b tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:12.060345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e9198-5f61-4564-b118-c0cfb5694e3b tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] PATH_INFO: `/v3/OS-TRUST/trusts/e049880c792c4f8689ab01985f871bbe` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:12.060345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-2e1e9198-5f61-4564-b118-c0cfb5694e3b tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Could not find trust: e049880c792c4f8689ab01985f871bbe.: keystone.exception.TrustNotFound: Could not find trust: e049880c792c4f8689ab01985f871bbe. Oct 27 03:43:12.060345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:43:12.060345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:43:12.060345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:43:12.060345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:43:12.060345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:43:12.060345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:43:12.060345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:43:12.060345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:43:12.060345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:43:12.060345 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:43:12.061283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:43:12.061283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 27 03:43:12.061283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 27 03:43:12.061283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 27 03:43:12.061283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 27 03:43:12.061283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 27 03:43:12.061283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 27 03:43:12.061283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 27 03:43:12.061283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 27 03:43:12.061283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:43:12.061283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:43:12.061283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 27 03:43:12.061283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 27 03:43:12.061283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 27 03:43:12.061283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 27 03:43:12.061283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: e049880c792c4f8689ab01985f871bbe. Oct 27 03:43:12.061283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:43:12.062358 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2163/4303] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:43:12 2022] GET /identity/v3/OS-TRUST/trusts/e049880c792c4f8689ab01985f871bbe => generated 111 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 27 03:43:12.063642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f06094-ee34-4401-b1a6-96b5c727852f tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:12.065130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-24f06094-ee34-4401-b1a6-96b5c727852f tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:12.081546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f06094-ee34-4401-b1a6-96b5c727852f tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:12.087017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2754c-2945-4c82-8a98-e4ced6b8377e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:12.088064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2754c-2945-4c82-8a98-e4ced6b8377e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:12.088405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2754c-2945-4c82-8a98-e4ced6b8377e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:12.088824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2754c-2945-4c82-8a98-e4ced6b8377e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/roles/a35aade092fe4fab9cd081e87a052395` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:12.090515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2754c-2945-4c82-8a98-e4ced6b8377e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a35aade092fe4fab9cd081e87a052395)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:12.092315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2754c-2945-4c82-8a98-e4ced6b8377e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:12.350223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f1d2754c-2945-4c82-8a98-e4ced6b8377e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invalidating the token cache because role a35aade092fe4fab9cd081e87a052395 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:12.350223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f1d2754c-2945-4c82-8a98-e4ced6b8377e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:12.350937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f1d2754c-2945-4c82-8a98-e4ced6b8377e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:12.362763 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2141/4304] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:12 2022] DELETE /identity/v3/roles/a35aade092fe4fab9cd081e87a052395 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:12.367411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e9198-5f61-4564-b118-c0cfb5694e3b tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:12.371406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2e1e9198-5f61-4564-b118-c0cfb5694e3b tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:12.401259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e9198-5f61-4564-b118-c0cfb5694e3b tempest-TrustsV3TestJSON-462913468 tempest-user-843731001] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:12.578908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03702f2d-a343-4219-a296-47077c9be41f tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:12.579677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03702f2d-a343-4219-a296-47077c9be41f tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:12.580034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03702f2d-a343-4219-a296-47077c9be41f tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:12.580367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03702f2d-a343-4219-a296-47077c9be41f tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/roles/b048848f9da74692aa09d7f56b1d2856` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:12.588252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03702f2d-a343-4219-a296-47077c9be41f tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b048848f9da74692aa09d7f56b1d2856)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:12.590242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03702f2d-a343-4219-a296-47077c9be41f tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:12.925331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-03702f2d-a343-4219-a296-47077c9be41f tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invalidating the token cache because role b048848f9da74692aa09d7f56b1d2856 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:12.925629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-03702f2d-a343-4219-a296-47077c9be41f tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:12.926759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-03702f2d-a343-4219-a296-47077c9be41f tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:12.932511 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2164/4305] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:12 2022] DELETE /identity/v3/roles/b048848f9da74692aa09d7f56b1d2856 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:12.933778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2754c-2945-4c82-8a98-e4ced6b8377e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:12.951836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2754c-2945-4c82-8a98-e4ced6b8377e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:13.050923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:13.088901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4dd2a-0421-4202-9b6d-e9d948f130a5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:13.089684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4dd2a-0421-4202-9b6d-e9d948f130a5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:13.089976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4dd2a-0421-4202-9b6d-e9d948f130a5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:13.090296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4dd2a-0421-4202-9b6d-e9d948f130a5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/users/1d805e0eff2a412b8f01156184ef68e8` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:13.091495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4dd2a-0421-4202-9b6d-e9d948f130a5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1d805e0eff2a412b8f01156184ef68e8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:13.093581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4dd2a-0421-4202-9b6d-e9d948f130a5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:13.235063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b0e4dd2a-0421-4202-9b6d-e9d948f130a5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d805e0eff2a412b8f01156184ef68e8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:13.241252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b0e4dd2a-0421-4202-9b6d-e9d948f130a5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d805e0eff2a412b8f01156184ef68e8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:13.247487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b0e4dd2a-0421-4202-9b6d-e9d948f130a5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d805e0eff2a412b8f01156184ef68e8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:13.264467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b0e4dd2a-0421-4202-9b6d-e9d948f130a5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d805e0eff2a412b8f01156184ef68e8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:13.352895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b0e4dd2a-0421-4202-9b6d-e9d948f130a5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d805e0eff2a412b8f01156184ef68e8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:13.360619 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2142/4306] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:12 2022] DELETE /identity/v3/users/1d805e0eff2a412b8f01156184ef68e8 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:13.365760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03702f2d-a343-4219-a296-47077c9be41f tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:13.367852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-03702f2d-a343-4219-a296-47077c9be41f tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:13.383641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03702f2d-a343-4219-a296-47077c9be41f tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:13.507934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f7790-6581-4400-b008-ad6c17d9dd30 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:13.509295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f7790-6581-4400-b008-ad6c17d9dd30 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:13.509589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f7790-6581-4400-b008-ad6c17d9dd30 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:13.510017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f7790-6581-4400-b008-ad6c17d9dd30 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/projects/ed79e87b2fa444cfb4c78f9be3f6742b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:13.512464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f7790-6581-4400-b008-ad6c17d9dd30 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ed79e87b2fa444cfb4c78f9be3f6742b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:13.514582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f7790-6581-4400-b008-ad6c17d9dd30 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:13.523456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:13.754194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1e0f7790-6581-4400-b008-ad6c17d9dd30 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed79e87b2fa444cfb4c78f9be3f6742b', 'request_id': 'req-1e0f7790-6581-4400-b008-ad6c17d9dd30'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:13.774748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1e0f7790-6581-4400-b008-ad6c17d9dd30 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed79e87b2fa444cfb4c78f9be3f6742b', 'request_id': 'req-1e0f7790-6581-4400-b008-ad6c17d9dd30'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:13.799341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1e0f7790-6581-4400-b008-ad6c17d9dd30 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed79e87b2fa444cfb4c78f9be3f6742b', 'request_id': 'req-1e0f7790-6581-4400-b008-ad6c17d9dd30'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:13.903079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1e0f7790-6581-4400-b008-ad6c17d9dd30 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] The token cache is being invalidate because project ed79e87b2fa444cfb4c78f9be3f6742b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:13.903598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1e0f7790-6581-4400-b008-ad6c17d9dd30 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:13.905630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1e0f7790-6581-4400-b008-ad6c17d9dd30 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:13.909272 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2165/4307] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:43:13 2022] DELETE /identity/v3/projects/ed79e87b2fa444cfb4c78f9be3f6742b => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:13.915368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4dd2a-0421-4202-9b6d-e9d948f130a5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:13.917672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b0e4dd2a-0421-4202-9b6d-e9d948f130a5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:13.935923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4dd2a-0421-4202-9b6d-e9d948f130a5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:14.058273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104fd3b-5daf-4f34-9783-a2b6531180b7 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:14.059280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104fd3b-5daf-4f34-9783-a2b6531180b7 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:14.059585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104fd3b-5daf-4f34-9783-a2b6531180b7 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:14.059869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104fd3b-5daf-4f34-9783-a2b6531180b7 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:14.060513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104fd3b-5daf-4f34-9783-a2b6531180b7 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:14.062609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104fd3b-5daf-4f34-9783-a2b6531180b7 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:14.186193 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2143/4308] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Oct 27 03:43:13 2022] POST /identity/v3/projects => generated 329 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:14.189661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f7790-6581-4400-b008-ad6c17d9dd30 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:14.193509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1e0f7790-6581-4400-b008-ad6c17d9dd30 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:14.230024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f7790-6581-4400-b008-ad6c17d9dd30 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:14.369465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab50b7-6233-4462-a4e4-96ae54160b3b tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:14.372947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab50b7-6233-4462-a4e4-96ae54160b3b tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:14.373285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab50b7-6233-4462-a4e4-96ae54160b3b tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:14.373574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab50b7-6233-4462-a4e4-96ae54160b3b tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:14.374298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab50b7-6233-4462-a4e4-96ae54160b3b tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:14.376265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab50b7-6233-4462-a4e4-96ae54160b3b tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:14.506326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebde9c9-fde0-4195-9adf-f8f88b3fc9d0 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:14.507231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebde9c9-fde0-4195-9adf-f8f88b3fc9d0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:14.507698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebde9c9-fde0-4195-9adf-f8f88b3fc9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:14.516294 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2166/4309] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:43:14 2022] POST /identity/v3/users => generated 413 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:14.517522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab50b7-6233-4462-a4e4-96ae54160b3b tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:14.534406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6ebde9c9-fde0-4195-9adf-f8f88b3fc9d0 None None] MFA Rules not processed for user `43172c9e71704c869a25181574d67b35`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:14.536340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6ebde9c9-fde0-4195-9adf-f8f88b3fc9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:14.540425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab50b7-6233-4462-a4e4-96ae54160b3b tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:14.561212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b64ac-c2fe-4b90-bfc8-1e8457aac9d0 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:14.561518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b64ac-c2fe-4b90-bfc8-1e8457aac9d0 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:14.561818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b64ac-c2fe-4b90-bfc8-1e8457aac9d0 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:14.562125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b64ac-c2fe-4b90-bfc8-1e8457aac9d0 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:14.562958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b64ac-c2fe-4b90-bfc8-1e8457aac9d0 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:14.564431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b64ac-c2fe-4b90-bfc8-1e8457aac9d0 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:14.667643 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2167/4310] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:43:14 2022] POST /identity/v3/roles => generated 244 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:14.672675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b64ac-c2fe-4b90-bfc8-1e8457aac9d0 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:14.697585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b64ac-c2fe-4b90-bfc8-1e8457aac9d0 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:14.708393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec51a75-d3fa-4850-8b67-d23ef335e8e3 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:14.709564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec51a75-d3fa-4850-8b67-d23ef335e8e3 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:14.709959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec51a75-d3fa-4850-8b67-d23ef335e8e3 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:14.710172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec51a75-d3fa-4850-8b67-d23ef335e8e3 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:14.710823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec51a75-d3fa-4850-8b67-d23ef335e8e3 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:14.714834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec51a75-d3fa-4850-8b67-d23ef335e8e3 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:14.732255 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2144/4311] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:14.813308 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2168/4312] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:43:14 2022] POST /identity/v3/roles => generated 246 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:14.817382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebde9c9-fde0-4195-9adf-f8f88b3fc9d0 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:14.840437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebde9c9-fde0-4195-9adf-f8f88b3fc9d0 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:14.845672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bc383-c914-4036-b47f-9797d62ee2a4 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:14.847264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bc383-c914-4036-b47f-9797d62ee2a4 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:14.847767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bc383-c914-4036-b47f-9797d62ee2a4 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:14.848239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bc383-c914-4036-b47f-9797d62ee2a4 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/projects/faa8e828244e4b428cac518f540b3de8/users/8ed1ea4812584242b6f16c3614844e57/roles/080980e3e0f2476888b21d866f3e13c0` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:14.882290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bc383-c914-4036-b47f-9797d62ee2a4 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_grant(project_id=faa8e828244e4b428cac518f540b3de8, user_id=8ed1ea4812584242b6f16c3614844e57, role_id=080980e3e0f2476888b21d866f3e13c0)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:14.887018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bc383-c914-4036-b47f-9797d62ee2a4 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:14.985882 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2145/4313] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:43:14 2022] PUT /identity/v3/projects/faa8e828244e4b428cac518f540b3de8/users/8ed1ea4812584242b6f16c3614844e57/roles/080980e3e0f2476888b21d866f3e13c0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:14.990690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec51a75-d3fa-4850-8b67-d23ef335e8e3 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:15.007684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec51a75-d3fa-4850-8b67-d23ef335e8e3 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:15.089671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95908b5-e7a8-4e83-930e-923d132884f1 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:15.090737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95908b5-e7a8-4e83-930e-923d132884f1 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:15.091208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95908b5-e7a8-4e83-930e-923d132884f1 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:15.091653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95908b5-e7a8-4e83-930e-923d132884f1 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/projects/faa8e828244e4b428cac518f540b3de8/users/8ed1ea4812584242b6f16c3614844e57/roles/b94ecdb0e38645f9aa70ea450429844b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:15.095544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95908b5-e7a8-4e83-930e-923d132884f1 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_grant(project_id=faa8e828244e4b428cac518f540b3de8, user_id=8ed1ea4812584242b6f16c3614844e57, role_id=b94ecdb0e38645f9aa70ea450429844b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:15.114387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95908b5-e7a8-4e83-930e-923d132884f1 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:15.203140 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2169/4314] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:43:14 2022] PUT /identity/v3/projects/faa8e828244e4b428cac518f540b3de8/users/8ed1ea4812584242b6f16c3614844e57/roles/b94ecdb0e38645f9aa70ea450429844b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:43:15.203835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bc383-c914-4036-b47f-9797d62ee2a4 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:15.219956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bc383-c914-4036-b47f-9797d62ee2a4 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:15.317984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb613376-17d7-42f3-bf28-067aad6143a7 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:15.319448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb613376-17d7-42f3-bf28-067aad6143a7 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:15.319834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb613376-17d7-42f3-bf28-067aad6143a7 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:15.320282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb613376-17d7-42f3-bf28-067aad6143a7 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:15.321026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb613376-17d7-42f3-bf28-067aad6143a7 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:15.323153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb613376-17d7-42f3-bf28-067aad6143a7 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:15.358641 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2146/4315] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:15 2022] GET /identity/v3/users => generated 8348 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:15.362747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d28f4e-365a-41b1-b6a2-d133cd958c3e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:15.363041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d28f4e-365a-41b1-b6a2-d133cd958c3e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:15.364604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d28f4e-365a-41b1-b6a2-d133cd958c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:15.419845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-12d28f4e-365a-41b1-b6a2-d133cd958c3e None None] MFA Rules not processed for user `8ed1ea4812584242b6f16c3614844e57`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:15.421380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-12d28f4e-365a-41b1-b6a2-d133cd958c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:15.499192 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2170/4316] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:15 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:15.509722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb02d9-7a7f-4b24-9d8c-008499b1a759 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:15.510239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb02d9-7a7f-4b24-9d8c-008499b1a759 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:15.510336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb02d9-7a7f-4b24-9d8c-008499b1a759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:15.548805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-dddb02d9-7a7f-4b24-9d8c-008499b1a759 None None] MFA Rules not processed for user `8ed1ea4812584242b6f16c3614844e57`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:15.551452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dddb02d9-7a7f-4b24-9d8c-008499b1a759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:15.566397 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2147/4317] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:15 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:15.567403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d28f4e-365a-41b1-b6a2-d133cd958c3e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:15.577830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d28f4e-365a-41b1-b6a2-d133cd958c3e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:15.590709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2c4c5-c96f-43cc-8fbd-15cea68afc3f tempest-TrustsV3TestJSON-1986928970 tempest-user-655357359] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ed1ea4812584242b6f16c3614844e57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faa8e828244e4b428cac518f540b3de8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1489061904', 'tempest-NotDelegatedRole-282718405'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:15.591988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2c4c5-c96f-43cc-8fbd-15cea68afc3f tempest-TrustsV3TestJSON-1986928970 tempest-user-655357359] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:15.592557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2c4c5-c96f-43cc-8fbd-15cea68afc3f tempest-TrustsV3TestJSON-1986928970 tempest-user-655357359] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:15.593152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2c4c5-c96f-43cc-8fbd-15cea68afc3f tempest-TrustsV3TestJSON-1986928970 tempest-user-655357359] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:15.594146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2c4c5-c96f-43cc-8fbd-15cea68afc3f tempest-TrustsV3TestJSON-1986928970 tempest-user-655357359] RBAC: Authorizing `identity:create_trust()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:15.595735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2c4c5-c96f-43cc-8fbd-15cea68afc3f tempest-TrustsV3TestJSON-1986928970 tempest-user-655357359] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:15.713090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-2fa2c4c5-c96f-43cc-8fbd-15cea68afc3f tempest-TrustsV3TestJSON-1986928970 tempest-user-655357359] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 27 03:43:15.713090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:43:15.713090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Oct 27 03:43:15.713090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Oct 27 03:43:15.713090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Oct 27 03:43:15.713090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Oct 27 03:43:15.713090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Oct 27 03:43:15.713090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:43:15.713090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:43:15.713090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:43:15.713090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:43:15.713090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Oct 27 03:43:15.713090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Oct 27 03:43:15.713090 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Oct 27 03:43:15.714212 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise ValueError(str(e)) Oct 27 03:43:15.714212 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Oct 27 03:43:15.714212 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:43:15.714212 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:43:15.714212 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:43:15.714212 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:43:15.714212 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:43:15.714212 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:43:15.714212 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:43:15.714212 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:43:15.714212 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:43:15.714212 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:43:15.714212 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:43:15.714212 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:43:15.714212 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:43:15.714212 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:43:15.714212 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Oct 27 03:43:15.714212 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Oct 27 03:43:15.719158 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Oct 27 03:43:15.719158 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Oct 27 03:43:15.719158 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Oct 27 03:43:15.719158 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Oct 27 03:43:15.719158 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 27 03:43:15.719158 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:43:15.719158 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2171/4318] 10.222.0.20 () {60 vars in 1174 bytes} [Thu Oct 27 03:43:15 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 148 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 27 03:43:15.725070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb02d9-7a7f-4b24-9d8c-008499b1a759 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:15.735268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:15.752030 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb02d9-7a7f-4b24-9d8c-008499b1a759 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:15.758257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ed0d2-99ec-479b-842c-e96f8250363a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:15.758923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ed0d2-99ec-479b-842c-e96f8250363a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:15.759212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ed0d2-99ec-479b-842c-e96f8250363a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:15.759491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ed0d2-99ec-479b-842c-e96f8250363a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/roles/b94ecdb0e38645f9aa70ea450429844b` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:15.761010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ed0d2-99ec-479b-842c-e96f8250363a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b94ecdb0e38645f9aa70ea450429844b)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:15.769933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ed0d2-99ec-479b-842c-e96f8250363a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:16.048708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-015ed0d2-99ec-479b-842c-e96f8250363a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invalidating the token cache because role b94ecdb0e38645f9aa70ea450429844b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:16.049018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-015ed0d2-99ec-479b-842c-e96f8250363a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:16.050013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-015ed0d2-99ec-479b-842c-e96f8250363a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:16.054529 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2148/4319] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:15 2022] DELETE /identity/v3/roles/b94ecdb0e38645f9aa70ea450429844b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:16.059171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2c4c5-c96f-43cc-8fbd-15cea68afc3f tempest-TrustsV3TestJSON-1986928970 tempest-user-655357359] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:16.061548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2fa2c4c5-c96f-43cc-8fbd-15cea68afc3f tempest-TrustsV3TestJSON-1986928970 tempest-user-655357359] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:16.090894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2c4c5-c96f-43cc-8fbd-15cea68afc3f tempest-TrustsV3TestJSON-1986928970 tempest-user-655357359] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:16.262169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e159ed-a1bc-4c0e-b045-2ff4aab8b91e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:16.264158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e159ed-a1bc-4c0e-b045-2ff4aab8b91e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:16.264158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e159ed-a1bc-4c0e-b045-2ff4aab8b91e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:16.264158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e159ed-a1bc-4c0e-b045-2ff4aab8b91e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/roles/080980e3e0f2476888b21d866f3e13c0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:16.265173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e159ed-a1bc-4c0e-b045-2ff4aab8b91e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:delete_role(role_id=080980e3e0f2476888b21d866f3e13c0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:16.266856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e159ed-a1bc-4c0e-b045-2ff4aab8b91e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:16.446554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-47e159ed-a1bc-4c0e-b045-2ff4aab8b91e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invalidating the token cache because role 080980e3e0f2476888b21d866f3e13c0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:16.447113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-47e159ed-a1bc-4c0e-b045-2ff4aab8b91e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:16.449173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-47e159ed-a1bc-4c0e-b045-2ff4aab8b91e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:16.452088 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2172/4320] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:16 2022] DELETE /identity/v3/roles/080980e3e0f2476888b21d866f3e13c0 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:16.455991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ed0d2-99ec-479b-842c-e96f8250363a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:16.468290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ed0d2-99ec-479b-842c-e96f8250363a tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:16.554315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82af74e-0e66-44eb-b4de-17e30235509d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:16.555130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82af74e-0e66-44eb-b4de-17e30235509d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:16.555430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82af74e-0e66-44eb-b4de-17e30235509d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:16.555729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82af74e-0e66-44eb-b4de-17e30235509d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/users/8ed1ea4812584242b6f16c3614844e57` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:16.556937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82af74e-0e66-44eb-b4de-17e30235509d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8ed1ea4812584242b6f16c3614844e57)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:16.558930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82af74e-0e66-44eb-b4de-17e30235509d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:16.701056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a82af74e-0e66-44eb-b4de-17e30235509d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed1ea4812584242b6f16c3614844e57'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:16.701762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a82af74e-0e66-44eb-b4de-17e30235509d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed1ea4812584242b6f16c3614844e57'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:16.709728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a82af74e-0e66-44eb-b4de-17e30235509d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed1ea4812584242b6f16c3614844e57'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:16.722005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a82af74e-0e66-44eb-b4de-17e30235509d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed1ea4812584242b6f16c3614844e57'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:16.794767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a82af74e-0e66-44eb-b4de-17e30235509d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed1ea4812584242b6f16c3614844e57'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:16.804754 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2149/4321] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:16 2022] DELETE /identity/v3/users/8ed1ea4812584242b6f16c3614844e57 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:16.808714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e159ed-a1bc-4c0e-b045-2ff4aab8b91e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:16.810266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-47e159ed-a1bc-4c0e-b045-2ff4aab8b91e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:16.834656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e159ed-a1bc-4c0e-b045-2ff4aab8b91e tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:16.911065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18f472-5753-47f8-a831-d9ae7768e5bd tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:16.911834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18f472-5753-47f8-a831-d9ae7768e5bd tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:16.912627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18f472-5753-47f8-a831-d9ae7768e5bd tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:16.912907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18f472-5753-47f8-a831-d9ae7768e5bd tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/projects/faa8e828244e4b428cac518f540b3de8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:16.914171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18f472-5753-47f8-a831-d9ae7768e5bd tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:delete_project(project_id=faa8e828244e4b428cac518f540b3de8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:16.916498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18f472-5753-47f8-a831-d9ae7768e5bd tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:17.078575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ef18f472-5753-47f8-a831-d9ae7768e5bd tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faa8e828244e4b428cac518f540b3de8', 'request_id': 'req-ef18f472-5753-47f8-a831-d9ae7768e5bd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:17.093082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ef18f472-5753-47f8-a831-d9ae7768e5bd tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faa8e828244e4b428cac518f540b3de8', 'request_id': 'req-ef18f472-5753-47f8-a831-d9ae7768e5bd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:17.096933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ef18f472-5753-47f8-a831-d9ae7768e5bd tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faa8e828244e4b428cac518f540b3de8', 'request_id': 'req-ef18f472-5753-47f8-a831-d9ae7768e5bd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:17.248432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:17.260108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ef18f472-5753-47f8-a831-d9ae7768e5bd tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] The token cache is being invalidate because project faa8e828244e4b428cac518f540b3de8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:17.260438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ef18f472-5753-47f8-a831-d9ae7768e5bd tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:17.261187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ef18f472-5753-47f8-a831-d9ae7768e5bd tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:17.262828 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2173/4322] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:43:16 2022] DELETE /identity/v3/projects/faa8e828244e4b428cac518f540b3de8 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:43:17.268309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82af74e-0e66-44eb-b4de-17e30235509d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:17.269863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a82af74e-0e66-44eb-b4de-17e30235509d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:17.297568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82af74e-0e66-44eb-b4de-17e30235509d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:17.431295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a13a4-853b-457b-8423-92e2b327c948 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:17.432164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a13a4-853b-457b-8423-92e2b327c948 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:17.432482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a13a4-853b-457b-8423-92e2b327c948 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:17.432765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a13a4-853b-457b-8423-92e2b327c948 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:17.433412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a13a4-853b-457b-8423-92e2b327c948 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:17.435621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a13a4-853b-457b-8423-92e2b327c948 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:17.543355 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2150/4323] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Oct 27 03:43:17 2022] POST /identity/v3/projects => generated 326 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:17.547899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18f472-5753-47f8-a831-d9ae7768e5bd tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:17.550012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ef18f472-5753-47f8-a831-d9ae7768e5bd tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:17.578325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18f472-5753-47f8-a831-d9ae7768e5bd tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:17.711426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408c4a7-3337-4211-bb54-3c7d33e0ce3d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:17.711956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408c4a7-3337-4211-bb54-3c7d33e0ce3d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:17.712244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408c4a7-3337-4211-bb54-3c7d33e0ce3d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:17.712523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408c4a7-3337-4211-bb54-3c7d33e0ce3d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:17.715410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408c4a7-3337-4211-bb54-3c7d33e0ce3d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:17.723658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408c4a7-3337-4211-bb54-3c7d33e0ce3d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:17.852556 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2174/4324] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:43:17 2022] POST /identity/v3/users => generated 413 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:17.856584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a13a4-853b-457b-8423-92e2b327c948 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:17.883526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a13a4-853b-457b-8423-92e2b327c948 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:17.889772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58125d85-7ab7-431f-b508-1f9335b6f0bf tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:17.890733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58125d85-7ab7-431f-b508-1f9335b6f0bf tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:17.891173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58125d85-7ab7-431f-b508-1f9335b6f0bf tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:17.891799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58125d85-7ab7-431f-b508-1f9335b6f0bf tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:17.893250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58125d85-7ab7-431f-b508-1f9335b6f0bf tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:17.895100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58125d85-7ab7-431f-b508-1f9335b6f0bf tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:18.051066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408c4a7-3337-4211-bb54-3c7d33e0ce3d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:18.061394 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2151/4325] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:43:17 2022] POST /identity/v3/roles => generated 243 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:18.064155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408c4a7-3337-4211-bb54-3c7d33e0ce3d tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:18.087732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed7447-9f9d-44e6-9fc1-87a814f32236 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:18.088666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed7447-9f9d-44e6-9fc1-87a814f32236 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:18.089121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed7447-9f9d-44e6-9fc1-87a814f32236 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:18.089557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed7447-9f9d-44e6-9fc1-87a814f32236 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:18.092439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed7447-9f9d-44e6-9fc1-87a814f32236 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:18.094564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed7447-9f9d-44e6-9fc1-87a814f32236 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:18.222199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58125d85-7ab7-431f-b508-1f9335b6f0bf tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:18.223286 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2175/4326] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:43:18 2022] POST /identity/v3/roles => generated 247 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:43:18.239640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58125d85-7ab7-431f-b508-1f9335b6f0bf tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:18.253324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1afa6-ed28-45c8-a59e-87475296ac10 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:18.254359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1afa6-ed28-45c8-a59e-87475296ac10 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:18.254825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1afa6-ed28-45c8-a59e-87475296ac10 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:18.255283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1afa6-ed28-45c8-a59e-87475296ac10 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/projects/c2e8defd2b83467498b6cc1a2823adbe/users/d1be4b9ea37542bf9aaa8c67c9466061/roles/bcbc962cc1ec4e6ba6b5012980971b69` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:18.280135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1afa6-ed28-45c8-a59e-87475296ac10 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c2e8defd2b83467498b6cc1a2823adbe, user_id=d1be4b9ea37542bf9aaa8c67c9466061, role_id=bcbc962cc1ec4e6ba6b5012980971b69)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:18.283692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1afa6-ed28-45c8-a59e-87475296ac10 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:18.408703 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2152/4327] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:43:18 2022] PUT /identity/v3/projects/c2e8defd2b83467498b6cc1a2823adbe/users/d1be4b9ea37542bf9aaa8c67c9466061/roles/bcbc962cc1ec4e6ba6b5012980971b69 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:18.413396 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed7447-9f9d-44e6-9fc1-87a814f32236 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:18.428194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed7447-9f9d-44e6-9fc1-87a814f32236 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:18.528400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109b4b9-51ee-4dbf-a5ab-a59a02495653 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:18.529239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109b4b9-51ee-4dbf-a5ab-a59a02495653 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:18.534372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109b4b9-51ee-4dbf-a5ab-a59a02495653 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:18.534372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109b4b9-51ee-4dbf-a5ab-a59a02495653 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/projects/c2e8defd2b83467498b6cc1a2823adbe/users/d1be4b9ea37542bf9aaa8c67c9466061/roles/f3eb8d81e748442ab72c57662a6fc54e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:18.534372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109b4b9-51ee-4dbf-a5ab-a59a02495653 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c2e8defd2b83467498b6cc1a2823adbe, user_id=d1be4b9ea37542bf9aaa8c67c9466061, role_id=f3eb8d81e748442ab72c57662a6fc54e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:18.536168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109b4b9-51ee-4dbf-a5ab-a59a02495653 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:18.710730 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2176/4328] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:43:18 2022] PUT /identity/v3/projects/c2e8defd2b83467498b6cc1a2823adbe/users/d1be4b9ea37542bf9aaa8c67c9466061/roles/f3eb8d81e748442ab72c57662a6fc54e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:18.714642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1afa6-ed28-45c8-a59e-87475296ac10 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:18.730249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1afa6-ed28-45c8-a59e-87475296ac10 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:18.830518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3d567-bf00-4cb8-826a-2ae79904509c tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:18.832524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3d567-bf00-4cb8-826a-2ae79904509c tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:18.833241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3d567-bf00-4cb8-826a-2ae79904509c tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:18.834508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3d567-bf00-4cb8-826a-2ae79904509c tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:18.835485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3d567-bf00-4cb8-826a-2ae79904509c tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:18.838004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3d567-bf00-4cb8-826a-2ae79904509c tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:18.889180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905004b-ca24-43f5-9a0c-6822cec0922b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:18.889867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905004b-ca24-43f5-9a0c-6822cec0922b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:18.890422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905004b-ca24-43f5-9a0c-6822cec0922b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:18.895992 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2153/4329] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:18 2022] GET /identity/v3/users => generated 8348 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:18.986384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e905004b-ca24-43f5-9a0c-6822cec0922b None None] MFA Rules not processed for user `d1be4b9ea37542bf9aaa8c67c9466061`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:18.987703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e905004b-ca24-43f5-9a0c-6822cec0922b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:19.144408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460186b-6101-4fee-8b26-b27249b4914c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:19.147020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460186b-6101-4fee-8b26-b27249b4914c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:19.148753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460186b-6101-4fee-8b26-b27249b4914c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:19.160083 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2177/4330] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:18 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:43:19.205174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a460186b-6101-4fee-8b26-b27249b4914c None None] MFA Rules not processed for user `d1be4b9ea37542bf9aaa8c67c9466061`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:19.210966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a460186b-6101-4fee-8b26-b27249b4914c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:19.231327 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2154/4331] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:19 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:19.247481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905004b-ca24-43f5-9a0c-6822cec0922b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:19.257229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460186b-6101-4fee-8b26-b27249b4914c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:19.257229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a460186b-6101-4fee-8b26-b27249b4914c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:19.266004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905004b-ca24-43f5-9a0c-6822cec0922b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:19.277775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d255c9-e15c-47f7-94a7-c7320daddb81 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1be4b9ea37542bf9aaa8c67c9466061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2e8defd2b83467498b6cc1a2823adbe', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1047659703', 'tempest-DelegatedRole-830378704'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:19.278439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d255c9-e15c-47f7-94a7-c7320daddb81 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:19.278726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d255c9-e15c-47f7-94a7-c7320daddb81 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:19.279003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d255c9-e15c-47f7-94a7-c7320daddb81 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:19.279699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d255c9-e15c-47f7-94a7-c7320daddb81 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: Authorizing `identity:create_trust()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:19.280869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d255c9-e15c-47f7-94a7-c7320daddb81 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:19.423422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460186b-6101-4fee-8b26-b27249b4914c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:19.428373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e5fa8-254e-44aa-8254-c5268e7cf628 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:19.429029 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e5fa8-254e-44aa-8254-c5268e7cf628 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:19.429374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e5fa8-254e-44aa-8254-c5268e7cf628 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:19.429654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e5fa8-254e-44aa-8254-c5268e7cf628 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:19.431575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5d4e5fa8-254e-44aa-8254-c5268e7cf628 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:19.581343 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2178/4332] 10.222.0.20 () {60 vars in 1174 bytes} [Thu Oct 27 03:43:19 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:19.588673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d255c9-e15c-47f7-94a7-c7320daddb81 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:19.613398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d255c9-e15c-47f7-94a7-c7320daddb81 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:19.620782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785d9b4-168e-4c30-a8a5-8270321c8300 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1be4b9ea37542bf9aaa8c67c9466061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2e8defd2b83467498b6cc1a2823adbe', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1047659703', 'tempest-DelegatedRole-830378704'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:19.621564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785d9b4-168e-4c30-a8a5-8270321c8300 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:19.621920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785d9b4-168e-4c30-a8a5-8270321c8300 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:19.622343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785d9b4-168e-4c30-a8a5-8270321c8300 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] PATH_INFO: `/v3/OS-TRUST/trusts/5cdf7762903f4d72ba6ad9b2509031eb` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:19.627646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e5fa8-254e-44aa-8254-c5268e7cf628 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:19.629476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e5fa8-254e-44aa-8254-c5268e7cf628 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:19.630808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785d9b4-168e-4c30-a8a5-8270321c8300 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: Authorizing `identity:get_trust(trust_id=5cdf7762903f4d72ba6ad9b2509031eb)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:19.632868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785d9b4-168e-4c30-a8a5-8270321c8300 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:19.656266 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2155/4333] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:43:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:43:19.657239 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2179/4334] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:43:19 2022] GET /identity/v3/OS-TRUST/trusts/5cdf7762903f4d72ba6ad9b2509031eb => generated 833 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:43:19.657367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e5fa8-254e-44aa-8254-c5268e7cf628 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:19.684470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e5fa8-254e-44aa-8254-c5268e7cf628 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:19.695613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550acb6-b8ef-449c-b01d-8f3fd91a0c43 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1be4b9ea37542bf9aaa8c67c9466061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2e8defd2b83467498b6cc1a2823adbe', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1047659703', 'tempest-DelegatedRole-830378704'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:19.696560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550acb6-b8ef-449c-b01d-8f3fd91a0c43 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:19.697034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550acb6-b8ef-449c-b01d-8f3fd91a0c43 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:19.697481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550acb6-b8ef-449c-b01d-8f3fd91a0c43 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] PATH_INFO: `/v3/OS-TRUST/trusts/5cdf7762903f4d72ba6ad9b2509031eb/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:19.707049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550acb6-b8ef-449c-b01d-8f3fd91a0c43 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=5cdf7762903f4d72ba6ad9b2509031eb)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:19.712248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550acb6-b8ef-449c-b01d-8f3fd91a0c43 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:19.722991 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2156/4335] 10.222.0.20 () {58 vars in 1269 bytes} [Thu Oct 27 03:43:19 2022] GET /identity/v3/OS-TRUST/trusts/5cdf7762903f4d72ba6ad9b2509031eb/roles => generated 370 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:43:19.726669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785d9b4-168e-4c30-a8a5-8270321c8300 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:19.738085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785d9b4-168e-4c30-a8a5-8270321c8300 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:19.746936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85a975-07e4-4473-946c-aaa491ca67e1 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1be4b9ea37542bf9aaa8c67c9466061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2e8defd2b83467498b6cc1a2823adbe', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1047659703', 'tempest-DelegatedRole-830378704'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:19.747848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85a975-07e4-4473-946c-aaa491ca67e1 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:19.748345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85a975-07e4-4473-946c-aaa491ca67e1 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:19.748789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85a975-07e4-4473-946c-aaa491ca67e1 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] PATH_INFO: `/v3/OS-TRUST/trusts/5cdf7762903f4d72ba6ad9b2509031eb/roles/bcbc962cc1ec4e6ba6b5012980971b69` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:19.758348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85a975-07e4-4473-946c-aaa491ca67e1 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: Authorizing `identity:get_role_for_trust(trust_id=5cdf7762903f4d72ba6ad9b2509031eb, role_id=bcbc962cc1ec4e6ba6b5012980971b69)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:19.760172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85a975-07e4-4473-946c-aaa491ca67e1 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:19.773349 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2180/4336] 10.222.0.20 () {58 vars in 1368 bytes} [Thu Oct 27 03:43:19 2022] GET /identity/v3/OS-TRUST/trusts/5cdf7762903f4d72ba6ad9b2509031eb/roles/bcbc962cc1ec4e6ba6b5012980971b69 => generated 243 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:43:19.774008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550acb6-b8ef-449c-b01d-8f3fd91a0c43 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:19.786009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550acb6-b8ef-449c-b01d-8f3fd91a0c43 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:19.797405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cc8db-3609-4a47-8b96-b0663db4b57b tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1be4b9ea37542bf9aaa8c67c9466061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2e8defd2b83467498b6cc1a2823adbe', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1047659703', 'tempest-DelegatedRole-830378704'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:19.801733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cc8db-3609-4a47-8b96-b0663db4b57b tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] REQUEST_METHOD: `HEAD` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:19.801733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cc8db-3609-4a47-8b96-b0663db4b57b tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:19.801733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cc8db-3609-4a47-8b96-b0663db4b57b tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] PATH_INFO: `/v3/OS-TRUST/trusts/5cdf7762903f4d72ba6ad9b2509031eb/roles/bcbc962cc1ec4e6ba6b5012980971b69` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:19.823110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937cc8db-3609-4a47-8b96-b0663db4b57b tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: Authorizing `identity:get_role_for_trust(trust_id=5cdf7762903f4d72ba6ad9b2509031eb, role_id=bcbc962cc1ec4e6ba6b5012980971b69)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:19.825258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937cc8db-3609-4a47-8b96-b0663db4b57b tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:19.836346 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2157/4337] 10.222.0.20 () {58 vars in 1369 bytes} [Thu Oct 27 03:43:19 2022] HEAD /identity/v3/OS-TRUST/trusts/5cdf7762903f4d72ba6ad9b2509031eb/roles/bcbc962cc1ec4e6ba6b5012980971b69 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:43:19.840517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85a975-07e4-4473-946c-aaa491ca67e1 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:19.855571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85a975-07e4-4473-946c-aaa491ca67e1 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:19.860738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a44356-320c-4aae-a7f3-9aa3e5a17467 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1be4b9ea37542bf9aaa8c67c9466061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2e8defd2b83467498b6cc1a2823adbe', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1047659703', 'tempest-DelegatedRole-830378704'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:19.861654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a44356-320c-4aae-a7f3-9aa3e5a17467 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:19.862189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a44356-320c-4aae-a7f3-9aa3e5a17467 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:19.862641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a44356-320c-4aae-a7f3-9aa3e5a17467 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] PATH_INFO: `/v3/OS-TRUST/trusts/5cdf7762903f4d72ba6ad9b2509031eb/roles/f3eb8d81e748442ab72c57662a6fc54e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:19.873996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a44356-320c-4aae-a7f3-9aa3e5a17467 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: Authorizing `identity:get_role_for_trust(trust_id=5cdf7762903f4d72ba6ad9b2509031eb, role_id=f3eb8d81e748442ab72c57662a6fc54e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:19.877126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a44356-320c-4aae-a7f3-9aa3e5a17467 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:19.881619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:19.893258 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-77a44356-320c-4aae-a7f3-9aa3e5a17467 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Could not find role: f3eb8d81e748442ab72c57662a6fc54e.: keystone.exception.RoleNotFound: Could not find role: f3eb8d81e748442ab72c57662a6fc54e. Oct 27 03:43:19.893258 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:43:19.893258 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:43:19.893258 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:43:19.893258 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:43:19.893258 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:43:19.893258 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:43:19.893258 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:43:19.893258 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:43:19.893258 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:43:19.893258 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:43:19.893258 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:43:19.893258 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 27 03:43:19.893258 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:43:19.893258 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: f3eb8d81e748442ab72c57662a6fc54e. Oct 27 03:43:19.894548 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:43:19.900407 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2181/4338] 10.222.0.20 () {58 vars in 1368 bytes} [Thu Oct 27 03:43:19 2022] GET /identity/v3/OS-TRUST/trusts/5cdf7762903f4d72ba6ad9b2509031eb/roles/f3eb8d81e748442ab72c57662a6fc54e => generated 110 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:43:19.901041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cc8db-3609-4a47-8b96-b0663db4b57b tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:19.914299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cc8db-3609-4a47-8b96-b0663db4b57b tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:19.926570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779b2e4-bc67-48b4-bd68-86ae3f5673ca tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1be4b9ea37542bf9aaa8c67c9466061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2e8defd2b83467498b6cc1a2823adbe', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1047659703', 'tempest-DelegatedRole-830378704'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:19.927869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779b2e4-bc67-48b4-bd68-86ae3f5673ca tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] REQUEST_METHOD: `HEAD` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:19.928205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779b2e4-bc67-48b4-bd68-86ae3f5673ca tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:19.928517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779b2e4-bc67-48b4-bd68-86ae3f5673ca tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] PATH_INFO: `/v3/OS-TRUST/trusts/5cdf7762903f4d72ba6ad9b2509031eb/roles/f3eb8d81e748442ab72c57662a6fc54e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:19.942384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779b2e4-bc67-48b4-bd68-86ae3f5673ca tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: Authorizing `identity:get_role_for_trust(trust_id=5cdf7762903f4d72ba6ad9b2509031eb, role_id=f3eb8d81e748442ab72c57662a6fc54e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:19.944437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779b2e4-bc67-48b4-bd68-86ae3f5673ca tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:19.979201 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-b779b2e4-bc67-48b4-bd68-86ae3f5673ca tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Could not find role: f3eb8d81e748442ab72c57662a6fc54e.: keystone.exception.RoleNotFound: Could not find role: f3eb8d81e748442ab72c57662a6fc54e. Oct 27 03:43:19.979201 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:43:19.979201 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:43:19.979201 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:43:19.979201 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:43:19.979201 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:43:19.979201 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:43:19.979201 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:43:19.979201 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:43:19.979201 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:43:19.979201 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:43:19.979201 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:43:19.979201 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 27 03:43:19.979201 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:43:19.979201 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: f3eb8d81e748442ab72c57662a6fc54e. Oct 27 03:43:19.980485 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:43:19.998529 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2158/4339] 10.222.0.20 () {58 vars in 1369 bytes} [Thu Oct 27 03:43:19 2022] HEAD /identity/v3/OS-TRUST/trusts/5cdf7762903f4d72ba6ad9b2509031eb/roles/f3eb8d81e748442ab72c57662a6fc54e => generated 0 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 27 03:43:20.004150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a44356-320c-4aae-a7f3-9aa3e5a17467 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:20.029217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a44356-320c-4aae-a7f3-9aa3e5a17467 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:20.048923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924939f5-f391-485f-99a3-98448cec2c05 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1be4b9ea37542bf9aaa8c67c9466061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2e8defd2b83467498b6cc1a2823adbe', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1047659703', 'tempest-DelegatedRole-830378704'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:20.053826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924939f5-f391-485f-99a3-98448cec2c05 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:20.061355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924939f5-f391-485f-99a3-98448cec2c05 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:20.062018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924939f5-f391-485f-99a3-98448cec2c05 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] PATH_INFO: `/v3/OS-TRUST/trusts/5cdf7762903f4d72ba6ad9b2509031eb` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:20.080313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924939f5-f391-485f-99a3-98448cec2c05 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: Authorizing `identity:delete_trust(trust_id=5cdf7762903f4d72ba6ad9b2509031eb)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:20.082401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924939f5-f391-485f-99a3-98448cec2c05 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:20.344257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-924939f5-f391-485f-99a3-98448cec2c05 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '5cdf7762903f4d72ba6ad9b2509031eb', 'request_id': 'req-924939f5-f391-485f-99a3-98448cec2c05'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:20.348817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-924939f5-f391-485f-99a3-98448cec2c05 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '5cdf7762903f4d72ba6ad9b2509031eb', 'request_id': 'req-924939f5-f391-485f-99a3-98448cec2c05'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:20.348817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-924939f5-f391-485f-99a3-98448cec2c05 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '5cdf7762903f4d72ba6ad9b2509031eb', 'request_id': 'req-924939f5-f391-485f-99a3-98448cec2c05'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:20.368996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:20.390488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779b2e4-bc67-48b4-bd68-86ae3f5673ca tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:20.392511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b779b2e4-bc67-48b4-bd68-86ae3f5673ca tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:20.484427 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2182/4340] 10.222.0.20 () {58 vars in 1254 bytes} [Thu Oct 27 03:43:20 2022] DELETE /identity/v3/OS-TRUST/trusts/5cdf7762903f4d72ba6ad9b2509031eb => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:20.489699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924939f5-f391-485f-99a3-98448cec2c05 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:20.492449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-924939f5-f391-485f-99a3-98448cec2c05 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:20.527572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924939f5-f391-485f-99a3-98448cec2c05 tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:20.529853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779b2e4-bc67-48b4-bd68-86ae3f5673ca tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:20.536602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543a682-30e2-4022-8a87-79ff4d24f81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:20.537753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a682-30e2-4022-8a87-79ff4d24f81a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:20.538235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a682-30e2-4022-8a87-79ff4d24f81a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:20.538782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a682-30e2-4022-8a87-79ff4d24f81a admin admin] PATH_INFO: `/v3/users/82daefe001364499b2ee9eb7da2599be` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:20.540718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543a682-30e2-4022-8a87-79ff4d24f81a admin admin] RBAC: Authorizing `identity:delete_user(user_id=82daefe001364499b2ee9eb7da2599be)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:20.542045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0b107-760e-497b-9cc5-92c76d62731e tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1be4b9ea37542bf9aaa8c67c9466061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2e8defd2b83467498b6cc1a2823adbe', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1047659703', 'tempest-DelegatedRole-830378704'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:20.542715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0b107-760e-497b-9cc5-92c76d62731e tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:20.543014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0b107-760e-497b-9cc5-92c76d62731e tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:20.543292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0b107-760e-497b-9cc5-92c76d62731e tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] PATH_INFO: `/v3/OS-TRUST/trusts/5cdf7762903f4d72ba6ad9b2509031eb` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:20.545467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543a682-30e2-4022-8a87-79ff4d24f81a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:20.556385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-c3f0b107-760e-497b-9cc5-92c76d62731e tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Could not find trust: 5cdf7762903f4d72ba6ad9b2509031eb.: keystone.exception.TrustNotFound: Could not find trust: 5cdf7762903f4d72ba6ad9b2509031eb. Oct 27 03:43:20.556385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:43:20.556385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:43:20.556385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:43:20.556385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:43:20.556385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:43:20.556385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:43:20.556385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:43:20.556385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:43:20.556385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:43:20.556385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:43:20.556385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:43:20.556385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 27 03:43:20.556385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 27 03:43:20.556385 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 27 03:43:20.557611 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 27 03:43:20.557611 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 27 03:43:20.557611 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 27 03:43:20.557611 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 27 03:43:20.557611 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 27 03:43:20.557611 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:43:20.557611 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:43:20.557611 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 27 03:43:20.557611 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 27 03:43:20.557611 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 27 03:43:20.557611 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 27 03:43:20.557611 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 5cdf7762903f4d72ba6ad9b2509031eb. Oct 27 03:43:20.557611 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:43:20.564603 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2183/4341] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:43:20 2022] GET /identity/v3/OS-TRUST/trusts/5cdf7762903f4d72ba6ad9b2509031eb => generated 111 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 27 03:43:20.566614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0b107-760e-497b-9cc5-92c76d62731e tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:20.568777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c3f0b107-760e-497b-9cc5-92c76d62731e tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:20.592794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0b107-760e-497b-9cc5-92c76d62731e tempest-TrustsV3TestJSON-2585433 tempest-user-778690818] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:20.600574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91274afb-66eb-4d37-9718-00d2f3005bd5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:20.601675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91274afb-66eb-4d37-9718-00d2f3005bd5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:20.602375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91274afb-66eb-4d37-9718-00d2f3005bd5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:20.602872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91274afb-66eb-4d37-9718-00d2f3005bd5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/roles/f3eb8d81e748442ab72c57662a6fc54e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:20.604759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91274afb-66eb-4d37-9718-00d2f3005bd5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f3eb8d81e748442ab72c57662a6fc54e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:20.608009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91274afb-66eb-4d37-9718-00d2f3005bd5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:20.929055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9543a682-30e2-4022-8a87-79ff4d24f81a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82daefe001364499b2ee9eb7da2599be'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:20.930525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9543a682-30e2-4022-8a87-79ff4d24f81a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82daefe001364499b2ee9eb7da2599be'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:20.941423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9543a682-30e2-4022-8a87-79ff4d24f81a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82daefe001364499b2ee9eb7da2599be'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:20.960858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9543a682-30e2-4022-8a87-79ff4d24f81a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82daefe001364499b2ee9eb7da2599be'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:20.993148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-91274afb-66eb-4d37-9718-00d2f3005bd5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invalidating the token cache because role f3eb8d81e748442ab72c57662a6fc54e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:20.993713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-91274afb-66eb-4d37-9718-00d2f3005bd5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:20.994145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-91274afb-66eb-4d37-9718-00d2f3005bd5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:20.996144 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2184/4342] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:20 2022] DELETE /identity/v3/roles/f3eb8d81e748442ab72c57662a6fc54e => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:21.000372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91274afb-66eb-4d37-9718-00d2f3005bd5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:21.002202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-91274afb-66eb-4d37-9718-00d2f3005bd5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:21.041861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9543a682-30e2-4022-8a87-79ff4d24f81a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82daefe001364499b2ee9eb7da2599be'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:21.049167 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2159/4343] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:20 2022] DELETE /identity/v3/users/82daefe001364499b2ee9eb7da2599be => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:21.081876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91274afb-66eb-4d37-9718-00d2f3005bd5 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:21.152319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd702be-d9b3-40b1-9251-ddb89b71d3bf tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:21.153144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd702be-d9b3-40b1-9251-ddb89b71d3bf tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:21.153543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd702be-d9b3-40b1-9251-ddb89b71d3bf tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:21.153960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd702be-d9b3-40b1-9251-ddb89b71d3bf tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/roles/bcbc962cc1ec4e6ba6b5012980971b69` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:21.155941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd702be-d9b3-40b1-9251-ddb89b71d3bf tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bcbc962cc1ec4e6ba6b5012980971b69)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:21.157779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd702be-d9b3-40b1-9251-ddb89b71d3bf tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:21.386227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4bd702be-d9b3-40b1-9251-ddb89b71d3bf tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invalidating the token cache because role bcbc962cc1ec4e6ba6b5012980971b69 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:21.386529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4bd702be-d9b3-40b1-9251-ddb89b71d3bf tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:21.389009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4bd702be-d9b3-40b1-9251-ddb89b71d3bf tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:21.392974 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2185/4344] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:20 2022] DELETE /identity/v3/roles/bcbc962cc1ec4e6ba6b5012980971b69 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:21.393800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543a682-30e2-4022-8a87-79ff4d24f81a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:21.395396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9543a682-30e2-4022-8a87-79ff4d24f81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:21.419464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543a682-30e2-4022-8a87-79ff4d24f81a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:21.420576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd702be-d9b3-40b1-9251-ddb89b71d3bf tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:21.422398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4bd702be-d9b3-40b1-9251-ddb89b71d3bf tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:21.521739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a3fda-7ef6-4d55-bdb1-4618e04d09df tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:21.522642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a3fda-7ef6-4d55-bdb1-4618e04d09df tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:21.522931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a3fda-7ef6-4d55-bdb1-4618e04d09df tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:21.526776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a3fda-7ef6-4d55-bdb1-4618e04d09df tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/users/d1be4b9ea37542bf9aaa8c67c9466061` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:21.526776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a3fda-7ef6-4d55-bdb1-4618e04d09df tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d1be4b9ea37542bf9aaa8c67c9466061)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:21.527163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a3fda-7ef6-4d55-bdb1-4618e04d09df tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:21.571083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd702be-d9b3-40b1-9251-ddb89b71d3bf tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:21.581196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b33ff-2a78-48ea-83cd-13a8e31fb449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:21.582017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b33ff-2a78-48ea-83cd-13a8e31fb449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:21.582379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b33ff-2a78-48ea-83cd-13a8e31fb449 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:21.582759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b33ff-2a78-48ea-83cd-13a8e31fb449 admin admin] PATH_INFO: `/v3/projects/98617e3a5b6c449c88449c236a8f2ecf` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:21.584855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b33ff-2a78-48ea-83cd-13a8e31fb449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98617e3a5b6c449c88449c236a8f2ecf)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:21.587424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b33ff-2a78-48ea-83cd-13a8e31fb449 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:21.638376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-648a3fda-7ef6-4d55-bdb1-4618e04d09df tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1be4b9ea37542bf9aaa8c67c9466061'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:21.639044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-648a3fda-7ef6-4d55-bdb1-4618e04d09df tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1be4b9ea37542bf9aaa8c67c9466061'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:21.646604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-648a3fda-7ef6-4d55-bdb1-4618e04d09df tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1be4b9ea37542bf9aaa8c67c9466061'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:21.659062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-648a3fda-7ef6-4d55-bdb1-4618e04d09df tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1be4b9ea37542bf9aaa8c67c9466061'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:21.704864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6f1b33ff-2a78-48ea-83cd-13a8e31fb449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98617e3a5b6c449c88449c236a8f2ecf', 'request_id': 'req-6f1b33ff-2a78-48ea-83cd-13a8e31fb449'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:21.711517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6f1b33ff-2a78-48ea-83cd-13a8e31fb449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98617e3a5b6c449c88449c236a8f2ecf', 'request_id': 'req-6f1b33ff-2a78-48ea-83cd-13a8e31fb449'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:21.716936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6f1b33ff-2a78-48ea-83cd-13a8e31fb449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98617e3a5b6c449c88449c236a8f2ecf', 'request_id': 'req-6f1b33ff-2a78-48ea-83cd-13a8e31fb449'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:21.750879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-648a3fda-7ef6-4d55-bdb1-4618e04d09df tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1be4b9ea37542bf9aaa8c67c9466061'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:21.760193 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2160/4345] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:21 2022] DELETE /identity/v3/users/d1be4b9ea37542bf9aaa8c67c9466061 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:21.764292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a3fda-7ef6-4d55-bdb1-4618e04d09df tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:21.765703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-648a3fda-7ef6-4d55-bdb1-4618e04d09df tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:21.830312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6f1b33ff-2a78-48ea-83cd-13a8e31fb449 admin admin] The token cache is being invalidate because project 98617e3a5b6c449c88449c236a8f2ecf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:21.830612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6f1b33ff-2a78-48ea-83cd-13a8e31fb449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:21.830731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a3fda-7ef6-4d55-bdb1-4618e04d09df tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:21.831260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6f1b33ff-2a78-48ea-83cd-13a8e31fb449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:21.836804 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2186/4346] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:43:21 2022] DELETE /identity/v3/projects/98617e3a5b6c449c88449c236a8f2ecf => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:43:21.836965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b034d-da46-40a6-910c-ead5fe2aff34 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:21.836965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b034d-da46-40a6-910c-ead5fe2aff34 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:21.836965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b034d-da46-40a6-910c-ead5fe2aff34 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:21.837237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b034d-da46-40a6-910c-ead5fe2aff34 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/projects/c2e8defd2b83467498b6cc1a2823adbe` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:21.838073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b034d-da46-40a6-910c-ead5fe2aff34 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c2e8defd2b83467498b6cc1a2823adbe)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:21.838878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19929e7-3f30-42a0-aca1-5b46819c36ed None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:21.839331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19929e7-3f30-42a0-aca1-5b46819c36ed None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:21.839877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19929e7-3f30-42a0-aca1-5b46819c36ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:21.839995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b034d-da46-40a6-910c-ead5fe2aff34 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:21.879869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f19929e7-3f30-42a0-aca1-5b46819c36ed None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:21.882005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f19929e7-3f30-42a0-aca1-5b46819c36ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:21.980905 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2187/4347] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:21.993528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45339d-37ae-4ebd-8cfb-00f3d63b45ca None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:21.994263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45339d-37ae-4ebd-8cfb-00f3d63b45ca None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:21.994263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45339d-37ae-4ebd-8cfb-00f3d63b45ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:22.016094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9b45339d-37ae-4ebd-8cfb-00f3d63b45ca None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:22.017688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9b45339d-37ae-4ebd-8cfb-00f3d63b45ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:22.064788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e00b034d-da46-40a6-910c-ead5fe2aff34 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2e8defd2b83467498b6cc1a2823adbe', 'request_id': 'req-e00b034d-da46-40a6-910c-ead5fe2aff34'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:22.135216 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2188/4348] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:22.137571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45339d-37ae-4ebd-8cfb-00f3d63b45ca None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:22.151146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e00b034d-da46-40a6-910c-ead5fe2aff34 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2e8defd2b83467498b6cc1a2823adbe', 'request_id': 'req-e00b034d-da46-40a6-910c-ead5fe2aff34'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:22.159080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e00b034d-da46-40a6-910c-ead5fe2aff34 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2e8defd2b83467498b6cc1a2823adbe', 'request_id': 'req-e00b034d-da46-40a6-910c-ead5fe2aff34'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:22.171246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45339d-37ae-4ebd-8cfb-00f3d63b45ca None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:22.185919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900378d-bc44-406c-aa5d-292ebee8c960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:22.190156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900378d-bc44-406c-aa5d-292ebee8c960 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:22.190156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900378d-bc44-406c-aa5d-292ebee8c960 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:22.190156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900378d-bc44-406c-aa5d-292ebee8c960 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:22.191284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e00b034d-da46-40a6-910c-ead5fe2aff34 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] The token cache is being invalidate because project c2e8defd2b83467498b6cc1a2823adbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:22.191446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900378d-bc44-406c-aa5d-292ebee8c960 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:43:22.191673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900378d-bc44-406c-aa5d-292ebee8c960 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:22.192058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e00b034d-da46-40a6-910c-ead5fe2aff34 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:22.194448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e00b034d-da46-40a6-910c-ead5fe2aff34 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:22.196290 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2161/4349] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:43:21 2022] DELETE /identity/v3/projects/c2e8defd2b83467498b6cc1a2823adbe => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:43:22.210756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b034d-da46-40a6-910c-ead5fe2aff34 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:22.212819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e00b034d-da46-40a6-910c-ead5fe2aff34 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:22.214400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900378d-bc44-406c-aa5d-292ebee8c960 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:22.233407 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2189/4350] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:43:22.238666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900378d-bc44-406c-aa5d-292ebee8c960 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:22.240545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c900378d-bc44-406c-aa5d-292ebee8c960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:22.275070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900378d-bc44-406c-aa5d-292ebee8c960 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:22.281472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c1936-9987-415d-be76-3446bada079d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:22.282126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c1936-9987-415d-be76-3446bada079d admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:22.282410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c1936-9987-415d-be76-3446bada079d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:22.283418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c1936-9987-415d-be76-3446bada079d admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:22.284078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c1936-9987-415d-be76-3446bada079d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:22.286339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c1936-9987-415d-be76-3446bada079d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:22.358170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b034d-da46-40a6-910c-ead5fe2aff34 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:22.363819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f285f-a495-4c9c-9fd4-b95515362c50 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:22.365095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f285f-a495-4c9c-9fd4-b95515362c50 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:22.365396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f285f-a495-4c9c-9fd4-b95515362c50 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:22.365681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f285f-a495-4c9c-9fd4-b95515362c50 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:22.367569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f285f-a495-4c9c-9fd4-b95515362c50 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:22.370494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f285f-a495-4c9c-9fd4-b95515362c50 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:22.415054 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2190/4351] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:43:22 2022] POST /identity/v3/projects => generated 393 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:22.418542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c1936-9987-415d-be76-3446bada079d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:22.487504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c1936-9987-415d-be76-3446bada079d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:22.494598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a4439-16d1-4ab0-8178-db4dd7ab3be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:22.495154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a4439-16d1-4ab0-8178-db4dd7ab3be6 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:22.497648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a4439-16d1-4ab0-8178-db4dd7ab3be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:22.497648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a4439-16d1-4ab0-8178-db4dd7ab3be6 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:22.497648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a4439-16d1-4ab0-8178-db4dd7ab3be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:22.498411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a4439-16d1-4ab0-8178-db4dd7ab3be6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:22.506088 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2162/4352] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Oct 27 03:43:22 2022] POST /identity/v3/projects => generated 329 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:43:22.507330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f285f-a495-4c9c-9fd4-b95515362c50 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:22.516765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:22.603767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f285f-a495-4c9c-9fd4-b95515362c50 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:22.605438 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2191/4353] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:43:22 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:22.606629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a4439-16d1-4ab0-8178-db4dd7ab3be6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:22.610816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fe240-70b0-4e1c-8555-5b47be14c884 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:22.611499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fe240-70b0-4e1c-8555-5b47be14c884 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:22.611787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fe240-70b0-4e1c-8555-5b47be14c884 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:22.612062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fe240-70b0-4e1c-8555-5b47be14c884 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:22.612810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02fe240-70b0-4e1c-8555-5b47be14c884 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:22.615131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02fe240-70b0-4e1c-8555-5b47be14c884 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:22.619543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a4439-16d1-4ab0-8178-db4dd7ab3be6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:22.705046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c46122-4383-4623-9b1b-8d59d855519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:22.705669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c46122-4383-4623-9b1b-8d59d855519a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:22.705956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c46122-4383-4623-9b1b-8d59d855519a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:22.706263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c46122-4383-4623-9b1b-8d59d855519a admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:22.706919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c46122-4383-4623-9b1b-8d59d855519a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:22.709116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c46122-4383-4623-9b1b-8d59d855519a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:22.721345 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2192/4354] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:22.729426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c46122-4383-4623-9b1b-8d59d855519a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:22.738660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c46122-4383-4623-9b1b-8d59d855519a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:22.751385 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2163/4355] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:43:22 2022] POST /identity/v3/users => generated 416 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:43:22.754424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef86fb9-33a2-40c9-8a50-7f1d89b21211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:22.755261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef86fb9-33a2-40c9-8a50-7f1d89b21211 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:22.756128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef86fb9-33a2-40c9-8a50-7f1d89b21211 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:22.759306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef86fb9-33a2-40c9-8a50-7f1d89b21211 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:22.759306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef86fb9-33a2-40c9-8a50-7f1d89b21211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:22.759306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef86fb9-33a2-40c9-8a50-7f1d89b21211 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:22.760735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fe240-70b0-4e1c-8555-5b47be14c884 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:22.776151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fe240-70b0-4e1c-8555-5b47be14c884 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:22.782524 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2193/4356] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:22.783763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0e343-b9d3-425d-91b4-7a1d2d713d35 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:22.784403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0e343-b9d3-425d-91b4-7a1d2d713d35 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:22.785373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0e343-b9d3-425d-91b4-7a1d2d713d35 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:22.785706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0e343-b9d3-425d-91b4-7a1d2d713d35 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:22.788592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0e343-b9d3-425d-91b4-7a1d2d713d35 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:22.789441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0e343-b9d3-425d-91b4-7a1d2d713d35 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:22.790452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef86fb9-33a2-40c9-8a50-7f1d89b21211 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:22.807967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef86fb9-33a2-40c9-8a50-7f1d89b21211 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:22.814926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbab11-f5eb-4ebc-b372-6fe8178b5314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:22.815860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbab11-f5eb-4ebc-b372-6fe8178b5314 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:22.816030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbab11-f5eb-4ebc-b372-6fe8178b5314 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:22.816419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbab11-f5eb-4ebc-b372-6fe8178b5314 admin admin] PATH_INFO: `/v3/projects/e4f0730b38a946759ea32c36f5876eb3/users/ae9ddb0e44024937865411a7d2c3d956/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:22.840311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbab11-f5eb-4ebc-b372-6fe8178b5314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4f0730b38a946759ea32c36f5876eb3, user_id=ae9ddb0e44024937865411a7d2c3d956, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:22.843397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbab11-f5eb-4ebc-b372-6fe8178b5314 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:22.879391 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2164/4357] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:43:22 2022] POST /identity/v3/roles => generated 243 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:22.884171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0e343-b9d3-425d-91b4-7a1d2d713d35 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:22.912965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0e343-b9d3-425d-91b4-7a1d2d713d35 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:22.947218 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2194/4358] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:43:22 2022] PUT /identity/v3/projects/e4f0730b38a946759ea32c36f5876eb3/users/ae9ddb0e44024937865411a7d2c3d956/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:22.948694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a8cdb-a930-4fda-b012-9c6615b706ac None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:22.948987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a8cdb-a930-4fda-b012-9c6615b706ac None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:22.949267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a8cdb-a930-4fda-b012-9c6615b706ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:22.953172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8f133-eafa-468a-8479-d27d3c259353 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:22.953826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8f133-eafa-468a-8479-d27d3c259353 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:22.954180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8f133-eafa-468a-8479-d27d3c259353 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:22.954963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8f133-eafa-468a-8479-d27d3c259353 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:22.955981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8f133-eafa-468a-8479-d27d3c259353 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:22.959830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8f133-eafa-468a-8479-d27d3c259353 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:22.992093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-5f5a8cdb-a930-4fda-b012-9c6615b706ac None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:22.993670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5f5a8cdb-a930-4fda-b012-9c6615b706ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:22.997148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:23.064038 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2165/4359] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:43:22 2022] POST /identity/v3/roles => generated 246 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:43:23.068183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8f133-eafa-468a-8479-d27d3c259353 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:23.086962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8f133-eafa-468a-8479-d27d3c259353 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:23.094010 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2195/4360] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:23.115740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a8cdb-a930-4fda-b012-9c6615b706ac None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:23.117657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5f5a8cdb-a930-4fda-b012-9c6615b706ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:23.176679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93216135-3e64-4172-bef5-eb9342be5478 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:23.177554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93216135-3e64-4172-bef5-eb9342be5478 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:23.178065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93216135-3e64-4172-bef5-eb9342be5478 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:23.178507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93216135-3e64-4172-bef5-eb9342be5478 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/projects/dd7f48b2023a4520bf1f7fbcfd3a533a/users/5960e62ec6934d9fb20210097679edd6/roles/6c3d55ce57034dd797cedccb214f9b6e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:23.214546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93216135-3e64-4172-bef5-eb9342be5478 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_grant(project_id=dd7f48b2023a4520bf1f7fbcfd3a533a, user_id=5960e62ec6934d9fb20210097679edd6, role_id=6c3d55ce57034dd797cedccb214f9b6e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:23.218184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93216135-3e64-4172-bef5-eb9342be5478 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:23.223259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a8cdb-a930-4fda-b012-9c6615b706ac None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:23.229310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fb8de-09ac-4f57-a46d-c1851b4fe6bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:23.230343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fb8de-09ac-4f57-a46d-c1851b4fe6bb service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:23.230530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fb8de-09ac-4f57-a46d-c1851b4fe6bb service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:23.230888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fb8de-09ac-4f57-a46d-c1851b4fe6bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:23.242632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fb8de-09ac-4f57-a46d-c1851b4fe6bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:23.244135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fb8de-09ac-4f57-a46d-c1851b4fe6bb service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:23.256766 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2196/4361] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:43:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:43:23.300830 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2166/4362] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:43:23 2022] PUT /identity/v3/projects/dd7f48b2023a4520bf1f7fbcfd3a533a/users/5960e62ec6934d9fb20210097679edd6/roles/6c3d55ce57034dd797cedccb214f9b6e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:23.305506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fb8de-09ac-4f57-a46d-c1851b4fe6bb service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:23.317117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fb8de-09ac-4f57-a46d-c1851b4fe6bb service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:23.430497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2a3f9-567c-4447-bc82-4d8bc8145785 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:23.431269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2a3f9-567c-4447-bc82-4d8bc8145785 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:23.431637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2a3f9-567c-4447-bc82-4d8bc8145785 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:23.431902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2a3f9-567c-4447-bc82-4d8bc8145785 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/projects/dd7f48b2023a4520bf1f7fbcfd3a533a/users/5960e62ec6934d9fb20210097679edd6/roles/54035e35113f41e79b7f5c2a2f8da12f` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:23.439708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2a3f9-567c-4447-bc82-4d8bc8145785 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:create_grant(project_id=dd7f48b2023a4520bf1f7fbcfd3a533a, user_id=5960e62ec6934d9fb20210097679edd6, role_id=54035e35113f41e79b7f5c2a2f8da12f)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:23.444930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2a3f9-567c-4447-bc82-4d8bc8145785 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:23.564142 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2197/4363] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:43:23 2022] PUT /identity/v3/projects/dd7f48b2023a4520bf1f7fbcfd3a533a/users/5960e62ec6934d9fb20210097679edd6/roles/54035e35113f41e79b7f5c2a2f8da12f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:23.568141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93216135-3e64-4172-bef5-eb9342be5478 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:23.586288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93216135-3e64-4172-bef5-eb9342be5478 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:23.714086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9f1ac-eddf-4057-ae24-1920f537c9ae tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:23.714788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9f1ac-eddf-4057-ae24-1920f537c9ae tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:23.715096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9f1ac-eddf-4057-ae24-1920f537c9ae tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:23.715371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9f1ac-eddf-4057-ae24-1920f537c9ae tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:23.716948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9f1ac-eddf-4057-ae24-1920f537c9ae tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:23.720669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9f1ac-eddf-4057-ae24-1920f537c9ae tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:23.772278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9329cf9-0cd6-4660-a81e-e0c07709f42a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:23.772649 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2167/4364] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:23 2022] GET /identity/v3/users => generated 8354 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:23.772879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9329cf9-0cd6-4660-a81e-e0c07709f42a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:23.773258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9329cf9-0cd6-4660-a81e-e0c07709f42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:23.855958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a9329cf9-0cd6-4660-a81e-e0c07709f42a None None] MFA Rules not processed for user `5960e62ec6934d9fb20210097679edd6`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:23.857902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a9329cf9-0cd6-4660-a81e-e0c07709f42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:23.944736 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2198/4365] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:23 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:23.954830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bfd03-def7-4b0b-9295-6f68107d64af None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:23.965617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bfd03-def7-4b0b-9295-6f68107d64af None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:23.965617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bfd03-def7-4b0b-9295-6f68107d64af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:24.014246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f30bfd03-def7-4b0b-9295-6f68107d64af None None] MFA Rules not processed for user `5960e62ec6934d9fb20210097679edd6`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:24.015923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f30bfd03-def7-4b0b-9295-6f68107d64af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:24.035429 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2168/4366] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:23 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:24.041458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9329cf9-0cd6-4660-a81e-e0c07709f42a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:24.057745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9329cf9-0cd6-4660-a81e-e0c07709f42a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:24.065681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a81347-f287-4b1e-b3fb-8745d505b4b6 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5960e62ec6934d9fb20210097679edd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd7f48b2023a4520bf1f7fbcfd3a533a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-999187960', 'tempest-NotDelegatedRole-593613118'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:24.066513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a81347-f287-4b1e-b3fb-8745d505b4b6 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:24.066929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a81347-f287-4b1e-b3fb-8745d505b4b6 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:24.067357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a81347-f287-4b1e-b3fb-8745d505b4b6 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:24.068901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a81347-f287-4b1e-b3fb-8745d505b4b6 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: Authorizing `identity:create_trust()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:24.070534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a81347-f287-4b1e-b3fb-8745d505b4b6 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:24.297914 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2199/4367] 10.222.0.20 () {60 vars in 1174 bytes} [Thu Oct 27 03:43:24 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:24.301807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bfd03-def7-4b0b-9295-6f68107d64af None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:24.322324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bfd03-def7-4b0b-9295-6f68107d64af None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:24.326690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fedf3-0513-4d1d-9359-ef814c10409e tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5960e62ec6934d9fb20210097679edd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd7f48b2023a4520bf1f7fbcfd3a533a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-999187960', 'tempest-NotDelegatedRole-593613118'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:24.327346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fedf3-0513-4d1d-9359-ef814c10409e tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:24.327623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fedf3-0513-4d1d-9359-ef814c10409e tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:24.327953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fedf3-0513-4d1d-9359-ef814c10409e tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] PATH_INFO: `/v3/OS-TRUST/trusts/bb49d0ef565341bc8b0418a68d3702d3` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:24.345848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4fedf3-0513-4d1d-9359-ef814c10409e tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: Authorizing `identity:get_trust(trust_id=bb49d0ef565341bc8b0418a68d3702d3)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:24.347366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4fedf3-0513-4d1d-9359-ef814c10409e tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:24.365390 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2169/4368] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:43:24 2022] GET /identity/v3/OS-TRUST/trusts/bb49d0ef565341bc8b0418a68d3702d3 => generated 834 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:43:24.369401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a81347-f287-4b1e-b3fb-8745d505b4b6 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:24.381544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a81347-f287-4b1e-b3fb-8745d505b4b6 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:24.384773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:24.394865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1101d0e-7c8e-4f15-8dd5-49fc7968e9c4 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5960e62ec6934d9fb20210097679edd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd7f48b2023a4520bf1f7fbcfd3a533a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-999187960', 'tempest-NotDelegatedRole-593613118'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:24.396951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1101d0e-7c8e-4f15-8dd5-49fc7968e9c4 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:24.397580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1101d0e-7c8e-4f15-8dd5-49fc7968e9c4 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:24.398127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1101d0e-7c8e-4f15-8dd5-49fc7968e9c4 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] PATH_INFO: `/v3/OS-TRUST/trusts/bb49d0ef565341bc8b0418a68d3702d3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:24.409147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1101d0e-7c8e-4f15-8dd5-49fc7968e9c4 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=bb49d0ef565341bc8b0418a68d3702d3)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:24.410693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1101d0e-7c8e-4f15-8dd5-49fc7968e9c4 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:24.429744 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2200/4369] 10.222.0.20 () {58 vars in 1269 bytes} [Thu Oct 27 03:43:24 2022] GET /identity/v3/OS-TRUST/trusts/bb49d0ef565341bc8b0418a68d3702d3/roles => generated 370 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:43:24.433976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fedf3-0513-4d1d-9359-ef814c10409e tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:24.446885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fedf3-0513-4d1d-9359-ef814c10409e tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:24.463491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41d7d8-b948-47dd-9ce1-a3ebd7aa8852 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5960e62ec6934d9fb20210097679edd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd7f48b2023a4520bf1f7fbcfd3a533a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-999187960', 'tempest-NotDelegatedRole-593613118'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:24.464171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41d7d8-b948-47dd-9ce1-a3ebd7aa8852 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:24.464470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41d7d8-b948-47dd-9ce1-a3ebd7aa8852 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:24.464747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41d7d8-b948-47dd-9ce1-a3ebd7aa8852 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] PATH_INFO: `/v3/OS-TRUST/trusts/bb49d0ef565341bc8b0418a68d3702d3/roles/6c3d55ce57034dd797cedccb214f9b6e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:24.473398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41d7d8-b948-47dd-9ce1-a3ebd7aa8852 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: Authorizing `identity:get_role_for_trust(trust_id=bb49d0ef565341bc8b0418a68d3702d3, role_id=6c3d55ce57034dd797cedccb214f9b6e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:24.475601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41d7d8-b948-47dd-9ce1-a3ebd7aa8852 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:24.485508 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2170/4370] 10.222.0.20 () {58 vars in 1368 bytes} [Thu Oct 27 03:43:24 2022] GET /identity/v3/OS-TRUST/trusts/bb49d0ef565341bc8b0418a68d3702d3/roles/6c3d55ce57034dd797cedccb214f9b6e => generated 243 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:43:24.497788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1101d0e-7c8e-4f15-8dd5-49fc7968e9c4 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:24.524672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1101d0e-7c8e-4f15-8dd5-49fc7968e9c4 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:24.548403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b4789-28eb-47c1-9cca-2dd5a6cd42db tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5960e62ec6934d9fb20210097679edd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd7f48b2023a4520bf1f7fbcfd3a533a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-999187960', 'tempest-NotDelegatedRole-593613118'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:24.549080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b4789-28eb-47c1-9cca-2dd5a6cd42db tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] REQUEST_METHOD: `HEAD` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:24.549361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b4789-28eb-47c1-9cca-2dd5a6cd42db tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:24.550619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b4789-28eb-47c1-9cca-2dd5a6cd42db tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] PATH_INFO: `/v3/OS-TRUST/trusts/bb49d0ef565341bc8b0418a68d3702d3/roles/6c3d55ce57034dd797cedccb214f9b6e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:24.567017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b4789-28eb-47c1-9cca-2dd5a6cd42db tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: Authorizing `identity:get_role_for_trust(trust_id=bb49d0ef565341bc8b0418a68d3702d3, role_id=6c3d55ce57034dd797cedccb214f9b6e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:24.569105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b4789-28eb-47c1-9cca-2dd5a6cd42db tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:24.585517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41d7d8-b948-47dd-9ce1-a3ebd7aa8852 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:24.587215 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2201/4371] 10.222.0.20 () {58 vars in 1369 bytes} [Thu Oct 27 03:43:24 2022] HEAD /identity/v3/OS-TRUST/trusts/bb49d0ef565341bc8b0418a68d3702d3/roles/6c3d55ce57034dd797cedccb214f9b6e => generated 0 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 27 03:43:24.600826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41d7d8-b948-47dd-9ce1-a3ebd7aa8852 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:24.613464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54727d97-3e80-415c-9816-ce24ad564c54 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5960e62ec6934d9fb20210097679edd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd7f48b2023a4520bf1f7fbcfd3a533a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-999187960', 'tempest-NotDelegatedRole-593613118'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:24.614503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54727d97-3e80-415c-9816-ce24ad564c54 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:24.615527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54727d97-3e80-415c-9816-ce24ad564c54 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:24.615981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54727d97-3e80-415c-9816-ce24ad564c54 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] PATH_INFO: `/v3/OS-TRUST/trusts/bb49d0ef565341bc8b0418a68d3702d3/roles/54035e35113f41e79b7f5c2a2f8da12f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:24.625665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:24.627041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54727d97-3e80-415c-9816-ce24ad564c54 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: Authorizing `identity:get_role_for_trust(trust_id=bb49d0ef565341bc8b0418a68d3702d3, role_id=54035e35113f41e79b7f5c2a2f8da12f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:24.632354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54727d97-3e80-415c-9816-ce24ad564c54 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:24.646716 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-54727d97-3e80-415c-9816-ce24ad564c54 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Could not find role: 54035e35113f41e79b7f5c2a2f8da12f.: keystone.exception.RoleNotFound: Could not find role: 54035e35113f41e79b7f5c2a2f8da12f. Oct 27 03:43:24.646716 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:43:24.646716 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:43:24.646716 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:43:24.646716 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:43:24.646716 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:43:24.646716 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:43:24.646716 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:43:24.646716 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:43:24.646716 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:43:24.646716 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:43:24.646716 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:43:24.646716 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 27 03:43:24.646716 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:43:24.646716 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 54035e35113f41e79b7f5c2a2f8da12f. Oct 27 03:43:24.647904 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:43:24.652681 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2171/4372] 10.222.0.20 () {58 vars in 1368 bytes} [Thu Oct 27 03:43:24 2022] GET /identity/v3/OS-TRUST/trusts/bb49d0ef565341bc8b0418a68d3702d3/roles/54035e35113f41e79b7f5c2a2f8da12f => generated 110 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:43:24.654175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b4789-28eb-47c1-9cca-2dd5a6cd42db tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:24.670896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b4789-28eb-47c1-9cca-2dd5a6cd42db tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:24.678210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fd212-a233-467d-98c9-bd0f00922ee1 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5960e62ec6934d9fb20210097679edd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd7f48b2023a4520bf1f7fbcfd3a533a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-999187960', 'tempest-NotDelegatedRole-593613118'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:24.678882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fd212-a233-467d-98c9-bd0f00922ee1 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] REQUEST_METHOD: `HEAD` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:24.679160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fd212-a233-467d-98c9-bd0f00922ee1 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:24.679438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fd212-a233-467d-98c9-bd0f00922ee1 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] PATH_INFO: `/v3/OS-TRUST/trusts/bb49d0ef565341bc8b0418a68d3702d3/roles/54035e35113f41e79b7f5c2a2f8da12f` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:24.686605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fd212-a233-467d-98c9-bd0f00922ee1 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: Authorizing `identity:get_role_for_trust(trust_id=bb49d0ef565341bc8b0418a68d3702d3, role_id=54035e35113f41e79b7f5c2a2f8da12f)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:24.688085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fd212-a233-467d-98c9-bd0f00922ee1 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:24.701134 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-659fd212-a233-467d-98c9-bd0f00922ee1 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Could not find role: 54035e35113f41e79b7f5c2a2f8da12f.: keystone.exception.RoleNotFound: Could not find role: 54035e35113f41e79b7f5c2a2f8da12f. Oct 27 03:43:24.701134 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:43:24.701134 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:43:24.701134 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:43:24.701134 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:43:24.701134 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:43:24.701134 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:43:24.701134 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:43:24.701134 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:43:24.701134 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:43:24.701134 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:43:24.701134 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:43:24.701134 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 27 03:43:24.701134 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:43:24.701134 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 54035e35113f41e79b7f5c2a2f8da12f. Oct 27 03:43:24.702360 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:43:24.705247 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2202/4373] 10.222.0.20 () {58 vars in 1369 bytes} [Thu Oct 27 03:43:24 2022] HEAD /identity/v3/OS-TRUST/trusts/bb49d0ef565341bc8b0418a68d3702d3/roles/54035e35113f41e79b7f5c2a2f8da12f => generated 0 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 27 03:43:24.706313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54727d97-3e80-415c-9816-ce24ad564c54 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:24.726273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54727d97-3e80-415c-9816-ce24ad564c54 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:24.737654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdca67-d7f8-460c-89f0-67f9b0ea0691 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5960e62ec6934d9fb20210097679edd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd7f48b2023a4520bf1f7fbcfd3a533a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-999187960', 'tempest-NotDelegatedRole-593613118'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:24.738382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdca67-d7f8-460c-89f0-67f9b0ea0691 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:24.738662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdca67-d7f8-460c-89f0-67f9b0ea0691 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:24.738935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdca67-d7f8-460c-89f0-67f9b0ea0691 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] PATH_INFO: `/v3/OS-TRUST/trusts/bb49d0ef565341bc8b0418a68d3702d3` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:24.746190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdca67-d7f8-460c-89f0-67f9b0ea0691 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: Authorizing `identity:delete_trust(trust_id=bb49d0ef565341bc8b0418a68d3702d3)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:24.747704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdca67-d7f8-460c-89f0-67f9b0ea0691 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:24.854534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-aafdca67-d7f8-460c-89f0-67f9b0ea0691 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'bb49d0ef565341bc8b0418a68d3702d3', 'request_id': 'req-aafdca67-d7f8-460c-89f0-67f9b0ea0691'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:24.933302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-aafdca67-d7f8-460c-89f0-67f9b0ea0691 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'bb49d0ef565341bc8b0418a68d3702d3', 'request_id': 'req-aafdca67-d7f8-460c-89f0-67f9b0ea0691'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:24.935007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-aafdca67-d7f8-460c-89f0-67f9b0ea0691 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'bb49d0ef565341bc8b0418a68d3702d3', 'request_id': 'req-aafdca67-d7f8-460c-89f0-67f9b0ea0691'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:24.945960 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2172/4374] 10.222.0.20 () {58 vars in 1254 bytes} [Thu Oct 27 03:43:24 2022] DELETE /identity/v3/OS-TRUST/trusts/bb49d0ef565341bc8b0418a68d3702d3 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:43:24.947470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fd212-a233-467d-98c9-bd0f00922ee1 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:24.950215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-659fd212-a233-467d-98c9-bd0f00922ee1 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:24.967659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fd212-a233-467d-98c9-bd0f00922ee1 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:24.976705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07779215-05d7-4411-81b4-08fb4458d45e tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5960e62ec6934d9fb20210097679edd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd7f48b2023a4520bf1f7fbcfd3a533a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-999187960', 'tempest-NotDelegatedRole-593613118'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:24.977966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07779215-05d7-4411-81b4-08fb4458d45e tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:24.979432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07779215-05d7-4411-81b4-08fb4458d45e tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:24.980440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07779215-05d7-4411-81b4-08fb4458d45e tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] PATH_INFO: `/v3/OS-TRUST/trusts/bb49d0ef565341bc8b0418a68d3702d3` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:25.015138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-07779215-05d7-4411-81b4-08fb4458d45e tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Could not find trust: bb49d0ef565341bc8b0418a68d3702d3.: keystone.exception.TrustNotFound: Could not find trust: bb49d0ef565341bc8b0418a68d3702d3. Oct 27 03:43:25.015138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:43:25.015138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:43:25.015138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:43:25.015138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:43:25.015138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:43:25.015138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:43:25.015138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:43:25.015138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:43:25.015138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:43:25.015138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:43:25.015138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:43:25.015138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 27 03:43:25.015138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 27 03:43:25.015138 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 27 03:43:25.016404 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 27 03:43:25.016404 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 27 03:43:25.016404 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 27 03:43:25.016404 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 27 03:43:25.016404 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 27 03:43:25.016404 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:43:25.016404 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:43:25.016404 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 27 03:43:25.016404 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 27 03:43:25.016404 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 27 03:43:25.016404 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 27 03:43:25.016404 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: bb49d0ef565341bc8b0418a68d3702d3. Oct 27 03:43:25.016404 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:43:25.021967 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2203/4375] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:43:24 2022] GET /identity/v3/OS-TRUST/trusts/bb49d0ef565341bc8b0418a68d3702d3 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:43:25.022872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdca67-d7f8-460c-89f0-67f9b0ea0691 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:25.025681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-aafdca67-d7f8-460c-89f0-67f9b0ea0691 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:25.044464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdca67-d7f8-460c-89f0-67f9b0ea0691 tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:25.051984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3e6b0-e1a2-4497-bea4-8a02c9b8e195 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:25.053938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3e6b0-e1a2-4497-bea4-8a02c9b8e195 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:25.054487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3e6b0-e1a2-4497-bea4-8a02c9b8e195 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:25.058021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3e6b0-e1a2-4497-bea4-8a02c9b8e195 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/roles/54035e35113f41e79b7f5c2a2f8da12f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:25.061223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3e6b0-e1a2-4497-bea4-8a02c9b8e195 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:delete_role(role_id=54035e35113f41e79b7f5c2a2f8da12f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:25.063121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3e6b0-e1a2-4497-bea4-8a02c9b8e195 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:25.236745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:25.310615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e6a3e6b0-e1a2-4497-bea4-8a02c9b8e195 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invalidating the token cache because role 54035e35113f41e79b7f5c2a2f8da12f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:25.310615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e6a3e6b0-e1a2-4497-bea4-8a02c9b8e195 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:25.310615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e6a3e6b0-e1a2-4497-bea4-8a02c9b8e195 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:25.316120 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2173/4376] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:25 2022] DELETE /identity/v3/roles/54035e35113f41e79b7f5c2a2f8da12f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:25.320004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07779215-05d7-4411-81b4-08fb4458d45e tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:25.321980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-07779215-05d7-4411-81b4-08fb4458d45e tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:25.354242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07779215-05d7-4411-81b4-08fb4458d45e tempest-TrustsV3TestJSON-1670844691 tempest-user-1821170345] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:25.429910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53a41c-99c3-4ef8-9b4b-0eab96f9898f tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:25.430746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53a41c-99c3-4ef8-9b4b-0eab96f9898f tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:25.431140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53a41c-99c3-4ef8-9b4b-0eab96f9898f tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:25.431494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53a41c-99c3-4ef8-9b4b-0eab96f9898f tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/roles/6c3d55ce57034dd797cedccb214f9b6e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:25.433107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53a41c-99c3-4ef8-9b4b-0eab96f9898f tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6c3d55ce57034dd797cedccb214f9b6e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:25.434880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53a41c-99c3-4ef8-9b4b-0eab96f9898f tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:25.482780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:25.751070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1f53a41c-99c3-4ef8-9b4b-0eab96f9898f tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invalidating the token cache because role 6c3d55ce57034dd797cedccb214f9b6e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:25.751371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1f53a41c-99c3-4ef8-9b4b-0eab96f9898f tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:25.762276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1f53a41c-99c3-4ef8-9b4b-0eab96f9898f tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:25.762276 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2204/4377] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:25 2022] DELETE /identity/v3/roles/6c3d55ce57034dd797cedccb214f9b6e => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:25.765131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3e6b0-e1a2-4497-bea4-8a02c9b8e195 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:25.780441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3e6b0-e1a2-4497-bea4-8a02c9b8e195 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:25.875719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0baa60e-97a5-4e25-97cc-e8689d5e55b8 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:25.876375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0baa60e-97a5-4e25-97cc-e8689d5e55b8 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:25.876975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0baa60e-97a5-4e25-97cc-e8689d5e55b8 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:25.877647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0baa60e-97a5-4e25-97cc-e8689d5e55b8 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/users/5960e62ec6934d9fb20210097679edd6` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:25.879147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0baa60e-97a5-4e25-97cc-e8689d5e55b8 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5960e62ec6934d9fb20210097679edd6)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:25.884087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0baa60e-97a5-4e25-97cc-e8689d5e55b8 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:26.023456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d0baa60e-97a5-4e25-97cc-e8689d5e55b8 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5960e62ec6934d9fb20210097679edd6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:26.024397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d0baa60e-97a5-4e25-97cc-e8689d5e55b8 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5960e62ec6934d9fb20210097679edd6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:26.034624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d0baa60e-97a5-4e25-97cc-e8689d5e55b8 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5960e62ec6934d9fb20210097679edd6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:26.048240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d0baa60e-97a5-4e25-97cc-e8689d5e55b8 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5960e62ec6934d9fb20210097679edd6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:26.110406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d0baa60e-97a5-4e25-97cc-e8689d5e55b8 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5960e62ec6934d9fb20210097679edd6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:26.117269 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2174/4378] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:25 2022] DELETE /identity/v3/users/5960e62ec6934d9fb20210097679edd6 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:26.121411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53a41c-99c3-4ef8-9b4b-0eab96f9898f tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:26.123009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1f53a41c-99c3-4ef8-9b4b-0eab96f9898f tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:26.143399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53a41c-99c3-4ef8-9b4b-0eab96f9898f tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:26.241510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51379528-6380-4252-8459-b98259b1b815 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b78e1c3562d47e0a07fa1b1078c2eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0176f021f6e414b840a06f4c964ace8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:26.242219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51379528-6380-4252-8459-b98259b1b815 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:26.242514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51379528-6380-4252-8459-b98259b1b815 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:26.242796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51379528-6380-4252-8459-b98259b1b815 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] PATH_INFO: `/v3/projects/dd7f48b2023a4520bf1f7fbcfd3a533a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:26.244394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51379528-6380-4252-8459-b98259b1b815 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dd7f48b2023a4520bf1f7fbcfd3a533a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:26.245931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51379528-6380-4252-8459-b98259b1b815 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:26.446326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-51379528-6380-4252-8459-b98259b1b815 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd7f48b2023a4520bf1f7fbcfd3a533a', 'request_id': 'req-51379528-6380-4252-8459-b98259b1b815'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:26.454745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-51379528-6380-4252-8459-b98259b1b815 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd7f48b2023a4520bf1f7fbcfd3a533a', 'request_id': 'req-51379528-6380-4252-8459-b98259b1b815'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:26.461600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-51379528-6380-4252-8459-b98259b1b815 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd7f48b2023a4520bf1f7fbcfd3a533a', 'request_id': 'req-51379528-6380-4252-8459-b98259b1b815'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:26.534517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-51379528-6380-4252-8459-b98259b1b815 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] The token cache is being invalidate because project dd7f48b2023a4520bf1f7fbcfd3a533a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:26.536339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-51379528-6380-4252-8459-b98259b1b815 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:26.536339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-51379528-6380-4252-8459-b98259b1b815 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:26.543932 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2205/4379] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:43:26 2022] DELETE /identity/v3/projects/dd7f48b2023a4520bf1f7fbcfd3a533a => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:26.545377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0baa60e-97a5-4e25-97cc-e8689d5e55b8 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:26.548923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d0baa60e-97a5-4e25-97cc-e8689d5e55b8 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:26.638393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0baa60e-97a5-4e25-97cc-e8689d5e55b8 tempest-TrustsV3TestJSON-1104982189 tempest-TrustsV3TestJSON-1104982189-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:26.712752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3350b1-7a29-47f9-a5fd-fa2a47d79529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:26.713729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3350b1-7a29-47f9-a5fd-fa2a47d79529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:26.714425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3350b1-7a29-47f9-a5fd-fa2a47d79529 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:26.714968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3350b1-7a29-47f9-a5fd-fa2a47d79529 admin admin] PATH_INFO: `/v3/users/a8d520feb6e044038716fb5896e1d345` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:26.716355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3350b1-7a29-47f9-a5fd-fa2a47d79529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8d520feb6e044038716fb5896e1d345)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:26.718667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3350b1-7a29-47f9-a5fd-fa2a47d79529 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:27.042593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1b3350b1-7a29-47f9-a5fd-fa2a47d79529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8d520feb6e044038716fb5896e1d345'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:27.043237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1b3350b1-7a29-47f9-a5fd-fa2a47d79529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8d520feb6e044038716fb5896e1d345'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:27.055376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1b3350b1-7a29-47f9-a5fd-fa2a47d79529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8d520feb6e044038716fb5896e1d345'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:27.087585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1b3350b1-7a29-47f9-a5fd-fa2a47d79529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8d520feb6e044038716fb5896e1d345'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:27.196230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1b3350b1-7a29-47f9-a5fd-fa2a47d79529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8d520feb6e044038716fb5896e1d345'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:27.205234 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2175/4380] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:26 2022] DELETE /identity/v3/users/a8d520feb6e044038716fb5896e1d345 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:27.211576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac679cdc-45ed-44c6-aba9-5e80e25c1ba9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:27.212518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac679cdc-45ed-44c6-aba9-5e80e25c1ba9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:27.212953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac679cdc-45ed-44c6-aba9-5e80e25c1ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:27.235725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ac679cdc-45ed-44c6-aba9-5e80e25c1ba9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:27.237503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ac679cdc-45ed-44c6-aba9-5e80e25c1ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:27.375891 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2206/4381] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:27.394275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3350b1-7a29-47f9-a5fd-fa2a47d79529 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:27.396741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:27.399037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1b3350b1-7a29-47f9-a5fd-fa2a47d79529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:27.530506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3350b1-7a29-47f9-a5fd-fa2a47d79529 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:27.535664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25da6f-4531-48f4-a6d7-5ac863efeef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:27.537289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25da6f-4531-48f4-a6d7-5ac863efeef2 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:27.537753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25da6f-4531-48f4-a6d7-5ac863efeef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:27.538235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25da6f-4531-48f4-a6d7-5ac863efeef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:27.550774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25da6f-4531-48f4-a6d7-5ac863efeef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:27.552697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25da6f-4531-48f4-a6d7-5ac863efeef2 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:27.564813 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2176/4382] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:43:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:43:28.230991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:29.737717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac679cdc-45ed-44c6-aba9-5e80e25c1ba9 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:29.743537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ac679cdc-45ed-44c6-aba9-5e80e25c1ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:29.778204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac679cdc-45ed-44c6-aba9-5e80e25c1ba9 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:29.796197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:29.821399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa50fa3-ba37-4f75-b1fd-a11202fc827a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:29.825676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa50fa3-ba37-4f75-b1fd-a11202fc827a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:29.826121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa50fa3-ba37-4f75-b1fd-a11202fc827a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:29.828614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa50fa3-ba37-4f75-b1fd-a11202fc827a admin admin] PATH_INFO: `/v3/projects/b4ac8d612b834cb99b696d93d83a9cbd` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:29.831954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa50fa3-ba37-4f75-b1fd-a11202fc827a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4ac8d612b834cb99b696d93d83a9cbd)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:29.836818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa50fa3-ba37-4f75-b1fd-a11202fc827a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:30.075111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9aa50fa3-ba37-4f75-b1fd-a11202fc827a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4ac8d612b834cb99b696d93d83a9cbd', 'request_id': 'req-9aa50fa3-ba37-4f75-b1fd-a11202fc827a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:30.089161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9aa50fa3-ba37-4f75-b1fd-a11202fc827a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4ac8d612b834cb99b696d93d83a9cbd', 'request_id': 'req-9aa50fa3-ba37-4f75-b1fd-a11202fc827a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:30.101620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9aa50fa3-ba37-4f75-b1fd-a11202fc827a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4ac8d612b834cb99b696d93d83a9cbd', 'request_id': 'req-9aa50fa3-ba37-4f75-b1fd-a11202fc827a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:30.197704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:30.220526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9aa50fa3-ba37-4f75-b1fd-a11202fc827a admin admin] The token cache is being invalidate because project b4ac8d612b834cb99b696d93d83a9cbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:30.220818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9aa50fa3-ba37-4f75-b1fd-a11202fc827a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:30.221490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9aa50fa3-ba37-4f75-b1fd-a11202fc827a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:30.223304 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2207/4383] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:43:29 2022] DELETE /identity/v3/projects/b4ac8d612b834cb99b696d93d83a9cbd => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:30.227303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25da6f-4531-48f4-a6d7-5ac863efeef2 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:30.240588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25da6f-4531-48f4-a6d7-5ac863efeef2 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:30.357421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18049ed-6235-4919-9eb8-86eb76d0211f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:30.358655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18049ed-6235-4919-9eb8-86eb76d0211f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:30.359232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18049ed-6235-4919-9eb8-86eb76d0211f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:30.359676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18049ed-6235-4919-9eb8-86eb76d0211f admin admin] PATH_INFO: `/v3/users/3b78e1c3562d47e0a07fa1b1078c2eec` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:30.361145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18049ed-6235-4919-9eb8-86eb76d0211f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b78e1c3562d47e0a07fa1b1078c2eec)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:30.363575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18049ed-6235-4919-9eb8-86eb76d0211f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:30.638870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a18049ed-6235-4919-9eb8-86eb76d0211f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b78e1c3562d47e0a07fa1b1078c2eec'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:30.639850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a18049ed-6235-4919-9eb8-86eb76d0211f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b78e1c3562d47e0a07fa1b1078c2eec'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:30.659234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a18049ed-6235-4919-9eb8-86eb76d0211f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b78e1c3562d47e0a07fa1b1078c2eec'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:30.691000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a18049ed-6235-4919-9eb8-86eb76d0211f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b78e1c3562d47e0a07fa1b1078c2eec'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:30.815900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a18049ed-6235-4919-9eb8-86eb76d0211f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b78e1c3562d47e0a07fa1b1078c2eec'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:30.829073 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2177/4384] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:30 2022] DELETE /identity/v3/users/3b78e1c3562d47e0a07fa1b1078c2eec => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:30.968185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:31.145567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:32.100068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:32.436443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa50fa3-ba37-4f75-b1fd-a11202fc827a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:32.438088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9aa50fa3-ba37-4f75-b1fd-a11202fc827a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:32.462221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa50fa3-ba37-4f75-b1fd-a11202fc827a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:32.580801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097606ef-7a56-4f04-ad57-02ad37aaa832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:32.581619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097606ef-7a56-4f04-ad57-02ad37aaa832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:32.582190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097606ef-7a56-4f04-ad57-02ad37aaa832 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:32.582740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097606ef-7a56-4f04-ad57-02ad37aaa832 admin admin] PATH_INFO: `/v3/projects/d0176f021f6e414b840a06f4c964ace8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:32.588421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097606ef-7a56-4f04-ad57-02ad37aaa832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0176f021f6e414b840a06f4c964ace8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:32.594226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097606ef-7a56-4f04-ad57-02ad37aaa832 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:32.799758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-097606ef-7a56-4f04-ad57-02ad37aaa832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0176f021f6e414b840a06f4c964ace8', 'request_id': 'req-097606ef-7a56-4f04-ad57-02ad37aaa832'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:32.820967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-097606ef-7a56-4f04-ad57-02ad37aaa832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0176f021f6e414b840a06f4c964ace8', 'request_id': 'req-097606ef-7a56-4f04-ad57-02ad37aaa832'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:32.831446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-097606ef-7a56-4f04-ad57-02ad37aaa832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0176f021f6e414b840a06f4c964ace8', 'request_id': 'req-097606ef-7a56-4f04-ad57-02ad37aaa832'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:32.928267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-097606ef-7a56-4f04-ad57-02ad37aaa832 admin admin] The token cache is being invalidate because project d0176f021f6e414b840a06f4c964ace8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:32.928764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-097606ef-7a56-4f04-ad57-02ad37aaa832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:32.931845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-097606ef-7a56-4f04-ad57-02ad37aaa832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:32.936329 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2208/4385] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:43:32 2022] DELETE /identity/v3/projects/d0176f021f6e414b840a06f4c964ace8 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:32.940915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694edda-110a-4e16-8e9c-e1c4843317a0 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:32.941439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694edda-110a-4e16-8e9c-e1c4843317a0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:32.941563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694edda-110a-4e16-8e9c-e1c4843317a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:32.986212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:32.989729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c694edda-110a-4e16-8e9c-e1c4843317a0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:32.993429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c694edda-110a-4e16-8e9c-e1c4843317a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:33.151604 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2178/4386] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:33.157790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25941dae-4a5a-46df-9164-65db476db40b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:33.158451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25941dae-4a5a-46df-9164-65db476db40b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:33.158883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25941dae-4a5a-46df-9164-65db476db40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:33.201790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-25941dae-4a5a-46df-9164-65db476db40b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:33.203100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-25941dae-4a5a-46df-9164-65db476db40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:33.211904 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2209/4387] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:33.218527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694edda-110a-4e16-8e9c-e1c4843317a0 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:33.231311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:33.245902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694edda-110a-4e16-8e9c-e1c4843317a0 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:33.246683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f28840-5d30-4579-bcc7-6b56316500e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:33.247495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f28840-5d30-4579-bcc7-6b56316500e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:33.247937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f28840-5d30-4579-bcc7-6b56316500e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:33.248363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f28840-5d30-4579-bcc7-6b56316500e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:33.249188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f28840-5d30-4579-bcc7-6b56316500e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:43:33.249658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f28840-5d30-4579-bcc7-6b56316500e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:33.253940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f28840-5d30-4579-bcc7-6b56316500e1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:33.284861 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2179/4388] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:43:33.286813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25941dae-4a5a-46df-9164-65db476db40b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:33.299934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25941dae-4a5a-46df-9164-65db476db40b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:33.311527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83b512-a071-4317-b53a-1ccaff97d125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:33.314279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83b512-a071-4317-b53a-1ccaff97d125 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:33.314573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83b512-a071-4317-b53a-1ccaff97d125 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:33.314855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83b512-a071-4317-b53a-1ccaff97d125 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:33.316555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83b512-a071-4317-b53a-1ccaff97d125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:33.327167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83b512-a071-4317-b53a-1ccaff97d125 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:33.451167 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2210/4389] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:43:33 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:33.455547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f28840-5d30-4579-bcc7-6b56316500e1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:33.476655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f28840-5d30-4579-bcc7-6b56316500e1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:33.647147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03c6e6-5b22-4fc4-b1c1-bef207d87fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:33.647791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03c6e6-5b22-4fc4-b1c1-bef207d87fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:33.648075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03c6e6-5b22-4fc4-b1c1-bef207d87fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:33.648772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03c6e6-5b22-4fc4-b1c1-bef207d87fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:33.649421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03c6e6-5b22-4fc4-b1c1-bef207d87fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:33.651477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03c6e6-5b22-4fc4-b1c1-bef207d87fd0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:33.783015 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2180/4390] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:43:33 2022] POST /identity/v3/users => generated 286 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:33.792424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83b512-a071-4317-b53a-1ccaff97d125 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:33.812711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83b512-a071-4317-b53a-1ccaff97d125 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:33.828579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9666e8-de00-4c94-b79e-cdfa377dc06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:33.829447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9666e8-de00-4c94-b79e-cdfa377dc06f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:33.830271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9666e8-de00-4c94-b79e-cdfa377dc06f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:33.831427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9666e8-de00-4c94-b79e-cdfa377dc06f admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:33.832814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9666e8-de00-4c94-b79e-cdfa377dc06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:33.837137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9666e8-de00-4c94-b79e-cdfa377dc06f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:33.865144 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2211/4391] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:33.869166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03c6e6-5b22-4fc4-b1c1-bef207d87fd0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:33.886111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03c6e6-5b22-4fc4-b1c1-bef207d87fd0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:33.894804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a75978-bfb2-4e36-9db9-10974f0770f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:33.895439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a75978-bfb2-4e36-9db9-10974f0770f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:33.896319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a75978-bfb2-4e36-9db9-10974f0770f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:33.896596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a75978-bfb2-4e36-9db9-10974f0770f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:33.897309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a75978-bfb2-4e36-9db9-10974f0770f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:33.901970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a75978-bfb2-4e36-9db9-10974f0770f8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:33.929815 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2181/4392] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:33.933351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9666e8-de00-4c94-b79e-cdfa377dc06f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:33.952565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9666e8-de00-4c94-b79e-cdfa377dc06f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:33.964099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a363e0-72b6-4892-8ea3-7917e1639f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:33.965359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a363e0-72b6-4892-8ea3-7917e1639f2d admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:33.965893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a363e0-72b6-4892-8ea3-7917e1639f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:33.966422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a363e0-72b6-4892-8ea3-7917e1639f2d admin admin] PATH_INFO: `/v3/projects/e19205fde609461a8eb228b8905903c1/users/7a2715cd8e9d4ced97237543dba3bd53/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:34.009132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a363e0-72b6-4892-8ea3-7917e1639f2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e19205fde609461a8eb228b8905903c1, user_id=7a2715cd8e9d4ced97237543dba3bd53, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:34.012207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a363e0-72b6-4892-8ea3-7917e1639f2d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:34.110629 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2212/4393] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:43:33 2022] PUT /identity/v3/projects/e19205fde609461a8eb228b8905903c1/users/7a2715cd8e9d4ced97237543dba3bd53/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:34.147181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:34.242334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70783dfe-ca8b-4e15-9414-03192454945b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:34.243351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70783dfe-ca8b-4e15-9414-03192454945b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:34.243783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70783dfe-ca8b-4e15-9414-03192454945b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:34.300464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-70783dfe-ca8b-4e15-9414-03192454945b None None] MFA Rules not processed for user `7a2715cd8e9d4ced97237543dba3bd53`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:34.301933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-70783dfe-ca8b-4e15-9414-03192454945b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:34.374874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:34.439810 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2182/4394] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:34.444133 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a363e0-72b6-4892-8ea3-7917e1639f2d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:34.617168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a363e0-72b6-4892-8ea3-7917e1639f2d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:34.636419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d1eb8-2766-407a-a890-33676ec53a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:34.640310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d1eb8-2766-407a-a890-33676ec53a12 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:34.640310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d1eb8-2766-407a-a890-33676ec53a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:34.640310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d1eb8-2766-407a-a890-33676ec53a12 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:34.640310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d1eb8-2766-407a-a890-33676ec53a12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:34.641534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d1eb8-2766-407a-a890-33676ec53a12 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:34.787326 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2213/4395] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:43:34 2022] POST /identity/v3/projects => generated 369 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:34.788629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70783dfe-ca8b-4e15-9414-03192454945b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:34.805283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70783dfe-ca8b-4e15-9414-03192454945b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:34.924276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12805363-1d70-4b13-a0e3-72f9c8318889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:34.925117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12805363-1d70-4b13-a0e3-72f9c8318889 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:34.925264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12805363-1d70-4b13-a0e3-72f9c8318889 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:34.925514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12805363-1d70-4b13-a0e3-72f9c8318889 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:34.926317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12805363-1d70-4b13-a0e3-72f9c8318889 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:34.930868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12805363-1d70-4b13-a0e3-72f9c8318889 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:35.047813 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2183/4396] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:43:34 2022] POST /identity/v3/users => generated 291 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:35.049049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d1eb8-2766-407a-a890-33676ec53a12 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:35.064059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d1eb8-2766-407a-a890-33676ec53a12 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:35.071782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a7488-d47b-409f-9c99-0c4fbaff6622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:35.073045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a7488-d47b-409f-9c99-0c4fbaff6622 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:35.073896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a7488-d47b-409f-9c99-0c4fbaff6622 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:35.074461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a7488-d47b-409f-9c99-0c4fbaff6622 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:35.075404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a7488-d47b-409f-9c99-0c4fbaff6622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:35.077286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a7488-d47b-409f-9c99-0c4fbaff6622 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:35.108429 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2214/4397] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:35.115335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12805363-1d70-4b13-a0e3-72f9c8318889 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:35.123682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12805363-1d70-4b13-a0e3-72f9c8318889 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:35.139873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94979ef1-9bc2-4ab9-a991-69e1c46f24af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:35.140567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94979ef1-9bc2-4ab9-a991-69e1c46f24af admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:35.140949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94979ef1-9bc2-4ab9-a991-69e1c46f24af admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:35.141224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94979ef1-9bc2-4ab9-a991-69e1c46f24af admin admin] PATH_INFO: `/v3/projects/5dd64980bf5449d8a666f3a23cd4b750/users/20857b321287460188182a6b0abbbe54/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:35.172148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94979ef1-9bc2-4ab9-a991-69e1c46f24af admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd64980bf5449d8a666f3a23cd4b750, user_id=20857b321287460188182a6b0abbbe54, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:35.174726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94979ef1-9bc2-4ab9-a991-69e1c46f24af admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:35.199025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:35.248310 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2184/4398] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:43:35 2022] PUT /identity/v3/projects/5dd64980bf5449d8a666f3a23cd4b750/users/20857b321287460188182a6b0abbbe54/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:43:35.252548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a7488-d47b-409f-9c99-0c4fbaff6622 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:35.266152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a7488-d47b-409f-9c99-0c4fbaff6622 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:35.352571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:35.415010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec0de7-3b2e-438e-b34b-8197987cfc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:35.426371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec0de7-3b2e-438e-b34b-8197987cfc5b admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:35.426371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec0de7-3b2e-438e-b34b-8197987cfc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:35.426371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec0de7-3b2e-438e-b34b-8197987cfc5b admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:35.426371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec0de7-3b2e-438e-b34b-8197987cfc5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:35.426371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec0de7-3b2e-438e-b34b-8197987cfc5b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:35.439572 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2215/4399] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:35.445163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94979ef1-9bc2-4ab9-a991-69e1c46f24af admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:35.460829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94979ef1-9bc2-4ab9-a991-69e1c46f24af admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:35.467733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabc195-ed99-4d32-bb51-0b08e295a6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:35.468638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabc195-ed99-4d32-bb51-0b08e295a6d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:35.469113 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabc195-ed99-4d32-bb51-0b08e295a6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:35.469798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabc195-ed99-4d32-bb51-0b08e295a6d5 admin admin] PATH_INFO: `/v3/projects/5dd64980bf5449d8a666f3a23cd4b750/users/20857b321287460188182a6b0abbbe54/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:35.472154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeabc195-ed99-4d32-bb51-0b08e295a6d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd64980bf5449d8a666f3a23cd4b750, user_id=20857b321287460188182a6b0abbbe54, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:35.475989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeabc195-ed99-4d32-bb51-0b08e295a6d5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:35.490086 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2185/4400] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:43:35 2022] PUT /identity/v3/projects/5dd64980bf5449d8a666f3a23cd4b750/users/20857b321287460188182a6b0abbbe54/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:35.504805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30c366-2448-4b0c-bbf6-cddcfd412685 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:35.505659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30c366-2448-4b0c-bbf6-cddcfd412685 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:35.505944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30c366-2448-4b0c-bbf6-cddcfd412685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:35.574022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0f30c366-2448-4b0c-bbf6-cddcfd412685 None None] MFA Rules not processed for user `20857b321287460188182a6b0abbbe54`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:35.575216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0f30c366-2448-4b0c-bbf6-cddcfd412685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:35.847057 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2216/4401] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:35.852108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabc195-ed99-4d32-bb51-0b08e295a6d5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:35.868296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabc195-ed99-4d32-bb51-0b08e295a6d5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:35.898742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727b2a5-8c89-47fe-bc7e-fbfee29b9ac7 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20857b321287460188182a6b0abbbe54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd64980bf5449d8a666f3a23cd4b750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:35.899351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727b2a5-8c89-47fe-bc7e-fbfee29b9ac7 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:35.899643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727b2a5-8c89-47fe-bc7e-fbfee29b9ac7 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:35.899925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727b2a5-8c89-47fe-bc7e-fbfee29b9ac7 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:35.900584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727b2a5-8c89-47fe-bc7e-fbfee29b9ac7 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:35.902531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727b2a5-8c89-47fe-bc7e-fbfee29b9ac7 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:35.905109 n-d-862769-1 devstack@keystone.service[82179]: WARNING keystone.server.flask.common [None req-3727b2a5-8c89-47fe-bc7e-fbfee29b9ac7 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 27 03:43:35.926458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:36.071973 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2186/4402] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:43:35 2022] POST /identity/v3/projects => generated 359 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:36.076079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30c366-2448-4b0c-bbf6-cddcfd412685 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:36.091982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30c366-2448-4b0c-bbf6-cddcfd412685 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:36.245487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:36.266009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff0eb8-ec99-49a5-83ec-5e12f59fd358 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20857b321287460188182a6b0abbbe54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd64980bf5449d8a666f3a23cd4b750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:36.266647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486bddf-a971-4d56-a122-f25561cdc20f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:36.267122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff0eb8-ec99-49a5-83ec-5e12f59fd358 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:36.267122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff0eb8-ec99-49a5-83ec-5e12f59fd358 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:36.267304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff0eb8-ec99-49a5-83ec-5e12f59fd358 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:36.267768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486bddf-a971-4d56-a122-f25561cdc20f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:36.267887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff0eb8-ec99-49a5-83ec-5e12f59fd358 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:36.268294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486bddf-a971-4d56-a122-f25561cdc20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:36.269775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff0eb8-ec99-49a5-83ec-5e12f59fd358 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:36.339870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-3486bddf-a971-4d56-a122-f25561cdc20f None None] MFA Rules not processed for user `ae9ddb0e44024937865411a7d2c3d956`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:36.342661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3486bddf-a971-4d56-a122-f25561cdc20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:36.396150 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2217/4403] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:43:36 2022] POST /identity/v3/users => generated 373 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:36.397815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff0eb8-ec99-49a5-83ec-5e12f59fd358 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:36.436359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff0eb8-ec99-49a5-83ec-5e12f59fd358 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:36.460817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03601860-48a0-4378-bf83-34d19a7854fb tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20857b321287460188182a6b0abbbe54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd64980bf5449d8a666f3a23cd4b750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:36.461672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03601860-48a0-4378-bf83-34d19a7854fb tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:36.462484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03601860-48a0-4378-bf83-34d19a7854fb tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:36.462484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03601860-48a0-4378-bf83-34d19a7854fb tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:36.463393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03601860-48a0-4378-bf83-34d19a7854fb tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:43:36.463589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03601860-48a0-4378-bf83-34d19a7854fb tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:36.485305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03601860-48a0-4378-bf83-34d19a7854fb tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:36.530693 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2187/4404] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:36.540563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa671c0-80e6-4294-a68f-2afb57607223 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:36.542261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa671c0-80e6-4294-a68f-2afb57607223 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:36.543176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa671c0-80e6-4294-a68f-2afb57607223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:36.564097 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2218/4405] 10.222.0.20 () {58 vars in 1157 bytes} [Thu Oct 27 03:43:36 2022] GET /identity/v3/users?domain_id=default => generated 8028 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:36.569485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03601860-48a0-4378-bf83-34d19a7854fb tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:36.589268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ffa671c0-80e6-4294-a68f-2afb57607223 None None] MFA Rules not processed for user `ae9ddb0e44024937865411a7d2c3d956`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:36.591037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ffa671c0-80e6-4294-a68f-2afb57607223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:36.593554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03601860-48a0-4378-bf83-34d19a7854fb tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:36.611107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fefc5a-70cd-469d-a84d-683a5e4f5ea1 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20857b321287460188182a6b0abbbe54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd64980bf5449d8a666f3a23cd4b750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:36.613409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fefc5a-70cd-469d-a84d-683a5e4f5ea1 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:36.614822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fefc5a-70cd-469d-a84d-683a5e4f5ea1 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:36.617404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fefc5a-70cd-469d-a84d-683a5e4f5ea1 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] PATH_INFO: `/v3/users/9311d1b2b701437cb8d1a6b0226c251a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:36.623100 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2188/4406] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:43:36.631804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa671c0-80e6-4294-a68f-2afb57607223 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:36.635218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ffa671c0-80e6-4294-a68f-2afb57607223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:36.659511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fefc5a-70cd-469d-a84d-683a5e4f5ea1 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] RBAC: Authorizing `identity:update_user(user_id=9311d1b2b701437cb8d1a6b0226c251a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:36.665809 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-27fefc5a-70cd-469d-a84d-683a5e4f5ea1 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:43:36.665809 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:43:36.665809 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:43:36.670060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fefc5a-70cd-469d-a84d-683a5e4f5ea1 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:36.791489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-27fefc5a-70cd-469d-a84d-683a5e4f5ea1 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9311d1b2b701437cb8d1a6b0226c251a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:36.806020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa671c0-80e6-4294-a68f-2afb57607223 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:36.813722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261602e-a091-47bb-aabd-f9b68907b8f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:36.814957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261602e-a091-47bb-aabd-f9b68907b8f3 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:36.815464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261602e-a091-47bb-aabd-f9b68907b8f3 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:36.818888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261602e-a091-47bb-aabd-f9b68907b8f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:36.829707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261602e-a091-47bb-aabd-f9b68907b8f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:36.832434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261602e-a091-47bb-aabd-f9b68907b8f3 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:36.861918 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2189/4407] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:43:36 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:43:36.910059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-27fefc5a-70cd-469d-a84d-683a5e4f5ea1 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Invalidating the token cache because user 9311d1b2b701437cb8d1a6b0226c251a was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:36.910625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-27fefc5a-70cd-469d-a84d-683a5e4f5ea1 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:36.911309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-27fefc5a-70cd-469d-a84d-683a5e4f5ea1 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:36.917302 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2219/4408] 10.222.0.20 () {60 vars in 1244 bytes} [Thu Oct 27 03:43:36 2022] PATCH /identity/v3/users/9311d1b2b701437cb8d1a6b0226c251a => generated 488 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:43:36.919122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e2f84-9238-428b-9347-4209fa76df52 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:36.919647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e2f84-9238-428b-9347-4209fa76df52 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:36.920254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e2f84-9238-428b-9347-4209fa76df52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:36.980008 n-d-862769-1 devstack@keystone.service[82179]: WARNING keystone.auth.plugins.core [None req-f99e2f84-9238-428b-9347-4209fa76df52 None None] User is disabled: 9311d1b2b701437cb8d1a6b0226c251a: AssertionError: User is disabled: 9311d1b2b701437cb8d1a6b0226c251a Oct 27 03:43:37.000870 n-d-862769-1 devstack@keystone.service[82179]: WARNING keystone.server.flask.application [None req-f99e2f84-9238-428b-9347-4209fa76df52 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.20: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 27 03:43:37.003601 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2190/4409] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:36 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 86 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 27 03:43:37.009183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fefc5a-70cd-469d-a84d-683a5e4f5ea1 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:37.011609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-27fefc5a-70cd-469d-a84d-683a5e4f5ea1 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:37.036949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fefc5a-70cd-469d-a84d-683a5e4f5ea1 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:37.049936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5656f9b-d98b-46c2-bb72-f0e7d9b7118e tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20857b321287460188182a6b0abbbe54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd64980bf5449d8a666f3a23cd4b750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:37.050671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5656f9b-d98b-46c2-bb72-f0e7d9b7118e tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:37.055025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5656f9b-d98b-46c2-bb72-f0e7d9b7118e tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:37.055552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5656f9b-d98b-46c2-bb72-f0e7d9b7118e tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] PATH_INFO: `/v3/users/9311d1b2b701437cb8d1a6b0226c251a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:37.089061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5656f9b-d98b-46c2-bb72-f0e7d9b7118e tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9311d1b2b701437cb8d1a6b0226c251a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:37.095301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5656f9b-d98b-46c2-bb72-f0e7d9b7118e tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:37.277626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b5656f9b-d98b-46c2-bb72-f0e7d9b7118e tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9311d1b2b701437cb8d1a6b0226c251a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:37.278910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b5656f9b-d98b-46c2-bb72-f0e7d9b7118e tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9311d1b2b701437cb8d1a6b0226c251a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:37.290338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b5656f9b-d98b-46c2-bb72-f0e7d9b7118e tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9311d1b2b701437cb8d1a6b0226c251a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:37.325991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b5656f9b-d98b-46c2-bb72-f0e7d9b7118e tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9311d1b2b701437cb8d1a6b0226c251a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:37.326831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b5656f9b-d98b-46c2-bb72-f0e7d9b7118e tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9311d1b2b701437cb8d1a6b0226c251a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:37.402368 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2220/4410] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:37 2022] DELETE /identity/v3/users/9311d1b2b701437cb8d1a6b0226c251a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:37.403137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e2f84-9238-428b-9347-4209fa76df52 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:37.408233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f99e2f84-9238-428b-9347-4209fa76df52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:37.585543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:37.635353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e2f84-9238-428b-9347-4209fa76df52 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:37.641683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dffbbc-1a12-49a1-bc10-6c3db91196b7 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20857b321287460188182a6b0abbbe54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd64980bf5449d8a666f3a23cd4b750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:37.643865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dffbbc-1a12-49a1-bc10-6c3db91196b7 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:37.644384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dffbbc-1a12-49a1-bc10-6c3db91196b7 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:37.644871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dffbbc-1a12-49a1-bc10-6c3db91196b7 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] PATH_INFO: `/v3/projects/d432eb40443847388829514de5acddd3` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:37.650703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dffbbc-1a12-49a1-bc10-6c3db91196b7 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d432eb40443847388829514de5acddd3)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:37.657419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dffbbc-1a12-49a1-bc10-6c3db91196b7 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:37.849793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-68dffbbc-1a12-49a1-bc10-6c3db91196b7 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd432eb40443847388829514de5acddd3', 'request_id': 'req-68dffbbc-1a12-49a1-bc10-6c3db91196b7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:37.951865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-68dffbbc-1a12-49a1-bc10-6c3db91196b7 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd432eb40443847388829514de5acddd3', 'request_id': 'req-68dffbbc-1a12-49a1-bc10-6c3db91196b7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:37.963466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-68dffbbc-1a12-49a1-bc10-6c3db91196b7 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd432eb40443847388829514de5acddd3', 'request_id': 'req-68dffbbc-1a12-49a1-bc10-6c3db91196b7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:37.983621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-68dffbbc-1a12-49a1-bc10-6c3db91196b7 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] The token cache is being invalidate because project d432eb40443847388829514de5acddd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:37.991924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-68dffbbc-1a12-49a1-bc10-6c3db91196b7 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:37.991924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-68dffbbc-1a12-49a1-bc10-6c3db91196b7 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:37.991924 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2191/4411] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:43:37 2022] DELETE /identity/v3/projects/d432eb40443847388829514de5acddd3 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:37.995005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5656f9b-d98b-46c2-bb72-f0e7d9b7118e tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:38.011639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5656f9b-d98b-46c2-bb72-f0e7d9b7118e tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:38.103510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=83,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=11 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:38.112112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008f45f-b1ca-4133-88dd-9aa6d6a4fa4f tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20857b321287460188182a6b0abbbe54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd64980bf5449d8a666f3a23cd4b750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:38.112830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008f45f-b1ca-4133-88dd-9aa6d6a4fa4f tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:38.113606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008f45f-b1ca-4133-88dd-9aa6d6a4fa4f tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:38.114008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008f45f-b1ca-4133-88dd-9aa6d6a4fa4f tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:38.114944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008f45f-b1ca-4133-88dd-9aa6d6a4fa4f tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:38.117419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008f45f-b1ca-4133-88dd-9aa6d6a4fa4f tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:38.139007 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-5008f45f-b1ca-4133-88dd-9aa6d6a4fa4f tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Could not find domain: 4cdb6ba284d7419fbc6bdd42d8cec753.: keystone.exception.DomainNotFound: Could not find domain: 4cdb6ba284d7419fbc6bdd42d8cec753. Oct 27 03:43:38.139007 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:43:38.139007 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 27 03:43:38.139007 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 27 03:43:38.139007 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:43:38.139007 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:43:38.139007 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:43:38.139007 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:43:38.139007 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 4cdb6ba284d7419fbc6bdd42d8cec753. Oct 27 03:43:38.139007 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:43:38.139007 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:43:38.139007 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:43:38.139007 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:43:38.139007 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:43:38.139007 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:43:38.139007 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:43:38.140191 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:43:38.140191 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:43:38.140191 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:43:38.140191 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:43:38.140191 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:43:38.140191 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:43:38.140191 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:43:38.140191 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 27 03:43:38.140191 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 27 03:43:38.140191 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:43:38.140191 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:43:38.140191 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:43:38.140191 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:43:38.140191 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:43:38.140191 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:43:38.140191 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Oct 27 03:43:38.140191 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:43:38.141235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:43:38.141235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:43:38.141235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:43:38.141235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:43:38.141235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:43:38.141235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:43:38.141235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:43:38.141235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:43:38.141235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:43:38.141235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:43:38.141235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:43:38.141235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:43:38.141235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:43:38.141235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:43:38.141235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:43:38.141235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:43:38.141235 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 27 03:43:38.143252 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:43:38.143252 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 4cdb6ba284d7419fbc6bdd42d8cec753. Oct 27 03:43:38.143252 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:43:38.147417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dffbbc-1a12-49a1-bc10-6c3db91196b7 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:38.147591 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2221/4412] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:43:37 2022] POST /identity/v3/users => generated 112 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:43:38.149036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-68dffbbc-1a12-49a1-bc10-6c3db91196b7 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:38.260959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dffbbc-1a12-49a1-bc10-6c3db91196b7 tempest-UsersNegativeTest-731732890 tempest-UsersNegativeTest-731732890-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:38.267181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce255b05-41db-4b71-a32c-6801babffb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:38.268432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce255b05-41db-4b71-a32c-6801babffb74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:38.269179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce255b05-41db-4b71-a32c-6801babffb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:38.269682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce255b05-41db-4b71-a32c-6801babffb74 admin admin] PATH_INFO: `/v3/users/7a2715cd8e9d4ced97237543dba3bd53` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:38.272148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce255b05-41db-4b71-a32c-6801babffb74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a2715cd8e9d4ced97237543dba3bd53)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:38.274567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce255b05-41db-4b71-a32c-6801babffb74 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:38.481156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ce255b05-41db-4b71-a32c-6801babffb74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a2715cd8e9d4ced97237543dba3bd53'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:38.483206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ce255b05-41db-4b71-a32c-6801babffb74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a2715cd8e9d4ced97237543dba3bd53'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:38.504576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ce255b05-41db-4b71-a32c-6801babffb74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a2715cd8e9d4ced97237543dba3bd53'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:38.538148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ce255b05-41db-4b71-a32c-6801babffb74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a2715cd8e9d4ced97237543dba3bd53'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:38.624987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ce255b05-41db-4b71-a32c-6801babffb74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a2715cd8e9d4ced97237543dba3bd53'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:38.626927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:38.637183 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2192/4413] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:38 2022] DELETE /identity/v3/users/7a2715cd8e9d4ced97237543dba3bd53 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:43:38.642927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a991682-3ef3-4856-94b3-7198d326b4ca None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:38.643218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a991682-3ef3-4856-94b3-7198d326b4ca None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:38.643499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a991682-3ef3-4856-94b3-7198d326b4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:38.691493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0a991682-3ef3-4856-94b3-7198d326b4ca None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:38.693723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0a991682-3ef3-4856-94b3-7198d326b4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:38.796656 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2222/4414] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:38.829155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce255b05-41db-4b71-a32c-6801babffb74 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:38.831083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ce255b05-41db-4b71-a32c-6801babffb74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:38.968219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce255b05-41db-4b71-a32c-6801babffb74 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:38.997161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b5bde-f1e6-4f2f-b56b-066f6ed0a100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:38.997161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b5bde-f1e6-4f2f-b56b-066f6ed0a100 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:38.997161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b5bde-f1e6-4f2f-b56b-066f6ed0a100 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:38.997161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b5bde-f1e6-4f2f-b56b-066f6ed0a100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:39.032431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b5bde-f1e6-4f2f-b56b-066f6ed0a100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:39.035189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b5bde-f1e6-4f2f-b56b-066f6ed0a100 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:39.062947 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2193/4415] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:43:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:43:40.039332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a991682-3ef3-4856-94b3-7198d326b4ca None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:40.041428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0a991682-3ef3-4856-94b3-7198d326b4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:40.062389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a991682-3ef3-4856-94b3-7198d326b4ca None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:40.079865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b314a-5976-4795-8082-19cb09a013af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:40.079865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b314a-5976-4795-8082-19cb09a013af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:40.079865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b314a-5976-4795-8082-19cb09a013af admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:40.079865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b314a-5976-4795-8082-19cb09a013af admin admin] PATH_INFO: `/v3/projects/e19205fde609461a8eb228b8905903c1` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:40.080173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b314a-5976-4795-8082-19cb09a013af admin admin] RBAC: Authorizing `identity:delete_project(project_id=e19205fde609461a8eb228b8905903c1)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:40.080173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b314a-5976-4795-8082-19cb09a013af admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:40.246860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3f0b314a-5976-4795-8082-19cb09a013af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e19205fde609461a8eb228b8905903c1', 'request_id': 'req-3f0b314a-5976-4795-8082-19cb09a013af'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:40.257952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3f0b314a-5976-4795-8082-19cb09a013af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e19205fde609461a8eb228b8905903c1', 'request_id': 'req-3f0b314a-5976-4795-8082-19cb09a013af'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:40.269809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3f0b314a-5976-4795-8082-19cb09a013af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e19205fde609461a8eb228b8905903c1', 'request_id': 'req-3f0b314a-5976-4795-8082-19cb09a013af'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:40.426556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3f0b314a-5976-4795-8082-19cb09a013af admin admin] The token cache is being invalidate because project e19205fde609461a8eb228b8905903c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:40.428558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3f0b314a-5976-4795-8082-19cb09a013af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:40.433803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3f0b314a-5976-4795-8082-19cb09a013af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:40.440914 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2223/4416] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:43:40 2022] DELETE /identity/v3/projects/e19205fde609461a8eb228b8905903c1 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:40.441577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b5bde-f1e6-4f2f-b56b-066f6ed0a100 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:40.462568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b5bde-f1e6-4f2f-b56b-066f6ed0a100 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:40.610221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e9f08-b1e5-4cba-9aa9-d8f3ec2d1889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:40.610980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e9f08-b1e5-4cba-9aa9-d8f3ec2d1889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:40.611151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e9f08-b1e5-4cba-9aa9-d8f3ec2d1889 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:40.611432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e9f08-b1e5-4cba-9aa9-d8f3ec2d1889 admin admin] PATH_INFO: `/v3/users/20857b321287460188182a6b0abbbe54` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:40.612578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e9f08-b1e5-4cba-9aa9-d8f3ec2d1889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20857b321287460188182a6b0abbbe54)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:40.615199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e9f08-b1e5-4cba-9aa9-d8f3ec2d1889 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:40.957460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c91e9f08-b1e5-4cba-9aa9-d8f3ec2d1889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20857b321287460188182a6b0abbbe54'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:40.958545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c91e9f08-b1e5-4cba-9aa9-d8f3ec2d1889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20857b321287460188182a6b0abbbe54'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:41.014458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c91e9f08-b1e5-4cba-9aa9-d8f3ec2d1889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20857b321287460188182a6b0abbbe54'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:41.053505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c91e9f08-b1e5-4cba-9aa9-d8f3ec2d1889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20857b321287460188182a6b0abbbe54'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:41.122105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c91e9f08-b1e5-4cba-9aa9-d8f3ec2d1889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20857b321287460188182a6b0abbbe54'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:41.129432 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2194/4417] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:40 2022] DELETE /identity/v3/users/20857b321287460188182a6b0abbbe54 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:41.970241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b314a-5976-4795-8082-19cb09a013af admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:41.972109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3f0b314a-5976-4795-8082-19cb09a013af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:42.007030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b314a-5976-4795-8082-19cb09a013af admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:42.103014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b2187-1795-4929-81f5-75adee4f7228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:42.104791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b2187-1795-4929-81f5-75adee4f7228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:42.106003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b2187-1795-4929-81f5-75adee4f7228 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:42.106472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b2187-1795-4929-81f5-75adee4f7228 admin admin] PATH_INFO: `/v3/projects/5dd64980bf5449d8a666f3a23cd4b750` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:42.108184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b2187-1795-4929-81f5-75adee4f7228 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dd64980bf5449d8a666f3a23cd4b750)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:42.112223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b2187-1795-4929-81f5-75adee4f7228 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:42.142637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:42.239209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c24b2187-1795-4929-81f5-75adee4f7228 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dd64980bf5449d8a666f3a23cd4b750', 'request_id': 'req-c24b2187-1795-4929-81f5-75adee4f7228'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:42.259286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c24b2187-1795-4929-81f5-75adee4f7228 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dd64980bf5449d8a666f3a23cd4b750', 'request_id': 'req-c24b2187-1795-4929-81f5-75adee4f7228'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:42.262851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c24b2187-1795-4929-81f5-75adee4f7228 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dd64980bf5449d8a666f3a23cd4b750', 'request_id': 'req-c24b2187-1795-4929-81f5-75adee4f7228'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:42.426389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c24b2187-1795-4929-81f5-75adee4f7228 admin admin] The token cache is being invalidate because project 5dd64980bf5449d8a666f3a23cd4b750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:42.426389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c24b2187-1795-4929-81f5-75adee4f7228 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:42.429195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c24b2187-1795-4929-81f5-75adee4f7228 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:42.430349 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2224/4418] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:43:41 2022] DELETE /identity/v3/projects/5dd64980bf5449d8a666f3a23cd4b750 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:42.443684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1c7ce-6df3-4d66-83d1-920f22781a97 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:42.444268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1c7ce-6df3-4d66-83d1-920f22781a97 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:42.444268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1c7ce-6df3-4d66-83d1-920f22781a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:42.486672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-44e1c7ce-6df3-4d66-83d1-920f22781a97 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:42.488209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-44e1c7ce-6df3-4d66-83d1-920f22781a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:42.526514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:42.631886 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2195/4419] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:42.639243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06027f-5155-4d14-a11b-1232ec437722 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:42.639780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06027f-5155-4d14-a11b-1232ec437722 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:42.640140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06027f-5155-4d14-a11b-1232ec437722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:42.687886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8e06027f-5155-4d14-a11b-1232ec437722 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:42.689181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8e06027f-5155-4d14-a11b-1232ec437722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:42.702890 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2225/4420] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:42.710608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1c7ce-6df3-4d66-83d1-920f22781a97 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:42.721724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1c7ce-6df3-4d66-83d1-920f22781a97 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:42.731419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b419d-909e-4140-a7d4-582db72294c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:42.732143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b419d-909e-4140-a7d4-582db72294c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:42.732431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b419d-909e-4140-a7d4-582db72294c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:42.732762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b419d-909e-4140-a7d4-582db72294c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:42.733426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b419d-909e-4140-a7d4-582db72294c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:43:42.733731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b419d-909e-4140-a7d4-582db72294c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:42.736186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b419d-909e-4140-a7d4-582db72294c7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:42.756256 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2196/4421] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:43:42.757658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06027f-5155-4d14-a11b-1232ec437722 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:42.767404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06027f-5155-4d14-a11b-1232ec437722 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:42.782710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49712b8-8fda-4bc8-a7ff-477d20043bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:42.783522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49712b8-8fda-4bc8-a7ff-477d20043bac admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:42.783906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49712b8-8fda-4bc8-a7ff-477d20043bac admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:42.784418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49712b8-8fda-4bc8-a7ff-477d20043bac admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:42.786734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49712b8-8fda-4bc8-a7ff-477d20043bac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:42.788911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49712b8-8fda-4bc8-a7ff-477d20043bac admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:42.870547 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2226/4422] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:43:42 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:43:42.874808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b419d-909e-4140-a7d4-582db72294c7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:42.887631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b419d-909e-4140-a7d4-582db72294c7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:42.982357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c44cd-41cd-4d37-a551-315a666e1f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:42.983154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c44cd-41cd-4d37-a551-315a666e1f58 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:42.983496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c44cd-41cd-4d37-a551-315a666e1f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:42.983783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c44cd-41cd-4d37-a551-315a666e1f58 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:42.984442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c44cd-41cd-4d37-a551-315a666e1f58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:42.986590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c44cd-41cd-4d37-a551-315a666e1f58 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:43.100469 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2197/4423] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:43:42 2022] POST /identity/v3/users => generated 285 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:43.102422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49712b8-8fda-4bc8-a7ff-477d20043bac admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:43.116338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49712b8-8fda-4bc8-a7ff-477d20043bac admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:43.121749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd489e5-d538-4f7d-b0cc-9f8695d8a266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:43.122637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd489e5-d538-4f7d-b0cc-9f8695d8a266 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:43.123427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd489e5-d538-4f7d-b0cc-9f8695d8a266 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:43.123863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd489e5-d538-4f7d-b0cc-9f8695d8a266 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:43.124691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd489e5-d538-4f7d-b0cc-9f8695d8a266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:43.127264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd489e5-d538-4f7d-b0cc-9f8695d8a266 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:43.142084 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2227/4424] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:43.145302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c44cd-41cd-4d37-a551-315a666e1f58 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:43.156581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c44cd-41cd-4d37-a551-315a666e1f58 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:43.161514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb94bcc-0211-4d35-832d-b6442e3f97cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:43.162178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb94bcc-0211-4d35-832d-b6442e3f97cb admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:43.164614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb94bcc-0211-4d35-832d-b6442e3f97cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:43.164614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb94bcc-0211-4d35-832d-b6442e3f97cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:43.164614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb94bcc-0211-4d35-832d-b6442e3f97cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:43.165015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb94bcc-0211-4d35-832d-b6442e3f97cb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:43.182784 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2198/4425] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:43.183001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd489e5-d538-4f7d-b0cc-9f8695d8a266 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:43.201686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd489e5-d538-4f7d-b0cc-9f8695d8a266 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:43.206250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891f3b4-9abd-437a-bd81-7bf00dee7150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:43.207147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891f3b4-9abd-437a-bd81-7bf00dee7150 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:43.207434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891f3b4-9abd-437a-bd81-7bf00dee7150 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:43.207712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891f3b4-9abd-437a-bd81-7bf00dee7150 admin admin] PATH_INFO: `/v3/projects/99aedbd922f8478682aae127f0141eb4/users/c84d5b75973b47d2957fdfd661687445/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:43.230536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891f3b4-9abd-437a-bd81-7bf00dee7150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99aedbd922f8478682aae127f0141eb4, user_id=c84d5b75973b47d2957fdfd661687445, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:43.232992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891f3b4-9abd-437a-bd81-7bf00dee7150 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:43.305409 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2228/4426] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:43:43 2022] PUT /identity/v3/projects/99aedbd922f8478682aae127f0141eb4/users/c84d5b75973b47d2957fdfd661687445/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:43:43.317633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157e2e5-352f-4c26-87bc-38a63012fcc3 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:43.317920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157e2e5-352f-4c26-87bc-38a63012fcc3 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:43.318229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157e2e5-352f-4c26-87bc-38a63012fcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:43.352029 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c157e2e5-352f-4c26-87bc-38a63012fcc3 None None] MFA Rules not processed for user `c84d5b75973b47d2957fdfd661687445`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:43.353225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c157e2e5-352f-4c26-87bc-38a63012fcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:43.448541 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2199/4427] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:43.449629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891f3b4-9abd-437a-bd81-7bf00dee7150 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:43.558467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891f3b4-9abd-437a-bd81-7bf00dee7150 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:43.571692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad4cf0-dfba-4bc1-82d5-6f9941ee6d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:43.572340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad4cf0-dfba-4bc1-82d5-6f9941ee6d06 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:43.572639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad4cf0-dfba-4bc1-82d5-6f9941ee6d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:43.573267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad4cf0-dfba-4bc1-82d5-6f9941ee6d06 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:43.573564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad4cf0-dfba-4bc1-82d5-6f9941ee6d06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:43.575529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad4cf0-dfba-4bc1-82d5-6f9941ee6d06 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:43.711041 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2229/4428] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:43:43 2022] POST /identity/v3/projects => generated 369 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:43.712727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157e2e5-352f-4c26-87bc-38a63012fcc3 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:43.726381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157e2e5-352f-4c26-87bc-38a63012fcc3 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:43.740137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:43.796781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf1678-58e7-46ba-be33-df52fa2f584d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:43.799273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf1678-58e7-46ba-be33-df52fa2f584d admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:43.799273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf1678-58e7-46ba-be33-df52fa2f584d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:43.799273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf1678-58e7-46ba-be33-df52fa2f584d admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:43.799273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf1678-58e7-46ba-be33-df52fa2f584d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:43.800439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf1678-58e7-46ba-be33-df52fa2f584d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:43.914986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad4cf0-dfba-4bc1-82d5-6f9941ee6d06 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:43.923860 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2200/4429] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:43:43 2022] POST /identity/v3/users => generated 285 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:43.928215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad4cf0-dfba-4bc1-82d5-6f9941ee6d06 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:43.934101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0144083-1752-48d7-9790-a6997fa90570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:43.934732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0144083-1752-48d7-9790-a6997fa90570 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:43.935016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0144083-1752-48d7-9790-a6997fa90570 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:43.935294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0144083-1752-48d7-9790-a6997fa90570 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:43.936007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0144083-1752-48d7-9790-a6997fa90570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:43.938385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0144083-1752-48d7-9790-a6997fa90570 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:43.958645 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2230/4430] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:43.959666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf1678-58e7-46ba-be33-df52fa2f584d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:43.974389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf1678-58e7-46ba-be33-df52fa2f584d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:43.980791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8952b-3f92-435e-b8f5-a4ccc6f03a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:43.981546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8952b-3f92-435e-b8f5-a4ccc6f03a47 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:43.982468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8952b-3f92-435e-b8f5-a4ccc6f03a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:43.982899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8952b-3f92-435e-b8f5-a4ccc6f03a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:43.983572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8952b-3f92-435e-b8f5-a4ccc6f03a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:43.985200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8952b-3f92-435e-b8f5-a4ccc6f03a47 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:44.001612 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2201/4431] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:43:44.006628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0144083-1752-48d7-9790-a6997fa90570 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:44.017021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0144083-1752-48d7-9790-a6997fa90570 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:44.022860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ece033-2d13-4417-afe0-5bc06d43aec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:44.023527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ece033-2d13-4417-afe0-5bc06d43aec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:44.023808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ece033-2d13-4417-afe0-5bc06d43aec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:44.024108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ece033-2d13-4417-afe0-5bc06d43aec2 admin admin] PATH_INFO: `/v3/projects/2e8d9e0291d84acd81d0fe1428982501/users/b0e57ec304554a83b386c677d848f0e2/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:44.040813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ece033-2d13-4417-afe0-5bc06d43aec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e8d9e0291d84acd81d0fe1428982501, user_id=b0e57ec304554a83b386c677d848f0e2, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:44.043636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ece033-2d13-4417-afe0-5bc06d43aec2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:44.046333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:44.149712 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2231/4432] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:43:44 2022] PUT /identity/v3/projects/2e8d9e0291d84acd81d0fe1428982501/users/b0e57ec304554a83b386c677d848f0e2/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:44.159378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7bf3f-7b65-42c7-83ee-74d6d5e28319 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:44.164442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7bf3f-7b65-42c7-83ee-74d6d5e28319 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:44.164845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7bf3f-7b65-42c7-83ee-74d6d5e28319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:44.229478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f0c7bf3f-7b65-42c7-83ee-74d6d5e28319 None None] MFA Rules not processed for user `b0e57ec304554a83b386c677d848f0e2`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:44.231002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f0c7bf3f-7b65-42c7-83ee-74d6d5e28319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:44.411005 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2202/4433] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:44.432229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ece033-2d13-4417-afe0-5bc06d43aec2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:44.434235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-25ece033-2d13-4417-afe0-5bc06d43aec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:44.547873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ece033-2d13-4417-afe0-5bc06d43aec2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:44.551602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3c460-8aab-43f8-873e-7eb84ba36295 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:44.552215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3c460-8aab-43f8-873e-7eb84ba36295 service glance] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:44.552499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3c460-8aab-43f8-873e-7eb84ba36295 service glance] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:44.552777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3c460-8aab-43f8-873e-7eb84ba36295 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:44.619783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7bf3f-7b65-42c7-83ee-74d6d5e28319 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:44.621458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f0c7bf3f-7b65-42c7-83ee-74d6d5e28319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:44.629544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3c460-8aab-43f8-873e-7eb84ba36295 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:44.632323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3c460-8aab-43f8-873e-7eb84ba36295 service glance] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:44.642398 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2232/4434] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:43:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:43:44.755789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7bf3f-7b65-42c7-83ee-74d6d5e28319 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:44.762430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e5708-c9c4-4cd2-8edb-01f8aa3dda8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:44.763248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e5708-c9c4-4cd2-8edb-01f8aa3dda8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:44.764232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e5708-c9c4-4cd2-8edb-01f8aa3dda8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:44.764232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e5708-c9c4-4cd2-8edb-01f8aa3dda8b admin admin] PATH_INFO: `/v3/users/e9a1a8d8c9004318b5d48a2036edefa9` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:44.765582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e5708-c9c4-4cd2-8edb-01f8aa3dda8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9a1a8d8c9004318b5d48a2036edefa9)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:44.767698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e5708-c9c4-4cd2-8edb-01f8aa3dda8b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:44.872630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:44.992469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3c460-8aab-43f8-873e-7eb84ba36295 service glance] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:45.013416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3c460-8aab-43f8-873e-7eb84ba36295 service glance] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:45.019595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c581951-9dba-4340-8209-e34908741931 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:45.020224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c581951-9dba-4340-8209-e34908741931 service glance] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:45.020698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c581951-9dba-4340-8209-e34908741931 service glance] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:45.020979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c581951-9dba-4340-8209-e34908741931 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:45.022744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-875e5708-c9c4-4cd2-8edb-01f8aa3dda8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9a1a8d8c9004318b5d48a2036edefa9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:45.023638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-875e5708-c9c4-4cd2-8edb-01f8aa3dda8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9a1a8d8c9004318b5d48a2036edefa9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:45.031871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c581951-9dba-4340-8209-e34908741931 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:45.033486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-875e5708-c9c4-4cd2-8edb-01f8aa3dda8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9a1a8d8c9004318b5d48a2036edefa9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:45.033614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c581951-9dba-4340-8209-e34908741931 service glance] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:45.045588 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2233/4435] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:43:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:43:45.049722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-875e5708-c9c4-4cd2-8edb-01f8aa3dda8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9a1a8d8c9004318b5d48a2036edefa9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:45.121712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-875e5708-c9c4-4cd2-8edb-01f8aa3dda8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9a1a8d8c9004318b5d48a2036edefa9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:45.128545 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2203/4436] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:44 2022] DELETE /identity/v3/users/e9a1a8d8c9004318b5d48a2036edefa9 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:43:45.133947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcbd15-5e64-47e1-b3b6-59c11f134797 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:45.134304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcbd15-5e64-47e1-b3b6-59c11f134797 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:45.134588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcbd15-5e64-47e1-b3b6-59c11f134797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:45.156299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-94fcbd15-5e64-47e1-b3b6-59c11f134797 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:45.160754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-94fcbd15-5e64-47e1-b3b6-59c11f134797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:45.237908 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2234/4437] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:45.247214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e5708-c9c4-4cd2-8edb-01f8aa3dda8b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:45.251729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-875e5708-c9c4-4cd2-8edb-01f8aa3dda8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:45.325172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e5708-c9c4-4cd2-8edb-01f8aa3dda8b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:45.330583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff4a70-cb1a-4a72-b6d3-6fa9414b2e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:45.331324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff4a70-cb1a-4a72-b6d3-6fa9414b2e43 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:45.331694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff4a70-cb1a-4a72-b6d3-6fa9414b2e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:45.332060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff4a70-cb1a-4a72-b6d3-6fa9414b2e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:45.344986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff4a70-cb1a-4a72-b6d3-6fa9414b2e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:45.346115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff4a70-cb1a-4a72-b6d3-6fa9414b2e43 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:45.357765 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2204/4438] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:43:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:43:45.686553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcbd15-5e64-47e1-b3b6-59c11f134797 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:45.688188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-94fcbd15-5e64-47e1-b3b6-59c11f134797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:45.721091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcbd15-5e64-47e1-b3b6-59c11f134797 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:45.734095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613bda2-1599-46a9-a1fa-c5452a01ae9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:45.735171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613bda2-1599-46a9-a1fa-c5452a01ae9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:45.735652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613bda2-1599-46a9-a1fa-c5452a01ae9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:45.736122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613bda2-1599-46a9-a1fa-c5452a01ae9e admin admin] PATH_INFO: `/v3/projects/4f70d6a092214b1d9a605d0557246d36` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:45.737528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613bda2-1599-46a9-a1fa-c5452a01ae9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f70d6a092214b1d9a605d0557246d36)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:45.740564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613bda2-1599-46a9-a1fa-c5452a01ae9e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:45.769966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:45.903166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5613bda2-1599-46a9-a1fa-c5452a01ae9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f70d6a092214b1d9a605d0557246d36', 'request_id': 'req-5613bda2-1599-46a9-a1fa-c5452a01ae9e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:45.913532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5613bda2-1599-46a9-a1fa-c5452a01ae9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f70d6a092214b1d9a605d0557246d36', 'request_id': 'req-5613bda2-1599-46a9-a1fa-c5452a01ae9e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:45.921400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5613bda2-1599-46a9-a1fa-c5452a01ae9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f70d6a092214b1d9a605d0557246d36', 'request_id': 'req-5613bda2-1599-46a9-a1fa-c5452a01ae9e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:46.023378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5613bda2-1599-46a9-a1fa-c5452a01ae9e admin admin] The token cache is being invalidate because project 4f70d6a092214b1d9a605d0557246d36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:46.023875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5613bda2-1599-46a9-a1fa-c5452a01ae9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:46.026580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5613bda2-1599-46a9-a1fa-c5452a01ae9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:46.031284 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2235/4439] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:43:45 2022] DELETE /identity/v3/projects/4f70d6a092214b1d9a605d0557246d36 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:46.036514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f7ba5-8f6f-409f-a1be-82a778f3fc24 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:46.037373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f7ba5-8f6f-409f-a1be-82a778f3fc24 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:46.038352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f7ba5-8f6f-409f-a1be-82a778f3fc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:46.094587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-288f7ba5-8f6f-409f-a1be-82a778f3fc24 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:46.095817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-288f7ba5-8f6f-409f-a1be-82a778f3fc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:46.230544 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2205/4440] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:46.238069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53f2ab-4d8e-411f-ad52-57c4bb1a31b4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:46.238569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53f2ab-4d8e-411f-ad52-57c4bb1a31b4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:46.238893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53f2ab-4d8e-411f-ad52-57c4bb1a31b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:46.270089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-aa53f2ab-4d8e-411f-ad52-57c4bb1a31b4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:46.272592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-aa53f2ab-4d8e-411f-ad52-57c4bb1a31b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:46.284360 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2236/4441] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:46.289694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f7ba5-8f6f-409f-a1be-82a778f3fc24 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:46.306467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f7ba5-8f6f-409f-a1be-82a778f3fc24 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:46.324686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868612f-c1b9-4dd4-aa19-88c021ce9aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:46.325521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868612f-c1b9-4dd4-aa19-88c021ce9aaa admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:46.326225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868612f-c1b9-4dd4-aa19-88c021ce9aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:46.327265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868612f-c1b9-4dd4-aa19-88c021ce9aaa admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:46.328100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868612f-c1b9-4dd4-aa19-88c021ce9aaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:43:46.328864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868612f-c1b9-4dd4-aa19-88c021ce9aaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:46.332474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868612f-c1b9-4dd4-aa19-88c021ce9aaa admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:46.353195 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2206/4442] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:43:46.357547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53f2ab-4d8e-411f-ad52-57c4bb1a31b4 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:46.368643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53f2ab-4d8e-411f-ad52-57c4bb1a31b4 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:46.374578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae39d1-b688-497d-8f8a-ef14a011dc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:46.375508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae39d1-b688-497d-8f8a-ef14a011dc1c admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:46.376058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae39d1-b688-497d-8f8a-ef14a011dc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:46.376554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae39d1-b688-497d-8f8a-ef14a011dc1c admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:46.377481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae39d1-b688-497d-8f8a-ef14a011dc1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:46.380343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae39d1-b688-497d-8f8a-ef14a011dc1c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:46.490828 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2237/4443] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:43:46 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:46.497127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868612f-c1b9-4dd4-aa19-88c021ce9aaa admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:46.513306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868612f-c1b9-4dd4-aa19-88c021ce9aaa admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:46.555887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:46.620086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac415d9-5c30-467a-9092-ef4c5d09f20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:46.621919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac415d9-5c30-467a-9092-ef4c5d09f20d admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:46.623205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac415d9-5c30-467a-9092-ef4c5d09f20d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:46.624227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac415d9-5c30-467a-9092-ef4c5d09f20d admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:46.625999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac415d9-5c30-467a-9092-ef4c5d09f20d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:46.629622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac415d9-5c30-467a-9092-ef4c5d09f20d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:46.731654 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2207/4444] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:43:46 2022] POST /identity/v3/users => generated 291 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:46.735362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae39d1-b688-497d-8f8a-ef14a011dc1c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:46.746909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae39d1-b688-497d-8f8a-ef14a011dc1c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:46.751858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd51a99-b002-4ab3-bcfd-a881a49dba2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:46.752523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd51a99-b002-4ab3-bcfd-a881a49dba2a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:46.752811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd51a99-b002-4ab3-bcfd-a881a49dba2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:46.753143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd51a99-b002-4ab3-bcfd-a881a49dba2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:46.753802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd51a99-b002-4ab3-bcfd-a881a49dba2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:46.756029 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd51a99-b002-4ab3-bcfd-a881a49dba2a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:46.771218 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2238/4445] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:46.775337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac415d9-5c30-467a-9092-ef4c5d09f20d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:46.785421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac415d9-5c30-467a-9092-ef4c5d09f20d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:46.790144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e778f51-4376-4570-b3a5-c310c202c2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:46.790744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e778f51-4376-4570-b3a5-c310c202c2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:46.791025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e778f51-4376-4570-b3a5-c310c202c2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:46.791296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e778f51-4376-4570-b3a5-c310c202c2e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:46.791967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e778f51-4376-4570-b3a5-c310c202c2e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:46.793554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e778f51-4376-4570-b3a5-c310c202c2e9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:46.810168 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2208/4446] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:43:46.814111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd51a99-b002-4ab3-bcfd-a881a49dba2a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:46.826986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd51a99-b002-4ab3-bcfd-a881a49dba2a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:46.832251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922a40c-a37f-437e-aa95-38d8cef4fdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:46.837157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922a40c-a37f-437e-aa95-38d8cef4fdef admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:46.837157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922a40c-a37f-437e-aa95-38d8cef4fdef admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:46.837157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922a40c-a37f-437e-aa95-38d8cef4fdef admin admin] PATH_INFO: `/v3/projects/c5bee28100e648919e06446cf7c627b6/users/a2b49a82d97941d9b4bf278b14f0e84e/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:46.859836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922a40c-a37f-437e-aa95-38d8cef4fdef admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5bee28100e648919e06446cf7c627b6, user_id=a2b49a82d97941d9b4bf278b14f0e84e, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:46.863179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922a40c-a37f-437e-aa95-38d8cef4fdef admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:46.970447 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2239/4447] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:43:46 2022] PUT /identity/v3/projects/c5bee28100e648919e06446cf7c627b6/users/a2b49a82d97941d9b4bf278b14f0e84e/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:46.980504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3c2dc-652b-4eea-93d4-d5ea30e5867d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:46.980939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3c2dc-652b-4eea-93d4-d5ea30e5867d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:46.981404 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3c2dc-652b-4eea-93d4-d5ea30e5867d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:47.022008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-16f3c2dc-652b-4eea-93d4-d5ea30e5867d None None] MFA Rules not processed for user `a2b49a82d97941d9b4bf278b14f0e84e`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:47.023527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-16f3c2dc-652b-4eea-93d4-d5ea30e5867d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:47.109191 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2209/4448] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:43:47.121346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922a40c-a37f-437e-aa95-38d8cef4fdef admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:47.123179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e922a40c-a37f-437e-aa95-38d8cef4fdef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:47.233671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922a40c-a37f-437e-aa95-38d8cef4fdef admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:47.250302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0fe64-709c-4272-9ece-2d99b3ecea16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:47.251514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0fe64-709c-4272-9ece-2d99b3ecea16 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:47.251878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0fe64-709c-4272-9ece-2d99b3ecea16 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:47.252251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0fe64-709c-4272-9ece-2d99b3ecea16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:47.263638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0fe64-709c-4272-9ece-2d99b3ecea16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:47.265691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0fe64-709c-4272-9ece-2d99b3ecea16 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:47.283654 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2240/4449] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:43:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:43:48.491454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3c2dc-652b-4eea-93d4-d5ea30e5867d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:48.493181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-16f3c2dc-652b-4eea-93d4-d5ea30e5867d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:48.566021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3c2dc-652b-4eea-93d4-d5ea30e5867d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:48.571778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b84017-a00f-402c-b61d-9cefde720f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:48.572412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b84017-a00f-402c-b61d-9cefde720f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:48.572705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b84017-a00f-402c-b61d-9cefde720f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:48.572986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b84017-a00f-402c-b61d-9cefde720f5a admin admin] PATH_INFO: `/v3/users/c84d5b75973b47d2957fdfd661687445` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:48.574233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b84017-a00f-402c-b61d-9cefde720f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c84d5b75973b47d2957fdfd661687445)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:48.576136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b84017-a00f-402c-b61d-9cefde720f5a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:48.790741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:48.794164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b2b84017-a00f-402c-b61d-9cefde720f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c84d5b75973b47d2957fdfd661687445'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:48.794775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b2b84017-a00f-402c-b61d-9cefde720f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c84d5b75973b47d2957fdfd661687445'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:48.803164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b2b84017-a00f-402c-b61d-9cefde720f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c84d5b75973b47d2957fdfd661687445'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:48.818555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b2b84017-a00f-402c-b61d-9cefde720f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c84d5b75973b47d2957fdfd661687445'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:48.921472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b2b84017-a00f-402c-b61d-9cefde720f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c84d5b75973b47d2957fdfd661687445'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:48.935400 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2210/4450] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:48 2022] DELETE /identity/v3/users/c84d5b75973b47d2957fdfd661687445 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:48.937610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e10960-5d29-45a9-b78e-890492ab8d5d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:48.938494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e10960-5d29-45a9-b78e-890492ab8d5d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:48.938779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e10960-5d29-45a9-b78e-890492ab8d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:48.965862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-58e10960-5d29-45a9-b78e-890492ab8d5d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:48.967413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-58e10960-5d29-45a9-b78e-890492ab8d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:49.015334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:49.031720 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2241/4451] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:49.043181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b84017-a00f-402c-b61d-9cefde720f5a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:49.044952 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b2b84017-a00f-402c-b61d-9cefde720f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:49.113528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b84017-a00f-402c-b61d-9cefde720f5a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:49.118801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad3a5a-226f-4535-84ab-540e47efc999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:49.119472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad3a5a-226f-4535-84ab-540e47efc999 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:49.119755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad3a5a-226f-4535-84ab-540e47efc999 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:49.120046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad3a5a-226f-4535-84ab-540e47efc999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:49.129474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad3a5a-226f-4535-84ab-540e47efc999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:49.130964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad3a5a-226f-4535-84ab-540e47efc999 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:49.140848 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2211/4452] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:43:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:43:49.639462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e10960-5d29-45a9-b78e-890492ab8d5d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:49.641372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-58e10960-5d29-45a9-b78e-890492ab8d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:49.654661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e10960-5d29-45a9-b78e-890492ab8d5d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:49.687486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2cbff-0e93-43b5-acd6-ac7f01e72b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:49.687486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2cbff-0e93-43b5-acd6-ac7f01e72b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:49.687486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2cbff-0e93-43b5-acd6-ac7f01e72b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:49.687486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2cbff-0e93-43b5-acd6-ac7f01e72b9f admin admin] PATH_INFO: `/v3/projects/99aedbd922f8478682aae127f0141eb4` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:49.690854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2cbff-0e93-43b5-acd6-ac7f01e72b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=99aedbd922f8478682aae127f0141eb4)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:49.693361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2cbff-0e93-43b5-acd6-ac7f01e72b9f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:49.887984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0ea2cbff-0e93-43b5-acd6-ac7f01e72b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99aedbd922f8478682aae127f0141eb4', 'request_id': 'req-0ea2cbff-0e93-43b5-acd6-ac7f01e72b9f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:49.899822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0ea2cbff-0e93-43b5-acd6-ac7f01e72b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99aedbd922f8478682aae127f0141eb4', 'request_id': 'req-0ea2cbff-0e93-43b5-acd6-ac7f01e72b9f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:49.908832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0ea2cbff-0e93-43b5-acd6-ac7f01e72b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99aedbd922f8478682aae127f0141eb4', 'request_id': 'req-0ea2cbff-0e93-43b5-acd6-ac7f01e72b9f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:49.986938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0ea2cbff-0e93-43b5-acd6-ac7f01e72b9f admin admin] The token cache is being invalidate because project 99aedbd922f8478682aae127f0141eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:49.987660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0ea2cbff-0e93-43b5-acd6-ac7f01e72b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:49.988371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0ea2cbff-0e93-43b5-acd6-ac7f01e72b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:49.990603 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2242/4453] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:43:49 2022] DELETE /identity/v3/projects/99aedbd922f8478682aae127f0141eb4 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:49.996604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad3a5a-226f-4535-84ab-540e47efc999 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:50.019183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad3a5a-226f-4535-84ab-540e47efc999 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:50.139715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e1411-f395-4044-a450-9648946dbe07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:50.140551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e1411-f395-4044-a450-9648946dbe07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:50.141001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e1411-f395-4044-a450-9648946dbe07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:50.141431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e1411-f395-4044-a450-9648946dbe07 admin admin] PATH_INFO: `/v3/users/b0e57ec304554a83b386c677d848f0e2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:50.142848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e1411-f395-4044-a450-9648946dbe07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0e57ec304554a83b386c677d848f0e2)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:50.145254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e1411-f395-4044-a450-9648946dbe07 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:50.383917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c92e1411-f395-4044-a450-9648946dbe07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0e57ec304554a83b386c677d848f0e2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:50.384653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c92e1411-f395-4044-a450-9648946dbe07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0e57ec304554a83b386c677d848f0e2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:50.393852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c92e1411-f395-4044-a450-9648946dbe07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0e57ec304554a83b386c677d848f0e2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:50.403662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:50.410231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c92e1411-f395-4044-a450-9648946dbe07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0e57ec304554a83b386c677d848f0e2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:50.505392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c92e1411-f395-4044-a450-9648946dbe07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0e57ec304554a83b386c677d848f0e2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:50.515244 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2212/4454] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:43:49 2022] DELETE /identity/v3/users/b0e57ec304554a83b386c677d848f0e2 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:50.997936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2cbff-0e93-43b5-acd6-ac7f01e72b9f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:50.999999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0ea2cbff-0e93-43b5-acd6-ac7f01e72b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:51.015911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2cbff-0e93-43b5-acd6-ac7f01e72b9f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:51.102799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9564ffe-a9d4-4b87-920c-708f58108fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:51.103712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9564ffe-a9d4-4b87-920c-708f58108fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:51.103817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9564ffe-a9d4-4b87-920c-708f58108fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:51.104062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9564ffe-a9d4-4b87-920c-708f58108fa8 admin admin] PATH_INFO: `/v3/projects/2e8d9e0291d84acd81d0fe1428982501` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:51.105519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9564ffe-a9d4-4b87-920c-708f58108fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e8d9e0291d84acd81d0fe1428982501)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:51.109858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9564ffe-a9d4-4b87-920c-708f58108fa8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:51.234097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a9564ffe-a9d4-4b87-920c-708f58108fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e8d9e0291d84acd81d0fe1428982501', 'request_id': 'req-a9564ffe-a9d4-4b87-920c-708f58108fa8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:51.243697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a9564ffe-a9d4-4b87-920c-708f58108fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e8d9e0291d84acd81d0fe1428982501', 'request_id': 'req-a9564ffe-a9d4-4b87-920c-708f58108fa8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:51.252287 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a9564ffe-a9d4-4b87-920c-708f58108fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e8d9e0291d84acd81d0fe1428982501', 'request_id': 'req-a9564ffe-a9d4-4b87-920c-708f58108fa8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:51.322977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a9564ffe-a9d4-4b87-920c-708f58108fa8 admin admin] The token cache is being invalidate because project 2e8d9e0291d84acd81d0fe1428982501 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:43:51.323772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a9564ffe-a9d4-4b87-920c-708f58108fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:51.324608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a9564ffe-a9d4-4b87-920c-708f58108fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:43:51.327340 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2243/4455] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:43:50 2022] DELETE /identity/v3/projects/2e8d9e0291d84acd81d0fe1428982501 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:51.335547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a695ba-8913-4eb7-955c-09899470f037 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:51.336091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a695ba-8913-4eb7-955c-09899470f037 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:51.336091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a695ba-8913-4eb7-955c-09899470f037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:51.364509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-00a695ba-8913-4eb7-955c-09899470f037 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:51.365963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-00a695ba-8913-4eb7-955c-09899470f037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:51.442919 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2213/4456] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:51.450394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906fd48-aed0-4722-bb8b-19bc3146af50 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:51.450912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906fd48-aed0-4722-bb8b-19bc3146af50 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:51.451326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906fd48-aed0-4722-bb8b-19bc3146af50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:51.459999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:51.514992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0906fd48-aed0-4722-bb8b-19bc3146af50 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:51.517697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0906fd48-aed0-4722-bb8b-19bc3146af50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:51.543566 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2244/4457] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:51.548747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a695ba-8913-4eb7-955c-09899470f037 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:51.562262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a695ba-8913-4eb7-955c-09899470f037 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:51.568209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146d54d-4a4b-45e0-b9d8-724a969a8bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:51.569060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146d54d-4a4b-45e0-b9d8-724a969a8bea admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:51.569347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146d54d-4a4b-45e0-b9d8-724a969a8bea admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:51.569629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146d54d-4a4b-45e0-b9d8-724a969a8bea admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:51.570325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146d54d-4a4b-45e0-b9d8-724a969a8bea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:43:51.570841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146d54d-4a4b-45e0-b9d8-724a969a8bea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:51.572419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146d54d-4a4b-45e0-b9d8-724a969a8bea admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:51.589565 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2214/4458] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:43:51.593889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906fd48-aed0-4722-bb8b-19bc3146af50 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:51.610795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906fd48-aed0-4722-bb8b-19bc3146af50 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:51.613002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e37c81-d6cb-40d4-8846-120ecb676314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:51.613693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e37c81-d6cb-40d4-8846-120ecb676314 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:51.614560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e37c81-d6cb-40d4-8846-120ecb676314 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:51.614841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e37c81-d6cb-40d4-8846-120ecb676314 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:51.615476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e37c81-d6cb-40d4-8846-120ecb676314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:51.617479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e37c81-d6cb-40d4-8846-120ecb676314 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:51.755781 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2245/4459] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:43:51 2022] POST /identity/v3/projects => generated 397 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:51.763540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146d54d-4a4b-45e0-b9d8-724a969a8bea admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:51.779569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146d54d-4a4b-45e0-b9d8-724a969a8bea admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:51.849210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62392cfc-d0ed-48cd-9d6a-828386b00203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:51.850645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62392cfc-d0ed-48cd-9d6a-828386b00203 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:51.852657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62392cfc-d0ed-48cd-9d6a-828386b00203 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:51.853991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62392cfc-d0ed-48cd-9d6a-828386b00203 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:51.856138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62392cfc-d0ed-48cd-9d6a-828386b00203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:51.859426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62392cfc-d0ed-48cd-9d6a-828386b00203 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:51.962564 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2215/4460] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:43:51 2022] POST /identity/v3/users => generated 299 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:43:51.966829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e37c81-d6cb-40d4-8846-120ecb676314 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:51.978880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e37c81-d6cb-40d4-8846-120ecb676314 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:51.985132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a126d-da0a-4f19-bcd2-aec756a8a2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:51.985804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a126d-da0a-4f19-bcd2-aec756a8a2dc admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:51.986109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a126d-da0a-4f19-bcd2-aec756a8a2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:51.986635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a126d-da0a-4f19-bcd2-aec756a8a2dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:51.987292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a126d-da0a-4f19-bcd2-aec756a8a2dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:51.988968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a126d-da0a-4f19-bcd2-aec756a8a2dc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:52.000582 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2246/4461] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:52.005235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62392cfc-d0ed-48cd-9d6a-828386b00203 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:52.015788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62392cfc-d0ed-48cd-9d6a-828386b00203 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:52.021772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a705232-b04e-49a8-8c3a-ff28c9156f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:52.022617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a705232-b04e-49a8-8c3a-ff28c9156f5e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:52.022804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a705232-b04e-49a8-8c3a-ff28c9156f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:52.023229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a705232-b04e-49a8-8c3a-ff28c9156f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:52.024128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a705232-b04e-49a8-8c3a-ff28c9156f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:52.025834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a705232-b04e-49a8-8c3a-ff28c9156f5e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:52.039819 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2216/4462] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:43:52.046947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a126d-da0a-4f19-bcd2-aec756a8a2dc admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:52.061917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a126d-da0a-4f19-bcd2-aec756a8a2dc admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:52.069050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229fd03-5dd1-4094-8648-68fb184d1c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:52.069813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229fd03-5dd1-4094-8648-68fb184d1c06 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:52.070226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229fd03-5dd1-4094-8648-68fb184d1c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:52.070510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229fd03-5dd1-4094-8648-68fb184d1c06 admin admin] PATH_INFO: `/v3/projects/c068b0f1dd5047558b5ebaa5051bea03/users/1c31cc9fdea545c484496e9534c1218f/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:52.090329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229fd03-5dd1-4094-8648-68fb184d1c06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c068b0f1dd5047558b5ebaa5051bea03, user_id=1c31cc9fdea545c484496e9534c1218f, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:52.093104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229fd03-5dd1-4094-8648-68fb184d1c06 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:52.166916 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2247/4463] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:43:52 2022] PUT /identity/v3/projects/c068b0f1dd5047558b5ebaa5051bea03/users/1c31cc9fdea545c484496e9534c1218f/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:43:52.182996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da759a-6265-45d2-8980-4e0ecce43d47 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:52.183264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da759a-6265-45d2-8980-4e0ecce43d47 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:52.183560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da759a-6265-45d2-8980-4e0ecce43d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:52.252818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a0da759a-6265-45d2-8980-4e0ecce43d47 None None] MFA Rules not processed for user `1c31cc9fdea545c484496e9534c1218f`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:52.254129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a0da759a-6265-45d2-8980-4e0ecce43d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:52.305830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:52.353720 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2217/4464] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:52 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:43:52.360652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229fd03-5dd1-4094-8648-68fb184d1c06 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:43:52.362599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a229fd03-5dd1-4094-8648-68fb184d1c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:52.431662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229fd03-5dd1-4094-8648-68fb184d1c06 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:43:52.436763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2217f92-338e-41b1-ba64-9ba1f11dccd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:43:52.441462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2217f92-338e-41b1-ba64-9ba1f11dccd3 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:52.441657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2217f92-338e-41b1-ba64-9ba1f11dccd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:52.442836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2217f92-338e-41b1-ba64-9ba1f11dccd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:52.462873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2217f92-338e-41b1-ba64-9ba1f11dccd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:43:52.464880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2217f92-338e-41b1-ba64-9ba1f11dccd3 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:43:52.478704 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2248/4465] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:43:52 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:43:53.378535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a951e-287d-4d6a-9b25-6582641cdaaa None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:43:53.379083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a951e-287d-4d6a-9b25-6582641cdaaa None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:43:53.379083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a951e-287d-4d6a-9b25-6582641cdaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:43:53.437671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-be6a951e-287d-4d6a-9b25-6582641cdaaa None None] MFA Rules not processed for user `9454949c8d794b6093d7d4fc64d12c33`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:43:53.441918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-be6a951e-287d-4d6a-9b25-6582641cdaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:43:53.573452 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2218/4466] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:43:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:44:01.701115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2217f92-338e-41b1-ba64-9ba1f11dccd3 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:01.703325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d2217f92-338e-41b1-ba64-9ba1f11dccd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:01.814771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2217f92-338e-41b1-ba64-9ba1f11dccd3 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:01.821243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3573842-6ee8-4486-9485-094e0d3a44a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:01.821902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3573842-6ee8-4486-9485-094e0d3a44a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:01.822222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3573842-6ee8-4486-9485-094e0d3a44a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:01.822502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3573842-6ee8-4486-9485-094e0d3a44a7 admin admin] PATH_INFO: `/v3/users/a2b49a82d97941d9b4bf278b14f0e84e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:01.823790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3573842-6ee8-4486-9485-094e0d3a44a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2b49a82d97941d9b4bf278b14f0e84e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:01.825848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3573842-6ee8-4486-9485-094e0d3a44a7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:02.022901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:02.025544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c3573842-6ee8-4486-9485-094e0d3a44a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2b49a82d97941d9b4bf278b14f0e84e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:02.026312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c3573842-6ee8-4486-9485-094e0d3a44a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2b49a82d97941d9b4bf278b14f0e84e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:02.034989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c3573842-6ee8-4486-9485-094e0d3a44a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2b49a82d97941d9b4bf278b14f0e84e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:02.048803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c3573842-6ee8-4486-9485-094e0d3a44a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2b49a82d97941d9b4bf278b14f0e84e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:02.049538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c3573842-6ee8-4486-9485-094e0d3a44a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2b49a82d97941d9b4bf278b14f0e84e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:02.122567 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2249/4467] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:44:01 2022] DELETE /identity/v3/users/a2b49a82d97941d9b4bf278b14f0e84e => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:02.127823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d1562-e50a-4d2b-8f7f-f6093ae12072 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:02.128739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d1562-e50a-4d2b-8f7f-f6093ae12072 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:02.129192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d1562-e50a-4d2b-8f7f-f6093ae12072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:02.153637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f56d1562-e50a-4d2b-8f7f-f6093ae12072 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:02.155278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f56d1562-e50a-4d2b-8f7f-f6093ae12072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:02.246236 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2219/4468] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:44:02.257746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3573842-6ee8-4486-9485-094e0d3a44a7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:02.259226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c3573842-6ee8-4486-9485-094e0d3a44a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:02.360112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3573842-6ee8-4486-9485-094e0d3a44a7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:02.370993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57a260-7d34-4208-b114-5575274cfc60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:02.371650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57a260-7d34-4208-b114-5575274cfc60 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:02.371936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57a260-7d34-4208-b114-5575274cfc60 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:02.372217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57a260-7d34-4208-b114-5575274cfc60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:02.384793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57a260-7d34-4208-b114-5575274cfc60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:02.386362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57a260-7d34-4208-b114-5575274cfc60 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:02.397947 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2250/4469] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:44:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:44:02.721506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d1562-e50a-4d2b-8f7f-f6093ae12072 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:02.723802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f56d1562-e50a-4d2b-8f7f-f6093ae12072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:02.745151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d1562-e50a-4d2b-8f7f-f6093ae12072 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:02.754739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0dff4-3235-4597-a645-eea75d0cd1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:02.754739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0dff4-3235-4597-a645-eea75d0cd1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:02.754739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0dff4-3235-4597-a645-eea75d0cd1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:02.754739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0dff4-3235-4597-a645-eea75d0cd1d0 admin admin] PATH_INFO: `/v3/projects/c5bee28100e648919e06446cf7c627b6` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:02.755438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0dff4-3235-4597-a645-eea75d0cd1d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5bee28100e648919e06446cf7c627b6)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:02.757189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0dff4-3235-4597-a645-eea75d0cd1d0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:02.890773 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-25e0dff4-3235-4597-a645-eea75d0cd1d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5bee28100e648919e06446cf7c627b6', 'request_id': 'req-25e0dff4-3235-4597-a645-eea75d0cd1d0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:02.978492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-25e0dff4-3235-4597-a645-eea75d0cd1d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5bee28100e648919e06446cf7c627b6', 'request_id': 'req-25e0dff4-3235-4597-a645-eea75d0cd1d0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:02.987775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-25e0dff4-3235-4597-a645-eea75d0cd1d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5bee28100e648919e06446cf7c627b6', 'request_id': 'req-25e0dff4-3235-4597-a645-eea75d0cd1d0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:03.000032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:03.001860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-25e0dff4-3235-4597-a645-eea75d0cd1d0 admin admin] The token cache is being invalidate because project c5bee28100e648919e06446cf7c627b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:44:03.002757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-25e0dff4-3235-4597-a645-eea75d0cd1d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:03.003495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-25e0dff4-3235-4597-a645-eea75d0cd1d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:03.005682 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2220/4470] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:44:02 2022] DELETE /identity/v3/projects/c5bee28100e648919e06446cf7c627b6 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:03.010119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3985e9-5518-4be9-9f3d-846c08604f42 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:03.011352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3985e9-5518-4be9-9f3d-846c08604f42 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:03.011857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3985e9-5518-4be9-9f3d-846c08604f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:03.036152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2a3985e9-5518-4be9-9f3d-846c08604f42 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:03.038013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2a3985e9-5518-4be9-9f3d-846c08604f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:03.122853 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2251/4471] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:44:03.125004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37c781-b98f-4fe6-9ee5-284fb462406f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:03.125577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37c781-b98f-4fe6-9ee5-284fb462406f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:03.125928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37c781-b98f-4fe6-9ee5-284fb462406f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:03.154647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-fd37c781-b98f-4fe6-9ee5-284fb462406f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:03.154647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fd37c781-b98f-4fe6-9ee5-284fb462406f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:03.161502 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2221/4472] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:44:03.165880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3985e9-5518-4be9-9f3d-846c08604f42 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:03.179518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3985e9-5518-4be9-9f3d-846c08604f42 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:03.192619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ed116-2f68-46dc-b903-b205dbb74a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:03.193255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ed116-2f68-46dc-b903-b205dbb74a2f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:03.193540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ed116-2f68-46dc-b903-b205dbb74a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:03.193815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ed116-2f68-46dc-b903-b205dbb74a2f admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:03.194705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ed116-2f68-46dc-b903-b205dbb74a2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:44:03.195137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ed116-2f68-46dc-b903-b205dbb74a2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:03.196793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ed116-2f68-46dc-b903-b205dbb74a2f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:03.212645 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2252/4473] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:44:03.213892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37c781-b98f-4fe6-9ee5-284fb462406f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:03.225041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37c781-b98f-4fe6-9ee5-284fb462406f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:03.231137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56094ba-bfb8-4667-a8fc-af9e3b3162c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:03.237050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56094ba-bfb8-4667-a8fc-af9e3b3162c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:03.237050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56094ba-bfb8-4667-a8fc-af9e3b3162c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:03.237050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56094ba-bfb8-4667-a8fc-af9e3b3162c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:03.237050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56094ba-bfb8-4667-a8fc-af9e3b3162c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:03.237050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56094ba-bfb8-4667-a8fc-af9e3b3162c9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:03.332706 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2222/4474] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:44:03 2022] POST /identity/v3/projects => generated 357 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:44:03.336572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ed116-2f68-46dc-b903-b205dbb74a2f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:03.347581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ed116-2f68-46dc-b903-b205dbb74a2f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:03.446227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:03.472080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5b75b-13fb-4038-818c-64916c9342d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:03.473099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5b75b-13fb-4038-818c-64916c9342d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:03.473547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5b75b-13fb-4038-818c-64916c9342d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:03.473985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5b75b-13fb-4038-818c-64916c9342d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:03.474902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5b75b-13fb-4038-818c-64916c9342d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:03.476993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5b75b-13fb-4038-818c-64916c9342d6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:03.589286 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2253/4475] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:44:03 2022] POST /identity/v3/users => generated 279 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:44:03.594402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56094ba-bfb8-4667-a8fc-af9e3b3162c9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:03.606705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56094ba-bfb8-4667-a8fc-af9e3b3162c9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:03.611942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787e874-38fe-4541-b7da-3238eb7e0699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:03.612797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787e874-38fe-4541-b7da-3238eb7e0699 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:03.613781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787e874-38fe-4541-b7da-3238eb7e0699 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:03.614773 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787e874-38fe-4541-b7da-3238eb7e0699 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:03.615469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787e874-38fe-4541-b7da-3238eb7e0699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:03.617145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787e874-38fe-4541-b7da-3238eb7e0699 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:03.631298 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2223/4476] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:44:03.638005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5b75b-13fb-4038-818c-64916c9342d6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:03.646472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5b75b-13fb-4038-818c-64916c9342d6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:03.653490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a64ce-f8ca-4676-8879-6f30048877c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:03.654538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a64ce-f8ca-4676-8879-6f30048877c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:03.655297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a64ce-f8ca-4676-8879-6f30048877c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:03.655871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a64ce-f8ca-4676-8879-6f30048877c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:03.656743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a64ce-f8ca-4676-8879-6f30048877c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:03.658785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a64ce-f8ca-4676-8879-6f30048877c2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:03.674582 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2254/4477] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:44:03.675765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787e874-38fe-4541-b7da-3238eb7e0699 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:03.686481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787e874-38fe-4541-b7da-3238eb7e0699 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:03.693632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a73dc-49a3-4c7e-b068-17a3df38bcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:03.694355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a73dc-49a3-4c7e-b068-17a3df38bcb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:03.694641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a73dc-49a3-4c7e-b068-17a3df38bcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:03.695130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a73dc-49a3-4c7e-b068-17a3df38bcb0 admin admin] PATH_INFO: `/v3/projects/8e84901f62884f0aa05d2ddd51a27fcf/users/17eaebda87ec495f8ad5459fb0853e1c/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:03.712015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a73dc-49a3-4c7e-b068-17a3df38bcb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e84901f62884f0aa05d2ddd51a27fcf, user_id=17eaebda87ec495f8ad5459fb0853e1c, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:03.714802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a73dc-49a3-4c7e-b068-17a3df38bcb0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:03.781837 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2224/4478] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:44:03 2022] PUT /identity/v3/projects/8e84901f62884f0aa05d2ddd51a27fcf/users/17eaebda87ec495f8ad5459fb0853e1c/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:44:03.794828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288fccc-ccf0-436e-b207-b45a0ffb1105 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:03.795125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288fccc-ccf0-436e-b207-b45a0ffb1105 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:03.795465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288fccc-ccf0-436e-b207-b45a0ffb1105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:03.833703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7288fccc-ccf0-436e-b207-b45a0ffb1105 None None] MFA Rules not processed for user `17eaebda87ec495f8ad5459fb0853e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:03.835279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7288fccc-ccf0-436e-b207-b45a0ffb1105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:03.922488 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2255/4479] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:44:03.933168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a73dc-49a3-4c7e-b068-17a3df38bcb0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:03.935656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3c2a73dc-49a3-4c7e-b068-17a3df38bcb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:04.017812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a73dc-49a3-4c7e-b068-17a3df38bcb0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:04.026838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b46004-9b59-43fc-8136-524ac6e81a34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:04.030830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b46004-9b59-43fc-8136-524ac6e81a34 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:04.030830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b46004-9b59-43fc-8136-524ac6e81a34 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:04.030830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b46004-9b59-43fc-8136-524ac6e81a34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:04.041536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b46004-9b59-43fc-8136-524ac6e81a34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:04.044221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b46004-9b59-43fc-8136-524ac6e81a34 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:04.057651 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2225/4480] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:44:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:44:05.637938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288fccc-ccf0-436e-b207-b45a0ffb1105 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:05.643040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7288fccc-ccf0-436e-b207-b45a0ffb1105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:05.752158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288fccc-ccf0-436e-b207-b45a0ffb1105 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:05.759745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0b5b4-246f-42e9-b6f9-f5c53478c624 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:05.760756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0b5b4-246f-42e9-b6f9-f5c53478c624 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:05.762216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0b5b4-246f-42e9-b6f9-f5c53478c624 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:05.762703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0b5b4-246f-42e9-b6f9-f5c53478c624 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:05.766311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-98c0b5b4-246f-42e9-b6f9-f5c53478c624 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:05.921710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:05.933211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0b5b4-246f-42e9-b6f9-f5c53478c624 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:05.934724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0b5b4-246f-42e9-b6f9-f5c53478c624 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:05.979597 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2256/4481] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:44:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:44:14.051072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:16.607231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b46004-9b59-43fc-8136-524ac6e81a34 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:16.609317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-03b46004-9b59-43fc-8136-524ac6e81a34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:16.681156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:16.697426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0b5b4-246f-42e9-b6f9-f5c53478c624 service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:16.698967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-98c0b5b4-246f-42e9-b6f9-f5c53478c624 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:16.809833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b46004-9b59-43fc-8136-524ac6e81a34 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:16.813615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0b5b4-246f-42e9-b6f9-f5c53478c624 service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:16.815330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4103e-983e-4ace-8f23-f22d0a5b4290 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:16.816073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4103e-983e-4ace-8f23-f22d0a5b4290 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:16.817073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4103e-983e-4ace-8f23-f22d0a5b4290 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:16.819996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4103e-983e-4ace-8f23-f22d0a5b4290 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:16.819996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f2e4103e-983e-4ace-8f23-f22d0a5b4290 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:16.831823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d992c57-95e0-4f79-a4e0-5addc6436385 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:16.833245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d992c57-95e0-4f79-a4e0-5addc6436385 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:16.833775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d992c57-95e0-4f79-a4e0-5addc6436385 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:16.834263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d992c57-95e0-4f79-a4e0-5addc6436385 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:16.837625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0d992c57-95e0-4f79-a4e0-5addc6436385 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:16.838977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4103e-983e-4ace-8f23-f22d0a5b4290 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:16.847532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4103e-983e-4ace-8f23-f22d0a5b4290 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:16.878591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d992c57-95e0-4f79-a4e0-5addc6436385 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:16.880255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d992c57-95e0-4f79-a4e0-5addc6436385 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:16.887825 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2226/4482] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:44:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:44:16.888888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4103e-983e-4ace-8f23-f22d0a5b4290 service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:16.898708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f2e4103e-983e-4ace-8f23-f22d0a5b4290 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:16.924118 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2257/4483] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:44:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:44:17.062682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4103e-983e-4ace-8f23-f22d0a5b4290 service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:17.072670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630412a-68f9-4480-8713-a132528950b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:17.072670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630412a-68f9-4480-8713-a132528950b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:17.072670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630412a-68f9-4480-8713-a132528950b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:17.072670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630412a-68f9-4480-8713-a132528950b3 admin admin] PATH_INFO: `/v3/users/1c31cc9fdea545c484496e9534c1218f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:17.073191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630412a-68f9-4480-8713-a132528950b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c31cc9fdea545c484496e9534c1218f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:17.075051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630412a-68f9-4480-8713-a132528950b3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:17.257601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1630412a-68f9-4480-8713-a132528950b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c31cc9fdea545c484496e9534c1218f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:17.259034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1630412a-68f9-4480-8713-a132528950b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c31cc9fdea545c484496e9534c1218f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:17.270859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1630412a-68f9-4480-8713-a132528950b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c31cc9fdea545c484496e9534c1218f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:17.293072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1630412a-68f9-4480-8713-a132528950b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c31cc9fdea545c484496e9534c1218f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:17.394561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1630412a-68f9-4480-8713-a132528950b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c31cc9fdea545c484496e9534c1218f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:17.397394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:17.405486 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2227/4484] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:44:16 2022] DELETE /identity/v3/users/1c31cc9fdea545c484496e9534c1218f => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:17.408688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b153c-24c0-4edc-9067-3aa43773ec97 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:17.408980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b153c-24c0-4edc-9067-3aa43773ec97 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:17.409256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b153c-24c0-4edc-9067-3aa43773ec97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:17.503417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0c9b153c-24c0-4edc-9067-3aa43773ec97 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:17.503417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0c9b153c-24c0-4edc-9067-3aa43773ec97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:17.667798 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2258/4485] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:44:17.679567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630412a-68f9-4480-8713-a132528950b3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:17.681536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1630412a-68f9-4480-8713-a132528950b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:17.817737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630412a-68f9-4480-8713-a132528950b3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:17.821875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d3e80-9289-410c-8b6b-1394cc11f317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:17.823048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d3e80-9289-410c-8b6b-1394cc11f317 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:17.823572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d3e80-9289-410c-8b6b-1394cc11f317 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:17.824008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d3e80-9289-410c-8b6b-1394cc11f317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:17.836019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d3e80-9289-410c-8b6b-1394cc11f317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:17.837939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d3e80-9289-410c-8b6b-1394cc11f317 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:17.851655 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2228/4486] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:44:18.189562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b153c-24c0-4edc-9067-3aa43773ec97 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:18.191081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0c9b153c-24c0-4edc-9067-3aa43773ec97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:18.213127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b153c-24c0-4edc-9067-3aa43773ec97 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:18.235386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dcf0ca-6c0c-44a2-9ee0-b2f51352876f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:18.236831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcf0ca-6c0c-44a2-9ee0-b2f51352876f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:18.237121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcf0ca-6c0c-44a2-9ee0-b2f51352876f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:18.237398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcf0ca-6c0c-44a2-9ee0-b2f51352876f admin admin] PATH_INFO: `/v3/projects/c068b0f1dd5047558b5ebaa5051bea03` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:18.239843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dcf0ca-6c0c-44a2-9ee0-b2f51352876f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c068b0f1dd5047558b5ebaa5051bea03)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:18.241783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dcf0ca-6c0c-44a2-9ee0-b2f51352876f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:18.380776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-98dcf0ca-6c0c-44a2-9ee0-b2f51352876f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c068b0f1dd5047558b5ebaa5051bea03', 'request_id': 'req-98dcf0ca-6c0c-44a2-9ee0-b2f51352876f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:18.388156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-98dcf0ca-6c0c-44a2-9ee0-b2f51352876f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c068b0f1dd5047558b5ebaa5051bea03', 'request_id': 'req-98dcf0ca-6c0c-44a2-9ee0-b2f51352876f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:18.395618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-98dcf0ca-6c0c-44a2-9ee0-b2f51352876f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c068b0f1dd5047558b5ebaa5051bea03', 'request_id': 'req-98dcf0ca-6c0c-44a2-9ee0-b2f51352876f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:18.521798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-98dcf0ca-6c0c-44a2-9ee0-b2f51352876f admin admin] The token cache is being invalidate because project c068b0f1dd5047558b5ebaa5051bea03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:44:18.523218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-98dcf0ca-6c0c-44a2-9ee0-b2f51352876f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:18.523218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-98dcf0ca-6c0c-44a2-9ee0-b2f51352876f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:18.525070 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2259/4487] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:44:18 2022] DELETE /identity/v3/projects/c068b0f1dd5047558b5ebaa5051bea03 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:18.529775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a3934-2096-431f-ba83-3c778780bbdc None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:18.530434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a3934-2096-431f-ba83-3c778780bbdc None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:18.531038 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a3934-2096-431f-ba83-3c778780bbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:18.572457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-524a3934-2096-431f-ba83-3c778780bbdc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:18.573765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-524a3934-2096-431f-ba83-3c778780bbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:18.676410 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2229/4488] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:44:18.684267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fd6f4-b75c-41ed-981d-dd31210f7d41 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:18.684563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fd6f4-b75c-41ed-981d-dd31210f7d41 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:18.684851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fd6f4-b75c-41ed-981d-dd31210f7d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:18.710869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-216fd6f4-b75c-41ed-981d-dd31210f7d41 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:18.712102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-216fd6f4-b75c-41ed-981d-dd31210f7d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:18.724403 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2260/4489] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:44:18.726012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a3934-2096-431f-ba83-3c778780bbdc None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:18.740233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a3934-2096-431f-ba83-3c778780bbdc None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:18.745073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506585b-9f1f-4f25-8cf2-157fc1d3cb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:18.745896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506585b-9f1f-4f25-8cf2-157fc1d3cb6f admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:18.746297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506585b-9f1f-4f25-8cf2-157fc1d3cb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:18.746648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506585b-9f1f-4f25-8cf2-157fc1d3cb6f admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:18.747433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506585b-9f1f-4f25-8cf2-157fc1d3cb6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:44:18.747810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506585b-9f1f-4f25-8cf2-157fc1d3cb6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:18.749650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506585b-9f1f-4f25-8cf2-157fc1d3cb6f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:18.762824 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2230/4490] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:44:18.767436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fd6f4-b75c-41ed-981d-dd31210f7d41 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:18.779092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fd6f4-b75c-41ed-981d-dd31210f7d41 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:18.784070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43df81-14ea-43bd-b97e-c0892f7c1e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:18.784788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43df81-14ea-43bd-b97e-c0892f7c1e5e admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:18.785674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43df81-14ea-43bd-b97e-c0892f7c1e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:18.786024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43df81-14ea-43bd-b97e-c0892f7c1e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:18.786764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43df81-14ea-43bd-b97e-c0892f7c1e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:18.788813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43df81-14ea-43bd-b97e-c0892f7c1e5e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:18.793748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:18.873732 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2261/4491] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:44:18 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:44:18.879585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506585b-9f1f-4f25-8cf2-157fc1d3cb6f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:18.890772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506585b-9f1f-4f25-8cf2-157fc1d3cb6f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:18.977923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e8501-677b-4ae2-bef5-7c811a3c243f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:18.978872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e8501-677b-4ae2-bef5-7c811a3c243f admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:18.979489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e8501-677b-4ae2-bef5-7c811a3c243f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:18.980144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e8501-677b-4ae2-bef5-7c811a3c243f admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:18.980999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e8501-677b-4ae2-bef5-7c811a3c243f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:18.985547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e8501-677b-4ae2-bef5-7c811a3c243f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:19.105665 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2231/4492] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:44:18 2022] POST /identity/v3/users => generated 292 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:44:19.107050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43df81-14ea-43bd-b97e-c0892f7c1e5e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:19.119130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43df81-14ea-43bd-b97e-c0892f7c1e5e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:19.125185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbc80c-24ee-4256-893b-1c76798277c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:19.125969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbc80c-24ee-4256-893b-1c76798277c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:19.126386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbc80c-24ee-4256-893b-1c76798277c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:19.126789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbc80c-24ee-4256-893b-1c76798277c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:19.127643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbc80c-24ee-4256-893b-1c76798277c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:19.129468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbc80c-24ee-4256-893b-1c76798277c7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:19.146461 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2262/4493] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:44:19.147654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e8501-677b-4ae2-bef5-7c811a3c243f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:19.158869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e8501-677b-4ae2-bef5-7c811a3c243f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:19.164784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d17b78-1eb8-4f58-a080-7c238494c7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:19.165684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d17b78-1eb8-4f58-a080-7c238494c7fc admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:19.165684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d17b78-1eb8-4f58-a080-7c238494c7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:19.165979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d17b78-1eb8-4f58-a080-7c238494c7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:19.166862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d17b78-1eb8-4f58-a080-7c238494c7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:19.168489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d17b78-1eb8-4f58-a080-7c238494c7fc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:19.185321 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2232/4494] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:44:19.186706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbc80c-24ee-4256-893b-1c76798277c7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:19.201859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbc80c-24ee-4256-893b-1c76798277c7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:19.209459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d10720-1550-4688-a083-d955f65692a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:19.210221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d10720-1550-4688-a083-d955f65692a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:19.210510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d10720-1550-4688-a083-d955f65692a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:19.210846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d10720-1550-4688-a083-d955f65692a9 admin admin] PATH_INFO: `/v3/projects/65b1b865a19842a5939a38723249f3ea/users/60699cdf37184b7aaf740fa4f3a8af00/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:19.234686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d10720-1550-4688-a083-d955f65692a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b1b865a19842a5939a38723249f3ea, user_id=60699cdf37184b7aaf740fa4f3a8af00, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:19.237772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d10720-1550-4688-a083-d955f65692a9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:19.339551 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2263/4495] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:44:19 2022] PUT /identity/v3/projects/65b1b865a19842a5939a38723249f3ea/users/60699cdf37184b7aaf740fa4f3a8af00/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:19.351446 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbfe98-cccb-442d-ba86-a58143af6d90 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:19.351790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbfe98-cccb-442d-ba86-a58143af6d90 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:19.355678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbfe98-cccb-442d-ba86-a58143af6d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:19.395410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:19.412593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c4fbfe98-cccb-442d-ba86-a58143af6d90 None None] MFA Rules not processed for user `60699cdf37184b7aaf740fa4f3a8af00`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:19.413843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c4fbfe98-cccb-442d-ba86-a58143af6d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:19.500790 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2233/4496] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:44:19.511394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d10720-1550-4688-a083-d955f65692a9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:19.513312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f5d10720-1550-4688-a083-d955f65692a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:19.631147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d10720-1550-4688-a083-d955f65692a9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:19.641586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6fd1d-777a-498d-b366-4da6df24c875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:19.641914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6fd1d-777a-498d-b366-4da6df24c875 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:19.653482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6fd1d-777a-498d-b366-4da6df24c875 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:19.653482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6fd1d-777a-498d-b366-4da6df24c875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:19.685631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6fd1d-777a-498d-b366-4da6df24c875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:19.687369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6fd1d-777a-498d-b366-4da6df24c875 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:19.699443 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2264/4497] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:44:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:44:22.407826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbfe98-cccb-442d-ba86-a58143af6d90 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:22.410332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c4fbfe98-cccb-442d-ba86-a58143af6d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:22.534566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbfe98-cccb-442d-ba86-a58143af6d90 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:22.554011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab41f22-4c90-494f-beca-ba2afe312826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:22.556543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab41f22-4c90-494f-beca-ba2afe312826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:22.556929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab41f22-4c90-494f-beca-ba2afe312826 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:22.557215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab41f22-4c90-494f-beca-ba2afe312826 admin admin] PATH_INFO: `/v3/users/17eaebda87ec495f8ad5459fb0853e1c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:22.558911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab41f22-4c90-494f-beca-ba2afe312826 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17eaebda87ec495f8ad5459fb0853e1c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:22.561097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab41f22-4c90-494f-beca-ba2afe312826 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:22.792834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0ab41f22-4c90-494f-beca-ba2afe312826 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17eaebda87ec495f8ad5459fb0853e1c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:22.793549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0ab41f22-4c90-494f-beca-ba2afe312826 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17eaebda87ec495f8ad5459fb0853e1c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:22.802338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0ab41f22-4c90-494f-beca-ba2afe312826 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17eaebda87ec495f8ad5459fb0853e1c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:22.817600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0ab41f22-4c90-494f-beca-ba2afe312826 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17eaebda87ec495f8ad5459fb0853e1c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:22.898008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0ab41f22-4c90-494f-beca-ba2afe312826 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17eaebda87ec495f8ad5459fb0853e1c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:22.908614 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2234/4498] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:44:22 2022] DELETE /identity/v3/users/17eaebda87ec495f8ad5459fb0853e1c => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:22.913629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6172846-8aee-4f2d-a227-d64b9ac9ac4a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:22.914201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6172846-8aee-4f2d-a227-d64b9ac9ac4a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:22.914201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6172846-8aee-4f2d-a227-d64b9ac9ac4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:22.960714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f6172846-8aee-4f2d-a227-d64b9ac9ac4a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:22.963452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f6172846-8aee-4f2d-a227-d64b9ac9ac4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:23.127307 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2265/4499] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:44:23.138654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab41f22-4c90-494f-beca-ba2afe312826 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:23.140471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0ab41f22-4c90-494f-beca-ba2afe312826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:23.168608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:23.244323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab41f22-4c90-494f-beca-ba2afe312826 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:23.249283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68165619-ee98-437e-a6e7-3d9ed89a56c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:23.249913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68165619-ee98-437e-a6e7-3d9ed89a56c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:23.250228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68165619-ee98-437e-a6e7-3d9ed89a56c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:23.250508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68165619-ee98-437e-a6e7-3d9ed89a56c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:23.261772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68165619-ee98-437e-a6e7-3d9ed89a56c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:23.263313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68165619-ee98-437e-a6e7-3d9ed89a56c5 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:23.275266 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2235/4500] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:44:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:44:23.677895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6172846-8aee-4f2d-a227-d64b9ac9ac4a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:23.679433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f6172846-8aee-4f2d-a227-d64b9ac9ac4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:23.701954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6172846-8aee-4f2d-a227-d64b9ac9ac4a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:23.715042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91cdad-921a-47b2-977c-2fcba2e46f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:23.715672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91cdad-921a-47b2-977c-2fcba2e46f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:23.715960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91cdad-921a-47b2-977c-2fcba2e46f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:23.716240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91cdad-921a-47b2-977c-2fcba2e46f10 admin admin] PATH_INFO: `/v3/projects/8e84901f62884f0aa05d2ddd51a27fcf` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:23.717615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91cdad-921a-47b2-977c-2fcba2e46f10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e84901f62884f0aa05d2ddd51a27fcf)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:23.720046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91cdad-921a-47b2-977c-2fcba2e46f10 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:23.897114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:23.902407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ff91cdad-921a-47b2-977c-2fcba2e46f10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e84901f62884f0aa05d2ddd51a27fcf', 'request_id': 'req-ff91cdad-921a-47b2-977c-2fcba2e46f10'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:23.914089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ff91cdad-921a-47b2-977c-2fcba2e46f10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e84901f62884f0aa05d2ddd51a27fcf', 'request_id': 'req-ff91cdad-921a-47b2-977c-2fcba2e46f10'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:23.923427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ff91cdad-921a-47b2-977c-2fcba2e46f10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e84901f62884f0aa05d2ddd51a27fcf', 'request_id': 'req-ff91cdad-921a-47b2-977c-2fcba2e46f10'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:23.995572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ff91cdad-921a-47b2-977c-2fcba2e46f10 admin admin] The token cache is being invalidate because project 8e84901f62884f0aa05d2ddd51a27fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:44:23.995876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ff91cdad-921a-47b2-977c-2fcba2e46f10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:23.998643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ff91cdad-921a-47b2-977c-2fcba2e46f10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:24.003374 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2266/4501] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:44:23 2022] DELETE /identity/v3/projects/8e84901f62884f0aa05d2ddd51a27fcf => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:24.008132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451e2bd-304a-48e9-a35d-a794c112cd13 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:24.008588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451e2bd-304a-48e9-a35d-a794c112cd13 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:24.008708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451e2bd-304a-48e9-a35d-a794c112cd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:24.047537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-2451e2bd-304a-48e9-a35d-a794c112cd13 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:24.048810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2451e2bd-304a-48e9-a35d-a794c112cd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:24.146140 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2236/4502] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:44:24.154070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418f372-eea9-4578-8fab-54221b19bf28 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:24.154481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418f372-eea9-4578-8fab-54221b19bf28 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:24.154865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418f372-eea9-4578-8fab-54221b19bf28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:24.177909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6418f372-eea9-4578-8fab-54221b19bf28 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:24.180337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6418f372-eea9-4578-8fab-54221b19bf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:24.198081 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2267/4503] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:44:24.204286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451e2bd-304a-48e9-a35d-a794c112cd13 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:24.216401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451e2bd-304a-48e9-a35d-a794c112cd13 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:24.221677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d197da5-ea24-4d86-bfb0-8f89114627ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:24.222661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d197da5-ea24-4d86-bfb0-8f89114627ba admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:24.222969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d197da5-ea24-4d86-bfb0-8f89114627ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:24.223780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d197da5-ea24-4d86-bfb0-8f89114627ba admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:24.224447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d197da5-ea24-4d86-bfb0-8f89114627ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:44:24.224759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d197da5-ea24-4d86-bfb0-8f89114627ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:24.226553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d197da5-ea24-4d86-bfb0-8f89114627ba admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:24.251178 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2237/4504] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:44:24.252635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418f372-eea9-4578-8fab-54221b19bf28 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:24.271467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418f372-eea9-4578-8fab-54221b19bf28 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:24.277063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad0f75-f50f-478e-9954-a14a5e8ee2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:24.278766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad0f75-f50f-478e-9954-a14a5e8ee2b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:24.279335 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad0f75-f50f-478e-9954-a14a5e8ee2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:24.279614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad0f75-f50f-478e-9954-a14a5e8ee2b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:24.290977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad0f75-f50f-478e-9954-a14a5e8ee2b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:24.290977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad0f75-f50f-478e-9954-a14a5e8ee2b9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:24.393371 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2268/4505] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:44:24 2022] POST /identity/v3/projects => generated 363 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:44:24.394120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d197da5-ea24-4d86-bfb0-8f89114627ba admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:24.410323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d197da5-ea24-4d86-bfb0-8f89114627ba admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:24.527452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c9aae-ae99-445e-82fa-d63862773aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:24.528232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c9aae-ae99-445e-82fa-d63862773aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:24.528622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c9aae-ae99-445e-82fa-d63862773aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:24.529705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c9aae-ae99-445e-82fa-d63862773aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:24.530615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c9aae-ae99-445e-82fa-d63862773aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:24.532735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c9aae-ae99-445e-82fa-d63862773aa5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:24.630977 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2238/4506] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:44:24 2022] POST /identity/v3/users => generated 282 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:44:24.635265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad0f75-f50f-478e-9954-a14a5e8ee2b9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:24.653715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad0f75-f50f-478e-9954-a14a5e8ee2b9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:24.660457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2d4a3-19d0-442d-9022-99e6d82afbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:24.661479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2d4a3-19d0-442d-9022-99e6d82afbda admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:24.661956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2d4a3-19d0-442d-9022-99e6d82afbda admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:24.662493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2d4a3-19d0-442d-9022-99e6d82afbda admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:24.663492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2d4a3-19d0-442d-9022-99e6d82afbda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:24.679082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2d4a3-19d0-442d-9022-99e6d82afbda admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:24.689330 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2269/4507] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:44:24.693689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c9aae-ae99-445e-82fa-d63862773aa5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:24.708025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c9aae-ae99-445e-82fa-d63862773aa5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:24.713710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241ceee-2493-48be-a372-0e0d5fdceee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:24.714754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241ceee-2493-48be-a372-0e0d5fdceee1 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:24.715257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241ceee-2493-48be-a372-0e0d5fdceee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:24.715787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241ceee-2493-48be-a372-0e0d5fdceee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:24.716701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241ceee-2493-48be-a372-0e0d5fdceee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:24.718676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241ceee-2493-48be-a372-0e0d5fdceee1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:24.738624 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2239/4508] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:44:24.743049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2d4a3-19d0-442d-9022-99e6d82afbda admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:24.754763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2d4a3-19d0-442d-9022-99e6d82afbda admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:24.772825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573ab66-0eeb-43bc-88bf-447c3cd2d2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:24.773917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573ab66-0eeb-43bc-88bf-447c3cd2d2a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:24.774417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573ab66-0eeb-43bc-88bf-447c3cd2d2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:24.774852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573ab66-0eeb-43bc-88bf-447c3cd2d2a6 admin admin] PATH_INFO: `/v3/projects/c6d9e2174da045378571966fd4305e63/users/d75fe2c96ff8489fafc88b4c63cbfb86/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:24.804780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573ab66-0eeb-43bc-88bf-447c3cd2d2a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d9e2174da045378571966fd4305e63, user_id=d75fe2c96ff8489fafc88b4c63cbfb86, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:24.804932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573ab66-0eeb-43bc-88bf-447c3cd2d2a6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:24.895984 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2270/4509] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:44:24 2022] PUT /identity/v3/projects/c6d9e2174da045378571966fd4305e63/users/d75fe2c96ff8489fafc88b4c63cbfb86/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:24.905919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a5003-882b-4c24-b631-79b0017b5e26 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:24.906253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a5003-882b-4c24-b631-79b0017b5e26 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:24.906632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a5003-882b-4c24-b631-79b0017b5e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:24.955995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-184a5003-882b-4c24-b631-79b0017b5e26 None None] MFA Rules not processed for user `d75fe2c96ff8489fafc88b4c63cbfb86`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:24.957989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-184a5003-882b-4c24-b631-79b0017b5e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:24.987657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:25.117510 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2240/4510] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:44:25.119046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573ab66-0eeb-43bc-88bf-447c3cd2d2a6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:25.251787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573ab66-0eeb-43bc-88bf-447c3cd2d2a6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:25.257433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5be720-82bb-4f4e-8942-cb40a535e47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:25.258116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5be720-82bb-4f4e-8942-cb40a535e47f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:25.258408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5be720-82bb-4f4e-8942-cb40a535e47f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:25.258690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5be720-82bb-4f4e-8942-cb40a535e47f admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:25.259426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5be720-82bb-4f4e-8942-cb40a535e47f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:25.262129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5be720-82bb-4f4e-8942-cb40a535e47f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:25.372302 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2271/4511] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:44:25 2022] POST /identity/v3/projects => generated 363 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:44:25.376297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a5003-882b-4c24-b631-79b0017b5e26 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:25.392796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a5003-882b-4c24-b631-79b0017b5e26 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:25.546203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520707ce-26e5-4876-b56f-b84940f1d7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:25.547004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520707ce-26e5-4876-b56f-b84940f1d7f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:25.547383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520707ce-26e5-4876-b56f-b84940f1d7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:25.547835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520707ce-26e5-4876-b56f-b84940f1d7f9 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:25.548603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520707ce-26e5-4876-b56f-b84940f1d7f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:25.554227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520707ce-26e5-4876-b56f-b84940f1d7f9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:25.718781 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2241/4512] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:44:25 2022] POST /identity/v3/users => generated 288 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:44:25.723069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5be720-82bb-4f4e-8942-cb40a535e47f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:25.774025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5be720-82bb-4f4e-8942-cb40a535e47f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:25.806880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e646624-bfe7-4b4d-916f-d175a83aaa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:25.807537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e646624-bfe7-4b4d-916f-d175a83aaa5a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:25.807834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e646624-bfe7-4b4d-916f-d175a83aaa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:25.808114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e646624-bfe7-4b4d-916f-d175a83aaa5a admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:25.808800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e646624-bfe7-4b4d-916f-d175a83aaa5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:25.828512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e646624-bfe7-4b4d-916f-d175a83aaa5a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:25.862027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520707ce-26e5-4876-b56f-b84940f1d7f9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:25.863997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-520707ce-26e5-4876-b56f-b84940f1d7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:25.871293 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2272/4513] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:44:25.873078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e646624-bfe7-4b4d-916f-d175a83aaa5a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:25.897300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e646624-bfe7-4b4d-916f-d175a83aaa5a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:25.911351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03c8d1-f50a-4d32-80ae-e5436f630955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:25.912580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03c8d1-f50a-4d32-80ae-e5436f630955 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:25.913065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03c8d1-f50a-4d32-80ae-e5436f630955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:25.913769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03c8d1-f50a-4d32-80ae-e5436f630955 admin admin] PATH_INFO: `/v3/projects/b7b479c2a9e54eef9ff587bae506fd8d/users/8920a85c8ac34952a0c9f99ec1bd33f3/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:25.945603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03c8d1-f50a-4d32-80ae-e5436f630955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7b479c2a9e54eef9ff587bae506fd8d, user_id=8920a85c8ac34952a0c9f99ec1bd33f3, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:25.948488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03c8d1-f50a-4d32-80ae-e5436f630955 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:26.010755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520707ce-26e5-4876-b56f-b84940f1d7f9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:26.017935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cee4c0-5c71-4739-8f3c-6b8676db9e6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:26.018948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cee4c0-5c71-4739-8f3c-6b8676db9e6a service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:26.019987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cee4c0-5c71-4739-8f3c-6b8676db9e6a service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:26.020506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cee4c0-5c71-4739-8f3c-6b8676db9e6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:26.023644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-38cee4c0-5c71-4739-8f3c-6b8676db9e6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:26.029381 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2273/4514] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:44:25 2022] PUT /identity/v3/projects/b7b479c2a9e54eef9ff587bae506fd8d/users/8920a85c8ac34952a0c9f99ec1bd33f3/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:26.030227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03c8d1-f50a-4d32-80ae-e5436f630955 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:26.036644 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8b03c8d1-f50a-4d32-80ae-e5436f630955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:26.093906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:26.121545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cee4c0-5c71-4739-8f3c-6b8676db9e6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:26.123763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cee4c0-5c71-4739-8f3c-6b8676db9e6a service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:26.124910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:26.165138 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2242/4515] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:44:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:44:26.180090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cee4c0-5c71-4739-8f3c-6b8676db9e6a service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:26.206333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cee4c0-5c71-4739-8f3c-6b8676db9e6a service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:26.254610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03c8d1-f50a-4d32-80ae-e5436f630955 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:26.270293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17887e40-7ccc-4b54-b8df-be3c4737bcd4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:26.270936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17887e40-7ccc-4b54-b8df-be3c4737bcd4 service glance] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:26.278540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17887e40-7ccc-4b54-b8df-be3c4737bcd4 service glance] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:26.278849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17887e40-7ccc-4b54-b8df-be3c4737bcd4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:26.304111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02054e-e17d-40fa-a067-5f99d9f63aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:26.304941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02054e-e17d-40fa-a067-5f99d9f63aec admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:26.305333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02054e-e17d-40fa-a067-5f99d9f63aec admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:26.305720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02054e-e17d-40fa-a067-5f99d9f63aec admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:26.307014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02054e-e17d-40fa-a067-5f99d9f63aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:26.311531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02054e-e17d-40fa-a067-5f99d9f63aec admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:26.336393 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2243/4516] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:44:26.347276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02054e-e17d-40fa-a067-5f99d9f63aec admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:26.378169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02054e-e17d-40fa-a067-5f99d9f63aec admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:26.393336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba354159-81c5-471d-bd4a-80042c843394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:26.395106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba354159-81c5-471d-bd4a-80042c843394 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:26.401856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba354159-81c5-471d-bd4a-80042c843394 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:26.401856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba354159-81c5-471d-bd4a-80042c843394 admin admin] PATH_INFO: `/v3/projects/b7b479c2a9e54eef9ff587bae506fd8d/users/8920a85c8ac34952a0c9f99ec1bd33f3/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:26.404627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba354159-81c5-471d-bd4a-80042c843394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7b479c2a9e54eef9ff587bae506fd8d, user_id=8920a85c8ac34952a0c9f99ec1bd33f3, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:26.407910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba354159-81c5-471d-bd4a-80042c843394 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:26.432886 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2244/4517] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:44:26 2022] PUT /identity/v3/projects/b7b479c2a9e54eef9ff587bae506fd8d/users/8920a85c8ac34952a0c9f99ec1bd33f3/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:26.443529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6531c6-defb-4e36-b9f2-f4c165205577 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:26.443900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6531c6-defb-4e36-b9f2-f4c165205577 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:26.444106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6531c6-defb-4e36-b9f2-f4c165205577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:26.451313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17887e40-7ccc-4b54-b8df-be3c4737bcd4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:26.452346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17887e40-7ccc-4b54-b8df-be3c4737bcd4 service glance] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:26.490490 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2274/4518] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:44:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:44:26.516944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8d6531c6-defb-4e36-b9f2-f4c165205577 None None] MFA Rules not processed for user `8920a85c8ac34952a0c9f99ec1bd33f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:26.535771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8d6531c6-defb-4e36-b9f2-f4c165205577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:26.750854 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2245/4519] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:44:26.832272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17887e40-7ccc-4b54-b8df-be3c4737bcd4 service glance] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:26.833719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-17887e40-7ccc-4b54-b8df-be3c4737bcd4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:26.953282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17887e40-7ccc-4b54-b8df-be3c4737bcd4 service glance] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:27.043336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac719a-69a6-4f15-8516-fc592350854d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:27.046601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac719a-69a6-4f15-8516-fc592350854d service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:27.047015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac719a-69a6-4f15-8516-fc592350854d service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:27.047735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac719a-69a6-4f15-8516-fc592350854d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:27.065899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac719a-69a6-4f15-8516-fc592350854d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:27.068239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac719a-69a6-4f15-8516-fc592350854d service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:27.082999 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2275/4520] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:44:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:44:27.190718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33175c61-cdc9-408e-9d8d-d93daab51690 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:27.191746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33175c61-cdc9-408e-9d8d-d93daab51690 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:27.192481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33175c61-cdc9-408e-9d8d-d93daab51690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:27.234642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-33175c61-cdc9-408e-9d8d-d93daab51690 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:27.250659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-33175c61-cdc9-408e-9d8d-d93daab51690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:27.357157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:27.407639 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2246/4521] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:44:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:44:27.594988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac719a-69a6-4f15-8516-fc592350854d service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:27.596215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9aac719a-69a6-4f15-8516-fc592350854d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:27.734714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:27.848656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac719a-69a6-4f15-8516-fc592350854d service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:27.867066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e5774-5892-4aa0-8eeb-66e487fd7f82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:27.867695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e5774-5892-4aa0-8eeb-66e487fd7f82 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:27.868351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e5774-5892-4aa0-8eeb-66e487fd7f82 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:27.868631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e5774-5892-4aa0-8eeb-66e487fd7f82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:27.887450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e5774-5892-4aa0-8eeb-66e487fd7f82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:27.903720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e5774-5892-4aa0-8eeb-66e487fd7f82 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:27.956245 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2276/4522] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:44:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:44:29.361202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33175c61-cdc9-408e-9d8d-d93daab51690 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:29.523349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33175c61-cdc9-408e-9d8d-d93daab51690 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:29.550367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d27a64-e836-405a-b933-b1a65eba91d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:29.552561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d27a64-e836-405a-b933-b1a65eba91d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:29.552561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d27a64-e836-405a-b933-b1a65eba91d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:29.552561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d27a64-e836-405a-b933-b1a65eba91d5 admin admin] PATH_INFO: `/v3/users/d75fe2c96ff8489fafc88b4c63cbfb86` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:29.556825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d27a64-e836-405a-b933-b1a65eba91d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d75fe2c96ff8489fafc88b4c63cbfb86)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:29.563127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d27a64-e836-405a-b933-b1a65eba91d5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:29.775068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-84d27a64-e836-405a-b933-b1a65eba91d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd75fe2c96ff8489fafc88b4c63cbfb86'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:29.775840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-84d27a64-e836-405a-b933-b1a65eba91d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd75fe2c96ff8489fafc88b4c63cbfb86'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:29.797139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-84d27a64-e836-405a-b933-b1a65eba91d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd75fe2c96ff8489fafc88b4c63cbfb86'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:29.831220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-84d27a64-e836-405a-b933-b1a65eba91d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd75fe2c96ff8489fafc88b4c63cbfb86'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:29.898499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-84d27a64-e836-405a-b933-b1a65eba91d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd75fe2c96ff8489fafc88b4c63cbfb86'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:29.907705 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2247/4523] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:44:29 2022] DELETE /identity/v3/users/d75fe2c96ff8489fafc88b4c63cbfb86 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:29.912557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fad31d-374e-4326-ab4d-cdf13770ad96 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:29.913481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fad31d-374e-4326-ab4d-cdf13770ad96 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:29.914007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fad31d-374e-4326-ab4d-cdf13770ad96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:29.964819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d8fad31d-374e-4326-ab4d-cdf13770ad96 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:29.972142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d8fad31d-374e-4326-ab4d-cdf13770ad96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:30.138990 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2277/4524] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:44:30.231621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d27a64-e836-405a-b933-b1a65eba91d5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:30.233328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-84d27a64-e836-405a-b933-b1a65eba91d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:30.396083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d27a64-e836-405a-b933-b1a65eba91d5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:30.401151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa063a-05be-4c98-adfd-fae0d40266b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:30.402264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa063a-05be-4c98-adfd-fae0d40266b2 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:30.402544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa063a-05be-4c98-adfd-fae0d40266b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:30.405342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa063a-05be-4c98-adfd-fae0d40266b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:30.450499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa063a-05be-4c98-adfd-fae0d40266b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:30.454450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa063a-05be-4c98-adfd-fae0d40266b2 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:30.488474 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2248/4525] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:44:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:44:31.109931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fad31d-374e-4326-ab4d-cdf13770ad96 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:31.112071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d8fad31d-374e-4326-ab4d-cdf13770ad96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:31.149389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fad31d-374e-4326-ab4d-cdf13770ad96 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:31.159344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef70de-082d-4258-a540-18771296853f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:31.163352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef70de-082d-4258-a540-18771296853f service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:31.163352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef70de-082d-4258-a540-18771296853f service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:31.163352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef70de-082d-4258-a540-18771296853f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:31.168137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2aef70de-082d-4258-a540-18771296853f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:31.210015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef70de-082d-4258-a540-18771296853f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:31.214682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef70de-082d-4258-a540-18771296853f service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:31.245509 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2278/4526] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:44:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:44:33.250279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa063a-05be-4c98-adfd-fae0d40266b2 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:33.252575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5dfa063a-05be-4c98-adfd-fae0d40266b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:33.282262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa063a-05be-4c98-adfd-fae0d40266b2 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:33.296707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3bbfd-6cdf-4027-bfe3-007d5ca351a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:33.297705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3bbfd-6cdf-4027-bfe3-007d5ca351a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:33.298296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3bbfd-6cdf-4027-bfe3-007d5ca351a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:33.298793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3bbfd-6cdf-4027-bfe3-007d5ca351a9 admin admin] PATH_INFO: `/v3/projects/c6d9e2174da045378571966fd4305e63` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:33.300211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3bbfd-6cdf-4027-bfe3-007d5ca351a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d9e2174da045378571966fd4305e63)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:33.303621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3bbfd-6cdf-4027-bfe3-007d5ca351a9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:33.307357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:33.461904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f1a3bbfd-6cdf-4027-bfe3-007d5ca351a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d9e2174da045378571966fd4305e63', 'request_id': 'req-f1a3bbfd-6cdf-4027-bfe3-007d5ca351a9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:33.571752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f1a3bbfd-6cdf-4027-bfe3-007d5ca351a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d9e2174da045378571966fd4305e63', 'request_id': 'req-f1a3bbfd-6cdf-4027-bfe3-007d5ca351a9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:33.585820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f1a3bbfd-6cdf-4027-bfe3-007d5ca351a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d9e2174da045378571966fd4305e63', 'request_id': 'req-f1a3bbfd-6cdf-4027-bfe3-007d5ca351a9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:33.619355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f1a3bbfd-6cdf-4027-bfe3-007d5ca351a9 admin admin] The token cache is being invalidate because project c6d9e2174da045378571966fd4305e63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:44:33.620371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f1a3bbfd-6cdf-4027-bfe3-007d5ca351a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:33.621286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f1a3bbfd-6cdf-4027-bfe3-007d5ca351a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:33.626850 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2249/4527] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:44:33 2022] DELETE /identity/v3/projects/c6d9e2174da045378571966fd4305e63 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:33.627894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef70de-082d-4258-a540-18771296853f service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:33.641696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef70de-082d-4258-a540-18771296853f service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:33.792420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cb428-e3d9-4fbb-9e25-c4c4078ddc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:33.794617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cb428-e3d9-4fbb-9e25-c4c4078ddc93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:33.795766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cb428-e3d9-4fbb-9e25-c4c4078ddc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:33.802988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cb428-e3d9-4fbb-9e25-c4c4078ddc93 admin admin] PATH_INFO: `/v3/users/8920a85c8ac34952a0c9f99ec1bd33f3` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:33.807083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cb428-e3d9-4fbb-9e25-c4c4078ddc93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8920a85c8ac34952a0c9f99ec1bd33f3)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:33.810744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cb428-e3d9-4fbb-9e25-c4c4078ddc93 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:33.826192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3bbfd-6cdf-4027-bfe3-007d5ca351a9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:33.826192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f1a3bbfd-6cdf-4027-bfe3-007d5ca351a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:33.850971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3bbfd-6cdf-4027-bfe3-007d5ca351a9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:33.868828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca31a0-8f0c-42f8-90e3-71eef80bd82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:33.873393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca31a0-8f0c-42f8-90e3-71eef80bd82e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:33.877358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca31a0-8f0c-42f8-90e3-71eef80bd82e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:33.877851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca31a0-8f0c-42f8-90e3-71eef80bd82e admin admin] PATH_INFO: `/v3/users/60699cdf37184b7aaf740fa4f3a8af00` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:33.882195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca31a0-8f0c-42f8-90e3-71eef80bd82e admin admin] RBAC: Authorizing `identity:delete_user(user_id=60699cdf37184b7aaf740fa4f3a8af00)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:33.888317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca31a0-8f0c-42f8-90e3-71eef80bd82e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:34.049125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:34.054204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dc4cb428-e3d9-4fbb-9e25-c4c4078ddc93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8920a85c8ac34952a0c9f99ec1bd33f3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:34.054996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dc4cb428-e3d9-4fbb-9e25-c4c4078ddc93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8920a85c8ac34952a0c9f99ec1bd33f3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:34.073185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dc4cb428-e3d9-4fbb-9e25-c4c4078ddc93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8920a85c8ac34952a0c9f99ec1bd33f3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:34.109714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dc4cb428-e3d9-4fbb-9e25-c4c4078ddc93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8920a85c8ac34952a0c9f99ec1bd33f3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:34.111941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dc4cb428-e3d9-4fbb-9e25-c4c4078ddc93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8920a85c8ac34952a0c9f99ec1bd33f3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:34.124712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-05ca31a0-8f0c-42f8-90e3-71eef80bd82e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60699cdf37184b7aaf740fa4f3a8af00'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:34.128768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-05ca31a0-8f0c-42f8-90e3-71eef80bd82e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60699cdf37184b7aaf740fa4f3a8af00'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:34.136799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-05ca31a0-8f0c-42f8-90e3-71eef80bd82e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60699cdf37184b7aaf740fa4f3a8af00'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:34.157797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-05ca31a0-8f0c-42f8-90e3-71eef80bd82e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60699cdf37184b7aaf740fa4f3a8af00'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:34.232547 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2279/4528] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:44:33 2022] DELETE /identity/v3/users/8920a85c8ac34952a0c9f99ec1bd33f3 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:34.321219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-05ca31a0-8f0c-42f8-90e3-71eef80bd82e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60699cdf37184b7aaf740fa4f3a8af00'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:34.329829 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2250/4529] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:44:33 2022] DELETE /identity/v3/users/60699cdf37184b7aaf740fa4f3a8af00 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:34.337892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8c712-8b09-4946-b9be-9e8df7b2a8f5 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:34.338448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8c712-8b09-4946-b9be-9e8df7b2a8f5 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:34.338911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8c712-8b09-4946-b9be-9e8df7b2a8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:34.397099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-5cf8c712-8b09-4946-b9be-9e8df7b2a8f5 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:34.398412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5cf8c712-8b09-4946-b9be-9e8df7b2a8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:34.611349 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2280/4530] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:44:34.661325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca31a0-8f0c-42f8-90e3-71eef80bd82e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:34.663290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-05ca31a0-8f0c-42f8-90e3-71eef80bd82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:34.820781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca31a0-8f0c-42f8-90e3-71eef80bd82e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:34.833376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f50e3-7c1c-45b6-b472-1a8323e472ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:34.834245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f50e3-7c1c-45b6-b472-1a8323e472ce service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:34.838131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f50e3-7c1c-45b6-b472-1a8323e472ce service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:34.838131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f50e3-7c1c-45b6-b472-1a8323e472ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:34.861638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f50e3-7c1c-45b6-b472-1a8323e472ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:34.863914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f50e3-7c1c-45b6-b472-1a8323e472ce service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:34.880224 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2251/4531] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:44:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:44:36.358604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8c712-8b09-4946-b9be-9e8df7b2a8f5 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:36.362268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5cf8c712-8b09-4946-b9be-9e8df7b2a8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:36.397124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8c712-8b09-4946-b9be-9e8df7b2a8f5 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:36.407930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbf653-efa2-4baa-80fd-1bcb8d34a18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:36.408820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbf653-efa2-4baa-80fd-1bcb8d34a18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:36.409265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbf653-efa2-4baa-80fd-1bcb8d34a18f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:36.409762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbf653-efa2-4baa-80fd-1bcb8d34a18f admin admin] PATH_INFO: `/v3/projects/65b1b865a19842a5939a38723249f3ea` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:36.411846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbf653-efa2-4baa-80fd-1bcb8d34a18f admin admin] RBAC: Authorizing `identity:delete_project(project_id=65b1b865a19842a5939a38723249f3ea)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:36.413938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbf653-efa2-4baa-80fd-1bcb8d34a18f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:36.608702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-eefbf653-efa2-4baa-80fd-1bcb8d34a18f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65b1b865a19842a5939a38723249f3ea', 'request_id': 'req-eefbf653-efa2-4baa-80fd-1bcb8d34a18f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:36.629183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-eefbf653-efa2-4baa-80fd-1bcb8d34a18f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65b1b865a19842a5939a38723249f3ea', 'request_id': 'req-eefbf653-efa2-4baa-80fd-1bcb8d34a18f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:36.682319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-eefbf653-efa2-4baa-80fd-1bcb8d34a18f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65b1b865a19842a5939a38723249f3ea', 'request_id': 'req-eefbf653-efa2-4baa-80fd-1bcb8d34a18f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:36.766908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-eefbf653-efa2-4baa-80fd-1bcb8d34a18f admin admin] The token cache is being invalidate because project 65b1b865a19842a5939a38723249f3ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:44:36.767305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-eefbf653-efa2-4baa-80fd-1bcb8d34a18f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:36.767971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-eefbf653-efa2-4baa-80fd-1bcb8d34a18f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:36.769542 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2281/4532] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:44:36 2022] DELETE /identity/v3/projects/65b1b865a19842a5939a38723249f3ea => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:36.774796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e4fd7-c56a-4ff9-9c38-62a916ce3492 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:36.775737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e4fd7-c56a-4ff9-9c38-62a916ce3492 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:36.776256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e4fd7-c56a-4ff9-9c38-62a916ce3492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:36.803277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:36.812961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-305e4fd7-c56a-4ff9-9c38-62a916ce3492 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:36.817818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-305e4fd7-c56a-4ff9-9c38-62a916ce3492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:37.101523 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2252/4533] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:44:37.101986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dad97e-5271-4e13-b133-82146341bb60 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:37.101986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dad97e-5271-4e13-b133-82146341bb60 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:37.101986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dad97e-5271-4e13-b133-82146341bb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:37.101986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-44dad97e-5271-4e13-b133-82146341bb60 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:37.101986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-44dad97e-5271-4e13-b133-82146341bb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:37.101986 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2282/4534] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:44:37.104252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e4fd7-c56a-4ff9-9c38-62a916ce3492 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:37.115032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e4fd7-c56a-4ff9-9c38-62a916ce3492 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:37.121735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5bce2-3135-4f81-a50e-8ac9c1eca71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:37.122540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5bce2-3135-4f81-a50e-8ac9c1eca71e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:37.123017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5bce2-3135-4f81-a50e-8ac9c1eca71e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:37.123405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5bce2-3135-4f81-a50e-8ac9c1eca71e admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:37.124789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5bce2-3135-4f81-a50e-8ac9c1eca71e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:44:37.125260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5bce2-3135-4f81-a50e-8ac9c1eca71e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:37.131971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5bce2-3135-4f81-a50e-8ac9c1eca71e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:37.151736 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2253/4535] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:44:37.153353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dad97e-5271-4e13-b133-82146341bb60 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:37.166189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dad97e-5271-4e13-b133-82146341bb60 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:37.174980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5c034-41ac-4c7f-ad52-1730d29292fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:37.175786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5c034-41ac-4c7f-ad52-1730d29292fa admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:37.176172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5c034-41ac-4c7f-ad52-1730d29292fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:37.176557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5c034-41ac-4c7f-ad52-1730d29292fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:37.178158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5c034-41ac-4c7f-ad52-1730d29292fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:37.181267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5c034-41ac-4c7f-ad52-1730d29292fa admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:37.216286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5bce2-3135-4f81-a50e-8ac9c1eca71e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:37.220138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-24b5bce2-3135-4f81-a50e-8ac9c1eca71e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:37.261669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5bce2-3135-4f81-a50e-8ac9c1eca71e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:37.267108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3be64c-f993-4cd9-90e5-02c9e4f03f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:37.268158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3be64c-f993-4cd9-90e5-02c9e4f03f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:37.268441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3be64c-f993-4cd9-90e5-02c9e4f03f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:37.268929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3be64c-f993-4cd9-90e5-02c9e4f03f4e admin admin] PATH_INFO: `/v3/projects/b7b479c2a9e54eef9ff587bae506fd8d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:37.270418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3be64c-f993-4cd9-90e5-02c9e4f03f4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7b479c2a9e54eef9ff587bae506fd8d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:37.273175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3be64c-f993-4cd9-90e5-02c9e4f03f4e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:37.312225 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2283/4536] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:44:37 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:44:37.316806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5c034-41ac-4c7f-ad52-1730d29292fa admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:37.345043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:37.413177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8f3be64c-f993-4cd9-90e5-02c9e4f03f4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7b479c2a9e54eef9ff587bae506fd8d', 'request_id': 'req-8f3be64c-f993-4cd9-90e5-02c9e4f03f4e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:37.427768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5c034-41ac-4c7f-ad52-1730d29292fa admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:37.493062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8f3be64c-f993-4cd9-90e5-02c9e4f03f4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7b479c2a9e54eef9ff587bae506fd8d', 'request_id': 'req-8f3be64c-f993-4cd9-90e5-02c9e4f03f4e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:37.502628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8f3be64c-f993-4cd9-90e5-02c9e4f03f4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7b479c2a9e54eef9ff587bae506fd8d', 'request_id': 'req-8f3be64c-f993-4cd9-90e5-02c9e4f03f4e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:37.553273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bb6f3-3c40-4b16-8acd-9b2478c758dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:37.553273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bb6f3-3c40-4b16-8acd-9b2478c758dd admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:37.553273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bb6f3-3c40-4b16-8acd-9b2478c758dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:37.553273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bb6f3-3c40-4b16-8acd-9b2478c758dd admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:37.553738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0bb6f3-3c40-4b16-8acd-9b2478c758dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:37.555763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0bb6f3-3c40-4b16-8acd-9b2478c758dd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:37.559460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8f3be64c-f993-4cd9-90e5-02c9e4f03f4e admin admin] The token cache is being invalidate because project b7b479c2a9e54eef9ff587bae506fd8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:44:37.560059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8f3be64c-f993-4cd9-90e5-02c9e4f03f4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:37.561493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8f3be64c-f993-4cd9-90e5-02c9e4f03f4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:37.593786 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2254/4537] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:44:37 2022] DELETE /identity/v3/projects/b7b479c2a9e54eef9ff587bae506fd8d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:37.596372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cbe3d-c2b7-48b5-ac09-6572b1d5c897 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:37.596885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cbe3d-c2b7-48b5-ac09-6572b1d5c897 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:37.597370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cbe3d-c2b7-48b5-ac09-6572b1d5c897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:37.641526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-020cbe3d-c2b7-48b5-ac09-6572b1d5c897 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:37.642806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-020cbe3d-c2b7-48b5-ac09-6572b1d5c897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:37.669985 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2255/4538] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:44:37.681358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74adac8-b489-41a3-afac-7beb145b4565 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:37.681650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74adac8-b489-41a3-afac-7beb145b4565 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:37.681925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74adac8-b489-41a3-afac-7beb145b4565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:37.693484 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2284/4539] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:44:37 2022] POST /identity/v3/users => generated 288 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:44:37.696197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bb6f3-3c40-4b16-8acd-9b2478c758dd admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:37.698162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7b0bb6f3-3c40-4b16-8acd-9b2478c758dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:37.711648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bb6f3-3c40-4b16-8acd-9b2478c758dd admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:37.716965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d6108-4d0b-44d7-9cf7-9a5f759a48c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:37.718368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d6108-4d0b-44d7-9cf7-9a5f759a48c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:37.718664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d6108-4d0b-44d7-9cf7-9a5f759a48c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:37.718995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d6108-4d0b-44d7-9cf7-9a5f759a48c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:37.719711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d6108-4d0b-44d7-9cf7-9a5f759a48c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:37.722098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d6108-4d0b-44d7-9cf7-9a5f759a48c6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:37.742632 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2285/4540] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:44:37.743070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a74adac8-b489-41a3-afac-7beb145b4565 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:37.744345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a74adac8-b489-41a3-afac-7beb145b4565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:37.747893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d6108-4d0b-44d7-9cf7-9a5f759a48c6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:37.767276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d6108-4d0b-44d7-9cf7-9a5f759a48c6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:37.788267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade394d-5e0a-43b9-8d40-3d7e6569daee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:37.788267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade394d-5e0a-43b9-8d40-3d7e6569daee admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:37.788267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade394d-5e0a-43b9-8d40-3d7e6569daee admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:37.788267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade394d-5e0a-43b9-8d40-3d7e6569daee admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:37.788652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade394d-5e0a-43b9-8d40-3d7e6569daee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:37.788652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade394d-5e0a-43b9-8d40-3d7e6569daee admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:37.791599 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2256/4541] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:44:37.796331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74adac8-b489-41a3-afac-7beb145b4565 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:37.816563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74adac8-b489-41a3-afac-7beb145b4565 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:37.820553 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2286/4542] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:44:37.821531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade394d-5e0a-43b9-8d40-3d7e6569daee admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:37.830021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbaddec-9505-493e-9b57-2fdaf7bb93d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:37.835562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbaddec-9505-493e-9b57-2fdaf7bb93d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:37.835562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbaddec-9505-493e-9b57-2fdaf7bb93d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:37.835562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbaddec-9505-493e-9b57-2fdaf7bb93d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:37.835562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbaddec-9505-493e-9b57-2fdaf7bb93d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:44:37.835562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbaddec-9505-493e-9b57-2fdaf7bb93d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:37.836871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbaddec-9505-493e-9b57-2fdaf7bb93d9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:37.844600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade394d-5e0a-43b9-8d40-3d7e6569daee admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:37.855196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f51c5d-eaaf-4c72-a71a-a2692a3ac56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:37.855738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f51c5d-eaaf-4c72-a71a-a2692a3ac56f admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:37.856150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f51c5d-eaaf-4c72-a71a-a2692a3ac56f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:37.856453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f51c5d-eaaf-4c72-a71a-a2692a3ac56f admin admin] PATH_INFO: `/v3/projects/39ad9a67609d4b2bb8f50c914ae947c9/users/3fbb50fe1a4d4660adfbfe14c7123933/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:37.866131 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2257/4543] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:44:37.870065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbaddec-9505-493e-9b57-2fdaf7bb93d9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:37.891915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbaddec-9505-493e-9b57-2fdaf7bb93d9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:37.901995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ab430-a10a-47ac-9617-4f2a3fd16322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:37.902910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ab430-a10a-47ac-9617-4f2a3fd16322 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:37.903343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ab430-a10a-47ac-9617-4f2a3fd16322 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:37.903810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ab430-a10a-47ac-9617-4f2a3fd16322 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:37.904619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ab430-a10a-47ac-9617-4f2a3fd16322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:37.906860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ab430-a10a-47ac-9617-4f2a3fd16322 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:37.942239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f51c5d-eaaf-4c72-a71a-a2692a3ac56f admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ad9a67609d4b2bb8f50c914ae947c9, user_id=3fbb50fe1a4d4660adfbfe14c7123933, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:37.948470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f51c5d-eaaf-4c72-a71a-a2692a3ac56f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:38.049586 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2258/4544] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:44:37 2022] POST /identity/v3/projects => generated 367 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:44:38.054004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ab430-a10a-47ac-9617-4f2a3fd16322 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:38.095442 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2287/4545] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:44:37 2022] PUT /identity/v3/projects/39ad9a67609d4b2bb8f50c914ae947c9/users/3fbb50fe1a4d4660adfbfe14c7123933/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:38.105012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398d567-0321-49cc-b4b7-6fdb37899e7f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:38.105351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398d567-0321-49cc-b4b7-6fdb37899e7f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:38.106080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398d567-0321-49cc-b4b7-6fdb37899e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:38.141624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:38.178680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1398d567-0321-49cc-b4b7-6fdb37899e7f None None] MFA Rules not processed for user `3fbb50fe1a4d4660adfbfe14c7123933`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:38.189257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1398d567-0321-49cc-b4b7-6fdb37899e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:38.262440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ab430-a10a-47ac-9617-4f2a3fd16322 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:38.382378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fed081-4776-4c93-8eac-d506468b8b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:38.383080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fed081-4776-4c93-8eac-d506468b8b35 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:38.383444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fed081-4776-4c93-8eac-d506468b8b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:38.383931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fed081-4776-4c93-8eac-d506468b8b35 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:38.384635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fed081-4776-4c93-8eac-d506468b8b35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:38.386996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fed081-4776-4c93-8eac-d506468b8b35 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:38.390402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:38.408949 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2288/4546] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:44:38.439546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398d567-0321-49cc-b4b7-6fdb37899e7f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:38.442933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1398d567-0321-49cc-b4b7-6fdb37899e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:38.494820 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2259/4547] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:44:38 2022] POST /identity/v3/users => generated 284 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:44:38.499321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fed081-4776-4c93-8eac-d506468b8b35 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:38.531757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fed081-4776-4c93-8eac-d506468b8b35 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:38.545532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3150517-cebc-470c-93a5-64eae68a6d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:38.551159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3150517-cebc-470c-93a5-64eae68a6d80 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:38.551904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3150517-cebc-470c-93a5-64eae68a6d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:38.551904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3150517-cebc-470c-93a5-64eae68a6d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:38.553768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3150517-cebc-470c-93a5-64eae68a6d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:38.558333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3150517-cebc-470c-93a5-64eae68a6d80 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:38.571066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398d567-0321-49cc-b4b7-6fdb37899e7f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:38.583985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676369f-16f2-47ac-a295-c229a3ea8b94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:38.584750 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2260/4548] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:44:38.585071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676369f-16f2-47ac-a295-c229a3ea8b94 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:38.585356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676369f-16f2-47ac-a295-c229a3ea8b94 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:38.585634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676369f-16f2-47ac-a295-c229a3ea8b94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:38.589709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3150517-cebc-470c-93a5-64eae68a6d80 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:38.611071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676369f-16f2-47ac-a295-c229a3ea8b94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:38.613739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3150517-cebc-470c-93a5-64eae68a6d80 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:38.615822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676369f-16f2-47ac-a295-c229a3ea8b94 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:38.622626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb59ab-a3de-4fd4-9329-69cb2f043f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:38.623267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb59ab-a3de-4fd4-9329-69cb2f043f7d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:38.626187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb59ab-a3de-4fd4-9329-69cb2f043f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:38.626481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb59ab-a3de-4fd4-9329-69cb2f043f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:38.627179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb59ab-a3de-4fd4-9329-69cb2f043f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:38.631182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb59ab-a3de-4fd4-9329-69cb2f043f7d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:38.642565 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2289/4549] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:44:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:44:38.654603 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2261/4550] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:44:38.658547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676369f-16f2-47ac-a295-c229a3ea8b94 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:38.673088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676369f-16f2-47ac-a295-c229a3ea8b94 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:38.679466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06252410-c607-4cdd-9b95-79b38042f4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:38.680266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06252410-c607-4cdd-9b95-79b38042f4f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:38.680651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06252410-c607-4cdd-9b95-79b38042f4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:38.681231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06252410-c607-4cdd-9b95-79b38042f4f5 admin admin] PATH_INFO: `/v3/projects/84037fb173734a70a2e4dfcc19ffbb6d/users/42f516e01ce549b29f6b8bd5ca5e35bd/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:38.711900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06252410-c607-4cdd-9b95-79b38042f4f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84037fb173734a70a2e4dfcc19ffbb6d, user_id=42f516e01ce549b29f6b8bd5ca5e35bd, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:38.714682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06252410-c607-4cdd-9b95-79b38042f4f5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:38.841602 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2290/4551] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:44:38 2022] PUT /identity/v3/projects/84037fb173734a70a2e4dfcc19ffbb6d/users/42f516e01ce549b29f6b8bd5ca5e35bd/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:38.851585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad096c2-578c-49bf-8e67-5a64e15652c5 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:38.852064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad096c2-578c-49bf-8e67-5a64e15652c5 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:38.852165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad096c2-578c-49bf-8e67-5a64e15652c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:38.902442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-bad096c2-578c-49bf-8e67-5a64e15652c5 None None] MFA Rules not processed for user `42f516e01ce549b29f6b8bd5ca5e35bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:38.905628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bad096c2-578c-49bf-8e67-5a64e15652c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:39.008396 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2262/4552] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:44:39.012980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06252410-c607-4cdd-9b95-79b38042f4f5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:39.217785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06252410-c607-4cdd-9b95-79b38042f4f5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:39.235944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612aaec0-47cd-4994-ba12-edbeceab2584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:39.236577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612aaec0-47cd-4994-ba12-edbeceab2584 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:39.236861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612aaec0-47cd-4994-ba12-edbeceab2584 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:39.237137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612aaec0-47cd-4994-ba12-edbeceab2584 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:39.239033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612aaec0-47cd-4994-ba12-edbeceab2584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:39.251529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612aaec0-47cd-4994-ba12-edbeceab2584 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:39.399376 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2291/4553] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:44:39 2022] POST /identity/v3/projects => generated 369 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:44:39.399598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad096c2-578c-49bf-8e67-5a64e15652c5 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:39.411743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad096c2-578c-49bf-8e67-5a64e15652c5 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:39.483639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:39.545271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afdc71-43be-460a-a22b-6901f4cce869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:39.545396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afdc71-43be-460a-a22b-6901f4cce869 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:39.545790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afdc71-43be-460a-a22b-6901f4cce869 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:39.545988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afdc71-43be-460a-a22b-6901f4cce869 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:39.546727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afdc71-43be-460a-a22b-6901f4cce869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:39.549495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afdc71-43be-460a-a22b-6901f4cce869 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:39.688918 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2263/4554] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:44:39 2022] POST /identity/v3/users => generated 291 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:44:39.693483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612aaec0-47cd-4994-ba12-edbeceab2584 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:39.711597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612aaec0-47cd-4994-ba12-edbeceab2584 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:39.719429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4a2f2-6608-434b-a548-32d03cc4e0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:39.720056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4a2f2-6608-434b-a548-32d03cc4e0dc admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:39.720894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4a2f2-6608-434b-a548-32d03cc4e0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:39.721179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4a2f2-6608-434b-a548-32d03cc4e0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:39.721840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4a2f2-6608-434b-a548-32d03cc4e0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:39.724129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4a2f2-6608-434b-a548-32d03cc4e0dc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:39.746973 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2292/4555] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:44:39.750892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afdc71-43be-460a-a22b-6901f4cce869 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:39.777456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afdc71-43be-460a-a22b-6901f4cce869 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:39.787289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49af2c-b63e-49d4-a7a8-8e0f8eff8963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:39.789786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49af2c-b63e-49d4-a7a8-8e0f8eff8963 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:39.789786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49af2c-b63e-49d4-a7a8-8e0f8eff8963 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:39.789786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49af2c-b63e-49d4-a7a8-8e0f8eff8963 admin admin] PATH_INFO: `/v3/projects/35e919d2faeb44eeb6b5591938093e6c/users/ebbe09c61841483a83d233f6da5ab343/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:39.813423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49af2c-b63e-49d4-a7a8-8e0f8eff8963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e919d2faeb44eeb6b5591938093e6c, user_id=ebbe09c61841483a83d233f6da5ab343, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:39.825636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49af2c-b63e-49d4-a7a8-8e0f8eff8963 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:39.927444 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2264/4556] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:44:39 2022] PUT /identity/v3/projects/35e919d2faeb44eeb6b5591938093e6c/users/ebbe09c61841483a83d233f6da5ab343/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:39.930800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4a2f2-6608-434b-a548-32d03cc4e0dc admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:39.976399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4a2f2-6608-434b-a548-32d03cc4e0dc admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:40.087607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:40.108684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5956e-0d62-4f53-8648-0da7204369ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:40.111787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5956e-0d62-4f53-8648-0da7204369ac admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:40.113977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5956e-0d62-4f53-8648-0da7204369ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:40.113977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5956e-0d62-4f53-8648-0da7204369ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:40.115999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5956e-0d62-4f53-8648-0da7204369ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:40.127955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5956e-0d62-4f53-8648-0da7204369ac admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:40.145151 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2293/4557] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:44:40.149024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49af2c-b63e-49d4-a7a8-8e0f8eff8963 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:40.174614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49af2c-b63e-49d4-a7a8-8e0f8eff8963 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:40.246834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634b1e0-e979-4df2-be15-058b392f83d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:40.247534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634b1e0-e979-4df2-be15-058b392f83d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:40.247819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634b1e0-e979-4df2-be15-058b392f83d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:40.250981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634b1e0-e979-4df2-be15-058b392f83d7 admin admin] PATH_INFO: `/v3/projects/35e919d2faeb44eeb6b5591938093e6c/users/ebbe09c61841483a83d233f6da5ab343/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:40.255622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634b1e0-e979-4df2-be15-058b392f83d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e919d2faeb44eeb6b5591938093e6c, user_id=ebbe09c61841483a83d233f6da5ab343, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:40.263373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634b1e0-e979-4df2-be15-058b392f83d7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:40.303043 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2265/4558] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:44:40 2022] PUT /identity/v3/projects/35e919d2faeb44eeb6b5591938093e6c/users/ebbe09c61841483a83d233f6da5ab343/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:40.314876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce417ec-3a6f-4019-992a-522c3557bdbf None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:40.315180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce417ec-3a6f-4019-992a-522c3557bdbf None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:40.315806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce417ec-3a6f-4019-992a-522c3557bdbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:40.397187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0ce417ec-3a6f-4019-992a-522c3557bdbf None None] MFA Rules not processed for user `ebbe09c61841483a83d233f6da5ab343`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:40.401277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0ce417ec-3a6f-4019-992a-522c3557bdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:40.595362 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2294/4559] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:44:40.609985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634b1e0-e979-4df2-be15-058b392f83d7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:40.612732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6634b1e0-e979-4df2-be15-058b392f83d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:41.033174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634b1e0-e979-4df2-be15-058b392f83d7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:41.044468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b7c8f-e952-4ae8-b250-941b4291beb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:41.045109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b7c8f-e952-4ae8-b250-941b4291beb1 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:41.045395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b7c8f-e952-4ae8-b250-941b4291beb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:41.045672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b7c8f-e952-4ae8-b250-941b4291beb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:41.074422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b7c8f-e952-4ae8-b250-941b4291beb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:41.077743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b7c8f-e952-4ae8-b250-941b4291beb1 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:41.107570 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2266/4560] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:44:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:44:41.285144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce417ec-3a6f-4019-992a-522c3557bdbf None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:41.287664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0ce417ec-3a6f-4019-992a-522c3557bdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:41.318936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce417ec-3a6f-4019-992a-522c3557bdbf None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:41.329919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bbadc-e94b-47ca-8c44-9ef1fc2ad985 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:41.330972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bbadc-e94b-47ca-8c44-9ef1fc2ad985 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:41.332098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bbadc-e94b-47ca-8c44-9ef1fc2ad985 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:41.335280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bbadc-e94b-47ca-8c44-9ef1fc2ad985 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:41.487169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068bbadc-e94b-47ca-8c44-9ef1fc2ad985 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:41.489352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068bbadc-e94b-47ca-8c44-9ef1fc2ad985 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:41.518178 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2295/4561] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:44:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:44:48.347398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b7c8f-e952-4ae8-b250-941b4291beb1 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:48.546214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b7c8f-e952-4ae8-b250-941b4291beb1 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:48.554439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a65ff9-be34-481d-ae3c-63900615c8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:48.555401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a65ff9-be34-481d-ae3c-63900615c8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:48.555845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a65ff9-be34-481d-ae3c-63900615c8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:48.556325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a65ff9-be34-481d-ae3c-63900615c8ec admin admin] PATH_INFO: `/v3/users/42f516e01ce549b29f6b8bd5ca5e35bd` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:48.558513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a65ff9-be34-481d-ae3c-63900615c8ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=42f516e01ce549b29f6b8bd5ca5e35bd)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:48.561312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a65ff9-be34-481d-ae3c-63900615c8ec admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:48.746994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:48.787022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-81a65ff9-be34-481d-ae3c-63900615c8ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42f516e01ce549b29f6b8bd5ca5e35bd'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:48.787940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-81a65ff9-be34-481d-ae3c-63900615c8ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42f516e01ce549b29f6b8bd5ca5e35bd'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:48.809353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-81a65ff9-be34-481d-ae3c-63900615c8ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42f516e01ce549b29f6b8bd5ca5e35bd'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:48.844850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-81a65ff9-be34-481d-ae3c-63900615c8ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42f516e01ce549b29f6b8bd5ca5e35bd'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:48.954984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-81a65ff9-be34-481d-ae3c-63900615c8ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42f516e01ce549b29f6b8bd5ca5e35bd'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:48.968298 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2267/4562] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:44:48 2022] DELETE /identity/v3/users/42f516e01ce549b29f6b8bd5ca5e35bd => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:48.969550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e735f-395a-48d3-8e40-6e00a34358a5 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:48.970514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e735f-395a-48d3-8e40-6e00a34358a5 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:48.971550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e735f-395a-48d3-8e40-6e00a34358a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:49.011182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-569e735f-395a-48d3-8e40-6e00a34358a5 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:49.017355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-569e735f-395a-48d3-8e40-6e00a34358a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:49.182719 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2296/4563] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:44:49.496139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a65ff9-be34-481d-ae3c-63900615c8ec admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:49.499077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-81a65ff9-be34-481d-ae3c-63900615c8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:49.642308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a65ff9-be34-481d-ae3c-63900615c8ec admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:49.652535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5083a4-3875-4192-9ea9-65e2f8ba62a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:49.653076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5083a4-3875-4192-9ea9-65e2f8ba62a2 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:49.653363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5083a4-3875-4192-9ea9-65e2f8ba62a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:49.653640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5083a4-3875-4192-9ea9-65e2f8ba62a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:49.680481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5083a4-3875-4192-9ea9-65e2f8ba62a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:49.683414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5083a4-3875-4192-9ea9-65e2f8ba62a2 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:49.710890 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2268/4564] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:44:50.440332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e735f-395a-48d3-8e40-6e00a34358a5 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:50.442941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-569e735f-395a-48d3-8e40-6e00a34358a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:50.466856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e735f-395a-48d3-8e40-6e00a34358a5 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:50.479236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b55cf-84e2-4a0a-902b-c500ed72506b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:50.481729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b55cf-84e2-4a0a-902b-c500ed72506b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:50.481729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b55cf-84e2-4a0a-902b-c500ed72506b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:50.481729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b55cf-84e2-4a0a-902b-c500ed72506b admin admin] PATH_INFO: `/v3/projects/84037fb173734a70a2e4dfcc19ffbb6d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:50.482734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b55cf-84e2-4a0a-902b-c500ed72506b admin admin] RBAC: Authorizing `identity:delete_project(project_id=84037fb173734a70a2e4dfcc19ffbb6d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:50.491497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b55cf-84e2-4a0a-902b-c500ed72506b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:50.509550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:50.682411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d39b55cf-84e2-4a0a-902b-c500ed72506b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84037fb173734a70a2e4dfcc19ffbb6d', 'request_id': 'req-d39b55cf-84e2-4a0a-902b-c500ed72506b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:50.702093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d39b55cf-84e2-4a0a-902b-c500ed72506b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84037fb173734a70a2e4dfcc19ffbb6d', 'request_id': 'req-d39b55cf-84e2-4a0a-902b-c500ed72506b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:50.717410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d39b55cf-84e2-4a0a-902b-c500ed72506b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84037fb173734a70a2e4dfcc19ffbb6d', 'request_id': 'req-d39b55cf-84e2-4a0a-902b-c500ed72506b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:50.861169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d39b55cf-84e2-4a0a-902b-c500ed72506b admin admin] The token cache is being invalidate because project 84037fb173734a70a2e4dfcc19ffbb6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:44:50.861621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d39b55cf-84e2-4a0a-902b-c500ed72506b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:50.862506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d39b55cf-84e2-4a0a-902b-c500ed72506b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:50.867192 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2297/4565] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:44:50 2022] DELETE /identity/v3/projects/84037fb173734a70a2e4dfcc19ffbb6d => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:50.871257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5083a4-3875-4192-9ea9-65e2f8ba62a2 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:50.905348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5083a4-3875-4192-9ea9-65e2f8ba62a2 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:51.119638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87cd8a-609a-4fa5-834c-e9e169614b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:51.120594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87cd8a-609a-4fa5-834c-e9e169614b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:51.121031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87cd8a-609a-4fa5-834c-e9e169614b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:51.121455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87cd8a-609a-4fa5-834c-e9e169614b13 admin admin] PATH_INFO: `/v3/users/ebbe09c61841483a83d233f6da5ab343` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:51.124770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87cd8a-609a-4fa5-834c-e9e169614b13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebbe09c61841483a83d233f6da5ab343)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:51.127625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87cd8a-609a-4fa5-834c-e9e169614b13 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:51.389802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1a87cd8a-609a-4fa5-834c-e9e169614b13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebbe09c61841483a83d233f6da5ab343'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:51.399689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1a87cd8a-609a-4fa5-834c-e9e169614b13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebbe09c61841483a83d233f6da5ab343'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:51.437573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:51.446741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1a87cd8a-609a-4fa5-834c-e9e169614b13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebbe09c61841483a83d233f6da5ab343'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:51.483288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1a87cd8a-609a-4fa5-834c-e9e169614b13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebbe09c61841483a83d233f6da5ab343'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:51.572382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1a87cd8a-609a-4fa5-834c-e9e169614b13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebbe09c61841483a83d233f6da5ab343'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:51.584468 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2269/4566] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:44:50 2022] DELETE /identity/v3/users/ebbe09c61841483a83d233f6da5ab343 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:44:53.214806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b55cf-84e2-4a0a-902b-c500ed72506b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:53.217064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d39b55cf-84e2-4a0a-902b-c500ed72506b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:53.258976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b55cf-84e2-4a0a-902b-c500ed72506b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:53.368687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4af77f-ca92-47e6-8490-499caf43948a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:53.369802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4af77f-ca92-47e6-8490-499caf43948a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:53.370343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4af77f-ca92-47e6-8490-499caf43948a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:53.370932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4af77f-ca92-47e6-8490-499caf43948a admin admin] PATH_INFO: `/v3/projects/35e919d2faeb44eeb6b5591938093e6c` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:53.372437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4af77f-ca92-47e6-8490-499caf43948a admin admin] RBAC: Authorizing `identity:delete_project(project_id=35e919d2faeb44eeb6b5591938093e6c)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:53.374692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4af77f-ca92-47e6-8490-499caf43948a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:53.512585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bd4af77f-ca92-47e6-8490-499caf43948a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35e919d2faeb44eeb6b5591938093e6c', 'request_id': 'req-bd4af77f-ca92-47e6-8490-499caf43948a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:53.525947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bd4af77f-ca92-47e6-8490-499caf43948a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35e919d2faeb44eeb6b5591938093e6c', 'request_id': 'req-bd4af77f-ca92-47e6-8490-499caf43948a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:53.546094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bd4af77f-ca92-47e6-8490-499caf43948a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35e919d2faeb44eeb6b5591938093e6c', 'request_id': 'req-bd4af77f-ca92-47e6-8490-499caf43948a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:53.686148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bd4af77f-ca92-47e6-8490-499caf43948a admin admin] The token cache is being invalidate because project 35e919d2faeb44eeb6b5591938093e6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:44:53.686148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bd4af77f-ca92-47e6-8490-499caf43948a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:53.686148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bd4af77f-ca92-47e6-8490-499caf43948a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:53.691218 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2298/4567] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:44:53 2022] DELETE /identity/v3/projects/35e919d2faeb44eeb6b5591938093e6c => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:53.692938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214124a4-b778-4777-82eb-d6e207cdc0c8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:53.693413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214124a4-b778-4777-82eb-d6e207cdc0c8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:53.693531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214124a4-b778-4777-82eb-d6e207cdc0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:53.724343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-214124a4-b778-4777-82eb-d6e207cdc0c8 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:53.728415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-214124a4-b778-4777-82eb-d6e207cdc0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:53.984252 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2270/4568] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:44:54.024903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bd38e-ff2c-4108-ad7a-228611acc96b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:54.025570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bd38e-ff2c-4108-ad7a-228611acc96b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:54.026383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bd38e-ff2c-4108-ad7a-228611acc96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:54.075244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3d1bd38e-ff2c-4108-ad7a-228611acc96b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:54.077435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3d1bd38e-ff2c-4108-ad7a-228611acc96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:54.104383 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2299/4569] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:44:54.106461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214124a4-b778-4777-82eb-d6e207cdc0c8 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:54.122049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214124a4-b778-4777-82eb-d6e207cdc0c8 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:54.137441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23403e5e-cdaf-4756-946e-58eeefb24596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:54.138308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23403e5e-cdaf-4756-946e-58eeefb24596 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:54.138702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23403e5e-cdaf-4756-946e-58eeefb24596 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:54.139084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23403e5e-cdaf-4756-946e-58eeefb24596 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:54.140341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23403e5e-cdaf-4756-946e-58eeefb24596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:44:54.140341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23403e5e-cdaf-4756-946e-58eeefb24596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:54.142061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23403e5e-cdaf-4756-946e-58eeefb24596 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:54.204632 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2271/4570] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:44:54.209569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bd38e-ff2c-4108-ad7a-228611acc96b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:54.222729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bd38e-ff2c-4108-ad7a-228611acc96b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:54.246689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f97b1a-7f20-4878-9dd7-684c32facab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:54.247625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f97b1a-7f20-4878-9dd7-684c32facab9 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:54.250730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f97b1a-7f20-4878-9dd7-684c32facab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:54.251577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f97b1a-7f20-4878-9dd7-684c32facab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:54.252397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f97b1a-7f20-4878-9dd7-684c32facab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:54.255023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f97b1a-7f20-4878-9dd7-684c32facab9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:54.305663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:54.390695 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2300/4571] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:44:54 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:44:54.391943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23403e5e-cdaf-4756-946e-58eeefb24596 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:54.404511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23403e5e-cdaf-4756-946e-58eeefb24596 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:54.594131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f7b9c-d554-4c99-89b2-7c9ac63e495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:54.597217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f7b9c-d554-4c99-89b2-7c9ac63e495b admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:54.599165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f7b9c-d554-4c99-89b2-7c9ac63e495b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:54.599818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f7b9c-d554-4c99-89b2-7c9ac63e495b admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:54.600710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f7b9c-d554-4c99-89b2-7c9ac63e495b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:54.606013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f7b9c-d554-4c99-89b2-7c9ac63e495b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:54.726805 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2272/4572] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:44:54 2022] POST /identity/v3/users => generated 294 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:44:54.731070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f97b1a-7f20-4878-9dd7-684c32facab9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:54.745765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f97b1a-7f20-4878-9dd7-684c32facab9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:54.784572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c1c6d-79d3-48c6-ac4c-d9b859c4078b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:54.785319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c1c6d-79d3-48c6-ac4c-d9b859c4078b admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:54.786113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c1c6d-79d3-48c6-ac4c-d9b859c4078b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:54.786113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c1c6d-79d3-48c6-ac4c-d9b859c4078b admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:54.787438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c1c6d-79d3-48c6-ac4c-d9b859c4078b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:54.789421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c1c6d-79d3-48c6-ac4c-d9b859c4078b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:54.831609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f7b9c-d554-4c99-89b2-7c9ac63e495b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:54.844090 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2301/4573] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:44:54.855949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f7b9c-d554-4c99-89b2-7c9ac63e495b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:54.886549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d8f25-67f2-4a77-8c1c-71c30e41037b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:54.887201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d8f25-67f2-4a77-8c1c-71c30e41037b admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:54.887487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d8f25-67f2-4a77-8c1c-71c30e41037b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:54.887937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d8f25-67f2-4a77-8c1c-71c30e41037b admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:54.889067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d8f25-67f2-4a77-8c1c-71c30e41037b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:54.894064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d8f25-67f2-4a77-8c1c-71c30e41037b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:54.942883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c1c6d-79d3-48c6-ac4c-d9b859c4078b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:54.943700 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2273/4574] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:44:54.964240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c1c6d-79d3-48c6-ac4c-d9b859c4078b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:55.001772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939d941-3506-4f24-a9c7-cfc1b5891fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:55.003014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939d941-3506-4f24-a9c7-cfc1b5891fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:55.003526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939d941-3506-4f24-a9c7-cfc1b5891fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:55.004004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939d941-3506-4f24-a9c7-cfc1b5891fb0 admin admin] PATH_INFO: `/v3/projects/9c1f760ac8704b91bd32d3e5dcd145ca/users/9110d6220ff54501beabda04e6a18547/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:55.046110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939d941-3506-4f24-a9c7-cfc1b5891fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c1f760ac8704b91bd32d3e5dcd145ca, user_id=9110d6220ff54501beabda04e6a18547, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:55.048904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939d941-3506-4f24-a9c7-cfc1b5891fb0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:55.150148 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2302/4575] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:44:54 2022] PUT /identity/v3/projects/9c1f760ac8704b91bd32d3e5dcd145ca/users/9110d6220ff54501beabda04e6a18547/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:55.161399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f9dbf-7c3d-406b-991f-0770c2a9c521 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:55.161688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f9dbf-7c3d-406b-991f-0770c2a9c521 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:55.162419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f9dbf-7c3d-406b-991f-0770c2a9c521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:55.277683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a93f9dbf-7c3d-406b-991f-0770c2a9c521 None None] MFA Rules not processed for user `9110d6220ff54501beabda04e6a18547`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:55.278980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a93f9dbf-7c3d-406b-991f-0770c2a9c521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:55.354599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:55.446885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939d941-3506-4f24-a9c7-cfc1b5891fb0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:55.448864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a939d941-3506-4f24-a9c7-cfc1b5891fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:55.530451 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2274/4576] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:44:55.534785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f9dbf-7c3d-406b-991f-0770c2a9c521 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:55.661131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939d941-3506-4f24-a9c7-cfc1b5891fb0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:55.698805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa078ac3-0f85-4aaf-90b5-820a96c2f9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:55.699335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f9dbf-7c3d-406b-991f-0770c2a9c521 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:55.699548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa078ac3-0f85-4aaf-90b5-820a96c2f9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:55.699777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa078ac3-0f85-4aaf-90b5-820a96c2f9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:55.700283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa078ac3-0f85-4aaf-90b5-820a96c2f9dd admin admin] PATH_INFO: `/v3/users/88497702ee824799952e4bcd583ee367` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:55.706812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d725c-b635-4c7d-b49c-18e1e41a6ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:55.706992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa078ac3-0f85-4aaf-90b5-820a96c2f9dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=88497702ee824799952e4bcd583ee367)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:55.708176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d725c-b635-4c7d-b49c-18e1e41a6ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:55.708636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d725c-b635-4c7d-b49c-18e1e41a6ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:55.708804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa078ac3-0f85-4aaf-90b5-820a96c2f9dd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:55.709330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d725c-b635-4c7d-b49c-18e1e41a6ce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:55.710250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d725c-b635-4c7d-b49c-18e1e41a6ce6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:55.712397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d725c-b635-4c7d-b49c-18e1e41a6ce6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:55.837238 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2275/4577] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:44:55 2022] POST /identity/v3/projects => generated 385 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:44:55.838267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d725c-b635-4c7d-b49c-18e1e41a6ce6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:56.009929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-aa078ac3-0f85-4aaf-90b5-820a96c2f9dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88497702ee824799952e4bcd583ee367'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:56.011891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-aa078ac3-0f85-4aaf-90b5-820a96c2f9dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88497702ee824799952e4bcd583ee367'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:56.044473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-aa078ac3-0f85-4aaf-90b5-820a96c2f9dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88497702ee824799952e4bcd583ee367'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:56.106363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-aa078ac3-0f85-4aaf-90b5-820a96c2f9dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88497702ee824799952e4bcd583ee367'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:56.107313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-aa078ac3-0f85-4aaf-90b5-820a96c2f9dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88497702ee824799952e4bcd583ee367'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:56.135348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d725c-b635-4c7d-b49c-18e1e41a6ce6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:56.153022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea72ec8-9b68-4993-953c-0f94519a2761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:56.155105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea72ec8-9b68-4993-953c-0f94519a2761 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:56.155947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea72ec8-9b68-4993-953c-0f94519a2761 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:56.156434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea72ec8-9b68-4993-953c-0f94519a2761 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:56.158741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea72ec8-9b68-4993-953c-0f94519a2761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:56.168125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea72ec8-9b68-4993-953c-0f94519a2761 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:56.195702 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2303/4578] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:44:55 2022] DELETE /identity/v3/users/88497702ee824799952e4bcd583ee367 => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:44:56.324263 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2276/4579] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:44:55 2022] POST /identity/v3/users => generated 299 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:44:56.328346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa078ac3-0f85-4aaf-90b5-820a96c2f9dd admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:56.329874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-aa078ac3-0f85-4aaf-90b5-820a96c2f9dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:56.409639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:56.464729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa078ac3-0f85-4aaf-90b5-820a96c2f9dd admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:56.490863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46917f1d-fd4a-43dc-a8da-c899874fa082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:56.491808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46917f1d-fd4a-43dc-a8da-c899874fa082 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:56.492260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46917f1d-fd4a-43dc-a8da-c899874fa082 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:56.492707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46917f1d-fd4a-43dc-a8da-c899874fa082 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:56.493654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46917f1d-fd4a-43dc-a8da-c899874fa082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:56.495482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46917f1d-fd4a-43dc-a8da-c899874fa082 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:56.517900 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2304/4580] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:44:56.523161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea72ec8-9b68-4993-953c-0f94519a2761 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:56.539024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea72ec8-9b68-4993-953c-0f94519a2761 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:56.559166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515b6ff-6e9d-4bc4-b92d-f9df70d4e307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:56.561373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515b6ff-6e9d-4bc4-b92d-f9df70d4e307 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:56.576074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515b6ff-6e9d-4bc4-b92d-f9df70d4e307 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:56.576074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515b6ff-6e9d-4bc4-b92d-f9df70d4e307 admin admin] PATH_INFO: `/v3/projects/97964065c62f49aaa968f10adbef9ea1/users/4caa114b82ef460b9b0679554ede5fb8/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:56.608713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515b6ff-6e9d-4bc4-b92d-f9df70d4e307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97964065c62f49aaa968f10adbef9ea1, user_id=4caa114b82ef460b9b0679554ede5fb8, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:56.615852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515b6ff-6e9d-4bc4-b92d-f9df70d4e307 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:56.740104 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2277/4581] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:44:56 2022] PUT /identity/v3/projects/97964065c62f49aaa968f10adbef9ea1/users/4caa114b82ef460b9b0679554ede5fb8/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:56.743276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46917f1d-fd4a-43dc-a8da-c899874fa082 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:56.755291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46917f1d-fd4a-43dc-a8da-c899874fa082 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:56.902814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845da057-3b50-4c3a-9cad-b706cfed1c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:56.903451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845da057-3b50-4c3a-9cad-b706cfed1c87 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:56.903740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845da057-3b50-4c3a-9cad-b706cfed1c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:56.904023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845da057-3b50-4c3a-9cad-b706cfed1c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:56.904689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845da057-3b50-4c3a-9cad-b706cfed1c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:56.906347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845da057-3b50-4c3a-9cad-b706cfed1c87 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:56.926640 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2305/4582] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:44:56.927866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515b6ff-6e9d-4bc4-b92d-f9df70d4e307 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:56.942265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515b6ff-6e9d-4bc4-b92d-f9df70d4e307 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:56.964645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3265c1a-de25-4a70-bde0-5d338e0b3e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:56.965263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3265c1a-de25-4a70-bde0-5d338e0b3e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:56.965549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3265c1a-de25-4a70-bde0-5d338e0b3e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:56.965826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3265c1a-de25-4a70-bde0-5d338e0b3e10 admin admin] PATH_INFO: `/v3/projects/97964065c62f49aaa968f10adbef9ea1/users/4caa114b82ef460b9b0679554ede5fb8/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:56.968505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3265c1a-de25-4a70-bde0-5d338e0b3e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97964065c62f49aaa968f10adbef9ea1, user_id=4caa114b82ef460b9b0679554ede5fb8, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:56.971323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3265c1a-de25-4a70-bde0-5d338e0b3e10 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:56.999456 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2278/4583] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:44:56 2022] PUT /identity/v3/projects/97964065c62f49aaa968f10adbef9ea1/users/4caa114b82ef460b9b0679554ede5fb8/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:44:57.016012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cf83b-4967-4ffd-a350-ebd2d88755a0 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:57.016573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cf83b-4967-4ffd-a350-ebd2d88755a0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:57.017015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cf83b-4967-4ffd-a350-ebd2d88755a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:57.079727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-db0cf83b-4967-4ffd-a350-ebd2d88755a0 None None] MFA Rules not processed for user `4caa114b82ef460b9b0679554ede5fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:57.081017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-db0cf83b-4967-4ffd-a350-ebd2d88755a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:57.237385 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2306/4584] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:44:57.256898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3265c1a-de25-4a70-bde0-5d338e0b3e10 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:57.268128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e3265c1a-de25-4a70-bde0-5d338e0b3e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:57.275109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:57.386718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3265c1a-de25-4a70-bde0-5d338e0b3e10 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:57.391934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9060a-2518-48a6-8c78-1ea690101105 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:57.392892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9060a-2518-48a6-8c78-1ea690101105 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:57.393280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9060a-2518-48a6-8c78-1ea690101105 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:57.393702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9060a-2518-48a6-8c78-1ea690101105 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:57.406478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9060a-2518-48a6-8c78-1ea690101105 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:57.408287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9060a-2518-48a6-8c78-1ea690101105 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:57.468201 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2279/4585] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:44:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:44:57.475187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cf83b-4967-4ffd-a350-ebd2d88755a0 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:57.476678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-db0cf83b-4967-4ffd-a350-ebd2d88755a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:57.685206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:57.711365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cf83b-4967-4ffd-a350-ebd2d88755a0 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:57.744350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cea24-f414-4700-8e37-9dc8321c27b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:57.745027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cea24-f414-4700-8e37-9dc8321c27b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:57.745492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cea24-f414-4700-8e37-9dc8321c27b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:57.745935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cea24-f414-4700-8e37-9dc8321c27b4 admin admin] PATH_INFO: `/v3/projects/1ec987ba67f94da4bbdadc3835e56d7d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:57.758341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8cea24-f414-4700-8e37-9dc8321c27b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ec987ba67f94da4bbdadc3835e56d7d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:57.763552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8cea24-f414-4700-8e37-9dc8321c27b4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:57.852656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9060a-2518-48a6-8c78-1ea690101105 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:57.876888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9060a-2518-48a6-8c78-1ea690101105 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:57.890343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218177bd-d746-405f-ae46-67b4b038032e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:57.891273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218177bd-d746-405f-ae46-67b4b038032e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:57.891556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218177bd-d746-405f-ae46-67b4b038032e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:57.891832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218177bd-d746-405f-ae46-67b4b038032e admin admin] PATH_INFO: `/v3/users/9110d6220ff54501beabda04e6a18547` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:57.893025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218177bd-d746-405f-ae46-67b4b038032e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9110d6220ff54501beabda04e6a18547)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:57.895583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218177bd-d746-405f-ae46-67b4b038032e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:58.044566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6a8cea24-f414-4700-8e37-9dc8321c27b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ec987ba67f94da4bbdadc3835e56d7d', 'request_id': 'req-6a8cea24-f414-4700-8e37-9dc8321c27b4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:58.058558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6a8cea24-f414-4700-8e37-9dc8321c27b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ec987ba67f94da4bbdadc3835e56d7d', 'request_id': 'req-6a8cea24-f414-4700-8e37-9dc8321c27b4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:58.066548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6a8cea24-f414-4700-8e37-9dc8321c27b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ec987ba67f94da4bbdadc3835e56d7d', 'request_id': 'req-6a8cea24-f414-4700-8e37-9dc8321c27b4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:58.214572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6a8cea24-f414-4700-8e37-9dc8321c27b4 admin admin] The token cache is being invalidate because project 1ec987ba67f94da4bbdadc3835e56d7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:44:58.214921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6a8cea24-f414-4700-8e37-9dc8321c27b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:58.222632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6a8cea24-f414-4700-8e37-9dc8321c27b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:58.224916 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2307/4586] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:44:57 2022] DELETE /identity/v3/projects/1ec987ba67f94da4bbdadc3835e56d7d => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:58.235159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cea24-f414-4700-8e37-9dc8321c27b4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:58.236896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6a8cea24-f414-4700-8e37-9dc8321c27b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:58.261229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-218177bd-d746-405f-ae46-67b4b038032e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9110d6220ff54501beabda04e6a18547'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:58.263112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-218177bd-d746-405f-ae46-67b4b038032e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9110d6220ff54501beabda04e6a18547'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:58.315011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-218177bd-d746-405f-ae46-67b4b038032e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9110d6220ff54501beabda04e6a18547'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:58.376802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-218177bd-d746-405f-ae46-67b4b038032e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9110d6220ff54501beabda04e6a18547'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:58.456734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cea24-f414-4700-8e37-9dc8321c27b4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:58.471936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298a55a-43f2-4006-915c-d289308efded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:58.472766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298a55a-43f2-4006-915c-d289308efded admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:58.477027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298a55a-43f2-4006-915c-d289308efded admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:58.477027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298a55a-43f2-4006-915c-d289308efded admin admin] PATH_INFO: `/v3/users/c2cdc3a79fb74382ba64bc3b1b9b3415` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:58.477027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298a55a-43f2-4006-915c-d289308efded admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2cdc3a79fb74382ba64bc3b1b9b3415)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:58.483815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298a55a-43f2-4006-915c-d289308efded admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:58.502378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-218177bd-d746-405f-ae46-67b4b038032e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9110d6220ff54501beabda04e6a18547'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:58.509626 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2280/4587] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:44:57 2022] DELETE /identity/v3/users/9110d6220ff54501beabda04e6a18547 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:44:58.515557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63163535-7469-4c7a-b0fd-31b9c5fa5ded None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:58.516132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63163535-7469-4c7a-b0fd-31b9c5fa5ded None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:58.516627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63163535-7469-4c7a-b0fd-31b9c5fa5ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:58.575200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-63163535-7469-4c7a-b0fd-31b9c5fa5ded None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:44:58.576732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-63163535-7469-4c7a-b0fd-31b9c5fa5ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:58.704606 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2281/4588] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:44:58.737520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63163535-7469-4c7a-b0fd-31b9c5fa5ded None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:44:58.739056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-63163535-7469-4c7a-b0fd-31b9c5fa5ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:58.786224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:58.790275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0298a55a-43f2-4006-915c-d289308efded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2cdc3a79fb74382ba64bc3b1b9b3415'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:58.794935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0298a55a-43f2-4006-915c-d289308efded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2cdc3a79fb74382ba64bc3b1b9b3415'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:58.831947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0298a55a-43f2-4006-915c-d289308efded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2cdc3a79fb74382ba64bc3b1b9b3415'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:58.896939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0298a55a-43f2-4006-915c-d289308efded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2cdc3a79fb74382ba64bc3b1b9b3415'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:58.898610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0298a55a-43f2-4006-915c-d289308efded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2cdc3a79fb74382ba64bc3b1b9b3415'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:44:58.910329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63163535-7469-4c7a-b0fd-31b9c5fa5ded None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:44:58.917596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac007fb3-c4f5-4f3e-8806-884e885ce72e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:44:58.933098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac007fb3-c4f5-4f3e-8806-884e885ce72e service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:58.933460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac007fb3-c4f5-4f3e-8806-884e885ce72e service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:58.933908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac007fb3-c4f5-4f3e-8806-884e885ce72e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:58.938648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ac007fb3-c4f5-4f3e-8806-884e885ce72e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:44:58.995216 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2308/4589] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:44:58 2022] DELETE /identity/v3/users/c2cdc3a79fb74382ba64bc3b1b9b3415 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:44:58.995459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac007fb3-c4f5-4f3e-8806-884e885ce72e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:44:58.997976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac007fb3-c4f5-4f3e-8806-884e885ce72e service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:44:59.021051 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2282/4590] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:44:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:44:59.969780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56dcb5-3eb3-4d92-bac9-83bda577ccbd None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:44:59.970369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56dcb5-3eb3-4d92-bac9-83bda577ccbd None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:44:59.970480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56dcb5-3eb3-4d92-bac9-83bda577ccbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:44:59.994462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:00.001295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1f56dcb5-3eb3-4d92-bac9-83bda577ccbd None None] MFA Rules not processed for user `9454949c8d794b6093d7d4fc64d12c33`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:00.003275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1f56dcb5-3eb3-4d92-bac9-83bda577ccbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:00.084264 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2309/4591] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:44:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:00.665128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac007fb3-c4f5-4f3e-8806-884e885ce72e service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:00.667729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ac007fb3-c4f5-4f3e-8806-884e885ce72e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:00.697486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac007fb3-c4f5-4f3e-8806-884e885ce72e service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:00.797698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda75c65-8c56-40e2-839d-95430ce8dd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:00.798640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda75c65-8c56-40e2-839d-95430ce8dd27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:00.799118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda75c65-8c56-40e2-839d-95430ce8dd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:00.799640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda75c65-8c56-40e2-839d-95430ce8dd27 admin admin] PATH_INFO: `/v3/projects/088fd91527c748c89e358ed7959c131a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:00.804878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda75c65-8c56-40e2-839d-95430ce8dd27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=088fd91527c748c89e358ed7959c131a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:00.807175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda75c65-8c56-40e2-839d-95430ce8dd27 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:00.953446 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bda75c65-8c56-40e2-839d-95430ce8dd27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '088fd91527c748c89e358ed7959c131a', 'request_id': 'req-bda75c65-8c56-40e2-839d-95430ce8dd27'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:01.022100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bda75c65-8c56-40e2-839d-95430ce8dd27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '088fd91527c748c89e358ed7959c131a', 'request_id': 'req-bda75c65-8c56-40e2-839d-95430ce8dd27'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:01.037387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bda75c65-8c56-40e2-839d-95430ce8dd27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '088fd91527c748c89e358ed7959c131a', 'request_id': 'req-bda75c65-8c56-40e2-839d-95430ce8dd27'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:01.066260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bda75c65-8c56-40e2-839d-95430ce8dd27 admin admin] The token cache is being invalidate because project 088fd91527c748c89e358ed7959c131a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:45:01.067861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bda75c65-8c56-40e2-839d-95430ce8dd27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:01.073586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bda75c65-8c56-40e2-839d-95430ce8dd27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:01.078222 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2283/4592] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:45:00 2022] DELETE /identity/v3/projects/088fd91527c748c89e358ed7959c131a => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:01.079847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15cc0c-1c51-406f-aee7-4e8ffcded344 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:01.080309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15cc0c-1c51-406f-aee7-4e8ffcded344 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:01.080408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15cc0c-1c51-406f-aee7-4e8ffcded344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:01.116817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9a15cc0c-1c51-406f-aee7-4e8ffcded344 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:01.119406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9a15cc0c-1c51-406f-aee7-4e8ffcded344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:01.309997 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2310/4593] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:01.320540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18472f98-7423-4a4a-917b-a6a525b0a8ae None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:01.320848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18472f98-7423-4a4a-917b-a6a525b0a8ae None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:01.321114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18472f98-7423-4a4a-917b-a6a525b0a8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:01.359012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15cc0c-1c51-406f-aee7-4e8ffcded344 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:01.360452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9a15cc0c-1c51-406f-aee7-4e8ffcded344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:01.368505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-18472f98-7423-4a4a-917b-a6a525b0a8ae None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:01.370025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-18472f98-7423-4a4a-917b-a6a525b0a8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:01.385250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15cc0c-1c51-406f-aee7-4e8ffcded344 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:01.391715 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2284/4594] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:01.395785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18472f98-7423-4a4a-917b-a6a525b0a8ae None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:01.405720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e2c1a-c436-4643-9eaa-aaaa0e8da4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:01.406839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e2c1a-c436-4643-9eaa-aaaa0e8da4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:01.407278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e2c1a-c436-4643-9eaa-aaaa0e8da4df admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:01.417481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e2c1a-c436-4643-9eaa-aaaa0e8da4df admin admin] PATH_INFO: `/v3/projects/9c1f760ac8704b91bd32d3e5dcd145ca` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:01.418814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18472f98-7423-4a4a-917b-a6a525b0a8ae None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:01.442612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5131a8-b49a-4141-9cc8-9ff789f7ffab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:01.442612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5131a8-b49a-4141-9cc8-9ff789f7ffab admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:01.442612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5131a8-b49a-4141-9cc8-9ff789f7ffab admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:01.442612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5131a8-b49a-4141-9cc8-9ff789f7ffab admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:01.443289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5131a8-b49a-4141-9cc8-9ff789f7ffab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:45:01.443289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5131a8-b49a-4141-9cc8-9ff789f7ffab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:01.447136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5131a8-b49a-4141-9cc8-9ff789f7ffab admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:01.459798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e2c1a-c436-4643-9eaa-aaaa0e8da4df admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c1f760ac8704b91bd32d3e5dcd145ca)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:01.466293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e2c1a-c436-4643-9eaa-aaaa0e8da4df admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:01.500448 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2285/4595] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:45:01.502237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56244f2-0d2a-4975-b938-bab231a65103 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:01.505954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56244f2-0d2a-4975-b938-bab231a65103 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:01.506494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56244f2-0d2a-4975-b938-bab231a65103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:01.556342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b56244f2-0d2a-4975-b938-bab231a65103 None None] MFA Rules not processed for user `43172c9e71704c869a25181574d67b35`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:01.557606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b56244f2-0d2a-4975-b938-bab231a65103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:01.620562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:01.681862 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2286/4596] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:01.682782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56244f2-0d2a-4975-b938-bab231a65103 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:01.706597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f92e2c1a-c436-4643-9eaa-aaaa0e8da4df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c1f760ac8704b91bd32d3e5dcd145ca', 'request_id': 'req-f92e2c1a-c436-4643-9eaa-aaaa0e8da4df'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:01.710629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56244f2-0d2a-4975-b938-bab231a65103 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:01.728643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f92e2c1a-c436-4643-9eaa-aaaa0e8da4df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c1f760ac8704b91bd32d3e5dcd145ca', 'request_id': 'req-f92e2c1a-c436-4643-9eaa-aaaa0e8da4df'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:01.776788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f92e2c1a-c436-4643-9eaa-aaaa0e8da4df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c1f760ac8704b91bd32d3e5dcd145ca', 'request_id': 'req-f92e2c1a-c436-4643-9eaa-aaaa0e8da4df'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:01.817135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d6801-439d-49ee-b193-040aa80a9d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:01.830431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d6801-439d-49ee-b193-040aa80a9d8c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:01.830924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d6801-439d-49ee-b193-040aa80a9d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:01.831209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d6801-439d-49ee-b193-040aa80a9d8c admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:01.831909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d6801-439d-49ee-b193-040aa80a9d8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:01.836159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d6801-439d-49ee-b193-040aa80a9d8c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:01.892082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f92e2c1a-c436-4643-9eaa-aaaa0e8da4df admin admin] The token cache is being invalidate because project 9c1f760ac8704b91bd32d3e5dcd145ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:45:01.894089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f92e2c1a-c436-4643-9eaa-aaaa0e8da4df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:01.898439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f92e2c1a-c436-4643-9eaa-aaaa0e8da4df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:01.902020 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2311/4597] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:45:01 2022] DELETE /identity/v3/projects/9c1f760ac8704b91bd32d3e5dcd145ca => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:01.906549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e2c1a-c436-4643-9eaa-aaaa0e8da4df admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:01.912065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f92e2c1a-c436-4643-9eaa-aaaa0e8da4df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:01.949616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e2c1a-c436-4643-9eaa-aaaa0e8da4df admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:01.961391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea253ef-3871-495d-9f3d-c13ece9e9bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:01.962148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea253ef-3871-495d-9f3d-c13ece9e9bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:01.962435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea253ef-3871-495d-9f3d-c13ece9e9bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:01.962713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea253ef-3871-495d-9f3d-c13ece9e9bd2 admin admin] PATH_INFO: `/v3/users/4caa114b82ef460b9b0679554ede5fb8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:01.968325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea253ef-3871-495d-9f3d-c13ece9e9bd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4caa114b82ef460b9b0679554ede5fb8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:01.970613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea253ef-3871-495d-9f3d-c13ece9e9bd2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:02.020556 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2287/4598] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:45:01 2022] POST /identity/v3/projects => generated 367 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:02.024297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d6801-439d-49ee-b193-040aa80a9d8c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:02.035298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0b3d6801-439d-49ee-b193-040aa80a9d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:02.264140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:02.280104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d6801-439d-49ee-b193-040aa80a9d8c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:02.286289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9ea253ef-3871-495d-9f3d-c13ece9e9bd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4caa114b82ef460b9b0679554ede5fb8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:02.288555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9ea253ef-3871-495d-9f3d-c13ece9e9bd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4caa114b82ef460b9b0679554ede5fb8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:02.303363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66772159-b3d9-47c4-acdc-894c9b356553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:02.305844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66772159-b3d9-47c4-acdc-894c9b356553 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:02.307562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66772159-b3d9-47c4-acdc-894c9b356553 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:02.307821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9ea253ef-3871-495d-9f3d-c13ece9e9bd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4caa114b82ef460b9b0679554ede5fb8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:02.308076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66772159-b3d9-47c4-acdc-894c9b356553 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:02.308851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66772159-b3d9-47c4-acdc-894c9b356553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:02.314730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66772159-b3d9-47c4-acdc-894c9b356553 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:02.352923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9ea253ef-3871-495d-9f3d-c13ece9e9bd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4caa114b82ef460b9b0679554ede5fb8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:02.354525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9ea253ef-3871-495d-9f3d-c13ece9e9bd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4caa114b82ef460b9b0679554ede5fb8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:02.424468 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2312/4599] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:45:01 2022] DELETE /identity/v3/users/4caa114b82ef460b9b0679554ede5fb8 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:02.428349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea253ef-3871-495d-9f3d-c13ece9e9bd2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:02.440229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9ea253ef-3871-495d-9f3d-c13ece9e9bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:02.445223 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2288/4600] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:45:02 2022] POST /identity/v3/users => generated 284 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:02.449814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66772159-b3d9-47c4-acdc-894c9b356553 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:02.452323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-66772159-b3d9-47c4-acdc-894c9b356553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:02.509502 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66772159-b3d9-47c4-acdc-894c9b356553 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:02.645327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea253ef-3871-495d-9f3d-c13ece9e9bd2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:02.663820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a0600-1e20-420b-8f79-ecf51f224cb2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:02.665896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a0600-1e20-420b-8f79-ecf51f224cb2 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:02.667475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a0600-1e20-420b-8f79-ecf51f224cb2 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:02.667475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a0600-1e20-420b-8f79-ecf51f224cb2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:02.675771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-218a0600-1e20-420b-8f79-ecf51f224cb2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:02.682784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:02.708128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea687a-41f1-4033-8baa-7c95c46369d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:02.710377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea687a-41f1-4033-8baa-7c95c46369d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:02.710867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea687a-41f1-4033-8baa-7c95c46369d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:02.712565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea687a-41f1-4033-8baa-7c95c46369d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:02.713510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea687a-41f1-4033-8baa-7c95c46369d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:02.715521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a0600-1e20-420b-8f79-ecf51f224cb2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:02.719043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea687a-41f1-4033-8baa-7c95c46369d7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:02.719893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a0600-1e20-420b-8f79-ecf51f224cb2 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:02.745601 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2289/4601] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:02.748350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea687a-41f1-4033-8baa-7c95c46369d7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:02.757318 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2313/4602] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:45:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:45:02.787293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea687a-41f1-4033-8baa-7c95c46369d7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:02.801958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8611fe-2349-467e-b97e-ba7a68a4c43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:02.805226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8611fe-2349-467e-b97e-ba7a68a4c43b admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:02.805226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8611fe-2349-467e-b97e-ba7a68a4c43b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:02.805226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8611fe-2349-467e-b97e-ba7a68a4c43b admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:02.805226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8611fe-2349-467e-b97e-ba7a68a4c43b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:02.813575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8611fe-2349-467e-b97e-ba7a68a4c43b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:02.835019 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2290/4603] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:02.840198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a0600-1e20-420b-8f79-ecf51f224cb2 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:02.874759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a0600-1e20-420b-8f79-ecf51f224cb2 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:02.889331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd8ced-121b-47c5-b95b-ee2ff15952d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:02.889979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd8ced-121b-47c5-b95b-ee2ff15952d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:02.890609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd8ced-121b-47c5-b95b-ee2ff15952d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:02.890897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd8ced-121b-47c5-b95b-ee2ff15952d2 admin admin] PATH_INFO: `/v3/projects/86b90d4cb5eb42958248b6f82516ce19/users/ca2da57f02884a968d685b53a5399e46/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:02.939516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd8ced-121b-47c5-b95b-ee2ff15952d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b90d4cb5eb42958248b6f82516ce19, user_id=ca2da57f02884a968d685b53a5399e46, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:02.946232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd8ced-121b-47c5-b95b-ee2ff15952d2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:03.078126 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2314/4604] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:02 2022] PUT /identity/v3/projects/86b90d4cb5eb42958248b6f82516ce19/users/ca2da57f02884a968d685b53a5399e46/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:03.082335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e76b5f-b289-44d9-93e3-a334a81e7d6c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:03.082627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e76b5f-b289-44d9-93e3-a334a81e7d6c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:03.088873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e76b5f-b289-44d9-93e3-a334a81e7d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:03.163838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-08e76b5f-b289-44d9-93e3-a334a81e7d6c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:03.165248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-08e76b5f-b289-44d9-93e3-a334a81e7d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:03.400232 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2291/4605] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:03.449811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd8ced-121b-47c5-b95b-ee2ff15952d2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:03.455503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b9bd8ced-121b-47c5-b95b-ee2ff15952d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:03.692270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd8ced-121b-47c5-b95b-ee2ff15952d2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:03.702100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b003a3-cfda-46b3-a11f-57e33bbcc10b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:03.704463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b003a3-cfda-46b3-a11f-57e33bbcc10b service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:03.705341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b003a3-cfda-46b3-a11f-57e33bbcc10b service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:03.706760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b003a3-cfda-46b3-a11f-57e33bbcc10b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:03.747353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b003a3-cfda-46b3-a11f-57e33bbcc10b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:03.754627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b003a3-cfda-46b3-a11f-57e33bbcc10b service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:03.774681 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2315/4606] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:45:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:45:04.101396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e76b5f-b289-44d9-93e3-a334a81e7d6c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:04.103544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-08e76b5f-b289-44d9-93e3-a334a81e7d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:04.122566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e76b5f-b289-44d9-93e3-a334a81e7d6c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:04.147646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a984e4b-8388-4314-b817-a8c30eb53eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:04.148693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a984e4b-8388-4314-b817-a8c30eb53eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:04.152236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a984e4b-8388-4314-b817-a8c30eb53eea admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:04.160462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a984e4b-8388-4314-b817-a8c30eb53eea admin admin] PATH_INFO: `/v3/projects/97964065c62f49aaa968f10adbef9ea1` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:04.179980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a984e4b-8388-4314-b817-a8c30eb53eea admin admin] RBAC: Authorizing `identity:delete_project(project_id=97964065c62f49aaa968f10adbef9ea1)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:04.181591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a984e4b-8388-4314-b817-a8c30eb53eea admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:04.359028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8a984e4b-8388-4314-b817-a8c30eb53eea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97964065c62f49aaa968f10adbef9ea1', 'request_id': 'req-8a984e4b-8388-4314-b817-a8c30eb53eea'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:04.501777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8a984e4b-8388-4314-b817-a8c30eb53eea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97964065c62f49aaa968f10adbef9ea1', 'request_id': 'req-8a984e4b-8388-4314-b817-a8c30eb53eea'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:04.519474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8a984e4b-8388-4314-b817-a8c30eb53eea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97964065c62f49aaa968f10adbef9ea1', 'request_id': 'req-8a984e4b-8388-4314-b817-a8c30eb53eea'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:04.555155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8a984e4b-8388-4314-b817-a8c30eb53eea admin admin] The token cache is being invalidate because project 97964065c62f49aaa968f10adbef9ea1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:45:04.555716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8a984e4b-8388-4314-b817-a8c30eb53eea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:04.556581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8a984e4b-8388-4314-b817-a8c30eb53eea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:04.562091 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2292/4607] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:45:04 2022] DELETE /identity/v3/projects/97964065c62f49aaa968f10adbef9ea1 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:04.563624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386a6b8-bbc1-432b-a3c8-dca2be3838fc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:04.564089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386a6b8-bbc1-432b-a3c8-dca2be3838fc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:04.564367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386a6b8-bbc1-432b-a3c8-dca2be3838fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:04.623756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3386a6b8-bbc1-432b-a3c8-dca2be3838fc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:04.629490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3386a6b8-bbc1-432b-a3c8-dca2be3838fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:04.658126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:04.783378 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2316/4608] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:45:04.790495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ea630-47a0-42ef-9748-e07e8b2c20f4 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:04.790784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ea630-47a0-42ef-9748-e07e8b2c20f4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:04.791067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ea630-47a0-42ef-9748-e07e8b2c20f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:04.831847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e65ea630-47a0-42ef-9748-e07e8b2c20f4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:04.833866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e65ea630-47a0-42ef-9748-e07e8b2c20f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:04.868724 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2293/4609] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:04.870601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386a6b8-bbc1-432b-a3c8-dca2be3838fc None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:04.889642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386a6b8-bbc1-432b-a3c8-dca2be3838fc None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:04.905014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb8586-0f80-41e3-be6a-8e301a827d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:04.906997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb8586-0f80-41e3-be6a-8e301a827d0d admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:04.907377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb8586-0f80-41e3-be6a-8e301a827d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:04.907665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb8586-0f80-41e3-be6a-8e301a827d0d admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:04.908338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb8586-0f80-41e3-be6a-8e301a827d0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:45:04.908643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb8586-0f80-41e3-be6a-8e301a827d0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:04.927275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb8586-0f80-41e3-be6a-8e301a827d0d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:04.943454 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2317/4610] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:45:04.947040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ea630-47a0-42ef-9748-e07e8b2c20f4 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:04.957963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ea630-47a0-42ef-9748-e07e8b2c20f4 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:04.965746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cce68-a0f2-4cde-948c-89977a32ab0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:04.966519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cce68-a0f2-4cde-948c-89977a32ab0e admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:04.966949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cce68-a0f2-4cde-948c-89977a32ab0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:04.967734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cce68-a0f2-4cde-948c-89977a32ab0e admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:04.968191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577cce68-a0f2-4cde-948c-89977a32ab0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:04.970457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577cce68-a0f2-4cde-948c-89977a32ab0e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:05.159814 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2294/4611] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:45:04 2022] POST /identity/v3/projects => generated 379 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:05.164937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb8586-0f80-41e3-be6a-8e301a827d0d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:05.209341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb8586-0f80-41e3-be6a-8e301a827d0d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:05.453266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4afed-b80e-4178-9981-cdf3462eb7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:05.456182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4afed-b80e-4178-9981-cdf3462eb7da admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:05.459354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4afed-b80e-4178-9981-cdf3462eb7da admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:05.461914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4afed-b80e-4178-9981-cdf3462eb7da admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:05.462945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4afed-b80e-4178-9981-cdf3462eb7da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:05.466126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4afed-b80e-4178-9981-cdf3462eb7da admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:05.590108 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2318/4612] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:45:05 2022] POST /identity/v3/users => generated 290 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:05.594453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cce68-a0f2-4cde-948c-89977a32ab0e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:05.620817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cce68-a0f2-4cde-948c-89977a32ab0e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:05.637274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c471a0c-7d54-4fea-ad3b-c2cead4282c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:05.638114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c471a0c-7d54-4fea-ad3b-c2cead4282c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:05.638507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c471a0c-7d54-4fea-ad3b-c2cead4282c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:05.638907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c471a0c-7d54-4fea-ad3b-c2cead4282c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:05.639835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c471a0c-7d54-4fea-ad3b-c2cead4282c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:05.641588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c471a0c-7d54-4fea-ad3b-c2cead4282c2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:05.662583 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2295/4613] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:05.666613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4afed-b80e-4178-9981-cdf3462eb7da admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:05.685062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4afed-b80e-4178-9981-cdf3462eb7da admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:05.698791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8686f-0cc8-48cd-8d52-258e57c2f19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:05.699650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8686f-0cc8-48cd-8d52-258e57c2f19c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:05.700077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8686f-0cc8-48cd-8d52-258e57c2f19c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:05.700916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8686f-0cc8-48cd-8d52-258e57c2f19c admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:05.701748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8686f-0cc8-48cd-8d52-258e57c2f19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:05.706206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8686f-0cc8-48cd-8d52-258e57c2f19c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:05.746448 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2319/4614] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:05.748612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c471a0c-7d54-4fea-ad3b-c2cead4282c2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:05.759810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c471a0c-7d54-4fea-ad3b-c2cead4282c2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:05.783647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64a898-117c-4ff2-89ff-1615db050d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:05.785092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64a898-117c-4ff2-89ff-1615db050d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:05.785478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64a898-117c-4ff2-89ff-1615db050d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:05.785858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64a898-117c-4ff2-89ff-1615db050d25 admin admin] PATH_INFO: `/v3/projects/e0fb3cc5f0e84ba2aef67367e4083485/users/a6f139efe66241128e6141617e32301a/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:05.822532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64a898-117c-4ff2-89ff-1615db050d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0fb3cc5f0e84ba2aef67367e4083485, user_id=a6f139efe66241128e6141617e32301a, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:05.827967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64a898-117c-4ff2-89ff-1615db050d25 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:05.840595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:05.937722 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2296/4615] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:05 2022] PUT /identity/v3/projects/e0fb3cc5f0e84ba2aef67367e4083485/users/a6f139efe66241128e6141617e32301a/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:05.948093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4d4d9-5694-48ed-b4a1-b3936cfb7b84 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:05.948222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4d4d9-5694-48ed-b4a1-b3936cfb7b84 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:05.948417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4d4d9-5694-48ed-b4a1-b3936cfb7b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:06.004150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a1c4d4d9-5694-48ed-b4a1-b3936cfb7b84 None None] MFA Rules not processed for user `a6f139efe66241128e6141617e32301a`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:06.005384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a1c4d4d9-5694-48ed-b4a1-b3936cfb7b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:06.153176 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2320/4616] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:06.154828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64a898-117c-4ff2-89ff-1615db050d25 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:06.291676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64a898-117c-4ff2-89ff-1615db050d25 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:06.303540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82583ab-4176-470f-983b-a0939adb6047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:06.304417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82583ab-4176-470f-983b-a0939adb6047 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:06.304860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82583ab-4176-470f-983b-a0939adb6047 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:06.305318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82583ab-4176-470f-983b-a0939adb6047 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:06.306164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82583ab-4176-470f-983b-a0939adb6047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:06.308256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82583ab-4176-470f-983b-a0939adb6047 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:06.486203 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2297/4617] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:45:06 2022] POST /identity/v3/projects => generated 379 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:06.487369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4d4d9-5694-48ed-b4a1-b3936cfb7b84 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:06.507390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4d4d9-5694-48ed-b4a1-b3936cfb7b84 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:06.524040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:06.652494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd1969-3d4c-4a62-ad52-20899f02963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:06.653351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd1969-3d4c-4a62-ad52-20899f02963a admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:06.653866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd1969-3d4c-4a62-ad52-20899f02963a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:06.654375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd1969-3d4c-4a62-ad52-20899f02963a admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:06.655191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd1969-3d4c-4a62-ad52-20899f02963a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:06.658395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd1969-3d4c-4a62-ad52-20899f02963a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:06.892442 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2321/4618] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:45:06 2022] POST /identity/v3/users => generated 296 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:06.896811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82583ab-4176-470f-983b-a0939adb6047 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:06.914940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82583ab-4176-470f-983b-a0939adb6047 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:06.926831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ec1e9-7364-413e-9ddb-8fe4c2f065ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:06.927534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ec1e9-7364-413e-9ddb-8fe4c2f065ea admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:06.927821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ec1e9-7364-413e-9ddb-8fe4c2f065ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:06.928099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ec1e9-7364-413e-9ddb-8fe4c2f065ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:06.928808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ec1e9-7364-413e-9ddb-8fe4c2f065ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:06.931005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ec1e9-7364-413e-9ddb-8fe4c2f065ea admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:06.957914 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2298/4619] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:06.962319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd1969-3d4c-4a62-ad52-20899f02963a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:06.979474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd1969-3d4c-4a62-ad52-20899f02963a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:06.990464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2ffd4-84e1-456a-a095-be47f20a70de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:06.991803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2ffd4-84e1-456a-a095-be47f20a70de admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:06.992201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2ffd4-84e1-456a-a095-be47f20a70de admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:06.992367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2ffd4-84e1-456a-a095-be47f20a70de admin admin] PATH_INFO: `/v3/projects/6eb9e48a3e574f8ea80d79811234cf15/users/8bc2dff8af5c4df383b22632d5ef9d21/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:07.027697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2ffd4-84e1-456a-a095-be47f20a70de admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb9e48a3e574f8ea80d79811234cf15, user_id=8bc2dff8af5c4df383b22632d5ef9d21, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:07.030464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2ffd4-84e1-456a-a095-be47f20a70de admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:07.146879 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2322/4620] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:06 2022] PUT /identity/v3/projects/6eb9e48a3e574f8ea80d79811234cf15/users/8bc2dff8af5c4df383b22632d5ef9d21/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:07.148441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ec1e9-7364-413e-9ddb-8fe4c2f065ea admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:07.165776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ec1e9-7364-413e-9ddb-8fe4c2f065ea admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:07.310895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858f5f4-1207-422c-b6f4-edb53b99479d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:07.312317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858f5f4-1207-422c-b6f4-edb53b99479d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:07.312955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858f5f4-1207-422c-b6f4-edb53b99479d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:07.313393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858f5f4-1207-422c-b6f4-edb53b99479d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:07.314250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858f5f4-1207-422c-b6f4-edb53b99479d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:07.317429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858f5f4-1207-422c-b6f4-edb53b99479d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:07.345071 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2299/4621] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:07.351325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2ffd4-84e1-456a-a095-be47f20a70de admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:07.368042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2ffd4-84e1-456a-a095-be47f20a70de admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:07.377003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fe7e0-cd17-408b-9cf0-578f60593738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:07.378735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fe7e0-cd17-408b-9cf0-578f60593738 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:07.379807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fe7e0-cd17-408b-9cf0-578f60593738 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:07.380554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fe7e0-cd17-408b-9cf0-578f60593738 admin admin] PATH_INFO: `/v3/projects/6eb9e48a3e574f8ea80d79811234cf15/users/8bc2dff8af5c4df383b22632d5ef9d21/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:07.383407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fe7e0-cd17-408b-9cf0-578f60593738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb9e48a3e574f8ea80d79811234cf15, user_id=8bc2dff8af5c4df383b22632d5ef9d21, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:07.387415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fe7e0-cd17-408b-9cf0-578f60593738 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:07.409407 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2323/4622] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:07 2022] PUT /identity/v3/projects/6eb9e48a3e574f8ea80d79811234cf15/users/8bc2dff8af5c4df383b22632d5ef9d21/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:07.420971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8881f9d-89eb-4c2f-a281-bdcb3716166e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:07.421554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8881f9d-89eb-4c2f-a281-bdcb3716166e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:07.422112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8881f9d-89eb-4c2f-a281-bdcb3716166e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:07.489495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d8881f9d-89eb-4c2f-a281-bdcb3716166e None None] MFA Rules not processed for user `8bc2dff8af5c4df383b22632d5ef9d21`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:07.492327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d8881f9d-89eb-4c2f-a281-bdcb3716166e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:07.606075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:07.638764 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2300/4623] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:07 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:07.667092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fe7e0-cd17-408b-9cf0-578f60593738 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:07.670978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-794fe7e0-cd17-408b-9cf0-578f60593738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:07.812628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fe7e0-cd17-408b-9cf0-578f60593738 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:07.825576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dea0c8-de35-4cad-91c4-64098803493f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:07.826948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dea0c8-de35-4cad-91c4-64098803493f service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:07.827235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dea0c8-de35-4cad-91c4-64098803493f service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:07.827515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dea0c8-de35-4cad-91c4-64098803493f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:07.968805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dea0c8-de35-4cad-91c4-64098803493f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:07.970411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dea0c8-de35-4cad-91c4-64098803493f service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:08.003200 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2324/4624] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:45:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:45:11.395935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8881f9d-89eb-4c2f-a281-bdcb3716166e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:11.429833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8881f9d-89eb-4c2f-a281-bdcb3716166e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:11.435515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a0bd0-1206-4a15-b12a-0bd351e8b83e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:11.436577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a0bd0-1206-4a15-b12a-0bd351e8b83e service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:11.437034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a0bd0-1206-4a15-b12a-0bd351e8b83e service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:11.437466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a0bd0-1206-4a15-b12a-0bd351e8b83e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:11.473884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a0bd0-1206-4a15-b12a-0bd351e8b83e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:11.475029 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a0bd0-1206-4a15-b12a-0bd351e8b83e service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:11.504225 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2301/4625] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:45:11 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:45:12.135189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dea0c8-de35-4cad-91c4-64098803493f service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:12.139997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-64dea0c8-de35-4cad-91c4-64098803493f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:12.246828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:12.360781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dea0c8-de35-4cad-91c4-64098803493f service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:12.366583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997b9f4-3de3-4ff7-8b26-c48ac0a3c581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:12.367235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997b9f4-3de3-4ff7-8b26-c48ac0a3c581 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:12.367517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997b9f4-3de3-4ff7-8b26-c48ac0a3c581 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:12.367792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997b9f4-3de3-4ff7-8b26-c48ac0a3c581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:12.369649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3997b9f4-3de3-4ff7-8b26-c48ac0a3c581 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:12.536144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997b9f4-3de3-4ff7-8b26-c48ac0a3c581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:12.536144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997b9f4-3de3-4ff7-8b26-c48ac0a3c581 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:12.567527 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2325/4626] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:45:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:45:14.679527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5cc70-3aa7-4fdc-8ab6-ff4f13a2f736 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:14.680450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5cc70-3aa7-4fdc-8ab6-ff4f13a2f736 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:14.680971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5cc70-3aa7-4fdc-8ab6-ff4f13a2f736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:14.706259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c8a5cc70-3aa7-4fdc-8ab6-ff4f13a2f736 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:14.707798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c8a5cc70-3aa7-4fdc-8ab6-ff4f13a2f736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:14.809465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997b9f4-3de3-4ff7-8b26-c48ac0a3c581 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:14.810986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3997b9f4-3de3-4ff7-8b26-c48ac0a3c581 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:14.812075 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2302/4627] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:45:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:14.813140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5cc70-3aa7-4fdc-8ab6-ff4f13a2f736 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:14.814741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c8a5cc70-3aa7-4fdc-8ab6-ff4f13a2f736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:14.831502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997b9f4-3de3-4ff7-8b26-c48ac0a3c581 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:14.837930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562da92-625b-4174-8601-df8f37e12a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:14.839115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562da92-625b-4174-8601-df8f37e12a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:14.840247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562da92-625b-4174-8601-df8f37e12a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:14.840857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562da92-625b-4174-8601-df8f37e12a16 admin admin] PATH_INFO: `/v3/users/ae9ddb0e44024937865411a7d2c3d956` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:14.842869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562da92-625b-4174-8601-df8f37e12a16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae9ddb0e44024937865411a7d2c3d956)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:14.845909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562da92-625b-4174-8601-df8f37e12a16 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:14.916066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5cc70-3aa7-4fdc-8ab6-ff4f13a2f736 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:14.923528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea96c8c-3546-428b-9583-fdce88ceb97c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:14.924517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea96c8c-3546-428b-9583-fdce88ceb97c service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:14.924975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea96c8c-3546-428b-9583-fdce88ceb97c service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:14.926106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea96c8c-3546-428b-9583-fdce88ceb97c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:14.935680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea96c8c-3546-428b-9583-fdce88ceb97c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:14.937768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea96c8c-3546-428b-9583-fdce88ceb97c service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:14.963427 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2303/4628] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:45:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:45:15.087969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7562da92-625b-4174-8601-df8f37e12a16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae9ddb0e44024937865411a7d2c3d956'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:15.091139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7562da92-625b-4174-8601-df8f37e12a16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae9ddb0e44024937865411a7d2c3d956'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:15.102678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7562da92-625b-4174-8601-df8f37e12a16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae9ddb0e44024937865411a7d2c3d956'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:15.119990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7562da92-625b-4174-8601-df8f37e12a16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae9ddb0e44024937865411a7d2c3d956'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:15.120516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7562da92-625b-4174-8601-df8f37e12a16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae9ddb0e44024937865411a7d2c3d956'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:15.236077 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2326/4629] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:45:14 2022] DELETE /identity/v3/users/ae9ddb0e44024937865411a7d2c3d956 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:45:16.135316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea96c8c-3546-428b-9583-fdce88ceb97c service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:16.170587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea96c8c-3546-428b-9583-fdce88ceb97c service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:16.395334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb3a31-fe2a-456b-8d42-442b60ff98f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:16.395334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb3a31-fe2a-456b-8d42-442b60ff98f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:16.395334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb3a31-fe2a-456b-8d42-442b60ff98f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:16.395334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb3a31-fe2a-456b-8d42-442b60ff98f3 admin admin] PATH_INFO: `/v3/projects/e4f0730b38a946759ea32c36f5876eb3` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:16.397184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb3a31-fe2a-456b-8d42-442b60ff98f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4f0730b38a946759ea32c36f5876eb3)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:16.397184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb3a31-fe2a-456b-8d42-442b60ff98f3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:16.465055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:16.713636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fcbb3a31-fe2a-456b-8d42-442b60ff98f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4f0730b38a946759ea32c36f5876eb3', 'request_id': 'req-fcbb3a31-fe2a-456b-8d42-442b60ff98f3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:16.824907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fcbb3a31-fe2a-456b-8d42-442b60ff98f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4f0730b38a946759ea32c36f5876eb3', 'request_id': 'req-fcbb3a31-fe2a-456b-8d42-442b60ff98f3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:16.838592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fcbb3a31-fe2a-456b-8d42-442b60ff98f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4f0730b38a946759ea32c36f5876eb3', 'request_id': 'req-fcbb3a31-fe2a-456b-8d42-442b60ff98f3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:16.861281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fcbb3a31-fe2a-456b-8d42-442b60ff98f3 admin admin] The token cache is being invalidate because project e4f0730b38a946759ea32c36f5876eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:45:16.861821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fcbb3a31-fe2a-456b-8d42-442b60ff98f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:16.862749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fcbb3a31-fe2a-456b-8d42-442b60ff98f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:16.864503 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2304/4630] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:45:16 2022] DELETE /identity/v3/projects/e4f0730b38a946759ea32c36f5876eb3 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:16.869551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997c1b7-46e7-41e9-b573-84f0c0f16ebb None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:16.870121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997c1b7-46e7-41e9-b573-84f0c0f16ebb None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:16.870563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997c1b7-46e7-41e9-b573-84f0c0f16ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:16.922466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d997c1b7-46e7-41e9-b573-84f0c0f16ebb None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:16.923867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d997c1b7-46e7-41e9-b573-84f0c0f16ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:17.059830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:17.147792 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2327/4631] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:17.152315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f973c1f-6c7f-43e4-a6c3-e7784f7a752a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:17.153208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f973c1f-6c7f-43e4-a6c3-e7784f7a752a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:17.153727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f973c1f-6c7f-43e4-a6c3-e7784f7a752a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:17.224600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0f973c1f-6c7f-43e4-a6c3-e7784f7a752a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:17.228482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0f973c1f-6c7f-43e4-a6c3-e7784f7a752a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:17.253609 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2305/4632] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:17.257627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997c1b7-46e7-41e9-b573-84f0c0f16ebb None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:17.274469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997c1b7-46e7-41e9-b573-84f0c0f16ebb None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:17.286194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e8de3-ceeb-48c7-98f1-1d96100c64b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:17.287504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e8de3-ceeb-48c7-98f1-1d96100c64b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:17.288078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e8de3-ceeb-48c7-98f1-1d96100c64b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:17.288638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e8de3-ceeb-48c7-98f1-1d96100c64b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:17.290276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e8de3-ceeb-48c7-98f1-1d96100c64b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:45:17.290833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e8de3-ceeb-48c7-98f1-1d96100c64b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:17.295321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e8de3-ceeb-48c7-98f1-1d96100c64b1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:17.327342 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2328/4633] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:45:17.330330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f973c1f-6c7f-43e4-a6c3-e7784f7a752a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:17.346654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f973c1f-6c7f-43e4-a6c3-e7784f7a752a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:17.360227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858108e-d6a0-4b30-a30d-0eb81c360486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:17.361364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858108e-d6a0-4b30-a30d-0eb81c360486 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:17.362263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858108e-d6a0-4b30-a30d-0eb81c360486 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:17.362799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858108e-d6a0-4b30-a30d-0eb81c360486 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:17.363830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858108e-d6a0-4b30-a30d-0eb81c360486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:17.367104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858108e-d6a0-4b30-a30d-0eb81c360486 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:17.497372 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2306/4634] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:45:17 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:17.502926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e8de3-ceeb-48c7-98f1-1d96100c64b1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:17.521899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e8de3-ceeb-48c7-98f1-1d96100c64b1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:17.643494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c044b-31ee-4c38-b95b-d14ed577f472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:17.644891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c044b-31ee-4c38-b95b-d14ed577f472 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:17.645529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c044b-31ee-4c38-b95b-d14ed577f472 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:17.645965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c044b-31ee-4c38-b95b-d14ed577f472 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:17.646820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c044b-31ee-4c38-b95b-d14ed577f472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:17.648945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c044b-31ee-4c38-b95b-d14ed577f472 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:17.752341 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2329/4635] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:45:17 2022] POST /identity/v3/users => generated 294 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:17.756780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858108e-d6a0-4b30-a30d-0eb81c360486 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:17.776232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858108e-d6a0-4b30-a30d-0eb81c360486 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:17.791763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b28a2-ac8a-4031-93b0-a32b31c55278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:17.792691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b28a2-ac8a-4031-93b0-a32b31c55278 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:17.792991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b28a2-ac8a-4031-93b0-a32b31c55278 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:17.793402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b28a2-ac8a-4031-93b0-a32b31c55278 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:17.794059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b28a2-ac8a-4031-93b0-a32b31c55278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:17.799275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b28a2-ac8a-4031-93b0-a32b31c55278 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:17.827890 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2307/4636] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:17.833185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c044b-31ee-4c38-b95b-d14ed577f472 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:17.849784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c044b-31ee-4c38-b95b-d14ed577f472 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:17.859742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e2edd-264a-49de-b6fe-c1dd94e778bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:17.860400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e2edd-264a-49de-b6fe-c1dd94e778bd admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:17.860715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e2edd-264a-49de-b6fe-c1dd94e778bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:17.860994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e2edd-264a-49de-b6fe-c1dd94e778bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:17.861725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e2edd-264a-49de-b6fe-c1dd94e778bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:17.863475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e2edd-264a-49de-b6fe-c1dd94e778bd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:17.902719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b28a2-ac8a-4031-93b0-a32b31c55278 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:17.915967 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2330/4637] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:17.918330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b28a2-ac8a-4031-93b0-a32b31c55278 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:17.937913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e14bdd-3f2a-4b73-9bba-ab93291a606d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:17.938728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e14bdd-3f2a-4b73-9bba-ab93291a606d admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:17.939124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e14bdd-3f2a-4b73-9bba-ab93291a606d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:17.939300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e14bdd-3f2a-4b73-9bba-ab93291a606d admin admin] PATH_INFO: `/v3/projects/2cb8d4a8c5044999b1e7e1000a0db3bd/users/a8d11d6c1ad9437f92525912d5ba3d92/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:17.993118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e14bdd-3f2a-4b73-9bba-ab93291a606d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cb8d4a8c5044999b1e7e1000a0db3bd, user_id=a8d11d6c1ad9437f92525912d5ba3d92, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:17.996649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e14bdd-3f2a-4b73-9bba-ab93291a606d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:18.101204 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2308/4638] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:17 2022] PUT /identity/v3/projects/2cb8d4a8c5044999b1e7e1000a0db3bd/users/a8d11d6c1ad9437f92525912d5ba3d92/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:45:18.106408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192ef23-f9ba-466b-83b4-7839f71866c7 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:18.106716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192ef23-f9ba-466b-83b4-7839f71866c7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:18.106996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192ef23-f9ba-466b-83b4-7839f71866c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:18.151754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e192ef23-f9ba-466b-83b4-7839f71866c7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:18.151754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e192ef23-f9ba-466b-83b4-7839f71866c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:18.385301 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2331/4639] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:18.398849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e14bdd-3f2a-4b73-9bba-ab93291a606d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:18.398849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-86e14bdd-3f2a-4b73-9bba-ab93291a606d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:18.524443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e14bdd-3f2a-4b73-9bba-ab93291a606d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:18.530393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c829363-5877-4e2a-8bb0-706267df59ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:18.531300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c829363-5877-4e2a-8bb0-706267df59ed service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:18.531753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c829363-5877-4e2a-8bb0-706267df59ed service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:18.532353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c829363-5877-4e2a-8bb0-706267df59ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:18.567182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c829363-5877-4e2a-8bb0-706267df59ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:18.571126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c829363-5877-4e2a-8bb0-706267df59ed service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:18.606175 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2309/4640] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:45:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:45:28.082554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192ef23-f9ba-466b-83b4-7839f71866c7 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:28.084860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e192ef23-f9ba-466b-83b4-7839f71866c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:28.108657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192ef23-f9ba-466b-83b4-7839f71866c7 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:28.121968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec984a-7b06-4d6a-81c2-b13da83d3939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:28.123595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec984a-7b06-4d6a-81c2-b13da83d3939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:28.123595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec984a-7b06-4d6a-81c2-b13da83d3939 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:28.123595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec984a-7b06-4d6a-81c2-b13da83d3939 admin admin] PATH_INFO: `/v3/users/a6f139efe66241128e6141617e32301a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:28.126857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec984a-7b06-4d6a-81c2-b13da83d3939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6f139efe66241128e6141617e32301a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:28.145622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec984a-7b06-4d6a-81c2-b13da83d3939 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:28.264564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c829363-5877-4e2a-8bb0-706267df59ed service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:28.266219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7c829363-5877-4e2a-8bb0-706267df59ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:28.307005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c829363-5877-4e2a-8bb0-706267df59ed service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:28.316825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e91da0-0dc1-4308-accb-ff8614922845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:28.318664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e91da0-0dc1-4308-accb-ff8614922845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:28.318934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e91da0-0dc1-4308-accb-ff8614922845 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:28.319274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e91da0-0dc1-4308-accb-ff8614922845 admin admin] PATH_INFO: `/v3/users/5ffc2b1c410149e884a47240b5425e57` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:28.332452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e91da0-0dc1-4308-accb-ff8614922845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ffc2b1c410149e884a47240b5425e57)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:28.334319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e91da0-0dc1-4308-accb-ff8614922845 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:28.459350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:28.471331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b0ec984a-7b06-4d6a-81c2-b13da83d3939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6f139efe66241128e6141617e32301a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:28.471331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b0ec984a-7b06-4d6a-81c2-b13da83d3939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6f139efe66241128e6141617e32301a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:28.496100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b0ec984a-7b06-4d6a-81c2-b13da83d3939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6f139efe66241128e6141617e32301a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:28.522067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b0ec984a-7b06-4d6a-81c2-b13da83d3939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6f139efe66241128e6141617e32301a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:28.524214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b0ec984a-7b06-4d6a-81c2-b13da83d3939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6f139efe66241128e6141617e32301a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:28.574645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:28.597664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a0e91da0-0dc1-4308-accb-ff8614922845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ffc2b1c410149e884a47240b5425e57'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:28.598405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a0e91da0-0dc1-4308-accb-ff8614922845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ffc2b1c410149e884a47240b5425e57'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:28.604495 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2332/4641] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:45:28 2022] DELETE /identity/v3/users/a6f139efe66241128e6141617e32301a => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:28.609963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cadad2-c108-4723-802f-3ff005b08465 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:28.611043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cadad2-c108-4723-802f-3ff005b08465 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:28.613858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cadad2-c108-4723-802f-3ff005b08465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:28.641217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a0e91da0-0dc1-4308-accb-ff8614922845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ffc2b1c410149e884a47240b5425e57'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:28.683213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a0e91da0-0dc1-4308-accb-ff8614922845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ffc2b1c410149e884a47240b5425e57'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:28.685230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d2cadad2-c108-4723-802f-3ff005b08465 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:28.686750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d2cadad2-c108-4723-802f-3ff005b08465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:28.760276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a0e91da0-0dc1-4308-accb-ff8614922845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ffc2b1c410149e884a47240b5425e57'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:28.771044 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2310/4642] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:45:28 2022] DELETE /identity/v3/users/5ffc2b1c410149e884a47240b5425e57 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:28.838813 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2333/4643] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:28.861935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e91da0-0dc1-4308-accb-ff8614922845 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:28.863452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a0e91da0-0dc1-4308-accb-ff8614922845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:29.008809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e91da0-0dc1-4308-accb-ff8614922845 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:29.025126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bacf7-0751-4bb8-b551-43f4d4d78934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:29.025776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bacf7-0751-4bb8-b551-43f4d4d78934 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:29.026085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bacf7-0751-4bb8-b551-43f4d4d78934 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:29.026368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bacf7-0751-4bb8-b551-43f4d4d78934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:29.210900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254bacf7-0751-4bb8-b551-43f4d4d78934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:29.212710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254bacf7-0751-4bb8-b551-43f4d4d78934 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:29.242816 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2311/4644] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:45:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:45:29.816213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cadad2-c108-4723-802f-3ff005b08465 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:29.818519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d2cadad2-c108-4723-802f-3ff005b08465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:29.849280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cadad2-c108-4723-802f-3ff005b08465 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:29.863990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37733a6e-d83c-475d-96fd-ee957f085c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:29.866911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37733a6e-d83c-475d-96fd-ee957f085c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:29.869768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37733a6e-d83c-475d-96fd-ee957f085c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:29.871061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37733a6e-d83c-475d-96fd-ee957f085c98 admin admin] PATH_INFO: `/v3/projects/38450368ef5c4e68ac3c19c7a0a1ce65` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:29.879110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37733a6e-d83c-475d-96fd-ee957f085c98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38450368ef5c4e68ac3c19c7a0a1ce65)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:29.883969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37733a6e-d83c-475d-96fd-ee957f085c98 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:30.088475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-37733a6e-d83c-475d-96fd-ee957f085c98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38450368ef5c4e68ac3c19c7a0a1ce65', 'request_id': 'req-37733a6e-d83c-475d-96fd-ee957f085c98'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:30.128266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-37733a6e-d83c-475d-96fd-ee957f085c98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38450368ef5c4e68ac3c19c7a0a1ce65', 'request_id': 'req-37733a6e-d83c-475d-96fd-ee957f085c98'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:30.177747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-37733a6e-d83c-475d-96fd-ee957f085c98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38450368ef5c4e68ac3c19c7a0a1ce65', 'request_id': 'req-37733a6e-d83c-475d-96fd-ee957f085c98'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:30.292334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-37733a6e-d83c-475d-96fd-ee957f085c98 admin admin] The token cache is being invalidate because project 38450368ef5c4e68ac3c19c7a0a1ce65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:45:30.293004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-37733a6e-d83c-475d-96fd-ee957f085c98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:30.294080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-37733a6e-d83c-475d-96fd-ee957f085c98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:30.298073 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2334/4645] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:45:29 2022] DELETE /identity/v3/projects/38450368ef5c4e68ac3c19c7a0a1ce65 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:30.304730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef3b1c-0684-4ca8-859f-9bf132ba062e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:30.305799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef3b1c-0684-4ca8-859f-9bf132ba062e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:30.306471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef3b1c-0684-4ca8-859f-9bf132ba062e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:30.334081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-38ef3b1c-0684-4ca8-859f-9bf132ba062e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:30.336384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-38ef3b1c-0684-4ca8-859f-9bf132ba062e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:30.373835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091c651-f67e-4b84-8a1d-e5b5ec658612 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:30.373835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091c651-f67e-4b84-8a1d-e5b5ec658612 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:30.374191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091c651-f67e-4b84-8a1d-e5b5ec658612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:30.453370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2091c651-f67e-4b84-8a1d-e5b5ec658612 None None] MFA Rules not processed for user `ca2da57f02884a968d685b53a5399e46`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:30.454817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2091c651-f67e-4b84-8a1d-e5b5ec658612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:30.520572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:30.528591 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2312/4646] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:30.537144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeca6bb-546f-4a5c-b3ae-82ccee2f3678 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:30.537450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeca6bb-546f-4a5c-b3ae-82ccee2f3678 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:30.537706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeca6bb-546f-4a5c-b3ae-82ccee2f3678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:30.563975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:30.575115 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2335/4647] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:30.586722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8d5f9-a324-450e-8d96-2e25991b6868 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:30.587015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8d5f9-a324-450e-8d96-2e25991b6868 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:30.587303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8d5f9-a324-450e-8d96-2e25991b6868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:30.590772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-2eeca6bb-546f-4a5c-b3ae-82ccee2f3678 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:30.592655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2eeca6bb-546f-4a5c-b3ae-82ccee2f3678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:30.616649 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2313/4648] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:45:30.621081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeca6bb-546f-4a5c-b3ae-82ccee2f3678 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:30.622631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-54a8d5f9-a324-450e-8d96-2e25991b6868 None None] MFA Rules not processed for user `ca2da57f02884a968d685b53a5399e46`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:30.624055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-54a8d5f9-a324-450e-8d96-2e25991b6868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:30.639578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeca6bb-546f-4a5c-b3ae-82ccee2f3678 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:30.645082 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2336/4649] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:30.653058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6308ea3-235e-49c6-8bf3-197f600ceded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:30.657155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6308ea3-235e-49c6-8bf3-197f600ceded admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:30.657155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6308ea3-235e-49c6-8bf3-197f600ceded admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:30.657155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6308ea3-235e-49c6-8bf3-197f600ceded admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:30.657155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6308ea3-235e-49c6-8bf3-197f600ceded admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:45:30.657155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6308ea3-235e-49c6-8bf3-197f600ceded admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:30.658203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8d5f9-a324-450e-8d96-2e25991b6868 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:30.661649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-54a8d5f9-a324-450e-8d96-2e25991b6868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:30.663711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6308ea3-235e-49c6-8bf3-197f600ceded admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:30.691378 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2314/4650] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:45:30.704211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6308ea3-235e-49c6-8bf3-197f600ceded admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:30.725533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6308ea3-235e-49c6-8bf3-197f600ceded admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:30.736246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e02d71-e106-40c5-aafc-4a90f4c85998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:30.737290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e02d71-e106-40c5-aafc-4a90f4c85998 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:30.737809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e02d71-e106-40c5-aafc-4a90f4c85998 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:30.738551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e02d71-e106-40c5-aafc-4a90f4c85998 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:30.740035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e02d71-e106-40c5-aafc-4a90f4c85998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:30.743782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e02d71-e106-40c5-aafc-4a90f4c85998 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:30.835763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8d5f9-a324-450e-8d96-2e25991b6868 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:30.850631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccc161-05ec-4a7e-947a-798d68e1b312 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:30.851734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccc161-05ec-4a7e-947a-798d68e1b312 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:30.852187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccc161-05ec-4a7e-947a-798d68e1b312 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:30.852626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccc161-05ec-4a7e-947a-798d68e1b312 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:30.873757 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2315/4651] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:45:30 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:30.875650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccc161-05ec-4a7e-947a-798d68e1b312 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:30.879783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccc161-05ec-4a7e-947a-798d68e1b312 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:30.887116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e02d71-e106-40c5-aafc-4a90f4c85998 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:30.906269 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2337/4652] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:45:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:45:30.991263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccc161-05ec-4a7e-947a-798d68e1b312 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:30.993528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-55ccc161-05ec-4a7e-947a-798d68e1b312 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:31.039866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccc161-05ec-4a7e-947a-798d68e1b312 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:31.085277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e02d71-e106-40c5-aafc-4a90f4c85998 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:31.099418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ac4d4-7529-4465-9662-ab495b60e797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:31.100055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ac4d4-7529-4465-9662-ab495b60e797 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:31.100394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ac4d4-7529-4465-9662-ab495b60e797 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:31.100977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ac4d4-7529-4465-9662-ab495b60e797 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:31.101683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ac4d4-7529-4465-9662-ab495b60e797 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:31.105259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ac4d4-7529-4465-9662-ab495b60e797 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:31.176363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4dfee-f1e9-4daf-822e-3b3e242ff182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:31.177542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4dfee-f1e9-4daf-822e-3b3e242ff182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:31.178618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4dfee-f1e9-4daf-822e-3b3e242ff182 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:31.179102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4dfee-f1e9-4daf-822e-3b3e242ff182 admin admin] PATH_INFO: `/v3/projects/e0fb3cc5f0e84ba2aef67367e4083485` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:31.180824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4dfee-f1e9-4daf-822e-3b3e242ff182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0fb3cc5f0e84ba2aef67367e4083485)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:31.186590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4dfee-f1e9-4daf-822e-3b3e242ff182 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:31.256237 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2316/4653] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:45:30 2022] POST /identity/v3/users => generated 288 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:31.258191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ac4d4-7529-4465-9662-ab495b60e797 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:31.269264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ac4d4-7529-4465-9662-ab495b60e797 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:31.280219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f75fd0-9dd7-45db-a919-c8f0ff8f279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:31.281284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f75fd0-9dd7-45db-a919-c8f0ff8f279d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:31.281284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f75fd0-9dd7-45db-a919-c8f0ff8f279d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:31.281677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f75fd0-9dd7-45db-a919-c8f0ff8f279d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:31.282490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f75fd0-9dd7-45db-a919-c8f0ff8f279d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:31.284204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f75fd0-9dd7-45db-a919-c8f0ff8f279d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:31.322382 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2317/4654] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:31.327463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f75fd0-9dd7-45db-a919-c8f0ff8f279d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:31.337181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3fe4dfee-f1e9-4daf-822e-3b3e242ff182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0fb3cc5f0e84ba2aef67367e4083485', 'request_id': 'req-3fe4dfee-f1e9-4daf-822e-3b3e242ff182'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:31.341912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:31.352243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f75fd0-9dd7-45db-a919-c8f0ff8f279d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:31.353251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3fe4dfee-f1e9-4daf-822e-3b3e242ff182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0fb3cc5f0e84ba2aef67367e4083485', 'request_id': 'req-3fe4dfee-f1e9-4daf-822e-3b3e242ff182'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:31.369669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3fe4dfee-f1e9-4daf-822e-3b3e242ff182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0fb3cc5f0e84ba2aef67367e4083485', 'request_id': 'req-3fe4dfee-f1e9-4daf-822e-3b3e242ff182'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:31.451213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3fe4dfee-f1e9-4daf-822e-3b3e242ff182 admin admin] The token cache is being invalidate because project e0fb3cc5f0e84ba2aef67367e4083485 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:45:31.451666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3fe4dfee-f1e9-4daf-822e-3b3e242ff182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:31.457165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3fe4dfee-f1e9-4daf-822e-3b3e242ff182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:31.459240 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2338/4655] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:45:30 2022] DELETE /identity/v3/projects/e0fb3cc5f0e84ba2aef67367e4083485 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:31.462868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4dfee-f1e9-4daf-822e-3b3e242ff182 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:31.464214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10adb8-c843-43b2-868c-2d98b3b585ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:31.464446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3fe4dfee-f1e9-4daf-822e-3b3e242ff182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:31.465194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10adb8-c843-43b2-868c-2d98b3b585ac admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:31.466072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10adb8-c843-43b2-868c-2d98b3b585ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:31.466072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10adb8-c843-43b2-868c-2d98b3b585ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:31.466875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10adb8-c843-43b2-868c-2d98b3b585ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:31.470414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10adb8-c843-43b2-868c-2d98b3b585ac admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:31.488061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4dfee-f1e9-4daf-822e-3b3e242ff182 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:31.497341 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2318/4656] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:31.503997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10adb8-c843-43b2-868c-2d98b3b585ac admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:31.506948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e21838-b024-48e0-b72c-47c02183914e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:31.508933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ce10adb8-c843-43b2-868c-2d98b3b585ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:31.509116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e21838-b024-48e0-b72c-47c02183914e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:31.509116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e21838-b024-48e0-b72c-47c02183914e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:31.509318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e21838-b024-48e0-b72c-47c02183914e admin admin] PATH_INFO: `/v3/users/8bc2dff8af5c4df383b22632d5ef9d21` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:31.510418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e21838-b024-48e0-b72c-47c02183914e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bc2dff8af5c4df383b22632d5ef9d21)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:31.512470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e21838-b024-48e0-b72c-47c02183914e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:31.526525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10adb8-c843-43b2-868c-2d98b3b585ac admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:31.532213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c78cf6-7f51-4839-bd6d-fc8081042ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:31.533198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c78cf6-7f51-4839-bd6d-fc8081042ca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:31.533777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c78cf6-7f51-4839-bd6d-fc8081042ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:31.534294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c78cf6-7f51-4839-bd6d-fc8081042ca0 admin admin] PATH_INFO: `/v3/projects/7c5b2568529a4d92835d7c717fd569e9/users/907c1680c15a45dea209c066d8a69276/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:31.556551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c78cf6-7f51-4839-bd6d-fc8081042ca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c5b2568529a4d92835d7c717fd569e9, user_id=907c1680c15a45dea209c066d8a69276, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:31.560972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c78cf6-7f51-4839-bd6d-fc8081042ca0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:31.701438 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2319/4657] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:31 2022] PUT /identity/v3/projects/7c5b2568529a4d92835d7c717fd569e9/users/907c1680c15a45dea209c066d8a69276/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:31.706754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b951e9-a199-42dd-a96c-20902e4659ec None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:31.707087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b951e9-a199-42dd-a96c-20902e4659ec None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:31.707327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b951e9-a199-42dd-a96c-20902e4659ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:31.754912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:31.761294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d2b951e9-a199-42dd-a96c-20902e4659ec None None] MFA Rules not processed for user `907c1680c15a45dea209c066d8a69276`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:31.762685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d2b951e9-a199-42dd-a96c-20902e4659ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:31.790292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d9e21838-b024-48e0-b72c-47c02183914e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bc2dff8af5c4df383b22632d5ef9d21'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:31.792574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d9e21838-b024-48e0-b72c-47c02183914e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bc2dff8af5c4df383b22632d5ef9d21'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:31.807919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d9e21838-b024-48e0-b72c-47c02183914e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bc2dff8af5c4df383b22632d5ef9d21'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:31.834253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d9e21838-b024-48e0-b72c-47c02183914e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bc2dff8af5c4df383b22632d5ef9d21'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:31.834253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d9e21838-b024-48e0-b72c-47c02183914e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bc2dff8af5c4df383b22632d5ef9d21'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:31.927871 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2320/4658] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:45:31.932383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b951e9-a199-42dd-a96c-20902e4659ec None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:31.933814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d2b951e9-a199-42dd-a96c-20902e4659ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:31.942317 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2339/4659] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:45:31 2022] DELETE /identity/v3/users/8bc2dff8af5c4df383b22632d5ef9d21 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:32.027118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b951e9-a199-42dd-a96c-20902e4659ec None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:32.199181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6100d-3be2-459c-a99e-40b09f7fd67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:32.201716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6100d-3be2-459c-a99e-40b09f7fd67d admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:32.202261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6100d-3be2-459c-a99e-40b09f7fd67d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:32.203137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6100d-3be2-459c-a99e-40b09f7fd67d admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:32.204784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6100d-3be2-459c-a99e-40b09f7fd67d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:32.209060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6100d-3be2-459c-a99e-40b09f7fd67d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:32.357394 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2321/4660] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:45:31 2022] POST /identity/v3/projects => generated 375 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:45:32.362720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e21838-b024-48e0-b72c-47c02183914e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:32.378152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e21838-b024-48e0-b72c-47c02183914e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:32.555351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e514b-ff15-4d30-a87b-fc0ebbc694d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:32.556202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e514b-ff15-4d30-a87b-fc0ebbc694d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:32.556849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e514b-ff15-4d30-a87b-fc0ebbc694d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:32.557272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e514b-ff15-4d30-a87b-fc0ebbc694d2 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:32.558760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e514b-ff15-4d30-a87b-fc0ebbc694d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:32.560956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e514b-ff15-4d30-a87b-fc0ebbc694d2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:32.676998 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2340/4661] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:45:32 2022] POST /identity/v3/users => generated 294 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:32.681276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6100d-3be2-459c-a99e-40b09f7fd67d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:32.694739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6100d-3be2-459c-a99e-40b09f7fd67d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:32.700095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696421cb-becb-43bb-add6-838fc74596fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:32.701508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696421cb-becb-43bb-add6-838fc74596fd admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:32.701992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696421cb-becb-43bb-add6-838fc74596fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:32.702646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696421cb-becb-43bb-add6-838fc74596fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:32.703914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696421cb-becb-43bb-add6-838fc74596fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:32.706766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696421cb-becb-43bb-add6-838fc74596fd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:32.719786 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2322/4662] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:32.724863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e514b-ff15-4d30-a87b-fc0ebbc694d2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:32.740888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e514b-ff15-4d30-a87b-fc0ebbc694d2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:32.742768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d068f-f462-42bc-9fab-d7322cadaadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:32.743704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d068f-f462-42bc-9fab-d7322cadaadb admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:32.744193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d068f-f462-42bc-9fab-d7322cadaadb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:32.744826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d068f-f462-42bc-9fab-d7322cadaadb admin admin] PATH_INFO: `/v3/projects/8e155f1b8fec4c148ecccc7b3af0f90a/users/cce2028818864b7b84fc4ec067d4d9c4/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:32.763299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d068f-f462-42bc-9fab-d7322cadaadb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e155f1b8fec4c148ecccc7b3af0f90a, user_id=cce2028818864b7b84fc4ec067d4d9c4, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:32.766264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d068f-f462-42bc-9fab-d7322cadaadb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:32.872244 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2341/4663] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:32 2022] PUT /identity/v3/projects/8e155f1b8fec4c148ecccc7b3af0f90a/users/cce2028818864b7b84fc4ec067d4d9c4/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:32.873166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696421cb-becb-43bb-add6-838fc74596fd admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:32.894799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696421cb-becb-43bb-add6-838fc74596fd admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:32.940201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:33.005980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbdefd-c143-42d0-9d1b-5d36d6db03f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:33.006717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbdefd-c143-42d0-9d1b-5d36d6db03f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:33.007008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbdefd-c143-42d0-9d1b-5d36d6db03f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:33.012403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbdefd-c143-42d0-9d1b-5d36d6db03f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:33.012403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbdefd-c143-42d0-9d1b-5d36d6db03f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:33.012403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbdefd-c143-42d0-9d1b-5d36d6db03f7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:33.025968 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2323/4664] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:33.029775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d068f-f462-42bc-9fab-d7322cadaadb admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:33.046074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d068f-f462-42bc-9fab-d7322cadaadb admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:33.058771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08d0ed-0084-4756-9027-714dbe1ccd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:33.060648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08d0ed-0084-4756-9027-714dbe1ccd7e admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:33.061202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08d0ed-0084-4756-9027-714dbe1ccd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:33.061670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08d0ed-0084-4756-9027-714dbe1ccd7e admin admin] PATH_INFO: `/v3/projects/8e155f1b8fec4c148ecccc7b3af0f90a/users/cce2028818864b7b84fc4ec067d4d9c4/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:33.069944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08d0ed-0084-4756-9027-714dbe1ccd7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e155f1b8fec4c148ecccc7b3af0f90a, user_id=cce2028818864b7b84fc4ec067d4d9c4, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:33.077939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08d0ed-0084-4756-9027-714dbe1ccd7e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:33.117098 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2342/4665] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:33 2022] PUT /identity/v3/projects/8e155f1b8fec4c148ecccc7b3af0f90a/users/cce2028818864b7b84fc4ec067d4d9c4/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:33.118117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93037037-ed5d-4166-864e-f666478e3ab8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:33.118474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93037037-ed5d-4166-864e-f666478e3ab8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:33.123161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93037037-ed5d-4166-864e-f666478e3ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:33.164053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-93037037-ed5d-4166-864e-f666478e3ab8 None None] MFA Rules not processed for user `cce2028818864b7b84fc4ec067d4d9c4`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:33.166560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-93037037-ed5d-4166-864e-f666478e3ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:33.246931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08d0ed-0084-4756-9027-714dbe1ccd7e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:33.249188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cd08d0ed-0084-4756-9027-714dbe1ccd7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:33.257312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=80,keystone:DELETE=13,keystone:INSERT=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:33.288101 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2324/4666] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:33.289591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93037037-ed5d-4166-864e-f666478e3ab8 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:33.314920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93037037-ed5d-4166-864e-f666478e3ab8 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:33.328860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f647e-f5fc-4fa5-819a-d18412d96f42 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce2028818864b7b84fc4ec067d4d9c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e155f1b8fec4c148ecccc7b3af0f90a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:33.329547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f647e-f5fc-4fa5-819a-d18412d96f42 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:33.331677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f647e-f5fc-4fa5-819a-d18412d96f42 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:33.333185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f647e-f5fc-4fa5-819a-d18412d96f42 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:33.333861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f647e-f5fc-4fa5-819a-d18412d96f42 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:33.335787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f647e-f5fc-4fa5-819a-d18412d96f42 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:33.378954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08d0ed-0084-4756-9027-714dbe1ccd7e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:33.386357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a1efa-bd1a-4257-9414-66e6cb33c770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:33.387126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a1efa-bd1a-4257-9414-66e6cb33c770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:33.387419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a1efa-bd1a-4257-9414-66e6cb33c770 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:33.387700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a1efa-bd1a-4257-9414-66e6cb33c770 admin admin] PATH_INFO: `/v3/projects/6eb9e48a3e574f8ea80d79811234cf15` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:33.389523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a1efa-bd1a-4257-9414-66e6cb33c770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eb9e48a3e574f8ea80d79811234cf15)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:33.392260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a1efa-bd1a-4257-9414-66e6cb33c770 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:33.461923 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2325/4667] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Oct 27 03:45:33 2022] POST /identity/v3/projects => generated 349 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:33.468392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f647e-f5fc-4fa5-819a-d18412d96f42 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:33.595431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f647e-f5fc-4fa5-819a-d18412d96f42 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:33.643785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0c6a1efa-bd1a-4257-9414-66e6cb33c770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eb9e48a3e574f8ea80d79811234cf15', 'request_id': 'req-0c6a1efa-bd1a-4257-9414-66e6cb33c770'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:33.659959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0c6a1efa-bd1a-4257-9414-66e6cb33c770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eb9e48a3e574f8ea80d79811234cf15', 'request_id': 'req-0c6a1efa-bd1a-4257-9414-66e6cb33c770'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:33.688172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0c6a1efa-bd1a-4257-9414-66e6cb33c770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eb9e48a3e574f8ea80d79811234cf15', 'request_id': 'req-0c6a1efa-bd1a-4257-9414-66e6cb33c770'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:33.732566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5dc1c4-61ff-4c16-b7d0-60b0ca38417f tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce2028818864b7b84fc4ec067d4d9c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e155f1b8fec4c148ecccc7b3af0f90a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:33.733248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dc1c4-61ff-4c16-b7d0-60b0ca38417f tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:33.733491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dc1c4-61ff-4c16-b7d0-60b0ca38417f tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:33.733772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dc1c4-61ff-4c16-b7d0-60b0ca38417f tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:33.734445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5dc1c4-61ff-4c16-b7d0-60b0ca38417f tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:33.737111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5dc1c4-61ff-4c16-b7d0-60b0ca38417f tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:33.788438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0c6a1efa-bd1a-4257-9414-66e6cb33c770 admin admin] The token cache is being invalidate because project 6eb9e48a3e574f8ea80d79811234cf15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:45:33.790331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0c6a1efa-bd1a-4257-9414-66e6cb33c770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:33.790331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0c6a1efa-bd1a-4257-9414-66e6cb33c770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:33.791885 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2343/4668] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:45:33 2022] DELETE /identity/v3/projects/6eb9e48a3e574f8ea80d79811234cf15 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:45:33.792936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a1efa-bd1a-4257-9414-66e6cb33c770 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:33.794809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0c6a1efa-bd1a-4257-9414-66e6cb33c770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:33.903013 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2326/4669] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:45:33 2022] POST /identity/v3/projects => generated 351 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:45:33.905742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de4a7e-68ef-4ff0-995d-7e6718d23f42 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:33.918464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de4a7e-68ef-4ff0-995d-7e6718d23f42 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:33.920404 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de4a7e-68ef-4ff0-995d-7e6718d23f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:33.923056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a1efa-bd1a-4257-9414-66e6cb33c770 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:33.943090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:33.974550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d4de4a7e-68ef-4ff0-995d-7e6718d23f42 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:33.976923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d4de4a7e-68ef-4ff0-995d-7e6718d23f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:34.056781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8c002-9cca-4959-9cb4-a305d0278aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:34.057569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8c002-9cca-4959-9cb4-a305d0278aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:34.057902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8c002-9cca-4959-9cb4-a305d0278aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:34.058252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8c002-9cca-4959-9cb4-a305d0278aa5 admin admin] PATH_INFO: `/v3/users/3fbb50fe1a4d4660adfbfe14c7123933` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:34.065389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8c002-9cca-4959-9cb4-a305d0278aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fbb50fe1a4d4660adfbfe14c7123933)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:34.065389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8c002-9cca-4959-9cb4-a305d0278aa5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:34.081361 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2327/4670] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:34.082942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de4a7e-68ef-4ff0-995d-7e6718d23f42 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:34.084535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d4de4a7e-68ef-4ff0-995d-7e6718d23f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:34.188167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de4a7e-68ef-4ff0-995d-7e6718d23f42 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:34.194557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bcc86d-dc1a-4cb4-ae60-49593d81dcb3 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce2028818864b7b84fc4ec067d4d9c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e155f1b8fec4c148ecccc7b3af0f90a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:34.195514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcc86d-dc1a-4cb4-ae60-49593d81dcb3 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:34.195806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcc86d-dc1a-4cb4-ae60-49593d81dcb3 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:34.196090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcc86d-dc1a-4cb4-ae60-49593d81dcb3 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] PATH_INFO: `/v3/users/907c1680c15a45dea209c066d8a69276` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:34.197623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bcc86d-dc1a-4cb4-ae60-49593d81dcb3 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorizing `identity:get_user(user_id=907c1680c15a45dea209c066d8a69276)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:34.200062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bcc86d-dc1a-4cb4-ae60-49593d81dcb3 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:34.204310 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2328/4671] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 03:45:34 2022] GET /identity/v3/users/907c1680c15a45dea209c066d8a69276 => generated 288 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:45:34.206641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9ad0f-2d4d-45bd-8595-e9a1eb7c846f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:34.206917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9ad0f-2d4d-45bd-8595-e9a1eb7c846f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:34.208949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9ad0f-2d4d-45bd-8595-e9a1eb7c846f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:34.254986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-34e9ad0f-2d4d-45bd-8595-e9a1eb7c846f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:34.256526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-34e9ad0f-2d4d-45bd-8595-e9a1eb7c846f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:34.279071 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2329/4672] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:34.280200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9ad0f-2d4d-45bd-8595-e9a1eb7c846f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:34.306376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9ad0f-2d4d-45bd-8595-e9a1eb7c846f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:34.312535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976caaff-134d-4459-9264-8a0b4173c821 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce2028818864b7b84fc4ec067d4d9c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e155f1b8fec4c148ecccc7b3af0f90a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:34.313610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976caaff-134d-4459-9264-8a0b4173c821 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:34.313902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976caaff-134d-4459-9264-8a0b4173c821 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:34.314312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976caaff-134d-4459-9264-8a0b4173c821 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:34.314978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976caaff-134d-4459-9264-8a0b4173c821 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:34.316764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976caaff-134d-4459-9264-8a0b4173c821 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:34.456595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffd8c002-9cca-4959-9cb4-a305d0278aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fbb50fe1a4d4660adfbfe14c7123933'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:34.459916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffd8c002-9cca-4959-9cb4-a305d0278aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fbb50fe1a4d4660adfbfe14c7123933'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:34.462613 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2330/4673] 10.222.0.20 () {60 vars in 1162 bytes} [Thu Oct 27 03:45:34 2022] POST /identity/v3/credentials => generated 431 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:34.471250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976caaff-134d-4459-9264-8a0b4173c821 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:34.478651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-976caaff-134d-4459-9264-8a0b4173c821 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:34.493623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffd8c002-9cca-4959-9cb4-a305d0278aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fbb50fe1a4d4660adfbfe14c7123933'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:34.532121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976caaff-134d-4459-9264-8a0b4173c821 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:34.539540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a8df1-02b3-4422-80f9-93ee596b873e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:34.541707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a8df1-02b3-4422-80f9-93ee596b873e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:34.542510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a8df1-02b3-4422-80f9-93ee596b873e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:34.542645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a8df1-02b3-4422-80f9-93ee596b873e admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:34.543246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a8df1-02b3-4422-80f9-93ee596b873e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:45:34.543555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a8df1-02b3-4422-80f9-93ee596b873e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:34.545641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a8df1-02b3-4422-80f9-93ee596b873e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:34.562845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffd8c002-9cca-4959-9cb4-a305d0278aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fbb50fe1a4d4660adfbfe14c7123933'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:34.568061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffd8c002-9cca-4959-9cb4-a305d0278aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fbb50fe1a4d4660adfbfe14c7123933'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:34.579900 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2331/4674] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:45:34.580996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a8df1-02b3-4422-80f9-93ee596b873e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:34.583035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-206a8df1-02b3-4422-80f9-93ee596b873e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:34.634149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a8df1-02b3-4422-80f9-93ee596b873e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:34.644738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa826a-d649-404d-83e3-378590c419bc tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce2028818864b7b84fc4ec067d4d9c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e155f1b8fec4c148ecccc7b3af0f90a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:34.645582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa826a-d649-404d-83e3-378590c419bc tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:34.646151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa826a-d649-404d-83e3-378590c419bc tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:34.646434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa826a-d649-404d-83e3-378590c419bc tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] PATH_INFO: `/v3/credentials/da85c59d67dca18e09166459d5a2aec13ef8e7002516b9ce73a124f4e2a440e7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:34.650878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa826a-d649-404d-83e3-378590c419bc tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=da85c59d67dca18e09166459d5a2aec13ef8e7002516b9ce73a124f4e2a440e7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:34.661390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa826a-d649-404d-83e3-378590c419bc tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:34.671211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa826a-d649-404d-83e3-378590c419bc tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=da85c59d67dca18e09166459d5a2aec13ef8e7002516b9ce73a124f4e2a440e7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:34.674768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa826a-d649-404d-83e3-378590c419bc tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:34.728985 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2344/4675] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:45:33 2022] DELETE /identity/v3/users/3fbb50fe1a4d4660adfbfe14c7123933 => generated 0 bytes in 936 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:34.729844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8c002-9cca-4959-9cb4-a305d0278aa5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:34.805085 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2332/4676] 10.222.0.20 () {60 vars in 1358 bytes} [Thu Oct 27 03:45:34 2022] PATCH /identity/v3/credentials/da85c59d67dca18e09166459d5a2aec13ef8e7002516b9ce73a124f4e2a440e7 => generated 436 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:45:34.806629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b332fa7-9ec6-4cc4-9a91-bff56468adaf None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:34.806931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b332fa7-9ec6-4cc4-9a91-bff56468adaf None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:34.807262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b332fa7-9ec6-4cc4-9a91-bff56468adaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:34.816095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:34.863154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8b332fa7-9ec6-4cc4-9a91-bff56468adaf None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:34.888002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8b332fa7-9ec6-4cc4-9a91-bff56468adaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:34.917004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8c002-9cca-4959-9cb4-a305d0278aa5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:34.922980 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2333/4677] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:34.925525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2ca97-49ff-4cc8-8a51-4bb5c79571c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:34.925525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2ca97-49ff-4cc8-8a51-4bb5c79571c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:34.926013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2ca97-49ff-4cc8-8a51-4bb5c79571c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:34.926637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2ca97-49ff-4cc8-8a51-4bb5c79571c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:34.927505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2ca97-49ff-4cc8-8a51-4bb5c79571c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:34.928427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b332fa7-9ec6-4cc4-9a91-bff56468adaf None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:34.930881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2ca97-49ff-4cc8-8a51-4bb5c79571c4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:35.050339 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2345/4678] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:45:34 2022] POST /identity/v3/projects => generated 383 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:35.051611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2ca97-49ff-4cc8-8a51-4bb5c79571c4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:35.053601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-97a2ca97-49ff-4cc8-8a51-4bb5c79571c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:35.069074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b332fa7-9ec6-4cc4-9a91-bff56468adaf None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:35.122765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:35.169904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2ca97-49ff-4cc8-8a51-4bb5c79571c4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:35.172511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28ba10-9384-4a62-898e-92da042b78b4 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce2028818864b7b84fc4ec067d4d9c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e155f1b8fec4c148ecccc7b3af0f90a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:35.173004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28ba10-9384-4a62-898e-92da042b78b4 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:35.173307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28ba10-9384-4a62-898e-92da042b78b4 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:35.173636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28ba10-9384-4a62-898e-92da042b78b4 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] PATH_INFO: `/v3/credentials/da85c59d67dca18e09166459d5a2aec13ef8e7002516b9ce73a124f4e2a440e7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:35.176940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28ba10-9384-4a62-898e-92da042b78b4 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=da85c59d67dca18e09166459d5a2aec13ef8e7002516b9ce73a124f4e2a440e7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:35.199876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31454066-2d75-4eab-ae21-a614b2efd581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:35.200845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31454066-2d75-4eab-ae21-a614b2efd581 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:35.200845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31454066-2d75-4eab-ae21-a614b2efd581 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:35.201053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31454066-2d75-4eab-ae21-a614b2efd581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:35.201710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28ba10-9384-4a62-898e-92da042b78b4 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:35.212740 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2334/4679] 10.222.0.20 () {58 vars in 1335 bytes} [Thu Oct 27 03:45:34 2022] GET /identity/v3/credentials/da85c59d67dca18e09166459d5a2aec13ef8e7002516b9ce73a124f4e2a440e7 => generated 436 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:45:35.213647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28ba10-9384-4a62-898e-92da042b78b4 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:35.298765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31454066-2d75-4eab-ae21-a614b2efd581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:35.300502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31454066-2d75-4eab-ae21-a614b2efd581 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:35.313194 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2346/4680] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:45:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:45:35.314913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31454066-2d75-4eab-ae21-a614b2efd581 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:35.327696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31454066-2d75-4eab-ae21-a614b2efd581 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:35.335267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b06e8b-e653-415a-b0fc-69a31f0c8ee3 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce2028818864b7b84fc4ec067d4d9c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e155f1b8fec4c148ecccc7b3af0f90a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:35.336033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b06e8b-e653-415a-b0fc-69a31f0c8ee3 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:35.336417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b06e8b-e653-415a-b0fc-69a31f0c8ee3 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:35.336794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b06e8b-e653-415a-b0fc-69a31f0c8ee3 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] PATH_INFO: `/v3/credentials/da85c59d67dca18e09166459d5a2aec13ef8e7002516b9ce73a124f4e2a440e7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:35.339694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b06e8b-e653-415a-b0fc-69a31f0c8ee3 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=da85c59d67dca18e09166459d5a2aec13ef8e7002516b9ce73a124f4e2a440e7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:35.343283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b06e8b-e653-415a-b0fc-69a31f0c8ee3 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:35.438713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28ba10-9384-4a62-898e-92da042b78b4 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:35.449813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12d988-d665-4f6d-a841-4e7256d63e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:35.450913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12d988-d665-4f6d-a841-4e7256d63e92 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:35.451539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12d988-d665-4f6d-a841-4e7256d63e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:35.452205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12d988-d665-4f6d-a841-4e7256d63e92 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:35.453827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12d988-d665-4f6d-a841-4e7256d63e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:35.458155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12d988-d665-4f6d-a841-4e7256d63e92 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:35.459275 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2347/4681] 10.222.0.20 () {58 vars in 1338 bytes} [Thu Oct 27 03:45:35 2022] DELETE /identity/v3/credentials/da85c59d67dca18e09166459d5a2aec13ef8e7002516b9ce73a124f4e2a440e7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:35.466195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b06e8b-e653-415a-b0fc-69a31f0c8ee3 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:35.484127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b06e8b-e653-415a-b0fc-69a31f0c8ee3 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:35.491840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d13e3d-88e1-4c13-a9ca-3ce65fe66879 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce2028818864b7b84fc4ec067d4d9c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e155f1b8fec4c148ecccc7b3af0f90a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:35.492545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d13e3d-88e1-4c13-a9ca-3ce65fe66879 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:35.492845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d13e3d-88e1-4c13-a9ca-3ce65fe66879 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:35.493588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d13e3d-88e1-4c13-a9ca-3ce65fe66879 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:35.493794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d13e3d-88e1-4c13-a9ca-3ce65fe66879 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:35.496083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d13e3d-88e1-4c13-a9ca-3ce65fe66879 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:35.641850 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2335/4682] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:45:35 2022] POST /identity/v3/users => generated 292 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:35.652075 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2348/4683] 10.222.0.20 () {60 vars in 1162 bytes} [Thu Oct 27 03:45:35 2022] POST /identity/v3/credentials => generated 430 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:35.656523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d13e3d-88e1-4c13-a9ca-3ce65fe66879 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:35.659569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12d988-d665-4f6d-a841-4e7256d63e92 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:35.690713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d13e3d-88e1-4c13-a9ca-3ce65fe66879 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:35.710416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4f95b-9bdb-41c0-924d-6db88df43a2f tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce2028818864b7b84fc4ec067d4d9c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e155f1b8fec4c148ecccc7b3af0f90a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:35.711071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4f95b-9bdb-41c0-924d-6db88df43a2f tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:35.712497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4f95b-9bdb-41c0-924d-6db88df43a2f tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:35.712793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4f95b-9bdb-41c0-924d-6db88df43a2f tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:35.713517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12d988-d665-4f6d-a841-4e7256d63e92 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:35.714655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4f95b-9bdb-41c0-924d-6db88df43a2f tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:35.720575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4f95b-9bdb-41c0-924d-6db88df43a2f tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:35.758131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711fb80-fd67-47c7-bd07-ebf8e8cdde58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:35.758807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711fb80-fd67-47c7-bd07-ebf8e8cdde58 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:35.763891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711fb80-fd67-47c7-bd07-ebf8e8cdde58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:35.765685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711fb80-fd67-47c7-bd07-ebf8e8cdde58 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:35.766621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711fb80-fd67-47c7-bd07-ebf8e8cdde58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:35.776959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711fb80-fd67-47c7-bd07-ebf8e8cdde58 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:35.805038 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2336/4684] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:35.806394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711fb80-fd67-47c7-bd07-ebf8e8cdde58 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:35.814090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7711fb80-fd67-47c7-bd07-ebf8e8cdde58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:35.816021 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2349/4685] 10.222.0.20 () {60 vars in 1162 bytes} [Thu Oct 27 03:45:35 2022] POST /identity/v3/credentials => generated 430 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:35.816849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4f95b-9bdb-41c0-924d-6db88df43a2f tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:35.830910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711fb80-fd67-47c7-bd07-ebf8e8cdde58 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:35.836967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9751d-a5e2-4310-90f7-6ae0f21c5bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:35.838751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9751d-a5e2-4310-90f7-6ae0f21c5bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:35.839257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9751d-a5e2-4310-90f7-6ae0f21c5bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:35.839770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9751d-a5e2-4310-90f7-6ae0f21c5bf6 admin admin] PATH_INFO: `/v3/projects/39ad9a67609d4b2bb8f50c914ae947c9` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:35.841737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9751d-a5e2-4310-90f7-6ae0f21c5bf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39ad9a67609d4b2bb8f50c914ae947c9)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:35.843972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9751d-a5e2-4310-90f7-6ae0f21c5bf6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:35.846681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4f95b-9bdb-41c0-924d-6db88df43a2f tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:35.862180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226a7b0-c47f-4f1e-bc55-a53a5e505dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:35.862816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226a7b0-c47f-4f1e-bc55-a53a5e505dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:35.863112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226a7b0-c47f-4f1e-bc55-a53a5e505dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:35.863360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226a7b0-c47f-4f1e-bc55-a53a5e505dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:35.873131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226a7b0-c47f-4f1e-bc55-a53a5e505dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:35.875412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226a7b0-c47f-4f1e-bc55-a53a5e505dc1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:35.907404 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2350/4686] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:35.912050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226a7b0-c47f-4f1e-bc55-a53a5e505dc1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:35.929995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226a7b0-c47f-4f1e-bc55-a53a5e505dc1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:35.948308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed223e-1184-481c-9515-25162c3faa53 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce2028818864b7b84fc4ec067d4d9c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e155f1b8fec4c148ecccc7b3af0f90a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:35.948308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed223e-1184-481c-9515-25162c3faa53 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:35.948308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed223e-1184-481c-9515-25162c3faa53 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:35.957284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed223e-1184-481c-9515-25162c3faa53 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:35.958005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed223e-1184-481c-9515-25162c3faa53 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:35.961302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed223e-1184-481c-9515-25162c3faa53 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:35.981528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed223e-1184-481c-9515-25162c3faa53 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:35.983871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed223e-1184-481c-9515-25162c3faa53 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:35.989672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed223e-1184-481c-9515-25162c3faa53 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:35.996056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed223e-1184-481c-9515-25162c3faa53 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:35.999943 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2351/4687] 10.222.0.20 () {58 vars in 1140 bytes} [Thu Oct 27 03:45:35 2022] GET /identity/v3/credentials => generated 945 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:45:36.003183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed223e-1184-481c-9515-25162c3faa53 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:36.020532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ace9751d-a5e2-4310-90f7-6ae0f21c5bf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39ad9a67609d4b2bb8f50c914ae947c9', 'request_id': 'req-ace9751d-a5e2-4310-90f7-6ae0f21c5bf6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:36.047281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed223e-1184-481c-9515-25162c3faa53 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:36.137212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ace9751d-a5e2-4310-90f7-6ae0f21c5bf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39ad9a67609d4b2bb8f50c914ae947c9', 'request_id': 'req-ace9751d-a5e2-4310-90f7-6ae0f21c5bf6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:36.147129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ace9751d-a5e2-4310-90f7-6ae0f21c5bf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39ad9a67609d4b2bb8f50c914ae947c9', 'request_id': 'req-ace9751d-a5e2-4310-90f7-6ae0f21c5bf6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:36.188334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ace9751d-a5e2-4310-90f7-6ae0f21c5bf6 admin admin] The token cache is being invalidate because project 39ad9a67609d4b2bb8f50c914ae947c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:45:36.188677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ace9751d-a5e2-4310-90f7-6ae0f21c5bf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:36.190175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ace9751d-a5e2-4310-90f7-6ae0f21c5bf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:36.191222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d390cd-f040-4f49-8bbf-31a8b05afaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:36.193783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d390cd-f040-4f49-8bbf-31a8b05afaf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:36.194336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d390cd-f040-4f49-8bbf-31a8b05afaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:36.196056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d390cd-f040-4f49-8bbf-31a8b05afaf2 admin admin] PATH_INFO: `/v3/projects/27120f8c7f2e4f038d4cd7d11e8bba4d/users/0aa14e8eb0784d2b8be3ced8b763cabd/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:36.198426 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2337/4688] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:45:35 2022] DELETE /identity/v3/projects/39ad9a67609d4b2bb8f50c914ae947c9 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:36.200577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9751d-a5e2-4310-90f7-6ae0f21c5bf6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:36.206480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ace9751d-a5e2-4310-90f7-6ae0f21c5bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:36.247688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d390cd-f040-4f49-8bbf-31a8b05afaf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27120f8c7f2e4f038d4cd7d11e8bba4d, user_id=0aa14e8eb0784d2b8be3ced8b763cabd, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:36.255331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d390cd-f040-4f49-8bbf-31a8b05afaf2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:36.394169 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2352/4689] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:36 2022] PUT /identity/v3/projects/27120f8c7f2e4f038d4cd7d11e8bba4d/users/0aa14e8eb0784d2b8be3ced8b763cabd/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:36.406605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748d97c-aa75-462e-8aea-e706129106aa None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:36.409813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748d97c-aa75-462e-8aea-e706129106aa None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:36.413794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748d97c-aa75-462e-8aea-e706129106aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:36.418179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9751d-a5e2-4310-90f7-6ae0f21c5bf6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:36.445498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:36.481891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b748d97c-aa75-462e-8aea-e706129106aa None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:36.484989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b748d97c-aa75-462e-8aea-e706129106aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:36.561694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9b37d-8995-4787-a7a9-14b28abde781 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce2028818864b7b84fc4ec067d4d9c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e155f1b8fec4c148ecccc7b3af0f90a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:36.562659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9b37d-8995-4787-a7a9-14b28abde781 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:36.563106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9b37d-8995-4787-a7a9-14b28abde781 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:36.566515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9b37d-8995-4787-a7a9-14b28abde781 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] PATH_INFO: `/v3/credentials/248af4568102a7370c2596ad9af1b8a7bc0f315f3832440079ce155bc3915a28` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:36.566515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9b37d-8995-4787-a7a9-14b28abde781 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=248af4568102a7370c2596ad9af1b8a7bc0f315f3832440079ce155bc3915a28)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:36.568448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9b37d-8995-4787-a7a9-14b28abde781 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:36.588528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:36.597628 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2353/4690] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:36.607427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f6cd7-aa0b-47ae-9e19-643efcb7873a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:36.607427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f6cd7-aa0b-47ae-9e19-643efcb7873a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:36.607427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f6cd7-aa0b-47ae-9e19-643efcb7873a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:36.673487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-cb3f6cd7-aa0b-47ae-9e19-643efcb7873a None None] MFA Rules not processed for user `0aa14e8eb0784d2b8be3ced8b763cabd`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:36.675287 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cb3f6cd7-aa0b-47ae-9e19-643efcb7873a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:36.685425 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2338/4691] 10.222.0.20 () {58 vars in 1338 bytes} [Thu Oct 27 03:45:36 2022] DELETE /identity/v3/credentials/248af4568102a7370c2596ad9af1b8a7bc0f315f3832440079ce155bc3915a28 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:36.686922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e9951-b6d5-4cd9-ac93-805be0170d74 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:36.687877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e9951-b6d5-4cd9-ac93-805be0170d74 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:36.687877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e9951-b6d5-4cd9-ac93-805be0170d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:36.736149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-592e9951-b6d5-4cd9-ac93-805be0170d74 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:36.742935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-592e9951-b6d5-4cd9-ac93-805be0170d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:36.762454 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2339/4692] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:36.763347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e9951-b6d5-4cd9-ac93-805be0170d74 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:36.789902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e9951-b6d5-4cd9-ac93-805be0170d74 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:36.800600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66128ce5-1d81-473b-ab99-8cec1cbc786e tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce2028818864b7b84fc4ec067d4d9c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e155f1b8fec4c148ecccc7b3af0f90a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:36.801291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66128ce5-1d81-473b-ab99-8cec1cbc786e tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:36.801577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66128ce5-1d81-473b-ab99-8cec1cbc786e tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:36.801860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66128ce5-1d81-473b-ab99-8cec1cbc786e tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] PATH_INFO: `/v3/credentials/f00905be5032ddd586b17e5b40e014557b5a108c67487163c769d6d38a5f31e7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:36.804497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66128ce5-1d81-473b-ab99-8cec1cbc786e tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=f00905be5032ddd586b17e5b40e014557b5a108c67487163c769d6d38a5f31e7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:36.806317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66128ce5-1d81-473b-ab99-8cec1cbc786e tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:36.811450 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2354/4693] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:36.813389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f6cd7-aa0b-47ae-9e19-643efcb7873a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:36.834836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f6cd7-aa0b-47ae-9e19-643efcb7873a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:36.840823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988cffe0-1ae9-4ac3-9099-79c88314df25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:36.841956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988cffe0-1ae9-4ac3-9099-79c88314df25 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:36.841956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988cffe0-1ae9-4ac3-9099-79c88314df25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:36.842231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988cffe0-1ae9-4ac3-9099-79c88314df25 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:36.842985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988cffe0-1ae9-4ac3-9099-79c88314df25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:45:36.843368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988cffe0-1ae9-4ac3-9099-79c88314df25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:36.845278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988cffe0-1ae9-4ac3-9099-79c88314df25 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:36.867448 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2355/4694] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:45:36.868463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988cffe0-1ae9-4ac3-9099-79c88314df25 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:36.870547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-988cffe0-1ae9-4ac3-9099-79c88314df25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:36.891622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988cffe0-1ae9-4ac3-9099-79c88314df25 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:36.897022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a5cc1-1029-4a5e-935d-a73aaa3704fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:36.897656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a5cc1-1029-4a5e-935d-a73aaa3704fc admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:36.898841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a5cc1-1029-4a5e-935d-a73aaa3704fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:36.899544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a5cc1-1029-4a5e-935d-a73aaa3704fc admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:36.900382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a5cc1-1029-4a5e-935d-a73aaa3704fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:36.902541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a5cc1-1029-4a5e-935d-a73aaa3704fc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:36.922849 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2340/4695] 10.222.0.20 () {58 vars in 1338 bytes} [Thu Oct 27 03:45:36 2022] DELETE /identity/v3/credentials/f00905be5032ddd586b17e5b40e014557b5a108c67487163c769d6d38a5f31e7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:36.922849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66128ce5-1d81-473b-ab99-8cec1cbc786e tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:36.938578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66128ce5-1d81-473b-ab99-8cec1cbc786e tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:36.946713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d942d22-ee99-4729-b37a-cda5c801d8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:36.947396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d942d22-ee99-4729-b37a-cda5c801d8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:36.947675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d942d22-ee99-4729-b37a-cda5c801d8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:36.947945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d942d22-ee99-4729-b37a-cda5c801d8a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:36.948660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d942d22-ee99-4729-b37a-cda5c801d8a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:36.951000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d942d22-ee99-4729-b37a-cda5c801d8a7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:37.017110 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2356/4696] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:45:36 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:37.018857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a5cc1-1029-4a5e-935d-a73aaa3704fc admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:37.051224 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2341/4697] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:45:36 2022] POST /identity/v3/projects => generated 403 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:37.052839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d942d22-ee99-4729-b37a-cda5c801d8a7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:37.117776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a5cc1-1029-4a5e-935d-a73aaa3704fc admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:37.130350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d942d22-ee99-4729-b37a-cda5c801d8a7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:37.137967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777b156-ee1b-4877-b8b8-f839e4a6c872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:37.138730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777b156-ee1b-4877-b8b8-f839e4a6c872 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:37.139129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777b156-ee1b-4877-b8b8-f839e4a6c872 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:37.139472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777b156-ee1b-4877-b8b8-f839e4a6c872 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:37.140173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777b156-ee1b-4877-b8b8-f839e4a6c872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:37.143602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777b156-ee1b-4877-b8b8-f839e4a6c872 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:37.237299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b26cb-731b-4d10-bab3-101d45397024 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce2028818864b7b84fc4ec067d4d9c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e155f1b8fec4c148ecccc7b3af0f90a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:37.238339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b26cb-731b-4d10-bab3-101d45397024 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:37.238609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b26cb-731b-4d10-bab3-101d45397024 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:37.238953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b26cb-731b-4d10-bab3-101d45397024 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] PATH_INFO: `/v3/projects/b1f2835cdb2e42249bb1d02468708439` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:37.240232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b26cb-731b-4d10-bab3-101d45397024 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b1f2835cdb2e42249bb1d02468708439)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:37.242601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b26cb-731b-4d10-bab3-101d45397024 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:37.253063 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2342/4698] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:45:37 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:37.256966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777b156-ee1b-4877-b8b8-f839e4a6c872 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:37.286128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777b156-ee1b-4877-b8b8-f839e4a6c872 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:37.293970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47bcce-3388-48e2-a4e5-7d0dabf0e55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:37.294889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47bcce-3388-48e2-a4e5-7d0dabf0e55f admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:37.295167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47bcce-3388-48e2-a4e5-7d0dabf0e55f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:37.295439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47bcce-3388-48e2-a4e5-7d0dabf0e55f admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:37.296083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47bcce-3388-48e2-a4e5-7d0dabf0e55f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:37.298148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47bcce-3388-48e2-a4e5-7d0dabf0e55f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:37.386569 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2343/4699] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:45:37 2022] POST /identity/v3/users => generated 302 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:37.390738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47bcce-3388-48e2-a4e5-7d0dabf0e55f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:37.398556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-da8b26cb-731b-4d10-bab3-101d45397024 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1f2835cdb2e42249bb1d02468708439', 'request_id': 'req-da8b26cb-731b-4d10-bab3-101d45397024'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:37.407056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47bcce-3388-48e2-a4e5-7d0dabf0e55f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:37.409458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-da8b26cb-731b-4d10-bab3-101d45397024 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1f2835cdb2e42249bb1d02468708439', 'request_id': 'req-da8b26cb-731b-4d10-bab3-101d45397024'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:37.416653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-da8b26cb-731b-4d10-bab3-101d45397024 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1f2835cdb2e42249bb1d02468708439', 'request_id': 'req-da8b26cb-731b-4d10-bab3-101d45397024'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:37.511396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac0440-259b-4d19-a736-6e4d44e260e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:37.512118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac0440-259b-4d19-a736-6e4d44e260e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:37.512474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac0440-259b-4d19-a736-6e4d44e260e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:37.513582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac0440-259b-4d19-a736-6e4d44e260e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:37.514510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac0440-259b-4d19-a736-6e4d44e260e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:37.518700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac0440-259b-4d19-a736-6e4d44e260e3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:37.537491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-da8b26cb-731b-4d10-bab3-101d45397024 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] The token cache is being invalidate because project b1f2835cdb2e42249bb1d02468708439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:45:37.538289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-da8b26cb-731b-4d10-bab3-101d45397024 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:37.539519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-da8b26cb-731b-4d10-bab3-101d45397024 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:37.542587 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2357/4700] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:45:37 2022] DELETE /identity/v3/projects/b1f2835cdb2e42249bb1d02468708439 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:37.545931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b26cb-731b-4d10-bab3-101d45397024 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:37.546341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-da8b26cb-731b-4d10-bab3-101d45397024 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:37.553899 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2344/4701] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:37.569124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac0440-259b-4d19-a736-6e4d44e260e3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:37.569124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-27ac0440-259b-4d19-a736-6e4d44e260e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:37.576657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b26cb-731b-4d10-bab3-101d45397024 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:37.586301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3223b67-0d7c-425d-b116-be685e60da17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:37.594670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3223b67-0d7c-425d-b116-be685e60da17 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:37.594670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3223b67-0d7c-425d-b116-be685e60da17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:37.594670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3223b67-0d7c-425d-b116-be685e60da17 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:37.594670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3223b67-0d7c-425d-b116-be685e60da17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:37.594670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3223b67-0d7c-425d-b116-be685e60da17 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:37.640202 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2358/4702] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:37.641168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3223b67-0d7c-425d-b116-be685e60da17 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:37.644835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e3223b67-0d7c-425d-b116-be685e60da17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:37.686992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3223b67-0d7c-425d-b116-be685e60da17 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:37.693483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a536a12-b549-468f-8d82-68a16faf4495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:37.694380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a536a12-b549-468f-8d82-68a16faf4495 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:37.699487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a536a12-b549-468f-8d82-68a16faf4495 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:37.699487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a536a12-b549-468f-8d82-68a16faf4495 admin admin] PATH_INFO: `/v3/projects/8b53d6fcfbb2499ea236f5f6d0ad9f26/users/734a86508363447fb19569c663836d6f/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:37.718098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a536a12-b549-468f-8d82-68a16faf4495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b53d6fcfbb2499ea236f5f6d0ad9f26, user_id=734a86508363447fb19569c663836d6f, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:37.723169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac0440-259b-4d19-a736-6e4d44e260e3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:37.729240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209f207-3563-4e32-8305-5c6d6d1f3735 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce2028818864b7b84fc4ec067d4d9c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e155f1b8fec4c148ecccc7b3af0f90a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:37.729475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a536a12-b549-468f-8d82-68a16faf4495 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:37.730339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209f207-3563-4e32-8305-5c6d6d1f3735 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:37.730802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209f207-3563-4e32-8305-5c6d6d1f3735 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:37.731228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209f207-3563-4e32-8305-5c6d6d1f3735 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] PATH_INFO: `/v3/projects/da9e0b45670f4ca4ac444a8256bad09f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:37.733031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209f207-3563-4e32-8305-5c6d6d1f3735 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorizing `identity:delete_project(project_id=da9e0b45670f4ca4ac444a8256bad09f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:37.735530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209f207-3563-4e32-8305-5c6d6d1f3735 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:37.765699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:37.856944 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2359/4703] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:37 2022] PUT /identity/v3/projects/8b53d6fcfbb2499ea236f5f6d0ad9f26/users/734a86508363447fb19569c663836d6f/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:37.857881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a536a12-b549-468f-8d82-68a16faf4495 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:37.924471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e209f207-3563-4e32-8305-5c6d6d1f3735 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da9e0b45670f4ca4ac444a8256bad09f', 'request_id': 'req-e209f207-3563-4e32-8305-5c6d6d1f3735'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:37.972682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a536a12-b549-468f-8d82-68a16faf4495 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:37.992911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e209f207-3563-4e32-8305-5c6d6d1f3735 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da9e0b45670f4ca4ac444a8256bad09f', 'request_id': 'req-e209f207-3563-4e32-8305-5c6d6d1f3735'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:38.005295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e209f207-3563-4e32-8305-5c6d6d1f3735 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da9e0b45670f4ca4ac444a8256bad09f', 'request_id': 'req-e209f207-3563-4e32-8305-5c6d6d1f3735'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:38.014374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:38.031084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e209f207-3563-4e32-8305-5c6d6d1f3735 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] The token cache is being invalidate because project da9e0b45670f4ca4ac444a8256bad09f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:45:38.032509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e209f207-3563-4e32-8305-5c6d6d1f3735 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:38.038844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e209f207-3563-4e32-8305-5c6d6d1f3735 tempest-CredentialsTestJSON-1490831439 tempest-CredentialsTestJSON-1490831439-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:38.041045 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2345/4704] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:45:37 2022] DELETE /identity/v3/projects/da9e0b45670f4ca4ac444a8256bad09f => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:38.042751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69128c-cf91-4e91-b281-b71c1b58601a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:38.043262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69128c-cf91-4e91-b281-b71c1b58601a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:38.044606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69128c-cf91-4e91-b281-b71c1b58601a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:38.089897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ca69128c-cf91-4e91-b281-b71c1b58601a None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:38.094353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ca69128c-cf91-4e91-b281-b71c1b58601a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:38.177592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d739daa-e468-4c10-9f1d-1b4ac8d8e428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:38.178838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d739daa-e468-4c10-9f1d-1b4ac8d8e428 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:38.179123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d739daa-e468-4c10-9f1d-1b4ac8d8e428 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:38.179402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d739daa-e468-4c10-9f1d-1b4ac8d8e428 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:38.197614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d739daa-e468-4c10-9f1d-1b4ac8d8e428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:38.215800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d739daa-e468-4c10-9f1d-1b4ac8d8e428 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:38.235116 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2346/4705] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:45:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:38.237051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69128c-cf91-4e91-b281-b71c1b58601a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:38.238402 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2360/4706] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:38.239265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d739daa-e468-4c10-9f1d-1b4ac8d8e428 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:38.242384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5d739daa-e468-4c10-9f1d-1b4ac8d8e428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:38.261781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d739daa-e468-4c10-9f1d-1b4ac8d8e428 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:38.273300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b7489-6447-4e9d-993b-9610a1298045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:38.273966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b7489-6447-4e9d-993b-9610a1298045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:38.274291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b7489-6447-4e9d-993b-9610a1298045 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:38.274570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b7489-6447-4e9d-993b-9610a1298045 admin admin] PATH_INFO: `/v3/users/907c1680c15a45dea209c066d8a69276` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:38.275347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ca69128c-cf91-4e91-b281-b71c1b58601a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:38.275830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b7489-6447-4e9d-993b-9610a1298045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=907c1680c15a45dea209c066d8a69276)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:38.279284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b7489-6447-4e9d-993b-9610a1298045 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:38.310608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69128c-cf91-4e91-b281-b71c1b58601a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:38.336550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7e43a-c854-4f6f-921d-2cb006042f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:38.338780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7e43a-c854-4f6f-921d-2cb006042f15 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:38.338780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7e43a-c854-4f6f-921d-2cb006042f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:38.338780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7e43a-c854-4f6f-921d-2cb006042f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:38.338780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7e43a-c854-4f6f-921d-2cb006042f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:38.340982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7e43a-c854-4f6f-921d-2cb006042f15 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:38.364990 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2347/4707] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:38.365908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7e43a-c854-4f6f-921d-2cb006042f15 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:38.396874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-39c7e43a-c854-4f6f-921d-2cb006042f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:38.427095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7e43a-c854-4f6f-921d-2cb006042f15 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:38.437119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca70a9b-5f2c-4434-a7c1-f10e3c9e62d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:38.437810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca70a9b-5f2c-4434-a7c1-f10e3c9e62d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:38.438120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca70a9b-5f2c-4434-a7c1-f10e3c9e62d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:38.438402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca70a9b-5f2c-4434-a7c1-f10e3c9e62d0 admin admin] PATH_INFO: `/v3/projects/a72a2bc8348b4b078398a41870475443/users/485bf6f2e501433b96f847bb0f750017/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:38.463848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca70a9b-5f2c-4434-a7c1-f10e3c9e62d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a72a2bc8348b4b078398a41870475443, user_id=485bf6f2e501433b96f847bb0f750017, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:38.463848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca70a9b-5f2c-4434-a7c1-f10e3c9e62d0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:38.549136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-558b7489-6447-4e9d-993b-9610a1298045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '907c1680c15a45dea209c066d8a69276'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:38.549827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-558b7489-6447-4e9d-993b-9610a1298045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '907c1680c15a45dea209c066d8a69276'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:38.565642 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2348/4708] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:38 2022] PUT /identity/v3/projects/a72a2bc8348b4b078398a41870475443/users/485bf6f2e501433b96f847bb0f750017/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:38.566186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-558b7489-6447-4e9d-993b-9610a1298045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '907c1680c15a45dea209c066d8a69276'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:38.570272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca70a9b-5f2c-4434-a7c1-f10e3c9e62d0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:38.578005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3ca70a9b-5f2c-4434-a7c1-f10e3c9e62d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:38.594948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-558b7489-6447-4e9d-993b-9610a1298045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '907c1680c15a45dea209c066d8a69276'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:38.594948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-558b7489-6447-4e9d-993b-9610a1298045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '907c1680c15a45dea209c066d8a69276'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:38.679144 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2361/4709] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:45:38 2022] DELETE /identity/v3/users/907c1680c15a45dea209c066d8a69276 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:38.679991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b7489-6447-4e9d-993b-9610a1298045 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:38.683420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-558b7489-6447-4e9d-993b-9610a1298045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:38.740606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca70a9b-5f2c-4434-a7c1-f10e3c9e62d0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:38.825881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b7489-6447-4e9d-993b-9610a1298045 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:38.837124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e674f-81eb-407c-879b-024cf7547432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:38.837827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e674f-81eb-407c-879b-024cf7547432 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:38.838141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e674f-81eb-407c-879b-024cf7547432 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:38.838417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e674f-81eb-407c-879b-024cf7547432 admin admin] PATH_INFO: `/v3/projects/8b53d6fcfbb2499ea236f5f6d0ad9f26/users/734a86508363447fb19569c663836d6f/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:38.842225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e674f-81eb-407c-879b-024cf7547432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b53d6fcfbb2499ea236f5f6d0ad9f26, user_id=734a86508363447fb19569c663836d6f, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:38.844946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e674f-81eb-407c-879b-024cf7547432 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:38.861738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaec7a2-1195-4180-b3f8-a57c5dab8bc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:38.862411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaec7a2-1195-4180-b3f8-a57c5dab8bc5 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:38.862695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaec7a2-1195-4180-b3f8-a57c5dab8bc5 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:38.862972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaec7a2-1195-4180-b3f8-a57c5dab8bc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:38.868108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-edaec7a2-1195-4180-b3f8-a57c5dab8bc5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:38.881562 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2362/4710] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:38 2022] PUT /identity/v3/projects/8b53d6fcfbb2499ea236f5f6d0ad9f26/users/734a86508363447fb19569c663836d6f/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:38.883165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d672b-e40f-44a7-9e09-212b5d4006f9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:38.883425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d672b-e40f-44a7-9e09-212b5d4006f9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:38.883697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d672b-e40f-44a7-9e09-212b5d4006f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:38.905166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-345d672b-e40f-44a7-9e09-212b5d4006f9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:38.907195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-345d672b-e40f-44a7-9e09-212b5d4006f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:38.983804 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2363/4711] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:38.985531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54878f8-5da0-401c-b9d2-45117a07caf4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:38.986644 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54878f8-5da0-401c-b9d2-45117a07caf4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:38.987084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54878f8-5da0-401c-b9d2-45117a07caf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:38.994550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:38.996175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaec7a2-1195-4180-b3f8-a57c5dab8bc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:38.998350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaec7a2-1195-4180-b3f8-a57c5dab8bc5 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:39.012179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b54878f8-5da0-401c-b9d2-45117a07caf4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:39.013707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b54878f8-5da0-401c-b9d2-45117a07caf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:39.022869 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2364/4712] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:39.026475 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2349/4713] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:45:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:45:39.031289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaec7a2-1195-4180-b3f8-a57c5dab8bc5 service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:39.035252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acf0ba-3b38-4d08-9af3-134ac2f143bb None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:39.035765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acf0ba-3b38-4d08-9af3-134ac2f143bb None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:39.036432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acf0ba-3b38-4d08-9af3-134ac2f143bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:39.051861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-edaec7a2-1195-4180-b3f8-a57c5dab8bc5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:39.064643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:39.080596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-76acf0ba-3b38-4d08-9af3-134ac2f143bb None None] MFA Rules not processed for user `734a86508363447fb19569c663836d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:39.082263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-76acf0ba-3b38-4d08-9af3-134ac2f143bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:39.211087 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2365/4714] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:39.212565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acf0ba-3b38-4d08-9af3-134ac2f143bb None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:39.213772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-76acf0ba-3b38-4d08-9af3-134ac2f143bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:39.231674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaec7a2-1195-4180-b3f8-a57c5dab8bc5 service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:39.245740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:39.326768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acf0ba-3b38-4d08-9af3-134ac2f143bb None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:39.331658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5c830-4936-4bf3-a89d-727121f7a7a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:39.332105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5c830-4936-4bf3-a89d-727121f7a7a0 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:39.332393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5c830-4936-4bf3-a89d-727121f7a7a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:39.332685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5c830-4936-4bf3-a89d-727121f7a7a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:39.332948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566449d-d9ad-4daa-83a7-1fa4725d1b41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:39.333944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566449d-d9ad-4daa-83a7-1fa4725d1b41 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:39.334483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566449d-d9ad-4daa-83a7-1fa4725d1b41 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:39.334989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566449d-d9ad-4daa-83a7-1fa4725d1b41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:39.346666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566449d-d9ad-4daa-83a7-1fa4725d1b41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:39.347396 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5c830-4936-4bf3-a89d-727121f7a7a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:39.348886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566449d-d9ad-4daa-83a7-1fa4725d1b41 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:39.349125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5c830-4936-4bf3-a89d-727121f7a7a0 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:39.363144 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2350/4715] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:45:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:45:39.364831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566449d-d9ad-4daa-83a7-1fa4725d1b41 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:39.366518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4566449d-d9ad-4daa-83a7-1fa4725d1b41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:39.367490 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2366/4716] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:45:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:45:39.474948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566449d-d9ad-4daa-83a7-1fa4725d1b41 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:39.494324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56e82b-a25e-42f6-9391-1d9783e45dc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:39.495275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56e82b-a25e-42f6-9391-1d9783e45dc7 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:39.497616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56e82b-a25e-42f6-9391-1d9783e45dc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:39.497616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56e82b-a25e-42f6-9391-1d9783e45dc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:39.510610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56e82b-a25e-42f6-9391-1d9783e45dc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:39.512782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56e82b-a25e-42f6-9391-1d9783e45dc7 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:39.533481 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2351/4717] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:45:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:45:39.672530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:39.676512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a3ef0-d188-4ebd-bf7d-6c0484c7e70d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:39.676719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a3ef0-d188-4ebd-bf7d-6c0484c7e70d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:39.676936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a3ef0-d188-4ebd-bf7d-6c0484c7e70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:39.690704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56e82b-a25e-42f6-9391-1d9783e45dc7 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:39.709487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56e82b-a25e-42f6-9391-1d9783e45dc7 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:39.734654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f454d-df34-47de-9cfd-cbdc09100e7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:39.735376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f454d-df34-47de-9cfd-cbdc09100e7b service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:39.735664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f454d-df34-47de-9cfd-cbdc09100e7b service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:39.735980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f454d-df34-47de-9cfd-cbdc09100e7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:39.742645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-801f454d-df34-47de-9cfd-cbdc09100e7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:39.753283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ca7a3ef0-d188-4ebd-bf7d-6c0484c7e70d None None] MFA Rules not processed for user `a8d11d6c1ad9437f92525912d5ba3d92`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:39.771746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ca7a3ef0-d188-4ebd-bf7d-6c0484c7e70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:39.841871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f454d-df34-47de-9cfd-cbdc09100e7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:39.859178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f454d-df34-47de-9cfd-cbdc09100e7b service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:39.859178 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2352/4718] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:45:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:45:39.879667 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2367/4719] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:40.075281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:40.458532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:40.805489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f454d-df34-47de-9cfd-cbdc09100e7b service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:40.807047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-801f454d-df34-47de-9cfd-cbdc09100e7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:40.830356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f454d-df34-47de-9cfd-cbdc09100e7b service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:40.840760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b833c84-4299-41f6-b93a-daa2e95b0898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:40.841413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b833c84-4299-41f6-b93a-daa2e95b0898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:40.841753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b833c84-4299-41f6-b93a-daa2e95b0898 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:40.842311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b833c84-4299-41f6-b93a-daa2e95b0898 admin admin] PATH_INFO: `/v3/projects/7c5b2568529a4d92835d7c717fd569e9` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:40.845030 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b833c84-4299-41f6-b93a-daa2e95b0898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c5b2568529a4d92835d7c717fd569e9)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:40.859013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b833c84-4299-41f6-b93a-daa2e95b0898 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:41.090630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2b833c84-4299-41f6-b93a-daa2e95b0898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c5b2568529a4d92835d7c717fd569e9', 'request_id': 'req-2b833c84-4299-41f6-b93a-daa2e95b0898'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:41.186789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2b833c84-4299-41f6-b93a-daa2e95b0898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c5b2568529a4d92835d7c717fd569e9', 'request_id': 'req-2b833c84-4299-41f6-b93a-daa2e95b0898'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:41.196120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2b833c84-4299-41f6-b93a-daa2e95b0898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c5b2568529a4d92835d7c717fd569e9', 'request_id': 'req-2b833c84-4299-41f6-b93a-daa2e95b0898'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:41.216376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2b833c84-4299-41f6-b93a-daa2e95b0898 admin admin] The token cache is being invalidate because project 7c5b2568529a4d92835d7c717fd569e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:45:41.216718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2b833c84-4299-41f6-b93a-daa2e95b0898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:41.219302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2b833c84-4299-41f6-b93a-daa2e95b0898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:41.229623 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2353/4720] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:45:40 2022] DELETE /identity/v3/projects/7c5b2568529a4d92835d7c717fd569e9 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:41.232522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a3ef0-d188-4ebd-bf7d-6c0484c7e70d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:41.254084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a3ef0-d188-4ebd-bf7d-6c0484c7e70d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:41.403642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e170e7-4ed5-498d-9cb9-29755c41a730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:41.404627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e170e7-4ed5-498d-9cb9-29755c41a730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:41.404909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e170e7-4ed5-498d-9cb9-29755c41a730 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:41.405185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e170e7-4ed5-498d-9cb9-29755c41a730 admin admin] PATH_INFO: `/v3/users/cce2028818864b7b84fc4ec067d4d9c4` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:41.406388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e170e7-4ed5-498d-9cb9-29755c41a730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cce2028818864b7b84fc4ec067d4d9c4)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:41.409188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e170e7-4ed5-498d-9cb9-29755c41a730 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:41.680843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:41.715697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-93e170e7-4ed5-498d-9cb9-29755c41a730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cce2028818864b7b84fc4ec067d4d9c4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:41.716562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-93e170e7-4ed5-498d-9cb9-29755c41a730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cce2028818864b7b84fc4ec067d4d9c4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:41.727147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-93e170e7-4ed5-498d-9cb9-29755c41a730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cce2028818864b7b84fc4ec067d4d9c4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:41.749579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-93e170e7-4ed5-498d-9cb9-29755c41a730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cce2028818864b7b84fc4ec067d4d9c4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:41.753382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-93e170e7-4ed5-498d-9cb9-29755c41a730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cce2028818864b7b84fc4ec067d4d9c4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:41.860614 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2368/4721] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:45:41 2022] DELETE /identity/v3/users/cce2028818864b7b84fc4ec067d4d9c4 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:43.056790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a54d89-e526-4083-992d-c237d40cb5bb None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:43.057586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a54d89-e526-4083-992d-c237d40cb5bb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:43.062200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a54d89-e526-4083-992d-c237d40cb5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:43.147931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a1a54d89-e526-4083-992d-c237d40cb5bb None None] MFA Rules not processed for user `485bf6f2e501433b96f847bb0f750017`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:43.149446 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a1a54d89-e526-4083-992d-c237d40cb5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:43.250509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:43.320435 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2354/4722] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:43 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:43.321921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e170e7-4ed5-498d-9cb9-29755c41a730 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:43.323621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-93e170e7-4ed5-498d-9cb9-29755c41a730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:43.494462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:43.507105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e170e7-4ed5-498d-9cb9-29755c41a730 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:43.514445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a87c6-d6d6-468c-beb5-dc867cd8911a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:43.515756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a87c6-d6d6-468c-beb5-dc867cd8911a admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:43.518560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a87c6-d6d6-468c-beb5-dc867cd8911a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:43.519474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a87c6-d6d6-468c-beb5-dc867cd8911a admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:43.523586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a87c6-d6d6-468c-beb5-dc867cd8911a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:43.528483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a87c6-d6d6-468c-beb5-dc867cd8911a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:43.672767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a54d89-e526-4083-992d-c237d40cb5bb None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:43.673123 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2369/4723] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:45:43 2022] POST /identity/v3/projects => generated 405 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:43.693001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a54d89-e526-4083-992d-c237d40cb5bb None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:43.841058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03425f3-e1d9-4e33-b5f0-4c9b75b5e5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:43.841691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03425f3-e1d9-4e33-b5f0-4c9b75b5e5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:43.844023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03425f3-e1d9-4e33-b5f0-4c9b75b5e5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:43.844023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03425f3-e1d9-4e33-b5f0-4c9b75b5e5e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:43.844023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03425f3-e1d9-4e33-b5f0-4c9b75b5e5e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:43.844863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03425f3-e1d9-4e33-b5f0-4c9b75b5e5e2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:43.997522 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2355/4724] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:45:43 2022] POST /identity/v3/users => generated 309 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:43.999092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a87c6-d6d6-468c-beb5-dc867cd8911a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:44.015081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a87c6-d6d6-468c-beb5-dc867cd8911a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:44.025763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d43035-3e5d-451e-a1c8-5e52b62cd6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:44.026631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d43035-3e5d-451e-a1c8-5e52b62cd6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:44.027340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d43035-3e5d-451e-a1c8-5e52b62cd6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:44.027340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d43035-3e5d-451e-a1c8-5e52b62cd6c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:44.028480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d43035-3e5d-451e-a1c8-5e52b62cd6c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:44.030330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d43035-3e5d-451e-a1c8-5e52b62cd6c7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:44.057251 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2370/4725] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:44.059426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03425f3-e1d9-4e33-b5f0-4c9b75b5e5e2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:44.075860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03425f3-e1d9-4e33-b5f0-4c9b75b5e5e2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:44.087157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcba602-3003-43c1-a357-a3fe23488bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:44.087883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcba602-3003-43c1-a357-a3fe23488bec admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:44.088168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcba602-3003-43c1-a357-a3fe23488bec admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:44.088445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcba602-3003-43c1-a357-a3fe23488bec admin admin] PATH_INFO: `/v3/projects/ca44236ea9e94c999331669faf5c0e41/users/f3009dadbd8a46089206ab98967e69bb/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:44.155225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcba602-3003-43c1-a357-a3fe23488bec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca44236ea9e94c999331669faf5c0e41, user_id=f3009dadbd8a46089206ab98967e69bb, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:44.158779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcba602-3003-43c1-a357-a3fe23488bec admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:44.279043 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2356/4726] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:44 2022] PUT /identity/v3/projects/ca44236ea9e94c999331669faf5c0e41/users/f3009dadbd8a46089206ab98967e69bb/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:44.283334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d43035-3e5d-451e-a1c8-5e52b62cd6c7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:44.298000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d43035-3e5d-451e-a1c8-5e52b62cd6c7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:44.448582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123a698-c566-4159-8d08-422dcc7c28ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:44.448582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123a698-c566-4159-8d08-422dcc7c28ac admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:44.448582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123a698-c566-4159-8d08-422dcc7c28ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:44.450013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123a698-c566-4159-8d08-422dcc7c28ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:44.455728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123a698-c566-4159-8d08-422dcc7c28ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:44.463691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123a698-c566-4159-8d08-422dcc7c28ac admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:44.488912 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2371/4727] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:44.489553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcba602-3003-43c1-a357-a3fe23488bec admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:44.504957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcba602-3003-43c1-a357-a3fe23488bec admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:44.510302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324efdd2-f1b6-4cc6-ade9-09b388b90a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:44.510994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324efdd2-f1b6-4cc6-ade9-09b388b90a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:44.514762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324efdd2-f1b6-4cc6-ade9-09b388b90a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:44.514762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324efdd2-f1b6-4cc6-ade9-09b388b90a53 admin admin] PATH_INFO: `/v3/projects/ca44236ea9e94c999331669faf5c0e41/users/f3009dadbd8a46089206ab98967e69bb/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:44.514762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324efdd2-f1b6-4cc6-ade9-09b388b90a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca44236ea9e94c999331669faf5c0e41, user_id=f3009dadbd8a46089206ab98967e69bb, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:44.516623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324efdd2-f1b6-4cc6-ade9-09b388b90a53 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:44.530963 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2357/4728] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:44 2022] PUT /identity/v3/projects/ca44236ea9e94c999331669faf5c0e41/users/f3009dadbd8a46089206ab98967e69bb/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:45:44.626126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123a698-c566-4159-8d08-422dcc7c28ac admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:44.631062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8123a698-c566-4159-8d08-422dcc7c28ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:44.665120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123a698-c566-4159-8d08-422dcc7c28ac admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:44.792234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a974ca-98e7-446c-ae09-aeae70ad026b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:44.792974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a974ca-98e7-446c-ae09-aeae70ad026b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:44.793231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a974ca-98e7-446c-ae09-aeae70ad026b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:44.802219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a974ca-98e7-446c-ae09-aeae70ad026b admin admin] PATH_INFO: `/v3/projects/8e155f1b8fec4c148ecccc7b3af0f90a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:44.803291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a974ca-98e7-446c-ae09-aeae70ad026b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e155f1b8fec4c148ecccc7b3af0f90a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:44.805375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a974ca-98e7-446c-ae09-aeae70ad026b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:44.952272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-66a974ca-98e7-446c-ae09-aeae70ad026b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e155f1b8fec4c148ecccc7b3af0f90a', 'request_id': 'req-66a974ca-98e7-446c-ae09-aeae70ad026b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:44.965220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-66a974ca-98e7-446c-ae09-aeae70ad026b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e155f1b8fec4c148ecccc7b3af0f90a', 'request_id': 'req-66a974ca-98e7-446c-ae09-aeae70ad026b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:44.978898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-66a974ca-98e7-446c-ae09-aeae70ad026b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e155f1b8fec4c148ecccc7b3af0f90a', 'request_id': 'req-66a974ca-98e7-446c-ae09-aeae70ad026b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:45.096697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-66a974ca-98e7-446c-ae09-aeae70ad026b admin admin] The token cache is being invalidate because project 8e155f1b8fec4c148ecccc7b3af0f90a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:45:45.097001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-66a974ca-98e7-446c-ae09-aeae70ad026b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:45.098065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-66a974ca-98e7-446c-ae09-aeae70ad026b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:45.107261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b707b88-2833-408f-bae1-936aeba6af66 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:45.107805 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2372/4729] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:45:44 2022] DELETE /identity/v3/projects/8e155f1b8fec4c148ecccc7b3af0f90a => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:45.107940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b707b88-2833-408f-bae1-936aeba6af66 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:45.107940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b707b88-2833-408f-bae1-936aeba6af66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:45.134646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5b707b88-2833-408f-bae1-936aeba6af66 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:45.138233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5b707b88-2833-408f-bae1-936aeba6af66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:45.270442 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2358/4730] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:45:45.278667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69996197-ff35-43f3-8a78-36f9b0233cb2 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:45.278962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69996197-ff35-43f3-8a78-36f9b0233cb2 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:45.279245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69996197-ff35-43f3-8a78-36f9b0233cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:45.308655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-69996197-ff35-43f3-8a78-36f9b0233cb2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:45.310461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-69996197-ff35-43f3-8a78-36f9b0233cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:45.340921 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2373/4731] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:45.349363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b707b88-2833-408f-bae1-936aeba6af66 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:45.372399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b707b88-2833-408f-bae1-936aeba6af66 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:45.387037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3affcf-ae77-43fc-b466-6e8b7f0993a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:45.398814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3affcf-ae77-43fc-b466-6e8b7f0993a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:45.399719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3affcf-ae77-43fc-b466-6e8b7f0993a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:45.400185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:45.400426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3affcf-ae77-43fc-b466-6e8b7f0993a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:45.401299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3affcf-ae77-43fc-b466-6e8b7f0993a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:45:45.401803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3affcf-ae77-43fc-b466-6e8b7f0993a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:45.403731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3affcf-ae77-43fc-b466-6e8b7f0993a2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:45.425574 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2359/4732] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:45:45.430087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69996197-ff35-43f3-8a78-36f9b0233cb2 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:45.444280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69996197-ff35-43f3-8a78-36f9b0233cb2 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:45.456117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5eb42-acd5-44d6-b437-28420a9b5c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:45.461705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5eb42-acd5-44d6-b437-28420a9b5c22 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:45.462310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5eb42-acd5-44d6-b437-28420a9b5c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:45.462823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5eb42-acd5-44d6-b437-28420a9b5c22 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:45.463823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5eb42-acd5-44d6-b437-28420a9b5c22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:45.466574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5eb42-acd5-44d6-b437-28420a9b5c22 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:45.619306 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2374/4733] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:45:45 2022] POST /identity/v3/projects => generated 367 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:45:45.622806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3affcf-ae77-43fc-b466-6e8b7f0993a2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:45.643210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3affcf-ae77-43fc-b466-6e8b7f0993a2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:45.665838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:45.815194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d084823-6180-4ce2-9a3a-d3fe31bcafe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:45.816885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d084823-6180-4ce2-9a3a-d3fe31bcafe7 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:45.818649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d084823-6180-4ce2-9a3a-d3fe31bcafe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:45.819139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d084823-6180-4ce2-9a3a-d3fe31bcafe7 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:45.823825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d084823-6180-4ce2-9a3a-d3fe31bcafe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:45.826014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d084823-6180-4ce2-9a3a-d3fe31bcafe7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:45.984210 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2360/4734] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:45:45 2022] POST /identity/v3/users => generated 284 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:45.988429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5eb42-acd5-44d6-b437-28420a9b5c22 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:46.002136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5eb42-acd5-44d6-b437-28420a9b5c22 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:46.008917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a47c7-3e6a-4ad1-b4af-82b0fa54ff8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:46.009740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a47c7-3e6a-4ad1-b4af-82b0fa54ff8c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:46.010296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a47c7-3e6a-4ad1-b4af-82b0fa54ff8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:46.010801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a47c7-3e6a-4ad1-b4af-82b0fa54ff8c admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:46.012289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a47c7-3e6a-4ad1-b4af-82b0fa54ff8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:46.014343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a47c7-3e6a-4ad1-b4af-82b0fa54ff8c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:46.033699 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2375/4735] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:46.033920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d084823-6180-4ce2-9a3a-d3fe31bcafe7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:46.046369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d084823-6180-4ce2-9a3a-d3fe31bcafe7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:46.057738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f23a4e-074a-4a1a-acbe-cb93a287431b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:46.057926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f23a4e-074a-4a1a-acbe-cb93a287431b admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:46.058412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f23a4e-074a-4a1a-acbe-cb93a287431b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:46.058849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f23a4e-074a-4a1a-acbe-cb93a287431b admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:46.060296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f23a4e-074a-4a1a-acbe-cb93a287431b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:46.061948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f23a4e-074a-4a1a-acbe-cb93a287431b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:46.092500 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2361/4736] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:45:46.092983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a47c7-3e6a-4ad1-b4af-82b0fa54ff8c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:46.153924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a47c7-3e6a-4ad1-b4af-82b0fa54ff8c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:46.172682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fd48c-905a-4482-8e53-e02162f9b1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:46.174292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fd48c-905a-4482-8e53-e02162f9b1b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:46.174575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fd48c-905a-4482-8e53-e02162f9b1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:46.174849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fd48c-905a-4482-8e53-e02162f9b1b2 admin admin] PATH_INFO: `/v3/projects/46ed5d31522d43a99334c29099b00905/users/aa6782cbefac4eeeaffc99df290ea751/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:46.252555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fd48c-905a-4482-8e53-e02162f9b1b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ed5d31522d43a99334c29099b00905, user_id=aa6782cbefac4eeeaffc99df290ea751, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:46.256088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fd48c-905a-4482-8e53-e02162f9b1b2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:46.360073 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2376/4737] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:46 2022] PUT /identity/v3/projects/46ed5d31522d43a99334c29099b00905/users/aa6782cbefac4eeeaffc99df290ea751/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:46.372123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89c182-a36a-4e5f-9378-688af39807e7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:46.373829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89c182-a36a-4e5f-9378-688af39807e7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:46.374394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89c182-a36a-4e5f-9378-688af39807e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:46.448435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5b89c182-a36a-4e5f-9378-688af39807e7 None None] MFA Rules not processed for user `aa6782cbefac4eeeaffc99df290ea751`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:46.449682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5b89c182-a36a-4e5f-9378-688af39807e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:46.599831 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2362/4738] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:46.604195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fd48c-905a-4482-8e53-e02162f9b1b2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:46.695461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fd48c-905a-4482-8e53-e02162f9b1b2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:46.700079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce5fad-97cf-4a71-ac1f-d894b24d85c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:46.700943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce5fad-97cf-4a71-ac1f-d894b24d85c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:46.701249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce5fad-97cf-4a71-ac1f-d894b24d85c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:46.701514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce5fad-97cf-4a71-ac1f-d894b24d85c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:46.702284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce5fad-97cf-4a71-ac1f-d894b24d85c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:46.704684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce5fad-97cf-4a71-ac1f-d894b24d85c1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:46.783918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89c182-a36a-4e5f-9378-688af39807e7 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:46.789986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5b89c182-a36a-4e5f-9378-688af39807e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:46.827455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89c182-a36a-4e5f-9378-688af39807e7 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:46.845065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b46100-f38b-41ee-8490-c6feaa95bd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:46.846258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b46100-f38b-41ee-8490-c6feaa95bd01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:46.846671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b46100-f38b-41ee-8490-c6feaa95bd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:46.846791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b46100-f38b-41ee-8490-c6feaa95bd01 admin admin] PATH_INFO: `/v3/users/9454949c8d794b6093d7d4fc64d12c33` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:46.848718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b46100-f38b-41ee-8490-c6feaa95bd01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9454949c8d794b6093d7d4fc64d12c33)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:46.850866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b46100-f38b-41ee-8490-c6feaa95bd01 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:46.867674 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2377/4739] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:45:46 2022] POST /identity/v3/projects => generated 367 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:46.868755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce5fad-97cf-4a71-ac1f-d894b24d85c1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:47.010956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce5fad-97cf-4a71-ac1f-d894b24d85c1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:47.026315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9cb9c-a952-4b79-a9ed-2d303fbc443b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:47.026315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9cb9c-a952-4b79-a9ed-2d303fbc443b admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:47.026315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9cb9c-a952-4b79-a9ed-2d303fbc443b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:47.026315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9cb9c-a952-4b79-a9ed-2d303fbc443b admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:47.026753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9cb9c-a952-4b79-a9ed-2d303fbc443b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:47.026753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9cb9c-a952-4b79-a9ed-2d303fbc443b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:47.116851 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2378/4740] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:45:46 2022] POST /identity/v3/users => generated 290 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:47.118725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8e57d-850d-44f6-baa9-24e4e1cea7e9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:47.119032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8e57d-850d-44f6-baa9-24e4e1cea7e9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:47.119491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8e57d-850d-44f6-baa9-24e4e1cea7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:47.126288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b4b46100-f38b-41ee-8490-c6feaa95bd01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9454949c8d794b6093d7d4fc64d12c33'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:47.127756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b4b46100-f38b-41ee-8490-c6feaa95bd01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9454949c8d794b6093d7d4fc64d12c33'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:47.135437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b4b46100-f38b-41ee-8490-c6feaa95bd01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9454949c8d794b6093d7d4fc64d12c33'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:47.147875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b4b46100-f38b-41ee-8490-c6feaa95bd01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9454949c8d794b6093d7d4fc64d12c33'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:47.154194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-56f8e57d-850d-44f6-baa9-24e4e1cea7e9 None None] MFA Rules not processed for user `f3009dadbd8a46089206ab98967e69bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:47.155615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-56f8e57d-850d-44f6-baa9-24e4e1cea7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:47.249454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b4b46100-f38b-41ee-8490-c6feaa95bd01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9454949c8d794b6093d7d4fc64d12c33'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:47.259089 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2363/4741] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:45:46 2022] DELETE /identity/v3/users/9454949c8d794b6093d7d4fc64d12c33 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:47.260332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b46100-f38b-41ee-8490-c6feaa95bd01 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:47.278249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b4b46100-f38b-41ee-8490-c6feaa95bd01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:47.282082 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2379/4742] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:47 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:47.394100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b46100-f38b-41ee-8490-c6feaa95bd01 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:47.399967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf4afe-51d3-42bf-91b5-0c1750dbac77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:47.401340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf4afe-51d3-42bf-91b5-0c1750dbac77 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:47.401809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf4afe-51d3-42bf-91b5-0c1750dbac77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:47.402853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf4afe-51d3-42bf-91b5-0c1750dbac77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:47.403677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf4afe-51d3-42bf-91b5-0c1750dbac77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:47.406197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf4afe-51d3-42bf-91b5-0c1750dbac77 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:47.429863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8e57d-850d-44f6-baa9-24e4e1cea7e9 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:47.443674 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2364/4743] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:47.445539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8e57d-850d-44f6-baa9-24e4e1cea7e9 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:47.455639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99562501-77ea-4007-9368-8d40af821492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:47.456714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99562501-77ea-4007-9368-8d40af821492 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:47.457168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99562501-77ea-4007-9368-8d40af821492 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:47.457605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99562501-77ea-4007-9368-8d40af821492 admin admin] PATH_INFO: `/v3/projects/33826b78bd8240bebdeeb1587b2bb578/users/716bd387ca454a0389134f4ec2a5e5a8/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:47.477759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:47.478420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99562501-77ea-4007-9368-8d40af821492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33826b78bd8240bebdeeb1587b2bb578, user_id=716bd387ca454a0389134f4ec2a5e5a8, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:47.483071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99562501-77ea-4007-9368-8d40af821492 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:47.606319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf4afe-51d3-42bf-91b5-0c1750dbac77 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:47.627441 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2380/4744] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:47 2022] PUT /identity/v3/projects/33826b78bd8240bebdeeb1587b2bb578/users/716bd387ca454a0389134f4ec2a5e5a8/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:47.647083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf4afe-51d3-42bf-91b5-0c1750dbac77 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:47.728803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ebe9f-4516-4f7e-8089-5cc93fda4cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:47.729545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ebe9f-4516-4f7e-8089-5cc93fda4cfe admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:47.732397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ebe9f-4516-4f7e-8089-5cc93fda4cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:47.732714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ebe9f-4516-4f7e-8089-5cc93fda4cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:47.733392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ebe9f-4516-4f7e-8089-5cc93fda4cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:47.735067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ebe9f-4516-4f7e-8089-5cc93fda4cfe admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:47.741537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99562501-77ea-4007-9368-8d40af821492 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:47.743301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-99562501-77ea-4007-9368-8d40af821492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:47.747681 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2365/4745] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:47.751661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ebe9f-4516-4f7e-8089-5cc93fda4cfe admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:47.763779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ebe9f-4516-4f7e-8089-5cc93fda4cfe admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:47.775885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb3e94-e991-4471-ba0b-31710ed96bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:47.776783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb3e94-e991-4471-ba0b-31710ed96bca admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:47.777247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb3e94-e991-4471-ba0b-31710ed96bca admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:47.777695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb3e94-e991-4471-ba0b-31710ed96bca admin admin] PATH_INFO: `/v3/projects/33826b78bd8240bebdeeb1587b2bb578/users/716bd387ca454a0389134f4ec2a5e5a8/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:47.781242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb3e94-e991-4471-ba0b-31710ed96bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=33826b78bd8240bebdeeb1587b2bb578, user_id=716bd387ca454a0389134f4ec2a5e5a8, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:47.786115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb3e94-e991-4471-ba0b-31710ed96bca admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:47.786862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99562501-77ea-4007-9368-8d40af821492 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:47.792872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30906c6b-ce7f-450b-8ba5-92c3df30de3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:47.793861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30906c6b-ce7f-450b-8ba5-92c3df30de3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:47.794633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30906c6b-ce7f-450b-8ba5-92c3df30de3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:47.795445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30906c6b-ce7f-450b-8ba5-92c3df30de3d admin admin] PATH_INFO: `/v3/projects/eb2e83a4c2af45b49c6f23de08547160` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:47.797202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30906c6b-ce7f-450b-8ba5-92c3df30de3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb2e83a4c2af45b49c6f23de08547160)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:47.800173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30906c6b-ce7f-450b-8ba5-92c3df30de3d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:47.802074 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2366/4746] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:47 2022] PUT /identity/v3/projects/33826b78bd8240bebdeeb1587b2bb578/users/716bd387ca454a0389134f4ec2a5e5a8/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:45:47.815170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de6a6f-c1dc-4ddf-a58b-c4c7417dc3c7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:47.816664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de6a6f-c1dc-4ddf-a58b-c4c7417dc3c7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:47.817930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de6a6f-c1dc-4ddf-a58b-c4c7417dc3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:47.876016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:47.883075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-70de6a6f-c1dc-4ddf-a58b-c4c7417dc3c7 None None] MFA Rules not processed for user `716bd387ca454a0389134f4ec2a5e5a8`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:47.886063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-70de6a6f-c1dc-4ddf-a58b-c4c7417dc3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:47.992210 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2367/4747] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:47.995765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de6a6f-c1dc-4ddf-a58b-c4c7417dc3c7 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:47.997102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30906c6b-ce7f-450b-8ba5-92c3df30de3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb2e83a4c2af45b49c6f23de08547160', 'request_id': 'req-30906c6b-ce7f-450b-8ba5-92c3df30de3d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:47.999797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-70de6a6f-c1dc-4ddf-a58b-c4c7417dc3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:48.019171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30906c6b-ce7f-450b-8ba5-92c3df30de3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb2e83a4c2af45b49c6f23de08547160', 'request_id': 'req-30906c6b-ce7f-450b-8ba5-92c3df30de3d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:48.045250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30906c6b-ce7f-450b-8ba5-92c3df30de3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb2e83a4c2af45b49c6f23de08547160', 'request_id': 'req-30906c6b-ce7f-450b-8ba5-92c3df30de3d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:48.154165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30906c6b-ce7f-450b-8ba5-92c3df30de3d admin admin] The token cache is being invalidate because project eb2e83a4c2af45b49c6f23de08547160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:45:48.154165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30906c6b-ce7f-450b-8ba5-92c3df30de3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:48.154165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30906c6b-ce7f-450b-8ba5-92c3df30de3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:48.167774 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2381/4748] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:45:47 2022] DELETE /identity/v3/projects/eb2e83a4c2af45b49c6f23de08547160 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:45:48.172787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30906c6b-ce7f-450b-8ba5-92c3df30de3d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:48.172787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-30906c6b-ce7f-450b-8ba5-92c3df30de3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:48.173858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de6a6f-c1dc-4ddf-a58b-c4c7417dc3c7 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:48.330682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb49ef5-7ee3-48ea-aebe-f5ace1481dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:48.331906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb49ef5-7ee3-48ea-aebe-f5ace1481dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:48.332198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb49ef5-7ee3-48ea-aebe-f5ace1481dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:48.332751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb49ef5-7ee3-48ea-aebe-f5ace1481dfb admin admin] PATH_INFO: `/v3/users/0aa14e8eb0784d2b8be3ced8b763cabd` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:48.335477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb49ef5-7ee3-48ea-aebe-f5ace1481dfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa14e8eb0784d2b8be3ced8b763cabd)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:48.338922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb49ef5-7ee3-48ea-aebe-f5ace1481dfb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:48.354816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30906c6b-ce7f-450b-8ba5-92c3df30de3d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:48.361814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b195470-bded-49f1-b2b1-b127815e6c97 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:48.363597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b195470-bded-49f1-b2b1-b127815e6c97 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:48.364844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b195470-bded-49f1-b2b1-b127815e6c97 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:48.365303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b195470-bded-49f1-b2b1-b127815e6c97 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:48.366222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b195470-bded-49f1-b2b1-b127815e6c97 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:48.368034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b195470-bded-49f1-b2b1-b127815e6c97 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:48.518356 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2382/4749] 10.222.0.20 () {60 vars in 1150 bytes} [Thu Oct 27 03:45:48 2022] POST /identity/v3/domains => generated 275 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:48.519779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cfa4e-9cc2-4a59-9556-ee4035dcbd84 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:48.520072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cfa4e-9cc2-4a59-9556-ee4035dcbd84 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:48.520350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cfa4e-9cc2-4a59-9556-ee4035dcbd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:48.568553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-048cfa4e-9cc2-4a59-9556-ee4035dcbd84 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:48.571135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-048cfa4e-9cc2-4a59-9556-ee4035dcbd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:48.641019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2fb49ef5-7ee3-48ea-aebe-f5ace1481dfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa14e8eb0784d2b8be3ced8b763cabd'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:48.643962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2fb49ef5-7ee3-48ea-aebe-f5ace1481dfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa14e8eb0784d2b8be3ced8b763cabd'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:48.661313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2fb49ef5-7ee3-48ea-aebe-f5ace1481dfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa14e8eb0784d2b8be3ced8b763cabd'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:48.679498 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2383/4750] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:48.680825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cfa4e-9cc2-4a59-9556-ee4035dcbd84 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:48.686469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-048cfa4e-9cc2-4a59-9556-ee4035dcbd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:48.702187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2fb49ef5-7ee3-48ea-aebe-f5ace1481dfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa14e8eb0784d2b8be3ced8b763cabd'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:48.774956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2fb49ef5-7ee3-48ea-aebe-f5ace1481dfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa14e8eb0784d2b8be3ced8b763cabd'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:48.782974 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2368/4751] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:45:47 2022] DELETE /identity/v3/users/0aa14e8eb0784d2b8be3ced8b763cabd => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:48.784313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a7319-75a3-40d3-ae6a-cf47f4c4c489 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:48.784604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a7319-75a3-40d3-ae6a-cf47f4c4c489 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:48.784879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a7319-75a3-40d3-ae6a-cf47f4c4c489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:48.831184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-930a7319-75a3-40d3-ae6a-cf47f4c4c489 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:48.839254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-930a7319-75a3-40d3-ae6a-cf47f4c4c489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:48.897684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cfa4e-9cc2-4a59-9556-ee4035dcbd84 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:48.994027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:49.060189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ee883-ab41-4dc3-b70a-32b4a6b4f3c9 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:49.060853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ee883-ab41-4dc3-b70a-32b4a6b4f3c9 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:49.061141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ee883-ab41-4dc3-b70a-32b4a6b4f3c9 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:49.061436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ee883-ab41-4dc3-b70a-32b4a6b4f3c9 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:49.062170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ee883-ab41-4dc3-b70a-32b4a6b4f3c9 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:49.063945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ee883-ab41-4dc3-b70a-32b4a6b4f3c9 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:49.083966 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2369/4752] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:49.085374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8defdd-ea6b-4dfe-aa07-6b8cbe12fcd3 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:49.090319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8defdd-ea6b-4dfe-aa07-6b8cbe12fcd3 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:49.090319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8defdd-ea6b-4dfe-aa07-6b8cbe12fcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:49.130776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-fc8defdd-ea6b-4dfe-aa07-6b8cbe12fcd3 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:49.137336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fc8defdd-ea6b-4dfe-aa07-6b8cbe12fcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:49.151058 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2370/4753] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:49.151943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8defdd-ea6b-4dfe-aa07-6b8cbe12fcd3 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:49.185115 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2384/4754] 10.222.0.20 () {60 vars in 1150 bytes} [Thu Oct 27 03:45:48 2022] POST /identity/v3/domains => generated 275 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:49.185115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ee883-ab41-4dc3-b70a-32b4a6b4f3c9 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:49.188390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b00ee883-ab41-4dc3-b70a-32b4a6b4f3c9 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:49.193271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8defdd-ea6b-4dfe-aa07-6b8cbe12fcd3 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:49.205245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:49.273263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75192a38-bfb5-49ad-9bbc-053acb37762a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:49.274202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75192a38-bfb5-49ad-9bbc-053acb37762a admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:49.274648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75192a38-bfb5-49ad-9bbc-053acb37762a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:49.275085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75192a38-bfb5-49ad-9bbc-053acb37762a admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:49.275909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75192a38-bfb5-49ad-9bbc-053acb37762a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:45:49.276378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75192a38-bfb5-49ad-9bbc-053acb37762a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:49.278404 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75192a38-bfb5-49ad-9bbc-053acb37762a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:49.308965 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2371/4755] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:45:49.311623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75192a38-bfb5-49ad-9bbc-053acb37762a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:49.312229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ee883-ab41-4dc3-b70a-32b4a6b4f3c9 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:49.318874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e677e5c-f750-4c2b-a229-aa3a59cf7216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:49.319575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e677e5c-f750-4c2b-a229-aa3a59cf7216 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:49.319985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e677e5c-f750-4c2b-a229-aa3a59cf7216 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:49.320124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e677e5c-f750-4c2b-a229-aa3a59cf7216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:49.332599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e677e5c-f750-4c2b-a229-aa3a59cf7216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:49.334174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e677e5c-f750-4c2b-a229-aa3a59cf7216 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:49.347920 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2385/4756] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:45:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:45:49.349363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e677e5c-f750-4c2b-a229-aa3a59cf7216 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:49.362698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e677e5c-f750-4c2b-a229-aa3a59cf7216 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:49.369706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a180b-2503-4f70-bba8-373fbb9ce569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:49.375465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a180b-2503-4f70-bba8-373fbb9ce569 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:49.375465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a180b-2503-4f70-bba8-373fbb9ce569 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:49.375465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a180b-2503-4f70-bba8-373fbb9ce569 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:49.375465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a180b-2503-4f70-bba8-373fbb9ce569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:49.375465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a180b-2503-4f70-bba8-373fbb9ce569 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:49.409587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75192a38-bfb5-49ad-9bbc-053acb37762a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:49.414792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8524ce-dd7f-4236-825a-b63616e089a4 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:49.415577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8524ce-dd7f-4236-825a-b63616e089a4 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:49.416037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8524ce-dd7f-4236-825a-b63616e089a4 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:49.416696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8524ce-dd7f-4236-825a-b63616e089a4 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:49.417438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8524ce-dd7f-4236-825a-b63616e089a4 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:49.418902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8524ce-dd7f-4236-825a-b63616e089a4 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:49.466247 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2386/4757] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:45:49 2022] POST /identity/v3/projects => generated 397 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:49.469872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a180b-2503-4f70-bba8-373fbb9ce569 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:49.472250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-596a180b-2503-4f70-bba8-373fbb9ce569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:49.567639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a180b-2503-4f70-bba8-373fbb9ce569 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:49.573109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4677f-2fa2-43b4-8fdf-5ea9d4b06e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:49.573592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4677f-2fa2-43b4-8fdf-5ea9d4b06e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:49.573874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4677f-2fa2-43b4-8fdf-5ea9d4b06e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:49.574305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4677f-2fa2-43b4-8fdf-5ea9d4b06e6f admin admin] PATH_INFO: `/v3/users/a8d11d6c1ad9437f92525912d5ba3d92` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:49.575649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4677f-2fa2-43b4-8fdf-5ea9d4b06e6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8d11d6c1ad9437f92525912d5ba3d92)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:49.577601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4677f-2fa2-43b4-8fdf-5ea9d4b06e6f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:49.590397 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2372/4758] 10.222.0.20 () {60 vars in 1150 bytes} [Thu Oct 27 03:45:49 2022] POST /identity/v3/domains => generated 278 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:49.591486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8524ce-dd7f-4236-825a-b63616e089a4 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:49.676227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8524ce-dd7f-4236-825a-b63616e089a4 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:49.681705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edca9d1-1535-4156-8b71-dc30ac3698f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:49.682652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edca9d1-1535-4156-8b71-dc30ac3698f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:49.683088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edca9d1-1535-4156-8b71-dc30ac3698f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:49.683515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edca9d1-1535-4156-8b71-dc30ac3698f3 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:49.684215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edca9d1-1535-4156-8b71-dc30ac3698f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:49.686183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edca9d1-1535-4156-8b71-dc30ac3698f3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:49.806886 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2373/4759] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:45:49 2022] POST /identity/v3/users => generated 299 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:49.806886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edca9d1-1535-4156-8b71-dc30ac3698f3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:49.850248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-15d4677f-2fa2-43b4-8fdf-5ea9d4b06e6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8d11d6c1ad9437f92525912d5ba3d92'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:49.851010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-15d4677f-2fa2-43b4-8fdf-5ea9d4b06e6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8d11d6c1ad9437f92525912d5ba3d92'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:49.858593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-15d4677f-2fa2-43b4-8fdf-5ea9d4b06e6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8d11d6c1ad9437f92525912d5ba3d92'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:49.871581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-15d4677f-2fa2-43b4-8fdf-5ea9d4b06e6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8d11d6c1ad9437f92525912d5ba3d92'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:49.872272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-15d4677f-2fa2-43b4-8fdf-5ea9d4b06e6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8d11d6c1ad9437f92525912d5ba3d92'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:49.881530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edca9d1-1535-4156-8b71-dc30ac3698f3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:49.889642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d625e9d-9932-4e61-825b-6b93cd81f5c9 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:49.890589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d625e9d-9932-4e61-825b-6b93cd81f5c9 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:49.890950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d625e9d-9932-4e61-825b-6b93cd81f5c9 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:49.892398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d625e9d-9932-4e61-825b-6b93cd81f5c9 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:49.892969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d625e9d-9932-4e61-825b-6b93cd81f5c9 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:49.897373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d625e9d-9932-4e61-825b-6b93cd81f5c9 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:49.925042 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2387/4760] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:45:49 2022] DELETE /identity/v3/users/a8d11d6c1ad9437f92525912d5ba3d92 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:49.926910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4677f-2fa2-43b4-8fdf-5ea9d4b06e6f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:49.928328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-15d4677f-2fa2-43b4-8fdf-5ea9d4b06e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:49.974661 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2374/4761] 10.222.0.20 () {60 vars in 1150 bytes} [Thu Oct 27 03:45:49 2022] POST /identity/v3/domains => generated 280 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:49.978612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d625e9d-9932-4e61-825b-6b93cd81f5c9 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:49.981590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3d625e9d-9932-4e61-825b-6b93cd81f5c9 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:50.020474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4677f-2fa2-43b4-8fdf-5ea9d4b06e6f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:50.058314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d625e9d-9932-4e61-825b-6b93cd81f5c9 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:50.063216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6fbee-35fb-407f-b4fd-48cca123f34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:50.064221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6fbee-35fb-407f-b4fd-48cca123f34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:50.065122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6fbee-35fb-407f-b4fd-48cca123f34e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:50.065414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6fbee-35fb-407f-b4fd-48cca123f34e admin admin] PATH_INFO: `/v3/users/485bf6f2e501433b96f847bb0f750017` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:50.066767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6fbee-35fb-407f-b4fd-48cca123f34e admin admin] RBAC: Authorizing `identity:delete_user(user_id=485bf6f2e501433b96f847bb0f750017)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:50.068670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6fbee-35fb-407f-b4fd-48cca123f34e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:50.088430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51f454-2bce-4225-b34a-f27cf039c7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:50.089400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51f454-2bce-4225-b34a-f27cf039c7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:50.089925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51f454-2bce-4225-b34a-f27cf039c7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:50.090480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51f454-2bce-4225-b34a-f27cf039c7e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:50.091517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51f454-2bce-4225-b34a-f27cf039c7e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:50.093635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51f454-2bce-4225-b34a-f27cf039c7e7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:50.107970 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2388/4762] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:50.109122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51f454-2bce-4225-b34a-f27cf039c7e7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:50.111705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1a51f454-2bce-4225-b34a-f27cf039c7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:50.182360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51f454-2bce-4225-b34a-f27cf039c7e7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:50.187115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb76bc-f977-436e-8626-d50d85a96545 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:50.187759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb76bc-f977-436e-8626-d50d85a96545 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:50.188047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb76bc-f977-436e-8626-d50d85a96545 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:50.188328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb76bc-f977-436e-8626-d50d85a96545 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains/6461f2a7cae247718f20b757b1299510` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:50.199866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb76bc-f977-436e-8626-d50d85a96545 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6461f2a7cae247718f20b757b1299510)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:50.201477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb76bc-f977-436e-8626-d50d85a96545 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:50.228904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ecbb76bc-f977-436e-8626-d50d85a96545 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6461f2a7cae247718f20b757b1299510'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.239563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ecbb76bc-f977-436e-8626-d50d85a96545 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6461f2a7cae247718f20b757b1299510'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.254551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:50.303024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d0e6fbee-35fb-407f-b4fd-48cca123f34e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '485bf6f2e501433b96f847bb0f750017'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.303677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d0e6fbee-35fb-407f-b4fd-48cca123f34e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '485bf6f2e501433b96f847bb0f750017'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.310587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d0e6fbee-35fb-407f-b4fd-48cca123f34e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '485bf6f2e501433b96f847bb0f750017'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.322178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d0e6fbee-35fb-407f-b4fd-48cca123f34e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '485bf6f2e501433b96f847bb0f750017'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.371855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ecbb76bc-f977-436e-8626-d50d85a96545 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6461f2a7cae247718f20b757b1299510', 'request_id': 'req-ecbb76bc-f977-436e-8626-d50d85a96545'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.378482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ecbb76bc-f977-436e-8626-d50d85a96545 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6461f2a7cae247718f20b757b1299510', 'request_id': 'req-ecbb76bc-f977-436e-8626-d50d85a96545'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.382269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d0e6fbee-35fb-407f-b4fd-48cca123f34e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '485bf6f2e501433b96f847bb0f750017'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.384339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ecbb76bc-f977-436e-8626-d50d85a96545 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6461f2a7cae247718f20b757b1299510', 'request_id': 'req-ecbb76bc-f977-436e-8626-d50d85a96545'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.388940 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2375/4763] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:45:49 2022] DELETE /identity/v3/users/485bf6f2e501433b96f847bb0f750017 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:50.391393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6fbee-35fb-407f-b4fd-48cca123f34e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:50.391537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d0e6fbee-35fb-407f-b4fd-48cca123f34e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:50.462025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6fbee-35fb-407f-b4fd-48cca123f34e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:50.468030 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70825cfd-b488-49b5-8b2b-7ea2b5ecff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:50.469063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70825cfd-b488-49b5-8b2b-7ea2b5ecff32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:50.469348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70825cfd-b488-49b5-8b2b-7ea2b5ecff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:50.469625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70825cfd-b488-49b5-8b2b-7ea2b5ecff32 admin admin] PATH_INFO: `/v3/projects/27120f8c7f2e4f038d4cd7d11e8bba4d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:50.471419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70825cfd-b488-49b5-8b2b-7ea2b5ecff32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27120f8c7f2e4f038d4cd7d11e8bba4d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:50.474392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70825cfd-b488-49b5-8b2b-7ea2b5ecff32 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:50.482814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ecbb76bc-f977-436e-8626-d50d85a96545 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] The token cache is being invalidate because project 6461f2a7cae247718f20b757b1299510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:45:50.483615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ecbb76bc-f977-436e-8626-d50d85a96545 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.484017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ecbb76bc-f977-436e-8626-d50d85a96545 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.495661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ecbb76bc-f977-436e-8626-d50d85a96545 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6461f2a7cae247718f20b757b1299510', 'request_id': 'req-ecbb76bc-f977-436e-8626-d50d85a96545'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.496450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ecbb76bc-f977-436e-8626-d50d85a96545 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6461f2a7cae247718f20b757b1299510', 'request_id': 'req-ecbb76bc-f977-436e-8626-d50d85a96545'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.497182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ecbb76bc-f977-436e-8626-d50d85a96545 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6461f2a7cae247718f20b757b1299510', 'request_id': 'req-ecbb76bc-f977-436e-8626-d50d85a96545'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.512019 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2389/4764] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:45:50 2022] DELETE /identity/v3/domains/6461f2a7cae247718f20b757b1299510 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:50.512019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb76bc-f977-436e-8626-d50d85a96545 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:50.512019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ecbb76bc-f977-436e-8626-d50d85a96545 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:50.569154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:50.596853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb76bc-f977-436e-8626-d50d85a96545 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:50.619579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-70825cfd-b488-49b5-8b2b-7ea2b5ecff32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27120f8c7f2e4f038d4cd7d11e8bba4d', 'request_id': 'req-70825cfd-b488-49b5-8b2b-7ea2b5ecff32'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.662366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893305a3-ff69-4ed2-8392-4c7e2dd72dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:50.662994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893305a3-ff69-4ed2-8392-4c7e2dd72dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:50.663277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893305a3-ff69-4ed2-8392-4c7e2dd72dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:50.663552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893305a3-ff69-4ed2-8392-4c7e2dd72dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:50.664207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893305a3-ff69-4ed2-8392-4c7e2dd72dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:50.665813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893305a3-ff69-4ed2-8392-4c7e2dd72dc2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:50.677433 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2390/4765] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:50.679941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893305a3-ff69-4ed2-8392-4c7e2dd72dc2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:50.682074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-893305a3-ff69-4ed2-8392-4c7e2dd72dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:50.695381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893305a3-ff69-4ed2-8392-4c7e2dd72dc2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:50.703433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-70825cfd-b488-49b5-8b2b-7ea2b5ecff32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27120f8c7f2e4f038d4cd7d11e8bba4d', 'request_id': 'req-70825cfd-b488-49b5-8b2b-7ea2b5ecff32'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.703926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23930e-04db-45d3-a9ad-f6f7854b9c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:50.705171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23930e-04db-45d3-a9ad-f6f7854b9c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:50.705526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23930e-04db-45d3-a9ad-f6f7854b9c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:50.705885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23930e-04db-45d3-a9ad-f6f7854b9c0f admin admin] PATH_INFO: `/v3/projects/2cb8d4a8c5044999b1e7e1000a0db3bd` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:50.708246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23930e-04db-45d3-a9ad-f6f7854b9c0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cb8d4a8c5044999b1e7e1000a0db3bd)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:50.713406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-70825cfd-b488-49b5-8b2b-7ea2b5ecff32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27120f8c7f2e4f038d4cd7d11e8bba4d', 'request_id': 'req-70825cfd-b488-49b5-8b2b-7ea2b5ecff32'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.716159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23930e-04db-45d3-a9ad-f6f7854b9c0f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:50.734669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-70825cfd-b488-49b5-8b2b-7ea2b5ecff32 admin admin] The token cache is being invalidate because project 27120f8c7f2e4f038d4cd7d11e8bba4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:45:50.734964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-70825cfd-b488-49b5-8b2b-7ea2b5ecff32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.735850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-70825cfd-b488-49b5-8b2b-7ea2b5ecff32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.737648 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2376/4766] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:45:50 2022] DELETE /identity/v3/projects/27120f8c7f2e4f038d4cd7d11e8bba4d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:50.738428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70825cfd-b488-49b5-8b2b-7ea2b5ecff32 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:50.739728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-70825cfd-b488-49b5-8b2b-7ea2b5ecff32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:50.809831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70825cfd-b488-49b5-8b2b-7ea2b5ecff32 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:50.814605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf303973-20eb-4040-966a-2305a438eaf6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:50.815316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf303973-20eb-4040-966a-2305a438eaf6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:50.815651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf303973-20eb-4040-966a-2305a438eaf6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:50.816022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf303973-20eb-4040-966a-2305a438eaf6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:50.816752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf303973-20eb-4040-966a-2305a438eaf6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:50.818473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf303973-20eb-4040-966a-2305a438eaf6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:50.846996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0f23930e-04db-45d3-a9ad-f6f7854b9c0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cb8d4a8c5044999b1e7e1000a0db3bd', 'request_id': 'req-0f23930e-04db-45d3-a9ad-f6f7854b9c0f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.854698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0f23930e-04db-45d3-a9ad-f6f7854b9c0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cb8d4a8c5044999b1e7e1000a0db3bd', 'request_id': 'req-0f23930e-04db-45d3-a9ad-f6f7854b9c0f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.861368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0f23930e-04db-45d3-a9ad-f6f7854b9c0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cb8d4a8c5044999b1e7e1000a0db3bd', 'request_id': 'req-0f23930e-04db-45d3-a9ad-f6f7854b9c0f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.909834 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2377/4767] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:45:50 2022] POST /identity/v3/domains => generated 249 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:50.909834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf303973-20eb-4040-966a-2305a438eaf6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:50.911686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cf303973-20eb-4040-966a-2305a438eaf6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:50.925654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0f23930e-04db-45d3-a9ad-f6f7854b9c0f admin admin] The token cache is being invalidate because project 2cb8d4a8c5044999b1e7e1000a0db3bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:45:50.925947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0f23930e-04db-45d3-a9ad-f6f7854b9c0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.926617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0f23930e-04db-45d3-a9ad-f6f7854b9c0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:50.932746 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2391/4768] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:45:50 2022] DELETE /identity/v3/projects/2cb8d4a8c5044999b1e7e1000a0db3bd => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:50.932746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23930e-04db-45d3-a9ad-f6f7854b9c0f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:50.937002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0f23930e-04db-45d3-a9ad-f6f7854b9c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:51.018405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf303973-20eb-4040-966a-2305a438eaf6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:51.024642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0962a4-6144-4f14-ba7c-5c26fc0a7792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:51.025400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0962a4-6144-4f14-ba7c-5c26fc0a7792 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:51.025750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0962a4-6144-4f14-ba7c-5c26fc0a7792 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:51.026133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0962a4-6144-4f14-ba7c-5c26fc0a7792 admin admin] PATH_INFO: `/v3/projects/63fc6a536b2f46b19fa2e6ab35917332/users/b983494c36da483d9f626522f74d9963/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:51.033652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23930e-04db-45d3-a9ad-f6f7854b9c0f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:51.048220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0962a4-6144-4f14-ba7c-5c26fc0a7792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63fc6a536b2f46b19fa2e6ab35917332, user_id=b983494c36da483d9f626522f74d9963, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:51.050855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaaf718-42f0-4d62-92bd-521b4c2a9a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:51.051450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0962a4-6144-4f14-ba7c-5c26fc0a7792 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:51.052251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaf718-42f0-4d62-92bd-521b4c2a9a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:51.052612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaf718-42f0-4d62-92bd-521b4c2a9a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:51.052966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaf718-42f0-4d62-92bd-521b4c2a9a6c admin admin] PATH_INFO: `/v3/projects/a72a2bc8348b4b078398a41870475443` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:51.054275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaaf718-42f0-4d62-92bd-521b4c2a9a6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a72a2bc8348b4b078398a41870475443)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:51.056306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaaf718-42f0-4d62-92bd-521b4c2a9a6c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:51.106051 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2378/4769] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:50 2022] PUT /identity/v3/projects/63fc6a536b2f46b19fa2e6ab35917332/users/b983494c36da483d9f626522f74d9963/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:51.106051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0962a4-6144-4f14-ba7c-5c26fc0a7792 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:51.106051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ce0962a4-6144-4f14-ba7c-5c26fc0a7792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:51.170075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0962a4-6144-4f14-ba7c-5c26fc0a7792 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:51.178600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b6f0a-990c-4446-bcfa-5a535605fb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:51.179245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b6f0a-990c-4446-bcfa-5a535605fb2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:51.179528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b6f0a-990c-4446-bcfa-5a535605fb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:51.179815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b6f0a-990c-4446-bcfa-5a535605fb2a admin admin] PATH_INFO: `/v3/users/734a86508363447fb19569c663836d6f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:51.181329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b6f0a-990c-4446-bcfa-5a535605fb2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=734a86508363447fb19569c663836d6f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:51.183487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b6f0a-990c-4446-bcfa-5a535605fb2a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:51.195867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:51.201482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-edaaf718-42f0-4d62-92bd-521b4c2a9a6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a72a2bc8348b4b078398a41870475443', 'request_id': 'req-edaaf718-42f0-4d62-92bd-521b4c2a9a6c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:51.210579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-edaaf718-42f0-4d62-92bd-521b4c2a9a6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a72a2bc8348b4b078398a41870475443', 'request_id': 'req-edaaf718-42f0-4d62-92bd-521b4c2a9a6c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:51.217481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-edaaf718-42f0-4d62-92bd-521b4c2a9a6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a72a2bc8348b4b078398a41870475443', 'request_id': 'req-edaaf718-42f0-4d62-92bd-521b4c2a9a6c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:51.239777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:51.290563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-edaaf718-42f0-4d62-92bd-521b4c2a9a6c admin admin] The token cache is being invalidate because project a72a2bc8348b4b078398a41870475443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:45:51.290943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-edaaf718-42f0-4d62-92bd-521b4c2a9a6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:51.291580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-edaaf718-42f0-4d62-92bd-521b4c2a9a6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:51.293242 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2392/4770] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:45:50 2022] DELETE /identity/v3/projects/a72a2bc8348b4b078398a41870475443 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:51.296432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaaf718-42f0-4d62-92bd-521b4c2a9a6c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:51.296432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-edaaf718-42f0-4d62-92bd-521b4c2a9a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:51.348258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-797b6f0a-990c-4446-bcfa-5a535605fb2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '734a86508363447fb19569c663836d6f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:51.349083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-797b6f0a-990c-4446-bcfa-5a535605fb2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '734a86508363447fb19569c663836d6f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:51.357436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-797b6f0a-990c-4446-bcfa-5a535605fb2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '734a86508363447fb19569c663836d6f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:51.368215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaaf718-42f0-4d62-92bd-521b4c2a9a6c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:51.371895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-797b6f0a-990c-4446-bcfa-5a535605fb2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '734a86508363447fb19569c663836d6f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:51.374143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa264e-adae-439e-a77c-36c0ca0063ca tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:51.374883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa264e-adae-439e-a77c-36c0ca0063ca tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:51.375271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa264e-adae-439e-a77c-36c0ca0063ca tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:51.375628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa264e-adae-439e-a77c-36c0ca0063ca tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains/03271a08d15744d8ba5c7fbbc09a4700` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:51.389692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa264e-adae-439e-a77c-36c0ca0063ca tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=03271a08d15744d8ba5c7fbbc09a4700)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:51.391397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa264e-adae-439e-a77c-36c0ca0063ca tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:51.415958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-47aa264e-adae-439e-a77c-36c0ca0063ca tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '03271a08d15744d8ba5c7fbbc09a4700'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:51.416761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-47aa264e-adae-439e-a77c-36c0ca0063ca tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '03271a08d15744d8ba5c7fbbc09a4700'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:51.462741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-797b6f0a-990c-4446-bcfa-5a535605fb2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '734a86508363447fb19569c663836d6f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:51.469374 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2379/4771] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:45:51 2022] DELETE /identity/v3/users/734a86508363447fb19569c663836d6f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:51.475463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe8424-1c47-4953-8239-e1a8bc0f5a00 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:51.475463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe8424-1c47-4953-8239-e1a8bc0f5a00 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:51.475463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe8424-1c47-4953-8239-e1a8bc0f5a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:51.497103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-42fe8424-1c47-4953-8239-e1a8bc0f5a00 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:51.500141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-42fe8424-1c47-4953-8239-e1a8bc0f5a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:51.510426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-47aa264e-adae-439e-a77c-36c0ca0063ca tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '03271a08d15744d8ba5c7fbbc09a4700'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:51.511280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-47aa264e-adae-439e-a77c-36c0ca0063ca tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '03271a08d15744d8ba5c7fbbc09a4700'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:51.514573 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2393/4772] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:45:51 2022] PATCH /identity/v3/domains/03271a08d15744d8ba5c7fbbc09a4700 => generated 250 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:45:51.515927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e367c29-6b3a-4e51-94e2-e6368ef6e25a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:51.516213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e367c29-6b3a-4e51-94e2-e6368ef6e25a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:51.516486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e367c29-6b3a-4e51-94e2-e6368ef6e25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:51.540823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6e367c29-6b3a-4e51-94e2-e6368ef6e25a None None] MFA Rules not processed for user `ca2da57f02884a968d685b53a5399e46`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:51.543201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6e367c29-6b3a-4e51-94e2-e6368ef6e25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:51.588544 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2380/4773] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:51.591971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602014f-f6e9-4a6e-a70c-3892617ea2a6 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:51.591971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602014f-f6e9-4a6e-a70c-3892617ea2a6 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:51.591971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602014f-f6e9-4a6e-a70c-3892617ea2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:51.611808 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2394/4774] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:51.612677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e367c29-6b3a-4e51-94e2-e6368ef6e25a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:51.614097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6e367c29-6b3a-4e51-94e2-e6368ef6e25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:51.616555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8602014f-f6e9-4a6e-a70c-3892617ea2a6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:51.618016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8602014f-f6e9-4a6e-a70c-3892617ea2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:51.627254 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2381/4775] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:51.627974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602014f-f6e9-4a6e-a70c-3892617ea2a6 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:51.631504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e367c29-6b3a-4e51-94e2-e6368ef6e25a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:51.632327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8602014f-f6e9-4a6e-a70c-3892617ea2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:51.645696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9969f8b-501c-42cc-861d-489b193856f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:51.650555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9969f8b-501c-42cc-861d-489b193856f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:51.650555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9969f8b-501c-42cc-861d-489b193856f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:51.651510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9969f8b-501c-42cc-861d-489b193856f1 admin admin] PATH_INFO: `/v3/users/f3009dadbd8a46089206ab98967e69bb` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:51.654766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9969f8b-501c-42cc-861d-489b193856f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3009dadbd8a46089206ab98967e69bb)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:51.660864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9969f8b-501c-42cc-861d-489b193856f1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:51.724353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602014f-f6e9-4a6e-a70c-3892617ea2a6 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:51.728920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c1893-7daf-4604-9967-a5824f40c354 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:51.729581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c1893-7daf-4604-9967-a5824f40c354 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:51.729917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c1893-7daf-4604-9967-a5824f40c354 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:51.730295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c1893-7daf-4604-9967-a5824f40c354 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains/03271a08d15744d8ba5c7fbbc09a4700` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:51.746220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c1893-7daf-4604-9967-a5824f40c354 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=03271a08d15744d8ba5c7fbbc09a4700)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:51.747607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c1893-7daf-4604-9967-a5824f40c354 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:51.786063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-243c1893-7daf-4604-9967-a5824f40c354 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '03271a08d15744d8ba5c7fbbc09a4700'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:51.794166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:51.802732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-243c1893-7daf-4604-9967-a5824f40c354 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '03271a08d15744d8ba5c7fbbc09a4700'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:51.880630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c9969f8b-501c-42cc-861d-489b193856f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3009dadbd8a46089206ab98967e69bb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:51.881392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c9969f8b-501c-42cc-861d-489b193856f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3009dadbd8a46089206ab98967e69bb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:51.889401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c9969f8b-501c-42cc-861d-489b193856f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3009dadbd8a46089206ab98967e69bb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:51.910998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c9969f8b-501c-42cc-861d-489b193856f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3009dadbd8a46089206ab98967e69bb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:51.911801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c9969f8b-501c-42cc-861d-489b193856f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3009dadbd8a46089206ab98967e69bb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:51.946764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-243c1893-7daf-4604-9967-a5824f40c354 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03271a08d15744d8ba5c7fbbc09a4700', 'request_id': 'req-243c1893-7daf-4604-9967-a5824f40c354'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:51.954172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:52.013513 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2395/4776] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:45:51 2022] DELETE /identity/v3/users/f3009dadbd8a46089206ab98967e69bb => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:52.015242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb649b-78f7-4f0a-979a-dc7ffbb8e688 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:52.015821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb649b-78f7-4f0a-979a-dc7ffbb8e688 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:52.016347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb649b-78f7-4f0a-979a-dc7ffbb8e688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:52.061145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-88eb649b-78f7-4f0a-979a-dc7ffbb8e688 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:52.063514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-88eb649b-78f7-4f0a-979a-dc7ffbb8e688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:52.094492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-243c1893-7daf-4604-9967-a5824f40c354 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03271a08d15744d8ba5c7fbbc09a4700', 'request_id': 'req-243c1893-7daf-4604-9967-a5824f40c354'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:52.103842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-243c1893-7daf-4604-9967-a5824f40c354 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03271a08d15744d8ba5c7fbbc09a4700', 'request_id': 'req-243c1893-7daf-4604-9967-a5824f40c354'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:52.118703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-243c1893-7daf-4604-9967-a5824f40c354 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] The token cache is being invalidate because project 03271a08d15744d8ba5c7fbbc09a4700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:45:52.119262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-243c1893-7daf-4604-9967-a5824f40c354 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:52.120126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-243c1893-7daf-4604-9967-a5824f40c354 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:52.129728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-243c1893-7daf-4604-9967-a5824f40c354 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '03271a08d15744d8ba5c7fbbc09a4700', 'request_id': 'req-243c1893-7daf-4604-9967-a5824f40c354'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:52.131387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-243c1893-7daf-4604-9967-a5824f40c354 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '03271a08d15744d8ba5c7fbbc09a4700', 'request_id': 'req-243c1893-7daf-4604-9967-a5824f40c354'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:52.132215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-243c1893-7daf-4604-9967-a5824f40c354 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '03271a08d15744d8ba5c7fbbc09a4700', 'request_id': 'req-243c1893-7daf-4604-9967-a5824f40c354'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:52.143531 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2382/4777] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:45:51 2022] DELETE /identity/v3/domains/03271a08d15744d8ba5c7fbbc09a4700 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:52.149220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c1893-7daf-4604-9967-a5824f40c354 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:52.149220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-243c1893-7daf-4604-9967-a5824f40c354 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:52.159670 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2396/4778] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:52.160612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb649b-78f7-4f0a-979a-dc7ffbb8e688 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:52.162700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-88eb649b-78f7-4f0a-979a-dc7ffbb8e688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:52.178655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb649b-78f7-4f0a-979a-dc7ffbb8e688 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:52.187409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab90ed-e5b2-41d0-b1f8-b4f436f8c578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:52.193566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab90ed-e5b2-41d0-b1f8-b4f436f8c578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:52.194101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab90ed-e5b2-41d0-b1f8-b4f436f8c578 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:52.195553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab90ed-e5b2-41d0-b1f8-b4f436f8c578 admin admin] PATH_INFO: `/v3/projects/8b53d6fcfbb2499ea236f5f6d0ad9f26` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:52.198800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab90ed-e5b2-41d0-b1f8-b4f436f8c578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b53d6fcfbb2499ea236f5f6d0ad9f26)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:52.201275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab90ed-e5b2-41d0-b1f8-b4f436f8c578 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:52.205291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:52.268723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c1893-7daf-4604-9967-a5824f40c354 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:52.334614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64cf41-7e08-42a1-bc39-2fa4baedf90f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:52.335228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64cf41-7e08-42a1-bc39-2fa4baedf90f service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:52.335511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64cf41-7e08-42a1-bc39-2fa4baedf90f service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:52.335787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64cf41-7e08-42a1-bc39-2fa4baedf90f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:52.337614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3c64cf41-7e08-42a1-bc39-2fa4baedf90f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:52.350309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64cf41-7e08-42a1-bc39-2fa4baedf90f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:52.352772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64cf41-7e08-42a1-bc39-2fa4baedf90f service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:52.365349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-32ab90ed-e5b2-41d0-b1f8-b4f436f8c578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b53d6fcfbb2499ea236f5f6d0ad9f26', 'request_id': 'req-32ab90ed-e5b2-41d0-b1f8-b4f436f8c578'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:52.368156 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2383/4779] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:45:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:45:52.369081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64cf41-7e08-42a1-bc39-2fa4baedf90f service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:52.370445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3c64cf41-7e08-42a1-bc39-2fa4baedf90f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:52.395431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-32ab90ed-e5b2-41d0-b1f8-b4f436f8c578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b53d6fcfbb2499ea236f5f6d0ad9f26', 'request_id': 'req-32ab90ed-e5b2-41d0-b1f8-b4f436f8c578'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:52.403922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-32ab90ed-e5b2-41d0-b1f8-b4f436f8c578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b53d6fcfbb2499ea236f5f6d0ad9f26', 'request_id': 'req-32ab90ed-e5b2-41d0-b1f8-b4f436f8c578'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:52.495779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-32ab90ed-e5b2-41d0-b1f8-b4f436f8c578 admin admin] The token cache is being invalidate because project 8b53d6fcfbb2499ea236f5f6d0ad9f26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:45:52.504478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-32ab90ed-e5b2-41d0-b1f8-b4f436f8c578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:52.504478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-32ab90ed-e5b2-41d0-b1f8-b4f436f8c578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:52.505361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64cf41-7e08-42a1-bc39-2fa4baedf90f service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:52.505836 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2397/4780] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:45:52 2022] DELETE /identity/v3/projects/8b53d6fcfbb2499ea236f5f6d0ad9f26 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:52.505836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab90ed-e5b2-41d0-b1f8-b4f436f8c578 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:52.505836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-32ab90ed-e5b2-41d0-b1f8-b4f436f8c578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:52.601384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7e954-5b45-4ca2-98df-bb2a0b3f546c tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:52.602136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7e954-5b45-4ca2-98df-bb2a0b3f546c tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:52.602404 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7e954-5b45-4ca2-98df-bb2a0b3f546c tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:52.602782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab90ed-e5b2-41d0-b1f8-b4f436f8c578 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:52.602916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7e954-5b45-4ca2-98df-bb2a0b3f546c tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:52.603522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7e954-5b45-4ca2-98df-bb2a0b3f546c tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:52.608255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7e954-5b45-4ca2-98df-bb2a0b3f546c tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:52.608991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a041ef-ae94-42cd-a196-0d0b79e3caa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:52.609790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a041ef-ae94-42cd-a196-0d0b79e3caa6 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:52.610200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a041ef-ae94-42cd-a196-0d0b79e3caa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:52.611268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a041ef-ae94-42cd-a196-0d0b79e3caa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:52.612025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a041ef-ae94-42cd-a196-0d0b79e3caa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:45:52.613150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a041ef-ae94-42cd-a196-0d0b79e3caa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:52.615559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a041ef-ae94-42cd-a196-0d0b79e3caa6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:52.630498 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2398/4781] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:45:52.635609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a041ef-ae94-42cd-a196-0d0b79e3caa6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:52.637821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-23a041ef-ae94-42cd-a196-0d0b79e3caa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:52.643812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:52.654832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a041ef-ae94-42cd-a196-0d0b79e3caa6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:52.661271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6fbfe-c4bb-42d3-ac0f-fd100478e5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:52.661744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6fbfe-c4bb-42d3-ac0f-fd100478e5b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:52.662229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6fbfe-c4bb-42d3-ac0f-fd100478e5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:52.662605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6fbfe-c4bb-42d3-ac0f-fd100478e5b2 admin admin] PATH_INFO: `/v3/projects/ca44236ea9e94c999331669faf5c0e41` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:52.663862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6fbfe-c4bb-42d3-ac0f-fd100478e5b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca44236ea9e94c999331669faf5c0e41)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:52.667826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6fbfe-c4bb-42d3-ac0f-fd100478e5b2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:52.742216 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2384/4782] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:45:52 2022] POST /identity/v3/domains => generated 278 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:52.744223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bb30e-68ca-4d28-885c-17a326d5c037 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:52.744715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bb30e-68ca-4d28-885c-17a326d5c037 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:52.745250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bb30e-68ca-4d28-885c-17a326d5c037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:52.766479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f00bb30e-68ca-4d28-885c-17a326d5c037 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:52.768605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f00bb30e-68ca-4d28-885c-17a326d5c037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:52.845917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1aa6fbfe-c4bb-42d3-ac0f-fd100478e5b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca44236ea9e94c999331669faf5c0e41', 'request_id': 'req-1aa6fbfe-c4bb-42d3-ac0f-fd100478e5b2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:52.854182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1aa6fbfe-c4bb-42d3-ac0f-fd100478e5b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca44236ea9e94c999331669faf5c0e41', 'request_id': 'req-1aa6fbfe-c4bb-42d3-ac0f-fd100478e5b2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:52.865216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1aa6fbfe-c4bb-42d3-ac0f-fd100478e5b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca44236ea9e94c999331669faf5c0e41', 'request_id': 'req-1aa6fbfe-c4bb-42d3-ac0f-fd100478e5b2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:52.872988 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2385/4783] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:52.872988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bb30e-68ca-4d28-885c-17a326d5c037 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:52.890125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bb30e-68ca-4d28-885c-17a326d5c037 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:52.956608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3972c-3660-465a-b908-e9d7aaab2391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:52.957231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3972c-3660-465a-b908-e9d7aaab2391 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:52.957548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3972c-3660-465a-b908-e9d7aaab2391 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:52.957828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3972c-3660-465a-b908-e9d7aaab2391 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:52.958511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3972c-3660-465a-b908-e9d7aaab2391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:52.961263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3972c-3660-465a-b908-e9d7aaab2391 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:52.979402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1aa6fbfe-c4bb-42d3-ac0f-fd100478e5b2 admin admin] The token cache is being invalidate because project ca44236ea9e94c999331669faf5c0e41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:45:52.979402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1aa6fbfe-c4bb-42d3-ac0f-fd100478e5b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:52.979402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1aa6fbfe-c4bb-42d3-ac0f-fd100478e5b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:52.979402 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2399/4784] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:45:52 2022] DELETE /identity/v3/projects/ca44236ea9e94c999331669faf5c0e41 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:52.979402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6fbfe-c4bb-42d3-ac0f-fd100478e5b2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:52.980220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1aa6fbfe-c4bb-42d3-ac0f-fd100478e5b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:53.054437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6fbfe-c4bb-42d3-ac0f-fd100478e5b2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:53.059932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26508653-278d-40de-b236-62fcbc2e579e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:53.060561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26508653-278d-40de-b236-62fcbc2e579e service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:53.060847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26508653-278d-40de-b236-62fcbc2e579e service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:53.061128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26508653-278d-40de-b236-62fcbc2e579e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:53.063318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-26508653-278d-40de-b236-62fcbc2e579e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:53.077903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26508653-278d-40de-b236-62fcbc2e579e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:53.080130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26508653-278d-40de-b236-62fcbc2e579e service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:53.095579 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2400/4785] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:45:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:45:53.096491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26508653-278d-40de-b236-62fcbc2e579e service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:53.097858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-26508653-278d-40de-b236-62fcbc2e579e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:53.109894 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2386/4786] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:45:52 2022] POST /identity/v3/projects => generated 401 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:53.111978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571551d-0f35-45cd-9e9a-8945f50575a2 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:53.112541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571551d-0f35-45cd-9e9a-8945f50575a2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:53.113040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571551d-0f35-45cd-9e9a-8945f50575a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:53.142825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f571551d-0f35-45cd-9e9a-8945f50575a2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:53.145467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f571551d-0f35-45cd-9e9a-8945f50575a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:53.190870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26508653-278d-40de-b236-62fcbc2e579e service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:53.255626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d8b18-9936-4f06-b654-b2535e69168f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:53.256737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d8b18-9936-4f06-b654-b2535e69168f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:53.256917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d8b18-9936-4f06-b654-b2535e69168f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:53.257129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d8b18-9936-4f06-b654-b2535e69168f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains/cbdefea922444237b294bb1fa87b8bff` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:53.272800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d8b18-9936-4f06-b654-b2535e69168f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=cbdefea922444237b294bb1fa87b8bff)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:53.274591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d8b18-9936-4f06-b654-b2535e69168f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:53.281634 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2387/4787] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:53.284018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e563bb-f3eb-4c20-9d50-22fe456f3e75 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:53.284529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e563bb-f3eb-4c20-9d50-22fe456f3e75 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:53.285105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e563bb-f3eb-4c20-9d50-22fe456f3e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:53.305134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ef7d8b18-9936-4f06-b654-b2535e69168f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'cbdefea922444237b294bb1fa87b8bff'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:53.306056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ef7d8b18-9936-4f06-b654-b2535e69168f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'cbdefea922444237b294bb1fa87b8bff'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:53.334457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e3e563bb-f3eb-4c20-9d50-22fe456f3e75 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:53.335858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e3e563bb-f3eb-4c20-9d50-22fe456f3e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:53.420950 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2388/4788] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:53.423639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e563bb-f3eb-4c20-9d50-22fe456f3e75 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:53.427885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e3e563bb-f3eb-4c20-9d50-22fe456f3e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:53.432528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ef7d8b18-9936-4f06-b654-b2535e69168f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'cbdefea922444237b294bb1fa87b8bff'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:53.438269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ef7d8b18-9936-4f06-b654-b2535e69168f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'cbdefea922444237b294bb1fa87b8bff'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:53.448030 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2401/4789] 10.222.0.20 () {60 vars in 1250 bytes} [Thu Oct 27 03:45:53 2022] PATCH /identity/v3/domains/cbdefea922444237b294bb1fa87b8bff => generated 277 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:45:53.449762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d8b18-9936-4f06-b654-b2535e69168f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:53.452108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ef7d8b18-9936-4f06-b654-b2535e69168f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:53.474892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d8b18-9936-4f06-b654-b2535e69168f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:53.484915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaecf9a-4d7d-49e1-be74-f8f04b2a496c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:53.486504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaecf9a-4d7d-49e1-be74-f8f04b2a496c admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:53.487117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaecf9a-4d7d-49e1-be74-f8f04b2a496c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:53.487686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaecf9a-4d7d-49e1-be74-f8f04b2a496c admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:53.488598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaecf9a-4d7d-49e1-be74-f8f04b2a496c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:53.496909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaecf9a-4d7d-49e1-be74-f8f04b2a496c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:53.507280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:53.555248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e563bb-f3eb-4c20-9d50-22fe456f3e75 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:53.561928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcde7a2-ea08-4cb9-af13-058c095fa542 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:53.563284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcde7a2-ea08-4cb9-af13-058c095fa542 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:53.564237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcde7a2-ea08-4cb9-af13-058c095fa542 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:53.564584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcde7a2-ea08-4cb9-af13-058c095fa542 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:53.566536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3fcde7a2-ea08-4cb9-af13-058c095fa542 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:53.582716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcde7a2-ea08-4cb9-af13-058c095fa542 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:53.584370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcde7a2-ea08-4cb9-af13-058c095fa542 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:53.598762 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2389/4790] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:45:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:45:53.599906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcde7a2-ea08-4cb9-af13-058c095fa542 service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:53.601601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3fcde7a2-ea08-4cb9-af13-058c095fa542 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:53.615360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcde7a2-ea08-4cb9-af13-058c095fa542 service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:53.620263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab82317-b14d-49ad-9902-1b2d6f17fa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:53.622783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab82317-b14d-49ad-9902-1b2d6f17fa44 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:53.623146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab82317-b14d-49ad-9902-1b2d6f17fa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:53.623500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab82317-b14d-49ad-9902-1b2d6f17fa44 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:53.624242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab82317-b14d-49ad-9902-1b2d6f17fa44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:45:53.624629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab82317-b14d-49ad-9902-1b2d6f17fa44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:53.627319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab82317-b14d-49ad-9902-1b2d6f17fa44 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:53.640733 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2390/4791] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:45:53.642329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529c09a-4bbf-4ed0-83ad-4efa4a2282da None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:53.642755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529c09a-4bbf-4ed0-83ad-4efa4a2282da None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:53.643047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529c09a-4bbf-4ed0-83ad-4efa4a2282da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:53.663303 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2402/4792] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:45:53 2022] POST /identity/v3/users => generated 301 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:53.663303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaecf9a-4d7d-49e1-be74-f8f04b2a496c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:53.668807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e529c09a-4bbf-4ed0-83ad-4efa4a2282da None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:53.670212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-caaecf9a-4d7d-49e1-be74-f8f04b2a496c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:53.670520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e529c09a-4bbf-4ed0-83ad-4efa4a2282da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:53.692068 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2391/4793] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:53.692068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b6e24-eb13-42aa-8f72-865302859315 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:53.692068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b6e24-eb13-42aa-8f72-865302859315 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:53.692068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b6e24-eb13-42aa-8f72-865302859315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:53.714129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4a4b6e24-eb13-42aa-8f72-865302859315 None None] MFA Rules not processed for user `ca2da57f02884a968d685b53a5399e46`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:53.715375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4a4b6e24-eb13-42aa-8f72-865302859315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:53.756793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:53.802249 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2392/4794] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:53.802249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b6e24-eb13-42aa-8f72-865302859315 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:53.804787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaecf9a-4d7d-49e1-be74-f8f04b2a496c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:53.810826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a0ff6-37ea-49a6-9d57-d905849a3bd2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:53.811465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a0ff6-37ea-49a6-9d57-d905849a3bd2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:53.811752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a0ff6-37ea-49a6-9d57-d905849a3bd2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:53.812031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a0ff6-37ea-49a6-9d57-d905849a3bd2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains/cbdefea922444237b294bb1fa87b8bff` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:53.820283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b6e24-eb13-42aa-8f72-865302859315 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:53.825069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a0ff6-37ea-49a6-9d57-d905849a3bd2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=cbdefea922444237b294bb1fa87b8bff)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:53.827376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a0ff6-37ea-49a6-9d57-d905849a3bd2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:53.831003 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2403/4795] 10.222.0.20 () {58 vars in 1227 bytes} [Thu Oct 27 03:45:53 2022] GET /identity/v3/domains/cbdefea922444237b294bb1fa87b8bff => generated 277 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:45:53.832136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a0ff6-37ea-49a6-9d57-d905849a3bd2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:53.839470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e0ee2-35be-43c8-ab41-97694bce3678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:53.839790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e0ee2-35be-43c8-ab41-97694bce3678 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:53.840187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e0ee2-35be-43c8-ab41-97694bce3678 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:53.840460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e0ee2-35be-43c8-ab41-97694bce3678 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:53.841172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e0ee2-35be-43c8-ab41-97694bce3678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:53.844054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e0ee2-35be-43c8-ab41-97694bce3678 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:53.859266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a0ff6-37ea-49a6-9d57-d905849a3bd2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:53.865552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8969d-4312-4690-82b2-88f13c451e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:53.866734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8969d-4312-4690-82b2-88f13c451e7d admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:53.867143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8969d-4312-4690-82b2-88f13c451e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:53.867524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8969d-4312-4690-82b2-88f13c451e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:53.868572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8969d-4312-4690-82b2-88f13c451e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:53.871058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8969d-4312-4690-82b2-88f13c451e7d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:53.888315 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2404/4796] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:53.889379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8969d-4312-4690-82b2-88f13c451e7d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:53.905239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8969d-4312-4690-82b2-88f13c451e7d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:53.910764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0319c6a-15f6-4429-bc0e-ded22e5ab079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:53.911394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0319c6a-15f6-4429-bc0e-ded22e5ab079 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:53.911686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0319c6a-15f6-4429-bc0e-ded22e5ab079 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:53.911975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0319c6a-15f6-4429-bc0e-ded22e5ab079 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:53.912681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0319c6a-15f6-4429-bc0e-ded22e5ab079 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:45:53.913171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0319c6a-15f6-4429-bc0e-ded22e5ab079 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:53.914919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0319c6a-15f6-4429-bc0e-ded22e5ab079 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:53.928817 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2405/4797] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:45:53.929861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0319c6a-15f6-4429-bc0e-ded22e5ab079 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:53.942237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0319c6a-15f6-4429-bc0e-ded22e5ab079 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:53.947870 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2393/4798] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:45:53 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:53.948716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e0ee2-35be-43c8-ab41-97694bce3678 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:53.951428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:53.952086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:53.952378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:53.952662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains/cbdefea922444237b294bb1fa87b8bff` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:53.953923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=cbdefea922444237b294bb1fa87b8bff)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:53.956264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:53.997670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'cbdefea922444237b294bb1fa87b8bff'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:54.019036 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'cbdefea922444237b294bb1fa87b8bff'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:54.081681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e0ee2-35be-43c8-ab41-97694bce3678 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:54.112886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4fb85-d5bb-4bc4-bcfc-3b01fb1d1a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:54.114874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4fb85-d5bb-4bc4-bcfc-3b01fb1d1a03 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:54.117566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4fb85-d5bb-4bc4-bcfc-3b01fb1d1a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:54.118119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4fb85-d5bb-4bc4-bcfc-3b01fb1d1a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:54.118991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4fb85-d5bb-4bc4-bcfc-3b01fb1d1a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:54.126889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4fb85-d5bb-4bc4-bcfc-3b01fb1d1a03 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:54.166079 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2394/4799] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:54.167582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4fb85-d5bb-4bc4-bcfc-3b01fb1d1a03 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:54.172970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbdefea922444237b294bb1fa87b8bff', 'request_id': 'req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:54.183358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbdefea922444237b294bb1fa87b8bff', 'request_id': 'req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:54.185408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4fb85-d5bb-4bc4-bcfc-3b01fb1d1a03 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:54.192403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbdefea922444237b294bb1fa87b8bff', 'request_id': 'req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:54.265962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:54.272958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] The token cache is being invalidate because project cbdefea922444237b294bb1fa87b8bff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:45:54.273610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:54.274754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:54.291068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'cbdefea922444237b294bb1fa87b8bff', 'request_id': 'req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:54.292728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba3ea0-acbb-46bf-ba4b-733d7ea03aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:54.293267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'cbdefea922444237b294bb1fa87b8bff', 'request_id': 'req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:54.295037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba3ea0-acbb-46bf-ba4b-733d7ea03aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:54.295433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba3ea0-acbb-46bf-ba4b-733d7ea03aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:54.295913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'cbdefea922444237b294bb1fa87b8bff', 'request_id': 'req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:54.296310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba3ea0-acbb-46bf-ba4b-733d7ea03aa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:54.298734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba3ea0-acbb-46bf-ba4b-733d7ea03aa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:54.302584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba3ea0-acbb-46bf-ba4b-733d7ea03aa4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:54.321273 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2406/4800] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:45:53 2022] DELETE /identity/v3/domains/cbdefea922444237b294bb1fa87b8bff => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:54.325269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:54.328531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:54.355177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4bed0-00a8-422b-bfde-1c48eac3b7b2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:54.361971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d266a-a41a-46cb-88bb-b508a8862dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:54.362444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d266a-a41a-46cb-88bb-b508a8862dad admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:54.362758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d266a-a41a-46cb-88bb-b508a8862dad admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:54.363021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d266a-a41a-46cb-88bb-b508a8862dad admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:54.364205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d266a-a41a-46cb-88bb-b508a8862dad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:54.365961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d266a-a41a-46cb-88bb-b508a8862dad admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:54.410461 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2395/4801] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:45:54 2022] POST /identity/v3/projects => generated 401 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:54.412658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba3ea0-acbb-46bf-ba4b-733d7ea03aa4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:54.417133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-10ba3ea0-acbb-46bf-ba4b-733d7ea03aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:54.503587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba3ea0-acbb-46bf-ba4b-733d7ea03aa4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:54.510214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcc85a-d33c-43e1-bb7d-a5d39ebb382c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:54.510331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcc85a-d33c-43e1-bb7d-a5d39ebb382c admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:54.510688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcc85a-d33c-43e1-bb7d-a5d39ebb382c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:54.511005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcc85a-d33c-43e1-bb7d-a5d39ebb382c admin admin] PATH_INFO: `/v3/projects/f0f9a18bae864fcfade2f95432cf15aa/users/2aa87226d8fd4e428b0fc09dbee3b4bc/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:54.521208 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2407/4802] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:45:54 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:54.522385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d266a-a41a-46cb-88bb-b508a8862dad admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:54.524390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-412d266a-a41a-46cb-88bb-b508a8862dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:54.529124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efcc85a-d33c-43e1-bb7d-a5d39ebb382c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f9a18bae864fcfade2f95432cf15aa, user_id=2aa87226d8fd4e428b0fc09dbee3b4bc, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:54.533474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efcc85a-d33c-43e1-bb7d-a5d39ebb382c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:54.552035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:54.609006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d266a-a41a-46cb-88bb-b508a8862dad admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:54.624871 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2396/4803] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:54 2022] PUT /identity/v3/projects/f0f9a18bae864fcfade2f95432cf15aa/users/2aa87226d8fd4e428b0fc09dbee3b4bc/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:54.625852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcc85a-d33c-43e1-bb7d-a5d39ebb382c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:54.631682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6efcc85a-d33c-43e1-bb7d-a5d39ebb382c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:54.704062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d12ab2-8a90-4f0a-b47f-38c834c22ab6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:54.705494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d12ab2-8a90-4f0a-b47f-38c834c22ab6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:54.707295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d12ab2-8a90-4f0a-b47f-38c834c22ab6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:54.707888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d12ab2-8a90-4f0a-b47f-38c834c22ab6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:54.708841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d12ab2-8a90-4f0a-b47f-38c834c22ab6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:54.710843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d12ab2-8a90-4f0a-b47f-38c834c22ab6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:54.742386 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2408/4804] 10.222.0.20 () {58 vars in 1128 bytes} [Thu Oct 27 03:45:54 2022] GET /identity/v3/domains => generated 1346 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:54.743621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d12ab2-8a90-4f0a-b47f-38c834c22ab6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:54.745638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcc85a-d33c-43e1-bb7d-a5d39ebb382c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:54.758490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc327d-f58a-444e-a7c5-3af4b5c95146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:54.759430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc327d-f58a-444e-a7c5-3af4b5c95146 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:54.759727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc327d-f58a-444e-a7c5-3af4b5c95146 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:54.760001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc327d-f58a-444e-a7c5-3af4b5c95146 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:54.760708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc327d-f58a-444e-a7c5-3af4b5c95146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:54.762717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc327d-f58a-444e-a7c5-3af4b5c95146 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:54.768695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d12ab2-8a90-4f0a-b47f-38c834c22ab6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:54.778981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a55bd-d4d0-4eca-b41c-8827614a64f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:54.779755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a55bd-d4d0-4eca-b41c-8827614a64f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:54.780243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a55bd-d4d0-4eca-b41c-8827614a64f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:54.790199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a55bd-d4d0-4eca-b41c-8827614a64f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:54.791266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a55bd-d4d0-4eca-b41c-8827614a64f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:54.796502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a55bd-d4d0-4eca-b41c-8827614a64f2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:54.833042 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2409/4805] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:54.833042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8deacb-44a2-47ca-b144-ddad5562bdaf None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:54.833042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8deacb-44a2-47ca-b144-ddad5562bdaf None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:54.833042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8deacb-44a2-47ca-b144-ddad5562bdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:54.857337 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2397/4806] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:45:54 2022] POST /identity/v3/users => generated 301 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:54.858389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc327d-f58a-444e-a7c5-3af4b5c95146 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:54.881016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ac8deacb-44a2-47ca-b144-ddad5562bdaf None None] MFA Rules not processed for user `2aa87226d8fd4e428b0fc09dbee3b4bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:54.886373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ac8deacb-44a2-47ca-b144-ddad5562bdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:55.013621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc327d-f58a-444e-a7c5-3af4b5c95146 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:55.026011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68facf0d-a217-4478-9476-62c5f64ed700 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:55.026848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68facf0d-a217-4478-9476-62c5f64ed700 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:55.028518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68facf0d-a217-4478-9476-62c5f64ed700 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:55.028906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68facf0d-a217-4478-9476-62c5f64ed700 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains/cbdefea922444237b294bb1fa87b8bff` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:55.038351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68facf0d-a217-4478-9476-62c5f64ed700 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:45:55.043686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-68facf0d-a217-4478-9476-62c5f64ed700 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Could not find domain: cbdefea922444237b294bb1fa87b8bff.: keystone.exception.DomainNotFound: Could not find domain: cbdefea922444237b294bb1fa87b8bff. Oct 27 03:45:55.043686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:45:55.043686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 27 03:45:55.043686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 27 03:45:55.043686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:45:55.043686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:45:55.043686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:45:55.043686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:45:55.043686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: cbdefea922444237b294bb1fa87b8bff. Oct 27 03:45:55.043686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:45:55.043686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:45:55.043686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:45:55.043686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:45:55.043686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:45:55.043686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:45:55.043686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:45:55.045222 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:45:55.045222 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:45:55.045222 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:45:55.045222 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:45:55.045222 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:45:55.045222 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:45:55.045222 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:45:55.045222 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 27 03:45:55.045222 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 27 03:45:55.045222 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:45:55.045222 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:45:55.045222 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:45:55.045222 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:45:55.045222 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:45:55.045222 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:45:55.045222 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:45:55.046367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:45:55.046367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:45:55.046367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:45:55.046367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:45:55.046367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:45:55.046367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:45:55.046367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:45:55.046367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:45:55.046367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:45:55.046367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:45:55.046367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:45:55.046367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:45:55.046367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:45:55.046367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 27 03:45:55.046367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:45:55.046367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: cbdefea922444237b294bb1fa87b8bff. Oct 27 03:45:55.046367 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:45:55.050968 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2398/4807] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:45:54 2022] PATCH /identity/v3/domains/cbdefea922444237b294bb1fa87b8bff => generated 112 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:45:55.053661 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2410/4808] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:54 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:55.054153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:55.054258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8deacb-44a2-47ca-b144-ddad5562bdaf None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:55.056556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68facf0d-a217-4478-9476-62c5f64ed700 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:55.065061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8deacb-44a2-47ca-b144-ddad5562bdaf None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:55.070339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554864f9-b410-4f83-b4ab-3719285384ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:55.071420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554864f9-b410-4f83-b4ab-3719285384ff admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:55.071561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554864f9-b410-4f83-b4ab-3719285384ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:55.071863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554864f9-b410-4f83-b4ab-3719285384ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:55.072651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554864f9-b410-4f83-b4ab-3719285384ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:55.074401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554864f9-b410-4f83-b4ab-3719285384ff admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:55.077289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68facf0d-a217-4478-9476-62c5f64ed700 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:55.087649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e51b4a-8afd-4015-8505-a25d20e033ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:55.089819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e51b4a-8afd-4015-8505-a25d20e033ff admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:55.090110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e51b4a-8afd-4015-8505-a25d20e033ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:55.090745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e51b4a-8afd-4015-8505-a25d20e033ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:55.091419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e51b4a-8afd-4015-8505-a25d20e033ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:55.092740 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2411/4809] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:55.094303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554864f9-b410-4f83-b4ab-3719285384ff admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:55.097905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e51b4a-8afd-4015-8505-a25d20e033ff admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:55.111067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:55.112578 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2399/4810] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:55.125332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e51b4a-8afd-4015-8505-a25d20e033ff admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:55.127194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554864f9-b410-4f83-b4ab-3719285384ff admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:55.128141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e51b4a-8afd-4015-8505-a25d20e033ff admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:55.129317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32cf99-55be-4d92-a6a4-a4969a5f6f4e tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:55.130067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32cf99-55be-4d92-a6a4-a4969a5f6f4e tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:55.130435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32cf99-55be-4d92-a6a4-a4969a5f6f4e tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:55.130638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32cf99-55be-4d92-a6a4-a4969a5f6f4e tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:55.132254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73018333-6e58-4111-b5cf-5be873ff1d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:55.133062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73018333-6e58-4111-b5cf-5be873ff1d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:55.133354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73018333-6e58-4111-b5cf-5be873ff1d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:55.133638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73018333-6e58-4111-b5cf-5be873ff1d4d admin admin] PATH_INFO: `/v3/users/2aa87226d8fd4e428b0fc09dbee3b4bc` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:55.134455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32cf99-55be-4d92-a6a4-a4969a5f6f4e tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:55.134852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73018333-6e58-4111-b5cf-5be873ff1d4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aa87226d8fd4e428b0fc09dbee3b4bc)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:55.136242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32cf99-55be-4d92-a6a4-a4969a5f6f4e tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:55.136770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73018333-6e58-4111-b5cf-5be873ff1d4d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:55.215750 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2412/4811] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:45:55 2022] POST /identity/v3/domains => generated 276 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:55.215750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32cf99-55be-4d92-a6a4-a4969a5f6f4e tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:55.323953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32cf99-55be-4d92-a6a4-a4969a5f6f4e tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:55.328862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a8afc-b4ad-47cf-8af4-17f930b85197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:55.330151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a8afc-b4ad-47cf-8af4-17f930b85197 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:55.334769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a8afc-b4ad-47cf-8af4-17f930b85197 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:55.334769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a8afc-b4ad-47cf-8af4-17f930b85197 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:55.334769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a8afc-b4ad-47cf-8af4-17f930b85197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:55.334769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a8afc-b4ad-47cf-8af4-17f930b85197 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:55.348001 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2413/4812] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:55.350188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a8afc-b4ad-47cf-8af4-17f930b85197 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:55.361153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a8afc-b4ad-47cf-8af4-17f930b85197 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:55.367998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aba022-34c2-4342-a5f0-b5583b15a1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:55.368410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aba022-34c2-4342-a5f0-b5583b15a1e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:55.368697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aba022-34c2-4342-a5f0-b5583b15a1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:55.369035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aba022-34c2-4342-a5f0-b5583b15a1e6 admin admin] PATH_INFO: `/v3/projects/185dd630465a4f4593ad6b41f4afff03/users/75183125b92a4976be9d3b7f1b827168/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:55.381162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-73018333-6e58-4111-b5cf-5be873ff1d4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aa87226d8fd4e428b0fc09dbee3b4bc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:55.382327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-73018333-6e58-4111-b5cf-5be873ff1d4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aa87226d8fd4e428b0fc09dbee3b4bc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:55.387018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aba022-34c2-4342-a5f0-b5583b15a1e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=185dd630465a4f4593ad6b41f4afff03, user_id=75183125b92a4976be9d3b7f1b827168, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:55.389688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aba022-34c2-4342-a5f0-b5583b15a1e6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:55.428191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-73018333-6e58-4111-b5cf-5be873ff1d4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aa87226d8fd4e428b0fc09dbee3b4bc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:55.475808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-73018333-6e58-4111-b5cf-5be873ff1d4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aa87226d8fd4e428b0fc09dbee3b4bc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:55.497228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:55.543511 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2414/4813] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:55 2022] PUT /identity/v3/projects/185dd630465a4f4593ad6b41f4afff03/users/75183125b92a4976be9d3b7f1b827168/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:55.544965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aba022-34c2-4342-a5f0-b5583b15a1e6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:55.557425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-46aba022-34c2-4342-a5f0-b5583b15a1e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:55.588940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-73018333-6e58-4111-b5cf-5be873ff1d4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aa87226d8fd4e428b0fc09dbee3b4bc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:55.603391 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2400/4814] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:45:55 2022] DELETE /identity/v3/users/2aa87226d8fd4e428b0fc09dbee3b4bc => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:55.605855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73018333-6e58-4111-b5cf-5be873ff1d4d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:55.608378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-73018333-6e58-4111-b5cf-5be873ff1d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:55.651106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aba022-34c2-4342-a5f0-b5583b15a1e6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:55.740147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73018333-6e58-4111-b5cf-5be873ff1d4d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:55.753808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a5cca-769f-4a49-8989-f0e2345d951d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:55.756937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a5cca-769f-4a49-8989-f0e2345d951d admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:55.757235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a5cca-769f-4a49-8989-f0e2345d951d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:55.757561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a5cca-769f-4a49-8989-f0e2345d951d admin admin] PATH_INFO: `/v3/projects/b95556bbad1a4411b4fee590ade992fa/users/9e197ce88b624971bd05b65cf0f9c782/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:55.781574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654aa4c-51ff-40b7-a8e1-49e87cb98b61 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:55.784588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654aa4c-51ff-40b7-a8e1-49e87cb98b61 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:55.784995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654aa4c-51ff-40b7-a8e1-49e87cb98b61 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:55.785229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a5cca-769f-4a49-8989-f0e2345d951d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95556bbad1a4411b4fee590ade992fa, user_id=9e197ce88b624971bd05b65cf0f9c782, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:55.785752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654aa4c-51ff-40b7-a8e1-49e87cb98b61 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:55.786386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654aa4c-51ff-40b7-a8e1-49e87cb98b61 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:55.788449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654aa4c-51ff-40b7-a8e1-49e87cb98b61 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:55.789425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a5cca-769f-4a49-8989-f0e2345d951d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:55.880599 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2401/4815] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:55 2022] PUT /identity/v3/projects/b95556bbad1a4411b4fee590ade992fa/users/9e197ce88b624971bd05b65cf0f9c782/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:55.882131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf0ac0-10f0-432a-a195-49f1e375dfcb None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:55.882583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf0ac0-10f0-432a-a195-49f1e375dfcb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:55.883823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf0ac0-10f0-432a-a195-49f1e375dfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:55.916904 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2415/4816] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:45:55 2022] POST /identity/v3/users => generated 348 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:55.918311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6f527-56c4-4c10-9580-f53fb98bc754 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:55.918599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6f527-56c4-4c10-9580-f53fb98bc754 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:55.918872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6f527-56c4-4c10-9580-f53fb98bc754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:55.931911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-3cdf0ac0-10f0-432a-a195-49f1e375dfcb None None] MFA Rules not processed for user `75183125b92a4976be9d3b7f1b827168`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:55.933275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3cdf0ac0-10f0-432a-a195-49f1e375dfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:55.961769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4ac6f527-56c4-4c10-9580-f53fb98bc754 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:55.966883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4ac6f527-56c4-4c10-9580-f53fb98bc754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:55.970056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:56.071818 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2402/4817] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:56.073031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a576cb1-40b2-4c57-bfa5-223dd5ff22e3 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:56.073318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a576cb1-40b2-4c57-bfa5-223dd5ff22e3 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:56.073602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a576cb1-40b2-4c57-bfa5-223dd5ff22e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:56.078719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:56.112464 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2416/4818] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:56.113527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6f527-56c4-4c10-9580-f53fb98bc754 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:56.135894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8a576cb1-40b2-4c57-bfa5-223dd5ff22e3 None None] MFA Rules not processed for user `9e197ce88b624971bd05b65cf0f9c782`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:56.137266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8a576cb1-40b2-4c57-bfa5-223dd5ff22e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:56.206715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6f527-56c4-4c10-9580-f53fb98bc754 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:56.215085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cae16a-019b-4aba-8d2b-0af7783e921b tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:56.217134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cae16a-019b-4aba-8d2b-0af7783e921b tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:56.217869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cae16a-019b-4aba-8d2b-0af7783e921b tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:56.220909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cae16a-019b-4aba-8d2b-0af7783e921b tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/groups` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:56.221690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cae16a-019b-4aba-8d2b-0af7783e921b tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:56.222894 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-80cae16a-019b-4aba-8d2b-0af7783e921b tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:45:56.222894 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:45:56.222894 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:45:56.227090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cae16a-019b-4aba-8d2b-0af7783e921b tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:56.279055 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2403/4819] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:56 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:56.285891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a576cb1-40b2-4c57-bfa5-223dd5ff22e3 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:56.285891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8a576cb1-40b2-4c57-bfa5-223dd5ff22e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:56.299954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a576cb1-40b2-4c57-bfa5-223dd5ff22e3 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:56.305196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736f6ad-2a2a-4a09-89ed-40da205c4f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:56.305918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736f6ad-2a2a-4a09-89ed-40da205c4f04 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:56.306318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736f6ad-2a2a-4a09-89ed-40da205c4f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:56.306878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736f6ad-2a2a-4a09-89ed-40da205c4f04 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:56.307645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736f6ad-2a2a-4a09-89ed-40da205c4f04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:56.309860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736f6ad-2a2a-4a09-89ed-40da205c4f04 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:56.363440 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2417/4820] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:45:56 2022] POST /identity/v3/groups => generated 325 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:56.364489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cae16a-019b-4aba-8d2b-0af7783e921b tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:56.370466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-80cae16a-019b-4aba-8d2b-0af7783e921b tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:56.452899 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2404/4821] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:45:56 2022] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:56.454090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736f6ad-2a2a-4a09-89ed-40da205c4f04 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:56.532032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cae16a-019b-4aba-8d2b-0af7783e921b tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:56.561190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736f6ad-2a2a-4a09-89ed-40da205c4f04 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:56.566854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fc429-4f2f-4f04-8cf0-949895bb4b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:56.567496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fc429-4f2f-4f04-8cf0-949895bb4b01 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:56.567778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fc429-4f2f-4f04-8cf0-949895bb4b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:56.569599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fc429-4f2f-4f04-8cf0-949895bb4b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:56.570316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fc429-4f2f-4f04-8cf0-949895bb4b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:56.581234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fc429-4f2f-4f04-8cf0-949895bb4b01 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:56.619885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86050aa4-ee54-4899-90e4-b49a5c4058e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:56.620785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86050aa4-ee54-4899-90e4-b49a5c4058e3 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:56.621236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86050aa4-ee54-4899-90e4-b49a5c4058e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:56.621685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86050aa4-ee54-4899-90e4-b49a5c4058e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:56.633855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86050aa4-ee54-4899-90e4-b49a5c4058e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:56.635922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86050aa4-ee54-4899-90e4-b49a5c4058e3 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:56.647941 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2418/4822] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:45:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:45:56.648741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86050aa4-ee54-4899-90e4-b49a5c4058e3 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:56.725894 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2405/4823] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:45:56 2022] POST /identity/v3/projects => generated 401 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:56.731971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fc429-4f2f-4f04-8cf0-949895bb4b01 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:56.742752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86050aa4-ee54-4899-90e4-b49a5c4058e3 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:56.749809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:56.817214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:56.839864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfd952-ab51-4b11-938b-48e9da4508b6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:56.854809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfd952-ab51-4b11-938b-48e9da4508b6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:56.854809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfd952-ab51-4b11-938b-48e9da4508b6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:56.854809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfd952-ab51-4b11-938b-48e9da4508b6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains/0214d09fe5684e93a1568fe8317294d2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:56.854809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfd952-ab51-4b11-938b-48e9da4508b6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0214d09fe5684e93a1568fe8317294d2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:56.855519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfd952-ab51-4b11-938b-48e9da4508b6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:56.864374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fc429-4f2f-4f04-8cf0-949895bb4b01 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:56.870922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9ac66-ce7a-414e-b866-3a1790311143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:56.872091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9ac66-ce7a-414e-b866-3a1790311143 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:56.872487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9ac66-ce7a-414e-b866-3a1790311143 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:56.872937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9ac66-ce7a-414e-b866-3a1790311143 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:56.873877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9ac66-ce7a-414e-b866-3a1790311143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:56.877360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9ac66-ce7a-414e-b866-3a1790311143 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:56.920716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-81dfd952-ab51-4b11-938b-48e9da4508b6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0214d09fe5684e93a1568fe8317294d2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:56.922000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-81dfd952-ab51-4b11-938b-48e9da4508b6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0214d09fe5684e93a1568fe8317294d2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:56.980838 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2406/4824] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:45:56 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:56.982627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9ac66-ce7a-414e-b866-3a1790311143 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:56.985249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-11d9ac66-ce7a-414e-b866-3a1790311143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:57.004205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9ac66-ce7a-414e-b866-3a1790311143 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:57.061331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-81dfd952-ab51-4b11-938b-48e9da4508b6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0214d09fe5684e93a1568fe8317294d2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:57.062195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-81dfd952-ab51-4b11-938b-48e9da4508b6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0214d09fe5684e93a1568fe8317294d2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:57.070005 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2419/4825] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:45:56 2022] PATCH /identity/v3/domains/0214d09fe5684e93a1568fe8317294d2 => generated 277 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:45:57.071478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfd952-ab51-4b11-938b-48e9da4508b6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:57.074698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-81dfd952-ab51-4b11-938b-48e9da4508b6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:57.099813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314442ea-cfdb-46ef-8223-9a2e3415920c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:57.100750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314442ea-cfdb-46ef-8223-9a2e3415920c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:57.102652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314442ea-cfdb-46ef-8223-9a2e3415920c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:57.103114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314442ea-cfdb-46ef-8223-9a2e3415920c admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:57.103975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314442ea-cfdb-46ef-8223-9a2e3415920c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:57.112451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314442ea-cfdb-46ef-8223-9a2e3415920c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:57.201623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:57.214662 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2407/4826] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:45:56 2022] POST /identity/v3/users => generated 307 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:57.215681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314442ea-cfdb-46ef-8223-9a2e3415920c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:57.242374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-314442ea-cfdb-46ef-8223-9a2e3415920c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:57.250392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfd952-ab51-4b11-938b-48e9da4508b6 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:57.258924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ba046-22e5-450b-b47a-db3ff4e92c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:57.259892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ba046-22e5-450b-b47a-db3ff4e92c97 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:57.260185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ba046-22e5-450b-b47a-db3ff4e92c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:57.260579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ba046-22e5-450b-b47a-db3ff4e92c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:57.261447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ba046-22e5-450b-b47a-db3ff4e92c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:57.264939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ba046-22e5-450b-b47a-db3ff4e92c97 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:57.283073 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2420/4827] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:57.284095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ba046-22e5-450b-b47a-db3ff4e92c97 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:57.286079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-041ba046-22e5-450b-b47a-db3ff4e92c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:57.304810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ba046-22e5-450b-b47a-db3ff4e92c97 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:57.322996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfd5cd-ae98-4db1-8d38-e99d6c7db0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:57.322996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfd5cd-ae98-4db1-8d38-e99d6c7db0df admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:57.322996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfd5cd-ae98-4db1-8d38-e99d6c7db0df admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:57.322996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfd5cd-ae98-4db1-8d38-e99d6c7db0df admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:57.323686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfd5cd-ae98-4db1-8d38-e99d6c7db0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:57.323686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfd5cd-ae98-4db1-8d38-e99d6c7db0df admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:57.341009 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2421/4828] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:57.341961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfd5cd-ae98-4db1-8d38-e99d6c7db0df admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:57.354631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfd5cd-ae98-4db1-8d38-e99d6c7db0df admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:57.361205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49adbfd-9b13-4286-8f5d-a9d55c0e8bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:57.361832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49adbfd-9b13-4286-8f5d-a9d55c0e8bcf admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:57.362201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49adbfd-9b13-4286-8f5d-a9d55c0e8bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:57.362487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49adbfd-9b13-4286-8f5d-a9d55c0e8bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:57.363145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49adbfd-9b13-4286-8f5d-a9d55c0e8bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:57.366646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49adbfd-9b13-4286-8f5d-a9d55c0e8bcf admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:57.381837 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2422/4829] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:57.381837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49adbfd-9b13-4286-8f5d-a9d55c0e8bcf admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:57.387304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314442ea-cfdb-46ef-8223-9a2e3415920c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:57.390579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49adbfd-9b13-4286-8f5d-a9d55c0e8bcf admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:57.397692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d528871-1951-4185-a0d4-0feedfc4849b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:57.398714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d528871-1951-4185-a0d4-0feedfc4849b admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:57.399005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d528871-1951-4185-a0d4-0feedfc4849b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:57.399299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d528871-1951-4185-a0d4-0feedfc4849b admin admin] PATH_INFO: `/v3/projects/12fac4638da842b19095f6bdcdabac5e/users/ebc0c82c28b84ca8908364c34abb0a48/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:57.399634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e053ee1-4420-40fb-b8c9-dde817dba94d tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:57.400299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e053ee1-4420-40fb-b8c9-dde817dba94d tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:57.400592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e053ee1-4420-40fb-b8c9-dde817dba94d tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:57.400877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e053ee1-4420-40fb-b8c9-dde817dba94d tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains/0214d09fe5684e93a1568fe8317294d2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:57.420652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e053ee1-4420-40fb-b8c9-dde817dba94d tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0214d09fe5684e93a1568fe8317294d2)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:57.422764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e053ee1-4420-40fb-b8c9-dde817dba94d tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:57.423034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d528871-1951-4185-a0d4-0feedfc4849b admin admin] RBAC: Authorizing `identity:create_grant(project_id=12fac4638da842b19095f6bdcdabac5e, user_id=ebc0c82c28b84ca8908364c34abb0a48, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:57.426565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d528871-1951-4185-a0d4-0feedfc4849b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:57.450915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6e053ee1-4420-40fb-b8c9-dde817dba94d tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0214d09fe5684e93a1568fe8317294d2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:57.531251 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2423/4830] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:57 2022] PUT /identity/v3/projects/12fac4638da842b19095f6bdcdabac5e/users/ebc0c82c28b84ca8908364c34abb0a48/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:57.533492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d528871-1951-4185-a0d4-0feedfc4849b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:57.600044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d528871-1951-4185-a0d4-0feedfc4849b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:57.604828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124b8ae-5120-4544-a4e6-2c42888321be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:57.605571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124b8ae-5120-4544-a4e6-2c42888321be admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:57.605956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124b8ae-5120-4544-a4e6-2c42888321be admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:57.606287 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124b8ae-5120-4544-a4e6-2c42888321be admin admin] PATH_INFO: `/v3/projects/038f66b7ea334bd7a74cd5b6189450eb/users/49cbc285be1c48419ee58fcc150676b2/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:57.634409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124b8ae-5120-4544-a4e6-2c42888321be admin admin] RBAC: Authorizing `identity:create_grant(project_id=038f66b7ea334bd7a74cd5b6189450eb, user_id=49cbc285be1c48419ee58fcc150676b2, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:57.637288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124b8ae-5120-4544-a4e6-2c42888321be admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:57.645330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:57.738171 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2424/4831] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:57 2022] PUT /identity/v3/projects/038f66b7ea334bd7a74cd5b6189450eb/users/49cbc285be1c48419ee58fcc150676b2/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:57.739365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124b8ae-5120-4544-a4e6-2c42888321be admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:57.748550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5124b8ae-5120-4544-a4e6-2c42888321be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:57.836827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6e053ee1-4420-40fb-b8c9-dde817dba94d tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff87df8d8e6423fb0de0f66a3c4e64f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:57.838212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6e053ee1-4420-40fb-b8c9-dde817dba94d tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff87df8d8e6423fb0de0f66a3c4e64f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:57.854151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6e053ee1-4420-40fb-b8c9-dde817dba94d tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff87df8d8e6423fb0de0f66a3c4e64f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:57.877403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124b8ae-5120-4544-a4e6-2c42888321be admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:57.884645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1699f8e-35ff-422d-be16-fd1329a4663a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:57.885919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1699f8e-35ff-422d-be16-fd1329a4663a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:57.886677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1699f8e-35ff-422d-be16-fd1329a4663a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:57.886990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6e053ee1-4420-40fb-b8c9-dde817dba94d tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff87df8d8e6423fb0de0f66a3c4e64f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:57.887710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1699f8e-35ff-422d-be16-fd1329a4663a admin admin] PATH_INFO: `/v3/projects/f0f9a18bae864fcfade2f95432cf15aa` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:57.890820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1699f8e-35ff-422d-be16-fd1329a4663a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f9a18bae864fcfade2f95432cf15aa)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:57.894131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1699f8e-35ff-422d-be16-fd1329a4663a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:57.976837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6e053ee1-4420-40fb-b8c9-dde817dba94d tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff87df8d8e6423fb0de0f66a3c4e64f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:57.983734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6e053ee1-4420-40fb-b8c9-dde817dba94d tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0214d09fe5684e93a1568fe8317294d2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:58.054947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f1699f8e-35ff-422d-be16-fd1329a4663a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f9a18bae864fcfade2f95432cf15aa', 'request_id': 'req-f1699f8e-35ff-422d-be16-fd1329a4663a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:58.062697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f1699f8e-35ff-422d-be16-fd1329a4663a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f9a18bae864fcfade2f95432cf15aa', 'request_id': 'req-f1699f8e-35ff-422d-be16-fd1329a4663a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:58.070542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f1699f8e-35ff-422d-be16-fd1329a4663a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f9a18bae864fcfade2f95432cf15aa', 'request_id': 'req-f1699f8e-35ff-422d-be16-fd1329a4663a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:58.092389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:58.142701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f1699f8e-35ff-422d-be16-fd1329a4663a admin admin] The token cache is being invalidate because project f0f9a18bae864fcfade2f95432cf15aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:45:58.142936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f1699f8e-35ff-422d-be16-fd1329a4663a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:58.145655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f1699f8e-35ff-422d-be16-fd1329a4663a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:58.146563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6e053ee1-4420-40fb-b8c9-dde817dba94d tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0214d09fe5684e93a1568fe8317294d2', 'request_id': 'req-6e053ee1-4420-40fb-b8c9-dde817dba94d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:58.148058 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2425/4832] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:45:57 2022] DELETE /identity/v3/projects/f0f9a18bae864fcfade2f95432cf15aa => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:58.149016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1699f8e-35ff-422d-be16-fd1329a4663a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:58.153179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f1699f8e-35ff-422d-be16-fd1329a4663a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:58.223202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6e053ee1-4420-40fb-b8c9-dde817dba94d tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0214d09fe5684e93a1568fe8317294d2', 'request_id': 'req-6e053ee1-4420-40fb-b8c9-dde817dba94d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:58.230809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6e053ee1-4420-40fb-b8c9-dde817dba94d tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0214d09fe5684e93a1568fe8317294d2', 'request_id': 'req-6e053ee1-4420-40fb-b8c9-dde817dba94d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:58.237744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1699f8e-35ff-422d-be16-fd1329a4663a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:58.242910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6e053ee1-4420-40fb-b8c9-dde817dba94d tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] The token cache is being invalidate because project 0214d09fe5684e93a1568fe8317294d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:45:58.243480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6e053ee1-4420-40fb-b8c9-dde817dba94d tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:58.244520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6e053ee1-4420-40fb-b8c9-dde817dba94d tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:58.265182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6e053ee1-4420-40fb-b8c9-dde817dba94d tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0214d09fe5684e93a1568fe8317294d2', 'request_id': 'req-6e053ee1-4420-40fb-b8c9-dde817dba94d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:58.266423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6e053ee1-4420-40fb-b8c9-dde817dba94d tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0214d09fe5684e93a1568fe8317294d2', 'request_id': 'req-6e053ee1-4420-40fb-b8c9-dde817dba94d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:58.272918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6e053ee1-4420-40fb-b8c9-dde817dba94d tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0214d09fe5684e93a1568fe8317294d2', 'request_id': 'req-6e053ee1-4420-40fb-b8c9-dde817dba94d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:45:58.296661 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2408/4833] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:45:57 2022] DELETE /identity/v3/domains/0214d09fe5684e93a1568fe8317294d2 => generated 0 bytes in 1078 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:58.296661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faed5cc-e7f8-4708-8b3e-05a607c12c1c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:58.304658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faed5cc-e7f8-4708-8b3e-05a607c12c1c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:58.304962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faed5cc-e7f8-4708-8b3e-05a607c12c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:58.357007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5faed5cc-e7f8-4708-8b3e-05a607c12c1c None None] MFA Rules not processed for user `49cbc285be1c48419ee58fcc150676b2`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:58.360653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5faed5cc-e7f8-4708-8b3e-05a607c12c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:58.368928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8abad1-d2b0-4485-ac34-85051caf7ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:58.369611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8abad1-d2b0-4485-ac34-85051caf7ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:58.369838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8abad1-d2b0-4485-ac34-85051caf7ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:58.370144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8abad1-d2b0-4485-ac34-85051caf7ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:58.370803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8abad1-d2b0-4485-ac34-85051caf7ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:58.372422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8abad1-d2b0-4485-ac34-85051caf7ce6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:58.394843 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2426/4834] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:58.396813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b33d3e-ff39-425c-9ea8-f6a99f9fbb54 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:58.396813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b33d3e-ff39-425c-9ea8-f6a99f9fbb54 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:58.396813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b33d3e-ff39-425c-9ea8-f6a99f9fbb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:58.444159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-79b33d3e-ff39-425c-9ea8-f6a99f9fbb54 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:58.445378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-79b33d3e-ff39-425c-9ea8-f6a99f9fbb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:58.461331 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2409/4835] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:58.461331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faed5cc-e7f8-4708-8b3e-05a607c12c1c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:58.462908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5faed5cc-e7f8-4708-8b3e-05a607c12c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:58.470956 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2427/4836] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:58.470956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b33d3e-ff39-425c-9ea8-f6a99f9fbb54 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:58.474021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-79b33d3e-ff39-425c-9ea8-f6a99f9fbb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:58.498401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b33d3e-ff39-425c-9ea8-f6a99f9fbb54 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:58.505338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d53c26-b81d-489b-b748-5e36ba538fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:58.506282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d53c26-b81d-489b-b748-5e36ba538fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:58.506567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d53c26-b81d-489b-b748-5e36ba538fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:58.509113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d53c26-b81d-489b-b748-5e36ba538fbf admin admin] PATH_INFO: `/v3/projects/12fac4638da842b19095f6bdcdabac5e/users/ebc0c82c28b84ca8908364c34abb0a48/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:58.509357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d53c26-b81d-489b-b748-5e36ba538fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=12fac4638da842b19095f6bdcdabac5e, user_id=ebc0c82c28b84ca8908364c34abb0a48, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:58.513691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d53c26-b81d-489b-b748-5e36ba538fbf admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:58.533699 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2428/4837] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:58 2022] PUT /identity/v3/projects/12fac4638da842b19095f6bdcdabac5e/users/ebc0c82c28b84ca8908364c34abb0a48/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:58.543206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d53c26-b81d-489b-b748-5e36ba538fbf admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:58.546519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-46d53c26-b81d-489b-b748-5e36ba538fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:58.579958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faed5cc-e7f8-4708-8b3e-05a607c12c1c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:58.618517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d53c26-b81d-489b-b748-5e36ba538fbf admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:58.625401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caff589-761c-4113-94a3-1b3b95da0834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:58.626252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caff589-761c-4113-94a3-1b3b95da0834 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:58.626541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caff589-761c-4113-94a3-1b3b95da0834 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:58.626819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caff589-761c-4113-94a3-1b3b95da0834 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:58.627466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caff589-761c-4113-94a3-1b3b95da0834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:58.629664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caff589-761c-4113-94a3-1b3b95da0834 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:58.650028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff89ade-e689-4259-9a4f-fe5c2c2fb263 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:58.650634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff89ade-e689-4259-9a4f-fe5c2c2fb263 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:58.650934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff89ade-e689-4259-9a4f-fe5c2c2fb263 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:58.651209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff89ade-e689-4259-9a4f-fe5c2c2fb263 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains/0214d09fe5684e93a1568fe8317294d2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:58.659337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff89ade-e689-4259-9a4f-fe5c2c2fb263 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=0214d09fe5684e93a1568fe8317294d2)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:58.661244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff89ade-e689-4259-9a4f-fe5c2c2fb263 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:58.666434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:58.675961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-bff89ade-e689-4259-9a4f-fe5c2c2fb263 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Could not find domain: 0214d09fe5684e93a1568fe8317294d2.: keystone.exception.DomainNotFound: Could not find domain: 0214d09fe5684e93a1568fe8317294d2. Oct 27 03:45:58.675961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:45:58.675961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 27 03:45:58.675961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 27 03:45:58.675961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:45:58.675961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:45:58.675961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:45:58.675961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:45:58.675961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0214d09fe5684e93a1568fe8317294d2. Oct 27 03:45:58.675961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:45:58.675961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:45:58.675961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:45:58.675961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:45:58.675961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:45:58.675961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:45:58.675961 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:45:58.677291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:45:58.677291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:45:58.677291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:45:58.677291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:45:58.677291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:45:58.677291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:45:58.677291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:45:58.677291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 03:45:58.677291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 03:45:58.677291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 03:45:58.677291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 03:45:58.677291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:45:58.677291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:45:58.677291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:45:58.677291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:45:58.677291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:45:58.677291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:45:58.678867 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:45:58.678867 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:45:58.678867 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:45:58.678867 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:45:58.678867 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:45:58.678867 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:45:58.678867 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:45:58.678867 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:45:58.678867 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:45:58.678867 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:45:58.678867 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 27 03:45:58.678867 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:45:58.678867 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0214d09fe5684e93a1568fe8317294d2. Oct 27 03:45:58.678867 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:45:58.678867 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2410/4838] 10.222.0.20 () {58 vars in 1227 bytes} [Thu Oct 27 03:45:58 2022] GET /identity/v3/domains/0214d09fe5684e93a1568fe8317294d2 => generated 112 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:45:58.679870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731d348-2af6-4ff6-8d65-0b5508261bf6 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:58.679870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731d348-2af6-4ff6-8d65-0b5508261bf6 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:58.679870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731d348-2af6-4ff6-8d65-0b5508261bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:58.701955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8731d348-2af6-4ff6-8d65-0b5508261bf6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:58.704455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8731d348-2af6-4ff6-8d65-0b5508261bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:58.715811 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2411/4839] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:58.715811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763d184-3f6b-4e28-a9cb-063993c849bc None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:58.715811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763d184-3f6b-4e28-a9cb-063993c849bc None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:58.715811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763d184-3f6b-4e28-a9cb-063993c849bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:58.732677 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2429/4840] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:45:58 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:58.733614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caff589-761c-4113-94a3-1b3b95da0834 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:58.752881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e763d184-3f6b-4e28-a9cb-063993c849bc None None] MFA Rules not processed for user `ebc0c82c28b84ca8908364c34abb0a48`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:45:58.754856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e763d184-3f6b-4e28-a9cb-063993c849bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:58.830657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caff589-761c-4113-94a3-1b3b95da0834 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:58.838763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30bdc4-f100-41be-88ab-90af264b3d3c tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:58.841057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30bdc4-f100-41be-88ab-90af264b3d3c tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:58.841057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30bdc4-f100-41be-88ab-90af264b3d3c tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:58.842109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30bdc4-f100-41be-88ab-90af264b3d3c tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/users/8ff87df8d8e6423fb0de0f66a3c4e64f` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:58.853188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30bdc4-f100-41be-88ab-90af264b3d3c tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:get_user(user_id=8ff87df8d8e6423fb0de0f66a3c4e64f)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:58.855469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30bdc4-f100-41be-88ab-90af264b3d3c tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:58.874480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-fa30bdc4-f100-41be-88ab-90af264b3d3c tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Could not find user: 8ff87df8d8e6423fb0de0f66a3c4e64f.: keystone.exception.UserNotFound: Could not find user: 8ff87df8d8e6423fb0de0f66a3c4e64f. Oct 27 03:45:58.874480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:45:58.874480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:45:58.874480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:45:58.874480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:45:58.874480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:45:58.874480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:45:58.874480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:45:58.874480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:45:58.874480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:45:58.874480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:45:58.874480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:45:58.874480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 03:45:58.874480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 03:45:58.874480 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 03:45:58.876776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 03:45:58.876776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:45:58.876776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:45:58.876776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:45:58.876776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:45:58.876776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:45:58.876776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:45:58.876776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:45:58.876776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:45:58.876776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:45:58.876776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:45:58.876776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:45:58.876776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:45:58.876776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:45:58.876776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:45:58.876776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:45:58.876776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:45:58.877923 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:45:58.877923 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:45:58.877923 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:45:58.877923 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:45:58.877923 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:45:58.877923 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:45:58.877923 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:45:58.877923 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:45:58.877923 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:45:58.877923 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:45:58.877923 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 8ff87df8d8e6423fb0de0f66a3c4e64f. Oct 27 03:45:58.877923 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:45:58.880738 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2430/4841] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 03:45:58 2022] GET /identity/v3/users/8ff87df8d8e6423fb0de0f66a3c4e64f => generated 110 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:45:58.881662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30bdc4-f100-41be-88ab-90af264b3d3c tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:58.890909 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2412/4842] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:45:58 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:45:58.897930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763d184-3f6b-4e28-a9cb-063993c849bc None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:58.962950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30bdc4-f100-41be-88ab-90af264b3d3c tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:58.968574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848d3b9-4665-402b-b2a1-e1b3f333c730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:58.969206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848d3b9-4665-402b-b2a1-e1b3f333c730 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:58.969491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848d3b9-4665-402b-b2a1-e1b3f333c730 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:58.970490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848d3b9-4665-402b-b2a1-e1b3f333c730 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:58.971159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848d3b9-4665-402b-b2a1-e1b3f333c730 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:45:58.971470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848d3b9-4665-402b-b2a1-e1b3f333c730 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:58.973401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848d3b9-4665-402b-b2a1-e1b3f333c730 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:58.990929 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2431/4843] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:45:58.990929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848d3b9-4665-402b-b2a1-e1b3f333c730 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:58.993461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763d184-3f6b-4e28-a9cb-063993c849bc None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:58.999363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a5f20-ddb4-4754-93b7-b0ce076ddd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:59.000299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a5f20-ddb4-4754-93b7-b0ce076ddd38 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:59.000579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a5f20-ddb4-4754-93b7-b0ce076ddd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:59.000967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a5f20-ddb4-4754-93b7-b0ce076ddd38 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:59.002277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a5f20-ddb4-4754-93b7-b0ce076ddd38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:59.007035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848d3b9-4665-402b-b2a1-e1b3f333c730 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:59.007174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a5f20-ddb4-4754-93b7-b0ce076ddd38 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:59.009337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef5556-05fc-4699-9f04-cdb3000fc6b5 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:59.010416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef5556-05fc-4699-9f04-cdb3000fc6b5 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:59.010664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef5556-05fc-4699-9f04-cdb3000fc6b5 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:59.011014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef5556-05fc-4699-9f04-cdb3000fc6b5 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/groups/ec46ccb60bdc4505823568810c564fce` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:59.019535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef5556-05fc-4699-9f04-cdb3000fc6b5 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:get_group(group_id=ec46ccb60bdc4505823568810c564fce)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:59.021563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef5556-05fc-4699-9f04-cdb3000fc6b5 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:59.045283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-74ef5556-05fc-4699-9f04-cdb3000fc6b5 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Could not find group: ec46ccb60bdc4505823568810c564fce.: keystone.exception.GroupNotFound: Could not find group: ec46ccb60bdc4505823568810c564fce. Oct 27 03:45:59.045283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:45:59.045283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:45:59.045283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:45:59.045283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:45:59.045283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:45:59.045283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:45:59.045283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:45:59.045283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:45:59.045283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:45:59.045283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:45:59.045283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:45:59.045283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Oct 27 03:45:59.045283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_group(group_id) Oct 27 03:45:59.045283 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Oct 27 03:45:59.046523 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Oct 27 03:45:59.046523 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:45:59.046523 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:45:59.046523 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:45:59.046523 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:45:59.046523 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:45:59.046523 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:45:59.046523 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:45:59.046523 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:45:59.046523 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:45:59.046523 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:45:59.046523 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:45:59.046523 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:45:59.046523 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:45:59.046523 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:45:59.046523 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:45:59.046523 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:45:59.047750 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:45:59.047750 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:45:59.047750 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:45:59.047750 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:45:59.047750 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 27 03:45:59.047750 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 27 03:45:59.047750 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 27 03:45:59.047750 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 27 03:45:59.047750 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 27 03:45:59.047750 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 27 03:45:59.047750 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: ec46ccb60bdc4505823568810c564fce. Oct 27 03:45:59.047750 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:45:59.050455 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2432/4844] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:45:58 2022] GET /identity/v3/groups/ec46ccb60bdc4505823568810c564fce => generated 111 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:45:59.051454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef5556-05fc-4699-9f04-cdb3000fc6b5 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:59.053328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-74ef5556-05fc-4699-9f04-cdb3000fc6b5 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:59.107315 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2413/4845] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:45:58 2022] POST /identity/v3/users => generated 295 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:59.107315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a5f20-ddb4-4754-93b7-b0ce076ddd38 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:59.118328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a5f20-ddb4-4754-93b7-b0ce076ddd38 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:59.123579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a0131-4121-48d8-8d53-6abf60330420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:59.124389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a0131-4121-48d8-8d53-6abf60330420 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:59.124776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a0131-4121-48d8-8d53-6abf60330420 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:59.125151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a0131-4121-48d8-8d53-6abf60330420 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:59.125895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a0131-4121-48d8-8d53-6abf60330420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:59.128792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a0131-4121-48d8-8d53-6abf60330420 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:59.131876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef5556-05fc-4699-9f04-cdb3000fc6b5 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:59.136721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c079e8-00bb-4eeb-8f1d-e6f090081417 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:59.137923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c079e8-00bb-4eeb-8f1d-e6f090081417 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:59.138683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c079e8-00bb-4eeb-8f1d-e6f090081417 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:59.139161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c079e8-00bb-4eeb-8f1d-e6f090081417 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:59.151777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c079e8-00bb-4eeb-8f1d-e6f090081417 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:59.153274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c079e8-00bb-4eeb-8f1d-e6f090081417 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:59.163327 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2433/4846] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:45:59 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:45:59.164145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c079e8-00bb-4eeb-8f1d-e6f090081417 service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:59.174466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c079e8-00bb-4eeb-8f1d-e6f090081417 service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:59.179277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bd7ec-4c43-477f-8170-ee8eca5f48b3 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:59.183934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bd7ec-4c43-477f-8170-ee8eca5f48b3 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:59.183934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bd7ec-4c43-477f-8170-ee8eca5f48b3 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:59.183934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bd7ec-4c43-477f-8170-ee8eca5f48b3 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/groups/ec46ccb60bdc4505823568810c564fce` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:59.189997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bd7ec-4c43-477f-8170-ee8eca5f48b3 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:45:59.195883 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-265bd7ec-4c43-477f-8170-ee8eca5f48b3 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Could not find group: ec46ccb60bdc4505823568810c564fce.: keystone.exception.GroupNotFound: Could not find group: ec46ccb60bdc4505823568810c564fce. Oct 27 03:45:59.195883 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:45:59.195883 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:45:59.195883 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:45:59.195883 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:45:59.195883 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:45:59.195883 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:45:59.195883 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:45:59.195883 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:45:59.195883 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:45:59.195883 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:45:59.195883 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:45:59.195883 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Oct 27 03:45:59.195883 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Oct 27 03:45:59.197077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:45:59.197077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:45:59.197077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:45:59.197077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:45:59.197077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:45:59.197077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:45:59.197077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:45:59.197077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:45:59.197077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:45:59.197077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:45:59.197077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:45:59.197077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:45:59.197077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:45:59.197077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:45:59.197077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:45:59.197077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:45:59.197077 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:45:59.198397 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:45:59.198397 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:45:59.198397 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:45:59.198397 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:45:59.198397 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:45:59.198397 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:45:59.198397 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:45:59.198397 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 27 03:45:59.198397 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 27 03:45:59.198397 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 27 03:45:59.198397 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 27 03:45:59.198397 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 27 03:45:59.198397 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 27 03:45:59.198397 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: ec46ccb60bdc4505823568810c564fce. Oct 27 03:45:59.198397 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:45:59.198397 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2434/4847] 10.222.0.20 () {58 vars in 1227 bytes} [Thu Oct 27 03:45:59 2022] DELETE /identity/v3/groups/ec46ccb60bdc4505823568810c564fce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:45:59.199450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bd7ec-4c43-477f-8170-ee8eca5f48b3 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:59.214198 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2414/4848] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:45:59 2022] POST /identity/v3/projects => generated 361 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:59.215285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bd7ec-4c43-477f-8170-ee8eca5f48b3 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:59.216579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a0131-4121-48d8-8d53-6abf60330420 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:59.287523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:59.325422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fac88f-fa30-485b-88a8-759fad87117e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:59.327091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fac88f-fa30-485b-88a8-759fad87117e admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:59.327573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fac88f-fa30-485b-88a8-759fad87117e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:59.327953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fac88f-fa30-485b-88a8-759fad87117e admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:59.329701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fac88f-fa30-485b-88a8-759fad87117e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:59.331638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fac88f-fa30-485b-88a8-759fad87117e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:59.347558 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2435/4849] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:45:59.348667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fac88f-fa30-485b-88a8-759fad87117e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:59.374475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fac88f-fa30-485b-88a8-759fad87117e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:59.379216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a0131-4121-48d8-8d53-6abf60330420 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:59.400905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb643e-a033-4417-92c1-a2f0e58caac2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:59.401578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb643e-a033-4417-92c1-a2f0e58caac2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:59.401865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb643e-a033-4417-92c1-a2f0e58caac2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:59.404267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb643e-a033-4417-92c1-a2f0e58caac2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/users/8ff87df8d8e6423fb0de0f66a3c4e64f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:59.409363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388caba-f51a-4d2d-a150-084021c8d6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:59.410237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388caba-f51a-4d2d-a150-084021c8d6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:59.412189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388caba-f51a-4d2d-a150-084021c8d6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:59.412719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388caba-f51a-4d2d-a150-084021c8d6b0 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:59.413968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388caba-f51a-4d2d-a150-084021c8d6b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:59.417787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388caba-f51a-4d2d-a150-084021c8d6b0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:59.421341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb643e-a033-4417-92c1-a2f0e58caac2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8ff87df8d8e6423fb0de0f66a3c4e64f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:59.428200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb643e-a033-4417-92c1-a2f0e58caac2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:59.458775 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-1cfb643e-a033-4417-92c1-a2f0e58caac2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Could not find user: 8ff87df8d8e6423fb0de0f66a3c4e64f.: keystone.exception.UserNotFound: Could not find user: 8ff87df8d8e6423fb0de0f66a3c4e64f. Oct 27 03:45:59.458775 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:45:59.458775 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:45:59.458775 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:45:59.458775 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:45:59.458775 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:45:59.458775 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:45:59.458775 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:45:59.458775 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:45:59.458775 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:45:59.458775 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:45:59.458775 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:45:59.458775 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Oct 27 03:45:59.458775 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Oct 27 03:45:59.460057 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:45:59.460057 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:45:59.460057 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:45:59.460057 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:45:59.460057 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:45:59.460057 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:45:59.460057 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Oct 27 03:45:59.460057 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Oct 27 03:45:59.460057 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:45:59.460057 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:45:59.460057 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:45:59.460057 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:45:59.460057 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 03:45:59.460057 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:45:59.460057 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:45:59.460057 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:45:59.460057 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:45:59.460057 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:45:59.461478 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:45:59.461478 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:45:59.461478 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:45:59.461478 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:45:59.461478 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:45:59.461478 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:45:59.461478 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:45:59.461478 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:45:59.461478 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:45:59.461478 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:45:59.461478 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 03:45:59.461478 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 03:45:59.461478 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 03:45:59.461478 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 03:45:59.461478 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 03:45:59.461478 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 03:45:59.461478 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 8ff87df8d8e6423fb0de0f66a3c4e64f. Oct 27 03:45:59.461478 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:45:59.465947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:59.470720 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2415/4850] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:45:59 2022] DELETE /identity/v3/users/8ff87df8d8e6423fb0de0f66a3c4e64f => generated 110 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:45:59.471867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb643e-a033-4417-92c1-a2f0e58caac2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:59.493398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb643e-a033-4417-92c1-a2f0e58caac2 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:59.502681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0460e-5a48-453c-abcf-ea234f4c06bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:59.503408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0460e-5a48-453c-abcf-ea234f4c06bf admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:59.503692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0460e-5a48-453c-abcf-ea234f4c06bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:59.503967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0460e-5a48-453c-abcf-ea234f4c06bf admin admin] PATH_INFO: `/v3/projects/84568aa78d26412280d9578523d1ca5e/users/2b321c4a7d144f4ebeb4eb58f8313f33/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:59.525977 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2436/4851] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:45:59 2022] POST /identity/v3/users => generated 281 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:45:59.527115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388caba-f51a-4d2d-a150-084021c8d6b0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:59.534910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0460e-5a48-453c-abcf-ea234f4c06bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=84568aa78d26412280d9578523d1ca5e, user_id=2b321c4a7d144f4ebeb4eb58f8313f33, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:59.538795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0460e-5a48-453c-abcf-ea234f4c06bf admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:59.640185 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2416/4852] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:45:59 2022] PUT /identity/v3/projects/84568aa78d26412280d9578523d1ca5e/users/2b321c4a7d144f4ebeb4eb58f8313f33/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:45:59.647063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0460e-5a48-453c-abcf-ea234f4c06bf admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:59.685544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388caba-f51a-4d2d-a150-084021c8d6b0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:59.797602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aadb1f-0ff3-4562-bd0c-2db856d7ce8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:59.799158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aadb1f-0ff3-4562-bd0c-2db856d7ce8a service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:59.799639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aadb1f-0ff3-4562-bd0c-2db856d7ce8a service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:59.800071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aadb1f-0ff3-4562-bd0c-2db856d7ce8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:59.802323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-54aadb1f-0ff3-4562-bd0c-2db856d7ce8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:45:59.846912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0460e-5a48-453c-abcf-ea234f4c06bf admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:45:59.862264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fafd62-b194-462f-8342-9d331a95cb2a tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:45:59.862935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fafd62-b194-462f-8342-9d331a95cb2a tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:45:59.863224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fafd62-b194-462f-8342-9d331a95cb2a tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:45:59.863506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fafd62-b194-462f-8342-9d331a95cb2a tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains/0214d09fe5684e93a1568fe8317294d2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:45:59.886182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fafd62-b194-462f-8342-9d331a95cb2a tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:45:59.891399 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-92fafd62-b194-462f-8342-9d331a95cb2a tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Could not find domain: 0214d09fe5684e93a1568fe8317294d2.: keystone.exception.DomainNotFound: Could not find domain: 0214d09fe5684e93a1568fe8317294d2. Oct 27 03:45:59.891399 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:45:59.891399 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 27 03:45:59.891399 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 27 03:45:59.891399 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:45:59.891399 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:45:59.891399 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:45:59.891399 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:45:59.891399 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0214d09fe5684e93a1568fe8317294d2. Oct 27 03:45:59.891399 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:45:59.891399 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:45:59.891399 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:45:59.891399 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:45:59.891399 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:45:59.891399 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:45:59.891399 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:45:59.893314 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:45:59.893314 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:45:59.893314 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:45:59.893314 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:45:59.893314 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:45:59.893314 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:45:59.893314 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:45:59.893314 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 27 03:45:59.893314 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 27 03:45:59.893314 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:45:59.893314 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:45:59.893314 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:45:59.893314 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:45:59.893314 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:45:59.893314 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:45:59.893314 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:45:59.895447 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:45:59.895447 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:45:59.895447 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:45:59.895447 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:45:59.895447 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:45:59.895447 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:45:59.895447 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:45:59.895447 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:45:59.895447 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:45:59.895447 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:45:59.895447 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:45:59.895447 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:45:59.895447 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:45:59.895447 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 27 03:45:59.895447 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:45:59.895447 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0214d09fe5684e93a1568fe8317294d2. Oct 27 03:45:59.895447 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:45:59.898074 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2417/4853] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:45:59 2022] PATCH /identity/v3/domains/0214d09fe5684e93a1568fe8317294d2 => generated 112 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:45:59.899023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fafd62-b194-462f-8342-9d331a95cb2a tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:59.926345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aadb1f-0ff3-4562-bd0c-2db856d7ce8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:45:59.926345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aadb1f-0ff3-4562-bd0c-2db856d7ce8a service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:45:59.935495 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2437/4854] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:45:59 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:45:59.936520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aadb1f-0ff3-4562-bd0c-2db856d7ce8a service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:45:59.954987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:00.018968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fafd62-b194-462f-8342-9d331a95cb2a tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:00.034939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028353c-4342-486f-803c-8242935743bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:00.035728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028353c-4342-486f-803c-8242935743bc admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:00.036119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028353c-4342-486f-803c-8242935743bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:00.036500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028353c-4342-486f-803c-8242935743bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:00.037336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028353c-4342-486f-803c-8242935743bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:00.049199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:00.049367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028353c-4342-486f-803c-8242935743bc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:00.072623 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2418/4855] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:00.075056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028353c-4342-486f-803c-8242935743bc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:00.083552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aadb1f-0ff3-4562-bd0c-2db856d7ce8a service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:00.098152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9feb593-4f40-4146-b8fe-0392b82a984c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:00.098794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9feb593-4f40-4146-b8fe-0392b82a984c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:00.101134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9feb593-4f40-4146-b8fe-0392b82a984c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:00.101357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9feb593-4f40-4146-b8fe-0392b82a984c admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:00.105211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9feb593-4f40-4146-b8fe-0392b82a984c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:00.107016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9feb593-4f40-4146-b8fe-0392b82a984c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:00.115252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028353c-4342-486f-803c-8242935743bc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:00.136740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229a350-1097-4e9a-814e-10ec363672d8 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:00.137910 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2438/4856] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:00.138823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9feb593-4f40-4146-b8fe-0392b82a984c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:00.143120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229a350-1097-4e9a-814e-10ec363672d8 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:00.143654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229a350-1097-4e9a-814e-10ec363672d8 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:00.146182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229a350-1097-4e9a-814e-10ec363672d8 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:00.147739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229a350-1097-4e9a-814e-10ec363672d8 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:00.151977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229a350-1097-4e9a-814e-10ec363672d8 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:00.158282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9feb593-4f40-4146-b8fe-0392b82a984c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:00.162657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21c0df-56c0-484a-a547-c94321853beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:00.163339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21c0df-56c0-484a-a547-c94321853beb admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:00.163626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21c0df-56c0-484a-a547-c94321853beb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:00.163905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21c0df-56c0-484a-a547-c94321853beb admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:00.164577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21c0df-56c0-484a-a547-c94321853beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:00.166905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21c0df-56c0-484a-a547-c94321853beb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:00.187759 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2439/4857] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:00.189433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21c0df-56c0-484a-a547-c94321853beb admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:00.201400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21c0df-56c0-484a-a547-c94321853beb admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:00.219864 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2419/4858] 10.222.0.20 () {58 vars in 1128 bytes} [Thu Oct 27 03:46:00 2022] GET /identity/v3/domains => generated 1346 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:00.221404 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229a350-1097-4e9a-814e-10ec363672d8 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:00.227526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd07332-69a3-4895-818b-0baca7f0a932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:00.228984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd07332-69a3-4895-818b-0baca7f0a932 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:00.229228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd07332-69a3-4895-818b-0baca7f0a932 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:00.229542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd07332-69a3-4895-818b-0baca7f0a932 admin admin] PATH_INFO: `/v3/projects/84568aa78d26412280d9578523d1ca5e/users/2b321c4a7d144f4ebeb4eb58f8313f33/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:00.234421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd07332-69a3-4895-818b-0baca7f0a932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84568aa78d26412280d9578523d1ca5e, user_id=2b321c4a7d144f4ebeb4eb58f8313f33, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:00.238952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd07332-69a3-4895-818b-0baca7f0a932 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:00.240433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229a350-1097-4e9a-814e-10ec363672d8 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:00.250386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a892ed-5d6a-41a9-b4fd-3ebc3bc2e636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:00.251710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a892ed-5d6a-41a9-b4fd-3ebc3bc2e636 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:00.252073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a892ed-5d6a-41a9-b4fd-3ebc3bc2e636 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:00.252422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a892ed-5d6a-41a9-b4fd-3ebc3bc2e636 admin admin] PATH_INFO: `/v3/projects/f9f134eb355647b38be2a7e4971c7793/users/342fb365711d42d99f0a249ebaa5847a/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:00.255919 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2440/4859] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:00 2022] PUT /identity/v3/projects/84568aa78d26412280d9578523d1ca5e/users/2b321c4a7d144f4ebeb4eb58f8313f33/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:00.257144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd07332-69a3-4895-818b-0baca7f0a932 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:00.282290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a892ed-5d6a-41a9-b4fd-3ebc3bc2e636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9f134eb355647b38be2a7e4971c7793, user_id=342fb365711d42d99f0a249ebaa5847a, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:00.285459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a892ed-5d6a-41a9-b4fd-3ebc3bc2e636 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:00.339681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd07332-69a3-4895-818b-0baca7f0a932 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:00.346085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01f1a7-eef1-44a5-9953-9d10d905246e tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:00.346753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01f1a7-eef1-44a5-9953-9d10d905246e tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:00.347058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01f1a7-eef1-44a5-9953-9d10d905246e tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:00.348352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01f1a7-eef1-44a5-9953-9d10d905246e tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:00.348352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01f1a7-eef1-44a5-9953-9d10d905246e tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:46:00.348951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01f1a7-eef1-44a5-9953-9d10d905246e tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:00.350457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01f1a7-eef1-44a5-9953-9d10d905246e tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:00.379144 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2441/4860] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:46:00 2022] GET /identity/v3/domains?enabled=True => generated 1092 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:00.409698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda05ab-b2ca-4720-84ee-50246cf2d09a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:00.409698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda05ab-b2ca-4720-84ee-50246cf2d09a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:00.409698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda05ab-b2ca-4720-84ee-50246cf2d09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:00.433330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-fdda05ab-b2ca-4720-84ee-50246cf2d09a None None] MFA Rules not processed for user `2b321c4a7d144f4ebeb4eb58f8313f33`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:00.434883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fdda05ab-b2ca-4720-84ee-50246cf2d09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:00.519417 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2442/4861] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:00.525150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda05ab-b2ca-4720-84ee-50246cf2d09a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:00.536958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda05ab-b2ca-4720-84ee-50246cf2d09a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:00.541880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa577912-4dd6-4a18-9e4f-99a662d9acd0 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:00.542659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa577912-4dd6-4a18-9e4f-99a662d9acd0 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:00.543001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa577912-4dd6-4a18-9e4f-99a662d9acd0 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:00.543355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa577912-4dd6-4a18-9e4f-99a662d9acd0 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:00.544309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa577912-4dd6-4a18-9e4f-99a662d9acd0 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-183756496) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:46:00.544941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa577912-4dd6-4a18-9e4f-99a662d9acd0 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:00.546846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa577912-4dd6-4a18-9e4f-99a662d9acd0 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:00.563576 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2443/4862] 10.222.0.20 () {58 vars in 1197 bytes} [Thu Oct 27 03:46:00 2022] GET /identity/v3/domains?name=tempest-test_domain-183756496 => generated 406 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:00.564757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa577912-4dd6-4a18-9e4f-99a662d9acd0 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:00.566673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-aa577912-4dd6-4a18-9e4f-99a662d9acd0 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:00.604916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:00.607632 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2420/4863] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:00 2022] PUT /identity/v3/projects/f9f134eb355647b38be2a7e4971c7793/users/342fb365711d42d99f0a249ebaa5847a/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:00.608550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a892ed-5d6a-41a9-b4fd-3ebc3bc2e636 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:00.652781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa577912-4dd6-4a18-9e4f-99a662d9acd0 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:00.710645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a892ed-5d6a-41a9-b4fd-3ebc3bc2e636 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:00.716664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6c87d-76c7-421f-b71a-3f523e4fb7d8 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:00.717326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6c87d-76c7-421f-b71a-3f523e4fb7d8 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:00.717652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6c87d-76c7-421f-b71a-3f523e4fb7d8 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:00.718844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6c87d-76c7-421f-b71a-3f523e4fb7d8 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains/0214d09fe5684e93a1568fe8317294d2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:00.731132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6c87d-76c7-421f-b71a-3f523e4fb7d8 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:46:00.737052 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-6ed6c87d-76c7-421f-b71a-3f523e4fb7d8 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Could not find domain: 0214d09fe5684e93a1568fe8317294d2.: keystone.exception.DomainNotFound: Could not find domain: 0214d09fe5684e93a1568fe8317294d2. Oct 27 03:46:00.737052 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:46:00.737052 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 27 03:46:00.737052 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 27 03:46:00.737052 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:46:00.737052 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:46:00.737052 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:46:00.737052 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:46:00.737052 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0214d09fe5684e93a1568fe8317294d2. Oct 27 03:46:00.737052 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:00.737052 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:46:00.737052 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:00.737052 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:46:00.737052 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:46:00.737052 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:46:00.737052 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:46:00.738425 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:46:00.738425 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:46:00.738425 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:46:00.738425 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:46:00.738425 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:46:00.738425 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:46:00.738425 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:46:00.738425 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 27 03:46:00.738425 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 27 03:46:00.738425 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:46:00.738425 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:46:00.738425 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:46:00.738425 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:46:00.738425 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:46:00.738425 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:46:00.738425 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:46:00.740051 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:46:00.740051 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:46:00.740051 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:46:00.740051 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:46:00.740051 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:46:00.740051 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:46:00.740051 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:46:00.740051 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:46:00.740051 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:46:00.740051 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:46:00.740051 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:46:00.740051 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:46:00.740051 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:46:00.740051 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 27 03:46:00.740051 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:46:00.740051 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0214d09fe5684e93a1568fe8317294d2. Oct 27 03:46:00.740051 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:00.741981 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2421/4864] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:46:00 2022] PATCH /identity/v3/domains/0214d09fe5684e93a1568fe8317294d2 => generated 112 bytes in 130 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:46:00.741981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e253e-22fa-4967-a41f-c85916283840 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:00.741981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e253e-22fa-4967-a41f-c85916283840 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:00.741981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e253e-22fa-4967-a41f-c85916283840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:00.747293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02067d0-522c-4fb1-a580-910086e9bdae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:00.747954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02067d0-522c-4fb1-a580-910086e9bdae service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:00.748242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02067d0-522c-4fb1-a580-910086e9bdae service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:00.748518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02067d0-522c-4fb1-a580-910086e9bdae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:00.750557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d02067d0-522c-4fb1-a580-910086e9bdae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:00.781195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-626e253e-22fa-4967-a41f-c85916283840 None None] MFA Rules not processed for user `342fb365711d42d99f0a249ebaa5847a`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:00.783265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-626e253e-22fa-4967-a41f-c85916283840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:00.829517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02067d0-522c-4fb1-a580-910086e9bdae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:00.831011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02067d0-522c-4fb1-a580-910086e9bdae service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:00.841112 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2444/4865] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:00.841749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02067d0-522c-4fb1-a580-910086e9bdae service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:00.853022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02067d0-522c-4fb1-a580-910086e9bdae service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:00.858027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1f7ed-f734-4b73-a2b4-2ac911ce466e tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:00.858695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1f7ed-f734-4b73-a2b4-2ac911ce466e tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:00.859037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1f7ed-f734-4b73-a2b4-2ac911ce466e tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:00.859679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1f7ed-f734-4b73-a2b4-2ac911ce466e tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains/dad31fffc8d04690b31988d6a86fd916` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:00.866910 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2422/4866] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:00.881293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1f7ed-f734-4b73-a2b4-2ac911ce466e tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=dad31fffc8d04690b31988d6a86fd916)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:00.884943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1f7ed-f734-4b73-a2b4-2ac911ce466e tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:00.925299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e253e-22fa-4967-a41f-c85916283840 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:00.951093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:00.970991 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2445/4867] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:46:00 2022] PATCH /identity/v3/domains/dad31fffc8d04690b31988d6a86fd916 => generated 278 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:00.979543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1f7ed-f734-4b73-a2b4-2ac911ce466e tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:01.009943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1f7ed-f734-4b73-a2b4-2ac911ce466e tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:01.035551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:01.036216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:01.036503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:01.040793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains/dad31fffc8d04690b31988d6a86fd916` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:01.064731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=dad31fffc8d04690b31988d6a86fd916)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:01.067166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:01.074638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e253e-22fa-4967-a41f-c85916283840 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:01.081614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c03b7-126f-46b9-87c6-ef83875e3b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:01.082909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c03b7-126f-46b9-87c6-ef83875e3b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:01.083346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c03b7-126f-46b9-87c6-ef83875e3b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:01.083872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c03b7-126f-46b9-87c6-ef83875e3b98 admin admin] PATH_INFO: `/v3/users/342fb365711d42d99f0a249ebaa5847a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:01.086080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c03b7-126f-46b9-87c6-ef83875e3b98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=342fb365711d42d99f0a249ebaa5847a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:01.088334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c03b7-126f-46b9-87c6-ef83875e3b98 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:01.117211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'dad31fffc8d04690b31988d6a86fd916'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:01.139827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'dad31fffc8d04690b31988d6a86fd916'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:01.353573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:01.357479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad31fffc8d04690b31988d6a86fd916', 'request_id': 'req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:01.357830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ac9c03b7-126f-46b9-87c6-ef83875e3b98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '342fb365711d42d99f0a249ebaa5847a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:01.358974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ac9c03b7-126f-46b9-87c6-ef83875e3b98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '342fb365711d42d99f0a249ebaa5847a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:01.365673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad31fffc8d04690b31988d6a86fd916', 'request_id': 'req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:01.367670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ac9c03b7-126f-46b9-87c6-ef83875e3b98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '342fb365711d42d99f0a249ebaa5847a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:01.371701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad31fffc8d04690b31988d6a86fd916', 'request_id': 'req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:01.383202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ac9c03b7-126f-46b9-87c6-ef83875e3b98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '342fb365711d42d99f0a249ebaa5847a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:01.445042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] The token cache is being invalidate because project dad31fffc8d04690b31988d6a86fd916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:01.445946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:01.446868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:01.459647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'dad31fffc8d04690b31988d6a86fd916', 'request_id': 'req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:01.460359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'dad31fffc8d04690b31988d6a86fd916', 'request_id': 'req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:01.461246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'dad31fffc8d04690b31988d6a86fd916', 'request_id': 'req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:01.477767 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2446/4868] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:46:00 2022] DELETE /identity/v3/domains/dad31fffc8d04690b31988d6a86fd916 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:01.478759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:01.481250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:01.576555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb8ca5-ba94-4503-8a9f-575d2d63a00f tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:01.581809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413e4b8-9432-456d-9465-508bbaa42766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:01.585707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ac9c03b7-126f-46b9-87c6-ef83875e3b98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '342fb365711d42d99f0a249ebaa5847a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:01.595947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413e4b8-9432-456d-9465-508bbaa42766 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:01.597095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413e4b8-9432-456d-9465-508bbaa42766 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:01.597386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413e4b8-9432-456d-9465-508bbaa42766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:01.598226 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2423/4869] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:00 2022] DELETE /identity/v3/users/342fb365711d42d99f0a249ebaa5847a => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:46:01.599606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8413e4b8-9432-456d-9465-508bbaa42766 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:01.600630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c03b7-126f-46b9-87c6-ef83875e3b98 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:01.602301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ac9c03b7-126f-46b9-87c6-ef83875e3b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:01.748199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c03b7-126f-46b9-87c6-ef83875e3b98 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:01.762561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc34096-bb33-40b1-b9b1-d12878f2b235 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:01.763283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc34096-bb33-40b1-b9b1-d12878f2b235 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:01.763577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc34096-bb33-40b1-b9b1-d12878f2b235 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:01.764062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc34096-bb33-40b1-b9b1-d12878f2b235 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains/2aec21a360b24e8d84fba3fc87d364bc` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:01.790005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc34096-bb33-40b1-b9b1-d12878f2b235 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2aec21a360b24e8d84fba3fc87d364bc)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:01.791914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc34096-bb33-40b1-b9b1-d12878f2b235 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:01.809709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413e4b8-9432-456d-9465-508bbaa42766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:01.811871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413e4b8-9432-456d-9465-508bbaa42766 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:01.844407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3dc34096-bb33-40b1-b9b1-d12878f2b235 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2aec21a360b24e8d84fba3fc87d364bc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:01.845877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3dc34096-bb33-40b1-b9b1-d12878f2b235 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2aec21a360b24e8d84fba3fc87d364bc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:01.852609 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2447/4870] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:01.860936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c7c66-4387-4b8d-b86b-54aa38b84976 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:01.864734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c7c66-4387-4b8d-b86b-54aa38b84976 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:01.865416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c7c66-4387-4b8d-b86b-54aa38b84976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:01.966909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3dc34096-bb33-40b1-b9b1-d12878f2b235 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2aec21a360b24e8d84fba3fc87d364bc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:01.967900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3dc34096-bb33-40b1-b9b1-d12878f2b235 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2aec21a360b24e8d84fba3fc87d364bc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:01.971125 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2424/4871] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:46:01 2022] PATCH /identity/v3/domains/2aec21a360b24e8d84fba3fc87d364bc => generated 276 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:01.972998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a69c7c66-4387-4b8d-b86b-54aa38b84976 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:01.974640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a69c7c66-4387-4b8d-b86b-54aa38b84976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:01.975130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc34096-bb33-40b1-b9b1-d12878f2b235 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:01.976971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3dc34096-bb33-40b1-b9b1-d12878f2b235 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:02.049703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:02.068236 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2448/4872] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:02.123286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c7c66-4387-4b8d-b86b-54aa38b84976 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:02.128937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a69c7c66-4387-4b8d-b86b-54aa38b84976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:02.137014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc34096-bb33-40b1-b9b1-d12878f2b235 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:02.143941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48c720-5d84-44e0-b2c0-05b0d7189657 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:02.144611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48c720-5d84-44e0-b2c0-05b0d7189657 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:02.144883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48c720-5d84-44e0-b2c0-05b0d7189657 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:02.145161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48c720-5d84-44e0-b2c0-05b0d7189657 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains/2aec21a360b24e8d84fba3fc87d364bc` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:02.159195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48c720-5d84-44e0-b2c0-05b0d7189657 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2aec21a360b24e8d84fba3fc87d364bc)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:02.160903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48c720-5d84-44e0-b2c0-05b0d7189657 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:02.190602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ef48c720-5d84-44e0-b2c0-05b0d7189657 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2aec21a360b24e8d84fba3fc87d364bc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:02.201610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ef48c720-5d84-44e0-b2c0-05b0d7189657 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2aec21a360b24e8d84fba3fc87d364bc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:02.271096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c7c66-4387-4b8d-b86b-54aa38b84976 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:02.287152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079de77f-83dc-42b6-aa35-013f7a348caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:02.287895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079de77f-83dc-42b6-aa35-013f7a348caa service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:02.288228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079de77f-83dc-42b6-aa35-013f7a348caa service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:02.288547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079de77f-83dc-42b6-aa35-013f7a348caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:02.315420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079de77f-83dc-42b6-aa35-013f7a348caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:02.321697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079de77f-83dc-42b6-aa35-013f7a348caa service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:02.368329 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2449/4873] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:02.375104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ef48c720-5d84-44e0-b2c0-05b0d7189657 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aec21a360b24e8d84fba3fc87d364bc', 'request_id': 'req-ef48c720-5d84-44e0-b2c0-05b0d7189657'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:02.420941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:02.477727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ef48c720-5d84-44e0-b2c0-05b0d7189657 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aec21a360b24e8d84fba3fc87d364bc', 'request_id': 'req-ef48c720-5d84-44e0-b2c0-05b0d7189657'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:02.479874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:02.491908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ef48c720-5d84-44e0-b2c0-05b0d7189657 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aec21a360b24e8d84fba3fc87d364bc', 'request_id': 'req-ef48c720-5d84-44e0-b2c0-05b0d7189657'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:02.509414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ef48c720-5d84-44e0-b2c0-05b0d7189657 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] The token cache is being invalidate because project 2aec21a360b24e8d84fba3fc87d364bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:02.509743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ef48c720-5d84-44e0-b2c0-05b0d7189657 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:02.510439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ef48c720-5d84-44e0-b2c0-05b0d7189657 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:02.520050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ef48c720-5d84-44e0-b2c0-05b0d7189657 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2aec21a360b24e8d84fba3fc87d364bc', 'request_id': 'req-ef48c720-5d84-44e0-b2c0-05b0d7189657'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:02.520807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ef48c720-5d84-44e0-b2c0-05b0d7189657 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2aec21a360b24e8d84fba3fc87d364bc', 'request_id': 'req-ef48c720-5d84-44e0-b2c0-05b0d7189657'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:02.521772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ef48c720-5d84-44e0-b2c0-05b0d7189657 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2aec21a360b24e8d84fba3fc87d364bc', 'request_id': 'req-ef48c720-5d84-44e0-b2c0-05b0d7189657'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:02.535894 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2425/4874] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:46:01 2022] DELETE /identity/v3/domains/2aec21a360b24e8d84fba3fc87d364bc => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:02.537275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079de77f-83dc-42b6-aa35-013f7a348caa service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:02.549770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079de77f-83dc-42b6-aa35-013f7a348caa service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:02.678986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae1214-52d0-41d0-bd59-5c68f6fef2f3 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:02.678986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae1214-52d0-41d0-bd59-5c68f6fef2f3 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:02.678986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae1214-52d0-41d0-bd59-5c68f6fef2f3 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:02.679467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae1214-52d0-41d0-bd59-5c68f6fef2f3 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains/11df73690ffd4abbac698c99a617b2e7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:02.710149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae1214-52d0-41d0-bd59-5c68f6fef2f3 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=11df73690ffd4abbac698c99a617b2e7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:02.712451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae1214-52d0-41d0-bd59-5c68f6fef2f3 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:02.762440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-11ae1214-52d0-41d0-bd59-5c68f6fef2f3 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '11df73690ffd4abbac698c99a617b2e7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:02.765095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-11ae1214-52d0-41d0-bd59-5c68f6fef2f3 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '11df73690ffd4abbac698c99a617b2e7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:02.939081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-11ae1214-52d0-41d0-bd59-5c68f6fef2f3 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '11df73690ffd4abbac698c99a617b2e7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:02.950331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-11ae1214-52d0-41d0-bd59-5c68f6fef2f3 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '11df73690ffd4abbac698c99a617b2e7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:02.950331 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2450/4875] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:46:02 2022] PATCH /identity/v3/domains/11df73690ffd4abbac698c99a617b2e7 => generated 276 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:46:02.953287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48c720-5d84-44e0-b2c0-05b0d7189657 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:02.955037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ef48c720-5d84-44e0-b2c0-05b0d7189657 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:02.971523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48c720-5d84-44e0-b2c0-05b0d7189657 tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:03.000466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:03.051264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48a7fb-b629-4410-a105-420458669fcc tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bd387ca454a0389134f4ec2a5e5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33826b78bd8240bebdeeb1587b2bb578', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:03.052194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48a7fb-b629-4410-a105-420458669fcc tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:03.052647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48a7fb-b629-4410-a105-420458669fcc tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:03.053109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48a7fb-b629-4410-a105-420458669fcc tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] PATH_INFO: `/v3/domains/11df73690ffd4abbac698c99a617b2e7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:03.068324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48a7fb-b629-4410-a105-420458669fcc tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=11df73690ffd4abbac698c99a617b2e7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:03.070698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48a7fb-b629-4410-a105-420458669fcc tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:03.104919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e48a7fb-b629-4410-a105-420458669fcc tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '11df73690ffd4abbac698c99a617b2e7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:03.116866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e48a7fb-b629-4410-a105-420458669fcc tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '11df73690ffd4abbac698c99a617b2e7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:03.204670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:03.216454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e48a7fb-b629-4410-a105-420458669fcc tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11df73690ffd4abbac698c99a617b2e7', 'request_id': 'req-1e48a7fb-b629-4410-a105-420458669fcc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:03.312763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d31ea-c98b-4492-bfc3-14b00146a5ce None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:03.313058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d31ea-c98b-4492-bfc3-14b00146a5ce None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:03.313469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d31ea-c98b-4492-bfc3-14b00146a5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:03.315541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e48a7fb-b629-4410-a105-420458669fcc tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11df73690ffd4abbac698c99a617b2e7', 'request_id': 'req-1e48a7fb-b629-4410-a105-420458669fcc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:03.331297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e48a7fb-b629-4410-a105-420458669fcc tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11df73690ffd4abbac698c99a617b2e7', 'request_id': 'req-1e48a7fb-b629-4410-a105-420458669fcc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:03.354749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e48a7fb-b629-4410-a105-420458669fcc tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] The token cache is being invalidate because project 11df73690ffd4abbac698c99a617b2e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:03.358364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e48a7fb-b629-4410-a105-420458669fcc tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:03.358625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e48a7fb-b629-4410-a105-420458669fcc tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:03.370979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e48a7fb-b629-4410-a105-420458669fcc tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '11df73690ffd4abbac698c99a617b2e7', 'request_id': 'req-1e48a7fb-b629-4410-a105-420458669fcc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:03.371907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e48a7fb-b629-4410-a105-420458669fcc tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '11df73690ffd4abbac698c99a617b2e7', 'request_id': 'req-1e48a7fb-b629-4410-a105-420458669fcc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:03.372729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e48a7fb-b629-4410-a105-420458669fcc tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '11df73690ffd4abbac698c99a617b2e7', 'request_id': 'req-1e48a7fb-b629-4410-a105-420458669fcc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:03.390380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-895d31ea-c98b-4492-bfc3-14b00146a5ce None None] MFA Rules not processed for user `b983494c36da483d9f626522f74d9963`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:03.398004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-895d31ea-c98b-4492-bfc3-14b00146a5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:03.401065 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2426/4876] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:46:02 2022] DELETE /identity/v3/domains/11df73690ffd4abbac698c99a617b2e7 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:03.405640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48a7fb-b629-4410-a105-420458669fcc tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:03.408458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1e48a7fb-b629-4410-a105-420458669fcc tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:03.640727 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2451/4877] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:03 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:46:03.644225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad5ab0-7fcc-4914-9827-8dfd52209485 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:03.644644 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad5ab0-7fcc-4914-9827-8dfd52209485 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:03.645342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad5ab0-7fcc-4914-9827-8dfd52209485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:03.650660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48a7fb-b629-4410-a105-420458669fcc tempest-DomainsTestJSON-1063583783 tempest-DomainsTestJSON-1063583783-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:03.662701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ba43b-41df-4fdd-9903-0de9461d30eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:03.667784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ba43b-41df-4fdd-9903-0de9461d30eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:03.667784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ba43b-41df-4fdd-9903-0de9461d30eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:03.667784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ba43b-41df-4fdd-9903-0de9461d30eb admin admin] PATH_INFO: `/v3/users/aa6782cbefac4eeeaffc99df290ea751` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:03.669779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ba43b-41df-4fdd-9903-0de9461d30eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa6782cbefac4eeeaffc99df290ea751)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:03.679175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ba43b-41df-4fdd-9903-0de9461d30eb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:03.694108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:03.697656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3cad5ab0-7fcc-4914-9827-8dfd52209485 None None] MFA Rules not processed for user `b983494c36da483d9f626522f74d9963`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:03.701849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3cad5ab0-7fcc-4914-9827-8dfd52209485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:03.719085 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2452/4878] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:03 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:03.732028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad5ab0-7fcc-4914-9827-8dfd52209485 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:03.742057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3cad5ab0-7fcc-4914-9827-8dfd52209485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:03.892279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:03.912997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad5ab0-7fcc-4914-9827-8dfd52209485 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:03.953206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e6893-b5e4-4430-a186-f7b194011126 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:03.955013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e6893-b5e4-4430-a186-f7b194011126 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:03.955664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e6893-b5e4-4430-a186-f7b194011126 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:03.956127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e6893-b5e4-4430-a186-f7b194011126 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:03.966682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e6893-b5e4-4430-a186-f7b194011126 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:03.968585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e6893-b5e4-4430-a186-f7b194011126 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:03.981217 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2453/4879] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:03 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:03.982405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e6893-b5e4-4430-a186-f7b194011126 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:03.984110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fd8e6893-b5e4-4430-a186-f7b194011126 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:04.004446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e6893-b5e4-4430-a186-f7b194011126 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:04.030531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af06942-965e-4302-a342-979b82de60ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:04.031384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af06942-965e-4302-a342-979b82de60ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:04.031675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af06942-965e-4302-a342-979b82de60ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:04.035171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af06942-965e-4302-a342-979b82de60ee admin admin] PATH_INFO: `/v3/projects/f9f134eb355647b38be2a7e4971c7793` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:04.038092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af06942-965e-4302-a342-979b82de60ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9f134eb355647b38be2a7e4971c7793)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:04.041483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af06942-965e-4302-a342-979b82de60ee admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:04.063916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9a1ba43b-41df-4fdd-9903-0de9461d30eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa6782cbefac4eeeaffc99df290ea751'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:04.071122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9a1ba43b-41df-4fdd-9903-0de9461d30eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa6782cbefac4eeeaffc99df290ea751'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:04.114740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9a1ba43b-41df-4fdd-9903-0de9461d30eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa6782cbefac4eeeaffc99df290ea751'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:04.175673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9a1ba43b-41df-4fdd-9903-0de9461d30eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa6782cbefac4eeeaffc99df290ea751'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:04.240280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1af06942-965e-4302-a342-979b82de60ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9f134eb355647b38be2a7e4971c7793', 'request_id': 'req-1af06942-965e-4302-a342-979b82de60ee'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:04.271750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9a1ba43b-41df-4fdd-9903-0de9461d30eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa6782cbefac4eeeaffc99df290ea751'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:04.272118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1af06942-965e-4302-a342-979b82de60ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9f134eb355647b38be2a7e4971c7793', 'request_id': 'req-1af06942-965e-4302-a342-979b82de60ee'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:04.286243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1af06942-965e-4302-a342-979b82de60ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9f134eb355647b38be2a7e4971c7793', 'request_id': 'req-1af06942-965e-4302-a342-979b82de60ee'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:04.287202 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2427/4880] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:03 2022] DELETE /identity/v3/users/aa6782cbefac4eeeaffc99df290ea751 => generated 0 bytes in 882 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:04.291760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a20d5-f1d2-46cc-8560-1ee3592a2418 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:04.292054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a20d5-f1d2-46cc-8560-1ee3592a2418 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:04.292332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a20d5-f1d2-46cc-8560-1ee3592a2418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:04.386622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-978a20d5-f1d2-46cc-8560-1ee3592a2418 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:04.392425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1af06942-965e-4302-a342-979b82de60ee admin admin] The token cache is being invalidate because project f9f134eb355647b38be2a7e4971c7793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:04.392425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1af06942-965e-4302-a342-979b82de60ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:04.394028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1af06942-965e-4302-a342-979b82de60ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:04.394791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-978a20d5-f1d2-46cc-8560-1ee3592a2418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:04.397298 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2454/4881] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:03 2022] DELETE /identity/v3/projects/f9f134eb355647b38be2a7e4971c7793 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:04.404060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f11fa4-acf7-47a1-8586-ebb6b1e4ca72 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:04.404387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f11fa4-acf7-47a1-8586-ebb6b1e4ca72 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:04.404636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f11fa4-acf7-47a1-8586-ebb6b1e4ca72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:04.558249 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2428/4882] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:04.564950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-42f11fa4-acf7-47a1-8586-ebb6b1e4ca72 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:04.571755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a20d5-f1d2-46cc-8560-1ee3592a2418 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:04.573113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-42f11fa4-acf7-47a1-8586-ebb6b1e4ca72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:04.573569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-978a20d5-f1d2-46cc-8560-1ee3592a2418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:04.601008 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2455/4883] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:04.612738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76606369-3fb3-4b78-b084-2935f4241d04 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:04.612738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76606369-3fb3-4b78-b084-2935f4241d04 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:04.612738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76606369-3fb3-4b78-b084-2935f4241d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:04.647319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-76606369-3fb3-4b78-b084-2935f4241d04 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:04.650563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-76606369-3fb3-4b78-b084-2935f4241d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:04.685495 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2456/4884] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:04.687014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76606369-3fb3-4b78-b084-2935f4241d04 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:04.689537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-76606369-3fb3-4b78-b084-2935f4241d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:04.734527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a20d5-f1d2-46cc-8560-1ee3592a2418 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:04.738925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7603d2f-583a-4483-8fa4-00042993a516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:04.739691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7603d2f-583a-4483-8fa4-00042993a516 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:04.739986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7603d2f-583a-4483-8fa4-00042993a516 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:04.740267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7603d2f-583a-4483-8fa4-00042993a516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:04.751270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7603d2f-583a-4483-8fa4-00042993a516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:04.752755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7603d2f-583a-4483-8fa4-00042993a516 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:04.765156 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2429/4885] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:46:04.766154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7603d2f-583a-4483-8fa4-00042993a516 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:04.785359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7603d2f-583a-4483-8fa4-00042993a516 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:04.795939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8ffed-e54e-47a9-9ab8-7b059769f1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:04.796574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8ffed-e54e-47a9-9ab8-7b059769f1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:04.810401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8ffed-e54e-47a9-9ab8-7b059769f1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:04.810401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8ffed-e54e-47a9-9ab8-7b059769f1d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:04.810401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8ffed-e54e-47a9-9ab8-7b059769f1d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:46:04.810401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8ffed-e54e-47a9-9ab8-7b059769f1d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:04.810401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8ffed-e54e-47a9-9ab8-7b059769f1d1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:04.819239 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2430/4886] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:04.824120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8ffed-e54e-47a9-9ab8-7b059769f1d1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:04.842392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76606369-3fb3-4b78-b084-2935f4241d04 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:04.846183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8ffed-e54e-47a9-9ab8-7b059769f1d1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:04.846629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa823df8-82d0-433d-8cc0-827276af6579 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:04.847896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa823df8-82d0-433d-8cc0-827276af6579 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:04.848504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa823df8-82d0-433d-8cc0-827276af6579 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:04.849661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa823df8-82d0-433d-8cc0-827276af6579 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:04.852985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fa823df8-82d0-433d-8cc0-827276af6579 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:04.856048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2d147-2e71-4ba2-8c10-acb9863421e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:04.856791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2d147-2e71-4ba2-8c10-acb9863421e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:04.863198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2d147-2e71-4ba2-8c10-acb9863421e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:04.865908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2d147-2e71-4ba2-8c10-acb9863421e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:04.868703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2d147-2e71-4ba2-8c10-acb9863421e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:04.870730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2d147-2e71-4ba2-8c10-acb9863421e8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:05.019847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa823df8-82d0-433d-8cc0-827276af6579 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:05.021328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa823df8-82d0-433d-8cc0-827276af6579 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:05.040978 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2431/4887] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:04 2022] POST /identity/v3/projects => generated 403 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:05.045044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2d147-2e71-4ba2-8c10-acb9863421e8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:05.053946 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2457/4888] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:05.188397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2d147-2e71-4ba2-8c10-acb9863421e8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:05.209297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def21c8f-f420-418f-8a30-31e54acf9936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:05.209996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def21c8f-f420-418f-8a30-31e54acf9936 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:05.210358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def21c8f-f420-418f-8a30-31e54acf9936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:05.210730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def21c8f-f420-418f-8a30-31e54acf9936 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:05.211116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:05.212466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def21c8f-f420-418f-8a30-31e54acf9936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:05.214486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def21c8f-f420-418f-8a30-31e54acf9936 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:05.324466 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2432/4889] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:05 2022] POST /identity/v3/users => generated 302 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:05.330614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa823df8-82d0-433d-8cc0-827276af6579 service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:05.344535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa823df8-82d0-433d-8cc0-827276af6579 service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:05.356322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b73d7d-ade7-4d5c-9961-a4727fe57cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:05.357157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b73d7d-ade7-4d5c-9961-a4727fe57cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:05.357541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b73d7d-ade7-4d5c-9961-a4727fe57cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:05.357948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b73d7d-ade7-4d5c-9961-a4727fe57cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:05.358900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b73d7d-ade7-4d5c-9961-a4727fe57cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:05.361163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b73d7d-ade7-4d5c-9961-a4727fe57cb5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:05.399272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def21c8f-f420-418f-8a30-31e54acf9936 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:05.399512 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2458/4890] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:46:05.429625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def21c8f-f420-418f-8a30-31e54acf9936 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:05.444213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d28f7-c1be-48b4-ad24-10b8eaf92760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:05.445446 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d28f7-c1be-48b4-ad24-10b8eaf92760 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:05.445446 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d28f7-c1be-48b4-ad24-10b8eaf92760 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:05.445446 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d28f7-c1be-48b4-ad24-10b8eaf92760 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:05.446310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d28f7-c1be-48b4-ad24-10b8eaf92760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:05.448136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d28f7-c1be-48b4-ad24-10b8eaf92760 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:05.474703 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2433/4891] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:05.479229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b73d7d-ade7-4d5c-9961-a4727fe57cb5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:05.490733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b73d7d-ade7-4d5c-9961-a4727fe57cb5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:05.497019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:05.500621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603498f-2340-4832-88ca-662dddc786d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:05.502010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603498f-2340-4832-88ca-662dddc786d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:05.502783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603498f-2340-4832-88ca-662dddc786d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:05.504278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603498f-2340-4832-88ca-662dddc786d0 admin admin] PATH_INFO: `/v3/projects/d3f51ad7c5194372ad4dc2e5b0d5c65b/users/74663cc541d74917aee9ff51e59d3cfa/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:05.544871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603498f-2340-4832-88ca-662dddc786d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f51ad7c5194372ad4dc2e5b0d5c65b, user_id=74663cc541d74917aee9ff51e59d3cfa, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:05.548348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603498f-2340-4832-88ca-662dddc786d0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:05.707277 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2459/4892] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:05 2022] PUT /identity/v3/projects/d3f51ad7c5194372ad4dc2e5b0d5c65b/users/74663cc541d74917aee9ff51e59d3cfa/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:05.709164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa85d6-977b-4a15-a6d4-f49f62322364 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:05.709458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa85d6-977b-4a15-a6d4-f49f62322364 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:05.710165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa85d6-977b-4a15-a6d4-f49f62322364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:05.744789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603498f-2340-4832-88ca-662dddc786d0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:05.747655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9603498f-2340-4832-88ca-662dddc786d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:05.807409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-fefa85d6-977b-4a15-a6d4-f49f62322364 None None] MFA Rules not processed for user `74663cc541d74917aee9ff51e59d3cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:05.819467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fefa85d6-977b-4a15-a6d4-f49f62322364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:05.835298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:05.983578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603498f-2340-4832-88ca-662dddc786d0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:05.999342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9270b65-3189-4ae8-a4e2-61e9f64454ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:06.000065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9270b65-3189-4ae8-a4e2-61e9f64454ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:06.000350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9270b65-3189-4ae8-a4e2-61e9f64454ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:06.000630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9270b65-3189-4ae8-a4e2-61e9f64454ad admin admin] PATH_INFO: `/v3/projects/46ed5d31522d43a99334c29099b00905` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:06.001144 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2434/4893] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:05 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:06.002607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9270b65-3189-4ae8-a4e2-61e9f64454ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ed5d31522d43a99334c29099b00905)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:06.009108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa85d6-977b-4a15-a6d4-f49f62322364 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:06.011464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9270b65-3189-4ae8-a4e2-61e9f64454ad admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:06.023451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa85d6-977b-4a15-a6d4-f49f62322364 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:06.037299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860611ca-90c5-4f74-8da1-0eb9bbbae7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:06.039102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860611ca-90c5-4f74-8da1-0eb9bbbae7de admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:06.039481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860611ca-90c5-4f74-8da1-0eb9bbbae7de admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:06.044968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860611ca-90c5-4f74-8da1-0eb9bbbae7de admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:06.044968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860611ca-90c5-4f74-8da1-0eb9bbbae7de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:06.048562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860611ca-90c5-4f74-8da1-0eb9bbbae7de admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:06.230226 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2435/4894] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:06 2022] POST /identity/v3/projects => generated 401 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:06.231805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860611ca-90c5-4f74-8da1-0eb9bbbae7de admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:06.264022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e9270b65-3189-4ae8-a4e2-61e9f64454ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ed5d31522d43a99334c29099b00905', 'request_id': 'req-e9270b65-3189-4ae8-a4e2-61e9f64454ad'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:06.283749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e9270b65-3189-4ae8-a4e2-61e9f64454ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ed5d31522d43a99334c29099b00905', 'request_id': 'req-e9270b65-3189-4ae8-a4e2-61e9f64454ad'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:06.317988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e9270b65-3189-4ae8-a4e2-61e9f64454ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ed5d31522d43a99334c29099b00905', 'request_id': 'req-e9270b65-3189-4ae8-a4e2-61e9f64454ad'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:06.378167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860611ca-90c5-4f74-8da1-0eb9bbbae7de admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:06.408175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97251b9-c525-443f-aa86-d693361d0067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:06.408818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97251b9-c525-443f-aa86-d693361d0067 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:06.409096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97251b9-c525-443f-aa86-d693361d0067 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:06.409370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97251b9-c525-443f-aa86-d693361d0067 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:06.410017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97251b9-c525-443f-aa86-d693361d0067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:06.429189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e9270b65-3189-4ae8-a4e2-61e9f64454ad admin admin] The token cache is being invalidate because project 46ed5d31522d43a99334c29099b00905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:06.429537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e9270b65-3189-4ae8-a4e2-61e9f64454ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:06.430953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e9270b65-3189-4ae8-a4e2-61e9f64454ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:06.433929 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2460/4895] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:05 2022] DELETE /identity/v3/projects/46ed5d31522d43a99334c29099b00905 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:06.437632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97251b9-c525-443f-aa86-d693361d0067 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:06.440111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9270b65-3189-4ae8-a4e2-61e9f64454ad admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:06.451024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e9270b65-3189-4ae8-a4e2-61e9f64454ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:06.571000 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2436/4896] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:06 2022] POST /identity/v3/users => generated 307 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:06.572951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97251b9-c525-443f-aa86-d693361d0067 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:06.575665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e97251b9-c525-443f-aa86-d693361d0067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:06.622660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97251b9-c525-443f-aa86-d693361d0067 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:06.637429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681eb13-6552-406e-b49c-6d6eb72938f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:06.640449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681eb13-6552-406e-b49c-6d6eb72938f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:06.642994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681eb13-6552-406e-b49c-6d6eb72938f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:06.642994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681eb13-6552-406e-b49c-6d6eb72938f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:06.642994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681eb13-6552-406e-b49c-6d6eb72938f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:06.647017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681eb13-6552-406e-b49c-6d6eb72938f4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:06.661673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9270b65-3189-4ae8-a4e2-61e9f64454ad admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:06.675241 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2437/4897] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:06.678879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681eb13-6552-406e-b49c-6d6eb72938f4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:06.695816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233f8c7-a574-4857-bfae-5c5c5869b05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:06.698106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233f8c7-a574-4857-bfae-5c5c5869b05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:06.698778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233f8c7-a574-4857-bfae-5c5c5869b05b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:06.704612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233f8c7-a574-4857-bfae-5c5c5869b05b admin admin] PATH_INFO: `/v3/users/716bd387ca454a0389134f4ec2a5e5a8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:06.704612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233f8c7-a574-4857-bfae-5c5c5869b05b admin admin] RBAC: Authorizing `identity:delete_user(user_id=716bd387ca454a0389134f4ec2a5e5a8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:06.708494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233f8c7-a574-4857-bfae-5c5c5869b05b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:06.709734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681eb13-6552-406e-b49c-6d6eb72938f4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:06.721874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7e180-88de-4c5a-9dff-4d7b03d17c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:06.722681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7e180-88de-4c5a-9dff-4d7b03d17c8c admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:06.722960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7e180-88de-4c5a-9dff-4d7b03d17c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:06.723242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7e180-88de-4c5a-9dff-4d7b03d17c8c admin admin] PATH_INFO: `/v3/projects/0d3f358072754e04bfe5176df24993b1/users/0de3f34d53e84b71bc151bb268187c31/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:06.769065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7e180-88de-4c5a-9dff-4d7b03d17c8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3f358072754e04bfe5176df24993b1, user_id=0de3f34d53e84b71bc151bb268187c31, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:06.782692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7e180-88de-4c5a-9dff-4d7b03d17c8c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:06.934194 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2438/4898] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:06 2022] PUT /identity/v3/projects/0d3f358072754e04bfe5176df24993b1/users/0de3f34d53e84b71bc151bb268187c31/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:06.939902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7e180-88de-4c5a-9dff-4d7b03d17c8c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:06.975513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6233f8c7-a574-4857-bfae-5c5c5869b05b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '716bd387ca454a0389134f4ec2a5e5a8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:06.980029 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6233f8c7-a574-4857-bfae-5c5c5869b05b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '716bd387ca454a0389134f4ec2a5e5a8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:07.010854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6233f8c7-a574-4857-bfae-5c5c5869b05b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '716bd387ca454a0389134f4ec2a5e5a8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:07.040835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6233f8c7-a574-4857-bfae-5c5c5869b05b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '716bd387ca454a0389134f4ec2a5e5a8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:07.042584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6233f8c7-a574-4857-bfae-5c5c5869b05b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '716bd387ca454a0389134f4ec2a5e5a8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:07.178360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7e180-88de-4c5a-9dff-4d7b03d17c8c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:07.184136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a75fa-3a3b-4b6d-aec4-38269a2bddc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:07.186221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a75fa-3a3b-4b6d-aec4-38269a2bddc7 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:07.186221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a75fa-3a3b-4b6d-aec4-38269a2bddc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:07.186221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a75fa-3a3b-4b6d-aec4-38269a2bddc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:07.187064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a75fa-3a3b-4b6d-aec4-38269a2bddc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:07.189821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a75fa-3a3b-4b6d-aec4-38269a2bddc7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:07.217202 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2439/4899] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:07.227396 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2461/4900] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:06 2022] DELETE /identity/v3/users/716bd387ca454a0389134f4ec2a5e5a8 => generated 0 bytes in 789 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:07.228675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a75fa-3a3b-4b6d-aec4-38269a2bddc7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:07.235343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c20a75fa-3a3b-4b6d-aec4-38269a2bddc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:07.278207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233f8c7-a574-4857-bfae-5c5c5869b05b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:07.278723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6233f8c7-a574-4857-bfae-5c5c5869b05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:07.290518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a75fa-3a3b-4b6d-aec4-38269a2bddc7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:07.424177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233f8c7-a574-4857-bfae-5c5c5869b05b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:07.434852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1244b-bd82-40df-a60e-9a4268fccf49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:07.435885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1244b-bd82-40df-a60e-9a4268fccf49 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:07.436371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1244b-bd82-40df-a60e-9a4268fccf49 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:07.437436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1244b-bd82-40df-a60e-9a4268fccf49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:07.437908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae16e1e-7c1b-48d3-ae77-80d8d9800576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:07.438763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae16e1e-7c1b-48d3-ae77-80d8d9800576 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:07.439059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae16e1e-7c1b-48d3-ae77-80d8d9800576 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:07.439414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae16e1e-7c1b-48d3-ae77-80d8d9800576 admin admin] PATH_INFO: `/v3/projects/0d3f358072754e04bfe5176df24993b1/users/0de3f34d53e84b71bc151bb268187c31/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:07.441777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae16e1e-7c1b-48d3-ae77-80d8d9800576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3f358072754e04bfe5176df24993b1, user_id=0de3f34d53e84b71bc151bb268187c31, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:07.442812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1be1244b-bd82-40df-a60e-9a4268fccf49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:07.445089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae16e1e-7c1b-48d3-ae77-80d8d9800576 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:07.470093 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2440/4901] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:07 2022] PUT /identity/v3/projects/0d3f358072754e04bfe5176df24993b1/users/0de3f34d53e84b71bc151bb268187c31/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:07.472085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cb25e-d01c-4c0e-a7fb-cddb60a8b7ae None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:07.472443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cb25e-d01c-4c0e-a7fb-cddb60a8b7ae None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:07.473024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cb25e-d01c-4c0e-a7fb-cddb60a8b7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:07.515028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-254cb25e-d01c-4c0e-a7fb-cddb60a8b7ae None None] MFA Rules not processed for user `0de3f34d53e84b71bc151bb268187c31`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:07.517123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-254cb25e-d01c-4c0e-a7fb-cddb60a8b7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:07.646002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1244b-bd82-40df-a60e-9a4268fccf49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:07.647608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1244b-bd82-40df-a60e-9a4268fccf49 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:07.657777 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2441/4902] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:07 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:07.661798 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2462/4903] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:46:07.662770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cb25e-d01c-4c0e-a7fb-cddb60a8b7ae None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:07.685936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cb25e-d01c-4c0e-a7fb-cddb60a8b7ae None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:07.700051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c263c-1e5f-4aad-bced-3f9262c694e3 tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de3f34d53e84b71bc151bb268187c31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d3f358072754e04bfe5176df24993b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:07.700569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c263c-1e5f-4aad-bced-3f9262c694e3 tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:07.700858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c263c-1e5f-4aad-bced-3f9262c694e3 tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:07.701147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c263c-1e5f-4aad-bced-3f9262c694e3 tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:07.701904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c263c-1e5f-4aad-bced-3f9262c694e3 tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:07.710719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c263c-1e5f-4aad-bced-3f9262c694e3 tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:07.799978 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2442/4904] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:46:07 2022] POST /identity/v3/roles => generated 238 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:46:07.804639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1244b-bd82-40df-a60e-9a4268fccf49 service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:07.970841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1244b-bd82-40df-a60e-9a4268fccf49 service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:07.990460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210f424-92f1-42d1-904a-2461660c886b tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de3f34d53e84b71bc151bb268187c31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d3f358072754e04bfe5176df24993b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:07.991918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210f424-92f1-42d1-904a-2461660c886b tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:07.992564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210f424-92f1-42d1-904a-2461660c886b tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:07.993038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210f424-92f1-42d1-904a-2461660c886b tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] PATH_INFO: `/v3/projects/d3f51ad7c5194372ad4dc2e5b0d5c65b/users/74663cc541d74917aee9ff51e59d3cfa/roles/d811845a3fca4d46a34d7ac9a69a69d0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:07.997964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210f424-92f1-42d1-904a-2461660c886b tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d3f51ad7c5194372ad4dc2e5b0d5c65b, user_id=74663cc541d74917aee9ff51e59d3cfa, role_id=d811845a3fca4d46a34d7ac9a69a69d0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:08.002838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210f424-92f1-42d1-904a-2461660c886b tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:08.070921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c263c-1e5f-4aad-bced-3f9262c694e3 tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:08.070921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8b3c263c-1e5f-4aad-bced-3f9262c694e3 tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:08.090880 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2463/4905] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:07 2022] PUT /identity/v3/projects/d3f51ad7c5194372ad4dc2e5b0d5c65b/users/74663cc541d74917aee9ff51e59d3cfa/roles/d811845a3fca4d46a34d7ac9a69a69d0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:08.096938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210f424-92f1-42d1-904a-2461660c886b tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:08.100704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a210f424-92f1-42d1-904a-2461660c886b tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:08.192080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c263c-1e5f-4aad-bced-3f9262c694e3 tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:08.263126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210f424-92f1-42d1-904a-2461660c886b tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:08.284229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcc54e-9e4b-4857-a21c-3002e4d3a78b tempest-ApplicationCredentialsV3AdminTest-1548611255 tempest-ApplicationCredentialsV3AdminTest-1548611255-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74663cc541d74917aee9ff51e59d3cfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3f51ad7c5194372ad4dc2e5b0d5c65b', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-29873634', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:08.285433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcc54e-9e4b-4857-a21c-3002e4d3a78b tempest-ApplicationCredentialsV3AdminTest-1548611255 tempest-ApplicationCredentialsV3AdminTest-1548611255-project] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:08.286122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcc54e-9e4b-4857-a21c-3002e4d3a78b tempest-ApplicationCredentialsV3AdminTest-1548611255 tempest-ApplicationCredentialsV3AdminTest-1548611255-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:08.286657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcc54e-9e4b-4857-a21c-3002e4d3a78b tempest-ApplicationCredentialsV3AdminTest-1548611255 tempest-ApplicationCredentialsV3AdminTest-1548611255-project] PATH_INFO: `/v3/users/74663cc541d74917aee9ff51e59d3cfa/application_credentials` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:08.291876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=5,keystone:SELECT=95 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:08.292931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcc54e-9e4b-4857-a21c-3002e4d3a78b tempest-ApplicationCredentialsV3AdminTest-1548611255 tempest-ApplicationCredentialsV3AdminTest-1548611255-project] RBAC: Authorizing `identity:create_application_credential(user_id=74663cc541d74917aee9ff51e59d3cfa)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:08.294424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcc54e-9e4b-4857-a21c-3002e4d3a78b tempest-ApplicationCredentialsV3AdminTest-1548611255 tempest-ApplicationCredentialsV3AdminTest-1548611255-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:08.299255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db39a0f-1538-4118-ab7f-a0710269814d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:08.303944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db39a0f-1538-4118-ab7f-a0710269814d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:08.304213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db39a0f-1538-4118-ab7f-a0710269814d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:08.304501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db39a0f-1538-4118-ab7f-a0710269814d admin admin] PATH_INFO: `/v3/projects/33826b78bd8240bebdeeb1587b2bb578` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:08.305770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db39a0f-1538-4118-ab7f-a0710269814d admin admin] RBAC: Authorizing `identity:delete_project(project_id=33826b78bd8240bebdeeb1587b2bb578)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:08.307810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db39a0f-1538-4118-ab7f-a0710269814d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:08.531376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4db39a0f-1538-4118-ab7f-a0710269814d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33826b78bd8240bebdeeb1587b2bb578', 'request_id': 'req-4db39a0f-1538-4118-ab7f-a0710269814d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:08.537089 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2464/4906] 10.222.0.20 () {60 vars in 1315 bytes} [Thu Oct 27 03:46:08 2022] POST /identity/v3/users/74663cc541d74917aee9ff51e59d3cfa/application_credentials => generated 657 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:08.541197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ba6c2-61b3-486b-bd5c-651ecc2f42d3 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:08.541761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ba6c2-61b3-486b-bd5c-651ecc2f42d3 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:08.551573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ba6c2-61b3-486b-bd5c-651ecc2f42d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:08.616480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4db39a0f-1538-4118-ab7f-a0710269814d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33826b78bd8240bebdeeb1587b2bb578', 'request_id': 'req-4db39a0f-1538-4118-ab7f-a0710269814d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:08.616924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d31ba6c2-61b3-486b-bd5c-651ecc2f42d3 None None] MFA Rules not processed for user `74663cc541d74917aee9ff51e59d3cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:08.620845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d31ba6c2-61b3-486b-bd5c-651ecc2f42d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:08.625206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4db39a0f-1538-4118-ab7f-a0710269814d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33826b78bd8240bebdeeb1587b2bb578', 'request_id': 'req-4db39a0f-1538-4118-ab7f-a0710269814d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:08.654181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4db39a0f-1538-4118-ab7f-a0710269814d admin admin] The token cache is being invalidate because project 33826b78bd8240bebdeeb1587b2bb578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:08.654796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4db39a0f-1538-4118-ab7f-a0710269814d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:08.656447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4db39a0f-1538-4118-ab7f-a0710269814d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:08.662182 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2443/4907] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:08 2022] DELETE /identity/v3/projects/33826b78bd8240bebdeeb1587b2bb578 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:46:08.667198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3d815-b15e-4aee-87af-94bc25e97d52 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:08.667853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3d815-b15e-4aee-87af-94bc25e97d52 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:08.668241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3d815-b15e-4aee-87af-94bc25e97d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:08.735401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b0b3d815-b15e-4aee-87af-94bc25e97d52 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:08.737585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b0b3d815-b15e-4aee-87af-94bc25e97d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:08.817161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:08.970495 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2465/4908] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:08 2022] POST /identity/v3/auth/tokens => generated 3394 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Oct 27 03:46:08.972582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ba6c2-61b3-486b-bd5c-651ecc2f42d3 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:08.974329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d31ba6c2-61b3-486b-bd5c-651ecc2f42d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:09.000116 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2444/4909] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:46:09.005033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf6467-7272-4bf7-8b89-e4f75e603775 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:09.005469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf6467-7272-4bf7-8b89-e4f75e603775 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:09.005847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf6467-7272-4bf7-8b89-e4f75e603775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:09.063259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-18cf6467-7272-4bf7-8b89-e4f75e603775 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:09.068527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-18cf6467-7272-4bf7-8b89-e4f75e603775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:09.106943 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2445/4910] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:09.126126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf6467-7272-4bf7-8b89-e4f75e603775 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:09.152507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ba6c2-61b3-486b-bd5c-651ecc2f42d3 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:09.158421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf6467-7272-4bf7-8b89-e4f75e603775 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:09.171535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2549f17-e8f7-4c49-b0fc-be742c1f1198 tempest-ApplicationCredentialsV3AdminTest-1548611255 tempest-ApplicationCredentialsV3AdminTest-1548611255-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74663cc541d74917aee9ff51e59d3cfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3f51ad7c5194372ad4dc2e5b0d5c65b', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-29873634', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:09.172239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2549f17-e8f7-4c49-b0fc-be742c1f1198 tempest-ApplicationCredentialsV3AdminTest-1548611255 tempest-ApplicationCredentialsV3AdminTest-1548611255-project] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:09.172570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2549f17-e8f7-4c49-b0fc-be742c1f1198 tempest-ApplicationCredentialsV3AdminTest-1548611255 tempest-ApplicationCredentialsV3AdminTest-1548611255-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:09.173477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2549f17-e8f7-4c49-b0fc-be742c1f1198 tempest-ApplicationCredentialsV3AdminTest-1548611255 tempest-ApplicationCredentialsV3AdminTest-1548611255-project] PATH_INFO: `/v3/users/74663cc541d74917aee9ff51e59d3cfa/application_credentials/1211e3fb6b634305b876364d86a86718` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:09.174912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2549f17-e8f7-4c49-b0fc-be742c1f1198 tempest-ApplicationCredentialsV3AdminTest-1548611255 tempest-ApplicationCredentialsV3AdminTest-1548611255-project] RBAC: Authorizing `identity:delete_application_credential(user_id=74663cc541d74917aee9ff51e59d3cfa, application_credential_id=1211e3fb6b634305b876364d86a86718)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:09.176497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2549f17-e8f7-4c49-b0fc-be742c1f1198 tempest-ApplicationCredentialsV3AdminTest-1548611255 tempest-ApplicationCredentialsV3AdminTest-1548611255-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:09.197440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372808a5-c57f-4628-a26a-030dc16de0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:09.198582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372808a5-c57f-4628-a26a-030dc16de0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:09.199838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372808a5-c57f-4628-a26a-030dc16de0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:09.200500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372808a5-c57f-4628-a26a-030dc16de0b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:09.202602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372808a5-c57f-4628-a26a-030dc16de0b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:46:09.203953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372808a5-c57f-4628-a26a-030dc16de0b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:09.221483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372808a5-c57f-4628-a26a-030dc16de0b5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:09.273458 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2446/4911] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:09.277913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372808a5-c57f-4628-a26a-030dc16de0b5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:09.293918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372808a5-c57f-4628-a26a-030dc16de0b5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:09.314788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afce169-aff6-4e13-b677-49698efe3d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:09.316261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afce169-aff6-4e13-b677-49698efe3d1b admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:09.316822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afce169-aff6-4e13-b677-49698efe3d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:09.317379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afce169-aff6-4e13-b677-49698efe3d1b admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:09.318285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afce169-aff6-4e13-b677-49698efe3d1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:09.320620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afce169-aff6-4e13-b677-49698efe3d1b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:09.557751 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2466/4912] 10.222.0.20 () {58 vars in 1395 bytes} [Thu Oct 27 03:46:08 2022] DELETE /identity/v3/users/74663cc541d74917aee9ff51e59d3cfa/application_credentials/1211e3fb6b634305b876364d86a86718 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:09.558930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2549f17-e8f7-4c49-b0fc-be742c1f1198 tempest-ApplicationCredentialsV3AdminTest-1548611255 tempest-ApplicationCredentialsV3AdminTest-1548611255-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:09.561577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b2549f17-e8f7-4c49-b0fc-be742c1f1198 tempest-ApplicationCredentialsV3AdminTest-1548611255 tempest-ApplicationCredentialsV3AdminTest-1548611255-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:09.566641 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2447/4913] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:09 2022] POST /identity/v3/projects => generated 387 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:46:09.571002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afce169-aff6-4e13-b677-49698efe3d1b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:09.728339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afce169-aff6-4e13-b677-49698efe3d1b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:09.737440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2549f17-e8f7-4c49-b0fc-be742c1f1198 tempest-ApplicationCredentialsV3AdminTest-1548611255 tempest-ApplicationCredentialsV3AdminTest-1548611255-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:09.739824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e13d18-03dd-4990-8d25-2382e693c29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:09.740584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e13d18-03dd-4990-8d25-2382e693c29f admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:09.740978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e13d18-03dd-4990-8d25-2382e693c29f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:09.742111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e13d18-03dd-4990-8d25-2382e693c29f admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:09.745207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e13d18-03dd-4990-8d25-2382e693c29f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:09.747925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e13d18-03dd-4990-8d25-2382e693c29f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:09.848962 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2448/4914] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:09 2022] POST /identity/v3/users => generated 294 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:09.851775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e13d18-03dd-4990-8d25-2382e693c29f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:09.870320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0839c17-c0b7-42d3-a1ca-22e5a6a40b48 tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de3f34d53e84b71bc151bb268187c31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d3f358072754e04bfe5176df24993b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:09.870983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0839c17-c0b7-42d3-a1ca-22e5a6a40b48 tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:09.871474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0839c17-c0b7-42d3-a1ca-22e5a6a40b48 tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:09.871932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0839c17-c0b7-42d3-a1ca-22e5a6a40b48 tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] PATH_INFO: `/v3/roles/d811845a3fca4d46a34d7ac9a69a69d0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:09.873617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0839c17-c0b7-42d3-a1ca-22e5a6a40b48 tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d811845a3fca4d46a34d7ac9a69a69d0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:09.877449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0839c17-c0b7-42d3-a1ca-22e5a6a40b48 tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:09.882873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e13d18-03dd-4990-8d25-2382e693c29f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:09.900681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4c2d6-835e-4cdf-aa21-0b592687cf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:09.901323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4c2d6-835e-4cdf-aa21-0b592687cf03 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:09.902316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4c2d6-835e-4cdf-aa21-0b592687cf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:09.902316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4c2d6-835e-4cdf-aa21-0b592687cf03 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:09.902853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4c2d6-835e-4cdf-aa21-0b592687cf03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:09.904471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4c2d6-835e-4cdf-aa21-0b592687cf03 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:09.935942 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2449/4915] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:09 2022] GET /identity/v3/roles => generated 1649 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:09.940583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4c2d6-835e-4cdf-aa21-0b592687cf03 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:09.959849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4c2d6-835e-4cdf-aa21-0b592687cf03 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:09.970077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df9e3e-df2b-44c7-b17d-af1c98daca75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:09.970762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df9e3e-df2b-44c7-b17d-af1c98daca75 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:09.971046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df9e3e-df2b-44c7-b17d-af1c98daca75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:09.971324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df9e3e-df2b-44c7-b17d-af1c98daca75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:09.971973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df9e3e-df2b-44c7-b17d-af1c98daca75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:09.974302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df9e3e-df2b-44c7-b17d-af1c98daca75 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:10.008471 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2450/4916] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:09 2022] GET /identity/v3/roles => generated 1649 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:46:10.009294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df9e3e-df2b-44c7-b17d-af1c98daca75 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:10.026248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df9e3e-df2b-44c7-b17d-af1c98daca75 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:10.044275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bddd9-ac8d-4cd5-ab88-196a67217a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:10.046975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bddd9-ac8d-4cd5-ab88-196a67217a18 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:10.046975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bddd9-ac8d-4cd5-ab88-196a67217a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:10.046975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bddd9-ac8d-4cd5-ab88-196a67217a18 admin admin] PATH_INFO: `/v3/projects/0a35e318a2444e10ac8faba23153c7c1/users/0c69d98a86894431b48a67306457af43/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:10.075288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a0839c17-c0b7-42d3-a1ca-22e5a6a40b48 tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] Invalidating the token cache because role d811845a3fca4d46a34d7ac9a69a69d0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:10.075288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a0839c17-c0b7-42d3-a1ca-22e5a6a40b48 tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:10.076273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a0839c17-c0b7-42d3-a1ca-22e5a6a40b48 tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:10.081985 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2467/4917] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:09 2022] DELETE /identity/v3/roles/d811845a3fca4d46a34d7ac9a69a69d0 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:10.082496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1bddd9-ac8d-4cd5-ab88-196a67217a18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a35e318a2444e10ac8faba23153c7c1, user_id=0c69d98a86894431b48a67306457af43, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:10.085542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1bddd9-ac8d-4cd5-ab88-196a67217a18 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:10.086831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0839c17-c0b7-42d3-a1ca-22e5a6a40b48 tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:10.091797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a0839c17-c0b7-42d3-a1ca-22e5a6a40b48 tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:10.166564 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2451/4918] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:10 2022] PUT /identity/v3/projects/0a35e318a2444e10ac8faba23153c7c1/users/0c69d98a86894431b48a67306457af43/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:10.192512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042561f-ad48-4fa1-a65b-5955f71b83b3 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:10.192512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042561f-ad48-4fa1-a65b-5955f71b83b3 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:10.192804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042561f-ad48-4fa1-a65b-5955f71b83b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:10.205557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:10.250491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5042561f-ad48-4fa1-a65b-5955f71b83b3 None None] MFA Rules not processed for user `0c69d98a86894431b48a67306457af43`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:10.267137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5042561f-ad48-4fa1-a65b-5955f71b83b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:10.280774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0839c17-c0b7-42d3-a1ca-22e5a6a40b48 tempest-ApplicationCredentialsV3AdminTest-200422326 tempest-ApplicationCredentialsV3AdminTest-200422326-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:10.474806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d4d2d-bc62-4f1c-a567-c0b48162b79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:10.480559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d4d2d-bc62-4f1c-a567-c0b48162b79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:10.480864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d4d2d-bc62-4f1c-a567-c0b48162b79a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:10.481143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d4d2d-bc62-4f1c-a567-c0b48162b79a admin admin] PATH_INFO: `/v3/users/74663cc541d74917aee9ff51e59d3cfa` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:10.483518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d4d2d-bc62-4f1c-a567-c0b48162b79a admin admin] RBAC: Authorizing `identity:delete_user(user_id=74663cc541d74917aee9ff51e59d3cfa)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:10.486069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d4d2d-bc62-4f1c-a567-c0b48162b79a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:10.509650 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2452/4919] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:46:10.510627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042561f-ad48-4fa1-a65b-5955f71b83b3 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:10.513636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5042561f-ad48-4fa1-a65b-5955f71b83b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:10.565720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042561f-ad48-4fa1-a65b-5955f71b83b3 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:10.580309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65f781-1ba8-49ac-846a-67a27f439e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:10.580955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65f781-1ba8-49ac-846a-67a27f439e52 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:10.581244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65f781-1ba8-49ac-846a-67a27f439e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:10.581520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65f781-1ba8-49ac-846a-67a27f439e52 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:10.586309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65f781-1ba8-49ac-846a-67a27f439e52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:10.588321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65f781-1ba8-49ac-846a-67a27f439e52 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:10.727213 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2453/4920] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:10 2022] POST /identity/v3/projects => generated 387 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:10.729413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65f781-1ba8-49ac-846a-67a27f439e52 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:10.749498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-254d4d2d-bc62-4f1c-a567-c0b48162b79a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74663cc541d74917aee9ff51e59d3cfa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:10.752675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-254d4d2d-bc62-4f1c-a567-c0b48162b79a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74663cc541d74917aee9ff51e59d3cfa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:10.763468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-254d4d2d-bc62-4f1c-a567-c0b48162b79a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74663cc541d74917aee9ff51e59d3cfa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:10.778968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-254d4d2d-bc62-4f1c-a567-c0b48162b79a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74663cc541d74917aee9ff51e59d3cfa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:10.779648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-254d4d2d-bc62-4f1c-a567-c0b48162b79a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74663cc541d74917aee9ff51e59d3cfa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:10.834946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65f781-1ba8-49ac-846a-67a27f439e52 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:10.883510 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2468/4921] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:10 2022] DELETE /identity/v3/users/74663cc541d74917aee9ff51e59d3cfa => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:46:10.888286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c91221-1f2a-4aee-8015-03a10d75235e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:10.889538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c91221-1f2a-4aee-8015-03a10d75235e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:10.889873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c91221-1f2a-4aee-8015-03a10d75235e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:10.899630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0746123-5fb8-4acf-a053-5ca57361f604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:10.902155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0746123-5fb8-4acf-a053-5ca57361f604 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:10.902448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0746123-5fb8-4acf-a053-5ca57361f604 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:10.902732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0746123-5fb8-4acf-a053-5ca57361f604 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:10.903388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0746123-5fb8-4acf-a053-5ca57361f604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:10.905378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0746123-5fb8-4acf-a053-5ca57361f604 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:10.956336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-29c91221-1f2a-4aee-8015-03a10d75235e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:10.958960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-29c91221-1f2a-4aee-8015-03a10d75235e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:11.029220 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2454/4922] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:10 2022] POST /identity/v3/users => generated 300 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:11.031753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0746123-5fb8-4acf-a053-5ca57361f604 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:11.037425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a0746123-5fb8-4acf-a053-5ca57361f604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:11.075532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0746123-5fb8-4acf-a053-5ca57361f604 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:11.089047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487bde0-e2dc-4c1a-b239-39ab970f7b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:11.089687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487bde0-e2dc-4c1a-b239-39ab970f7b21 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:11.089977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487bde0-e2dc-4c1a-b239-39ab970f7b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:11.090304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487bde0-e2dc-4c1a-b239-39ab970f7b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:11.091645 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2469/4923] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:11.092231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487bde0-e2dc-4c1a-b239-39ab970f7b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:11.095456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487bde0-e2dc-4c1a-b239-39ab970f7b21 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:11.102726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c91221-1f2a-4aee-8015-03a10d75235e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:11.104952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-29c91221-1f2a-4aee-8015-03a10d75235e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:11.110560 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2455/4924] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:46:11.114747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487bde0-e2dc-4c1a-b239-39ab970f7b21 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:11.127955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487bde0-e2dc-4c1a-b239-39ab970f7b21 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:11.133810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77166c3-5bb4-4f0e-9183-7eda89b54461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:11.134797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77166c3-5bb4-4f0e-9183-7eda89b54461 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:11.135218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77166c3-5bb4-4f0e-9183-7eda89b54461 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:11.136169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77166c3-5bb4-4f0e-9183-7eda89b54461 admin admin] PATH_INFO: `/v3/projects/8d4e3334372746bfb009acc5832d0954/users/144eef04f8db40e59954c63aa878ad2d/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:11.156305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77166c3-5bb4-4f0e-9183-7eda89b54461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d4e3334372746bfb009acc5832d0954, user_id=144eef04f8db40e59954c63aa878ad2d, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:11.160056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77166c3-5bb4-4f0e-9183-7eda89b54461 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:11.180220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:11.228730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c91221-1f2a-4aee-8015-03a10d75235e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:11.233509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b73b7-9048-4e3f-be90-95fcce34bb27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:11.234354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b73b7-9048-4e3f-be90-95fcce34bb27 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:11.234745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b73b7-9048-4e3f-be90-95fcce34bb27 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:11.235725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b73b7-9048-4e3f-be90-95fcce34bb27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:11.241866 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2456/4925] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:11 2022] PUT /identity/v3/projects/8d4e3334372746bfb009acc5832d0954/users/144eef04f8db40e59954c63aa878ad2d/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:46:11.245952 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77166c3-5bb4-4f0e-9183-7eda89b54461 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:11.247553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b73b7-9048-4e3f-be90-95fcce34bb27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:11.249231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b73b7-9048-4e3f-be90-95fcce34bb27 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:11.262013 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2470/4926] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:11.342357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:11.381121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77166c3-5bb4-4f0e-9183-7eda89b54461 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:11.399036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846feaf-457a-48fe-95f9-3a3459274a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:11.399780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846feaf-457a-48fe-95f9-3a3459274a38 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:11.401620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846feaf-457a-48fe-95f9-3a3459274a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:11.402013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846feaf-457a-48fe-95f9-3a3459274a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:11.402811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846feaf-457a-48fe-95f9-3a3459274a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:11.405902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846feaf-457a-48fe-95f9-3a3459274a38 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:11.426452 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2457/4927] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:46:11.429233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b73b7-9048-4e3f-be90-95fcce34bb27 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:11.455602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b73b7-9048-4e3f-be90-95fcce34bb27 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:11.461764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cd402-0f78-4adc-adc1-1839be16ddb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:11.462772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cd402-0f78-4adc-adc1-1839be16ddb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:11.463772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cd402-0f78-4adc-adc1-1839be16ddb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:11.463772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cd402-0f78-4adc-adc1-1839be16ddb4 admin admin] PATH_INFO: `/v3/projects/8d4e3334372746bfb009acc5832d0954/users/144eef04f8db40e59954c63aa878ad2d/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:11.465994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cd402-0f78-4adc-adc1-1839be16ddb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d4e3334372746bfb009acc5832d0954, user_id=144eef04f8db40e59954c63aa878ad2d, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:11.468969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cd402-0f78-4adc-adc1-1839be16ddb4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:11.508529 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2471/4928] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:11 2022] PUT /identity/v3/projects/8d4e3334372746bfb009acc5832d0954/users/144eef04f8db40e59954c63aa878ad2d/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:11.509712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bb2b3-3b33-4353-ae99-51977fb0d0ca None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:11.510164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bb2b3-3b33-4353-ae99-51977fb0d0ca None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:11.510380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bb2b3-3b33-4353-ae99-51977fb0d0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:11.581350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6c7bb2b3-3b33-4353-ae99-51977fb0d0ca None None] MFA Rules not processed for user `144eef04f8db40e59954c63aa878ad2d`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:11.583000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6c7bb2b3-3b33-4353-ae99-51977fb0d0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:11.809005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cd402-0f78-4adc-adc1-1839be16ddb4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:11.815547 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2458/4929] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:11 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:11.822915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cd402-0f78-4adc-adc1-1839be16ddb4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:11.833911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6181b-52df-465f-822e-e7f48fe7a268 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '144eef04f8db40e59954c63aa878ad2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d4e3334372746bfb009acc5832d0954', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:11.838222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6181b-52df-465f-822e-e7f48fe7a268 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:11.838222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6181b-52df-465f-822e-e7f48fe7a268 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:11.838222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6181b-52df-465f-822e-e7f48fe7a268 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:11.838222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6181b-52df-465f-822e-e7f48fe7a268 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:11.840224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6181b-52df-465f-822e-e7f48fe7a268 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:11.965046 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2472/4930] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:11 2022] POST /identity/v3/services => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:11.970462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bb2b3-3b33-4353-ae99-51977fb0d0ca None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:11.984212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bb2b3-3b33-4353-ae99-51977fb0d0ca None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:12.021674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba86ed6-60f7-44e2-b4e5-f3f7dd39a3bd tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '144eef04f8db40e59954c63aa878ad2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d4e3334372746bfb009acc5832d0954', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:12.022736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba86ed6-60f7-44e2-b4e5-f3f7dd39a3bd tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:12.023199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba86ed6-60f7-44e2-b4e5-f3f7dd39a3bd tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:12.023646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba86ed6-60f7-44e2-b4e5-f3f7dd39a3bd tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:12.024555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba86ed6-60f7-44e2-b4e5-f3f7dd39a3bd tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:12.025783 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-6ba86ed6-60f7-44e2-b4e5-f3f7dd39a3bd tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:46:12.025783 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:46:12.025783 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:46:12.026871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba86ed6-60f7-44e2-b4e5-f3f7dd39a3bd tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:12.051683 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-6ba86ed6-60f7-44e2-b4e5-f3f7dd39a3bd tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 27 03:46:12.051683 n-d-862769-1 devstack@keystone.service[82179]: Failed validating 'type' in schema['properties']['enabled']: Oct 27 03:46:12.051683 n-d-862769-1 devstack@keystone.service[82179]: {'enum': [True, False, None], 'type': 'boolean'} Oct 27 03:46:12.051683 n-d-862769-1 devstack@keystone.service[82179]: On instance['enabled']: Oct 27 03:46:12.051683 n-d-862769-1 devstack@keystone.service[82179]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 27 03:46:12.051683 n-d-862769-1 devstack@keystone.service[82179]: Failed validating 'type' in schema['properties']['enabled']: Oct 27 03:46:12.051683 n-d-862769-1 devstack@keystone.service[82179]: {'enum': [True, False, None], 'type': 'boolean'} Oct 27 03:46:12.051683 n-d-862769-1 devstack@keystone.service[82179]: On instance['enabled']: Oct 27 03:46:12.051683 n-d-862769-1 devstack@keystone.service[82179]: 'False' Oct 27 03:46:12.051683 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:46:12.051683 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 27 03:46:12.051683 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 27 03:46:12.051683 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:46:12.051683 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise error Oct 27 03:46:12.051683 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 27 03:46:12.051683 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:12.051683 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 27 03:46:12.051683 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 27 03:46:12.051683 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:12.051683 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application On instance['enabled']: Oct 27 03:46:12.051683 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application 'False' Oct 27 03:46:12.051683 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:12.051683 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:46:12.058928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:12.058928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:46:12.058928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:46:12.058928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:46:12.058928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:46:12.058928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:46:12.058928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:46:12.058928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:46:12.058928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:46:12.058928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:46:12.058928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:46:12.058928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:46:12.058928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 27 03:46:12.058928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 27 03:46:12.058928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 27 03:46:12.058928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 27 03:46:12.058928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 27 03:46:12.060291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 27 03:46:12.060291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 27 03:46:12.060291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:12.060291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 27 03:46:12.060291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 27 03:46:12.060291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:12.060291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application On instance['enabled']: Oct 27 03:46:12.060291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application 'False' Oct 27 03:46:12.060291 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:12.060291 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2459/4931] 10.222.0.20 () {60 vars in 1156 bytes} [Thu Oct 27 03:46:11 2022] POST /identity/v3/endpoints => generated 283 bytes in 84 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 27 03:46:12.061114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6181b-52df-465f-822e-e7f48fe7a268 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:12.080707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6181b-52df-465f-822e-e7f48fe7a268 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:12.093403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f4e48-096b-4f88-8319-80603a513b1f tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '144eef04f8db40e59954c63aa878ad2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d4e3334372746bfb009acc5832d0954', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:12.094124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f4e48-096b-4f88-8319-80603a513b1f tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:12.097627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f4e48-096b-4f88-8319-80603a513b1f tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:12.097627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f4e48-096b-4f88-8319-80603a513b1f tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:12.097627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f4e48-096b-4f88-8319-80603a513b1f tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:12.104385 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-6a3f4e48-096b-4f88-8319-80603a513b1f tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:46:12.104385 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:46:12.104385 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:46:12.111030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f4e48-096b-4f88-8319-80603a513b1f tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:12.127676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-6a3f4e48-096b-4f88-8319-80603a513b1f tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 27 03:46:12.127676 n-d-862769-1 devstack@keystone.service[82180]: Failed validating 'type' in schema['properties']['enabled']: Oct 27 03:46:12.127676 n-d-862769-1 devstack@keystone.service[82180]: {'enum': [True, False, None], 'type': 'boolean'} Oct 27 03:46:12.127676 n-d-862769-1 devstack@keystone.service[82180]: On instance['enabled']: Oct 27 03:46:12.127676 n-d-862769-1 devstack@keystone.service[82180]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 27 03:46:12.127676 n-d-862769-1 devstack@keystone.service[82180]: Failed validating 'type' in schema['properties']['enabled']: Oct 27 03:46:12.127676 n-d-862769-1 devstack@keystone.service[82180]: {'enum': [True, False, None], 'type': 'boolean'} Oct 27 03:46:12.127676 n-d-862769-1 devstack@keystone.service[82180]: On instance['enabled']: Oct 27 03:46:12.127676 n-d-862769-1 devstack@keystone.service[82180]: 'True' Oct 27 03:46:12.127676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:46:12.127676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 27 03:46:12.127676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 27 03:46:12.127676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:46:12.127676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise error Oct 27 03:46:12.127676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 27 03:46:12.127676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:46:12.127676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 27 03:46:12.127676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 27 03:46:12.127676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:46:12.127676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application On instance['enabled']: Oct 27 03:46:12.127676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application 'True' Oct 27 03:46:12.127676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:46:12.127676 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:46:12.131552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:46:12.131552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:46:12.131552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:46:12.131552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:46:12.131552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:46:12.131552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:46:12.131552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:46:12.131552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:46:12.131552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:46:12.131552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:46:12.131552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:46:12.131552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:46:12.131552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 27 03:46:12.131552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 27 03:46:12.131552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 27 03:46:12.131552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 27 03:46:12.131552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 27 03:46:12.132717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 27 03:46:12.132717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 27 03:46:12.132717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:46:12.132717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 27 03:46:12.132717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 27 03:46:12.132717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:46:12.132717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application On instance['enabled']: Oct 27 03:46:12.132717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application 'True' Oct 27 03:46:12.132717 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:46:12.132717 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2473/4932] 10.222.0.20 () {60 vars in 1156 bytes} [Thu Oct 27 03:46:12 2022] POST /identity/v3/endpoints => generated 281 bytes in 71 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 27 03:46:12.136048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba86ed6-60f7-44e2-b4e5-f3f7dd39a3bd tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:12.159957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba86ed6-60f7-44e2-b4e5-f3f7dd39a3bd tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:12.159957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5377944-0765-40e9-9ded-7266490da1c2 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '144eef04f8db40e59954c63aa878ad2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d4e3334372746bfb009acc5832d0954', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:12.159957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5377944-0765-40e9-9ded-7266490da1c2 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:12.160846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5377944-0765-40e9-9ded-7266490da1c2 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:12.160846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5377944-0765-40e9-9ded-7266490da1c2 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:12.166412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5377944-0765-40e9-9ded-7266490da1c2 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:12.172321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5377944-0765-40e9-9ded-7266490da1c2 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:12.200254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f4e48-096b-4f88-8319-80603a513b1f tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:12.204621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6a3f4e48-096b-4f88-8319-80603a513b1f tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:12.321090 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-a5377944-0765-40e9-9ded-7266490da1c2 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1927230110. To ensure interoperability, identifiers should be a valid uuid. Oct 27 03:46:12.321090 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 27 03:46:12.321090 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:46:12.341166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f4e48-096b-4f88-8319-80603a513b1f tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:12.379890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a0d42-53a0-4640-945c-70d900963f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:12.379890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a0d42-53a0-4640-945c-70d900963f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:12.379890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a0d42-53a0-4640-945c-70d900963f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:12.380937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a0d42-53a0-4640-945c-70d900963f7c admin admin] PATH_INFO: `/v3/users/9e197ce88b624971bd05b65cf0f9c782` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:12.385320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a0d42-53a0-4640-945c-70d900963f7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e197ce88b624971bd05b65cf0f9c782)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:12.392567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a0d42-53a0-4640-945c-70d900963f7c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:12.394269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:12.510158 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2460/4933] 10.222.0.20 () {60 vars in 1156 bytes} [Thu Oct 27 03:46:12 2022] POST /identity/v3/endpoints => generated 360 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:12.514074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5377944-0765-40e9-9ded-7266490da1c2 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:12.560439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5377944-0765-40e9-9ded-7266490da1c2 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:12.585041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766a193-986a-437a-bf6a-bfc0fcb7206f tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '144eef04f8db40e59954c63aa878ad2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d4e3334372746bfb009acc5832d0954', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:12.586153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766a193-986a-437a-bf6a-bfc0fcb7206f tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:12.586716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766a193-986a-437a-bf6a-bfc0fcb7206f tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:12.587213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766a193-986a-437a-bf6a-bfc0fcb7206f tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] PATH_INFO: `/v3/regions/tempest-region-1927230110` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:12.588066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766a193-986a-437a-bf6a-bfc0fcb7206f tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1927230110)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:12.589408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766a193-986a-437a-bf6a-bfc0fcb7206f tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:12.592212 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2461/4934] 10.222.0.20 () {58 vars in 1206 bytes} [Thu Oct 27 03:46:12 2022] GET /identity/v3/regions/tempest-region-1927230110 => generated 180 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:46:12.596962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766a193-986a-437a-bf6a-bfc0fcb7206f tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:12.627257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766a193-986a-437a-bf6a-bfc0fcb7206f tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:12.628507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:12.644160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383c086-56cd-4a9d-844f-bddcfa72b46d tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '144eef04f8db40e59954c63aa878ad2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d4e3334372746bfb009acc5832d0954', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:12.645078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383c086-56cd-4a9d-844f-bddcfa72b46d tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:12.645586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383c086-56cd-4a9d-844f-bddcfa72b46d tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:12.646404 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383c086-56cd-4a9d-844f-bddcfa72b46d tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] PATH_INFO: `/v3/endpoints/82c0e1d5cb4542bdba0240d490d5789d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:12.666714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383c086-56cd-4a9d-844f-bddcfa72b46d tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=82c0e1d5cb4542bdba0240d490d5789d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:12.668112 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-d383c086-56cd-4a9d-844f-bddcfa72b46d tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:46:12.668112 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:46:12.668112 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:46:12.670322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383c086-56cd-4a9d-844f-bddcfa72b46d tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:12.675164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fe2a0d42-53a0-4640-945c-70d900963f7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e197ce88b624971bd05b65cf0f9c782'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:12.676257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fe2a0d42-53a0-4640-945c-70d900963f7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e197ce88b624971bd05b65cf0f9c782'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:12.689780 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-d383c086-56cd-4a9d-844f-bddcfa72b46d tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 27 03:46:12.689780 n-d-862769-1 devstack@keystone.service[82179]: Failed validating 'type' in schema['properties']['enabled']: Oct 27 03:46:12.689780 n-d-862769-1 devstack@keystone.service[82179]: {'enum': [True, False, None], 'type': 'boolean'} Oct 27 03:46:12.689780 n-d-862769-1 devstack@keystone.service[82179]: On instance['enabled']: Oct 27 03:46:12.689780 n-d-862769-1 devstack@keystone.service[82179]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 27 03:46:12.689780 n-d-862769-1 devstack@keystone.service[82179]: Failed validating 'type' in schema['properties']['enabled']: Oct 27 03:46:12.689780 n-d-862769-1 devstack@keystone.service[82179]: {'enum': [True, False, None], 'type': 'boolean'} Oct 27 03:46:12.689780 n-d-862769-1 devstack@keystone.service[82179]: On instance['enabled']: Oct 27 03:46:12.689780 n-d-862769-1 devstack@keystone.service[82179]: 'False' Oct 27 03:46:12.689780 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:46:12.689780 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 27 03:46:12.689780 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 27 03:46:12.689780 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:46:12.689780 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise error Oct 27 03:46:12.689780 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 27 03:46:12.689780 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:12.689780 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 27 03:46:12.689780 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 27 03:46:12.689780 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:12.689780 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application On instance['enabled']: Oct 27 03:46:12.689780 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application 'False' Oct 27 03:46:12.689780 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:12.689780 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:46:12.694066 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:12.694066 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:46:12.694066 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:46:12.694066 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:46:12.694066 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:46:12.694066 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:46:12.694066 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:46:12.694066 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:46:12.694066 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:46:12.694066 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:46:12.694066 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:46:12.694066 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:46:12.694066 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 27 03:46:12.694066 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 27 03:46:12.694066 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 27 03:46:12.694066 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 27 03:46:12.694066 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 27 03:46:12.695503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 27 03:46:12.695503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 27 03:46:12.695503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:12.695503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 27 03:46:12.695503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 27 03:46:12.695503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:12.695503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application On instance['enabled']: Oct 27 03:46:12.695503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application 'False' Oct 27 03:46:12.695503 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:12.695503 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2462/4935] 10.222.0.20 () {60 vars in 1255 bytes} [Thu Oct 27 03:46:12 2022] PATCH /identity/v3/endpoints/82c0e1d5cb4542bdba0240d490d5789d => generated 283 bytes in 95 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 27 03:46:12.695503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383c086-56cd-4a9d-844f-bddcfa72b46d tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:12.702719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d383c086-56cd-4a9d-844f-bddcfa72b46d tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:12.706089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fe2a0d42-53a0-4640-945c-70d900963f7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e197ce88b624971bd05b65cf0f9c782'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:12.751609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fe2a0d42-53a0-4640-945c-70d900963f7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e197ce88b624971bd05b65cf0f9c782'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:12.753848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383c086-56cd-4a9d-844f-bddcfa72b46d tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:12.756505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fe2a0d42-53a0-4640-945c-70d900963f7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e197ce88b624971bd05b65cf0f9c782'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:12.767358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b43fe-bbb7-48c6-81dd-d4acae8258d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:12.768180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b43fe-bbb7-48c6-81dd-d4acae8258d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:12.768568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b43fe-bbb7-48c6-81dd-d4acae8258d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:12.769265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b43fe-bbb7-48c6-81dd-d4acae8258d5 admin admin] PATH_INFO: `/v3/projects/d3f51ad7c5194372ad4dc2e5b0d5c65b` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:12.771925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b43fe-bbb7-48c6-81dd-d4acae8258d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3f51ad7c5194372ad4dc2e5b0d5c65b)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:12.775168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b43fe-bbb7-48c6-81dd-d4acae8258d5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:12.860228 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2474/4936] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:12 2022] DELETE /identity/v3/users/9e197ce88b624971bd05b65cf0f9c782 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:12.860228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a0d42-53a0-4640-945c-70d900963f7c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:12.860228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fe2a0d42-53a0-4640-945c-70d900963f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:13.025192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6d0b43fe-bbb7-48c6-81dd-d4acae8258d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3f51ad7c5194372ad4dc2e5b0d5c65b', 'request_id': 'req-6d0b43fe-bbb7-48c6-81dd-d4acae8258d5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:13.070962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a0d42-53a0-4640-945c-70d900963f7c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:13.162203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6d0b43fe-bbb7-48c6-81dd-d4acae8258d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3f51ad7c5194372ad4dc2e5b0d5c65b', 'request_id': 'req-6d0b43fe-bbb7-48c6-81dd-d4acae8258d5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:13.173430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6d0b43fe-bbb7-48c6-81dd-d4acae8258d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3f51ad7c5194372ad4dc2e5b0d5c65b', 'request_id': 'req-6d0b43fe-bbb7-48c6-81dd-d4acae8258d5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:13.221502 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6d0b43fe-bbb7-48c6-81dd-d4acae8258d5 admin admin] The token cache is being invalidate because project d3f51ad7c5194372ad4dc2e5b0d5c65b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:13.221857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6d0b43fe-bbb7-48c6-81dd-d4acae8258d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:13.223160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6d0b43fe-bbb7-48c6-81dd-d4acae8258d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:13.227172 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2463/4937] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:12 2022] DELETE /identity/v3/projects/d3f51ad7c5194372ad4dc2e5b0d5c65b => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:13.228822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3767d2-3a0d-40a3-ac41-bf227073be9f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:13.229115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3767d2-3a0d-40a3-ac41-bf227073be9f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:13.231625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3767d2-3a0d-40a3-ac41-bf227073be9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:13.301154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2486d3-1a66-4fc6-85ad-d42b5ba2886c tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '144eef04f8db40e59954c63aa878ad2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d4e3334372746bfb009acc5832d0954', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:13.302853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8c3767d2-3a0d-40a3-ac41-bf227073be9f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:13.304457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8c3767d2-3a0d-40a3-ac41-bf227073be9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:13.310613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2486d3-1a66-4fc6-85ad-d42b5ba2886c tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:13.310998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2486d3-1a66-4fc6-85ad-d42b5ba2886c tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:13.311284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2486d3-1a66-4fc6-85ad-d42b5ba2886c tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] PATH_INFO: `/v3/endpoints/82c0e1d5cb4542bdba0240d490d5789d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:13.314561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2486d3-1a66-4fc6-85ad-d42b5ba2886c tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=82c0e1d5cb4542bdba0240d490d5789d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:13.315589 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-5a2486d3-1a66-4fc6-85ad-d42b5ba2886c tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:46:13.315589 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:46:13.315589 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:46:13.326634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2486d3-1a66-4fc6-85ad-d42b5ba2886c tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:13.415241 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2464/4938] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:13 2022] POST /identity/v3/auth/tokens => generated 3553 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:13.416448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3767d2-3a0d-40a3-ac41-bf227073be9f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:13.418283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8c3767d2-3a0d-40a3-ac41-bf227073be9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:13.427749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5a2486d3-1a66-4fc6-85ad-d42b5ba2886c tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '82c0e1d5cb4542bdba0240d490d5789d', 'request_id': 'req-5a2486d3-1a66-4fc6-85ad-d42b5ba2886c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:13.446738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3767d2-3a0d-40a3-ac41-bf227073be9f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:13.453656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2e66d-297b-4ac3-8f56-3a9e7e7d143e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:13.456088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2e66d-297b-4ac3-8f56-3a9e7e7d143e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:13.456541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2e66d-297b-4ac3-8f56-3a9e7e7d143e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:13.456948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2e66d-297b-4ac3-8f56-3a9e7e7d143e admin admin] PATH_INFO: `/v3/users/0de3f34d53e84b71bc151bb268187c31` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:13.458477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2e66d-297b-4ac3-8f56-3a9e7e7d143e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de3f34d53e84b71bc151bb268187c31)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:13.460885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2e66d-297b-4ac3-8f56-3a9e7e7d143e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:13.462368 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2475/4939] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:12 2022] DELETE /identity/v3/endpoints/82c0e1d5cb4542bdba0240d490d5789d => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:13.463394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2486d3-1a66-4fc6-85ad-d42b5ba2886c tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:13.465766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5a2486d3-1a66-4fc6-85ad-d42b5ba2886c tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:13.590027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2486d3-1a66-4fc6-85ad-d42b5ba2886c tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:13.595064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b631af4-007d-485e-acc5-cff9d1e45509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:13.596691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b631af4-007d-485e-acc5-cff9d1e45509 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:13.596974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b631af4-007d-485e-acc5-cff9d1e45509 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:13.597260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b631af4-007d-485e-acc5-cff9d1e45509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:13.618167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b631af4-007d-485e-acc5-cff9d1e45509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:13.623718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b631af4-007d-485e-acc5-cff9d1e45509 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:13.679120 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2476/4940] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:13 2022] GET /identity/v3/auth/tokens => generated 3371 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:13.680083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b631af4-007d-485e-acc5-cff9d1e45509 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:13.683141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8b631af4-007d-485e-acc5-cff9d1e45509 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:13.709407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:13.733380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b631af4-007d-485e-acc5-cff9d1e45509 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:13.743607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ea716-e776-4388-95bd-f7ce873ce2b2 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '144eef04f8db40e59954c63aa878ad2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d4e3334372746bfb009acc5832d0954', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:13.744274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ea716-e776-4388-95bd-f7ce873ce2b2 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:13.744581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ea716-e776-4388-95bd-f7ce873ce2b2 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:13.744854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ea716-e776-4388-95bd-f7ce873ce2b2 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] PATH_INFO: `/v3/regions/tempest-region-1927230110` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:13.745458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ea716-e776-4388-95bd-f7ce873ce2b2 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1927230110)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:13.746600 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-e35ea716-e776-4388-95bd-f7ce873ce2b2 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:46:13.746600 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:46:13.746600 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:46:13.747419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ea716-e776-4388-95bd-f7ce873ce2b2 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:13.765512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e6d2e66d-297b-4ac3-8f56-3a9e7e7d143e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de3f34d53e84b71bc151bb268187c31'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:13.767379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e6d2e66d-297b-4ac3-8f56-3a9e7e7d143e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de3f34d53e84b71bc151bb268187c31'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:13.784034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e6d2e66d-297b-4ac3-8f56-3a9e7e7d143e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de3f34d53e84b71bc151bb268187c31'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:13.829669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e6d2e66d-297b-4ac3-8f56-3a9e7e7d143e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de3f34d53e84b71bc151bb268187c31'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:13.916638 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-e35ea716-e776-4388-95bd-f7ce873ce2b2 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1927230110. To ensure interoperability, identifiers should be a valid uuid. Oct 27 03:46:13.916638 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 27 03:46:13.916638 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:46:13.925822 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2477/4941] 10.222.0.20 () {58 vars in 1209 bytes} [Thu Oct 27 03:46:13 2022] DELETE /identity/v3/regions/tempest-region-1927230110 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:13.930572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ea716-e776-4388-95bd-f7ce873ce2b2 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:13.933161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e35ea716-e776-4388-95bd-f7ce873ce2b2 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:13.956921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e6d2e66d-297b-4ac3-8f56-3a9e7e7d143e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de3f34d53e84b71bc151bb268187c31'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:13.972595 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2465/4942] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:13 2022] DELETE /identity/v3/users/0de3f34d53e84b71bc151bb268187c31 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:13.986321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ea716-e776-4388-95bd-f7ce873ce2b2 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:14.096463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24bde2-91d4-427c-a571-e92bc5ff0c4b tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '144eef04f8db40e59954c63aa878ad2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d4e3334372746bfb009acc5832d0954', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:14.102998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24bde2-91d4-427c-a571-e92bc5ff0c4b tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:14.102998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24bde2-91d4-427c-a571-e92bc5ff0c4b tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:14.102998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24bde2-91d4-427c-a571-e92bc5ff0c4b tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:14.102998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24bde2-91d4-427c-a571-e92bc5ff0c4b tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:14.103430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24bde2-91d4-427c-a571-e92bc5ff0c4b tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:14.190579 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-7f24bde2-91d4-427c-a571-e92bc5ff0c4b tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1908774656. To ensure interoperability, identifiers should be a valid uuid. Oct 27 03:46:14.190579 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 27 03:46:14.190579 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:46:14.303805 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2478/4943] 10.222.0.20 () {60 vars in 1156 bytes} [Thu Oct 27 03:46:13 2022] POST /identity/v3/endpoints => generated 361 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:46:14.306373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2e66d-297b-4ac3-8f56-3a9e7e7d143e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:14.326731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2e66d-297b-4ac3-8f56-3a9e7e7d143e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:14.372322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489d754-c618-47c7-9f9f-70844aeac057 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '144eef04f8db40e59954c63aa878ad2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d4e3334372746bfb009acc5832d0954', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:14.373055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489d754-c618-47c7-9f9f-70844aeac057 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:14.374463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489d754-c618-47c7-9f9f-70844aeac057 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:14.374987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489d754-c618-47c7-9f9f-70844aeac057 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] PATH_INFO: `/v3/regions/tempest-region-1908774656` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:14.375658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489d754-c618-47c7-9f9f-70844aeac057 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1908774656)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:14.376797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489d754-c618-47c7-9f9f-70844aeac057 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:14.386750 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2466/4944] 10.222.0.20 () {58 vars in 1206 bytes} [Thu Oct 27 03:46:14 2022] GET /identity/v3/regions/tempest-region-1908774656 => generated 180 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:14.389540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24bde2-91d4-427c-a571-e92bc5ff0c4b tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:14.397460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489d754-c618-47c7-9f9f-70844aeac057 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:14.399366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1489d754-c618-47c7-9f9f-70844aeac057 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:14.410009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24bde2-91d4-427c-a571-e92bc5ff0c4b tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:14.426792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c107334-b902-40b5-bb03-eb8efd0f10dc tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '144eef04f8db40e59954c63aa878ad2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d4e3334372746bfb009acc5832d0954', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:14.428009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c107334-b902-40b5-bb03-eb8efd0f10dc tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:14.428625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c107334-b902-40b5-bb03-eb8efd0f10dc tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:14.429379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c107334-b902-40b5-bb03-eb8efd0f10dc tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] PATH_INFO: `/v3/endpoints/c9487dadd13649b1a6d327b7aacb55d0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:14.462873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c107334-b902-40b5-bb03-eb8efd0f10dc tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=c9487dadd13649b1a6d327b7aacb55d0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:14.472033 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-2c107334-b902-40b5-bb03-eb8efd0f10dc tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:46:14.472033 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:46:14.472033 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:46:14.472520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c107334-b902-40b5-bb03-eb8efd0f10dc tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:14.482745 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-2c107334-b902-40b5-bb03-eb8efd0f10dc tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 27 03:46:14.482745 n-d-862769-1 devstack@keystone.service[82180]: Failed validating 'type' in schema['properties']['enabled']: Oct 27 03:46:14.482745 n-d-862769-1 devstack@keystone.service[82180]: {'enum': [True, False, None], 'type': 'boolean'} Oct 27 03:46:14.482745 n-d-862769-1 devstack@keystone.service[82180]: On instance['enabled']: Oct 27 03:46:14.482745 n-d-862769-1 devstack@keystone.service[82180]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 27 03:46:14.482745 n-d-862769-1 devstack@keystone.service[82180]: Failed validating 'type' in schema['properties']['enabled']: Oct 27 03:46:14.482745 n-d-862769-1 devstack@keystone.service[82180]: {'enum': [True, False, None], 'type': 'boolean'} Oct 27 03:46:14.482745 n-d-862769-1 devstack@keystone.service[82180]: On instance['enabled']: Oct 27 03:46:14.482745 n-d-862769-1 devstack@keystone.service[82180]: 'True' Oct 27 03:46:14.482745 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:46:14.482745 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 27 03:46:14.482745 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 27 03:46:14.482745 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:46:14.482745 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise error Oct 27 03:46:14.482745 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 27 03:46:14.482745 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:46:14.482745 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 27 03:46:14.482745 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 27 03:46:14.482745 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:46:14.482745 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application On instance['enabled']: Oct 27 03:46:14.482745 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application 'True' Oct 27 03:46:14.482745 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:46:14.482745 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:46:14.484725 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:46:14.484725 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:46:14.484725 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:46:14.484725 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:46:14.484725 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:46:14.484725 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:46:14.484725 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:46:14.484725 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:46:14.484725 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:46:14.484725 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:46:14.484725 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:46:14.484725 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:46:14.484725 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 27 03:46:14.484725 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 27 03:46:14.484725 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 27 03:46:14.484725 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 27 03:46:14.484725 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 27 03:46:14.486667 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 27 03:46:14.486667 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 27 03:46:14.486667 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:46:14.486667 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 27 03:46:14.486667 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 27 03:46:14.486667 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:46:14.486667 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application On instance['enabled']: Oct 27 03:46:14.486667 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application 'True' Oct 27 03:46:14.486667 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:46:14.488626 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2479/4945] 10.222.0.20 () {60 vars in 1255 bytes} [Thu Oct 27 03:46:14 2022] PATCH /identity/v3/endpoints/c9487dadd13649b1a6d327b7aacb55d0 => generated 281 bytes in 99 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 27 03:46:14.493500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c107334-b902-40b5-bb03-eb8efd0f10dc tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:14.528709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c107334-b902-40b5-bb03-eb8efd0f10dc tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:14.552198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cb86f-bd60-4412-972d-d9f5ba4b141c tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '144eef04f8db40e59954c63aa878ad2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d4e3334372746bfb009acc5832d0954', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:14.553107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cb86f-bd60-4412-972d-d9f5ba4b141c tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:14.553566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cb86f-bd60-4412-972d-d9f5ba4b141c tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:14.554021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cb86f-bd60-4412-972d-d9f5ba4b141c tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] PATH_INFO: `/v3/endpoints/c9487dadd13649b1a6d327b7aacb55d0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:14.558010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1cb86f-bd60-4412-972d-d9f5ba4b141c tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=c9487dadd13649b1a6d327b7aacb55d0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:14.558237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489d754-c618-47c7-9f9f-70844aeac057 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:14.564599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5295146-4ea4-4a15-a87f-98940e5a3aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:14.565455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5295146-4ea4-4a15-a87f-98940e5a3aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:14.565791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1cb86f-bd60-4412-972d-d9f5ba4b141c tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:14.565954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5295146-4ea4-4a15-a87f-98940e5a3aca admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:14.566305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5295146-4ea4-4a15-a87f-98940e5a3aca admin admin] PATH_INFO: `/v3/projects/b95556bbad1a4411b4fee590ade992fa` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:14.567362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5295146-4ea4-4a15-a87f-98940e5a3aca admin admin] RBAC: Authorizing `identity:delete_project(project_id=b95556bbad1a4411b4fee590ade992fa)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:14.569380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5295146-4ea4-4a15-a87f-98940e5a3aca admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:14.664785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fc1cb86f-bd60-4412-972d-d9f5ba4b141c tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'c9487dadd13649b1a6d327b7aacb55d0', 'request_id': 'req-fc1cb86f-bd60-4412-972d-d9f5ba4b141c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:14.685052 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2480/4946] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:14 2022] DELETE /identity/v3/endpoints/c9487dadd13649b1a6d327b7aacb55d0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:14.689802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cb86f-bd60-4412-972d-d9f5ba4b141c tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:14.751884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cb86f-bd60-4412-972d-d9f5ba4b141c tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:14.765000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:14.789259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5295146-4ea4-4a15-a87f-98940e5a3aca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b95556bbad1a4411b4fee590ade992fa', 'request_id': 'req-a5295146-4ea4-4a15-a87f-98940e5a3aca'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:14.912333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989de09-6738-4f27-a72a-068f452eb1e5 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '144eef04f8db40e59954c63aa878ad2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d4e3334372746bfb009acc5832d0954', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:14.913004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989de09-6738-4f27-a72a-068f452eb1e5 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:14.913294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989de09-6738-4f27-a72a-068f452eb1e5 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:14.913572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989de09-6738-4f27-a72a-068f452eb1e5 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] PATH_INFO: `/v3/regions/tempest-region-1908774656` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:14.914199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989de09-6738-4f27-a72a-068f452eb1e5 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1908774656)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:14.915810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989de09-6738-4f27-a72a-068f452eb1e5 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:14.919069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5295146-4ea4-4a15-a87f-98940e5a3aca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b95556bbad1a4411b4fee590ade992fa', 'request_id': 'req-a5295146-4ea4-4a15-a87f-98940e5a3aca'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:14.927305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5295146-4ea4-4a15-a87f-98940e5a3aca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b95556bbad1a4411b4fee590ade992fa', 'request_id': 'req-a5295146-4ea4-4a15-a87f-98940e5a3aca'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:14.952073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5295146-4ea4-4a15-a87f-98940e5a3aca admin admin] The token cache is being invalidate because project b95556bbad1a4411b4fee590ade992fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:14.958271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5295146-4ea4-4a15-a87f-98940e5a3aca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:14.959336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5295146-4ea4-4a15-a87f-98940e5a3aca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:14.961500 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2467/4947] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:14 2022] DELETE /identity/v3/projects/b95556bbad1a4411b4fee590ade992fa => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:46:14.965419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5295146-4ea4-4a15-a87f-98940e5a3aca admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:14.968813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a5295146-4ea4-4a15-a87f-98940e5a3aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:15.021382 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2481/4948] 10.222.0.20 () {58 vars in 1209 bytes} [Thu Oct 27 03:46:14 2022] DELETE /identity/v3/regions/tempest-region-1908774656 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:46:15.026445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989de09-6738-4f27-a72a-068f452eb1e5 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:15.030211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f989de09-6738-4f27-a72a-068f452eb1e5 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:15.081832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989de09-6738-4f27-a72a-068f452eb1e5 tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:15.095988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95343218-b189-4fed-8692-128dd1b19d0e tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '144eef04f8db40e59954c63aa878ad2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d4e3334372746bfb009acc5832d0954', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:15.096659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95343218-b189-4fed-8692-128dd1b19d0e tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:15.096945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95343218-b189-4fed-8692-128dd1b19d0e tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:15.097278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95343218-b189-4fed-8692-128dd1b19d0e tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] PATH_INFO: `/v3/services/099f5cc598824c1ea99646d8bc981cd4` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:15.097935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95343218-b189-4fed-8692-128dd1b19d0e tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorizing `identity:delete_service(service_id=099f5cc598824c1ea99646d8bc981cd4)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:15.104224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95343218-b189-4fed-8692-128dd1b19d0e tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:15.186131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5295146-4ea4-4a15-a87f-98940e5a3aca admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:15.218203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43e9be-956b-4f54-977e-cb170fc5e3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:15.230646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43e9be-956b-4f54-977e-cb170fc5e3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:15.231037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43e9be-956b-4f54-977e-cb170fc5e3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:15.231384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43e9be-956b-4f54-977e-cb170fc5e3f8 admin admin] PATH_INFO: `/v3/users/ebc0c82c28b84ca8908364c34abb0a48` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:15.233045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43e9be-956b-4f54-977e-cb170fc5e3f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebc0c82c28b84ca8908364c34abb0a48)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:15.240353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43e9be-956b-4f54-977e-cb170fc5e3f8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:15.256983 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2482/4949] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:15 2022] DELETE /identity/v3/services/099f5cc598824c1ea99646d8bc981cd4 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:46:15.259082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95343218-b189-4fed-8692-128dd1b19d0e tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:15.262769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-95343218-b189-4fed-8692-128dd1b19d0e tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:15.326123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95343218-b189-4fed-8692-128dd1b19d0e tempest-EndpointsNegativeTestJSON-1908617367 tempest-EndpointsNegativeTestJSON-1908617367-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:15.340162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec42a80-ec7f-4ea2-b4c0-2a7ec5e353be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:15.345398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec42a80-ec7f-4ea2-b4c0-2a7ec5e353be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:15.345398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec42a80-ec7f-4ea2-b4c0-2a7ec5e353be admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:15.345398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec42a80-ec7f-4ea2-b4c0-2a7ec5e353be admin admin] PATH_INFO: `/v3/users/0c69d98a86894431b48a67306457af43` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:15.345398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec42a80-ec7f-4ea2-b4c0-2a7ec5e353be admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c69d98a86894431b48a67306457af43)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:15.347337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec42a80-ec7f-4ea2-b4c0-2a7ec5e353be admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:15.368357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:15.584737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ff43e9be-956b-4f54-977e-cb170fc5e3f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebc0c82c28b84ca8908364c34abb0a48'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:15.593787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ff43e9be-956b-4f54-977e-cb170fc5e3f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebc0c82c28b84ca8908364c34abb0a48'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:15.628661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ff43e9be-956b-4f54-977e-cb170fc5e3f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebc0c82c28b84ca8908364c34abb0a48'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:15.670660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dec42a80-ec7f-4ea2-b4c0-2a7ec5e353be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c69d98a86894431b48a67306457af43'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:15.671551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dec42a80-ec7f-4ea2-b4c0-2a7ec5e353be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c69d98a86894431b48a67306457af43'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:15.679776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ff43e9be-956b-4f54-977e-cb170fc5e3f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebc0c82c28b84ca8908364c34abb0a48'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:15.685188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dec42a80-ec7f-4ea2-b4c0-2a7ec5e353be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c69d98a86894431b48a67306457af43'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:15.732439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dec42a80-ec7f-4ea2-b4c0-2a7ec5e353be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c69d98a86894431b48a67306457af43'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:15.733517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dec42a80-ec7f-4ea2-b4c0-2a7ec5e353be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c69d98a86894431b48a67306457af43'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:15.834334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ff43e9be-956b-4f54-977e-cb170fc5e3f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebc0c82c28b84ca8908364c34abb0a48'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:15.840937 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2468/4950] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:14 2022] DELETE /identity/v3/users/ebc0c82c28b84ca8908364c34abb0a48 => generated 0 bytes in 875 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:15.841607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43e9be-956b-4f54-977e-cb170fc5e3f8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:15.843207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ff43e9be-956b-4f54-977e-cb170fc5e3f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:15.937245 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2483/4951] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:15 2022] DELETE /identity/v3/users/0c69d98a86894431b48a67306457af43 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:15.939208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03584de-aa83-4b1c-a027-2737f5b389c4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:15.939506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03584de-aa83-4b1c-a027-2737f5b389c4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:15.939833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03584de-aa83-4b1c-a027-2737f5b389c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:16.043003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f03584de-aa83-4b1c-a027-2737f5b389c4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:16.049409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f03584de-aa83-4b1c-a027-2737f5b389c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:16.112230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43e9be-956b-4f54-977e-cb170fc5e3f8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:16.227881 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2484/4952] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:16.254799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a2b79-9d4f-4905-b7a8-d06e4b05f815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:16.256145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a2b79-9d4f-4905-b7a8-d06e4b05f815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:16.257426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a2b79-9d4f-4905-b7a8-d06e4b05f815 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:16.259765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a2b79-9d4f-4905-b7a8-d06e4b05f815 admin admin] PATH_INFO: `/v3/projects/0d3f358072754e04bfe5176df24993b1` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:16.266847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a2b79-9d4f-4905-b7a8-d06e4b05f815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d3f358072754e04bfe5176df24993b1)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:16.272624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a2b79-9d4f-4905-b7a8-d06e4b05f815 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:16.404236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03584de-aa83-4b1c-a027-2737f5b389c4 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:16.406457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f03584de-aa83-4b1c-a027-2737f5b389c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:16.428860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a51a2b79-9d4f-4905-b7a8-d06e4b05f815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d3f358072754e04bfe5176df24993b1', 'request_id': 'req-a51a2b79-9d4f-4905-b7a8-d06e4b05f815'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:16.537026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a51a2b79-9d4f-4905-b7a8-d06e4b05f815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d3f358072754e04bfe5176df24993b1', 'request_id': 'req-a51a2b79-9d4f-4905-b7a8-d06e4b05f815'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:16.547244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03584de-aa83-4b1c-a027-2737f5b389c4 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:16.548208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a51a2b79-9d4f-4905-b7a8-d06e4b05f815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d3f358072754e04bfe5176df24993b1', 'request_id': 'req-a51a2b79-9d4f-4905-b7a8-d06e4b05f815'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:16.578127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a51a2b79-9d4f-4905-b7a8-d06e4b05f815 admin admin] The token cache is being invalidate because project 0d3f358072754e04bfe5176df24993b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:16.578449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a51a2b79-9d4f-4905-b7a8-d06e4b05f815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:16.583116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a51a2b79-9d4f-4905-b7a8-d06e4b05f815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:16.591495 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2469/4953] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:15 2022] DELETE /identity/v3/projects/0d3f358072754e04bfe5176df24993b1 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:16.595311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9613bc-7d98-49f2-8621-da6e4e42e0a4 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:16.595644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9613bc-7d98-49f2-8621-da6e4e42e0a4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:16.595930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9613bc-7d98-49f2-8621-da6e4e42e0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:16.643436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:16.658212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-de9613bc-7d98-49f2-8621-da6e4e42e0a4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:16.659255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-de9613bc-7d98-49f2-8621-da6e4e42e0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:16.702492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce16c70-ad6c-4ab3-93b1-3d9bd61cb747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:16.703551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce16c70-ad6c-4ab3-93b1-3d9bd61cb747 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:16.712791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce16c70-ad6c-4ab3-93b1-3d9bd61cb747 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:16.718532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce16c70-ad6c-4ab3-93b1-3d9bd61cb747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:16.724404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6ce16c70-ad6c-4ab3-93b1-3d9bd61cb747 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:16.738259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:16.780171 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2470/4954] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:16.783726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd6c74-ab33-4f33-bef8-e80370f9e79c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:16.784025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd6c74-ab33-4f33-bef8-e80370f9e79c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:16.784435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd6c74-ab33-4f33-bef8-e80370f9e79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:16.870554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-23cd6c74-ab33-4f33-bef8-e80370f9e79c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:16.878366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-23cd6c74-ab33-4f33-bef8-e80370f9e79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:16.894639 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2471/4955] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:16.898949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd6c74-ab33-4f33-bef8-e80370f9e79c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:16.907080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce16c70-ad6c-4ab3-93b1-3d9bd61cb747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:16.911975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd6c74-ab33-4f33-bef8-e80370f9e79c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:16.913172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce16c70-ad6c-4ab3-93b1-3d9bd61cb747 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:16.918420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f77e1-eec4-4dba-9a1b-f4d12c0586cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:16.919740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f77e1-eec4-4dba-9a1b-f4d12c0586cb admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:16.920388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f77e1-eec4-4dba-9a1b-f4d12c0586cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:16.921046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f77e1-eec4-4dba-9a1b-f4d12c0586cb admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:16.921941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f77e1-eec4-4dba-9a1b-f4d12c0586cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:46:16.923085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f77e1-eec4-4dba-9a1b-f4d12c0586cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:16.925747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f77e1-eec4-4dba-9a1b-f4d12c0586cb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:16.967362 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2485/4956] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:46:16.976657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce16c70-ad6c-4ab3-93b1-3d9bd61cb747 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:16.980776 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2472/4957] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:46:16.990838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce16c70-ad6c-4ab3-93b1-3d9bd61cb747 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:16.996272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c785cd-d68f-4003-9ac4-97f61c3056b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:16.997149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c785cd-d68f-4003-9ac4-97f61c3056b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:16.998998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c785cd-d68f-4003-9ac4-97f61c3056b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:16.998998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c785cd-d68f-4003-9ac4-97f61c3056b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:16.998998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c785cd-d68f-4003-9ac4-97f61c3056b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:17.000252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c785cd-d68f-4003-9ac4-97f61c3056b1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:17.119921 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2486/4958] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:16 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:17.143710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f77e1-eec4-4dba-9a1b-f4d12c0586cb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:17.166556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f77e1-eec4-4dba-9a1b-f4d12c0586cb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:17.284464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972668c-9d57-498c-8686-18f36ea71a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:17.286358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972668c-9d57-498c-8686-18f36ea71a66 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:17.286890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972668c-9d57-498c-8686-18f36ea71a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:17.294199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972668c-9d57-498c-8686-18f36ea71a66 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:17.296711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972668c-9d57-498c-8686-18f36ea71a66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:17.297410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972668c-9d57-498c-8686-18f36ea71a66 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:17.431931 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2473/4959] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:17 2022] POST /identity/v3/users => generated 286 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:17.436886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c785cd-d68f-4003-9ac4-97f61c3056b1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:17.458838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c785cd-d68f-4003-9ac4-97f61c3056b1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:17.480065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf098d-9f21-4102-ba1b-4eadca2e9dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:17.481409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf098d-9f21-4102-ba1b-4eadca2e9dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:17.482181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf098d-9f21-4102-ba1b-4eadca2e9dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:17.486298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf098d-9f21-4102-ba1b-4eadca2e9dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:17.486298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf098d-9f21-4102-ba1b-4eadca2e9dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:17.489198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf098d-9f21-4102-ba1b-4eadca2e9dd0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:17.503053 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2487/4960] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:17.507068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972668c-9d57-498c-8686-18f36ea71a66 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:17.528778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972668c-9d57-498c-8686-18f36ea71a66 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:17.544322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ea18f-b58a-4d0b-b489-8e9c03b9cb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:17.544769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ea18f-b58a-4d0b-b489-8e9c03b9cb07 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:17.545064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ea18f-b58a-4d0b-b489-8e9c03b9cb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:17.545238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ea18f-b58a-4d0b-b489-8e9c03b9cb07 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:17.545896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ea18f-b58a-4d0b-b489-8e9c03b9cb07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:17.547760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ea18f-b58a-4d0b-b489-8e9c03b9cb07 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:17.574387 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2474/4961] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:46:17.579844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf098d-9f21-4102-ba1b-4eadca2e9dd0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:17.608416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf098d-9f21-4102-ba1b-4eadca2e9dd0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:17.635996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504b6a9-3654-4502-8439-38cb9ef3f6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:17.636692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504b6a9-3654-4502-8439-38cb9ef3f6e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:17.636981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504b6a9-3654-4502-8439-38cb9ef3f6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:17.637261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504b6a9-3654-4502-8439-38cb9ef3f6e3 admin admin] PATH_INFO: `/v3/projects/290d9ee521664aa9be518611e64d2d9c/users/a73f3d2d8ddd4ab9bfaa825e248181e4/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:17.661174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504b6a9-3654-4502-8439-38cb9ef3f6e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=290d9ee521664aa9be518611e64d2d9c, user_id=a73f3d2d8ddd4ab9bfaa825e248181e4, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:17.669338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504b6a9-3654-4502-8439-38cb9ef3f6e3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:17.749161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:17.762863 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2488/4962] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:17 2022] PUT /identity/v3/projects/290d9ee521664aa9be518611e64d2d9c/users/a73f3d2d8ddd4ab9bfaa825e248181e4/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:17.774576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2b71d-7a84-452e-9a5b-59d9a915e645 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:17.774894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2b71d-7a84-452e-9a5b-59d9a915e645 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:17.775181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2b71d-7a84-452e-9a5b-59d9a915e645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:17.789260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504b6a9-3654-4502-8439-38cb9ef3f6e3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:17.791369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5504b6a9-3654-4502-8439-38cb9ef3f6e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:17.807494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-49c2b71d-7a84-452e-9a5b-59d9a915e645 None None] MFA Rules not processed for user `a73f3d2d8ddd4ab9bfaa825e248181e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:17.810818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-49c2b71d-7a84-452e-9a5b-59d9a915e645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:17.972090 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2475/4963] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:17.977066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2b71d-7a84-452e-9a5b-59d9a915e645 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:18.001463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2b71d-7a84-452e-9a5b-59d9a915e645 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:18.015320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504b6a9-3654-4502-8439-38cb9ef3f6e3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:18.021315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc3ec2-8687-4753-98c0-c9ef2c98e3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:18.029821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc3ec2-8687-4753-98c0-c9ef2c98e3ff admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:18.030264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc3ec2-8687-4753-98c0-c9ef2c98e3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:18.030561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc3ec2-8687-4753-98c0-c9ef2c98e3ff admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:18.031275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc3ec2-8687-4753-98c0-c9ef2c98e3ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:18.033622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc3ec2-8687-4753-98c0-c9ef2c98e3ff admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:18.038305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3b50e-c68f-4d71-8636-19fba64ac945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:18.039627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3b50e-c68f-4d71-8636-19fba64ac945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:18.039627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3b50e-c68f-4d71-8636-19fba64ac945 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:18.039627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3b50e-c68f-4d71-8636-19fba64ac945 admin admin] PATH_INFO: `/v3/projects/12fac4638da842b19095f6bdcdabac5e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:18.052415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3b50e-c68f-4d71-8636-19fba64ac945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12fac4638da842b19095f6bdcdabac5e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:18.064215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3b50e-c68f-4d71-8636-19fba64ac945 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:18.113784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:18.208624 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2476/4964] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:17 2022] POST /identity/v3/projects => generated 371 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:18.210220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc3ec2-8687-4753-98c0-c9ef2c98e3ff admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:18.281048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2ba3b50e-c68f-4d71-8636-19fba64ac945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12fac4638da842b19095f6bdcdabac5e', 'request_id': 'req-2ba3b50e-c68f-4d71-8636-19fba64ac945'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:18.299653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2ba3b50e-c68f-4d71-8636-19fba64ac945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12fac4638da842b19095f6bdcdabac5e', 'request_id': 'req-2ba3b50e-c68f-4d71-8636-19fba64ac945'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:18.355621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2ba3b50e-c68f-4d71-8636-19fba64ac945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12fac4638da842b19095f6bdcdabac5e', 'request_id': 'req-2ba3b50e-c68f-4d71-8636-19fba64ac945'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:18.408659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc3ec2-8687-4753-98c0-c9ef2c98e3ff admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:18.441623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2ba3b50e-c68f-4d71-8636-19fba64ac945 admin admin] The token cache is being invalidate because project 12fac4638da842b19095f6bdcdabac5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:18.442633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2ba3b50e-c68f-4d71-8636-19fba64ac945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:18.443889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2ba3b50e-c68f-4d71-8636-19fba64ac945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:18.446242 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2489/4965] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:17 2022] DELETE /identity/v3/projects/12fac4638da842b19095f6bdcdabac5e => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:18.447423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3b50e-c68f-4d71-8636-19fba64ac945 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:18.453128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2ba3b50e-c68f-4d71-8636-19fba64ac945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:18.563933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6e249-4c69-4fc4-99c1-15aed82279e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:18.564570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6e249-4c69-4fc4-99c1-15aed82279e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:18.564858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6e249-4c69-4fc4-99c1-15aed82279e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:18.565135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6e249-4c69-4fc4-99c1-15aed82279e3 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:18.565776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6e249-4c69-4fc4-99c1-15aed82279e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:18.567772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6e249-4c69-4fc4-99c1-15aed82279e3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:18.608657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3b50e-c68f-4d71-8636-19fba64ac945 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:18.619132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34633f53-7796-4954-af0f-67e9944f6e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:18.620145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34633f53-7796-4954-af0f-67e9944f6e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:18.624447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34633f53-7796-4954-af0f-67e9944f6e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:18.625007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34633f53-7796-4954-af0f-67e9944f6e74 admin admin] PATH_INFO: `/v3/projects/0a35e318a2444e10ac8faba23153c7c1` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:18.627133 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34633f53-7796-4954-af0f-67e9944f6e74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a35e318a2444e10ac8faba23153c7c1)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:18.632668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34633f53-7796-4954-af0f-67e9944f6e74 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:18.674712 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2477/4966] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:18 2022] POST /identity/v3/users => generated 292 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:18.674712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4bdeb-5e6e-4554-9ce5-9a5e575269ec None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:18.674712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4bdeb-5e6e-4554-9ce5-9a5e575269ec None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:18.674712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4bdeb-5e6e-4554-9ce5-9a5e575269ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:18.722500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-26b4bdeb-5e6e-4554-9ce5-9a5e575269ec None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:18.724023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-26b4bdeb-5e6e-4554-9ce5-9a5e575269ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:18.733150 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2478/4967] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:18.734369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4bdeb-5e6e-4554-9ce5-9a5e575269ec None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:18.737127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-26b4bdeb-5e6e-4554-9ce5-9a5e575269ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:18.749913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4bdeb-5e6e-4554-9ce5-9a5e575269ec None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:18.756469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc94c6b-23f0-4b89-abf7-6d29a9cb3eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:18.757425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc94c6b-23f0-4b89-abf7-6d29a9cb3eac admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:18.757942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc94c6b-23f0-4b89-abf7-6d29a9cb3eac admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:18.758481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc94c6b-23f0-4b89-abf7-6d29a9cb3eac admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:18.759382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc94c6b-23f0-4b89-abf7-6d29a9cb3eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:18.761271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc94c6b-23f0-4b89-abf7-6d29a9cb3eac admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:18.773713 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2479/4968] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:18.775416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc25fa-66df-4d17-bf86-8a8618dae8e9 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:18.775931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc25fa-66df-4d17-bf86-8a8618dae8e9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:18.776431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc25fa-66df-4d17-bf86-8a8618dae8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:18.828736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d9fc25fa-66df-4d17-bf86-8a8618dae8e9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:18.844784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d9fc25fa-66df-4d17-bf86-8a8618dae8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:18.854775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-34633f53-7796-4954-af0f-67e9944f6e74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a35e318a2444e10ac8faba23153c7c1', 'request_id': 'req-34633f53-7796-4954-af0f-67e9944f6e74'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:18.863776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-34633f53-7796-4954-af0f-67e9944f6e74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a35e318a2444e10ac8faba23153c7c1', 'request_id': 'req-34633f53-7796-4954-af0f-67e9944f6e74'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:18.886397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-34633f53-7796-4954-af0f-67e9944f6e74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a35e318a2444e10ac8faba23153c7c1', 'request_id': 'req-34633f53-7796-4954-af0f-67e9944f6e74'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:18.940683 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2480/4969] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:18.941744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc25fa-66df-4d17-bf86-8a8618dae8e9 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:18.952860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc25fa-66df-4d17-bf86-8a8618dae8e9 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:18.968210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee157c-1e9f-4ce2-a4a7-8e574f602d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:18.968914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee157c-1e9f-4ce2-a4a7-8e574f602d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:18.969887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee157c-1e9f-4ce2-a4a7-8e574f602d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:18.972911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee157c-1e9f-4ce2-a4a7-8e574f602d6d admin admin] PATH_INFO: `/v3/projects/694db3014cd547e8b4c7e4d9a4ae36d0/users/d679bb22d8b54f17b3570b6d85955e1c/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:19.003656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee157c-1e9f-4ce2-a4a7-8e574f602d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=694db3014cd547e8b4c7e4d9a4ae36d0, user_id=d679bb22d8b54f17b3570b6d85955e1c, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:19.006479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee157c-1e9f-4ce2-a4a7-8e574f602d6d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:19.015381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-34633f53-7796-4954-af0f-67e9944f6e74 admin admin] The token cache is being invalidate because project 0a35e318a2444e10ac8faba23153c7c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:19.015798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-34633f53-7796-4954-af0f-67e9944f6e74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:19.018862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-34633f53-7796-4954-af0f-67e9944f6e74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:19.023144 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2490/4970] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:18 2022] DELETE /identity/v3/projects/0a35e318a2444e10ac8faba23153c7c1 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:19.028518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34633f53-7796-4954-af0f-67e9944f6e74 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:19.030862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-34633f53-7796-4954-af0f-67e9944f6e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:19.049250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34633f53-7796-4954-af0f-67e9944f6e74 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:19.066907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86b3d3-255e-4460-93b3-cafc1fd70cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:19.067866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86b3d3-255e-4460-93b3-cafc1fd70cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:19.068472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86b3d3-255e-4460-93b3-cafc1fd70cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:19.068811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86b3d3-255e-4460-93b3-cafc1fd70cf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:19.070152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86b3d3-255e-4460-93b3-cafc1fd70cf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:46:19.070522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86b3d3-255e-4460-93b3-cafc1fd70cf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:19.072899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86b3d3-255e-4460-93b3-cafc1fd70cf6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:19.097753 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2481/4972] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:18 2022] PUT /identity/v3/projects/694db3014cd547e8b4c7e4d9a4ae36d0/users/d679bb22d8b54f17b3570b6d85955e1c/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:19.097977 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2491/4972] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:19.098099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee157c-1e9f-4ce2-a4a7-8e574f602d6d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:19.098193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86b3d3-255e-4460-93b3-cafc1fd70cf6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:19.098778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-da86b3d3-255e-4460-93b3-cafc1fd70cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:19.108467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-94ee157c-1e9f-4ce2-a4a7-8e574f602d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:19.115894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86b3d3-255e-4460-93b3-cafc1fd70cf6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:19.233346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387aa33-644e-4fd7-a461-0cccf461ec99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:19.234257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387aa33-644e-4fd7-a461-0cccf461ec99 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:19.234968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387aa33-644e-4fd7-a461-0cccf461ec99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:19.235257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387aa33-644e-4fd7-a461-0cccf461ec99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:19.235977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387aa33-644e-4fd7-a461-0cccf461ec99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:19.238752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387aa33-644e-4fd7-a461-0cccf461ec99 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:19.252893 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2492/4973] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:46:19.253235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387aa33-644e-4fd7-a461-0cccf461ec99 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:19.268351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387aa33-644e-4fd7-a461-0cccf461ec99 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:19.270911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee157c-1e9f-4ce2-a4a7-8e574f602d6d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:19.276753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff44d9-1050-4fad-b846-edca870ef02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:19.277605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f87b74-59cc-4fc1-8df6-b198ee05fbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:19.278309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f87b74-59cc-4fc1-8df6-b198ee05fbc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:19.278600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f87b74-59cc-4fc1-8df6-b198ee05fbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:19.278885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f87b74-59cc-4fc1-8df6-b198ee05fbc0 admin admin] PATH_INFO: `/v3/users/144eef04f8db40e59954c63aa878ad2d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:19.279279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff44d9-1050-4fad-b846-edca870ef02a admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:19.279846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff44d9-1050-4fad-b846-edca870ef02a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:19.280162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f87b74-59cc-4fc1-8df6-b198ee05fbc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=144eef04f8db40e59954c63aa878ad2d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:19.280586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff44d9-1050-4fad-b846-edca870ef02a admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:19.281458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff44d9-1050-4fad-b846-edca870ef02a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:19.284942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff44d9-1050-4fad-b846-edca870ef02a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:19.285505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f87b74-59cc-4fc1-8df6-b198ee05fbc0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:19.359433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:19.453186 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2493/4974] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:19 2022] POST /identity/v3/projects => generated 407 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:19.454932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff44d9-1050-4fad-b846-edca870ef02a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:19.618632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff44d9-1050-4fad-b846-edca870ef02a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:19.640875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f49bbd-d9aa-4776-b055-5603d28974e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:19.642925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f49bbd-d9aa-4776-b055-5603d28974e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:19.642925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f49bbd-d9aa-4776-b055-5603d28974e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:19.643145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f49bbd-d9aa-4776-b055-5603d28974e7 admin admin] PATH_INFO: `/v3/projects/694db3014cd547e8b4c7e4d9a4ae36d0/users/d679bb22d8b54f17b3570b6d85955e1c/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:19.651065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f49bbd-d9aa-4776-b055-5603d28974e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=694db3014cd547e8b4c7e4d9a4ae36d0, user_id=d679bb22d8b54f17b3570b6d85955e1c, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:19.654052 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f49bbd-d9aa-4776-b055-5603d28974e7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:19.674924 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2494/4975] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:19 2022] PUT /identity/v3/projects/694db3014cd547e8b4c7e4d9a4ae36d0/users/d679bb22d8b54f17b3570b6d85955e1c/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:19.678172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f49bbd-d9aa-4776-b055-5603d28974e7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:19.712139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b5f87b74-59cc-4fc1-8df6-b198ee05fbc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144eef04f8db40e59954c63aa878ad2d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:19.716396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b5f87b74-59cc-4fc1-8df6-b198ee05fbc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144eef04f8db40e59954c63aa878ad2d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:19.747031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b5f87b74-59cc-4fc1-8df6-b198ee05fbc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144eef04f8db40e59954c63aa878ad2d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:19.799101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b5f87b74-59cc-4fc1-8df6-b198ee05fbc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144eef04f8db40e59954c63aa878ad2d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:19.820720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f49bbd-d9aa-4776-b055-5603d28974e7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:19.833153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d3622-37c4-4e9d-baf0-29bcaa94bca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:19.833942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d3622-37c4-4e9d-baf0-29bcaa94bca0 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:19.834248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d3622-37c4-4e9d-baf0-29bcaa94bca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:19.834526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d3622-37c4-4e9d-baf0-29bcaa94bca0 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:19.835178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d3622-37c4-4e9d-baf0-29bcaa94bca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:19.838217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d3622-37c4-4e9d-baf0-29bcaa94bca0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:19.923548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b5f87b74-59cc-4fc1-8df6-b198ee05fbc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144eef04f8db40e59954c63aa878ad2d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:19.933697 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2482/4976] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:19 2022] DELETE /identity/v3/users/144eef04f8db40e59954c63aa878ad2d => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:19.933697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ac847-5eb8-4026-8eaa-441cccad38fc None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:19.933697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ac847-5eb8-4026-8eaa-441cccad38fc None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:19.933697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ac847-5eb8-4026-8eaa-441cccad38fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:19.964192 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2495/4977] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:19 2022] POST /identity/v3/users => generated 304 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:19.965667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d3622-37c4-4e9d-baf0-29bcaa94bca0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:19.970371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-eb6d3622-37c4-4e9d-baf0-29bcaa94bca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:20.013520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d3622-37c4-4e9d-baf0-29bcaa94bca0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:20.021061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0a1ac847-5eb8-4026-8eaa-441cccad38fc None None] MFA Rules not processed for user `d679bb22d8b54f17b3570b6d85955e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:20.022358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0a1ac847-5eb8-4026-8eaa-441cccad38fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:20.276483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:20.294170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba07dd-cfe8-411a-ac1d-6e3ee1b4c077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:20.295090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba07dd-cfe8-411a-ac1d-6e3ee1b4c077 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:20.295383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba07dd-cfe8-411a-ac1d-6e3ee1b4c077 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:20.295658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba07dd-cfe8-411a-ac1d-6e3ee1b4c077 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:20.296333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba07dd-cfe8-411a-ac1d-6e3ee1b4c077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:20.298060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba07dd-cfe8-411a-ac1d-6e3ee1b4c077 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:20.334245 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2483/4978] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:20.334245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ac847-5eb8-4026-8eaa-441cccad38fc None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:20.339333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ac847-5eb8-4026-8eaa-441cccad38fc None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:20.344512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952a21f-f0da-4429-96aa-585fbc2b83a5 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:20.345107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952a21f-f0da-4429-96aa-585fbc2b83a5 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:20.345437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952a21f-f0da-4429-96aa-585fbc2b83a5 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:20.346000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952a21f-f0da-4429-96aa-585fbc2b83a5 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:20.346735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952a21f-f0da-4429-96aa-585fbc2b83a5 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:20.348784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952a21f-f0da-4429-96aa-585fbc2b83a5 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:20.376022 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2496/4979] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:20.394260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba07dd-cfe8-411a-ac1d-6e3ee1b4c077 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:20.399483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba07dd-cfe8-411a-ac1d-6e3ee1b4c077 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:20.434211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3c447-8734-4c67-9b89-b75ba5b3cfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:20.435175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3c447-8734-4c67-9b89-b75ba5b3cfce admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:20.435628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3c447-8734-4c67-9b89-b75ba5b3cfce admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:20.436088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3c447-8734-4c67-9b89-b75ba5b3cfce admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:20.437068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3c447-8734-4c67-9b89-b75ba5b3cfce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:20.442146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3c447-8734-4c67-9b89-b75ba5b3cfce admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:20.458478 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2484/4980] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:46:20 2022] POST /identity/v3/domains => generated 276 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:20.459537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952a21f-f0da-4429-96aa-585fbc2b83a5 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:20.473662 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2497/4981] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:20.478848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3c447-8734-4c67-9b89-b75ba5b3cfce admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:20.509715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3c447-8734-4c67-9b89-b75ba5b3cfce admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:20.623581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd1c0d-b080-42f9-acd0-6f9fd966f508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:20.624694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd1c0d-b080-42f9-acd0-6f9fd966f508 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:20.626262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd1c0d-b080-42f9-acd0-6f9fd966f508 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:20.626795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd1c0d-b080-42f9-acd0-6f9fd966f508 admin admin] PATH_INFO: `/v3/projects/cc47b2c9c7204547bedbefb0c449182c/users/79209301c2544708892a9e4418f2ffe7/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:20.645663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd1c0d-b080-42f9-acd0-6f9fd966f508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc47b2c9c7204547bedbefb0c449182c, user_id=79209301c2544708892a9e4418f2ffe7, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:20.651198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd1c0d-b080-42f9-acd0-6f9fd966f508 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:20.664885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952a21f-f0da-4429-96aa-585fbc2b83a5 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:20.670986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cd97d-c662-4857-ac69-490f8fdf2f26 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:20.671966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cd97d-c662-4857-ac69-490f8fdf2f26 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:20.672812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cd97d-c662-4857-ac69-490f8fdf2f26 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:20.673765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cd97d-c662-4857-ac69-490f8fdf2f26 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:20.675664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4cd97d-c662-4857-ac69-490f8fdf2f26 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:20.679774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4cd97d-c662-4857-ac69-490f8fdf2f26 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:20.760392 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2498/4982] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:20 2022] PUT /identity/v3/projects/cc47b2c9c7204547bedbefb0c449182c/users/79209301c2544708892a9e4418f2ffe7/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:20.771778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0b78d-69cf-40cf-92d3-58750b277628 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:20.772602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0b78d-69cf-40cf-92d3-58750b277628 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:20.772892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0b78d-69cf-40cf-92d3-58750b277628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:20.865544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-55c0b78d-69cf-40cf-92d3-58750b277628 None None] MFA Rules not processed for user `79209301c2544708892a9e4418f2ffe7`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:20.867010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-55c0b78d-69cf-40cf-92d3-58750b277628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:20.880892 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2485/4983] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:20 2022] POST /identity/v3/projects => generated 401 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:20.881886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cd97d-c662-4857-ac69-490f8fdf2f26 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:21.015719 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2499/4984] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:20 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:21.019864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0b78d-69cf-40cf-92d3-58750b277628 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:21.066852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cd97d-c662-4857-ac69-490f8fdf2f26 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:21.080221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f03cea-331a-4943-a9ed-2f728ea40b33 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:21.080870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f03cea-331a-4943-a9ed-2f728ea40b33 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:21.081140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f03cea-331a-4943-a9ed-2f728ea40b33 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:21.082556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f03cea-331a-4943-a9ed-2f728ea40b33 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/groups` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:21.083428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f03cea-331a-4943-a9ed-2f728ea40b33 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:21.088388 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-d4f03cea-331a-4943-a9ed-2f728ea40b33 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:46:21.088388 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:46:21.088388 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:46:21.090773 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f03cea-331a-4943-a9ed-2f728ea40b33 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:21.171119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0b78d-69cf-40cf-92d3-58750b277628 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:21.184163 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2486/4985] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:46:20 2022] POST /identity/v3/groups => generated 302 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:21.184163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f03cea-331a-4943-a9ed-2f728ea40b33 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:21.210955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d4f03cea-331a-4943-a9ed-2f728ea40b33 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:21.345964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:21.361666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc1e35-168b-459c-9b3a-b6e14082020c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:21.362416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc1e35-168b-459c-9b3a-b6e14082020c admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:21.362699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc1e35-168b-459c-9b3a-b6e14082020c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:21.363596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc1e35-168b-459c-9b3a-b6e14082020c admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:21.364251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc1e35-168b-459c-9b3a-b6e14082020c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:21.366227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc1e35-168b-459c-9b3a-b6e14082020c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:21.389373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f03cea-331a-4943-a9ed-2f728ea40b33 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:21.400062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0dc84-b998-4bb7-8e43-bdd5948d0ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:21.400905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0dc84-b998-4bb7-8e43-bdd5948d0ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:21.401193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0dc84-b998-4bb7-8e43-bdd5948d0ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:21.401476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0dc84-b998-4bb7-8e43-bdd5948d0ae2 admin admin] PATH_INFO: `/v3/projects/8d4e3334372746bfb009acc5832d0954` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:21.403203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0dc84-b998-4bb7-8e43-bdd5948d0ae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d4e3334372746bfb009acc5832d0954)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:21.406715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0dc84-b998-4bb7-8e43-bdd5948d0ae2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:21.546323 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2500/4986] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:21 2022] POST /identity/v3/projects => generated 407 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:46:21.547317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc1e35-168b-459c-9b3a-b6e14082020c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:21.567639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e6b0dc84-b998-4bb7-8e43-bdd5948d0ae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d4e3334372746bfb009acc5832d0954', 'request_id': 'req-e6b0dc84-b998-4bb7-8e43-bdd5948d0ae2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:21.651274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e6b0dc84-b998-4bb7-8e43-bdd5948d0ae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d4e3334372746bfb009acc5832d0954', 'request_id': 'req-e6b0dc84-b998-4bb7-8e43-bdd5948d0ae2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:21.659777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e6b0dc84-b998-4bb7-8e43-bdd5948d0ae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d4e3334372746bfb009acc5832d0954', 'request_id': 'req-e6b0dc84-b998-4bb7-8e43-bdd5948d0ae2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:21.663788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc1e35-168b-459c-9b3a-b6e14082020c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:21.671946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54edd28-b0a0-408a-89cc-937b259d6e9b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:21.673413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54edd28-b0a0-408a-89cc-937b259d6e9b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:21.673580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54edd28-b0a0-408a-89cc-937b259d6e9b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:21.676407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54edd28-b0a0-408a-89cc-937b259d6e9b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:21.676407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54edd28-b0a0-408a-89cc-937b259d6e9b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:21.676756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54edd28-b0a0-408a-89cc-937b259d6e9b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:21.691070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e6b0dc84-b998-4bb7-8e43-bdd5948d0ae2 admin admin] The token cache is being invalidate because project 8d4e3334372746bfb009acc5832d0954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:21.691952 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e6b0dc84-b998-4bb7-8e43-bdd5948d0ae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:21.692908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e6b0dc84-b998-4bb7-8e43-bdd5948d0ae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:21.698192 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2487/4987] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:21 2022] DELETE /identity/v3/projects/8d4e3334372746bfb009acc5832d0954 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:21.699052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0dc84-b998-4bb7-8e43-bdd5948d0ae2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:21.703091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e6b0dc84-b998-4bb7-8e43-bdd5948d0ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:21.754121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:21.775198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0dc84-b998-4bb7-8e43-bdd5948d0ae2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:21.793016 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2501/4988] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:21 2022] POST /identity/v3/users => generated 439 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:21.793016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95e3f3-0187-476a-8e8c-e9b8312cae36 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:21.793016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95e3f3-0187-476a-8e8c-e9b8312cae36 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:21.793016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95e3f3-0187-476a-8e8c-e9b8312cae36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:21.831353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-bb95e3f3-0187-476a-8e8c-e9b8312cae36 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:21.833144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bb95e3f3-0187-476a-8e8c-e9b8312cae36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:21.900004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569fd83-5f4f-4857-afa3-fd898c046ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:21.901052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569fd83-5f4f-4857-afa3-fd898c046ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:21.901586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569fd83-5f4f-4857-afa3-fd898c046ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:21.902136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569fd83-5f4f-4857-afa3-fd898c046ed7 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:21.902986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569fd83-5f4f-4857-afa3-fd898c046ed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:21.905188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569fd83-5f4f-4857-afa3-fd898c046ed7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:21.920034 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2502/4989] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:21.920034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95e3f3-0187-476a-8e8c-e9b8312cae36 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:21.920034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bb95e3f3-0187-476a-8e8c-e9b8312cae36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:21.932471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95e3f3-0187-476a-8e8c-e9b8312cae36 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:21.937651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54812d-641d-4819-b098-dc86363f5bdb tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:21.938936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54812d-641d-4819-b098-dc86363f5bdb tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:21.939220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54812d-641d-4819-b098-dc86363f5bdb tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:21.939496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54812d-641d-4819-b098-dc86363f5bdb tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:21.940844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54812d-641d-4819-b098-dc86363f5bdb tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:21.942121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54812d-641d-4819-b098-dc86363f5bdb tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:22.026391 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2503/4990] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:46:21 2022] POST /identity/v3/roles => generated 240 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:22.026391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6920b5c-b81d-4e02-bd29-6179a2c0c50e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:22.026391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6920b5c-b81d-4e02-bd29-6179a2c0c50e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:22.026391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6920b5c-b81d-4e02-bd29-6179a2c0c50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:22.032335 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2488/4991] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:21 2022] POST /identity/v3/users => generated 310 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:22.032819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569fd83-5f4f-4857-afa3-fd898c046ed7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:22.049255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569fd83-5f4f-4857-afa3-fd898c046ed7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:22.057062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b36271-c2c1-4253-a317-196444fb7b01 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:22.057963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b36271-c2c1-4253-a317-196444fb7b01 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:22.059004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b36271-c2c1-4253-a317-196444fb7b01 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:22.059393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b36271-c2c1-4253-a317-196444fb7b01 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/74edfa89391b4dd6ba9e421aafe88fa2/groups/8b8d8c2298da4587990f0859880af9b6/roles/c6274a3a8caa4b43814f5f3d3b5d91b4/inherited_to_projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:22.069520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a6920b5c-b81d-4e02-bd29-6179a2c0c50e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:22.071088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a6920b5c-b81d-4e02-bd29-6179a2c0c50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:22.071624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b36271-c2c1-4253-a317-196444fb7b01 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:create_grant(project_id=74edfa89391b4dd6ba9e421aafe88fa2, group_id=8b8d8c2298da4587990f0859880af9b6, role_id=c6274a3a8caa4b43814f5f3d3b5d91b4)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:22.075314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b36271-c2c1-4253-a317-196444fb7b01 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:22.087992 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2504/4992] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:22.088753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6920b5c-b81d-4e02-bd29-6179a2c0c50e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:22.101304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6920b5c-b81d-4e02-bd29-6179a2c0c50e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:22.105660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65d331-6fcb-45e1-9839-12d41dc16cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:22.106326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65d331-6fcb-45e1-9839-12d41dc16cfe admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:22.107267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65d331-6fcb-45e1-9839-12d41dc16cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:22.107494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65d331-6fcb-45e1-9839-12d41dc16cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:22.108171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65d331-6fcb-45e1-9839-12d41dc16cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:22.110537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65d331-6fcb-45e1-9839-12d41dc16cfe admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:22.121842 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2505/4993] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:22 2022] GET /identity/v3/roles => generated 1651 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:22.121842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65d331-6fcb-45e1-9839-12d41dc16cfe admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:22.141192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65d331-6fcb-45e1-9839-12d41dc16cfe admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:22.153324 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2489/4994] 10.222.0.20 () {60 vars in 1585 bytes} [Thu Oct 27 03:46:22 2022] PUT /identity/v3/OS-INHERIT/projects/74edfa89391b4dd6ba9e421aafe88fa2/groups/8b8d8c2298da4587990f0859880af9b6/roles/c6274a3a8caa4b43814f5f3d3b5d91b4/inherited_to_projects => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:22.154204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b36271-c2c1-4253-a317-196444fb7b01 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:22.154575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e879562-fc51-4a54-9296-6833cfe71f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:22.155279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e879562-fc51-4a54-9296-6833cfe71f4d admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:22.155558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e879562-fc51-4a54-9296-6833cfe71f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:22.155837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e879562-fc51-4a54-9296-6833cfe71f4d admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:22.157883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e879562-fc51-4a54-9296-6833cfe71f4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:46:22.159320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e879562-fc51-4a54-9296-6833cfe71f4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:22.160865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e879562-fc51-4a54-9296-6833cfe71f4d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:22.196990 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2506/4995] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:22.197359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e879562-fc51-4a54-9296-6833cfe71f4d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:22.210205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e879562-fc51-4a54-9296-6833cfe71f4d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:22.247893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b36271-c2c1-4253-a317-196444fb7b01 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:22.254832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bd183-78df-497f-86f5-62bb46d1cf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:22.255508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bd183-78df-497f-86f5-62bb46d1cf99 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:22.256406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bd183-78df-497f-86f5-62bb46d1cf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:22.256406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bd183-78df-497f-86f5-62bb46d1cf99 admin admin] PATH_INFO: `/v3/projects/b44723cc53b6480c9ec2fce9d2cab5c3/users/b182ee26790e468d88e395a0b48fe6f6/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:22.279854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bd183-78df-497f-86f5-62bb46d1cf99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44723cc53b6480c9ec2fce9d2cab5c3, user_id=b182ee26790e468d88e395a0b48fe6f6, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:22.284178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bd183-78df-497f-86f5-62bb46d1cf99 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:22.288714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb8e9e-be56-48d9-aa62-ff82fa574516 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:22.289793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb8e9e-be56-48d9-aa62-ff82fa574516 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:22.290314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb8e9e-be56-48d9-aa62-ff82fa574516 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:22.290798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb8e9e-be56-48d9-aa62-ff82fa574516 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/74edfa89391b4dd6ba9e421aafe88fa2/groups/8b8d8c2298da4587990f0859880af9b6/roles/c6274a3a8caa4b43814f5f3d3b5d91b4/inherited_to_projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:22.293159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb8e9e-be56-48d9-aa62-ff82fa574516 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:check_grant(project_id=74edfa89391b4dd6ba9e421aafe88fa2, group_id=8b8d8c2298da4587990f0859880af9b6, role_id=c6274a3a8caa4b43814f5f3d3b5d91b4)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:22.305078 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-9dcb8e9e-be56-48d9-aa62-ff82fa574516 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:46:22.305078 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:46:22.305078 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:46:22.307082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb8e9e-be56-48d9-aa62-ff82fa574516 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:22.315329 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2507/4996] 10.222.0.20 () {58 vars in 1567 bytes} [Thu Oct 27 03:46:22 2022] HEAD /identity/v3/OS-INHERIT/projects/74edfa89391b4dd6ba9e421aafe88fa2/groups/8b8d8c2298da4587990f0859880af9b6/roles/c6274a3a8caa4b43814f5f3d3b5d91b4/inherited_to_projects => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:22.316169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb8e9e-be56-48d9-aa62-ff82fa574516 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:22.337080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb8e9e-be56-48d9-aa62-ff82fa574516 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:22.342647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e1d14-8cdd-47c2-bd49-a8689bef5957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:22.343555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e1d14-8cdd-47c2-bd49-a8689bef5957 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:22.344014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e1d14-8cdd-47c2-bd49-a8689bef5957 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:22.345553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e1d14-8cdd-47c2-bd49-a8689bef5957 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:22.346331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e1d14-8cdd-47c2-bd49-a8689bef5957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:22.348792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e1d14-8cdd-47c2-bd49-a8689bef5957 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:22.443115 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2490/4997] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:22 2022] PUT /identity/v3/projects/b44723cc53b6480c9ec2fce9d2cab5c3/users/b182ee26790e468d88e395a0b48fe6f6/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:22.444297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bd183-78df-497f-86f5-62bb46d1cf99 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:22.468639 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2508/4998] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:22 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:22.469705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e1d14-8cdd-47c2-bd49-a8689bef5957 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:22.616817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bd183-78df-497f-86f5-62bb46d1cf99 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:22.669291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e1d14-8cdd-47c2-bd49-a8689bef5957 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:22.677719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51acae2-85e3-4eb5-bc57-c3ede63f3bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:22.678560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51acae2-85e3-4eb5-bc57-c3ede63f3bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:22.679097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51acae2-85e3-4eb5-bc57-c3ede63f3bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:22.679578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51acae2-85e3-4eb5-bc57-c3ede63f3bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:22.680334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51acae2-85e3-4eb5-bc57-c3ede63f3bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:22.682514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51acae2-85e3-4eb5-bc57-c3ede63f3bd2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:22.701030 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2509/4999] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:22 2022] GET /identity/v3/roles => generated 1651 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:22.702127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51acae2-85e3-4eb5-bc57-c3ede63f3bd2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:22.727701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51acae2-85e3-4eb5-bc57-c3ede63f3bd2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:22.733566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa4d39-a1f5-4427-8058-110c212c683a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:22.734327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa4d39-a1f5-4427-8058-110c212c683a admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:22.735306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa4d39-a1f5-4427-8058-110c212c683a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:22.735714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa4d39-a1f5-4427-8058-110c212c683a admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:22.736526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa4d39-a1f5-4427-8058-110c212c683a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:22.741491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa4d39-a1f5-4427-8058-110c212c683a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:22.775053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858283b-2ba3-4995-8d1f-a2405abe806a tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:22.775938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858283b-2ba3-4995-8d1f-a2405abe806a tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:22.777519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858283b-2ba3-4995-8d1f-a2405abe806a tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:22.778397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858283b-2ba3-4995-8d1f-a2405abe806a tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/74edfa89391b4dd6ba9e421aafe88fa2/groups/8b8d8c2298da4587990f0859880af9b6/roles/c6274a3a8caa4b43814f5f3d3b5d91b4/inherited_to_projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:22.782949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858283b-2ba3-4995-8d1f-a2405abe806a tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=74edfa89391b4dd6ba9e421aafe88fa2, group_id=8b8d8c2298da4587990f0859880af9b6, role_id=c6274a3a8caa4b43814f5f3d3b5d91b4)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:22.784725 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-0858283b-2ba3-4995-8d1f-a2405abe806a tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:46:22.784725 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:46:22.784725 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:46:22.787206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858283b-2ba3-4995-8d1f-a2405abe806a tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:22.795734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0858283b-2ba3-4995-8d1f-a2405abe806a tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invalidating the token cache because role c6274a3a8caa4b43814f5f3d3b5d91b4 was removed from group 8b8d8c2298da4587990f0859880af9b6 on project 74edfa89391b4dd6ba9e421aafe88fa2. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:22.796171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0858283b-2ba3-4995-8d1f-a2405abe806a tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:22.796999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0858283b-2ba3-4995-8d1f-a2405abe806a tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:22.902976 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2491/5000] 10.222.0.20 () {58 vars in 1569 bytes} [Thu Oct 27 03:46:22 2022] DELETE /identity/v3/OS-INHERIT/projects/74edfa89391b4dd6ba9e421aafe88fa2/groups/8b8d8c2298da4587990f0859880af9b6/roles/c6274a3a8caa4b43814f5f3d3b5d91b4/inherited_to_projects => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:22.912719 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2510/5001] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:22 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:22.912719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa4d39-a1f5-4427-8058-110c212c683a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:22.913031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858283b-2ba3-4995-8d1f-a2405abe806a tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:22.917462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0858283b-2ba3-4995-8d1f-a2405abe806a tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:22.920338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-50fa4d39-a1f5-4427-8058-110c212c683a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:22.936414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa4d39-a1f5-4427-8058-110c212c683a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:23.052361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:23.092628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bd060-5d67-4254-aeed-ec3845e2c515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:23.093740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bd060-5d67-4254-aeed-ec3845e2c515 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:23.094873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bd060-5d67-4254-aeed-ec3845e2c515 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:23.095375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bd060-5d67-4254-aeed-ec3845e2c515 admin admin] PATH_INFO: `/v3/projects/b44723cc53b6480c9ec2fce9d2cab5c3/users/b182ee26790e468d88e395a0b48fe6f6/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:23.097935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bd060-5d67-4254-aeed-ec3845e2c515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44723cc53b6480c9ec2fce9d2cab5c3, user_id=b182ee26790e468d88e395a0b48fe6f6, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:23.100923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bd060-5d67-4254-aeed-ec3845e2c515 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:23.108683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858283b-2ba3-4995-8d1f-a2405abe806a tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:23.120312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c565f6c-fc0b-48b5-8f5f-b645f44d8d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:23.120312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c565f6c-fc0b-48b5-8f5f-b645f44d8d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:23.120312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c565f6c-fc0b-48b5-8f5f-b645f44d8d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:23.120312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c565f6c-fc0b-48b5-8f5f-b645f44d8d48 admin admin] PATH_INFO: `/v3/users/75183125b92a4976be9d3b7f1b827168` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:23.120876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c565f6c-fc0b-48b5-8f5f-b645f44d8d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75183125b92a4976be9d3b7f1b827168)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:23.122100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c565f6c-fc0b-48b5-8f5f-b645f44d8d48 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:23.127209 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2511/5002] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:22 2022] PUT /identity/v3/projects/b44723cc53b6480c9ec2fce9d2cab5c3/users/b182ee26790e468d88e395a0b48fe6f6/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:23.128175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bd060-5d67-4254-aeed-ec3845e2c515 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:23.133521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-406bd060-5d67-4254-aeed-ec3845e2c515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:23.239942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:23.249610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bd060-5d67-4254-aeed-ec3845e2c515 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:23.255174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e320fa-42a3-4629-8b01-f2f32fa3b239 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:23.256197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e320fa-42a3-4629-8b01-f2f32fa3b239 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:23.256606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e320fa-42a3-4629-8b01-f2f32fa3b239 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:23.256893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e320fa-42a3-4629-8b01-f2f32fa3b239 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/roles/c6274a3a8caa4b43814f5f3d3b5d91b4` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:23.258560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e320fa-42a3-4629-8b01-f2f32fa3b239 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c6274a3a8caa4b43814f5f3d3b5d91b4)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:23.260219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e320fa-42a3-4629-8b01-f2f32fa3b239 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:23.354311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4c565f6c-fc0b-48b5-8f5f-b645f44d8d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75183125b92a4976be9d3b7f1b827168'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:23.354959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4c565f6c-fc0b-48b5-8f5f-b645f44d8d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75183125b92a4976be9d3b7f1b827168'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:23.363720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4c565f6c-fc0b-48b5-8f5f-b645f44d8d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75183125b92a4976be9d3b7f1b827168'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:23.389131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4c565f6c-fc0b-48b5-8f5f-b645f44d8d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75183125b92a4976be9d3b7f1b827168'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:23.439477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-28e320fa-42a3-4629-8b01-f2f32fa3b239 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invalidating the token cache because role c6274a3a8caa4b43814f5f3d3b5d91b4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:23.439864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-28e320fa-42a3-4629-8b01-f2f32fa3b239 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:23.441764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-28e320fa-42a3-4629-8b01-f2f32fa3b239 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:23.447022 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2512/5003] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:23 2022] DELETE /identity/v3/roles/c6274a3a8caa4b43814f5f3d3b5d91b4 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:23.451663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e320fa-42a3-4629-8b01-f2f32fa3b239 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:23.463593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-28e320fa-42a3-4629-8b01-f2f32fa3b239 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:23.496758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4c565f6c-fc0b-48b5-8f5f-b645f44d8d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75183125b92a4976be9d3b7f1b827168'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:23.510182 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2492/5004] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:22 2022] DELETE /identity/v3/users/75183125b92a4976be9d3b7f1b827168 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:23.510182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686da09f-6e5c-4d8c-a82f-421620199fc0 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:23.510182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686da09f-6e5c-4d8c-a82f-421620199fc0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:23.510182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686da09f-6e5c-4d8c-a82f-421620199fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:23.582744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e320fa-42a3-4629-8b01-f2f32fa3b239 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:23.606627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-686da09f-6e5c-4d8c-a82f-421620199fc0 None None] MFA Rules not processed for user `b182ee26790e468d88e395a0b48fe6f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:23.611398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-686da09f-6e5c-4d8c-a82f-421620199fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:23.706780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e902961-887b-465f-8324-1c343e3a4e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:23.707973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e902961-887b-465f-8324-1c343e3a4e95 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:23.708423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e902961-887b-465f-8324-1c343e3a4e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:23.714998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e902961-887b-465f-8324-1c343e3a4e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:23.714998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e902961-887b-465f-8324-1c343e3a4e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:23.714998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e902961-887b-465f-8324-1c343e3a4e95 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:23.733261 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2513/5005] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:23.734956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e902961-887b-465f-8324-1c343e3a4e95 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:23.736816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6e902961-887b-465f-8324-1c343e3a4e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:23.786909 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2493/5006] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:23 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:23.789383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686da09f-6e5c-4d8c-a82f-421620199fc0 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:23.791313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-686da09f-6e5c-4d8c-a82f-421620199fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:23.871451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e902961-887b-465f-8324-1c343e3a4e95 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:23.880130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e80860-c475-4512-bfa8-484dc9118242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:23.880456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e80860-c475-4512-bfa8-484dc9118242 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:23.880787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e80860-c475-4512-bfa8-484dc9118242 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:23.881070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e80860-c475-4512-bfa8-484dc9118242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:23.884467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-30e80860-c475-4512-bfa8-484dc9118242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:23.958626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686da09f-6e5c-4d8c-a82f-421620199fc0 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:23.969854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:23.970103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff8553-bca2-4119-838b-88bdc2bc6eb6 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:23.970703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff8553-bca2-4119-838b-88bdc2bc6eb6 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:23.970991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff8553-bca2-4119-838b-88bdc2bc6eb6 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:23.975829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff8553-bca2-4119-838b-88bdc2bc6eb6 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:23.975829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff8553-bca2-4119-838b-88bdc2bc6eb6 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:23.975829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff8553-bca2-4119-838b-88bdc2bc6eb6 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:24.016479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:24.031374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e80860-c475-4512-bfa8-484dc9118242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:24.033705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e80860-c475-4512-bfa8-484dc9118242 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:24.106424 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2494/5007] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:46:23 2022] POST /identity/v3/roles => generated 240 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:24.107827 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2514/5008] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:24.128862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e80860-c475-4512-bfa8-484dc9118242 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:24.136054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93c14e-8e07-4a4f-a24f-456556e2d2e6 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:24.136654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93c14e-8e07-4a4f-a24f-456556e2d2e6 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:24.136654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93c14e-8e07-4a4f-a24f-456556e2d2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:24.157725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e80860-c475-4512-bfa8-484dc9118242 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:24.178849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9332b-39a3-45d9-926d-9c2b24f683aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:24.190554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9332b-39a3-45d9-926d-9c2b24f683aa admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:24.190868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9332b-39a3-45d9-926d-9c2b24f683aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:24.191114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9332b-39a3-45d9-926d-9c2b24f683aa admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:24.194881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9332b-39a3-45d9-926d-9c2b24f683aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:24.196817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9332b-39a3-45d9-926d-9c2b24f683aa admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:24.214998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-2d93c14e-8e07-4a4f-a24f-456556e2d2e6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:24.217977 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2515/5009] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:24 2022] GET /identity/v3/roles => generated 1651 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:24.219913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9332b-39a3-45d9-926d-9c2b24f683aa admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:24.221223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2d93c14e-8e07-4a4f-a24f-456556e2d2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:24.235932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3fe9332b-39a3-45d9-926d-9c2b24f683aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:24.240772 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2495/5010] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:24.240772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93c14e-8e07-4a4f-a24f-456556e2d2e6 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:24.276287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93c14e-8e07-4a4f-a24f-456556e2d2e6 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:24.286922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e47bc-f469-45ca-a0a3-5c266ba250fc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:24.287743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e47bc-f469-45ca-a0a3-5c266ba250fc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:24.288041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e47bc-f469-45ca-a0a3-5c266ba250fc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:24.288386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e47bc-f469-45ca-a0a3-5c266ba250fc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/74edfa89391b4dd6ba9e421aafe88fa2/users/ee54a1fb8e67423c8ba0b711648c05b2/roles/62d054433e44468fa8ccce1790d3a6ac/inherited_to_projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:24.318501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e47bc-f469-45ca-a0a3-5c266ba250fc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:create_grant(project_id=74edfa89391b4dd6ba9e421aafe88fa2, user_id=ee54a1fb8e67423c8ba0b711648c05b2, role_id=62d054433e44468fa8ccce1790d3a6ac)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:24.321177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e47bc-f469-45ca-a0a3-5c266ba250fc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:24.331288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9332b-39a3-45d9-926d-9c2b24f683aa admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:24.334010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:24.342831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f7fb2-0ba8-41b9-8d58-c96625c78ef3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:24.342831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f7fb2-0ba8-41b9-8d58-c96625c78ef3 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:24.342831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f7fb2-0ba8-41b9-8d58-c96625c78ef3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:24.342831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f7fb2-0ba8-41b9-8d58-c96625c78ef3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:24.354575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f7fb2-0ba8-41b9-8d58-c96625c78ef3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:24.356842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f7fb2-0ba8-41b9-8d58-c96625c78ef3 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:24.377179 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2516/5011] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:24 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:24.378314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f7fb2-0ba8-41b9-8d58-c96625c78ef3 service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:24.392586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f7fb2-0ba8-41b9-8d58-c96625c78ef3 service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:24.401046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b2bec-125d-49bf-8120-1766ba41461e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:24.401737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b2bec-125d-49bf-8120-1766ba41461e admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:24.402023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b2bec-125d-49bf-8120-1766ba41461e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:24.402344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b2bec-125d-49bf-8120-1766ba41461e admin admin] PATH_INFO: `/v3/projects/dfbf160659d24b6db40fd019ea1af002/users/17cb75672b9c4a94bf72f254e0857198/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:24.423990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b2bec-125d-49bf-8120-1766ba41461e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfbf160659d24b6db40fd019ea1af002, user_id=17cb75672b9c4a94bf72f254e0857198, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:24.427173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b2bec-125d-49bf-8120-1766ba41461e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:24.441205 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2496/5012] 10.222.0.20 () {60 vars in 1582 bytes} [Thu Oct 27 03:46:24 2022] PUT /identity/v3/OS-INHERIT/projects/74edfa89391b4dd6ba9e421aafe88fa2/users/ee54a1fb8e67423c8ba0b711648c05b2/roles/62d054433e44468fa8ccce1790d3a6ac/inherited_to_projects => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:24.444417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e47bc-f469-45ca-a0a3-5c266ba250fc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:24.533606 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2517/5013] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:24 2022] PUT /identity/v3/projects/dfbf160659d24b6db40fd019ea1af002/users/17cb75672b9c4a94bf72f254e0857198/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:24.533606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b2bec-125d-49bf-8120-1766ba41461e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:24.560383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e47bc-f469-45ca-a0a3-5c266ba250fc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:24.628866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b2bec-125d-49bf-8120-1766ba41461e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:24.642235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0df5c-198b-4068-9904-676e324db1f1 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:24.642934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0df5c-198b-4068-9904-676e324db1f1 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:24.643221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0df5c-198b-4068-9904-676e324db1f1 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:24.645097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0df5c-198b-4068-9904-676e324db1f1 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/74edfa89391b4dd6ba9e421aafe88fa2/users/ee54a1fb8e67423c8ba0b711648c05b2/roles/62d054433e44468fa8ccce1790d3a6ac/inherited_to_projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:24.647075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0df5c-198b-4068-9904-676e324db1f1 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:check_grant(project_id=74edfa89391b4dd6ba9e421aafe88fa2, user_id=ee54a1fb8e67423c8ba0b711648c05b2, role_id=62d054433e44468fa8ccce1790d3a6ac)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:24.649795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0df5c-198b-4068-9904-676e324db1f1 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:24.654660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:24.660933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d197b-8aa3-4951-8d0a-6f0897b7d476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:24.665273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d197b-8aa3-4951-8d0a-6f0897b7d476 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:24.665273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d197b-8aa3-4951-8d0a-6f0897b7d476 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:24.665493 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2518/5014] 10.222.0.20 () {58 vars in 1564 bytes} [Thu Oct 27 03:46:24 2022] HEAD /identity/v3/OS-INHERIT/projects/74edfa89391b4dd6ba9e421aafe88fa2/users/ee54a1fb8e67423c8ba0b711648c05b2/roles/62d054433e44468fa8ccce1790d3a6ac/inherited_to_projects => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:24.665597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d197b-8aa3-4951-8d0a-6f0897b7d476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:24.665684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f3a4b-a3b5-402e-9508-79b07d7d1672 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:24.665684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f3a4b-a3b5-402e-9508-79b07d7d1672 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:24.665684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f3a4b-a3b5-402e-9508-79b07d7d1672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:24.712181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-261f3a4b-a3b5-402e-9508-79b07d7d1672 None None] MFA Rules not processed for user `17cb75672b9c4a94bf72f254e0857198`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:24.715472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-261f3a4b-a3b5-402e-9508-79b07d7d1672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:24.763151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d197b-8aa3-4951-8d0a-6f0897b7d476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:24.764706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d197b-8aa3-4951-8d0a-6f0897b7d476 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:24.784100 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2497/5015] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:24.785087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d197b-8aa3-4951-8d0a-6f0897b7d476 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:24.797012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d197b-8aa3-4951-8d0a-6f0897b7d476 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:24.801962 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2519/5016] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:24.803554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f3fc0-db06-4d27-b1b9-ebbc08259075 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:24.804244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f3fc0-db06-4d27-b1b9-ebbc08259075 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:24.804530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f3fc0-db06-4d27-b1b9-ebbc08259075 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:24.804874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f3fc0-db06-4d27-b1b9-ebbc08259075 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/74edfa89391b4dd6ba9e421aafe88fa2/users/ee54a1fb8e67423c8ba0b711648c05b2/roles/62d054433e44468fa8ccce1790d3a6ac/inherited_to_projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:24.806566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f3a4b-a3b5-402e-9508-79b07d7d1672 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:24.812303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f3fc0-db06-4d27-b1b9-ebbc08259075 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=74edfa89391b4dd6ba9e421aafe88fa2, user_id=ee54a1fb8e67423c8ba0b711648c05b2, role_id=62d054433e44468fa8ccce1790d3a6ac)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:24.813085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f3fc0-db06-4d27-b1b9-ebbc08259075 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:24.818333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f3a4b-a3b5-402e-9508-79b07d7d1672 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:24.818895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-009f3fc0-db06-4d27-b1b9-ebbc08259075 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invalidating the token cache because role 62d054433e44468fa8ccce1790d3a6ac was removed from user ee54a1fb8e67423c8ba0b711648c05b2 on project 74edfa89391b4dd6ba9e421aafe88fa2. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:24.819359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-009f3fc0-db06-4d27-b1b9-ebbc08259075 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:24.820584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-009f3fc0-db06-4d27-b1b9-ebbc08259075 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:24.825374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb464d-bcfe-4987-ab88-a79a200279a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:24.826214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb464d-bcfe-4987-ab88-a79a200279a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:24.826602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb464d-bcfe-4987-ab88-a79a200279a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:24.826967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb464d-bcfe-4987-ab88-a79a200279a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:24.827667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb464d-bcfe-4987-ab88-a79a200279a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:24.836770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb464d-bcfe-4987-ab88-a79a200279a7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:24.940582 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2498/5017] 10.222.0.20 () {58 vars in 1566 bytes} [Thu Oct 27 03:46:24 2022] DELETE /identity/v3/OS-INHERIT/projects/74edfa89391b4dd6ba9e421aafe88fa2/users/ee54a1fb8e67423c8ba0b711648c05b2/roles/62d054433e44468fa8ccce1790d3a6ac/inherited_to_projects => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:24.944463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f3fc0-db06-4d27-b1b9-ebbc08259075 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:24.944463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-009f3fc0-db06-4d27-b1b9-ebbc08259075 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:24.978072 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2520/5018] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:24 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:24.978072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb464d-bcfe-4987-ab88-a79a200279a7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:24.982311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-28bb464d-bcfe-4987-ab88-a79a200279a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:25.043206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f3fc0-db06-4d27-b1b9-ebbc08259075 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:25.044872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:25.084118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb464d-bcfe-4987-ab88-a79a200279a7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:25.091208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d485c54-d715-449f-b5c9-e9e08e34c876 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:25.092223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d485c54-d715-449f-b5c9-e9e08e34c876 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:25.092581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d485c54-d715-449f-b5c9-e9e08e34c876 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:25.093512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d485c54-d715-449f-b5c9-e9e08e34c876 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/roles/62d054433e44468fa8ccce1790d3a6ac` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:25.095247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d485c54-d715-449f-b5c9-e9e08e34c876 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:delete_role(role_id=62d054433e44468fa8ccce1790d3a6ac)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:25.097047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d485c54-d715-449f-b5c9-e9e08e34c876 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:25.144475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf85e01-489d-435c-9978-ae95159e437d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:25.145085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf85e01-489d-435c-9978-ae95159e437d service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:25.145369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf85e01-489d-435c-9978-ae95159e437d service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:25.145646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf85e01-489d-435c-9978-ae95159e437d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:25.149063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5cf85e01-489d-435c-9978-ae95159e437d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:25.235508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf85e01-489d-435c-9978-ae95159e437d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:25.237017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf85e01-489d-435c-9978-ae95159e437d service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:25.247402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6d485c54-d715-449f-b5c9-e9e08e34c876 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invalidating the token cache because role 62d054433e44468fa8ccce1790d3a6ac has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:25.252148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6d485c54-d715-449f-b5c9-e9e08e34c876 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:25.252148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6d485c54-d715-449f-b5c9-e9e08e34c876 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:25.252148 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2521/5019] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:24 2022] DELETE /identity/v3/roles/62d054433e44468fa8ccce1790d3a6ac => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:25.252148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d485c54-d715-449f-b5c9-e9e08e34c876 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:25.257080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6d485c54-d715-449f-b5c9-e9e08e34c876 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:25.261248 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2499/5020] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:24 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:25.261988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf85e01-489d-435c-9978-ae95159e437d service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:25.279040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf85e01-489d-435c-9978-ae95159e437d service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:25.377246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d485c54-d715-449f-b5c9-e9e08e34c876 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:25.382207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf32d5d-b070-4767-af71-791d8258c6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:25.382831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf32d5d-b070-4767-af71-791d8258c6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:25.383118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf32d5d-b070-4767-af71-791d8258c6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:25.383424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf32d5d-b070-4767-af71-791d8258c6b3 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:25.384219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf32d5d-b070-4767-af71-791d8258c6b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:25.386565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf32d5d-b070-4767-af71-791d8258c6b3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:25.389693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76088532-3797-4011-8490-0083831d0518 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:25.390595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76088532-3797-4011-8490-0083831d0518 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:25.390776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76088532-3797-4011-8490-0083831d0518 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:25.391920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76088532-3797-4011-8490-0083831d0518 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:25.392607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76088532-3797-4011-8490-0083831d0518 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:25.394395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76088532-3797-4011-8490-0083831d0518 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:25.556327 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2522/5021] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:25 2022] POST /identity/v3/users => generated 300 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:25.556546 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2500/5022] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:46:25 2022] POST /identity/v3/roles => generated 240 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:25.556546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87444632-958e-4cec-9a91-dfb8247f5272 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:25.556546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87444632-958e-4cec-9a91-dfb8247f5272 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:25.556546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87444632-958e-4cec-9a91-dfb8247f5272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:25.557847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf32d5d-b070-4767-af71-791d8258c6b3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:25.559497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-aaf32d5d-b070-4767-af71-791d8258c6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:25.572373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf32d5d-b070-4767-af71-791d8258c6b3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:25.575583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-87444632-958e-4cec-9a91-dfb8247f5272 None None] MFA Rules not processed for user `ca2da57f02884a968d685b53a5399e46`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:25.576774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-87444632-958e-4cec-9a91-dfb8247f5272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:25.577111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8042a-6177-46f1-90a7-2c67cbcd78a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:25.577739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8042a-6177-46f1-90a7-2c67cbcd78a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:25.578022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8042a-6177-46f1-90a7-2c67cbcd78a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:25.579008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8042a-6177-46f1-90a7-2c67cbcd78a7 admin admin] PATH_INFO: `/v3/projects/185dd630465a4f4593ad6b41f4afff03` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:25.580203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8042a-6177-46f1-90a7-2c67cbcd78a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=185dd630465a4f4593ad6b41f4afff03)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:25.582152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8042a-6177-46f1-90a7-2c67cbcd78a7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:25.644566 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2501/5023] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:25.646995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87444632-958e-4cec-9a91-dfb8247f5272 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:25.660561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87444632-958e-4cec-9a91-dfb8247f5272 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:25.667772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67bc0f-724c-46b4-98cf-df14c4cd0661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:25.668459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67bc0f-724c-46b4-98cf-df14c4cd0661 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:25.668745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67bc0f-724c-46b4-98cf-df14c4cd0661 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:25.669023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67bc0f-724c-46b4-98cf-df14c4cd0661 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:25.669945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67bc0f-724c-46b4-98cf-df14c4cd0661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:25.674923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67bc0f-724c-46b4-98cf-df14c4cd0661 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:25.694447 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2502/5024] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:25 2022] GET /identity/v3/roles => generated 1651 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:25.694447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67bc0f-724c-46b4-98cf-df14c4cd0661 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:25.694447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cf67bc0f-724c-46b4-98cf-df14c4cd0661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:25.704986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67bc0f-724c-46b4-98cf-df14c4cd0661 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:25.711300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48ed03-4f60-4ef7-86c9-a03f885058fd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:25.711300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48ed03-4f60-4ef7-86c9-a03f885058fd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:25.711300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48ed03-4f60-4ef7-86c9-a03f885058fd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:25.711582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48ed03-4f60-4ef7-86c9-a03f885058fd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/308a99eb19f24728931c488312702b34/groups/8b8d8c2298da4587990f0859880af9b6/roles/3e414bfaba00425a8a0db4bc44b092cc/inherited_to_projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:25.713663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48ed03-4f60-4ef7-86c9-a03f885058fd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=308a99eb19f24728931c488312702b34, group_id=8b8d8c2298da4587990f0859880af9b6, role_id=3e414bfaba00425a8a0db4bc44b092cc)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:25.716516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48ed03-4f60-4ef7-86c9-a03f885058fd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:25.731569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:25.770459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bbf8042a-6177-46f1-90a7-2c67cbcd78a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '185dd630465a4f4593ad6b41f4afff03', 'request_id': 'req-bbf8042a-6177-46f1-90a7-2c67cbcd78a7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:25.778222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bbf8042a-6177-46f1-90a7-2c67cbcd78a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '185dd630465a4f4593ad6b41f4afff03', 'request_id': 'req-bbf8042a-6177-46f1-90a7-2c67cbcd78a7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:25.784194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bbf8042a-6177-46f1-90a7-2c67cbcd78a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '185dd630465a4f4593ad6b41f4afff03', 'request_id': 'req-bbf8042a-6177-46f1-90a7-2c67cbcd78a7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:25.813474 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2503/5025] 10.222.0.20 () {60 vars in 1582 bytes} [Thu Oct 27 03:46:25 2022] PUT /identity/v3/OS-INHERIT/domains/308a99eb19f24728931c488312702b34/groups/8b8d8c2298da4587990f0859880af9b6/roles/3e414bfaba00425a8a0db4bc44b092cc/inherited_to_projects => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:25.814261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48ed03-4f60-4ef7-86c9-a03f885058fd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:25.883923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bbf8042a-6177-46f1-90a7-2c67cbcd78a7 admin admin] The token cache is being invalidate because project 185dd630465a4f4593ad6b41f4afff03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:25.885076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bbf8042a-6177-46f1-90a7-2c67cbcd78a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:25.886916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bbf8042a-6177-46f1-90a7-2c67cbcd78a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:25.893302 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2523/5026] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:25 2022] DELETE /identity/v3/projects/185dd630465a4f4593ad6b41f4afff03 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:25.894892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8042a-6177-46f1-90a7-2c67cbcd78a7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:25.896714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48ed03-4f60-4ef7-86c9-a03f885058fd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:25.897386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bbf8042a-6177-46f1-90a7-2c67cbcd78a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:25.902423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423439a7-ec2d-4e2d-a056-009383bff0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:25.903211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423439a7-ec2d-4e2d-a056-009383bff0fa admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:25.903485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423439a7-ec2d-4e2d-a056-009383bff0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:25.903771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423439a7-ec2d-4e2d-a056-009383bff0fa admin admin] PATH_INFO: `/v3/projects/43c9c2e329f04aba95f52aad77b623a8/users/d55a25b6c6e647bda1c94a292c2665a0/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:25.925625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423439a7-ec2d-4e2d-a056-009383bff0fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c9c2e329f04aba95f52aad77b623a8, user_id=d55a25b6c6e647bda1c94a292c2665a0, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:25.928913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423439a7-ec2d-4e2d-a056-009383bff0fa admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:26.004661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8042a-6177-46f1-90a7-2c67cbcd78a7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:26.046368 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2504/5027] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:25 2022] PUT /identity/v3/projects/43c9c2e329f04aba95f52aad77b623a8/users/d55a25b6c6e647bda1c94a292c2665a0/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:26.050732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423439a7-ec2d-4e2d-a056-009383bff0fa admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:26.055244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-423439a7-ec2d-4e2d-a056-009383bff0fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:26.103905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a1a86-fcf3-4838-9a58-4a6a87380bd4 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:26.106178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a1a86-fcf3-4838-9a58-4a6a87380bd4 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:26.106665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a1a86-fcf3-4838-9a58-4a6a87380bd4 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:26.107622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a1a86-fcf3-4838-9a58-4a6a87380bd4 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/308a99eb19f24728931c488312702b34/groups/8b8d8c2298da4587990f0859880af9b6/roles/inherited_to_projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:26.110415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a1a86-fcf3-4838-9a58-4a6a87380bd4 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=308a99eb19f24728931c488312702b34, group_id=8b8d8c2298da4587990f0859880af9b6)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:26.112742 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-ac9a1a86-fcf3-4838-9a58-4a6a87380bd4 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:46:26.112742 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:46:26.112742 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:46:26.118477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a1a86-fcf3-4838-9a58-4a6a87380bd4 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:26.139941 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2524/5028] 10.222.0.20 () {58 vars in 1464 bytes} [Thu Oct 27 03:46:25 2022] GET /identity/v3/OS-INHERIT/domains/308a99eb19f24728931c488312702b34/groups/8b8d8c2298da4587990f0859880af9b6/roles/inherited_to_projects => generated 448 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:26.141678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a1a86-fcf3-4838-9a58-4a6a87380bd4 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:26.145418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ac9a1a86-fcf3-4838-9a58-4a6a87380bd4 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:26.146460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423439a7-ec2d-4e2d-a056-009383bff0fa admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:26.168344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a1a86-fcf3-4838-9a58-4a6a87380bd4 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:26.169174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e4498-e93b-4211-adaa-ee85a6d697e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:26.170273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e4498-e93b-4211-adaa-ee85a6d697e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:26.170764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e4498-e93b-4211-adaa-ee85a6d697e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:26.171193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e4498-e93b-4211-adaa-ee85a6d697e0 admin admin] PATH_INFO: `/v3/users/49cbc285be1c48419ee58fcc150676b2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:26.175608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e4498-e93b-4211-adaa-ee85a6d697e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49cbc285be1c48419ee58fcc150676b2)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:26.179517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e4498-e93b-4211-adaa-ee85a6d697e0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:26.182132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab53017-3e54-4794-8297-3eba66f355aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:26.182298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab53017-3e54-4794-8297-3eba66f355aa admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:26.185007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab53017-3e54-4794-8297-3eba66f355aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:26.185007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab53017-3e54-4794-8297-3eba66f355aa admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:26.185007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab53017-3e54-4794-8297-3eba66f355aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:26.189298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab53017-3e54-4794-8297-3eba66f355aa admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:26.214490 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2525/5029] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:26 2022] GET /identity/v3/roles => generated 1651 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:26.215494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab53017-3e54-4794-8297-3eba66f355aa admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:26.317895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:26.347655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab53017-3e54-4794-8297-3eba66f355aa admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:26.361168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2a2ba-f7b1-447f-bef1-bc9bddb3d50a tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:26.361890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2a2ba-f7b1-447f-bef1-bc9bddb3d50a tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:26.362275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2a2ba-f7b1-447f-bef1-bc9bddb3d50a tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:26.362442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2a2ba-f7b1-447f-bef1-bc9bddb3d50a tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/308a99eb19f24728931c488312702b34/groups/8b8d8c2298da4587990f0859880af9b6/roles/3e414bfaba00425a8a0db4bc44b092cc/inherited_to_projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:26.371708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2a2ba-f7b1-447f-bef1-bc9bddb3d50a tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=308a99eb19f24728931c488312702b34, group_id=8b8d8c2298da4587990f0859880af9b6, role_id=3e414bfaba00425a8a0db4bc44b092cc)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:26.384810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2a2ba-f7b1-447f-bef1-bc9bddb3d50a tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:26.399174 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2526/5030] 10.222.0.20 () {58 vars in 1564 bytes} [Thu Oct 27 03:46:26 2022] HEAD /identity/v3/OS-INHERIT/domains/308a99eb19f24728931c488312702b34/groups/8b8d8c2298da4587990f0859880af9b6/roles/3e414bfaba00425a8a0db4bc44b092cc/inherited_to_projects => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:26.400316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2a2ba-f7b1-447f-bef1-bc9bddb3d50a tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:26.425968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2a2ba-f7b1-447f-bef1-bc9bddb3d50a tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:26.436340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7350e-28e8-4979-bbe8-4cf3a99ac34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:26.439185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7350e-28e8-4979-bbe8-4cf3a99ac34b admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:26.442753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7350e-28e8-4979-bbe8-4cf3a99ac34b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:26.442753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7350e-28e8-4979-bbe8-4cf3a99ac34b admin admin] PATH_INFO: `/v3/projects/43c9c2e329f04aba95f52aad77b623a8/users/d55a25b6c6e647bda1c94a292c2665a0/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:26.443802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7350e-28e8-4979-bbe8-4cf3a99ac34b admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c9c2e329f04aba95f52aad77b623a8, user_id=d55a25b6c6e647bda1c94a292c2665a0, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:26.446497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7350e-28e8-4979-bbe8-4cf3a99ac34b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:26.464432 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2527/5031] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:26 2022] PUT /identity/v3/projects/43c9c2e329f04aba95f52aad77b623a8/users/d55a25b6c6e647bda1c94a292c2665a0/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:26.467382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7350e-28e8-4979-bbe8-4cf3a99ac34b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:26.551323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a79e4498-e93b-4211-adaa-ee85a6d697e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49cbc285be1c48419ee58fcc150676b2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:26.552578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a79e4498-e93b-4211-adaa-ee85a6d697e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49cbc285be1c48419ee58fcc150676b2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:26.569441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a79e4498-e93b-4211-adaa-ee85a6d697e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49cbc285be1c48419ee58fcc150676b2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:26.586778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7350e-28e8-4979-bbe8-4cf3a99ac34b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:26.592343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7301d4-be1f-4c22-960b-0cc573f76b8b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:26.606892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7301d4-be1f-4c22-960b-0cc573f76b8b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:26.606892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7301d4-be1f-4c22-960b-0cc573f76b8b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:26.607101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7301d4-be1f-4c22-960b-0cc573f76b8b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/308a99eb19f24728931c488312702b34/groups/8b8d8c2298da4587990f0859880af9b6/roles/3e414bfaba00425a8a0db4bc44b092cc/inherited_to_projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:26.613168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a79e4498-e93b-4211-adaa-ee85a6d697e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49cbc285be1c48419ee58fcc150676b2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:26.613601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7301d4-be1f-4c22-960b-0cc573f76b8b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=308a99eb19f24728931c488312702b34, group_id=8b8d8c2298da4587990f0859880af9b6, role_id=3e414bfaba00425a8a0db4bc44b092cc)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:26.614802 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-ec7301d4-be1f-4c22-960b-0cc573f76b8b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:46:26.614802 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:46:26.614802 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:46:26.616712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7301d4-be1f-4c22-960b-0cc573f76b8b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:26.623888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ec7301d4-be1f-4c22-960b-0cc573f76b8b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invalidating the token cache because role 3e414bfaba00425a8a0db4bc44b092cc was removed from group 8b8d8c2298da4587990f0859880af9b6 on domain 308a99eb19f24728931c488312702b34. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:26.624259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ec7301d4-be1f-4c22-960b-0cc573f76b8b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:26.625102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ec7301d4-be1f-4c22-960b-0cc573f76b8b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:26.733678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a79e4498-e93b-4211-adaa-ee85a6d697e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49cbc285be1c48419ee58fcc150676b2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:26.739741 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2505/5032] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:26 2022] DELETE /identity/v3/users/49cbc285be1c48419ee58fcc150676b2 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:26.741259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac9058-c00c-49da-80aa-bd0fa778eed7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:26.741620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac9058-c00c-49da-80aa-bd0fa778eed7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:26.741905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac9058-c00c-49da-80aa-bd0fa778eed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:26.754549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:26.773224 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2528/5033] 10.222.0.20 () {58 vars in 1566 bytes} [Thu Oct 27 03:46:26 2022] DELETE /identity/v3/OS-INHERIT/domains/308a99eb19f24728931c488312702b34/groups/8b8d8c2298da4587990f0859880af9b6/roles/3e414bfaba00425a8a0db4bc44b092cc/inherited_to_projects => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:26.777304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7301d4-be1f-4c22-960b-0cc573f76b8b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:26.779890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ec7301d4-be1f-4c22-960b-0cc573f76b8b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:26.824076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f1ac9058-c00c-49da-80aa-bd0fa778eed7 None None] MFA Rules not processed for user `d55a25b6c6e647bda1c94a292c2665a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:26.825325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f1ac9058-c00c-49da-80aa-bd0fa778eed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:26.932072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7301d4-be1f-4c22-960b-0cc573f76b8b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:26.953031 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2506/5034] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:26.958791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac9058-c00c-49da-80aa-bd0fa778eed7 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:26.964628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac6db1-845c-4bf3-bac4-e5db3a6f2dd0 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:26.965295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac6db1-845c-4bf3-bac4-e5db3a6f2dd0 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:26.965578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac6db1-845c-4bf3-bac4-e5db3a6f2dd0 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:26.965928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac6db1-845c-4bf3-bac4-e5db3a6f2dd0 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/roles/3e414bfaba00425a8a0db4bc44b092cc` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:26.970780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac6db1-845c-4bf3-bac4-e5db3a6f2dd0 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3e414bfaba00425a8a0db4bc44b092cc)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:26.972223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac6db1-845c-4bf3-bac4-e5db3a6f2dd0 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:26.988801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac9058-c00c-49da-80aa-bd0fa778eed7 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:27.021517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b895f-4cac-4fb4-bb2d-110b4406ddd8 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55a25b6c6e647bda1c94a292c2665a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c9c2e329f04aba95f52aad77b623a8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:27.023655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b895f-4cac-4fb4-bb2d-110b4406ddd8 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:27.024158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b895f-4cac-4fb4-bb2d-110b4406ddd8 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:27.024847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b895f-4cac-4fb4-bb2d-110b4406ddd8 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:27.027114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b895f-4cac-4fb4-bb2d-110b4406ddd8 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:27.036230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b895f-4cac-4fb4-bb2d-110b4406ddd8 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:27.138425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-97ac6db1-845c-4bf3-bac4-e5db3a6f2dd0 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invalidating the token cache because role 3e414bfaba00425a8a0db4bc44b092cc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:27.138723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-97ac6db1-845c-4bf3-bac4-e5db3a6f2dd0 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:27.142320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-97ac6db1-845c-4bf3-bac4-e5db3a6f2dd0 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:27.148275 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2529/5035] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:26 2022] DELETE /identity/v3/roles/3e414bfaba00425a8a0db4bc44b092cc => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:46:27.149263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac6db1-845c-4bf3-bac4-e5db3a6f2dd0 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:27.150858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-97ac6db1-845c-4bf3-bac4-e5db3a6f2dd0 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:27.255892 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2507/5036] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:26 2022] POST /identity/v3/projects => generated 359 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:46:27.268471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac6db1-845c-4bf3-bac4-e5db3a6f2dd0 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:27.275762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b895f-4cac-4fb4-bb2d-110b4406ddd8 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:27.284024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f05b895f-4cac-4fb4-bb2d-110b4406ddd8 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:27.352077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:27.465467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1ed32-83cd-4853-852c-7cc2adaaf465 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:27.468102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1ed32-83cd-4853-852c-7cc2adaaf465 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:27.469071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1ed32-83cd-4853-852c-7cc2adaaf465 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:27.471882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1ed32-83cd-4853-852c-7cc2adaaf465 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:27.473946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1ed32-83cd-4853-852c-7cc2adaaf465 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:27.475957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b895f-4cac-4fb4-bb2d-110b4406ddd8 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:27.478485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1ed32-83cd-4853-852c-7cc2adaaf465 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:27.514788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde53d3c-418c-4ff7-8c6f-b7b7501ed995 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55a25b6c6e647bda1c94a292c2665a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c9c2e329f04aba95f52aad77b623a8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:27.515478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde53d3c-418c-4ff7-8c6f-b7b7501ed995 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:27.515787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde53d3c-418c-4ff7-8c6f-b7b7501ed995 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:27.516584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde53d3c-418c-4ff7-8c6f-b7b7501ed995 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] PATH_INFO: `/v3/projects/04d8996d9c2245088673f329ded03b90/tags/tempest-tag-1236823362` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:27.519940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde53d3c-418c-4ff7-8c6f-b7b7501ed995 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=04d8996d9c2245088673f329ded03b90, value=tempest-tag-1236823362)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:27.522256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde53d3c-418c-4ff7-8c6f-b7b7501ed995 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:27.591471 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2530/5037] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:46:27 2022] POST /identity/v3/roles => generated 239 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:46:27.596990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1ed32-83cd-4853-852c-7cc2adaaf465 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:27.632856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1ed32-83cd-4853-852c-7cc2adaaf465 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:27.648155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e35a99-1681-4779-9708-2b91127e2355 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:27.653731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e35a99-1681-4779-9708-2b91127e2355 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:27.654089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e35a99-1681-4779-9708-2b91127e2355 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:27.666695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e35a99-1681-4779-9708-2b91127e2355 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/308a99eb19f24728931c488312702b34/users/ee54a1fb8e67423c8ba0b711648c05b2/roles/7894451f41f84b7191aa43a846d67b3b/inherited_to_projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:27.692531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e35a99-1681-4779-9708-2b91127e2355 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=308a99eb19f24728931c488312702b34, user_id=ee54a1fb8e67423c8ba0b711648c05b2, role_id=7894451f41f84b7191aa43a846d67b3b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:27.700488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e35a99-1681-4779-9708-2b91127e2355 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:27.775813 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-fde53d3c-418c-4ff7-8c6f-b7b7501ed995 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1236823362. To ensure interoperability, identifiers should be a valid uuid. Oct 27 03:46:27.775813 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 27 03:46:27.775813 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:46:27.783812 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2508/5038] 10.222.0.20 () {60 vars in 1333 bytes} [Thu Oct 27 03:46:27 2022] PUT /identity/v3/projects/04d8996d9c2245088673f329ded03b90/tags/tempest-tag-1236823362 => generated 0 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) Oct 27 03:46:27.785058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde53d3c-418c-4ff7-8c6f-b7b7501ed995 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:27.788764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fde53d3c-418c-4ff7-8c6f-b7b7501ed995 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:27.825221 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2531/5039] 10.222.0.20 () {60 vars in 1579 bytes} [Thu Oct 27 03:46:27 2022] PUT /identity/v3/OS-INHERIT/domains/308a99eb19f24728931c488312702b34/users/ee54a1fb8e67423c8ba0b711648c05b2/roles/7894451f41f84b7191aa43a846d67b3b/inherited_to_projects => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:46:27.833579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e35a99-1681-4779-9708-2b91127e2355 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:27.933891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde53d3c-418c-4ff7-8c6f-b7b7501ed995 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:27.966640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e35a99-1681-4779-9708-2b91127e2355 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:27.971951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69889323-028c-4828-b3a6-764ba3cf6e4a tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55a25b6c6e647bda1c94a292c2665a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c9c2e329f04aba95f52aad77b623a8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:27.972779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69889323-028c-4828-b3a6-764ba3cf6e4a tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:27.973080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69889323-028c-4828-b3a6-764ba3cf6e4a tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:27.973503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69889323-028c-4828-b3a6-764ba3cf6e4a tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] PATH_INFO: `/v3/projects/04d8996d9c2245088673f329ded03b90/tags/tempest-tag-1236823362` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:27.995002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69889323-028c-4828-b3a6-764ba3cf6e4a tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=04d8996d9c2245088673f329ded03b90, value=tempest-tag-1236823362)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:27.999729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69889323-028c-4828-b3a6-764ba3cf6e4a tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:28.020256 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2532/5040] 10.222.0.20 () {58 vars in 1314 bytes} [Thu Oct 27 03:46:27 2022] GET /identity/v3/projects/04d8996d9c2245088673f329ded03b90/tags/tempest-tag-1236823362 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:28.021369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69889323-028c-4828-b3a6-764ba3cf6e4a tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:28.090114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8adacd-b1f3-4cf1-97fa-1bb09956bd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:28.090973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8adacd-b1f3-4cf1-97fa-1bb09956bd5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:28.091566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8adacd-b1f3-4cf1-97fa-1bb09956bd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:28.091816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8adacd-b1f3-4cf1-97fa-1bb09956bd5f admin admin] PATH_INFO: `/v3/projects/038f66b7ea334bd7a74cd5b6189450eb` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:28.093231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8adacd-b1f3-4cf1-97fa-1bb09956bd5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=038f66b7ea334bd7a74cd5b6189450eb)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:28.095895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8adacd-b1f3-4cf1-97fa-1bb09956bd5f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:28.123700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:28.172837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69889323-028c-4828-b3a6-764ba3cf6e4a tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:28.183633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37533fca-7ae4-4fb4-9dd6-831d610aa733 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:28.186865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37533fca-7ae4-4fb4-9dd6-831d610aa733 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:28.187154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37533fca-7ae4-4fb4-9dd6-831d610aa733 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:28.187435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37533fca-7ae4-4fb4-9dd6-831d610aa733 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/308a99eb19f24728931c488312702b34/users/ee54a1fb8e67423c8ba0b711648c05b2/roles/inherited_to_projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:28.189921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37533fca-7ae4-4fb4-9dd6-831d610aa733 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=308a99eb19f24728931c488312702b34, user_id=ee54a1fb8e67423c8ba0b711648c05b2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:28.192684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37533fca-7ae4-4fb4-9dd6-831d610aa733 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:28.246570 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2533/5041] 10.222.0.20 () {58 vars in 1461 bytes} [Thu Oct 27 03:46:28 2022] GET /identity/v3/OS-INHERIT/domains/308a99eb19f24728931c488312702b34/users/ee54a1fb8e67423c8ba0b711648c05b2/roles/inherited_to_projects => generated 446 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:28.251637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37533fca-7ae4-4fb4-9dd6-831d610aa733 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:28.271468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37533fca-7ae4-4fb4-9dd6-831d610aa733 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:28.304192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8e8adacd-b1f3-4cf1-97fa-1bb09956bd5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '038f66b7ea334bd7a74cd5b6189450eb', 'request_id': 'req-8e8adacd-b1f3-4cf1-97fa-1bb09956bd5f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:28.351030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6555ad-81d8-42cf-ba26-2efa5e4290a7 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55a25b6c6e647bda1c94a292c2665a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c9c2e329f04aba95f52aad77b623a8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:28.351679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6555ad-81d8-42cf-ba26-2efa5e4290a7 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:28.354027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6555ad-81d8-42cf-ba26-2efa5e4290a7 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:28.354027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6555ad-81d8-42cf-ba26-2efa5e4290a7 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] PATH_INFO: `/v3/projects/04d8996d9c2245088673f329ded03b90/tags` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:28.354027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6555ad-81d8-42cf-ba26-2efa5e4290a7 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=04d8996d9c2245088673f329ded03b90)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:28.355743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6555ad-81d8-42cf-ba26-2efa5e4290a7 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:28.373027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8e8adacd-b1f3-4cf1-97fa-1bb09956bd5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '038f66b7ea334bd7a74cd5b6189450eb', 'request_id': 'req-8e8adacd-b1f3-4cf1-97fa-1bb09956bd5f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:28.380594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8e8adacd-b1f3-4cf1-97fa-1bb09956bd5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '038f66b7ea334bd7a74cd5b6189450eb', 'request_id': 'req-8e8adacd-b1f3-4cf1-97fa-1bb09956bd5f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:28.393338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8e8adacd-b1f3-4cf1-97fa-1bb09956bd5f admin admin] The token cache is being invalidate because project 038f66b7ea334bd7a74cd5b6189450eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:28.393633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8e8adacd-b1f3-4cf1-97fa-1bb09956bd5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:28.394488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8e8adacd-b1f3-4cf1-97fa-1bb09956bd5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:28.396170 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2509/5042] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:27 2022] DELETE /identity/v3/projects/038f66b7ea334bd7a74cd5b6189450eb => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:28.399573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8adacd-b1f3-4cf1-97fa-1bb09956bd5f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:28.399573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8e8adacd-b1f3-4cf1-97fa-1bb09956bd5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:28.466129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8adacd-b1f3-4cf1-97fa-1bb09956bd5f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:28.471406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e82598-5b25-43db-af7f-8bc60cc22dbc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:28.472124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e82598-5b25-43db-af7f-8bc60cc22dbc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:28.473776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e82598-5b25-43db-af7f-8bc60cc22dbc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:28.473776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e82598-5b25-43db-af7f-8bc60cc22dbc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/308a99eb19f24728931c488312702b34/users/ee54a1fb8e67423c8ba0b711648c05b2/roles/7894451f41f84b7191aa43a846d67b3b/inherited_to_projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:28.474917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e82598-5b25-43db-af7f-8bc60cc22dbc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=308a99eb19f24728931c488312702b34, user_id=ee54a1fb8e67423c8ba0b711648c05b2, role_id=7894451f41f84b7191aa43a846d67b3b)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:28.475956 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-42e82598-5b25-43db-af7f-8bc60cc22dbc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:46:28.475956 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:46:28.475956 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:46:28.477903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e82598-5b25-43db-af7f-8bc60cc22dbc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:28.485303 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2510/5043] 10.222.0.20 () {58 vars in 1561 bytes} [Thu Oct 27 03:46:28 2022] HEAD /identity/v3/OS-INHERIT/domains/308a99eb19f24728931c488312702b34/users/ee54a1fb8e67423c8ba0b711648c05b2/roles/7894451f41f84b7191aa43a846d67b3b/inherited_to_projects => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:28.485984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e82598-5b25-43db-af7f-8bc60cc22dbc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:28.487837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-42e82598-5b25-43db-af7f-8bc60cc22dbc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:28.510674 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2534/5044] 10.222.0.20 () {60 vars in 1265 bytes} [Thu Oct 27 03:46:28 2022] PUT /identity/v3/projects/04d8996d9c2245088673f329ded03b90/tags => generated 140 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:28.511556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6555ad-81d8-42cf-ba26-2efa5e4290a7 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:28.534707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6555ad-81d8-42cf-ba26-2efa5e4290a7 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:28.549029 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f8b9b-2ebd-4df0-b1ab-17d0fb819613 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:28.549029 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f8b9b-2ebd-4df0-b1ab-17d0fb819613 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:28.549029 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f8b9b-2ebd-4df0-b1ab-17d0fb819613 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:28.549357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f8b9b-2ebd-4df0-b1ab-17d0fb819613 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/308a99eb19f24728931c488312702b34/users/ee54a1fb8e67423c8ba0b711648c05b2/roles/7894451f41f84b7191aa43a846d67b3b/inherited_to_projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:28.549357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f8b9b-2ebd-4df0-b1ab-17d0fb819613 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=308a99eb19f24728931c488312702b34, user_id=ee54a1fb8e67423c8ba0b711648c05b2, role_id=7894451f41f84b7191aa43a846d67b3b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:28.552460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f8b9b-2ebd-4df0-b1ab-17d0fb819613 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:28.558405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c36f8b9b-2ebd-4df0-b1ab-17d0fb819613 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invalidating the token cache because role 7894451f41f84b7191aa43a846d67b3b was removed from user ee54a1fb8e67423c8ba0b711648c05b2 on domain 308a99eb19f24728931c488312702b34. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:28.558834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c36f8b9b-2ebd-4df0-b1ab-17d0fb819613 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:28.559724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c36f8b9b-2ebd-4df0-b1ab-17d0fb819613 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:28.577873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e82598-5b25-43db-af7f-8bc60cc22dbc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:28.584112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857852e-0d6b-4ed3-b8f6-4874c1a945e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:28.585686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857852e-0d6b-4ed3-b8f6-4874c1a945e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:28.586117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857852e-0d6b-4ed3-b8f6-4874c1a945e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:28.586405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857852e-0d6b-4ed3-b8f6-4874c1a945e6 admin admin] PATH_INFO: `/v3/users/2b321c4a7d144f4ebeb4eb58f8313f33` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:28.587891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857852e-0d6b-4ed3-b8f6-4874c1a945e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b321c4a7d144f4ebeb4eb58f8313f33)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:28.590813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857852e-0d6b-4ed3-b8f6-4874c1a945e6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:28.640246 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2535/5045] 10.222.0.20 () {58 vars in 1563 bytes} [Thu Oct 27 03:46:28 2022] DELETE /identity/v3/OS-INHERIT/domains/308a99eb19f24728931c488312702b34/users/ee54a1fb8e67423c8ba0b711648c05b2/roles/7894451f41f84b7191aa43a846d67b3b/inherited_to_projects => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:28.642092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f8b9b-2ebd-4df0-b1ab-17d0fb819613 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:28.644005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c36f8b9b-2ebd-4df0-b1ab-17d0fb819613 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:28.714509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f8b9b-2ebd-4df0-b1ab-17d0fb819613 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:28.719922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78fa18-18a7-4397-bbdf-f24277f2b6e2 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55a25b6c6e647bda1c94a292c2665a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c9c2e329f04aba95f52aad77b623a8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:28.720606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78fa18-18a7-4397-bbdf-f24277f2b6e2 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:28.721212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78fa18-18a7-4397-bbdf-f24277f2b6e2 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:28.721212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78fa18-18a7-4397-bbdf-f24277f2b6e2 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] PATH_INFO: `/v3/projects/04d8996d9c2245088673f329ded03b90/tags` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:28.736233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78fa18-18a7-4397-bbdf-f24277f2b6e2 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=04d8996d9c2245088673f329ded03b90)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:28.740048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78fa18-18a7-4397-bbdf-f24277f2b6e2 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:28.752037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9857852e-0d6b-4ed3-b8f6-4874c1a945e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b321c4a7d144f4ebeb4eb58f8313f33'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:28.753129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9857852e-0d6b-4ed3-b8f6-4874c1a945e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b321c4a7d144f4ebeb4eb58f8313f33'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:28.757110 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2536/5046] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:46:28 2022] GET /identity/v3/projects/04d8996d9c2245088673f329ded03b90/tags => generated 140 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:28.758235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78fa18-18a7-4397-bbdf-f24277f2b6e2 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:28.760273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0f78fa18-18a7-4397-bbdf-f24277f2b6e2 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:28.763102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9857852e-0d6b-4ed3-b8f6-4874c1a945e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b321c4a7d144f4ebeb4eb58f8313f33'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:28.777880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9857852e-0d6b-4ed3-b8f6-4874c1a945e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b321c4a7d144f4ebeb4eb58f8313f33'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:28.848224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78fa18-18a7-4397-bbdf-f24277f2b6e2 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:28.853010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02b4b7-111b-41d2-9243-0e45afbb474d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:28.853653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02b4b7-111b-41d2-9243-0e45afbb474d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:28.853950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02b4b7-111b-41d2-9243-0e45afbb474d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:28.854261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02b4b7-111b-41d2-9243-0e45afbb474d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/roles/7894451f41f84b7191aa43a846d67b3b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:28.855668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02b4b7-111b-41d2-9243-0e45afbb474d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7894451f41f84b7191aa43a846d67b3b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:28.857364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02b4b7-111b-41d2-9243-0e45afbb474d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:28.865178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9857852e-0d6b-4ed3-b8f6-4874c1a945e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b321c4a7d144f4ebeb4eb58f8313f33'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:28.873779 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2511/5047] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:28 2022] DELETE /identity/v3/users/2b321c4a7d144f4ebeb4eb58f8313f33 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:28.877024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857852e-0d6b-4ed3-b8f6-4874c1a945e6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:28.877911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9857852e-0d6b-4ed3-b8f6-4874c1a945e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:28.897066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:28.981194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857852e-0d6b-4ed3-b8f6-4874c1a945e6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:28.987116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916bcfe-9a8d-4e9f-9461-43c9324c2c55 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55a25b6c6e647bda1c94a292c2665a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c9c2e329f04aba95f52aad77b623a8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:28.988159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916bcfe-9a8d-4e9f-9461-43c9324c2c55 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:28.988680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916bcfe-9a8d-4e9f-9461-43c9324c2c55 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:28.989201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916bcfe-9a8d-4e9f-9461-43c9324c2c55 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] PATH_INFO: `/v3/projects/04d8996d9c2245088673f329ded03b90/tags/tempest-tag-1482687000` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:28.990733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916bcfe-9a8d-4e9f-9461-43c9324c2c55 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=04d8996d9c2245088673f329ded03b90, value=tempest-tag-1482687000)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:28.993936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916bcfe-9a8d-4e9f-9461-43c9324c2c55 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:29.034988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1c02b4b7-111b-41d2-9243-0e45afbb474d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invalidating the token cache because role 7894451f41f84b7191aa43a846d67b3b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:29.035558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1c02b4b7-111b-41d2-9243-0e45afbb474d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:29.036493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1c02b4b7-111b-41d2-9243-0e45afbb474d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:29.038742 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2537/5048] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:28 2022] DELETE /identity/v3/roles/7894451f41f84b7191aa43a846d67b3b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:29.043652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02b4b7-111b-41d2-9243-0e45afbb474d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:29.045438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1c02b4b7-111b-41d2-9243-0e45afbb474d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:29.113103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02b4b7-111b-41d2-9243-0e45afbb474d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:29.124453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eedf7f-1b2e-41f7-bc89-25959c1e9b03 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:29.124767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eedf7f-1b2e-41f7-bc89-25959c1e9b03 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:29.126762 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-9916bcfe-9a8d-4e9f-9461-43c9324c2c55 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1482687000. To ensure interoperability, identifiers should be a valid uuid. Oct 27 03:46:29.126762 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 27 03:46:29.126762 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:46:29.127980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eedf7f-1b2e-41f7-bc89-25959c1e9b03 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:29.128298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eedf7f-1b2e-41f7-bc89-25959c1e9b03 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:29.129065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eedf7f-1b2e-41f7-bc89-25959c1e9b03 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:29.130839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eedf7f-1b2e-41f7-bc89-25959c1e9b03 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:29.148090 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2512/5049] 10.222.0.20 () {58 vars in 1317 bytes} [Thu Oct 27 03:46:28 2022] DELETE /identity/v3/projects/04d8996d9c2245088673f329ded03b90/tags/tempest-tag-1482687000 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:29.149438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916bcfe-9a8d-4e9f-9461-43c9324c2c55 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:29.154737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9916bcfe-9a8d-4e9f-9461-43c9324c2c55 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:29.202232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916bcfe-9a8d-4e9f-9461-43c9324c2c55 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:29.255464 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2538/5050] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:46:29 2022] POST /identity/v3/roles => generated 239 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:29.260341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eedf7f-1b2e-41f7-bc89-25959c1e9b03 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:29.286658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eedf7f-1b2e-41f7-bc89-25959c1e9b03 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:29.292389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa668b5c-8aa7-4e9b-bb6a-229d59d3d36e tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:29.293288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa668b5c-8aa7-4e9b-bb6a-229d59d3d36e tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:29.293978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa668b5c-8aa7-4e9b-bb6a-229d59d3d36e tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:29.294498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa668b5c-8aa7-4e9b-bb6a-229d59d3d36e tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:29.295616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa668b5c-8aa7-4e9b-bb6a-229d59d3d36e tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:29.298458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa668b5c-8aa7-4e9b-bb6a-229d59d3d36e tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:29.348573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef92ba-cbdc-4ad9-9287-405c842cf893 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55a25b6c6e647bda1c94a292c2665a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c9c2e329f04aba95f52aad77b623a8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:29.349356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef92ba-cbdc-4ad9-9287-405c842cf893 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:29.349593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef92ba-cbdc-4ad9-9287-405c842cf893 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:29.349940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef92ba-cbdc-4ad9-9287-405c842cf893 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] PATH_INFO: `/v3/projects/04d8996d9c2245088673f329ded03b90/tags/tempest-tag-1482687000` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:29.363350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef92ba-cbdc-4ad9-9287-405c842cf893 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=04d8996d9c2245088673f329ded03b90, value=tempest-tag-1482687000)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:29.365812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef92ba-cbdc-4ad9-9287-405c842cf893 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:29.382451 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-96ef92ba-cbdc-4ad9-9287-405c842cf893 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Could not find project tag: tempest-tag-1482687000.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1482687000. Oct 27 03:46:29.382451 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:46:29.382451 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:46:29.382451 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:46:29.382451 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:46:29.382451 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:46:29.382451 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:46:29.382451 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:46:29.382451 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:46:29.382451 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:46:29.382451 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:46:29.382451 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:46:29.382451 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Oct 27 03:46:29.382451 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Oct 27 03:46:29.383549 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:46:29.383549 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:46:29.383549 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Oct 27 03:46:29.383549 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Oct 27 03:46:29.383549 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1482687000. Oct 27 03:46:29.383549 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:29.387788 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2513/5051] 10.222.0.20 () {58 vars in 1314 bytes} [Thu Oct 27 03:46:29 2022] GET /identity/v3/projects/04d8996d9c2245088673f329ded03b90/tags/tempest-tag-1482687000 => generated 107 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:46:29.387941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef92ba-cbdc-4ad9-9287-405c842cf893 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:29.405541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef92ba-cbdc-4ad9-9287-405c842cf893 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:29.434092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b3ea6-ce55-4aef-a73f-a0b88891fe24 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55a25b6c6e647bda1c94a292c2665a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c9c2e329f04aba95f52aad77b623a8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:29.436004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b3ea6-ce55-4aef-a73f-a0b88891fe24 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:29.436345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b3ea6-ce55-4aef-a73f-a0b88891fe24 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:29.436583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b3ea6-ce55-4aef-a73f-a0b88891fe24 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] PATH_INFO: `/v3/projects/04d8996d9c2245088673f329ded03b90/tags` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:29.439664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b3ea6-ce55-4aef-a73f-a0b88891fe24 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=04d8996d9c2245088673f329ded03b90)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:29.445347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b3ea6-ce55-4aef-a73f-a0b88891fe24 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:29.484447 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2539/5052] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:29 2022] POST /identity/v3/projects => generated 408 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:29.488619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa668b5c-8aa7-4e9b-bb6a-229d59d3d36e tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:29.588090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:29.591246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa668b5c-8aa7-4e9b-bb6a-229d59d3d36e tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:29.595736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e8530-295f-4385-af52-06016272c51f tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:29.596690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e8530-295f-4385-af52-06016272c51f tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:29.597084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e8530-295f-4385-af52-06016272c51f tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:29.597486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e8530-295f-4385-af52-06016272c51f tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/308a99eb19f24728931c488312702b34/users/ee54a1fb8e67423c8ba0b711648c05b2/roles/fc54bfabf05b4d52bbe75163dfcfc08c/inherited_to_projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:29.600045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e8530-295f-4385-af52-06016272c51f tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=308a99eb19f24728931c488312702b34, user_id=ee54a1fb8e67423c8ba0b711648c05b2, role_id=fc54bfabf05b4d52bbe75163dfcfc08c)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:29.604678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e8530-295f-4385-af52-06016272c51f tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:29.649903 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2514/5053] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:46:29 2022] DELETE /identity/v3/projects/04d8996d9c2245088673f329ded03b90/tags => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:46:29.653769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b3ea6-ce55-4aef-a73f-a0b88891fe24 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:29.668050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b3ea6-ce55-4aef-a73f-a0b88891fe24 tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:29.706824 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2540/5054] 10.222.0.20 () {60 vars in 1579 bytes} [Thu Oct 27 03:46:29 2022] PUT /identity/v3/OS-INHERIT/domains/308a99eb19f24728931c488312702b34/users/ee54a1fb8e67423c8ba0b711648c05b2/roles/fc54bfabf05b4d52bbe75163dfcfc08c/inherited_to_projects => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:46:29.735826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e8530-295f-4385-af52-06016272c51f tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:29.801344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f86264-9a08-48d7-b2c5-48afd8f2e2da tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55a25b6c6e647bda1c94a292c2665a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c9c2e329f04aba95f52aad77b623a8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:29.802162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f86264-9a08-48d7-b2c5-48afd8f2e2da tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:29.802518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f86264-9a08-48d7-b2c5-48afd8f2e2da tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:29.802865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f86264-9a08-48d7-b2c5-48afd8f2e2da tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] PATH_INFO: `/v3/projects/04d8996d9c2245088673f329ded03b90/tags` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:29.816216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f86264-9a08-48d7-b2c5-48afd8f2e2da tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=04d8996d9c2245088673f329ded03b90)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:29.818841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f86264-9a08-48d7-b2c5-48afd8f2e2da tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:29.858596 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2515/5055] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:46:29 2022] GET /identity/v3/projects/04d8996d9c2245088673f329ded03b90/tags => generated 66 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 27 03:46:29.861252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f86264-9a08-48d7-b2c5-48afd8f2e2da tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:29.870123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-32f86264-9a08-48d7-b2c5-48afd8f2e2da tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:29.917918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e8530-295f-4385-af52-06016272c51f tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:29.926223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ad57e-1987-42fa-968a-1c91e824a614 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:29.926974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ad57e-1987-42fa-968a-1c91e824a614 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:29.927363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ad57e-1987-42fa-968a-1c91e824a614 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:29.927746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ad57e-1987-42fa-968a-1c91e824a614 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:29.928603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ad57e-1987-42fa-968a-1c91e824a614 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Adding query filter params (scope.project.id=74edfa89391b4dd6ba9e421aafe88fa2, user.id=ee54a1fb8e67423c8ba0b711648c05b2) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:46:29.929021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ad57e-1987-42fa-968a-1c91e824a614 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:29.930281 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-9e0ad57e-1987-42fa-968a-1c91e824a614 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:46:29.930281 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:46:29.930281 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:46:29.932144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ad57e-1987-42fa-968a-1c91e824a614 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:29.982605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f86264-9a08-48d7-b2c5-48afd8f2e2da tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:30.080590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e73dc-5a21-4abe-ad18-a08a794bafe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:30.082939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e73dc-5a21-4abe-ad18-a08a794bafe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:30.083775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e73dc-5a21-4abe-ad18-a08a794bafe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:30.084342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e73dc-5a21-4abe-ad18-a08a794bafe8 admin admin] PATH_INFO: `/v3/projects/84568aa78d26412280d9578523d1ca5e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:30.086473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e73dc-5a21-4abe-ad18-a08a794bafe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84568aa78d26412280d9578523d1ca5e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:30.090824 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2541/5056] 10.222.0.20 () {58 vars in 1356 bytes} [Thu Oct 27 03:46:29 2022] GET /identity/v3/role_assignments?scope.project.id=74edfa89391b4dd6ba9e421aafe88fa2&user.id=ee54a1fb8e67423c8ba0b711648c05b2&effective => generated 648 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:30.090824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ad57e-1987-42fa-968a-1c91e824a614 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:30.094659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e73dc-5a21-4abe-ad18-a08a794bafe8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:30.179710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:30.313283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ad57e-1987-42fa-968a-1c91e824a614 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:30.326187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb7e73dc-5a21-4abe-ad18-a08a794bafe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84568aa78d26412280d9578523d1ca5e', 'request_id': 'req-bb7e73dc-5a21-4abe-ad18-a08a794bafe8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:30.393315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb7e73dc-5a21-4abe-ad18-a08a794bafe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84568aa78d26412280d9578523d1ca5e', 'request_id': 'req-bb7e73dc-5a21-4abe-ad18-a08a794bafe8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:30.409320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb7e73dc-5a21-4abe-ad18-a08a794bafe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84568aa78d26412280d9578523d1ca5e', 'request_id': 'req-bb7e73dc-5a21-4abe-ad18-a08a794bafe8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:30.425970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb7e73dc-5a21-4abe-ad18-a08a794bafe8 admin admin] The token cache is being invalidate because project 84568aa78d26412280d9578523d1ca5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:30.426244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb7e73dc-5a21-4abe-ad18-a08a794bafe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:30.427926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb7e73dc-5a21-4abe-ad18-a08a794bafe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:30.429918 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2516/5057] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:29 2022] DELETE /identity/v3/projects/84568aa78d26412280d9578523d1ca5e => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:30.430803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e73dc-5a21-4abe-ad18-a08a794bafe8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:30.433941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bb7e73dc-5a21-4abe-ad18-a08a794bafe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:30.450940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900e516-cea5-4cb8-a958-c9477dd876bb tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55a25b6c6e647bda1c94a292c2665a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c9c2e329f04aba95f52aad77b623a8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:30.451603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900e516-cea5-4cb8-a958-c9477dd876bb tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:30.451889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900e516-cea5-4cb8-a958-c9477dd876bb tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:30.452169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900e516-cea5-4cb8-a958-c9477dd876bb tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] PATH_INFO: `/v3/projects/04d8996d9c2245088673f329ded03b90` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:30.464371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900e516-cea5-4cb8-a958-c9477dd876bb tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: Authorizing `identity:delete_project(project_id=04d8996d9c2245088673f329ded03b90)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:30.466575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900e516-cea5-4cb8-a958-c9477dd876bb tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:30.556239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e73dc-5a21-4abe-ad18-a08a794bafe8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:30.561763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6fdeb-56e5-4e22-a202-072df56137e0 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:30.562469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6fdeb-56e5-4e22-a202-072df56137e0 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:30.563330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6fdeb-56e5-4e22-a202-072df56137e0 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:30.564054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6fdeb-56e5-4e22-a202-072df56137e0 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:30.564947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d6fdeb-56e5-4e22-a202-072df56137e0 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Adding query filter params (scope.project.id=1e4278263f664210aad374689d9ba24a, user.id=ee54a1fb8e67423c8ba0b711648c05b2) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:46:30.565267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d6fdeb-56e5-4e22-a202-072df56137e0 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:30.566482 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-a1d6fdeb-56e5-4e22-a202-072df56137e0 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:46:30.566482 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:46:30.566482 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:46:30.572848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d6fdeb-56e5-4e22-a202-072df56137e0 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:30.645459 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2517/5058] 10.222.0.20 () {58 vars in 1356 bytes} [Thu Oct 27 03:46:30 2022] GET /identity/v3/role_assignments?scope.project.id=1e4278263f664210aad374689d9ba24a&user.id=ee54a1fb8e67423c8ba0b711648c05b2&effective => generated 648 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:30.647785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495ab31-9e2f-4e5a-ac25-dd6578f88ed0 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:30.648132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495ab31-9e2f-4e5a-ac25-dd6578f88ed0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:30.648676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495ab31-9e2f-4e5a-ac25-dd6578f88ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:30.658656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:30.693493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6495ab31-9e2f-4e5a-ac25-dd6578f88ed0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:30.694867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6495ab31-9e2f-4e5a-ac25-dd6578f88ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:30.747724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1900e516-cea5-4cb8-a958-c9477dd876bb tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04d8996d9c2245088673f329ded03b90', 'request_id': 'req-1900e516-cea5-4cb8-a958-c9477dd876bb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:30.759444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1900e516-cea5-4cb8-a958-c9477dd876bb tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04d8996d9c2245088673f329ded03b90', 'request_id': 'req-1900e516-cea5-4cb8-a958-c9477dd876bb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:30.775145 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2518/5059] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:30.784271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495ab31-9e2f-4e5a-ac25-dd6578f88ed0 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:30.790597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1900e516-cea5-4cb8-a958-c9477dd876bb tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04d8996d9c2245088673f329ded03b90', 'request_id': 'req-1900e516-cea5-4cb8-a958-c9477dd876bb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:30.896365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:30.905696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495ab31-9e2f-4e5a-ac25-dd6578f88ed0 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:31.064957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1900e516-cea5-4cb8-a958-c9477dd876bb tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] The token cache is being invalidate because project 04d8996d9c2245088673f329ded03b90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:31.065440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1900e516-cea5-4cb8-a958-c9477dd876bb tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:31.066602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1900e516-cea5-4cb8-a958-c9477dd876bb tempest-IdentityV3ProjectTagsTest-1983955182 tempest-IdentityV3ProjectTagsTest-1983955182-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:31.069555 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2542/5060] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:30 2022] DELETE /identity/v3/projects/04d8996d9c2245088673f329ded03b90 => generated 0 bytes in 981 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:31.072026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c05d7-c274-40f5-8d8d-da4528ce34ed None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:31.076221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c05d7-c274-40f5-8d8d-da4528ce34ed None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:31.076884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70b5ac-852c-4a0a-8205-847e9efd0438 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:31.077024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c05d7-c274-40f5-8d8d-da4528ce34ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:31.077589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70b5ac-852c-4a0a-8205-847e9efd0438 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:31.077954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70b5ac-852c-4a0a-8205-847e9efd0438 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:31.079192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70b5ac-852c-4a0a-8205-847e9efd0438 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/308a99eb19f24728931c488312702b34/users/ee54a1fb8e67423c8ba0b711648c05b2/roles/fc54bfabf05b4d52bbe75163dfcfc08c/inherited_to_projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:31.081565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70b5ac-852c-4a0a-8205-847e9efd0438 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=308a99eb19f24728931c488312702b34, user_id=ee54a1fb8e67423c8ba0b711648c05b2, role_id=fc54bfabf05b4d52bbe75163dfcfc08c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:31.084384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70b5ac-852c-4a0a-8205-847e9efd0438 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:31.092200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6b70b5ac-852c-4a0a-8205-847e9efd0438 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invalidating the token cache because role fc54bfabf05b4d52bbe75163dfcfc08c was removed from user ee54a1fb8e67423c8ba0b711648c05b2 on domain 308a99eb19f24728931c488312702b34. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:31.092200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6b70b5ac-852c-4a0a-8205-847e9efd0438 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:31.092200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6b70b5ac-852c-4a0a-8205-847e9efd0438 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:31.122264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0d1c05d7-c274-40f5-8d8d-da4528ce34ed None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:31.123609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0d1c05d7-c274-40f5-8d8d-da4528ce34ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:31.188684 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2519/5061] 10.222.0.20 () {58 vars in 1563 bytes} [Thu Oct 27 03:46:30 2022] DELETE /identity/v3/OS-INHERIT/domains/308a99eb19f24728931c488312702b34/users/ee54a1fb8e67423c8ba0b711648c05b2/roles/fc54bfabf05b4d52bbe75163dfcfc08c/inherited_to_projects => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:31.189737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70b5ac-852c-4a0a-8205-847e9efd0438 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:31.191362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6b70b5ac-852c-4a0a-8205-847e9efd0438 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:31.300803 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2543/5062] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:31.300803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c05d7-c274-40f5-8d8d-da4528ce34ed None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:31.300803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0d1c05d7-c274-40f5-8d8d-da4528ce34ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:31.305612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c05d7-c274-40f5-8d8d-da4528ce34ed None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:31.379643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70b5ac-852c-4a0a-8205-847e9efd0438 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:31.385528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbd213-b01c-49f0-83e8-88a8585bce23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:31.386643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbd213-b01c-49f0-83e8-88a8585bce23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:31.387225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbd213-b01c-49f0-83e8-88a8585bce23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:31.387784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbd213-b01c-49f0-83e8-88a8585bce23 admin admin] PATH_INFO: `/v3/users/17cb75672b9c4a94bf72f254e0857198` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:31.389243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afbd213-b01c-49f0-83e8-88a8585bce23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17cb75672b9c4a94bf72f254e0857198)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:31.391797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afbd213-b01c-49f0-83e8-88a8585bce23 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:31.409563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74181f28-4874-4cf1-bdcc-76388a8a14fa tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:31.410337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74181f28-4874-4cf1-bdcc-76388a8a14fa tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:31.411350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74181f28-4874-4cf1-bdcc-76388a8a14fa tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:31.411758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74181f28-4874-4cf1-bdcc-76388a8a14fa tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:31.412514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74181f28-4874-4cf1-bdcc-76388a8a14fa tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Adding query filter params (scope.project.id=74edfa89391b4dd6ba9e421aafe88fa2, user.id=ee54a1fb8e67423c8ba0b711648c05b2) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:46:31.412917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74181f28-4874-4cf1-bdcc-76388a8a14fa tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:31.415202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74181f28-4874-4cf1-bdcc-76388a8a14fa tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:31.467968 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2544/5063] 10.222.0.20 () {58 vars in 1356 bytes} [Thu Oct 27 03:46:31 2022] GET /identity/v3/role_assignments?scope.project.id=74edfa89391b4dd6ba9e421aafe88fa2&user.id=ee54a1fb8e67423c8ba0b711648c05b2&effective => generated 228 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:31.469495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74181f28-4874-4cf1-bdcc-76388a8a14fa tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:31.492391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74181f28-4874-4cf1-bdcc-76388a8a14fa tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:31.497753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a3f42-2936-4ace-adf8-8fc3047417ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:31.498584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a3f42-2936-4ace-adf8-8fc3047417ea admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:31.499002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a3f42-2936-4ace-adf8-8fc3047417ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:31.499428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a3f42-2936-4ace-adf8-8fc3047417ea admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:31.500234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a3f42-2936-4ace-adf8-8fc3047417ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:46:31.500615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a3f42-2936-4ace-adf8-8fc3047417ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:31.502934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a3f42-2936-4ace-adf8-8fc3047417ea admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:31.520556 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2545/5064] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:31.521355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a3f42-2936-4ace-adf8-8fc3047417ea admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:31.541913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a3f42-2936-4ace-adf8-8fc3047417ea admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:31.549933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abdb3e-1e26-4405-a0c4-5f3b18058b3b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:31.550643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abdb3e-1e26-4405-a0c4-5f3b18058b3b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:31.551081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abdb3e-1e26-4405-a0c4-5f3b18058b3b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:31.551373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abdb3e-1e26-4405-a0c4-5f3b18058b3b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:31.552126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06abdb3e-1e26-4405-a0c4-5f3b18058b3b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Adding query filter params (scope.project.id=1e4278263f664210aad374689d9ba24a, user.id=ee54a1fb8e67423c8ba0b711648c05b2) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:46:31.552438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06abdb3e-1e26-4405-a0c4-5f3b18058b3b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:31.554716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06abdb3e-1e26-4405-a0c4-5f3b18058b3b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:31.568899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:31.659413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:31.664756 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2546/5065] 10.222.0.20 () {58 vars in 1356 bytes} [Thu Oct 27 03:46:31 2022] GET /identity/v3/role_assignments?scope.project.id=1e4278263f664210aad374689d9ba24a&user.id=ee54a1fb8e67423c8ba0b711648c05b2&effective => generated 228 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:31.664756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abdb3e-1e26-4405-a0c4-5f3b18058b3b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:31.698360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abdb3e-1e26-4405-a0c4-5f3b18058b3b tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:31.713057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadb265-5620-4dd0-95fb-6030a9d024dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:31.713650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadb265-5620-4dd0-95fb-6030a9d024dc admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:31.713942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadb265-5620-4dd0-95fb-6030a9d024dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:31.714457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadb265-5620-4dd0-95fb-6030a9d024dc admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:31.714948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadb265-5620-4dd0-95fb-6030a9d024dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:31.716881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadb265-5620-4dd0-95fb-6030a9d024dc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:31.834644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0afbd213-b01c-49f0-83e8-88a8585bce23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17cb75672b9c4a94bf72f254e0857198'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:31.837900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0afbd213-b01c-49f0-83e8-88a8585bce23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17cb75672b9c4a94bf72f254e0857198'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:31.858757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0afbd213-b01c-49f0-83e8-88a8585bce23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17cb75672b9c4a94bf72f254e0857198'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:31.897496 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2547/5066] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:31 2022] POST /identity/v3/projects => generated 379 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:31.899970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadb265-5620-4dd0-95fb-6030a9d024dc admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:31.912607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6dadb265-5620-4dd0-95fb-6030a9d024dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:31.947645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0afbd213-b01c-49f0-83e8-88a8585bce23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17cb75672b9c4a94bf72f254e0857198'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:32.084239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0afbd213-b01c-49f0-83e8-88a8585bce23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17cb75672b9c4a94bf72f254e0857198'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:32.088771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadb265-5620-4dd0-95fb-6030a9d024dc admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:32.096441 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2520/5067] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:31 2022] DELETE /identity/v3/users/17cb75672b9c4a94bf72f254e0857198 => generated 0 bytes in 904 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:32.096643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba952f8-fd4d-4cf6-ae81-c75c62e25247 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:32.096769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbd213-b01c-49f0-83e8-88a8585bce23 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:32.096879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba952f8-fd4d-4cf6-ae81-c75c62e25247 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:32.096879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba952f8-fd4d-4cf6-ae81-c75c62e25247 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:32.096879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba952f8-fd4d-4cf6-ae81-c75c62e25247 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/projects/1e4278263f664210aad374689d9ba24a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:32.097533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0afbd213-b01c-49f0-83e8-88a8585bce23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:32.098306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba952f8-fd4d-4cf6-ae81-c75c62e25247 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1e4278263f664210aad374689d9ba24a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:32.100984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba952f8-fd4d-4cf6-ae81-c75c62e25247 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:32.264225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbd213-b01c-49f0-83e8-88a8585bce23 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:32.298091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ba952f8-fd4d-4cf6-ae81-c75c62e25247 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e4278263f664210aad374689d9ba24a', 'request_id': 'req-7ba952f8-fd4d-4cf6-ae81-c75c62e25247'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:32.320610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ba952f8-fd4d-4cf6-ae81-c75c62e25247 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e4278263f664210aad374689d9ba24a', 'request_id': 'req-7ba952f8-fd4d-4cf6-ae81-c75c62e25247'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:32.338171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ba952f8-fd4d-4cf6-ae81-c75c62e25247 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e4278263f664210aad374689d9ba24a', 'request_id': 'req-7ba952f8-fd4d-4cf6-ae81-c75c62e25247'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:32.459464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ba952f8-fd4d-4cf6-ae81-c75c62e25247 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] The token cache is being invalidate because project 1e4278263f664210aad374689d9ba24a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:32.460490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ba952f8-fd4d-4cf6-ae81-c75c62e25247 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:32.462081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ba952f8-fd4d-4cf6-ae81-c75c62e25247 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:32.464042 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2548/5068] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:31 2022] DELETE /identity/v3/projects/1e4278263f664210aad374689d9ba24a => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:32.465358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90377826-0c57-4d45-8c4b-3ede430b2d81 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:32.465688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90377826-0c57-4d45-8c4b-3ede430b2d81 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:32.472872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90377826-0c57-4d45-8c4b-3ede430b2d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:32.476839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460de04-4f21-40f0-bb7e-90ae0faa961b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:32.477482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460de04-4f21-40f0-bb7e-90ae0faa961b admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:32.477772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460de04-4f21-40f0-bb7e-90ae0faa961b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:32.479264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460de04-4f21-40f0-bb7e-90ae0faa961b admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:32.479915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460de04-4f21-40f0-bb7e-90ae0faa961b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:32.483362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460de04-4f21-40f0-bb7e-90ae0faa961b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:32.519272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-90377826-0c57-4d45-8c4b-3ede430b2d81 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:32.520623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-90377826-0c57-4d45-8c4b-3ede430b2d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:32.548752 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2549/5069] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:32.560529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90377826-0c57-4d45-8c4b-3ede430b2d81 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:32.565968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-90377826-0c57-4d45-8c4b-3ede430b2d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:32.645563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:32.655987 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2521/5070] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:32 2022] POST /identity/v3/users => generated 290 bytes in 562 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:32.658176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460de04-4f21-40f0-bb7e-90ae0faa961b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:32.663791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e460de04-4f21-40f0-bb7e-90ae0faa961b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:32.796186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:32.831133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460de04-4f21-40f0-bb7e-90ae0faa961b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:32.835309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf792c-ad82-4b10-b506-30876ff7bacf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:32.839969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf792c-ad82-4b10-b506-30876ff7bacf service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:32.842124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf792c-ad82-4b10-b506-30876ff7bacf service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:32.842406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90377826-0c57-4d45-8c4b-3ede430b2d81 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:32.846655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf792c-ad82-4b10-b506-30876ff7bacf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:32.857902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b138d8b-c167-4481-bf84-f8476f3643c9 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:32.858749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b138d8b-c167-4481-bf84-f8476f3643c9 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:32.859038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b138d8b-c167-4481-bf84-f8476f3643c9 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:32.859323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b138d8b-c167-4481-bf84-f8476f3643c9 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/roles/fc54bfabf05b4d52bbe75163dfcfc08c` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:32.862210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b138d8b-c167-4481-bf84-f8476f3643c9 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fc54bfabf05b4d52bbe75163dfcfc08c)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:32.863842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b138d8b-c167-4481-bf84-f8476f3643c9 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:32.866543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf792c-ad82-4b10-b506-30876ff7bacf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:32.868286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf792c-ad82-4b10-b506-30876ff7bacf service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:32.885808 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2522/5071] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:32.886804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf792c-ad82-4b10-b506-30876ff7bacf service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:32.888339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-11bf792c-ad82-4b10-b506-30876ff7bacf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:32.912820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf792c-ad82-4b10-b506-30876ff7bacf service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:32.919236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e6a69-dc9e-4a44-9731-f5d9cbf7c941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:32.922548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e6a69-dc9e-4a44-9731-f5d9cbf7c941 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:32.923123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e6a69-dc9e-4a44-9731-f5d9cbf7c941 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:32.923976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e6a69-dc9e-4a44-9731-f5d9cbf7c941 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:32.924899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e6a69-dc9e-4a44-9731-f5d9cbf7c941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:32.926946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e6a69-dc9e-4a44-9731-f5d9cbf7c941 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:32.949488 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2523/5072] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:32 2022] GET /identity/v3/roles => generated 1650 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:32.950584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e6a69-dc9e-4a44-9731-f5d9cbf7c941 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:32.959881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6f2e6a69-dc9e-4a44-9731-f5d9cbf7c941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:32.985511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6b138d8b-c167-4481-bf84-f8476f3643c9 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invalidating the token cache because role fc54bfabf05b4d52bbe75163dfcfc08c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:32.985927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6b138d8b-c167-4481-bf84-f8476f3643c9 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:32.993976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6b138d8b-c167-4481-bf84-f8476f3643c9 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:32.993976 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2550/5073] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:32 2022] DELETE /identity/v3/roles/fc54bfabf05b4d52bbe75163dfcfc08c => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:32.994289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e6a69-dc9e-4a44-9731-f5d9cbf7c941 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:32.994402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b138d8b-c167-4481-bf84-f8476f3643c9 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:33.001840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6b138d8b-c167-4481-bf84-f8476f3643c9 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:33.139873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37278ae5-ccaa-4e6a-8891-f75abbe5b5f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:33.141620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37278ae5-ccaa-4e6a-8891-f75abbe5b5f4 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:33.142062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37278ae5-ccaa-4e6a-8891-f75abbe5b5f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:33.142275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37278ae5-ccaa-4e6a-8891-f75abbe5b5f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:33.148812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-37278ae5-ccaa-4e6a-8891-f75abbe5b5f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:33.192866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37278ae5-ccaa-4e6a-8891-f75abbe5b5f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:33.194811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b138d8b-c167-4481-bf84-f8476f3643c9 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:33.195306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37278ae5-ccaa-4e6a-8891-f75abbe5b5f4 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:33.209661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1606f-9f08-4853-885b-9e3492a8e72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:33.210407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1606f-9f08-4853-885b-9e3492a8e72e admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:33.210931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1606f-9f08-4853-885b-9e3492a8e72e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:33.211311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1606f-9f08-4853-885b-9e3492a8e72e admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:33.212076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1606f-9f08-4853-885b-9e3492a8e72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:33.214296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1606f-9f08-4853-885b-9e3492a8e72e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:33.226874 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2524/5074] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:33.229230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37278ae5-ccaa-4e6a-8891-f75abbe5b5f4 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:33.235109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-37278ae5-ccaa-4e6a-8891-f75abbe5b5f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:33.241681 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2551/5075] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:33.246953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1606f-9f08-4853-885b-9e3492a8e72e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:33.277297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1606f-9f08-4853-885b-9e3492a8e72e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:33.291070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b6acc-e141-43a3-936e-eff37a6c83c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:33.292298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b6acc-e141-43a3-936e-eff37a6c83c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:33.292867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b6acc-e141-43a3-936e-eff37a6c83c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:33.293388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b6acc-e141-43a3-936e-eff37a6c83c9 admin admin] PATH_INFO: `/v3/projects/ed251a93b3684a25a8bcf1d255ae4f06/users/d0ef329b36954b1a9d642913377d4cd3/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:33.337549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b6acc-e141-43a3-936e-eff37a6c83c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed251a93b3684a25a8bcf1d255ae4f06, user_id=d0ef329b36954b1a9d642913377d4cd3, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:33.348692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b6acc-e141-43a3-936e-eff37a6c83c9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:33.414563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37278ae5-ccaa-4e6a-8891-f75abbe5b5f4 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:33.429497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96fd99-2f62-4f96-864c-27c401218c88 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:33.429497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96fd99-2f62-4f96-864c-27c401218c88 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:33.429497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96fd99-2f62-4f96-864c-27c401218c88 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:33.429917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96fd99-2f62-4f96-864c-27c401218c88 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:33.432732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96fd99-2f62-4f96-864c-27c401218c88 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:33.435642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96fd99-2f62-4f96-864c-27c401218c88 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:33.451464 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2552/5076] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:33 2022] PUT /identity/v3/projects/ed251a93b3684a25a8bcf1d255ae4f06/users/d0ef329b36954b1a9d642913377d4cd3/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:33.454262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b6acc-e141-43a3-936e-eff37a6c83c9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:33.463263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-560b6acc-e141-43a3-936e-eff37a6c83c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:33.543938 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2525/5077] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:46:33 2022] POST /identity/v3/roles => generated 240 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:33.543938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3591789-037e-49e0-b3dc-fffafdf287fb None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:33.543938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3591789-037e-49e0-b3dc-fffafdf287fb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:33.543938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3591789-037e-49e0-b3dc-fffafdf287fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:33.569160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b6acc-e141-43a3-936e-eff37a6c83c9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:33.574638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571ff8a-0eeb-43cc-ab33-487c2c50d5b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:33.575735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571ff8a-0eeb-43cc-ab33-487c2c50d5b2 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:33.576191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571ff8a-0eeb-43cc-ab33-487c2c50d5b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:33.576821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571ff8a-0eeb-43cc-ab33-487c2c50d5b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:33.579442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0571ff8a-0eeb-43cc-ab33-487c2c50d5b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:33.612958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b3591789-037e-49e0-b3dc-fffafdf287fb None None] MFA Rules not processed for user `d0ef329b36954b1a9d642913377d4cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:33.614617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b3591789-037e-49e0-b3dc-fffafdf287fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:33.693755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571ff8a-0eeb-43cc-ab33-487c2c50d5b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:33.696813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571ff8a-0eeb-43cc-ab33-487c2c50d5b2 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:33.713815 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2553/5078] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:33.715720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571ff8a-0eeb-43cc-ab33-487c2c50d5b2 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:33.772853 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2526/5079] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:33.787681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3591789-037e-49e0-b3dc-fffafdf287fb None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:33.792463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b3591789-037e-49e0-b3dc-fffafdf287fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:33.807997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571ff8a-0eeb-43cc-ab33-487c2c50d5b2 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:33.825209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd432977-bad1-460a-901b-b0bb85e865e5 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:33.825902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd432977-bad1-460a-901b-b0bb85e865e5 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:33.826265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd432977-bad1-460a-901b-b0bb85e865e5 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:33.826544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd432977-bad1-460a-901b-b0bb85e865e5 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:33.827323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd432977-bad1-460a-901b-b0bb85e865e5 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:33.835247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd432977-bad1-460a-901b-b0bb85e865e5 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:33.908469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3591789-037e-49e0-b3dc-fffafdf287fb None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:33.917085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dc0b4-5ebb-42d6-a428-f9b44bc72513 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:33.924932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dc0b4-5ebb-42d6-a428-f9b44bc72513 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:33.925247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dc0b4-5ebb-42d6-a428-f9b44bc72513 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:33.925526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dc0b4-5ebb-42d6-a428-f9b44bc72513 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:33.936070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dc0b4-5ebb-42d6-a428-f9b44bc72513 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:33.938196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dc0b4-5ebb-42d6-a428-f9b44bc72513 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:33.964570 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2527/5080] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:33.985596 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2554/5081] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:33 2022] POST /identity/v3/projects => generated 409 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:33.988359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dc0b4-5ebb-42d6-a428-f9b44bc72513 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:34.028611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:34.028611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dc0b4-5ebb-42d6-a428-f9b44bc72513 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:34.080261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:34.156658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2684333-ca69-49b0-9c4d-69286cf5684c tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:34.157981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2684333-ca69-49b0-9c4d-69286cf5684c tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:34.158395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2684333-ca69-49b0-9c4d-69286cf5684c tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:34.158800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2684333-ca69-49b0-9c4d-69286cf5684c tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/74edfa89391b4dd6ba9e421aafe88fa2/users/ee54a1fb8e67423c8ba0b711648c05b2/roles/1f3c3b700fcd4d4a9e43592af47b909d/inherited_to_projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:34.161650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2684333-ca69-49b0-9c4d-69286cf5684c tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:create_grant(project_id=74edfa89391b4dd6ba9e421aafe88fa2, user_id=ee54a1fb8e67423c8ba0b711648c05b2, role_id=1f3c3b700fcd4d4a9e43592af47b909d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:34.168260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2684333-ca69-49b0-9c4d-69286cf5684c tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:34.262295 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2528/5082] 10.222.0.20 () {60 vars in 1582 bytes} [Thu Oct 27 03:46:33 2022] PUT /identity/v3/OS-INHERIT/projects/74edfa89391b4dd6ba9e421aafe88fa2/users/ee54a1fb8e67423c8ba0b711648c05b2/roles/1f3c3b700fcd4d4a9e43592af47b909d/inherited_to_projects => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:34.267134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd432977-bad1-460a-901b-b0bb85e865e5 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:34.280261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd432977-bad1-460a-901b-b0bb85e865e5 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:34.363664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5d467-06d6-4905-996e-478102a84646 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:34.366819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5d467-06d6-4905-996e-478102a84646 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:34.367659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5d467-06d6-4905-996e-478102a84646 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:34.368716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5d467-06d6-4905-996e-478102a84646 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:34.369826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5d467-06d6-4905-996e-478102a84646 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Adding query filter params (scope.project.id=652793900aa44f75acf17dea35cf77f6, user.id=ee54a1fb8e67423c8ba0b711648c05b2) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:46:34.370548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5d467-06d6-4905-996e-478102a84646 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:34.373047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5d467-06d6-4905-996e-478102a84646 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:34.461748 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2555/5083] 10.222.0.20 () {58 vars in 1356 bytes} [Thu Oct 27 03:46:34 2022] GET /identity/v3/role_assignments?scope.project.id=652793900aa44f75acf17dea35cf77f6&user.id=ee54a1fb8e67423c8ba0b711648c05b2&effective => generated 649 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:34.465599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2684333-ca69-49b0-9c4d-69286cf5684c tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:34.488870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2684333-ca69-49b0-9c4d-69286cf5684c tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:34.505421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6445d6-7c89-4884-94ea-101818376cfd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:34.506287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6445d6-7c89-4884-94ea-101818376cfd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:34.512046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6445d6-7c89-4884-94ea-101818376cfd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:34.512046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6445d6-7c89-4884-94ea-101818376cfd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/74edfa89391b4dd6ba9e421aafe88fa2/users/ee54a1fb8e67423c8ba0b711648c05b2/roles/1f3c3b700fcd4d4a9e43592af47b909d/inherited_to_projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:34.512046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6445d6-7c89-4884-94ea-101818376cfd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=74edfa89391b4dd6ba9e421aafe88fa2, user_id=ee54a1fb8e67423c8ba0b711648c05b2, role_id=1f3c3b700fcd4d4a9e43592af47b909d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:34.517965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6445d6-7c89-4884-94ea-101818376cfd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:34.544336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ae6445d6-7c89-4884-94ea-101818376cfd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invalidating the token cache because role 1f3c3b700fcd4d4a9e43592af47b909d was removed from user ee54a1fb8e67423c8ba0b711648c05b2 on project 74edfa89391b4dd6ba9e421aafe88fa2. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:34.544336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ae6445d6-7c89-4884-94ea-101818376cfd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:34.544336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ae6445d6-7c89-4884-94ea-101818376cfd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:34.630914 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2529/5084] 10.222.0.20 () {58 vars in 1566 bytes} [Thu Oct 27 03:46:34 2022] DELETE /identity/v3/OS-INHERIT/projects/74edfa89391b4dd6ba9e421aafe88fa2/users/ee54a1fb8e67423c8ba0b711648c05b2/roles/1f3c3b700fcd4d4a9e43592af47b909d/inherited_to_projects => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:34.634589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5d467-06d6-4905-996e-478102a84646 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:34.642711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e7a5d467-06d6-4905-996e-478102a84646 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:34.685752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:34.705289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5d467-06d6-4905-996e-478102a84646 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:34.854694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0e0a0-1578-4e7c-adb2-85b3b5eeb8f3 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:34.855610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0e0a0-1578-4e7c-adb2-85b3b5eeb8f3 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:34.856037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0e0a0-1578-4e7c-adb2-85b3b5eeb8f3 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:34.863085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0e0a0-1578-4e7c-adb2-85b3b5eeb8f3 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:34.867759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0e0a0-1578-4e7c-adb2-85b3b5eeb8f3 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Adding query filter params (scope.project.id=652793900aa44f75acf17dea35cf77f6, user.id=ee54a1fb8e67423c8ba0b711648c05b2) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:46:34.867759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0e0a0-1578-4e7c-adb2-85b3b5eeb8f3 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:34.868434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0e0a0-1578-4e7c-adb2-85b3b5eeb8f3 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:34.961044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:34.970225 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2556/5085] 10.222.0.20 () {58 vars in 1356 bytes} [Thu Oct 27 03:46:34 2022] GET /identity/v3/role_assignments?scope.project.id=652793900aa44f75acf17dea35cf77f6&user.id=ee54a1fb8e67423c8ba0b711648c05b2&effective => generated 228 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:34.973796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6445d6-7c89-4884-94ea-101818376cfd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:34.987369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6445d6-7c89-4884-94ea-101818376cfd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:34.996951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2331cb1-4938-47a5-8e0c-826f3249275d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:34.996951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2331cb1-4938-47a5-8e0c-826f3249275d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:34.996951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2331cb1-4938-47a5-8e0c-826f3249275d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:34.997600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2331cb1-4938-47a5-8e0c-826f3249275d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/projects/652793900aa44f75acf17dea35cf77f6` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:34.998629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2331cb1-4938-47a5-8e0c-826f3249275d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:delete_project(project_id=652793900aa44f75acf17dea35cf77f6)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:35.001151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2331cb1-4938-47a5-8e0c-826f3249275d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:35.180081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c2331cb1-4938-47a5-8e0c-826f3249275d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652793900aa44f75acf17dea35cf77f6', 'request_id': 'req-c2331cb1-4938-47a5-8e0c-826f3249275d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:35.235673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0e0a0-1578-4e7c-adb2-85b3b5eeb8f3 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:35.237988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b9b0e0a0-1578-4e7c-adb2-85b3b5eeb8f3 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:35.261942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c2331cb1-4938-47a5-8e0c-826f3249275d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652793900aa44f75acf17dea35cf77f6', 'request_id': 'req-c2331cb1-4938-47a5-8e0c-826f3249275d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:35.279926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c2331cb1-4938-47a5-8e0c-826f3249275d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652793900aa44f75acf17dea35cf77f6', 'request_id': 'req-c2331cb1-4938-47a5-8e0c-826f3249275d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:35.320304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c2331cb1-4938-47a5-8e0c-826f3249275d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] The token cache is being invalidate because project 652793900aa44f75acf17dea35cf77f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:35.320751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c2331cb1-4938-47a5-8e0c-826f3249275d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:35.323063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c2331cb1-4938-47a5-8e0c-826f3249275d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:35.329775 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2530/5086] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:34 2022] DELETE /identity/v3/projects/652793900aa44f75acf17dea35cf77f6 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:35.333623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2331cb1-4938-47a5-8e0c-826f3249275d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:35.335238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c2331cb1-4938-47a5-8e0c-826f3249275d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:35.364897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0e0a0-1578-4e7c-adb2-85b3b5eeb8f3 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:35.494152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2331cb1-4938-47a5-8e0c-826f3249275d tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:35.511955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778b468-3786-4c5b-adf9-9bb07992cfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:35.514421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778b468-3786-4c5b-adf9-9bb07992cfb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:35.520879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b887fc-a965-4605-96b3-26cef98fc7cd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:35.520879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b887fc-a965-4605-96b3-26cef98fc7cd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:35.521166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778b468-3786-4c5b-adf9-9bb07992cfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:35.521297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b887fc-a965-4605-96b3-26cef98fc7cd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:35.521401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778b468-3786-4c5b-adf9-9bb07992cfb1 admin admin] PATH_INFO: `/v3/projects/dfbf160659d24b6db40fd019ea1af002` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:35.521521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b887fc-a965-4605-96b3-26cef98fc7cd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/roles/1f3c3b700fcd4d4a9e43592af47b909d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:35.521521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b887fc-a965-4605-96b3-26cef98fc7cd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1f3c3b700fcd4d4a9e43592af47b909d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:35.522773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778b468-3786-4c5b-adf9-9bb07992cfb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfbf160659d24b6db40fd019ea1af002)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:35.531458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778b468-3786-4c5b-adf9-9bb07992cfb1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:35.540949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b887fc-a965-4605-96b3-26cef98fc7cd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:35.717455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a778b468-3786-4c5b-adf9-9bb07992cfb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfbf160659d24b6db40fd019ea1af002', 'request_id': 'req-a778b468-3786-4c5b-adf9-9bb07992cfb1'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:35.730830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a778b468-3786-4c5b-adf9-9bb07992cfb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfbf160659d24b6db40fd019ea1af002', 'request_id': 'req-a778b468-3786-4c5b-adf9-9bb07992cfb1'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:35.733157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42b887fc-a965-4605-96b3-26cef98fc7cd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invalidating the token cache because role 1f3c3b700fcd4d4a9e43592af47b909d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:35.733309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a778b468-3786-4c5b-adf9-9bb07992cfb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfbf160659d24b6db40fd019ea1af002', 'request_id': 'req-a778b468-3786-4c5b-adf9-9bb07992cfb1'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:35.733516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42b887fc-a965-4605-96b3-26cef98fc7cd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:35.734957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42b887fc-a965-4605-96b3-26cef98fc7cd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:35.737091 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2531/5087] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:35 2022] DELETE /identity/v3/roles/1f3c3b700fcd4d4a9e43592af47b909d => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:46:35.742152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b887fc-a965-4605-96b3-26cef98fc7cd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:35.744249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-42b887fc-a965-4605-96b3-26cef98fc7cd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:35.859763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a778b468-3786-4c5b-adf9-9bb07992cfb1 admin admin] The token cache is being invalidate because project dfbf160659d24b6db40fd019ea1af002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:35.862649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a778b468-3786-4c5b-adf9-9bb07992cfb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:35.864932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a778b468-3786-4c5b-adf9-9bb07992cfb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:35.870282 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2557/5088] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:35 2022] DELETE /identity/v3/projects/dfbf160659d24b6db40fd019ea1af002 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:35.874633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778b468-3786-4c5b-adf9-9bb07992cfb1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:35.877066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a778b468-3786-4c5b-adf9-9bb07992cfb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:35.887970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b887fc-a965-4605-96b3-26cef98fc7cd tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:35.915160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee5c85-a37a-4608-9aa1-87c846c99d13 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:35.915160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee5c85-a37a-4608-9aa1-87c846c99d13 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:35.915160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee5c85-a37a-4608-9aa1-87c846c99d13 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:35.915566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee5c85-a37a-4608-9aa1-87c846c99d13 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/users/ee54a1fb8e67423c8ba0b711648c05b2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:35.917312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee5c85-a37a-4608-9aa1-87c846c99d13 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ee54a1fb8e67423c8ba0b711648c05b2)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:35.920665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee5c85-a37a-4608-9aa1-87c846c99d13 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:36.017887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778b468-3786-4c5b-adf9-9bb07992cfb1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:36.105301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e279798-3de5-4c9f-8e62-7c8078139c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:36.106870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e279798-3de5-4c9f-8e62-7c8078139c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:36.107673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e279798-3de5-4c9f-8e62-7c8078139c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:36.107968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e279798-3de5-4c9f-8e62-7c8078139c62 admin admin] PATH_INFO: `/v3/users/d55a25b6c6e647bda1c94a292c2665a0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:36.109629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e279798-3de5-4c9f-8e62-7c8078139c62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d55a25b6c6e647bda1c94a292c2665a0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:36.111760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e279798-3de5-4c9f-8e62-7c8078139c62 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:36.150978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-65ee5c85-a37a-4608-9aa1-87c846c99d13 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee54a1fb8e67423c8ba0b711648c05b2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:36.151565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-65ee5c85-a37a-4608-9aa1-87c846c99d13 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee54a1fb8e67423c8ba0b711648c05b2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:36.170907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-65ee5c85-a37a-4608-9aa1-87c846c99d13 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee54a1fb8e67423c8ba0b711648c05b2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:36.205778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-65ee5c85-a37a-4608-9aa1-87c846c99d13 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee54a1fb8e67423c8ba0b711648c05b2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:36.298337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:36.299194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-65ee5c85-a37a-4608-9aa1-87c846c99d13 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee54a1fb8e67423c8ba0b711648c05b2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:36.306434 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2532/5089] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:35 2022] DELETE /identity/v3/users/ee54a1fb8e67423c8ba0b711648c05b2 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:46:36.310590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee5c85-a37a-4608-9aa1-87c846c99d13 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:36.313123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-65ee5c85-a37a-4608-9aa1-87c846c99d13 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:36.378676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5e279798-3de5-4c9f-8e62-7c8078139c62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd55a25b6c6e647bda1c94a292c2665a0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:36.379373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5e279798-3de5-4c9f-8e62-7c8078139c62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd55a25b6c6e647bda1c94a292c2665a0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:36.399756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5e279798-3de5-4c9f-8e62-7c8078139c62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd55a25b6c6e647bda1c94a292c2665a0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:36.430099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5e279798-3de5-4c9f-8e62-7c8078139c62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd55a25b6c6e647bda1c94a292c2665a0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:36.432903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5e279798-3de5-4c9f-8e62-7c8078139c62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd55a25b6c6e647bda1c94a292c2665a0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:36.451038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:36.488201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee5c85-a37a-4608-9aa1-87c846c99d13 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:36.502745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063dadd-61e0-4ad1-b3da-8b49a100dc65 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:36.503659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063dadd-61e0-4ad1-b3da-8b49a100dc65 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:36.504233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063dadd-61e0-4ad1-b3da-8b49a100dc65 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:36.504626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063dadd-61e0-4ad1-b3da-8b49a100dc65 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/groups/8b8d8c2298da4587990f0859880af9b6` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:36.506704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063dadd-61e0-4ad1-b3da-8b49a100dc65 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:delete_group(group_id=8b8d8c2298da4587990f0859880af9b6)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:36.508562 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-e063dadd-61e0-4ad1-b3da-8b49a100dc65 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:46:36.508562 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:46:36.508562 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:46:36.513358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063dadd-61e0-4ad1-b3da-8b49a100dc65 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:36.518495 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2558/5090] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:35 2022] DELETE /identity/v3/users/d55a25b6c6e647bda1c94a292c2665a0 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:36.698689 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2533/5091] 10.222.0.20 () {58 vars in 1227 bytes} [Thu Oct 27 03:46:36 2022] DELETE /identity/v3/groups/8b8d8c2298da4587990f0859880af9b6 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:46:36.702879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e279798-3de5-4c9f-8e62-7c8078139c62 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:36.705154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5e279798-3de5-4c9f-8e62-7c8078139c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:36.843825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e279798-3de5-4c9f-8e62-7c8078139c62 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:36.949410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a88204-ea3c-4b5d-8f2f-0626dac5156f tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:36.950290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a88204-ea3c-4b5d-8f2f-0626dac5156f tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:36.950693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a88204-ea3c-4b5d-8f2f-0626dac5156f tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:36.951084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a88204-ea3c-4b5d-8f2f-0626dac5156f tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/projects/74edfa89391b4dd6ba9e421aafe88fa2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:36.952430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a88204-ea3c-4b5d-8f2f-0626dac5156f tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:delete_project(project_id=74edfa89391b4dd6ba9e421aafe88fa2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:36.955151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a88204-ea3c-4b5d-8f2f-0626dac5156f tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:37.172941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-44a88204-ea3c-4b5d-8f2f-0626dac5156f tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74edfa89391b4dd6ba9e421aafe88fa2', 'request_id': 'req-44a88204-ea3c-4b5d-8f2f-0626dac5156f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:37.189695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-44a88204-ea3c-4b5d-8f2f-0626dac5156f tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74edfa89391b4dd6ba9e421aafe88fa2', 'request_id': 'req-44a88204-ea3c-4b5d-8f2f-0626dac5156f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:37.202639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-44a88204-ea3c-4b5d-8f2f-0626dac5156f tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74edfa89391b4dd6ba9e421aafe88fa2', 'request_id': 'req-44a88204-ea3c-4b5d-8f2f-0626dac5156f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:37.305533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-44a88204-ea3c-4b5d-8f2f-0626dac5156f tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] The token cache is being invalidate because project 74edfa89391b4dd6ba9e421aafe88fa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:37.305927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-44a88204-ea3c-4b5d-8f2f-0626dac5156f tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:37.306758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-44a88204-ea3c-4b5d-8f2f-0626dac5156f tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:37.311930 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2559/5092] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:36 2022] DELETE /identity/v3/projects/74edfa89391b4dd6ba9e421aafe88fa2 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:37.315117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063dadd-61e0-4ad1-b3da-8b49a100dc65 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:37.315710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e063dadd-61e0-4ad1-b3da-8b49a100dc65 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:37.352856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063dadd-61e0-4ad1-b3da-8b49a100dc65 tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:37.463275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d77123-ac39-42f8-891d-673dd49932ec tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:37.464222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d77123-ac39-42f8-891d-673dd49932ec tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:37.464570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d77123-ac39-42f8-891d-673dd49932ec tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:37.464946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d77123-ac39-42f8-891d-673dd49932ec tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/domains/308a99eb19f24728931c488312702b34` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:37.467243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d77123-ac39-42f8-891d-673dd49932ec tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=308a99eb19f24728931c488312702b34)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:37.469731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d77123-ac39-42f8-891d-673dd49932ec tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:37.520466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f2d77123-ac39-42f8-891d-673dd49932ec tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '308a99eb19f24728931c488312702b34'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:37.521556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f2d77123-ac39-42f8-891d-673dd49932ec tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '308a99eb19f24728931c488312702b34'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:37.643851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:37.723403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f2d77123-ac39-42f8-891d-673dd49932ec tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '308a99eb19f24728931c488312702b34'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:37.725242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f2d77123-ac39-42f8-891d-673dd49932ec tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '308a99eb19f24728931c488312702b34'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:37.740649 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2534/5093] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:46:37 2022] PATCH /identity/v3/domains/308a99eb19f24728931c488312702b34 => generated 277 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:37.744574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a88204-ea3c-4b5d-8f2f-0626dac5156f tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:37.758396 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a88204-ea3c-4b5d-8f2f-0626dac5156f tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:37.773720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d77123-ac39-42f8-891d-673dd49932ec tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:37.776999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f2d77123-ac39-42f8-891d-673dd49932ec tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:37.867448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:37.959351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd679bb22d8b54f17b3570b6d85955e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '694db3014cd547e8b4c7e4d9a4ae36d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:37.963241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:37.963241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:37.963241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] PATH_INFO: `/v3/domains/308a99eb19f24728931c488312702b34` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:37.995602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=308a99eb19f24728931c488312702b34)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:37.998308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:38.032340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d77123-ac39-42f8-891d-673dd49932ec tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:38.042004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bf79a-377d-4ef7-b46b-8065891888e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:38.042264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bf79a-377d-4ef7-b46b-8065891888e9 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:38.042666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bf79a-377d-4ef7-b46b-8065891888e9 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:38.042954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bf79a-377d-4ef7-b46b-8065891888e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:38.051759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-971bf79a-377d-4ef7-b46b-8065891888e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:38.056656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '308a99eb19f24728931c488312702b34'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:38.078762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bf79a-377d-4ef7-b46b-8065891888e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:38.078762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bf79a-377d-4ef7-b46b-8065891888e9 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:38.084892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '308a99eb19f24728931c488312702b34'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:38.105329 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2535/5094] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:46:38.111508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bf79a-377d-4ef7-b46b-8065891888e9 service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:38.111684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-971bf79a-377d-4ef7-b46b-8065891888e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:38.229743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '308a99eb19f24728931c488312702b34', 'request_id': 'req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:38.256937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '308a99eb19f24728931c488312702b34', 'request_id': 'req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:38.275186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bf79a-377d-4ef7-b46b-8065891888e9 service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:38.278505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '308a99eb19f24728931c488312702b34', 'request_id': 'req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:38.351808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] The token cache is being invalidate because project 308a99eb19f24728931c488312702b34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:38.351808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:38.363436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:38.388579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '308a99eb19f24728931c488312702b34', 'request_id': 'req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:38.390261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '308a99eb19f24728931c488312702b34', 'request_id': 'req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:38.392122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '308a99eb19f24728931c488312702b34', 'request_id': 'req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:38.421206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a950a3-7604-40e6-9ccf-de90a803eb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:38.423365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a950a3-7604-40e6-9ccf-de90a803eb28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:38.423983 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2560/5095] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:46:37 2022] DELETE /identity/v3/domains/308a99eb19f24728931c488312702b34 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:46:38.428726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a950a3-7604-40e6-9ccf-de90a803eb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:38.429344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a950a3-7604-40e6-9ccf-de90a803eb28 admin admin] PATH_INFO: `/v3/users/b983494c36da483d9f626522f74d9963` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:38.430342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:38.431272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a950a3-7604-40e6-9ccf-de90a803eb28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b983494c36da483d9f626522f74d9963)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:38.431858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:38.434961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a950a3-7604-40e6-9ccf-de90a803eb28 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:38.467117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dda1b1-f905-4569-bc90-31f6a7aaaefc tempest-InheritsV3TestJSON-570795371 tempest-InheritsV3TestJSON-570795371-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:38.474074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2743ed-2ede-4768-b90f-c86ff4ed0b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:38.474829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2743ed-2ede-4768-b90f-c86ff4ed0b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:38.475114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2743ed-2ede-4768-b90f-c86ff4ed0b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:38.475533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2743ed-2ede-4768-b90f-c86ff4ed0b98 admin admin] PATH_INFO: `/v3/users/a73f3d2d8ddd4ab9bfaa825e248181e4` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:38.476822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2743ed-2ede-4768-b90f-c86ff4ed0b98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a73f3d2d8ddd4ab9bfaa825e248181e4)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:38.479742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2743ed-2ede-4768-b90f-c86ff4ed0b98 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:38.728314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2a2743ed-2ede-4768-b90f-c86ff4ed0b98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a73f3d2d8ddd4ab9bfaa825e248181e4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:38.729877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2a2743ed-2ede-4768-b90f-c86ff4ed0b98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a73f3d2d8ddd4ab9bfaa825e248181e4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:38.730809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c8a950a3-7604-40e6-9ccf-de90a803eb28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b983494c36da483d9f626522f74d9963'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:38.734854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c8a950a3-7604-40e6-9ccf-de90a803eb28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b983494c36da483d9f626522f74d9963'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:38.745780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2a2743ed-2ede-4768-b90f-c86ff4ed0b98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a73f3d2d8ddd4ab9bfaa825e248181e4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:38.749890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c8a950a3-7604-40e6-9ccf-de90a803eb28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b983494c36da483d9f626522f74d9963'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:38.774815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2a2743ed-2ede-4768-b90f-c86ff4ed0b98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a73f3d2d8ddd4ab9bfaa825e248181e4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:38.788511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2a2743ed-2ede-4768-b90f-c86ff4ed0b98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a73f3d2d8ddd4ab9bfaa825e248181e4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:38.792394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c8a950a3-7604-40e6-9ccf-de90a803eb28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b983494c36da483d9f626522f74d9963'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:38.890064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c8a950a3-7604-40e6-9ccf-de90a803eb28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b983494c36da483d9f626522f74d9963'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:38.897233 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2536/5096] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:38 2022] DELETE /identity/v3/users/b983494c36da483d9f626522f74d9963 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:38.958962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:38.976193 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2561/5097] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:38 2022] DELETE /identity/v3/users/a73f3d2d8ddd4ab9bfaa825e248181e4 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:38.978049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c960d5d-6970-4ff0-a8d8-6ddabf24a608 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:38.978414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c960d5d-6970-4ff0-a8d8-6ddabf24a608 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:38.978769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c960d5d-6970-4ff0-a8d8-6ddabf24a608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:39.025207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9c960d5d-6970-4ff0-a8d8-6ddabf24a608 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:39.026571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9c960d5d-6970-4ff0-a8d8-6ddabf24a608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:39.207299 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2537/5098] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:39.256081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2743ed-2ede-4768-b90f-c86ff4ed0b98 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:39.258252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2a2743ed-2ede-4768-b90f-c86ff4ed0b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:39.383650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2743ed-2ede-4768-b90f-c86ff4ed0b98 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:39.389515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755feaf2-6dba-4b39-b053-8fd3654e58d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:39.391967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755feaf2-6dba-4b39-b053-8fd3654e58d7 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:39.392470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755feaf2-6dba-4b39-b053-8fd3654e58d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:39.393268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755feaf2-6dba-4b39-b053-8fd3654e58d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:39.408506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755feaf2-6dba-4b39-b053-8fd3654e58d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:39.423321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755feaf2-6dba-4b39-b053-8fd3654e58d7 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:39.448804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c960d5d-6970-4ff0-a8d8-6ddabf24a608 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:39.450295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9c960d5d-6970-4ff0-a8d8-6ddabf24a608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:39.454308 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2562/5099] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:39.477041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c960d5d-6970-4ff0-a8d8-6ddabf24a608 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:39.499691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb148988-6afc-4f16-a1ff-07e948b6d776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:39.500679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb148988-6afc-4f16-a1ff-07e948b6d776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:39.500975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb148988-6afc-4f16-a1ff-07e948b6d776 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:39.501258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb148988-6afc-4f16-a1ff-07e948b6d776 admin admin] PATH_INFO: `/v3/projects/43c9c2e329f04aba95f52aad77b623a8` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:39.505260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb148988-6afc-4f16-a1ff-07e948b6d776 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43c9c2e329f04aba95f52aad77b623a8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:39.507288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb148988-6afc-4f16-a1ff-07e948b6d776 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:39.748090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb148988-6afc-4f16-a1ff-07e948b6d776 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43c9c2e329f04aba95f52aad77b623a8', 'request_id': 'req-bb148988-6afc-4f16-a1ff-07e948b6d776'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:39.833019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb148988-6afc-4f16-a1ff-07e948b6d776 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43c9c2e329f04aba95f52aad77b623a8', 'request_id': 'req-bb148988-6afc-4f16-a1ff-07e948b6d776'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:39.841726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb148988-6afc-4f16-a1ff-07e948b6d776 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43c9c2e329f04aba95f52aad77b623a8', 'request_id': 'req-bb148988-6afc-4f16-a1ff-07e948b6d776'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:39.884072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb148988-6afc-4f16-a1ff-07e948b6d776 admin admin] The token cache is being invalidate because project 43c9c2e329f04aba95f52aad77b623a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:39.884371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb148988-6afc-4f16-a1ff-07e948b6d776 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:39.892816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb148988-6afc-4f16-a1ff-07e948b6d776 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:39.896152 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2538/5100] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:39 2022] DELETE /identity/v3/projects/43c9c2e329f04aba95f52aad77b623a8 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:39.900926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d2c54-1bc2-4b92-b650-f32886d1774f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:39.901847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d2c54-1bc2-4b92-b650-f32886d1774f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:39.902323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d2c54-1bc2-4b92-b650-f32886d1774f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:39.945576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-bb9d2c54-1bc2-4b92-b650-f32886d1774f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:39.948583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bb9d2c54-1bc2-4b92-b650-f32886d1774f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:40.121255 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2563/5101] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:40.249313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103f88b-62ed-4de3-8d78-1f950c0c98e4 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:40.249896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103f88b-62ed-4de3-8d78-1f950c0c98e4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:40.250719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103f88b-62ed-4de3-8d78-1f950c0c98e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:40.301559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6103f88b-62ed-4de3-8d78-1f950c0c98e4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:40.303357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6103f88b-62ed-4de3-8d78-1f950c0c98e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:40.327595 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2539/5102] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:40.333929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d2c54-1bc2-4b92-b650-f32886d1774f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:40.352216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d2c54-1bc2-4b92-b650-f32886d1774f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:40.369197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea0ad0-b86a-4193-ad78-29a0531ae7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:40.370666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea0ad0-b86a-4193-ad78-29a0531ae7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:40.373963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea0ad0-b86a-4193-ad78-29a0531ae7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:40.374515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea0ad0-b86a-4193-ad78-29a0531ae7f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:40.375933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea0ad0-b86a-4193-ad78-29a0531ae7f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:46:40.379295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea0ad0-b86a-4193-ad78-29a0531ae7f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:40.385575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:40.386854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea0ad0-b86a-4193-ad78-29a0531ae7f6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:40.430936 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2564/5103] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:40.432389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103f88b-62ed-4de3-8d78-1f950c0c98e4 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:40.445662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103f88b-62ed-4de3-8d78-1f950c0c98e4 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:40.459585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6deab-3a43-41fe-8cfb-b040e10ac7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:40.461269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6deab-3a43-41fe-8cfb-b040e10ac7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:40.466922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6deab-3a43-41fe-8cfb-b040e10ac7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:40.471913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6deab-3a43-41fe-8cfb-b040e10ac7c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:40.471913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6deab-3a43-41fe-8cfb-b040e10ac7c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:40.471913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6deab-3a43-41fe-8cfb-b040e10ac7c8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:40.516078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea0ad0-b86a-4193-ad78-29a0531ae7f6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:40.518274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bcea0ad0-b86a-4193-ad78-29a0531ae7f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:40.549197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea0ad0-b86a-4193-ad78-29a0531ae7f6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:40.555321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156c639-2db7-410a-a6a5-840a54ba4326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:40.557968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156c639-2db7-410a-a6a5-840a54ba4326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:40.557968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156c639-2db7-410a-a6a5-840a54ba4326 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:40.557968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156c639-2db7-410a-a6a5-840a54ba4326 admin admin] PATH_INFO: `/v3/projects/63fc6a536b2f46b19fa2e6ab35917332` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:40.557968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156c639-2db7-410a-a6a5-840a54ba4326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63fc6a536b2f46b19fa2e6ab35917332)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:40.560368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156c639-2db7-410a-a6a5-840a54ba4326 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:40.595147 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2540/5104] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:40 2022] POST /identity/v3/projects => generated 395 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:40.596398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6deab-3a43-41fe-8cfb-b040e10ac7c8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:40.829632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6deab-3a43-41fe-8cfb-b040e10ac7c8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:40.871195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f34a00-066f-4708-ba24-c2f50f7d1e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:40.872131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f34a00-066f-4708-ba24-c2f50f7d1e4b admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:40.876427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f34a00-066f-4708-ba24-c2f50f7d1e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:40.876427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f34a00-066f-4708-ba24-c2f50f7d1e4b admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:40.878194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f34a00-066f-4708-ba24-c2f50f7d1e4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:40.888519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f34a00-066f-4708-ba24-c2f50f7d1e4b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:40.893017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f156c639-2db7-410a-a6a5-840a54ba4326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63fc6a536b2f46b19fa2e6ab35917332', 'request_id': 'req-f156c639-2db7-410a-a6a5-840a54ba4326'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:40.912787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f156c639-2db7-410a-a6a5-840a54ba4326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63fc6a536b2f46b19fa2e6ab35917332', 'request_id': 'req-f156c639-2db7-410a-a6a5-840a54ba4326'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:40.955443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f156c639-2db7-410a-a6a5-840a54ba4326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63fc6a536b2f46b19fa2e6ab35917332', 'request_id': 'req-f156c639-2db7-410a-a6a5-840a54ba4326'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:41.037503 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2541/5105] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:40 2022] POST /identity/v3/users => generated 298 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:41.039346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f34a00-066f-4708-ba24-c2f50f7d1e4b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:41.055344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f34a00-066f-4708-ba24-c2f50f7d1e4b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:41.062877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f156c639-2db7-410a-a6a5-840a54ba4326 admin admin] The token cache is being invalidate because project 63fc6a536b2f46b19fa2e6ab35917332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:41.062877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f156c639-2db7-410a-a6a5-840a54ba4326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:41.070695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f156c639-2db7-410a-a6a5-840a54ba4326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:41.070695 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2565/5106] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:40 2022] DELETE /identity/v3/projects/63fc6a536b2f46b19fa2e6ab35917332 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:41.072982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504fe42-b079-430e-8224-57478dd554d3 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:41.073643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504fe42-b079-430e-8224-57478dd554d3 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:41.074018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504fe42-b079-430e-8224-57478dd554d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:41.155234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8504fe42-b079-430e-8224-57478dd554d3 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:41.162023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8504fe42-b079-430e-8224-57478dd554d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:41.210591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e952cfd-bfe5-40f7-98c6-80bd0885614f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:41.212758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e952cfd-bfe5-40f7-98c6-80bd0885614f admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:41.214606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e952cfd-bfe5-40f7-98c6-80bd0885614f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:41.215001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e952cfd-bfe5-40f7-98c6-80bd0885614f admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:41.217563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e952cfd-bfe5-40f7-98c6-80bd0885614f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:41.222834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e952cfd-bfe5-40f7-98c6-80bd0885614f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:41.250679 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2542/5107] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:41.254379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e952cfd-bfe5-40f7-98c6-80bd0885614f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:41.258890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1e952cfd-bfe5-40f7-98c6-80bd0885614f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:41.271215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:41.290018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e952cfd-bfe5-40f7-98c6-80bd0885614f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:41.303976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638522f-8b2f-4972-b283-e71bdc30597d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:41.305353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638522f-8b2f-4972-b283-e71bdc30597d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:41.306331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638522f-8b2f-4972-b283-e71bdc30597d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:41.308701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638522f-8b2f-4972-b283-e71bdc30597d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:41.310592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638522f-8b2f-4972-b283-e71bdc30597d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:41.313144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638522f-8b2f-4972-b283-e71bdc30597d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:41.344694 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2566/5108] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:41.347430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498d5cf-74e3-49ca-8598-a59a597eeafc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:41.348684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498d5cf-74e3-49ca-8598-a59a597eeafc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:41.350930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498d5cf-74e3-49ca-8598-a59a597eeafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:41.377783 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2543/5109] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:41.378576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638522f-8b2f-4972-b283-e71bdc30597d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:41.392032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638522f-8b2f-4972-b283-e71bdc30597d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:41.397862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23562e40-748c-4f91-aa37-3ca5e7b01efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:41.398611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23562e40-748c-4f91-aa37-3ca5e7b01efb admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:41.398900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23562e40-748c-4f91-aa37-3ca5e7b01efb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:41.399362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23562e40-748c-4f91-aa37-3ca5e7b01efb admin admin] PATH_INFO: `/v3/projects/ad60af655cf84ed0960c1e8d97590481/users/b9915194930243cb8e7f3343109aa529/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:41.426016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e498d5cf-74e3-49ca-8598-a59a597eeafc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:41.426790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e498d5cf-74e3-49ca-8598-a59a597eeafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:41.437119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23562e40-748c-4f91-aa37-3ca5e7b01efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad60af655cf84ed0960c1e8d97590481, user_id=b9915194930243cb8e7f3343109aa529, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:41.440321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23562e40-748c-4f91-aa37-3ca5e7b01efb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:41.448554 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2567/5110] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:41.455122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498d5cf-74e3-49ca-8598-a59a597eeafc None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:41.472983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498d5cf-74e3-49ca-8598-a59a597eeafc None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:41.495176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe0f9d-4f7a-4230-923d-1249cbb495b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:41.495869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe0f9d-4f7a-4230-923d-1249cbb495b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:41.496159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe0f9d-4f7a-4230-923d-1249cbb495b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:41.496546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe0f9d-4f7a-4230-923d-1249cbb495b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:41.497269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe0f9d-4f7a-4230-923d-1249cbb495b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:46:41.502276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe0f9d-4f7a-4230-923d-1249cbb495b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:41.502901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe0f9d-4f7a-4230-923d-1249cbb495b5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:41.532545 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2544/5111] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:41 2022] PUT /identity/v3/projects/ad60af655cf84ed0960c1e8d97590481/users/b9915194930243cb8e7f3343109aa529/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:41.543108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687bcb3-083d-4fe5-8631-cb83117d9273 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:41.543391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687bcb3-083d-4fe5-8631-cb83117d9273 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:41.543841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687bcb3-083d-4fe5-8631-cb83117d9273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:41.549886 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2568/5112] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:41.558433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe0f9d-4f7a-4230-923d-1249cbb495b5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:41.585421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe0f9d-4f7a-4230-923d-1249cbb495b5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:41.605210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d687bcb3-083d-4fe5-8631-cb83117d9273 None None] MFA Rules not processed for user `b9915194930243cb8e7f3343109aa529`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:41.608825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d687bcb3-083d-4fe5-8631-cb83117d9273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:41.738677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:41.759168 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2545/5113] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:41 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:41.760422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687bcb3-083d-4fe5-8631-cb83117d9273 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:41.763680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d687bcb3-083d-4fe5-8631-cb83117d9273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:41.807231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c1aba-dbfc-4fb5-82e4-6adabe6feb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:41.810844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c1aba-dbfc-4fb5-82e4-6adabe6feb13 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:41.816042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c1aba-dbfc-4fb5-82e4-6adabe6feb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:41.816528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c1aba-dbfc-4fb5-82e4-6adabe6feb13 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:41.817369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c1aba-dbfc-4fb5-82e4-6adabe6feb13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:41.824088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c1aba-dbfc-4fb5-82e4-6adabe6feb13 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:41.854328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687bcb3-083d-4fe5-8631-cb83117d9273 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:41.894621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb086765-fb01-4258-8953-ac756b5c0b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:41.896261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb086765-fb01-4258-8953-ac756b5c0b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:41.897480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb086765-fb01-4258-8953-ac756b5c0b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:41.898807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb086765-fb01-4258-8953-ac756b5c0b35 admin admin] PATH_INFO: `/v3/projects/290d9ee521664aa9be518611e64d2d9c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:41.903322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb086765-fb01-4258-8953-ac756b5c0b35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=290d9ee521664aa9be518611e64d2d9c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:41.905679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb086765-fb01-4258-8953-ac756b5c0b35 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:41.980111 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2569/5114] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:41 2022] POST /identity/v3/projects => generated 397 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:41.980770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c1aba-dbfc-4fb5-82e4-6adabe6feb13 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:42.095125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-eb086765-fb01-4258-8953-ac756b5c0b35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '290d9ee521664aa9be518611e64d2d9c', 'request_id': 'req-eb086765-fb01-4258-8953-ac756b5c0b35'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:42.100331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c1aba-dbfc-4fb5-82e4-6adabe6feb13 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:42.165153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-eb086765-fb01-4258-8953-ac756b5c0b35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '290d9ee521664aa9be518611e64d2d9c', 'request_id': 'req-eb086765-fb01-4258-8953-ac756b5c0b35'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:42.174487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-eb086765-fb01-4258-8953-ac756b5c0b35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '290d9ee521664aa9be518611e64d2d9c', 'request_id': 'req-eb086765-fb01-4258-8953-ac756b5c0b35'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:42.199150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-eb086765-fb01-4258-8953-ac756b5c0b35 admin admin] The token cache is being invalidate because project 290d9ee521664aa9be518611e64d2d9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:42.199537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-eb086765-fb01-4258-8953-ac756b5c0b35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:42.200325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-eb086765-fb01-4258-8953-ac756b5c0b35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:42.206267 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2546/5115] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:41 2022] DELETE /identity/v3/projects/290d9ee521664aa9be518611e64d2d9c => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:42.207374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb086765-fb01-4258-8953-ac756b5c0b35 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:42.208991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-eb086765-fb01-4258-8953-ac756b5c0b35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:42.244493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd328ad-73cf-4d80-92df-c32db8f132da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:42.245379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd328ad-73cf-4d80-92df-c32db8f132da admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:42.245813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd328ad-73cf-4d80-92df-c32db8f132da admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:42.246298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd328ad-73cf-4d80-92df-c32db8f132da admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:42.247055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd328ad-73cf-4d80-92df-c32db8f132da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:42.249363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd328ad-73cf-4d80-92df-c32db8f132da admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:42.266025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:42.305381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb086765-fb01-4258-8953-ac756b5c0b35 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:42.314978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105e690-b32b-4988-afca-8904da9b3e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:42.315674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105e690-b32b-4988-afca-8904da9b3e8f admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:42.315983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105e690-b32b-4988-afca-8904da9b3e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:42.316217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105e690-b32b-4988-afca-8904da9b3e8f admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:42.316940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105e690-b32b-4988-afca-8904da9b3e8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:42.319766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105e690-b32b-4988-afca-8904da9b3e8f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:42.358813 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2570/5116] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:41 2022] POST /identity/v3/projects => generated 395 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:42.361066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd328ad-73cf-4d80-92df-c32db8f132da admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:42.364001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0bd328ad-73cf-4d80-92df-c32db8f132da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:42.505840 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2547/5117] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:42 2022] POST /identity/v3/users => generated 299 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:42.507920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105e690-b32b-4988-afca-8904da9b3e8f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:42.510138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e105e690-b32b-4988-afca-8904da9b3e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:42.530647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105e690-b32b-4988-afca-8904da9b3e8f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:42.549022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd328ad-73cf-4d80-92df-c32db8f132da admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:42.560340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534c856-91bd-4ab9-8d8a-91143b472654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:42.561689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534c856-91bd-4ab9-8d8a-91143b472654 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:42.562249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534c856-91bd-4ab9-8d8a-91143b472654 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:42.562785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534c856-91bd-4ab9-8d8a-91143b472654 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:42.563779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c534c856-91bd-4ab9-8d8a-91143b472654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:42.566241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c534c856-91bd-4ab9-8d8a-91143b472654 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:42.566403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f574eed-96a0-4a61-8d07-58a7a09a3795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:42.567030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f574eed-96a0-4a61-8d07-58a7a09a3795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:42.570744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f574eed-96a0-4a61-8d07-58a7a09a3795 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:42.570744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f574eed-96a0-4a61-8d07-58a7a09a3795 admin admin] PATH_INFO: `/v3/users/d679bb22d8b54f17b3570b6d85955e1c` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:42.570983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f574eed-96a0-4a61-8d07-58a7a09a3795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d679bb22d8b54f17b3570b6d85955e1c)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:42.572900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f574eed-96a0-4a61-8d07-58a7a09a3795 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:42.726955 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2548/5118] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:42 2022] POST /identity/v3/users => generated 304 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:42.728363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534c856-91bd-4ab9-8d8a-91143b472654 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:42.773673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534c856-91bd-4ab9-8d8a-91143b472654 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:42.809582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acd497-20e9-45f5-965e-36e6ff4f2b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:42.809582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acd497-20e9-45f5-965e-36e6ff4f2b31 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:42.809582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acd497-20e9-45f5-965e-36e6ff4f2b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:42.809582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acd497-20e9-45f5-965e-36e6ff4f2b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:42.810538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4acd497-20e9-45f5-965e-36e6ff4f2b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:42.810538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4acd497-20e9-45f5-965e-36e6ff4f2b31 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:42.839746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4f574eed-96a0-4a61-8d07-58a7a09a3795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd679bb22d8b54f17b3570b6d85955e1c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:42.843079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4f574eed-96a0-4a61-8d07-58a7a09a3795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd679bb22d8b54f17b3570b6d85955e1c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:42.851451 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2549/5119] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:42.852584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acd497-20e9-45f5-965e-36e6ff4f2b31 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:42.861661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e4acd497-20e9-45f5-965e-36e6ff4f2b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:42.884734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4f574eed-96a0-4a61-8d07-58a7a09a3795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd679bb22d8b54f17b3570b6d85955e1c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:42.931761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acd497-20e9-45f5-965e-36e6ff4f2b31 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:42.951443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc21bb-8a2f-46eb-96ab-3254c58bac4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:42.952243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc21bb-8a2f-46eb-96ab-3254c58bac4e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:42.952607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc21bb-8a2f-46eb-96ab-3254c58bac4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:42.953519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc21bb-8a2f-46eb-96ab-3254c58bac4e admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:42.954363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc21bb-8a2f-46eb-96ab-3254c58bac4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:42.956097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc21bb-8a2f-46eb-96ab-3254c58bac4e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:42.961532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:42.974211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4f574eed-96a0-4a61-8d07-58a7a09a3795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd679bb22d8b54f17b3570b6d85955e1c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:42.974211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4f574eed-96a0-4a61-8d07-58a7a09a3795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd679bb22d8b54f17b3570b6d85955e1c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:42.986779 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2550/5120] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:42.987766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc21bb-8a2f-46eb-96ab-3254c58bac4e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:42.993218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-63cc21bb-8a2f-46eb-96ab-3254c58bac4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:43.073989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc21bb-8a2f-46eb-96ab-3254c58bac4e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:43.090689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78db41-835b-4dde-b1a6-eb1864257728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:43.091522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78db41-835b-4dde-b1a6-eb1864257728 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:43.096575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78db41-835b-4dde-b1a6-eb1864257728 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:43.097196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78db41-835b-4dde-b1a6-eb1864257728 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:43.098016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78db41-835b-4dde-b1a6-eb1864257728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:43.099689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78db41-835b-4dde-b1a6-eb1864257728 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:43.139130 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2551/5121] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:43.145305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78db41-835b-4dde-b1a6-eb1864257728 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:43.167843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78db41-835b-4dde-b1a6-eb1864257728 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:43.185421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bed897-e0b7-478b-83d2-e2b14801b27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:43.186465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bed897-e0b7-478b-83d2-e2b14801b27d admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:43.188017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bed897-e0b7-478b-83d2-e2b14801b27d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:43.190446 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bed897-e0b7-478b-83d2-e2b14801b27d admin admin] PATH_INFO: `/v3/projects/72d5b3f96f6b47ceaacb604f6c0e4b5e/users/82a322be9f6f4900a1d028d00c7ae12e/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:43.225073 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2571/5122] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:42 2022] DELETE /identity/v3/users/d679bb22d8b54f17b3570b6d85955e1c => generated 0 bytes in 864 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:43.227942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f574eed-96a0-4a61-8d07-58a7a09a3795 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:43.235968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:43.247597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bed897-e0b7-478b-83d2-e2b14801b27d admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d5b3f96f6b47ceaacb604f6c0e4b5e, user_id=82a322be9f6f4900a1d028d00c7ae12e, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:43.254893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bed897-e0b7-478b-83d2-e2b14801b27d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:43.361098 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2552/5123] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:43 2022] PUT /identity/v3/projects/72d5b3f96f6b47ceaacb604f6c0e4b5e/users/82a322be9f6f4900a1d028d00c7ae12e/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:43.362556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bed897-e0b7-478b-83d2-e2b14801b27d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:43.476071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f574eed-96a0-4a61-8d07-58a7a09a3795 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:43.604283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bed897-e0b7-478b-83d2-e2b14801b27d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:43.612060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42534d07-af84-40e0-a9a2-80d0b1ebb969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:43.613095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42534d07-af84-40e0-a9a2-80d0b1ebb969 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:43.614735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42534d07-af84-40e0-a9a2-80d0b1ebb969 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:43.615370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42534d07-af84-40e0-a9a2-80d0b1ebb969 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:43.617166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42534d07-af84-40e0-a9a2-80d0b1ebb969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:43.619694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42534d07-af84-40e0-a9a2-80d0b1ebb969 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:43.636779 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2553/5124] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:43.640698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42534d07-af84-40e0-a9a2-80d0b1ebb969 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:43.645242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c96ac5-b299-4625-bcbe-43035befb13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:43.646425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c96ac5-b299-4625-bcbe-43035befb13f admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:43.646915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c96ac5-b299-4625-bcbe-43035befb13f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:43.647494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c96ac5-b299-4625-bcbe-43035befb13f admin admin] PATH_INFO: `/v3/projects/abf267ba6748402a97cbb16e7f1a0081/users/ba39251aae4446dcbe11d9407f3166c7/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:43.654502 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42534d07-af84-40e0-a9a2-80d0b1ebb969 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:43.661244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53782dc-45cd-4adb-8ed5-a169a1864acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:43.663519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53782dc-45cd-4adb-8ed5-a169a1864acd admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:43.663519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53782dc-45cd-4adb-8ed5-a169a1864acd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:43.663519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53782dc-45cd-4adb-8ed5-a169a1864acd admin admin] PATH_INFO: `/v3/projects/72d5b3f96f6b47ceaacb604f6c0e4b5e/users/82a322be9f6f4900a1d028d00c7ae12e/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:43.664868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53782dc-45cd-4adb-8ed5-a169a1864acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d5b3f96f6b47ceaacb604f6c0e4b5e, user_id=82a322be9f6f4900a1d028d00c7ae12e, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:43.668454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53782dc-45cd-4adb-8ed5-a169a1864acd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:43.687742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c96ac5-b299-4625-bcbe-43035befb13f admin admin] RBAC: Authorizing `identity:create_grant(project_id=abf267ba6748402a97cbb16e7f1a0081, user_id=ba39251aae4446dcbe11d9407f3166c7, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:43.690553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c96ac5-b299-4625-bcbe-43035befb13f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:43.710508 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2554/5125] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:43 2022] PUT /identity/v3/projects/72d5b3f96f6b47ceaacb604f6c0e4b5e/users/82a322be9f6f4900a1d028d00c7ae12e/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:46:43.712306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006aea3-b84f-41cd-b1aa-26be834ba1ad None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:43.712440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006aea3-b84f-41cd-b1aa-26be834ba1ad None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:43.715668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006aea3-b84f-41cd-b1aa-26be834ba1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:43.769470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a006aea3-b84f-41cd-b1aa-26be834ba1ad None None] MFA Rules not processed for user `82a322be9f6f4900a1d028d00c7ae12e`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:43.771105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a006aea3-b84f-41cd-b1aa-26be834ba1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:43.782417 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2572/5126] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:43 2022] PUT /identity/v3/projects/abf267ba6748402a97cbb16e7f1a0081/users/ba39251aae4446dcbe11d9407f3166c7/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:43.783374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c96ac5-b299-4625-bcbe-43035befb13f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:43.796884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-83c96ac5-b299-4625-bcbe-43035befb13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:43.931172 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2555/5127] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:43 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:43.937973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057d56e-3f0f-42e5-9806-a1a3ed51d150 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:43.938554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057d56e-3f0f-42e5-9806-a1a3ed51d150 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:43.938988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057d56e-3f0f-42e5-9806-a1a3ed51d150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:43.980112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c96ac5-b299-4625-bcbe-43035befb13f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:43.990763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f5bd8-e451-4b11-a34d-41f92bc9f6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:43.992493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f5bd8-e451-4b11-a34d-41f92bc9f6e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:43.993194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f5bd8-e451-4b11-a34d-41f92bc9f6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:43.994244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f5bd8-e451-4b11-a34d-41f92bc9f6e4 admin admin] PATH_INFO: `/v3/users/79209301c2544708892a9e4418f2ffe7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:43.996956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f5bd8-e451-4b11-a34d-41f92bc9f6e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79209301c2544708892a9e4418f2ffe7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:44.001896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f5bd8-e451-4b11-a34d-41f92bc9f6e4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:44.036780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b057d56e-3f0f-42e5-9806-a1a3ed51d150 None None] MFA Rules not processed for user `ba39251aae4446dcbe11d9407f3166c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:44.038193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b057d56e-3f0f-42e5-9806-a1a3ed51d150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:44.157999 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2556/5128] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:43 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:44.157999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057d56e-3f0f-42e5-9806-a1a3ed51d150 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:44.167012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b057d56e-3f0f-42e5-9806-a1a3ed51d150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:44.200964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057d56e-3f0f-42e5-9806-a1a3ed51d150 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:44.228405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651947a-c0ea-4fc9-8a3b-813c8d116352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:44.229098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651947a-c0ea-4fc9-8a3b-813c8d116352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:44.229791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651947a-c0ea-4fc9-8a3b-813c8d116352 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:44.230119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651947a-c0ea-4fc9-8a3b-813c8d116352 admin admin] PATH_INFO: `/v3/users/b74e8d6facd1460ab31a3ce4b24dd315` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:44.233939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651947a-c0ea-4fc9-8a3b-813c8d116352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b74e8d6facd1460ab31a3ce4b24dd315)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:44.236820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:44.237308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651947a-c0ea-4fc9-8a3b-813c8d116352 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:44.239826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0d3f5bd8-e451-4b11-a34d-41f92bc9f6e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79209301c2544708892a9e4418f2ffe7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:44.245114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0d3f5bd8-e451-4b11-a34d-41f92bc9f6e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79209301c2544708892a9e4418f2ffe7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:44.255938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0d3f5bd8-e451-4b11-a34d-41f92bc9f6e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79209301c2544708892a9e4418f2ffe7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:44.290722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0d3f5bd8-e451-4b11-a34d-41f92bc9f6e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79209301c2544708892a9e4418f2ffe7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:44.291509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0d3f5bd8-e451-4b11-a34d-41f92bc9f6e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79209301c2544708892a9e4418f2ffe7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:44.439844 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2573/5129] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:43 2022] DELETE /identity/v3/users/79209301c2544708892a9e4418f2ffe7 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:44.441343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f5bd8-e451-4b11-a34d-41f92bc9f6e4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:44.446584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0d3f5bd8-e451-4b11-a34d-41f92bc9f6e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:44.476004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:44.589307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a651947a-c0ea-4fc9-8a3b-813c8d116352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b74e8d6facd1460ab31a3ce4b24dd315'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:44.590880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a651947a-c0ea-4fc9-8a3b-813c8d116352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b74e8d6facd1460ab31a3ce4b24dd315'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:44.621470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a651947a-c0ea-4fc9-8a3b-813c8d116352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b74e8d6facd1460ab31a3ce4b24dd315'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:44.651410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a651947a-c0ea-4fc9-8a3b-813c8d116352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b74e8d6facd1460ab31a3ce4b24dd315'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:44.674244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f5bd8-e451-4b11-a34d-41f92bc9f6e4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:44.691557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e5aa7-cb33-4d9f-ac95-606edc2f6e40 tempest-ProjectsNegativeStaticTestJSON-538218556 tempest-ProjectsNegativeStaticTestJSON-538218556-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9915194930243cb8e7f3343109aa529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad60af655cf84ed0960c1e8d97590481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:44.691557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e5aa7-cb33-4d9f-ac95-606edc2f6e40 tempest-ProjectsNegativeStaticTestJSON-538218556 tempest-ProjectsNegativeStaticTestJSON-538218556-project] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:44.691557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e5aa7-cb33-4d9f-ac95-606edc2f6e40 tempest-ProjectsNegativeStaticTestJSON-538218556 tempest-ProjectsNegativeStaticTestJSON-538218556-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:44.691876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e5aa7-cb33-4d9f-ac95-606edc2f6e40 tempest-ProjectsNegativeStaticTestJSON-538218556 tempest-ProjectsNegativeStaticTestJSON-538218556-project] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:44.691876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e5aa7-cb33-4d9f-ac95-606edc2f6e40 tempest-ProjectsNegativeStaticTestJSON-538218556 tempest-ProjectsNegativeStaticTestJSON-538218556-project] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:44.702649 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-0f3e5aa7-cb33-4d9f-ac95-606edc2f6e40 tempest-ProjectsNegativeStaticTestJSON-538218556 tempest-ProjectsNegativeStaticTestJSON-538218556-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 27 03:46:44.702649 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:46:44.702649 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:46:44.702649 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:46:44.702649 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:46:44.702649 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:46:44.702649 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:46:44.702649 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:46:44.702649 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:46:44.702649 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:46:44.702649 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:46:44.702649 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:46:44.702649 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Oct 27 03:46:44.702649 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 27 03:46:44.704438 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 27 03:46:44.704438 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 27 03:46:44.704438 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 27 03:46:44.704438 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 27 03:46:44.704438 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:46:44.704438 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 27 03:46:44.704438 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 27 03:46:44.704438 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:46:44.709109 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2574/5130] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Oct 27 03:46:44 2022] POST /identity/v3/projects => generated 136 bytes in 268 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:46:44.710714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8f88a-cb2c-406a-808f-1d23b9884216 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:44.711785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8f88a-cb2c-406a-808f-1d23b9884216 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:44.712391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8f88a-cb2c-406a-808f-1d23b9884216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:44.745952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-50d8f88a-cb2c-406a-808f-1d23b9884216 None None] MFA Rules not processed for user `ba39251aae4446dcbe11d9407f3166c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:44.748643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-50d8f88a-cb2c-406a-808f-1d23b9884216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:44.770789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a651947a-c0ea-4fc9-8a3b-813c8d116352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b74e8d6facd1460ab31a3ce4b24dd315'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:44.782018 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2557/5131] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:44 2022] DELETE /identity/v3/users/b74e8d6facd1460ab31a3ce4b24dd315 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:44.783588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b9ffb-5ecf-41c5-aa44-25ddf79ce09d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:44.818522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b9ffb-5ecf-41c5-aa44-25ddf79ce09d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:44.819248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b9ffb-5ecf-41c5-aa44-25ddf79ce09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:44.858853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e87b9ffb-5ecf-41c5-aa44-25ddf79ce09d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:44.861480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e87b9ffb-5ecf-41c5-aa44-25ddf79ce09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:44.929636 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2575/5132] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:44 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:44.934141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8f88a-cb2c-406a-808f-1d23b9884216 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:44.935317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-50d8f88a-cb2c-406a-808f-1d23b9884216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:45.026524 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2558/5133] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:45.028392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b9ffb-5ecf-41c5-aa44-25ddf79ce09d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:45.033034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e87b9ffb-5ecf-41c5-aa44-25ddf79ce09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:45.081783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8f88a-cb2c-406a-808f-1d23b9884216 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:45.095841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca665fe-f2fd-4089-b887-425a13464c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:45.096560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca665fe-f2fd-4089-b887-425a13464c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:45.096912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca665fe-f2fd-4089-b887-425a13464c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:45.097593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca665fe-f2fd-4089-b887-425a13464c43 admin admin] PATH_INFO: `/v3/projects/694db3014cd547e8b4c7e4d9a4ae36d0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:45.098978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca665fe-f2fd-4089-b887-425a13464c43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=694db3014cd547e8b4c7e4d9a4ae36d0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:45.101601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca665fe-f2fd-4089-b887-425a13464c43 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:45.160477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b9ffb-5ecf-41c5-aa44-25ddf79ce09d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:45.165420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf90884-5a5e-4c19-9d58-ddbdf62f76dd tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82a322be9f6f4900a1d028d00c7ae12e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d5b3f96f6b47ceaacb604f6c0e4b5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:45.166159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf90884-5a5e-4c19-9d58-ddbdf62f76dd tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:45.166459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf90884-5a5e-4c19-9d58-ddbdf62f76dd tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:45.166746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf90884-5a5e-4c19-9d58-ddbdf62f76dd tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:45.167383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf90884-5a5e-4c19-9d58-ddbdf62f76dd tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:45.169545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf90884-5a5e-4c19-9d58-ddbdf62f76dd tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:45.177800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-5cf90884-5a5e-4c19-9d58-ddbdf62f76dd tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] Invalid input for field 'name': '' is too short Oct 27 03:46:45.177800 n-d-862769-1 devstack@keystone.service[82179]: Failed validating 'minLength' in schema['properties']['name']: Oct 27 03:46:45.177800 n-d-862769-1 devstack@keystone.service[82179]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 27 03:46:45.177800 n-d-862769-1 devstack@keystone.service[82179]: On instance['name']: Oct 27 03:46:45.177800 n-d-862769-1 devstack@keystone.service[82179]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 27 03:46:45.177800 n-d-862769-1 devstack@keystone.service[82179]: Failed validating 'minLength' in schema['properties']['name']: Oct 27 03:46:45.177800 n-d-862769-1 devstack@keystone.service[82179]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 27 03:46:45.177800 n-d-862769-1 devstack@keystone.service[82179]: On instance['name']: Oct 27 03:46:45.177800 n-d-862769-1 devstack@keystone.service[82179]: '' Oct 27 03:46:45.177800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:46:45.177800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 27 03:46:45.177800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 27 03:46:45.177800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:46:45.177800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise error Oct 27 03:46:45.177800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 27 03:46:45.177800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:45.177800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 27 03:46:45.177800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 27 03:46:45.177800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:45.177800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application On instance['name']: Oct 27 03:46:45.177800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application '' Oct 27 03:46:45.177800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:45.177800 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:46:45.181163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:45.181163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:46:45.181163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:46:45.181163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:46:45.181163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:46:45.181163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:46:45.181163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:46:45.181163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:46:45.181163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:46:45.181163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:46:45.181163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:46:45.181163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:46:45.181163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 27 03:46:45.181163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 27 03:46:45.181163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 27 03:46:45.181163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 27 03:46:45.181163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 27 03:46:45.182371 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 27 03:46:45.182371 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 27 03:46:45.182371 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:45.182371 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 27 03:46:45.182371 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 27 03:46:45.182371 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:45.182371 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application On instance['name']: Oct 27 03:46:45.182371 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application '' Oct 27 03:46:45.182371 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:45.193981 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2559/5134] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Oct 27 03:46:45 2022] POST /identity/v3/projects => generated 283 bytes in 152 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 27 03:46:45.195269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf90884-5a5e-4c19-9d58-ddbdf62f76dd tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:45.197105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5cf90884-5a5e-4c19-9d58-ddbdf62f76dd tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:45.236095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:45.310460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fca665fe-f2fd-4089-b887-425a13464c43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '694db3014cd547e8b4c7e4d9a4ae36d0', 'request_id': 'req-fca665fe-f2fd-4089-b887-425a13464c43'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:45.336066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fca665fe-f2fd-4089-b887-425a13464c43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '694db3014cd547e8b4c7e4d9a4ae36d0', 'request_id': 'req-fca665fe-f2fd-4089-b887-425a13464c43'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:45.346953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf90884-5a5e-4c19-9d58-ddbdf62f76dd tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:45.348652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fca665fe-f2fd-4089-b887-425a13464c43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '694db3014cd547e8b4c7e4d9a4ae36d0', 'request_id': 'req-fca665fe-f2fd-4089-b887-425a13464c43'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:45.360785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:45.423413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98e57f-5d80-4077-a420-4f260c43f7bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:45.424032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98e57f-5d80-4077-a420-4f260c43f7bc service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:45.424313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98e57f-5d80-4077-a420-4f260c43f7bc service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:45.424587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98e57f-5d80-4077-a420-4f260c43f7bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:45.426393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cc98e57f-5d80-4077-a420-4f260c43f7bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:45.453898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fca665fe-f2fd-4089-b887-425a13464c43 admin admin] The token cache is being invalidate because project 694db3014cd547e8b4c7e4d9a4ae36d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:45.453898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fca665fe-f2fd-4089-b887-425a13464c43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:45.453898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fca665fe-f2fd-4089-b887-425a13464c43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:45.453898 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2576/5135] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:44 2022] DELETE /identity/v3/projects/694db3014cd547e8b4c7e4d9a4ae36d0 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:45.459019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca665fe-f2fd-4089-b887-425a13464c43 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:45.460849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fca665fe-f2fd-4089-b887-425a13464c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:45.540101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98e57f-5d80-4077-a420-4f260c43f7bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:45.545113 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98e57f-5d80-4077-a420-4f260c43f7bc service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:45.558130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca665fe-f2fd-4089-b887-425a13464c43 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:45.564298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fedb6-e945-485e-a32c-18d3e2204624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:45.565186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fedb6-e945-485e-a32c-18d3e2204624 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:45.565744 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2560/5136] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:45 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:45.566789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fedb6-e945-485e-a32c-18d3e2204624 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:45.567243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fedb6-e945-485e-a32c-18d3e2204624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:45.579998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-653fedb6-e945-485e-a32c-18d3e2204624 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:45.580101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98e57f-5d80-4077-a420-4f260c43f7bc service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:45.665740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653fedb6-e945-485e-a32c-18d3e2204624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:45.667490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653fedb6-e945-485e-a32c-18d3e2204624 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:45.679622 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2577/5137] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:45.680474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fedb6-e945-485e-a32c-18d3e2204624 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:45.681970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-653fedb6-e945-485e-a32c-18d3e2204624 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:45.696633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98e57f-5d80-4077-a420-4f260c43f7bc service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:45.697246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fedb6-e945-485e-a32c-18d3e2204624 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:45.705940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3808c-e834-4594-84c2-8cb6ee5dffca tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82a322be9f6f4900a1d028d00c7ae12e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d5b3f96f6b47ceaacb604f6c0e4b5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:45.707941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3808c-e834-4594-84c2-8cb6ee5dffca tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:45.708829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdc68e-6d64-4712-8a81-507ec28fb8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:45.709763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdc68e-6d64-4712-8a81-507ec28fb8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:45.710084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3808c-e834-4594-84c2-8cb6ee5dffca tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:45.710421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3808c-e834-4594-84c2-8cb6ee5dffca tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:45.711138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3808c-e834-4594-84c2-8cb6ee5dffca tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:45.711486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdc68e-6d64-4712-8a81-507ec28fb8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:45.711833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdc68e-6d64-4712-8a81-507ec28fb8cf admin admin] PATH_INFO: `/v3/users/43172c9e71704c869a25181574d67b35` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:45.714084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3808c-e834-4594-84c2-8cb6ee5dffca tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:45.714953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:45.717874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdc68e-6d64-4712-8a81-507ec28fb8cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=43172c9e71704c869a25181574d67b35)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:45.720006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdc68e-6d64-4712-8a81-507ec28fb8cf admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:45.726536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-eee3808c-e834-4594-84c2-8cb6ee5dffca tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 03:46:45.726536 n-d-862769-1 devstack@keystone.service[82179]: Failed validating 'maxLength' in schema['properties']['name']: Oct 27 03:46:45.726536 n-d-862769-1 devstack@keystone.service[82179]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 27 03:46:45.726536 n-d-862769-1 devstack@keystone.service[82179]: On instance['name']: Oct 27 03:46:45.726536 n-d-862769-1 devstack@keystone.service[82179]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 03:46:45.726536 n-d-862769-1 devstack@keystone.service[82179]: Failed validating 'maxLength' in schema['properties']['name']: Oct 27 03:46:45.726536 n-d-862769-1 devstack@keystone.service[82179]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 27 03:46:45.726536 n-d-862769-1 devstack@keystone.service[82179]: On instance['name']: Oct 27 03:46:45.726536 n-d-862769-1 devstack@keystone.service[82179]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 27 03:46:45.726536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:46:45.726536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 27 03:46:45.726536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 27 03:46:45.726536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:46:45.726536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise error Oct 27 03:46:45.726536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 03:46:45.726536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:45.726536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 27 03:46:45.726536 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 27 03:46:45.752826 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:45.752826 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application On instance['name']: Oct 27 03:46:45.752826 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 27 03:46:45.752826 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:45.752826 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:46:45.752826 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:45.752826 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:46:45.752826 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:46:45.752826 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:46:45.752826 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:46:45.752826 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:46:45.752826 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:46:45.752826 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:46:45.752826 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:46:45.752826 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:46:45.752826 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:46:45.752826 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:46:45.752826 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 27 03:46:45.754331 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 27 03:46:45.754331 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 27 03:46:45.754331 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 27 03:46:45.754331 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 27 03:46:45.754331 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 27 03:46:45.754331 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 03:46:45.754331 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:45.754331 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 27 03:46:45.754331 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 27 03:46:45.754331 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:45.754331 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application On instance['name']: Oct 27 03:46:45.754331 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 27 03:46:45.754331 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:45.754331 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2561/5138] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Oct 27 03:46:45 2022] POST /identity/v3/projects => generated 412 bytes in 161 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 27 03:46:45.755694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3808c-e834-4594-84c2-8cb6ee5dffca tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:45.755694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-eee3808c-e834-4594-84c2-8cb6ee5dffca tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:45.755694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3808c-e834-4594-84c2-8cb6ee5dffca tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:45.759420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7bc77-21d3-4e3e-9bca-fcf816c5d420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:45.760109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7bc77-21d3-4e3e-9bca-fcf816c5d420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:45.760392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7bc77-21d3-4e3e-9bca-fcf816c5d420 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:45.760672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7bc77-21d3-4e3e-9bca-fcf816c5d420 admin admin] PATH_INFO: `/v3/projects/c48bca00e4d445918f030bf885424b40` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:45.762453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7bc77-21d3-4e3e-9bca-fcf816c5d420 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c48bca00e4d445918f030bf885424b40)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:45.764524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7bc77-21d3-4e3e-9bca-fcf816c5d420 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:45.801848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:45.958010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6da7bc77-21d3-4e3e-9bca-fcf816c5d420 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c48bca00e4d445918f030bf885424b40', 'request_id': 'req-6da7bc77-21d3-4e3e-9bca-fcf816c5d420'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:45.971771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-99bdc68e-6d64-4712-8a81-507ec28fb8cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43172c9e71704c869a25181574d67b35'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:45.971771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-99bdc68e-6d64-4712-8a81-507ec28fb8cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43172c9e71704c869a25181574d67b35'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:45.979238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-99bdc68e-6d64-4712-8a81-507ec28fb8cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43172c9e71704c869a25181574d67b35'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:46.000278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-99bdc68e-6d64-4712-8a81-507ec28fb8cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43172c9e71704c869a25181574d67b35'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:46.000278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-99bdc68e-6d64-4712-8a81-507ec28fb8cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43172c9e71704c869a25181574d67b35'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:46.018874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6da7bc77-21d3-4e3e-9bca-fcf816c5d420 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c48bca00e4d445918f030bf885424b40', 'request_id': 'req-6da7bc77-21d3-4e3e-9bca-fcf816c5d420'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:46.027419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6da7bc77-21d3-4e3e-9bca-fcf816c5d420 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c48bca00e4d445918f030bf885424b40', 'request_id': 'req-6da7bc77-21d3-4e3e-9bca-fcf816c5d420'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:46.042307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:46.052823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6da7bc77-21d3-4e3e-9bca-fcf816c5d420 admin admin] The token cache is being invalidate because project c48bca00e4d445918f030bf885424b40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:46.054332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6da7bc77-21d3-4e3e-9bca-fcf816c5d420 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:46.055371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6da7bc77-21d3-4e3e-9bca-fcf816c5d420 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:46.059707 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2562/5139] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:45 2022] DELETE /identity/v3/projects/c48bca00e4d445918f030bf885424b40 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:46.063441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894e08a-a150-4176-9a45-34c6058edb83 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:46.064527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894e08a-a150-4176-9a45-34c6058edb83 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:46.065052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894e08a-a150-4176-9a45-34c6058edb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:46.084501 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2578/5140] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:45 2022] DELETE /identity/v3/users/43172c9e71704c869a25181574d67b35 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:46.087796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26250dc2-c215-4c9d-8557-d53fa88d5a87 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:46.092197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26250dc2-c215-4c9d-8557-d53fa88d5a87 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:46.092765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26250dc2-c215-4c9d-8557-d53fa88d5a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:46.099016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:46.111029 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5894e08a-a150-4176-9a45-34c6058edb83 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:46.112266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5894e08a-a150-4176-9a45-34c6058edb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:46.130290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-26250dc2-c215-4c9d-8557-d53fa88d5a87 None None] MFA Rules not processed for user `ba39251aae4446dcbe11d9407f3166c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:46.131250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-26250dc2-c215-4c9d-8557-d53fa88d5a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:46.212884 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2563/5141] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:46.213743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894e08a-a150-4176-9a45-34c6058edb83 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:46.215164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5894e08a-a150-4176-9a45-34c6058edb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:46.228294 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2579/5142] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:46.230365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d33f8-d9e8-4d87-a75b-057f6f130c9b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:46.230858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d33f8-d9e8-4d87-a75b-057f6f130c9b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:46.231334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d33f8-d9e8-4d87-a75b-057f6f130c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:46.257618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b36d33f8-d9e8-4d87-a75b-057f6f130c9b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:46.259200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b36d33f8-d9e8-4d87-a75b-057f6f130c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:46.286972 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2580/5143] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:46.286972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d33f8-d9e8-4d87-a75b-057f6f130c9b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:46.286972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b36d33f8-d9e8-4d87-a75b-057f6f130c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:46.299809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d33f8-d9e8-4d87-a75b-057f6f130c9b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:46.309063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe5f3c-a2a9-47d4-80ef-8e1923cd6efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:46.309864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe5f3c-a2a9-47d4-80ef-8e1923cd6efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:46.310295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe5f3c-a2a9-47d4-80ef-8e1923cd6efe admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:46.310765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe5f3c-a2a9-47d4-80ef-8e1923cd6efe admin admin] PATH_INFO: `/v3/projects/cc47b2c9c7204547bedbefb0c449182c` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:46.312012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe5f3c-a2a9-47d4-80ef-8e1923cd6efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc47b2c9c7204547bedbefb0c449182c)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:46.315135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe5f3c-a2a9-47d4-80ef-8e1923cd6efe admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:46.346638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894e08a-a150-4176-9a45-34c6058edb83 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:46.353235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec7a98-54a2-437e-b95d-431dfb68aace tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82a322be9f6f4900a1d028d00c7ae12e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d5b3f96f6b47ceaacb604f6c0e4b5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:46.353887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec7a98-54a2-437e-b95d-431dfb68aace tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:46.354250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec7a98-54a2-437e-b95d-431dfb68aace tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:46.354532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec7a98-54a2-437e-b95d-431dfb68aace tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] PATH_INFO: `/v3/projects/262c09491fe544d8a712b3ede6a50fe2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:46.363298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec7a98-54a2-437e-b95d-431dfb68aace tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] RBAC: Authorizing `identity:delete_project(project_id=262c09491fe544d8a712b3ede6a50fe2)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:46.365234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec7a98-54a2-437e-b95d-431dfb68aace tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:46.377875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-90ec7a98-54a2-437e-b95d-431dfb68aace tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] Could not find project: 262c09491fe544d8a712b3ede6a50fe2.: keystone.exception.ProjectNotFound: Could not find project: 262c09491fe544d8a712b3ede6a50fe2. Oct 27 03:46:46.377875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:46:46.377875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:46:46.377875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:46:46.377875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:46:46.377875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:46:46.377875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:46:46.377875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:46:46.377875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:46:46.377875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:46:46.377875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:46:46.377875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:46:46.377875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 27 03:46:46.377875 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 27 03:46:46.381640 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:46:46.381640 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:46:46.381640 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 27 03:46:46.381640 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 27 03:46:46.381640 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:46:46.381640 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:46:46.381640 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:46:46.381640 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:46:46.381640 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 262c09491fe544d8a712b3ede6a50fe2. Oct 27 03:46:46.381640 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:46.381640 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2564/5144] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:46 2022] DELETE /identity/v3/projects/262c09491fe544d8a712b3ede6a50fe2 => generated 113 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:46:46.381640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994ad18-0b4a-4b9e-ab77-0b38967131c7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:46.382758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994ad18-0b4a-4b9e-ab77-0b38967131c7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:46.382758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994ad18-0b4a-4b9e-ab77-0b38967131c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:46.401369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9994ad18-0b4a-4b9e-ab77-0b38967131c7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:46.402623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9994ad18-0b4a-4b9e-ab77-0b38967131c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:46.410784 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2565/5145] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:46.412028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172c8ce-d23a-4f54-9741-1bc7f1036338 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:46.412354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172c8ce-d23a-4f54-9741-1bc7f1036338 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:46.412671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172c8ce-d23a-4f54-9741-1bc7f1036338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:46.434662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8172c8ce-d23a-4f54-9741-1bc7f1036338 None None] MFA Rules not processed for user `ba39251aae4446dcbe11d9407f3166c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:46.435914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8172c8ce-d23a-4f54-9741-1bc7f1036338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:46.444575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ebe5f3c-a2a9-47d4-80ef-8e1923cd6efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc47b2c9c7204547bedbefb0c449182c', 'request_id': 'req-7ebe5f3c-a2a9-47d4-80ef-8e1923cd6efe'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:46.451276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ebe5f3c-a2a9-47d4-80ef-8e1923cd6efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc47b2c9c7204547bedbefb0c449182c', 'request_id': 'req-7ebe5f3c-a2a9-47d4-80ef-8e1923cd6efe'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:46.457957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ebe5f3c-a2a9-47d4-80ef-8e1923cd6efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc47b2c9c7204547bedbefb0c449182c', 'request_id': 'req-7ebe5f3c-a2a9-47d4-80ef-8e1923cd6efe'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:46.462204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:46.512539 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2566/5146] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:46.514111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2b186-692a-445c-abdd-a0630ba3bbd4 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:46.514623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2b186-692a-445c-abdd-a0630ba3bbd4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:46.515050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2b186-692a-445c-abdd-a0630ba3bbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:46.541886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a5d2b186-692a-445c-abdd-a0630ba3bbd4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:46.543492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a5d2b186-692a-445c-abdd-a0630ba3bbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:46.583216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ebe5f3c-a2a9-47d4-80ef-8e1923cd6efe admin admin] The token cache is being invalidate because project cc47b2c9c7204547bedbefb0c449182c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:46.590561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ebe5f3c-a2a9-47d4-80ef-8e1923cd6efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:46.590561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ebe5f3c-a2a9-47d4-80ef-8e1923cd6efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:46.590561 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2581/5147] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:46 2022] DELETE /identity/v3/projects/cc47b2c9c7204547bedbefb0c449182c => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:46.590561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe5f3c-a2a9-47d4-80ef-8e1923cd6efe admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:46.592400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7ebe5f3c-a2a9-47d4-80ef-8e1923cd6efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:46.616610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:46.637342 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2567/5148] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:46.638608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2b186-692a-445c-abdd-a0630ba3bbd4 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:46.641013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a5d2b186-692a-445c-abdd-a0630ba3bbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:46.656528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2b186-692a-445c-abdd-a0630ba3bbd4 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:46.661572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe5f3c-a2a9-47d4-80ef-8e1923cd6efe admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:46.662793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdad56-46a9-40de-8230-9e3c6e1345a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:46.663489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdad56-46a9-40de-8230-9e3c6e1345a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:46.663810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdad56-46a9-40de-8230-9e3c6e1345a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:46.664119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdad56-46a9-40de-8230-9e3c6e1345a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:46.664813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdad56-46a9-40de-8230-9e3c6e1345a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:46:46.665188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdad56-46a9-40de-8230-9e3c6e1345a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:46.666940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdad56-46a9-40de-8230-9e3c6e1345a1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:46.667077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7aa94-a8d1-4548-849c-00b5bf3e206f tempest-ProjectsNegativeStaticTestJSON-538218556 tempest-ProjectsNegativeStaticTestJSON-538218556-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9915194930243cb8e7f3343109aa529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad60af655cf84ed0960c1e8d97590481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:46.667815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7aa94-a8d1-4548-849c-00b5bf3e206f tempest-ProjectsNegativeStaticTestJSON-538218556 tempest-ProjectsNegativeStaticTestJSON-538218556-project] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:46.668274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7aa94-a8d1-4548-849c-00b5bf3e206f tempest-ProjectsNegativeStaticTestJSON-538218556 tempest-ProjectsNegativeStaticTestJSON-538218556-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:46.668757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7aa94-a8d1-4548-849c-00b5bf3e206f tempest-ProjectsNegativeStaticTestJSON-538218556 tempest-ProjectsNegativeStaticTestJSON-538218556-project] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:46.669506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7aa94-a8d1-4548-849c-00b5bf3e206f tempest-ProjectsNegativeStaticTestJSON-538218556 tempest-ProjectsNegativeStaticTestJSON-538218556-project] RBAC: Authorizing `identity:list_projects()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:46.678531 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-5ad7aa94-a8d1-4548-849c-00b5bf3e206f tempest-ProjectsNegativeStaticTestJSON-538218556 tempest-ProjectsNegativeStaticTestJSON-538218556-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 27 03:46:46.678531 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:46:46.678531 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:46:46.678531 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:46:46.678531 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:46:46.678531 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:46:46.678531 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:46:46.678531 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:46:46.678531 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:46:46.678531 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:46:46.678531 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:46:46.678531 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:46:46.678531 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Oct 27 03:46:46.678531 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._list_projects() Oct 27 03:46:46.683213 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Oct 27 03:46:46.683213 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Oct 27 03:46:46.683213 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 27 03:46:46.683213 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 27 03:46:46.683213 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 27 03:46:46.683213 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 27 03:46:46.683213 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:46:46.683213 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 27 03:46:46.683213 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 27 03:46:46.683213 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:46:46.683213 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2582/5149] 10.222.0.20 () {58 vars in 1131 bytes} [Thu Oct 27 03:46:46 2022] GET /identity/v3/projects => generated 135 bytes in 94 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:46:46.683213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7aa94-a8d1-4548-849c-00b5bf3e206f tempest-ProjectsNegativeStaticTestJSON-538218556 tempest-ProjectsNegativeStaticTestJSON-538218556-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:46.686123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5ad7aa94-a8d1-4548-849c-00b5bf3e206f tempest-ProjectsNegativeStaticTestJSON-538218556 tempest-ProjectsNegativeStaticTestJSON-538218556-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:46.689466 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2568/5150] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:46.690987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263526ee-8bbe-4f96-997a-d3a2a060302a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:46.691314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263526ee-8bbe-4f96-997a-d3a2a060302a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:46.691629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263526ee-8bbe-4f96-997a-d3a2a060302a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:46.712119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7aa94-a8d1-4548-849c-00b5bf3e206f tempest-ProjectsNegativeStaticTestJSON-538218556 tempest-ProjectsNegativeStaticTestJSON-538218556-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:46.716003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-263526ee-8bbe-4f96-997a-d3a2a060302a None None] MFA Rules not processed for user `ba39251aae4446dcbe11d9407f3166c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:46.717880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-263526ee-8bbe-4f96-997a-d3a2a060302a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:46.719079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf4ab9-2b85-476e-b88f-e908d29008e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:46.719984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf4ab9-2b85-476e-b88f-e908d29008e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:46.720381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf4ab9-2b85-476e-b88f-e908d29008e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:46.720813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf4ab9-2b85-476e-b88f-e908d29008e2 admin admin] PATH_INFO: `/v3/projects/e1f3ed7ef6c648c9ac771fbaadde1d0c` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:46.722392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf4ab9-2b85-476e-b88f-e908d29008e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1f3ed7ef6c648c9ac771fbaadde1d0c)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:46.724744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf4ab9-2b85-476e-b88f-e908d29008e2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:46.733039 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2569/5151] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:46.735538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263526ee-8bbe-4f96-997a-d3a2a060302a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:46.737652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-263526ee-8bbe-4f96-997a-d3a2a060302a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:46.766405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263526ee-8bbe-4f96-997a-d3a2a060302a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:46.773014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b1da6-ebac-46ee-80a4-c50f2a2a337b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:46.773760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b1da6-ebac-46ee-80a4-c50f2a2a337b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:46.774171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b1da6-ebac-46ee-80a4-c50f2a2a337b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:46.774931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b1da6-ebac-46ee-80a4-c50f2a2a337b admin admin] PATH_INFO: `/v3/users/b182ee26790e468d88e395a0b48fe6f6` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:46.776201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b1da6-ebac-46ee-80a4-c50f2a2a337b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b182ee26790e468d88e395a0b48fe6f6)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:46.778395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b1da6-ebac-46ee-80a4-c50f2a2a337b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:46.854831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-11bf4ab9-2b85-476e-b88f-e908d29008e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'request_id': 'req-11bf4ab9-2b85-476e-b88f-e908d29008e2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:46.863714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-11bf4ab9-2b85-476e-b88f-e908d29008e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'request_id': 'req-11bf4ab9-2b85-476e-b88f-e908d29008e2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:46.871443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-11bf4ab9-2b85-476e-b88f-e908d29008e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'request_id': 'req-11bf4ab9-2b85-476e-b88f-e908d29008e2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:46.989701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-11bf4ab9-2b85-476e-b88f-e908d29008e2 admin admin] The token cache is being invalidate because project e1f3ed7ef6c648c9ac771fbaadde1d0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:46.990402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-11bf4ab9-2b85-476e-b88f-e908d29008e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:46.991927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-11bf4ab9-2b85-476e-b88f-e908d29008e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:46.994013 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2583/5152] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:46 2022] DELETE /identity/v3/projects/e1f3ed7ef6c648c9ac771fbaadde1d0c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:46.995397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf4ab9-2b85-476e-b88f-e908d29008e2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:46.997862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-11bf4ab9-2b85-476e-b88f-e908d29008e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:47.036536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-976b1da6-ebac-46ee-80a4-c50f2a2a337b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b182ee26790e468d88e395a0b48fe6f6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:47.037402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-976b1da6-ebac-46ee-80a4-c50f2a2a337b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b182ee26790e468d88e395a0b48fe6f6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:47.046006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-976b1da6-ebac-46ee-80a4-c50f2a2a337b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b182ee26790e468d88e395a0b48fe6f6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:47.067085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-976b1da6-ebac-46ee-80a4-c50f2a2a337b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b182ee26790e468d88e395a0b48fe6f6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:47.084066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf4ab9-2b85-476e-b88f-e908d29008e2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:47.089209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42873ac-8be3-4f4b-8e25-56047a51907c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:47.089846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42873ac-8be3-4f4b-8e25-56047a51907c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:47.090295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42873ac-8be3-4f4b-8e25-56047a51907c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:47.090578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42873ac-8be3-4f4b-8e25-56047a51907c admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:47.091338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42873ac-8be3-4f4b-8e25-56047a51907c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:46:47.091649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42873ac-8be3-4f4b-8e25-56047a51907c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:47.094274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42873ac-8be3-4f4b-8e25-56047a51907c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:47.112184 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2584/5153] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:47.112184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42873ac-8be3-4f4b-8e25-56047a51907c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:47.114832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f42873ac-8be3-4f4b-8e25-56047a51907c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:47.150331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-976b1da6-ebac-46ee-80a4-c50f2a2a337b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b182ee26790e468d88e395a0b48fe6f6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:47.162149 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2570/5154] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:46 2022] DELETE /identity/v3/users/b182ee26790e468d88e395a0b48fe6f6 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:47.163281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b1da6-ebac-46ee-80a4-c50f2a2a337b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:47.166063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-976b1da6-ebac-46ee-80a4-c50f2a2a337b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:47.198379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42873ac-8be3-4f4b-8e25-56047a51907c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:47.216376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:47.269433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b1da6-ebac-46ee-80a4-c50f2a2a337b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:47.276159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb18ae6-49c6-4333-a3ee-f63ca9ae99b5 tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82a322be9f6f4900a1d028d00c7ae12e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d5b3f96f6b47ceaacb604f6c0e4b5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:47.277290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb18ae6-49c6-4333-a3ee-f63ca9ae99b5 tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:47.277765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb18ae6-49c6-4333-a3ee-f63ca9ae99b5 tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:47.278067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb18ae6-49c6-4333-a3ee-f63ca9ae99b5 tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:47.278795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb18ae6-49c6-4333-a3ee-f63ca9ae99b5 tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:47.279444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d00211-95cf-4013-a7a7-eb192f7a098a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:47.280295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d00211-95cf-4013-a7a7-eb192f7a098a admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:47.280933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d00211-95cf-4013-a7a7-eb192f7a098a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:47.281337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb18ae6-49c6-4333-a3ee-f63ca9ae99b5 tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:47.281639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d00211-95cf-4013-a7a7-eb192f7a098a admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:47.282615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d00211-95cf-4013-a7a7-eb192f7a098a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:47.285221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d00211-95cf-4013-a7a7-eb192f7a098a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:47.344594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:47.398085 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2585/5155] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:47 2022] POST /identity/v3/projects => generated 359 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:47.398085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7792af-e368-4d1e-8a2a-9a033bfdcbe6 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:47.398671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7792af-e368-4d1e-8a2a-9a033bfdcbe6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:47.399224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7792af-e368-4d1e-8a2a-9a033bfdcbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:47.412863 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2571/5156] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:47 2022] POST /identity/v3/projects => generated 371 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:47.412863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb2e9b-d4f3-4036-ad8b-dd2567f42aad None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:47.412863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb2e9b-d4f3-4036-ad8b-dd2567f42aad None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:47.412863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb2e9b-d4f3-4036-ad8b-dd2567f42aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:47.421310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9f7792af-e368-4d1e-8a2a-9a033bfdcbe6 None None] MFA Rules not processed for user `ba39251aae4446dcbe11d9407f3166c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:47.423042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9f7792af-e368-4d1e-8a2a-9a033bfdcbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:47.433541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-05bb2e9b-d4f3-4036-ad8b-dd2567f42aad None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:47.434945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-05bb2e9b-d4f3-4036-ad8b-dd2567f42aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:47.495463 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2586/5157] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:47 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:47.497804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7792af-e368-4d1e-8a2a-9a033bfdcbe6 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:47.499221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9f7792af-e368-4d1e-8a2a-9a033bfdcbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:47.508855 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2572/5158] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:47.510741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb2e9b-d4f3-4036-ad8b-dd2567f42aad None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:47.517451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7792af-e368-4d1e-8a2a-9a033bfdcbe6 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:47.522874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1589f75-d6d7-4ed9-b2ea-3200f52b821d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:47.523051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1589f75-d6d7-4ed9-b2ea-3200f52b821d admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:47.523260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1589f75-d6d7-4ed9-b2ea-3200f52b821d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:47.523528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1589f75-d6d7-4ed9-b2ea-3200f52b821d admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:47.524448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1589f75-d6d7-4ed9-b2ea-3200f52b821d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:47.526391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1589f75-d6d7-4ed9-b2ea-3200f52b821d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:47.626691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb2e9b-d4f3-4036-ad8b-dd2567f42aad None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:47.632186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1a677-49d3-48e2-b767-2621ec5239fb tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82a322be9f6f4900a1d028d00c7ae12e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d5b3f96f6b47ceaacb604f6c0e4b5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:47.632824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1a677-49d3-48e2-b767-2621ec5239fb tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:47.633089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1a677-49d3-48e2-b767-2621ec5239fb tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:47.633556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1a677-49d3-48e2-b767-2621ec5239fb tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:47.634259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1a677-49d3-48e2-b767-2621ec5239fb tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:47.636286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1a677-49d3-48e2-b767-2621ec5239fb tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:47.671865 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2587/5159] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:47 2022] POST /identity/v3/projects => generated 369 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:47.671865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1589f75-d6d7-4ed9-b2ea-3200f52b821d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:47.695439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.sql.core [None req-96c1a677-49d3-48e2-b767-2621ec5239fb tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-2132208825' for key 'project.ixu_project_name_domain_id'") Oct 27 03:46:47.695439 n-d-862769-1 devstack@keystone.service[82179]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 03:46:47.695439 n-d-862769-1 devstack@keystone.service[82179]: [parameters: {'id': '2329c8c3737145738eccfc4011bd96b0', 'name': 'tempest-project-dup-2132208825', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 27 03:46:47.695439 n-d-862769-1 devstack@keystone.service[82179]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82179) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 03:46:47.725178 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-96c1a677-49d3-48e2-b767-2621ec5239fb tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-2132208825, project id 2329c8c3737145738eccfc4011bd96b0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-2132208825, project id 2329c8c3737145738eccfc4011bd96b0. Oct 27 03:46:47.725178 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:46:47.725178 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 03:46:47.725178 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 03:46:47.725178 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 03:46:47.725178 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 03:46:47.725178 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 03:46:47.725178 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 03:46:47.725178 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 03:46:47.725178 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application conn.query(q) Oct 27 03:46:47.725178 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 03:46:47.725178 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 03:46:47.726762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 03:46:47.726762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application result.read() Oct 27 03:46:47.726762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 03:46:47.726762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 03:46:47.726762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 03:46:47.726762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 03:46:47.726762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 03:46:47.726762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 03:46:47.726762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 03:46:47.726762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 03:46:47.726762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-2132208825' for key 'project.ixu_project_name_domain_id'") Oct 27 03:46:47.726762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:47.726762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 27 03:46:47.726762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:47.726762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:46:47.726762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 27 03:46:47.726762 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 27 03:46:47.728150 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 27 03:46:47.728150 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 27 03:46:47.728150 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 03:46:47.728150 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application next(self.gen) Oct 27 03:46:47.728150 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 27 03:46:47.728150 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application yield resource Oct 27 03:46:47.728150 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 03:46:47.728150 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application next(self.gen) Oct 27 03:46:47.728150 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 27 03:46:47.728150 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.session.rollback() Oct 27 03:46:47.728150 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:46:47.728150 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.force_reraise() Oct 27 03:46:47.728150 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:46:47.728150 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise self.value Oct 27 03:46:47.728150 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 27 03:46:47.728150 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 27 03:46:47.728150 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 27 03:46:47.728150 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application session.commit() Oct 27 03:46:47.729573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 27 03:46:47.729573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 27 03:46:47.729573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 27 03:46:47.729573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._prepare_impl() Oct 27 03:46:47.729573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 27 03:46:47.729573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.session.flush() Oct 27 03:46:47.729573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 03:46:47.729573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._flush(objects) Oct 27 03:46:47.729573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 03:46:47.729573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 27 03:46:47.729573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 03:46:47.729573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application compat.raise_( Oct 27 03:46:47.729573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 03:46:47.729573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception Oct 27 03:46:47.729573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 03:46:47.729573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application flush_context.execute() Oct 27 03:46:47.729573 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 03:46:47.738279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rec.execute(self) Oct 27 03:46:47.738279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 03:46:47.738279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 27 03:46:47.738279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 03:46:47.738279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 27 03:46:47.738279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 27 03:46:47.738279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 27 03:46:47.738279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 03:46:47.738279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 03:46:47.738279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 03:46:47.738279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 27 03:46:47.738279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 03:46:47.738279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 27 03:46:47.738279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 03:46:47.738279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 27 03:46:47.738279 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 03:46:47.739602 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 03:46:47.739602 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 03:46:47.739602 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception Oct 27 03:46:47.739602 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 03:46:47.739602 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 03:46:47.739602 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 03:46:47.739602 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 03:46:47.739602 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 03:46:47.739602 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 03:46:47.739602 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 03:46:47.739602 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application conn.query(q) Oct 27 03:46:47.739602 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 03:46:47.739602 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 03:46:47.739602 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 03:46:47.739602 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application result.read() Oct 27 03:46:47.739602 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 03:46:47.739602 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 03:46:47.740987 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 03:46:47.740987 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 03:46:47.740987 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 03:46:47.740987 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 03:46:47.740987 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 03:46:47.740987 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 03:46:47.740987 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-2132208825' for key 'project.ixu_project_name_domain_id'") Oct 27 03:46:47.740987 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 03:46:47.740987 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [parameters: {'id': '2329c8c3737145738eccfc4011bd96b0', 'name': 'tempest-project-dup-2132208825', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 27 03:46:47.740987 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 03:46:47.740987 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:47.740987 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:46:47.740987 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:47.740987 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:46:47.740987 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 27 03:46:47.742155 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 27 03:46:47.742155 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 27 03:46:47.742155 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 27 03:46:47.742155 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-2132208825 at domain ID default. Oct 27 03:46:47.742155 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:47.742155 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:46:47.742155 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:47.742155 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:46:47.742155 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:46:47.742155 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:46:47.742155 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:46:47.742155 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:46:47.742155 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:46:47.742155 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:46:47.742155 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:46:47.742155 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:46:47.742155 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:46:47.743620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:46:47.743620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 27 03:46:47.743620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 27 03:46:47.743620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:46:47.743620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:46:47.743620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 27 03:46:47.743620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 27 03:46:47.743620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-2132208825, project id 2329c8c3737145738eccfc4011bd96b0. Oct 27 03:46:47.743620 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:47.743620 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2573/5160] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Oct 27 03:46:47 2022] POST /identity/v3/projects => generated 285 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:46:47.743620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece76631-02cb-4a1f-ad7b-9c1074635883 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:47.743620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece76631-02cb-4a1f-ad7b-9c1074635883 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:47.744677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece76631-02cb-4a1f-ad7b-9c1074635883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:47.748475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1589f75-d6d7-4ed9-b2ea-3200f52b821d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:47.753112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ece76631-02cb-4a1f-ad7b-9c1074635883 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:47.753458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22235479-8423-43db-80ac-3bd6f10b6529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:47.754094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22235479-8423-43db-80ac-3bd6f10b6529 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:47.754380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22235479-8423-43db-80ac-3bd6f10b6529 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:47.754655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22235479-8423-43db-80ac-3bd6f10b6529 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:47.754782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ece76631-02cb-4a1f-ad7b-9c1074635883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:47.755282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22235479-8423-43db-80ac-3bd6f10b6529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:47.757226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22235479-8423-43db-80ac-3bd6f10b6529 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:47.763381 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2574/5161] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:47.768117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece76631-02cb-4a1f-ad7b-9c1074635883 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:47.768117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ece76631-02cb-4a1f-ad7b-9c1074635883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:47.778427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece76631-02cb-4a1f-ad7b-9c1074635883 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:47.784001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943087e7-9880-411d-887b-6a504c3a3ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:47.784653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943087e7-9880-411d-887b-6a504c3a3ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:47.784937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943087e7-9880-411d-887b-6a504c3a3ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:47.785282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943087e7-9880-411d-887b-6a504c3a3ef9 admin admin] PATH_INFO: `/v3/users/ba39251aae4446dcbe11d9407f3166c7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:47.786540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943087e7-9880-411d-887b-6a504c3a3ef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba39251aae4446dcbe11d9407f3166c7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:47.791182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943087e7-9880-411d-887b-6a504c3a3ef9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:47.871609 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2588/5162] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:47 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:47.871609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22235479-8423-43db-80ac-3bd6f10b6529 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:47.879573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22235479-8423-43db-80ac-3bd6f10b6529 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:47.884239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8399823-3bfc-4b0e-b4e8-4fa5052a6922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:47.884827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8399823-3bfc-4b0e-b4e8-4fa5052a6922 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:47.885107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8399823-3bfc-4b0e-b4e8-4fa5052a6922 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:47.885380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8399823-3bfc-4b0e-b4e8-4fa5052a6922 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:47.885997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8399823-3bfc-4b0e-b4e8-4fa5052a6922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:47.887924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8399823-3bfc-4b0e-b4e8-4fa5052a6922 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:47.893388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:47.978453 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2589/5163] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:47 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:47.980489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8399823-3bfc-4b0e-b4e8-4fa5052a6922 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:47.988987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-943087e7-9880-411d-887b-6a504c3a3ef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba39251aae4446dcbe11d9407f3166c7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:47.990131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-943087e7-9880-411d-887b-6a504c3a3ef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba39251aae4446dcbe11d9407f3166c7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:47.998073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-943087e7-9880-411d-887b-6a504c3a3ef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba39251aae4446dcbe11d9407f3166c7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:48.011162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-943087e7-9880-411d-887b-6a504c3a3ef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba39251aae4446dcbe11d9407f3166c7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:48.059950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8399823-3bfc-4b0e-b4e8-4fa5052a6922 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:48.064623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31acc0-7d34-4033-804d-4b8c436fa54e tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82a322be9f6f4900a1d028d00c7ae12e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d5b3f96f6b47ceaacb604f6c0e4b5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:48.065265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31acc0-7d34-4033-804d-4b8c436fa54e tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:48.065560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31acc0-7d34-4033-804d-4b8c436fa54e tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:48.065848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31acc0-7d34-4033-804d-4b8c436fa54e tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] PATH_INFO: `/v3/projects/4f853b9f9fb84696b574403c6ad4f7eb` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:48.067020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31acc0-7d34-4033-804d-4b8c436fa54e tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4f853b9f9fb84696b574403c6ad4f7eb)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:48.068930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31acc0-7d34-4033-804d-4b8c436fa54e tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:48.104364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-943087e7-9880-411d-887b-6a504c3a3ef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba39251aae4446dcbe11d9407f3166c7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:48.111568 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2575/5164] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:47 2022] DELETE /identity/v3/users/ba39251aae4446dcbe11d9407f3166c7 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:48.112367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943087e7-9880-411d-887b-6a504c3a3ef9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:48.113700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-943087e7-9880-411d-887b-6a504c3a3ef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:48.182783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943087e7-9880-411d-887b-6a504c3a3ef9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:48.200317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dd31acc0-7d34-4033-804d-4b8c436fa54e tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f853b9f9fb84696b574403c6ad4f7eb', 'request_id': 'req-dd31acc0-7d34-4033-804d-4b8c436fa54e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:48.208786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dd31acc0-7d34-4033-804d-4b8c436fa54e tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f853b9f9fb84696b574403c6ad4f7eb', 'request_id': 'req-dd31acc0-7d34-4033-804d-4b8c436fa54e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:48.216954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dd31acc0-7d34-4033-804d-4b8c436fa54e tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f853b9f9fb84696b574403c6ad4f7eb', 'request_id': 'req-dd31acc0-7d34-4033-804d-4b8c436fa54e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:48.252293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a318bf0-1a0b-42a9-8ae5-b0b66085d5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:48.252914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a318bf0-1a0b-42a9-8ae5-b0b66085d5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:48.253225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a318bf0-1a0b-42a9-8ae5-b0b66085d5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:48.253509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a318bf0-1a0b-42a9-8ae5-b0b66085d5b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:48.254197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a318bf0-1a0b-42a9-8ae5-b0b66085d5b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:46:48.254526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a318bf0-1a0b-42a9-8ae5-b0b66085d5b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:48.256124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a318bf0-1a0b-42a9-8ae5-b0b66085d5b0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:48.271432 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2576/5165] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:48.272246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a318bf0-1a0b-42a9-8ae5-b0b66085d5b0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:48.274186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2a318bf0-1a0b-42a9-8ae5-b0b66085d5b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:48.291038 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a318bf0-1a0b-42a9-8ae5-b0b66085d5b0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:48.297293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a15431-f603-472f-a802-bb15789e2a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:48.297870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a15431-f603-472f-a802-bb15789e2a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:48.298291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a15431-f603-472f-a802-bb15789e2a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:48.298705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a15431-f603-472f-a802-bb15789e2a0c admin admin] PATH_INFO: `/v3/projects/b44723cc53b6480c9ec2fce9d2cab5c3` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:48.300057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a15431-f603-472f-a802-bb15789e2a0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b44723cc53b6480c9ec2fce9d2cab5c3)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:48.302135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a15431-f603-472f-a802-bb15789e2a0c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:48.322306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dd31acc0-7d34-4033-804d-4b8c436fa54e tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] The token cache is being invalidate because project 4f853b9f9fb84696b574403c6ad4f7eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:48.322667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dd31acc0-7d34-4033-804d-4b8c436fa54e tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:48.323342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dd31acc0-7d34-4033-804d-4b8c436fa54e tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:48.329379 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2590/5166] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:47 2022] DELETE /identity/v3/projects/4f853b9f9fb84696b574403c6ad4f7eb => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:48.329379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31acc0-7d34-4033-804d-4b8c436fa54e tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:48.329379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-dd31acc0-7d34-4033-804d-4b8c436fa54e tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:48.341947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31acc0-7d34-4033-804d-4b8c436fa54e tempest-ProjectsNegativeStaticTestJSON-200379187 tempest-ProjectsNegativeStaticTestJSON-200379187-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:48.346759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4cd55-e808-49ab-a73d-7d26337e8da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:48.347385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4cd55-e808-49ab-a73d-7d26337e8da5 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:48.347651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4cd55-e808-49ab-a73d-7d26337e8da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:48.347927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4cd55-e808-49ab-a73d-7d26337e8da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:48.352796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4cd55-e808-49ab-a73d-7d26337e8da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:48.352796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4cd55-e808-49ab-a73d-7d26337e8da5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:48.360907 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2591/5167] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:48.361894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4cd55-e808-49ab-a73d-7d26337e8da5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:48.364185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-64e4cd55-e808-49ab-a73d-7d26337e8da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:48.378598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4cd55-e808-49ab-a73d-7d26337e8da5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:48.383452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b4b31-e906-4e03-a394-94ca9f4d95a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:48.384053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b4b31-e906-4e03-a394-94ca9f4d95a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:48.384339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b4b31-e906-4e03-a394-94ca9f4d95a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:48.384616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b4b31-e906-4e03-a394-94ca9f4d95a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:48.385249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b4b31-e906-4e03-a394-94ca9f4d95a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:48.386886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b4b31-e906-4e03-a394-94ca9f4d95a4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:48.400313 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2592/5168] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:48.401675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d163d-d5ca-4690-91ee-f321f22c01f3 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:48.401973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d163d-d5ca-4690-91ee-f321f22c01f3 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:48.402277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d163d-d5ca-4690-91ee-f321f22c01f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:48.435259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6a4d163d-d5ca-4690-91ee-f321f22c01f3 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:48.436504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6a4d163d-d5ca-4690-91ee-f321f22c01f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:48.440539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-13a15431-f603-472f-a802-bb15789e2a0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b44723cc53b6480c9ec2fce9d2cab5c3', 'request_id': 'req-13a15431-f603-472f-a802-bb15789e2a0c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:48.514415 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2593/5169] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:48.516150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d163d-d5ca-4690-91ee-f321f22c01f3 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:48.517617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6a4d163d-d5ca-4690-91ee-f321f22c01f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:48.527071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-13a15431-f603-472f-a802-bb15789e2a0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b44723cc53b6480c9ec2fce9d2cab5c3', 'request_id': 'req-13a15431-f603-472f-a802-bb15789e2a0c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:48.532331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d163d-d5ca-4690-91ee-f321f22c01f3 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:48.536099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-13a15431-f603-472f-a802-bb15789e2a0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b44723cc53b6480c9ec2fce9d2cab5c3', 'request_id': 'req-13a15431-f603-472f-a802-bb15789e2a0c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:48.541718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f2cd9-a830-4dd0-89fc-b17c5db43224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:48.542626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f2cd9-a830-4dd0-89fc-b17c5db43224 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:48.543025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f2cd9-a830-4dd0-89fc-b17c5db43224 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:48.543386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f2cd9-a830-4dd0-89fc-b17c5db43224 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:48.545065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f2cd9-a830-4dd0-89fc-b17c5db43224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:48.547159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f2cd9-a830-4dd0-89fc-b17c5db43224 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:48.552660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-13a15431-f603-472f-a802-bb15789e2a0c admin admin] The token cache is being invalidate because project b44723cc53b6480c9ec2fce9d2cab5c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:48.553547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-13a15431-f603-472f-a802-bb15789e2a0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:48.555909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:48.556736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-13a15431-f603-472f-a802-bb15789e2a0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:48.559377 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2577/5170] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:48 2022] DELETE /identity/v3/projects/b44723cc53b6480c9ec2fce9d2cab5c3 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:48.560640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a15431-f603-472f-a802-bb15789e2a0c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:48.562945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-13a15431-f603-472f-a802-bb15789e2a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:48.579643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a15431-f603-472f-a802-bb15789e2a0c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:48.583856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:48.589589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb151a9-7357-41e9-b057-a0ad6d03d3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:48.590300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb151a9-7357-41e9-b057-a0ad6d03d3f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:48.590589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb151a9-7357-41e9-b057-a0ad6d03d3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:48.590868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb151a9-7357-41e9-b057-a0ad6d03d3f6 admin admin] PATH_INFO: `/v3/users/b9915194930243cb8e7f3343109aa529` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:48.592030 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb151a9-7357-41e9-b057-a0ad6d03d3f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9915194930243cb8e7f3343109aa529)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:48.594968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb151a9-7357-41e9-b057-a0ad6d03d3f6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:48.646313 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2594/5171] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:48 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:48.647318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f2cd9-a830-4dd0-89fc-b17c5db43224 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:48.649306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-de4f2cd9-a830-4dd0-89fc-b17c5db43224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:48.726737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f2cd9-a830-4dd0-89fc-b17c5db43224 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:48.731972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62fe81-8713-4e80-adbe-91bb69f32935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:48.732616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62fe81-8713-4e80-adbe-91bb69f32935 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:48.732919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62fe81-8713-4e80-adbe-91bb69f32935 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:48.733181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62fe81-8713-4e80-adbe-91bb69f32935 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:48.734292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62fe81-8713-4e80-adbe-91bb69f32935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:48.735827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62fe81-8713-4e80-adbe-91bb69f32935 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:48.741027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-beb151a9-7357-41e9-b057-a0ad6d03d3f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9915194930243cb8e7f3343109aa529'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:48.742600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-beb151a9-7357-41e9-b057-a0ad6d03d3f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9915194930243cb8e7f3343109aa529'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:48.753026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-beb151a9-7357-41e9-b057-a0ad6d03d3f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9915194930243cb8e7f3343109aa529'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:48.753876 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2595/5172] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:48.755083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62fe81-8713-4e80-adbe-91bb69f32935 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:48.758056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2e62fe81-8713-4e80-adbe-91bb69f32935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:48.770247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-beb151a9-7357-41e9-b057-a0ad6d03d3f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9915194930243cb8e7f3343109aa529'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:48.774619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62fe81-8713-4e80-adbe-91bb69f32935 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:48.780233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b35e4b-8d43-4947-a65b-4a225350dc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:48.784848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b35e4b-8d43-4947-a65b-4a225350dc4b admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:48.784848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b35e4b-8d43-4947-a65b-4a225350dc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:48.784848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b35e4b-8d43-4947-a65b-4a225350dc4b admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:48.784848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b35e4b-8d43-4947-a65b-4a225350dc4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:48.784848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b35e4b-8d43-4947-a65b-4a225350dc4b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:48.795465 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2596/5173] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:48.796659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b35e4b-8d43-4947-a65b-4a225350dc4b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:48.800011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-71b35e4b-8d43-4947-a65b-4a225350dc4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:48.836964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-beb151a9-7357-41e9-b057-a0ad6d03d3f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9915194930243cb8e7f3343109aa529'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:48.845155 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2578/5174] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:48 2022] DELETE /identity/v3/users/b9915194930243cb8e7f3343109aa529 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:48.847479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d29695-a944-499e-8649-9154a72f8d30 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:48.847769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d29695-a944-499e-8649-9154a72f8d30 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:48.850185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d29695-a944-499e-8649-9154a72f8d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:48.876170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-10d29695-a944-499e-8649-9154a72f8d30 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:48.877536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-10d29695-a944-499e-8649-9154a72f8d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:48.887467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b35e4b-8d43-4947-a65b-4a225350dc4b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:48.902122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:48.952328 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2579/5175] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:48.955553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc654db-c6e7-4971-a0e8-1d8a36e3ecf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:48.956348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc654db-c6e7-4971-a0e8-1d8a36e3ecf8 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:48.956813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc654db-c6e7-4971-a0e8-1d8a36e3ecf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:48.957235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc654db-c6e7-4971-a0e8-1d8a36e3ecf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:48.960309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fbc654db-c6e7-4971-a0e8-1d8a36e3ecf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:48.960451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d29695-a944-499e-8649-9154a72f8d30 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:48.961734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-10d29695-a944-499e-8649-9154a72f8d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:48.974160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d29695-a944-499e-8649-9154a72f8d30 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:48.976809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc654db-c6e7-4971-a0e8-1d8a36e3ecf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:48.978770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc654db-c6e7-4971-a0e8-1d8a36e3ecf8 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:48.979120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65921a-d34c-4eeb-a4a8-097d18a78c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:48.979738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65921a-d34c-4eeb-a4a8-097d18a78c86 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:48.980023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65921a-d34c-4eeb-a4a8-097d18a78c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:48.980299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65921a-d34c-4eeb-a4a8-097d18a78c86 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:48.980933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65921a-d34c-4eeb-a4a8-097d18a78c86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:48.982997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65921a-d34c-4eeb-a4a8-097d18a78c86 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:48.995464 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2597/5176] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:48.996755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc654db-c6e7-4971-a0e8-1d8a36e3ecf8 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:48.998762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fbc654db-c6e7-4971-a0e8-1d8a36e3ecf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:49.014822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc654db-c6e7-4971-a0e8-1d8a36e3ecf8 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:49.020717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6710f1-8b8c-4427-b703-1a46bcf64b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:49.021777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6710f1-8b8c-4427-b703-1a46bcf64b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:49.021777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6710f1-8b8c-4427-b703-1a46bcf64b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:49.022329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6710f1-8b8c-4427-b703-1a46bcf64b3c admin admin] PATH_INFO: `/v3/projects/f259bc4753e842eb9951bd4a0867a599/users/5b05b30c45074bcfa0fbba02a562a97f/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:49.053238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6710f1-8b8c-4427-b703-1a46bcf64b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f259bc4753e842eb9951bd4a0867a599, user_id=5b05b30c45074bcfa0fbba02a562a97f, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:49.053238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6710f1-8b8c-4427-b703-1a46bcf64b3c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:49.073147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:49.110685 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2580/5177] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:48 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:49.110685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65921a-d34c-4eeb-a4a8-097d18a78c86 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:49.122666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65921a-d34c-4eeb-a4a8-097d18a78c86 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:49.128333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f4b7e-14a9-4853-8650-8f24ff6e5e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:49.129015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f4b7e-14a9-4853-8650-8f24ff6e5e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:49.129302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f4b7e-14a9-4853-8650-8f24ff6e5e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:49.129588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f4b7e-14a9-4853-8650-8f24ff6e5e91 admin admin] PATH_INFO: `/v3/projects/c5e4420c80d2408692aaff1f0ac89f90/users/020b5a4a2ff445829da2e81673ed8c26/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:49.145481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f4b7e-14a9-4853-8650-8f24ff6e5e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e4420c80d2408692aaff1f0ac89f90, user_id=020b5a4a2ff445829da2e81673ed8c26, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:49.148232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f4b7e-14a9-4853-8650-8f24ff6e5e91 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:49.164201 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2598/5178] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:48 2022] PUT /identity/v3/projects/f259bc4753e842eb9951bd4a0867a599/users/5b05b30c45074bcfa0fbba02a562a97f/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:49.170211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26ad61-5e4d-415e-8cd1-c68aee9daef9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:49.170211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26ad61-5e4d-415e-8cd1-c68aee9daef9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:49.170211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26ad61-5e4d-415e-8cd1-c68aee9daef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:49.193492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8f26ad61-5e4d-415e-8cd1-c68aee9daef9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:49.194824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8f26ad61-5e4d-415e-8cd1-c68aee9daef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:49.271413 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2581/5179] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:49 2022] PUT /identity/v3/projects/c5e4420c80d2408692aaff1f0ac89f90/users/020b5a4a2ff445829da2e81673ed8c26/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:49.273240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819ada6-76bd-498b-b036-dae3b71a32bf None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:49.281953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819ada6-76bd-498b-b036-dae3b71a32bf None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:49.281953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819ada6-76bd-498b-b036-dae3b71a32bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:49.287063 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2599/5180] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:49.291496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26ad61-5e4d-415e-8cd1-c68aee9daef9 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:49.299924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9819ada6-76bd-498b-b036-dae3b71a32bf None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:49.301179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9819ada6-76bd-498b-b036-dae3b71a32bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:49.313112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26ad61-5e4d-415e-8cd1-c68aee9daef9 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:49.405040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:49.409382 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2582/5181] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:49.414012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdb5d7-f407-4c97-8c8b-ab7610b3f808 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:49.414339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdb5d7-f407-4c97-8c8b-ab7610b3f808 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:49.415131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdb5d7-f407-4c97-8c8b-ab7610b3f808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:49.449328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b86c9b-bc50-4222-8eb6-15feae2a5ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:49.450132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b86c9b-bc50-4222-8eb6-15feae2a5ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:49.450410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b86c9b-bc50-4222-8eb6-15feae2a5ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:49.450689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b86c9b-bc50-4222-8eb6-15feae2a5ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:49.451441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b86c9b-bc50-4222-8eb6-15feae2a5ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:49.453213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b86c9b-bc50-4222-8eb6-15feae2a5ac1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:49.463255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ccbdb5d7-f407-4c97-8c8b-ab7610b3f808 None None] MFA Rules not processed for user `5b05b30c45074bcfa0fbba02a562a97f`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:49.464494 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2600/5182] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:49.465867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510ec42-b95d-4703-a347-fee1728e3e42 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:49.466185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510ec42-b95d-4703-a347-fee1728e3e42 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:49.466465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510ec42-b95d-4703-a347-fee1728e3e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:49.467669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ccbdb5d7-f407-4c97-8c8b-ab7610b3f808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:49.498496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2510ec42-b95d-4703-a347-fee1728e3e42 None None] MFA Rules not processed for user `020b5a4a2ff445829da2e81673ed8c26`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:49.500711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2510ec42-b95d-4703-a347-fee1728e3e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:49.549060 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2583/5183] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:49.550153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbdb5d7-f407-4c97-8c8b-ab7610b3f808 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:49.553672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ccbdb5d7-f407-4c97-8c8b-ab7610b3f808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:49.584052 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:49.607047 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2601/5184] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:49.608012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510ec42-b95d-4703-a347-fee1728e3e42 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:49.621006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510ec42-b95d-4703-a347-fee1728e3e42 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:49.623209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbdb5d7-f407-4c97-8c8b-ab7610b3f808 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:49.626422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbc155-dc77-4b61-8f13-7158d06396a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:49.627032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbc155-dc77-4b61-8f13-7158d06396a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:49.627318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbc155-dc77-4b61-8f13-7158d06396a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:49.627426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c9adc-aca9-464b-91ed-f7955f2db066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:49.627598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbc155-dc77-4b61-8f13-7158d06396a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:49.628032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c9adc-aca9-464b-91ed-f7955f2db066 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:49.628252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbc155-dc77-4b61-8f13-7158d06396a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:46:49.628413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c9adc-aca9-464b-91ed-f7955f2db066 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:49.628561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbc155-dc77-4b61-8f13-7158d06396a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:49.628682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c9adc-aca9-464b-91ed-f7955f2db066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:49.630230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbc155-dc77-4b61-8f13-7158d06396a4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:49.637987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c9adc-aca9-464b-91ed-f7955f2db066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:49.639466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c9adc-aca9-464b-91ed-f7955f2db066 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:49.643155 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2602/5185] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:49.643756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbc155-dc77-4b61-8f13-7158d06396a4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:49.654549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbc155-dc77-4b61-8f13-7158d06396a4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:49.655026 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2584/5186] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:49.656067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c9adc-aca9-464b-91ed-f7955f2db066 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:49.657635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b44c9adc-aca9-464b-91ed-f7955f2db066 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:49.663621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13f150-a7b0-43e1-b190-0ee32383b75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:49.664240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13f150-a7b0-43e1-b190-0ee32383b75c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:49.664520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13f150-a7b0-43e1-b190-0ee32383b75c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:49.664793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13f150-a7b0-43e1-b190-0ee32383b75c admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:49.671922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c9adc-aca9-464b-91ed-f7955f2db066 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:49.674957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13f150-a7b0-43e1-b190-0ee32383b75c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:49.678186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955714f4-43ae-4697-815b-624201ca6e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:49.678862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955714f4-43ae-4697-815b-624201ca6e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:49.679148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955714f4-43ae-4697-815b-624201ca6e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:49.679430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955714f4-43ae-4697-815b-624201ca6e65 admin admin] PATH_INFO: `/v3/projects/abf267ba6748402a97cbb16e7f1a0081` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:49.680717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955714f4-43ae-4697-815b-624201ca6e65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abf267ba6748402a97cbb16e7f1a0081)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:49.681924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13f150-a7b0-43e1-b190-0ee32383b75c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:49.682843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955714f4-43ae-4697-815b-624201ca6e65 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:49.705109 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2603/5187] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:49.706067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13f150-a7b0-43e1-b190-0ee32383b75c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:49.716957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13f150-a7b0-43e1-b190-0ee32383b75c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:49.722676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631d378-8b06-4c0e-864f-681f15fb08cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:49.723355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631d378-8b06-4c0e-864f-681f15fb08cc admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:49.723743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631d378-8b06-4c0e-864f-681f15fb08cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:49.724028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631d378-8b06-4c0e-864f-681f15fb08cc admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:49.724833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631d378-8b06-4c0e-864f-681f15fb08cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:49.727063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631d378-8b06-4c0e-864f-681f15fb08cc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:49.727326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:49.800974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-955714f4-43ae-4697-815b-624201ca6e65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abf267ba6748402a97cbb16e7f1a0081', 'request_id': 'req-955714f4-43ae-4697-815b-624201ca6e65'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:49.842114 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2604/5188] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:49 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:49.842114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631d378-8b06-4c0e-864f-681f15fb08cc admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:49.915286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631d378-8b06-4c0e-864f-681f15fb08cc admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:49.918848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-955714f4-43ae-4697-815b-624201ca6e65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abf267ba6748402a97cbb16e7f1a0081', 'request_id': 'req-955714f4-43ae-4697-815b-624201ca6e65'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:49.928489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e75a22-710b-42bc-9e19-043a8e4b60f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:49.928489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e75a22-710b-42bc-9e19-043a8e4b60f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:49.928489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e75a22-710b-42bc-9e19-043a8e4b60f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:49.928489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e75a22-710b-42bc-9e19-043a8e4b60f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:49.928888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e75a22-710b-42bc-9e19-043a8e4b60f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:49.928888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e75a22-710b-42bc-9e19-043a8e4b60f5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:49.930128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-955714f4-43ae-4697-815b-624201ca6e65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abf267ba6748402a97cbb16e7f1a0081', 'request_id': 'req-955714f4-43ae-4697-815b-624201ca6e65'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:49.946133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-955714f4-43ae-4697-815b-624201ca6e65 admin admin] The token cache is being invalidate because project abf267ba6748402a97cbb16e7f1a0081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:49.949702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-955714f4-43ae-4697-815b-624201ca6e65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:49.950660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-955714f4-43ae-4697-815b-624201ca6e65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:49.956520 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2585/5189] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:49 2022] DELETE /identity/v3/projects/abf267ba6748402a97cbb16e7f1a0081 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:49.956520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955714f4-43ae-4697-815b-624201ca6e65 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:49.956520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-955714f4-43ae-4697-815b-624201ca6e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:49.993212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:50.037003 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2605/5190] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:49 2022] POST /identity/v3/projects => generated 367 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:50.037225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e75a22-710b-42bc-9e19-043a8e4b60f5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:50.041022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b8e75a22-710b-42bc-9e19-043a8e4b60f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:50.042493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955714f4-43ae-4697-815b-624201ca6e65 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:50.127768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e75a22-710b-42bc-9e19-043a8e4b60f5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:50.128243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b5dab-2004-4233-b220-d902c9e10794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:50.128867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b5dab-2004-4233-b220-d902c9e10794 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:50.129158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b5dab-2004-4233-b220-d902c9e10794 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:50.129440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b5dab-2004-4233-b220-d902c9e10794 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:50.130132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b5dab-2004-4233-b220-d902c9e10794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:50.132224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b5dab-2004-4233-b220-d902c9e10794 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:50.132802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcd152-cdcc-4256-b539-d1347a19af5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:50.133550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcd152-cdcc-4256-b539-d1347a19af5e admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:50.133855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcd152-cdcc-4256-b539-d1347a19af5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:50.134206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcd152-cdcc-4256-b539-d1347a19af5e admin admin] PATH_INFO: `/v3/projects/99b82766f45e4f8c8d207974abe7f19a/users/966feb108a724a18919b3a106e9d9c8e/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:50.148804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fcd152-cdcc-4256-b539-d1347a19af5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b82766f45e4f8c8d207974abe7f19a, user_id=966feb108a724a18919b3a106e9d9c8e, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:50.152043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fcd152-cdcc-4256-b539-d1347a19af5e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:50.243820 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2586/5191] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:49 2022] POST /identity/v3/projects => generated 365 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:50.243820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b5dab-2004-4233-b220-d902c9e10794 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:50.247619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dd2b5dab-2004-4233-b220-d902c9e10794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:50.268720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:50.273891 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2606/5192] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:50 2022] PUT /identity/v3/projects/99b82766f45e4f8c8d207974abe7f19a/users/966feb108a724a18919b3a106e9d9c8e/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:50.275200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c3242-d807-49e0-b5f1-5d66493438dd None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:50.275493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c3242-d807-49e0-b5f1-5d66493438dd None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:50.275770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c3242-d807-49e0-b5f1-5d66493438dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:50.299827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d12c3242-d807-49e0-b5f1-5d66493438dd None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:50.301155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d12c3242-d807-49e0-b5f1-5d66493438dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:50.324723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b5dab-2004-4233-b220-d902c9e10794 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:50.372738 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2607/5193] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:50.373582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c3242-d807-49e0-b5f1-5d66493438dd None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:50.381483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d12c3242-d807-49e0-b5f1-5d66493438dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:50.393938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c3242-d807-49e0-b5f1-5d66493438dd None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:50.398728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965dc8a-de1e-4646-8bad-5c4df7ae762f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:50.399364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965dc8a-de1e-4646-8bad-5c4df7ae762f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:50.399642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd85bea-71e9-4a32-8bba-2a9fdd1e7962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:50.399796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965dc8a-de1e-4646-8bad-5c4df7ae762f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:50.399901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965dc8a-de1e-4646-8bad-5c4df7ae762f admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:50.400259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd85bea-71e9-4a32-8bba-2a9fdd1e7962 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:50.400543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd85bea-71e9-4a32-8bba-2a9fdd1e7962 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:50.400654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965dc8a-de1e-4646-8bad-5c4df7ae762f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:50.400822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd85bea-71e9-4a32-8bba-2a9fdd1e7962 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:50.401444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd85bea-71e9-4a32-8bba-2a9fdd1e7962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:50.402732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965dc8a-de1e-4646-8bad-5c4df7ae762f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:50.403411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd85bea-71e9-4a32-8bba-2a9fdd1e7962 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:50.504835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:50.513322 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2587/5194] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:50 2022] POST /identity/v3/users => generated 295 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:50.513322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd85bea-71e9-4a32-8bba-2a9fdd1e7962 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:50.513322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bbd85bea-71e9-4a32-8bba-2a9fdd1e7962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:50.514333 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2608/5195] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:50 2022] POST /identity/v3/users => generated 290 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:50.515120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965dc8a-de1e-4646-8bad-5c4df7ae762f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:50.526433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd85bea-71e9-4a32-8bba-2a9fdd1e7962 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:50.528295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965dc8a-de1e-4646-8bad-5c4df7ae762f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:50.533301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ceee0-d4e5-455e-8002-637fcca3a977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:50.533904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ceee0-d4e5-455e-8002-637fcca3a977 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:50.535470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703f651-7e65-45d5-b43c-46f6b3ff9062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:50.535603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ceee0-d4e5-455e-8002-637fcca3a977 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:50.535603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ceee0-d4e5-455e-8002-637fcca3a977 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:50.535850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703f651-7e65-45d5-b43c-46f6b3ff9062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:50.535968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ceee0-d4e5-455e-8002-637fcca3a977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:50.536069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703f651-7e65-45d5-b43c-46f6b3ff9062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:50.536069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703f651-7e65-45d5-b43c-46f6b3ff9062 admin admin] PATH_INFO: `/v3/projects/ad60af655cf84ed0960c1e8d97590481` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:50.537119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ceee0-d4e5-455e-8002-637fcca3a977 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:50.537594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703f651-7e65-45d5-b43c-46f6b3ff9062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad60af655cf84ed0960c1e8d97590481)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:50.539792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703f651-7e65-45d5-b43c-46f6b3ff9062 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:50.616845 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2609/5196] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:50 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:50.618391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348219f-e635-4977-8dac-b6f90a101f1a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:50.618862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348219f-e635-4977-8dac-b6f90a101f1a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:50.619317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348219f-e635-4977-8dac-b6f90a101f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:50.648871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2348219f-e635-4977-8dac-b6f90a101f1a None None] MFA Rules not processed for user `966feb108a724a18919b3a106e9d9c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:50.650156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2348219f-e635-4977-8dac-b6f90a101f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:50.664042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b703f651-7e65-45d5-b43c-46f6b3ff9062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad60af655cf84ed0960c1e8d97590481', 'request_id': 'req-b703f651-7e65-45d5-b43c-46f6b3ff9062'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:50.668732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:50.720064 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2610/5197] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:50.721616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d325eee-27c4-4d4c-9cf1-d4be0da17b87 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:50.722197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d325eee-27c4-4d4c-9cf1-d4be0da17b87 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:50.722887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d325eee-27c4-4d4c-9cf1-d4be0da17b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:50.747336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8d325eee-27c4-4d4c-9cf1-d4be0da17b87 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:50.748555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8d325eee-27c4-4d4c-9cf1-d4be0da17b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:50.754133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b703f651-7e65-45d5-b43c-46f6b3ff9062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad60af655cf84ed0960c1e8d97590481', 'request_id': 'req-b703f651-7e65-45d5-b43c-46f6b3ff9062'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:50.761857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b703f651-7e65-45d5-b43c-46f6b3ff9062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad60af655cf84ed0960c1e8d97590481', 'request_id': 'req-b703f651-7e65-45d5-b43c-46f6b3ff9062'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:50.775182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b703f651-7e65-45d5-b43c-46f6b3ff9062 admin admin] The token cache is being invalidate because project ad60af655cf84ed0960c1e8d97590481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:50.775625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b703f651-7e65-45d5-b43c-46f6b3ff9062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:50.776366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b703f651-7e65-45d5-b43c-46f6b3ff9062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:50.777960 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2588/5198] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:50 2022] DELETE /identity/v3/projects/ad60af655cf84ed0960c1e8d97590481 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:50.782437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703f651-7e65-45d5-b43c-46f6b3ff9062 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:50.783873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b703f651-7e65-45d5-b43c-46f6b3ff9062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:50.815596 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2611/5199] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:50.816544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d325eee-27c4-4d4c-9cf1-d4be0da17b87 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:50.817894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8d325eee-27c4-4d4c-9cf1-d4be0da17b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:50.830625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d325eee-27c4-4d4c-9cf1-d4be0da17b87 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:50.835398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9a396-226b-42ad-944c-4cfca4f19091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:50.836018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9a396-226b-42ad-944c-4cfca4f19091 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:50.836307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9a396-226b-42ad-944c-4cfca4f19091 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:50.836754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9a396-226b-42ad-944c-4cfca4f19091 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:50.837402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9a396-226b-42ad-944c-4cfca4f19091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:50.839173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9a396-226b-42ad-944c-4cfca4f19091 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:50.851258 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2612/5200] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:50.852117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9a396-226b-42ad-944c-4cfca4f19091 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:50.853841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-63f9a396-226b-42ad-944c-4cfca4f19091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:50.861039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703f651-7e65-45d5-b43c-46f6b3ff9062 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:50.867488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9a396-226b-42ad-944c-4cfca4f19091 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:50.868545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b6293-6417-478f-9827-a910a58a12fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:50.869241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b6293-6417-478f-9827-a910a58a12fa admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:50.869600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b6293-6417-478f-9827-a910a58a12fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:50.869963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b6293-6417-478f-9827-a910a58a12fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:50.870779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b6293-6417-478f-9827-a910a58a12fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:50.872396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b6293-6417-478f-9827-a910a58a12fa admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:50.873289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8f365-86ff-485f-a73c-ec3cf0c45bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:50.873960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8f365-86ff-485f-a73c-ec3cf0c45bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:50.874227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8f365-86ff-485f-a73c-ec3cf0c45bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:50.875158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8f365-86ff-485f-a73c-ec3cf0c45bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:50.875749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8f365-86ff-485f-a73c-ec3cf0c45bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:50.877346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8f365-86ff-485f-a73c-ec3cf0c45bc6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:50.887081 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2589/5201] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:50.887081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fec06c-a037-46d5-9e08-9d6ad8c03e56 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:50.887081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fec06c-a037-46d5-9e08-9d6ad8c03e56 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:50.887081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fec06c-a037-46d5-9e08-9d6ad8c03e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:50.895343 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2613/5202] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:50.895343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8f365-86ff-485f-a73c-ec3cf0c45bc6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:50.899524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d5b8f365-86ff-485f-a73c-ec3cf0c45bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:50.906835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e2fec06c-a037-46d5-9e08-9d6ad8c03e56 None None] MFA Rules not processed for user `966feb108a724a18919b3a106e9d9c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:50.908365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e2fec06c-a037-46d5-9e08-9d6ad8c03e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:50.914907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8f365-86ff-485f-a73c-ec3cf0c45bc6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:50.916219 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2590/5203] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:50.917031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fec06c-a037-46d5-9e08-9d6ad8c03e56 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:50.925581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e10f47-5a59-4688-a09d-c737e656422b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:50.926258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e10f47-5a59-4688-a09d-c737e656422b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:50.926546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e10f47-5a59-4688-a09d-c737e656422b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:50.926922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e10f47-5a59-4688-a09d-c737e656422b admin admin] PATH_INFO: `/v3/users/82a322be9f6f4900a1d028d00c7ae12e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:50.928107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e10f47-5a59-4688-a09d-c737e656422b admin admin] RBAC: Authorizing `identity:delete_user(user_id=82a322be9f6f4900a1d028d00c7ae12e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:50.930021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e10f47-5a59-4688-a09d-c737e656422b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:50.930258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fec06c-a037-46d5-9e08-9d6ad8c03e56 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:50.936490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54d2f9-72f3-4815-8ae6-38b75fee25f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:50.936783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54d2f9-72f3-4815-8ae6-38b75fee25f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:50.937178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54d2f9-72f3-4815-8ae6-38b75fee25f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:50.937506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54d2f9-72f3-4815-8ae6-38b75fee25f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:50.938265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54d2f9-72f3-4815-8ae6-38b75fee25f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:46:50.938755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54d2f9-72f3-4815-8ae6-38b75fee25f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:50.940419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54d2f9-72f3-4815-8ae6-38b75fee25f9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:50.955138 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2591/5204] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:50.956212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54d2f9-72f3-4815-8ae6-38b75fee25f9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:50.965979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54d2f9-72f3-4815-8ae6-38b75fee25f9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:50.971772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14fe15-c760-4fb2-9e77-a7f00f53a3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:50.972504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14fe15-c760-4fb2-9e77-a7f00f53a3a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:50.972855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14fe15-c760-4fb2-9e77-a7f00f53a3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:50.973248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14fe15-c760-4fb2-9e77-a7f00f53a3a9 admin admin] PATH_INFO: `/v3/projects/21d64140b2aa4a1683fbaefcfb0d70e5/users/76ae92bdb7464f52af032dc9626dab57/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:50.977482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:50.989651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14fe15-c760-4fb2-9e77-a7f00f53a3a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d64140b2aa4a1683fbaefcfb0d70e5, user_id=76ae92bdb7464f52af032dc9626dab57, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:50.992556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14fe15-c760-4fb2-9e77-a7f00f53a3a9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:51.087738 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2592/5205] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:50 2022] PUT /identity/v3/projects/21d64140b2aa4a1683fbaefcfb0d70e5/users/76ae92bdb7464f52af032dc9626dab57/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:51.089535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14fe15-c760-4fb2-9e77-a7f00f53a3a9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:51.154324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c8e10f47-5a59-4688-a09d-c737e656422b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82a322be9f6f4900a1d028d00c7ae12e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:51.155295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c8e10f47-5a59-4688-a09d-c737e656422b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82a322be9f6f4900a1d028d00c7ae12e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:51.171017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c8e10f47-5a59-4688-a09d-c737e656422b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82a322be9f6f4900a1d028d00c7ae12e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:51.201829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14fe15-c760-4fb2-9e77-a7f00f53a3a9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:51.209668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c8e10f47-5a59-4688-a09d-c737e656422b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82a322be9f6f4900a1d028d00c7ae12e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:51.212079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c8e10f47-5a59-4688-a09d-c737e656422b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82a322be9f6f4900a1d028d00c7ae12e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:51.213225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29874e-0610-4486-b029-3c3f6e3521f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:51.215422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29874e-0610-4486-b029-3c3f6e3521f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:51.215783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29874e-0610-4486-b029-3c3f6e3521f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:51.217422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29874e-0610-4486-b029-3c3f6e3521f5 admin admin] PATH_INFO: `/v3/projects/76fcb82a896849ea833237c77b1cf554/users/c01cd548b4924d9ca76e148a0c73e018/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:51.242681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29874e-0610-4486-b029-3c3f6e3521f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76fcb82a896849ea833237c77b1cf554, user_id=c01cd548b4924d9ca76e148a0c73e018, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:51.248209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29874e-0610-4486-b029-3c3f6e3521f5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:51.251586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:51.305696 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2614/5206] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:50 2022] DELETE /identity/v3/users/82a322be9f6f4900a1d028d00c7ae12e => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:51.306611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e10f47-5a59-4688-a09d-c737e656422b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:51.308076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c8e10f47-5a59-4688-a09d-c737e656422b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:51.336645 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2593/5207] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:51 2022] PUT /identity/v3/projects/76fcb82a896849ea833237c77b1cf554/users/c01cd548b4924d9ca76e148a0c73e018/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:51.338457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29874e-0610-4486-b029-3c3f6e3521f5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:51.344656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ac29874e-0610-4486-b029-3c3f6e3521f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:51.445442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e10f47-5a59-4688-a09d-c737e656422b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:51.501540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29874e-0610-4486-b029-3c3f6e3521f5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:51.508978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c515851-fcd9-41d5-8b92-d3ab8ef5209d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:51.509602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c515851-fcd9-41d5-8b92-d3ab8ef5209d service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:51.510667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c515851-fcd9-41d5-8b92-d3ab8ef5209d service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:51.510667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c515851-fcd9-41d5-8b92-d3ab8ef5209d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:51.512483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7c515851-fcd9-41d5-8b92-d3ab8ef5209d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:51.522015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e973c-4580-4a24-9190-e9d537b10f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:51.523290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e973c-4580-4a24-9190-e9d537b10f50 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:51.523681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e973c-4580-4a24-9190-e9d537b10f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:51.524061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e973c-4580-4a24-9190-e9d537b10f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:51.524827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e973c-4580-4a24-9190-e9d537b10f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:51.526582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e973c-4580-4a24-9190-e9d537b10f50 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:51.540366 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2615/5208] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:51.540366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e973c-4580-4a24-9190-e9d537b10f50 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:51.541328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-495e973c-4580-4a24-9190-e9d537b10f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:51.555119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e973c-4580-4a24-9190-e9d537b10f50 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:51.560785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90b2d2-5fee-4e26-9864-0781163893e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:51.561656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90b2d2-5fee-4e26-9864-0781163893e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:51.562570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90b2d2-5fee-4e26-9864-0781163893e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:51.572790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90b2d2-5fee-4e26-9864-0781163893e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:51.572790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90b2d2-5fee-4e26-9864-0781163893e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:51.572790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90b2d2-5fee-4e26-9864-0781163893e8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:51.588722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c515851-fcd9-41d5-8b92-d3ab8ef5209d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:51.590449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c515851-fcd9-41d5-8b92-d3ab8ef5209d service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:51.601995 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2594/5209] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:51.618568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c515851-fcd9-41d5-8b92-d3ab8ef5209d service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:51.632136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7c515851-fcd9-41d5-8b92-d3ab8ef5209d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:51.664180 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2616/5210] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:51 2022] POST /identity/v3/projects => generated 397 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:51.665499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90b2d2-5fee-4e26-9864-0781163893e8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:51.665724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c515851-fcd9-41d5-8b92-d3ab8ef5209d service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:51.668725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4e90b2d2-5fee-4e26-9864-0781163893e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:51.682099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:51.770150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:51.783169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f57f0-60d2-482d-ab5f-9b9a782dd732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:51.783169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f57f0-60d2-482d-ab5f-9b9a782dd732 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:51.783169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f57f0-60d2-482d-ab5f-9b9a782dd732 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:51.783169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f57f0-60d2-482d-ab5f-9b9a782dd732 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:51.783534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f57f0-60d2-482d-ab5f-9b9a782dd732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:51.784137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f57f0-60d2-482d-ab5f-9b9a782dd732 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:51.801797 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2595/5211] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:51.801797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f57f0-60d2-482d-ab5f-9b9a782dd732 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:51.803909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-003f57f0-60d2-482d-ab5f-9b9a782dd732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:51.820057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f57f0-60d2-482d-ab5f-9b9a782dd732 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:51.825189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721d694-1f04-40fc-a2cf-3d56130d20bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:51.827561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721d694-1f04-40fc-a2cf-3d56130d20bb admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:51.827561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721d694-1f04-40fc-a2cf-3d56130d20bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:51.827561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721d694-1f04-40fc-a2cf-3d56130d20bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:51.827561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721d694-1f04-40fc-a2cf-3d56130d20bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:51.829476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721d694-1f04-40fc-a2cf-3d56130d20bb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:51.832093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90b2d2-5fee-4e26-9864-0781163893e8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:51.838286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5752259-4a9b-4f66-ba73-072adab89c46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:51.839178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5752259-4a9b-4f66-ba73-072adab89c46 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:51.839483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5752259-4a9b-4f66-ba73-072adab89c46 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:51.839895 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2596/5212] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:51.840579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721d694-1f04-40fc-a2cf-3d56130d20bb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:51.842427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5752259-4a9b-4f66-ba73-072adab89c46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:51.844710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e5752259-4a9b-4f66-ba73-072adab89c46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:51.855049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721d694-1f04-40fc-a2cf-3d56130d20bb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:51.860535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5752259-4a9b-4f66-ba73-072adab89c46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:51.861265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3bc4a-015c-4d09-8f9b-b68f075d7bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:51.862183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5752259-4a9b-4f66-ba73-072adab89c46 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:51.862615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3bc4a-015c-4d09-8f9b-b68f075d7bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:51.863072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3bc4a-015c-4d09-8f9b-b68f075d7bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:51.863516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3bc4a-015c-4d09-8f9b-b68f075d7bf1 admin admin] PATH_INFO: `/v3/projects/0ac942bb12164dc6adfd2c767cc47669/users/afc6b0abd5294accb5a1461df1c12ac2/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:51.884609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3bc4a-015c-4d09-8f9b-b68f075d7bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ac942bb12164dc6adfd2c767cc47669, user_id=afc6b0abd5294accb5a1461df1c12ac2, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:51.884902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3bc4a-015c-4d09-8f9b-b68f075d7bf1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:51.890796 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2617/5213] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:51.892111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5752259-4a9b-4f66-ba73-072adab89c46 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:51.913832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5752259-4a9b-4f66-ba73-072adab89c46 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:51.917437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24e0aa-6a52-491f-9b44-819ecdb5a667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:51.918182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24e0aa-6a52-491f-9b44-819ecdb5a667 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:51.918474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24e0aa-6a52-491f-9b44-819ecdb5a667 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:51.918753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24e0aa-6a52-491f-9b44-819ecdb5a667 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:51.919552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24e0aa-6a52-491f-9b44-819ecdb5a667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:51.922580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24e0aa-6a52-491f-9b44-819ecdb5a667 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:52.010122 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2597/5214] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:51 2022] PUT /identity/v3/projects/0ac942bb12164dc6adfd2c767cc47669/users/afc6b0abd5294accb5a1461df1c12ac2/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:52.010122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3bc4a-015c-4d09-8f9b-b68f075d7bf1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:52.033765 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2618/5215] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:51 2022] POST /identity/v3/users => generated 299 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:52.034880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24e0aa-6a52-491f-9b44-819ecdb5a667 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:52.055025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24e0aa-6a52-491f-9b44-819ecdb5a667 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:52.099565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3bc4a-015c-4d09-8f9b-b68f075d7bf1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:52.105003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc71232-f987-4812-be0e-9d4cb762a89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:52.105683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc71232-f987-4812-be0e-9d4cb762a89d admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:52.106304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc71232-f987-4812-be0e-9d4cb762a89d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:52.106786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc71232-f987-4812-be0e-9d4cb762a89d admin admin] PATH_INFO: `/v3/projects/21d64140b2aa4a1683fbaefcfb0d70e5/users/76ae92bdb7464f52af032dc9626dab57/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:52.109300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc71232-f987-4812-be0e-9d4cb762a89d admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d64140b2aa4a1683fbaefcfb0d70e5, user_id=76ae92bdb7464f52af032dc9626dab57, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:52.112028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc71232-f987-4812-be0e-9d4cb762a89d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:52.117571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfebff5-ea3a-4bd3-bb2f-21ac47df6a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:52.118260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfebff5-ea3a-4bd3-bb2f-21ac47df6a3d admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:52.118545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfebff5-ea3a-4bd3-bb2f-21ac47df6a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:52.118818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfebff5-ea3a-4bd3-bb2f-21ac47df6a3d admin admin] PATH_INFO: `/v3/projects/76fcb82a896849ea833237c77b1cf554/users/c01cd548b4924d9ca76e148a0c73e018/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:52.121714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfebff5-ea3a-4bd3-bb2f-21ac47df6a3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76fcb82a896849ea833237c77b1cf554, user_id=c01cd548b4924d9ca76e148a0c73e018, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:52.122443 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2598/5216] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:52 2022] PUT /identity/v3/projects/21d64140b2aa4a1683fbaefcfb0d70e5/users/76ae92bdb7464f52af032dc9626dab57/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:52.123354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc71232-f987-4812-be0e-9d4cb762a89d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:52.124926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfebff5-ea3a-4bd3-bb2f-21ac47df6a3d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:52.132840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bdc71232-f987-4812-be0e-9d4cb762a89d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:52.136775 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2619/5217] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:52 2022] PUT /identity/v3/projects/76fcb82a896849ea833237c77b1cf554/users/c01cd548b4924d9ca76e148a0c73e018/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:52.138970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfebff5-ea3a-4bd3-bb2f-21ac47df6a3d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:52.141316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7dfebff5-ea3a-4bd3-bb2f-21ac47df6a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:52.212697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc71232-f987-4812-be0e-9d4cb762a89d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:52.231500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfebff5-ea3a-4bd3-bb2f-21ac47df6a3d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:52.237525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffc505-ec53-450d-b9fd-1e535b20408c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:52.238179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffc505-ec53-450d-b9fd-1e535b20408c service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:52.238462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffc505-ec53-450d-b9fd-1e535b20408c service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:52.238737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffc505-ec53-450d-b9fd-1e535b20408c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:52.240558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5fffc505-ec53-450d-b9fd-1e535b20408c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:52.272358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62fba2-e913-4f64-9c8c-239aa55ac9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:52.273459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62fba2-e913-4f64-9c8c-239aa55ac9b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:52.273459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62fba2-e913-4f64-9c8c-239aa55ac9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:52.273667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62fba2-e913-4f64-9c8c-239aa55ac9b9 admin admin] PATH_INFO: `/v3/projects/72d5b3f96f6b47ceaacb604f6c0e4b5e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:52.274717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62fba2-e913-4f64-9c8c-239aa55ac9b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72d5b3f96f6b47ceaacb604f6c0e4b5e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:52.276783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62fba2-e913-4f64-9c8c-239aa55ac9b9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:52.303766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fffc505-ec53-450d-b9fd-1e535b20408c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:52.305372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fffc505-ec53-450d-b9fd-1e535b20408c service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:52.314825 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2620/5218] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:46:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:46:52.315658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffc505-ec53-450d-b9fd-1e535b20408c service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:52.317018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5fffc505-ec53-450d-b9fd-1e535b20408c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:52.389877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffc505-ec53-450d-b9fd-1e535b20408c service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:52.396185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07390d-ba93-453f-8447-7db875847246 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:52.396835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07390d-ba93-453f-8447-7db875847246 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:52.397257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07390d-ba93-453f-8447-7db875847246 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:52.399655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07390d-ba93-453f-8447-7db875847246 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:52.399655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bc07390d-ba93-453f-8447-7db875847246 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:52.413950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07390d-ba93-453f-8447-7db875847246 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:52.415591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07390d-ba93-453f-8447-7db875847246 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:52.417158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4d62fba2-e913-4f64-9c8c-239aa55ac9b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72d5b3f96f6b47ceaacb604f6c0e4b5e', 'request_id': 'req-4d62fba2-e913-4f64-9c8c-239aa55ac9b9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:52.429036 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2621/5219] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:52.430351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a086e84-b542-4985-b1ee-4700d9ad80e1 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:52.430643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a086e84-b542-4985-b1ee-4700d9ad80e1 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:52.430920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a086e84-b542-4985-b1ee-4700d9ad80e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:52.441376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:52.458747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-5a086e84-b542-4985-b1ee-4700d9ad80e1 None None] MFA Rules not processed for user `afc6b0abd5294accb5a1461df1c12ac2`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:52.459947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5a086e84-b542-4985-b1ee-4700d9ad80e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:52.526242 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2622/5220] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:52.527187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a086e84-b542-4985-b1ee-4700d9ad80e1 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:52.533888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4d62fba2-e913-4f64-9c8c-239aa55ac9b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72d5b3f96f6b47ceaacb604f6c0e4b5e', 'request_id': 'req-4d62fba2-e913-4f64-9c8c-239aa55ac9b9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:52.537992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:52.544265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4d62fba2-e913-4f64-9c8c-239aa55ac9b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72d5b3f96f6b47ceaacb604f6c0e4b5e', 'request_id': 'req-4d62fba2-e913-4f64-9c8c-239aa55ac9b9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:52.571823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4d62fba2-e913-4f64-9c8c-239aa55ac9b9 admin admin] The token cache is being invalidate because project 72d5b3f96f6b47ceaacb604f6c0e4b5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:52.572214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4d62fba2-e913-4f64-9c8c-239aa55ac9b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:52.572912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4d62fba2-e913-4f64-9c8c-239aa55ac9b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:52.574521 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2599/5221] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:52 2022] DELETE /identity/v3/projects/72d5b3f96f6b47ceaacb604f6c0e4b5e => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:52.575970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb49a8-7d26-489b-a148-4a57c93a27bc None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:52.576361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb49a8-7d26-489b-a148-4a57c93a27bc None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:52.576635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb49a8-7d26-489b-a148-4a57c93a27bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:52.605045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-35cb49a8-7d26-489b-a148-4a57c93a27bc None None] MFA Rules not processed for user `966feb108a724a18919b3a106e9d9c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:52.607224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a086e84-b542-4985-b1ee-4700d9ad80e1 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:52.607358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-35cb49a8-7d26-489b-a148-4a57c93a27bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:52.611692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5946f5-4764-461f-a9af-bbfdd04168eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:52.612359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5946f5-4764-461f-a9af-bbfdd04168eb admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:52.612650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5946f5-4764-461f-a9af-bbfdd04168eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:52.612928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5946f5-4764-461f-a9af-bbfdd04168eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:52.613597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5946f5-4764-461f-a9af-bbfdd04168eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:52.615748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5946f5-4764-461f-a9af-bbfdd04168eb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:52.631500 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2623/5222] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:52.631500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce974285-2c63-4975-a061-b6041200d005 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:52.631500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce974285-2c63-4975-a061-b6041200d005 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:52.631500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce974285-2c63-4975-a061-b6041200d005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:52.660355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ce974285-2c63-4975-a061-b6041200d005 None None] MFA Rules not processed for user `76ae92bdb7464f52af032dc9626dab57`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:52.661818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ce974285-2c63-4975-a061-b6041200d005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:52.670495 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2600/5223] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:52.672360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451ddd9-064c-4497-a326-3019ef6bda57 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:52.674499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451ddd9-064c-4497-a326-3019ef6bda57 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:52.674499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451ddd9-064c-4497-a326-3019ef6bda57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:52.704600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1451ddd9-064c-4497-a326-3019ef6bda57 None None] MFA Rules not processed for user `c01cd548b4924d9ca76e148a0c73e018`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:52.705893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1451ddd9-064c-4497-a326-3019ef6bda57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:52.739608 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2624/5224] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:52.740523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce974285-2c63-4975-a061-b6041200d005 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:52.741927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ce974285-2c63-4975-a061-b6041200d005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:52.758172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce974285-2c63-4975-a061-b6041200d005 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:52.763695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66135112-9391-46af-979b-374d73cbf42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:52.764373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66135112-9391-46af-979b-374d73cbf42a admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:52.764723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66135112-9391-46af-979b-374d73cbf42a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:52.765675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66135112-9391-46af-979b-374d73cbf42a admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:52.766661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66135112-9391-46af-979b-374d73cbf42a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:52.768438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66135112-9391-46af-979b-374d73cbf42a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:52.775249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:52.803444 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2601/5225] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:52.804742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bddab8-83ed-4ad3-9ea2-f82c43f07c2b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:52.805036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bddab8-83ed-4ad3-9ea2-f82c43f07c2b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:52.805410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bddab8-83ed-4ad3-9ea2-f82c43f07c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:52.831361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-63bddab8-83ed-4ad3-9ea2-f82c43f07c2b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:52.832652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-63bddab8-83ed-4ad3-9ea2-f82c43f07c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:52.841002 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2602/5226] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:52.841843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bddab8-83ed-4ad3-9ea2-f82c43f07c2b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:52.843382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-63bddab8-83ed-4ad3-9ea2-f82c43f07c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:52.855172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bddab8-83ed-4ad3-9ea2-f82c43f07c2b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:52.860652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7822b-d2d6-47fa-b47a-331ce8f7b048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:52.861265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7822b-d2d6-47fa-b47a-331ce8f7b048 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:52.861574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7822b-d2d6-47fa-b47a-331ce8f7b048 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:52.862218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7822b-d2d6-47fa-b47a-331ce8f7b048 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:52.862532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7822b-d2d6-47fa-b47a-331ce8f7b048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:52.864164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7822b-d2d6-47fa-b47a-331ce8f7b048 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:52.877866 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2603/5227] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:52.877866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7822b-d2d6-47fa-b47a-331ce8f7b048 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:52.886713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7822b-d2d6-47fa-b47a-331ce8f7b048 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:52.890854 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2625/5228] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:52 2022] POST /identity/v3/projects => generated 365 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:52.892064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66135112-9391-46af-979b-374d73cbf42a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:52.896423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44649cd-7685-49f9-a6fb-3217452b7be2 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:52.897248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44649cd-7685-49f9-a6fb-3217452b7be2 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:52.897729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44649cd-7685-49f9-a6fb-3217452b7be2 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:52.898184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44649cd-7685-49f9-a6fb-3217452b7be2 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:52.898914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44649cd-7685-49f9-a6fb-3217452b7be2 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:52.900793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44649cd-7685-49f9-a6fb-3217452b7be2 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:52.961100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66135112-9391-46af-979b-374d73cbf42a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:52.965958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e027fb7-3636-46c5-93b9-9fd10cc23882 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cd548b4924d9ca76e148a0c73e018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fcb82a896849ea833237c77b1cf554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:52.966613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e027fb7-3636-46c5-93b9-9fd10cc23882 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:52.966899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e027fb7-3636-46c5-93b9-9fd10cc23882 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:52.967178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e027fb7-3636-46c5-93b9-9fd10cc23882 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:52.967828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e027fb7-3636-46c5-93b9-9fd10cc23882 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:52.970427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e027fb7-3636-46c5-93b9-9fd10cc23882 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:53.013700 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2604/5229] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:46:52 2022] POST /identity/v3/domains => generated 276 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:53.016712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ab282-54d4-4e95-8d4e-ddb762b7766c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:53.016999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ab282-54d4-4e95-8d4e-ddb762b7766c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:53.017279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ab282-54d4-4e95-8d4e-ddb762b7766c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:53.052075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f94ab282-54d4-4e95-8d4e-ddb762b7766c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:53.054488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f94ab282-54d4-4e95-8d4e-ddb762b7766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:53.112322 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2626/5230] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:52 2022] POST /identity/v3/projects => generated 334 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:53.115296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e027fb7-3636-46c5-93b9-9fd10cc23882 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:53.173881 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2605/5231] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:53.173881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ab282-54d4-4e95-8d4e-ddb762b7766c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:53.201169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ab282-54d4-4e95-8d4e-ddb762b7766c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:53.255658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e027fb7-3636-46c5-93b9-9fd10cc23882 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:53.261438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d51082-e49d-494e-9dfa-0af25e8dcf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:53.262329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d51082-e49d-494e-9dfa-0af25e8dcf69 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:53.262724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d51082-e49d-494e-9dfa-0af25e8dcf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:53.263080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d51082-e49d-494e-9dfa-0af25e8dcf69 admin admin] PATH_INFO: `/v3/projects/14a3cfa6aaa74174a706a759f692c113/users/b4dae167878b41699b8caae5a0386cf4/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:53.274149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7b33d-57e5-4410-abd2-81395112eb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:53.274813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7b33d-57e5-4410-abd2-81395112eb80 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:53.275259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7b33d-57e5-4410-abd2-81395112eb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:53.275761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7b33d-57e5-4410-abd2-81395112eb80 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:53.276300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7b33d-57e5-4410-abd2-81395112eb80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:53.280431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7b33d-57e5-4410-abd2-81395112eb80 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:53.281006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d51082-e49d-494e-9dfa-0af25e8dcf69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a3cfa6aaa74174a706a759f692c113, user_id=b4dae167878b41699b8caae5a0386cf4, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:53.285816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d51082-e49d-494e-9dfa-0af25e8dcf69 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:53.387629 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2627/5232] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:53 2022] PUT /identity/v3/projects/14a3cfa6aaa74174a706a759f692c113/users/b4dae167878b41699b8caae5a0386cf4/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:53.388473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d51082-e49d-494e-9dfa-0af25e8dcf69 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:53.400448 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2606/5233] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:53 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:53.401320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7b33d-57e5-4410-abd2-81395112eb80 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:53.475868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7b33d-57e5-4410-abd2-81395112eb80 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:53.475999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:53.477730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d51082-e49d-494e-9dfa-0af25e8dcf69 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:53.483533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597c980-af7d-4045-be65-03df0c5172e5 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:53.493655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597c980-af7d-4045-be65-03df0c5172e5 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:53.493655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597c980-af7d-4045-be65-03df0c5172e5 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:53.493655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597c980-af7d-4045-be65-03df0c5172e5 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:53.493655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597c980-af7d-4045-be65-03df0c5172e5 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:53.493655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597c980-af7d-4045-be65-03df0c5172e5 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:53.535478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8366606-4ca3-4b02-87f8-dd0df733528b tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cd548b4924d9ca76e148a0c73e018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fcb82a896849ea833237c77b1cf554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:53.536097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8366606-4ca3-4b02-87f8-dd0df733528b tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:53.536391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8366606-4ca3-4b02-87f8-dd0df733528b tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:53.536674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8366606-4ca3-4b02-87f8-dd0df733528b tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:53.537325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8366606-4ca3-4b02-87f8-dd0df733528b tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:53.539240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8366606-4ca3-4b02-87f8-dd0df733528b tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:53.572517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:53.579971 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2628/5234] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:46:53 2022] POST /identity/v3/groups => generated 281 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:53.579971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597c980-af7d-4045-be65-03df0c5172e5 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:53.637293 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2607/5235] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Oct 27 03:46:53 2022] POST /identity/v3/projects => generated 332 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:53.638918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64610128-1458-400e-8c2c-4557fa579292 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:53.639206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64610128-1458-400e-8c2c-4557fa579292 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:53.639485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64610128-1458-400e-8c2c-4557fa579292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:53.641915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597c980-af7d-4045-be65-03df0c5172e5 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:53.674012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-64610128-1458-400e-8c2c-4557fa579292 None None] MFA Rules not processed for user `ca2da57f02884a968d685b53a5399e46`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:53.674012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-64610128-1458-400e-8c2c-4557fa579292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:53.730374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce04356-0ee6-4d51-bae9-11aeddc0aad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:53.731432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce04356-0ee6-4d51-bae9-11aeddc0aad5 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:53.731961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce04356-0ee6-4d51-bae9-11aeddc0aad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:53.732466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce04356-0ee6-4d51-bae9-11aeddc0aad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:53.733397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce04356-0ee6-4d51-bae9-11aeddc0aad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:46:53.734278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce04356-0ee6-4d51-bae9-11aeddc0aad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:53.735072 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2608/5236] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:53.736370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857862e-6429-4be7-a20a-aeebd0548723 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:53.736665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857862e-6429-4be7-a20a-aeebd0548723 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:53.736927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce04356-0ee6-4d51-bae9-11aeddc0aad5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:53.737060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857862e-6429-4be7-a20a-aeebd0548723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:53.750468 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2629/5237] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:53.755000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce04356-0ee6-4d51-bae9-11aeddc0aad5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:53.766091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce04356-0ee6-4d51-bae9-11aeddc0aad5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:53.775301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6142fd-0b73-4bb2-ab0c-71c69a3a362f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:53.776826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a857862e-6429-4be7-a20a-aeebd0548723 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:53.777483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6142fd-0b73-4bb2-ab0c-71c69a3a362f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:53.777691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6142fd-0b73-4bb2-ab0c-71c69a3a362f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:53.778001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6142fd-0b73-4bb2-ab0c-71c69a3a362f admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:53.779861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a857862e-6429-4be7-a20a-aeebd0548723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:53.780141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6142fd-0b73-4bb2-ab0c-71c69a3a362f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:53.784262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6142fd-0b73-4bb2-ab0c-71c69a3a362f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:53.798919 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2609/5238] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:53.803179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857862e-6429-4be7-a20a-aeebd0548723 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:53.814586 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2630/5239] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:53.816190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6142fd-0b73-4bb2-ab0c-71c69a3a362f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:53.923178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6142fd-0b73-4bb2-ab0c-71c69a3a362f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:53.929367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967fefe-1faf-4c11-b764-9e6f75b4752e tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cd548b4924d9ca76e148a0c73e018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fcb82a896849ea833237c77b1cf554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:53.930101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967fefe-1faf-4c11-b764-9e6f75b4752e tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:53.930473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967fefe-1faf-4c11-b764-9e6f75b4752e tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:53.930831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967fefe-1faf-4c11-b764-9e6f75b4752e tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:53.931622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2967fefe-1faf-4c11-b764-9e6f75b4752e tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:53.933581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2967fefe-1faf-4c11-b764-9e6f75b4752e tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:53.941575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857862e-6429-4be7-a20a-aeebd0548723 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:53.948662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15532a5-489b-4298-97df-a6ed5caa791e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:53.951764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15532a5-489b-4298-97df-a6ed5caa791e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:53.951764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15532a5-489b-4298-97df-a6ed5caa791e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:53.951764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15532a5-489b-4298-97df-a6ed5caa791e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups/b892f46f608044d1b619b9c0cbe2950a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:53.957796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15532a5-489b-4298-97df-a6ed5caa791e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:update_group(group_id=b892f46f608044d1b619b9c0cbe2950a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:53.959310 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-d15532a5-489b-4298-97df-a6ed5caa791e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:46:53.959310 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:46:53.959310 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:46:53.960760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15532a5-489b-4298-97df-a6ed5caa791e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:54.107203 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2631/5240] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:53 2022] POST /identity/v3/projects => generated 358 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:54.107203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967fefe-1faf-4c11-b764-9e6f75b4752e tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:54.146290 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2610/5241] 10.222.0.20 () {60 vars in 1247 bytes} [Thu Oct 27 03:46:53 2022] PATCH /identity/v3/groups/b892f46f608044d1b619b9c0cbe2950a => generated 293 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:54.149971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15532a5-489b-4298-97df-a6ed5caa791e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:54.153606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d15532a5-489b-4298-97df-a6ed5caa791e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:54.195555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967fefe-1faf-4c11-b764-9e6f75b4752e tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:54.204862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb8f5a-2f66-4e55-8c32-f87292575616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:54.204862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb8f5a-2f66-4e55-8c32-f87292575616 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:54.204862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb8f5a-2f66-4e55-8c32-f87292575616 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:54.204862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb8f5a-2f66-4e55-8c32-f87292575616 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:54.205767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb8f5a-2f66-4e55-8c32-f87292575616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:54.207333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb8f5a-2f66-4e55-8c32-f87292575616 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:54.312798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15532a5-489b-4298-97df-a6ed5caa791e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:54.331038 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2632/5242] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:46:54 2022] POST /identity/v3/projects => generated 371 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:54.331826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb8f5a-2f66-4e55-8c32-f87292575616 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:54.411665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7764f0f-187d-4c6f-a2c0-d186ccab7330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:54.413258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7764f0f-187d-4c6f-a2c0-d186ccab7330 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:54.414420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7764f0f-187d-4c6f-a2c0-d186ccab7330 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:54.414801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7764f0f-187d-4c6f-a2c0-d186ccab7330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:54.426184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7764f0f-187d-4c6f-a2c0-d186ccab7330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:54.427636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7764f0f-187d-4c6f-a2c0-d186ccab7330 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:54.436854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb8f5a-2f66-4e55-8c32-f87292575616 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:54.439717 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2611/5243] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:54.440539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7764f0f-187d-4c6f-a2c0-d186ccab7330 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:54.442764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488f386-7522-4461-a4c9-386092686b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:54.443502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488f386-7522-4461-a4c9-386092686b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:54.443889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488f386-7522-4461-a4c9-386092686b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:54.444267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488f386-7522-4461-a4c9-386092686b22 admin admin] PATH_INFO: `/v3/projects/8d9c581dca8b4895aeacf01687297bd2/users/afda5438557846cc852a2c31347076e2/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:54.462410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488f386-7522-4461-a4c9-386092686b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d9c581dca8b4895aeacf01687297bd2, user_id=afda5438557846cc852a2c31347076e2, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:54.465475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488f386-7522-4461-a4c9-386092686b22 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:54.509730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7764f0f-187d-4c6f-a2c0-d186ccab7330 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:54.559872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:54.571379 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2633/5244] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:54 2022] PUT /identity/v3/projects/8d9c581dca8b4895aeacf01687297bd2/users/afda5438557846cc852a2c31347076e2/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:54.572763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488f386-7522-4461-a4c9-386092686b22 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:54.587055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae659fd-e384-4f3d-b5b1-1e30c6a34ee8 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cd548b4924d9ca76e148a0c73e018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fcb82a896849ea833237c77b1cf554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:54.587879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae659fd-e384-4f3d-b5b1-1e30c6a34ee8 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:54.588287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae659fd-e384-4f3d-b5b1-1e30c6a34ee8 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:54.588681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae659fd-e384-4f3d-b5b1-1e30c6a34ee8 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:54.589692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae659fd-e384-4f3d-b5b1-1e30c6a34ee8 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:54.598718 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-9ae659fd-e384-4f3d-b5b1-1e30c6a34ee8 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:46:54.598718 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:46:54.598718 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:46:54.598718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae659fd-e384-4f3d-b5b1-1e30c6a34ee8 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:54.642818 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2612/5245] 10.222.0.20 () {58 vars in 1131 bytes} [Thu Oct 27 03:46:54 2022] GET /identity/v3/projects => generated 7508 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:54.644113 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae659fd-e384-4f3d-b5b1-1e30c6a34ee8 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:54.658086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae659fd-e384-4f3d-b5b1-1e30c6a34ee8 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:54.701369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:54.753831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488f386-7522-4461-a4c9-386092686b22 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:54.778734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82451d2-966b-472f-9504-af0813b1a7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:54.779833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82451d2-966b-472f-9504-af0813b1a7cc admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:54.780238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82451d2-966b-472f-9504-af0813b1a7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:54.780506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82451d2-966b-472f-9504-af0813b1a7cc admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:54.781197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82451d2-966b-472f-9504-af0813b1a7cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:54.783705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82451d2-966b-472f-9504-af0813b1a7cc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:54.783913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d12fa-190f-438a-a2f4-c3dbfe37801e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:54.785482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d12fa-190f-438a-a2f4-c3dbfe37801e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:54.785760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d12fa-190f-438a-a2f4-c3dbfe37801e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:54.786171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d12fa-190f-438a-a2f4-c3dbfe37801e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups/b892f46f608044d1b619b9c0cbe2950a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:54.798902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d12fa-190f-438a-a2f4-c3dbfe37801e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:get_group(group_id=b892f46f608044d1b619b9c0cbe2950a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:54.803309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d12fa-190f-438a-a2f4-c3dbfe37801e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:54.805416 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2634/5246] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:54 2022] GET /identity/v3/groups/b892f46f608044d1b619b9c0cbe2950a => generated 293 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:54.806248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d12fa-190f-438a-a2f4-c3dbfe37801e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:54.823749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d12fa-190f-438a-a2f4-c3dbfe37801e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:54.829658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ffb3a-7a19-4d30-81c0-686be74926ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:54.833611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ffb3a-7a19-4d30-81c0-686be74926ce admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:54.833611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ffb3a-7a19-4d30-81c0-686be74926ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:54.833611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ffb3a-7a19-4d30-81c0-686be74926ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:54.833611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ffb3a-7a19-4d30-81c0-686be74926ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:54.833611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ffb3a-7a19-4d30-81c0-686be74926ce admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:54.848821 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2635/5247] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:54.849533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ffb3a-7a19-4d30-81c0-686be74926ce admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:54.887928 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2613/5248] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:54 2022] POST /identity/v3/users => generated 286 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:54.890833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82451d2-966b-472f-9504-af0813b1a7cc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:54.903690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82451d2-966b-472f-9504-af0813b1a7cc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:54.910409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc40b8d-9b68-4f49-a57b-83e93fdf20eb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:54.919398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc40b8d-9b68-4f49-a57b-83e93fdf20eb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:54.919398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc40b8d-9b68-4f49-a57b-83e93fdf20eb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:54.919398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc40b8d-9b68-4f49-a57b-83e93fdf20eb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups/b892f46f608044d1b619b9c0cbe2950a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:54.920654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc40b8d-9b68-4f49-a57b-83e93fdf20eb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:update_group(group_id=b892f46f608044d1b619b9c0cbe2950a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:54.923580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc40b8d-9b68-4f49-a57b-83e93fdf20eb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:54.989444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ffb3a-7a19-4d30-81c0-686be74926ce admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:54.994688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5e524-fc14-40ce-8109-b47ab5b9a608 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cd548b4924d9ca76e148a0c73e018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fcb82a896849ea833237c77b1cf554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:54.995311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5e524-fc14-40ce-8109-b47ab5b9a608 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:54.995603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5e524-fc14-40ce-8109-b47ab5b9a608 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:54.995888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5e524-fc14-40ce-8109-b47ab5b9a608 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:54.996575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5e524-fc14-40ce-8109-b47ab5b9a608 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:46:54.996890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5e524-fc14-40ce-8109-b47ab5b9a608 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:54.998837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5e524-fc14-40ce-8109-b47ab5b9a608 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:55.010180 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2614/5249] 10.222.0.20 () {60 vars in 1246 bytes} [Thu Oct 27 03:46:54 2022] PATCH /identity/v3/groups/b892f46f608044d1b619b9c0cbe2950a => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:55.010180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc40b8d-9b68-4f49-a57b-83e93fdf20eb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:55.024037 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2636/5250] 10.222.0.20 () {58 vars in 1158 bytes} [Thu Oct 27 03:46:54 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:55.024037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5e524-fc14-40ce-8109-b47ab5b9a608 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:55.029264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc40b8d-9b68-4f49-a57b-83e93fdf20eb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:55.035092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5e524-fc14-40ce-8109-b47ab5b9a608 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:55.038742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70180e6e-a6e9-4153-b338-4f5cbe2f0955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:55.039420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70180e6e-a6e9-4153-b338-4f5cbe2f0955 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:55.039703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70180e6e-a6e9-4153-b338-4f5cbe2f0955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:55.039867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0225bb1-483d-4e21-a660-0be040bfeefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:55.039998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70180e6e-a6e9-4153-b338-4f5cbe2f0955 admin admin] PATH_INFO: `/v3/projects/8d9c581dca8b4895aeacf01687297bd2/users/afda5438557846cc852a2c31347076e2/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:55.040473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0225bb1-483d-4e21-a660-0be040bfeefe admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:55.040763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0225bb1-483d-4e21-a660-0be040bfeefe admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:55.041042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0225bb1-483d-4e21-a660-0be040bfeefe admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:55.041689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0225bb1-483d-4e21-a660-0be040bfeefe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:55.042740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70180e6e-a6e9-4153-b338-4f5cbe2f0955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d9c581dca8b4895aeacf01687297bd2, user_id=afda5438557846cc852a2c31347076e2, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:55.043359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0225bb1-483d-4e21-a660-0be040bfeefe admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:55.045687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70180e6e-a6e9-4153-b338-4f5cbe2f0955 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:55.054108 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2637/5251] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:55.054783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0225bb1-483d-4e21-a660-0be040bfeefe admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:55.060356 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2615/5252] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:55 2022] PUT /identity/v3/projects/8d9c581dca8b4895aeacf01687297bd2/users/afda5438557846cc852a2c31347076e2/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:55.061334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70180e6e-a6e9-4153-b338-4f5cbe2f0955 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:55.073919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0225bb1-483d-4e21-a660-0be040bfeefe admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:55.150227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70180e6e-a6e9-4153-b338-4f5cbe2f0955 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:55.163441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c00416-3b17-4a1b-8662-b60e1e928b10 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cd548b4924d9ca76e148a0c73e018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fcb82a896849ea833237c77b1cf554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:55.163890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d67eef-f72e-4fd8-86cd-4b1aacab3cdb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:55.164487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c00416-3b17-4a1b-8662-b60e1e928b10 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:55.164670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d67eef-f72e-4fd8-86cd-4b1aacab3cdb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:55.164908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c00416-3b17-4a1b-8662-b60e1e928b10 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:55.165110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d67eef-f72e-4fd8-86cd-4b1aacab3cdb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:55.165329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c00416-3b17-4a1b-8662-b60e1e928b10 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:55.165536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d67eef-f72e-4fd8-86cd-4b1aacab3cdb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups/b892f46f608044d1b619b9c0cbe2950a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:55.166053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c00416-3b17-4a1b-8662-b60e1e928b10 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: Adding query filter params (parent_id=feda318c33b34f2b9587416bea9def28) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:46:55.166372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c00416-3b17-4a1b-8662-b60e1e928b10 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:55.169527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c00416-3b17-4a1b-8662-b60e1e928b10 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:55.172357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d67eef-f72e-4fd8-86cd-4b1aacab3cdb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:delete_group(group_id=b892f46f608044d1b619b9c0cbe2950a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:55.173497 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-30d67eef-f72e-4fd8-86cd-4b1aacab3cdb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:46:55.173497 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:46:55.173497 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:46:55.175151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d67eef-f72e-4fd8-86cd-4b1aacab3cdb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:55.194508 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2616/5253] 10.222.0.20 () {58 vars in 1216 bytes} [Thu Oct 27 03:46:55 2022] GET /identity/v3/projects?parent_id=feda318c33b34f2b9587416bea9def28 => generated 498 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:55.204356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c00416-3b17-4a1b-8662-b60e1e928b10 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:55.350470 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2638/5254] 10.222.0.20 () {58 vars in 1227 bytes} [Thu Oct 27 03:46:55 2022] DELETE /identity/v3/groups/b892f46f608044d1b619b9c0cbe2950a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:55.352608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb619b1-1389-4695-b6f5-346937ef19d6 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:55.353082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb619b1-1389-4695-b6f5-346937ef19d6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:55.353665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb619b1-1389-4695-b6f5-346937ef19d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:55.375787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c00416-3b17-4a1b-8662-b60e1e928b10 tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:55.389020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-cdb619b1-1389-4695-b6f5-346937ef19d6 None None] MFA Rules not processed for user `afda5438557846cc852a2c31347076e2`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:55.390743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cdb619b1-1389-4695-b6f5-346937ef19d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:55.472213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d52355-1929-4236-a9d4-8fbbc1e3bb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:55.472884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d52355-1929-4236-a9d4-8fbbc1e3bb2d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:55.473169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d52355-1929-4236-a9d4-8fbbc1e3bb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:55.473448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d52355-1929-4236-a9d4-8fbbc1e3bb2d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:55.474338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d52355-1929-4236-a9d4-8fbbc1e3bb2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:55.476091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d52355-1929-4236-a9d4-8fbbc1e3bb2d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:55.501806 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2617/5255] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:55.501806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d52355-1929-4236-a9d4-8fbbc1e3bb2d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:55.538651 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2639/5256] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:55.538651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb619b1-1389-4695-b6f5-346937ef19d6 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:55.631947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d52355-1929-4236-a9d4-8fbbc1e3bb2d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:55.639200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb619b1-1389-4695-b6f5-346937ef19d6 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:55.646510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc3a1c-e3b5-4c17-b38a-e51459c1459c tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cd548b4924d9ca76e148a0c73e018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fcb82a896849ea833237c77b1cf554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:55.647736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc3a1c-e3b5-4c17-b38a-e51459c1459c tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:55.648036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc3a1c-e3b5-4c17-b38a-e51459c1459c tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:55.648485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc3a1c-e3b5-4c17-b38a-e51459c1459c tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] PATH_INFO: `/v3/projects/ccd1270865024648a6979f10968d8a12` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:55.651550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc3a1c-e3b5-4c17-b38a-e51459c1459c tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ccd1270865024648a6979f10968d8a12)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:55.653269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e72cb0-c6db-436a-8eb6-81f64b771fe9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:55.654092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e72cb0-c6db-436a-8eb6-81f64b771fe9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:55.659632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e72cb0-c6db-436a-8eb6-81f64b771fe9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:55.659632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e72cb0-c6db-436a-8eb6-81f64b771fe9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:55.659632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e72cb0-c6db-436a-8eb6-81f64b771fe9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:55.660216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc3a1c-e3b5-4c17-b38a-e51459c1459c tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:55.661355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e72cb0-c6db-436a-8eb6-81f64b771fe9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:55.775669 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2640/5257] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:46:55 2022] POST /identity/v3/groups => generated 327 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:55.779809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e72cb0-c6db-436a-8eb6-81f64b771fe9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:55.791512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e72cb0-c6db-436a-8eb6-81f64b771fe9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:55.797553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf6679-222b-4064-8792-f1900709272a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:55.798310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf6679-222b-4064-8792-f1900709272a admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:55.798599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf6679-222b-4064-8792-f1900709272a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:55.798875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf6679-222b-4064-8792-f1900709272a admin admin] PATH_INFO: `/v3/projects/975651c9e106415da336a1786d5e1717/users/57c1e257c4a4468b81c7d4b9bf8735ed/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:55.825741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-eadc3a1c-e3b5-4c17-b38a-e51459c1459c tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd1270865024648a6979f10968d8a12', 'request_id': 'req-eadc3a1c-e3b5-4c17-b38a-e51459c1459c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:55.831938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf6679-222b-4064-8792-f1900709272a admin admin] RBAC: Authorizing `identity:create_grant(project_id=975651c9e106415da336a1786d5e1717, user_id=57c1e257c4a4468b81c7d4b9bf8735ed, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:55.837755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf6679-222b-4064-8792-f1900709272a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:55.878757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:55.912642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-eadc3a1c-e3b5-4c17-b38a-e51459c1459c tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd1270865024648a6979f10968d8a12', 'request_id': 'req-eadc3a1c-e3b5-4c17-b38a-e51459c1459c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:55.920835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-eadc3a1c-e3b5-4c17-b38a-e51459c1459c tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd1270865024648a6979f10968d8a12', 'request_id': 'req-eadc3a1c-e3b5-4c17-b38a-e51459c1459c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:55.926504 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2641/5258] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:46:55 2022] PUT /identity/v3/projects/975651c9e106415da336a1786d5e1717/users/57c1e257c4a4468b81c7d4b9bf8735ed/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:55.928330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf6679-222b-4064-8792-f1900709272a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:55.929508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:55.930847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2cbf6679-222b-4064-8792-f1900709272a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:55.937471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-eadc3a1c-e3b5-4c17-b38a-e51459c1459c tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] The token cache is being invalidate because project ccd1270865024648a6979f10968d8a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:55.937776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-eadc3a1c-e3b5-4c17-b38a-e51459c1459c tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:55.944140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-eadc3a1c-e3b5-4c17-b38a-e51459c1459c tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:55.944140 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2618/5259] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:55 2022] DELETE /identity/v3/projects/ccd1270865024648a6979f10968d8a12 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:55.944140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc3a1c-e3b5-4c17-b38a-e51459c1459c tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:55.944140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-eadc3a1c-e3b5-4c17-b38a-e51459c1459c tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:56.001858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf6679-222b-4064-8792-f1900709272a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:56.008172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ad97d-7e77-404d-8a48-0afa3becf257 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:56.009090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ad97d-7e77-404d-8a48-0afa3becf257 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:56.009535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ad97d-7e77-404d-8a48-0afa3becf257 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:56.009905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ad97d-7e77-404d-8a48-0afa3becf257 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:56.012174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ef6ad97d-7e77-404d-8a48-0afa3becf257 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:56.037408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc3a1c-e3b5-4c17-b38a-e51459c1459c tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:56.126772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114a7f7-d283-4624-a0ec-68465cd5b95c tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:56.127581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114a7f7-d283-4624-a0ec-68465cd5b95c tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:56.127989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114a7f7-d283-4624-a0ec-68465cd5b95c tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:56.128431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114a7f7-d283-4624-a0ec-68465cd5b95c tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:56.129183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114a7f7-d283-4624-a0ec-68465cd5b95c tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:56.131698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114a7f7-d283-4624-a0ec-68465cd5b95c tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:56.139326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ad97d-7e77-404d-8a48-0afa3becf257 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:56.144476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ad97d-7e77-404d-8a48-0afa3becf257 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:56.158694 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2642/5260] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:56.160552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c92d41-bd08-44ec-9ddc-c1df141c4c65 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:56.160946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c92d41-bd08-44ec-9ddc-c1df141c4c65 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:56.161509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c92d41-bd08-44ec-9ddc-c1df141c4c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:56.210374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-26c92d41-bd08-44ec-9ddc-c1df141c4c65 None None] MFA Rules not processed for user `57c1e257c4a4468b81c7d4b9bf8735ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:56.212834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-26c92d41-bd08-44ec-9ddc-c1df141c4c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:56.251331 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2619/5261] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:55 2022] POST /identity/v3/users => generated 323 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:56.251331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114a7f7-d283-4624-a0ec-68465cd5b95c tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:56.253746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c114a7f7-d283-4624-a0ec-68465cd5b95c tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:56.355936 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2643/5262] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:56.357437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c92d41-bd08-44ec-9ddc-c1df141c4c65 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:56.371825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c92d41-bd08-44ec-9ddc-c1df141c4c65 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:56.376763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85929d5-2514-4623-a9ad-6cd24896c73f tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:56.377534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85929d5-2514-4623-a9ad-6cd24896c73f tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:56.377926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85929d5-2514-4623-a9ad-6cd24896c73f tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:56.378336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85929d5-2514-4623-a9ad-6cd24896c73f tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups/643e85801c384ab0820a88bbb9a1ad68/users/28f7d3e6ba83495b848fb1348c27bc47` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:56.382304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114a7f7-d283-4624-a0ec-68465cd5b95c tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:56.387843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5e14e-56af-4011-8dc6-3a1579e1ea8e tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cd548b4924d9ca76e148a0c73e018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fcb82a896849ea833237c77b1cf554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:56.388485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5e14e-56af-4011-8dc6-3a1579e1ea8e tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:56.388985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5e14e-56af-4011-8dc6-3a1579e1ea8e tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:56.389266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5e14e-56af-4011-8dc6-3a1579e1ea8e tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] PATH_INFO: `/v3/projects/feda318c33b34f2b9587416bea9def28` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:56.390505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5e14e-56af-4011-8dc6-3a1579e1ea8e tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: Authorizing `identity:delete_project(project_id=feda318c33b34f2b9587416bea9def28)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:56.392997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5e14e-56af-4011-8dc6-3a1579e1ea8e tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:56.397849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85929d5-2514-4623-a9ad-6cd24896c73f tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=643e85801c384ab0820a88bbb9a1ad68, user_id=28f7d3e6ba83495b848fb1348c27bc47)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:56.399053 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-c85929d5-2514-4623-a9ad-6cd24896c73f tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:46:56.399053 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:46:56.399053 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:46:56.400248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85929d5-2514-4623-a9ad-6cd24896c73f tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:56.508652 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2644/5263] 10.222.0.20 () {60 vars in 1360 bytes} [Thu Oct 27 03:46:56 2022] PUT /identity/v3/groups/643e85801c384ab0820a88bbb9a1ad68/users/28f7d3e6ba83495b848fb1348c27bc47 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:56.509686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85929d5-2514-4623-a9ad-6cd24896c73f tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:56.556719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c8a5e14e-56af-4011-8dc6-3a1579e1ea8e tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feda318c33b34f2b9587416bea9def28', 'request_id': 'req-c8a5e14e-56af-4011-8dc6-3a1579e1ea8e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:56.647699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85929d5-2514-4623-a9ad-6cd24896c73f tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:56.663944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c8a5e14e-56af-4011-8dc6-3a1579e1ea8e tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feda318c33b34f2b9587416bea9def28', 'request_id': 'req-c8a5e14e-56af-4011-8dc6-3a1579e1ea8e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:56.674689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c8a5e14e-56af-4011-8dc6-3a1579e1ea8e tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feda318c33b34f2b9587416bea9def28', 'request_id': 'req-c8a5e14e-56af-4011-8dc6-3a1579e1ea8e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:56.688341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c8a5e14e-56af-4011-8dc6-3a1579e1ea8e tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] The token cache is being invalidate because project feda318c33b34f2b9587416bea9def28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:56.688619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c8a5e14e-56af-4011-8dc6-3a1579e1ea8e tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:56.689918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c8a5e14e-56af-4011-8dc6-3a1579e1ea8e tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:56.695294 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2620/5264] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:56 2022] DELETE /identity/v3/projects/feda318c33b34f2b9587416bea9def28 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:56.696614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5e14e-56af-4011-8dc6-3a1579e1ea8e tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:56.698751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c8a5e14e-56af-4011-8dc6-3a1579e1ea8e tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:56.761899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3401e5-888c-4f25-9f46-0ea7b8bf2b94 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c1e257c4a4468b81c7d4b9bf8735ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975651c9e106415da336a1786d5e1717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:56.762849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3401e5-888c-4f25-9f46-0ea7b8bf2b94 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:56.763322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3401e5-888c-4f25-9f46-0ea7b8bf2b94 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:56.763919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3401e5-888c-4f25-9f46-0ea7b8bf2b94 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] PATH_INFO: `/v3/users/57c1e257c4a4468b81c7d4b9bf8735ed/application_credentials` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:56.764994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3401e5-888c-4f25-9f46-0ea7b8bf2b94 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: Authorizing `identity:create_application_credential(user_id=57c1e257c4a4468b81c7d4b9bf8735ed)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:56.766559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3401e5-888c-4f25-9f46-0ea7b8bf2b94 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:56.818968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5e14e-56af-4011-8dc6-3a1579e1ea8e tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:56.823639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30499f62-4719-40bd-bdf3-23f3a02295af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:56.824260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30499f62-4719-40bd-bdf3-23f3a02295af service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:56.824597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30499f62-4719-40bd-bdf3-23f3a02295af service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:56.824921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30499f62-4719-40bd-bdf3-23f3a02295af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:56.826697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-30499f62-4719-40bd-bdf3-23f3a02295af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:56.935463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30499f62-4719-40bd-bdf3-23f3a02295af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:56.938318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30499f62-4719-40bd-bdf3-23f3a02295af service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:56.960591 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2621/5265] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:56.961733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30499f62-4719-40bd-bdf3-23f3a02295af service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:56.965020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-30499f62-4719-40bd-bdf3-23f3a02295af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:57.023065 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2645/5266] 10.222.0.20 () {60 vars in 1315 bytes} [Thu Oct 27 03:46:56 2022] POST /identity/v3/users/57c1e257c4a4468b81c7d4b9bf8735ed/application_credentials => generated 920 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:57.023958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3401e5-888c-4f25-9f46-0ea7b8bf2b94 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:57.030187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5d3401e5-888c-4f25-9f46-0ea7b8bf2b94 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:57.034248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:57.110493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:57.154233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30499f62-4719-40bd-bdf3-23f3a02295af service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:57.160079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62160ace-fe48-4a8c-8e04-ce826e5ec36d tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:57.160976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62160ace-fe48-4a8c-8e04-ce826e5ec36d tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:57.161162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62160ace-fe48-4a8c-8e04-ce826e5ec36d tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:57.161551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62160ace-fe48-4a8c-8e04-ce826e5ec36d tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:57.162229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62160ace-fe48-4a8c-8e04-ce826e5ec36d tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:57.164861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62160ace-fe48-4a8c-8e04-ce826e5ec36d tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:57.218940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3401e5-888c-4f25-9f46-0ea7b8bf2b94 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:57.230894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eeab6a-9c1e-497e-8af3-0bb8cfc73bec tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cd548b4924d9ca76e148a0c73e018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fcb82a896849ea833237c77b1cf554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:57.231986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eeab6a-9c1e-497e-8af3-0bb8cfc73bec tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:57.232441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eeab6a-9c1e-497e-8af3-0bb8cfc73bec tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:57.232930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eeab6a-9c1e-497e-8af3-0bb8cfc73bec tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] PATH_INFO: `/v3/projects/2c5258f50f414fb88c88c73fb81f1dea` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:57.235708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eeab6a-9c1e-497e-8af3-0bb8cfc73bec tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2c5258f50f414fb88c88c73fb81f1dea)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:57.239220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eeab6a-9c1e-497e-8af3-0bb8cfc73bec tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:57.291880 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2622/5267] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:56 2022] POST /identity/v3/users => generated 321 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:57.295596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62160ace-fe48-4a8c-8e04-ce826e5ec36d tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:57.302696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-62160ace-fe48-4a8c-8e04-ce826e5ec36d tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:57.337032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62160ace-fe48-4a8c-8e04-ce826e5ec36d tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:57.348299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d8c61-2af5-40f6-ae12-ef4d3e149abd tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c1e257c4a4468b81c7d4b9bf8735ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975651c9e106415da336a1786d5e1717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:57.348299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d8c61-2af5-40f6-ae12-ef4d3e149abd tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:57.348299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d8c61-2af5-40f6-ae12-ef4d3e149abd tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:57.348691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d8c61-2af5-40f6-ae12-ef4d3e149abd tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] PATH_INFO: `/v3/users/57c1e257c4a4468b81c7d4b9bf8735ed/access_rules/64fcecd8e6cd4776b425fca630149555` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:57.350822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d8c61-2af5-40f6-ae12-ef4d3e149abd tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: Authorizing `identity:delete_access_rule(user_id=57c1e257c4a4468b81c7d4b9bf8735ed, access_rule_id=64fcecd8e6cd4776b425fca630149555)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:57.352442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d8c61-2af5-40f6-ae12-ef4d3e149abd tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:57.382001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-52eeab6a-9c1e-497e-8af3-0bb8cfc73bec tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c5258f50f414fb88c88c73fb81f1dea', 'request_id': 'req-52eeab6a-9c1e-497e-8af3-0bb8cfc73bec'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:57.389715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-52eeab6a-9c1e-497e-8af3-0bb8cfc73bec tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c5258f50f414fb88c88c73fb81f1dea', 'request_id': 'req-52eeab6a-9c1e-497e-8af3-0bb8cfc73bec'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:57.398497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-52eeab6a-9c1e-497e-8af3-0bb8cfc73bec tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c5258f50f414fb88c88c73fb81f1dea', 'request_id': 'req-52eeab6a-9c1e-497e-8af3-0bb8cfc73bec'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:57.420394 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-f62d8c61-2af5-40f6-ae12-ef4d3e149abd tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 27 03:46:57.420394 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:46:57.420394 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Oct 27 03:46:57.420394 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application session.delete(ref) Oct 27 03:46:57.420394 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 03:46:57.420394 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application next(self.gen) Oct 27 03:46:57.420394 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 27 03:46:57.420394 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application yield resource Oct 27 03:46:57.420394 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 03:46:57.420394 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application next(self.gen) Oct 27 03:46:57.420394 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 27 03:46:57.420394 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.session.rollback() Oct 27 03:46:57.420394 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:46:57.420394 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.force_reraise() Oct 27 03:46:57.420394 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:46:57.420394 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise self.value Oct 27 03:46:57.422198 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 27 03:46:57.422198 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 27 03:46:57.422198 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 27 03:46:57.422198 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application session.commit() Oct 27 03:46:57.422198 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 27 03:46:57.422198 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 27 03:46:57.422198 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 27 03:46:57.422198 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._prepare_impl() Oct 27 03:46:57.422198 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 27 03:46:57.422198 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.session.flush() Oct 27 03:46:57.422198 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 03:46:57.422198 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._flush(objects) Oct 27 03:46:57.422198 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 03:46:57.422198 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 27 03:46:57.422198 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 03:46:57.422198 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application compat.raise_( Oct 27 03:46:57.423277 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 03:46:57.423277 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception Oct 27 03:46:57.423277 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 03:46:57.423277 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application flush_context.execute() Oct 27 03:46:57.423277 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 03:46:57.423277 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rec.execute(self) Oct 27 03:46:57.423277 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Oct 27 03:46:57.423277 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Oct 27 03:46:57.423277 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Oct 27 03:46:57.423277 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._synchronize( Oct 27 03:46:57.423277 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Oct 27 03:46:57.423277 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Oct 27 03:46:57.423277 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Oct 27 03:46:57.423277 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise AssertionError( Oct 27 03:46:57.423277 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Oct 27 03:46:57.423277 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:57.424360 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:46:57.424360 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:57.424360 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:46:57.424360 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:46:57.424360 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:46:57.424360 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:46:57.424360 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:46:57.424360 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:46:57.424360 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:46:57.424360 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:46:57.424360 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:46:57.424360 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:46:57.424360 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:46:57.424360 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Oct 27 03:46:57.424360 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Oct 27 03:46:57.424360 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:46:57.424360 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:46:57.425551 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Oct 27 03:46:57.425551 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Oct 27 03:46:57.425551 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Oct 27 03:46:57.425551 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 27 03:46:57.425551 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 27 03:46:57.425551 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:46:57.427001 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2623/5268] 10.222.0.20 () {58 vars in 1362 bytes} [Thu Oct 27 03:46:57 2022] DELETE /identity/v3/users/57c1e257c4a4468b81c7d4b9bf8735ed/access_rules/64fcecd8e6cd4776b425fca630149555 => generated 89 bytes in 135 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:46:57.427941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d8c61-2af5-40f6-ae12-ef4d3e149abd tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:57.440374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d8c61-2af5-40f6-ae12-ef4d3e149abd tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:57.510447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac2d79-8ec5-444d-98a4-28ce3160776c tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:57.511218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac2d79-8ec5-444d-98a4-28ce3160776c tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:57.512572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac2d79-8ec5-444d-98a4-28ce3160776c tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:57.512572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac2d79-8ec5-444d-98a4-28ce3160776c tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups/643e85801c384ab0820a88bbb9a1ad68/users/b4d102cfd0d84052bdbf8fe8c394f490` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:57.532170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac2d79-8ec5-444d-98a4-28ce3160776c tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=643e85801c384ab0820a88bbb9a1ad68, user_id=b4d102cfd0d84052bdbf8fe8c394f490)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:57.533257 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-19ac2d79-8ec5-444d-98a4-28ce3160776c tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:46:57.533257 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:46:57.533257 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:46:57.535054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac2d79-8ec5-444d-98a4-28ce3160776c tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:57.537579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-52eeab6a-9c1e-497e-8af3-0bb8cfc73bec tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] The token cache is being invalidate because project 2c5258f50f414fb88c88c73fb81f1dea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:46:57.538254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-52eeab6a-9c1e-497e-8af3-0bb8cfc73bec tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:57.546672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-52eeab6a-9c1e-497e-8af3-0bb8cfc73bec tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:57.560938 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2646/5269] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:46:57 2022] DELETE /identity/v3/projects/2c5258f50f414fb88c88c73fb81f1dea => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:57.566658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eeab6a-9c1e-497e-8af3-0bb8cfc73bec tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:57.576055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-52eeab6a-9c1e-497e-8af3-0bb8cfc73bec tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:57.736811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eeab6a-9c1e-497e-8af3-0bb8cfc73bec tempest-ListProjectsTestJSON-1987285571 tempest-ListProjectsTestJSON-1987285571-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:57.754718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b7e5c-4057-49b1-9264-05db2fe532a1 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c1e257c4a4468b81c7d4b9bf8735ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975651c9e106415da336a1786d5e1717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:57.755564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b7e5c-4057-49b1-9264-05db2fe532a1 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:57.755952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b7e5c-4057-49b1-9264-05db2fe532a1 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:57.756347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b7e5c-4057-49b1-9264-05db2fe532a1 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] PATH_INFO: `/v3/users/57c1e257c4a4468b81c7d4b9bf8735ed/application_credentials/b700da43b94b4942a509b7f5045fec17` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:57.777324 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2624/5270] 10.222.0.20 () {60 vars in 1360 bytes} [Thu Oct 27 03:46:57 2022] PUT /identity/v3/groups/643e85801c384ab0820a88bbb9a1ad68/users/b4d102cfd0d84052bdbf8fe8c394f490 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:57.777324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac2d79-8ec5-444d-98a4-28ce3160776c tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:57.779089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-19ac2d79-8ec5-444d-98a4-28ce3160776c tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:57.798448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b7e5c-4057-49b1-9264-05db2fe532a1 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: Authorizing `identity:delete_application_credential(user_id=57c1e257c4a4468b81c7d4b9bf8735ed, application_credential_id=b700da43b94b4942a509b7f5045fec17)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:57.800942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b7e5c-4057-49b1-9264-05db2fe532a1 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:57.917463 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2647/5271] 10.222.0.20 () {58 vars in 1395 bytes} [Thu Oct 27 03:46:57 2022] DELETE /identity/v3/users/57c1e257c4a4468b81c7d4b9bf8735ed/application_credentials/b700da43b94b4942a509b7f5045fec17 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:57.922516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b7e5c-4057-49b1-9264-05db2fe532a1 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:57.927119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9c0b7e5c-4057-49b1-9264-05db2fe532a1 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:57.969906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b7e5c-4057-49b1-9264-05db2fe532a1 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:58.027720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac2d79-8ec5-444d-98a4-28ce3160776c tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:58.039174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770973a-3d5e-4c21-8647-9910bc78611e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:58.039986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770973a-3d5e-4c21-8647-9910bc78611e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:58.042123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770973a-3d5e-4c21-8647-9910bc78611e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:58.042123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770973a-3d5e-4c21-8647-9910bc78611e admin admin] PATH_INFO: `/v3/users/5b05b30c45074bcfa0fbba02a562a97f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:58.042123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770973a-3d5e-4c21-8647-9910bc78611e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b05b30c45074bcfa0fbba02a562a97f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:58.044597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770973a-3d5e-4c21-8647-9910bc78611e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:58.116907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fbad2-2815-416d-8ada-d89206e3de4e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:58.117800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fbad2-2815-416d-8ada-d89206e3de4e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:58.118244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fbad2-2815-416d-8ada-d89206e3de4e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:58.118637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fbad2-2815-416d-8ada-d89206e3de4e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:58.119630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fbad2-2815-416d-8ada-d89206e3de4e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:58.121883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fbad2-2815-416d-8ada-d89206e3de4e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:58.238662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:58.253447 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2648/5272] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:46:57 2022] POST /identity/v3/users => generated 323 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:58.253447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fbad2-2815-416d-8ada-d89206e3de4e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:58.345844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fbad2-2815-416d-8ada-d89206e3de4e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:58.352043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf3d56-3c64-4a52-9b8e-1ca9115eac0c tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c1e257c4a4468b81c7d4b9bf8735ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975651c9e106415da336a1786d5e1717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:58.352952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf3d56-3c64-4a52-9b8e-1ca9115eac0c tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:58.354080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf3d56-3c64-4a52-9b8e-1ca9115eac0c tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:58.354661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf3d56-3c64-4a52-9b8e-1ca9115eac0c tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] PATH_INFO: `/v3/users/57c1e257c4a4468b81c7d4b9bf8735ed/access_rules` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:58.357170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf3d56-3c64-4a52-9b8e-1ca9115eac0c tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: Authorizing `identity:list_access_rules(user_id=57c1e257c4a4468b81c7d4b9bf8735ed)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:58.359270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf3d56-3c64-4a52-9b8e-1ca9115eac0c tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:58.365442 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2649/5273] 10.222.0.20 () {58 vars in 1260 bytes} [Thu Oct 27 03:46:58 2022] GET /identity/v3/users/57c1e257c4a4468b81c7d4b9bf8735ed/access_rules => generated 369 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:58.366595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf3d56-3c64-4a52-9b8e-1ca9115eac0c tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:58.371502 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:58.386277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf3d56-3c64-4a52-9b8e-1ca9115eac0c tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:58.406279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8972c9-05f3-494a-9ecf-8d66159dc2ff tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:58.406279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8972c9-05f3-494a-9ecf-8d66159dc2ff tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:58.406279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8972c9-05f3-494a-9ecf-8d66159dc2ff tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:58.407553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8972c9-05f3-494a-9ecf-8d66159dc2ff tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups/643e85801c384ab0820a88bbb9a1ad68/users/675d30ff2dfb4822b2ff049033677c18` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:58.407783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b770973a-3d5e-4c21-8647-9910bc78611e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b05b30c45074bcfa0fbba02a562a97f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:58.407783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b770973a-3d5e-4c21-8647-9910bc78611e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b05b30c45074bcfa0fbba02a562a97f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:58.429047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b770973a-3d5e-4c21-8647-9910bc78611e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b05b30c45074bcfa0fbba02a562a97f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:58.445555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b770973a-3d5e-4c21-8647-9910bc78611e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b05b30c45074bcfa0fbba02a562a97f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:58.450592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8972c9-05f3-494a-9ecf-8d66159dc2ff tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=643e85801c384ab0820a88bbb9a1ad68, user_id=675d30ff2dfb4822b2ff049033677c18)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:58.458684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8972c9-05f3-494a-9ecf-8d66159dc2ff tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:58.621874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b770973a-3d5e-4c21-8647-9910bc78611e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b05b30c45074bcfa0fbba02a562a97f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:58.630977 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2650/5274] 10.222.0.20 () {60 vars in 1360 bytes} [Thu Oct 27 03:46:58 2022] PUT /identity/v3/groups/643e85801c384ab0820a88bbb9a1ad68/users/675d30ff2dfb4822b2ff049033677c18 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:58.631294 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2625/5275] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:46:57 2022] DELETE /identity/v3/users/5b05b30c45074bcfa0fbba02a562a97f => generated 0 bytes in 856 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:58.634617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8972c9-05f3-494a-9ecf-8d66159dc2ff tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:58.635149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770973a-3d5e-4c21-8647-9910bc78611e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:58.637829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b770973a-3d5e-4c21-8647-9910bc78611e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:58.641170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bf8972c9-05f3-494a-9ecf-8d66159dc2ff tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:58.786545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8972c9-05f3-494a-9ecf-8d66159dc2ff tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:58.847585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770973a-3d5e-4c21-8647-9910bc78611e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:58.861960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2fc51-ac8d-424f-bf0c-70994f79c1ca tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:58.864585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2fc51-ac8d-424f-bf0c-70994f79c1ca tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:58.866167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2fc51-ac8d-424f-bf0c-70994f79c1ca tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:58.866763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2fc51-ac8d-424f-bf0c-70994f79c1ca tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups/643e85801c384ab0820a88bbb9a1ad68/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:58.872850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2fc51-ac8d-424f-bf0c-70994f79c1ca tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=643e85801c384ab0820a88bbb9a1ad68)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:58.876569 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-b3c2fc51-ac8d-424f-bf0c-70994f79c1ca tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:46:58.876569 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:46:58.876569 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:46:58.879707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2fc51-ac8d-424f-bf0c-70994f79c1ca tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:58.906701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29962835-9b52-4d04-9efd-9c75ed249385 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c1e257c4a4468b81c7d4b9bf8735ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975651c9e106415da336a1786d5e1717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:58.907393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29962835-9b52-4d04-9efd-9c75ed249385 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:58.907689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29962835-9b52-4d04-9efd-9c75ed249385 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:58.907977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29962835-9b52-4d04-9efd-9c75ed249385 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] PATH_INFO: `/v3/users/57c1e257c4a4468b81c7d4b9bf8735ed/access_rules/64fcecd8e6cd4776b425fca630149555` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:58.909638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29962835-9b52-4d04-9efd-9c75ed249385 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: Authorizing `identity:delete_access_rule(user_id=57c1e257c4a4468b81c7d4b9bf8735ed, access_rule_id=64fcecd8e6cd4776b425fca630149555)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:58.911203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29962835-9b52-4d04-9efd-9c75ed249385 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:58.940031 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2626/5276] 10.222.0.20 () {58 vars in 1242 bytes} [Thu Oct 27 03:46:58 2022] GET /identity/v3/groups/643e85801c384ab0820a88bbb9a1ad68/users => generated 1083 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:46:58.944420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e0d4f-3568-4ce2-aaca-d583086daa3d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:58.944988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e0d4f-3568-4ce2-aaca-d583086daa3d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:58.945638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e0d4f-3568-4ce2-aaca-d583086daa3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:58.989603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-956e0d4f-3568-4ce2-aaca-d583086daa3d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:46:58.994621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-956e0d4f-3568-4ce2-aaca-d583086daa3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:59.116523 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2651/5277] 10.222.0.20 () {58 vars in 1362 bytes} [Thu Oct 27 03:46:58 2022] DELETE /identity/v3/users/57c1e257c4a4468b81c7d4b9bf8735ed/access_rules/64fcecd8e6cd4776b425fca630149555 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:59.117655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29962835-9b52-4d04-9efd-9c75ed249385 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:59.163796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29962835-9b52-4d04-9efd-9c75ed249385 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:59.191698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29532982-ef80-4be9-8c37-3615009490a9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:59.191698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29532982-ef80-4be9-8c37-3615009490a9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:59.192019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29532982-ef80-4be9-8c37-3615009490a9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:59.192302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29532982-ef80-4be9-8c37-3615009490a9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups/643e85801c384ab0820a88bbb9a1ad68/users/28f7d3e6ba83495b848fb1348c27bc47` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:59.206596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29532982-ef80-4be9-8c37-3615009490a9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=643e85801c384ab0820a88bbb9a1ad68, user_id=28f7d3e6ba83495b848fb1348c27bc47)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:59.207662 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-29532982-ef80-4be9-8c37-3615009490a9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:46:59.207662 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:46:59.207662 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:46:59.215055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29532982-ef80-4be9-8c37-3615009490a9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:59.239646 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2627/5278] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:46:59.241529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e0d4f-3568-4ce2-aaca-d583086daa3d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:59.269132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e0d4f-3568-4ce2-aaca-d583086daa3d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:59.282323 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2652/5279] 10.222.0.20 () {58 vars in 1342 bytes} [Thu Oct 27 03:46:59 2022] HEAD /identity/v3/groups/643e85801c384ab0820a88bbb9a1ad68/users/28f7d3e6ba83495b848fb1348c27bc47 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:59.282323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29532982-ef80-4be9-8c37-3615009490a9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:59.284887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-29532982-ef80-4be9-8c37-3615009490a9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:59.291722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac22d0-c78f-49bf-a5e4-b0a99a2d60bf tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c1e257c4a4468b81c7d4b9bf8735ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975651c9e106415da336a1786d5e1717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:59.298210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac22d0-c78f-49bf-a5e4-b0a99a2d60bf tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:59.298611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac22d0-c78f-49bf-a5e4-b0a99a2d60bf tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:59.298969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac22d0-c78f-49bf-a5e4-b0a99a2d60bf tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] PATH_INFO: `/v3/users/57c1e257c4a4468b81c7d4b9bf8735ed/access_rules` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:59.303654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac22d0-c78f-49bf-a5e4-b0a99a2d60bf tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: Authorizing `identity:list_access_rules(user_id=57c1e257c4a4468b81c7d4b9bf8735ed)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:59.313982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac22d0-c78f-49bf-a5e4-b0a99a2d60bf tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:59.338139 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2628/5280] 10.222.0.20 () {58 vars in 1260 bytes} [Thu Oct 27 03:46:59 2022] GET /identity/v3/users/57c1e257c4a4468b81c7d4b9bf8735ed/access_rules => generated 158 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:46:59.342259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac22d0-c78f-49bf-a5e4-b0a99a2d60bf tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:59.350498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e4ac22d0-c78f-49bf-a5e4-b0a99a2d60bf tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:59.385608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29532982-ef80-4be9-8c37-3615009490a9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:59.394634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d0f12-89a2-47d2-8403-98833c0d19c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:59.394634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d0f12-89a2-47d2-8403-98833c0d19c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:59.394634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d0f12-89a2-47d2-8403-98833c0d19c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:59.394634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d0f12-89a2-47d2-8403-98833c0d19c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:59.398602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-964d0f12-89a2-47d2-8403-98833c0d19c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:46:59.404889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac22d0-c78f-49bf-a5e4-b0a99a2d60bf tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:59.427517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:59.455724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd88ff-9b73-4fdb-bc91-4bdd9607a017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:59.469058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d0f12-89a2-47d2-8403-98833c0d19c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:59.471688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d0f12-89a2-47d2-8403-98833c0d19c5 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:59.475261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd88ff-9b73-4fdb-bc91-4bdd9607a017 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:59.479295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd88ff-9b73-4fdb-bc91-4bdd9607a017 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:59.479810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd88ff-9b73-4fdb-bc91-4bdd9607a017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:59.512173 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2653/5281] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:59.513471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d0f12-89a2-47d2-8403-98833c0d19c5 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:59.517206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd88ff-9b73-4fdb-bc91-4bdd9607a017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:59.519006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd88ff-9b73-4fdb-bc91-4bdd9607a017 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:59.532504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d0f12-89a2-47d2-8403-98833c0d19c5 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:59.544141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e860cb-2c16-4bfd-aeb5-bce3c313a21e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:59.549229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e860cb-2c16-4bfd-aeb5-bce3c313a21e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:59.549626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e860cb-2c16-4bfd-aeb5-bce3c313a21e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:59.550092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e860cb-2c16-4bfd-aeb5-bce3c313a21e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups/643e85801c384ab0820a88bbb9a1ad68/users/28f7d3e6ba83495b848fb1348c27bc47` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:59.553253 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2629/5282] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:46:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:59.553657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd88ff-9b73-4fdb-bc91-4bdd9607a017 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:59.554599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e860cb-2c16-4bfd-aeb5-bce3c313a21e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=643e85801c384ab0820a88bbb9a1ad68, user_id=28f7d3e6ba83495b848fb1348c27bc47)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:59.556385 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-43e860cb-2c16-4bfd-aeb5-bce3c313a21e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:46:59.556385 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:46:59.556385 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:46:59.561638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e860cb-2c16-4bfd-aeb5-bce3c313a21e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:59.572571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd88ff-9b73-4fdb-bc91-4bdd9607a017 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:46:59.583351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae17bf-52b4-40eb-8a91-d96aa3de9bf0 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c1e257c4a4468b81c7d4b9bf8735ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975651c9e106415da336a1786d5e1717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:46:59.584059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae17bf-52b4-40eb-8a91-d96aa3de9bf0 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:46:59.584288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae17bf-52b4-40eb-8a91-d96aa3de9bf0 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:46:59.584569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae17bf-52b4-40eb-8a91-d96aa3de9bf0 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] PATH_INFO: `/v3/users/57c1e257c4a4468b81c7d4b9bf8735ed/application_credentials` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:46:59.585248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae17bf-52b4-40eb-8a91-d96aa3de9bf0 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: Authorizing `identity:create_application_credential(user_id=57c1e257c4a4468b81c7d4b9bf8735ed)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:46:59.586441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae17bf-52b4-40eb-8a91-d96aa3de9bf0 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:46:59.644052 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-43e860cb-2c16-4bfd-aeb5-bce3c313a21e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '28f7d3e6ba83495b848fb1348c27bc47'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:46:59.685869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:59.844314 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2654/5283] 10.222.0.20 () {58 vars in 1344 bytes} [Thu Oct 27 03:46:59 2022] DELETE /identity/v3/groups/643e85801c384ab0820a88bbb9a1ad68/users/28f7d3e6ba83495b848fb1348c27bc47 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:46:59.846129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e860cb-2c16-4bfd-aeb5-bce3c313a21e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:59.891451 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2630/5284] 10.222.0.20 () {60 vars in 1315 bytes} [Thu Oct 27 03:46:59 2022] POST /identity/v3/users/57c1e257c4a4468b81c7d4b9bf8735ed/application_credentials => generated 921 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:46:59.892728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae17bf-52b4-40eb-8a91-d96aa3de9bf0 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:46:59.918711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae17bf-52b4-40eb-8a91-d96aa3de9bf0 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:00.022236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e860cb-2c16-4bfd-aeb5-bce3c313a21e tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:00.035883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfb012-8cf2-46a6-a622-ed26ae2716b6 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:00.037256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfb012-8cf2-46a6-a622-ed26ae2716b6 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:00.042568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfb012-8cf2-46a6-a622-ed26ae2716b6 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:00.045232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfb012-8cf2-46a6-a622-ed26ae2716b6 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups/643e85801c384ab0820a88bbb9a1ad68/users/b4d102cfd0d84052bdbf8fe8c394f490` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:00.058987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668a763-73eb-43c6-9522-db77d9d41bf6 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c1e257c4a4468b81c7d4b9bf8735ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975651c9e106415da336a1786d5e1717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:00.059956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668a763-73eb-43c6-9522-db77d9d41bf6 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:00.061051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668a763-73eb-43c6-9522-db77d9d41bf6 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:00.062994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668a763-73eb-43c6-9522-db77d9d41bf6 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] PATH_INFO: `/v3/users/57c1e257c4a4468b81c7d4b9bf8735ed/access_rules` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:00.063767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfb012-8cf2-46a6-a622-ed26ae2716b6 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=643e85801c384ab0820a88bbb9a1ad68, user_id=b4d102cfd0d84052bdbf8fe8c394f490)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:00.067694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668a763-73eb-43c6-9522-db77d9d41bf6 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: Authorizing `identity:list_access_rules(user_id=57c1e257c4a4468b81c7d4b9bf8735ed)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:00.073551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfb012-8cf2-46a6-a622-ed26ae2716b6 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:00.073728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668a763-73eb-43c6-9522-db77d9d41bf6 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:00.091745 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2631/5285] 10.222.0.20 () {58 vars in 1260 bytes} [Thu Oct 27 03:46:59 2022] GET /identity/v3/users/57c1e257c4a4468b81c7d4b9bf8735ed/access_rules => generated 369 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:00.092769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668a763-73eb-43c6-9522-db77d9d41bf6 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:00.111800 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2655/5286] 10.222.0.20 () {58 vars in 1342 bytes} [Thu Oct 27 03:46:59 2022] HEAD /identity/v3/groups/643e85801c384ab0820a88bbb9a1ad68/users/b4d102cfd0d84052bdbf8fe8c394f490 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:00.115724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfb012-8cf2-46a6-a622-ed26ae2716b6 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:00.116988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668a763-73eb-43c6-9522-db77d9d41bf6 tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:00.137653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c08d8-b80d-478b-b9de-15183fe6711e tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c1e257c4a4468b81c7d4b9bf8735ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975651c9e106415da336a1786d5e1717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:00.137653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c08d8-b80d-478b-b9de-15183fe6711e tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:00.137653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c08d8-b80d-478b-b9de-15183fe6711e tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:00.138026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c08d8-b80d-478b-b9de-15183fe6711e tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] PATH_INFO: `/v3/users/57c1e257c4a4468b81c7d4b9bf8735ed/application_credentials` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:00.138026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c08d8-b80d-478b-b9de-15183fe6711e tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: Authorizing `identity:create_application_credential(user_id=57c1e257c4a4468b81c7d4b9bf8735ed)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:00.138234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfb012-8cf2-46a6-a622-ed26ae2716b6 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:00.138683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c08d8-b80d-478b-b9de-15183fe6711e tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:00.148378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0129c-0c48-4d93-99f8-6f2897ab7b53 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:00.148378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0129c-0c48-4d93-99f8-6f2897ab7b53 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:00.148378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0129c-0c48-4d93-99f8-6f2897ab7b53 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:00.148817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0129c-0c48-4d93-99f8-6f2897ab7b53 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups/643e85801c384ab0820a88bbb9a1ad68/users/b4d102cfd0d84052bdbf8fe8c394f490` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:00.154854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0129c-0c48-4d93-99f8-6f2897ab7b53 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=643e85801c384ab0820a88bbb9a1ad68, user_id=b4d102cfd0d84052bdbf8fe8c394f490)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:00.155096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0129c-0c48-4d93-99f8-6f2897ab7b53 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:00.278925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-43e0129c-0c48-4d93-99f8-6f2897ab7b53 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'b4d102cfd0d84052bdbf8fe8c394f490'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:00.376560 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2656/5287] 10.222.0.20 () {58 vars in 1344 bytes} [Thu Oct 27 03:47:00 2022] DELETE /identity/v3/groups/643e85801c384ab0820a88bbb9a1ad68/users/b4d102cfd0d84052bdbf8fe8c394f490 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:47:00.380991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0129c-0c48-4d93-99f8-6f2897ab7b53 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:00.401385 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2632/5288] 10.222.0.20 () {60 vars in 1315 bytes} [Thu Oct 27 03:47:00 2022] POST /identity/v3/users/57c1e257c4a4468b81c7d4b9bf8735ed/application_credentials => generated 921 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:00.406262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c08d8-b80d-478b-b9de-15183fe6711e tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:00.430954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c08d8-b80d-478b-b9de-15183fe6711e tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:00.584948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7601070-0a91-451d-ac73-478f8822fc7e tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c1e257c4a4468b81c7d4b9bf8735ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975651c9e106415da336a1786d5e1717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:00.585663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7601070-0a91-451d-ac73-478f8822fc7e tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:00.585950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7601070-0a91-451d-ac73-478f8822fc7e tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:00.586260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7601070-0a91-451d-ac73-478f8822fc7e tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] PATH_INFO: `/v3/users/57c1e257c4a4468b81c7d4b9bf8735ed/access_rules/8dab57106f2d49dc8e35db2489410c01` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:00.587428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7601070-0a91-451d-ac73-478f8822fc7e tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: Authorizing `identity:get_access_rule(user_id=57c1e257c4a4468b81c7d4b9bf8735ed, access_rule_id=8dab57106f2d49dc8e35db2489410c01)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:00.588950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7601070-0a91-451d-ac73-478f8822fc7e tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:00.603970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0129c-0c48-4d93-99f8-6f2897ab7b53 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:00.610689 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2633/5289] 10.222.0.20 () {58 vars in 1359 bytes} [Thu Oct 27 03:47:00 2022] GET /identity/v3/users/57c1e257c4a4468b81c7d4b9bf8735ed/access_rules/8dab57106f2d49dc8e35db2489410c01 => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:00.615297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7601070-0a91-451d-ac73-478f8822fc7e tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:00.617386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a7601070-0a91-451d-ac73-478f8822fc7e tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:00.617847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de61b3a-a523-4ad4-a98c-6193059226e2 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:00.618566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de61b3a-a523-4ad4-a98c-6193059226e2 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:00.618853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de61b3a-a523-4ad4-a98c-6193059226e2 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:00.619134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de61b3a-a523-4ad4-a98c-6193059226e2 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups/643e85801c384ab0820a88bbb9a1ad68/users/675d30ff2dfb4822b2ff049033677c18` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:00.625704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de61b3a-a523-4ad4-a98c-6193059226e2 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=643e85801c384ab0820a88bbb9a1ad68, user_id=675d30ff2dfb4822b2ff049033677c18)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:00.629446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de61b3a-a523-4ad4-a98c-6193059226e2 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:00.654659 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2657/5290] 10.222.0.20 () {58 vars in 1342 bytes} [Thu Oct 27 03:47:00 2022] HEAD /identity/v3/groups/643e85801c384ab0820a88bbb9a1ad68/users/675d30ff2dfb4822b2ff049033677c18 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:00.659385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de61b3a-a523-4ad4-a98c-6193059226e2 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:00.685835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de61b3a-a523-4ad4-a98c-6193059226e2 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:00.712302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616f98f-0792-403e-bd08-2ddba47cfee4 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:00.713317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616f98f-0792-403e-bd08-2ddba47cfee4 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:00.716399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616f98f-0792-403e-bd08-2ddba47cfee4 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:00.716399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616f98f-0792-403e-bd08-2ddba47cfee4 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups/643e85801c384ab0820a88bbb9a1ad68/users/675d30ff2dfb4822b2ff049033677c18` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:00.721404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616f98f-0792-403e-bd08-2ddba47cfee4 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=643e85801c384ab0820a88bbb9a1ad68, user_id=675d30ff2dfb4822b2ff049033677c18)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:00.725283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616f98f-0792-403e-bd08-2ddba47cfee4 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:00.736784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7601070-0a91-451d-ac73-478f8822fc7e tempest-AccessRulesV3Test-1297731616 tempest-AccessRulesV3Test-1297731616-project] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:00.746546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d54ae7-1fa5-4eed-897b-7389678fbcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:00.746546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d54ae7-1fa5-4eed-897b-7389678fbcf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:00.746546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d54ae7-1fa5-4eed-897b-7389678fbcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:00.747036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d54ae7-1fa5-4eed-897b-7389678fbcf4 admin admin] PATH_INFO: `/v3/users/57c1e257c4a4468b81c7d4b9bf8735ed` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:00.748421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d54ae7-1fa5-4eed-897b-7389678fbcf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57c1e257c4a4468b81c7d4b9bf8735ed)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:00.751601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d54ae7-1fa5-4eed-897b-7389678fbcf4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:00.883991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0616f98f-0792-403e-bd08-2ddba47cfee4 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '675d30ff2dfb4822b2ff049033677c18'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:00.996158 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2658/5291] 10.222.0.20 () {58 vars in 1344 bytes} [Thu Oct 27 03:47:00 2022] DELETE /identity/v3/groups/643e85801c384ab0820a88bbb9a1ad68/users/675d30ff2dfb4822b2ff049033677c18 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:00.997652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616f98f-0792-403e-bd08-2ddba47cfee4 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:01.110976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-27d54ae7-1fa5-4eed-897b-7389678fbcf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57c1e257c4a4468b81c7d4b9bf8735ed'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:01.112867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-27d54ae7-1fa5-4eed-897b-7389678fbcf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57c1e257c4a4468b81c7d4b9bf8735ed'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:01.133283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-27d54ae7-1fa5-4eed-897b-7389678fbcf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57c1e257c4a4468b81c7d4b9bf8735ed'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:01.193207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616f98f-0792-403e-bd08-2ddba47cfee4 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:01.221157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94967a-5f3a-487f-aa52-22a9edf723cb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:01.224503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94967a-5f3a-487f-aa52-22a9edf723cb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:01.225779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94967a-5f3a-487f-aa52-22a9edf723cb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:01.226373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94967a-5f3a-487f-aa52-22a9edf723cb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups/643e85801c384ab0820a88bbb9a1ad68/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:01.230444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94967a-5f3a-487f-aa52-22a9edf723cb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=643e85801c384ab0820a88bbb9a1ad68)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:01.236833 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-1e94967a-5f3a-487f-aa52-22a9edf723cb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:01.236833 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:47:01.236833 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:47:01.238805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94967a-5f3a-487f-aa52-22a9edf723cb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:01.278117 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2659/5292] 10.222.0.20 () {58 vars in 1242 bytes} [Thu Oct 27 03:47:00 2022] GET /identity/v3/groups/643e85801c384ab0820a88bbb9a1ad68/users => generated 145 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:01.280448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94967a-5f3a-487f-aa52-22a9edf723cb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:01.286228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1e94967a-5f3a-487f-aa52-22a9edf723cb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:01.400111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-27d54ae7-1fa5-4eed-897b-7389678fbcf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57c1e257c4a4468b81c7d4b9bf8735ed'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:01.425056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94967a-5f3a-487f-aa52-22a9edf723cb tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:01.436574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f094b-7fe4-4617-8bbf-503fa1263bd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:01.437578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f094b-7fe4-4617-8bbf-503fa1263bd4 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:01.438124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f094b-7fe4-4617-8bbf-503fa1263bd4 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:01.438588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f094b-7fe4-4617-8bbf-503fa1263bd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:01.446434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-151f094b-7fe4-4617-8bbf-503fa1263bd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:01.480696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f094b-7fe4-4617-8bbf-503fa1263bd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:01.482361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f094b-7fe4-4617-8bbf-503fa1263bd4 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:01.519902 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2660/5293] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:01.520933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f094b-7fe4-4617-8bbf-503fa1263bd4 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:01.524957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-151f094b-7fe4-4617-8bbf-503fa1263bd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:01.572265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f094b-7fe4-4617-8bbf-503fa1263bd4 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:01.583625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-27d54ae7-1fa5-4eed-897b-7389678fbcf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57c1e257c4a4468b81c7d4b9bf8735ed'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:01.595072 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2634/5294] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:00 2022] DELETE /identity/v3/users/57c1e257c4a4468b81c7d4b9bf8735ed => generated 0 bytes in 980 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:47:01.599829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e4ffc-bfad-4f10-af43-fa9bd3b89f1d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:01.599986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e4ffc-bfad-4f10-af43-fa9bd3b89f1d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:01.600328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e4ffc-bfad-4f10-af43-fa9bd3b89f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:01.601842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d84dd-16ad-4ca9-8140-5c59d96c0a72 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:01.602538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d84dd-16ad-4ca9-8140-5c59d96c0a72 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:01.602827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d84dd-16ad-4ca9-8140-5c59d96c0a72 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:01.603115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d84dd-16ad-4ca9-8140-5c59d96c0a72 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/users/675d30ff2dfb4822b2ff049033677c18` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:01.604769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d84dd-16ad-4ca9-8140-5c59d96c0a72 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:delete_user(user_id=675d30ff2dfb4822b2ff049033677c18)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:01.606663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d84dd-16ad-4ca9-8140-5c59d96c0a72 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:01.633951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4f7e4ffc-bfad-4f10-af43-fa9bd3b89f1d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:01.638014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4f7e4ffc-bfad-4f10-af43-fa9bd3b89f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:01.789382 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2635/5295] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:01.794627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e4ffc-bfad-4f10-af43-fa9bd3b89f1d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:01.796943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4f7e4ffc-bfad-4f10-af43-fa9bd3b89f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:01.816442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e4ffc-bfad-4f10-af43-fa9bd3b89f1d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:01.831990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062ecd6-a884-4052-8028-a9d260e36223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:01.832744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062ecd6-a884-4052-8028-a9d260e36223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:01.837632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062ecd6-a884-4052-8028-a9d260e36223 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:01.837632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062ecd6-a884-4052-8028-a9d260e36223 admin admin] PATH_INFO: `/v3/projects/f259bc4753e842eb9951bd4a0867a599` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:01.838567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062ecd6-a884-4052-8028-a9d260e36223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f259bc4753e842eb9951bd4a0867a599)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:01.840705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062ecd6-a884-4052-8028-a9d260e36223 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:01.930424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:01.976646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a01d84dd-16ad-4ca9-8140-5c59d96c0a72 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '675d30ff2dfb4822b2ff049033677c18'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:01.977744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a01d84dd-16ad-4ca9-8140-5c59d96c0a72 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '675d30ff2dfb4822b2ff049033677c18'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:01.997014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a01d84dd-16ad-4ca9-8140-5c59d96c0a72 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '675d30ff2dfb4822b2ff049033677c18'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:02.027508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a01d84dd-16ad-4ca9-8140-5c59d96c0a72 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '675d30ff2dfb4822b2ff049033677c18'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:02.027726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:02.028251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a01d84dd-16ad-4ca9-8140-5c59d96c0a72 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '675d30ff2dfb4822b2ff049033677c18'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:02.046965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9062ecd6-a884-4052-8028-a9d260e36223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f259bc4753e842eb9951bd4a0867a599', 'request_id': 'req-9062ecd6-a884-4052-8028-a9d260e36223'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:02.128891 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2661/5296] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:01 2022] DELETE /identity/v3/users/675d30ff2dfb4822b2ff049033677c18 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:02.132504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d84dd-16ad-4ca9-8140-5c59d96c0a72 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:02.137514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a01d84dd-16ad-4ca9-8140-5c59d96c0a72 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:02.207058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9062ecd6-a884-4052-8028-a9d260e36223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f259bc4753e842eb9951bd4a0867a599', 'request_id': 'req-9062ecd6-a884-4052-8028-a9d260e36223'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:02.216583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9062ecd6-a884-4052-8028-a9d260e36223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f259bc4753e842eb9951bd4a0867a599', 'request_id': 'req-9062ecd6-a884-4052-8028-a9d260e36223'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:02.250800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9062ecd6-a884-4052-8028-a9d260e36223 admin admin] The token cache is being invalidate because project f259bc4753e842eb9951bd4a0867a599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:02.251374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9062ecd6-a884-4052-8028-a9d260e36223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:02.253162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9062ecd6-a884-4052-8028-a9d260e36223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:02.258631 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2636/5297] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:01 2022] DELETE /identity/v3/projects/f259bc4753e842eb9951bd4a0867a599 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:47:02.258631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062ecd6-a884-4052-8028-a9d260e36223 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:02.267006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9062ecd6-a884-4052-8028-a9d260e36223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:02.276394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d84dd-16ad-4ca9-8140-5c59d96c0a72 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:02.287224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba17ae-8fe1-49e9-8450-3940d3357428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:02.288985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba17ae-8fe1-49e9-8450-3940d3357428 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:02.288985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba17ae-8fe1-49e9-8450-3940d3357428 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:02.289619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba17ae-8fe1-49e9-8450-3940d3357428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:02.292076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-13ba17ae-8fe1-49e9-8450-3940d3357428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:02.382879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba17ae-8fe1-49e9-8450-3940d3357428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:02.384425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba17ae-8fe1-49e9-8450-3940d3357428 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:02.397773 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2662/5298] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:02.399053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba17ae-8fe1-49e9-8450-3940d3357428 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:02.400887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-13ba17ae-8fe1-49e9-8450-3940d3357428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:02.416324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba17ae-8fe1-49e9-8450-3940d3357428 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:02.423202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede92454-dfdf-4004-b489-c981e91fe17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:02.427215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede92454-dfdf-4004-b489-c981e91fe17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:02.427415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede92454-dfdf-4004-b489-c981e91fe17f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:02.427522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede92454-dfdf-4004-b489-c981e91fe17f admin admin] PATH_INFO: `/v3/users/c01cd548b4924d9ca76e148a0c73e018` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:02.429327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede92454-dfdf-4004-b489-c981e91fe17f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c01cd548b4924d9ca76e148a0c73e018)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:02.432789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062ecd6-a884-4052-8028-a9d260e36223 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:02.437575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede92454-dfdf-4004-b489-c981e91fe17f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:02.528137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc56def-6372-4b48-bf02-14c3965ea551 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:02.529040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc56def-6372-4b48-bf02-14c3965ea551 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:02.529333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc56def-6372-4b48-bf02-14c3965ea551 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:02.529614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc56def-6372-4b48-bf02-14c3965ea551 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/users/b4d102cfd0d84052bdbf8fe8c394f490` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:02.531648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc56def-6372-4b48-bf02-14c3965ea551 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b4d102cfd0d84052bdbf8fe8c394f490)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:02.534086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc56def-6372-4b48-bf02-14c3965ea551 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:02.761855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3bc56def-6372-4b48-bf02-14c3965ea551 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4d102cfd0d84052bdbf8fe8c394f490'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:02.764808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3bc56def-6372-4b48-bf02-14c3965ea551 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4d102cfd0d84052bdbf8fe8c394f490'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:02.787049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3bc56def-6372-4b48-bf02-14c3965ea551 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4d102cfd0d84052bdbf8fe8c394f490'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:02.825162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3bc56def-6372-4b48-bf02-14c3965ea551 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4d102cfd0d84052bdbf8fe8c394f490'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:02.877722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ede92454-dfdf-4004-b489-c981e91fe17f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c01cd548b4924d9ca76e148a0c73e018'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:02.881840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ede92454-dfdf-4004-b489-c981e91fe17f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c01cd548b4924d9ca76e148a0c73e018'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:02.905100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ede92454-dfdf-4004-b489-c981e91fe17f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c01cd548b4924d9ca76e148a0c73e018'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:02.923216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3bc56def-6372-4b48-bf02-14c3965ea551 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4d102cfd0d84052bdbf8fe8c394f490'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:02.945007 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2637/5299] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:02 2022] DELETE /identity/v3/users/b4d102cfd0d84052bdbf8fe8c394f490 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:02.949173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc56def-6372-4b48-bf02-14c3965ea551 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:02.955257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3bc56def-6372-4b48-bf02-14c3965ea551 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:02.957369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ede92454-dfdf-4004-b489-c981e91fe17f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c01cd548b4924d9ca76e148a0c73e018'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:02.958392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ede92454-dfdf-4004-b489-c981e91fe17f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c01cd548b4924d9ca76e148a0c73e018'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:03.075714 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2663/5300] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:02 2022] DELETE /identity/v3/users/c01cd548b4924d9ca76e148a0c73e018 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:03.136401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc56def-6372-4b48-bf02-14c3965ea551 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:03.275048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede92454-dfdf-4004-b489-c981e91fe17f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:03.276709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ede92454-dfdf-4004-b489-c981e91fe17f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:03.414052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05e728-0b0e-4e2f-a1f4-584eb1e949b5 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:03.417043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05e728-0b0e-4e2f-a1f4-584eb1e949b5 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:03.418490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05e728-0b0e-4e2f-a1f4-584eb1e949b5 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:03.418782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05e728-0b0e-4e2f-a1f4-584eb1e949b5 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/users/28f7d3e6ba83495b848fb1348c27bc47` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:03.422565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05e728-0b0e-4e2f-a1f4-584eb1e949b5 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:delete_user(user_id=28f7d3e6ba83495b848fb1348c27bc47)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:03.424878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05e728-0b0e-4e2f-a1f4-584eb1e949b5 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:03.476624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede92454-dfdf-4004-b489-c981e91fe17f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:03.490073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e4627-9bfb-431b-a220-8b4a5ed66e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:03.491020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e4627-9bfb-431b-a220-8b4a5ed66e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:03.491624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e4627-9bfb-431b-a220-8b4a5ed66e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:03.492316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e4627-9bfb-431b-a220-8b4a5ed66e91 admin admin] PATH_INFO: `/v3/projects/975651c9e106415da336a1786d5e1717` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:03.493773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e4627-9bfb-431b-a220-8b4a5ed66e91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=975651c9e106415da336a1786d5e1717)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:03.497980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e4627-9bfb-431b-a220-8b4a5ed66e91 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:03.580349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7b05e728-0b0e-4e2f-a1f4-584eb1e949b5 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28f7d3e6ba83495b848fb1348c27bc47'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:03.582408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7b05e728-0b0e-4e2f-a1f4-584eb1e949b5 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28f7d3e6ba83495b848fb1348c27bc47'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:03.604239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7b05e728-0b0e-4e2f-a1f4-584eb1e949b5 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28f7d3e6ba83495b848fb1348c27bc47'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:03.629219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7b05e728-0b0e-4e2f-a1f4-584eb1e949b5 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28f7d3e6ba83495b848fb1348c27bc47'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:03.741107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7b05e728-0b0e-4e2f-a1f4-584eb1e949b5 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28f7d3e6ba83495b848fb1348c27bc47'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:03.758755 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2638/5301] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:02 2022] DELETE /identity/v3/users/28f7d3e6ba83495b848fb1348c27bc47 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:03.758755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05e728-0b0e-4e2f-a1f4-584eb1e949b5 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:03.758755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7b05e728-0b0e-4e2f-a1f4-584eb1e949b5 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:03.790544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bf0e4627-9bfb-431b-a220-8b4a5ed66e91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '975651c9e106415da336a1786d5e1717', 'request_id': 'req-bf0e4627-9bfb-431b-a220-8b4a5ed66e91'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:03.805700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bf0e4627-9bfb-431b-a220-8b4a5ed66e91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '975651c9e106415da336a1786d5e1717', 'request_id': 'req-bf0e4627-9bfb-431b-a220-8b4a5ed66e91'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:03.821302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bf0e4627-9bfb-431b-a220-8b4a5ed66e91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '975651c9e106415da336a1786d5e1717', 'request_id': 'req-bf0e4627-9bfb-431b-a220-8b4a5ed66e91'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:03.901107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05e728-0b0e-4e2f-a1f4-584eb1e949b5 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:03.907635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bf0e4627-9bfb-431b-a220-8b4a5ed66e91 admin admin] The token cache is being invalidate because project 975651c9e106415da336a1786d5e1717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:03.908523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bf0e4627-9bfb-431b-a220-8b4a5ed66e91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:03.910118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bf0e4627-9bfb-431b-a220-8b4a5ed66e91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:03.911335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20e742-55be-4fa8-b533-c2bd6e5648d4 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:03.912369 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2664/5302] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:03 2022] DELETE /identity/v3/projects/975651c9e106415da336a1786d5e1717 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:03.914599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e4627-9bfb-431b-a220-8b4a5ed66e91 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:03.916758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bf0e4627-9bfb-431b-a220-8b4a5ed66e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:03.916997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20e742-55be-4fa8-b533-c2bd6e5648d4 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:03.917397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20e742-55be-4fa8-b533-c2bd6e5648d4 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:03.917798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20e742-55be-4fa8-b533-c2bd6e5648d4 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups/643e85801c384ab0820a88bbb9a1ad68` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:03.919329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20e742-55be-4fa8-b533-c2bd6e5648d4 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:delete_group(group_id=643e85801c384ab0820a88bbb9a1ad68)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:03.922418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20e742-55be-4fa8-b533-c2bd6e5648d4 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:03.953729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:04.051973 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2639/5303] 10.222.0.20 () {58 vars in 1227 bytes} [Thu Oct 27 03:47:03 2022] DELETE /identity/v3/groups/643e85801c384ab0820a88bbb9a1ad68 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:04.055241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e4627-9bfb-431b-a220-8b4a5ed66e91 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:04.056493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cfb7c-a4ab-40fa-9121-5c8fe2045b9f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:04.057098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cfb7c-a4ab-40fa-9121-5c8fe2045b9f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:04.057362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cfb7c-a4ab-40fa-9121-5c8fe2045b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:04.093788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:04.104435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0c9cfb7c-a4ab-40fa-9121-5c8fe2045b9f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:04.106658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0c9cfb7c-a4ab-40fa-9121-5c8fe2045b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:04.173296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e20137-a839-44b1-8a32-945788f7a3ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:04.173948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e20137-a839-44b1-8a32-945788f7a3ac service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:04.174268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e20137-a839-44b1-8a32-945788f7a3ac service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:04.174543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e20137-a839-44b1-8a32-945788f7a3ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:04.179706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-50e20137-a839-44b1-8a32-945788f7a3ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:04.202997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e20137-a839-44b1-8a32-945788f7a3ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:04.205786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e20137-a839-44b1-8a32-945788f7a3ac service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:04.230209 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2640/5304] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:04.231674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cfb7c-a4ab-40fa-9121-5c8fe2045b9f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:04.234013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0c9cfb7c-a4ab-40fa-9121-5c8fe2045b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:04.240707 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2665/5305] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:04.263578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333803e-41aa-4d48-8991-21fd911606b9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:04.265742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333803e-41aa-4d48-8991-21fd911606b9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:04.266543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333803e-41aa-4d48-8991-21fd911606b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:04.386345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d333803e-41aa-4d48-8991-21fd911606b9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:04.396734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d333803e-41aa-4d48-8991-21fd911606b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:04.437787 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2666/5306] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:04.437787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333803e-41aa-4d48-8991-21fd911606b9 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:04.448507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d333803e-41aa-4d48-8991-21fd911606b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:04.454927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cfb7c-a4ab-40fa-9121-5c8fe2045b9f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:04.466062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7010e18-7cd0-44c3-bb40-e90157c0937f tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:04.466928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7010e18-7cd0-44c3-bb40-e90157c0937f tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:04.467046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7010e18-7cd0-44c3-bb40-e90157c0937f tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:04.467334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7010e18-7cd0-44c3-bb40-e90157c0937f tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:04.469908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7010e18-7cd0-44c3-bb40-e90157c0937f tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:04.485242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7010e18-7cd0-44c3-bb40-e90157c0937f tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:04.509542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333803e-41aa-4d48-8991-21fd911606b9 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:04.537236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08953bf2-78e5-4b7f-90e1-6709c70bc4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:04.538171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08953bf2-78e5-4b7f-90e1-6709c70bc4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:04.538454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08953bf2-78e5-4b7f-90e1-6709c70bc4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:04.538786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08953bf2-78e5-4b7f-90e1-6709c70bc4d4 admin admin] PATH_INFO: `/v3/projects/76fcb82a896849ea833237c77b1cf554` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:04.542397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08953bf2-78e5-4b7f-90e1-6709c70bc4d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76fcb82a896849ea833237c77b1cf554)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:04.548085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08953bf2-78e5-4b7f-90e1-6709c70bc4d4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:04.579065 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2641/5307] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:47:04 2022] POST /identity/v3/groups => generated 325 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:04.579869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7010e18-7cd0-44c3-bb40-e90157c0937f tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:04.606791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7010e18-7cd0-44c3-bb40-e90157c0937f tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:04.619281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fde38-9c83-4e5c-b965-19e372a6d490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:04.620024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fde38-9c83-4e5c-b965-19e372a6d490 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:04.620388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fde38-9c83-4e5c-b965-19e372a6d490 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:04.620749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fde38-9c83-4e5c-b965-19e372a6d490 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:04.623269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fde38-9c83-4e5c-b965-19e372a6d490 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:47:04.623269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fde38-9c83-4e5c-b965-19e372a6d490 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:04.631943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fde38-9c83-4e5c-b965-19e372a6d490 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:04.666793 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2642/5308] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:04.666793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fde38-9c83-4e5c-b965-19e372a6d490 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:04.691225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fde38-9c83-4e5c-b965-19e372a6d490 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:04.717293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07432d44-4ddb-4d7e-99ea-e51082f371b7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:04.719089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07432d44-4ddb-4d7e-99ea-e51082f371b7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:04.719596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07432d44-4ddb-4d7e-99ea-e51082f371b7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:04.726618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07432d44-4ddb-4d7e-99ea-e51082f371b7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:04.728020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07432d44-4ddb-4d7e-99ea-e51082f371b7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:04.733430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07432d44-4ddb-4d7e-99ea-e51082f371b7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:04.784691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-08953bf2-78e5-4b7f-90e1-6709c70bc4d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76fcb82a896849ea833237c77b1cf554', 'request_id': 'req-08953bf2-78e5-4b7f-90e1-6709c70bc4d4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:04.798768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-08953bf2-78e5-4b7f-90e1-6709c70bc4d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76fcb82a896849ea833237c77b1cf554', 'request_id': 'req-08953bf2-78e5-4b7f-90e1-6709c70bc4d4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:04.817210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-08953bf2-78e5-4b7f-90e1-6709c70bc4d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76fcb82a896849ea833237c77b1cf554', 'request_id': 'req-08953bf2-78e5-4b7f-90e1-6709c70bc4d4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:04.842250 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2643/5309] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:47:04 2022] POST /identity/v3/groups => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:04.843653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07432d44-4ddb-4d7e-99ea-e51082f371b7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:04.870816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07432d44-4ddb-4d7e-99ea-e51082f371b7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:04.916151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-08953bf2-78e5-4b7f-90e1-6709c70bc4d4 admin admin] The token cache is being invalidate because project 76fcb82a896849ea833237c77b1cf554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:04.917098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-08953bf2-78e5-4b7f-90e1-6709c70bc4d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:04.917651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-08953bf2-78e5-4b7f-90e1-6709c70bc4d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:04.920674 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2667/5310] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:04 2022] DELETE /identity/v3/projects/76fcb82a896849ea833237c77b1cf554 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:04.923454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08953bf2-78e5-4b7f-90e1-6709c70bc4d4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:04.928074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-08953bf2-78e5-4b7f-90e1-6709c70bc4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:05.031464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0710022-daa9-4061-84ac-50356757b0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:05.032078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0710022-daa9-4061-84ac-50356757b0d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:05.032362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0710022-daa9-4061-84ac-50356757b0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:05.032636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0710022-daa9-4061-84ac-50356757b0d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:05.033280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0710022-daa9-4061-84ac-50356757b0d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:05.039757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0710022-daa9-4061-84ac-50356757b0d1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:05.110761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08953bf2-78e5-4b7f-90e1-6709c70bc4d4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:05.148566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce53da-4a59-41c3-a454-64b3954603dd tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:05.149220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce53da-4a59-41c3-a454-64b3954603dd tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:05.149507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce53da-4a59-41c3-a454-64b3954603dd tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:05.149783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce53da-4a59-41c3-a454-64b3954603dd tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:05.150487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce53da-4a59-41c3-a454-64b3954603dd tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:05.161201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce53da-4a59-41c3-a454-64b3954603dd tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:05.214202 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2644/5311] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:47:04 2022] POST /identity/v3/projects => generated 375 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:05.215639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fa891-8758-440b-bcec-0777aac72825 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:05.215877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fa891-8758-440b-bcec-0777aac72825 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:05.216294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fa891-8758-440b-bcec-0777aac72825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:05.260041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f22fa891-8758-440b-bcec-0777aac72825 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:05.260041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f22fa891-8758-440b-bcec-0777aac72825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:05.284844 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2668/5312] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:47:04 2022] POST /identity/v3/groups => generated 326 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:05.288655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce53da-4a59-41c3-a454-64b3954603dd tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:05.292373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d8ce53da-4a59-41c3-a454-64b3954603dd tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:05.360051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce53da-4a59-41c3-a454-64b3954603dd tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:05.388149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:05.434246 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2645/5313] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:05.435187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fa891-8758-440b-bcec-0777aac72825 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:05.478198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09439bfa-91db-4d13-9883-46d302542b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:05.479657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09439bfa-91db-4d13-9883-46d302542b92 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:05.480157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09439bfa-91db-4d13-9883-46d302542b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:05.480942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09439bfa-91db-4d13-9883-46d302542b92 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:05.503687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09439bfa-91db-4d13-9883-46d302542b92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:05.507293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09439bfa-91db-4d13-9883-46d302542b92 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:05.527165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fa891-8758-440b-bcec-0777aac72825 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:05.534309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e729523-7320-42cd-93f6-2cf7650edef9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:05.535123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e729523-7320-42cd-93f6-2cf7650edef9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:05.535430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e729523-7320-42cd-93f6-2cf7650edef9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:05.535784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e729523-7320-42cd-93f6-2cf7650edef9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:05.536510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e729523-7320-42cd-93f6-2cf7650edef9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:05.537712 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-1e729523-7320-42cd-93f6-2cf7650edef9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:05.537712 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:47:05.537712 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:47:05.538978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e729523-7320-42cd-93f6-2cf7650edef9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:05.548428 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2646/5314] 10.222.0.20 () {58 vars in 1125 bytes} [Thu Oct 27 03:47:05 2022] GET /identity/v3/groups => generated 1488 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:05.552107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f8e4f-2f35-48a2-bc22-28128a57c5ab None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:05.556033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f8e4f-2f35-48a2-bc22-28128a57c5ab None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:05.556033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f8e4f-2f35-48a2-bc22-28128a57c5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:05.603150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ae9f8e4f-2f35-48a2-bc22-28128a57c5ab None None] MFA Rules not processed for user `b4dae167878b41699b8caae5a0386cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:05.604492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ae9f8e4f-2f35-48a2-bc22-28128a57c5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:05.634583 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2669/5315] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:47:05 2022] POST /identity/v3/users => generated 288 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:05.638682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de566c-223e-499b-807d-fb00e5eb78e8 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:05.638682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de566c-223e-499b-807d-fb00e5eb78e8 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:05.638682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de566c-223e-499b-807d-fb00e5eb78e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:05.659626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c7de566c-223e-499b-807d-fb00e5eb78e8 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:05.660546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c7de566c-223e-499b-807d-fb00e5eb78e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:05.672612 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2670/5316] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:05.673451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de566c-223e-499b-807d-fb00e5eb78e8 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:05.690388 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2647/5317] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:05 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:05.691807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de566c-223e-499b-807d-fb00e5eb78e8 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:05.698526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f8e4f-2f35-48a2-bc22-28128a57c5ab None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:05.698701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c756f39-be28-4f95-9866-6c1c9b3a8005 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:05.699228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c756f39-be28-4f95-9866-6c1c9b3a8005 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:05.700044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c756f39-be28-4f95-9866-6c1c9b3a8005 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:05.700513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c756f39-be28-4f95-9866-6c1c9b3a8005 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups/e492d0be2f2444059203714031061233` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:05.733077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f8e4f-2f35-48a2-bc22-28128a57c5ab None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:05.745727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c756f39-be28-4f95-9866-6c1c9b3a8005 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e492d0be2f2444059203714031061233)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:05.745855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218f0df-56e8-43d6-9786-a2b36a010597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:05.745855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218f0df-56e8-43d6-9786-a2b36a010597 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:05.745855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218f0df-56e8-43d6-9786-a2b36a010597 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:05.745855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218f0df-56e8-43d6-9786-a2b36a010597 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:05.746421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218f0df-56e8-43d6-9786-a2b36a010597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:05.746861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c756f39-be28-4f95-9866-6c1c9b3a8005 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:05.750953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218f0df-56e8-43d6-9786-a2b36a010597 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:05.773692 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2648/5318] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:05.774984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218f0df-56e8-43d6-9786-a2b36a010597 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:05.789880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218f0df-56e8-43d6-9786-a2b36a010597 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:05.797225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:05.798025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42af41-b26c-4b35-b8a1-e585992e83c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:05.798904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42af41-b26c-4b35-b8a1-e585992e83c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:05.799293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42af41-b26c-4b35-b8a1-e585992e83c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:05.799728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42af41-b26c-4b35-b8a1-e585992e83c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:05.800596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42af41-b26c-4b35-b8a1-e585992e83c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:47:05.800990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42af41-b26c-4b35-b8a1-e585992e83c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:05.802871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42af41-b26c-4b35-b8a1-e585992e83c9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:05.845669 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2649/5319] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:05.845669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05221d73-514c-4843-afa5-8754a7d1615c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:05.845669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05221d73-514c-4843-afa5-8754a7d1615c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:05.845669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05221d73-514c-4843-afa5-8754a7d1615c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:05.872340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-05221d73-514c-4843-afa5-8754a7d1615c None None] MFA Rules not processed for user `b4dae167878b41699b8caae5a0386cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:05.873853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-05221d73-514c-4843-afa5-8754a7d1615c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:05.883981 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2650/5320] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:05 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:05.893450 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2671/5321] 10.222.0.20 () {58 vars in 1227 bytes} [Thu Oct 27 03:47:05 2022] DELETE /identity/v3/groups/e492d0be2f2444059203714031061233 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:05.894787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05221d73-514c-4843-afa5-8754a7d1615c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:05.897848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c756f39-be28-4f95-9866-6c1c9b3a8005 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:05.922990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05221d73-514c-4843-afa5-8754a7d1615c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:06.018249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba199bc-36f9-4f25-8b81-cb190cc1c1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:06.018536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba199bc-36f9-4f25-8b81-cb190cc1c1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:06.018658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba199bc-36f9-4f25-8b81-cb190cc1c1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:06.018906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba199bc-36f9-4f25-8b81-cb190cc1c1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:06.019564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba199bc-36f9-4f25-8b81-cb190cc1c1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:06.021195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba199bc-36f9-4f25-8b81-cb190cc1c1f5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:06.038271 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2651/5322] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:06.040052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba199bc-36f9-4f25-8b81-cb190cc1c1f5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:06.043327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7ba199bc-36f9-4f25-8b81-cb190cc1c1f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:06.056227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c756f39-be28-4f95-9866-6c1c9b3a8005 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:06.073791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123c4dd-1997-4a1f-9f17-9614bbbc964a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:06.074622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123c4dd-1997-4a1f-9f17-9614bbbc964a admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:06.075010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123c4dd-1997-4a1f-9f17-9614bbbc964a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:06.075551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123c4dd-1997-4a1f-9f17-9614bbbc964a admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:06.076495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123c4dd-1997-4a1f-9f17-9614bbbc964a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:06.078894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123c4dd-1997-4a1f-9f17-9614bbbc964a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:06.196545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba199bc-36f9-4f25-8b81-cb190cc1c1f5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:06.204657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca27f49-5310-4c83-be56-e3ed41ed8daa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:06.205343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca27f49-5310-4c83-be56-e3ed41ed8daa service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:06.205630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca27f49-5310-4c83-be56-e3ed41ed8daa service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:06.205906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca27f49-5310-4c83-be56-e3ed41ed8daa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:06.263985 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2672/5323] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:47:05 2022] POST /identity/v3/projects => generated 367 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:06.265897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123c4dd-1997-4a1f-9f17-9614bbbc964a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:06.275326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca27f49-5310-4c83-be56-e3ed41ed8daa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:06.277041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca27f49-5310-4c83-be56-e3ed41ed8daa service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:06.316217 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2652/5324] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:06 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:06.318176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca27f49-5310-4c83-be56-e3ed41ed8daa service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:06.366926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca27f49-5310-4c83-be56-e3ed41ed8daa service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:06.419662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123c4dd-1997-4a1f-9f17-9614bbbc964a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:06.442312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3b716-14e7-4af1-b8ed-283caac764aa tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:06.443336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3b716-14e7-4af1-b8ed-283caac764aa tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:06.445012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3b716-14e7-4af1-b8ed-283caac764aa tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:06.445506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3b716-14e7-4af1-b8ed-283caac764aa tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups/08f402e745bc45f4bb14da2f8d8a4a3a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:06.457245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3b716-14e7-4af1-b8ed-283caac764aa tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:delete_group(group_id=08f402e745bc45f4bb14da2f8d8a4a3a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:06.463542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3b716-14e7-4af1-b8ed-283caac764aa tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:06.487962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e38ac7-1c99-43c2-98b4-9f9aa01f339a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:06.488832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e38ac7-1c99-43c2-98b4-9f9aa01f339a admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:06.489180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e38ac7-1c99-43c2-98b4-9f9aa01f339a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:06.489534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e38ac7-1c99-43c2-98b4-9f9aa01f339a admin admin] PATH_INFO: `/v3/projects/04394989e28241b483f436e61ac83691/users/19b926d6fb454a21b788dfdb2272e993/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:06.507506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e38ac7-1c99-43c2-98b4-9f9aa01f339a admin admin] RBAC: Authorizing `identity:create_grant(project_id=04394989e28241b483f436e61ac83691, user_id=19b926d6fb454a21b788dfdb2272e993, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:06.511268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e38ac7-1c99-43c2-98b4-9f9aa01f339a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:06.588859 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2653/5325] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:06 2022] PUT /identity/v3/projects/04394989e28241b483f436e61ac83691/users/19b926d6fb454a21b788dfdb2272e993/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:06.590066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e38ac7-1c99-43c2-98b4-9f9aa01f339a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:06.605328 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2673/5326] 10.222.0.20 () {58 vars in 1227 bytes} [Thu Oct 27 03:47:06 2022] DELETE /identity/v3/groups/08f402e745bc45f4bb14da2f8d8a4a3a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:06.606992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4997e-a820-48bd-a935-add395745d0b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:06.609545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4997e-a820-48bd-a935-add395745d0b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:06.609935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4997e-a820-48bd-a935-add395745d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:06.689745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-06f4997e-a820-48bd-a935-add395745d0b None None] MFA Rules not processed for user `19b926d6fb454a21b788dfdb2272e993`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:06.693016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-06f4997e-a820-48bd-a935-add395745d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:06.752556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e38ac7-1c99-43c2-98b4-9f9aa01f339a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:06.907870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724369a-99e9-4cd7-8e0e-e686476ff9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:06.908520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724369a-99e9-4cd7-8e0e-e686476ff9f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:06.908806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724369a-99e9-4cd7-8e0e-e686476ff9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:06.909087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724369a-99e9-4cd7-8e0e-e686476ff9f0 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:06.909740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724369a-99e9-4cd7-8e0e-e686476ff9f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:06.912167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724369a-99e9-4cd7-8e0e-e686476ff9f0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:07.035132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:07.048047 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2654/5327] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:47:06 2022] POST /identity/v3/users => generated 284 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:07.050140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724369a-99e9-4cd7-8e0e-e686476ff9f0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:07.125013 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2674/5328] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 519 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:07.126385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4997e-a820-48bd-a935-add395745d0b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:07.127893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-06f4997e-a820-48bd-a935-add395745d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:07.218555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724369a-99e9-4cd7-8e0e-e686476ff9f0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:07.230379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d63f3-a689-4438-88c6-7daca7448cf9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:07.231082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d63f3-a689-4438-88c6-7daca7448cf9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:07.231379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d63f3-a689-4438-88c6-7daca7448cf9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:07.232210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d63f3-a689-4438-88c6-7daca7448cf9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups/14413550bbc94d2297fa1d2ca1ecdd62` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:07.248342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d63f3-a689-4438-88c6-7daca7448cf9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:delete_group(group_id=14413550bbc94d2297fa1d2ca1ecdd62)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:07.251589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d63f3-a689-4438-88c6-7daca7448cf9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:07.264171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4997e-a820-48bd-a935-add395745d0b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:07.282648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd4d28-a43f-488c-908f-2642e72b30bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:07.283442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd4d28-a43f-488c-908f-2642e72b30bd service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:07.283738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd4d28-a43f-488c-908f-2642e72b30bd service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:07.284013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd4d28-a43f-488c-908f-2642e72b30bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:07.286093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7fdd4d28-a43f-488c-908f-2642e72b30bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:07.313038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd4d28-a43f-488c-908f-2642e72b30bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:07.315209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd4d28-a43f-488c-908f-2642e72b30bd service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:07.347816 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2675/5329] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:07.349070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd4d28-a43f-488c-908f-2642e72b30bd service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:07.361924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd4d28-a43f-488c-908f-2642e72b30bd service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:07.367586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42cc70-0b89-4e5e-a987-b53d8770b143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:07.371480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42cc70-0b89-4e5e-a987-b53d8770b143 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:07.371480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42cc70-0b89-4e5e-a987-b53d8770b143 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:07.371480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42cc70-0b89-4e5e-a987-b53d8770b143 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:07.371480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42cc70-0b89-4e5e-a987-b53d8770b143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:07.372088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42cc70-0b89-4e5e-a987-b53d8770b143 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:07.406608 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2676/5330] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:07.407541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42cc70-0b89-4e5e-a987-b53d8770b143 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:07.417002 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2655/5331] 10.222.0.20 () {58 vars in 1227 bytes} [Thu Oct 27 03:47:07 2022] DELETE /identity/v3/groups/14413550bbc94d2297fa1d2ca1ecdd62 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:07.419055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d63f3-a689-4438-88c6-7daca7448cf9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:07.435633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42cc70-0b89-4e5e-a987-b53d8770b143 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:07.557422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780c0ec-58dd-4f82-88ad-3af42470fa6d tempest-IdentityCatalogTest-1175727190 tempest-IdentityCatalogTest-1175727190-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19b926d6fb454a21b788dfdb2272e993', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04394989e28241b483f436e61ac83691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:07.558081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780c0ec-58dd-4f82-88ad-3af42470fa6d tempest-IdentityCatalogTest-1175727190 tempest-IdentityCatalogTest-1175727190-project] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:07.558367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780c0ec-58dd-4f82-88ad-3af42470fa6d tempest-IdentityCatalogTest-1175727190 tempest-IdentityCatalogTest-1175727190-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:07.558664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780c0ec-58dd-4f82-88ad-3af42470fa6d tempest-IdentityCatalogTest-1175727190 tempest-IdentityCatalogTest-1175727190-project] PATH_INFO: `/v3/auth/catalog` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:07.559254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780c0ec-58dd-4f82-88ad-3af42470fa6d tempest-IdentityCatalogTest-1175727190 tempest-IdentityCatalogTest-1175727190-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:07.560332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780c0ec-58dd-4f82-88ad-3af42470fa6d tempest-IdentityCatalogTest-1175727190 tempest-IdentityCatalogTest-1175727190-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:07.570277 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2677/5332] 10.222.0.20 () {58 vars in 1143 bytes} [Thu Oct 27 03:47:07 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:07.571416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780c0ec-58dd-4f82-88ad-3af42470fa6d tempest-IdentityCatalogTest-1175727190 tempest-IdentityCatalogTest-1175727190-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:07.633562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d63f3-a689-4438-88c6-7daca7448cf9 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:07.660042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a63104-7853-472c-8444-2f8dd5989b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:07.663275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a63104-7853-472c-8444-2f8dd5989b6a admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:07.665894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a63104-7853-472c-8444-2f8dd5989b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:07.666293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a63104-7853-472c-8444-2f8dd5989b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:07.670309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a63104-7853-472c-8444-2f8dd5989b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:07.680296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a63104-7853-472c-8444-2f8dd5989b6a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:07.712399 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2656/5333] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:07.714171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a63104-7853-472c-8444-2f8dd5989b6a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:07.738958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a63104-7853-472c-8444-2f8dd5989b6a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:07.750850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780c0ec-58dd-4f82-88ad-3af42470fa6d tempest-IdentityCatalogTest-1175727190 tempest-IdentityCatalogTest-1175727190-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:07.751578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae5271-df24-4d1e-9b72-e97951695164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:07.752570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae5271-df24-4d1e-9b72-e97951695164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:07.753245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae5271-df24-4d1e-9b72-e97951695164 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:07.754218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae5271-df24-4d1e-9b72-e97951695164 admin admin] PATH_INFO: `/v3/users/19b926d6fb454a21b788dfdb2272e993` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:07.756472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae5271-df24-4d1e-9b72-e97951695164 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19b926d6fb454a21b788dfdb2272e993)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:07.763703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae5271-df24-4d1e-9b72-e97951695164 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:07.780306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5c2b2-eab6-4cdf-a792-7d55751197db tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:07.783555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5c2b2-eab6-4cdf-a792-7d55751197db tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:07.785611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5c2b2-eab6-4cdf-a792-7d55751197db tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:07.792544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5c2b2-eab6-4cdf-a792-7d55751197db tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:07.792544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5c2b2-eab6-4cdf-a792-7d55751197db tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:07.795320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5c2b2-eab6-4cdf-a792-7d55751197db tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:07.803042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:07.936637 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2678/5334] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:47:07 2022] POST /identity/v3/users => generated 323 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:07.946441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5c2b2-eab6-4cdf-a792-7d55751197db tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:07.980228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5c2b2-eab6-4cdf-a792-7d55751197db tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:07.995869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59944ccf-3d5f-4330-9e61-5bab29b69024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:07.996449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59944ccf-3d5f-4330-9e61-5bab29b69024 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:07.996741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59944ccf-3d5f-4330-9e61-5bab29b69024 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:07.997019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59944ccf-3d5f-4330-9e61-5bab29b69024 admin admin] PATH_INFO: `/v3/projects/6aa971f3c0064d2ea2fc853b1679d128/users/0ccc048ad9414170a8c0e97d1b65938a/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:08.054080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59944ccf-3d5f-4330-9e61-5bab29b69024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa971f3c0064d2ea2fc853b1679d128, user_id=0ccc048ad9414170a8c0e97d1b65938a, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:08.057293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59944ccf-3d5f-4330-9e61-5bab29b69024 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:08.154334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6cae5271-df24-4d1e-9b72-e97951695164 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19b926d6fb454a21b788dfdb2272e993'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:08.158293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6cae5271-df24-4d1e-9b72-e97951695164 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19b926d6fb454a21b788dfdb2272e993'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:08.177685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6cae5271-df24-4d1e-9b72-e97951695164 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19b926d6fb454a21b788dfdb2272e993'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:08.209305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6cae5271-df24-4d1e-9b72-e97951695164 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19b926d6fb454a21b788dfdb2272e993'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:08.221628 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2679/5335] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:07 2022] PUT /identity/v3/projects/6aa971f3c0064d2ea2fc853b1679d128/users/0ccc048ad9414170a8c0e97d1b65938a/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:08.222418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59944ccf-3d5f-4330-9e61-5bab29b69024 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:08.224223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-59944ccf-3d5f-4330-9e61-5bab29b69024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:08.296424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59944ccf-3d5f-4330-9e61-5bab29b69024 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:08.301581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4652be5-d11f-4d64-8c5a-c9fd7fac6113 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:08.302259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4652be5-d11f-4d64-8c5a-c9fd7fac6113 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:08.302556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4652be5-d11f-4d64-8c5a-c9fd7fac6113 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:08.302841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4652be5-d11f-4d64-8c5a-c9fd7fac6113 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:08.303489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4652be5-d11f-4d64-8c5a-c9fd7fac6113 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:08.305511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4652be5-d11f-4d64-8c5a-c9fd7fac6113 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:08.341184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6cae5271-df24-4d1e-9b72-e97951695164 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19b926d6fb454a21b788dfdb2272e993'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:08.354851 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2657/5336] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:07 2022] DELETE /identity/v3/users/19b926d6fb454a21b788dfdb2272e993 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:08.361682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f983e7d-ad1d-4e78-a616-d8a6a65c0ef8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:08.361990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f983e7d-ad1d-4e78-a616-d8a6a65c0ef8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:08.362289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f983e7d-ad1d-4e78-a616-d8a6a65c0ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:08.407316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5f983e7d-ad1d-4e78-a616-d8a6a65c0ef8 None None] MFA Rules not processed for user `0ccc048ad9414170a8c0e97d1b65938a`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:08.408074 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2680/5337] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:47:08 2022] POST /identity/v3/groups => generated 327 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:08.408796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5f983e7d-ad1d-4e78-a616-d8a6a65c0ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:08.409813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b154d-8e1d-4c18-9c4c-92820a386e1f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:08.412432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b154d-8e1d-4c18-9c4c-92820a386e1f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:08.412936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b154d-8e1d-4c18-9c4c-92820a386e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:08.459759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-226b154d-8e1d-4c18-9c4c-92820a386e1f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:08.465134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-226b154d-8e1d-4c18-9c4c-92820a386e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:08.529418 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2658/5338] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:08.530434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f983e7d-ad1d-4e78-a616-d8a6a65c0ef8 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:08.576766 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2681/5339] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:08.578866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b154d-8e1d-4c18-9c4c-92820a386e1f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:08.591284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-226b154d-8e1d-4c18-9c4c-92820a386e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:08.612635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b154d-8e1d-4c18-9c4c-92820a386e1f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:08.621798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f1802-c8e9-4a72-ac57-f3306202edfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:08.631969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f1802-c8e9-4a72-ac57-f3306202edfd admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:08.632272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f1802-c8e9-4a72-ac57-f3306202edfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:08.632559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f1802-c8e9-4a72-ac57-f3306202edfd admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:08.634791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f1802-c8e9-4a72-ac57-f3306202edfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:08.636770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f1802-c8e9-4a72-ac57-f3306202edfd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:08.646838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f983e7d-ad1d-4e78-a616-d8a6a65c0ef8 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:08.657234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5549fbd-2c8d-40e2-8aa3-737529a4f91b tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:08.658242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5549fbd-2c8d-40e2-8aa3-737529a4f91b tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:08.658740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5549fbd-2c8d-40e2-8aa3-737529a4f91b tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:08.659214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5549fbd-2c8d-40e2-8aa3-737529a4f91b tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups/e1583b4220ec4cb8a1a24ba32668eaeb/users/c75898959e594ba797a60a5fc831bebe` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:08.665604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:08.722815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5549fbd-2c8d-40e2-8aa3-737529a4f91b tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=e1583b4220ec4cb8a1a24ba32668eaeb, user_id=c75898959e594ba797a60a5fc831bebe)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:08.726125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5549fbd-2c8d-40e2-8aa3-737529a4f91b tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:08.759556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:08.822288 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2682/5340] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:47:08 2022] POST /identity/v3/projects => generated 363 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:08.823296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f1802-c8e9-4a72-ac57-f3306202edfd admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:08.828089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-244f1802-c8e9-4a72-ac57-f3306202edfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:08.896177 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2659/5341] 10.222.0.20 () {60 vars in 1360 bytes} [Thu Oct 27 03:47:08 2022] PUT /identity/v3/groups/e1583b4220ec4cb8a1a24ba32668eaeb/users/c75898959e594ba797a60a5fc831bebe => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:08.899920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5549fbd-2c8d-40e2-8aa3-737529a4f91b tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:09.090275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f1802-c8e9-4a72-ac57-f3306202edfd admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:09.090509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5549fbd-2c8d-40e2-8aa3-737529a4f91b tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:09.104520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39b524-0393-49f7-95f8-41760f8db286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:09.105908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39b524-0393-49f7-95f8-41760f8db286 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:09.106235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39b524-0393-49f7-95f8-41760f8db286 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:09.106535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39b524-0393-49f7-95f8-41760f8db286 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:09.111177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39b524-0393-49f7-95f8-41760f8db286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:09.113191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39b524-0393-49f7-95f8-41760f8db286 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:09.203521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43dd934-ff5e-4c6a-a361-fd497070d6df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:09.204157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dd934-ff5e-4c6a-a361-fd497070d6df service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:09.204443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dd934-ff5e-4c6a-a361-fd497070d6df service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:09.204728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dd934-ff5e-4c6a-a361-fd497070d6df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:09.221808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43dd934-ff5e-4c6a-a361-fd497070d6df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:09.223883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43dd934-ff5e-4c6a-a361-fd497070d6df service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:09.240367 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2683/5342] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:09.249730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43dd934-ff5e-4c6a-a361-fd497070d6df service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:09.285596 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2660/5343] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:47:08 2022] POST /identity/v3/users => generated 288 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:09.286725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39b524-0393-49f7-95f8-41760f8db286 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:09.309414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39b524-0393-49f7-95f8-41760f8db286 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:09.322843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e04974-9ebc-4f98-a669-aa557811cbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:09.323560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e04974-9ebc-4f98-a669-aa557811cbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:09.323854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e04974-9ebc-4f98-a669-aa557811cbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:09.324272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e04974-9ebc-4f98-a669-aa557811cbc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:09.324804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e04974-9ebc-4f98-a669-aa557811cbc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:09.327283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e04974-9ebc-4f98-a669-aa557811cbc8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:09.363856 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2661/5344] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:47:09.366617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e04974-9ebc-4f98-a669-aa557811cbc8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:09.391958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e04974-9ebc-4f98-a669-aa557811cbc8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:09.405801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43dd934-ff5e-4c6a-a361-fd497070d6df service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:09.415068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754f397-f9da-4464-bfbe-7e6e38050e38 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:09.417098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754f397-f9da-4464-bfbe-7e6e38050e38 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:09.417385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754f397-f9da-4464-bfbe-7e6e38050e38 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:09.417669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754f397-f9da-4464-bfbe-7e6e38050e38 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:09.419509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754f397-f9da-4464-bfbe-7e6e38050e38 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:09.426341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754f397-f9da-4464-bfbe-7e6e38050e38 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:09.446088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447483e0-1181-453f-96a1-a6c6e49fb03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:09.447665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447483e0-1181-453f-96a1-a6c6e49fb03c admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:09.451901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447483e0-1181-453f-96a1-a6c6e49fb03c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:09.452493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447483e0-1181-453f-96a1-a6c6e49fb03c admin admin] PATH_INFO: `/v3/projects/b579d7bca31743ee90996be0e718deea/users/71b37d51fdaf45a98b419989db43c374/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:09.481884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447483e0-1181-453f-96a1-a6c6e49fb03c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b579d7bca31743ee90996be0e718deea, user_id=71b37d51fdaf45a98b419989db43c374, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:09.485437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447483e0-1181-453f-96a1-a6c6e49fb03c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:09.567577 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2684/5345] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:47:09 2022] POST /identity/v3/groups => generated 324 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:09.567577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1787f-a3ea-4ccc-82ec-a28bb891bd7a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:09.567577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1787f-a3ea-4ccc-82ec-a28bb891bd7a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:09.567577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1787f-a3ea-4ccc-82ec-a28bb891bd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:09.590794 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2662/5346] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:09 2022] PUT /identity/v3/projects/b579d7bca31743ee90996be0e718deea/users/71b37d51fdaf45a98b419989db43c374/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:47:09.590794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447483e0-1181-453f-96a1-a6c6e49fb03c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:09.635191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f5d1787f-a3ea-4ccc-82ec-a28bb891bd7a None None] MFA Rules not processed for user `ca2da57f02884a968d685b53a5399e46`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:09.636440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f5d1787f-a3ea-4ccc-82ec-a28bb891bd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:09.645840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:09.781265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447483e0-1181-453f-96a1-a6c6e49fb03c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:09.784047 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2685/5347] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:09.784902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d1787f-a3ea-4ccc-82ec-a28bb891bd7a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:09.800712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4be62-785a-4ed0-94a4-6227a471e78a tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:09.801753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4be62-785a-4ed0-94a4-6227a471e78a tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:09.802234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4be62-785a-4ed0-94a4-6227a471e78a tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:09.802919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4be62-785a-4ed0-94a4-6227a471e78a tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups/228e55f6a5ea42e69e4efc7972730c3c/users/c75898959e594ba797a60a5fc831bebe` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:09.812381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4be62-785a-4ed0-94a4-6227a471e78a tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=228e55f6a5ea42e69e4efc7972730c3c, user_id=c75898959e594ba797a60a5fc831bebe)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:09.814698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4be62-785a-4ed0-94a4-6227a471e78a tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:09.928086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d1787f-a3ea-4ccc-82ec-a28bb891bd7a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:09.934009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df9b50-a757-4ddf-b982-cd405f2166ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:09.935095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df9b50-a757-4ddf-b982-cd405f2166ba admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:09.946095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df9b50-a757-4ddf-b982-cd405f2166ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:09.946095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df9b50-a757-4ddf-b982-cd405f2166ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:09.946095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df9b50-a757-4ddf-b982-cd405f2166ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:09.946095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df9b50-a757-4ddf-b982-cd405f2166ba admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:09.956467 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2686/5348] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:09.970444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df9b50-a757-4ddf-b982-cd405f2166ba admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:09.982688 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2663/5349] 10.222.0.20 () {60 vars in 1360 bytes} [Thu Oct 27 03:47:09 2022] PUT /identity/v3/groups/228e55f6a5ea42e69e4efc7972730c3c/users/c75898959e594ba797a60a5fc831bebe => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:09.984090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df9b50-a757-4ddf-b982-cd405f2166ba admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:09.986623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4be62-785a-4ed0-94a4-6227a471e78a tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:10.137938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a89218-27a3-4e43-bcc1-903377e00793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:10.139033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a89218-27a3-4e43-bcc1-903377e00793 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:10.140007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a89218-27a3-4e43-bcc1-903377e00793 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:10.140448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a89218-27a3-4e43-bcc1-903377e00793 admin admin] PATH_INFO: `/v3/projects/b579d7bca31743ee90996be0e718deea/users/71b37d51fdaf45a98b419989db43c374/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:10.143810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a89218-27a3-4e43-bcc1-903377e00793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b579d7bca31743ee90996be0e718deea, user_id=71b37d51fdaf45a98b419989db43c374, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:10.148188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a89218-27a3-4e43-bcc1-903377e00793 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:10.203379 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2687/5350] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:09 2022] PUT /identity/v3/projects/b579d7bca31743ee90996be0e718deea/users/71b37d51fdaf45a98b419989db43c374/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:10.205435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4be62-785a-4ed0-94a4-6227a471e78a tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:10.222834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c857c-2609-4ae4-b446-105a0b7e3325 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:10.224390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c857c-2609-4ae4-b446-105a0b7e3325 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:10.224847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c857c-2609-4ae4-b446-105a0b7e3325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:10.287228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7f2c857c-2609-4ae4-b446-105a0b7e3325 None None] MFA Rules not processed for user `71b37d51fdaf45a98b419989db43c374`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:10.289460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7f2c857c-2609-4ae4-b446-105a0b7e3325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:10.367404 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:10.452672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4e2bd-d3ae-4c5e-abdf-1d182e2a3b91 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:10.453344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4e2bd-d3ae-4c5e-abdf-1d182e2a3b91 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:10.453626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4e2bd-d3ae-4c5e-abdf-1d182e2a3b91 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:10.453907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4e2bd-d3ae-4c5e-abdf-1d182e2a3b91 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/users/c75898959e594ba797a60a5fc831bebe/groups` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:10.468850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4e2bd-d3ae-4c5e-abdf-1d182e2a3b91 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=c75898959e594ba797a60a5fc831bebe)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:10.471053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4e2bd-d3ae-4c5e-abdf-1d182e2a3b91 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:10.526145 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2664/5351] 10.222.0.20 () {58 vars in 1242 bytes} [Thu Oct 27 03:47:09 2022] GET /identity/v3/users/c75898959e594ba797a60a5fc831bebe/groups => generated 837 bytes in 540 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:10.527011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4e2bd-d3ae-4c5e-abdf-1d182e2a3b91 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:10.532196 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2688/5352] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:10.536691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c857c-2609-4ae4-b446-105a0b7e3325 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:10.553818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4e2bd-d3ae-4c5e-abdf-1d182e2a3b91 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:10.558590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c857c-2609-4ae4-b446-105a0b7e3325 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:10.566071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d98ab6-9bb2-4926-abdf-383dd6b76169 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:10.566992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d98ab6-9bb2-4926-abdf-383dd6b76169 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:10.567136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d98ab6-9bb2-4926-abdf-383dd6b76169 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:10.567376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d98ab6-9bb2-4926-abdf-383dd6b76169 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups/228e55f6a5ea42e69e4efc7972730c3c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:10.569087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d98ab6-9bb2-4926-abdf-383dd6b76169 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:delete_group(group_id=228e55f6a5ea42e69e4efc7972730c3c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:10.572639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b8b59-8488-4c77-a207-8634a61532e1 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71b37d51fdaf45a98b419989db43c374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b579d7bca31743ee90996be0e718deea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:10.580417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b8b59-8488-4c77-a207-8634a61532e1 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:10.580989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b8b59-8488-4c77-a207-8634a61532e1 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:10.600870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b8b59-8488-4c77-a207-8634a61532e1 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:10.601453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d98ab6-9bb2-4926-abdf-383dd6b76169 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:10.601565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:10.601565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b8b59-8488-4c77-a207-8634a61532e1 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:10.601565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b8b59-8488-4c77-a207-8634a61532e1 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:10.730827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:10.778505 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2689/5353] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:47:10 2022] POST /identity/v3/domains => generated 275 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:10.780929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b8b59-8488-4c77-a207-8634a61532e1 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:10.787160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6f9b8b59-8488-4c77-a207-8634a61532e1 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:10.811426 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2665/5354] 10.222.0.20 () {58 vars in 1227 bytes} [Thu Oct 27 03:47:10 2022] DELETE /identity/v3/groups/228e55f6a5ea42e69e4efc7972730c3c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:10.812375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d98ab6-9bb2-4926-abdf-383dd6b76169 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:10.815231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-96d98ab6-9bb2-4926-abdf-383dd6b76169 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:10.855769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:10.938098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d98ab6-9bb2-4926-abdf-383dd6b76169 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:10.952941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b8b59-8488-4c77-a207-8634a61532e1 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:10.953399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c2554-8a37-4b00-9a85-e0024f51c153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:10.954201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c2554-8a37-4b00-9a85-e0024f51c153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:10.955695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c2554-8a37-4b00-9a85-e0024f51c153 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:10.956044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c2554-8a37-4b00-9a85-e0024f51c153 admin admin] PATH_INFO: `/v3/projects/04394989e28241b483f436e61ac83691` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:10.959360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d918f48-4cbf-421b-aa52-c258ae3e1ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:10.960284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d918f48-4cbf-421b-aa52-c258ae3e1ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:10.960743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d918f48-4cbf-421b-aa52-c258ae3e1ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:10.961184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d918f48-4cbf-421b-aa52-c258ae3e1ae0 admin admin] PATH_INFO: `/v3/users/afc6b0abd5294accb5a1461df1c12ac2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:10.961909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c2554-8a37-4b00-9a85-e0024f51c153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04394989e28241b483f436e61ac83691)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:10.962795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d918f48-4cbf-421b-aa52-c258ae3e1ae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afc6b0abd5294accb5a1461df1c12ac2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:10.964900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d918f48-4cbf-421b-aa52-c258ae3e1ae0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:10.967503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c2554-8a37-4b00-9a85-e0024f51c153 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:11.229486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0d918f48-4cbf-421b-aa52-c258ae3e1ae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afc6b0abd5294accb5a1461df1c12ac2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:11.234070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0d918f48-4cbf-421b-aa52-c258ae3e1ae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afc6b0abd5294accb5a1461df1c12ac2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:11.234983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-368c2554-8a37-4b00-9a85-e0024f51c153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04394989e28241b483f436e61ac83691', 'request_id': 'req-368c2554-8a37-4b00-9a85-e0024f51c153'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:11.247000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0d918f48-4cbf-421b-aa52-c258ae3e1ae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afc6b0abd5294accb5a1461df1c12ac2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:11.274283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0d918f48-4cbf-421b-aa52-c258ae3e1ae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afc6b0abd5294accb5a1461df1c12ac2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:11.275177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0d918f48-4cbf-421b-aa52-c258ae3e1ae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afc6b0abd5294accb5a1461df1c12ac2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:11.308066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-368c2554-8a37-4b00-9a85-e0024f51c153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04394989e28241b483f436e61ac83691', 'request_id': 'req-368c2554-8a37-4b00-9a85-e0024f51c153'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:11.319177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-368c2554-8a37-4b00-9a85-e0024f51c153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04394989e28241b483f436e61ac83691', 'request_id': 'req-368c2554-8a37-4b00-9a85-e0024f51c153'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:11.346689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-368c2554-8a37-4b00-9a85-e0024f51c153 admin admin] The token cache is being invalidate because project 04394989e28241b483f436e61ac83691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:11.347355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-368c2554-8a37-4b00-9a85-e0024f51c153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:11.349216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-368c2554-8a37-4b00-9a85-e0024f51c153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:11.354556 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2666/5355] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:10 2022] DELETE /identity/v3/projects/04394989e28241b483f436e61ac83691 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:11.354556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c2554-8a37-4b00-9a85-e0024f51c153 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:11.354891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-368c2554-8a37-4b00-9a85-e0024f51c153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:11.370082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:11.401434 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2690/5356] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:10 2022] DELETE /identity/v3/users/afc6b0abd5294accb5a1461df1c12ac2 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:11.402312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d918f48-4cbf-421b-aa52-c258ae3e1ae0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:11.406238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0d918f48-4cbf-421b-aa52-c258ae3e1ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:11.569074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:11.613037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c2554-8a37-4b00-9a85-e0024f51c153 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:11.622297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d918f48-4cbf-421b-aa52-c258ae3e1ae0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:11.653223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66b354-b6b0-450d-a67b-4d4a225eac1f tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:11.656667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66b354-b6b0-450d-a67b-4d4a225eac1f tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:11.656962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66b354-b6b0-450d-a67b-4d4a225eac1f tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:11.657251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66b354-b6b0-450d-a67b-4d4a225eac1f tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/groups/e1583b4220ec4cb8a1a24ba32668eaeb` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:11.678299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66b354-b6b0-450d-a67b-4d4a225eac1f tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e1583b4220ec4cb8a1a24ba32668eaeb)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:11.688908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66b354-b6b0-450d-a67b-4d4a225eac1f tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:11.942582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfcd30-4fe2-4c30-bec6-ffd04db2e2ce tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71b37d51fdaf45a98b419989db43c374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b579d7bca31743ee90996be0e718deea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:11.943243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfcd30-4fe2-4c30-bec6-ffd04db2e2ce tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:11.943536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfcd30-4fe2-4c30-bec6-ffd04db2e2ce tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:11.943839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfcd30-4fe2-4c30-bec6-ffd04db2e2ce tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:11.944515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfcd30-4fe2-4c30-bec6-ffd04db2e2ce tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:11.946571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfcd30-4fe2-4c30-bec6-ffd04db2e2ce tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:12.031475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:12.065599 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2691/5357] 10.222.0.20 () {58 vars in 1227 bytes} [Thu Oct 27 03:47:11 2022] DELETE /identity/v3/groups/e1583b4220ec4cb8a1a24ba32668eaeb => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:12.068146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0e515-3e49-4696-8322-89a0b33ccdac None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:12.068870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0e515-3e49-4696-8322-89a0b33ccdac None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:12.069591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0e515-3e49-4696-8322-89a0b33ccdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:12.102320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3be0e515-3e49-4696-8322-89a0b33ccdac None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:12.104495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3be0e515-3e49-4696-8322-89a0b33ccdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:12.125292 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2667/5358] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:47:11 2022] POST /identity/v3/users => generated 346 bytes in 773 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:12.126657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004603b-481e-4e6d-95e3-3142f928d410 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:12.126969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004603b-481e-4e6d-95e3-3142f928d410 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:12.127237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004603b-481e-4e6d-95e3-3142f928d410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:12.203504 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2692/5359] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:12.204801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0e515-3e49-4696-8322-89a0b33ccdac None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:12.206257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3be0e515-3e49-4696-8322-89a0b33ccdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:12.253088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1004603b-481e-4e6d-95e3-3142f928d410 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:12.255529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1004603b-481e-4e6d-95e3-3142f928d410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:12.283239 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2668/5360] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:12.283239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004603b-481e-4e6d-95e3-3142f928d410 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:12.352744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0e515-3e49-4696-8322-89a0b33ccdac None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:12.361922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12804e82-5591-4f8b-a6ae-32c6a232e441 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:12.363276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12804e82-5591-4f8b-a6ae-32c6a232e441 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:12.363633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12804e82-5591-4f8b-a6ae-32c6a232e441 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:12.363985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12804e82-5591-4f8b-a6ae-32c6a232e441 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/users/c75898959e594ba797a60a5fc831bebe` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:12.365261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12804e82-5591-4f8b-a6ae-32c6a232e441 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c75898959e594ba797a60a5fc831bebe)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:12.367711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12804e82-5591-4f8b-a6ae-32c6a232e441 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:12.388282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004603b-481e-4e6d-95e3-3142f928d410 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:12.394816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfe36b-1472-493b-932a-8989f6a27282 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71b37d51fdaf45a98b419989db43c374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b579d7bca31743ee90996be0e718deea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:12.395705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfe36b-1472-493b-932a-8989f6a27282 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:12.396173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfe36b-1472-493b-932a-8989f6a27282 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:12.396752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfe36b-1472-493b-932a-8989f6a27282 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:12.397923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfe36b-1472-493b-932a-8989f6a27282 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:12.400001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfe36b-1472-493b-932a-8989f6a27282 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:12.429065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:12.519358 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2669/5361] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:47:12 2022] POST /identity/v3/users => generated 324 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:12.520857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ee481-cc59-4405-ab10-5950ab6f275e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:12.521444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ee481-cc59-4405-ab10-5950ab6f275e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:12.521444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ee481-cc59-4405-ab10-5950ab6f275e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:12.534441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-12804e82-5591-4f8b-a6ae-32c6a232e441 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c75898959e594ba797a60a5fc831bebe'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:12.535419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-12804e82-5591-4f8b-a6ae-32c6a232e441 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c75898959e594ba797a60a5fc831bebe'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:12.547901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1d8ee481-cc59-4405-ab10-5950ab6f275e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:12.549166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1d8ee481-cc59-4405-ab10-5950ab6f275e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:12.553428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-12804e82-5591-4f8b-a6ae-32c6a232e441 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c75898959e594ba797a60a5fc831bebe'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:12.561248 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2670/5362] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:12.562276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ee481-cc59-4405-ab10-5950ab6f275e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:12.563749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1d8ee481-cc59-4405-ab10-5950ab6f275e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:12.569344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-12804e82-5591-4f8b-a6ae-32c6a232e441 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c75898959e594ba797a60a5fc831bebe'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:12.570530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-12804e82-5591-4f8b-a6ae-32c6a232e441 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c75898959e594ba797a60a5fc831bebe'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:12.624861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:12.662208 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2693/5363] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:12 2022] DELETE /identity/v3/users/c75898959e594ba797a60a5fc831bebe => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:12.662208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12804e82-5591-4f8b-a6ae-32c6a232e441 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:12.662855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-12804e82-5591-4f8b-a6ae-32c6a232e441 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:12.669694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ee481-cc59-4405-ab10-5950ab6f275e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:12.753788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12804e82-5591-4f8b-a6ae-32c6a232e441 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:12.760107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94b4a6-cfd8-4975-b9d2-ccd936f4b4f5 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71b37d51fdaf45a98b419989db43c374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b579d7bca31743ee90996be0e718deea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:12.760664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94b4a6-cfd8-4975-b9d2-ccd936f4b4f5 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:12.761057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94b4a6-cfd8-4975-b9d2-ccd936f4b4f5 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:12.761355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94b4a6-cfd8-4975-b9d2-ccd936f4b4f5 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] PATH_INFO: `/v3/users/3b515de5682e4f03882ed4bbd6a49d7d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:12.771194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f2d3f-31e9-4125-b520-2fa7f670c570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:12.772253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f2d3f-31e9-4125-b520-2fa7f670c570 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:12.773249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f2d3f-31e9-4125-b520-2fa7f670c570 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:12.774094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f2d3f-31e9-4125-b520-2fa7f670c570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:12.777379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bd1f2d3f-31e9-4125-b520-2fa7f670c570 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:12.779331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94b4a6-cfd8-4975-b9d2-ccd936f4b4f5 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Authorizing `identity:get_user(user_id=3b515de5682e4f03882ed4bbd6a49d7d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:12.781810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94b4a6-cfd8-4975-b9d2-ccd936f4b4f5 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:12.788317 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2694/5364] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 03:47:12 2022] GET /identity/v3/users/3b515de5682e4f03882ed4bbd6a49d7d => generated 346 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:12.789245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94b4a6-cfd8-4975-b9d2-ccd936f4b4f5 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:12.865036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f2d3f-31e9-4125-b520-2fa7f670c570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:12.869573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f2d3f-31e9-4125-b520-2fa7f670c570 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:12.886460 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2671/5365] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:12.887388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f2d3f-31e9-4125-b520-2fa7f670c570 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:12.888915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bd1f2d3f-31e9-4125-b520-2fa7f670c570 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:12.898220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94b4a6-cfd8-4975-b9d2-ccd936f4b4f5 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:12.914634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3216fa-1a8c-44d0-9ec5-6c59a5402df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:12.915335 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3216fa-1a8c-44d0-9ec5-6c59a5402df8 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:12.915719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3216fa-1a8c-44d0-9ec5-6c59a5402df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:12.915886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3216fa-1a8c-44d0-9ec5-6c59a5402df8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:12.918095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3216fa-1a8c-44d0-9ec5-6c59a5402df8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:47:12.918095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3216fa-1a8c-44d0-9ec5-6c59a5402df8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:12.931589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3216fa-1a8c-44d0-9ec5-6c59a5402df8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:12.937922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:12.969099 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2695/5366] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:12.969099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3216fa-1a8c-44d0-9ec5-6c59a5402df8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:12.996330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3216fa-1a8c-44d0-9ec5-6c59a5402df8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:13.004704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b346a4-abc6-42c4-9c89-7f7980b917dc tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71b37d51fdaf45a98b419989db43c374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b579d7bca31743ee90996be0e718deea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:13.005774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b346a4-abc6-42c4-9c89-7f7980b917dc tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:13.006269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b346a4-abc6-42c4-9c89-7f7980b917dc tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:13.006727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b346a4-abc6-42c4-9c89-7f7980b917dc tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:13.007785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b346a4-abc6-42c4-9c89-7f7980b917dc tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Adding query filter params (domain_id=6401728941de4c058cb3dc1993d3a254) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:47:13.008259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b346a4-abc6-42c4-9c89-7f7980b917dc tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:13.010456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b346a4-abc6-42c4-9c89-7f7980b917dc tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:13.034367 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2696/5367] 10.222.0.20 () {58 vars in 1207 bytes} [Thu Oct 27 03:47:12 2022] GET /identity/v3/users?domain_id=6401728941de4c058cb3dc1993d3a254 => generated 483 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:13.034906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b346a4-abc6-42c4-9c89-7f7980b917dc tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:13.051183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f2d3f-31e9-4125-b520-2fa7f670c570 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:13.062980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b346a4-abc6-42c4-9c89-7f7980b917dc tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:13.063853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0dd58-2d08-4695-a3fa-5b773e244f79 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:13.064583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0dd58-2d08-4695-a3fa-5b773e244f79 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:13.064932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0dd58-2d08-4695-a3fa-5b773e244f79 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:13.065211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0dd58-2d08-4695-a3fa-5b773e244f79 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/domains/036a0cd6102d404086c1558466f5d864` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:13.066721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0dd58-2d08-4695-a3fa-5b773e244f79 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=036a0cd6102d404086c1558466f5d864)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:13.068492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0dd58-2d08-4695-a3fa-5b773e244f79 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:13.076165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68381d9e-f794-43b7-9ee4-fa9b17072c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:13.076829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68381d9e-f794-43b7-9ee4-fa9b17072c63 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:13.077650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68381d9e-f794-43b7-9ee4-fa9b17072c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:13.077928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68381d9e-f794-43b7-9ee4-fa9b17072c63 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:13.078848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68381d9e-f794-43b7-9ee4-fa9b17072c63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:13.081249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68381d9e-f794-43b7-9ee4-fa9b17072c63 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:13.114395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-19c0dd58-2d08-4695-a3fa-5b773e244f79 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '036a0cd6102d404086c1558466f5d864'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:13.114395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-19c0dd58-2d08-4695-a3fa-5b773e244f79 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '036a0cd6102d404086c1558466f5d864'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:13.231927 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2697/5368] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:47:13 2022] POST /identity/v3/projects => generated 361 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:13.231927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68381d9e-f794-43b7-9ee4-fa9b17072c63 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:13.232579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-68381d9e-f794-43b7-9ee4-fa9b17072c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:13.238496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-19c0dd58-2d08-4695-a3fa-5b773e244f79 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '036a0cd6102d404086c1558466f5d864'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:13.239749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-19c0dd58-2d08-4695-a3fa-5b773e244f79 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '036a0cd6102d404086c1558466f5d864'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:13.247004 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2672/5369] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:47:12 2022] PATCH /identity/v3/domains/036a0cd6102d404086c1558466f5d864 => generated 277 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:13.248187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0dd58-2d08-4695-a3fa-5b773e244f79 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:13.251528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-19c0dd58-2d08-4695-a3fa-5b773e244f79 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:13.365048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0dd58-2d08-4695-a3fa-5b773e244f79 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:13.381633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68381d9e-f794-43b7-9ee4-fa9b17072c63 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:13.390932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64b533-7f86-407e-b820-8c2fbdc77116 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71b37d51fdaf45a98b419989db43c374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b579d7bca31743ee90996be0e718deea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:13.393338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64b533-7f86-407e-b820-8c2fbdc77116 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:13.393338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64b533-7f86-407e-b820-8c2fbdc77116 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:13.393338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64b533-7f86-407e-b820-8c2fbdc77116 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:13.393338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64b533-7f86-407e-b820-8c2fbdc77116 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:13.398333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64b533-7f86-407e-b820-8c2fbdc77116 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:13.414748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:13.443167 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2698/5370] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:13 2022] GET /identity/v3/users => generated 8283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:13.446014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64b533-7f86-407e-b820-8c2fbdc77116 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:13.450512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4b64b533-7f86-407e-b820-8c2fbdc77116 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:13.469455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d9b47-7faa-4b36-982a-29ea9be8d19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:13.470223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d9b47-7faa-4b36-982a-29ea9be8d19e admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:13.470587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d9b47-7faa-4b36-982a-29ea9be8d19e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:13.471068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d9b47-7faa-4b36-982a-29ea9be8d19e admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:13.471793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d9b47-7faa-4b36-982a-29ea9be8d19e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:13.474141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d9b47-7faa-4b36-982a-29ea9be8d19e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:13.572863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64b533-7f86-407e-b820-8c2fbdc77116 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:13.578412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ae92bdb7464f52af032dc9626dab57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d64140b2aa4a1683fbaefcfb0d70e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:13.579060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:13.579347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:13.579629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] PATH_INFO: `/v3/domains/036a0cd6102d404086c1558466f5d864` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:13.593931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=036a0cd6102d404086c1558466f5d864)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:13.601377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:13.627243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '036a0cd6102d404086c1558466f5d864'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:13.638902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '036a0cd6102d404086c1558466f5d864'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:13.717437 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2673/5371] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:47:13 2022] POST /identity/v3/users => generated 281 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:13.720976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d9b47-7faa-4b36-982a-29ea9be8d19e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:13.721895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-895d9b47-7faa-4b36-982a-29ea9be8d19e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:13.735834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d9b47-7faa-4b36-982a-29ea9be8d19e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:13.740457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc01a1-4281-489d-836b-070b3267d6c8 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71b37d51fdaf45a98b419989db43c374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b579d7bca31743ee90996be0e718deea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:13.741072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc01a1-4281-489d-836b-070b3267d6c8 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:13.741386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc01a1-4281-489d-836b-070b3267d6c8 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:13.741715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc01a1-4281-489d-836b-070b3267d6c8 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:13.742453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc01a1-4281-489d-836b-070b3267d6c8 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Adding query filter params (name=tempest-test_user-82073481) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:47:13.742788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc01a1-4281-489d-836b-070b3267d6c8 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:13.744819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc01a1-4281-489d-836b-070b3267d6c8 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:13.766326 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2674/5372] 10.222.0.20 () {58 vars in 1185 bytes} [Thu Oct 27 03:47:13 2022] GET /identity/v3/users?name=tempest-test_user-82073481 => generated 472 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:13.767211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc01a1-4281-489d-836b-070b3267d6c8 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:13.770705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-41fc01a1-4281-489d-836b-070b3267d6c8 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:13.785650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc01a1-4281-489d-836b-070b3267d6c8 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:13.808020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '036a0cd6102d404086c1558466f5d864', 'request_id': 'req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:13.819709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '036a0cd6102d404086c1558466f5d864', 'request_id': 'req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:13.829927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '036a0cd6102d404086c1558466f5d864', 'request_id': 'req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:13.852984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01384866-8ddd-4d0d-b47a-d4d10a1a6908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:13.853759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01384866-8ddd-4d0d-b47a-d4d10a1a6908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:13.854068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01384866-8ddd-4d0d-b47a-d4d10a1a6908 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:13.854832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01384866-8ddd-4d0d-b47a-d4d10a1a6908 admin admin] PATH_INFO: `/v3/projects/0ac942bb12164dc6adfd2c767cc47669` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:13.857986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01384866-8ddd-4d0d-b47a-d4d10a1a6908 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ac942bb12164dc6adfd2c767cc47669)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:13.862452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01384866-8ddd-4d0d-b47a-d4d10a1a6908 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:13.947900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] The token cache is being invalidate because project 036a0cd6102d404086c1558466f5d864 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:13.948204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:13.948896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:13.958370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '036a0cd6102d404086c1558466f5d864', 'request_id': 'req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:13.959523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '036a0cd6102d404086c1558466f5d864', 'request_id': 'req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:13.960161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '036a0cd6102d404086c1558466f5d864', 'request_id': 'req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:14.008734 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2699/5373] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:47:13 2022] DELETE /identity/v3/domains/036a0cd6102d404086c1558466f5d864 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:14.008734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:14.011137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:14.027201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-01384866-8ddd-4d0d-b47a-d4d10a1a6908 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ac942bb12164dc6adfd2c767cc47669', 'request_id': 'req-01384866-8ddd-4d0d-b47a-d4d10a1a6908'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:14.044479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc8772-61b1-44b8-b71e-11e0b0b78cf7 tempest-GroupsV3TestJSON-859324093 tempest-GroupsV3TestJSON-859324093-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:14.137607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-01384866-8ddd-4d0d-b47a-d4d10a1a6908 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ac942bb12164dc6adfd2c767cc47669', 'request_id': 'req-01384866-8ddd-4d0d-b47a-d4d10a1a6908'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:14.148937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-01384866-8ddd-4d0d-b47a-d4d10a1a6908 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ac942bb12164dc6adfd2c767cc47669', 'request_id': 'req-01384866-8ddd-4d0d-b47a-d4d10a1a6908'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:14.179501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-01384866-8ddd-4d0d-b47a-d4d10a1a6908 admin admin] The token cache is being invalidate because project 0ac942bb12164dc6adfd2c767cc47669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:14.180833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-01384866-8ddd-4d0d-b47a-d4d10a1a6908 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:14.181697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-01384866-8ddd-4d0d-b47a-d4d10a1a6908 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:14.189599 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2675/5374] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:13 2022] DELETE /identity/v3/projects/0ac942bb12164dc6adfd2c767cc47669 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:14.189599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01384866-8ddd-4d0d-b47a-d4d10a1a6908 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:14.193098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-01384866-8ddd-4d0d-b47a-d4d10a1a6908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:14.199469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0d644-09a1-48ee-90a0-58db31c28948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:14.200190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0d644-09a1-48ee-90a0-58db31c28948 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:14.200476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0d644-09a1-48ee-90a0-58db31c28948 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:14.200858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0d644-09a1-48ee-90a0-58db31c28948 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:14.203219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0d644-09a1-48ee-90a0-58db31c28948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:14.207453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0d644-09a1-48ee-90a0-58db31c28948 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:14.229998 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2700/5375] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:14.234154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0d644-09a1-48ee-90a0-58db31c28948 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:14.244849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fef0d644-09a1-48ee-90a0-58db31c28948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:14.273222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0d644-09a1-48ee-90a0-58db31c28948 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:14.279142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e67e91-05b8-4852-9c56-b5c874d2fce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:14.279946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e67e91-05b8-4852-9c56-b5c874d2fce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:14.281052 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e67e91-05b8-4852-9c56-b5c874d2fce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:14.281345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e67e91-05b8-4852-9c56-b5c874d2fce6 admin admin] PATH_INFO: `/v3/users/020b5a4a2ff445829da2e81673ed8c26` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:14.282799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e67e91-05b8-4852-9c56-b5c874d2fce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=020b5a4a2ff445829da2e81673ed8c26)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:14.284756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e67e91-05b8-4852-9c56-b5c874d2fce6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:14.310972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01384866-8ddd-4d0d-b47a-d4d10a1a6908 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:14.326828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599e82c-25bc-4ad0-bca2-2ebc35ad75a3 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71b37d51fdaf45a98b419989db43c374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b579d7bca31743ee90996be0e718deea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:14.327913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:14.328253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599e82c-25bc-4ad0-bca2-2ebc35ad75a3 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:14.328621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599e82c-25bc-4ad0-bca2-2ebc35ad75a3 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:14.328820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599e82c-25bc-4ad0-bca2-2ebc35ad75a3 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:14.329687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599e82c-25bc-4ad0-bca2-2ebc35ad75a3 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:47:14.329887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599e82c-25bc-4ad0-bca2-2ebc35ad75a3 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:14.331778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599e82c-25bc-4ad0-bca2-2ebc35ad75a3 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:14.370148 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2676/5376] 10.222.0.20 () {58 vars in 1149 bytes} [Thu Oct 27 03:47:14 2022] GET /identity/v3/users?enabled=False => generated 432 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:14.373721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599e82c-25bc-4ad0-bca2-2ebc35ad75a3 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:14.377610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8599e82c-25bc-4ad0-bca2-2ebc35ad75a3 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:14.394624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599e82c-25bc-4ad0-bca2-2ebc35ad75a3 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:14.402163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7c7eb-9249-4102-97af-324be7a17c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:14.403019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7c7eb-9249-4102-97af-324be7a17c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:14.403369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7c7eb-9249-4102-97af-324be7a17c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:14.403716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7c7eb-9249-4102-97af-324be7a17c39 admin admin] PATH_INFO: `/v3/users/afda5438557846cc852a2c31347076e2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:14.405740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7c7eb-9249-4102-97af-324be7a17c39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afda5438557846cc852a2c31347076e2)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:14.407764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7c7eb-9249-4102-97af-324be7a17c39 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:14.498245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:14.598570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-86e67e91-05b8-4852-9c56-b5c874d2fce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '020b5a4a2ff445829da2e81673ed8c26'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:14.600421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-86e67e91-05b8-4852-9c56-b5c874d2fce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '020b5a4a2ff445829da2e81673ed8c26'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:14.608784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-86e67e91-05b8-4852-9c56-b5c874d2fce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '020b5a4a2ff445829da2e81673ed8c26'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:14.621710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-86e67e91-05b8-4852-9c56-b5c874d2fce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '020b5a4a2ff445829da2e81673ed8c26'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:14.622475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-86e67e91-05b8-4852-9c56-b5c874d2fce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '020b5a4a2ff445829da2e81673ed8c26'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:14.649505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e9c7c7eb-9249-4102-97af-324be7a17c39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afda5438557846cc852a2c31347076e2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:14.660743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e9c7c7eb-9249-4102-97af-324be7a17c39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afda5438557846cc852a2c31347076e2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:14.683354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e9c7c7eb-9249-4102-97af-324be7a17c39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afda5438557846cc852a2c31347076e2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:14.710963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e9c7c7eb-9249-4102-97af-324be7a17c39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afda5438557846cc852a2c31347076e2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:14.782428 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2701/5377] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:14 2022] DELETE /identity/v3/users/020b5a4a2ff445829da2e81673ed8c26 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:14.784129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e67e91-05b8-4852-9c56-b5c874d2fce6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:14.786425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-86e67e91-05b8-4852-9c56-b5c874d2fce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:14.831639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e9c7c7eb-9249-4102-97af-324be7a17c39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afda5438557846cc852a2c31347076e2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:14.844999 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2677/5378] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:14 2022] DELETE /identity/v3/users/afda5438557846cc852a2c31347076e2 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:14.844999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7c7eb-9249-4102-97af-324be7a17c39 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:14.844999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e9c7c7eb-9249-4102-97af-324be7a17c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:14.958143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e67e91-05b8-4852-9c56-b5c874d2fce6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:15.081466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7c7eb-9249-4102-97af-324be7a17c39 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:15.095456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b27ef2-a7b6-4604-988f-5c9426693d31 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71b37d51fdaf45a98b419989db43c374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b579d7bca31743ee90996be0e718deea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:15.096135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b27ef2-a7b6-4604-988f-5c9426693d31 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:15.096422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b27ef2-a7b6-4604-988f-5c9426693d31 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:15.096703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b27ef2-a7b6-4604-988f-5c9426693d31 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] PATH_INFO: `/v3/users/a2eb8552e1ef4ed1939779f9595265d5` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:15.139025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515e4ea-a0af-4b9e-8f10-eac9b4090962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:15.139704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515e4ea-a0af-4b9e-8f10-eac9b4090962 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:15.139989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515e4ea-a0af-4b9e-8f10-eac9b4090962 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:15.140264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515e4ea-a0af-4b9e-8f10-eac9b4090962 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:15.140924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515e4ea-a0af-4b9e-8f10-eac9b4090962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:15.142571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515e4ea-a0af-4b9e-8f10-eac9b4090962 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:15.156102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b27ef2-a7b6-4604-988f-5c9426693d31 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a2eb8552e1ef4ed1939779f9595265d5)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:15.158025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b27ef2-a7b6-4604-988f-5c9426693d31 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:15.177777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:15.189446 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2702/5379] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:15.189446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53cc06-3174-4334-8de7-ed2cd8dd8652 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:15.189446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53cc06-3174-4334-8de7-ed2cd8dd8652 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:15.189864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53cc06-3174-4334-8de7-ed2cd8dd8652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:15.265580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-fc53cc06-3174-4334-8de7-ed2cd8dd8652 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:15.266918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fc53cc06-3174-4334-8de7-ed2cd8dd8652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:15.292368 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2703/5380] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:15.292368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53cc06-3174-4334-8de7-ed2cd8dd8652 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:15.293532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fc53cc06-3174-4334-8de7-ed2cd8dd8652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:15.320727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-31b27ef2-a7b6-4604-988f-5c9426693d31 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2eb8552e1ef4ed1939779f9595265d5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:15.324784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-31b27ef2-a7b6-4604-988f-5c9426693d31 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2eb8552e1ef4ed1939779f9595265d5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:15.326712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53cc06-3174-4334-8de7-ed2cd8dd8652 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:15.343136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-31b27ef2-a7b6-4604-988f-5c9426693d31 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2eb8552e1ef4ed1939779f9595265d5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:15.348139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1bd83-2c9a-443d-9789-0e5c479dc273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:15.348834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1bd83-2c9a-443d-9789-0e5c479dc273 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:15.349117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1bd83-2c9a-443d-9789-0e5c479dc273 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:15.349547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1bd83-2c9a-443d-9789-0e5c479dc273 admin admin] PATH_INFO: `/v3/projects/0b5351c188a04a2ca93a475d21410dbe/users/30f94e1b136e40b3a3934e734e32904f/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:15.368450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-31b27ef2-a7b6-4604-988f-5c9426693d31 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2eb8552e1ef4ed1939779f9595265d5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:15.378912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1bd83-2c9a-443d-9789-0e5c479dc273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b5351c188a04a2ca93a475d21410dbe, user_id=30f94e1b136e40b3a3934e734e32904f, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:15.381978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1bd83-2c9a-443d-9789-0e5c479dc273 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:15.481815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-31b27ef2-a7b6-4604-988f-5c9426693d31 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2eb8552e1ef4ed1939779f9595265d5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:15.495995 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2678/5381] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:14 2022] DELETE /identity/v3/users/a2eb8552e1ef4ed1939779f9595265d5 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:15.497092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b27ef2-a7b6-4604-988f-5c9426693d31 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:15.500012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-31b27ef2-a7b6-4604-988f-5c9426693d31 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:15.567242 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2704/5382] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:15 2022] PUT /identity/v3/projects/0b5351c188a04a2ca93a475d21410dbe/users/30f94e1b136e40b3a3934e734e32904f/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:15.568492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1bd83-2c9a-443d-9789-0e5c479dc273 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:15.572196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8cc1bd83-2c9a-443d-9789-0e5c479dc273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:15.665943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:15.687453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b27ef2-a7b6-4604-988f-5c9426693d31 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:15.729827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1bd83-2c9a-443d-9789-0e5c479dc273 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:15.744061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae571429-3919-4e20-8bf1-bd6e98fbd027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:15.745010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae571429-3919-4e20-8bf1-bd6e98fbd027 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:15.745303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae571429-3919-4e20-8bf1-bd6e98fbd027 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:15.745586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae571429-3919-4e20-8bf1-bd6e98fbd027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:15.747561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ae571429-3919-4e20-8bf1-bd6e98fbd027 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:15.751545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551dbb93-85e5-41b4-afbe-5c97ed9273af tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71b37d51fdaf45a98b419989db43c374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b579d7bca31743ee90996be0e718deea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:15.752707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551dbb93-85e5-41b4-afbe-5c97ed9273af tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:15.754274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551dbb93-85e5-41b4-afbe-5c97ed9273af tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:15.754653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551dbb93-85e5-41b4-afbe-5c97ed9273af tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] PATH_INFO: `/v3/users/3b515de5682e4f03882ed4bbd6a49d7d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:15.757862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551dbb93-85e5-41b4-afbe-5c97ed9273af tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3b515de5682e4f03882ed4bbd6a49d7d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:15.761402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551dbb93-85e5-41b4-afbe-5c97ed9273af tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:15.868429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae571429-3919-4e20-8bf1-bd6e98fbd027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:15.870251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae571429-3919-4e20-8bf1-bd6e98fbd027 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:15.884152 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2679/5383] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:15.885935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750d2ad-aa83-46f2-a4e6-0cec96d89bc1 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:15.886314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750d2ad-aa83-46f2-a4e6-0cec96d89bc1 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:15.886602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750d2ad-aa83-46f2-a4e6-0cec96d89bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:15.942272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-551dbb93-85e5-41b4-afbe-5c97ed9273af tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b515de5682e4f03882ed4bbd6a49d7d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:15.943184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-551dbb93-85e5-41b4-afbe-5c97ed9273af tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b515de5682e4f03882ed4bbd6a49d7d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:15.952000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6750d2ad-aa83-46f2-a4e6-0cec96d89bc1 None None] MFA Rules not processed for user `30f94e1b136e40b3a3934e734e32904f`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:15.954142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6750d2ad-aa83-46f2-a4e6-0cec96d89bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:15.955447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-551dbb93-85e5-41b4-afbe-5c97ed9273af tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b515de5682e4f03882ed4bbd6a49d7d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:15.971572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-551dbb93-85e5-41b4-afbe-5c97ed9273af tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b515de5682e4f03882ed4bbd6a49d7d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:15.972323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-551dbb93-85e5-41b4-afbe-5c97ed9273af tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b515de5682e4f03882ed4bbd6a49d7d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:16.024712 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2680/5384] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:16.029843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919418a-ab40-4795-87dc-087882ca62f8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:16.030754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919418a-ab40-4795-87dc-087882ca62f8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:16.035543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919418a-ab40-4795-87dc-087882ca62f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:16.049566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c919418a-ab40-4795-87dc-087882ca62f8 None None] MFA Rules not processed for user `30f94e1b136e40b3a3934e734e32904f`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:16.050824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c919418a-ab40-4795-87dc-087882ca62f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:16.059641 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2681/5385] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:16 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 03:47:16.061048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7bdc7-6aa0-45d2-bf98-abd22f57f65c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:16.061368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7bdc7-6aa0-45d2-bf98-abd22f57f65c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:16.061654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7bdc7-6aa0-45d2-bf98-abd22f57f65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:16.065748 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2705/5386] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:15 2022] DELETE /identity/v3/users/3b515de5682e4f03882ed4bbd6a49d7d => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:16.069794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551dbb93-85e5-41b4-afbe-5c97ed9273af tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:16.071579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-551dbb93-85e5-41b4-afbe-5c97ed9273af tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:16.082686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-23d7bdc7-6aa0-45d2-bf98-abd22f57f65c None None] MFA Rules not processed for user `30f94e1b136e40b3a3934e734e32904f`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:16.084860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-23d7bdc7-6aa0-45d2-bf98-abd22f57f65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:16.093544 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2682/5387] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:16 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:47:16.097601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7bdc7-6aa0-45d2-bf98-abd22f57f65c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:16.191580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551dbb93-85e5-41b4-afbe-5c97ed9273af tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:16.199871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739c730-ead2-4317-8ff8-2ece29578650 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71b37d51fdaf45a98b419989db43c374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b579d7bca31743ee90996be0e718deea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:16.200562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739c730-ead2-4317-8ff8-2ece29578650 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:16.200858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739c730-ead2-4317-8ff8-2ece29578650 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:16.201150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739c730-ead2-4317-8ff8-2ece29578650 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] PATH_INFO: `/v3/domains/6401728941de4c058cb3dc1993d3a254` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:16.203102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739c730-ead2-4317-8ff8-2ece29578650 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6401728941de4c058cb3dc1993d3a254)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:16.203324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7bdc7-6aa0-45d2-bf98-abd22f57f65c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:16.206674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739c730-ead2-4317-8ff8-2ece29578650 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:16.210434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ccf6f-0dac-4d5a-816e-11c400ceaf72 tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30f94e1b136e40b3a3934e734e32904f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b5351c188a04a2ca93a475d21410dbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:16.210434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ccf6f-0dac-4d5a-816e-11c400ceaf72 tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] REQUEST_METHOD: `HEAD` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:16.210434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ccf6f-0dac-4d5a-816e-11c400ceaf72 tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:16.210781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ccf6f-0dac-4d5a-816e-11c400ceaf72 tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:16.217388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ccf6f-0dac-4d5a-816e-11c400ceaf72 tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] RBAC: Authorizing `identity:check_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:16.220212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ccf6f-0dac-4d5a-816e-11c400ceaf72 tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:16.231364 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2683/5388] 10.222.0.20 () {56 vars in 1264 bytes} [Thu Oct 27 03:47:16 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Oct 27 03:47:16.232335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ccf6f-0dac-4d5a-816e-11c400ceaf72 tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:16.233742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e71ccf6f-0dac-4d5a-816e-11c400ceaf72 tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:16.244217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1739c730-ead2-4317-8ff8-2ece29578650 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6401728941de4c058cb3dc1993d3a254'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:16.249673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1739c730-ead2-4317-8ff8-2ece29578650 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6401728941de4c058cb3dc1993d3a254'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:16.387626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1739c730-ead2-4317-8ff8-2ece29578650 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6401728941de4c058cb3dc1993d3a254'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:16.388511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1739c730-ead2-4317-8ff8-2ece29578650 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6401728941de4c058cb3dc1993d3a254'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:16.398902 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2706/5389] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:47:16 2022] PATCH /identity/v3/domains/6401728941de4c058cb3dc1993d3a254 => generated 276 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:16.400061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739c730-ead2-4317-8ff8-2ece29578650 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:16.403389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1739c730-ead2-4317-8ff8-2ece29578650 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:16.409284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ccf6f-0dac-4d5a-816e-11c400ceaf72 tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:16.473273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:16.511972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739c730-ead2-4317-8ff8-2ece29578650 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:16.520024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b1805-416a-4f4b-a2f1-aa201cd790ce tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30f94e1b136e40b3a3934e734e32904f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b5351c188a04a2ca93a475d21410dbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:16.522231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b1805-416a-4f4b-a2f1-aa201cd790ce tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:16.522231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b1805-416a-4f4b-a2f1-aa201cd790ce tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:16.522231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b1805-416a-4f4b-a2f1-aa201cd790ce tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:16.524043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fed035-84cc-4ee5-ad7a-e6ea16222474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:16.524387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-de3b1805-416a-4f4b-a2f1-aa201cd790ce tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:16.525094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fed035-84cc-4ee5-ad7a-e6ea16222474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:16.525385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fed035-84cc-4ee5-ad7a-e6ea16222474 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:16.525668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fed035-84cc-4ee5-ad7a-e6ea16222474 admin admin] PATH_INFO: `/v3/projects/8d9c581dca8b4895aeacf01687297bd2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:16.527106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fed035-84cc-4ee5-ad7a-e6ea16222474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d9c581dca8b4895aeacf01687297bd2)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:16.529353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fed035-84cc-4ee5-ad7a-e6ea16222474 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:16.536050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b1805-416a-4f4b-a2f1-aa201cd790ce tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:16.538266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b1805-416a-4f4b-a2f1-aa201cd790ce tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:16.547244 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2707/5390] 10.222.0.20 () {56 vars in 1263 bytes} [Thu Oct 27 03:47:16 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:16.558718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b1805-416a-4f4b-a2f1-aa201cd790ce tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:16.561059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-de3b1805-416a-4f4b-a2f1-aa201cd790ce tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:16.633215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:16.649585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b1805-416a-4f4b-a2f1-aa201cd790ce tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:16.656506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71b37d51fdaf45a98b419989db43c374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b579d7bca31743ee90996be0e718deea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:16.660698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:16.660698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:16.660698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] PATH_INFO: `/v3/domains/6401728941de4c058cb3dc1993d3a254` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:16.671019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6401728941de4c058cb3dc1993d3a254)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:16.673176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:16.723589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-31fed035-84cc-4ee5-ad7a-e6ea16222474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d9c581dca8b4895aeacf01687297bd2', 'request_id': 'req-31fed035-84cc-4ee5-ad7a-e6ea16222474'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:16.744824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6401728941de4c058cb3dc1993d3a254'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:16.766176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6401728941de4c058cb3dc1993d3a254'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:16.858906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-31fed035-84cc-4ee5-ad7a-e6ea16222474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d9c581dca8b4895aeacf01687297bd2', 'request_id': 'req-31fed035-84cc-4ee5-ad7a-e6ea16222474'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:16.868144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-31fed035-84cc-4ee5-ad7a-e6ea16222474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d9c581dca8b4895aeacf01687297bd2', 'request_id': 'req-31fed035-84cc-4ee5-ad7a-e6ea16222474'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:16.890790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-31fed035-84cc-4ee5-ad7a-e6ea16222474 admin admin] The token cache is being invalidate because project 8d9c581dca8b4895aeacf01687297bd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:16.891491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-31fed035-84cc-4ee5-ad7a-e6ea16222474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:16.891931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-31fed035-84cc-4ee5-ad7a-e6ea16222474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:16.896880 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2684/5391] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:16 2022] DELETE /identity/v3/projects/8d9c581dca8b4895aeacf01687297bd2 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:16.897873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fed035-84cc-4ee5-ad7a-e6ea16222474 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:16.899356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-31fed035-84cc-4ee5-ad7a-e6ea16222474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:16.958738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6401728941de4c058cb3dc1993d3a254', 'request_id': 'req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:16.965254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6401728941de4c058cb3dc1993d3a254', 'request_id': 'req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:16.980747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6401728941de4c058cb3dc1993d3a254', 'request_id': 'req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:17.031095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fed035-84cc-4ee5-ad7a-e6ea16222474 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:17.066796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] The token cache is being invalidate because project 6401728941de4c058cb3dc1993d3a254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:17.067178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:17.069089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:17.094186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe4da5-46b1-49fa-b579-166c583354ee tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30f94e1b136e40b3a3934e734e32904f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b5351c188a04a2ca93a475d21410dbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:17.094991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe4da5-46b1-49fa-b579-166c583354ee tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:17.095349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe4da5-46b1-49fa-b579-166c583354ee tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:17.095849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe4da5-46b1-49fa-b579-166c583354ee tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:17.096338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6401728941de4c058cb3dc1993d3a254', 'request_id': 'req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:17.098189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7fbe4da5-46b1-49fa-b579-166c583354ee tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:17.098832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6401728941de4c058cb3dc1993d3a254', 'request_id': 'req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:17.099672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6401728941de4c058cb3dc1993d3a254', 'request_id': 'req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:17.106975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe4da5-46b1-49fa-b579-166c583354ee tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:17.108983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe4da5-46b1-49fa-b579-166c583354ee tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:17.125243 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2708/5392] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:47:16 2022] DELETE /identity/v3/domains/6401728941de4c058cb3dc1993d3a254 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:17.126460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:17.129470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:17.202499 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2685/5393] 10.222.0.20 () {56 vars in 1266 bytes} [Thu Oct 27 03:47:16 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:17.204542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65fa68-1848-4043-b245-f3c1b67a3c01 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:17.204854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65fa68-1848-4043-b245-f3c1b67a3c01 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:17.205992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65fa68-1848-4043-b245-f3c1b67a3c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:17.254269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:17.257423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-fd65fa68-1848-4043-b245-f3c1b67a3c01 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:17.258958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fd65fa68-1848-4043-b245-f3c1b67a3c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:17.295288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c81d11-cbea-4fbc-8e38-b6ac4d968a57 tempest-UsersV3TestJSON-21675624 tempest-UsersV3TestJSON-21675624-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:17.300652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1700b95-a9e8-4dce-8c4f-00a0d72bb388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:17.301323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1700b95-a9e8-4dce-8c4f-00a0d72bb388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:17.301615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1700b95-a9e8-4dce-8c4f-00a0d72bb388 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:17.301894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1700b95-a9e8-4dce-8c4f-00a0d72bb388 admin admin] PATH_INFO: `/v3/projects/c5e4420c80d2408692aaff1f0ac89f90` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:17.303165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1700b95-a9e8-4dce-8c4f-00a0d72bb388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5e4420c80d2408692aaff1f0ac89f90)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:17.305024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1700b95-a9e8-4dce-8c4f-00a0d72bb388 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:17.335061 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2686/5394] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:17.335957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65fa68-1848-4043-b245-f3c1b67a3c01 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:17.339477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fd65fa68-1848-4043-b245-f3c1b67a3c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:17.359022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65fa68-1848-4043-b245-f3c1b67a3c01 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:17.364195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c8c93-baea-4733-b91b-d283cb87df05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:17.365144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c8c93-baea-4733-b91b-d283cb87df05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:17.365430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c8c93-baea-4733-b91b-d283cb87df05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:17.365753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c8c93-baea-4733-b91b-d283cb87df05 admin admin] PATH_INFO: `/v3/users/0ccc048ad9414170a8c0e97d1b65938a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:17.366950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c8c93-baea-4733-b91b-d283cb87df05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ccc048ad9414170a8c0e97d1b65938a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:17.369184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c8c93-baea-4733-b91b-d283cb87df05 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:17.417994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b1700b95-a9e8-4dce-8c4f-00a0d72bb388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e4420c80d2408692aaff1f0ac89f90', 'request_id': 'req-b1700b95-a9e8-4dce-8c4f-00a0d72bb388'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:17.425603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b1700b95-a9e8-4dce-8c4f-00a0d72bb388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e4420c80d2408692aaff1f0ac89f90', 'request_id': 'req-b1700b95-a9e8-4dce-8c4f-00a0d72bb388'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:17.431165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b1700b95-a9e8-4dce-8c4f-00a0d72bb388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e4420c80d2408692aaff1f0ac89f90', 'request_id': 'req-b1700b95-a9e8-4dce-8c4f-00a0d72bb388'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:17.503923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b1700b95-a9e8-4dce-8c4f-00a0d72bb388 admin admin] The token cache is being invalidate because project c5e4420c80d2408692aaff1f0ac89f90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:17.504305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b1700b95-a9e8-4dce-8c4f-00a0d72bb388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:17.505056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b1700b95-a9e8-4dce-8c4f-00a0d72bb388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:17.507055 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2709/5395] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:17 2022] DELETE /identity/v3/projects/c5e4420c80d2408692aaff1f0ac89f90 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:17.511483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1700b95-a9e8-4dce-8c4f-00a0d72bb388 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:17.513278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b1700b95-a9e8-4dce-8c4f-00a0d72bb388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:17.605215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1700b95-a9e8-4dce-8c4f-00a0d72bb388 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:17.618859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18464470-a849-433c-bb05-f6f08ce611c1 tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30f94e1b136e40b3a3934e734e32904f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b5351c188a04a2ca93a475d21410dbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:17.628822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18464470-a849-433c-bb05-f6f08ce611c1 tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] REQUEST_METHOD: `HEAD` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:17.628822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18464470-a849-433c-bb05-f6f08ce611c1 tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:17.628822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18464470-a849-433c-bb05-f6f08ce611c1 tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:17.628822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-18464470-a849-433c-bb05-f6f08ce611c1 tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:17.653524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:17.680290 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-18464470-a849-433c-bb05-f6f08ce611c1 tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 27 03:47:17.680290 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:47:17.680290 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:47:17.680290 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:47:17.680290 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:47:17.680290 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:47:17.680290 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:47:17.680290 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:47:17.680290 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:47:17.680290 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:47:17.680290 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:47:17.680290 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:47:17.680290 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Oct 27 03:47:17.680290 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Oct 27 03:47:17.680290 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 27 03:47:17.681473 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 27 03:47:17.681473 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 27 03:47:17.681473 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 27 03:47:17.681473 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:47:17.681473 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:47:17.681473 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 27 03:47:17.681473 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 27 03:47:17.681473 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 27 03:47:17.681473 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 27 03:47:17.681473 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:47:17.681473 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:47:17.681473 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 27 03:47:17.681473 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 27 03:47:17.681473 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:47:17.681473 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:47:17.681473 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 27 03:47:17.681473 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 27 03:47:17.682967 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:47:17.682967 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:47:17.682967 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 27 03:47:17.682967 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 27 03:47:17.682967 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 27 03:47:17.682967 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:47:17.682967 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2710/5396] 10.222.0.20 () {56 vars in 1264 bytes} [Thu Oct 27 03:47:17 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Oct 27 03:47:17.684035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f40c8c93-baea-4733-b91b-d283cb87df05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ccc048ad9414170a8c0e97d1b65938a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:17.684613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9d03d-a9f6-4c4c-a16e-d77e6ad9969d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:17.684734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f40c8c93-baea-4733-b91b-d283cb87df05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ccc048ad9414170a8c0e97d1b65938a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:17.685104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9d03d-a9f6-4c4c-a16e-d77e6ad9969d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:17.688600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9d03d-a9f6-4c4c-a16e-d77e6ad9969d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:17.699620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f40c8c93-baea-4733-b91b-d283cb87df05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ccc048ad9414170a8c0e97d1b65938a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:17.747301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-69f9d03d-a9f6-4c4c-a16e-d77e6ad9969d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:17.747301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-69f9d03d-a9f6-4c4c-a16e-d77e6ad9969d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:17.750385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f40c8c93-baea-4733-b91b-d283cb87df05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ccc048ad9414170a8c0e97d1b65938a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:17.820924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f40c8c93-baea-4733-b91b-d283cb87df05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ccc048ad9414170a8c0e97d1b65938a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:17.831047 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2711/5397] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:17.831266 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2687/5398] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:17 2022] DELETE /identity/v3/users/0ccc048ad9414170a8c0e97d1b65938a => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:17.831464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9d03d-a9f6-4c4c-a16e-d77e6ad9969d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:17.831554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5a4aa-9373-4a0d-84c8-cf2472955593 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:17.831554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5a4aa-9373-4a0d-84c8-cf2472955593 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:17.831554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5a4aa-9373-4a0d-84c8-cf2472955593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:17.832970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-69f9d03d-a9f6-4c4c-a16e-d77e6ad9969d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:17.845316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9d03d-a9f6-4c4c-a16e-d77e6ad9969d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:17.852087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-66f5a4aa-9373-4a0d-84c8-cf2472955593 None None] MFA Rules not processed for user `30f94e1b136e40b3a3934e734e32904f`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:17.857298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-66f5a4aa-9373-4a0d-84c8-cf2472955593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:17.857298 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2688/5399] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:17 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:47:17.859002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5a4aa-9373-4a0d-84c8-cf2472955593 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:17.927343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f56b8-ed89-43a3-b7d4-3c65d10da8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:17.928004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f56b8-ed89-43a3-b7d4-3c65d10da8ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:17.928368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f56b8-ed89-43a3-b7d4-3c65d10da8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:17.928649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f56b8-ed89-43a3-b7d4-3c65d10da8ff admin admin] PATH_INFO: `/v3/users/76ae92bdb7464f52af032dc9626dab57` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:17.930008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f56b8-ed89-43a3-b7d4-3c65d10da8ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=76ae92bdb7464f52af032dc9626dab57)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:17.931464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5a4aa-9373-4a0d-84c8-cf2472955593 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:17.932159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f56b8-ed89-43a3-b7d4-3c65d10da8ff admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:17.937715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433cf3b-5a16-44d5-838b-c7e7f88bfd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:17.938468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433cf3b-5a16-44d5-838b-c7e7f88bfd15 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:17.939251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433cf3b-5a16-44d5-838b-c7e7f88bfd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:17.939251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433cf3b-5a16-44d5-838b-c7e7f88bfd15 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:17.939856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433cf3b-5a16-44d5-838b-c7e7f88bfd15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:47:17.940332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433cf3b-5a16-44d5-838b-c7e7f88bfd15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:17.942134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433cf3b-5a16-44d5-838b-c7e7f88bfd15 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:17.964264 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2689/5400] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:17.964264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0051a-bf48-4c84-9cb0-3fd4e53da7c9 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:17.964264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0051a-bf48-4c84-9cb0-3fd4e53da7c9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:17.964264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0051a-bf48-4c84-9cb0-3fd4e53da7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:17.987281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-29f0051a-bf48-4c84-9cb0-3fd4e53da7c9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:17.988641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-29f0051a-bf48-4c84-9cb0-3fd4e53da7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:18.003086 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2690/5401] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:18.004023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0051a-bf48-4c84-9cb0-3fd4e53da7c9 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:18.005483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-29f0051a-bf48-4c84-9cb0-3fd4e53da7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:18.094972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0051a-bf48-4c84-9cb0-3fd4e53da7c9 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:18.099504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e7cf5-645e-46f8-8605-31b36ebc3071 tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30f94e1b136e40b3a3934e734e32904f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b5351c188a04a2ca93a475d21410dbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:18.100104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e7cf5-645e-46f8-8605-31b36ebc3071 tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:18.100391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e7cf5-645e-46f8-8605-31b36ebc3071 tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:18.100864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e7cf5-645e-46f8-8605-31b36ebc3071 tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:18.107344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e7cf5-645e-46f8-8605-31b36ebc3071 tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:18.109703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e7cf5-645e-46f8-8605-31b36ebc3071 tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:18.119061 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2691/5402] 10.222.0.20 () {56 vars in 1263 bytes} [Thu Oct 27 03:47:18 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:18.119061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e7cf5-645e-46f8-8605-31b36ebc3071 tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:18.128778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e7cf5-645e-46f8-8605-31b36ebc3071 tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:18.133723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e9c27-8f53-43d5-9e27-3ca46491d1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:18.134471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e9c27-8f53-43d5-9e27-3ca46491d1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:18.134936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e9c27-8f53-43d5-9e27-3ca46491d1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:18.135286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e9c27-8f53-43d5-9e27-3ca46491d1d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:18.136280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e9c27-8f53-43d5-9e27-3ca46491d1d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:18.138000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e9c27-8f53-43d5-9e27-3ca46491d1d9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:18.185785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-543f56b8-ed89-43a3-b7d4-3c65d10da8ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76ae92bdb7464f52af032dc9626dab57'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:18.188498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-543f56b8-ed89-43a3-b7d4-3c65d10da8ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76ae92bdb7464f52af032dc9626dab57'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:18.202452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-543f56b8-ed89-43a3-b7d4-3c65d10da8ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76ae92bdb7464f52af032dc9626dab57'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:18.223096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-543f56b8-ed89-43a3-b7d4-3c65d10da8ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76ae92bdb7464f52af032dc9626dab57'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:18.224176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-543f56b8-ed89-43a3-b7d4-3c65d10da8ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76ae92bdb7464f52af032dc9626dab57'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:18.251547 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2692/5403] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:47:18 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:18.252965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e9c27-8f53-43d5-9e27-3ca46491d1d9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:18.255375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0a2e9c27-8f53-43d5-9e27-3ca46491d1d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:18.309422 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2712/5404] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:17 2022] DELETE /identity/v3/users/76ae92bdb7464f52af032dc9626dab57 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:18.320964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f56b8-ed89-43a3-b7d4-3c65d10da8ff admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:18.324545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e9c27-8f53-43d5-9e27-3ca46491d1d9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:18.338448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-543f56b8-ed89-43a3-b7d4-3c65d10da8ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:18.488137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd82ab0-8670-444b-b8c8-7a1e6daf69a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:18.489326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd82ab0-8670-444b-b8c8-7a1e6daf69a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:18.489326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd82ab0-8670-444b-b8c8-7a1e6daf69a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:18.489797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd82ab0-8670-444b-b8c8-7a1e6daf69a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:18.492641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fbd82ab0-8670-444b-b8c8-7a1e6daf69a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:18.506972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f56b8-ed89-43a3-b7d4-3c65d10da8ff admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:18.511596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec3cd4-bb6c-4f0c-b001-e0e09f79c98d tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30f94e1b136e40b3a3934e734e32904f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b5351c188a04a2ca93a475d21410dbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:18.512311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec3cd4-bb6c-4f0c-b001-e0e09f79c98d tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:18.512583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec3cd4-bb6c-4f0c-b001-e0e09f79c98d tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:18.512863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec3cd4-bb6c-4f0c-b001-e0e09f79c98d tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:18.516586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-32ec3cd4-bb6c-4f0c-b001-e0e09f79c98d tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:18.535346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec3cd4-bb6c-4f0c-b001-e0e09f79c98d tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:18.537560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec3cd4-bb6c-4f0c-b001-e0e09f79c98d tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:18.600646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd82ab0-8670-444b-b8c8-7a1e6daf69a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:18.605351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd82ab0-8670-444b-b8c8-7a1e6daf69a3 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:18.619079 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2693/5405] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:18.620495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd82ab0-8670-444b-b8c8-7a1e6daf69a3 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:18.632998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fbd82ab0-8670-444b-b8c8-7a1e6daf69a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:18.648381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd82ab0-8670-444b-b8c8-7a1e6daf69a3 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:18.653095 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2713/5406] 10.222.0.20 () {56 vars in 1266 bytes} [Thu Oct 27 03:47:18 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:18.658545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94665ec-0f1b-4625-a3e4-03f842b16772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:18.659404 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94665ec-0f1b-4625-a3e4-03f842b16772 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:18.662865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94665ec-0f1b-4625-a3e4-03f842b16772 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:18.662865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94665ec-0f1b-4625-a3e4-03f842b16772 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:18.662865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94665ec-0f1b-4625-a3e4-03f842b16772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:18.662865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94665ec-0f1b-4625-a3e4-03f842b16772 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:18.667311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec3cd4-bb6c-4f0c-b001-e0e09f79c98d tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:18.680223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec3cd4-bb6c-4f0c-b001-e0e09f79c98d tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:18.684969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233cb71-fbbf-46ca-a54a-052bbdb09c1f tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30f94e1b136e40b3a3934e734e32904f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b5351c188a04a2ca93a475d21410dbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:18.685413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233cb71-fbbf-46ca-a54a-052bbdb09c1f tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:18.685707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233cb71-fbbf-46ca-a54a-052bbdb09c1f tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:18.687004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233cb71-fbbf-46ca-a54a-052bbdb09c1f tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:18.689515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:18.691614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3233cb71-fbbf-46ca-a54a-052bbdb09c1f tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:18.705992 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-3233cb71-fbbf-46ca-a54a-052bbdb09c1f tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 27 03:47:18.705992 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:47:18.705992 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:47:18.705992 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:47:18.705992 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:47:18.705992 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:47:18.705992 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:47:18.705992 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:47:18.705992 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:47:18.705992 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:47:18.705992 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:47:18.705992 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:47:18.705992 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Oct 27 03:47:18.705992 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Oct 27 03:47:18.705992 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 27 03:47:18.707528 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 27 03:47:18.707528 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 27 03:47:18.707528 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 27 03:47:18.707528 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:47:18.707528 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:47:18.707528 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 27 03:47:18.707528 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 27 03:47:18.707528 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 27 03:47:18.707528 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 27 03:47:18.707528 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:47:18.707528 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:47:18.707528 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 27 03:47:18.707528 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 27 03:47:18.707528 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:47:18.707528 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:47:18.707528 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 27 03:47:18.707528 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 27 03:47:18.708932 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:47:18.708932 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:47:18.708932 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 27 03:47:18.708932 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 27 03:47:18.708932 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 27 03:47:18.708932 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:47:18.714314 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2714/5407] 10.222.0.20 () {56 vars in 1263 bytes} [Thu Oct 27 03:47:18 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:47:18.718593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233cb71-fbbf-46ca-a54a-052bbdb09c1f tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:18.720477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3233cb71-fbbf-46ca-a54a-052bbdb09c1f tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:18.736505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233cb71-fbbf-46ca-a54a-052bbdb09c1f tempest-TokensV3Test-1159577459 tempest-TokensV3Test-1159577459-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:18.742341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e9d25-4e8f-4bf6-93ab-a92eb9992ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:18.743174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e9d25-4e8f-4bf6-93ab-a92eb9992ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:18.743554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e9d25-4e8f-4bf6-93ab-a92eb9992ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:18.744293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e9d25-4e8f-4bf6-93ab-a92eb9992ac7 admin admin] PATH_INFO: `/v3/users/30f94e1b136e40b3a3934e734e32904f` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:18.762815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e9d25-4e8f-4bf6-93ab-a92eb9992ac7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f94e1b136e40b3a3934e734e32904f)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:18.770567 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2694/5408] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:47:18 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:18.771732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94665ec-0f1b-4625-a3e4-03f842b16772 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:18.773990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e9d25-4e8f-4bf6-93ab-a92eb9992ac7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:18.791779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94665ec-0f1b-4625-a3e4-03f842b16772 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:18.804360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ac919-df32-4524-b15f-b8921508a216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:18.804994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ac919-df32-4524-b15f-b8921508a216 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:18.805276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ac919-df32-4524-b15f-b8921508a216 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:18.805554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ac919-df32-4524-b15f-b8921508a216 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:18.806252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ac919-df32-4524-b15f-b8921508a216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:18.807927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ac919-df32-4524-b15f-b8921508a216 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:18.832358 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2695/5409] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:47:18.833161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ac919-df32-4524-b15f-b8921508a216 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:18.852623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ac919-df32-4524-b15f-b8921508a216 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:18.871885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0b865-6570-4f79-a50c-cfe003ba8eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:18.871885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0b865-6570-4f79-a50c-cfe003ba8eaf admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:18.872271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0b865-6570-4f79-a50c-cfe003ba8eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:18.872453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0b865-6570-4f79-a50c-cfe003ba8eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:18.873101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0b865-6570-4f79-a50c-cfe003ba8eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:18.875823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0b865-6570-4f79-a50c-cfe003ba8eaf admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:18.894905 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2696/5410] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:18.899673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0b865-6570-4f79-a50c-cfe003ba8eaf admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:18.911876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0b865-6570-4f79-a50c-cfe003ba8eaf admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:18.917542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9985aa6-a837-4605-822c-c3be49f4573e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:18.918740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9985aa6-a837-4605-822c-c3be49f4573e admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:18.919034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9985aa6-a837-4605-822c-c3be49f4573e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:18.919315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9985aa6-a837-4605-822c-c3be49f4573e admin admin] PATH_INFO: `/v3/projects/eddec9cdc1494d088043f44c7bac537b/users/73bd244d596d4968a35fcb6154bd07d9/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:18.948322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9985aa6-a837-4605-822c-c3be49f4573e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eddec9cdc1494d088043f44c7bac537b, user_id=73bd244d596d4968a35fcb6154bd07d9, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:18.951284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9985aa6-a837-4605-822c-c3be49f4573e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:19.081945 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2697/5411] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:18 2022] PUT /identity/v3/projects/eddec9cdc1494d088043f44c7bac537b/users/73bd244d596d4968a35fcb6154bd07d9/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:47:19.094177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cea645-0258-431a-84ce-022cf368ff89 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:19.094593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cea645-0258-431a-84ce-022cf368ff89 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:19.095595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cea645-0258-431a-84ce-022cf368ff89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:19.114683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e32e9d25-4e8f-4bf6-93ab-a92eb9992ac7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f94e1b136e40b3a3934e734e32904f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:19.115382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e32e9d25-4e8f-4bf6-93ab-a92eb9992ac7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f94e1b136e40b3a3934e734e32904f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:19.125151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:19.132827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e32e9d25-4e8f-4bf6-93ab-a92eb9992ac7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f94e1b136e40b3a3934e734e32904f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:19.185587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f4cea645-0258-431a-84ce-022cf368ff89 None None] MFA Rules not processed for user `73bd244d596d4968a35fcb6154bd07d9`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:19.187586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e32e9d25-4e8f-4bf6-93ab-a92eb9992ac7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f94e1b136e40b3a3934e734e32904f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:19.189288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e32e9d25-4e8f-4bf6-93ab-a92eb9992ac7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f94e1b136e40b3a3934e734e32904f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:19.195337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f4cea645-0258-431a-84ce-022cf368ff89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:19.298356 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2715/5412] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:18 2022] DELETE /identity/v3/users/30f94e1b136e40b3a3934e734e32904f => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:19.302841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e9d25-4e8f-4bf6-93ab-a92eb9992ac7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:19.307899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e32e9d25-4e8f-4bf6-93ab-a92eb9992ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:19.340546 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2698/5413] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:19.340546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298ec6b-f56c-4e21-aa7d-bcb82ccb6fef None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:19.340546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298ec6b-f56c-4e21-aa7d-bcb82ccb6fef None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:19.340546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298ec6b-f56c-4e21-aa7d-bcb82ccb6fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:19.362553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d298ec6b-f56c-4e21-aa7d-bcb82ccb6fef None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:19.363826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d298ec6b-f56c-4e21-aa7d-bcb82ccb6fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:19.393257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e9d25-4e8f-4bf6-93ab-a92eb9992ac7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:19.400599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cdf6a-0953-4ef2-8f43-46d7d7566679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:19.400599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cdf6a-0953-4ef2-8f43-46d7d7566679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:19.400599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cdf6a-0953-4ef2-8f43-46d7d7566679 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:19.400599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cdf6a-0953-4ef2-8f43-46d7d7566679 admin admin] PATH_INFO: `/v3/projects/21d64140b2aa4a1683fbaefcfb0d70e5` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:19.401915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cdf6a-0953-4ef2-8f43-46d7d7566679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21d64140b2aa4a1683fbaefcfb0d70e5)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:19.404226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cdf6a-0953-4ef2-8f43-46d7d7566679 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:19.441557 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2699/5414] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:19.444490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298ec6b-f56c-4e21-aa7d-bcb82ccb6fef None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:19.444490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d298ec6b-f56c-4e21-aa7d-bcb82ccb6fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:19.509303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298ec6b-f56c-4e21-aa7d-bcb82ccb6fef None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:19.515685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ccabd-ff12-49c7-9ef6-7c64ce0c94f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:19.516220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ccabd-ff12-49c7-9ef6-7c64ce0c94f4 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:19.516499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ccabd-ff12-49c7-9ef6-7c64ce0c94f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:19.516768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ccabd-ff12-49c7-9ef6-7c64ce0c94f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:19.579988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e30cdf6a-0953-4ef2-8f43-46d7d7566679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21d64140b2aa4a1683fbaefcfb0d70e5', 'request_id': 'req-e30cdf6a-0953-4ef2-8f43-46d7d7566679'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:19.588117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ccabd-ff12-49c7-9ef6-7c64ce0c94f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:19.588332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e30cdf6a-0953-4ef2-8f43-46d7d7566679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21d64140b2aa4a1683fbaefcfb0d70e5', 'request_id': 'req-e30cdf6a-0953-4ef2-8f43-46d7d7566679'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:19.591253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ccabd-ff12-49c7-9ef6-7c64ce0c94f4 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:19.594785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e30cdf6a-0953-4ef2-8f43-46d7d7566679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21d64140b2aa4a1683fbaefcfb0d70e5', 'request_id': 'req-e30cdf6a-0953-4ef2-8f43-46d7d7566679'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:19.604151 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2700/5415] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:19.605200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ccabd-ff12-49c7-9ef6-7c64ce0c94f4 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:19.606721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4b1ccabd-ff12-49c7-9ef6-7c64ce0c94f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:19.687711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e30cdf6a-0953-4ef2-8f43-46d7d7566679 admin admin] The token cache is being invalidate because project 21d64140b2aa4a1683fbaefcfb0d70e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:19.690594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e30cdf6a-0953-4ef2-8f43-46d7d7566679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:19.692175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e30cdf6a-0953-4ef2-8f43-46d7d7566679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:19.698654 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2716/5416] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:19 2022] DELETE /identity/v3/projects/21d64140b2aa4a1683fbaefcfb0d70e5 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:19.701355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cdf6a-0953-4ef2-8f43-46d7d7566679 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:19.705593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e30cdf6a-0953-4ef2-8f43-46d7d7566679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:19.712157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ccabd-ff12-49c7-9ef6-7c64ce0c94f4 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:19.775419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15205a3f-71c8-4ed9-80a0-7330ab908c52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:19.776341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15205a3f-71c8-4ed9-80a0-7330ab908c52 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:19.777212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15205a3f-71c8-4ed9-80a0-7330ab908c52 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:19.778171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15205a3f-71c8-4ed9-80a0-7330ab908c52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:19.782187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-15205a3f-71c8-4ed9-80a0-7330ab908c52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:19.847540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cdf6a-0953-4ef2-8f43-46d7d7566679 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:19.860995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b3872-8f7b-46c2-9daf-8f2ddff2a602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:19.861805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b3872-8f7b-46c2-9daf-8f2ddff2a602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:19.862111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b3872-8f7b-46c2-9daf-8f2ddff2a602 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:19.862391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b3872-8f7b-46c2-9daf-8f2ddff2a602 admin admin] PATH_INFO: `/v3/projects/6aa971f3c0064d2ea2fc853b1679d128` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:19.863792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b3872-8f7b-46c2-9daf-8f2ddff2a602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa971f3c0064d2ea2fc853b1679d128)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:19.865906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b3872-8f7b-46c2-9daf-8f2ddff2a602 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:19.879522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15205a3f-71c8-4ed9-80a0-7330ab908c52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:19.882092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15205a3f-71c8-4ed9-80a0-7330ab908c52 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:19.900094 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2701/5417] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:19.909195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9c80b-8e93-4688-8019-832601d1b71b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:19.909332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9c80b-8e93-4688-8019-832601d1b71b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:19.909757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9c80b-8e93-4688-8019-832601d1b71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:19.936002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-3aa9c80b-8e93-4688-8019-832601d1b71b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:19.938641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3aa9c80b-8e93-4688-8019-832601d1b71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:19.960286 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2702/5418] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:19.962095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dedf6-548d-4d83-bec8-d392303c92ef None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:19.962401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dedf6-548d-4d83-bec8-d392303c92ef None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:19.962679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dedf6-548d-4d83-bec8-d392303c92ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:19.994290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-989dedf6-548d-4d83-bec8-d392303c92ef None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:19.995636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-989dedf6-548d-4d83-bec8-d392303c92ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:20.007617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cd8b3872-8f7b-46c2-9daf-8f2ddff2a602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa971f3c0064d2ea2fc853b1679d128', 'request_id': 'req-cd8b3872-8f7b-46c2-9daf-8f2ddff2a602'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:20.035762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cd8b3872-8f7b-46c2-9daf-8f2ddff2a602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa971f3c0064d2ea2fc853b1679d128', 'request_id': 'req-cd8b3872-8f7b-46c2-9daf-8f2ddff2a602'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:20.060872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cd8b3872-8f7b-46c2-9daf-8f2ddff2a602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa971f3c0064d2ea2fc853b1679d128', 'request_id': 'req-cd8b3872-8f7b-46c2-9daf-8f2ddff2a602'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:20.064342 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2703/5419] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:20.070834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dedf6-548d-4d83-bec8-d392303c92ef None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:20.081384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dedf6-548d-4d83-bec8-d392303c92ef None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:20.089953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879c5ec-e90d-406a-ad0a-ca926f38a55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:20.091152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879c5ec-e90d-406a-ad0a-ca926f38a55b admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:20.091624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879c5ec-e90d-406a-ad0a-ca926f38a55b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:20.092000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879c5ec-e90d-406a-ad0a-ca926f38a55b admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:20.093386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879c5ec-e90d-406a-ad0a-ca926f38a55b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:47:20.093726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879c5ec-e90d-406a-ad0a-ca926f38a55b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:20.095872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879c5ec-e90d-406a-ad0a-ca926f38a55b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:20.119671 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2704/5420] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:20.123526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879c5ec-e90d-406a-ad0a-ca926f38a55b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:20.134650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879c5ec-e90d-406a-ad0a-ca926f38a55b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:20.164016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cd8b3872-8f7b-46c2-9daf-8f2ddff2a602 admin admin] The token cache is being invalidate because project 6aa971f3c0064d2ea2fc853b1679d128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:20.164016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cd8b3872-8f7b-46c2-9daf-8f2ddff2a602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:20.164259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55bf0d-61dc-43ed-af7e-6631cfb3f98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:20.164259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55bf0d-61dc-43ed-af7e-6631cfb3f98d admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:20.165422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55bf0d-61dc-43ed-af7e-6631cfb3f98d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:20.165568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cd8b3872-8f7b-46c2-9daf-8f2ddff2a602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:20.165668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55bf0d-61dc-43ed-af7e-6631cfb3f98d admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:20.166014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef55bf0d-61dc-43ed-af7e-6631cfb3f98d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:20.169043 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2717/5421] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:19 2022] DELETE /identity/v3/projects/6aa971f3c0064d2ea2fc853b1679d128 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:20.169241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef55bf0d-61dc-43ed-af7e-6631cfb3f98d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:20.177965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b3872-8f7b-46c2-9daf-8f2ddff2a602 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:20.181642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cd8b3872-8f7b-46c2-9daf-8f2ddff2a602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:20.204338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b3872-8f7b-46c2-9daf-8f2ddff2a602 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:20.212890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:20.215354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d2094-2348-4e22-b34b-6c9951a67597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:20.216018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d2094-2348-4e22-b34b-6c9951a67597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:20.216295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d2094-2348-4e22-b34b-6c9951a67597 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:20.216574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d2094-2348-4e22-b34b-6c9951a67597 admin admin] PATH_INFO: `/v3/users/71b37d51fdaf45a98b419989db43c374` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:20.218440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d2094-2348-4e22-b34b-6c9951a67597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71b37d51fdaf45a98b419989db43c374)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:20.221344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d2094-2348-4e22-b34b-6c9951a67597 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:20.305571 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2705/5422] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:47:20 2022] POST /identity/v3/projects => generated 369 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:47:20.309497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55bf0d-61dc-43ed-af7e-6631cfb3f98d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:20.312438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ef55bf0d-61dc-43ed-af7e-6631cfb3f98d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:20.389885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55bf0d-61dc-43ed-af7e-6631cfb3f98d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:20.400849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6dafac-faef-48d5-8086-46ea8d0da5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:20.401667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6dafac-faef-48d5-8086-46ea8d0da5c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:20.402054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6dafac-faef-48d5-8086-46ea8d0da5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:20.402722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6dafac-faef-48d5-8086-46ea8d0da5c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:20.405450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6dafac-faef-48d5-8086-46ea8d0da5c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:20.406584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6dafac-faef-48d5-8086-46ea8d0da5c0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:20.522068 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2706/5423] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:47:20 2022] POST /identity/v3/users => generated 285 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:47:20.523256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6dafac-faef-48d5-8086-46ea8d0da5c0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:20.537230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6dafac-faef-48d5-8086-46ea8d0da5c0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:20.540841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba733058-fc6d-45cb-ab38-4f1febe63133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:20.541541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba733058-fc6d-45cb-ab38-4f1febe63133 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:20.541963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba733058-fc6d-45cb-ab38-4f1febe63133 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:20.542319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba733058-fc6d-45cb-ab38-4f1febe63133 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:20.543043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba733058-fc6d-45cb-ab38-4f1febe63133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:20.545031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba733058-fc6d-45cb-ab38-4f1febe63133 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:20.558630 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2707/5424] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:20.558630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba733058-fc6d-45cb-ab38-4f1febe63133 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:20.561275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ba733058-fc6d-45cb-ab38-4f1febe63133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:20.569865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ec4d2094-2348-4e22-b34b-6c9951a67597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71b37d51fdaf45a98b419989db43c374'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:20.570656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ec4d2094-2348-4e22-b34b-6c9951a67597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71b37d51fdaf45a98b419989db43c374'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:20.586615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ec4d2094-2348-4e22-b34b-6c9951a67597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71b37d51fdaf45a98b419989db43c374'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:20.588791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba733058-fc6d-45cb-ab38-4f1febe63133 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:20.604516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508eef2b-d465-4441-b921-7e8eab04845f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:20.605172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508eef2b-d465-4441-b921-7e8eab04845f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:20.605469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508eef2b-d465-4441-b921-7e8eab04845f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:20.605733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508eef2b-d465-4441-b921-7e8eab04845f admin admin] PATH_INFO: `/v3/projects/0b5351c188a04a2ca93a475d21410dbe` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:20.607699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508eef2b-d465-4441-b921-7e8eab04845f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b5351c188a04a2ca93a475d21410dbe)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:20.611690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ec4d2094-2348-4e22-b34b-6c9951a67597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71b37d51fdaf45a98b419989db43c374'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:20.612643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ec4d2094-2348-4e22-b34b-6c9951a67597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71b37d51fdaf45a98b419989db43c374'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:20.615284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508eef2b-d465-4441-b921-7e8eab04845f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:20.644480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:20.701597 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2718/5425] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:20 2022] DELETE /identity/v3/users/71b37d51fdaf45a98b419989db43c374 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:47:20.703312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d2094-2348-4e22-b34b-6c9951a67597 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:20.704770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ec4d2094-2348-4e22-b34b-6c9951a67597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:20.779905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d2094-2348-4e22-b34b-6c9951a67597 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:20.787153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-508eef2b-d465-4441-b921-7e8eab04845f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b5351c188a04a2ca93a475d21410dbe', 'request_id': 'req-508eef2b-d465-4441-b921-7e8eab04845f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:20.848608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec508a8-24cc-42a8-b4eb-d4f0527bc4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:20.849586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec508a8-24cc-42a8-b4eb-d4f0527bc4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:20.852904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec508a8-24cc-42a8-b4eb-d4f0527bc4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:20.852904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec508a8-24cc-42a8-b4eb-d4f0527bc4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:20.852904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec508a8-24cc-42a8-b4eb-d4f0527bc4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:20.862822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec508a8-24cc-42a8-b4eb-d4f0527bc4f2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:20.881308 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2719/5426] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:20.882568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec508a8-24cc-42a8-b4eb-d4f0527bc4f2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:20.896277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-508eef2b-d465-4441-b921-7e8eab04845f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b5351c188a04a2ca93a475d21410dbe', 'request_id': 'req-508eef2b-d465-4441-b921-7e8eab04845f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:20.897198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec508a8-24cc-42a8-b4eb-d4f0527bc4f2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:20.904162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50b4e1-0c0e-4008-9d0d-76abf50f5732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:20.905537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50b4e1-0c0e-4008-9d0d-76abf50f5732 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:20.905827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50b4e1-0c0e-4008-9d0d-76abf50f5732 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:20.906154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50b4e1-0c0e-4008-9d0d-76abf50f5732 admin admin] PATH_INFO: `/v3/projects/7fe1feec153247a5912efabd4819dcab/users/0beb08a9f02c44d78e2995f64bc0e5da/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:20.912281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-508eef2b-d465-4441-b921-7e8eab04845f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b5351c188a04a2ca93a475d21410dbe', 'request_id': 'req-508eef2b-d465-4441-b921-7e8eab04845f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:20.951502 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-508eef2b-d465-4441-b921-7e8eab04845f admin admin] The token cache is being invalidate because project 0b5351c188a04a2ca93a475d21410dbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:20.952381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-508eef2b-d465-4441-b921-7e8eab04845f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:20.953614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-508eef2b-d465-4441-b921-7e8eab04845f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:20.954747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50b4e1-0c0e-4008-9d0d-76abf50f5732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe1feec153247a5912efabd4819dcab, user_id=0beb08a9f02c44d78e2995f64bc0e5da, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:20.957520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50b4e1-0c0e-4008-9d0d-76abf50f5732 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:20.960102 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2708/5427] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:20 2022] DELETE /identity/v3/projects/0b5351c188a04a2ca93a475d21410dbe => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:20.968227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abe11f-a2c5-4886-8df7-55fbaee6f750 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:20.968837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abe11f-a2c5-4886-8df7-55fbaee6f750 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:20.968837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abe11f-a2c5-4886-8df7-55fbaee6f750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:20.997626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e2abe11f-a2c5-4886-8df7-55fbaee6f750 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:20.999677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e2abe11f-a2c5-4886-8df7-55fbaee6f750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:21.015567 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2709/5428] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:21.022953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66670404-db8e-483e-a3fc-ab1abf1375a6 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:21.023244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66670404-db8e-483e-a3fc-ab1abf1375a6 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:21.023531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66670404-db8e-483e-a3fc-ab1abf1375a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:21.067771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-66670404-db8e-483e-a3fc-ab1abf1375a6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:21.069065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-66670404-db8e-483e-a3fc-ab1abf1375a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:21.097416 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2720/5429] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:20 2022] PUT /identity/v3/projects/7fe1feec153247a5912efabd4819dcab/users/0beb08a9f02c44d78e2995f64bc0e5da/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:21.099068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f7ae5-2ac8-47af-9853-c66eb8bed5aa None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:21.099359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f7ae5-2ac8-47af-9853-c66eb8bed5aa None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:21.099638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f7ae5-2ac8-47af-9853-c66eb8bed5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:21.109164 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2710/5430] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:47:21.115581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66670404-db8e-483e-a3fc-ab1abf1375a6 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:21.134222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66670404-db8e-483e-a3fc-ab1abf1375a6 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:21.155421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3d8f7ae5-2ac8-47af-9853-c66eb8bed5aa None None] MFA Rules not processed for user `0beb08a9f02c44d78e2995f64bc0e5da`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:21.156672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3d8f7ae5-2ac8-47af-9853-c66eb8bed5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:21.234400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736610ce-3db5-47db-874c-435d4d4799bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:21.235346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736610ce-3db5-47db-874c-435d4d4799bf admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:21.235976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736610ce-3db5-47db-874c-435d4d4799bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:21.236302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736610ce-3db5-47db-874c-435d4d4799bf admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:21.237070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736610ce-3db5-47db-874c-435d4d4799bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:47:21.238403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736610ce-3db5-47db-874c-435d4d4799bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:21.242772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736610ce-3db5-47db-874c-435d4d4799bf admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:21.273326 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2711/5431] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:21.277941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736610ce-3db5-47db-874c-435d4d4799bf admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:21.290429 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2721/5432] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:21.300325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f7ae5-2ac8-47af-9853-c66eb8bed5aa None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:21.301059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736610ce-3db5-47db-874c-435d4d4799bf admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:21.301882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3d8f7ae5-2ac8-47af-9853-c66eb8bed5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:21.323362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f7ae5-2ac8-47af-9853-c66eb8bed5aa None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:21.336381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667bc61-703a-4795-bca6-e0dddb226233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:21.337260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667bc61-703a-4795-bca6-e0dddb226233 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:21.337928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667bc61-703a-4795-bca6-e0dddb226233 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:21.338623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667bc61-703a-4795-bca6-e0dddb226233 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:21.340067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667bc61-703a-4795-bca6-e0dddb226233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:21.340894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16670cea-973b-4253-9853-1afc8759f5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:21.343416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16670cea-973b-4253-9853-1afc8759f5f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:21.344884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667bc61-703a-4795-bca6-e0dddb226233 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:21.347723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16670cea-973b-4253-9853-1afc8759f5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:21.348005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16670cea-973b-4253-9853-1afc8759f5f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:21.348833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16670cea-973b-4253-9853-1afc8759f5f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:21.351774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16670cea-973b-4253-9853-1afc8759f5f1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:21.510372 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2712/5433] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:47:21 2022] POST /identity/v3/projects => generated 385 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:21.511517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667bc61-703a-4795-bca6-e0dddb226233 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:21.549567 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2722/5434] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:47:21 2022] POST /identity/v3/projects => generated 369 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:21.551961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16670cea-973b-4253-9853-1afc8759f5f1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:21.555433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-16670cea-973b-4253-9853-1afc8759f5f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:21.662902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667bc61-703a-4795-bca6-e0dddb226233 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:21.688922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16670cea-973b-4253-9853-1afc8759f5f1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:21.694338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7157dd-3ec9-4095-9f4a-fdaa2ce87c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:21.695065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7157dd-3ec9-4095-9f4a-fdaa2ce87c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:21.695348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7157dd-3ec9-4095-9f4a-fdaa2ce87c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:21.695630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7157dd-3ec9-4095-9f4a-fdaa2ce87c57 admin admin] PATH_INFO: `/v3/projects/b579d7bca31743ee90996be0e718deea` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:21.696907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7157dd-3ec9-4095-9f4a-fdaa2ce87c57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b579d7bca31743ee90996be0e718deea)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:21.699200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7157dd-3ec9-4095-9f4a-fdaa2ce87c57 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:21.735919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73db3bc-c3e2-45bb-a43c-f114f6070c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:21.736822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73db3bc-c3e2-45bb-a43c-f114f6070c9a admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:21.737106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73db3bc-c3e2-45bb-a43c-f114f6070c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:21.737383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73db3bc-c3e2-45bb-a43c-f114f6070c9a admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:21.738019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73db3bc-c3e2-45bb-a43c-f114f6070c9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:21.739987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73db3bc-c3e2-45bb-a43c-f114f6070c9a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:21.844849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cc7157dd-3ec9-4095-9f4a-fdaa2ce87c57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b579d7bca31743ee90996be0e718deea', 'request_id': 'req-cc7157dd-3ec9-4095-9f4a-fdaa2ce87c57'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:21.853865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cc7157dd-3ec9-4095-9f4a-fdaa2ce87c57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b579d7bca31743ee90996be0e718deea', 'request_id': 'req-cc7157dd-3ec9-4095-9f4a-fdaa2ce87c57'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:21.860421 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2713/5435] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:47:21 2022] POST /identity/v3/users => generated 293 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:21.860421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73db3bc-c3e2-45bb-a43c-f114f6070c9a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:21.865429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cc7157dd-3ec9-4095-9f4a-fdaa2ce87c57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b579d7bca31743ee90996be0e718deea', 'request_id': 'req-cc7157dd-3ec9-4095-9f4a-fdaa2ce87c57'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:21.869497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73db3bc-c3e2-45bb-a43c-f114f6070c9a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:21.932550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6935497-3c00-446c-a19e-e9a3503f26cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:21.933560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6935497-3c00-446c-a19e-e9a3503f26cc admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:21.933786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6935497-3c00-446c-a19e-e9a3503f26cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:21.934069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6935497-3c00-446c-a19e-e9a3503f26cc admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:21.934716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6935497-3c00-446c-a19e-e9a3503f26cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:21.937288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6935497-3c00-446c-a19e-e9a3503f26cc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:21.957940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:21.959785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cc7157dd-3ec9-4095-9f4a-fdaa2ce87c57 admin admin] The token cache is being invalidate because project b579d7bca31743ee90996be0e718deea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:21.960088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cc7157dd-3ec9-4095-9f4a-fdaa2ce87c57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:21.960771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cc7157dd-3ec9-4095-9f4a-fdaa2ce87c57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:21.962705 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2723/5436] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:21 2022] DELETE /identity/v3/projects/b579d7bca31743ee90996be0e718deea => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:21.964248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7157dd-3ec9-4095-9f4a-fdaa2ce87c57 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:21.966056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cc7157dd-3ec9-4095-9f4a-fdaa2ce87c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:21.981220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7157dd-3ec9-4095-9f4a-fdaa2ce87c57 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:21.985225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4d56e-eb16-4eed-983a-7aedbdf6f341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:21.986124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4d56e-eb16-4eed-983a-7aedbdf6f341 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:21.986370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4d56e-eb16-4eed-983a-7aedbdf6f341 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:21.986650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4d56e-eb16-4eed-983a-7aedbdf6f341 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:21.987307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4d56e-eb16-4eed-983a-7aedbdf6f341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:21.988950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4d56e-eb16-4eed-983a-7aedbdf6f341 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:22.005382 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2724/5437] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:22.007546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cde49f-11e9-4c9c-9a35-0a1e5b24da56 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:22.007854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cde49f-11e9-4c9c-9a35-0a1e5b24da56 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:22.008399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cde49f-11e9-4c9c-9a35-0a1e5b24da56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:22.039042 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2714/5438] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:47:21 2022] POST /identity/v3/users => generated 291 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:22.040069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6935497-3c00-446c-a19e-e9a3503f26cc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:22.056866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e1cde49f-11e9-4c9c-9a35-0a1e5b24da56 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:22.058064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e1cde49f-11e9-4c9c-9a35-0a1e5b24da56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:22.062320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6935497-3c00-446c-a19e-e9a3503f26cc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:22.067580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a07c8-fd40-4966-9d30-db6b983b8f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:22.068434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a07c8-fd40-4966-9d30-db6b983b8f7c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:22.068888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a07c8-fd40-4966-9d30-db6b983b8f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:22.069334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a07c8-fd40-4966-9d30-db6b983b8f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:22.070195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a07c8-fd40-4966-9d30-db6b983b8f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:22.072100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a07c8-fd40-4966-9d30-db6b983b8f7c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:22.074559 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2725/5439] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:22.076470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cde49f-11e9-4c9c-9a35-0a1e5b24da56 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:22.078522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e1cde49f-11e9-4c9c-9a35-0a1e5b24da56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:22.089929 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2715/5440] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:22.093997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70e4f6-e885-4d1e-bbd0-bc0ae12f977d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:22.093997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70e4f6-e885-4d1e-bbd0-bc0ae12f977d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:22.099952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cde49f-11e9-4c9c-9a35-0a1e5b24da56 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:22.105248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9223a5c-a44a-4f9e-a5d8-da97cf69b84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:22.105745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70e4f6-e885-4d1e-bbd0-bc0ae12f977d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:22.106146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9223a5c-a44a-4f9e-a5d8-da97cf69b84a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:22.106267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9223a5c-a44a-4f9e-a5d8-da97cf69b84a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:22.106532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9223a5c-a44a-4f9e-a5d8-da97cf69b84a admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:22.107175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9223a5c-a44a-4f9e-a5d8-da97cf69b84a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:22.109435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9223a5c-a44a-4f9e-a5d8-da97cf69b84a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:22.125338 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2726/5441] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:22.125338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9223a5c-a44a-4f9e-a5d8-da97cf69b84a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:22.134494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9223a5c-a44a-4f9e-a5d8-da97cf69b84a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:22.136984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6a70e4f6-e885-4d1e-bbd0-bc0ae12f977d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:22.138241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6a70e4f6-e885-4d1e-bbd0-bc0ae12f977d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:22.139414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b3c0c-9fd2-42fc-8fd1-8df126f81399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:22.140047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b3c0c-9fd2-42fc-8fd1-8df126f81399 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:22.145212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b3c0c-9fd2-42fc-8fd1-8df126f81399 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:22.145212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b3c0c-9fd2-42fc-8fd1-8df126f81399 admin admin] PATH_INFO: `/v3/projects/b670380d5ef14d77af2ffda2eb7bef2d/users/60f4c9c46d744457b656db3f63d9be68/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:22.145431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:22.148434 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2716/5442] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:22.149213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70e4f6-e885-4d1e-bbd0-bc0ae12f977d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:22.155795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b3c0c-9fd2-42fc-8fd1-8df126f81399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b670380d5ef14d77af2ffda2eb7bef2d, user_id=60f4c9c46d744457b656db3f63d9be68, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:22.158498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b3c0c-9fd2-42fc-8fd1-8df126f81399 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:22.159031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70e4f6-e885-4d1e-bbd0-bc0ae12f977d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:22.163935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe6e6b-de77-4097-98ae-86717634c1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:22.164614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe6e6b-de77-4097-98ae-86717634c1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:22.164894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe6e6b-de77-4097-98ae-86717634c1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:22.165167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe6e6b-de77-4097-98ae-86717634c1d5 admin admin] PATH_INFO: `/v3/projects/82f9c3b82eff463299b608d8df625cbb/users/b0e2e074e6ac4d2a815a754bfadc1a52/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:22.180540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe6e6b-de77-4097-98ae-86717634c1d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82f9c3b82eff463299b608d8df625cbb, user_id=b0e2e074e6ac4d2a815a754bfadc1a52, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:22.183487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe6e6b-de77-4097-98ae-86717634c1d5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:22.244114 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2727/5443] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:22 2022] PUT /identity/v3/projects/b670380d5ef14d77af2ffda2eb7bef2d/users/60f4c9c46d744457b656db3f63d9be68/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:22.245051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b3c0c-9fd2-42fc-8fd1-8df126f81399 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:22.305393 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2717/5444] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:22 2022] PUT /identity/v3/projects/82f9c3b82eff463299b608d8df625cbb/users/b0e2e074e6ac4d2a815a754bfadc1a52/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:22.306693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152fa9d-3566-4421-8df4-ab058c8c46ee None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:22.307032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152fa9d-3566-4421-8df4-ab058c8c46ee None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:22.307264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152fa9d-3566-4421-8df4-ab058c8c46ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:22.313571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b3c0c-9fd2-42fc-8fd1-8df126f81399 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:22.346015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1152fa9d-3566-4421-8df4-ab058c8c46ee None None] MFA Rules not processed for user `60f4c9c46d744457b656db3f63d9be68`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:22.347398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1152fa9d-3566-4421-8df4-ab058c8c46ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:22.490366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714d4b8-e62a-426a-a588-1e17528186fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:22.492271 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2718/5445] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:22.493204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152fa9d-3566-4421-8df4-ab058c8c46ee None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:22.494051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714d4b8-e62a-426a-a588-1e17528186fa admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:22.494488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714d4b8-e62a-426a-a588-1e17528186fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:22.494851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714d4b8-e62a-426a-a588-1e17528186fa admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:22.495629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714d4b8-e62a-426a-a588-1e17528186fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:47:22.496066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714d4b8-e62a-426a-a588-1e17528186fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:22.497720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714d4b8-e62a-426a-a588-1e17528186fa admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:22.511218 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2728/5446] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:22.515542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714d4b8-e62a-426a-a588-1e17528186fa admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:22.519693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152fa9d-3566-4421-8df4-ab058c8c46ee None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:22.529380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714d4b8-e62a-426a-a588-1e17528186fa admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:22.532269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05274f-1a10-4233-ad90-d3043297a280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:22.533895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa02371-312e-4281-985d-80f065de0f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:22.534705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa02371-312e-4281-985d-80f065de0f8b admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:22.534903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05274f-1a10-4233-ad90-d3043297a280 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:22.535188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa02371-312e-4281-985d-80f065de0f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:22.535744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa02371-312e-4281-985d-80f065de0f8b admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:22.536102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05274f-1a10-4233-ad90-d3043297a280 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:22.537211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa02371-312e-4281-985d-80f065de0f8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:22.538349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05274f-1a10-4233-ad90-d3043297a280 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:22.539007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa02371-312e-4281-985d-80f065de0f8b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:22.539877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05274f-1a10-4233-ad90-d3043297a280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:22.543336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05274f-1a10-4233-ad90-d3043297a280 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:22.562843 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2719/5447] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:22.564245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05274f-1a10-4233-ad90-d3043297a280 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:22.587324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05274f-1a10-4233-ad90-d3043297a280 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:22.600548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5b5a7-075d-466a-9c8b-286650c435fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:22.601366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5b5a7-075d-466a-9c8b-286650c435fb admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:22.602951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5b5a7-075d-466a-9c8b-286650c435fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:22.603406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5b5a7-075d-466a-9c8b-286650c435fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:22.615935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5b5a7-075d-466a-9c8b-286650c435fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:22.615935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5b5a7-075d-466a-9c8b-286650c435fb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:22.677553 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2729/5448] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:47:22 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:22.678667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa02371-312e-4281-985d-80f065de0f8b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:22.720315 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2720/5449] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:47:22 2022] POST /identity/v3/projects => generated 367 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:22.720315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5b5a7-075d-466a-9c8b-286650c435fb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:22.837515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa02371-312e-4281-985d-80f065de0f8b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:22.851850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5b5a7-075d-466a-9c8b-286650c435fb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:22.860606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44785c94-47a1-4e42-9384-ae40e82c71c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:22.861231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44785c94-47a1-4e42-9384-ae40e82c71c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:22.861518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44785c94-47a1-4e42-9384-ae40e82c71c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:22.861798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44785c94-47a1-4e42-9384-ae40e82c71c9 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:22.862469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44785c94-47a1-4e42-9384-ae40e82c71c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:22.869563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44785c94-47a1-4e42-9384-ae40e82c71c9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:22.934872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e895d9-9a0a-4146-a36e-32f26d347ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:22.935759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e895d9-9a0a-4146-a36e-32f26d347ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:22.936095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e895d9-9a0a-4146-a36e-32f26d347ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:22.936478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e895d9-9a0a-4146-a36e-32f26d347ebf admin admin] PATH_INFO: `/v3/projects/82f9c3b82eff463299b608d8df625cbb/users/b0e2e074e6ac4d2a815a754bfadc1a52/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:22.939522 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2721/5450] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:47:22 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:22.940888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb95fc-456f-4fa0-a8ce-1a467bca627e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:22.941185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb95fc-456f-4fa0-a8ce-1a467bca627e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:22.941468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb95fc-456f-4fa0-a8ce-1a467bca627e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:22.943312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e895d9-9a0a-4146-a36e-32f26d347ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=82f9c3b82eff463299b608d8df625cbb, user_id=b0e2e074e6ac4d2a815a754bfadc1a52, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:22.947309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e895d9-9a0a-4146-a36e-32f26d347ebf admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:22.965459 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2730/5451] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:22 2022] PUT /identity/v3/projects/82f9c3b82eff463299b608d8df625cbb/users/b0e2e074e6ac4d2a815a754bfadc1a52/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:22.966484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e895d9-9a0a-4146-a36e-32f26d347ebf admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:22.978914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-aabb95fc-456f-4fa0-a8ce-1a467bca627e None None] MFA Rules not processed for user `b4dae167878b41699b8caae5a0386cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:22.980987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-aabb95fc-456f-4fa0-a8ce-1a467bca627e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:23.036776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:23.061579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:23.087092 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2722/5452] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:22 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:23.093181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb95fc-456f-4fa0-a8ce-1a467bca627e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:23.160352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e895d9-9a0a-4146-a36e-32f26d347ebf admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:23.170398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6844836-21d1-4b13-a09d-6b7837c96307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:23.171362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6844836-21d1-4b13-a09d-6b7837c96307 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:23.171865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6844836-21d1-4b13-a09d-6b7837c96307 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:23.172237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6844836-21d1-4b13-a09d-6b7837c96307 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:23.172914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6844836-21d1-4b13-a09d-6b7837c96307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:23.175063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6844836-21d1-4b13-a09d-6b7837c96307 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:23.214230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb95fc-456f-4fa0-a8ce-1a467bca627e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:23.219400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7ec27-5d0b-4153-bcdc-ec0b6996d495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:23.220027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7ec27-5d0b-4153-bcdc-ec0b6996d495 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:23.220314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7ec27-5d0b-4153-bcdc-ec0b6996d495 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:23.220596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7ec27-5d0b-4153-bcdc-ec0b6996d495 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:23.221340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7ec27-5d0b-4153-bcdc-ec0b6996d495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:23.223066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7ec27-5d0b-4153-bcdc-ec0b6996d495 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:23.237632 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2723/5453] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:23.237632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768bb47-e63b-4a8f-ad29-665bae17bd85 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:23.237632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768bb47-e63b-4a8f-ad29-665bae17bd85 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:23.237632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768bb47-e63b-4a8f-ad29-665bae17bd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:23.266067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9768bb47-e63b-4a8f-ad29-665bae17bd85 None None] MFA Rules not processed for user `b0e2e074e6ac4d2a815a754bfadc1a52`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:23.267273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9768bb47-e63b-4a8f-ad29-665bae17bd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:23.286129 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2731/5454] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:47:22 2022] POST /identity/v3/users => generated 284 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:23.286129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c3d4e-2f66-4456-9483-c98b4373db9a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:23.286129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c3d4e-2f66-4456-9483-c98b4373db9a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:23.287196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c3d4e-2f66-4456-9483-c98b4373db9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:23.308160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e64c3d4e-2f66-4456-9483-c98b4373db9a None None] MFA Rules not processed for user `b4dae167878b41699b8caae5a0386cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:23.309411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e64c3d4e-2f66-4456-9483-c98b4373db9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:23.318111 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2732/5455] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:23 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:23.318974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c3d4e-2f66-4456-9483-c98b4373db9a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:23.340561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c3d4e-2f66-4456-9483-c98b4373db9a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:23.363541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71edb02-8a59-4ded-9057-f8ba704c5394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:23.364239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71edb02-8a59-4ded-9057-f8ba704c5394 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:23.364685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71edb02-8a59-4ded-9057-f8ba704c5394 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:23.365159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71edb02-8a59-4ded-9057-f8ba704c5394 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:23.365989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71edb02-8a59-4ded-9057-f8ba704c5394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:23.367861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71edb02-8a59-4ded-9057-f8ba704c5394 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:23.381511 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2733/5456] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:23.384664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71edb02-8a59-4ded-9057-f8ba704c5394 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:23.384803 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2724/5457] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:23.386006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae02fa2-2b35-4bed-805c-7129a6b6fa7b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:23.386321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae02fa2-2b35-4bed-805c-7129a6b6fa7b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:23.386596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae02fa2-2b35-4bed-805c-7129a6b6fa7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:23.399727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71edb02-8a59-4ded-9057-f8ba704c5394 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:23.405385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf3830-c1e4-4759-835d-ab2d2638d195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:23.406118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf3830-c1e4-4759-835d-ab2d2638d195 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:23.406394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf3830-c1e4-4759-835d-ab2d2638d195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:23.406672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf3830-c1e4-4759-835d-ab2d2638d195 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:23.406922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6ae02fa2-2b35-4bed-805c-7129a6b6fa7b None None] MFA Rules not processed for user `b4dae167878b41699b8caae5a0386cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:23.407319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf3830-c1e4-4759-835d-ab2d2638d195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:23.408123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6ae02fa2-2b35-4bed-805c-7129a6b6fa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:23.408987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf3830-c1e4-4759-835d-ab2d2638d195 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:23.416060 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2725/5458] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:23 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:23.422177 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2734/5459] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:23.422177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf3830-c1e4-4759-835d-ab2d2638d195 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:23.426954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae02fa2-2b35-4bed-805c-7129a6b6fa7b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:23.448133 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf3830-c1e4-4759-835d-ab2d2638d195 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:23.457837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae02fa2-2b35-4bed-805c-7129a6b6fa7b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:23.457837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075ae5d-097c-455b-b890-f3db43f23d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:23.458554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075ae5d-097c-455b-b890-f3db43f23d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:23.458644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075ae5d-097c-455b-b890-f3db43f23d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:23.458929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075ae5d-097c-455b-b890-f3db43f23d1e admin admin] PATH_INFO: `/v3/projects/15f4334612dc4adb91bcc6c9a466b6c5/users/341577a547a842c4a48d23f3d64b3d51/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:23.466882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208f256-3069-42d6-b086-aacf0cd04552 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e2e074e6ac4d2a815a754bfadc1a52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f9c3b82eff463299b608d8df625cbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:23.468342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208f256-3069-42d6-b086-aacf0cd04552 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:23.468638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208f256-3069-42d6-b086-aacf0cd04552 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:23.468920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208f256-3069-42d6-b086-aacf0cd04552 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] PATH_INFO: `/v3/policies` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:23.470368 n-d-862769-1 devstack@keystone.service[82180]: WARNING oslo_log.versionutils [None req-2208f256-3069-42d6-b086-aacf0cd04552 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 27 03:47:23.470880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208f256-3069-42d6-b086-aacf0cd04552 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:23.472323 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-2208f256-3069-42d6-b086-aacf0cd04552 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:23.472323 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:47:23.472323 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:47:23.473272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208f256-3069-42d6-b086-aacf0cd04552 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:23.477680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075ae5d-097c-455b-b890-f3db43f23d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f4334612dc4adb91bcc6c9a466b6c5, user_id=341577a547a842c4a48d23f3d64b3d51, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:23.481064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075ae5d-097c-455b-b890-f3db43f23d1e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:23.573127 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2735/5460] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Oct 27 03:47:23 2022] POST /identity/v3/policies => generated 228 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:23.574220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208f256-3069-42d6-b086-aacf0cd04552 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:23.585409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208f256-3069-42d6-b086-aacf0cd04552 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:23.594226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fc8f8-a68f-4b7d-bf90-61262914f74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:23.594226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fc8f8-a68f-4b7d-bf90-61262914f74b admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:23.594226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fc8f8-a68f-4b7d-bf90-61262914f74b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:23.594226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fc8f8-a68f-4b7d-bf90-61262914f74b admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:23.595343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fc8f8-a68f-4b7d-bf90-61262914f74b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:23.595343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fc8f8-a68f-4b7d-bf90-61262914f74b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:23.596487 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2726/5461] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:23 2022] PUT /identity/v3/projects/15f4334612dc4adb91bcc6c9a466b6c5/users/341577a547a842c4a48d23f3d64b3d51/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:23.597544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1255f9-a700-4554-b9a4-eb6caaa11e65 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:23.597831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1255f9-a700-4554-b9a4-eb6caaa11e65 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:23.598132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1255f9-a700-4554-b9a4-eb6caaa11e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:23.617568 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2736/5462] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:23.617568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fc8f8-a68f-4b7d-bf90-61262914f74b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:23.617809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4f1255f9-a700-4554-b9a4-eb6caaa11e65 None None] MFA Rules not processed for user `b4dae167878b41699b8caae5a0386cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:23.618834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4f1255f9-a700-4554-b9a4-eb6caaa11e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:23.629890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fc8f8-a68f-4b7d-bf90-61262914f74b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:23.699497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd392ab1-c970-4113-b5e4-bd17a33a95a6 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e2e074e6ac4d2a815a754bfadc1a52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f9c3b82eff463299b608d8df625cbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:23.700949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd392ab1-c970-4113-b5e4-bd17a33a95a6 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:23.702324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd392ab1-c970-4113-b5e4-bd17a33a95a6 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:23.702796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd392ab1-c970-4113-b5e4-bd17a33a95a6 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] PATH_INFO: `/v3/policies/c3b5dbbe2d82498caef35f816142ff02` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:23.708113 n-d-862769-1 devstack@keystone.service[82180]: WARNING oslo_log.versionutils [None req-bd392ab1-c970-4113-b5e4-bd17a33a95a6 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 27 03:47:23.708113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd392ab1-c970-4113-b5e4-bd17a33a95a6 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=c3b5dbbe2d82498caef35f816142ff02)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:23.708113 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-bd392ab1-c970-4113-b5e4-bd17a33a95a6 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:23.708113 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:47:23.708113 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:47:23.708113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd392ab1-c970-4113-b5e4-bd17a33a95a6 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:23.712973 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2727/5463] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:23 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:23.714219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cefddc-8d15-4140-9676-836cb2b00c8b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:23.718579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cefddc-8d15-4140-9676-836cb2b00c8b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:23.718579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cefddc-8d15-4140-9676-836cb2b00c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:23.753552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-10cefddc-8d15-4140-9676-836cb2b00c8b None None] MFA Rules not processed for user `341577a547a842c4a48d23f3d64b3d51`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:23.754704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-10cefddc-8d15-4140-9676-836cb2b00c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:23.820091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:23.820260 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2737/5464] 10.222.0.20 () {60 vars in 1252 bytes} [Thu Oct 27 03:47:23 2022] PATCH /identity/v3/policies/c3b5dbbe2d82498caef35f816142ff02 => generated 236 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:23.821272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd392ab1-c970-4113-b5e4-bd17a33a95a6 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:23.878900 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2728/5465] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:23.880371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3095a3-2ffd-433a-b034-dd9925a6c993 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:23.880716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3095a3-2ffd-433a-b034-dd9925a6c993 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:23.880998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3095a3-2ffd-433a-b034-dd9925a6c993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:23.904044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9f3095a3-2ffd-433a-b034-dd9925a6c993 None None] MFA Rules not processed for user `b4dae167878b41699b8caae5a0386cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:23.905879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9f3095a3-2ffd-433a-b034-dd9925a6c993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:23.912733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd392ab1-c970-4113-b5e4-bd17a33a95a6 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:23.913178 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2729/5466] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:23 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:23.914007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3095a3-2ffd-433a-b034-dd9925a6c993 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:23.923667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6333dc7-2cdb-46d9-9b7f-11bf7ada82a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:23.925129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6333dc7-2cdb-46d9-9b7f-11bf7ada82a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:23.926649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6333dc7-2cdb-46d9-9b7f-11bf7ada82a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:23.926959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6333dc7-2cdb-46d9-9b7f-11bf7ada82a7 admin admin] PATH_INFO: `/v3/projects/e7f27f9d6448405ab6c873bf3236bb0a/users/f3e44c456e88478e9c7b8b5f8e8a74ef/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:23.943547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3095a3-2ffd-433a-b034-dd9925a6c993 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:23.952614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab2e8d-0980-497d-b002-1f37f66d316e tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e2e074e6ac4d2a815a754bfadc1a52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f9c3b82eff463299b608d8df625cbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:23.953511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab2e8d-0980-497d-b002-1f37f66d316e tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:23.954152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab2e8d-0980-497d-b002-1f37f66d316e tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:23.954652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab2e8d-0980-497d-b002-1f37f66d316e tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] PATH_INFO: `/v3/policies/c3b5dbbe2d82498caef35f816142ff02` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:23.960011 n-d-862769-1 devstack@keystone.service[82179]: WARNING oslo_log.versionutils [None req-8fab2e8d-0980-497d-b002-1f37f66d316e tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 27 03:47:23.960011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab2e8d-0980-497d-b002-1f37f66d316e tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=c3b5dbbe2d82498caef35f816142ff02)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:23.960011 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-8fab2e8d-0980-497d-b002-1f37f66d316e tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:23.960011 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:47:23.960011 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:47:23.960511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab2e8d-0980-497d-b002-1f37f66d316e tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:23.978376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6333dc7-2cdb-46d9-9b7f-11bf7ada82a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7f27f9d6448405ab6c873bf3236bb0a, user_id=f3e44c456e88478e9c7b8b5f8e8a74ef, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:23.981216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6333dc7-2cdb-46d9-9b7f-11bf7ada82a7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:23.984835 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2730/5467] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:47:23 2022] GET /identity/v3/policies/c3b5dbbe2d82498caef35f816142ff02 => generated 236 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:23.988070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab2e8d-0980-497d-b002-1f37f66d316e tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:23.989867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8fab2e8d-0980-497d-b002-1f37f66d316e tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:24.049669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:24.075462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab2e8d-0980-497d-b002-1f37f66d316e tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:24.080347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8b623-6cd0-41a5-bce7-184bb7679389 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:24.080900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8b623-6cd0-41a5-bce7-184bb7679389 service glance] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:24.081180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8b623-6cd0-41a5-bce7-184bb7679389 service glance] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:24.081453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8b623-6cd0-41a5-bce7-184bb7679389 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:24.113002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:24.125207 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2738/5468] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:23 2022] PUT /identity/v3/projects/e7f27f9d6448405ab6c873bf3236bb0a/users/f3e44c456e88478e9c7b8b5f8e8a74ef/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:24.135233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6333dc7-2cdb-46d9-9b7f-11bf7ada82a7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:24.187713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8b623-6cd0-41a5-bce7-184bb7679389 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:24.191206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8b623-6cd0-41a5-bce7-184bb7679389 service glance] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:24.208700 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2731/5469] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:24.209692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1002ae1-b226-4190-aefc-acc4736bfdfe None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:24.215336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1002ae1-b226-4190-aefc-acc4736bfdfe None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:24.215336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1002ae1-b226-4190-aefc-acc4736bfdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:24.231801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6333dc7-2cdb-46d9-9b7f-11bf7ada82a7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:24.237530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c61ac-2e1f-4dfd-997c-72a7f5f245b5 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e2e074e6ac4d2a815a754bfadc1a52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f9c3b82eff463299b608d8df625cbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:24.238631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c61ac-2e1f-4dfd-997c-72a7f5f245b5 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:24.239123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c61ac-2e1f-4dfd-997c-72a7f5f245b5 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:24.239631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c61ac-2e1f-4dfd-997c-72a7f5f245b5 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] PATH_INFO: `/v3/policies/c3b5dbbe2d82498caef35f816142ff02` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:24.240720 n-d-862769-1 devstack@keystone.service[82180]: WARNING oslo_log.versionutils [None req-295c61ac-2e1f-4dfd-997c-72a7f5f245b5 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 27 03:47:24.241353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c61ac-2e1f-4dfd-997c-72a7f5f245b5 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=c3b5dbbe2d82498caef35f816142ff02)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:24.242835 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-295c61ac-2e1f-4dfd-997c-72a7f5f245b5 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:24.242835 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:47:24.242835 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:47:24.244100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c61ac-2e1f-4dfd-997c-72a7f5f245b5 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:24.248336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e1002ae1-b226-4190-aefc-acc4736bfdfe None None] MFA Rules not processed for user `f3e44c456e88478e9c7b8b5f8e8a74ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:24.250260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e1002ae1-b226-4190-aefc-acc4736bfdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:24.335438 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2732/5470] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:24.339726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1002ae1-b226-4190-aefc-acc4736bfdfe None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:24.383380 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2739/5471] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:24 2022] DELETE /identity/v3/policies/c3b5dbbe2d82498caef35f816142ff02 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:24.388806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c61ac-2e1f-4dfd-997c-72a7f5f245b5 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:24.403730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c61ac-2e1f-4dfd-997c-72a7f5f245b5 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:24.409501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fd3df-6182-4c99-9d2c-698045179315 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e2e074e6ac4d2a815a754bfadc1a52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f9c3b82eff463299b608d8df625cbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:24.410360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fd3df-6182-4c99-9d2c-698045179315 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:24.410654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fd3df-6182-4c99-9d2c-698045179315 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:24.410938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fd3df-6182-4c99-9d2c-698045179315 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] PATH_INFO: `/v3/policies` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:24.412302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9fd3df-6182-4c99-9d2c-698045179315 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:24.414689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9fd3df-6182-4c99-9d2c-698045179315 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:24.458651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1002ae1-b226-4190-aefc-acc4736bfdfe None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:24.464121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef08331-2aee-478c-aff0-47d4034585f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:24.464914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef08331-2aee-478c-aff0-47d4034585f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:24.465378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef08331-2aee-478c-aff0-47d4034585f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:24.465658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef08331-2aee-478c-aff0-47d4034585f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:24.466390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef08331-2aee-478c-aff0-47d4034585f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:24.469335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef08331-2aee-478c-aff0-47d4034585f0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:24.531473 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2740/5472] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Oct 27 03:47:24 2022] POST /identity/v3/policies => generated 230 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:47:24.534217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fd3df-6182-4c99-9d2c-698045179315 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:24.543980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=11 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:24.553984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fd3df-6182-4c99-9d2c-698045179315 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:24.561714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b270d-ad5f-4ec0-a0e2-b371a9eefd50 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e2e074e6ac4d2a815a754bfadc1a52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f9c3b82eff463299b608d8df625cbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:24.562668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b270d-ad5f-4ec0-a0e2-b371a9eefd50 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:24.562960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b270d-ad5f-4ec0-a0e2-b371a9eefd50 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:24.563242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b270d-ad5f-4ec0-a0e2-b371a9eefd50 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] PATH_INFO: `/v3/policies` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:24.564447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b270d-ad5f-4ec0-a0e2-b371a9eefd50 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:24.566338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b270d-ad5f-4ec0-a0e2-b371a9eefd50 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:24.613965 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2733/5473] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:47:24 2022] POST /identity/v3/projects => generated 367 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:47:24.618161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef08331-2aee-478c-aff0-47d4034585f0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:24.652937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:24.692002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef08331-2aee-478c-aff0-47d4034585f0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:24.699516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7da33-0c52-4868-9c21-4e14d5f92f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:24.704339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7da33-0c52-4868-9c21-4e14d5f92f12 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:24.704779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7da33-0c52-4868-9c21-4e14d5f92f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:24.705196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7da33-0c52-4868-9c21-4e14d5f92f12 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:24.706003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7da33-0c52-4868-9c21-4e14d5f92f12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:24.708804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7da33-0c52-4868-9c21-4e14d5f92f12 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:24.747277 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2741/5474] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Oct 27 03:47:24 2022] POST /identity/v3/policies => generated 229 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:24.747277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b270d-ad5f-4ec0-a0e2-b371a9eefd50 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:24.866508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b270d-ad5f-4ec0-a0e2-b371a9eefd50 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:24.898551 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2734/5475] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:47:24 2022] POST /identity/v3/users => generated 290 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:24.899456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7da33-0c52-4868-9c21-4e14d5f92f12 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:24.918694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:24.930018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24eb180-883b-4cc8-8a39-058fff364411 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:24.931032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24eb180-883b-4cc8-8a39-058fff364411 service glance] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:24.932655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24eb180-883b-4cc8-8a39-058fff364411 service glance] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:24.933196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24eb180-883b-4cc8-8a39-058fff364411 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:25.025519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7da33-0c52-4868-9c21-4e14d5f92f12 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:25.033158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb46289-d0b9-492a-a887-b715da301ac9 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e2e074e6ac4d2a815a754bfadc1a52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f9c3b82eff463299b608d8df625cbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:25.033535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb46289-d0b9-492a-a887-b715da301ac9 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:25.033818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb46289-d0b9-492a-a887-b715da301ac9 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:25.034206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb46289-d0b9-492a-a887-b715da301ac9 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] PATH_INFO: `/v3/policies` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:25.038876 n-d-862769-1 devstack@keystone.service[82179]: WARNING oslo_log.versionutils [None req-cfb46289-d0b9-492a-a887-b715da301ac9 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 27 03:47:25.038876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb46289-d0b9-492a-a887-b715da301ac9 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:25.038876 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-cfb46289-d0b9-492a-a887-b715da301ac9 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:25.038876 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:47:25.038876 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:47:25.039448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb46289-d0b9-492a-a887-b715da301ac9 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:25.042599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24eb180-883b-4cc8-8a39-058fff364411 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:25.045944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24eb180-883b-4cc8-8a39-058fff364411 service glance] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:25.061733 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2742/5476] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:25.062670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24eb180-883b-4cc8-8a39-058fff364411 service glance] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:25.081711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24eb180-883b-4cc8-8a39-058fff364411 service glance] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:25.087408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab8618-eed3-4fd8-a7b9-7e76be1d875d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:25.088064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab8618-eed3-4fd8-a7b9-7e76be1d875d admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:25.088364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab8618-eed3-4fd8-a7b9-7e76be1d875d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:25.088629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab8618-eed3-4fd8-a7b9-7e76be1d875d admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:25.089287 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab8618-eed3-4fd8-a7b9-7e76be1d875d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:25.090959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab8618-eed3-4fd8-a7b9-7e76be1d875d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:25.102377 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2743/5477] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:25.110770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab8618-eed3-4fd8-a7b9-7e76be1d875d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:25.125677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab8618-eed3-4fd8-a7b9-7e76be1d875d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:25.129368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0017c-1ab3-465e-a8ab-1e7cb374c717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:25.130468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0017c-1ab3-465e-a8ab-1e7cb374c717 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:25.130827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0017c-1ab3-465e-a8ab-1e7cb374c717 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:25.133940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0017c-1ab3-465e-a8ab-1e7cb374c717 admin admin] PATH_INFO: `/v3/projects/cf4ddbe0bf5042118914f60088976a9d/users/bee3f95207404328bb5c999b41455540/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:25.134156 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2735/5478] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Oct 27 03:47:24 2022] POST /identity/v3/policies => generated 229 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:25.136407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb46289-d0b9-492a-a887-b715da301ac9 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:25.144032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:25.151053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0017c-1ab3-465e-a8ab-1e7cb374c717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf4ddbe0bf5042118914f60088976a9d, user_id=bee3f95207404328bb5c999b41455540, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:25.154915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0017c-1ab3-465e-a8ab-1e7cb374c717 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:25.165793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb46289-d0b9-492a-a887-b715da301ac9 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:25.180162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e041d75-26d3-447a-be10-afb0b5c01e15 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e2e074e6ac4d2a815a754bfadc1a52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f9c3b82eff463299b608d8df625cbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:25.182637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e041d75-26d3-447a-be10-afb0b5c01e15 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:25.182637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e041d75-26d3-447a-be10-afb0b5c01e15 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:25.182637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e041d75-26d3-447a-be10-afb0b5c01e15 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] PATH_INFO: `/v3/policies` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:25.182637 n-d-862769-1 devstack@keystone.service[82179]: WARNING oslo_log.versionutils [None req-9e041d75-26d3-447a-be10-afb0b5c01e15 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 27 03:47:25.183472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e041d75-26d3-447a-be10-afb0b5c01e15 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:25.184737 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-9e041d75-26d3-447a-be10-afb0b5c01e15 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:25.184737 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:47:25.184737 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:47:25.186571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e041d75-26d3-447a-be10-afb0b5c01e15 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:25.196807 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2736/5479] 10.222.0.20 () {58 vars in 1131 bytes} [Thu Oct 27 03:47:25 2022] GET /identity/v3/policies => generated 764 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:25.204106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e041d75-26d3-447a-be10-afb0b5c01e15 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:25.220869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e041d75-26d3-447a-be10-afb0b5c01e15 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:25.226646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aeb740-9ab3-4a96-93a6-c0ae0b4464fe tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e2e074e6ac4d2a815a754bfadc1a52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f9c3b82eff463299b608d8df625cbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:25.227433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aeb740-9ab3-4a96-93a6-c0ae0b4464fe tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:25.227825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aeb740-9ab3-4a96-93a6-c0ae0b4464fe tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:25.229233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aeb740-9ab3-4a96-93a6-c0ae0b4464fe tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] PATH_INFO: `/v3/policies/8bbd2177e4824a5c8090887d1205eb95` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:25.230579 n-d-862769-1 devstack@keystone.service[82179]: WARNING oslo_log.versionutils [None req-49aeb740-9ab3-4a96-93a6-c0ae0b4464fe tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 27 03:47:25.231851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aeb740-9ab3-4a96-93a6-c0ae0b4464fe tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=8bbd2177e4824a5c8090887d1205eb95)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:25.234152 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-49aeb740-9ab3-4a96-93a6-c0ae0b4464fe tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:25.234152 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:47:25.234152 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:47:25.235270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aeb740-9ab3-4a96-93a6-c0ae0b4464fe tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:25.242475 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2744/5480] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:25 2022] PUT /identity/v3/projects/cf4ddbe0bf5042118914f60088976a9d/users/bee3f95207404328bb5c999b41455540/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:25.247029 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0017c-1ab3-465e-a8ab-1e7cb374c717 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:25.341673 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2737/5481] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:25 2022] DELETE /identity/v3/policies/8bbd2177e4824a5c8090887d1205eb95 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:47:25.346928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aeb740-9ab3-4a96-93a6-c0ae0b4464fe tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:25.371344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0017c-1ab3-465e-a8ab-1e7cb374c717 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:25.371558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aeb740-9ab3-4a96-93a6-c0ae0b4464fe tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:25.377334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60bda7-d9be-43ae-92f3-32197aea0e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:25.377974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60bda7-d9be-43ae-92f3-32197aea0e56 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:25.378363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60bda7-d9be-43ae-92f3-32197aea0e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:25.378712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60bda7-d9be-43ae-92f3-32197aea0e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:25.379442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60bda7-d9be-43ae-92f3-32197aea0e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:25.381127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60bda7-d9be-43ae-92f3-32197aea0e56 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:25.397661 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2745/5482] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:25.399456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60bda7-d9be-43ae-92f3-32197aea0e56 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:25.411963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60bda7-d9be-43ae-92f3-32197aea0e56 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:25.416834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:25.419440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19810e13-177f-4988-ab29-f9ba0d1156fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:25.420702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19810e13-177f-4988-ab29-f9ba0d1156fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:25.421057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19810e13-177f-4988-ab29-f9ba0d1156fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:25.421808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19810e13-177f-4988-ab29-f9ba0d1156fc admin admin] PATH_INFO: `/v3/projects/cf4ddbe0bf5042118914f60088976a9d/users/bee3f95207404328bb5c999b41455540/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:25.424196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19810e13-177f-4988-ab29-f9ba0d1156fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf4ddbe0bf5042118914f60088976a9d, user_id=bee3f95207404328bb5c999b41455540, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:25.427742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19810e13-177f-4988-ab29-f9ba0d1156fc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:25.465867 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2746/5483] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:25 2022] PUT /identity/v3/projects/cf4ddbe0bf5042118914f60088976a9d/users/bee3f95207404328bb5c999b41455540/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:25.467011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93732e-872a-4e75-87a0-6ec96ce7d50c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:25.467405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93732e-872a-4e75-87a0-6ec96ce7d50c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:25.467749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93732e-872a-4e75-87a0-6ec96ce7d50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:25.479565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:25.519300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0b93732e-872a-4e75-87a0-6ec96ce7d50c None None] MFA Rules not processed for user `bee3f95207404328bb5c999b41455540`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:25.521350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0b93732e-872a-4e75-87a0-6ec96ce7d50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:25.550014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9f642-8a37-4c47-a1d9-859235ffba36 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e2e074e6ac4d2a815a754bfadc1a52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f9c3b82eff463299b608d8df625cbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:25.550721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9f642-8a37-4c47-a1d9-859235ffba36 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:25.550980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9f642-8a37-4c47-a1d9-859235ffba36 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:25.551260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9f642-8a37-4c47-a1d9-859235ffba36 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] PATH_INFO: `/v3/policies/97e6be7c38d84cc78361fcaaad2a5509` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:25.552402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9f642-8a37-4c47-a1d9-859235ffba36 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=97e6be7c38d84cc78361fcaaad2a5509)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:25.555508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9f642-8a37-4c47-a1d9-859235ffba36 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:25.646703 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2747/5484] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:25.652037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93732e-872a-4e75-87a0-6ec96ce7d50c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:25.652297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:25.659019 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2738/5485] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:25 2022] DELETE /identity/v3/policies/97e6be7c38d84cc78361fcaaad2a5509 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:25.664169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93732e-872a-4e75-87a0-6ec96ce7d50c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:25.665388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9f642-8a37-4c47-a1d9-859235ffba36 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:25.668745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d626709-ab7b-4fd7-9309-9500a8bb5aa9 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee3f95207404328bb5c999b41455540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ddbe0bf5042118914f60088976a9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:25.674086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d626709-ab7b-4fd7-9309-9500a8bb5aa9 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:25.674513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d626709-ab7b-4fd7-9309-9500a8bb5aa9 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:25.674875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d626709-ab7b-4fd7-9309-9500a8bb5aa9 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] PATH_INFO: `/v3/regions` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:25.675620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d626709-ab7b-4fd7-9309-9500a8bb5aa9 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:25.676788 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-7d626709-ab7b-4fd7-9309-9500a8bb5aa9 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:25.676788 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:47:25.676788 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:47:25.678418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d626709-ab7b-4fd7-9309-9500a8bb5aa9 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:25.684833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9f642-8a37-4c47-a1d9-859235ffba36 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:25.792476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:25.824358 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2748/5486] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:47:25 2022] POST /identity/v3/regions => generated 224 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:25.825278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d626709-ab7b-4fd7-9309-9500a8bb5aa9 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:25.835270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a601ca-46fe-4315-b2cc-6bd9ccb514f3 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e2e074e6ac4d2a815a754bfadc1a52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f9c3b82eff463299b608d8df625cbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:25.835932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a601ca-46fe-4315-b2cc-6bd9ccb514f3 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:25.836229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a601ca-46fe-4315-b2cc-6bd9ccb514f3 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:25.836513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a601ca-46fe-4315-b2cc-6bd9ccb514f3 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] PATH_INFO: `/v3/policies/3ae6ac71a8364f23a782a284c68515dd` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:25.837934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a601ca-46fe-4315-b2cc-6bd9ccb514f3 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=3ae6ac71a8364f23a782a284c68515dd)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:25.839853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a601ca-46fe-4315-b2cc-6bd9ccb514f3 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:25.869522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d626709-ab7b-4fd7-9309-9500a8bb5aa9 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:25.879369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4047998-b77a-4a67-9bd5-23f03a1b2f24 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee3f95207404328bb5c999b41455540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ddbe0bf5042118914f60088976a9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:25.879952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4047998-b77a-4a67-9bd5-23f03a1b2f24 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:25.881416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4047998-b77a-4a67-9bd5-23f03a1b2f24 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:25.881714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4047998-b77a-4a67-9bd5-23f03a1b2f24 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] PATH_INFO: `/v3/regions` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:25.882405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4047998-b77a-4a67-9bd5-23f03a1b2f24 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:25.884012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4047998-b77a-4a67-9bd5-23f03a1b2f24 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:25.958844 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2739/5487] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:25 2022] DELETE /identity/v3/policies/3ae6ac71a8364f23a782a284c68515dd => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:47:25.965246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a601ca-46fe-4315-b2cc-6bd9ccb514f3 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:25.993787 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2749/5488] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:47:25 2022] POST /identity/v3/regions => generated 224 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:25.995165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4047998-b77a-4a67-9bd5-23f03a1b2f24 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:26.032615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4047998-b77a-4a67-9bd5-23f03a1b2f24 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:26.042103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccc5f5-0218-463c-970d-e8444594ceed tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee3f95207404328bb5c999b41455540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ddbe0bf5042118914f60088976a9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:26.043216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccc5f5-0218-463c-970d-e8444594ceed tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:26.043522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccc5f5-0218-463c-970d-e8444594ceed tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:26.043803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccc5f5-0218-463c-970d-e8444594ceed tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] PATH_INFO: `/v3/regions/ff4e2f64-14ed-4411-89c1-1edee3589154` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:26.044539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccc5f5-0218-463c-970d-e8444594ceed tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorizing `identity:create_region(region_id=ff4e2f64-14ed-4411-89c1-1edee3589154)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:26.048551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccc5f5-0218-463c-970d-e8444594ceed tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:26.080538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a601ca-46fe-4315-b2cc-6bd9ccb514f3 tempest-PoliciesTestJSON-1791428740 tempest-PoliciesTestJSON-1791428740-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:26.098372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:26.107097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bef9bc-65ed-42b5-9478-f010f5c39d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:26.108925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bef9bc-65ed-42b5-9478-f010f5c39d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:26.108925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bef9bc-65ed-42b5-9478-f010f5c39d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:26.109107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bef9bc-65ed-42b5-9478-f010f5c39d6e admin admin] PATH_INFO: `/v3/users/0beb08a9f02c44d78e2995f64bc0e5da` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:26.110358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bef9bc-65ed-42b5-9478-f010f5c39d6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0beb08a9f02c44d78e2995f64bc0e5da)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:26.112309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bef9bc-65ed-42b5-9478-f010f5c39d6e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:26.155782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:26.175202 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2750/5489] 10.222.0.20 () {60 vars in 1259 bytes} [Thu Oct 27 03:47:25 2022] PUT /identity/v3/regions/ff4e2f64-14ed-4411-89c1-1edee3589154 => generated 232 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:26.176716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccc5f5-0218-463c-970d-e8444594ceed tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:26.225718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccc5f5-0218-463c-970d-e8444594ceed tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:26.251567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee725ed-267f-4296-8e21-3ba256b74869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:26.251567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee725ed-267f-4296-8e21-3ba256b74869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:26.251567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee725ed-267f-4296-8e21-3ba256b74869 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:26.254439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee725ed-267f-4296-8e21-3ba256b74869 admin admin] PATH_INFO: `/v3/users/60f4c9c46d744457b656db3f63d9be68` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:26.254439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee725ed-267f-4296-8e21-3ba256b74869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f4c9c46d744457b656db3f63d9be68)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:26.254873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee725ed-267f-4296-8e21-3ba256b74869 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:26.349984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-09bef9bc-65ed-42b5-9478-f010f5c39d6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0beb08a9f02c44d78e2995f64bc0e5da'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:26.353903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-09bef9bc-65ed-42b5-9478-f010f5c39d6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0beb08a9f02c44d78e2995f64bc0e5da'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:26.370739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-09bef9bc-65ed-42b5-9478-f010f5c39d6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0beb08a9f02c44d78e2995f64bc0e5da'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:26.405492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-09bef9bc-65ed-42b5-9478-f010f5c39d6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0beb08a9f02c44d78e2995f64bc0e5da'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:26.489485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-09bef9bc-65ed-42b5-9478-f010f5c39d6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0beb08a9f02c44d78e2995f64bc0e5da'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:26.496576 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2740/5490] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:25 2022] DELETE /identity/v3/users/0beb08a9f02c44d78e2995f64bc0e5da => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:47:26.500749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bef9bc-65ed-42b5-9478-f010f5c39d6e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:26.502281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-09bef9bc-65ed-42b5-9478-f010f5c39d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:26.523745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:26.546163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bee725ed-267f-4296-8e21-3ba256b74869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f4c9c46d744457b656db3f63d9be68'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:26.549296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bee725ed-267f-4296-8e21-3ba256b74869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f4c9c46d744457b656db3f63d9be68'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:26.564844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bee725ed-267f-4296-8e21-3ba256b74869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f4c9c46d744457b656db3f63d9be68'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:26.654534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bee725ed-267f-4296-8e21-3ba256b74869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f4c9c46d744457b656db3f63d9be68'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:26.656773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bee725ed-267f-4296-8e21-3ba256b74869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f4c9c46d744457b656db3f63d9be68'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:26.679786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bef9bc-65ed-42b5-9478-f010f5c39d6e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:26.715761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f49bb-391d-4252-a104-bf62f002efba tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee3f95207404328bb5c999b41455540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ddbe0bf5042118914f60088976a9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:26.718251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f49bb-391d-4252-a104-bf62f002efba tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:26.718922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f49bb-391d-4252-a104-bf62f002efba tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:26.719565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f49bb-391d-4252-a104-bf62f002efba tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] PATH_INFO: `/v3/regions/ff4e2f64-14ed-4411-89c1-1edee3589154` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:26.720446 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f49bb-391d-4252-a104-bf62f002efba tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorizing `identity:delete_region(region_id=ff4e2f64-14ed-4411-89c1-1edee3589154)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:26.721638 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-429f49bb-391d-4252-a104-bf62f002efba tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:26.721638 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:47:26.721638 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:47:26.723446 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f49bb-391d-4252-a104-bf62f002efba tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:26.751104 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2751/5491] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:26 2022] DELETE /identity/v3/users/60f4c9c46d744457b656db3f63d9be68 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:26.752897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41937180-ddaa-413f-ad0c-c872e64966dc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:26.753900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41937180-ddaa-413f-ad0c-c872e64966dc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:26.754981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41937180-ddaa-413f-ad0c-c872e64966dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:26.803813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-41937180-ddaa-413f-ad0c-c872e64966dc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:26.805251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-41937180-ddaa-413f-ad0c-c872e64966dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:26.894956 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2741/5492] 10.222.0.20 () {58 vars in 1242 bytes} [Thu Oct 27 03:47:26 2022] DELETE /identity/v3/regions/ff4e2f64-14ed-4411-89c1-1edee3589154 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:26.902350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207c4d2-068b-4184-95e4-141b0e4b22a2 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:26.902880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207c4d2-068b-4184-95e4-141b0e4b22a2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:26.903843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207c4d2-068b-4184-95e4-141b0e4b22a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:26.938761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-2207c4d2-068b-4184-95e4-141b0e4b22a2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:26.940518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2207c4d2-068b-4184-95e4-141b0e4b22a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:26.944865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:26.979662 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2742/5493] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:26.980855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207c4d2-068b-4184-95e4-141b0e4b22a2 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:26.989950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2207c4d2-068b-4184-95e4-141b0e4b22a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:26.996497 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2752/5494] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:26.997785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41937180-ddaa-413f-ad0c-c872e64966dc None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:27.000021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-41937180-ddaa-413f-ad0c-c872e64966dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:27.085727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41937180-ddaa-413f-ad0c-c872e64966dc None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:27.089713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65213132-0f4e-4171-be82-85de08433f31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:27.090394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65213132-0f4e-4171-be82-85de08433f31 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:27.090682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65213132-0f4e-4171-be82-85de08433f31 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:27.090957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65213132-0f4e-4171-be82-85de08433f31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:27.110312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65213132-0f4e-4171-be82-85de08433f31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:27.112325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65213132-0f4e-4171-be82-85de08433f31 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:27.122839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207c4d2-068b-4184-95e4-141b0e4b22a2 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:27.130949 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2753/5495] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:27.132218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65213132-0f4e-4171-be82-85de08433f31 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:27.132891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960c425-471b-47e0-b365-5acb7e7a839e tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee3f95207404328bb5c999b41455540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ddbe0bf5042118914f60088976a9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:27.133733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960c425-471b-47e0-b365-5acb7e7a839e tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:27.134288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960c425-471b-47e0-b365-5acb7e7a839e tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:27.134520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-65213132-0f4e-4171-be82-85de08433f31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:27.134931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960c425-471b-47e0-b365-5acb7e7a839e tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] PATH_INFO: `/v3/regions` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:27.135591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960c425-471b-47e0-b365-5acb7e7a839e tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:27.136815 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-8960c425-471b-47e0-b365-5acb7e7a839e tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:27.136815 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:47:27.136815 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:47:27.137773 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960c425-471b-47e0-b365-5acb7e7a839e tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:27.154649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65213132-0f4e-4171-be82-85de08433f31 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:27.166217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d911a0-c606-4486-a074-bb25d467a672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:27.166855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d911a0-c606-4486-a074-bb25d467a672 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:27.167145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d911a0-c606-4486-a074-bb25d467a672 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:27.167482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d911a0-c606-4486-a074-bb25d467a672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:27.178290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d911a0-c606-4486-a074-bb25d467a672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:27.179822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d911a0-c606-4486-a074-bb25d467a672 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:27.198267 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2754/5496] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:27.270745 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2743/5497] 10.222.0.20 () {60 vars in 1150 bytes} [Thu Oct 27 03:47:26 2022] POST /identity/v3/regions => generated 254 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:27.279031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d911a0-c606-4486-a074-bb25d467a672 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:27.306580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d911a0-c606-4486-a074-bb25d467a672 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:27.343473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cbc98-1b99-4b37-a713-7e1d014a5a51 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee3f95207404328bb5c999b41455540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ddbe0bf5042118914f60088976a9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:27.343845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cbc98-1b99-4b37-a713-7e1d014a5a51 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:27.344142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cbc98-1b99-4b37-a713-7e1d014a5a51 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:27.344425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cbc98-1b99-4b37-a713-7e1d014a5a51 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] PATH_INFO: `/v3/regions/06bf964480c6447191168f13633ca718` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:27.345091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4cbc98-1b99-4b37-a713-7e1d014a5a51 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorizing `identity:update_region(region_id=06bf964480c6447191168f13633ca718)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:27.346167 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-5c4cbc98-1b99-4b37-a713-7e1d014a5a51 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:27.346167 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:47:27.346167 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:47:27.347019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4cbc98-1b99-4b37-a713-7e1d014a5a51 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:27.442094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960c425-471b-47e0-b365-5acb7e7a839e tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:27.445254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8960c425-471b-47e0-b365-5acb7e7a839e tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:27.488507 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2755/5498] 10.222.0.20 () {60 vars in 1250 bytes} [Thu Oct 27 03:47:27 2022] PATCH /identity/v3/regions/06bf964480c6447191168f13633ca718 => generated 254 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:27.489616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cbc98-1b99-4b37-a713-7e1d014a5a51 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:27.494167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960c425-471b-47e0-b365-5acb7e7a839e tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:27.514819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:27.517598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6aa922-caee-498d-8bfd-1ca57a386673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:27.518845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6aa922-caee-498d-8bfd-1ca57a386673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:27.519352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6aa922-caee-498d-8bfd-1ca57a386673 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:27.519860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6aa922-caee-498d-8bfd-1ca57a386673 admin admin] PATH_INFO: `/v3/users/73bd244d596d4968a35fcb6154bd07d9` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:27.520021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cbc98-1b99-4b37-a713-7e1d014a5a51 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:27.521682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6aa922-caee-498d-8bfd-1ca57a386673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73bd244d596d4968a35fcb6154bd07d9)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:27.524762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6aa922-caee-498d-8bfd-1ca57a386673 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:27.527111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c45609-4dc0-47a9-83ad-489c5f16332a tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee3f95207404328bb5c999b41455540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ddbe0bf5042118914f60088976a9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:27.527918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c45609-4dc0-47a9-83ad-489c5f16332a tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:27.528210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c45609-4dc0-47a9-83ad-489c5f16332a tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:27.528495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c45609-4dc0-47a9-83ad-489c5f16332a tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] PATH_INFO: `/v3/regions/06bf964480c6447191168f13633ca718` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:27.529099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c45609-4dc0-47a9-83ad-489c5f16332a tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorizing `identity:get_region(region_id=06bf964480c6447191168f13633ca718)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:27.530751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c45609-4dc0-47a9-83ad-489c5f16332a tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:27.542490 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2756/5499] 10.222.0.20 () {58 vars in 1227 bytes} [Thu Oct 27 03:47:27 2022] GET /identity/v3/regions/06bf964480c6447191168f13633ca718 => generated 254 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:47:27.545546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c45609-4dc0-47a9-83ad-489c5f16332a tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:27.585092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c45609-4dc0-47a9-83ad-489c5f16332a tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:27.593209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53f31b-7507-48f9-90ec-82720f9b1fbc tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee3f95207404328bb5c999b41455540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ddbe0bf5042118914f60088976a9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:27.595603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:27.595775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53f31b-7507-48f9-90ec-82720f9b1fbc tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:27.595775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53f31b-7507-48f9-90ec-82720f9b1fbc tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:27.595775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53f31b-7507-48f9-90ec-82720f9b1fbc tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] PATH_INFO: `/v3/regions/06bf964480c6447191168f13633ca718` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:27.595775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53f31b-7507-48f9-90ec-82720f9b1fbc tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorizing `identity:delete_region(region_id=06bf964480c6447191168f13633ca718)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:27.598645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53f31b-7507-48f9-90ec-82720f9b1fbc tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:27.738277 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2757/5500] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:47:27 2022] DELETE /identity/v3/regions/06bf964480c6447191168f13633ca718 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:27.739599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53f31b-7507-48f9-90ec-82720f9b1fbc tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:27.765062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53f31b-7507-48f9-90ec-82720f9b1fbc tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:27.769843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc8ec9-8860-4c56-9ba0-7c411d2b7b03 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee3f95207404328bb5c999b41455540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ddbe0bf5042118914f60088976a9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:27.770507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc8ec9-8860-4c56-9ba0-7c411d2b7b03 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:27.770799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc8ec9-8860-4c56-9ba0-7c411d2b7b03 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:27.771081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc8ec9-8860-4c56-9ba0-7c411d2b7b03 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] PATH_INFO: `/v3/regions` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:27.771684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc8ec9-8860-4c56-9ba0-7c411d2b7b03 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:27.772765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc8ec9-8860-4c56-9ba0-7c411d2b7b03 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:27.782117 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2758/5501] 10.222.0.20 () {58 vars in 1128 bytes} [Thu Oct 27 03:47:27 2022] GET /identity/v3/regions => generated 670 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:27.785439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc8ec9-8860-4c56-9ba0-7c411d2b7b03 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:27.796982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc8ec9-8860-4c56-9ba0-7c411d2b7b03 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:27.802879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b9e10-4a57-47ac-92a9-c60df299caa5 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee3f95207404328bb5c999b41455540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ddbe0bf5042118914f60088976a9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:27.803522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b9e10-4a57-47ac-92a9-c60df299caa5 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:27.803808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b9e10-4a57-47ac-92a9-c60df299caa5 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:27.804199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b9e10-4a57-47ac-92a9-c60df299caa5 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] PATH_INFO: `/v3/regions/06bf964480c6447191168f13633ca718` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:27.804672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b9e10-4a57-47ac-92a9-c60df299caa5 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorizing `identity:delete_region(region_id=06bf964480c6447191168f13633ca718)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:27.806471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b9e10-4a57-47ac-92a9-c60df299caa5 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:27.832928 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-1a8b9e10-4a57-47ac-92a9-c60df299caa5 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Could not find region: 06bf964480c6447191168f13633ca718.: keystone.exception.RegionNotFound: Could not find region: 06bf964480c6447191168f13633ca718. Oct 27 03:47:27.832928 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:47:27.832928 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Oct 27 03:47:27.832928 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Oct 27 03:47:27.832928 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Oct 27 03:47:27.832928 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Oct 27 03:47:27.832928 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Oct 27 03:47:27.832928 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 27 03:47:27.832928 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 06bf964480c6447191168f13633ca718. Oct 27 03:47:27.832928 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:47:27.832928 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:47:27.832928 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:47:27.832928 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:47:27.832928 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:47:27.832928 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:47:27.832928 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:47:27.834434 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:47:27.834434 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:47:27.834434 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:47:27.834434 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:47:27.834434 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:47:27.834434 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:47:27.834434 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:47:27.834434 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Oct 27 03:47:27.834434 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Oct 27 03:47:27.834434 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:47:27.834434 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:47:27.834434 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Oct 27 03:47:27.834434 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 27 03:47:27.834434 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 06bf964480c6447191168f13633ca718. Oct 27 03:47:27.834434 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:47:27.836555 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2759/5502] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:47:27 2022] DELETE /identity/v3/regions/06bf964480c6447191168f13633ca718 => generated 112 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:47:27.837559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b9e10-4a57-47ac-92a9-c60df299caa5 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:27.842221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1a8b9e10-4a57-47ac-92a9-c60df299caa5 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:27.852683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7a6aa922-caee-498d-8bfd-1ca57a386673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73bd244d596d4968a35fcb6154bd07d9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:27.854389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7a6aa922-caee-498d-8bfd-1ca57a386673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73bd244d596d4968a35fcb6154bd07d9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:27.870536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7a6aa922-caee-498d-8bfd-1ca57a386673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73bd244d596d4968a35fcb6154bd07d9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:27.883251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b9e10-4a57-47ac-92a9-c60df299caa5 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:27.890397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faba383-aabe-4457-8c36-880f98c4bf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:27.891219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faba383-aabe-4457-8c36-880f98c4bf0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:27.891580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faba383-aabe-4457-8c36-880f98c4bf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:27.891933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faba383-aabe-4457-8c36-880f98c4bf0c admin admin] PATH_INFO: `/v3/projects/b670380d5ef14d77af2ffda2eb7bef2d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:27.893371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faba383-aabe-4457-8c36-880f98c4bf0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b670380d5ef14d77af2ffda2eb7bef2d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:27.895484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7a6aa922-caee-498d-8bfd-1ca57a386673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73bd244d596d4968a35fcb6154bd07d9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:27.898468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faba383-aabe-4457-8c36-880f98c4bf0c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:27.989752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7a6aa922-caee-498d-8bfd-1ca57a386673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73bd244d596d4968a35fcb6154bd07d9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:28.001331 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2744/5503] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:27 2022] DELETE /identity/v3/users/73bd244d596d4968a35fcb6154bd07d9 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:47:28.002500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6aa922-caee-498d-8bfd-1ca57a386673 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:28.004617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7a6aa922-caee-498d-8bfd-1ca57a386673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:28.039135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9faba383-aabe-4457-8c36-880f98c4bf0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b670380d5ef14d77af2ffda2eb7bef2d', 'request_id': 'req-9faba383-aabe-4457-8c36-880f98c4bf0c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:28.046819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9faba383-aabe-4457-8c36-880f98c4bf0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b670380d5ef14d77af2ffda2eb7bef2d', 'request_id': 'req-9faba383-aabe-4457-8c36-880f98c4bf0c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:28.054453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9faba383-aabe-4457-8c36-880f98c4bf0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b670380d5ef14d77af2ffda2eb7bef2d', 'request_id': 'req-9faba383-aabe-4457-8c36-880f98c4bf0c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:28.086955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6aa922-caee-498d-8bfd-1ca57a386673 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:28.148716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9faba383-aabe-4457-8c36-880f98c4bf0c admin admin] The token cache is being invalidate because project b670380d5ef14d77af2ffda2eb7bef2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:28.149059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9faba383-aabe-4457-8c36-880f98c4bf0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:28.149729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9faba383-aabe-4457-8c36-880f98c4bf0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:28.151396 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2760/5504] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:27 2022] DELETE /identity/v3/projects/b670380d5ef14d77af2ffda2eb7bef2d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:28.151957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faba383-aabe-4457-8c36-880f98c4bf0c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:28.154487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef80da-db05-4a26-9b03-209a3888bcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:28.156163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef80da-db05-4a26-9b03-209a3888bcd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:28.156466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef80da-db05-4a26-9b03-209a3888bcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:28.157481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef80da-db05-4a26-9b03-209a3888bcd5 admin admin] PATH_INFO: `/v3/projects/7fe1feec153247a5912efabd4819dcab` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:28.158081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef80da-db05-4a26-9b03-209a3888bcd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fe1feec153247a5912efabd4819dcab)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:28.158677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9faba383-aabe-4457-8c36-880f98c4bf0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:28.160402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef80da-db05-4a26-9b03-209a3888bcd5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:28.299686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-71ef80da-db05-4a26-9b03-209a3888bcd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fe1feec153247a5912efabd4819dcab', 'request_id': 'req-71ef80da-db05-4a26-9b03-209a3888bcd5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:28.349494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faba383-aabe-4457-8c36-880f98c4bf0c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:28.375621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-71ef80da-db05-4a26-9b03-209a3888bcd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fe1feec153247a5912efabd4819dcab', 'request_id': 'req-71ef80da-db05-4a26-9b03-209a3888bcd5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:28.389887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-71ef80da-db05-4a26-9b03-209a3888bcd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fe1feec153247a5912efabd4819dcab', 'request_id': 'req-71ef80da-db05-4a26-9b03-209a3888bcd5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:28.403004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-71ef80da-db05-4a26-9b03-209a3888bcd5 admin admin] The token cache is being invalidate because project 7fe1feec153247a5912efabd4819dcab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:28.403445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-71ef80da-db05-4a26-9b03-209a3888bcd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:28.407090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-71ef80da-db05-4a26-9b03-209a3888bcd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:28.409597 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2745/5505] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:28 2022] DELETE /identity/v3/projects/7fe1feec153247a5912efabd4819dcab => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:28.410637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d34b1-d5db-42a6-91f9-939c7c4f44db None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:28.410928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d34b1-d5db-42a6-91f9-939c7c4f44db None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:28.411208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d34b1-d5db-42a6-91f9-939c7c4f44db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:28.457361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67a1ec-3954-4032-9516-f7c89cba9fe8 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee3f95207404328bb5c999b41455540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ddbe0bf5042118914f60088976a9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:28.458330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67a1ec-3954-4032-9516-f7c89cba9fe8 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:28.458604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67a1ec-3954-4032-9516-f7c89cba9fe8 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:28.458960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67a1ec-3954-4032-9516-f7c89cba9fe8 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] PATH_INFO: `/v3/regions` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:28.459797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67a1ec-3954-4032-9516-f7c89cba9fe8 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:28.461016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67a1ec-3954-4032-9516-f7c89cba9fe8 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:28.461199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0a4d34b1-d5db-42a6-91f9-939c7c4f44db None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:28.462476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0a4d34b1-d5db-42a6-91f9-939c7c4f44db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:28.467966 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2761/5506] 10.222.0.20 () {58 vars in 1128 bytes} [Thu Oct 27 03:47:28 2022] GET /identity/v3/regions => generated 670 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:28.468962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67a1ec-3954-4032-9516-f7c89cba9fe8 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:28.473977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fe67a1ec-3954-4032-9516-f7c89cba9fe8 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:28.486386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:28.615220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67a1ec-3954-4032-9516-f7c89cba9fe8 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:28.618687 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2746/5507] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:28.619649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d34b1-d5db-42a6-91f9-939c7c4f44db None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:28.620987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0a4d34b1-d5db-42a6-91f9-939c7c4f44db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:28.629328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5e44c-23a0-4c52-a0b2-a50b9623758a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:28.629986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5e44c-23a0-4c52-a0b2-a50b9623758a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:28.630286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5e44c-23a0-4c52-a0b2-a50b9623758a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:28.630566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5e44c-23a0-4c52-a0b2-a50b9623758a admin admin] PATH_INFO: `/v3/users/341577a547a842c4a48d23f3d64b3d51` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:28.631882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5e44c-23a0-4c52-a0b2-a50b9623758a admin admin] RBAC: Authorizing `identity:delete_user(user_id=341577a547a842c4a48d23f3d64b3d51)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:28.633870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5e44c-23a0-4c52-a0b2-a50b9623758a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:28.647582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d34b1-d5db-42a6-91f9-939c7c4f44db None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:28.658792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3152696-75c2-49e3-9e7d-37e5e2f0e13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:28.661438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3152696-75c2-49e3-9e7d-37e5e2f0e13e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:28.661438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3152696-75c2-49e3-9e7d-37e5e2f0e13e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:28.661438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3152696-75c2-49e3-9e7d-37e5e2f0e13e admin admin] PATH_INFO: `/v3/users/b0e2e074e6ac4d2a815a754bfadc1a52` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:28.671767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3152696-75c2-49e3-9e7d-37e5e2f0e13e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0e2e074e6ac4d2a815a754bfadc1a52)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:28.673950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3152696-75c2-49e3-9e7d-37e5e2f0e13e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:28.892172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-96f5e44c-23a0-4c52-a0b2-a50b9623758a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '341577a547a842c4a48d23f3d64b3d51'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:28.893031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-96f5e44c-23a0-4c52-a0b2-a50b9623758a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '341577a547a842c4a48d23f3d64b3d51'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:28.902489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-96f5e44c-23a0-4c52-a0b2-a50b9623758a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '341577a547a842c4a48d23f3d64b3d51'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:28.916970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:28.928051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-96f5e44c-23a0-4c52-a0b2-a50b9623758a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '341577a547a842c4a48d23f3d64b3d51'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:28.928051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-96f5e44c-23a0-4c52-a0b2-a50b9623758a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '341577a547a842c4a48d23f3d64b3d51'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:28.967728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f3152696-75c2-49e3-9e7d-37e5e2f0e13e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0e2e074e6ac4d2a815a754bfadc1a52'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:28.968424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f3152696-75c2-49e3-9e7d-37e5e2f0e13e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0e2e074e6ac4d2a815a754bfadc1a52'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:28.984144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f3152696-75c2-49e3-9e7d-37e5e2f0e13e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0e2e074e6ac4d2a815a754bfadc1a52'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:29.010398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f3152696-75c2-49e3-9e7d-37e5e2f0e13e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0e2e074e6ac4d2a815a754bfadc1a52'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:29.012959 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2762/5508] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:28 2022] DELETE /identity/v3/users/341577a547a842c4a48d23f3d64b3d51 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:29.014524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5e44c-23a0-4c52-a0b2-a50b9623758a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:29.023563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-96f5e44c-23a0-4c52-a0b2-a50b9623758a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:29.091559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f3152696-75c2-49e3-9e7d-37e5e2f0e13e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0e2e074e6ac4d2a815a754bfadc1a52'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:29.099789 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2747/5509] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:28 2022] DELETE /identity/v3/users/b0e2e074e6ac4d2a815a754bfadc1a52 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:29.101082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3152696-75c2-49e3-9e7d-37e5e2f0e13e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:29.105625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f3152696-75c2-49e3-9e7d-37e5e2f0e13e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:29.171594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5e44c-23a0-4c52-a0b2-a50b9623758a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:29.243667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f8268-7103-4112-8dc0-d3d72cbb761a tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee3f95207404328bb5c999b41455540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ddbe0bf5042118914f60088976a9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:29.244490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f8268-7103-4112-8dc0-d3d72cbb761a tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:29.244948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f8268-7103-4112-8dc0-d3d72cbb761a tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:29.245278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f8268-7103-4112-8dc0-d3d72cbb761a tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] PATH_INFO: `/v3/regions` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:29.245941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f8268-7103-4112-8dc0-d3d72cbb761a tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:29.246414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3152696-75c2-49e3-9e7d-37e5e2f0e13e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:29.251067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ec1ce-bb90-49aa-825d-2f1fd64e7e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:29.251937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ec1ce-bb90-49aa-825d-2f1fd64e7e94 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:29.252383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ec1ce-bb90-49aa-825d-2f1fd64e7e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:29.253603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ec1ce-bb90-49aa-825d-2f1fd64e7e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:29.263616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2b0ec1ce-bb90-49aa-825d-2f1fd64e7e94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:29.280970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f8268-7103-4112-8dc0-d3d72cbb761a tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:29.385304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ec1ce-bb90-49aa-825d-2f1fd64e7e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:29.387345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ec1ce-bb90-49aa-825d-2f1fd64e7e94 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:29.393897 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2763/5510] 10.222.0.20 () {60 vars in 1150 bytes} [Thu Oct 27 03:47:29 2022] POST /identity/v3/regions => generated 254 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:29.397571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f8268-7103-4112-8dc0-d3d72cbb761a tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:29.400353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bd1f8268-7103-4112-8dc0-d3d72cbb761a tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:29.426446 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2748/5511] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:29.453390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f8268-7103-4112-8dc0-d3d72cbb761a tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:29.461657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107625e7-8df7-4e41-9b5b-5423d6dca835 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee3f95207404328bb5c999b41455540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ddbe0bf5042118914f60088976a9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:29.462760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107625e7-8df7-4e41-9b5b-5423d6dca835 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:29.463278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107625e7-8df7-4e41-9b5b-5423d6dca835 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:29.463782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107625e7-8df7-4e41-9b5b-5423d6dca835 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] PATH_INFO: `/v3/regions` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:29.465336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107625e7-8df7-4e41-9b5b-5423d6dca835 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Adding query filter params (parent_region_id=c43ac6d9062645c3ae91f9b60ed3df89) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:47:29.465914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107625e7-8df7-4e41-9b5b-5423d6dca835 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:29.467398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107625e7-8df7-4e41-9b5b-5423d6dca835 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:29.474718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:29.478419 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2764/5512] 10.222.0.20 () {58 vars in 1227 bytes} [Thu Oct 27 03:47:29 2022] GET /identity/v3/regions?parent_region_id=c43ac6d9062645c3ae91f9b60ed3df89 => generated 400 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:29.482632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ec1ce-bb90-49aa-825d-2f1fd64e7e94 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:29.497046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ec1ce-bb90-49aa-825d-2f1fd64e7e94 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:29.503340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811df7bc-0337-4889-877f-e646a8f53df6 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee3f95207404328bb5c999b41455540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ddbe0bf5042118914f60088976a9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:29.503979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811df7bc-0337-4889-877f-e646a8f53df6 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:29.509105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811df7bc-0337-4889-877f-e646a8f53df6 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:29.509105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811df7bc-0337-4889-877f-e646a8f53df6 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] PATH_INFO: `/v3/regions/96b97f2dcef241fe89fb020d052129b6` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:29.509105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811df7bc-0337-4889-877f-e646a8f53df6 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorizing `identity:delete_region(region_id=96b97f2dcef241fe89fb020d052129b6)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:29.509105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811df7bc-0337-4889-877f-e646a8f53df6 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:29.611047 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2749/5513] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:47:29 2022] DELETE /identity/v3/regions/96b97f2dcef241fe89fb020d052129b6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:47:29.615266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107625e7-8df7-4e41-9b5b-5423d6dca835 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:29.632203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107625e7-8df7-4e41-9b5b-5423d6dca835 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:29.650467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8b667-aeeb-4286-a934-2bd3ee955020 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee3f95207404328bb5c999b41455540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ddbe0bf5042118914f60088976a9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:29.652655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8b667-aeeb-4286-a934-2bd3ee955020 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:29.652655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8b667-aeeb-4286-a934-2bd3ee955020 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:29.652655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8b667-aeeb-4286-a934-2bd3ee955020 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] PATH_INFO: `/v3/regions/57fafa399379439b95e6c8c540a80d79` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:29.653758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8b667-aeeb-4286-a934-2bd3ee955020 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorizing `identity:delete_region(region_id=57fafa399379439b95e6c8c540a80d79)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:29.655753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8b667-aeeb-4286-a934-2bd3ee955020 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:29.810811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811df7bc-0337-4889-877f-e646a8f53df6 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:29.811319 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2765/5514] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:47:29 2022] DELETE /identity/v3/regions/57fafa399379439b95e6c8c540a80d79 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:29.823774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811df7bc-0337-4889-877f-e646a8f53df6 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:29.824988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8b667-aeeb-4286-a934-2bd3ee955020 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:29.828660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-34a8b667-aeeb-4286-a934-2bd3ee955020 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:29.878303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:29.895303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be827e7-767b-4057-8d6c-d13dbb904197 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee3f95207404328bb5c999b41455540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ddbe0bf5042118914f60088976a9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:29.896953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be827e7-767b-4057-8d6c-d13dbb904197 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:29.897261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be827e7-767b-4057-8d6c-d13dbb904197 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:29.897543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be827e7-767b-4057-8d6c-d13dbb904197 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] PATH_INFO: `/v3/regions/c43ac6d9062645c3ae91f9b60ed3df89` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:29.899338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be827e7-767b-4057-8d6c-d13dbb904197 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorizing `identity:delete_region(region_id=c43ac6d9062645c3ae91f9b60ed3df89)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:29.902068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be827e7-767b-4057-8d6c-d13dbb904197 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:29.916672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8b667-aeeb-4286-a934-2bd3ee955020 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:29.924967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f895f-0898-4237-98c9-f043876813e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:29.926573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f895f-0898-4237-98c9-f043876813e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:29.927026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f895f-0898-4237-98c9-f043876813e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:29.927500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f895f-0898-4237-98c9-f043876813e0 admin admin] PATH_INFO: `/v3/projects/15f4334612dc4adb91bcc6c9a466b6c5` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:29.929952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f895f-0898-4237-98c9-f043876813e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15f4334612dc4adb91bcc6c9a466b6c5)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:29.937944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f895f-0898-4237-98c9-f043876813e0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:29.998813 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2750/5515] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:47:29 2022] DELETE /identity/v3/regions/c43ac6d9062645c3ae91f9b60ed3df89 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:30.002770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be827e7-767b-4057-8d6c-d13dbb904197 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:30.004520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3be827e7-767b-4057-8d6c-d13dbb904197 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:30.031198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be827e7-767b-4057-8d6c-d13dbb904197 tempest-RegionsTestJSON-1676205012 tempest-RegionsTestJSON-1676205012-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:30.036157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81093c2-17a6-47c0-aa7c-06a02abf40b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:30.036880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81093c2-17a6-47c0-aa7c-06a02abf40b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:30.037232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81093c2-17a6-47c0-aa7c-06a02abf40b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:30.037576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81093c2-17a6-47c0-aa7c-06a02abf40b8 admin admin] PATH_INFO: `/v3/users/f3e44c456e88478e9c7b8b5f8e8a74ef` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:30.038826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81093c2-17a6-47c0-aa7c-06a02abf40b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e44c456e88478e9c7b8b5f8e8a74ef)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:30.040812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81093c2-17a6-47c0-aa7c-06a02abf40b8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:30.100020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-738f895f-0898-4237-98c9-f043876813e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15f4334612dc4adb91bcc6c9a466b6c5', 'request_id': 'req-738f895f-0898-4237-98c9-f043876813e0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:30.111950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-738f895f-0898-4237-98c9-f043876813e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15f4334612dc4adb91bcc6c9a466b6c5', 'request_id': 'req-738f895f-0898-4237-98c9-f043876813e0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:30.117319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-738f895f-0898-4237-98c9-f043876813e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15f4334612dc4adb91bcc6c9a466b6c5', 'request_id': 'req-738f895f-0898-4237-98c9-f043876813e0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:30.231001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-738f895f-0898-4237-98c9-f043876813e0 admin admin] The token cache is being invalidate because project 15f4334612dc4adb91bcc6c9a466b6c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:30.231474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-738f895f-0898-4237-98c9-f043876813e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:30.232364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-738f895f-0898-4237-98c9-f043876813e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:30.234555 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2766/5516] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:29 2022] DELETE /identity/v3/projects/15f4334612dc4adb91bcc6c9a466b6c5 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:30.236206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f895f-0898-4237-98c9-f043876813e0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:30.238313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-738f895f-0898-4237-98c9-f043876813e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:30.341608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f81093c2-17a6-47c0-aa7c-06a02abf40b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e44c456e88478e9c7b8b5f8e8a74ef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:30.342829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f81093c2-17a6-47c0-aa7c-06a02abf40b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e44c456e88478e9c7b8b5f8e8a74ef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:30.359776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f81093c2-17a6-47c0-aa7c-06a02abf40b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e44c456e88478e9c7b8b5f8e8a74ef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:30.376223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f81093c2-17a6-47c0-aa7c-06a02abf40b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e44c456e88478e9c7b8b5f8e8a74ef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:30.377634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f895f-0898-4237-98c9-f043876813e0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:30.385851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fc297-9721-4413-b5fc-21296b78abc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:30.386531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fc297-9721-4413-b5fc-21296b78abc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:30.386821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fc297-9721-4413-b5fc-21296b78abc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:30.393980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fc297-9721-4413-b5fc-21296b78abc1 admin admin] PATH_INFO: `/v3/projects/82f9c3b82eff463299b608d8df625cbb` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:30.393980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fc297-9721-4413-b5fc-21296b78abc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82f9c3b82eff463299b608d8df625cbb)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:30.395807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fc297-9721-4413-b5fc-21296b78abc1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:30.484147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f81093c2-17a6-47c0-aa7c-06a02abf40b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e44c456e88478e9c7b8b5f8e8a74ef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:30.498975 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2751/5517] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:30 2022] DELETE /identity/v3/users/f3e44c456e88478e9c7b8b5f8e8a74ef => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:47:30.500301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81093c2-17a6-47c0-aa7c-06a02abf40b8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:30.502340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f81093c2-17a6-47c0-aa7c-06a02abf40b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:30.521473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:30.546702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7f9fc297-9721-4413-b5fc-21296b78abc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82f9c3b82eff463299b608d8df625cbb', 'request_id': 'req-7f9fc297-9721-4413-b5fc-21296b78abc1'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:30.557056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7f9fc297-9721-4413-b5fc-21296b78abc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82f9c3b82eff463299b608d8df625cbb', 'request_id': 'req-7f9fc297-9721-4413-b5fc-21296b78abc1'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:30.564487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7f9fc297-9721-4413-b5fc-21296b78abc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82f9c3b82eff463299b608d8df625cbb', 'request_id': 'req-7f9fc297-9721-4413-b5fc-21296b78abc1'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:30.607532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81093c2-17a6-47c0-aa7c-06a02abf40b8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:30.648259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7f9fc297-9721-4413-b5fc-21296b78abc1 admin admin] The token cache is being invalidate because project 82f9c3b82eff463299b608d8df625cbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:30.648259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7f9fc297-9721-4413-b5fc-21296b78abc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:30.649611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7f9fc297-9721-4413-b5fc-21296b78abc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:30.652305 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2767/5518] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:30 2022] DELETE /identity/v3/projects/82f9c3b82eff463299b608d8df625cbb => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:30.653569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a3dfa-85da-45d2-a104-4c35a3f4741c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:30.653929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a3dfa-85da-45d2-a104-4c35a3f4741c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:30.654396 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a3dfa-85da-45d2-a104-4c35a3f4741c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:30.683298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-715a3dfa-85da-45d2-a104-4c35a3f4741c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:30.685472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-715a3dfa-85da-45d2-a104-4c35a3f4741c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:30.692208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f6eda-a271-4d44-8aaf-43da59e4afdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:30.693476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f6eda-a271-4d44-8aaf-43da59e4afdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:30.694183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f6eda-a271-4d44-8aaf-43da59e4afdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:30.694813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f6eda-a271-4d44-8aaf-43da59e4afdf admin admin] PATH_INFO: `/v3/projects/eddec9cdc1494d088043f44c7bac537b` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:30.696643 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2768/5519] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:30.698984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef8e73-c53d-4f98-9c15-73ceac975de7 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:30.699270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef8e73-c53d-4f98-9c15-73ceac975de7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:30.699546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef8e73-c53d-4f98-9c15-73ceac975de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:30.706202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f6eda-a271-4d44-8aaf-43da59e4afdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=eddec9cdc1494d088043f44c7bac537b)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:30.708597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f6eda-a271-4d44-8aaf-43da59e4afdf admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:30.743908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1eef8e73-c53d-4f98-9c15-73ceac975de7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:30.745599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1eef8e73-c53d-4f98-9c15-73ceac975de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:30.757810 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2769/5520] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:30.757810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d29f9a-40d7-4674-b46a-a12553e3c977 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:30.757810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d29f9a-40d7-4674-b46a-a12553e3c977 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:30.757810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d29f9a-40d7-4674-b46a-a12553e3c977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:30.791056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-15d29f9a-40d7-4674-b46a-a12553e3c977 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:30.792370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-15d29f9a-40d7-4674-b46a-a12553e3c977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:30.801765 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2770/5521] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:30.808288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21de342-4359-44f3-ac95-0207a1ed4831 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:30.808288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21de342-4359-44f3-ac95-0207a1ed4831 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:30.808288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21de342-4359-44f3-ac95-0207a1ed4831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:30.830983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a21de342-4359-44f3-ac95-0207a1ed4831 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:30.830983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a21de342-4359-44f3-ac95-0207a1ed4831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:30.859837 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2771/5522] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:30.866923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21de342-4359-44f3-ac95-0207a1ed4831 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:30.870464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a21de342-4359-44f3-ac95-0207a1ed4831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:30.879333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-239f6eda-a271-4d44-8aaf-43da59e4afdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eddec9cdc1494d088043f44c7bac537b', 'request_id': 'req-239f6eda-a271-4d44-8aaf-43da59e4afdf'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:30.972310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-239f6eda-a271-4d44-8aaf-43da59e4afdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eddec9cdc1494d088043f44c7bac537b', 'request_id': 'req-239f6eda-a271-4d44-8aaf-43da59e4afdf'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:30.981198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-239f6eda-a271-4d44-8aaf-43da59e4afdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eddec9cdc1494d088043f44c7bac537b', 'request_id': 'req-239f6eda-a271-4d44-8aaf-43da59e4afdf'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:31.017651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-239f6eda-a271-4d44-8aaf-43da59e4afdf admin admin] The token cache is being invalidate because project eddec9cdc1494d088043f44c7bac537b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:31.018024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-239f6eda-a271-4d44-8aaf-43da59e4afdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:31.022101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-239f6eda-a271-4d44-8aaf-43da59e4afdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:31.031633 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2752/5523] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:30 2022] DELETE /identity/v3/projects/eddec9cdc1494d088043f44c7bac537b => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:31.033011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25ed98-ce7b-40a6-a3cf-a2c505b2aaf8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:31.037072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:31.040963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25ed98-ce7b-40a6-a3cf-a2c505b2aaf8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:31.041293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25ed98-ce7b-40a6-a3cf-a2c505b2aaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:31.052406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21de342-4359-44f3-ac95-0207a1ed4831 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:31.100792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-cc25ed98-ce7b-40a6-a3cf-a2c505b2aaf8 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:31.105835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cc25ed98-ce7b-40a6-a3cf-a2c505b2aaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:31.210190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13047f05-a179-4ab8-8ca4-2674bdef26c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:31.218269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13047f05-a179-4ab8-8ca4-2674bdef26c4 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:31.218269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13047f05-a179-4ab8-8ca4-2674bdef26c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:31.218269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13047f05-a179-4ab8-8ca4-2674bdef26c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:31.218983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-13047f05-a179-4ab8-8ca4-2674bdef26c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:31.279212 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2753/5524] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:31.279558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25ed98-ce7b-40a6-a3cf-a2c505b2aaf8 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:31.285647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cc25ed98-ce7b-40a6-a3cf-a2c505b2aaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:31.310134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:31.320695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25ed98-ce7b-40a6-a3cf-a2c505b2aaf8 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:31.329174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6a469-18ed-4d44-bafb-94838b6686de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:31.331216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6a469-18ed-4d44-bafb-94838b6686de admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:31.331684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6a469-18ed-4d44-bafb-94838b6686de admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:31.342647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6a469-18ed-4d44-bafb-94838b6686de admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:31.343572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6a469-18ed-4d44-bafb-94838b6686de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:47:31.344477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6a469-18ed-4d44-bafb-94838b6686de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:31.346369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6a469-18ed-4d44-bafb-94838b6686de admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:31.365288 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2754/5525] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:31.367092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159c224-b11a-4d45-9090-2ef22186c2c2 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:31.367716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159c224-b11a-4d45-9090-2ef22186c2c2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:31.369068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159c224-b11a-4d45-9090-2ef22186c2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:31.383273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:31.392765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c159c224-b11a-4d45-9090-2ef22186c2c2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:31.394339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c159c224-b11a-4d45-9090-2ef22186c2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:31.406131 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2755/5526] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:31.407257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13047f05-a179-4ab8-8ca4-2674bdef26c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:31.407602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159c224-b11a-4d45-9090-2ef22186c2c2 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:31.416803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13047f05-a179-4ab8-8ca4-2674bdef26c4 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:31.431674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159c224-b11a-4d45-9090-2ef22186c2c2 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:31.473653 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2772/5527] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:31.474070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67f27d-32de-4f16-b2b4-4b6efb4d3d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:31.474799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67f27d-32de-4f16-b2b4-4b6efb4d3d43 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:31.475003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13047f05-a179-4ab8-8ca4-2674bdef26c4 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:31.475125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67f27d-32de-4f16-b2b4-4b6efb4d3d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:31.475340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67f27d-32de-4f16-b2b4-4b6efb4d3d43 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:31.477882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67f27d-32de-4f16-b2b4-4b6efb4d3d43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:47:31.480887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67f27d-32de-4f16-b2b4-4b6efb4d3d43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:31.486250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67f27d-32de-4f16-b2b4-4b6efb4d3d43 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:31.492568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13047f05-a179-4ab8-8ca4-2674bdef26c4 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:31.498821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ec374-9bf7-48be-b84d-855f56ca7249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:31.499783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ec374-9bf7-48be-b84d-855f56ca7249 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:31.500268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ec374-9bf7-48be-b84d-855f56ca7249 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:31.501003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ec374-9bf7-48be-b84d-855f56ca7249 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:31.502200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ec374-9bf7-48be-b84d-855f56ca7249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:31.504318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ec374-9bf7-48be-b84d-855f56ca7249 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:31.550973 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2756/5528] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:31.550973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c66c0d-78a4-4282-a805-e9e6f43e0340 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:31.550973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c66c0d-78a4-4282-a805-e9e6f43e0340 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:31.550973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c66c0d-78a4-4282-a805-e9e6f43e0340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:31.591025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e5c66c0d-78a4-4282-a805-e9e6f43e0340 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:31.592330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e5c66c0d-78a4-4282-a805-e9e6f43e0340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:31.614738 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2757/5529] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:31.615036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c66c0d-78a4-4282-a805-e9e6f43e0340 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:31.620797 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2773/5530] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:47:31 2022] POST /identity/v3/projects => generated 369 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:31.622247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ec374-9bf7-48be-b84d-855f56ca7249 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:31.646341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c66c0d-78a4-4282-a805-e9e6f43e0340 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:31.750757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ec374-9bf7-48be-b84d-855f56ca7249 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:31.766713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef4681-bf3c-4c85-815f-8c962350f38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:31.767223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef4681-bf3c-4c85-815f-8c962350f38c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:31.767514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef4681-bf3c-4c85-815f-8c962350f38c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:31.767795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef4681-bf3c-4c85-815f-8c962350f38c admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:31.768463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef4681-bf3c-4c85-815f-8c962350f38c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:47:31.768777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef4681-bf3c-4c85-815f-8c962350f38c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:31.770430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef4681-bf3c-4c85-815f-8c962350f38c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:31.796150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6522a-009f-449a-811d-f4d8d3d63e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:31.798700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6522a-009f-449a-811d-f4d8d3d63e28 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:31.799300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6522a-009f-449a-811d-f4d8d3d63e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:31.800238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6522a-009f-449a-811d-f4d8d3d63e28 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:31.801195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6522a-009f-449a-811d-f4d8d3d63e28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:31.805107 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2774/5531] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:31.808193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef4681-bf3c-4c85-815f-8c962350f38c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:31.814345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6522a-009f-449a-811d-f4d8d3d63e28 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:31.847036 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef4681-bf3c-4c85-815f-8c962350f38c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:31.859592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d04f1-e4b2-4cb9-8e79-7a00fe1a3fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:31.860407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d04f1-e4b2-4cb9-8e79-7a00fe1a3fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:31.860564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d04f1-e4b2-4cb9-8e79-7a00fe1a3fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:31.860846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d04f1-e4b2-4cb9-8e79-7a00fe1a3fc4 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:31.862070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d04f1-e4b2-4cb9-8e79-7a00fe1a3fc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:31.876862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d04f1-e4b2-4cb9-8e79-7a00fe1a3fc4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:31.993652 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2758/5532] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:47:31 2022] POST /identity/v3/projects => generated 375 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:31.994938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6522a-009f-449a-811d-f4d8d3d63e28 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:32.011451 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2775/5533] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:47:31 2022] POST /identity/v3/users => generated 285 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:32.012629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d04f1-e4b2-4cb9-8e79-7a00fe1a3fc4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:32.040438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d04f1-e4b2-4cb9-8e79-7a00fe1a3fc4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:32.142182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6522a-009f-449a-811d-f4d8d3d63e28 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:32.148595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d50d61-63c9-4f31-8742-840b07df8ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:32.149387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d50d61-63c9-4f31-8742-840b07df8ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:32.152696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d50d61-63c9-4f31-8742-840b07df8ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:32.152696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d50d61-63c9-4f31-8742-840b07df8ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:32.152696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d50d61-63c9-4f31-8742-840b07df8ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:32.155130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d50d61-63c9-4f31-8742-840b07df8ca0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:32.193608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694373cf-0a6f-4c92-b2df-9ef3ad7035ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:32.195597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694373cf-0a6f-4c92-b2df-9ef3ad7035ac admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:32.195895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694373cf-0a6f-4c92-b2df-9ef3ad7035ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:32.196180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694373cf-0a6f-4c92-b2df-9ef3ad7035ac admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:32.196886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694373cf-0a6f-4c92-b2df-9ef3ad7035ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:32.204224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694373cf-0a6f-4c92-b2df-9ef3ad7035ac admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:32.280077 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2759/5534] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:47:31 2022] POST /identity/v3/projects => generated 383 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:32.280077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d50d61-63c9-4f31-8742-840b07df8ca0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:32.299485 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2776/5535] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:47:32 2022] POST /identity/v3/users => generated 288 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:32.303013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694373cf-0a6f-4c92-b2df-9ef3ad7035ac admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:32.335442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694373cf-0a6f-4c92-b2df-9ef3ad7035ac admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:32.399005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:32.429102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d50d61-63c9-4f31-8742-840b07df8ca0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:32.449295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2e44b-5497-45b1-b09e-2ab67243bdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:32.450235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2e44b-5497-45b1-b09e-2ab67243bdcb admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:32.450628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2e44b-5497-45b1-b09e-2ab67243bdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:32.451010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2e44b-5497-45b1-b09e-2ab67243bdcb admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:32.452364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2e44b-5497-45b1-b09e-2ab67243bdcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:32.455778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2e44b-5497-45b1-b09e-2ab67243bdcb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:32.457933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:32.489560 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2760/5536] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:32.491845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2e44b-5497-45b1-b09e-2ab67243bdcb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:32.526283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2e44b-5497-45b1-b09e-2ab67243bdcb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:32.542395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c3e5e-c44d-4946-88be-39f6ee0f0430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:32.543034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c3e5e-c44d-4946-88be-39f6ee0f0430 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:32.543442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c3e5e-c44d-4946-88be-39f6ee0f0430 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:32.543576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c3e5e-c44d-4946-88be-39f6ee0f0430 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:32.544215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c3e5e-c44d-4946-88be-39f6ee0f0430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:32.546668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac4a0d-df58-4d75-b123-5745ea79ffdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:32.547009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c3e5e-c44d-4946-88be-39f6ee0f0430 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:32.547639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac4a0d-df58-4d75-b123-5745ea79ffdd admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:32.548075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac4a0d-df58-4d75-b123-5745ea79ffdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:32.548453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac4a0d-df58-4d75-b123-5745ea79ffdd admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:32.549224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac4a0d-df58-4d75-b123-5745ea79ffdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:32.553241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac4a0d-df58-4d75-b123-5745ea79ffdd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:32.576021 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2761/5537] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:32.578097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac4a0d-df58-4d75-b123-5745ea79ffdd admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:32.594681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac4a0d-df58-4d75-b123-5745ea79ffdd admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:32.600936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23efee-ae2a-4c64-8f55-9ec61226b62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:32.601835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23efee-ae2a-4c64-8f55-9ec61226b62a admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:32.602289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23efee-ae2a-4c64-8f55-9ec61226b62a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:32.602674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23efee-ae2a-4c64-8f55-9ec61226b62a admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:32.603742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23efee-ae2a-4c64-8f55-9ec61226b62a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:32.611291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23efee-ae2a-4c64-8f55-9ec61226b62a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:32.627284 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2762/5538] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:32.632208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23efee-ae2a-4c64-8f55-9ec61226b62a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:32.658396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23efee-ae2a-4c64-8f55-9ec61226b62a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:32.664324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612330e-3e35-4b65-933d-df7bc0e94456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:32.667276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612330e-3e35-4b65-933d-df7bc0e94456 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:32.667276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612330e-3e35-4b65-933d-df7bc0e94456 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:32.667276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612330e-3e35-4b65-933d-df7bc0e94456 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:32.667276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612330e-3e35-4b65-933d-df7bc0e94456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:32.668749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612330e-3e35-4b65-933d-df7bc0e94456 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:32.685101 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2763/5539] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:32.687015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612330e-3e35-4b65-933d-df7bc0e94456 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:32.718345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612330e-3e35-4b65-933d-df7bc0e94456 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:32.727500 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2777/5540] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:47:32 2022] POST /identity/v3/users => generated 292 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:32.727500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c3e5e-c44d-4946-88be-39f6ee0f0430 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:32.730967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac4ea8-cd28-47ff-8405-6ed63bed1412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:32.731736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac4ea8-cd28-47ff-8405-6ed63bed1412 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:32.732184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac4ea8-cd28-47ff-8405-6ed63bed1412 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:32.732618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac4ea8-cd28-47ff-8405-6ed63bed1412 admin admin] PATH_INFO: `/v3/projects/4623cd7593c54d5eab10068b239cc599/users/90e9d7cd29034c978171ebe24ae2e004/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:32.752547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c3e5e-c44d-4946-88be-39f6ee0f0430 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:32.769522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017aa63-718c-4743-9ead-0089a3881a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:32.770250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017aa63-718c-4743-9ead-0089a3881a0d admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:32.774910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017aa63-718c-4743-9ead-0089a3881a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:32.774910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017aa63-718c-4743-9ead-0089a3881a0d admin admin] PATH_INFO: `/v3/projects/91f48eb5f9be49ca85b5028084d5e0ce/users/f501e7be812e41ebb05c15f0adfd8ea2/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:32.786186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac4ea8-cd28-47ff-8405-6ed63bed1412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4623cd7593c54d5eab10068b239cc599, user_id=90e9d7cd29034c978171ebe24ae2e004, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:32.792651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac4ea8-cd28-47ff-8405-6ed63bed1412 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:32.845022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017aa63-718c-4743-9ead-0089a3881a0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=91f48eb5f9be49ca85b5028084d5e0ce, user_id=f501e7be812e41ebb05c15f0adfd8ea2, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:32.849783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017aa63-718c-4743-9ead-0089a3881a0d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:32.900489 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2764/5541] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:32 2022] PUT /identity/v3/projects/4623cd7593c54d5eab10068b239cc599/users/90e9d7cd29034c978171ebe24ae2e004/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:32.901780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac4ea8-cd28-47ff-8405-6ed63bed1412 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:33.008311 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2778/5542] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:32 2022] PUT /identity/v3/projects/91f48eb5f9be49ca85b5028084d5e0ce/users/f501e7be812e41ebb05c15f0adfd8ea2/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:33.009927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6b7b6-ab81-4584-9d16-5298aae1aca2 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:33.010245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6b7b6-ab81-4584-9d16-5298aae1aca2 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:33.010525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6b7b6-ab81-4584-9d16-5298aae1aca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:33.061182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac4ea8-cd28-47ff-8405-6ed63bed1412 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:33.080059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7dc6b7b6-ab81-4584-9d16-5298aae1aca2 None None] MFA Rules not processed for user `90e9d7cd29034c978171ebe24ae2e004`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:33.081313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7dc6b7b6-ab81-4584-9d16-5298aae1aca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:33.206426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ffbb4-40ae-4886-8d5c-e7a221a3a76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:33.207710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ffbb4-40ae-4886-8d5c-e7a221a3a76e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:33.209367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ffbb4-40ae-4886-8d5c-e7a221a3a76e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:33.213351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ffbb4-40ae-4886-8d5c-e7a221a3a76e admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:33.214302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ffbb4-40ae-4886-8d5c-e7a221a3a76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:33.216683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ffbb4-40ae-4886-8d5c-e7a221a3a76e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:33.216841 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2779/5543] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:33.220398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b34f2-e55a-4c1d-93c3-d3111823829e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:33.221120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b34f2-e55a-4c1d-93c3-d3111823829e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:33.222063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b34f2-e55a-4c1d-93c3-d3111823829e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:33.242253 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2765/5544] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:33.250382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ffbb4-40ae-4886-8d5c-e7a221a3a76e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:33.252221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fc5ffbb4-40ae-4886-8d5c-e7a221a3a76e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:33.266111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ffbb4-40ae-4886-8d5c-e7a221a3a76e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:33.272876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a53ef-f470-4ab8-8f60-82af72ddbff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:33.273465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-122b34f2-e55a-4c1d-93c3-d3111823829e None None] MFA Rules not processed for user `f501e7be812e41ebb05c15f0adfd8ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:33.274549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a53ef-f470-4ab8-8f60-82af72ddbff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:33.274919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a53ef-f470-4ab8-8f60-82af72ddbff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:33.275270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a53ef-f470-4ab8-8f60-82af72ddbff2 admin admin] PATH_INFO: `/v3/projects/e7f27f9d6448405ab6c873bf3236bb0a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:33.275935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-122b34f2-e55a-4c1d-93c3-d3111823829e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:33.277079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a53ef-f470-4ab8-8f60-82af72ddbff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7f27f9d6448405ab6c873bf3236bb0a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:33.279351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a53ef-f470-4ab8-8f60-82af72ddbff2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:33.361312 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2780/5545] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:33.367320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b34f2-e55a-4c1d-93c3-d3111823829e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:33.378730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b34f2-e55a-4c1d-93c3-d3111823829e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:33.383574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da27f9-a034-44c3-b691-53cb6fad16a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:33.384198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da27f9-a034-44c3-b691-53cb6fad16a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:33.384562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da27f9-a034-44c3-b691-53cb6fad16a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:33.385040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da27f9-a034-44c3-b691-53cb6fad16a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:33.385585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da27f9-a034-44c3-b691-53cb6fad16a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:33.387622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da27f9-a034-44c3-b691-53cb6fad16a8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:33.535283 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2781/5546] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:47:33 2022] POST /identity/v3/projects => generated 369 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:33.537548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da27f9-a034-44c3-b691-53cb6fad16a8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:33.540265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e9a53ef-f470-4ab8-8f60-82af72ddbff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7f27f9d6448405ab6c873bf3236bb0a', 'request_id': 'req-1e9a53ef-f470-4ab8-8f60-82af72ddbff2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:33.633877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e9a53ef-f470-4ab8-8f60-82af72ddbff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7f27f9d6448405ab6c873bf3236bb0a', 'request_id': 'req-1e9a53ef-f470-4ab8-8f60-82af72ddbff2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:33.643218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e9a53ef-f470-4ab8-8f60-82af72ddbff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7f27f9d6448405ab6c873bf3236bb0a', 'request_id': 'req-1e9a53ef-f470-4ab8-8f60-82af72ddbff2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:33.663953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e9a53ef-f470-4ab8-8f60-82af72ddbff2 admin admin] The token cache is being invalidate because project e7f27f9d6448405ab6c873bf3236bb0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:33.663953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e9a53ef-f470-4ab8-8f60-82af72ddbff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:33.664329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e9a53ef-f470-4ab8-8f60-82af72ddbff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:33.666374 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2766/5547] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:33 2022] DELETE /identity/v3/projects/e7f27f9d6448405ab6c873bf3236bb0a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:33.670780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a53ef-f470-4ab8-8f60-82af72ddbff2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:33.674378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1e9a53ef-f470-4ab8-8f60-82af72ddbff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:33.703838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da27f9-a034-44c3-b691-53cb6fad16a8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:33.717636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f1254-9cac-49ac-a643-4fb4e038d3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:33.717636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f1254-9cac-49ac-a643-4fb4e038d3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:33.718196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f1254-9cac-49ac-a643-4fb4e038d3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:33.718418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f1254-9cac-49ac-a643-4fb4e038d3e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:33.719468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f1254-9cac-49ac-a643-4fb4e038d3e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:33.723943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f1254-9cac-49ac-a643-4fb4e038d3e7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:33.746389 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2782/5548] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:33.746389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f1254-9cac-49ac-a643-4fb4e038d3e7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:33.747508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3b1f1254-9cac-49ac-a643-4fb4e038d3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:33.766493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f1254-9cac-49ac-a643-4fb4e038d3e7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:33.778458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396b4cf-ed33-44bc-bdda-97480bdc6258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:33.781283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396b4cf-ed33-44bc-bdda-97480bdc6258 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:33.781283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396b4cf-ed33-44bc-bdda-97480bdc6258 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:33.781283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396b4cf-ed33-44bc-bdda-97480bdc6258 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:33.781283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396b4cf-ed33-44bc-bdda-97480bdc6258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:33.795234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396b4cf-ed33-44bc-bdda-97480bdc6258 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:33.803784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:33.820362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a53ef-f470-4ab8-8f60-82af72ddbff2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:33.915861 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2783/5549] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:47:33 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:33.917093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396b4cf-ed33-44bc-bdda-97480bdc6258 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:33.922006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c396b4cf-ed33-44bc-bdda-97480bdc6258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:33.931138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c064c-41da-4ddf-a8cd-660bde6aade5 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f501e7be812e41ebb05c15f0adfd8ea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91f48eb5f9be49ca85b5028084d5e0ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:33.931994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c064c-41da-4ddf-a8cd-660bde6aade5 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:33.932360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c064c-41da-4ddf-a8cd-660bde6aade5 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:33.932702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c064c-41da-4ddf-a8cd-660bde6aade5 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] PATH_INFO: `/v3/users/f501e7be812e41ebb05c15f0adfd8ea2/password` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:33.959174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396b4cf-ed33-44bc-bdda-97480bdc6258 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:33.980512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71766c8d-93a1-4d22-9b6b-7af5c1536400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:33.981356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71766c8d-93a1-4d22-9b6b-7af5c1536400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:33.981724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71766c8d-93a1-4d22-9b6b-7af5c1536400 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:33.982011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71766c8d-93a1-4d22-9b6b-7af5c1536400 admin admin] PATH_INFO: `/v3/users/bee3f95207404328bb5c999b41455540` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:33.984827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71766c8d-93a1-4d22-9b6b-7af5c1536400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bee3f95207404328bb5c999b41455540)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:33.986820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71766c8d-93a1-4d22-9b6b-7af5c1536400 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:34.176723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c94c064c-41da-4ddf-a8cd-660bde6aade5 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f501e7be812e41ebb05c15f0adfd8ea2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:34.246304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:34.355179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-71766c8d-93a1-4d22-9b6b-7af5c1536400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bee3f95207404328bb5c999b41455540'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:34.356374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-71766c8d-93a1-4d22-9b6b-7af5c1536400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bee3f95207404328bb5c999b41455540'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:34.366979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-71766c8d-93a1-4d22-9b6b-7af5c1536400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bee3f95207404328bb5c999b41455540'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:34.376423 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2767/5550] 10.222.0.20 () {60 vars in 1269 bytes} [Thu Oct 27 03:47:33 2022] POST /identity/v3/users/f501e7be812e41ebb05c15f0adfd8ea2/password => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:34.379595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c064c-41da-4ddf-a8cd-660bde6aade5 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:34.379595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c94c064c-41da-4ddf-a8cd-660bde6aade5 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:34.386883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-71766c8d-93a1-4d22-9b6b-7af5c1536400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bee3f95207404328bb5c999b41455540'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:34.387697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-71766c8d-93a1-4d22-9b6b-7af5c1536400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bee3f95207404328bb5c999b41455540'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:34.405314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c064c-41da-4ddf-a8cd-660bde6aade5 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:34.411523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a778598-c18b-41e8-8bc3-b4b6db71f587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:34.412646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a778598-c18b-41e8-8bc3-b4b6db71f587 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:34.413015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a778598-c18b-41e8-8bc3-b4b6db71f587 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:34.413492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a778598-c18b-41e8-8bc3-b4b6db71f587 admin admin] PATH_INFO: `/v3/projects/aead91140df544faa492b8fd1952db8c/users/66ba627e73834b84b1ee6514e1facd1c/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:34.434564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a778598-c18b-41e8-8bc3-b4b6db71f587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aead91140df544faa492b8fd1952db8c, user_id=66ba627e73834b84b1ee6514e1facd1c, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:34.443560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a778598-c18b-41e8-8bc3-b4b6db71f587 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:34.508717 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2784/5551] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:33 2022] DELETE /identity/v3/users/bee3f95207404328bb5c999b41455540 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:34.509647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71766c8d-93a1-4d22-9b6b-7af5c1536400 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:34.510999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-71766c8d-93a1-4d22-9b6b-7af5c1536400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:34.536390 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2768/5552] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:34 2022] PUT /identity/v3/projects/aead91140df544faa492b8fd1952db8c/users/66ba627e73834b84b1ee6514e1facd1c/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:34.541320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf3af9-293f-4ea2-84fc-961f6fd082e5 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:34.542160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf3af9-293f-4ea2-84fc-961f6fd082e5 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:34.542160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf3af9-293f-4ea2-84fc-961f6fd082e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:34.567006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-78bf3af9-293f-4ea2-84fc-961f6fd082e5 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:34.568684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-78bf3af9-293f-4ea2-84fc-961f6fd082e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:34.592663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71766c8d-93a1-4d22-9b6b-7af5c1536400 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:34.661798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c29a3-2a71-40a6-a383-b7836effb233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:34.667125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c29a3-2a71-40a6-a383-b7836effb233 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:34.667125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c29a3-2a71-40a6-a383-b7836effb233 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:34.667125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c29a3-2a71-40a6-a383-b7836effb233 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:34.667125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c29a3-2a71-40a6-a383-b7836effb233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:34.667125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c29a3-2a71-40a6-a383-b7836effb233 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:34.678062 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2769/5553] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:34.678062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf3af9-293f-4ea2-84fc-961f6fd082e5 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:34.678062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-78bf3af9-293f-4ea2-84fc-961f6fd082e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:34.678432 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2785/5554] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:34.681581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c29a3-2a71-40a6-a383-b7836effb233 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:34.692230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf3af9-293f-4ea2-84fc-961f6fd082e5 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:34.697205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c29a3-2a71-40a6-a383-b7836effb233 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:34.697341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba84868-8047-4544-853f-7bc9ee4c4eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:34.697491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da9f62-14b3-43fc-a8c4-3b981b1acff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:34.697618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba84868-8047-4544-853f-7bc9ee4c4eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:34.697730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da9f62-14b3-43fc-a8c4-3b981b1acff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:34.697844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba84868-8047-4544-853f-7bc9ee4c4eff admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:34.697959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da9f62-14b3-43fc-a8c4-3b981b1acff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:34.698105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba84868-8047-4544-853f-7bc9ee4c4eff admin admin] PATH_INFO: `/v3/users/b4dae167878b41699b8caae5a0386cf4` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:34.698219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da9f62-14b3-43fc-a8c4-3b981b1acff6 admin admin] PATH_INFO: `/v3/projects/592d85f7445943a0ad087bdcbb3a36ce/users/e7397bbf2f0f48aca03f8083465067e4/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:34.699219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba84868-8047-4544-853f-7bc9ee4c4eff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4dae167878b41699b8caae5a0386cf4)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:34.701181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba84868-8047-4544-853f-7bc9ee4c4eff admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:34.717874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da9f62-14b3-43fc-a8c4-3b981b1acff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=592d85f7445943a0ad087bdcbb3a36ce, user_id=e7397bbf2f0f48aca03f8083465067e4, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:34.722202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da9f62-14b3-43fc-a8c4-3b981b1acff6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:34.853292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:34.853946 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2786/5555] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:34 2022] PUT /identity/v3/projects/592d85f7445943a0ad087bdcbb3a36ce/users/e7397bbf2f0f48aca03f8083465067e4/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:47:34.853946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da9f62-14b3-43fc-a8c4-3b981b1acff6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:34.855062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-55da9f62-14b3-43fc-a8c4-3b981b1acff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:34.933865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da9f62-14b3-43fc-a8c4-3b981b1acff6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:34.940261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef715b-a02c-4583-9656-53fb5875d925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:34.940962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef715b-a02c-4583-9656-53fb5875d925 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:34.941250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef715b-a02c-4583-9656-53fb5875d925 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:34.941528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef715b-a02c-4583-9656-53fb5875d925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:34.981770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0ba84868-8047-4544-853f-7bc9ee4c4eff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4dae167878b41699b8caae5a0386cf4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:34.984135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0ba84868-8047-4544-853f-7bc9ee4c4eff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4dae167878b41699b8caae5a0386cf4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:35.004066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0ba84868-8047-4544-853f-7bc9ee4c4eff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4dae167878b41699b8caae5a0386cf4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:35.022822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0ba84868-8047-4544-853f-7bc9ee4c4eff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4dae167878b41699b8caae5a0386cf4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:35.029286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef715b-a02c-4583-9656-53fb5875d925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:35.032616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef715b-a02c-4583-9656-53fb5875d925 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:35.044114 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2787/5556] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:35.046139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef715b-a02c-4583-9656-53fb5875d925 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:35.057426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef715b-a02c-4583-9656-53fb5875d925 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:35.065203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a944213-82ca-480e-bb58-2f4411c78def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:35.066004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a944213-82ca-480e-bb58-2f4411c78def admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:35.066426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a944213-82ca-480e-bb58-2f4411c78def admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:35.066798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a944213-82ca-480e-bb58-2f4411c78def admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:35.067555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a944213-82ca-480e-bb58-2f4411c78def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:35.069739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a944213-82ca-480e-bb58-2f4411c78def admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:35.085620 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2788/5557] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:35.086802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a944213-82ca-480e-bb58-2f4411c78def admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:35.089879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9a944213-82ca-480e-bb58-2f4411c78def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:35.109274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a944213-82ca-480e-bb58-2f4411c78def admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:35.118608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0ba84868-8047-4544-853f-7bc9ee4c4eff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4dae167878b41699b8caae5a0386cf4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:35.130652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89282340-d3ec-4461-ae30-be8308328999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:35.130652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89282340-d3ec-4461-ae30-be8308328999 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:35.130893 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2770/5558] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:34 2022] DELETE /identity/v3/users/b4dae167878b41699b8caae5a0386cf4 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:35.130997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89282340-d3ec-4461-ae30-be8308328999 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:35.130997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89282340-d3ec-4461-ae30-be8308328999 admin admin] PATH_INFO: `/v3/projects/592d85f7445943a0ad087bdcbb3a36ce/users/e7397bbf2f0f48aca03f8083465067e4/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:35.131990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba84868-8047-4544-853f-7bc9ee4c4eff admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:35.134363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0ba84868-8047-4544-853f-7bc9ee4c4eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:35.135520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89282340-d3ec-4461-ae30-be8308328999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=592d85f7445943a0ad087bdcbb3a36ce, user_id=e7397bbf2f0f48aca03f8083465067e4, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:35.138317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89282340-d3ec-4461-ae30-be8308328999 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:35.151401 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2789/5559] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:35 2022] PUT /identity/v3/projects/592d85f7445943a0ad087bdcbb3a36ce/users/e7397bbf2f0f48aca03f8083465067e4/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:35.165272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2519e70-9528-42c4-9fc0-4607131cbbfa None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:35.165563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2519e70-9528-42c4-9fc0-4607131cbbfa None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:35.165970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2519e70-9528-42c4-9fc0-4607131cbbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:35.234397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f2519e70-9528-42c4-9fc0-4607131cbbfa None None] MFA Rules not processed for user `e7397bbf2f0f48aca03f8083465067e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:35.237133 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f2519e70-9528-42c4-9fc0-4607131cbbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:35.266738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba84868-8047-4544-853f-7bc9ee4c4eff admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:35.316044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:35.343757 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2790/5560] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:35.356263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08746b-894c-4489-89e5-97e52c4f7e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:35.357342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08746b-894c-4489-89e5-97e52c4f7e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:35.358347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08746b-894c-4489-89e5-97e52c4f7e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:35.358674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08746b-894c-4489-89e5-97e52c4f7e12 admin admin] PATH_INFO: `/v3/projects/cf4ddbe0bf5042118914f60088976a9d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:35.359926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08746b-894c-4489-89e5-97e52c4f7e12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf4ddbe0bf5042118914f60088976a9d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:35.361980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08746b-894c-4489-89e5-97e52c4f7e12 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:35.365191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2519e70-9528-42c4-9fc0-4607131cbbfa None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:35.366756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f2519e70-9528-42c4-9fc0-4607131cbbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:35.450679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2519e70-9528-42c4-9fc0-4607131cbbfa None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:35.455713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277d251-1d9c-4823-a3a1-2e36035d6b5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:35.456884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277d251-1d9c-4823-a3a1-2e36035d6b5b service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:35.456884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277d251-1d9c-4823-a3a1-2e36035d6b5b service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:35.457348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277d251-1d9c-4823-a3a1-2e36035d6b5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:35.473723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277d251-1d9c-4823-a3a1-2e36035d6b5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:35.475517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277d251-1d9c-4823-a3a1-2e36035d6b5b service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:35.492272 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2791/5561] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:35.493889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62faea7-83ff-4308-8683-b728333ef14f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:35.494411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62faea7-83ff-4308-8683-b728333ef14f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:35.494764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62faea7-83ff-4308-8683-b728333ef14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:35.507106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:35.517845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f62faea7-83ff-4308-8683-b728333ef14f None None] MFA Rules not processed for user `f501e7be812e41ebb05c15f0adfd8ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:35.519892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f62faea7-83ff-4308-8683-b728333ef14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:35.523832 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2792/5562] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:35 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:47:35.528225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f207dfb-c90f-46ba-af25-93d329de0c5e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:35.528619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f207dfb-c90f-46ba-af25-93d329de0c5e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:35.528896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f207dfb-c90f-46ba-af25-93d329de0c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:35.551361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1f207dfb-c90f-46ba-af25-93d329de0c5e None None] MFA Rules not processed for user `f501e7be812e41ebb05c15f0adfd8ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:35.553921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1f207dfb-c90f-46ba-af25-93d329de0c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:35.614126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7a08746b-894c-4489-89e5-97e52c4f7e12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf4ddbe0bf5042118914f60088976a9d', 'request_id': 'req-7a08746b-894c-4489-89e5-97e52c4f7e12'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:35.664371 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2793/5563] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:47:35.664371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f207dfb-c90f-46ba-af25-93d329de0c5e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:35.664371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1f207dfb-c90f-46ba-af25-93d329de0c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:35.681590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f207dfb-c90f-46ba-af25-93d329de0c5e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:35.750332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7a08746b-894c-4489-89e5-97e52c4f7e12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf4ddbe0bf5042118914f60088976a9d', 'request_id': 'req-7a08746b-894c-4489-89e5-97e52c4f7e12'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:35.758753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7a08746b-894c-4489-89e5-97e52c4f7e12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf4ddbe0bf5042118914f60088976a9d', 'request_id': 'req-7a08746b-894c-4489-89e5-97e52c4f7e12'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:35.778226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2743cbc-030b-4271-85ee-19cd899ba885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:35.779026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2743cbc-030b-4271-85ee-19cd899ba885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:35.779312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2743cbc-030b-4271-85ee-19cd899ba885 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:35.779660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2743cbc-030b-4271-85ee-19cd899ba885 admin admin] PATH_INFO: `/v3/projects/14a3cfa6aaa74174a706a759f692c113` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:35.780989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2743cbc-030b-4271-85ee-19cd899ba885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14a3cfa6aaa74174a706a759f692c113)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:35.781294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7a08746b-894c-4489-89e5-97e52c4f7e12 admin admin] The token cache is being invalidate because project cf4ddbe0bf5042118914f60088976a9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:35.781601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7a08746b-894c-4489-89e5-97e52c4f7e12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:35.782304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7a08746b-894c-4489-89e5-97e52c4f7e12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:35.783047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2743cbc-030b-4271-85ee-19cd899ba885 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:35.787251 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2771/5564] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:35 2022] DELETE /identity/v3/projects/cf4ddbe0bf5042118914f60088976a9d => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:35.787251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08746b-894c-4489-89e5-97e52c4f7e12 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:35.788932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7a08746b-894c-4489-89e5-97e52c4f7e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:35.805117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:35.890751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08746b-894c-4489-89e5-97e52c4f7e12 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:35.898862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ef1fe-e0c7-4047-9ed4-d4f43fdc75a7 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f501e7be812e41ebb05c15f0adfd8ea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91f48eb5f9be49ca85b5028084d5e0ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:35.899500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ef1fe-e0c7-4047-9ed4-d4f43fdc75a7 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:35.899932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ef1fe-e0c7-4047-9ed4-d4f43fdc75a7 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:35.900317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ef1fe-e0c7-4047-9ed4-d4f43fdc75a7 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] PATH_INFO: `/v3/users/f501e7be812e41ebb05c15f0adfd8ea2/password` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:35.968533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a2743cbc-030b-4271-85ee-19cd899ba885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14a3cfa6aaa74174a706a759f692c113', 'request_id': 'req-a2743cbc-030b-4271-85ee-19cd899ba885'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:35.971483 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-9c3ef1fe-e0c7-4047-9ed4-d4f43fdc75a7 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 27 03:47:35.971483 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:47:35.971483 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:47:35.971483 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:47:35.971483 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:47:35.971483 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:47:35.971483 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:47:35.971483 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:47:35.971483 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:47:35.971483 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:47:35.971483 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:47:35.971483 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:47:35.971483 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 27 03:47:35.972749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 27 03:47:35.972749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 27 03:47:35.972749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 27 03:47:35.972749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:47:35.972749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:47:35.972749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:47:35.972749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:47:35.972749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 27 03:47:35.972749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 27 03:47:35.972749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 27 03:47:35.972749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 27 03:47:35.972749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 27 03:47:35.972749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 27 03:47:35.972749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 27 03:47:35.972749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:47:35.974095 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2772/5565] 10.222.0.20 () {60 vars in 1269 bytes} [Thu Oct 27 03:47:35 2022] POST /identity/v3/users/f501e7be812e41ebb05c15f0adfd8ea2/password => generated 188 bytes in 189 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 27 03:47:35.976359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df938a-10b5-455f-89bd-14d05a927289 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:35.976838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df938a-10b5-455f-89bd-14d05a927289 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:35.977178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df938a-10b5-455f-89bd-14d05a927289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:35.987026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a2743cbc-030b-4271-85ee-19cd899ba885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14a3cfa6aaa74174a706a759f692c113', 'request_id': 'req-a2743cbc-030b-4271-85ee-19cd899ba885'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:36.014093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a2743cbc-030b-4271-85ee-19cd899ba885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14a3cfa6aaa74174a706a759f692c113', 'request_id': 'req-a2743cbc-030b-4271-85ee-19cd899ba885'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:36.019051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-77df938a-10b5-455f-89bd-14d05a927289 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:36.020314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-77df938a-10b5-455f-89bd-14d05a927289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:36.130273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a2743cbc-030b-4271-85ee-19cd899ba885 admin admin] The token cache is being invalidate because project 14a3cfa6aaa74174a706a759f692c113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:36.130273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a2743cbc-030b-4271-85ee-19cd899ba885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:36.130273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a2743cbc-030b-4271-85ee-19cd899ba885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:36.130273 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2794/5566] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:35 2022] DELETE /identity/v3/projects/14a3cfa6aaa74174a706a759f692c113 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:36.135701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2743cbc-030b-4271-85ee-19cd899ba885 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:36.135807 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2773/5567] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:36.137597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea70bfb-cedc-4895-82f2-e943ea9cf39f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:36.137961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea70bfb-cedc-4895-82f2-e943ea9cf39f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:36.138326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea70bfb-cedc-4895-82f2-e943ea9cf39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:36.142371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a2743cbc-030b-4271-85ee-19cd899ba885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:36.181808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-eea70bfb-cedc-4895-82f2-e943ea9cf39f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:36.183151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-eea70bfb-cedc-4895-82f2-e943ea9cf39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:36.209611 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2774/5568] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:47:36.210120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93c9e8-3726-4c31-8fcd-3b991d0ddf88 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:36.215312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93c9e8-3726-4c31-8fcd-3b991d0ddf88 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:36.215312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93c9e8-3726-4c31-8fcd-3b991d0ddf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:36.234803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-bc93c9e8-3726-4c31-8fcd-3b991d0ddf88 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:36.236021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bc93c9e8-3726-4c31-8fcd-3b991d0ddf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:36.244384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2743cbc-030b-4271-85ee-19cd899ba885 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:36.246533 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2775/5569] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:36.247854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f66735-62b6-40e5-b0c0-146ec167c4d4 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:36.248249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f66735-62b6-40e5-b0c0-146ec167c4d4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:36.248459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f66735-62b6-40e5-b0c0-146ec167c4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:36.265869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e841fa-4874-4aac-8c28-a486bd429f4d tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f501e7be812e41ebb05c15f0adfd8ea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91f48eb5f9be49ca85b5028084d5e0ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:36.266680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e841fa-4874-4aac-8c28-a486bd429f4d tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:36.266968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e841fa-4874-4aac-8c28-a486bd429f4d tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:36.267249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e841fa-4874-4aac-8c28-a486bd429f4d tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] PATH_INFO: `/v3/users/f501e7be812e41ebb05c15f0adfd8ea2/password` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:36.271010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-92f66735-62b6-40e5-b0c0-146ec167c4d4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:36.272880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-92f66735-62b6-40e5-b0c0-146ec167c4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:36.283061 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2776/5570] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:36.284269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f66735-62b6-40e5-b0c0-146ec167c4d4 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:36.311763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f66735-62b6-40e5-b0c0-146ec167c4d4 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:36.328124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa4dbc-e719-4ef5-ba88-77cead8cb5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:36.328757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa4dbc-e719-4ef5-ba88-77cead8cb5cd admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:36.329041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa4dbc-e719-4ef5-ba88-77cead8cb5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:36.329315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa4dbc-e719-4ef5-ba88-77cead8cb5cd admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:36.330651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa4dbc-e719-4ef5-ba88-77cead8cb5cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:47:36.330961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa4dbc-e719-4ef5-ba88-77cead8cb5cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:36.337645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa4dbc-e719-4ef5-ba88-77cead8cb5cd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:36.353616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-05e841fa-4874-4aac-8c28-a486bd429f4d tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 27 03:47:36.353616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:47:36.353616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:47:36.353616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:47:36.353616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:47:36.353616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:47:36.353616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:47:36.353616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:47:36.353616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:47:36.353616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:47:36.353616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:47:36.353616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:47:36.353616 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 27 03:47:36.355028 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 27 03:47:36.355028 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 27 03:47:36.355028 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 27 03:47:36.355028 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:47:36.355028 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:47:36.355028 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 03:47:36.355028 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 03:47:36.355028 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 27 03:47:36.355028 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 27 03:47:36.355028 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 27 03:47:36.355028 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 27 03:47:36.355028 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 27 03:47:36.355028 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 27 03:47:36.355028 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 27 03:47:36.355028 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:47:36.358233 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2795/5571] 10.222.0.20 () {60 vars in 1269 bytes} [Thu Oct 27 03:47:36 2022] POST /identity/v3/users/f501e7be812e41ebb05c15f0adfd8ea2/password => generated 188 bytes in 227 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 27 03:47:36.359584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e841fa-4874-4aac-8c28-a486bd429f4d tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:36.374687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e841fa-4874-4aac-8c28-a486bd429f4d tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:36.376677 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2777/5572] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:36.377611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa4dbc-e719-4ef5-ba88-77cead8cb5cd admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:36.382305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899b4f9-f794-4459-b3cf-53833fa9991c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:36.383296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899b4f9-f794-4459-b3cf-53833fa9991c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:36.383804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899b4f9-f794-4459-b3cf-53833fa9991c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:36.384296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899b4f9-f794-4459-b3cf-53833fa9991c admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:36.385453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899b4f9-f794-4459-b3cf-53833fa9991c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:47:36.385984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899b4f9-f794-4459-b3cf-53833fa9991c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:36.388334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899b4f9-f794-4459-b3cf-53833fa9991c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:36.389363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:36.405823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa4dbc-e719-4ef5-ba88-77cead8cb5cd admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:36.418902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd65fc-9743-4c75-9d64-34852c8e5403 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f501e7be812e41ebb05c15f0adfd8ea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91f48eb5f9be49ca85b5028084d5e0ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:36.421144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd65fc-9743-4c75-9d64-34852c8e5403 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:36.421576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd65fc-9743-4c75-9d64-34852c8e5403 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:36.427009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd65fc-9743-4c75-9d64-34852c8e5403 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] PATH_INFO: `/v3/users/f501e7be812e41ebb05c15f0adfd8ea2/password` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:36.431917 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2796/5573] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:36.432832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899b4f9-f794-4459-b3cf-53833fa9991c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:36.457160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899b4f9-f794-4459-b3cf-53833fa9991c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:36.480741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ab2a4-f9f1-456a-90dc-b2b02f22a230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:36.480741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ab2a4-f9f1-456a-90dc-b2b02f22a230 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:36.480741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ab2a4-f9f1-456a-90dc-b2b02f22a230 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:36.480741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ab2a4-f9f1-456a-90dc-b2b02f22a230 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:36.481801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ab2a4-f9f1-456a-90dc-b2b02f22a230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:36.482977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ab2a4-f9f1-456a-90dc-b2b02f22a230 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:36.587489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-febd65fc-9743-4c75-9d64-34852c8e5403 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f501e7be812e41ebb05c15f0adfd8ea2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:36.610149 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2797/5574] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:47:36 2022] POST /identity/v3/projects => generated 367 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:36.611536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ab2a4-f9f1-456a-90dc-b2b02f22a230 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:36.726196 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2778/5575] 10.222.0.20 () {60 vars in 1269 bytes} [Thu Oct 27 03:47:36 2022] POST /identity/v3/users/f501e7be812e41ebb05c15f0adfd8ea2/password => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:36.727044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd65fc-9743-4c75-9d64-34852c8e5403 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:36.750654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd65fc-9743-4c75-9d64-34852c8e5403 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:36.760183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7084996-0118-4afe-9292-f87260f5c887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:36.760848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7084996-0118-4afe-9292-f87260f5c887 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:36.761131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7084996-0118-4afe-9292-f87260f5c887 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:36.761428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7084996-0118-4afe-9292-f87260f5c887 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:36.762132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7084996-0118-4afe-9292-f87260f5c887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:36.764731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7084996-0118-4afe-9292-f87260f5c887 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:36.773012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ab2a4-f9f1-456a-90dc-b2b02f22a230 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:36.781830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001496e-199e-49f5-857b-6252f8ff5908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:36.782522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001496e-199e-49f5-857b-6252f8ff5908 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:36.782809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001496e-199e-49f5-857b-6252f8ff5908 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:36.783216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001496e-199e-49f5-857b-6252f8ff5908 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:36.784449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001496e-199e-49f5-857b-6252f8ff5908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:36.786565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001496e-199e-49f5-857b-6252f8ff5908 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:36.812352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:36.879399 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2779/5576] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:47:36 2022] POST /identity/v3/users => generated 284 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:36.887171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7084996-0118-4afe-9292-f87260f5c887 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:36.898445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7084996-0118-4afe-9292-f87260f5c887 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:36.909815 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2798/5577] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:47:36 2022] POST /identity/v3/projects => generated 373 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:36.912804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cbd92-3ad8-4ba1-8ffe-f1527df2f65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:36.913923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001496e-199e-49f5-857b-6252f8ff5908 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:36.916238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cbd92-3ad8-4ba1-8ffe-f1527df2f65d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:36.916528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cbd92-3ad8-4ba1-8ffe-f1527df2f65d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:36.917043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cbd92-3ad8-4ba1-8ffe-f1527df2f65d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:36.918279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94cbd92-3ad8-4ba1-8ffe-f1527df2f65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:36.923521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94cbd92-3ad8-4ba1-8ffe-f1527df2f65d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:36.950085 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2780/5578] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:36.953015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cbd92-3ad8-4ba1-8ffe-f1527df2f65d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:36.967965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cbd92-3ad8-4ba1-8ffe-f1527df2f65d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:37.067159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001496e-199e-49f5-857b-6252f8ff5908 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:37.078146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f9645-c1d7-49f8-94b5-64337e972962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:37.078861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f9645-c1d7-49f8-94b5-64337e972962 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:37.079033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f9645-c1d7-49f8-94b5-64337e972962 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:37.079310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f9645-c1d7-49f8-94b5-64337e972962 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:37.080029 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f9645-c1d7-49f8-94b5-64337e972962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:37.082128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f9645-c1d7-49f8-94b5-64337e972962 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:37.096291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a4121-6488-4902-baa9-53d34e040d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:37.096291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a4121-6488-4902-baa9-53d34e040d18 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:37.096291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a4121-6488-4902-baa9-53d34e040d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:37.096291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a4121-6488-4902-baa9-53d34e040d18 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:37.096753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a4121-6488-4902-baa9-53d34e040d18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:37.096753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a4121-6488-4902-baa9-53d34e040d18 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:37.099813 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2781/5579] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:47:37.100936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b71ec-4e27-4a09-9d3c-29fefc98815d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:37.101228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b71ec-4e27-4a09-9d3c-29fefc98815d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:37.101505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b71ec-4e27-4a09-9d3c-29fefc98815d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:37.144872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b09b71ec-4e27-4a09-9d3c-29fefc98815d None None] MFA Rules not processed for user `66ba627e73834b84b1ee6514e1facd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:37.149947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b09b71ec-4e27-4a09-9d3c-29fefc98815d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:37.196886 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2799/5580] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:47:36 2022] POST /identity/v3/users => generated 287 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:37.197966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a4121-6488-4902-baa9-53d34e040d18 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:37.228277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a4121-6488-4902-baa9-53d34e040d18 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:37.237680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20a91e-8932-444f-820f-844ea2d6e32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:37.238834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20a91e-8932-444f-820f-844ea2d6e32e admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:37.239188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20a91e-8932-444f-820f-844ea2d6e32e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:37.239543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20a91e-8932-444f-820f-844ea2d6e32e admin admin] PATH_INFO: `/v3/projects/bd67144b4af841f689217d6312083849/users/5c239e143a0d4a908a4f6330a638f0ee/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:37.284214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20a91e-8932-444f-820f-844ea2d6e32e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd67144b4af841f689217d6312083849, user_id=5c239e143a0d4a908a4f6330a638f0ee, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:37.288230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20a91e-8932-444f-820f-844ea2d6e32e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:37.351443 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2782/5581] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:37.352680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b71ec-4e27-4a09-9d3c-29fefc98815d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:37.366877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b71ec-4e27-4a09-9d3c-29fefc98815d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:37.375692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed48d9-dc20-48b6-9cce-a03be4c3eec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:37.377270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed48d9-dc20-48b6-9cce-a03be4c3eec7 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:37.378079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed48d9-dc20-48b6-9cce-a03be4c3eec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:37.379295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed48d9-dc20-48b6-9cce-a03be4c3eec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:37.380084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed48d9-dc20-48b6-9cce-a03be4c3eec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:37.383749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed48d9-dc20-48b6-9cce-a03be4c3eec7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:37.395054 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2800/5582] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:37 2022] PUT /identity/v3/projects/bd67144b4af841f689217d6312083849/users/5c239e143a0d4a908a4f6330a638f0ee/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:37.395515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20a91e-8932-444f-820f-844ea2d6e32e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:37.404208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ff20a91e-8932-444f-820f-844ea2d6e32e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:37.409769 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2783/5583] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:37.412196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcbbd8-b2db-41ce-9778-01ebda6d6159 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:37.412723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcbbd8-b2db-41ce-9778-01ebda6d6159 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:37.413126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcbbd8-b2db-41ce-9778-01ebda6d6159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:37.461736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-bfbcbbd8-b2db-41ce-9778-01ebda6d6159 None None] MFA Rules not processed for user `5c239e143a0d4a908a4f6330a638f0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:37.463015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bfbcbbd8-b2db-41ce-9778-01ebda6d6159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:37.564225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20a91e-8932-444f-820f-844ea2d6e32e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:37.568370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091ce02-82e6-48cc-ba77-72bb8b331962 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:37.569041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091ce02-82e6-48cc-ba77-72bb8b331962 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:37.572803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091ce02-82e6-48cc-ba77-72bb8b331962 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:37.572803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091ce02-82e6-48cc-ba77-72bb8b331962 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:37.585023 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2784/5584] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:37.586000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcbbd8-b2db-41ce-9778-01ebda6d6159 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:37.646958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091ce02-82e6-48cc-ba77-72bb8b331962 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:37.649440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091ce02-82e6-48cc-ba77-72bb8b331962 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:37.661237 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2801/5585] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:37.662362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091ce02-82e6-48cc-ba77-72bb8b331962 service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:37.714546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcbbd8-b2db-41ce-9778-01ebda6d6159 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:37.721649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68d681-cc92-4ce6-9dc4-8d3f3ea15f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:37.722468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68d681-cc92-4ce6-9dc4-8d3f3ea15f09 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:37.722823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68d681-cc92-4ce6-9dc4-8d3f3ea15f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:37.723216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68d681-cc92-4ce6-9dc4-8d3f3ea15f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:37.723978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68d681-cc92-4ce6-9dc4-8d3f3ea15f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:37.725673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68d681-cc92-4ce6-9dc4-8d3f3ea15f09 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:37.742397 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2785/5586] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:37.743811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266aeee4-d5f2-4baa-ba5c-14d298a8207f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:37.743943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266aeee4-d5f2-4baa-ba5c-14d298a8207f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:37.744173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266aeee4-d5f2-4baa-ba5c-14d298a8207f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:37.757976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091ce02-82e6-48cc-ba77-72bb8b331962 service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:37.788566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-266aeee4-d5f2-4baa-ba5c-14d298a8207f None None] MFA Rules not processed for user `f501e7be812e41ebb05c15f0adfd8ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:37.793570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1e4a2-450b-4c49-bdbe-53600e89b8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:37.793570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1e4a2-450b-4c49-bdbe-53600e89b8c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:37.793570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1e4a2-450b-4c49-bdbe-53600e89b8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:37.793570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1e4a2-450b-4c49-bdbe-53600e89b8c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:37.794154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1e4a2-450b-4c49-bdbe-53600e89b8c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:37.794498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-266aeee4-d5f2-4baa-ba5c-14d298a8207f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:37.794622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1e4a2-450b-4c49-bdbe-53600e89b8c8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:37.799263 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2786/5587] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:37 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:47:37.800289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266aeee4-d5f2-4baa-ba5c-14d298a8207f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:37.813368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266aeee4-d5f2-4baa-ba5c-14d298a8207f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:37.820076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3515e-8ee1-4732-9048-8ed767f04587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:37.821684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3515e-8ee1-4732-9048-8ed767f04587 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:37.822063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3515e-8ee1-4732-9048-8ed767f04587 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:37.822420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3515e-8ee1-4732-9048-8ed767f04587 admin admin] PATH_INFO: `/v3/projects/22265a03de2d478988f7a5ae2561e719/users/18d3c87c204946ffad3feb05bc6dfd53/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:37.843249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3515e-8ee1-4732-9048-8ed767f04587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22265a03de2d478988f7a5ae2561e719, user_id=18d3c87c204946ffad3feb05bc6dfd53, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:37.848168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3515e-8ee1-4732-9048-8ed767f04587 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:37.947422 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2802/5588] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:47:37 2022] POST /identity/v3/projects => generated 363 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:37.948742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f6ac0-1986-4ecb-90ca-b71df4705a9a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:37.949037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f6ac0-1986-4ecb-90ca-b71df4705a9a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:37.949318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f6ac0-1986-4ecb-90ca-b71df4705a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:37.976950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b71f6ac0-1986-4ecb-90ca-b71df4705a9a None None] MFA Rules not processed for user `f501e7be812e41ebb05c15f0adfd8ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:37.978332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b71f6ac0-1986-4ecb-90ca-b71df4705a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:38.008428 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2787/5589] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:37 2022] PUT /identity/v3/projects/22265a03de2d478988f7a5ae2561e719/users/18d3c87c204946ffad3feb05bc6dfd53/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:38.009134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3515e-8ee1-4732-9048-8ed767f04587 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:38.080223 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2803/5590] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:38.082233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d081c-e28a-4af6-ae99-5b82c414f548 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:38.082701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d081c-e28a-4af6-ae99-5b82c414f548 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:38.083327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d081c-e28a-4af6-ae99-5b82c414f548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:38.107712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-116d081c-e28a-4af6-ae99-5b82c414f548 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:38.108668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3515e-8ee1-4732-9048-8ed767f04587 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:38.108991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-116d081c-e28a-4af6-ae99-5b82c414f548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:38.113735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843080e1-7112-4cf0-af6a-469e3729ba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:38.114491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843080e1-7112-4cf0-af6a-469e3729ba2b admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:38.114868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843080e1-7112-4cf0-af6a-469e3729ba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:38.115313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843080e1-7112-4cf0-af6a-469e3729ba2b admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:38.116567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843080e1-7112-4cf0-af6a-469e3729ba2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:38.118061 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2804/5591] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:38.118251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843080e1-7112-4cf0-af6a-469e3729ba2b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:38.139422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d081c-e28a-4af6-ae99-5b82c414f548 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:38.221945 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2788/5592] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:47:38 2022] POST /identity/v3/users => generated 288 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:38.222911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843080e1-7112-4cf0-af6a-469e3729ba2b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:38.227956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-843080e1-7112-4cf0-af6a-469e3729ba2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:38.267378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d081c-e28a-4af6-ae99-5b82c414f548 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:38.281341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b4f42-0882-42c1-b11a-05a4b3e4797f tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f501e7be812e41ebb05c15f0adfd8ea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91f48eb5f9be49ca85b5028084d5e0ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:38.282160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b4f42-0882-42c1-b11a-05a4b3e4797f tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:38.282546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b4f42-0882-42c1-b11a-05a4b3e4797f tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:38.282918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b4f42-0882-42c1-b11a-05a4b3e4797f tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] PATH_INFO: `/v3/users/f501e7be812e41ebb05c15f0adfd8ea2/password` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:38.384182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:38.396990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843080e1-7112-4cf0-af6a-469e3729ba2b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:38.424299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47113b-850a-4987-8cd7-74ee081c1d81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:38.428262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47113b-850a-4987-8cd7-74ee081c1d81 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:38.428666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47113b-850a-4987-8cd7-74ee081c1d81 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:38.429056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47113b-850a-4987-8cd7-74ee081c1d81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:38.455401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f47113b-850a-4987-8cd7-74ee081c1d81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:38.460381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f47113b-850a-4987-8cd7-74ee081c1d81 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:38.489257 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2789/5593] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:38.492972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47113b-850a-4987-8cd7-74ee081c1d81 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:38.528218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47113b-850a-4987-8cd7-74ee081c1d81 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:38.535650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-961b4f42-0882-42c1-b11a-05a4b3e4797f tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f501e7be812e41ebb05c15f0adfd8ea2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:38.547282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0838a-e3ce-4dfa-b49d-6b2fed10a0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:38.547925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0838a-e3ce-4dfa-b49d-6b2fed10a0ab admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:38.548396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0838a-e3ce-4dfa-b49d-6b2fed10a0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:38.548686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0838a-e3ce-4dfa-b49d-6b2fed10a0ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:38.549522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0838a-e3ce-4dfa-b49d-6b2fed10a0ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:38.551345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0838a-e3ce-4dfa-b49d-6b2fed10a0ab admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:38.577631 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2790/5594] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:38.578868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0838a-e3ce-4dfa-b49d-6b2fed10a0ab admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:38.594118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0838a-e3ce-4dfa-b49d-6b2fed10a0ab admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:38.599450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48318f-a00e-4a35-846d-1277fe2390e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:38.600268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48318f-a00e-4a35-846d-1277fe2390e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:38.600560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48318f-a00e-4a35-846d-1277fe2390e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:38.600832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48318f-a00e-4a35-846d-1277fe2390e4 admin admin] PATH_INFO: `/v3/projects/696097cde9dd4148be22c954e0d49231/users/0987d141a6e249c29e2b5e7ec21bfe47/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:38.621495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48318f-a00e-4a35-846d-1277fe2390e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=696097cde9dd4148be22c954e0d49231, user_id=0987d141a6e249c29e2b5e7ec21bfe47, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:38.634018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48318f-a00e-4a35-846d-1277fe2390e4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:38.683103 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2805/5595] 10.222.0.20 () {60 vars in 1269 bytes} [Thu Oct 27 03:47:38 2022] POST /identity/v3/users/f501e7be812e41ebb05c15f0adfd8ea2/password => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:38.745395 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2791/5596] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:38 2022] PUT /identity/v3/projects/696097cde9dd4148be22c954e0d49231/users/0987d141a6e249c29e2b5e7ec21bfe47/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:47:38.749722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b4f42-0882-42c1-b11a-05a4b3e4797f tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:38.762636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b4f42-0882-42c1-b11a-05a4b3e4797f tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:38.813798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:38.962919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db1860-8d8e-4e53-a428-a7a6bcf5e9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:38.963950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db1860-8d8e-4e53-a428-a7a6bcf5e9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:38.965173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db1860-8d8e-4e53-a428-a7a6bcf5e9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:38.965173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db1860-8d8e-4e53-a428-a7a6bcf5e9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:38.965666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db1860-8d8e-4e53-a428-a7a6bcf5e9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:38.971179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db1860-8d8e-4e53-a428-a7a6bcf5e9e0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:38.987129 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2806/5597] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:38.991456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48318f-a00e-4a35-846d-1277fe2390e4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:39.031244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48318f-a00e-4a35-846d-1277fe2390e4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:39.038331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a719ae0-e76e-427d-ba4e-24000c2c2c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:39.039553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a719ae0-e76e-427d-ba4e-24000c2c2c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:39.040773 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a719ae0-e76e-427d-ba4e-24000c2c2c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:39.041863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a719ae0-e76e-427d-ba4e-24000c2c2c51 admin admin] PATH_INFO: `/v3/projects/696097cde9dd4148be22c954e0d49231/users/0987d141a6e249c29e2b5e7ec21bfe47/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:39.044213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a719ae0-e76e-427d-ba4e-24000c2c2c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=696097cde9dd4148be22c954e0d49231, user_id=0987d141a6e249c29e2b5e7ec21bfe47, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:39.048003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a719ae0-e76e-427d-ba4e-24000c2c2c51 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:39.067671 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2792/5598] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:38 2022] PUT /identity/v3/projects/696097cde9dd4148be22c954e0d49231/users/0987d141a6e249c29e2b5e7ec21bfe47/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:47:39.080225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c740a-7acf-4c84-b22e-456119773364 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:39.080606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c740a-7acf-4c84-b22e-456119773364 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:39.081521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c740a-7acf-4c84-b22e-456119773364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:39.127372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-363c740a-7acf-4c84-b22e-456119773364 None None] MFA Rules not processed for user `0987d141a6e249c29e2b5e7ec21bfe47`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:39.129103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-363c740a-7acf-4c84-b22e-456119773364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:39.245829 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2807/5599] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:39.250736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a719ae0-e76e-427d-ba4e-24000c2c2c51 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:39.265644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a719ae0-e76e-427d-ba4e-24000c2c2c51 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:39.278976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5be9a-832a-4ac8-80fa-1513f1911e72 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:39.279480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5be9a-832a-4ac8-80fa-1513f1911e72 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:39.279765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5be9a-832a-4ac8-80fa-1513f1911e72 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:39.280043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5be9a-832a-4ac8-80fa-1513f1911e72 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:39.280722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5be9a-832a-4ac8-80fa-1513f1911e72 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:39.285244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5be9a-832a-4ac8-80fa-1513f1911e72 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:39.396679 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2793/5600] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:47:39 2022] POST /identity/v3/roles => generated 234 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:47:39.401169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c740a-7acf-4c84-b22e-456119773364 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:39.412780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c740a-7acf-4c84-b22e-456119773364 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:39.419260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a44f8-f4f3-4e7b-bb5f-3fd82c315d28 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:39.421105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a44f8-f4f3-4e7b-bb5f-3fd82c315d28 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:39.421826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a44f8-f4f3-4e7b-bb5f-3fd82c315d28 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:39.421984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a44f8-f4f3-4e7b-bb5f-3fd82c315d28 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:39.423061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a44f8-f4f3-4e7b-bb5f-3fd82c315d28 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:39.425102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a44f8-f4f3-4e7b-bb5f-3fd82c315d28 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:39.533793 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2808/5601] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:47:39 2022] POST /identity/v3/roles => generated 234 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:47:39.538342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5be9a-832a-4ac8-80fa-1513f1911e72 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:39.565784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5be9a-832a-4ac8-80fa-1513f1911e72 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:39.577602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874299ac-2bb6-4bb7-aca2-2511c11f40a4 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:39.579701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874299ac-2bb6-4bb7-aca2-2511c11f40a4 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:39.579941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874299ac-2bb6-4bb7-aca2-2511c11f40a4 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:39.580231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874299ac-2bb6-4bb7-aca2-2511c11f40a4 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:39.582411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874299ac-2bb6-4bb7-aca2-2511c11f40a4 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:39.585801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874299ac-2bb6-4bb7-aca2-2511c11f40a4 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:39.709683 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2794/5602] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:47:39 2022] POST /identity/v3/roles => generated 234 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:39.710300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a44f8-f4f3-4e7b-bb5f-3fd82c315d28 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:39.710410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd40305-67ab-4bd0-b412-f0b0a7312b48 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:39.710410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd40305-67ab-4bd0-b412-f0b0a7312b48 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:39.710410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd40305-67ab-4bd0-b412-f0b0a7312b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:39.710731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a44f8-f4f3-4e7b-bb5f-3fd82c315d28 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:39.713296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bfafce-785a-41e9-9c30-ce84895f267c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:39.713942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfafce-785a-41e9-9c30-ce84895f267c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:39.714273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfafce-785a-41e9-9c30-ce84895f267c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:39.714555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfafce-785a-41e9-9c30-ce84895f267c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:39.715225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bfafce-785a-41e9-9c30-ce84895f267c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:39.717420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bfafce-785a-41e9-9c30-ce84895f267c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:39.746551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6bd40305-67ab-4bd0-b412-f0b0a7312b48 None None] MFA Rules not processed for user `f501e7be812e41ebb05c15f0adfd8ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:39.752967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6bd40305-67ab-4bd0-b412-f0b0a7312b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:39.766466 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2795/5603] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:39 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:47:39.771163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695dc61-c491-4249-a4ef-e8b71b4f539e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:39.771706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695dc61-c491-4249-a4ef-e8b71b4f539e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:39.778670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695dc61-c491-4249-a4ef-e8b71b4f539e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:39.815120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-7695dc61-c491-4249-a4ef-e8b71b4f539e None None] MFA Rules not processed for user `f501e7be812e41ebb05c15f0adfd8ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:39.818058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7695dc61-c491-4249-a4ef-e8b71b4f539e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:39.885433 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2809/5604] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:47:39 2022] POST /identity/v3/domains => generated 275 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:47:39.886794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bfafce-785a-41e9-9c30-ce84895f267c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:39.985353 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2796/5605] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:39.989570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695dc61-c491-4249-a4ef-e8b71b4f539e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:40.006720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bfafce-785a-41e9-9c30-ce84895f267c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:40.007714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695dc61-c491-4249-a4ef-e8b71b4f539e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:40.012242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9f62b-5536-4c42-8ec3-ac5a77eb8bfa tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:40.013478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9f62b-5536-4c42-8ec3-ac5a77eb8bfa tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:40.014833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9f62b-5536-4c42-8ec3-ac5a77eb8bfa tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:40.015394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9f62b-5536-4c42-8ec3-ac5a77eb8bfa tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:40.016300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9f62b-5536-4c42-8ec3-ac5a77eb8bfa tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:40.020788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9f62b-5536-4c42-8ec3-ac5a77eb8bfa tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:40.133133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bdea52-ae85-40e2-9d24-228ecab414db tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f501e7be812e41ebb05c15f0adfd8ea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91f48eb5f9be49ca85b5028084d5e0ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:40.134236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdea52-ae85-40e2-9d24-228ecab414db tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:40.134827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdea52-ae85-40e2-9d24-228ecab414db tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:40.135545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdea52-ae85-40e2-9d24-228ecab414db tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] PATH_INFO: `/v3/users/f501e7be812e41ebb05c15f0adfd8ea2/password` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:40.186186 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2810/5606] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:47:39 2022] POST /identity/v3/projects => generated 401 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:40.192964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9f62b-5536-4c42-8ec3-ac5a77eb8bfa tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:40.313862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-20bdea52-ae85-40e2-9d24-228ecab414db tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f501e7be812e41ebb05c15f0adfd8ea2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:40.348170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9f62b-5536-4c42-8ec3-ac5a77eb8bfa tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:40.353319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:40.356558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ef2d9-a119-4aa6-b481-e4d4278d3603 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:40.357284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ef2d9-a119-4aa6-b481-e4d4278d3603 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:40.357670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ef2d9-a119-4aa6-b481-e4d4278d3603 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:40.358027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ef2d9-a119-4aa6-b481-e4d4278d3603 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/groups` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:40.358779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ef2d9-a119-4aa6-b481-e4d4278d3603 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:40.360797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ef2d9-a119-4aa6-b481-e4d4278d3603 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:40.458842 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2797/5607] 10.222.0.20 () {60 vars in 1269 bytes} [Thu Oct 27 03:47:39 2022] POST /identity/v3/users/f501e7be812e41ebb05c15f0adfd8ea2/password => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:40.503615 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2811/5608] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:47:40 2022] POST /identity/v3/groups => generated 301 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:40.512069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bdea52-ae85-40e2-9d24-228ecab414db tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:40.536064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bdea52-ae85-40e2-9d24-228ecab414db tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:40.549752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e9a69-fcc1-4dae-942d-4720071ccd87 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:40.550507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e9a69-fcc1-4dae-942d-4720071ccd87 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:40.550799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e9a69-fcc1-4dae-942d-4720071ccd87 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:40.551083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e9a69-fcc1-4dae-942d-4720071ccd87 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:40.553438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e9a69-fcc1-4dae-942d-4720071ccd87 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:40.557681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e9a69-fcc1-4dae-942d-4720071ccd87 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:40.659995 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2798/5609] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:47:40 2022] POST /identity/v3/roles => generated 234 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:40.663581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ef2d9-a119-4aa6-b481-e4d4278d3603 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:40.675436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ef2d9-a119-4aa6-b481-e4d4278d3603 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:40.680423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e2d94-c3d8-49c4-bee0-44ccdad6783e tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:40.681038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e2d94-c3d8-49c4-bee0-44ccdad6783e tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:40.681387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e2d94-c3d8-49c4-bee0-44ccdad6783e tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:40.681795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e2d94-c3d8-49c4-bee0-44ccdad6783e tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:40.682519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e2d94-c3d8-49c4-bee0-44ccdad6783e tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:40.684482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e2d94-c3d8-49c4-bee0-44ccdad6783e tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:40.811769 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2812/5610] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:47:40 2022] POST /identity/v3/users => generated 442 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:40.816475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e9a69-fcc1-4dae-942d-4720071ccd87 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:40.828603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e9a69-fcc1-4dae-942d-4720071ccd87 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:40.851297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb872ae-dbe6-4d42-a70b-2420364e8530 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:40.851297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb872ae-dbe6-4d42-a70b-2420364e8530 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:40.851297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb872ae-dbe6-4d42-a70b-2420364e8530 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:40.851745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb872ae-dbe6-4d42-a70b-2420364e8530 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:40.851745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb872ae-dbe6-4d42-a70b-2420364e8530 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:40.851745 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-aeb872ae-dbe6-4d42-a70b-2420364e8530 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:40.851745 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:47:40.851745 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:47:40.851745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb872ae-dbe6-4d42-a70b-2420364e8530 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:40.959758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb428f8-1f4d-49a1-98bd-c82fba3989ea None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:40.959758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb428f8-1f4d-49a1-98bd-c82fba3989ea None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:40.959758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb428f8-1f4d-49a1-98bd-c82fba3989ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:40.993219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-cdb428f8-1f4d-49a1-98bd-c82fba3989ea None None] MFA Rules not processed for user `ca2da57f02884a968d685b53a5399e46`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:40.997897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cdb428f8-1f4d-49a1-98bd-c82fba3989ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:41.025381 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2799/5611] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:47:40 2022] POST /identity/v3/roles => generated 268 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:41.026314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb872ae-dbe6-4d42-a70b-2420364e8530 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:41.044759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb872ae-dbe6-4d42-a70b-2420364e8530 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:41.062255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2af240-eb82-49f5-8ef2-63b7be239f57 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:41.062895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2af240-eb82-49f5-8ef2-63b7be239f57 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:41.063186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2af240-eb82-49f5-8ef2-63b7be239f57 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:41.063471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2af240-eb82-49f5-8ef2-63b7be239f57 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/projects/69b460b9168847bbb5cc5a8200b263c2/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/240a72ecbf804ba1918f77d5cdb3c1c5` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:41.096164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2af240-eb82-49f5-8ef2-63b7be239f57 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_grant(project_id=69b460b9168847bbb5cc5a8200b263c2, user_id=d6a91a5b5e1f43d9aeb8b3da355f2c7c, role_id=240a72ecbf804ba1918f77d5cdb3c1c5)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:41.099048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2af240-eb82-49f5-8ef2-63b7be239f57 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:41.129022 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2813/5612] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:47:41.190584 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2800/5613] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:41 2022] PUT /identity/v3/projects/69b460b9168847bbb5cc5a8200b263c2/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/240a72ecbf804ba1918f77d5cdb3c1c5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:41.196835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb428f8-1f4d-49a1-98bd-c82fba3989ea None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:41.211833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb428f8-1f4d-49a1-98bd-c82fba3989ea None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:41.283476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0aaea-29dd-4355-a23b-222504611fed tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:41.284581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0aaea-29dd-4355-a23b-222504611fed tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:41.285139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0aaea-29dd-4355-a23b-222504611fed tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:41.285763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0aaea-29dd-4355-a23b-222504611fed tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:41.286789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0aaea-29dd-4355-a23b-222504611fed tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Adding query filter params (scope.project.id=69b460b9168847bbb5cc5a8200b263c2, user.id=d6a91a5b5e1f43d9aeb8b3da355f2c7c) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:47:41.287334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0aaea-29dd-4355-a23b-222504611fed tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:41.289753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0aaea-29dd-4355-a23b-222504611fed tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:41.414214 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2814/5614] 10.222.0.20 () {58 vars in 1356 bytes} [Thu Oct 27 03:47:41 2022] GET /identity/v3/role_assignments?scope.project.id=69b460b9168847bbb5cc5a8200b263c2&user.id=d6a91a5b5e1f43d9aeb8b3da355f2c7c&effective => generated 228 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:41.418424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2af240-eb82-49f5-8ef2-63b7be239f57 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:41.430365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2af240-eb82-49f5-8ef2-63b7be239f57 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:41.452657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199da751-4f6d-453c-ac86-860ca30317c2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:41.453822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199da751-4f6d-453c-ac86-860ca30317c2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:41.454346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199da751-4f6d-453c-ac86-860ca30317c2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:41.454798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199da751-4f6d-453c-ac86-860ca30317c2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/projects/69b460b9168847bbb5cc5a8200b263c2/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/240a72ecbf804ba1918f77d5cdb3c1c5` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:41.462811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014ddfa-3f7d-4cac-b438-bd8114248bdf None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:41.463650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014ddfa-3f7d-4cac-b438-bd8114248bdf None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:41.464117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014ddfa-3f7d-4cac-b438-bd8114248bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:41.474785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199da751-4f6d-453c-ac86-860ca30317c2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=69b460b9168847bbb5cc5a8200b263c2, user_id=d6a91a5b5e1f43d9aeb8b3da355f2c7c, role_id=240a72ecbf804ba1918f77d5cdb3c1c5)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:41.480776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199da751-4f6d-453c-ac86-860ca30317c2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:41.512564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-199da751-4f6d-453c-ac86-860ca30317c2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invalidating the token cache because role 240a72ecbf804ba1918f77d5cdb3c1c5 was removed from user d6a91a5b5e1f43d9aeb8b3da355f2c7c on project 69b460b9168847bbb5cc5a8200b263c2. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:41.518611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-199da751-4f6d-453c-ac86-860ca30317c2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:41.518611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-199da751-4f6d-453c-ac86-860ca30317c2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:41.518841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a014ddfa-3f7d-4cac-b438-bd8114248bdf None None] MFA Rules not processed for user `f501e7be812e41ebb05c15f0adfd8ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:41.522155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a014ddfa-3f7d-4cac-b438-bd8114248bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:41.536154 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2815/5615] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:41 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 03:47:41.538089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d8787-95aa-45e1-bbc9-61aad7b293ff None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:41.538089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d8787-95aa-45e1-bbc9-61aad7b293ff None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:41.538089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d8787-95aa-45e1-bbc9-61aad7b293ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:41.563662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ef4d8787-95aa-45e1-bbc9-61aad7b293ff None None] MFA Rules not processed for user `f501e7be812e41ebb05c15f0adfd8ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:41.564919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ef4d8787-95aa-45e1-bbc9-61aad7b293ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:41.644135 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2816/5616] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:41.648193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d8787-95aa-45e1-bbc9-61aad7b293ff None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:41.657484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d8787-95aa-45e1-bbc9-61aad7b293ff None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:41.675033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646867dc-e482-414b-a7f2-6db6bc6342ca tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f501e7be812e41ebb05c15f0adfd8ea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91f48eb5f9be49ca85b5028084d5e0ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:41.675033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646867dc-e482-414b-a7f2-6db6bc6342ca tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:41.675033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646867dc-e482-414b-a7f2-6db6bc6342ca tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:41.676273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646867dc-e482-414b-a7f2-6db6bc6342ca tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] PATH_INFO: `/v3/users/f501e7be812e41ebb05c15f0adfd8ea2/password` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:41.708278 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2801/5617] 10.222.0.20 () {58 vars in 1467 bytes} [Thu Oct 27 03:47:41 2022] DELETE /identity/v3/projects/69b460b9168847bbb5cc5a8200b263c2/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/240a72ecbf804ba1918f77d5cdb3c1c5 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:47:41.719235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199da751-4f6d-453c-ac86-860ca30317c2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:41.721821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-199da751-4f6d-453c-ac86-860ca30317c2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:41.827953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-646867dc-e482-414b-a7f2-6db6bc6342ca tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f501e7be812e41ebb05c15f0adfd8ea2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:41.838551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199da751-4f6d-453c-ac86-860ca30317c2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:41.853334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc9eeb-8674-4591-a2ee-21eb3bc9f549 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:41.854559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc9eeb-8674-4591-a2ee-21eb3bc9f549 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:41.855079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc9eeb-8674-4591-a2ee-21eb3bc9f549 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:41.855561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc9eeb-8674-4591-a2ee-21eb3bc9f549 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/240a72ecbf804ba1918f77d5cdb3c1c5` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:41.858370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc9eeb-8674-4591-a2ee-21eb3bc9f549 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=240a72ecbf804ba1918f77d5cdb3c1c5)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:41.859605 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-e3fc9eeb-8674-4591-a2ee-21eb3bc9f549 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:41.859605 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:47:41.859605 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:47:41.861348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc9eeb-8674-4591-a2ee-21eb3bc9f549 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:41.952735 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2817/5618] 10.222.0.20 () {60 vars in 1269 bytes} [Thu Oct 27 03:47:41 2022] POST /identity/v3/users/f501e7be812e41ebb05c15f0adfd8ea2/password => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:47:42.006293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e3fc9eeb-8674-4591-a2ee-21eb3bc9f549 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invalidating the token cache because role 240a72ecbf804ba1918f77d5cdb3c1c5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:42.007305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e3fc9eeb-8674-4591-a2ee-21eb3bc9f549 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:42.008757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e3fc9eeb-8674-4591-a2ee-21eb3bc9f549 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:42.011781 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2802/5619] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:41 2022] DELETE /identity/v3/roles/240a72ecbf804ba1918f77d5cdb3c1c5 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:47:42.017835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646867dc-e482-414b-a7f2-6db6bc6342ca tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:42.019726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-646867dc-e482-414b-a7f2-6db6bc6342ca tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:42.050230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646867dc-e482-414b-a7f2-6db6bc6342ca tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:42.093350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:42.215106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935654d6-05a0-4d9b-9fa0-4366a9f2b872 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:42.215854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935654d6-05a0-4d9b-9fa0-4366a9f2b872 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:42.216127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935654d6-05a0-4d9b-9fa0-4366a9f2b872 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:42.216414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935654d6-05a0-4d9b-9fa0-4366a9f2b872 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/projects/69b460b9168847bbb5cc5a8200b263c2/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/098c6cdac0004ef29753ae850dff7d6b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:42.222073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935654d6-05a0-4d9b-9fa0-4366a9f2b872 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_grant(project_id=69b460b9168847bbb5cc5a8200b263c2, user_id=d6a91a5b5e1f43d9aeb8b3da355f2c7c, role_id=098c6cdac0004ef29753ae850dff7d6b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:42.228200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935654d6-05a0-4d9b-9fa0-4366a9f2b872 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:42.257068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:42.348848 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2818/5620] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:42 2022] PUT /identity/v3/projects/69b460b9168847bbb5cc5a8200b263c2/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/098c6cdac0004ef29753ae850dff7d6b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:47:42.356413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc9eeb-8674-4591-a2ee-21eb3bc9f549 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:42.379140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc9eeb-8674-4591-a2ee-21eb3bc9f549 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:42.504104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73509b5-973c-437e-bca1-b7a0f1e810c7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:42.504881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73509b5-973c-437e-bca1-b7a0f1e810c7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:42.505465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73509b5-973c-437e-bca1-b7a0f1e810c7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:42.506074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73509b5-973c-437e-bca1-b7a0f1e810c7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:42.510476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73509b5-973c-437e-bca1-b7a0f1e810c7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=098c6cdac0004ef29753ae850dff7d6b, implied_role_id=53b212ca944742edb194af3e83f274fd)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:42.513000 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-f73509b5-973c-437e-bca1-b7a0f1e810c7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:42.513000 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:47:42.513000 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:47:42.515165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73509b5-973c-437e-bca1-b7a0f1e810c7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:42.664381 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2803/5621] 10.222.0.20 () {60 vars in 1363 bytes} [Thu Oct 27 03:47:42 2022] PUT /identity/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd => generated 519 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:42.668020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935654d6-05a0-4d9b-9fa0-4366a9f2b872 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:42.680776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935654d6-05a0-4d9b-9fa0-4366a9f2b872 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:42.850855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94591be-a822-49d1-8aaf-43f2ff4dae22 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:42.851478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94591be-a822-49d1-8aaf-43f2ff4dae22 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:42.851767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94591be-a822-49d1-8aaf-43f2ff4dae22 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:42.852063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94591be-a822-49d1-8aaf-43f2ff4dae22 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:42.852805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94591be-a822-49d1-8aaf-43f2ff4dae22 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Adding query filter params (scope.project.id=69b460b9168847bbb5cc5a8200b263c2, user.id=d6a91a5b5e1f43d9aeb8b3da355f2c7c) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:47:42.855035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94591be-a822-49d1-8aaf-43f2ff4dae22 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:42.863431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94591be-a822-49d1-8aaf-43f2ff4dae22 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:42.957788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b1fc0-e4ed-4f8a-ae39-d599175d1504 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:42.958438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b1fc0-e4ed-4f8a-ae39-d599175d1504 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:42.958550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b1fc0-e4ed-4f8a-ae39-d599175d1504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:43.028878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e74b1fc0-e4ed-4f8a-ae39-d599175d1504 None None] MFA Rules not processed for user `f501e7be812e41ebb05c15f0adfd8ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:43.030227 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2819/5622] 10.222.0.20 () {58 vars in 1356 bytes} [Thu Oct 27 03:47:42 2022] GET /identity/v3/role_assignments?scope.project.id=69b460b9168847bbb5cc5a8200b263c2&user.id=d6a91a5b5e1f43d9aeb8b3da355f2c7c&effective => generated 1061 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:43.034393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94591be-a822-49d1-8aaf-43f2ff4dae22 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:43.036863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e74b1fc0-e4ed-4f8a-ae39-d599175d1504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:43.054643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94591be-a822-49d1-8aaf-43f2ff4dae22 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:43.055480 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2804/5623] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:42 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 03:47:43.063962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed3323-35d1-4809-ac32-81ea000ee7c2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:43.065084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed3323-35d1-4809-ac32-81ea000ee7c2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:43.065547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed3323-35d1-4809-ac32-81ea000ee7c2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:43.066171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed3323-35d1-4809-ac32-81ea000ee7c2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:43.068341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed3323-35d1-4809-ac32-81ea000ee7c2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=098c6cdac0004ef29753ae850dff7d6b, implied_role_id=53b212ca944742edb194af3e83f274fd)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:43.069679 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-64ed3323-35d1-4809-ac32-81ea000ee7c2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:43.069679 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:47:43.069679 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:47:43.071402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed3323-35d1-4809-ac32-81ea000ee7c2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:43.201681 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2820/5624] 10.222.0.20 () {58 vars in 1347 bytes} [Thu Oct 27 03:47:43 2022] DELETE /identity/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:47:43.206141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b1fc0-e4ed-4f8a-ae39-d599175d1504 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:43.337659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b1fc0-e4ed-4f8a-ae39-d599175d1504 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:43.346181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83afeb0-50ac-4cea-8497-6d4a435694f3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:43.347266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83afeb0-50ac-4cea-8497-6d4a435694f3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:43.348328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83afeb0-50ac-4cea-8497-6d4a435694f3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:43.349232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83afeb0-50ac-4cea-8497-6d4a435694f3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:43.351979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83afeb0-50ac-4cea-8497-6d4a435694f3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Adding query filter params (scope.project.id=69b460b9168847bbb5cc5a8200b263c2, user.id=d6a91a5b5e1f43d9aeb8b3da355f2c7c) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:47:43.355878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83afeb0-50ac-4cea-8497-6d4a435694f3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:43.362388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83afeb0-50ac-4cea-8497-6d4a435694f3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:43.483547 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2805/5625] 10.222.0.20 () {58 vars in 1356 bytes} [Thu Oct 27 03:47:43 2022] GET /identity/v3/role_assignments?scope.project.id=69b460b9168847bbb5cc5a8200b263c2&user.id=d6a91a5b5e1f43d9aeb8b3da355f2c7c&effective => generated 577 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:43.488236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed3323-35d1-4809-ac32-81ea000ee7c2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:43.511764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed3323-35d1-4809-ac32-81ea000ee7c2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:43.529917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f75008-c7b2-4c1c-9602-44f3a4a27cf3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:43.533220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f75008-c7b2-4c1c-9602-44f3a4a27cf3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:43.533220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f75008-c7b2-4c1c-9602-44f3a4a27cf3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:43.533220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f75008-c7b2-4c1c-9602-44f3a4a27cf3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:43.534722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f75008-c7b2-4c1c-9602-44f3a4a27cf3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=098c6cdac0004ef29753ae850dff7d6b, implied_role_id=53b212ca944742edb194af3e83f274fd)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:43.536550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f75008-c7b2-4c1c-9602-44f3a4a27cf3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:43.626112 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-b8f75008-c7b2-4c1c-9602-44f3a4a27cf3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] 098c6cdac0004ef29753ae850dff7d6b does not imply 53b212ca944742edb194af3e83f274fd.: keystone.exception.ImpliedRoleNotFound: 098c6cdac0004ef29753ae850dff7d6b does not imply 53b212ca944742edb194af3e83f274fd. Oct 27 03:47:43.626112 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:47:43.626112 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 27 03:47:43.626112 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = query.one() Oct 27 03:47:43.626112 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 27 03:47:43.626112 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._iter().one() Oct 27 03:47:43.626112 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 27 03:47:43.626112 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._only_one_row( Oct 27 03:47:43.626112 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 27 03:47:43.626112 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 27 03:47:43.626112 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 27 03:47:43.626112 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:47:43.626112 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:47:43.626112 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:47:43.626112 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:47:43.626112 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:47:43.627662 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:47:43.627662 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:47:43.627662 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:47:43.627662 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:47:43.627662 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:47:43.627662 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:47:43.627662 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:47:43.627662 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:47:43.627662 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:47:43.627662 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 27 03:47:43.627662 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 27 03:47:43.627662 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:47:43.627662 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:47:43.627662 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 27 03:47:43.627662 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 27 03:47:43.627662 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 27 03:47:43.629018 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 27 03:47:43.629018 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 27 03:47:43.629018 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 27 03:47:43.629018 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 098c6cdac0004ef29753ae850dff7d6b does not imply 53b212ca944742edb194af3e83f274fd. Oct 27 03:47:43.629018 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:47:43.631574 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2821/5626] 10.222.0.20 () {58 vars in 1347 bytes} [Thu Oct 27 03:47:43 2022] DELETE /identity/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd => generated 137 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:47:43.636074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83afeb0-50ac-4cea-8497-6d4a435694f3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:43.660614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83afeb0-50ac-4cea-8497-6d4a435694f3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:43.683929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f639e36-59dd-4173-8eee-19d5be80e4c8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:43.684630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f639e36-59dd-4173-8eee-19d5be80e4c8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:43.685032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f639e36-59dd-4173-8eee-19d5be80e4c8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:43.685318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f639e36-59dd-4173-8eee-19d5be80e4c8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/projects/69b460b9168847bbb5cc5a8200b263c2/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/098c6cdac0004ef29753ae850dff7d6b` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:43.698966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f639e36-59dd-4173-8eee-19d5be80e4c8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=69b460b9168847bbb5cc5a8200b263c2, user_id=d6a91a5b5e1f43d9aeb8b3da355f2c7c, role_id=098c6cdac0004ef29753ae850dff7d6b)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:43.702416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f639e36-59dd-4173-8eee-19d5be80e4c8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:43.718431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:43.725146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9f639e36-59dd-4173-8eee-19d5be80e4c8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invalidating the token cache because role 098c6cdac0004ef29753ae850dff7d6b was removed from user d6a91a5b5e1f43d9aeb8b3da355f2c7c on project 69b460b9168847bbb5cc5a8200b263c2. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:43.725465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9f639e36-59dd-4173-8eee-19d5be80e4c8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:43.727428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9f639e36-59dd-4173-8eee-19d5be80e4c8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:43.863052 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2806/5627] 10.222.0.20 () {58 vars in 1467 bytes} [Thu Oct 27 03:47:43 2022] DELETE /identity/v3/projects/69b460b9168847bbb5cc5a8200b263c2/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/098c6cdac0004ef29753ae850dff7d6b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:43.864071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f75008-c7b2-4c1c-9602-44f3a4a27cf3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:43.865841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b8f75008-c7b2-4c1c-9602-44f3a4a27cf3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:43.895513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f75008-c7b2-4c1c-9602-44f3a4a27cf3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:44.058672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:44.060745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d63b0-65b6-48dc-b2b6-024c9469ea8f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:44.061282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d63b0-65b6-48dc-b2b6-024c9469ea8f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:44.061920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d63b0-65b6-48dc-b2b6-024c9469ea8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:44.081475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f7480-6181-4a4d-b7a5-48deca77e004 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:44.082585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f7480-6181-4a4d-b7a5-48deca77e004 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:44.083519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f7480-6181-4a4d-b7a5-48deca77e004 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:44.084035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f7480-6181-4a4d-b7a5-48deca77e004 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:44.085048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f7480-6181-4a4d-b7a5-48deca77e004 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:44.086399 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-4a7f7480-6181-4a4d-b7a5-48deca77e004 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:44.086399 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:47:44.086399 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:47:44.088171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f7480-6181-4a4d-b7a5-48deca77e004 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:44.097194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-7d1d63b0-65b6-48dc-b2b6-024c9469ea8f None None] MFA Rules not processed for user `f501e7be812e41ebb05c15f0adfd8ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:44.106695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7d1d63b0-65b6-48dc-b2b6-024c9469ea8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:44.192075 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2822/5628] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:47:43 2022] POST /identity/v3/roles => generated 271 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:47:44.196094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f7480-6181-4a4d-b7a5-48deca77e004 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:44.226624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f7480-6181-4a4d-b7a5-48deca77e004 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:44.257343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed849f-e24b-4f79-aaa7-7513b8e31b91 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:44.263401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed849f-e24b-4f79-aaa7-7513b8e31b91 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:44.264982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed849f-e24b-4f79-aaa7-7513b8e31b91 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:44.265573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed849f-e24b-4f79-aaa7-7513b8e31b91 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:44.267918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed849f-e24b-4f79-aaa7-7513b8e31b91 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Adding query filter params (domain_id=9b43c405024c47238c60b4cd20f9cc1e) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:47:44.275648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed849f-e24b-4f79-aaa7-7513b8e31b91 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:44.277197 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-faed849f-e24b-4f79-aaa7-7513b8e31b91 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:44.277197 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:47:44.277197 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:47:44.283761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed849f-e24b-4f79-aaa7-7513b8e31b91 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:44.307466 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2807/5629] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:47:44.313739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cd572-d459-4cb6-b15e-f038a5201c87 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:44.314108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cd572-d459-4cb6-b15e-f038a5201c87 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:44.314381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cd572-d459-4cb6-b15e-f038a5201c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:44.327261 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2823/5630] 10.222.0.20 () {58 vars in 1207 bytes} [Thu Oct 27 03:47:44 2022] GET /identity/v3/roles?domain_id=9b43c405024c47238c60b4cd20f9cc1e => generated 408 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:44.330114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed849f-e24b-4f79-aaa7-7513b8e31b91 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:44.364261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed849f-e24b-4f79-aaa7-7513b8e31b91 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:44.368333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bebd4-2365-4e4e-8504-0ca0b9f741d8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:44.369320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bebd4-2365-4e4e-8504-0ca0b9f741d8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:44.370405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bebd4-2365-4e4e-8504-0ca0b9f741d8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:44.370938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bebd4-2365-4e4e-8504-0ca0b9f741d8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/4033d8e60e864dff9ed643146abc9eae` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:44.374583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bebd4-2365-4e4e-8504-0ca0b9f741d8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=4033d8e60e864dff9ed643146abc9eae)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:44.377784 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-917bebd4-2365-4e4e-8504-0ca0b9f741d8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:44.377784 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:47:44.377784 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:47:44.380879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bebd4-2365-4e4e-8504-0ca0b9f741d8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:44.395300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-622cd572-d459-4cb6-b15e-f038a5201c87 None None] MFA Rules not processed for user `f501e7be812e41ebb05c15f0adfd8ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:44.399054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-622cd572-d459-4cb6-b15e-f038a5201c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:44.415249 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2808/5631] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:44 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:47:44.443203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ab10b-f08c-47e0-99e0-a6990da35ad9 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:44.443518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ab10b-f08c-47e0-99e0-a6990da35ad9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:44.449554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ab10b-f08c-47e0-99e0-a6990da35ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:44.596514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-917bebd4-2365-4e4e-8504-0ca0b9f741d8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invalidating the token cache because role 4033d8e60e864dff9ed643146abc9eae has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:44.597689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-917bebd4-2365-4e4e-8504-0ca0b9f741d8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:44.598694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-917bebd4-2365-4e4e-8504-0ca0b9f741d8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:44.613340 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2824/5632] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:44 2022] DELETE /identity/v3/roles/4033d8e60e864dff9ed643146abc9eae => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:44.617549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bebd4-2365-4e4e-8504-0ca0b9f741d8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:44.623748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-917bebd4-2365-4e4e-8504-0ca0b9f741d8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:44.928749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:44.944570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bebd4-2365-4e4e-8504-0ca0b9f741d8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:44.958578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89953bfa-8275-4c83-a2b1-df03fc6a7e2d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:44.959297 n-d-862769-1 devstack@keystone.service[82179]: WARNING keystone.server.flask.application [None req-2f5ab10b-f08c-47e0-99e0-a6990da35ad9 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.20: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 27 03:47:44.961024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89953bfa-8275-4c83-a2b1-df03fc6a7e2d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:44.961858 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2809/5633] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:44 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 553 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Oct 27 03:47:44.965876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89953bfa-8275-4c83-a2b1-df03fc6a7e2d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:44.967194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fdd55-80b7-40d0-981a-115605b7e159 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:44.967547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89953bfa-8275-4c83-a2b1-df03fc6a7e2d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:44.967853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fdd55-80b7-40d0-981a-115605b7e159 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:44.968282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fdd55-80b7-40d0-981a-115605b7e159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:44.968883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89953bfa-8275-4c83-a2b1-df03fc6a7e2d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Adding query filter params (domain_id=9b43c405024c47238c60b4cd20f9cc1e) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:47:44.970840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89953bfa-8275-4c83-a2b1-df03fc6a7e2d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:44.973608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89953bfa-8275-4c83-a2b1-df03fc6a7e2d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:44.984251 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2825/5634] 10.222.0.20 () {58 vars in 1207 bytes} [Thu Oct 27 03:47:44 2022] GET /identity/v3/roles?domain_id=9b43c405024c47238c60b4cd20f9cc1e => generated 148 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:44.987126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89953bfa-8275-4c83-a2b1-df03fc6a7e2d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:45.010638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89953bfa-8275-4c83-a2b1-df03fc6a7e2d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:45.025657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00bc85-5681-4d57-b18d-425a1d662f7e tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:45.026592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00bc85-5681-4d57-b18d-425a1d662f7e tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:45.027008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00bc85-5681-4d57-b18d-425a1d662f7e tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:45.027397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00bc85-5681-4d57-b18d-425a1d662f7e tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/4033d8e60e864dff9ed643146abc9eae` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:45.060364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00bc85-5681-4d57-b18d-425a1d662f7e tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:47:45.076500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-5e00bc85-5681-4d57-b18d-425a1d662f7e tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Could not find role: 4033d8e60e864dff9ed643146abc9eae.: keystone.exception.RoleNotFound: Could not find role: 4033d8e60e864dff9ed643146abc9eae. Oct 27 03:47:45.076500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:47:45.076500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:47:45.076500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:47:45.076500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:47:45.076500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:47:45.076500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:47:45.076500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:47:45.076500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:47:45.076500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:47:45.076500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:47:45.076500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:47:45.076500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Oct 27 03:47:45.076500 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Oct 27 03:47:45.077832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:47:45.077832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:47:45.077832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:47:45.077832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:47:45.077832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:47:45.077832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:47:45.077832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:47:45.077832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:47:45.077832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:47:45.077832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:47:45.077832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:47:45.077832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:47:45.077832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:47:45.077832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:47:45.077832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:47:45.077832 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:47:45.079271 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:47:45.079271 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:47:45.079271 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:47:45.079271 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:47:45.079271 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 03:47:45.079271 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 03:47:45.079271 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 03:47:45.079271 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 03:47:45.079271 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 03:47:45.079271 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 03:47:45.079271 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 4033d8e60e864dff9ed643146abc9eae. Oct 27 03:47:45.079271 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:47:45.085689 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2826/5635] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:44 2022] DELETE /identity/v3/roles/4033d8e60e864dff9ed643146abc9eae => generated 110 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:47:45.090653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00bc85-5681-4d57-b18d-425a1d662f7e tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:45.113815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00bc85-5681-4d57-b18d-425a1d662f7e tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:45.132278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97707b8d-8b9f-4ff1-a508-464a251abfe3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:45.133394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97707b8d-8b9f-4ff1-a508-464a251abfe3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:45.135204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97707b8d-8b9f-4ff1-a508-464a251abfe3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:45.135946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97707b8d-8b9f-4ff1-a508-464a251abfe3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/domains/9b43c405024c47238c60b4cd20f9cc1e/groups/3fdce43033634bc7b2028e8549520b69/roles/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:45.157320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97707b8d-8b9f-4ff1-a508-464a251abfe3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=9b43c405024c47238c60b4cd20f9cc1e, group_id=3fdce43033634bc7b2028e8549520b69, role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:45.160858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97707b8d-8b9f-4ff1-a508-464a251abfe3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:45.174747 n-d-862769-1 devstack@keystone.service[82179]: WARNING keystone.server.flask.application [None req-884fdd55-80b7-40d0-981a-115605b7e159 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.20: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 27 03:47:45.198503 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2810/5636] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:44 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 223 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 27 03:47:45.204026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056550b-12e1-4c8b-b85a-588d1fa29f43 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:45.204026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056550b-12e1-4c8b-b85a-588d1fa29f43 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:45.204026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056550b-12e1-4c8b-b85a-588d1fa29f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:45.264122 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2827/5637] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:45 2022] PUT /identity/v3/domains/9b43c405024c47238c60b4cd20f9cc1e/groups/3fdce43033634bc7b2028e8549520b69/roles/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:47:45.268718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97707b8d-8b9f-4ff1-a508-464a251abfe3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:45.295762 n-d-862769-1 devstack@keystone.service[82179]: WARNING keystone.server.flask.application [None req-8056550b-12e1-4c8b-b85a-588d1fa29f43 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.20: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 27 03:47:45.297714 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2811/5638] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:45 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 99 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 27 03:47:45.400903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97707b8d-8b9f-4ff1-a508-464a251abfe3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:45.407077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a1e2b-0528-4fc9-8f0a-fdf0ea5723dc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:45.408018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a1e2b-0528-4fc9-8f0a-fdf0ea5723dc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:45.408311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a1e2b-0528-4fc9-8f0a-fdf0ea5723dc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:45.408664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a1e2b-0528-4fc9-8f0a-fdf0ea5723dc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/domains/9b43c405024c47238c60b4cd20f9cc1e/groups/3fdce43033634bc7b2028e8549520b69/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:45.411233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a1e2b-0528-4fc9-8f0a-fdf0ea5723dc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=9b43c405024c47238c60b4cd20f9cc1e, group_id=3fdce43033634bc7b2028e8549520b69)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:45.414376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a1e2b-0528-4fc9-8f0a-fdf0ea5723dc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:45.443702 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2828/5639] 10.222.0.20 () {58 vars in 1365 bytes} [Thu Oct 27 03:47:45 2022] GET /identity/v3/domains/9b43c405024c47238c60b4cd20f9cc1e/groups/3fdce43033634bc7b2028e8549520b69/roles => generated 409 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:45.443981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056550b-12e1-4c8b-b85a-588d1fa29f43 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:45.446335 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:45.462781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056550b-12e1-4c8b-b85a-588d1fa29f43 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:45.475835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e6af7-c3ea-41a8-b641-bf0129db3bab tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:45.477217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e6af7-c3ea-41a8-b641-bf0129db3bab tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:45.478797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e6af7-c3ea-41a8-b641-bf0129db3bab tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:45.479632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e6af7-c3ea-41a8-b641-bf0129db3bab tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/domains/9b43c405024c47238c60b4cd20f9cc1e/groups/3fdce43033634bc7b2028e8549520b69/roles/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:45.485766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e6af7-c3ea-41a8-b641-bf0129db3bab tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=9b43c405024c47238c60b4cd20f9cc1e, group_id=3fdce43033634bc7b2028e8549520b69, role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:45.493356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e6af7-c3ea-41a8-b641-bf0129db3bab tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:45.516699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a1e2b-0528-4fc9-8f0a-fdf0ea5723dc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:45.517422 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2812/5640] 10.222.0.20 () {58 vars in 1465 bytes} [Thu Oct 27 03:47:45 2022] HEAD /identity/v3/domains/9b43c405024c47238c60b4cd20f9cc1e/groups/3fdce43033634bc7b2028e8549520b69/roles/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:45.552541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a1e2b-0528-4fc9-8f0a-fdf0ea5723dc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:45.579039 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d83e5-0d7f-4091-96e4-6a60317ae00d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:45.579744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d83e5-0d7f-4091-96e4-6a60317ae00d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:45.580034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d83e5-0d7f-4091-96e4-6a60317ae00d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:45.580326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d83e5-0d7f-4091-96e4-6a60317ae00d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/domains/9b43c405024c47238c60b4cd20f9cc1e/groups/3fdce43033634bc7b2028e8549520b69/roles/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:45.591004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d83e5-0d7f-4091-96e4-6a60317ae00d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=9b43c405024c47238c60b4cd20f9cc1e, group_id=3fdce43033634bc7b2028e8549520b69, role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:45.594288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d83e5-0d7f-4091-96e4-6a60317ae00d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:45.619265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-640d83e5-0d7f-4091-96e4-6a60317ae00d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invalidating the token cache because role 3a45126f0c3b4a19bdbb05359c2b8a4a was removed from group 3fdce43033634bc7b2028e8549520b69 on domain 9b43c405024c47238c60b4cd20f9cc1e. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:45.619993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-640d83e5-0d7f-4091-96e4-6a60317ae00d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:45.620564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-640d83e5-0d7f-4091-96e4-6a60317ae00d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:45.695282 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2829/5641] 10.222.0.20 () {58 vars in 1467 bytes} [Thu Oct 27 03:47:45 2022] DELETE /identity/v3/domains/9b43c405024c47238c60b4cd20f9cc1e/groups/3fdce43033634bc7b2028e8549520b69/roles/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:45.700462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e6af7-c3ea-41a8-b641-bf0129db3bab tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:45.703677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-911e6af7-c3ea-41a8-b641-bf0129db3bab tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:45.738705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e6af7-c3ea-41a8-b641-bf0129db3bab tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:45.802168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746a40b-7310-4b0f-bf13-976718f4dc01 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:45.803178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746a40b-7310-4b0f-bf13-976718f4dc01 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:45.803585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746a40b-7310-4b0f-bf13-976718f4dc01 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:45.803982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746a40b-7310-4b0f-bf13-976718f4dc01 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/projects/69b460b9168847bbb5cc5a8200b263c2/groups/3fdce43033634bc7b2028e8549520b69/roles/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:45.807515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746a40b-7310-4b0f-bf13-976718f4dc01 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_grant(project_id=69b460b9168847bbb5cc5a8200b263c2, group_id=3fdce43033634bc7b2028e8549520b69, role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:45.811826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746a40b-7310-4b0f-bf13-976718f4dc01 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:45.933493 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2813/5642] 10.222.0.20 () {60 vars in 1486 bytes} [Thu Oct 27 03:47:45 2022] PUT /identity/v3/projects/69b460b9168847bbb5cc5a8200b263c2/groups/3fdce43033634bc7b2028e8549520b69/roles/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:45.937651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d83e5-0d7f-4091-96e4-6a60317ae00d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:45.951719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d83e5-0d7f-4091-96e4-6a60317ae00d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:46.104675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693addd0-c669-4ce0-b70c-30e420180aa6 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:46.105509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693addd0-c669-4ce0-b70c-30e420180aa6 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:46.105877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693addd0-c669-4ce0-b70c-30e420180aa6 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:46.106206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693addd0-c669-4ce0-b70c-30e420180aa6 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/projects/69b460b9168847bbb5cc5a8200b263c2/groups/3fdce43033634bc7b2028e8549520b69/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:46.121089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693addd0-c669-4ce0-b70c-30e420180aa6 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:list_grants(project_id=69b460b9168847bbb5cc5a8200b263c2, group_id=3fdce43033634bc7b2028e8549520b69)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:46.129891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693addd0-c669-4ce0-b70c-30e420180aa6 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:46.158161 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2830/5643] 10.222.0.20 () {58 vars in 1368 bytes} [Thu Oct 27 03:47:45 2022] GET /identity/v3/projects/69b460b9168847bbb5cc5a8200b263c2/groups/3fdce43033634bc7b2028e8549520b69/roles => generated 410 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:46.162527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746a40b-7310-4b0f-bf13-976718f4dc01 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:46.175230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746a40b-7310-4b0f-bf13-976718f4dc01 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:46.203323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7556c7-d2a8-442d-858d-576cd0ee1baa tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:46.204924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7556c7-d2a8-442d-858d-576cd0ee1baa tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:46.205389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7556c7-d2a8-442d-858d-576cd0ee1baa tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:46.205898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7556c7-d2a8-442d-858d-576cd0ee1baa tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/groups/3fdce43033634bc7b2028e8549520b69/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:46.208056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:46.212738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7556c7-d2a8-442d-858d-576cd0ee1baa tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=3fdce43033634bc7b2028e8549520b69, user_id=d6a91a5b5e1f43d9aeb8b3da355f2c7c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:46.213234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7556c7-d2a8-442d-858d-576cd0ee1baa tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:46.339199 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2814/5644] 10.222.0.20 () {60 vars in 1360 bytes} [Thu Oct 27 03:47:46 2022] PUT /identity/v3/groups/3fdce43033634bc7b2028e8549520b69/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:46.345691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5e070-4830-436c-b3aa-fbc6192cc9b6 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:46.345993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5e070-4830-436c-b3aa-fbc6192cc9b6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:46.346308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5e070-4830-436c-b3aa-fbc6192cc9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:46.405165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-69c5e070-4830-436c-b3aa-fbc6192cc9b6 None None] MFA Rules not processed for user `d6a91a5b5e1f43d9aeb8b3da355f2c7c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:46.406534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-69c5e070-4830-436c-b3aa-fbc6192cc9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:46.622016 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2831/5645] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:46 2022] POST /identity/v3/auth/tokens => generated 3265 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:46.627228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7556c7-d2a8-442d-858d-576cd0ee1baa tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:46.739099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7556c7-d2a8-442d-858d-576cd0ee1baa tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:46.746539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e143c-d9dc-4254-b4b6-cec31a1574c8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:46.747721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e143c-d9dc-4254-b4b6-cec31a1574c8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:46.748216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e143c-d9dc-4254-b4b6-cec31a1574c8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:46.748687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e143c-d9dc-4254-b4b6-cec31a1574c8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/projects/69b460b9168847bbb5cc5a8200b263c2/groups/3fdce43033634bc7b2028e8549520b69/roles/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:46.753471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e143c-d9dc-4254-b4b6-cec31a1574c8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:check_grant(project_id=69b460b9168847bbb5cc5a8200b263c2, group_id=3fdce43033634bc7b2028e8549520b69, role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:46.756783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e143c-d9dc-4254-b4b6-cec31a1574c8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:46.770836 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2815/5646] 10.222.0.20 () {58 vars in 1468 bytes} [Thu Oct 27 03:47:46 2022] HEAD /identity/v3/projects/69b460b9168847bbb5cc5a8200b263c2/groups/3fdce43033634bc7b2028e8549520b69/roles/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:46.771735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5e070-4830-436c-b3aa-fbc6192cc9b6 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:46.807431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5e070-4830-436c-b3aa-fbc6192cc9b6 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:46.820129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab993211-90a4-4999-a4ac-9c06f0f13863 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:46.822241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab993211-90a4-4999-a4ac-9c06f0f13863 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:46.822241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab993211-90a4-4999-a4ac-9c06f0f13863 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:46.822241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab993211-90a4-4999-a4ac-9c06f0f13863 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/projects/69b460b9168847bbb5cc5a8200b263c2/groups/3fdce43033634bc7b2028e8549520b69/roles/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:46.828479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab993211-90a4-4999-a4ac-9c06f0f13863 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=69b460b9168847bbb5cc5a8200b263c2, group_id=3fdce43033634bc7b2028e8549520b69, role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:46.836223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab993211-90a4-4999-a4ac-9c06f0f13863 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:46.846995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ab993211-90a4-4999-a4ac-9c06f0f13863 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invalidating the token cache because role 3a45126f0c3b4a19bdbb05359c2b8a4a was removed from group 3fdce43033634bc7b2028e8549520b69 on project 69b460b9168847bbb5cc5a8200b263c2. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:46.847394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ab993211-90a4-4999-a4ac-9c06f0f13863 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:46.850413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ab993211-90a4-4999-a4ac-9c06f0f13863 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:46.975564 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2832/5647] 10.222.0.20 () {58 vars in 1470 bytes} [Thu Oct 27 03:47:46 2022] DELETE /identity/v3/projects/69b460b9168847bbb5cc5a8200b263c2/groups/3fdce43033634bc7b2028e8549520b69/roles/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:46.980687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e143c-d9dc-4254-b4b6-cec31a1574c8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:46.983346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-793e143c-d9dc-4254-b4b6-cec31a1574c8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:47.006801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e143c-d9dc-4254-b4b6-cec31a1574c8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:47.167853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0ffaf-8fd1-40ed-b564-447338c7e9e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:47.168899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0ffaf-8fd1-40ed-b564-447338c7e9e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:47.168899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0ffaf-8fd1-40ed-b564-447338c7e9e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:47.169205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0ffaf-8fd1-40ed-b564-447338c7e9e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/groups/3fdce43033634bc7b2028e8549520b69/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:47.172112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc0ffaf-8fd1-40ed-b564-447338c7e9e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=3fdce43033634bc7b2028e8549520b69, user_id=d6a91a5b5e1f43d9aeb8b3da355f2c7c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:47.173498 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-bcc0ffaf-8fd1-40ed-b564-447338c7e9e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:47.173498 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:47:47.173498 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:47:47.174855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc0ffaf-8fd1-40ed-b564-447338c7e9e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:47.267677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bcc0ffaf-8fd1-40ed-b564-447338c7e9e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd6a91a5b5e1f43d9aeb8b3da355f2c7c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:47.297475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:47.371237 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2816/5648] 10.222.0.20 () {58 vars in 1344 bytes} [Thu Oct 27 03:47:46 2022] DELETE /identity/v3/groups/3fdce43033634bc7b2028e8549520b69/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:47.372436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab993211-90a4-4999-a4ac-9c06f0f13863 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:47.386326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab993211-90a4-4999-a4ac-9c06f0f13863 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:47.563863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64cd749-0543-47ef-910e-170b4a1f36c9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:47.571083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cd749-0543-47ef-910e-170b4a1f36c9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:47.571083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cd749-0543-47ef-910e-170b4a1f36c9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:47.571083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cd749-0543-47ef-910e-170b4a1f36c9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/system/groups/3fdce43033634bc7b2028e8549520b69/roles/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:47.571842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64cd749-0543-47ef-910e-170b4a1f36c9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=3fdce43033634bc7b2028e8549520b69, role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:47.572955 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-a64cd749-0543-47ef-910e-170b4a1f36c9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:47.572955 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:47:47.572955 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:47:47.574605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64cd749-0543-47ef-910e-170b4a1f36c9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:47.678633 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2833/5649] 10.222.0.20 () {60 vars in 1381 bytes} [Thu Oct 27 03:47:47 2022] PUT /identity/v3/system/groups/3fdce43033634bc7b2028e8549520b69/roles/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:47.683427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0ffaf-8fd1-40ed-b564-447338c7e9e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:47.719534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0ffaf-8fd1-40ed-b564-447338c7e9e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:47.735592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da157143-cd25-4214-821e-5731651f02e8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:47.737578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da157143-cd25-4214-821e-5731651f02e8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:47.737874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da157143-cd25-4214-821e-5731651f02e8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:47.738187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da157143-cd25-4214-821e-5731651f02e8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/system/groups/3fdce43033634bc7b2028e8549520b69/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:47.739655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da157143-cd25-4214-821e-5731651f02e8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=3fdce43033634bc7b2028e8549520b69)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:47.740763 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-da157143-cd25-4214-821e-5731651f02e8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:47.740763 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:47:47.740763 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:47:47.741579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da157143-cd25-4214-821e-5731651f02e8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:47.759045 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2817/5650] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:47:47 2022] GET /identity/v3/system/groups/3fdce43033634bc7b2028e8549520b69/roles => generated 375 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:47.764068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64cd749-0543-47ef-910e-170b4a1f36c9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:47.786588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64cd749-0543-47ef-910e-170b4a1f36c9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:47.792256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb564ab-c78b-41fa-a988-39c16672169b tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:47.793399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb564ab-c78b-41fa-a988-39c16672169b tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:47.793934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb564ab-c78b-41fa-a988-39c16672169b tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:47.794531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb564ab-c78b-41fa-a988-39c16672169b tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/system/groups/3fdce43033634bc7b2028e8549520b69/roles/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:47.797524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb564ab-c78b-41fa-a988-39c16672169b tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=3fdce43033634bc7b2028e8549520b69, role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:47.798981 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-efb564ab-c78b-41fa-a988-39c16672169b tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:47.798981 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:47:47.798981 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:47:47.800678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb564ab-c78b-41fa-a988-39c16672169b tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:47.808988 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2834/5651] 10.222.0.20 () {58 vars in 1363 bytes} [Thu Oct 27 03:47:47 2022] HEAD /identity/v3/system/groups/3fdce43033634bc7b2028e8549520b69/roles/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:47.814501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da157143-cd25-4214-821e-5731651f02e8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:47.833532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da157143-cd25-4214-821e-5731651f02e8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:47.848354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b6903-29f6-4e8b-a678-6969e2839870 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:47.849043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b6903-29f6-4e8b-a678-6969e2839870 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:47.849339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b6903-29f6-4e8b-a678-6969e2839870 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:47.849871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b6903-29f6-4e8b-a678-6969e2839870 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/system/groups/3fdce43033634bc7b2028e8549520b69/roles/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:47.854653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b6903-29f6-4e8b-a678-6969e2839870 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=3fdce43033634bc7b2028e8549520b69, role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:47.858180 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-961b6903-29f6-4e8b-a678-6969e2839870 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:47.858180 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:47:47.858180 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:47:47.861219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b6903-29f6-4e8b-a678-6969e2839870 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:47.948179 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2818/5652] 10.222.0.20 () {58 vars in 1365 bytes} [Thu Oct 27 03:47:47 2022] DELETE /identity/v3/system/groups/3fdce43033634bc7b2028e8549520b69/roles/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:47.955787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb564ab-c78b-41fa-a988-39c16672169b tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:47.979229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb564ab-c78b-41fa-a988-39c16672169b tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:48.001115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38745aa2-b820-4b66-b62b-d3c5cd36b6b6 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:48.001990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38745aa2-b820-4b66-b62b-d3c5cd36b6b6 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:48.005373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38745aa2-b820-4b66-b62b-d3c5cd36b6b6 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:48.005788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38745aa2-b820-4b66-b62b-d3c5cd36b6b6 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/domains/9b43c405024c47238c60b4cd20f9cc1e/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:48.037044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38745aa2-b820-4b66-b62b-d3c5cd36b6b6 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=9b43c405024c47238c60b4cd20f9cc1e, user_id=d6a91a5b5e1f43d9aeb8b3da355f2c7c, role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:48.043499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38745aa2-b820-4b66-b62b-d3c5cd36b6b6 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:48.171216 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2835/5653] 10.222.0.20 () {60 vars in 1480 bytes} [Thu Oct 27 03:47:47 2022] PUT /identity/v3/domains/9b43c405024c47238c60b4cd20f9cc1e/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:48.172447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b6903-29f6-4e8b-a678-6969e2839870 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:48.221801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b6903-29f6-4e8b-a678-6969e2839870 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:48.342663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39f42a-37a6-418f-8bdf-8428384c47d9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:48.346139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39f42a-37a6-418f-8bdf-8428384c47d9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:48.346139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39f42a-37a6-418f-8bdf-8428384c47d9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:48.346139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39f42a-37a6-418f-8bdf-8428384c47d9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/domains/9b43c405024c47238c60b4cd20f9cc1e/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:48.349012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39f42a-37a6-418f-8bdf-8428384c47d9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=9b43c405024c47238c60b4cd20f9cc1e, user_id=d6a91a5b5e1f43d9aeb8b3da355f2c7c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:48.350177 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-ed39f42a-37a6-418f-8bdf-8428384c47d9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:48.350177 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:47:48.350177 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:47:48.352445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39f42a-37a6-418f-8bdf-8428384c47d9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:48.387934 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2819/5654] 10.222.0.20 () {58 vars in 1362 bytes} [Thu Oct 27 03:47:48 2022] GET /identity/v3/domains/9b43c405024c47238c60b4cd20f9cc1e/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles => generated 408 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:48.392021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38745aa2-b820-4b66-b62b-d3c5cd36b6b6 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:48.409410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38745aa2-b820-4b66-b62b-d3c5cd36b6b6 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:48.426604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4314df-a2c5-4205-a2a0-0e13564eda53 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:48.427685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4314df-a2c5-4205-a2a0-0e13564eda53 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:48.428238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4314df-a2c5-4205-a2a0-0e13564eda53 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:48.428752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4314df-a2c5-4205-a2a0-0e13564eda53 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/domains/9b43c405024c47238c60b4cd20f9cc1e/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:48.433451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4314df-a2c5-4205-a2a0-0e13564eda53 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=9b43c405024c47238c60b4cd20f9cc1e, user_id=d6a91a5b5e1f43d9aeb8b3da355f2c7c, role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:48.437043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4314df-a2c5-4205-a2a0-0e13564eda53 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:48.467609 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2836/5655] 10.222.0.20 () {58 vars in 1462 bytes} [Thu Oct 27 03:47:48 2022] HEAD /identity/v3/domains/9b43c405024c47238c60b4cd20f9cc1e/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:48.471544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39f42a-37a6-418f-8bdf-8428384c47d9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:48.491221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=11 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:48.502167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39f42a-37a6-418f-8bdf-8428384c47d9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:48.526857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d3abb-40f0-4924-8978-a12dc2bd40a8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:48.527919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d3abb-40f0-4924-8978-a12dc2bd40a8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:48.529276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d3abb-40f0-4924-8978-a12dc2bd40a8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:48.529276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d3abb-40f0-4924-8978-a12dc2bd40a8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/domains/9b43c405024c47238c60b4cd20f9cc1e/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:48.534520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d3abb-40f0-4924-8978-a12dc2bd40a8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=9b43c405024c47238c60b4cd20f9cc1e, user_id=d6a91a5b5e1f43d9aeb8b3da355f2c7c, role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:48.541784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d3abb-40f0-4924-8978-a12dc2bd40a8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:48.570862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ba5d3abb-40f0-4924-8978-a12dc2bd40a8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invalidating the token cache because role 3a45126f0c3b4a19bdbb05359c2b8a4a was removed from user d6a91a5b5e1f43d9aeb8b3da355f2c7c on domain 9b43c405024c47238c60b4cd20f9cc1e. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:48.571497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ba5d3abb-40f0-4924-8978-a12dc2bd40a8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:48.572656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ba5d3abb-40f0-4924-8978-a12dc2bd40a8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:48.667846 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2820/5656] 10.222.0.20 () {58 vars in 1464 bytes} [Thu Oct 27 03:47:48 2022] DELETE /identity/v3/domains/9b43c405024c47238c60b4cd20f9cc1e/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:48.673508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4314df-a2c5-4205-a2a0-0e13564eda53 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:48.676081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cf4314df-a2c5-4205-a2a0-0e13564eda53 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:48.710936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4314df-a2c5-4205-a2a0-0e13564eda53 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:48.851244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:48.869543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba84aa3-9c58-46c5-bf24-5ce147036ec5 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:48.870449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba84aa3-9c58-46c5-bf24-5ce147036ec5 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:48.870828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba84aa3-9c58-46c5-bf24-5ce147036ec5 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:48.871022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba84aa3-9c58-46c5-bf24-5ce147036ec5 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/projects/69b460b9168847bbb5cc5a8200b263c2/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:48.879894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba84aa3-9c58-46c5-bf24-5ce147036ec5 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_grant(project_id=69b460b9168847bbb5cc5a8200b263c2, user_id=d6a91a5b5e1f43d9aeb8b3da355f2c7c, role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:48.882752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba84aa3-9c58-46c5-bf24-5ce147036ec5 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:48.990678 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2837/5657] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:48 2022] PUT /identity/v3/projects/69b460b9168847bbb5cc5a8200b263c2/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:48.991883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d3abb-40f0-4924-8978-a12dc2bd40a8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:49.011298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d3abb-40f0-4924-8978-a12dc2bd40a8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:49.172983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a09bbc-c78f-491d-8aa5-4d8e424c0d4a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:49.173933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a09bbc-c78f-491d-8aa5-4d8e424c0d4a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:49.174264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a09bbc-c78f-491d-8aa5-4d8e424c0d4a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:49.174585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a09bbc-c78f-491d-8aa5-4d8e424c0d4a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/projects/69b460b9168847bbb5cc5a8200b263c2/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:49.177057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a09bbc-c78f-491d-8aa5-4d8e424c0d4a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:list_grants(project_id=69b460b9168847bbb5cc5a8200b263c2, user_id=d6a91a5b5e1f43d9aeb8b3da355f2c7c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:49.182524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a09bbc-c78f-491d-8aa5-4d8e424c0d4a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:49.245658 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2821/5658] 10.222.0.20 () {58 vars in 1365 bytes} [Thu Oct 27 03:47:48 2022] GET /identity/v3/projects/69b460b9168847bbb5cc5a8200b263c2/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles => generated 409 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:49.250471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba84aa3-9c58-46c5-bf24-5ce147036ec5 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:49.267874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba84aa3-9c58-46c5-bf24-5ce147036ec5 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:49.286079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cc899-4657-4f0b-b8ec-7d624c0e98cc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:49.286784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cc899-4657-4f0b-b8ec-7d624c0e98cc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:49.289251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cc899-4657-4f0b-b8ec-7d624c0e98cc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:49.289560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cc899-4657-4f0b-b8ec-7d624c0e98cc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/projects/69b460b9168847bbb5cc5a8200b263c2/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:49.300331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0cc899-4657-4f0b-b8ec-7d624c0e98cc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:check_grant(project_id=69b460b9168847bbb5cc5a8200b263c2, user_id=d6a91a5b5e1f43d9aeb8b3da355f2c7c, role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:49.306566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0cc899-4657-4f0b-b8ec-7d624c0e98cc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:49.326515 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2838/5659] 10.222.0.20 () {58 vars in 1465 bytes} [Thu Oct 27 03:47:49 2022] HEAD /identity/v3/projects/69b460b9168847bbb5cc5a8200b263c2/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:49.327958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a09bbc-c78f-491d-8aa5-4d8e424c0d4a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:49.341878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a09bbc-c78f-491d-8aa5-4d8e424c0d4a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:49.354355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30463001-9e1c-4468-a995-bc42d298a106 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:49.355118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30463001-9e1c-4468-a995-bc42d298a106 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:49.355380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30463001-9e1c-4468-a995-bc42d298a106 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:49.357759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30463001-9e1c-4468-a995-bc42d298a106 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/projects/69b460b9168847bbb5cc5a8200b263c2/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:49.367750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30463001-9e1c-4468-a995-bc42d298a106 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=69b460b9168847bbb5cc5a8200b263c2, user_id=d6a91a5b5e1f43d9aeb8b3da355f2c7c, role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:49.372007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30463001-9e1c-4468-a995-bc42d298a106 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:49.392833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-30463001-9e1c-4468-a995-bc42d298a106 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invalidating the token cache because role 3a45126f0c3b4a19bdbb05359c2b8a4a was removed from user d6a91a5b5e1f43d9aeb8b3da355f2c7c on project 69b460b9168847bbb5cc5a8200b263c2. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:49.393330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-30463001-9e1c-4468-a995-bc42d298a106 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:49.394440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-30463001-9e1c-4468-a995-bc42d298a106 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:49.523644 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2822/5660] 10.222.0.20 () {58 vars in 1467 bytes} [Thu Oct 27 03:47:49 2022] DELETE /identity/v3/projects/69b460b9168847bbb5cc5a8200b263c2/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:49.525046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cc899-4657-4f0b-b8ec-7d624c0e98cc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:49.526938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7a0cc899-4657-4f0b-b8ec-7d624c0e98cc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:49.558745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cc899-4657-4f0b-b8ec-7d624c0e98cc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:49.761691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091de675-f2e4-4eec-ac42-0679a74348e9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:49.762407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091de675-f2e4-4eec-ac42-0679a74348e9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:49.762674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091de675-f2e4-4eec-ac42-0679a74348e9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:49.762961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091de675-f2e4-4eec-ac42-0679a74348e9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/system/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:49.768719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091de675-f2e4-4eec-ac42-0679a74348e9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d6a91a5b5e1f43d9aeb8b3da355f2c7c, role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:49.771155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:49.773927 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-091de675-f2e4-4eec-ac42-0679a74348e9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:49.773927 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:47:49.773927 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:47:49.774854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091de675-f2e4-4eec-ac42-0679a74348e9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:49.856893 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2839/5661] 10.222.0.20 () {60 vars in 1378 bytes} [Thu Oct 27 03:47:49 2022] PUT /identity/v3/system/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:49.863314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30463001-9e1c-4468-a995-bc42d298a106 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:49.879309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30463001-9e1c-4468-a995-bc42d298a106 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:49.896351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf52871-90fe-47c5-bc43-59d49d9dc826 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:49.900476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf52871-90fe-47c5-bc43-59d49d9dc826 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:49.900476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf52871-90fe-47c5-bc43-59d49d9dc826 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:49.900476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf52871-90fe-47c5-bc43-59d49d9dc826 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/system/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:49.900476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf52871-90fe-47c5-bc43-59d49d9dc826 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=d6a91a5b5e1f43d9aeb8b3da355f2c7c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:49.901271 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-abf52871-90fe-47c5-bc43-59d49d9dc826 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:49.901271 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:47:49.901271 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:47:49.902312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf52871-90fe-47c5-bc43-59d49d9dc826 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:49.928303 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2823/5662] 10.222.0.20 () {58 vars in 1260 bytes} [Thu Oct 27 03:47:49 2022] GET /identity/v3/system/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles => generated 374 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:49.932534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091de675-f2e4-4eec-ac42-0679a74348e9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:49.948587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091de675-f2e4-4eec-ac42-0679a74348e9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:49.954618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b8c32-a221-4695-8b52-f400feb633de tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:49.955562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b8c32-a221-4695-8b52-f400feb633de tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:49.956047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b8c32-a221-4695-8b52-f400feb633de tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:49.956496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b8c32-a221-4695-8b52-f400feb633de tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/system/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:49.959411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c0b6d-9870-4d39-996d-ef830e5511e9 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:49.960355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c0b6d-9870-4d39-996d-ef830e5511e9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:49.963670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c0b6d-9870-4d39-996d-ef830e5511e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:49.977615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b8c32-a221-4695-8b52-f400feb633de tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=d6a91a5b5e1f43d9aeb8b3da355f2c7c, role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:49.979860 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-831b8c32-a221-4695-8b52-f400feb633de tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:49.979860 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:47:49.979860 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:47:49.980792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b8c32-a221-4695-8b52-f400feb633de tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:50.009468 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2840/5663] 10.222.0.20 () {58 vars in 1360 bytes} [Thu Oct 27 03:47:49 2022] HEAD /identity/v3/system/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:50.010542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b8c32-a221-4695-8b52-f400feb633de tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:50.051385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f87c0b6d-9870-4d39-996d-ef830e5511e9 None None] MFA Rules not processed for user `18d3c87c204946ffad3feb05bc6dfd53`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:50.054194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f87c0b6d-9870-4d39-996d-ef830e5511e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:50.069910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b8c32-a221-4695-8b52-f400feb633de tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:50.087580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f2e91-0d44-4039-acbf-34dafc564011 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:50.088596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f2e91-0d44-4039-acbf-34dafc564011 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:50.089076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f2e91-0d44-4039-acbf-34dafc564011 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:50.090134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f2e91-0d44-4039-acbf-34dafc564011 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/system/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:50.094658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f2e91-0d44-4039-acbf-34dafc564011 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=d6a91a5b5e1f43d9aeb8b3da355f2c7c, role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:50.096577 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-331f2e91-0d44-4039-acbf-34dafc564011 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:50.096577 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:47:50.096577 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:47:50.097963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f2e91-0d44-4039-acbf-34dafc564011 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:50.448197 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2841/5664] 10.222.0.20 () {58 vars in 1362 bytes} [Thu Oct 27 03:47:50 2022] DELETE /identity/v3/system/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c/roles/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:50.448197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f2e91-0d44-4039-acbf-34dafc564011 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:50.448197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f2e91-0d44-4039-acbf-34dafc564011 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:50.460455 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2824/5665] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:47:50.465657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7154539-8e46-4865-ba7e-d332b5be6fc8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:50.465657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7154539-8e46-4865-ba7e-d332b5be6fc8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:50.465657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7154539-8e46-4865-ba7e-d332b5be6fc8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:50.467204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7154539-8e46-4865-ba7e-d332b5be6fc8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:50.467204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7154539-8e46-4865-ba7e-d332b5be6fc8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:50.467204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7154539-8e46-4865-ba7e-d332b5be6fc8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:50.470269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c020f9e-f3e6-4bb4-b98b-6abcef572080 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:50.470269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c020f9e-f3e6-4bb4-b98b-6abcef572080 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:50.470269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c020f9e-f3e6-4bb4-b98b-6abcef572080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:50.470269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8c020f9e-f3e6-4bb4-b98b-6abcef572080 None None] MFA Rules not processed for user `18d3c87c204946ffad3feb05bc6dfd53`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:50.470269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8c020f9e-f3e6-4bb4-b98b-6abcef572080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:50.470269 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2825/5666] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:50.472460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c020f9e-f3e6-4bb4-b98b-6abcef572080 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:50.472460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8c020f9e-f3e6-4bb4-b98b-6abcef572080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:50.472460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c020f9e-f3e6-4bb4-b98b-6abcef572080 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:50.473030 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2842/5667] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:47:50 2022] POST /identity/v3/roles => generated 270 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:47:50.473030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7154539-8e46-4865-ba7e-d332b5be6fc8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:50.474869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd5b13-cce7-4c32-847f-6b0961c053f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:50.474869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd5b13-cce7-4c32-847f-6b0961c053f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:50.474869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd5b13-cce7-4c32-847f-6b0961c053f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:50.475416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f7154539-8e46-4865-ba7e-d332b5be6fc8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:50.475550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd5b13-cce7-4c32-847f-6b0961c053f9 admin admin] PATH_INFO: `/v3/users/966feb108a724a18919b3a106e9d9c8e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:50.475550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd5b13-cce7-4c32-847f-6b0961c053f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=966feb108a724a18919b3a106e9d9c8e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:50.475550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd5b13-cce7-4c32-847f-6b0961c053f9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:50.712379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7154539-8e46-4865-ba7e-d332b5be6fc8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:50.737043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cf68d-e0e4-4a4f-b90c-8b1552794f3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:50.737730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cf68d-e0e4-4a4f-b90c-8b1552794f3d service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:50.738019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cf68d-e0e4-4a4f-b90c-8b1552794f3d service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:50.738325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cf68d-e0e4-4a4f-b90c-8b1552794f3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:50.762504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331cf68d-e0e4-4a4f-b90c-8b1552794f3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:50.768744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331cf68d-e0e4-4a4f-b90c-8b1552794f3d service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:50.793893 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2843/5668] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:50.797234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cf68d-e0e4-4a4f-b90c-8b1552794f3d service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:50.820282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cf68d-e0e4-4a4f-b90c-8b1552794f3d service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:50.839911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac4f21-7af5-4bf0-a2c5-cbcbea1632d5 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:50.840569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac4f21-7af5-4bf0-a2c5-cbcbea1632d5 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:50.840852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac4f21-7af5-4bf0-a2c5-cbcbea1632d5 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:50.841137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac4f21-7af5-4bf0-a2c5-cbcbea1632d5 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:50.842428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac4f21-7af5-4bf0-a2c5-cbcbea1632d5 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:50.844033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac4f21-7af5-4bf0-a2c5-cbcbea1632d5 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:50.878306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1ffd5b13-cce7-4c32-847f-6b0961c053f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '966feb108a724a18919b3a106e9d9c8e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:50.879056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1ffd5b13-cce7-4c32-847f-6b0961c053f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '966feb108a724a18919b3a106e9d9c8e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:50.896996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1ffd5b13-cce7-4c32-847f-6b0961c053f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '966feb108a724a18919b3a106e9d9c8e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:50.915925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1ffd5b13-cce7-4c32-847f-6b0961c053f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '966feb108a724a18919b3a106e9d9c8e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:50.939907 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2844/5669] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:47:50 2022] POST /identity/v3/roles => generated 269 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:50.939907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac4f21-7af5-4bf0-a2c5-cbcbea1632d5 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:50.945094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b2ac4f21-7af5-4bf0-a2c5-cbcbea1632d5 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:51.050572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1ffd5b13-cce7-4c32-847f-6b0961c053f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '966feb108a724a18919b3a106e9d9c8e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:51.057534 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2826/5670] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:50 2022] DELETE /identity/v3/users/966feb108a724a18919b3a106e9d9c8e => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:51.061293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd5b13-cce7-4c32-847f-6b0961c053f9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:51.063096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1ffd5b13-cce7-4c32-847f-6b0961c053f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:51.093645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac4f21-7af5-4bf0-a2c5-cbcbea1632d5 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:51.119995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:51.229843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7b1e8-4054-446b-a036-31d6841599cc tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7397bbf2f0f48aca03f8083465067e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '592d85f7445943a0ad087bdcbb3a36ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:51.230515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7b1e8-4054-446b-a036-31d6841599cc tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:51.230808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7b1e8-4054-446b-a036-31d6841599cc tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:51.231084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7b1e8-4054-446b-a036-31d6841599cc tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:51.231751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7b1e8-4054-446b-a036-31d6841599cc tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:47:51.232129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7b1e8-4054-446b-a036-31d6841599cc tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:51.234504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7b1e8-4054-446b-a036-31d6841599cc tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:51.259546 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2845/5671] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:51.261459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd5b13-cce7-4c32-847f-6b0961c053f9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:51.263766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb17e91-c2fd-4efb-8a1b-b6a90ace873f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:51.264086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb17e91-c2fd-4efb-8a1b-b6a90ace873f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:51.264371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb17e91-c2fd-4efb-8a1b-b6a90ace873f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:51.270452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df06a2-fbf4-4f65-9135-d1e0b5626b06 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:51.272881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df06a2-fbf4-4f65-9135-d1e0b5626b06 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:51.273397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df06a2-fbf4-4f65-9135-d1e0b5626b06 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:51.273841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df06a2-fbf4-4f65-9135-d1e0b5626b06 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/b46c06d659c9412ba5ad73ae0f715a43/implies/887dd1c2cff24039a9e51a98e877e144` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:51.276419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df06a2-fbf4-4f65-9135-d1e0b5626b06 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b46c06d659c9412ba5ad73ae0f715a43, implied_role_id=887dd1c2cff24039a9e51a98e877e144)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:51.278536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df06a2-fbf4-4f65-9135-d1e0b5626b06 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:51.304774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-fbb17e91-c2fd-4efb-8a1b-b6a90ace873f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:51.306451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fbb17e91-c2fd-4efb-8a1b-b6a90ace873f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:51.390646 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2827/5672] 10.222.0.20 () {60 vars in 1363 bytes} [Thu Oct 27 03:47:51 2022] PUT /identity/v3/roles/b46c06d659c9412ba5ad73ae0f715a43/implies/887dd1c2cff24039a9e51a98e877e144 => generated 530 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:51.391758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df06a2-fbf4-4f65-9135-d1e0b5626b06 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:51.395139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a9df06a2-fbf4-4f65-9135-d1e0b5626b06 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:51.438051 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2846/5673] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:51.439416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb17e91-c2fd-4efb-8a1b-b6a90ace873f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:51.489164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb17e91-c2fd-4efb-8a1b-b6a90ace873f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:51.541054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df06a2-fbf4-4f65-9135-d1e0b5626b06 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:51.543568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:51.555954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd34ea-2610-401f-bff3-f6a5a6a71c0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:51.556605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd34ea-2610-401f-bff3-f6a5a6a71c0b service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:51.558629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd34ea-2610-401f-bff3-f6a5a6a71c0b service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:51.559068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd34ea-2610-401f-bff3-f6a5a6a71c0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:51.561900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-97cd34ea-2610-401f-bff3-f6a5a6a71c0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:51.618946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd34ea-2610-401f-bff3-f6a5a6a71c0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:51.620440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd34ea-2610-401f-bff3-f6a5a6a71c0b service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:51.653458 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2828/5674] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:51.656269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd34ea-2610-401f-bff3-f6a5a6a71c0b service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:51.683025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d13d2-21a9-4668-96db-b9b7397e1dd8 tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7397bbf2f0f48aca03f8083465067e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '592d85f7445943a0ad087bdcbb3a36ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:51.683639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d13d2-21a9-4668-96db-b9b7397e1dd8 tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:51.683914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d13d2-21a9-4668-96db-b9b7397e1dd8 tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:51.684190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d13d2-21a9-4668-96db-b9b7397e1dd8 tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:51.685249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d13d2-21a9-4668-96db-b9b7397e1dd8 tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:51.689642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d13d2-21a9-4668-96db-b9b7397e1dd8 tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:51.823224 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2847/5675] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:47:51 2022] POST /identity/v3/projects => generated 348 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:51.824126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d13d2-21a9-4668-96db-b9b7397e1dd8 tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:51.893611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd34ea-2610-401f-bff3-f6a5a6a71c0b service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:51.980370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d13d2-21a9-4668-96db-b9b7397e1dd8 tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:51.994287 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9e94b-b54f-4a84-b578-8344a20b09b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:51.994712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9e94b-b54f-4a84-b578-8344a20b09b7 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:51.996185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9e94b-b54f-4a84-b578-8344a20b09b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:51.996475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9e94b-b54f-4a84-b578-8344a20b09b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:52.025965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da6443-f276-42de-ba33-4cb8d1953dee tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:52.026679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da6443-f276-42de-ba33-4cb8d1953dee tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:52.026971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da6443-f276-42de-ba33-4cb8d1953dee tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:52.027259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da6443-f276-42de-ba33-4cb8d1953dee tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:52.027954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da6443-f276-42de-ba33-4cb8d1953dee tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:52.029708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da6443-f276-42de-ba33-4cb8d1953dee tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:52.061481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:52.125011 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2829/5676] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:47:51 2022] POST /identity/v3/domains => generated 275 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:52.127547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da6443-f276-42de-ba33-4cb8d1953dee tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:52.202797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c9e94b-b54f-4a84-b578-8344a20b09b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:52.204366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c9e94b-b54f-4a84-b578-8344a20b09b7 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:52.242631 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2848/5677] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:52.255102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9e94b-b54f-4a84-b578-8344a20b09b7 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:52.291005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9e94b-b54f-4a84-b578-8344a20b09b7 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:52.365692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da6443-f276-42de-ba33-4cb8d1953dee tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:52.371395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:52.385295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daeb01f-2776-4aa0-87f6-ffe141d0be0b tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7397bbf2f0f48aca03f8083465067e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '592d85f7445943a0ad087bdcbb3a36ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:52.385942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daeb01f-2776-4aa0-87f6-ffe141d0be0b tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:52.386420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daeb01f-2776-4aa0-87f6-ffe141d0be0b tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:52.386845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daeb01f-2776-4aa0-87f6-ffe141d0be0b tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:52.387867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daeb01f-2776-4aa0-87f6-ffe141d0be0b tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:47:52.388357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daeb01f-2776-4aa0-87f6-ffe141d0be0b tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:52.390290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daeb01f-2776-4aa0-87f6-ffe141d0be0b tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:52.411968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0fd83-9935-48bf-9e64-204ff02c9b33 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:52.412608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0fd83-9935-48bf-9e64-204ff02c9b33 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:52.412891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0fd83-9935-48bf-9e64-204ff02c9b33 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:52.414970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0fd83-9935-48bf-9e64-204ff02c9b33 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:52.415681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0fd83-9935-48bf-9e64-204ff02c9b33 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:52.421620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0fd83-9935-48bf-9e64-204ff02c9b33 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:52.427476 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2830/5678] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:52.562194 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2849/5679] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:47:52 2022] POST /identity/v3/roles => generated 269 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:52.566333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daeb01f-2776-4aa0-87f6-ffe141d0be0b tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:52.589830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daeb01f-2776-4aa0-87f6-ffe141d0be0b tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:52.625797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d492e1f-0298-43dc-95fd-064fb94f60c0 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:52.629261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d492e1f-0298-43dc-95fd-064fb94f60c0 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:52.630906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d492e1f-0298-43dc-95fd-064fb94f60c0 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:52.633298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d492e1f-0298-43dc-95fd-064fb94f60c0 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/b46c06d659c9412ba5ad73ae0f715a43/implies/22fe044af63346e59e5c6b0440919572` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:52.639005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d492e1f-0298-43dc-95fd-064fb94f60c0 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b46c06d659c9412ba5ad73ae0f715a43, implied_role_id=22fe044af63346e59e5c6b0440919572)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:52.663125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d492e1f-0298-43dc-95fd-064fb94f60c0 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:52.668521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:52.854255 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2831/5680] 10.222.0.20 () {60 vars in 1363 bytes} [Thu Oct 27 03:47:52 2022] PUT /identity/v3/roles/b46c06d659c9412ba5ad73ae0f715a43/implies/22fe044af63346e59e5c6b0440919572 => generated 530 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:52.859447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0fd83-9935-48bf-9e64-204ff02c9b33 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:52.884963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0fd83-9935-48bf-9e64-204ff02c9b33 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:53.014838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911c43e-eda4-4078-8e84-f3858de9b270 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:53.018512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911c43e-eda4-4078-8e84-f3858de9b270 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:53.018512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911c43e-eda4-4078-8e84-f3858de9b270 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:53.021155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911c43e-eda4-4078-8e84-f3858de9b270 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/b46c06d659c9412ba5ad73ae0f715a43/implies/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:53.023876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911c43e-eda4-4078-8e84-f3858de9b270 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b46c06d659c9412ba5ad73ae0f715a43, implied_role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:53.024913 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-5911c43e-eda4-4078-8e84-f3858de9b270 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:53.024913 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:47:53.024913 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:47:53.027741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911c43e-eda4-4078-8e84-f3858de9b270 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:53.181532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d492e1f-0298-43dc-95fd-064fb94f60c0 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:53.182627 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2850/5681] 10.222.0.20 () {60 vars in 1363 bytes} [Thu Oct 27 03:47:52 2022] PUT /identity/v3/roles/b46c06d659c9412ba5ad73ae0f715a43/implies/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 525 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:53.204322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d492e1f-0298-43dc-95fd-064fb94f60c0 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:53.254735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911c43e-eda4-4078-8e84-f3858de9b270 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:53.257515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5911c43e-eda4-4078-8e84-f3858de9b270 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:53.368670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9218766-9eff-4bfa-b5d6-134b6ed7a03c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:53.369568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9218766-9eff-4bfa-b5d6-134b6ed7a03c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:53.369862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9218766-9eff-4bfa-b5d6-134b6ed7a03c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:53.370318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9218766-9eff-4bfa-b5d6-134b6ed7a03c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/3a45126f0c3b4a19bdbb05359c2b8a4a/implies/b46c06d659c9412ba5ad73ae0f715a43` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:53.372520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9218766-9eff-4bfa-b5d6-134b6ed7a03c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=3a45126f0c3b4a19bdbb05359c2b8a4a, implied_role_id=b46c06d659c9412ba5ad73ae0f715a43)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:53.375915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9218766-9eff-4bfa-b5d6-134b6ed7a03c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:53.407825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-f9218766-9eff-4bfa-b5d6-134b6ed7a03c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] b46c06d659c9412ba5ad73ae0f715a43 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: b46c06d659c9412ba5ad73ae0f715a43 cannot be an implied roles. Oct 27 03:47:53.407825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:47:53.407825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:47:53.407825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:47:53.407825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:47:53.407825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:47:53.407825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:47:53.407825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:47:53.407825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:47:53.407825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:47:53.407825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:47:53.407825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:47:53.407825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Oct 27 03:47:53.407825 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Oct 27 03:47:53.408641 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:47:53.408641 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:47:53.408641 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Oct 27 03:47:53.408641 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Oct 27 03:47:53.408641 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: b46c06d659c9412ba5ad73ae0f715a43 cannot be an implied roles. Oct 27 03:47:53.408641 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:47:53.411644 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2832/5682] 10.222.0.20 () {60 vars in 1363 bytes} [Thu Oct 27 03:47:53 2022] PUT /identity/v3/roles/3a45126f0c3b4a19bdbb05359c2b8a4a/implies/b46c06d659c9412ba5ad73ae0f715a43 => generated 116 bytes in 230 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Oct 27 03:47:53.415736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9218766-9eff-4bfa-b5d6-134b6ed7a03c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:53.438974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9218766-9eff-4bfa-b5d6-134b6ed7a03c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:53.446089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43b650-85fc-451c-83ac-878bc42cfa9d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:53.446296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43b650-85fc-451c-83ac-878bc42cfa9d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:53.446613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43b650-85fc-451c-83ac-878bc42cfa9d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:53.446859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43b650-85fc-451c-83ac-878bc42cfa9d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/b46c06d659c9412ba5ad73ae0f715a43/implies/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:53.448663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43b650-85fc-451c-83ac-878bc42cfa9d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b46c06d659c9412ba5ad73ae0f715a43, implied_role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:53.450093 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-cb43b650-85fc-451c-83ac-878bc42cfa9d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:53.450093 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:47:53.450093 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:47:53.450958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911c43e-eda4-4078-8e84-f3858de9b270 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:53.451469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43b650-85fc-451c-83ac-878bc42cfa9d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:53.457270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e64c5-6fa0-4a96-bc14-5710a605ee2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:53.458086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e64c5-6fa0-4a96-bc14-5710a605ee2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:53.458493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e64c5-6fa0-4a96-bc14-5710a605ee2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:53.458871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e64c5-6fa0-4a96-bc14-5710a605ee2f admin admin] PATH_INFO: `/v3/projects/99b82766f45e4f8c8d207974abe7f19a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:53.461690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e64c5-6fa0-4a96-bc14-5710a605ee2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b82766f45e4f8c8d207974abe7f19a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:53.464718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e64c5-6fa0-4a96-bc14-5710a605ee2f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:53.533197 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2833/5683] 10.222.0.20 () {58 vars in 1347 bytes} [Thu Oct 27 03:47:53 2022] DELETE /identity/v3/roles/b46c06d659c9412ba5ad73ae0f715a43/implies/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:53.533197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43b650-85fc-451c-83ac-878bc42cfa9d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:53.633106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43b650-85fc-451c-83ac-878bc42cfa9d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:53.638926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d4e9c-c489-41a6-ab07-c133fa96375c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:53.639592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d4e9c-c489-41a6-ab07-c133fa96375c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:53.639913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d4e9c-c489-41a6-ab07-c133fa96375c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:53.640199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d4e9c-c489-41a6-ab07-c133fa96375c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/b46c06d659c9412ba5ad73ae0f715a43/implies/22fe044af63346e59e5c6b0440919572` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:53.641857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d4e9c-c489-41a6-ab07-c133fa96375c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b46c06d659c9412ba5ad73ae0f715a43, implied_role_id=22fe044af63346e59e5c6b0440919572)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:53.643533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d4e9c-c489-41a6-ab07-c133fa96375c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:53.681679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d64e64c5-6fa0-4a96-bc14-5710a605ee2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b82766f45e4f8c8d207974abe7f19a', 'request_id': 'req-d64e64c5-6fa0-4a96-bc14-5710a605ee2f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:53.693628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d64e64c5-6fa0-4a96-bc14-5710a605ee2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b82766f45e4f8c8d207974abe7f19a', 'request_id': 'req-d64e64c5-6fa0-4a96-bc14-5710a605ee2f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:53.708044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d64e64c5-6fa0-4a96-bc14-5710a605ee2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b82766f45e4f8c8d207974abe7f19a', 'request_id': 'req-d64e64c5-6fa0-4a96-bc14-5710a605ee2f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:53.734416 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2834/5684] 10.222.0.20 () {58 vars in 1347 bytes} [Thu Oct 27 03:47:53 2022] DELETE /identity/v3/roles/b46c06d659c9412ba5ad73ae0f715a43/implies/22fe044af63346e59e5c6b0440919572 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:53.741935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d4e9c-c489-41a6-ab07-c133fa96375c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:53.762584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:53.849877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d4e9c-c489-41a6-ab07-c133fa96375c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:53.862452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d64e64c5-6fa0-4a96-bc14-5710a605ee2f admin admin] The token cache is being invalidate because project 99b82766f45e4f8c8d207974abe7f19a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:53.862902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d64e64c5-6fa0-4a96-bc14-5710a605ee2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:53.864450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd794810-ffbd-4e67-b62c-1ec783932ee8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:53.865063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd794810-ffbd-4e67-b62c-1ec783932ee8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:53.865478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd794810-ffbd-4e67-b62c-1ec783932ee8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:53.865747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd794810-ffbd-4e67-b62c-1ec783932ee8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/22fe044af63346e59e5c6b0440919572` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:53.867314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d64e64c5-6fa0-4a96-bc14-5710a605ee2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:53.873138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd794810-ffbd-4e67-b62c-1ec783932ee8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=22fe044af63346e59e5c6b0440919572)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:53.880186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd794810-ffbd-4e67-b62c-1ec783932ee8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:53.884031 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2851/5685] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:53 2022] DELETE /identity/v3/projects/99b82766f45e4f8c8d207974abe7f19a => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:47:53.884031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e64c5-6fa0-4a96-bc14-5710a605ee2f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:53.888035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d64e64c5-6fa0-4a96-bc14-5710a605ee2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:54.029790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e64c5-6fa0-4a96-bc14-5710a605ee2f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:54.045714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dd794810-ffbd-4e67-b62c-1ec783932ee8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invalidating the token cache because role 22fe044af63346e59e5c6b0440919572 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:54.047503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dd794810-ffbd-4e67-b62c-1ec783932ee8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:54.047592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dd794810-ffbd-4e67-b62c-1ec783932ee8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:54.051705 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2835/5686] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:53 2022] DELETE /identity/v3/roles/22fe044af63346e59e5c6b0440919572 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:54.053250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156edf5a-c1d6-4610-9098-2b1ff61fc225 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:54.053680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156edf5a-c1d6-4610-9098-2b1ff61fc225 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:54.053974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156edf5a-c1d6-4610-9098-2b1ff61fc225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:54.089126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-156edf5a-c1d6-4610-9098-2b1ff61fc225 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:54.090078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:54.090765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-156edf5a-c1d6-4610-9098-2b1ff61fc225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:54.179819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fecea-ab3b-4b3c-9a2d-94121abae260 tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7397bbf2f0f48aca03f8083465067e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '592d85f7445943a0ad087bdcbb3a36ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:54.180219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fecea-ab3b-4b3c-9a2d-94121abae260 tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:54.180532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fecea-ab3b-4b3c-9a2d-94121abae260 tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:54.180836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fecea-ab3b-4b3c-9a2d-94121abae260 tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] PATH_INFO: `/v3/projects/c19af17b96334a889d7ab25345c681fe` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:54.185598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4fecea-ab3b-4b3c-9a2d-94121abae260 tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c19af17b96334a889d7ab25345c681fe)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:54.190357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4fecea-ab3b-4b3c-9a2d-94121abae260 tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:54.265650 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2836/5687] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:54.266705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156edf5a-c1d6-4610-9098-2b1ff61fc225 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:54.268415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-156edf5a-c1d6-4610-9098-2b1ff61fc225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:54.378926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-df4fecea-ab3b-4b3c-9a2d-94121abae260 tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c19af17b96334a889d7ab25345c681fe', 'request_id': 'req-df4fecea-ab3b-4b3c-9a2d-94121abae260'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:54.394412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-df4fecea-ab3b-4b3c-9a2d-94121abae260 tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c19af17b96334a889d7ab25345c681fe', 'request_id': 'req-df4fecea-ab3b-4b3c-9a2d-94121abae260'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:54.402180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-df4fecea-ab3b-4b3c-9a2d-94121abae260 tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c19af17b96334a889d7ab25345c681fe', 'request_id': 'req-df4fecea-ab3b-4b3c-9a2d-94121abae260'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:54.432987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156edf5a-c1d6-4610-9098-2b1ff61fc225 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:54.555228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-df4fecea-ab3b-4b3c-9a2d-94121abae260 tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] The token cache is being invalidate because project c19af17b96334a889d7ab25345c681fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:54.556107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-df4fecea-ab3b-4b3c-9a2d-94121abae260 tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:54.557314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-df4fecea-ab3b-4b3c-9a2d-94121abae260 tempest-RoutersAdminTest-1089592687 tempest-RoutersAdminTest-1089592687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:54.560136 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2852/5688] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:47:53 2022] DELETE /identity/v3/projects/c19af17b96334a889d7ab25345c681fe => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:54.578194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5aa56b-bbf3-4fba-937b-8313d3cfa1e0 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:54.579075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5aa56b-bbf3-4fba-937b-8313d3cfa1e0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:54.579606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5aa56b-bbf3-4fba-937b-8313d3cfa1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:54.585225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f11935-9293-4cd9-849e-2af8ea8cf157 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:54.585225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f11935-9293-4cd9-849e-2af8ea8cf157 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:54.585477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f11935-9293-4cd9-849e-2af8ea8cf157 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:54.585763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f11935-9293-4cd9-849e-2af8ea8cf157 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/domains/85dc3c9ad77f4ec6a23c27dc7d7b8842` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:54.617998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f11935-9293-4cd9-849e-2af8ea8cf157 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=85dc3c9ad77f4ec6a23c27dc7d7b8842)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:54.620302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-bf5aa56b-bbf3-4fba-937b-8313d3cfa1e0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:54.621795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bf5aa56b-bbf3-4fba-937b-8313d3cfa1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:54.625529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f11935-9293-4cd9-849e-2af8ea8cf157 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:54.683005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-80f11935-9293-4cd9-849e-2af8ea8cf157 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '85dc3c9ad77f4ec6a23c27dc7d7b8842'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:54.684570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-80f11935-9293-4cd9-849e-2af8ea8cf157 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '85dc3c9ad77f4ec6a23c27dc7d7b8842'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:54.778085 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2853/5689] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:54.778085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5aa56b-bbf3-4fba-937b-8313d3cfa1e0 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:54.779487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bf5aa56b-bbf3-4fba-937b-8313d3cfa1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:54.787996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:54.846417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-80f11935-9293-4cd9-849e-2af8ea8cf157 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '85dc3c9ad77f4ec6a23c27dc7d7b8842'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:54.847026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-80f11935-9293-4cd9-849e-2af8ea8cf157 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '85dc3c9ad77f4ec6a23c27dc7d7b8842'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:54.850373 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2837/5690] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:47:54 2022] PATCH /identity/v3/domains/85dc3c9ad77f4ec6a23c27dc7d7b8842 => generated 276 bytes in 584 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:54.851553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f11935-9293-4cd9-849e-2af8ea8cf157 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:54.857703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-80f11935-9293-4cd9-849e-2af8ea8cf157 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:54.927097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5aa56b-bbf3-4fba-937b-8313d3cfa1e0 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:55.042941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f11935-9293-4cd9-849e-2af8ea8cf157 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:55.049277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec7cc1-c262-4c6a-8884-eecd6ee02638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:55.049925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec7cc1-c262-4c6a-8884-eecd6ee02638 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:55.050998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec7cc1-c262-4c6a-8884-eecd6ee02638 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:55.051283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec7cc1-c262-4c6a-8884-eecd6ee02638 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:55.052861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec7cc1-c262-4c6a-8884-eecd6ee02638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:47:55.052861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec7cc1-c262-4c6a-8884-eecd6ee02638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:55.055052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec7cc1-c262-4c6a-8884-eecd6ee02638 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:55.068789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cd2cd-01ac-4f76-b3a3-6d4d62966303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:55.069965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cd2cd-01ac-4f76-b3a3-6d4d62966303 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:55.070366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cd2cd-01ac-4f76-b3a3-6d4d62966303 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:55.070730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cd2cd-01ac-4f76-b3a3-6d4d62966303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:55.071035 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2838/5691] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:55.072118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec7cc1-c262-4c6a-8884-eecd6ee02638 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:55.074130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-46ec7cc1-c262-4c6a-8884-eecd6ee02638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:55.075043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c71cd2cd-01ac-4f76-b3a3-6d4d62966303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:55.188083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cd2cd-01ac-4f76-b3a3-6d4d62966303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:55.189710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cd2cd-01ac-4f76-b3a3-6d4d62966303 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:55.201037 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2854/5692] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:55.202065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cd2cd-01ac-4f76-b3a3-6d4d62966303 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:55.206807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec7cc1-c262-4c6a-8884-eecd6ee02638 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:55.212108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6c1f7-8e6d-479e-bcba-7707aed85336 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:55.212848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6c1f7-8e6d-479e-bcba-7707aed85336 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:55.213217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6c1f7-8e6d-479e-bcba-7707aed85336 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:55.213646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6c1f7-8e6d-479e-bcba-7707aed85336 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/domains/85dc3c9ad77f4ec6a23c27dc7d7b8842` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:55.214176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cd2cd-01ac-4f76-b3a3-6d4d62966303 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:55.227586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e80e7-6a23-4211-b2b0-0d775e2e10e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:55.228715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e80e7-6a23-4211-b2b0-0d775e2e10e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:55.229007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e80e7-6a23-4211-b2b0-0d775e2e10e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:55.229296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e80e7-6a23-4211-b2b0-0d775e2e10e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:55.230082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e80e7-6a23-4211-b2b0-0d775e2e10e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:55.230180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6c1f7-8e6d-479e-bcba-7707aed85336 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=85dc3c9ad77f4ec6a23c27dc7d7b8842)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:55.232573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e80e7-6a23-4211-b2b0-0d775e2e10e4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:55.232764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6c1f7-8e6d-479e-bcba-7707aed85336 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:55.280549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1bd6c1f7-8e6d-479e-bcba-7707aed85336 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '85dc3c9ad77f4ec6a23c27dc7d7b8842'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:55.298858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1bd6c1f7-8e6d-479e-bcba-7707aed85336 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '85dc3c9ad77f4ec6a23c27dc7d7b8842'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:55.393139 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2855/5693] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:47:55 2022] POST /identity/v3/projects => generated 369 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:55.397513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e80e7-6a23-4211-b2b0-0d775e2e10e4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:55.534957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e80e7-6a23-4211-b2b0-0d775e2e10e4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:55.573688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1bd6c1f7-8e6d-479e-bcba-7707aed85336 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85dc3c9ad77f4ec6a23c27dc7d7b8842', 'request_id': 'req-1bd6c1f7-8e6d-479e-bcba-7707aed85336'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:55.632769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fca417-ff1a-49bc-8c96-6809dc51cf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:55.633452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fca417-ff1a-49bc-8c96-6809dc51cf53 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:55.633798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fca417-ff1a-49bc-8c96-6809dc51cf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:55.634151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fca417-ff1a-49bc-8c96-6809dc51cf53 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:55.634798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fca417-ff1a-49bc-8c96-6809dc51cf53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:55.636862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fca417-ff1a-49bc-8c96-6809dc51cf53 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:55.719665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1bd6c1f7-8e6d-479e-bcba-7707aed85336 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85dc3c9ad77f4ec6a23c27dc7d7b8842', 'request_id': 'req-1bd6c1f7-8e6d-479e-bcba-7707aed85336'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:55.730832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1bd6c1f7-8e6d-479e-bcba-7707aed85336 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85dc3c9ad77f4ec6a23c27dc7d7b8842', 'request_id': 'req-1bd6c1f7-8e6d-479e-bcba-7707aed85336'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:55.762840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1bd6c1f7-8e6d-479e-bcba-7707aed85336 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] The token cache is being invalidate because project 85dc3c9ad77f4ec6a23c27dc7d7b8842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:55.762840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1bd6c1f7-8e6d-479e-bcba-7707aed85336 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:55.766182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1bd6c1f7-8e6d-479e-bcba-7707aed85336 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:55.774520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:55.774520 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2856/5694] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:47:55 2022] POST /identity/v3/users => generated 285 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:55.780259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fca417-ff1a-49bc-8c96-6809dc51cf53 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:55.782076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-88fca417-ff1a-49bc-8c96-6809dc51cf53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:55.801595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1bd6c1f7-8e6d-479e-bcba-7707aed85336 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '85dc3c9ad77f4ec6a23c27dc7d7b8842', 'request_id': 'req-1bd6c1f7-8e6d-479e-bcba-7707aed85336'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:55.802726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1bd6c1f7-8e6d-479e-bcba-7707aed85336 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '85dc3c9ad77f4ec6a23c27dc7d7b8842', 'request_id': 'req-1bd6c1f7-8e6d-479e-bcba-7707aed85336'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:55.805477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fca417-ff1a-49bc-8c96-6809dc51cf53 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:55.805985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1bd6c1f7-8e6d-479e-bcba-7707aed85336 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '85dc3c9ad77f4ec6a23c27dc7d7b8842', 'request_id': 'req-1bd6c1f7-8e6d-479e-bcba-7707aed85336'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:55.810432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682ad70-33c3-4f92-a177-8254410e0778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:55.818079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682ad70-33c3-4f92-a177-8254410e0778 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:55.818412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682ad70-33c3-4f92-a177-8254410e0778 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:55.818699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682ad70-33c3-4f92-a177-8254410e0778 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:55.819378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682ad70-33c3-4f92-a177-8254410e0778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:55.821108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682ad70-33c3-4f92-a177-8254410e0778 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:55.835259 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2839/5695] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:47:55 2022] DELETE /identity/v3/domains/85dc3c9ad77f4ec6a23c27dc7d7b8842 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:55.839585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6c1f7-8e6d-479e-bcba-7707aed85336 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:55.841157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1bd6c1f7-8e6d-479e-bcba-7707aed85336 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:55.854105 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2857/5696] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:55 2022] GET /identity/v3/roles => generated 2320 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:47:55.855809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682ad70-33c3-4f92-a177-8254410e0778 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:55.858288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f682ad70-33c3-4f92-a177-8254410e0778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:55.873573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682ad70-33c3-4f92-a177-8254410e0778 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:55.902388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e9e93-4a67-4b88-9d53-9ded70b8ea35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:55.902914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e9e93-4a67-4b88-9d53-9ded70b8ea35 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:55.903196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e9e93-4a67-4b88-9d53-9ded70b8ea35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:55.903469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e9e93-4a67-4b88-9d53-9ded70b8ea35 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:55.905646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e9e93-4a67-4b88-9d53-9ded70b8ea35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:55.914332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e9e93-4a67-4b88-9d53-9ded70b8ea35 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:55.948034 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2858/5697] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:47:55 2022] GET /identity/v3/roles => generated 2320 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:55.948481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e9e93-4a67-4b88-9d53-9ded70b8ea35 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:55.967366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e9e93-4a67-4b88-9d53-9ded70b8ea35 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:55.972957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e5d7c-b652-47d1-8ad7-3d50a14a4049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:55.973698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e5d7c-b652-47d1-8ad7-3d50a14a4049 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:55.974190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e5d7c-b652-47d1-8ad7-3d50a14a4049 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:55.974291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e5d7c-b652-47d1-8ad7-3d50a14a4049 admin admin] PATH_INFO: `/v3/projects/115b85f8af8e491f85a80eeb979100a0/users/3771098cc42a447eab2524a0682133e8/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:56.023433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e5d7c-b652-47d1-8ad7-3d50a14a4049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=115b85f8af8e491f85a80eeb979100a0, user_id=3771098cc42a447eab2524a0682133e8, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:56.030825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e5d7c-b652-47d1-8ad7-3d50a14a4049 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:56.042960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6c1f7-8e6d-479e-bcba-7707aed85336 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:56.061596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab00fe-414b-4b25-9e72-bf8de7d9d465 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:56.062335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab00fe-414b-4b25-9e72-bf8de7d9d465 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:56.077756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab00fe-414b-4b25-9e72-bf8de7d9d465 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:56.077756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab00fe-414b-4b25-9e72-bf8de7d9d465 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/b46c06d659c9412ba5ad73ae0f715a43/implies/887dd1c2cff24039a9e51a98e877e144` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:56.077756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab00fe-414b-4b25-9e72-bf8de7d9d465 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b46c06d659c9412ba5ad73ae0f715a43, implied_role_id=887dd1c2cff24039a9e51a98e877e144)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:56.077756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab00fe-414b-4b25-9e72-bf8de7d9d465 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:56.154167 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2859/5698] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:47:55 2022] PUT /identity/v3/projects/115b85f8af8e491f85a80eeb979100a0/users/3771098cc42a447eab2524a0682133e8/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:56.166840 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2840/5699] 10.222.0.20 () {58 vars in 1347 bytes} [Thu Oct 27 03:47:55 2022] DELETE /identity/v3/roles/b46c06d659c9412ba5ad73ae0f715a43/implies/887dd1c2cff24039a9e51a98e877e144 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:47:56.169729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0f14a-3ce5-4ae5-afc0-c62ab4a82655 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:56.169729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0f14a-3ce5-4ae5-afc0-c62ab4a82655 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:56.169729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0f14a-3ce5-4ae5-afc0-c62ab4a82655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:56.172770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab00fe-414b-4b25-9e72-bf8de7d9d465 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:56.247196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:56.307787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-dbd0f14a-3ce5-4ae5-afc0-c62ab4a82655 None None] MFA Rules not processed for user `3771098cc42a447eab2524a0682133e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:56.312608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-dbd0f14a-3ce5-4ae5-afc0-c62ab4a82655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:56.416585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab00fe-414b-4b25-9e72-bf8de7d9d465 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:56.433210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0474d74-df60-42e1-ae9f-a7c0e40d31cf tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:56.434237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0474d74-df60-42e1-ae9f-a7c0e40d31cf tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:56.434736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0474d74-df60-42e1-ae9f-a7c0e40d31cf tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:56.435072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0474d74-df60-42e1-ae9f-a7c0e40d31cf tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/887dd1c2cff24039a9e51a98e877e144` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:56.438911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0474d74-df60-42e1-ae9f-a7c0e40d31cf tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=887dd1c2cff24039a9e51a98e877e144)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:56.440558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0474d74-df60-42e1-ae9f-a7c0e40d31cf tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:56.527184 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2860/5700] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:56.528650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40320a59-91ba-46e7-b5be-c94263ecc316 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:56.529479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40320a59-91ba-46e7-b5be-c94263ecc316 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:56.529710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40320a59-91ba-46e7-b5be-c94263ecc316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:56.563203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:56.641894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c0474d74-df60-42e1-ae9f-a7c0e40d31cf tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invalidating the token cache because role 887dd1c2cff24039a9e51a98e877e144 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:56.642434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c0474d74-df60-42e1-ae9f-a7c0e40d31cf tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:56.643495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c0474d74-df60-42e1-ae9f-a7c0e40d31cf tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:56.650540 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2841/5701] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:56 2022] DELETE /identity/v3/roles/887dd1c2cff24039a9e51a98e877e144 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:56.653476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29469c52-cfc8-4943-a6ba-3fe907d5039c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:56.653870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29469c52-cfc8-4943-a6ba-3fe907d5039c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:56.654289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29469c52-cfc8-4943-a6ba-3fe907d5039c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:56.708479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:56.745205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-29469c52-cfc8-4943-a6ba-3fe907d5039c None None] MFA Rules not processed for user `3771098cc42a447eab2524a0682133e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:56.748274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-29469c52-cfc8-4943-a6ba-3fe907d5039c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:56.896930 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2842/5702] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:56.897958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29469c52-cfc8-4943-a6ba-3fe907d5039c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:56.899422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-29469c52-cfc8-4943-a6ba-3fe907d5039c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:56.992567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-40320a59-91ba-46e7-b5be-c94263ecc316 None None] MFA Rules not processed for user `f501e7be812e41ebb05c15f0adfd8ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:57.003022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-40320a59-91ba-46e7-b5be-c94263ecc316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:57.016547 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2861/5703] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:56 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:47:57.017719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40320a59-91ba-46e7-b5be-c94263ecc316 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:57.019351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-40320a59-91ba-46e7-b5be-c94263ecc316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:57.069777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29469c52-cfc8-4943-a6ba-3fe907d5039c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:57.079850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94457757-7fb2-4b94-9ba7-309b5144d0f0 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:57.080828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94457757-7fb2-4b94-9ba7-309b5144d0f0 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:57.081207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94457757-7fb2-4b94-9ba7-309b5144d0f0 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:57.081559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94457757-7fb2-4b94-9ba7-309b5144d0f0 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/b46c06d659c9412ba5ad73ae0f715a43` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:57.083521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94457757-7fb2-4b94-9ba7-309b5144d0f0 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=b46c06d659c9412ba5ad73ae0f715a43)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:57.086187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94457757-7fb2-4b94-9ba7-309b5144d0f0 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:57.187311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40320a59-91ba-46e7-b5be-c94263ecc316 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:57.198206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12983a64-eeb2-4d82-9360-bb75f9a20caa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:57.199005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12983a64-eeb2-4d82-9360-bb75f9a20caa service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:57.199541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12983a64-eeb2-4d82-9360-bb75f9a20caa service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:57.199824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12983a64-eeb2-4d82-9360-bb75f9a20caa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:57.203792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-12983a64-eeb2-4d82-9360-bb75f9a20caa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:57.236292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12983a64-eeb2-4d82-9360-bb75f9a20caa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:57.243322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12983a64-eeb2-4d82-9360-bb75f9a20caa service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:57.249845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-94457757-7fb2-4b94-9ba7-309b5144d0f0 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invalidating the token cache because role b46c06d659c9412ba5ad73ae0f715a43 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:47:57.249845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-94457757-7fb2-4b94-9ba7-309b5144d0f0 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:57.249845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-94457757-7fb2-4b94-9ba7-309b5144d0f0 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:57.249845 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2843/5704] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:47:56 2022] DELETE /identity/v3/roles/b46c06d659c9412ba5ad73ae0f715a43 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:57.250225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94457757-7fb2-4b94-9ba7-309b5144d0f0 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:57.253998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-94457757-7fb2-4b94-9ba7-309b5144d0f0 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:57.276066 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2862/5705] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:47:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:47:57.290634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12983a64-eeb2-4d82-9360-bb75f9a20caa service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:57.317851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12983a64-eeb2-4d82-9360-bb75f9a20caa service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:57.362467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94457757-7fb2-4b94-9ba7-309b5144d0f0 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:57.378946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e494a-5a2f-4875-bf21-a772fcfa9723 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f501e7be812e41ebb05c15f0adfd8ea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91f48eb5f9be49ca85b5028084d5e0ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:57.379815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e494a-5a2f-4875-bf21-a772fcfa9723 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:57.380273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e494a-5a2f-4875-bf21-a772fcfa9723 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:57.380693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e494a-5a2f-4875-bf21-a772fcfa9723 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] PATH_INFO: `/v3/users/f501e7be812e41ebb05c15f0adfd8ea2/password` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:57.495323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9817901-289a-43a4-8fe6-09c9d6103358 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:57.497034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9817901-289a-43a4-8fe6-09c9d6103358 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:57.497575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9817901-289a-43a4-8fe6-09c9d6103358 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:57.498348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9817901-289a-43a4-8fe6-09c9d6103358 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:57.501940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9817901-289a-43a4-8fe6-09c9d6103358 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=098c6cdac0004ef29753ae850dff7d6b, implied_role_id=53b212ca944742edb194af3e83f274fd)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:57.504754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9817901-289a-43a4-8fe6-09c9d6103358 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:57.647663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-248e494a-5a2f-4875-bf21-a772fcfa9723 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f501e7be812e41ebb05c15f0adfd8ea2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:57.701772 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2863/5706] 10.222.0.20 () {60 vars in 1363 bytes} [Thu Oct 27 03:47:57 2022] PUT /identity/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd => generated 519 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:57.707190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9817901-289a-43a4-8fe6-09c9d6103358 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:57.709805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f9817901-289a-43a4-8fe6-09c9d6103358 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:57.714500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:57.755223 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2844/5707] 10.222.0.20 () {60 vars in 1269 bytes} [Thu Oct 27 03:47:57 2022] POST /identity/v3/users/f501e7be812e41ebb05c15f0adfd8ea2/password => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:57.930773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:57.948867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9817901-289a-43a4-8fe6-09c9d6103358 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:57.954299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c3fcc-a831-4573-ae03-c1386c9ab1af tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:57.955459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c3fcc-a831-4573-ae03-c1386c9ab1af tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:57.955459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c3fcc-a831-4573-ae03-c1386c9ab1af tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:57.955702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c3fcc-a831-4573-ae03-c1386c9ab1af tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:57.957374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c3fcc-a831-4573-ae03-c1386c9ab1af tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=098c6cdac0004ef29753ae850dff7d6b, implied_role_id=53b212ca944742edb194af3e83f274fd)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:57.962137 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-7e1c3fcc-a831-4573-ae03-c1386c9ab1af tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:57.962137 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:47:57.962137 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:47:57.963114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c3fcc-a831-4573-ae03-c1386c9ab1af tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:57.973861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c3fcc-a831-4573-ae03-c1386c9ab1af tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=098c6cdac0004ef29753ae850dff7d6b, implied_role_id=53b212ca944742edb194af3e83f274fd)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:57.980841 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-7e1c3fcc-a831-4573-ae03-c1386c9ab1af tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:57.980841 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:47:57.980841 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:47:57.985647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c3fcc-a831-4573-ae03-c1386c9ab1af tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:58.009887 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2864/5708] 10.222.0.20 () {58 vars in 1345 bytes} [Thu Oct 27 03:47:57 2022] HEAD /identity/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:58.010963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e494a-5a2f-4875-bf21-a772fcfa9723 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:58.033703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e494a-5a2f-4875-bf21-a772fcfa9723 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:58.054885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2df3f-eed5-4051-a4ba-94f250fb5b2d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:58.059427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2df3f-eed5-4051-a4ba-94f250fb5b2d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:58.059719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2df3f-eed5-4051-a4ba-94f250fb5b2d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:58.060586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2df3f-eed5-4051-a4ba-94f250fb5b2d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:58.065724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2df3f-eed5-4051-a4ba-94f250fb5b2d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=098c6cdac0004ef29753ae850dff7d6b, implied_role_id=53b212ca944742edb194af3e83f274fd)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:58.070490 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-5db2df3f-eed5-4051-a4ba-94f250fb5b2d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:58.070490 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:47:58.070490 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:47:58.071415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2df3f-eed5-4051-a4ba-94f250fb5b2d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:58.110489 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2845/5709] 10.222.0.20 () {58 vars in 1344 bytes} [Thu Oct 27 03:47:58 2022] GET /identity/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd => generated 519 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:47:58.114530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c3fcc-a831-4573-ae03-c1386c9ab1af tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:58.131899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c3fcc-a831-4573-ae03-c1386c9ab1af tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:58.160809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1b89a-a7e0-43ed-8bf6-df0eaefda6c3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:58.162922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1b89a-a7e0-43ed-8bf6-df0eaefda6c3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:58.163229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1b89a-a7e0-43ed-8bf6-df0eaefda6c3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:58.163515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1b89a-a7e0-43ed-8bf6-df0eaefda6c3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:58.171539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1b89a-a7e0-43ed-8bf6-df0eaefda6c3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=098c6cdac0004ef29753ae850dff7d6b, implied_role_id=53b212ca944742edb194af3e83f274fd)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:58.173397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1b89a-a7e0-43ed-8bf6-df0eaefda6c3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:58.298196 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2865/5710] 10.222.0.20 () {58 vars in 1347 bytes} [Thu Oct 27 03:47:58 2022] DELETE /identity/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:58.311531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2df3f-eed5-4051-a4ba-94f250fb5b2d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:58.324747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2df3f-eed5-4051-a4ba-94f250fb5b2d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:58.433382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1b94d-037b-47e7-a2f2-e6d973c8aaa2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:58.434394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1b94d-037b-47e7-a2f2-e6d973c8aaa2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:58.434808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1b94d-037b-47e7-a2f2-e6d973c8aaa2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:58.437941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1b94d-037b-47e7-a2f2-e6d973c8aaa2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:58.440684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1b94d-037b-47e7-a2f2-e6d973c8aaa2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=098c6cdac0004ef29753ae850dff7d6b, implied_role_id=53b212ca944742edb194af3e83f274fd)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:58.442450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1b94d-037b-47e7-a2f2-e6d973c8aaa2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:58.473463 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-22f1b94d-037b-47e7-a2f2-e6d973c8aaa2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] 098c6cdac0004ef29753ae850dff7d6b does not imply 53b212ca944742edb194af3e83f274fd.: keystone.exception.ImpliedRoleNotFound: 098c6cdac0004ef29753ae850dff7d6b does not imply 53b212ca944742edb194af3e83f274fd. Oct 27 03:47:58.473463 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:47:58.473463 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 27 03:47:58.473463 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = query.one() Oct 27 03:47:58.473463 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 27 03:47:58.473463 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._iter().one() Oct 27 03:47:58.473463 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 27 03:47:58.473463 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._only_one_row( Oct 27 03:47:58.473463 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 27 03:47:58.473463 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 27 03:47:58.473463 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 27 03:47:58.473463 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:47:58.473463 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:47:58.473463 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:47:58.473463 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:47:58.473463 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:47:58.474565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:47:58.474565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:47:58.474565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:47:58.474565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:47:58.474565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:47:58.474565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:47:58.474565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:47:58.474565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:47:58.474565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:47:58.474565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Oct 27 03:47:58.474565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Oct 27 03:47:58.474565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Oct 27 03:47:58.474565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Oct 27 03:47:58.474565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Oct 27 03:47:58.474565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 27 03:47:58.474565 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 27 03:47:58.475402 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 27 03:47:58.475402 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 098c6cdac0004ef29753ae850dff7d6b does not imply 53b212ca944742edb194af3e83f274fd. Oct 27 03:47:58.475402 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:47:58.477729 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2846/5711] 10.222.0.20 () {58 vars in 1344 bytes} [Thu Oct 27 03:47:58 2022] GET /identity/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd => generated 137 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:47:58.481849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1b89a-a7e0-43ed-8bf6-df0eaefda6c3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:58.502714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1b89a-a7e0-43ed-8bf6-df0eaefda6c3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:58.536278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8a20e-7766-4a65-879e-77261b215021 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:58.537511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8a20e-7766-4a65-879e-77261b215021 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:58.537991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8a20e-7766-4a65-879e-77261b215021 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:58.538443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8a20e-7766-4a65-879e-77261b215021 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:58.541533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8a20e-7766-4a65-879e-77261b215021 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=098c6cdac0004ef29753ae850dff7d6b, implied_role_id=53b212ca944742edb194af3e83f274fd)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:58.543920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8a20e-7766-4a65-879e-77261b215021 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:58.561974 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-66f8a20e-7766-4a65-879e-77261b215021 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] 098c6cdac0004ef29753ae850dff7d6b does not imply 53b212ca944742edb194af3e83f274fd.: keystone.exception.ImpliedRoleNotFound: 098c6cdac0004ef29753ae850dff7d6b does not imply 53b212ca944742edb194af3e83f274fd. Oct 27 03:47:58.561974 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:47:58.561974 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 27 03:47:58.561974 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = query.one() Oct 27 03:47:58.561974 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 27 03:47:58.561974 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._iter().one() Oct 27 03:47:58.561974 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 27 03:47:58.561974 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._only_one_row( Oct 27 03:47:58.561974 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 27 03:47:58.561974 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 27 03:47:58.561974 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 27 03:47:58.561974 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:47:58.561974 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:47:58.561974 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:47:58.561974 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:47:58.561974 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:47:58.563003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:47:58.563003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:47:58.563003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:47:58.563003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:47:58.563003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:47:58.563003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:47:58.563003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:47:58.563003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:47:58.563003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:47:58.563003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 27 03:47:58.563003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 27 03:47:58.563003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:47:58.563003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:47:58.563003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 27 03:47:58.563003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 27 03:47:58.563003 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 27 03:47:58.563776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 27 03:47:58.563776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 27 03:47:58.563776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 27 03:47:58.563776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 098c6cdac0004ef29753ae850dff7d6b does not imply 53b212ca944742edb194af3e83f274fd. Oct 27 03:47:58.563776 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:47:58.563776 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2866/5712] 10.222.0.20 () {58 vars in 1347 bytes} [Thu Oct 27 03:47:58 2022] DELETE /identity/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd => generated 137 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:47:58.572781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1b94d-037b-47e7-a2f2-e6d973c8aaa2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:58.587815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1b94d-037b-47e7-a2f2-e6d973c8aaa2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:58.599645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd695b65-19ba-443e-aeba-6e857367ac86 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:58.600317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd695b65-19ba-443e-aeba-6e857367ac86 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:58.600723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd695b65-19ba-443e-aeba-6e857367ac86 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:58.600954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd695b65-19ba-443e-aeba-6e857367ac86 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:58.602878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd695b65-19ba-443e-aeba-6e857367ac86 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=098c6cdac0004ef29753ae850dff7d6b, implied_role_id=53b212ca944742edb194af3e83f274fd)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:58.604506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd695b65-19ba-443e-aeba-6e857367ac86 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:58.708618 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2847/5713] 10.222.0.20 () {60 vars in 1363 bytes} [Thu Oct 27 03:47:58 2022] PUT /identity/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd => generated 519 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:58.712474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8a20e-7766-4a65-879e-77261b215021 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:58.727704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8a20e-7766-4a65-879e-77261b215021 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:58.760942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601a6fb-29ff-483e-96d3-704873438e59 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:58.762886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601a6fb-29ff-483e-96d3-704873438e59 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:58.762886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601a6fb-29ff-483e-96d3-704873438e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:58.804939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-3601a6fb-29ff-483e-96d3-704873438e59 None None] MFA Rules not processed for user `f501e7be812e41ebb05c15f0adfd8ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:58.805810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3601a6fb-29ff-483e-96d3-704873438e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:58.817532 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2848/5714] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:58 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:47:58.819018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df497c9-ab6e-486c-9794-d98b76abddc8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:58.821874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df497c9-ab6e-486c-9794-d98b76abddc8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:58.821874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df497c9-ab6e-486c-9794-d98b76abddc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:58.832903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5f691-45df-460d-8526-fdc8795f2977 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:58.834243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5f691-45df-460d-8526-fdc8795f2977 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:58.834511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5f691-45df-460d-8526-fdc8795f2977 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:58.834797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5f691-45df-460d-8526-fdc8795f2977 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/5cb64809a2434a7f874092a2dc0d46e0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:58.836907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5f691-45df-460d-8526-fdc8795f2977 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=098c6cdac0004ef29753ae850dff7d6b, implied_role_id=5cb64809a2434a7f874092a2dc0d46e0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:58.839190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5f691-45df-460d-8526-fdc8795f2977 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:58.949569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-3df497c9-ab6e-486c-9794-d98b76abddc8 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 27 03:47:58.949569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:47:58.949569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:47:58.949569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:47:58.949569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:47:58.949569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:47:58.949569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:47:58.949569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:47:58.949569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:47:58.949569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:47:58.949569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:47:58.949569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:47:58.949569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 27 03:47:58.949569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 27 03:47:58.949569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 27 03:47:58.949569 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 27 03:47:58.950686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Oct 27 03:47:58.950686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Oct 27 03:47:58.950686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Oct 27 03:47:58.950686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Oct 27 03:47:58.950686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Oct 27 03:47:58.950686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Oct 27 03:47:58.950686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Oct 27 03:47:58.950686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Oct 27 03:47:58.950686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:47:58.950686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:47:58.950686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 27 03:47:58.950686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 27 03:47:58.950686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 27 03:47:58.950686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 27 03:47:58.950686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:47:58.950686 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:47:58.951798 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 27 03:47:58.951798 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 27 03:47:58.951798 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:47:58.951798 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:47:58.951798 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 27 03:47:58.951798 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 27 03:47:58.951798 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:47:58.951798 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:47:58.951798 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 27 03:47:58.951798 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 27 03:47:58.951798 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 27 03:47:58.951798 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:47:58.953896 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2849/5715] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:58 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 136 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:47:58.960753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77ba4d-4462-4a75-8c86-50c4433236ca None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:58.961047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77ba4d-4462-4a75-8c86-50c4433236ca None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:58.961323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77ba4d-4462-4a75-8c86-50c4433236ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:58.998614 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2867/5716] 10.222.0.20 () {60 vars in 1363 bytes} [Thu Oct 27 03:47:58 2022] PUT /identity/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/5cb64809a2434a7f874092a2dc0d46e0 => generated 519 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:47:59.002731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5f691-45df-460d-8526-fdc8795f2977 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:59.092427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5f691-45df-460d-8526-fdc8795f2977 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:59.105281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c5212-443e-400d-88eb-e7b8740e776d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:59.106316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c5212-443e-400d-88eb-e7b8740e776d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:59.106702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c5212-443e-400d-88eb-e7b8740e776d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:59.107066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c5212-443e-400d-88eb-e7b8740e776d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/5cb64809a2434a7f874092a2dc0d46e0/implies/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:59.108794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c5212-443e-400d-88eb-e7b8740e776d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5cb64809a2434a7f874092a2dc0d46e0, implied_role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:59.111040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c5212-443e-400d-88eb-e7b8740e776d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:59.160073 n-d-862769-1 devstack@keystone.service[82179]: WARNING keystone.server.flask.application [None req-2a77ba4d-4462-4a75-8c86-50c4433236ca None None] Authorization failed. The request you have made requires authentication. from 10.222.0.20: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 27 03:47:59.164529 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2850/5717] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:58 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 202 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 27 03:47:59.168572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91382fe-f40c-4db9-88a8-4dfc5134939c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:59.168864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91382fe-f40c-4db9-88a8-4dfc5134939c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:59.169167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91382fe-f40c-4db9-88a8-4dfc5134939c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:59.293549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:59.308350 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2868/5718] 10.222.0.20 () {60 vars in 1363 bytes} [Thu Oct 27 03:47:59 2022] PUT /identity/v3/roles/5cb64809a2434a7f874092a2dc0d46e0/implies/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 519 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:47:59.309695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c5212-443e-400d-88eb-e7b8740e776d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:59.322937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d91382fe-f40c-4db9-88a8-4dfc5134939c None None] MFA Rules not processed for user `f501e7be812e41ebb05c15f0adfd8ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:47:59.327612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d91382fe-f40c-4db9-88a8-4dfc5134939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:47:59.439845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:59.469655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c5212-443e-400d-88eb-e7b8740e776d tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:59.482093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a2629-016c-46ba-ad71-a7ca4c3feb48 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:59.482826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a2629-016c-46ba-ad71-a7ca4c3feb48 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:59.483069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a2629-016c-46ba-ad71-a7ca4c3feb48 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:59.483346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a2629-016c-46ba-ad71-a7ca4c3feb48 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:59.483929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a2629-016c-46ba-ad71-a7ca4c3feb48 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:59.485017 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-eb8a2629-016c-46ba-ad71-a7ca4c3feb48 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:47:59.485017 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:47:59.485017 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:47:59.485922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a2629-016c-46ba-ad71-a7ca4c3feb48 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:59.526734 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2869/5719] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:47:59 2022] GET /identity/v3/role_inferences => generated 1603 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:47:59.529803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a2629-016c-46ba-ad71-a7ca4c3feb48 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:59.561368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a2629-016c-46ba-ad71-a7ca4c3feb48 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:59.570244 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2851/5720] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:47:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:47:59.575764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91382fe-f40c-4db9-88a8-4dfc5134939c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:59.585688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcc5c0-dbdb-4b55-9752-85691d7375c7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:59.588522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcc5c0-dbdb-4b55-9752-85691d7375c7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:59.588951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcc5c0-dbdb-4b55-9752-85691d7375c7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:59.589388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcc5c0-dbdb-4b55-9752-85691d7375c7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/5cb64809a2434a7f874092a2dc0d46e0/implies/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:59.593292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcc5c0-dbdb-4b55-9752-85691d7375c7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5cb64809a2434a7f874092a2dc0d46e0, implied_role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:59.596705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91382fe-f40c-4db9-88a8-4dfc5134939c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:59.598475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcc5c0-dbdb-4b55-9752-85691d7375c7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:59.605754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05d8d2-a869-48cd-93d2-5ec08c41ac08 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f501e7be812e41ebb05c15f0adfd8ea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91f48eb5f9be49ca85b5028084d5e0ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:59.606741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05d8d2-a869-48cd-93d2-5ec08c41ac08 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:59.607788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05d8d2-a869-48cd-93d2-5ec08c41ac08 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:59.608286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05d8d2-a869-48cd-93d2-5ec08c41ac08 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] PATH_INFO: `/v3/users/f501e7be812e41ebb05c15f0adfd8ea2/password` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:59.756314 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2870/5721] 10.222.0.20 () {58 vars in 1347 bytes} [Thu Oct 27 03:47:59 2022] DELETE /identity/v3/roles/5cb64809a2434a7f874092a2dc0d46e0/implies/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:59.761604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcc5c0-dbdb-4b55-9752-85691d7375c7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:47:59.781726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9f05d8d2-a869-48cd-93d2-5ec08c41ac08 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f501e7be812e41ebb05c15f0adfd8ea2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:47:59.890602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcc5c0-dbdb-4b55-9752-85691d7375c7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:47:59.899666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5728c9-f400-4ee6-9a8f-1373b7544fb2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:47:59.900342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5728c9-f400-4ee6-9a8f-1373b7544fb2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:47:59.900656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5728c9-f400-4ee6-9a8f-1373b7544fb2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:47:59.900997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5728c9-f400-4ee6-9a8f-1373b7544fb2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/5cb64809a2434a7f874092a2dc0d46e0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:47:59.902720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5728c9-f400-4ee6-9a8f-1373b7544fb2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=098c6cdac0004ef29753ae850dff7d6b, implied_role_id=5cb64809a2434a7f874092a2dc0d46e0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:47:59.904884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5728c9-f400-4ee6-9a8f-1373b7544fb2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:47:59.942872 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2852/5722] 10.222.0.20 () {60 vars in 1269 bytes} [Thu Oct 27 03:47:59 2022] POST /identity/v3/users/f501e7be812e41ebb05c15f0adfd8ea2/password => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:59.993376 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2871/5723] 10.222.0.20 () {58 vars in 1347 bytes} [Thu Oct 27 03:47:59 2022] DELETE /identity/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/5cb64809a2434a7f874092a2dc0d46e0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:47:59.997877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05d8d2-a869-48cd-93d2-5ec08c41ac08 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:00.012576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05d8d2-a869-48cd-93d2-5ec08c41ac08 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:00.094483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0161559-0a6e-47e8-bcb3-4f5a1cad984c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:00.095255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0161559-0a6e-47e8-bcb3-4f5a1cad984c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:00.095611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0161559-0a6e-47e8-bcb3-4f5a1cad984c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:00.095975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0161559-0a6e-47e8-bcb3-4f5a1cad984c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:00.097665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0161559-0a6e-47e8-bcb3-4f5a1cad984c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=098c6cdac0004ef29753ae850dff7d6b, implied_role_id=53b212ca944742edb194af3e83f274fd)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:00.100930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0161559-0a6e-47e8-bcb3-4f5a1cad984c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:00.206104 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2853/5724] 10.222.0.20 () {58 vars in 1347 bytes} [Thu Oct 27 03:47:59 2022] DELETE /identity/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:00.214199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5728c9-f400-4ee6-9a8f-1373b7544fb2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:00.243328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5728c9-f400-4ee6-9a8f-1373b7544fb2 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:00.343027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0dec1e-4120-45bb-a8a4-8a0497c6e323 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:00.343655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dec1e-4120-45bb-a8a4-8a0497c6e323 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:00.343951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dec1e-4120-45bb-a8a4-8a0497c6e323 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:00.344228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dec1e-4120-45bb-a8a4-8a0497c6e323 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:00.344926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0dec1e-4120-45bb-a8a4-8a0497c6e323 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:00.346529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0dec1e-4120-45bb-a8a4-8a0497c6e323 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:00.363515 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2872/5725] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:00 2022] GET /identity/v3/roles => generated 2320 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:48:00.364811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0161559-0a6e-47e8-bcb3-4f5a1cad984c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:00.389964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0161559-0a6e-47e8-bcb3-4f5a1cad984c tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:00.399425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe965b3c-c3a6-45dc-8fe4-49252147c2b1 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:00.399768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe965b3c-c3a6-45dc-8fe4-49252147c2b1 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:00.400053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe965b3c-c3a6-45dc-8fe4-49252147c2b1 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:00.400332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe965b3c-c3a6-45dc-8fe4-49252147c2b1 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:00.401010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe965b3c-c3a6-45dc-8fe4-49252147c2b1 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:00.402720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe965b3c-c3a6-45dc-8fe4-49252147c2b1 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:00.520897 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2854/5726] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:48:00 2022] POST /identity/v3/roles => generated 235 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:00.524825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0dec1e-4120-45bb-a8a4-8a0497c6e323 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:00.536864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0dec1e-4120-45bb-a8a4-8a0497c6e323 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:00.543022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914c310-78f8-4621-9d3f-f039cd2beef8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:00.543765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914c310-78f8-4621-9d3f-f039cd2beef8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:00.544078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914c310-78f8-4621-9d3f-f039cd2beef8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:00.544595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914c310-78f8-4621-9d3f-f039cd2beef8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/dc66ae29a5f14ae7ad2b804dfb106a5a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:00.546708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914c310-78f8-4621-9d3f-f039cd2beef8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:update_role(role_id=dc66ae29a5f14ae7ad2b804dfb106a5a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:00.547987 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-e914c310-78f8-4621-9d3f-f039cd2beef8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:48:00.547987 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:48:00.547987 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:48:00.557124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914c310-78f8-4621-9d3f-f039cd2beef8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:00.761016 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2873/5727] 10.222.0.20 () {60 vars in 1243 bytes} [Thu Oct 27 03:48:00 2022] PATCH /identity/v3/roles/dc66ae29a5f14ae7ad2b804dfb106a5a => generated 237 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:48:00.765167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe965b3c-c3a6-45dc-8fe4-49252147c2b1 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:00.777392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe965b3c-c3a6-45dc-8fe4-49252147c2b1 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:00.784463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed9a06-68eb-49bc-a269-cba7fcbafd2a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:00.787866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed9a06-68eb-49bc-a269-cba7fcbafd2a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:00.787866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed9a06-68eb-49bc-a269-cba7fcbafd2a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:00.787866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed9a06-68eb-49bc-a269-cba7fcbafd2a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/dc66ae29a5f14ae7ad2b804dfb106a5a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:00.798365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed9a06-68eb-49bc-a269-cba7fcbafd2a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:get_role(role_id=dc66ae29a5f14ae7ad2b804dfb106a5a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:00.799657 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-d2ed9a06-68eb-49bc-a269-cba7fcbafd2a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:48:00.799657 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:48:00.799657 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:48:00.802916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed9a06-68eb-49bc-a269-cba7fcbafd2a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:00.805145 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2855/5728] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 03:48:00 2022] GET /identity/v3/roles/dc66ae29a5f14ae7ad2b804dfb106a5a => generated 237 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:48:00.809262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914c310-78f8-4621-9d3f-f039cd2beef8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:00.821234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914c310-78f8-4621-9d3f-f039cd2beef8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:00.825570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90236c-2e2d-4596-9361-dac0492b9da8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:00.826297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90236c-2e2d-4596-9361-dac0492b9da8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:00.829842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90236c-2e2d-4596-9361-dac0492b9da8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:00.829842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90236c-2e2d-4596-9361-dac0492b9da8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:00.829842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90236c-2e2d-4596-9361-dac0492b9da8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:00.830899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90236c-2e2d-4596-9361-dac0492b9da8 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:00.849778 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2874/5729] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:00 2022] GET /identity/v3/roles => generated 2548 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:00.850907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed9a06-68eb-49bc-a269-cba7fcbafd2a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:00.863514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed9a06-68eb-49bc-a269-cba7fcbafd2a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:00.869592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf140ac2-c487-49c5-a957-52f2bd32b189 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:00.870464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf140ac2-c487-49c5-a957-52f2bd32b189 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:00.870854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf140ac2-c487-49c5-a957-52f2bd32b189 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:00.871196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf140ac2-c487-49c5-a957-52f2bd32b189 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/dc66ae29a5f14ae7ad2b804dfb106a5a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:00.872782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf140ac2-c487-49c5-a957-52f2bd32b189 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_role(role_id=dc66ae29a5f14ae7ad2b804dfb106a5a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:00.874526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf140ac2-c487-49c5-a957-52f2bd32b189 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:00.948219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3482e73-3b61-48aa-abe4-a2ed476696b4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:00.949178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3482e73-3b61-48aa-abe4-a2ed476696b4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:00.949489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3482e73-3b61-48aa-abe4-a2ed476696b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:01.012908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bf140ac2-c487-49c5-a957-52f2bd32b189 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invalidating the token cache because role dc66ae29a5f14ae7ad2b804dfb106a5a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:01.012908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bf140ac2-c487-49c5-a957-52f2bd32b189 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:01.012908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bf140ac2-c487-49c5-a957-52f2bd32b189 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:01.013820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f3482e73-3b61-48aa-abe4-a2ed476696b4 None None] MFA Rules not processed for user `f501e7be812e41ebb05c15f0adfd8ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:01.013820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f3482e73-3b61-48aa-abe4-a2ed476696b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:01.015059 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2856/5730] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:00 2022] DELETE /identity/v3/roles/dc66ae29a5f14ae7ad2b804dfb106a5a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:01.015371 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2875/5731] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:00 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:48:01.016444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf140ac2-c487-49c5-a957-52f2bd32b189 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:01.018250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bf140ac2-c487-49c5-a957-52f2bd32b189 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:01.019900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98559d-3034-42f3-bb89-456bd77c9a1d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:01.020397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98559d-3034-42f3-bb89-456bd77c9a1d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:01.020939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98559d-3034-42f3-bb89-456bd77c9a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:01.066899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ca98559d-3034-42f3-bb89-456bd77c9a1d None None] MFA Rules not processed for user `f501e7be812e41ebb05c15f0adfd8ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:01.069197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ca98559d-3034-42f3-bb89-456bd77c9a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:01.155388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf140ac2-c487-49c5-a957-52f2bd32b189 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:01.156163 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2876/5732] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:01.161521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98559d-3034-42f3-bb89-456bd77c9a1d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:01.167699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007ff84-0bbc-43cd-9f35-49ea77a0a6fc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:01.168395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007ff84-0bbc-43cd-9f35-49ea77a0a6fc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:01.168688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007ff84-0bbc-43cd-9f35-49ea77a0a6fc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:01.168970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007ff84-0bbc-43cd-9f35-49ea77a0a6fc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:01.171467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98559d-3034-42f3-bb89-456bd77c9a1d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:01.171810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007ff84-0bbc-43cd-9f35-49ea77a0a6fc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=098c6cdac0004ef29753ae850dff7d6b, implied_role_id=53b212ca944742edb194af3e83f274fd)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:01.173802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007ff84-0bbc-43cd-9f35-49ea77a0a6fc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:01.176361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f9a3d-47d6-4587-a2aa-3663c8266cfd tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f501e7be812e41ebb05c15f0adfd8ea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91f48eb5f9be49ca85b5028084d5e0ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:01.178190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f9a3d-47d6-4587-a2aa-3663c8266cfd tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:01.178547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f9a3d-47d6-4587-a2aa-3663c8266cfd tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:01.178896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f9a3d-47d6-4587-a2aa-3663c8266cfd tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] PATH_INFO: `/v3/users/f501e7be812e41ebb05c15f0adfd8ea2/password` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:01.205752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:01.312424 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2857/5733] 10.222.0.20 () {60 vars in 1363 bytes} [Thu Oct 27 03:48:01 2022] PUT /identity/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd => generated 519 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:01.312739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007ff84-0bbc-43cd-9f35-49ea77a0a6fc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:01.331578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:01.349517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-851f9a3d-47d6-4587-a2aa-3663c8266cfd tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f501e7be812e41ebb05c15f0adfd8ea2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:01.406205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007ff84-0bbc-43cd-9f35-49ea77a0a6fc tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:01.411464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b347e1-05bb-4611-8d5d-d7eefde1adbe tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:01.412180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b347e1-05bb-4611-8d5d-d7eefde1adbe tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:01.412466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b347e1-05bb-4611-8d5d-d7eefde1adbe tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:01.412887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b347e1-05bb-4611-8d5d-d7eefde1adbe tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/5cb64809a2434a7f874092a2dc0d46e0` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:01.414815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b347e1-05bb-4611-8d5d-d7eefde1adbe tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=098c6cdac0004ef29753ae850dff7d6b, implied_role_id=5cb64809a2434a7f874092a2dc0d46e0)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:01.422664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b347e1-05bb-4611-8d5d-d7eefde1adbe tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:01.474523 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2877/5734] 10.222.0.20 () {60 vars in 1269 bytes} [Thu Oct 27 03:48:01 2022] POST /identity/v3/users/f501e7be812e41ebb05c15f0adfd8ea2/password => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:01.585998 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2858/5735] 10.222.0.20 () {60 vars in 1363 bytes} [Thu Oct 27 03:48:01 2022] PUT /identity/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/5cb64809a2434a7f874092a2dc0d46e0 => generated 519 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:01.590790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f9a3d-47d6-4587-a2aa-3663c8266cfd tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:01.623966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f9a3d-47d6-4587-a2aa-3663c8266cfd tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:01.702667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10028a-ac26-4d00-9242-c437f356f012 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:01.703333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10028a-ac26-4d00-9242-c437f356f012 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:01.703624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10028a-ac26-4d00-9242-c437f356f012 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:01.703904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10028a-ac26-4d00-9242-c437f356f012 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/5cb64809a2434a7f874092a2dc0d46e0/implies/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:01.705595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10028a-ac26-4d00-9242-c437f356f012 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5cb64809a2434a7f874092a2dc0d46e0, implied_role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:01.707239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10028a-ac26-4d00-9242-c437f356f012 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:01.863091 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2878/5736] 10.222.0.20 () {60 vars in 1363 bytes} [Thu Oct 27 03:48:01 2022] PUT /identity/v3/roles/5cb64809a2434a7f874092a2dc0d46e0/implies/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 519 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:01.867053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b347e1-05bb-4611-8d5d-d7eefde1adbe tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:01.878865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b347e1-05bb-4611-8d5d-d7eefde1adbe tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:01.943810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f5712-1a82-4cc7-ab16-8a504756420f tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:01.944653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f5712-1a82-4cc7-ab16-8a504756420f tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:01.944803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f5712-1a82-4cc7-ab16-8a504756420f tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:01.945169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f5712-1a82-4cc7-ab16-8a504756420f tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/5cb64809a2434a7f874092a2dc0d46e0/implies` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:01.946268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f5712-1a82-4cc7-ab16-8a504756420f tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=5cb64809a2434a7f874092a2dc0d46e0)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:01.947361 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-744f5712-1a82-4cc7-ab16-8a504756420f tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:48:01.947361 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:48:01.947361 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:48:01.948295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f5712-1a82-4cc7-ab16-8a504756420f tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:01.956579 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2859/5737] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:48:01 2022] GET /identity/v3/roles/5cb64809a2434a7f874092a2dc0d46e0/implies => generated 488 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:48:01.960737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10028a-ac26-4d00-9242-c437f356f012 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:01.978665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10028a-ac26-4d00-9242-c437f356f012 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:01.984515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5ae97-eb9c-4b52-839c-121013f9075a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:01.985159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5ae97-eb9c-4b52-839c-121013f9075a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:01.985449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5ae97-eb9c-4b52-839c-121013f9075a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:01.989532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5ae97-eb9c-4b52-839c-121013f9075a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:01.989532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5ae97-eb9c-4b52-839c-121013f9075a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=098c6cdac0004ef29753ae850dff7d6b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:01.989532 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-63c5ae97-eb9c-4b52-839c-121013f9075a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:48:01.989532 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:48:01.989532 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:48:01.989532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5ae97-eb9c-4b52-839c-121013f9075a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:01.995869 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2879/5738] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:48:01 2022] GET /identity/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies => generated 658 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:48:02.000716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f5712-1a82-4cc7-ab16-8a504756420f tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:02.012265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f5712-1a82-4cc7-ab16-8a504756420f tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:02.022601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fced182-1c4f-4cd7-ab39-d98000c519ca tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:02.022601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fced182-1c4f-4cd7-ab39-d98000c519ca tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:02.022601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fced182-1c4f-4cd7-ab39-d98000c519ca tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:02.022970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fced182-1c4f-4cd7-ab39-d98000c519ca tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/5cb64809a2434a7f874092a2dc0d46e0/implies/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:02.022970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fced182-1c4f-4cd7-ab39-d98000c519ca tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5cb64809a2434a7f874092a2dc0d46e0, implied_role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:02.022970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fced182-1c4f-4cd7-ab39-d98000c519ca tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:02.142684 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2860/5739] 10.222.0.20 () {58 vars in 1347 bytes} [Thu Oct 27 03:48:01 2022] DELETE /identity/v3/roles/5cb64809a2434a7f874092a2dc0d46e0/implies/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:48:02.147083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5ae97-eb9c-4b52-839c-121013f9075a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:02.157849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5ae97-eb9c-4b52-839c-121013f9075a tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:02.266633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2d2e3-9b20-4d8f-88fd-9c965f93b241 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:02.267363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2d2e3-9b20-4d8f-88fd-9c965f93b241 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:02.267660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2d2e3-9b20-4d8f-88fd-9c965f93b241 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:02.267940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2d2e3-9b20-4d8f-88fd-9c965f93b241 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/5cb64809a2434a7f874092a2dc0d46e0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:02.269651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2d2e3-9b20-4d8f-88fd-9c965f93b241 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=098c6cdac0004ef29753ae850dff7d6b, implied_role_id=5cb64809a2434a7f874092a2dc0d46e0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:02.271965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2d2e3-9b20-4d8f-88fd-9c965f93b241 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:02.418688 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2880/5740] 10.222.0.20 () {58 vars in 1347 bytes} [Thu Oct 27 03:48:02 2022] DELETE /identity/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/5cb64809a2434a7f874092a2dc0d46e0 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:48:02.423999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fced182-1c4f-4cd7-ab39-d98000c519ca tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:02.436163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fced182-1c4f-4cd7-ab39-d98000c519ca tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:02.480874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30557b4b-87b2-448f-b93f-e49ebca9f37b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:02.481495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30557b4b-87b2-448f-b93f-e49ebca9f37b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:02.482618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30557b4b-87b2-448f-b93f-e49ebca9f37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:02.513657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-30557b4b-87b2-448f-b93f-e49ebca9f37b None None] MFA Rules not processed for user `f501e7be812e41ebb05c15f0adfd8ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:02.516039 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-30557b4b-87b2-448f-b93f-e49ebca9f37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:02.527042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:02.528407 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2881/5741] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:02 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:48:02.532555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afa5ab-d9f0-4e33-a4a4-82c50468a581 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:02.533096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afa5ab-d9f0-4e33-a4a4-82c50468a581 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:02.533538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afa5ab-d9f0-4e33-a4a4-82c50468a581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:02.561514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e3afa5ab-d9f0-4e33-a4a4-82c50468a581 None None] MFA Rules not processed for user `f501e7be812e41ebb05c15f0adfd8ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:02.562222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0bda9-c89e-4ddc-8fbc-3c2f1848bcc9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:02.563905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0bda9-c89e-4ddc-8fbc-3c2f1848bcc9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:02.564372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0bda9-c89e-4ddc-8fbc-3c2f1848bcc9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:02.564546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e3afa5ab-d9f0-4e33-a4a4-82c50468a581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:02.564976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0bda9-c89e-4ddc-8fbc-3c2f1848bcc9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:02.567247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0bda9-c89e-4ddc-8fbc-3c2f1848bcc9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=098c6cdac0004ef29753ae850dff7d6b, implied_role_id=53b212ca944742edb194af3e83f274fd)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:02.569855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0bda9-c89e-4ddc-8fbc-3c2f1848bcc9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:02.681451 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2882/5742] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:02.688532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afa5ab-d9f0-4e33-a4a4-82c50468a581 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:02.707536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afa5ab-d9f0-4e33-a4a4-82c50468a581 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:02.718493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb5f84-46a1-4c97-9da9-2c62e1d0af90 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f501e7be812e41ebb05c15f0adfd8ea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91f48eb5f9be49ca85b5028084d5e0ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:02.727057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb5f84-46a1-4c97-9da9-2c62e1d0af90 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:02.727057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb5f84-46a1-4c97-9da9-2c62e1d0af90 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:02.727057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb5f84-46a1-4c97-9da9-2c62e1d0af90 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] PATH_INFO: `/v3/users/f501e7be812e41ebb05c15f0adfd8ea2/password` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:02.727738 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2861/5743] 10.222.0.20 () {58 vars in 1347 bytes} [Thu Oct 27 03:48:02 2022] DELETE /identity/v3/roles/098c6cdac0004ef29753ae850dff7d6b/implies/53b212ca944742edb194af3e83f274fd => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:02.727738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0bda9-c89e-4ddc-8fbc-3c2f1848bcc9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:02.842313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0bda9-c89e-4ddc-8fbc-3c2f1848bcc9 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:02.848052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803339ab-abcb-40f6-add9-70f36e3b83f6 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:02.848883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803339ab-abcb-40f6-add9-70f36e3b83f6 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:02.849241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803339ab-abcb-40f6-add9-70f36e3b83f6 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:02.849594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803339ab-abcb-40f6-add9-70f36e3b83f6 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/domains/85dc3c9ad77f4ec6a23c27dc7d7b8842` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:02.860058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803339ab-abcb-40f6-add9-70f36e3b83f6 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:48:02.870411 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-803339ab-abcb-40f6-add9-70f36e3b83f6 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Could not find domain: 85dc3c9ad77f4ec6a23c27dc7d7b8842.: keystone.exception.DomainNotFound: Could not find domain: 85dc3c9ad77f4ec6a23c27dc7d7b8842. Oct 27 03:48:02.870411 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:48:02.870411 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 27 03:48:02.870411 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 27 03:48:02.870411 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:48:02.870411 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:48:02.870411 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:48:02.870411 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:48:02.870411 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 85dc3c9ad77f4ec6a23c27dc7d7b8842. Oct 27 03:48:02.870411 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:48:02.870411 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:48:02.870411 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:48:02.870411 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:48:02.870411 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:48:02.870411 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:48:02.870411 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:48:02.871928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:48:02.871928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:48:02.871928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:48:02.871928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:48:02.871928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:48:02.871928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:48:02.871928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:48:02.871928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 27 03:48:02.871928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 27 03:48:02.871928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:48:02.871928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:48:02.871928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:48:02.871928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:48:02.871928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:48:02.871928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:48:02.871928 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:48:02.873470 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:48:02.873470 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:48:02.873470 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:48:02.873470 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:48:02.873470 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:48:02.873470 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:48:02.873470 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:48:02.873470 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:48:02.873470 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:48:02.873470 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:48:02.873470 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:48:02.873470 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:48:02.873470 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:48:02.873470 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 27 03:48:02.873470 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:48:02.873470 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 85dc3c9ad77f4ec6a23c27dc7d7b8842. Oct 27 03:48:02.873470 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:48:02.874726 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2862/5744] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:48:02 2022] PATCH /identity/v3/domains/85dc3c9ad77f4ec6a23c27dc7d7b8842 => generated 112 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:48:02.876128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803339ab-abcb-40f6-add9-70f36e3b83f6 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:02.889014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803339ab-abcb-40f6-add9-70f36e3b83f6 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:02.896988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90df81-7d8e-48ce-87ae-e0789016f061 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:02.897758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90df81-7d8e-48ce-87ae-e0789016f061 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:02.898084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90df81-7d8e-48ce-87ae-e0789016f061 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:02.898366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90df81-7d8e-48ce-87ae-e0789016f061 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:02.902474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90df81-7d8e-48ce-87ae-e0789016f061 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d6a91a5b5e1f43d9aeb8b3da355f2c7c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:02.902474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90df81-7d8e-48ce-87ae-e0789016f061 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:02.940529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0adb5f84-46a1-4c97-9da9-2c62e1d0af90 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f501e7be812e41ebb05c15f0adfd8ea2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:03.046661 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2883/5745] 10.222.0.20 () {60 vars in 1269 bytes} [Thu Oct 27 03:48:02 2022] POST /identity/v3/users/f501e7be812e41ebb05c15f0adfd8ea2/password => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:03.071221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2e90df81-7d8e-48ce-87ae-e0789016f061 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6a91a5b5e1f43d9aeb8b3da355f2c7c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:03.072697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2e90df81-7d8e-48ce-87ae-e0789016f061 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6a91a5b5e1f43d9aeb8b3da355f2c7c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:03.082380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2e90df81-7d8e-48ce-87ae-e0789016f061 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6a91a5b5e1f43d9aeb8b3da355f2c7c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:03.096042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2e90df81-7d8e-48ce-87ae-e0789016f061 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6a91a5b5e1f43d9aeb8b3da355f2c7c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:03.199660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2e90df81-7d8e-48ce-87ae-e0789016f061 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6a91a5b5e1f43d9aeb8b3da355f2c7c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:03.206196 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2863/5746] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:02 2022] DELETE /identity/v3/users/d6a91a5b5e1f43d9aeb8b3da355f2c7c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:48:03.210592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb5f84-46a1-4c97-9da9-2c62e1d0af90 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:03.212613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0adb5f84-46a1-4c97-9da9-2c62e1d0af90 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:03.229478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb5f84-46a1-4c97-9da9-2c62e1d0af90 tempest-IdentityV3UsersTest-1864861162 tempest-IdentityV3UsersTest-1864861162-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:03.302496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fc14a-3ff9-409a-9c00-661ec91d3467 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:03.305840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fc14a-3ff9-409a-9c00-661ec91d3467 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:03.306168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fc14a-3ff9-409a-9c00-661ec91d3467 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:03.306454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fc14a-3ff9-409a-9c00-661ec91d3467 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/3a45126f0c3b4a19bdbb05359c2b8a4a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:03.312438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9fc14a-3ff9-409a-9c00-661ec91d3467 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3a45126f0c3b4a19bdbb05359c2b8a4a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:03.314908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9fc14a-3ff9-409a-9c00-661ec91d3467 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:03.324946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:INSERT=5,keystone:DELETE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:03.485156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bf9fc14a-3ff9-409a-9c00-661ec91d3467 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invalidating the token cache because role 3a45126f0c3b4a19bdbb05359c2b8a4a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:03.485756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bf9fc14a-3ff9-409a-9c00-661ec91d3467 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:03.486499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bf9fc14a-3ff9-409a-9c00-661ec91d3467 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:03.489945 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2884/5747] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:03 2022] DELETE /identity/v3/roles/3a45126f0c3b4a19bdbb05359c2b8a4a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:03.494241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90df81-7d8e-48ce-87ae-e0789016f061 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:03.506795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90df81-7d8e-48ce-87ae-e0789016f061 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:03.618243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f978f-5710-476e-83b5-06f0ff157737 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:03.618904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f978f-5710-476e-83b5-06f0ff157737 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:03.619192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f978f-5710-476e-83b5-06f0ff157737 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:03.619473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f978f-5710-476e-83b5-06f0ff157737 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/groups/3fdce43033634bc7b2028e8549520b69` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:03.620685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f978f-5710-476e-83b5-06f0ff157737 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_group(group_id=3fdce43033634bc7b2028e8549520b69)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:03.623211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f978f-5710-476e-83b5-06f0ff157737 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:03.804685 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2864/5748] 10.222.0.20 () {58 vars in 1227 bytes} [Thu Oct 27 03:48:03 2022] DELETE /identity/v3/groups/3fdce43033634bc7b2028e8549520b69 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:03.809306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fc14a-3ff9-409a-9c00-661ec91d3467 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:03.816906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bf9fc14a-3ff9-409a-9c00-661ec91d3467 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:03.831428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fc14a-3ff9-409a-9c00-661ec91d3467 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:03.929932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159e3b8-5aa9-4b87-ac79-439ba5cca7e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:03.930642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159e3b8-5aa9-4b87-ac79-439ba5cca7e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:03.931600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159e3b8-5aa9-4b87-ac79-439ba5cca7e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:03.931895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159e3b8-5aa9-4b87-ac79-439ba5cca7e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/projects/69b460b9168847bbb5cc5a8200b263c2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:03.933064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159e3b8-5aa9-4b87-ac79-439ba5cca7e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_project(project_id=69b460b9168847bbb5cc5a8200b263c2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:03.935229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159e3b8-5aa9-4b87-ac79-439ba5cca7e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:04.035958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:04.052493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3be65-612f-4d14-b66f-21066209eac2 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:04.053015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3be65-612f-4d14-b66f-21066209eac2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:04.053101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3be65-612f-4d14-b66f-21066209eac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:04.086248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ffd3be65-612f-4d14-b66f-21066209eac2 None None] MFA Rules not processed for user `f501e7be812e41ebb05c15f0adfd8ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:04.087470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ffd3be65-612f-4d14-b66f-21066209eac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:04.090875 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2865/5749] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:04 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 03:48:04.137232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0159e3b8-5aa9-4b87-ac79-439ba5cca7e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b460b9168847bbb5cc5a8200b263c2', 'request_id': 'req-0159e3b8-5aa9-4b87-ac79-439ba5cca7e7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:04.145661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0159e3b8-5aa9-4b87-ac79-439ba5cca7e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b460b9168847bbb5cc5a8200b263c2', 'request_id': 'req-0159e3b8-5aa9-4b87-ac79-439ba5cca7e7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:04.152273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0159e3b8-5aa9-4b87-ac79-439ba5cca7e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b460b9168847bbb5cc5a8200b263c2', 'request_id': 'req-0159e3b8-5aa9-4b87-ac79-439ba5cca7e7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:04.293115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0159e3b8-5aa9-4b87-ac79-439ba5cca7e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] The token cache is being invalidate because project 69b460b9168847bbb5cc5a8200b263c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:04.293437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0159e3b8-5aa9-4b87-ac79-439ba5cca7e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:04.294172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0159e3b8-5aa9-4b87-ac79-439ba5cca7e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:04.296276 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2885/5750] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:48:03 2022] DELETE /identity/v3/projects/69b460b9168847bbb5cc5a8200b263c2 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:04.300197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3be65-612f-4d14-b66f-21066209eac2 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:04.370636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3be65-612f-4d14-b66f-21066209eac2 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:04.376464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e9bfb-ad5b-4299-ba52-060678f58c00 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:04.377100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e9bfb-ad5b-4299-ba52-060678f58c00 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:04.377388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e9bfb-ad5b-4299-ba52-060678f58c00 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:04.377673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e9bfb-ad5b-4299-ba52-060678f58c00 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/domains/9b43c405024c47238c60b4cd20f9cc1e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:04.379028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e9bfb-ad5b-4299-ba52-060678f58c00 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9b43c405024c47238c60b4cd20f9cc1e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:04.381312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e9bfb-ad5b-4299-ba52-060678f58c00 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:04.415273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b33e9bfb-ad5b-4299-ba52-060678f58c00 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9b43c405024c47238c60b4cd20f9cc1e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:04.416259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b33e9bfb-ad5b-4299-ba52-060678f58c00 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9b43c405024c47238c60b4cd20f9cc1e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:04.530569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b33e9bfb-ad5b-4299-ba52-060678f58c00 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9b43c405024c47238c60b4cd20f9cc1e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:04.532209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b33e9bfb-ad5b-4299-ba52-060678f58c00 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9b43c405024c47238c60b4cd20f9cc1e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:04.537967 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2866/5751] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:48:04 2022] PATCH /identity/v3/domains/9b43c405024c47238c60b4cd20f9cc1e => generated 276 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:48:04.539652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159e3b8-5aa9-4b87-ac79-439ba5cca7e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:04.541319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0159e3b8-5aa9-4b87-ac79-439ba5cca7e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:04.555509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159e3b8-5aa9-4b87-ac79-439ba5cca7e7 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:04.620202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd203d85-64cd-4de6-9ea5-bc4658dcfea3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:04.620928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd203d85-64cd-4de6-9ea5-bc4658dcfea3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:04.621249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd203d85-64cd-4de6-9ea5-bc4658dcfea3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:04.621559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd203d85-64cd-4de6-9ea5-bc4658dcfea3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/domains/9b43c405024c47238c60b4cd20f9cc1e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:04.637112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd203d85-64cd-4de6-9ea5-bc4658dcfea3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9b43c405024c47238c60b4cd20f9cc1e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:04.639387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd203d85-64cd-4de6-9ea5-bc4658dcfea3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:04.686743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bd203d85-64cd-4de6-9ea5-bc4658dcfea3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9b43c405024c47238c60b4cd20f9cc1e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:04.701279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bd203d85-64cd-4de6-9ea5-bc4658dcfea3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9b43c405024c47238c60b4cd20f9cc1e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:04.906786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bd203d85-64cd-4de6-9ea5-bc4658dcfea3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b43c405024c47238c60b4cd20f9cc1e', 'request_id': 'req-bd203d85-64cd-4de6-9ea5-bc4658dcfea3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:04.919328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bd203d85-64cd-4de6-9ea5-bc4658dcfea3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b43c405024c47238c60b4cd20f9cc1e', 'request_id': 'req-bd203d85-64cd-4de6-9ea5-bc4658dcfea3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:04.931515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bd203d85-64cd-4de6-9ea5-bc4658dcfea3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b43c405024c47238c60b4cd20f9cc1e', 'request_id': 'req-bd203d85-64cd-4de6-9ea5-bc4658dcfea3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:05.009976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bd203d85-64cd-4de6-9ea5-bc4658dcfea3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] The token cache is being invalidate because project 9b43c405024c47238c60b4cd20f9cc1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:05.010327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bd203d85-64cd-4de6-9ea5-bc4658dcfea3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:05.012136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bd203d85-64cd-4de6-9ea5-bc4658dcfea3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:05.035401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bd203d85-64cd-4de6-9ea5-bc4658dcfea3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9b43c405024c47238c60b4cd20f9cc1e', 'request_id': 'req-bd203d85-64cd-4de6-9ea5-bc4658dcfea3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:05.036574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bd203d85-64cd-4de6-9ea5-bc4658dcfea3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9b43c405024c47238c60b4cd20f9cc1e', 'request_id': 'req-bd203d85-64cd-4de6-9ea5-bc4658dcfea3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:05.037475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bd203d85-64cd-4de6-9ea5-bc4658dcfea3 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9b43c405024c47238c60b4cd20f9cc1e', 'request_id': 'req-bd203d85-64cd-4de6-9ea5-bc4658dcfea3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:05.056728 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2886/5752] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:48:04 2022] DELETE /identity/v3/domains/9b43c405024c47238c60b4cd20f9cc1e => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:05.061022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e9bfb-ad5b-4299-ba52-060678f58c00 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:05.062687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b33e9bfb-ad5b-4299-ba52-060678f58c00 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:05.081286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e9bfb-ad5b-4299-ba52-060678f58c00 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:05.097151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b1cda-f244-43f6-9b46-6e43a7c11646 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:05.098059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b1cda-f244-43f6-9b46-6e43a7c11646 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:05.098059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b1cda-f244-43f6-9b46-6e43a7c11646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:05.138613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-575b1cda-f244-43f6-9b46-6e43a7c11646 None None] MFA Rules not processed for user `f501e7be812e41ebb05c15f0adfd8ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:05.143559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-575b1cda-f244-43f6-9b46-6e43a7c11646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:05.248048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ebbdd-12b2-42bb-abb9-c92a42a4b116 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:05.249035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ebbdd-12b2-42bb-abb9-c92a42a4b116 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:05.249214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ebbdd-12b2-42bb-abb9-c92a42a4b116 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:05.249507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ebbdd-12b2-42bb-abb9-c92a42a4b116 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/5cb64809a2434a7f874092a2dc0d46e0` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:05.251590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ebbdd-12b2-42bb-abb9-c92a42a4b116 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5cb64809a2434a7f874092a2dc0d46e0)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:05.252927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ebbdd-12b2-42bb-abb9-c92a42a4b116 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:05.270368 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2887/5753] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:48:05.271385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b1cda-f244-43f6-9b46-6e43a7c11646 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:05.272977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-575b1cda-f244-43f6-9b46-6e43a7c11646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:05.384943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b1cda-f244-43f6-9b46-6e43a7c11646 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:05.395133 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72caca6-a78c-4298-9528-e00ed17e21e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:05.396124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72caca6-a78c-4298-9528-e00ed17e21e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:05.396606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72caca6-a78c-4298-9528-e00ed17e21e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:05.398477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72caca6-a78c-4298-9528-e00ed17e21e7 admin admin] PATH_INFO: `/v3/users/f501e7be812e41ebb05c15f0adfd8ea2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:05.398656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72caca6-a78c-4298-9528-e00ed17e21e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f501e7be812e41ebb05c15f0adfd8ea2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:05.401120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72caca6-a78c-4298-9528-e00ed17e21e7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:05.504614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ab2ebbdd-12b2-42bb-abb9-c92a42a4b116 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invalidating the token cache because role 5cb64809a2434a7f874092a2dc0d46e0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:05.505827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ab2ebbdd-12b2-42bb-abb9-c92a42a4b116 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:05.506235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ab2ebbdd-12b2-42bb-abb9-c92a42a4b116 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:05.511525 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2867/5754] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:05 2022] DELETE /identity/v3/roles/5cb64809a2434a7f874092a2dc0d46e0 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:05.532202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ebbdd-12b2-42bb-abb9-c92a42a4b116 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:05.536085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ab2ebbdd-12b2-42bb-abb9-c92a42a4b116 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:05.690078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ebbdd-12b2-42bb-abb9-c92a42a4b116 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:05.695243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8a6d7-6ba2-4834-9870-4dd2d0900fed tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:05.696340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8a6d7-6ba2-4834-9870-4dd2d0900fed tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:05.697048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8a6d7-6ba2-4834-9870-4dd2d0900fed tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:05.697503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8a6d7-6ba2-4834-9870-4dd2d0900fed tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/53b212ca944742edb194af3e83f274fd` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:05.699127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8a6d7-6ba2-4834-9870-4dd2d0900fed tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_role(role_id=53b212ca944742edb194af3e83f274fd)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:05.701646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8a6d7-6ba2-4834-9870-4dd2d0900fed tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:05.854418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d72caca6-a78c-4298-9528-e00ed17e21e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f501e7be812e41ebb05c15f0adfd8ea2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:05.855105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d72caca6-a78c-4298-9528-e00ed17e21e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f501e7be812e41ebb05c15f0adfd8ea2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:05.873742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d72caca6-a78c-4298-9528-e00ed17e21e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f501e7be812e41ebb05c15f0adfd8ea2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:05.892838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d72caca6-a78c-4298-9528-e00ed17e21e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f501e7be812e41ebb05c15f0adfd8ea2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:05.893876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d72caca6-a78c-4298-9528-e00ed17e21e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f501e7be812e41ebb05c15f0adfd8ea2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:05.996451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8ca8a6d7-6ba2-4834-9870-4dd2d0900fed tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invalidating the token cache because role 53b212ca944742edb194af3e83f274fd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:05.997977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8ca8a6d7-6ba2-4834-9870-4dd2d0900fed tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:05.998957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8ca8a6d7-6ba2-4834-9870-4dd2d0900fed tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:06.001998 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2868/5755] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:05 2022] DELETE /identity/v3/roles/53b212ca944742edb194af3e83f274fd => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:06.007234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8a6d7-6ba2-4834-9870-4dd2d0900fed tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:06.009118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8ca8a6d7-6ba2-4834-9870-4dd2d0900fed tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:06.033109 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2888/5756] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:05 2022] DELETE /identity/v3/users/f501e7be812e41ebb05c15f0adfd8ea2 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:06.042278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d24643-968f-4040-adcc-2f0a5914a1f0 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:06.042491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d24643-968f-4040-adcc-2f0a5914a1f0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:06.042771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d24643-968f-4040-adcc-2f0a5914a1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:06.096951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c0d24643-968f-4040-adcc-2f0a5914a1f0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:06.098247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c0d24643-968f-4040-adcc-2f0a5914a1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:06.109911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8a6d7-6ba2-4834-9870-4dd2d0900fed tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:06.199714 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2889/5757] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:06.211783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d24643-968f-4040-adcc-2f0a5914a1f0 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:06.214945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c0d24643-968f-4040-adcc-2f0a5914a1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:06.270360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab9fa4-ee50-45c4-828f-144aecfcbb20 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0987d141a6e249c29e2b5e7ec21bfe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696097cde9dd4148be22c954e0d49231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:06.271193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab9fa4-ee50-45c4-828f-144aecfcbb20 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:06.271500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab9fa4-ee50-45c4-828f-144aecfcbb20 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:06.271797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab9fa4-ee50-45c4-828f-144aecfcbb20 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] PATH_INFO: `/v3/roles/098c6cdac0004ef29753ae850dff7d6b` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:06.273270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab9fa4-ee50-45c4-828f-144aecfcbb20 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorizing `identity:delete_role(role_id=098c6cdac0004ef29753ae850dff7d6b)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:06.276147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab9fa4-ee50-45c4-828f-144aecfcbb20 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:06.383279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d24643-968f-4040-adcc-2f0a5914a1f0 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:06.387710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72a99b-0ea7-4b34-8be1-a53d75c601ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:06.389066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72a99b-0ea7-4b34-8be1-a53d75c601ea service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:06.389352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72a99b-0ea7-4b34-8be1-a53d75c601ea service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:06.389751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72a99b-0ea7-4b34-8be1-a53d75c601ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:06.399778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72a99b-0ea7-4b34-8be1-a53d75c601ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:06.401248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72a99b-0ea7-4b34-8be1-a53d75c601ea service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:06.418259 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2890/5758] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:48:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:48:06.456322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5aab9fa4-ee50-45c4-828f-144aecfcbb20 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invalidating the token cache because role 098c6cdac0004ef29753ae850dff7d6b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:06.456322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5aab9fa4-ee50-45c4-828f-144aecfcbb20 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:06.456322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5aab9fa4-ee50-45c4-828f-144aecfcbb20 tempest-RolesV3TestJSON-64506526 tempest-RolesV3TestJSON-64506526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:06.483505 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2869/5759] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:06 2022] DELETE /identity/v3/roles/098c6cdac0004ef29753ae850dff7d6b => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:48:06.489609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72a99b-0ea7-4b34-8be1-a53d75c601ea service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:06.500025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3b72a99b-0ea7-4b34-8be1-a53d75c601ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:06.520591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72a99b-0ea7-4b34-8be1-a53d75c601ea service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:06.614341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772812c-21a8-4cdc-b0c6-44e144c9ab77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:06.615173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772812c-21a8-4cdc-b0c6-44e144c9ab77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:06.615551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772812c-21a8-4cdc-b0c6-44e144c9ab77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:06.615982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772812c-21a8-4cdc-b0c6-44e144c9ab77 admin admin] PATH_INFO: `/v3/users/5c239e143a0d4a908a4f6330a638f0ee` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:06.617688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772812c-21a8-4cdc-b0c6-44e144c9ab77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c239e143a0d4a908a4f6330a638f0ee)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:06.620965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772812c-21a8-4cdc-b0c6-44e144c9ab77 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:07.046359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2772812c-21a8-4cdc-b0c6-44e144c9ab77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c239e143a0d4a908a4f6330a638f0ee'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:07.048776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2772812c-21a8-4cdc-b0c6-44e144c9ab77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c239e143a0d4a908a4f6330a638f0ee'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:07.071961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2772812c-21a8-4cdc-b0c6-44e144c9ab77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c239e143a0d4a908a4f6330a638f0ee'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:07.106104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2772812c-21a8-4cdc-b0c6-44e144c9ab77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c239e143a0d4a908a4f6330a638f0ee'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:07.107858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2772812c-21a8-4cdc-b0c6-44e144c9ab77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c239e143a0d4a908a4f6330a638f0ee'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:07.249604 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2891/5760] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:06 2022] DELETE /identity/v3/users/5c239e143a0d4a908a4f6330a638f0ee => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:07.254328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d00afc-f2ac-4f77-b2cd-2c2bc6067a55 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:07.255627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d00afc-f2ac-4f77-b2cd-2c2bc6067a55 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:07.256143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d00afc-f2ac-4f77-b2cd-2c2bc6067a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:07.293773 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-11d00afc-f2ac-4f77-b2cd-2c2bc6067a55 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:07.296007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-11d00afc-f2ac-4f77-b2cd-2c2bc6067a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:07.463276 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2870/5761] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:07.502704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772812c-21a8-4cdc-b0c6-44e144c9ab77 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:07.504320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2772812c-21a8-4cdc-b0c6-44e144c9ab77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:07.538408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d00afc-f2ac-4f77-b2cd-2c2bc6067a55 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:07.542610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-11d00afc-f2ac-4f77-b2cd-2c2bc6067a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:07.600324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d00afc-f2ac-4f77-b2cd-2c2bc6067a55 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:07.629034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb82a1e-1ecb-4171-abce-daf891ed41cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:07.631981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb82a1e-1ecb-4171-abce-daf891ed41cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:07.632977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb82a1e-1ecb-4171-abce-daf891ed41cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:07.634327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb82a1e-1ecb-4171-abce-daf891ed41cb admin admin] PATH_INFO: `/v3/projects/91f48eb5f9be49ca85b5028084d5e0ce` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:07.639342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb82a1e-1ecb-4171-abce-daf891ed41cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=91f48eb5f9be49ca85b5028084d5e0ce)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:07.641349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb82a1e-1ecb-4171-abce-daf891ed41cb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:07.697335 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772812c-21a8-4cdc-b0c6-44e144c9ab77 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:07.706955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba20ac0-8e42-4ab6-94c1-89a774a86830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:07.708219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba20ac0-8e42-4ab6-94c1-89a774a86830 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:07.708746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba20ac0-8e42-4ab6-94c1-89a774a86830 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:07.709157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba20ac0-8e42-4ab6-94c1-89a774a86830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:07.724405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba20ac0-8e42-4ab6-94c1-89a774a86830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:07.726535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba20ac0-8e42-4ab6-94c1-89a774a86830 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:07.744833 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2892/5762] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:48:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:48:07.930869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5fb82a1e-1ecb-4171-abce-daf891ed41cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91f48eb5f9be49ca85b5028084d5e0ce', 'request_id': 'req-5fb82a1e-1ecb-4171-abce-daf891ed41cb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:08.030860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:08.073166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5fb82a1e-1ecb-4171-abce-daf891ed41cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91f48eb5f9be49ca85b5028084d5e0ce', 'request_id': 'req-5fb82a1e-1ecb-4171-abce-daf891ed41cb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:08.083524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5fb82a1e-1ecb-4171-abce-daf891ed41cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91f48eb5f9be49ca85b5028084d5e0ce', 'request_id': 'req-5fb82a1e-1ecb-4171-abce-daf891ed41cb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:08.104794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5fb82a1e-1ecb-4171-abce-daf891ed41cb admin admin] The token cache is being invalidate because project 91f48eb5f9be49ca85b5028084d5e0ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:08.105244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5fb82a1e-1ecb-4171-abce-daf891ed41cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:08.110574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5fb82a1e-1ecb-4171-abce-daf891ed41cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:08.112852 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2871/5763] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:48:07 2022] DELETE /identity/v3/projects/91f48eb5f9be49ca85b5028084d5e0ce => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:48:08.119099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10907a08-7cb3-4312-8274-e895ff27d1c5 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:08.119099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10907a08-7cb3-4312-8274-e895ff27d1c5 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:08.119694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10907a08-7cb3-4312-8274-e895ff27d1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:08.172322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-10907a08-7cb3-4312-8274-e895ff27d1c5 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:08.173830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-10907a08-7cb3-4312-8274-e895ff27d1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:08.410079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88074ad-5c99-4369-84b0-dfd682795ebf None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:08.411167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88074ad-5c99-4369-84b0-dfd682795ebf None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:08.411746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88074ad-5c99-4369-84b0-dfd682795ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:08.414901 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2893/5764] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:08.484596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e88074ad-5c99-4369-84b0-dfd682795ebf None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:08.487390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:08.489674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e88074ad-5c99-4369-84b0-dfd682795ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:08.507019 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2872/5765] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:08.511451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10907a08-7cb3-4312-8274-e895ff27d1c5 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:08.535075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10907a08-7cb3-4312-8274-e895ff27d1c5 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:08.546599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f28f7f-f81d-4c4c-8dd0-f950ea237a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:08.546599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f28f7f-f81d-4c4c-8dd0-f950ea237a6c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:08.546599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f28f7f-f81d-4c4c-8dd0-f950ea237a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:08.546599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f28f7f-f81d-4c4c-8dd0-f950ea237a6c admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:08.546909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f28f7f-f81d-4c4c-8dd0-f950ea237a6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:48:08.546909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f28f7f-f81d-4c4c-8dd0-f950ea237a6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:08.549163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f28f7f-f81d-4c4c-8dd0-f950ea237a6c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:08.569733 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2894/5766] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:48:08.570869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88074ad-5c99-4369-84b0-dfd682795ebf None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:08.582751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f28f7f-f81d-4c4c-8dd0-f950ea237a6c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:08.584967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d1f28f7f-f81d-4c4c-8dd0-f950ea237a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:08.585351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88074ad-5c99-4369-84b0-dfd682795ebf None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:08.606217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115eb80-c87c-4475-8645-d2540b50422e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:08.607605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115eb80-c87c-4475-8645-d2540b50422e admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:08.608028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115eb80-c87c-4475-8645-d2540b50422e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:08.608439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115eb80-c87c-4475-8645-d2540b50422e admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:08.609550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115eb80-c87c-4475-8645-d2540b50422e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:08.611791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115eb80-c87c-4475-8645-d2540b50422e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:08.627317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f28f7f-f81d-4c4c-8dd0-f950ea237a6c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:08.632904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c0806-7804-41b5-b81c-650f997bbeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:08.633421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c0806-7804-41b5-b81c-650f997bbeaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:08.641240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c0806-7804-41b5-b81c-650f997bbeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:08.641240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c0806-7804-41b5-b81c-650f997bbeaa admin admin] PATH_INFO: `/v3/projects/bd67144b4af841f689217d6312083849` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:08.648074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c0806-7804-41b5-b81c-650f997bbeaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd67144b4af841f689217d6312083849)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:08.654003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c0806-7804-41b5-b81c-650f997bbeaa admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:08.761502 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2873/5767] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:48:08 2022] POST /identity/v3/projects => generated 393 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:08.766567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115eb80-c87c-4475-8645-d2540b50422e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:08.846675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7f0c0806-7804-41b5-b81c-650f997bbeaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd67144b4af841f689217d6312083849', 'request_id': 'req-7f0c0806-7804-41b5-b81c-650f997bbeaa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:08.864786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7f0c0806-7804-41b5-b81c-650f997bbeaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd67144b4af841f689217d6312083849', 'request_id': 'req-7f0c0806-7804-41b5-b81c-650f997bbeaa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:08.879940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7f0c0806-7804-41b5-b81c-650f997bbeaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd67144b4af841f689217d6312083849', 'request_id': 'req-7f0c0806-7804-41b5-b81c-650f997bbeaa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:08.893964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115eb80-c87c-4475-8645-d2540b50422e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:08.991510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7f0c0806-7804-41b5-b81c-650f997bbeaa admin admin] The token cache is being invalidate because project bd67144b4af841f689217d6312083849 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:08.991823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7f0c0806-7804-41b5-b81c-650f997bbeaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:08.992942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7f0c0806-7804-41b5-b81c-650f997bbeaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:08.999240 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2895/5768] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:48:08 2022] DELETE /identity/v3/projects/bd67144b4af841f689217d6312083849 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:09.004114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c0806-7804-41b5-b81c-650f997bbeaa admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:09.011206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7f0c0806-7804-41b5-b81c-650f997bbeaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:09.035365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3518d7a-845d-41a3-a7ae-b15304acbc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:09.037801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c0806-7804-41b5-b81c-650f997bbeaa admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:09.037965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3518d7a-845d-41a3-a7ae-b15304acbc7d admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:09.038265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3518d7a-845d-41a3-a7ae-b15304acbc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:09.038651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3518d7a-845d-41a3-a7ae-b15304acbc7d admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:09.040285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3518d7a-845d-41a3-a7ae-b15304acbc7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:09.045436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3518d7a-845d-41a3-a7ae-b15304acbc7d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:09.051047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd180d8-a61e-4afd-9430-926ecbb41de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:09.051823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd180d8-a61e-4afd-9430-926ecbb41de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:09.052117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd180d8-a61e-4afd-9430-926ecbb41de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:09.052402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd180d8-a61e-4afd-9430-926ecbb41de3 admin admin] PATH_INFO: `/v3/users/0987d141a6e249c29e2b5e7ec21bfe47` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:09.053748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd180d8-a61e-4afd-9430-926ecbb41de3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0987d141a6e249c29e2b5e7ec21bfe47)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:09.059790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd180d8-a61e-4afd-9430-926ecbb41de3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:09.200395 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2874/5769] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:48:08 2022] POST /identity/v3/users => generated 303 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:09.202023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3518d7a-845d-41a3-a7ae-b15304acbc7d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:09.203283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b3518d7a-845d-41a3-a7ae-b15304acbc7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:09.229020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3518d7a-845d-41a3-a7ae-b15304acbc7d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:09.229020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01b7b9-639a-4cef-aac2-05d9b9bf0512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:09.232918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01b7b9-639a-4cef-aac2-05d9b9bf0512 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:09.233241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01b7b9-639a-4cef-aac2-05d9b9bf0512 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:09.233518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01b7b9-639a-4cef-aac2-05d9b9bf0512 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:09.234279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01b7b9-639a-4cef-aac2-05d9b9bf0512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:09.235913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01b7b9-639a-4cef-aac2-05d9b9bf0512 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:09.248440 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2875/5770] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:48:09.252811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01b7b9-639a-4cef-aac2-05d9b9bf0512 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:09.267206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01b7b9-639a-4cef-aac2-05d9b9bf0512 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:09.278431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86947f1a-33cf-4f22-8bce-9185c787e5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:09.279203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86947f1a-33cf-4f22-8bce-9185c787e5e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:09.279570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86947f1a-33cf-4f22-8bce-9185c787e5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:09.279951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86947f1a-33cf-4f22-8bce-9185c787e5e8 admin admin] PATH_INFO: `/v3/projects/ffdd799e80aa49e4b1cce6b7342e3378/users/976d08d174e942e8854587441bd08e18/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:09.305231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86947f1a-33cf-4f22-8bce-9185c787e5e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffdd799e80aa49e4b1cce6b7342e3378, user_id=976d08d174e942e8854587441bd08e18, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:09.308382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86947f1a-33cf-4f22-8bce-9185c787e5e8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:09.416475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4bd180d8-a61e-4afd-9430-926ecbb41de3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0987d141a6e249c29e2b5e7ec21bfe47'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:09.417485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4bd180d8-a61e-4afd-9430-926ecbb41de3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0987d141a6e249c29e2b5e7ec21bfe47'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:09.427269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4bd180d8-a61e-4afd-9430-926ecbb41de3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0987d141a6e249c29e2b5e7ec21bfe47'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:09.447628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4bd180d8-a61e-4afd-9430-926ecbb41de3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0987d141a6e249c29e2b5e7ec21bfe47'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:09.449232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4bd180d8-a61e-4afd-9430-926ecbb41de3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0987d141a6e249c29e2b5e7ec21bfe47'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:09.455665 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2876/5771] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:09 2022] PUT /identity/v3/projects/ffdd799e80aa49e4b1cce6b7342e3378/users/976d08d174e942e8854587441bd08e18/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:09.459705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86947f1a-33cf-4f22-8bce-9185c787e5e8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:09.461720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-86947f1a-33cf-4f22-8bce-9185c787e5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:09.572993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86947f1a-33cf-4f22-8bce-9185c787e5e8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:09.582855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7949a1a-9a24-4941-b0c0-8e67f726df6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:09.585332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7949a1a-9a24-4941-b0c0-8e67f726df6b admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:09.585620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7949a1a-9a24-4941-b0c0-8e67f726df6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:09.585896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7949a1a-9a24-4941-b0c0-8e67f726df6b admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:09.587402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7949a1a-9a24-4941-b0c0-8e67f726df6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:09.589044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7949a1a-9a24-4941-b0c0-8e67f726df6b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:09.602152 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2877/5772] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:48:09.603447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c2048-d5bc-40e3-bfc4-691ec1aebe0e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:09.603734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c2048-d5bc-40e3-bfc4-691ec1aebe0e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:09.604013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c2048-d5bc-40e3-bfc4-691ec1aebe0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:09.625202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e84c2048-d5bc-40e3-bfc4-691ec1aebe0e None None] MFA Rules not processed for user `ca2da57f02884a968d685b53a5399e46`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:09.626387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e84c2048-d5bc-40e3-bfc4-691ec1aebe0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:09.715053 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2878/5773] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:09.716960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c2048-d5bc-40e3-bfc4-691ec1aebe0e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:09.744932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c2048-d5bc-40e3-bfc4-691ec1aebe0e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:09.760395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05b2bb-d2da-492a-b832-a854967f2620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:09.770404 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05b2bb-d2da-492a-b832-a854967f2620 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:09.770932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05b2bb-d2da-492a-b832-a854967f2620 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:09.771365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05b2bb-d2da-492a-b832-a854967f2620 admin admin] PATH_INFO: `/v3/projects/ffdd799e80aa49e4b1cce6b7342e3378/users/976d08d174e942e8854587441bd08e18/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:09.779331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05b2bb-d2da-492a-b832-a854967f2620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffdd799e80aa49e4b1cce6b7342e3378, user_id=976d08d174e942e8854587441bd08e18, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:09.785600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05b2bb-d2da-492a-b832-a854967f2620 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:09.800315 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2896/5774] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:09 2022] DELETE /identity/v3/users/0987d141a6e249c29e2b5e7ec21bfe47 => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:09.844462 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2879/5775] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:09 2022] PUT /identity/v3/projects/ffdd799e80aa49e4b1cce6b7342e3378/users/976d08d174e942e8854587441bd08e18/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:09.937476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5d9f2-8df0-4e91-a06b-73cb39f54aea None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:09.937476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5d9f2-8df0-4e91-a06b-73cb39f54aea None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:09.937476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5d9f2-8df0-4e91-a06b-73cb39f54aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:10.001866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8aa5d9f2-8df0-4e91-a06b-73cb39f54aea None None] MFA Rules not processed for user `976d08d174e942e8854587441bd08e18`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:10.003993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8aa5d9f2-8df0-4e91-a06b-73cb39f54aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:10.136880 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2897/5776] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:09 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:10.143366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05b2bb-d2da-492a-b832-a854967f2620 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:10.314724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05b2bb-d2da-492a-b832-a854967f2620 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:10.332135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52bbbd-144a-41be-833d-cdd17cde274b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:10.332781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52bbbd-144a-41be-833d-cdd17cde274b admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:10.333070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52bbbd-144a-41be-833d-cdd17cde274b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:10.333347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52bbbd-144a-41be-833d-cdd17cde274b admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:10.333996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52bbbd-144a-41be-833d-cdd17cde274b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:10.336430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52bbbd-144a-41be-833d-cdd17cde274b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:10.518488 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2880/5777] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:48:10 2022] POST /identity/v3/projects => generated 393 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:10.522623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5d9f2-8df0-4e91-a06b-73cb39f54aea None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:10.537932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5d9f2-8df0-4e91-a06b-73cb39f54aea None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:10.657564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748f9ac-24f2-42e1-bf5e-98446518cdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:10.658786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748f9ac-24f2-42e1-bf5e-98446518cdd7 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:10.664924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748f9ac-24f2-42e1-bf5e-98446518cdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:10.664924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748f9ac-24f2-42e1-bf5e-98446518cdd7 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:10.664924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748f9ac-24f2-42e1-bf5e-98446518cdd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:10.664924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748f9ac-24f2-42e1-bf5e-98446518cdd7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:10.830081 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2898/5778] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:48:10 2022] POST /identity/v3/users => generated 297 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:10.834138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52bbbd-144a-41be-833d-cdd17cde274b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:10.852172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52bbbd-144a-41be-833d-cdd17cde274b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:10.858178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33bf42-679b-4e39-b5dc-1cf36b2e7d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:10.858856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33bf42-679b-4e39-b5dc-1cf36b2e7d5d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:10.859141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33bf42-679b-4e39-b5dc-1cf36b2e7d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:10.859420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33bf42-679b-4e39-b5dc-1cf36b2e7d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:10.860137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33bf42-679b-4e39-b5dc-1cf36b2e7d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:10.861838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33bf42-679b-4e39-b5dc-1cf36b2e7d5d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:10.876610 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2881/5779] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:48:10.877945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:10.885976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748f9ac-24f2-42e1-bf5e-98446518cdd7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:10.899519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748f9ac-24f2-42e1-bf5e-98446518cdd7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:10.904855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6bf3c-ef91-4675-9f82-ead960386c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:10.911748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6bf3c-ef91-4675-9f82-ead960386c69 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:10.911748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6bf3c-ef91-4675-9f82-ead960386c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:10.911748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6bf3c-ef91-4675-9f82-ead960386c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:10.911748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6bf3c-ef91-4675-9f82-ead960386c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:10.911748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6bf3c-ef91-4675-9f82-ead960386c69 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:10.923139 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2899/5780] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:10.927511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33bf42-679b-4e39-b5dc-1cf36b2e7d5d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:10.940133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33bf42-679b-4e39-b5dc-1cf36b2e7d5d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:10.945968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297a90e-3d71-4170-9fd7-74ff3af8a411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:10.946690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297a90e-3d71-4170-9fd7-74ff3af8a411 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:10.946974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297a90e-3d71-4170-9fd7-74ff3af8a411 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:10.947247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297a90e-3d71-4170-9fd7-74ff3af8a411 admin admin] PATH_INFO: `/v3/projects/f1bb926358124cbaa9c378848544b8e9/users/707b5089e56c4366869c4b59776c03e4/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:10.963740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297a90e-3d71-4170-9fd7-74ff3af8a411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1bb926358124cbaa9c378848544b8e9, user_id=707b5089e56c4366869c4b59776c03e4, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:10.967309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297a90e-3d71-4170-9fd7-74ff3af8a411 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:11.091909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6bf3c-ef91-4675-9f82-ead960386c69 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:11.093939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0fb6bf3c-ef91-4675-9f82-ead960386c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:11.123038 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2882/5781] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:10 2022] PUT /identity/v3/projects/f1bb926358124cbaa9c378848544b8e9/users/707b5089e56c4366869c4b59776c03e4/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:48:11.123587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6bf3c-ef91-4675-9f82-ead960386c69 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:11.138556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c3b28-0a92-4d67-9d23-393646e2d877 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:11.138556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c3b28-0a92-4d67-9d23-393646e2d877 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:11.138556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c3b28-0a92-4d67-9d23-393646e2d877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:11.223473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-834c3b28-0a92-4d67-9d23-393646e2d877 None None] MFA Rules not processed for user `707b5089e56c4366869c4b59776c03e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:11.224844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-834c3b28-0a92-4d67-9d23-393646e2d877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:11.288828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5511b60-4a17-4d1f-b39d-95f5daaced46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:11.292072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5511b60-4a17-4d1f-b39d-95f5daaced46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:11.292072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5511b60-4a17-4d1f-b39d-95f5daaced46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:11.292072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5511b60-4a17-4d1f-b39d-95f5daaced46 admin admin] PATH_INFO: `/v3/projects/696097cde9dd4148be22c954e0d49231` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:11.297775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5511b60-4a17-4d1f-b39d-95f5daaced46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=696097cde9dd4148be22c954e0d49231)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:11.300069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5511b60-4a17-4d1f-b39d-95f5daaced46 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:11.386824 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2883/5782] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:48:11.400762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c3b28-0a92-4d67-9d23-393646e2d877 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:11.402528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-834c3b28-0a92-4d67-9d23-393646e2d877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:11.525637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e5511b60-4a17-4d1f-b39d-95f5daaced46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '696097cde9dd4148be22c954e0d49231', 'request_id': 'req-e5511b60-4a17-4d1f-b39d-95f5daaced46'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:11.534755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c3b28-0a92-4d67-9d23-393646e2d877 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:11.582882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e5511b60-4a17-4d1f-b39d-95f5daaced46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '696097cde9dd4148be22c954e0d49231', 'request_id': 'req-e5511b60-4a17-4d1f-b39d-95f5daaced46'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:11.604068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e5511b60-4a17-4d1f-b39d-95f5daaced46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '696097cde9dd4148be22c954e0d49231', 'request_id': 'req-e5511b60-4a17-4d1f-b39d-95f5daaced46'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:11.693361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b68a4-1a9e-4a04-a080-e5e4fee41720 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:11.693361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b68a4-1a9e-4a04-a080-e5e4fee41720 service glance] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:11.693361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b68a4-1a9e-4a04-a080-e5e4fee41720 service glance] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:11.694003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b68a4-1a9e-4a04-a080-e5e4fee41720 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:11.742136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e5511b60-4a17-4d1f-b39d-95f5daaced46 admin admin] The token cache is being invalidate because project 696097cde9dd4148be22c954e0d49231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:11.742136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e5511b60-4a17-4d1f-b39d-95f5daaced46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:11.742826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e5511b60-4a17-4d1f-b39d-95f5daaced46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:11.744336 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2900/5783] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:48:11 2022] DELETE /identity/v3/projects/696097cde9dd4148be22c954e0d49231 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:48:11.749952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63698c8-f58f-4240-bfef-7f8c5e941d42 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:11.750424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63698c8-f58f-4240-bfef-7f8c5e941d42 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:11.750873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63698c8-f58f-4240-bfef-7f8c5e941d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:11.785209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b63698c8-f58f-4240-bfef-7f8c5e941d42 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:11.786750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b63698c8-f58f-4240-bfef-7f8c5e941d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:11.815289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b68a4-1a9e-4a04-a080-e5e4fee41720 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:11.816759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b68a4-1a9e-4a04-a080-e5e4fee41720 service glance] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:11.828989 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2884/5784] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:48:11 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:48:11.867034 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2901/5785] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:48:11.874853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc895be-1576-4a67-89f6-87fc604bd98a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:11.875143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc895be-1576-4a67-89f6-87fc604bd98a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:11.875420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc895be-1576-4a67-89f6-87fc604bd98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:11.917173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-abc895be-1576-4a67-89f6-87fc604bd98a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:11.919179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-abc895be-1576-4a67-89f6-87fc604bd98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:11.936486 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2885/5786] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:11.941444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63698c8-f58f-4240-bfef-7f8c5e941d42 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:11.953510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63698c8-f58f-4240-bfef-7f8c5e941d42 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:11.958498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833f2b3-1576-4bc8-bf6b-4f7baffba18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:11.959108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833f2b3-1576-4bc8-bf6b-4f7baffba18a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:11.959389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833f2b3-1576-4bc8-bf6b-4f7baffba18a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:11.959673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833f2b3-1576-4bc8-bf6b-4f7baffba18a admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:11.960370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833f2b3-1576-4bc8-bf6b-4f7baffba18a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:48:11.960675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833f2b3-1576-4bc8-bf6b-4f7baffba18a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:11.962289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833f2b3-1576-4bc8-bf6b-4f7baffba18a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:11.973945 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2902/5787] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:48:11.978239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc895be-1576-4a67-89f6-87fc604bd98a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:11.988161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc895be-1576-4a67-89f6-87fc604bd98a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:11.993348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e77be-aad5-4ecf-b34a-98245762f7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:11.994050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e77be-aad5-4ecf-b34a-98245762f7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:11.994287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e77be-aad5-4ecf-b34a-98245762f7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:11.994565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e77be-aad5-4ecf-b34a-98245762f7b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:11.995308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e77be-aad5-4ecf-b34a-98245762f7b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:12.000819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e77be-aad5-4ecf-b34a-98245762f7b1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:12.170208 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2886/5788] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:48:11 2022] POST /identity/v3/projects => generated 367 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:12.172095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833f2b3-1576-4bc8-bf6b-4f7baffba18a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:12.204255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833f2b3-1576-4bc8-bf6b-4f7baffba18a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:12.304483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d198ef-bd8d-431e-82f1-907b116d6267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:12.305197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d198ef-bd8d-431e-82f1-907b116d6267 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:12.305561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d198ef-bd8d-431e-82f1-907b116d6267 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:12.305846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d198ef-bd8d-431e-82f1-907b116d6267 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:12.306733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d198ef-bd8d-431e-82f1-907b116d6267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:12.309024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d198ef-bd8d-431e-82f1-907b116d6267 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:12.446285 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2903/5789] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:48:12 2022] POST /identity/v3/users => generated 284 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:12.446959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e77be-aad5-4ecf-b34a-98245762f7b1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:12.460035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e77be-aad5-4ecf-b34a-98245762f7b1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:12.465482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fce561-83b0-423d-9d0c-aed84b6dc0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:12.467530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fce561-83b0-423d-9d0c-aed84b6dc0af admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:12.467530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fce561-83b0-423d-9d0c-aed84b6dc0af admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:12.467530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fce561-83b0-423d-9d0c-aed84b6dc0af admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:12.467530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fce561-83b0-423d-9d0c-aed84b6dc0af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:12.469048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fce561-83b0-423d-9d0c-aed84b6dc0af admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:12.485813 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2887/5790] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:12.490086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d198ef-bd8d-431e-82f1-907b116d6267 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:12.501731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d198ef-bd8d-431e-82f1-907b116d6267 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:12.506418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cc904-0165-4eee-bf08-cfc1148f02d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:12.507019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cc904-0165-4eee-bf08-cfc1148f02d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:12.507300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cc904-0165-4eee-bf08-cfc1148f02d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:12.507610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cc904-0165-4eee-bf08-cfc1148f02d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:12.508280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cc904-0165-4eee-bf08-cfc1148f02d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:12.509873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cc904-0165-4eee-bf08-cfc1148f02d2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:12.536117 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2904/5791] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:12.541254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fce561-83b0-423d-9d0c-aed84b6dc0af admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:12.558351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fce561-83b0-423d-9d0c-aed84b6dc0af admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:12.571478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:12.578970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c5435-599f-4697-b24f-d375e2fbb9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:12.580164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c5435-599f-4697-b24f-d375e2fbb9b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:12.580692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c5435-599f-4697-b24f-d375e2fbb9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:12.581150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c5435-599f-4697-b24f-d375e2fbb9b6 admin admin] PATH_INFO: `/v3/projects/85f8bb3f5ec14274b796c838792c8116/users/43044bc84a5a49908ac69ee4ac8bfb3d/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:12.610355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c5435-599f-4697-b24f-d375e2fbb9b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f8bb3f5ec14274b796c838792c8116, user_id=43044bc84a5a49908ac69ee4ac8bfb3d, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:12.619803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c5435-599f-4697-b24f-d375e2fbb9b6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:12.747837 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2888/5792] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:12 2022] PUT /identity/v3/projects/85f8bb3f5ec14274b796c838792c8116/users/43044bc84a5a49908ac69ee4ac8bfb3d/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:12.759855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfd4cf-1d79-42e8-b797-6f7a64ec2868 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:12.760392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfd4cf-1d79-42e8-b797-6f7a64ec2868 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:12.761003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfd4cf-1d79-42e8-b797-6f7a64ec2868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:12.826830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8ecfd4cf-1d79-42e8-b797-6f7a64ec2868 None None] MFA Rules not processed for user `43044bc84a5a49908ac69ee4ac8bfb3d`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:12.828188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8ecfd4cf-1d79-42e8-b797-6f7a64ec2868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:12.911866 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2905/5793] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:12.916456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c5435-599f-4697-b24f-d375e2fbb9b6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:13.004373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c5435-599f-4697-b24f-d375e2fbb9b6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:13.009204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981ab73-6c83-459d-8799-59da6e994118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:13.009878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981ab73-6c83-459d-8799-59da6e994118 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:13.010206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981ab73-6c83-459d-8799-59da6e994118 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:13.010515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981ab73-6c83-459d-8799-59da6e994118 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:13.011181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981ab73-6c83-459d-8799-59da6e994118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:13.013798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981ab73-6c83-459d-8799-59da6e994118 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:13.183102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfd4cf-1d79-42e8-b797-6f7a64ec2868 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:13.186395 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2889/5794] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:48:12 2022] POST /identity/v3/projects => generated 369 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:13.212726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfd4cf-1d79-42e8-b797-6f7a64ec2868 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:13.363874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca301ef-497c-49b2-8977-842a76c243cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:13.364520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca301ef-497c-49b2-8977-842a76c243cf admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:13.364810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca301ef-497c-49b2-8977-842a76c243cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:13.365094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca301ef-497c-49b2-8977-842a76c243cf admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:13.365743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca301ef-497c-49b2-8977-842a76c243cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:13.371209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca301ef-497c-49b2-8977-842a76c243cf admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:13.492553 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2906/5795] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:48:13 2022] POST /identity/v3/users => generated 291 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:13.496544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981ab73-6c83-459d-8799-59da6e994118 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:13.512660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981ab73-6c83-459d-8799-59da6e994118 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:13.531914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f9082-8149-4d1f-8371-393298627c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:13.532831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f9082-8149-4d1f-8371-393298627c7f admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:13.533887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f9082-8149-4d1f-8371-393298627c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:13.533887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f9082-8149-4d1f-8371-393298627c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:13.534801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f9082-8149-4d1f-8371-393298627c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:13.536918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f9082-8149-4d1f-8371-393298627c7f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:13.550063 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2890/5796] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:13.554417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca301ef-497c-49b2-8977-842a76c243cf admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:13.566692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca301ef-497c-49b2-8977-842a76c243cf admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:13.571896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570b96e-d395-46b4-8746-6e56e52dbf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:13.572688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570b96e-d395-46b4-8746-6e56e52dbf71 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:13.573040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570b96e-d395-46b4-8746-6e56e52dbf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:13.573530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570b96e-d395-46b4-8746-6e56e52dbf71 admin admin] PATH_INFO: `/v3/projects/49c362f5d7ee4caab801a4d50e69dfc2/users/04b15b545dd1482abd1bd125dd1921e2/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:13.603487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570b96e-d395-46b4-8746-6e56e52dbf71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49c362f5d7ee4caab801a4d50e69dfc2, user_id=04b15b545dd1482abd1bd125dd1921e2, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:13.617480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570b96e-d395-46b4-8746-6e56e52dbf71 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:13.750311 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2907/5797] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:13 2022] PUT /identity/v3/projects/49c362f5d7ee4caab801a4d50e69dfc2/users/04b15b545dd1482abd1bd125dd1921e2/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:13.755651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f9082-8149-4d1f-8371-393298627c7f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:13.771229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f9082-8149-4d1f-8371-393298627c7f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:13.977359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d2ce9-59fa-4ef4-ac6d-848311b50317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:13.978081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d2ce9-59fa-4ef4-ac6d-848311b50317 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:13.978368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d2ce9-59fa-4ef4-ac6d-848311b50317 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:13.978650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d2ce9-59fa-4ef4-ac6d-848311b50317 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:13.979303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d2ce9-59fa-4ef4-ac6d-848311b50317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:13.982416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d2ce9-59fa-4ef4-ac6d-848311b50317 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:14.035203 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2891/5798] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:14.041299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570b96e-d395-46b4-8746-6e56e52dbf71 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:14.061812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570b96e-d395-46b4-8746-6e56e52dbf71 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:14.072992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b58d79-80d3-4b65-89b5-91033e7b48b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:14.074476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b58d79-80d3-4b65-89b5-91033e7b48b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:14.074893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b58d79-80d3-4b65-89b5-91033e7b48b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:14.075819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b58d79-80d3-4b65-89b5-91033e7b48b0 admin admin] PATH_INFO: `/v3/projects/49c362f5d7ee4caab801a4d50e69dfc2/users/04b15b545dd1482abd1bd125dd1921e2/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:14.081320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b58d79-80d3-4b65-89b5-91033e7b48b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49c362f5d7ee4caab801a4d50e69dfc2, user_id=04b15b545dd1482abd1bd125dd1921e2, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:14.103981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b58d79-80d3-4b65-89b5-91033e7b48b0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:14.143204 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2908/5799] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:14 2022] PUT /identity/v3/projects/49c362f5d7ee4caab801a4d50e69dfc2/users/04b15b545dd1482abd1bd125dd1921e2/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:14.159996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec56d2-e262-4989-9a13-02a1c677b43e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:14.160642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec56d2-e262-4989-9a13-02a1c677b43e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:14.161168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec56d2-e262-4989-9a13-02a1c677b43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:14.259327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e4ec56d2-e262-4989-9a13-02a1c677b43e None None] MFA Rules not processed for user `04b15b545dd1482abd1bd125dd1921e2`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:14.263803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e4ec56d2-e262-4989-9a13-02a1c677b43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:14.273224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:INSERT=5,keystone:DELETE=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:14.508744 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2892/5800] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:14.512296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b58d79-80d3-4b65-89b5-91033e7b48b0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:14.672182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b58d79-80d3-4b65-89b5-91033e7b48b0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:14.682137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71330546-9b7b-4b36-be04-ae3357214b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:14.683700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71330546-9b7b-4b36-be04-ae3357214b2b admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:14.685441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71330546-9b7b-4b36-be04-ae3357214b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:14.685902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71330546-9b7b-4b36-be04-ae3357214b2b admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:14.701425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71330546-9b7b-4b36-be04-ae3357214b2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:14.709457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71330546-9b7b-4b36-be04-ae3357214b2b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:14.721506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec56d2-e262-4989-9a13-02a1c677b43e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:14.723751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e4ec56d2-e262-4989-9a13-02a1c677b43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:14.772839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec56d2-e262-4989-9a13-02a1c677b43e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:14.786024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8299c-ca50-4f37-aaa6-689c98eb853c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:14.788317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8299c-ca50-4f37-aaa6-689c98eb853c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:14.788818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8299c-ca50-4f37-aaa6-689c98eb853c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:14.789263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8299c-ca50-4f37-aaa6-689c98eb853c admin admin] PATH_INFO: `/v3/users/976d08d174e942e8854587441bd08e18` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:14.793054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8299c-ca50-4f37-aaa6-689c98eb853c admin admin] RBAC: Authorizing `identity:delete_user(user_id=976d08d174e942e8854587441bd08e18)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:14.799798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8299c-ca50-4f37-aaa6-689c98eb853c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:14.879946 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2909/5801] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:48:14 2022] POST /identity/v3/projects => generated 367 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:14.900231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71330546-9b7b-4b36-be04-ae3357214b2b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:15.060926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71330546-9b7b-4b36-be04-ae3357214b2b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:15.078930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b8e04-f498-41ed-b7e3-91136e588563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:15.079591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b8e04-f498-41ed-b7e3-91136e588563 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:15.079880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b8e04-f498-41ed-b7e3-91136e588563 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:15.080155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b8e04-f498-41ed-b7e3-91136e588563 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:15.080966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b8e04-f498-41ed-b7e3-91136e588563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:15.083144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b8e04-f498-41ed-b7e3-91136e588563 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:15.120821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c4c8299c-ca50-4f37-aaa6-689c98eb853c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '976d08d174e942e8854587441bd08e18'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:15.121883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c4c8299c-ca50-4f37-aaa6-689c98eb853c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '976d08d174e942e8854587441bd08e18'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:15.136519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c4c8299c-ca50-4f37-aaa6-689c98eb853c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '976d08d174e942e8854587441bd08e18'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:15.207189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c4c8299c-ca50-4f37-aaa6-689c98eb853c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '976d08d174e942e8854587441bd08e18'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:15.306534 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2910/5802] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:48:14 2022] POST /identity/v3/users => generated 284 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:15.324403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b8e04-f498-41ed-b7e3-91136e588563 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:15.330628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9a0b8e04-f498-41ed-b7e3-91136e588563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:15.339036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c4c8299c-ca50-4f37-aaa6-689c98eb853c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '976d08d174e942e8854587441bd08e18'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:15.374509 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2893/5803] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:14 2022] DELETE /identity/v3/users/976d08d174e942e8854587441bd08e18 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:15.379808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c08f2-188b-4847-b656-1571d5ae0bb6 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:15.380100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c08f2-188b-4847-b656-1571d5ae0bb6 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:15.380380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c08f2-188b-4847-b656-1571d5ae0bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:15.384355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:15.461684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b8e04-f498-41ed-b7e3-91136e588563 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:15.486406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b44c08f2-188b-4847-b656-1571d5ae0bb6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:15.487750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b44c08f2-188b-4847-b656-1571d5ae0bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:15.597062 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2894/5804] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:15.602707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f62cd-d97e-4084-bd73-f480316801eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:15.603588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f62cd-d97e-4084-bd73-f480316801eb admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:15.604190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f62cd-d97e-4084-bd73-f480316801eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:15.604607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f62cd-d97e-4084-bd73-f480316801eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:15.606445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f62cd-d97e-4084-bd73-f480316801eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:15.609973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f62cd-d97e-4084-bd73-f480316801eb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:15.620315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c08f2-188b-4847-b656-1571d5ae0bb6 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:15.621697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b44c08f2-188b-4847-b656-1571d5ae0bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:15.644250 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2911/5805] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:15.645249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f62cd-d97e-4084-bd73-f480316801eb admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:15.668332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f62cd-d97e-4084-bd73-f480316801eb admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:15.682527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390aba2-bf23-4682-a456-1e4574b20fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:15.683180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390aba2-bf23-4682-a456-1e4574b20fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:15.683535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390aba2-bf23-4682-a456-1e4574b20fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:15.683816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390aba2-bf23-4682-a456-1e4574b20fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:15.685158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390aba2-bf23-4682-a456-1e4574b20fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:15.686821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390aba2-bf23-4682-a456-1e4574b20fd2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:15.724301 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2912/5806] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:15.729648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390aba2-bf23-4682-a456-1e4574b20fd2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:15.742764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390aba2-bf23-4682-a456-1e4574b20fd2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:15.748053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0ee74-699b-4634-91ea-2ef4a13fd511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:15.749170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0ee74-699b-4634-91ea-2ef4a13fd511 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:15.749601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0ee74-699b-4634-91ea-2ef4a13fd511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:15.751734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0ee74-699b-4634-91ea-2ef4a13fd511 admin admin] PATH_INFO: `/v3/projects/013d62557ab4436d894fc22ad2635d1d/users/4e215dbd38594c5c988704471b03ec34/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:15.770009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0ee74-699b-4634-91ea-2ef4a13fd511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=013d62557ab4436d894fc22ad2635d1d, user_id=4e215dbd38594c5c988704471b03ec34, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:15.772933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0ee74-699b-4634-91ea-2ef4a13fd511 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:15.815057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c08f2-188b-4847-b656-1571d5ae0bb6 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:15.823752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3e5c2-4f90-4700-a845-e11072638e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:15.824372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3e5c2-4f90-4700-a845-e11072638e4d service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:15.824924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3e5c2-4f90-4700-a845-e11072638e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:15.825771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3e5c2-4f90-4700-a845-e11072638e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:15.848226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3e5c2-4f90-4700-a845-e11072638e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:15.849735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3e5c2-4f90-4700-a845-e11072638e4d service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:15.868518 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2913/5807] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:15 2022] PUT /identity/v3/projects/013d62557ab4436d894fc22ad2635d1d/users/4e215dbd38594c5c988704471b03ec34/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:15.879470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ad5bc-da6a-4776-ba9a-35263b72ed9b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:15.879994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ad5bc-da6a-4776-ba9a-35263b72ed9b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:15.880111 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2895/5808] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:48:15.880525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ad5bc-da6a-4776-ba9a-35263b72ed9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:15.956582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-cf8ad5bc-da6a-4776-ba9a-35263b72ed9b None None] MFA Rules not processed for user `4e215dbd38594c5c988704471b03ec34`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:15.957824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cf8ad5bc-da6a-4776-ba9a-35263b72ed9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:16.139690 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2914/5809] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:48:16.144762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3e5c2-4f90-4700-a845-e11072638e4d service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:16.146363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fba3e5c2-4f90-4700-a845-e11072638e4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:16.257715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3e5c2-4f90-4700-a845-e11072638e4d service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:16.338329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5298647-375c-4e64-9206-2f3ddba755ec tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:16.339399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5298647-375c-4e64-9206-2f3ddba755ec tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:16.339923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5298647-375c-4e64-9206-2f3ddba755ec tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:16.340409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5298647-375c-4e64-9206-2f3ddba755ec tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:16.341954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5298647-375c-4e64-9206-2f3ddba755ec tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:16.344401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5298647-375c-4e64-9206-2f3ddba755ec tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:16.437835 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2896/5810] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:48:16 2022] POST /identity/v3/domains => generated 276 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:16.441812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ad5bc-da6a-4776-ba9a-35263b72ed9b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:16.461319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ad5bc-da6a-4776-ba9a-35263b72ed9b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:16.610339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c95ef-f97f-47dd-80cb-7cef5cf7f1da tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:16.611232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c95ef-f97f-47dd-80cb-7cef5cf7f1da tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:16.611666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c95ef-f97f-47dd-80cb-7cef5cf7f1da tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:16.612092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c95ef-f97f-47dd-80cb-7cef5cf7f1da tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:16.616237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c95ef-f97f-47dd-80cb-7cef5cf7f1da tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:16.617047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c95ef-f97f-47dd-80cb-7cef5cf7f1da tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:16.738893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5298647-375c-4e64-9206-2f3ddba755ec tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:16.739965 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2915/5811] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:48:16 2022] POST /identity/v3/roles => generated 239 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:16.763543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5298647-375c-4e64-9206-2f3ddba755ec tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:16.771072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa39dda-2436-4c68-984f-d3794c5a3d6e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:16.772029 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa39dda-2436-4c68-984f-d3794c5a3d6e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:16.782342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa39dda-2436-4c68-984f-d3794c5a3d6e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:16.782882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa39dda-2436-4c68-984f-d3794c5a3d6e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/domains/305d786ab16e4a5bac505da4545b8a7d/users/4e215dbd38594c5c988704471b03ec34/roles/cfce367afe894e54ad8bd775074af9c0` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:16.812956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa39dda-2436-4c68-984f-d3794c5a3d6e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=305d786ab16e4a5bac505da4545b8a7d, user_id=4e215dbd38594c5c988704471b03ec34, role_id=cfce367afe894e54ad8bd775074af9c0)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:16.817307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa39dda-2436-4c68-984f-d3794c5a3d6e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:16.973404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c95ef-f97f-47dd-80cb-7cef5cf7f1da tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:16.976291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-383c95ef-f97f-47dd-80cb-7cef5cf7f1da tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:16.986539 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2897/5812] 10.222.0.20 () {60 vars in 1480 bytes} [Thu Oct 27 03:48:16 2022] PUT /identity/v3/domains/305d786ab16e4a5bac505da4545b8a7d/users/4e215dbd38594c5c988704471b03ec34/roles/cfce367afe894e54ad8bd775074af9c0 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:48:16.991061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa39dda-2436-4c68-984f-d3794c5a3d6e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:17.110564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa39dda-2436-4c68-984f-d3794c5a3d6e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:17.118374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907556fe-644d-478d-9f4c-8a49b4d3f00b tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:17.119570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907556fe-644d-478d-9f4c-8a49b4d3f00b tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:17.120065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907556fe-644d-478d-9f4c-8a49b4d3f00b tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:17.120267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c95ef-f97f-47dd-80cb-7cef5cf7f1da tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:17.120740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907556fe-644d-478d-9f4c-8a49b4d3f00b tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:17.121813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907556fe-644d-478d-9f4c-8a49b4d3f00b tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:17.126063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907556fe-644d-478d-9f4c-8a49b4d3f00b tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:17.194495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0448f6-3852-44ce-97e5-84731dd0fba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:17.197327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0448f6-3852-44ce-97e5-84731dd0fba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:17.197776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0448f6-3852-44ce-97e5-84731dd0fba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:17.198189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0448f6-3852-44ce-97e5-84731dd0fba9 admin admin] PATH_INFO: `/v3/projects/ffdd799e80aa49e4b1cce6b7342e3378` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:17.200660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0448f6-3852-44ce-97e5-84731dd0fba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffdd799e80aa49e4b1cce6b7342e3378)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:17.203153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0448f6-3852-44ce-97e5-84731dd0fba9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:17.212482 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2898/5813] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:48:16 2022] POST /identity/v3/domains => generated 275 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:17.213725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907556fe-644d-478d-9f4c-8a49b4d3f00b tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:17.292976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907556fe-644d-478d-9f4c-8a49b4d3f00b tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:17.300452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bb1d0-2ddb-48a0-bc0d-a3638c6abaeb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:17.301409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bb1d0-2ddb-48a0-bc0d-a3638c6abaeb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:17.301901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bb1d0-2ddb-48a0-bc0d-a3638c6abaeb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:17.302560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bb1d0-2ddb-48a0-bc0d-a3638c6abaeb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:17.303548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bb1d0-2ddb-48a0-bc0d-a3638c6abaeb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:17.306236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bb1d0-2ddb-48a0-bc0d-a3638c6abaeb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:17.332887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5b0448f6-3852-44ce-97e5-84731dd0fba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffdd799e80aa49e4b1cce6b7342e3378', 'request_id': 'req-5b0448f6-3852-44ce-97e5-84731dd0fba9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:17.342469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5b0448f6-3852-44ce-97e5-84731dd0fba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffdd799e80aa49e4b1cce6b7342e3378', 'request_id': 'req-5b0448f6-3852-44ce-97e5-84731dd0fba9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:17.349758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5b0448f6-3852-44ce-97e5-84731dd0fba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffdd799e80aa49e4b1cce6b7342e3378', 'request_id': 'req-5b0448f6-3852-44ce-97e5-84731dd0fba9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:17.393882 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2899/5814] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:48:17 2022] POST /identity/v3/roles => generated 240 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:17.398199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bb1d0-2ddb-48a0-bc0d-a3638c6abaeb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:17.409559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bb1d0-2ddb-48a0-bc0d-a3638c6abaeb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:17.427025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5b0448f6-3852-44ce-97e5-84731dd0fba9 admin admin] The token cache is being invalidate because project ffdd799e80aa49e4b1cce6b7342e3378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:17.427643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5b0448f6-3852-44ce-97e5-84731dd0fba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:17.428898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5b0448f6-3852-44ce-97e5-84731dd0fba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:17.431389 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2916/5815] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:48:16 2022] DELETE /identity/v3/projects/ffdd799e80aa49e4b1cce6b7342e3378 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:17.436224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0448f6-3852-44ce-97e5-84731dd0fba9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:17.438355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5b0448f6-3852-44ce-97e5-84731dd0fba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:17.515278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78032bfa-fdc2-4c26-8826-2396fd568bd0 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:17.515886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78032bfa-fdc2-4c26-8826-2396fd568bd0 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:17.516836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78032bfa-fdc2-4c26-8826-2396fd568bd0 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:17.517122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78032bfa-fdc2-4c26-8826-2396fd568bd0 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/groups` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:17.517763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78032bfa-fdc2-4c26-8826-2396fd568bd0 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:17.519713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78032bfa-fdc2-4c26-8826-2396fd568bd0 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:17.538838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0448f6-3852-44ce-97e5-84731dd0fba9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:17.545382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bb8b5-6cc3-4b9f-99db-434a41040c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:17.546055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bb8b5-6cc3-4b9f-99db-434a41040c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:17.546384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bb8b5-6cc3-4b9f-99db-434a41040c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:17.546668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bb8b5-6cc3-4b9f-99db-434a41040c59 admin admin] PATH_INFO: `/v3/users/707b5089e56c4366869c4b59776c03e4` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:17.547883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bb8b5-6cc3-4b9f-99db-434a41040c59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=707b5089e56c4366869c4b59776c03e4)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:17.549819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bb8b5-6cc3-4b9f-99db-434a41040c59 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:17.629478 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2900/5816] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:48:17 2022] POST /identity/v3/groups => generated 325 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:48:17.634382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78032bfa-fdc2-4c26-8826-2396fd568bd0 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:17.639713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-78032bfa-fdc2-4c26-8826-2396fd568bd0 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:17.661691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78032bfa-fdc2-4c26-8826-2396fd568bd0 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:17.667607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7919eb-fb1a-468a-bd8c-a3f05049f40b tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:17.668283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7919eb-fb1a-468a-bd8c-a3f05049f40b tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:17.668580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7919eb-fb1a-468a-bd8c-a3f05049f40b tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:17.669664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7919eb-fb1a-468a-bd8c-a3f05049f40b tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/groups/fad53b7711ad463a86096509d5fbd048/users/4e215dbd38594c5c988704471b03ec34` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:17.678646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7919eb-fb1a-468a-bd8c-a3f05049f40b tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=fad53b7711ad463a86096509d5fbd048, user_id=4e215dbd38594c5c988704471b03ec34)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:17.682633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7919eb-fb1a-468a-bd8c-a3f05049f40b tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:17.745567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a91bb8b5-6cc3-4b9f-99db-434a41040c59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '707b5089e56c4366869c4b59776c03e4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:17.748716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a91bb8b5-6cc3-4b9f-99db-434a41040c59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '707b5089e56c4366869c4b59776c03e4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:17.781091 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2901/5817] 10.222.0.20 () {60 vars in 1360 bytes} [Thu Oct 27 03:48:17 2022] PUT /identity/v3/groups/fad53b7711ad463a86096509d5fbd048/users/4e215dbd38594c5c988704471b03ec34 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:17.786983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7919eb-fb1a-468a-bd8c-a3f05049f40b tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:17.790942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7f7919eb-fb1a-468a-bd8c-a3f05049f40b tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:17.792956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a91bb8b5-6cc3-4b9f-99db-434a41040c59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '707b5089e56c4366869c4b59776c03e4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:17.827539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a91bb8b5-6cc3-4b9f-99db-434a41040c59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '707b5089e56c4366869c4b59776c03e4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:17.828381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a91bb8b5-6cc3-4b9f-99db-434a41040c59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '707b5089e56c4366869c4b59776c03e4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:17.892785 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2917/5818] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:17 2022] DELETE /identity/v3/users/707b5089e56c4366869c4b59776c03e4 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:17.926224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7919eb-fb1a-468a-bd8c-a3f05049f40b tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:17.941801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:18.001471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143ef91-6589-4194-9841-21032407953a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:18.002758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143ef91-6589-4194-9841-21032407953a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:18.003213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143ef91-6589-4194-9841-21032407953a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:18.005573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143ef91-6589-4194-9841-21032407953a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/domains/4268881ad52c4eb9adb194b73b971d02/groups/fad53b7711ad463a86096509d5fbd048/roles/3c6e664362f343c08041a8b749178854` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:18.007041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143ef91-6589-4194-9841-21032407953a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=4268881ad52c4eb9adb194b73b971d02, group_id=fad53b7711ad463a86096509d5fbd048, role_id=3c6e664362f343c08041a8b749178854)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:18.010647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143ef91-6589-4194-9841-21032407953a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:18.072114 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2902/5819] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:17 2022] PUT /identity/v3/domains/4268881ad52c4eb9adb194b73b971d02/groups/fad53b7711ad463a86096509d5fbd048/roles/3c6e664362f343c08041a8b749178854 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:48:18.076999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bb8b5-6cc3-4b9f-99db-434a41040c59 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:18.096868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bb8b5-6cc3-4b9f-99db-434a41040c59 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:18.136540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:18.194997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ed1ec-28c0-42cc-94e5-e5f945c106a6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:18.197614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ed1ec-28c0-42cc-94e5-e5f945c106a6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:18.197930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ed1ec-28c0-42cc-94e5-e5f945c106a6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:18.198225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ed1ec-28c0-42cc-94e5-e5f945c106a6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:18.198982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ed1ec-28c0-42cc-94e5-e5f945c106a6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:18.203068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ed1ec-28c0-42cc-94e5-e5f945c106a6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:18.306665 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2918/5820] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:48:18 2022] POST /identity/v3/domains => generated 277 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:48:18.311207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143ef91-6589-4194-9841-21032407953a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:18.328249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143ef91-6589-4194-9841-21032407953a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:18.407974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b9232-a0b1-491a-aeff-4472e9e48d44 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:18.409145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b9232-a0b1-491a-aeff-4472e9e48d44 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:18.409438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b9232-a0b1-491a-aeff-4472e9e48d44 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:18.409720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b9232-a0b1-491a-aeff-4472e9e48d44 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:18.410520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b9232-a0b1-491a-aeff-4472e9e48d44 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:18.412201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b9232-a0b1-491a-aeff-4472e9e48d44 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:18.526728 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2903/5821] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:48:18 2022] POST /identity/v3/roles => generated 240 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:18.531464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ed1ec-28c0-42cc-94e5-e5f945c106a6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:18.543490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ed1ec-28c0-42cc-94e5-e5f945c106a6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:18.551334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccc441-b05b-4eb3-b3c3-84824ae6febe tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:18.552213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccc441-b05b-4eb3-b3c3-84824ae6febe tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:18.552591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccc441-b05b-4eb3-b3c3-84824ae6febe tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:18.552963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccc441-b05b-4eb3-b3c3-84824ae6febe tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/domains/8cbf547f4ace441dbfa25e8d0e937369/users/4e215dbd38594c5c988704471b03ec34/roles/1753665455fa4a9b9191a6c3ad8a181d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:18.572329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ccc441-b05b-4eb3-b3c3-84824ae6febe tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=8cbf547f4ace441dbfa25e8d0e937369, user_id=4e215dbd38594c5c988704471b03ec34, role_id=1753665455fa4a9b9191a6c3ad8a181d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:18.575923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ccc441-b05b-4eb3-b3c3-84824ae6febe tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:18.676002 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2919/5822] 10.222.0.20 () {60 vars in 1480 bytes} [Thu Oct 27 03:48:18 2022] PUT /identity/v3/domains/8cbf547f4ace441dbfa25e8d0e937369/users/4e215dbd38594c5c988704471b03ec34/roles/1753665455fa4a9b9191a6c3ad8a181d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:18.677705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b9232-a0b1-491a-aeff-4472e9e48d44 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:18.701105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b9232-a0b1-491a-aeff-4472e9e48d44 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:18.795317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740896d2-3aff-4bf3-8be0-dab53a10bb94 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:18.795970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740896d2-3aff-4bf3-8be0-dab53a10bb94 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:18.803256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740896d2-3aff-4bf3-8be0-dab53a10bb94 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:18.803769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740896d2-3aff-4bf3-8be0-dab53a10bb94 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:18.804720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740896d2-3aff-4bf3-8be0-dab53a10bb94 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:18.807039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740896d2-3aff-4bf3-8be0-dab53a10bb94 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:18.957166 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2904/5823] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:48:18 2022] POST /identity/v3/domains => generated 274 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:48:18.959756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccc441-b05b-4eb3-b3c3-84824ae6febe tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:18.979499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccc441-b05b-4eb3-b3c3-84824ae6febe tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:19.029098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:19.083118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88a245-b2ab-4752-a215-e55e947e1435 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:19.084044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88a245-b2ab-4752-a215-e55e947e1435 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:19.085420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88a245-b2ab-4752-a215-e55e947e1435 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:19.085893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88a245-b2ab-4752-a215-e55e947e1435 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:19.087001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88a245-b2ab-4752-a215-e55e947e1435 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:19.089973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88a245-b2ab-4752-a215-e55e947e1435 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:19.180336 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2920/5824] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:48:18 2022] POST /identity/v3/roles => generated 240 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:19.183677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740896d2-3aff-4bf3-8be0-dab53a10bb94 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:19.212538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740896d2-3aff-4bf3-8be0-dab53a10bb94 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:19.222214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433bab6-b9f2-4b80-937d-b47f82ed66eb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:19.222849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433bab6-b9f2-4b80-937d-b47f82ed66eb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:19.223133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433bab6-b9f2-4b80-937d-b47f82ed66eb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:19.223409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433bab6-b9f2-4b80-937d-b47f82ed66eb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/groups` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:19.224053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433bab6-b9f2-4b80-937d-b47f82ed66eb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:19.226389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433bab6-b9f2-4b80-937d-b47f82ed66eb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:19.458444 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2905/5825] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:48:19 2022] POST /identity/v3/groups => generated 326 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:19.463085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88a245-b2ab-4752-a215-e55e947e1435 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:19.480246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88a245-b2ab-4752-a215-e55e947e1435 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:19.495302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cada5-6758-4b6f-877b-fe309a92d62f tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:19.496174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cada5-6758-4b6f-877b-fe309a92d62f tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:19.496604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cada5-6758-4b6f-877b-fe309a92d62f tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:19.497564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cada5-6758-4b6f-877b-fe309a92d62f tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/groups/216cf0fcf96b461e9ceeaeb3b7d68086/users/4e215dbd38594c5c988704471b03ec34` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:19.507789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cada5-6758-4b6f-877b-fe309a92d62f tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=216cf0fcf96b461e9ceeaeb3b7d68086, user_id=4e215dbd38594c5c988704471b03ec34)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:19.508077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433bab6-b9f2-4b80-937d-b47f82ed66eb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:19.510004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4433bab6-b9f2-4b80-937d-b47f82ed66eb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:19.510145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cada5-6758-4b6f-877b-fe309a92d62f tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:19.620908 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2921/5826] 10.222.0.20 () {60 vars in 1360 bytes} [Thu Oct 27 03:48:19 2022] PUT /identity/v3/groups/216cf0fcf96b461e9ceeaeb3b7d68086/users/4e215dbd38594c5c988704471b03ec34 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:19.625656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cada5-6758-4b6f-877b-fe309a92d62f tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:19.641290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433bab6-b9f2-4b80-937d-b47f82ed66eb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:19.749185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:UPDATE=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:19.807283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cada5-6758-4b6f-877b-fe309a92d62f tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:19.813743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf7218-ff14-4318-87db-93d6199be016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:19.814729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf7218-ff14-4318-87db-93d6199be016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:19.815164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf7218-ff14-4318-87db-93d6199be016 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:19.815610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf7218-ff14-4318-87db-93d6199be016 admin admin] PATH_INFO: `/v3/projects/f1bb926358124cbaa9c378848544b8e9` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:19.817028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf7218-ff14-4318-87db-93d6199be016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1bb926358124cbaa9c378848544b8e9)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:19.819178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf7218-ff14-4318-87db-93d6199be016 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:19.821891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d69a6-16ad-4458-907e-1eea3271f4fa tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:19.822704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d69a6-16ad-4458-907e-1eea3271f4fa tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:19.823000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d69a6-16ad-4458-907e-1eea3271f4fa tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:19.826468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d69a6-16ad-4458-907e-1eea3271f4fa tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/domains/0da57134c4f94e04ab3058ec063235d2/groups/216cf0fcf96b461e9ceeaeb3b7d68086/roles/ab88757139d246cea790cd505d2e3c81` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:19.830298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d69a6-16ad-4458-907e-1eea3271f4fa tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=0da57134c4f94e04ab3058ec063235d2, group_id=216cf0fcf96b461e9ceeaeb3b7d68086, role_id=ab88757139d246cea790cd505d2e3c81)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:19.833573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d69a6-16ad-4458-907e-1eea3271f4fa tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:19.863767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:19.897648 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2922/5827] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:19 2022] PUT /identity/v3/domains/0da57134c4f94e04ab3058ec063235d2/groups/216cf0fcf96b461e9ceeaeb3b7d68086/roles/ab88757139d246cea790cd505d2e3c81 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:48:19.901799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d69a6-16ad-4458-907e-1eea3271f4fa tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:19.904755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f97d69a6-16ad-4458-907e-1eea3271f4fa tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:19.968202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-67bf7218-ff14-4318-87db-93d6199be016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1bb926358124cbaa9c378848544b8e9', 'request_id': 'req-67bf7218-ff14-4318-87db-93d6199be016'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:20.040067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-67bf7218-ff14-4318-87db-93d6199be016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1bb926358124cbaa9c378848544b8e9', 'request_id': 'req-67bf7218-ff14-4318-87db-93d6199be016'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:20.056643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-67bf7218-ff14-4318-87db-93d6199be016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1bb926358124cbaa9c378848544b8e9', 'request_id': 'req-67bf7218-ff14-4318-87db-93d6199be016'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:20.076067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-67bf7218-ff14-4318-87db-93d6199be016 admin admin] The token cache is being invalidate because project f1bb926358124cbaa9c378848544b8e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:20.076808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-67bf7218-ff14-4318-87db-93d6199be016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:20.077869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-67bf7218-ff14-4318-87db-93d6199be016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:20.085171 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2906/5828] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:48:19 2022] DELETE /identity/v3/projects/f1bb926358124cbaa9c378848544b8e9 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:20.087551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb7c38-ba0d-466e-8b6c-ddfdcb064aff None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:20.088154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb7c38-ba0d-466e-8b6c-ddfdcb064aff None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:20.088572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb7c38-ba0d-466e-8b6c-ddfdcb064aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:20.099775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d69a6-16ad-4458-907e-1eea3271f4fa tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:20.121190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-62cb7c38-ba0d-466e-8b6c-ddfdcb064aff None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:20.123117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-62cb7c38-ba0d-466e-8b6c-ddfdcb064aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:20.239506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce7369-b38c-40cc-8203-7f5457bd5821 tempest-TokensV3TestJSON-638503475 tempest-TokensV3TestJSON-638503475-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e215dbd38594c5c988704471b03ec34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '013d62557ab4436d894fc22ad2635d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:20.240141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce7369-b38c-40cc-8203-7f5457bd5821 tempest-TokensV3TestJSON-638503475 tempest-TokensV3TestJSON-638503475-project] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:20.240430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce7369-b38c-40cc-8203-7f5457bd5821 tempest-TokensV3TestJSON-638503475 tempest-TokensV3TestJSON-638503475-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:20.240711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce7369-b38c-40cc-8203-7f5457bd5821 tempest-TokensV3TestJSON-638503475 tempest-TokensV3TestJSON-638503475-project] PATH_INFO: `/v3/auth/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:20.242367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce7369-b38c-40cc-8203-7f5457bd5821 tempest-TokensV3TestJSON-638503475 tempest-TokensV3TestJSON-638503475-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:20.244678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce7369-b38c-40cc-8203-7f5457bd5821 tempest-TokensV3TestJSON-638503475 tempest-TokensV3TestJSON-638503475-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:20.268087 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2907/5829] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:20.276786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dbd79-5d3c-4a32-a63e-1717b4430b79 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:20.277075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dbd79-5d3c-4a32-a63e-1717b4430b79 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:20.277358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dbd79-5d3c-4a32-a63e-1717b4430b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:20.317476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-df3dbd79-5d3c-4a32-a63e-1717b4430b79 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:20.319543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-df3dbd79-5d3c-4a32-a63e-1717b4430b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:20.342854 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2908/5830] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:48:20.346954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3dbd79-5d3c-4a32-a63e-1717b4430b79 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:20.365864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3dbd79-5d3c-4a32-a63e-1717b4430b79 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:20.373016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4023269-e2e3-4905-a895-45865791803c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:20.373630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4023269-e2e3-4905-a895-45865791803c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:20.373920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4023269-e2e3-4905-a895-45865791803c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:20.374235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4023269-e2e3-4905-a895-45865791803c admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:20.375961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4023269-e2e3-4905-a895-45865791803c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:48:20.375961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4023269-e2e3-4905-a895-45865791803c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:20.376670 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2923/5831] 10.222.0.20 () {58 vars in 1143 bytes} [Thu Oct 27 03:48:19 2022] GET /identity/v3/auth/domains => generated 1170 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:20.377818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4023269-e2e3-4905-a895-45865791803c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:20.380391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce7369-b38c-40cc-8203-7f5457bd5821 tempest-TokensV3TestJSON-638503475 tempest-TokensV3TestJSON-638503475-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:20.382873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-afce7369-b38c-40cc-8203-7f5457bd5821 tempest-TokensV3TestJSON-638503475 tempest-TokensV3TestJSON-638503475-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:20.411070 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2909/5832] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:48:20.415322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4023269-e2e3-4905-a895-45865791803c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:20.430575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4023269-e2e3-4905-a895-45865791803c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:20.436770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae7d73-abe1-4d0c-bcb4-21f0d4664f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:20.438012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae7d73-abe1-4d0c-bcb4-21f0d4664f62 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:20.438498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae7d73-abe1-4d0c-bcb4-21f0d4664f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:20.438928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae7d73-abe1-4d0c-bcb4-21f0d4664f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:20.440005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae7d73-abe1-4d0c-bcb4-21f0d4664f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:20.442231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae7d73-abe1-4d0c-bcb4-21f0d4664f62 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:20.498939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce7369-b38c-40cc-8203-7f5457bd5821 tempest-TokensV3TestJSON-638503475 tempest-TokensV3TestJSON-638503475-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:20.506280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce5dcc-eda2-471f-b675-df5602e507cb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:20.508738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce5dcc-eda2-471f-b675-df5602e507cb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:20.508738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce5dcc-eda2-471f-b675-df5602e507cb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:20.508738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce5dcc-eda2-471f-b675-df5602e507cb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/domains/0da57134c4f94e04ab3058ec063235d2/groups/216cf0fcf96b461e9ceeaeb3b7d68086/roles/ab88757139d246cea790cd505d2e3c81` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:20.511466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce5dcc-eda2-471f-b675-df5602e507cb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=0da57134c4f94e04ab3058ec063235d2, group_id=216cf0fcf96b461e9ceeaeb3b7d68086, role_id=ab88757139d246cea790cd505d2e3c81)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:20.515188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce5dcc-eda2-471f-b675-df5602e507cb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:20.524113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-06ce5dcc-eda2-471f-b675-df5602e507cb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invalidating the token cache because role ab88757139d246cea790cd505d2e3c81 was removed from group 216cf0fcf96b461e9ceeaeb3b7d68086 on domain 0da57134c4f94e04ab3058ec063235d2. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:20.524509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-06ce5dcc-eda2-471f-b675-df5602e507cb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:20.533667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-06ce5dcc-eda2-471f-b675-df5602e507cb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:20.584241 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2910/5833] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:48:20 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:20.588875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae7d73-abe1-4d0c-bcb4-21f0d4664f62 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:20.592075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b7ae7d73-abe1-4d0c-bcb4-21f0d4664f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:20.628734 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2924/5834] 10.222.0.20 () {58 vars in 1467 bytes} [Thu Oct 27 03:48:20 2022] DELETE /identity/v3/domains/0da57134c4f94e04ab3058ec063235d2/groups/216cf0fcf96b461e9ceeaeb3b7d68086/roles/ab88757139d246cea790cd505d2e3c81 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:20.628734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce5dcc-eda2-471f-b675-df5602e507cb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:20.630449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-06ce5dcc-eda2-471f-b675-df5602e507cb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:20.755087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae7d73-abe1-4d0c-bcb4-21f0d4664f62 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:20.776725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce5dcc-eda2-471f-b675-df5602e507cb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:20.783545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64530228-87d5-48d0-845c-362150d0d18f tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:20.784229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64530228-87d5-48d0-845c-362150d0d18f tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:20.789452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64530228-87d5-48d0-845c-362150d0d18f tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:20.789452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64530228-87d5-48d0-845c-362150d0d18f tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/groups/216cf0fcf96b461e9ceeaeb3b7d68086/users/4e215dbd38594c5c988704471b03ec34` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:20.789452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64530228-87d5-48d0-845c-362150d0d18f tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=216cf0fcf96b461e9ceeaeb3b7d68086, user_id=4e215dbd38594c5c988704471b03ec34)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:20.789825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64530228-87d5-48d0-845c-362150d0d18f tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:20.818935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:20.865719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e213f-759b-47e8-9577-ecc81aa42527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:20.866813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e213f-759b-47e8-9577-ecc81aa42527 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:20.867841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e213f-759b-47e8-9577-ecc81aa42527 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:20.868303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e213f-759b-47e8-9577-ecc81aa42527 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:20.869099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e213f-759b-47e8-9577-ecc81aa42527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:20.870709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-64530228-87d5-48d0-845c-362150d0d18f tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4e215dbd38594c5c988704471b03ec34'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:20.880991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e213f-759b-47e8-9577-ecc81aa42527 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:20.996236 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2925/5835] 10.222.0.20 () {58 vars in 1344 bytes} [Thu Oct 27 03:48:20 2022] DELETE /identity/v3/groups/216cf0fcf96b461e9ceeaeb3b7d68086/users/4e215dbd38594c5c988704471b03ec34 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:48:20.998167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64530228-87d5-48d0-845c-362150d0d18f tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:21.023086 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2911/5836] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:48:20 2022] POST /identity/v3/users => generated 289 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:21.025216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e213f-759b-47e8-9577-ecc81aa42527 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:21.079929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e213f-759b-47e8-9577-ecc81aa42527 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:21.234055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dbcc4-c602-4bee-8e8f-0b9d4d1edb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:21.234796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dbcc4-c602-4bee-8e8f-0b9d4d1edb67 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:21.235243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dbcc4-c602-4bee-8e8f-0b9d4d1edb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:21.235623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dbcc4-c602-4bee-8e8f-0b9d4d1edb67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:21.236389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823dbcc4-c602-4bee-8e8f-0b9d4d1edb67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:21.240619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823dbcc4-c602-4bee-8e8f-0b9d4d1edb67 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:21.243890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64530228-87d5-48d0-845c-362150d0d18f tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:21.258257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624dfb0-7c9b-49d8-9e8b-d10f8f637094 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:21.258930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624dfb0-7c9b-49d8-9e8b-d10f8f637094 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:21.259220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624dfb0-7c9b-49d8-9e8b-d10f8f637094 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:21.259503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624dfb0-7c9b-49d8-9e8b-d10f8f637094 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/groups/216cf0fcf96b461e9ceeaeb3b7d68086` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:21.262344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624dfb0-7c9b-49d8-9e8b-d10f8f637094 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:delete_group(group_id=216cf0fcf96b461e9ceeaeb3b7d68086)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:21.268638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624dfb0-7c9b-49d8-9e8b-d10f8f637094 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:21.274299 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2912/5837] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:21 2022] GET /identity/v3/roles => generated 2343 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:21.277821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dbcc4-c602-4bee-8e8f-0b9d4d1edb67 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:21.318822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dbcc4-c602-4bee-8e8f-0b9d4d1edb67 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:21.336162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160af0fc-7e3a-4bcb-8e1c-ecba5bc6ebe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:21.336945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160af0fc-7e3a-4bcb-8e1c-ecba5bc6ebe0 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:21.337347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160af0fc-7e3a-4bcb-8e1c-ecba5bc6ebe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:21.337721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160af0fc-7e3a-4bcb-8e1c-ecba5bc6ebe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:21.340159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160af0fc-7e3a-4bcb-8e1c-ecba5bc6ebe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:21.348785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160af0fc-7e3a-4bcb-8e1c-ecba5bc6ebe0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:21.379918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:21.393292 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2913/5838] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:21 2022] GET /identity/v3/roles => generated 2343 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:21.394550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160af0fc-7e3a-4bcb-8e1c-ecba5bc6ebe0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:21.414103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160af0fc-7e3a-4bcb-8e1c-ecba5bc6ebe0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:21.427258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29446320-67d1-4402-ac4a-1108d07ff1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:21.428548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29446320-67d1-4402-ac4a-1108d07ff1c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:21.442662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29446320-67d1-4402-ac4a-1108d07ff1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:21.445476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29446320-67d1-4402-ac4a-1108d07ff1c7 admin admin] PATH_INFO: `/v3/projects/ca9c45864f75485095bb9428892c55d8/users/4fe2e814de124b98a9206248df24e040/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:21.472042 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2926/5839] 10.222.0.20 () {58 vars in 1227 bytes} [Thu Oct 27 03:48:20 2022] DELETE /identity/v3/groups/216cf0fcf96b461e9ceeaeb3b7d68086 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:21.479484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624dfb0-7c9b-49d8-9e8b-d10f8f637094 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:21.510419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29446320-67d1-4402-ac4a-1108d07ff1c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9c45864f75485095bb9428892c55d8, user_id=4fe2e814de124b98a9206248df24e040, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:21.513847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29446320-67d1-4402-ac4a-1108d07ff1c7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:21.667165 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2914/5840] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:21 2022] PUT /identity/v3/projects/ca9c45864f75485095bb9428892c55d8/users/4fe2e814de124b98a9206248df24e040/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:21.684283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab35269-4397-4e57-b002-0446ad63673f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:21.689683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab35269-4397-4e57-b002-0446ad63673f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:21.691378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab35269-4397-4e57-b002-0446ad63673f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:21.752720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624dfb0-7c9b-49d8-9e8b-d10f8f637094 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:21.775067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1ab35269-4397-4e57-b002-0446ad63673f None None] MFA Rules not processed for user `4fe2e814de124b98a9206248df24e040`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:21.776329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1ab35269-4397-4e57-b002-0446ad63673f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:21.892215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e613017-a32f-4934-9656-8a88066e5f48 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:21.892889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e613017-a32f-4934-9656-8a88066e5f48 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:21.893183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e613017-a32f-4934-9656-8a88066e5f48 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:21.893470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e613017-a32f-4934-9656-8a88066e5f48 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/roles/ab88757139d246cea790cd505d2e3c81` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:21.895011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e613017-a32f-4934-9656-8a88066e5f48 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ab88757139d246cea790cd505d2e3c81)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:21.896670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e613017-a32f-4934-9656-8a88066e5f48 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:21.911116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:21.989473 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2915/5841] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:48:21.995017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab35269-4397-4e57-b002-0446ad63673f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:22.085451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7e613017-a32f-4934-9656-8a88066e5f48 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invalidating the token cache because role ab88757139d246cea790cd505d2e3c81 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:22.086362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7e613017-a32f-4934-9656-8a88066e5f48 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:22.087409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7e613017-a32f-4934-9656-8a88066e5f48 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:22.089348 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2927/5842] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:21 2022] DELETE /identity/v3/roles/ab88757139d246cea790cd505d2e3c81 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:22.096272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e613017-a32f-4934-9656-8a88066e5f48 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:22.098996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7e613017-a32f-4934-9656-8a88066e5f48 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:22.163187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab35269-4397-4e57-b002-0446ad63673f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:22.194543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:22.288864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e613017-a32f-4934-9656-8a88066e5f48 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:22.297425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f460510-9acc-4ec6-ab78-099f3fb7206d tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:22.298260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f460510-9acc-4ec6-ab78-099f3fb7206d tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:22.298640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f460510-9acc-4ec6-ab78-099f3fb7206d tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:22.300377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f460510-9acc-4ec6-ab78-099f3fb7206d tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/domains/0da57134c4f94e04ab3058ec063235d2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:22.303072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f460510-9acc-4ec6-ab78-099f3fb7206d tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0da57134c4f94e04ab3058ec063235d2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:22.306568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f460510-9acc-4ec6-ab78-099f3fb7206d tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:22.362079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0beee-c1ac-416a-9687-3ed53b274711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:22.362728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0beee-c1ac-416a-9687-3ed53b274711 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:22.363020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0beee-c1ac-416a-9687-3ed53b274711 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:22.363304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0beee-c1ac-416a-9687-3ed53b274711 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:22.363960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0beee-c1ac-416a-9687-3ed53b274711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:22.366911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0beee-c1ac-416a-9687-3ed53b274711 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:22.402856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7f460510-9acc-4ec6-ab78-099f3fb7206d tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0da57134c4f94e04ab3058ec063235d2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:22.405811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7f460510-9acc-4ec6-ab78-099f3fb7206d tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0da57134c4f94e04ab3058ec063235d2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:22.529798 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2916/5843] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:48:21 2022] POST /identity/v3/projects => generated 377 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:22.531300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0beee-c1ac-416a-9687-3ed53b274711 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:22.535889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-81e0beee-c1ac-416a-9687-3ed53b274711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:22.541674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7f460510-9acc-4ec6-ab78-099f3fb7206d tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0da57134c4f94e04ab3058ec063235d2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:22.541674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7f460510-9acc-4ec6-ab78-099f3fb7206d tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0da57134c4f94e04ab3058ec063235d2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:22.546105 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2928/5844] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:48:22 2022] PATCH /identity/v3/domains/0da57134c4f94e04ab3058ec063235d2 => generated 275 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:48:22.546845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f460510-9acc-4ec6-ab78-099f3fb7206d tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:22.549757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7f460510-9acc-4ec6-ab78-099f3fb7206d tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:22.667898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:22.676370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0beee-c1ac-416a-9687-3ed53b274711 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:22.683193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe657f-59e2-4298-a4b5-85955d80745e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:22.683798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe657f-59e2-4298-a4b5-85955d80745e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:22.684190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe657f-59e2-4298-a4b5-85955d80745e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:22.684660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe657f-59e2-4298-a4b5-85955d80745e admin admin] PATH_INFO: `/v3/users/d0ef329b36954b1a9d642913377d4cd3` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:22.685849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe657f-59e2-4298-a4b5-85955d80745e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ef329b36954b1a9d642913377d4cd3)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:22.688763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe657f-59e2-4298-a4b5-85955d80745e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:22.705420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f460510-9acc-4ec6-ab78-099f3fb7206d tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:22.711373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b841d-0ff6-47d9-9a5c-bbb7e0d7c8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:22.712008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b841d-0ff6-47d9-9a5c-bbb7e0d7c8c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:22.713312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b841d-0ff6-47d9-9a5c-bbb7e0d7c8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:22.713610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b841d-0ff6-47d9-9a5c-bbb7e0d7c8c6 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:22.714282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b841d-0ff6-47d9-9a5c-bbb7e0d7c8c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:22.724741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b841d-0ff6-47d9-9a5c-bbb7e0d7c8c6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:22.853445 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2929/5845] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:48:22 2022] POST /identity/v3/users => generated 289 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:22.854514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b841d-0ff6-47d9-9a5c-bbb7e0d7c8c6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:22.857646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5e0b841d-0ff6-47d9-9a5c-bbb7e0d7c8c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:22.938025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dbfe657f-59e2-4298-a4b5-85955d80745e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ef329b36954b1a9d642913377d4cd3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:22.942315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dbfe657f-59e2-4298-a4b5-85955d80745e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ef329b36954b1a9d642913377d4cd3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:22.965239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dbfe657f-59e2-4298-a4b5-85955d80745e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ef329b36954b1a9d642913377d4cd3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:22.986652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dbfe657f-59e2-4298-a4b5-85955d80745e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ef329b36954b1a9d642913377d4cd3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:23.016578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b841d-0ff6-47d9-9a5c-bbb7e0d7c8c6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:23.042114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1fa57-6337-4f01-b7fb-99226bf3a914 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:23.046470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1fa57-6337-4f01-b7fb-99226bf3a914 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:23.047895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1fa57-6337-4f01-b7fb-99226bf3a914 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:23.049202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1fa57-6337-4f01-b7fb-99226bf3a914 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/domains/0da57134c4f94e04ab3058ec063235d2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:23.076907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1fa57-6337-4f01-b7fb-99226bf3a914 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0da57134c4f94e04ab3058ec063235d2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:23.092170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1fa57-6337-4f01-b7fb-99226bf3a914 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:23.105528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dbfe657f-59e2-4298-a4b5-85955d80745e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ef329b36954b1a9d642913377d4cd3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:23.116326 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2917/5846] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:22 2022] DELETE /identity/v3/users/d0ef329b36954b1a9d642913377d4cd3 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:23.116326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe657f-59e2-4298-a4b5-85955d80745e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:23.120373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dbfe657f-59e2-4298-a4b5-85955d80745e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:23.137252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30d1fa57-6337-4f01-b7fb-99226bf3a914 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0da57134c4f94e04ab3058ec063235d2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:23.148289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30d1fa57-6337-4f01-b7fb-99226bf3a914 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0da57134c4f94e04ab3058ec063235d2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:23.269841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe657f-59e2-4298-a4b5-85955d80745e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:23.283663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30d1fa57-6337-4f01-b7fb-99226bf3a914 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0da57134c4f94e04ab3058ec063235d2', 'request_id': 'req-30d1fa57-6337-4f01-b7fb-99226bf3a914'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:23.298586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30d1fa57-6337-4f01-b7fb-99226bf3a914 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0da57134c4f94e04ab3058ec063235d2', 'request_id': 'req-30d1fa57-6337-4f01-b7fb-99226bf3a914'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:23.323516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30d1fa57-6337-4f01-b7fb-99226bf3a914 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0da57134c4f94e04ab3058ec063235d2', 'request_id': 'req-30d1fa57-6337-4f01-b7fb-99226bf3a914'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:23.400143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb338fe-d207-4d45-bc3e-0206e5cfc801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:23.400431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb338fe-d207-4d45-bc3e-0206e5cfc801 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:23.400794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb338fe-d207-4d45-bc3e-0206e5cfc801 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:23.401598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb338fe-d207-4d45-bc3e-0206e5cfc801 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:23.402375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb338fe-d207-4d45-bc3e-0206e5cfc801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:23.407345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb338fe-d207-4d45-bc3e-0206e5cfc801 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:23.415686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30d1fa57-6337-4f01-b7fb-99226bf3a914 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] The token cache is being invalidate because project 0da57134c4f94e04ab3058ec063235d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:23.415991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30d1fa57-6337-4f01-b7fb-99226bf3a914 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:23.418325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30d1fa57-6337-4f01-b7fb-99226bf3a914 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:23.440920 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2918/5847] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:23 2022] GET /identity/v3/roles => generated 2112 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:23.442593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a1742-2247-4205-8154-b02ce3191d60 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:23.446394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a1742-2247-4205-8154-b02ce3191d60 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:23.446880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a1742-2247-4205-8154-b02ce3191d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:23.449095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30d1fa57-6337-4f01-b7fb-99226bf3a914 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0da57134c4f94e04ab3058ec063235d2', 'request_id': 'req-30d1fa57-6337-4f01-b7fb-99226bf3a914'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:23.451051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30d1fa57-6337-4f01-b7fb-99226bf3a914 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0da57134c4f94e04ab3058ec063235d2', 'request_id': 'req-30d1fa57-6337-4f01-b7fb-99226bf3a914'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:23.452902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30d1fa57-6337-4f01-b7fb-99226bf3a914 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0da57134c4f94e04ab3058ec063235d2', 'request_id': 'req-30d1fa57-6337-4f01-b7fb-99226bf3a914'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:23.471146 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2930/5848] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:48:22 2022] DELETE /identity/v3/domains/0da57134c4f94e04ab3058ec063235d2 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:23.475513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1fa57-6337-4f01-b7fb-99226bf3a914 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:23.479450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-175a1742-2247-4205-8154-b02ce3191d60 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:23.480774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-175a1742-2247-4205-8154-b02ce3191d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:23.491742 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2919/5849] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:23.493803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a1742-2247-4205-8154-b02ce3191d60 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:23.495553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-175a1742-2247-4205-8154-b02ce3191d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:23.500804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-30d1fa57-6337-4f01-b7fb-99226bf3a914 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:23.535222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1fa57-6337-4f01-b7fb-99226bf3a914 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:23.544466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60f2f3-eb37-482e-86ff-afbec9605c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:23.545564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60f2f3-eb37-482e-86ff-afbec9605c90 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:23.546004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60f2f3-eb37-482e-86ff-afbec9605c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:23.546473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60f2f3-eb37-482e-86ff-afbec9605c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:23.548526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60f2f3-eb37-482e-86ff-afbec9605c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:23.563041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60f2f3-eb37-482e-86ff-afbec9605c90 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:23.587186 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2931/5850] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:23 2022] GET /identity/v3/roles => generated 2112 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:23.588467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60f2f3-eb37-482e-86ff-afbec9605c90 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:23.591562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9e60f2f3-eb37-482e-86ff-afbec9605c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:23.724401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60f2f3-eb37-482e-86ff-afbec9605c90 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:23.727481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:23.729866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a1742-2247-4205-8154-b02ce3191d60 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:23.735442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d5b46-bf70-4134-a3c2-32c14199bf37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:23.738259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d5b46-bf70-4134-a3c2-32c14199bf37 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:23.738570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d5b46-bf70-4134-a3c2-32c14199bf37 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:23.738927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d5b46-bf70-4134-a3c2-32c14199bf37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:23.741303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce376ef-2d0b-4786-99fc-e37f5d4f8936 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:23.741995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce376ef-2d0b-4786-99fc-e37f5d4f8936 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:23.742308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce376ef-2d0b-4786-99fc-e37f5d4f8936 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:23.742590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce376ef-2d0b-4786-99fc-e37f5d4f8936 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/domains/8cbf547f4ace441dbfa25e8d0e937369/users/4e215dbd38594c5c988704471b03ec34/roles/1753665455fa4a9b9191a6c3ad8a181d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:23.747448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce376ef-2d0b-4786-99fc-e37f5d4f8936 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=8cbf547f4ace441dbfa25e8d0e937369, user_id=4e215dbd38594c5c988704471b03ec34, role_id=1753665455fa4a9b9191a6c3ad8a181d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:23.754017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce376ef-2d0b-4786-99fc-e37f5d4f8936 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:23.769338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cce376ef-2d0b-4786-99fc-e37f5d4f8936 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invalidating the token cache because role 1753665455fa4a9b9191a6c3ad8a181d was removed from user 4e215dbd38594c5c988704471b03ec34 on domain 8cbf547f4ace441dbfa25e8d0e937369. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:23.769644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cce376ef-2d0b-4786-99fc-e37f5d4f8936 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:23.771369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cce376ef-2d0b-4786-99fc-e37f5d4f8936 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:23.787308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d5b46-bf70-4134-a3c2-32c14199bf37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:23.788954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d5b46-bf70-4134-a3c2-32c14199bf37 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:23.825322 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2932/5851] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:48:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:48:23.827989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d5b46-bf70-4134-a3c2-32c14199bf37 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:23.860020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d5b46-bf70-4134-a3c2-32c14199bf37 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:23.880099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6ff1d-9f38-4e26-ae79-553e1f339f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:23.880960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6ff1d-9f38-4e26-ae79-553e1f339f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:23.881800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6ff1d-9f38-4e26-ae79-553e1f339f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:23.882104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6ff1d-9f38-4e26-ae79-553e1f339f17 admin admin] PATH_INFO: `/v3/projects/3eb0f9b843de45e591d841516ef7f8f2/users/b7fc7f7daec94aaca645f48af70c31db/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:23.919630 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2920/5852] 10.222.0.20 () {58 vars in 1464 bytes} [Thu Oct 27 03:48:23 2022] DELETE /identity/v3/domains/8cbf547f4ace441dbfa25e8d0e937369/users/4e215dbd38594c5c988704471b03ec34/roles/1753665455fa4a9b9191a6c3ad8a181d => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:23.922874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce376ef-2d0b-4786-99fc-e37f5d4f8936 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:23.924382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cce376ef-2d0b-4786-99fc-e37f5d4f8936 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:23.947065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6ff1d-9f38-4e26-ae79-553e1f339f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eb0f9b843de45e591d841516ef7f8f2, user_id=b7fc7f7daec94aaca645f48af70c31db, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:23.962532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6ff1d-9f38-4e26-ae79-553e1f339f17 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:24.096155 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2933/5853] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:23 2022] PUT /identity/v3/projects/3eb0f9b843de45e591d841516ef7f8f2/users/b7fc7f7daec94aaca645f48af70c31db/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:24.096384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce376ef-2d0b-4786-99fc-e37f5d4f8936 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:24.098160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc25a71-2d4b-42bc-966c-b3ab7669f7fd None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:24.098579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc25a71-2d4b-42bc-966c-b3ab7669f7fd None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:24.098862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc25a71-2d4b-42bc-966c-b3ab7669f7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:24.113161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:24.139190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-dbc25a71-2d4b-42bc-966c-b3ab7669f7fd None None] MFA Rules not processed for user `b7fc7f7daec94aaca645f48af70c31db`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:24.141011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-dbc25a71-2d4b-42bc-966c-b3ab7669f7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:24.264263 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2934/5854] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:48:24.272612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc25a71-2d4b-42bc-966c-b3ab7669f7fd None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:24.272612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-dbc25a71-2d4b-42bc-966c-b3ab7669f7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:24.280887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54603c4-3acf-4549-b071-ac7d7e258210 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:24.284372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54603c4-3acf-4549-b071-ac7d7e258210 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:24.284372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54603c4-3acf-4549-b071-ac7d7e258210 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:24.284372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54603c4-3acf-4549-b071-ac7d7e258210 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/roles/1753665455fa4a9b9191a6c3ad8a181d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:24.285473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54603c4-3acf-4549-b071-ac7d7e258210 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1753665455fa4a9b9191a6c3ad8a181d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:24.288331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54603c4-3acf-4549-b071-ac7d7e258210 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:24.363095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc25a71-2d4b-42bc-966c-b3ab7669f7fd None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:24.368970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f78f4c-b99e-416f-9575-90b8fe7563c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:24.369659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f78f4c-b99e-416f-9575-90b8fe7563c3 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:24.370061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f78f4c-b99e-416f-9575-90b8fe7563c3 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:24.370457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f78f4c-b99e-416f-9575-90b8fe7563c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:24.374104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-81f78f4c-b99e-416f-9575-90b8fe7563c3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:24.375840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f54603c4-3acf-4549-b071-ac7d7e258210 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invalidating the token cache because role 1753665455fa4a9b9191a6c3ad8a181d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:24.376500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f54603c4-3acf-4549-b071-ac7d7e258210 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:24.377838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f54603c4-3acf-4549-b071-ac7d7e258210 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:24.380088 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2921/5855] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:23 2022] DELETE /identity/v3/roles/1753665455fa4a9b9191a6c3ad8a181d => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:48:24.381648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54603c4-3acf-4549-b071-ac7d7e258210 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:24.383660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f54603c4-3acf-4549-b071-ac7d7e258210 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:24.472222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54603c4-3acf-4549-b071-ac7d7e258210 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:24.477242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1dc64-6f6f-4048-b553-4ee330dfbec3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:24.478173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1dc64-6f6f-4048-b553-4ee330dfbec3 service glance] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:24.478685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1dc64-6f6f-4048-b553-4ee330dfbec3 service glance] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:24.479132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1dc64-6f6f-4048-b553-4ee330dfbec3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:24.482521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-87d1dc64-6f6f-4048-b553-4ee330dfbec3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:24.487349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f78f4c-b99e-416f-9575-90b8fe7563c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:24.489078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f78f4c-b99e-416f-9575-90b8fe7563c3 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:24.523148 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2935/5856] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:48:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:48:24.524269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f78f4c-b99e-416f-9575-90b8fe7563c3 service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:24.549372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f78f4c-b99e-416f-9575-90b8fe7563c3 service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:24.599123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1dc64-6f6f-4048-b553-4ee330dfbec3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:24.600761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1dc64-6f6f-4048-b553-4ee330dfbec3 service glance] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:24.632941 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2922/5857] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:48:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:48:24.663233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec7223-8995-48f3-8b45-78cc046793e6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:24.664010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec7223-8995-48f3-8b45-78cc046793e6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:24.664297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec7223-8995-48f3-8b45-78cc046793e6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:24.664582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec7223-8995-48f3-8b45-78cc046793e6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/domains/8cbf547f4ace441dbfa25e8d0e937369` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:24.672891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec7223-8995-48f3-8b45-78cc046793e6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8cbf547f4ace441dbfa25e8d0e937369)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:24.679040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec7223-8995-48f3-8b45-78cc046793e6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:24.704447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f4ec7223-8995-48f3-8b45-78cc046793e6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8cbf547f4ace441dbfa25e8d0e937369'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:24.752563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f4ec7223-8995-48f3-8b45-78cc046793e6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8cbf547f4ace441dbfa25e8d0e937369'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:24.932707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1dc64-6f6f-4048-b553-4ee330dfbec3 service glance] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:24.935302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-87d1dc64-6f6f-4048-b553-4ee330dfbec3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:24.964155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f4ec7223-8995-48f3-8b45-78cc046793e6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8cbf547f4ace441dbfa25e8d0e937369'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:24.964155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f4ec7223-8995-48f3-8b45-78cc046793e6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8cbf547f4ace441dbfa25e8d0e937369'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:24.966734 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2936/5858] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:48:24 2022] PATCH /identity/v3/domains/8cbf547f4ace441dbfa25e8d0e937369 => generated 278 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:48:24.970611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec7223-8995-48f3-8b45-78cc046793e6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:24.972511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f4ec7223-8995-48f3-8b45-78cc046793e6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:25.080561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1dc64-6f6f-4048-b553-4ee330dfbec3 service glance] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:25.133607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec7223-8995-48f3-8b45-78cc046793e6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:25.141065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42549f5e-a814-422c-9603-64d3b251d43e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:25.142269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42549f5e-a814-422c-9603-64d3b251d43e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:25.142717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42549f5e-a814-422c-9603-64d3b251d43e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:25.143196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42549f5e-a814-422c-9603-64d3b251d43e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/domains/8cbf547f4ace441dbfa25e8d0e937369` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:25.159624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42549f5e-a814-422c-9603-64d3b251d43e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8cbf547f4ace441dbfa25e8d0e937369)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:25.162123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42549f5e-a814-422c-9603-64d3b251d43e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:25.202198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5dc32e-0998-4099-9bd9-ff5547948cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:25.203003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dc32e-0998-4099-9bd9-ff5547948cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:25.203733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dc32e-0998-4099-9bd9-ff5547948cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:25.203733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dc32e-0998-4099-9bd9-ff5547948cfd admin admin] PATH_INFO: `/v3/projects/ed251a93b3684a25a8bcf1d255ae4f06` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:25.207381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5dc32e-0998-4099-9bd9-ff5547948cfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed251a93b3684a25a8bcf1d255ae4f06)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:25.212088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5dc32e-0998-4099-9bd9-ff5547948cfd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:25.230185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-42549f5e-a814-422c-9603-64d3b251d43e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8cbf547f4ace441dbfa25e8d0e937369'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:25.269205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-42549f5e-a814-422c-9603-64d3b251d43e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8cbf547f4ace441dbfa25e8d0e937369'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:25.377725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bd5dc32e-0998-4099-9bd9-ff5547948cfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed251a93b3684a25a8bcf1d255ae4f06', 'request_id': 'req-bd5dc32e-0998-4099-9bd9-ff5547948cfd'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:25.391630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-42549f5e-a814-422c-9603-64d3b251d43e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cbf547f4ace441dbfa25e8d0e937369', 'request_id': 'req-42549f5e-a814-422c-9603-64d3b251d43e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:25.400536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-42549f5e-a814-422c-9603-64d3b251d43e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cbf547f4ace441dbfa25e8d0e937369', 'request_id': 'req-42549f5e-a814-422c-9603-64d3b251d43e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:25.406445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-42549f5e-a814-422c-9603-64d3b251d43e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cbf547f4ace441dbfa25e8d0e937369', 'request_id': 'req-42549f5e-a814-422c-9603-64d3b251d43e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:25.451205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bd5dc32e-0998-4099-9bd9-ff5547948cfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed251a93b3684a25a8bcf1d255ae4f06', 'request_id': 'req-bd5dc32e-0998-4099-9bd9-ff5547948cfd'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:25.461225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bd5dc32e-0998-4099-9bd9-ff5547948cfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed251a93b3684a25a8bcf1d255ae4f06', 'request_id': 'req-bd5dc32e-0998-4099-9bd9-ff5547948cfd'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:25.492225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bd5dc32e-0998-4099-9bd9-ff5547948cfd admin admin] The token cache is being invalidate because project ed251a93b3684a25a8bcf1d255ae4f06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:25.492541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bd5dc32e-0998-4099-9bd9-ff5547948cfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:25.494336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bd5dc32e-0998-4099-9bd9-ff5547948cfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:25.507364 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2923/5859] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:48:24 2022] DELETE /identity/v3/projects/ed251a93b3684a25a8bcf1d255ae4f06 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:48:25.509771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103bcac-e812-420b-9b12-9b23f5363d6c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:25.514851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103bcac-e812-420b-9b12-9b23f5363d6c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:25.514851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103bcac-e812-420b-9b12-9b23f5363d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:25.565066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-42549f5e-a814-422c-9603-64d3b251d43e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] The token cache is being invalidate because project 8cbf547f4ace441dbfa25e8d0e937369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:25.565969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-42549f5e-a814-422c-9603-64d3b251d43e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:25.570269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-42549f5e-a814-422c-9603-64d3b251d43e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:25.579412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1103bcac-e812-420b-9b12-9b23f5363d6c None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:25.581859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1103bcac-e812-420b-9b12-9b23f5363d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:25.586409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:25.588885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-42549f5e-a814-422c-9603-64d3b251d43e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8cbf547f4ace441dbfa25e8d0e937369', 'request_id': 'req-42549f5e-a814-422c-9603-64d3b251d43e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:25.594896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-42549f5e-a814-422c-9603-64d3b251d43e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8cbf547f4ace441dbfa25e8d0e937369', 'request_id': 'req-42549f5e-a814-422c-9603-64d3b251d43e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:25.597090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-42549f5e-a814-422c-9603-64d3b251d43e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8cbf547f4ace441dbfa25e8d0e937369', 'request_id': 'req-42549f5e-a814-422c-9603-64d3b251d43e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:25.620277 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2937/5860] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:48:24 2022] DELETE /identity/v3/domains/8cbf547f4ace441dbfa25e8d0e937369 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:25.620277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5faf9a-5316-4f33-9a5d-43c7e853a98a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:25.620277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5faf9a-5316-4f33-9a5d-43c7e853a98a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:25.620277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5faf9a-5316-4f33-9a5d-43c7e853a98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:25.694962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-bb5faf9a-5316-4f33-9a5d-43c7e853a98a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:25.699120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:25.702736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bb5faf9a-5316-4f33-9a5d-43c7e853a98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:25.746285 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2924/5861] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:48:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:25.748386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103bcac-e812-420b-9b12-9b23f5363d6c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:25.750732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1103bcac-e812-420b-9b12-9b23f5363d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:25.814917 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2938/5862] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:25.823161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e954181-68bb-4d68-a36c-d7c6040eb9a1 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:25.823734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e954181-68bb-4d68-a36c-d7c6040eb9a1 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:25.825279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e954181-68bb-4d68-a36c-d7c6040eb9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:25.848121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7e954181-68bb-4d68-a36c-d7c6040eb9a1 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:25.849436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7e954181-68bb-4d68-a36c-d7c6040eb9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:25.854515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103bcac-e812-420b-9b12-9b23f5363d6c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:25.863595 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2939/5863] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:48:25.868176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e954181-68bb-4d68-a36c-d7c6040eb9a1 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:25.868394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd7168-bef2-49fb-903b-4fb1d0f57d13 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:25.869772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd7168-bef2-49fb-903b-4fb1d0f57d13 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:25.869772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd7168-bef2-49fb-903b-4fb1d0f57d13 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:25.869772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd7168-bef2-49fb-903b-4fb1d0f57d13 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/domains/4268881ad52c4eb9adb194b73b971d02/groups/fad53b7711ad463a86096509d5fbd048/roles/3c6e664362f343c08041a8b749178854` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:25.873636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd7168-bef2-49fb-903b-4fb1d0f57d13 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=4268881ad52c4eb9adb194b73b971d02, group_id=fad53b7711ad463a86096509d5fbd048, role_id=3c6e664362f343c08041a8b749178854)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:25.876379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd7168-bef2-49fb-903b-4fb1d0f57d13 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:25.883221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-82fd7168-bef2-49fb-903b-4fb1d0f57d13 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invalidating the token cache because role 3c6e664362f343c08041a8b749178854 was removed from group fad53b7711ad463a86096509d5fbd048 on domain 4268881ad52c4eb9adb194b73b971d02. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:25.883512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-82fd7168-bef2-49fb-903b-4fb1d0f57d13 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:25.884254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-82fd7168-bef2-49fb-903b-4fb1d0f57d13 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:25.891194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e954181-68bb-4d68-a36c-d7c6040eb9a1 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:25.897865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c661802-d18c-4050-ad71-e65a5f29d6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:25.898758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c661802-d18c-4050-ad71-e65a5f29d6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:25.899048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c661802-d18c-4050-ad71-e65a5f29d6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:25.899468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c661802-d18c-4050-ad71-e65a5f29d6d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:25.900150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c661802-d18c-4050-ad71-e65a5f29d6d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:48:25.900462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c661802-d18c-4050-ad71-e65a5f29d6d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:25.914867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c661802-d18c-4050-ad71-e65a5f29d6d6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:25.953977 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2940/5864] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:48:25.955497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c661802-d18c-4050-ad71-e65a5f29d6d6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:25.957583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9c661802-d18c-4050-ad71-e65a5f29d6d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:25.981621 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2925/5865] 10.222.0.20 () {58 vars in 1467 bytes} [Thu Oct 27 03:48:25 2022] DELETE /identity/v3/domains/4268881ad52c4eb9adb194b73b971d02/groups/fad53b7711ad463a86096509d5fbd048/roles/3c6e664362f343c08041a8b749178854 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:25.981621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd7168-bef2-49fb-903b-4fb1d0f57d13 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:25.984067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-82fd7168-bef2-49fb-903b-4fb1d0f57d13 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:26.044604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c661802-d18c-4050-ad71-e65a5f29d6d6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:26.093000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd7168-bef2-49fb-903b-4fb1d0f57d13 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:26.099002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb55be-dabd-4477-a4b1-52d8111182dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:26.099630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb55be-dabd-4477-a4b1-52d8111182dd admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:26.099916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb55be-dabd-4477-a4b1-52d8111182dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:26.100197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb55be-dabd-4477-a4b1-52d8111182dd admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:26.100975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb55be-dabd-4477-a4b1-52d8111182dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:26.103000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb55be-dabd-4477-a4b1-52d8111182dd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:26.146336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d6e86-2dbb-4f3e-8fcb-63818161937e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:26.147471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d6e86-2dbb-4f3e-8fcb-63818161937e service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:26.147471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d6e86-2dbb-4f3e-8fcb-63818161937e service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:26.147762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d6e86-2dbb-4f3e-8fcb-63818161937e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:26.149782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8f0d6e86-2dbb-4f3e-8fcb-63818161937e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:26.218338 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2926/5866] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:48:25 2022] POST /identity/v3/projects => generated 365 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:26.218338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb55be-dabd-4477-a4b1-52d8111182dd admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:26.220149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-20fb55be-dabd-4477-a4b1-52d8111182dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:26.238482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d6e86-2dbb-4f3e-8fcb-63818161937e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:26.240125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d6e86-2dbb-4f3e-8fcb-63818161937e service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:26.250124 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2941/5867] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:48:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:48:26.250790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d6e86-2dbb-4f3e-8fcb-63818161937e service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:26.264992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d6e86-2dbb-4f3e-8fcb-63818161937e service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:26.305914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb55be-dabd-4477-a4b1-52d8111182dd admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:26.311849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e8cfb-5882-4894-b42d-a24efadaf008 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:26.318252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e8cfb-5882-4894-b42d-a24efadaf008 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:26.318252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e8cfb-5882-4894-b42d-a24efadaf008 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:26.318252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e8cfb-5882-4894-b42d-a24efadaf008 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/groups/fad53b7711ad463a86096509d5fbd048/users/4e215dbd38594c5c988704471b03ec34` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:26.318252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e8cfb-5882-4894-b42d-a24efadaf008 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=fad53b7711ad463a86096509d5fbd048, user_id=4e215dbd38594c5c988704471b03ec34)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:26.318677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e8cfb-5882-4894-b42d-a24efadaf008 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:26.344047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446542de-e054-4c83-83ab-826000c1e8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:26.344659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446542de-e054-4c83-83ab-826000c1e8bd admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:26.344948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446542de-e054-4c83-83ab-826000c1e8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:26.345243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446542de-e054-4c83-83ab-826000c1e8bd admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:26.345987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446542de-e054-4c83-83ab-826000c1e8bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:26.347956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446542de-e054-4c83-83ab-826000c1e8bd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:26.420709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-df6e8cfb-5882-4894-b42d-a24efadaf008 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4e215dbd38594c5c988704471b03ec34'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:26.497804 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2942/5868] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:48:26 2022] POST /identity/v3/users => generated 283 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:26.502887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446542de-e054-4c83-83ab-826000c1e8bd admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:26.514718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446542de-e054-4c83-83ab-826000c1e8bd admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:26.525005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1bb3f-36f1-4a00-9b11-80b40c078413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:26.525005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1bb3f-36f1-4a00-9b11-80b40c078413 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:26.525278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1bb3f-36f1-4a00-9b11-80b40c078413 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:26.525572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1bb3f-36f1-4a00-9b11-80b40c078413 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:26.526245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1bb3f-36f1-4a00-9b11-80b40c078413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:26.527903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1bb3f-36f1-4a00-9b11-80b40c078413 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:26.548555 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2927/5869] 10.222.0.20 () {58 vars in 1344 bytes} [Thu Oct 27 03:48:26 2022] DELETE /identity/v3/groups/fad53b7711ad463a86096509d5fbd048/users/4e215dbd38594c5c988704471b03ec34 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:26.552701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e8cfb-5882-4894-b42d-a24efadaf008 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:26.558642 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2943/5870] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:26 2022] GET /identity/v3/roles => generated 1881 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:26.561751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1bb3f-36f1-4a00-9b11-80b40c078413 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:26.592514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1bb3f-36f1-4a00-9b11-80b40c078413 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:26.639845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e8cfb-5882-4894-b42d-a24efadaf008 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:26.645997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4f4bd-dde6-41a3-b2a7-9869e7dacf6a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:26.647569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4f4bd-dde6-41a3-b2a7-9869e7dacf6a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:26.649169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4f4bd-dde6-41a3-b2a7-9869e7dacf6a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:26.649673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4f4bd-dde6-41a3-b2a7-9869e7dacf6a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/groups/fad53b7711ad463a86096509d5fbd048` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:26.651292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4f4bd-dde6-41a3-b2a7-9869e7dacf6a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:delete_group(group_id=fad53b7711ad463a86096509d5fbd048)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:26.654562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4f4bd-dde6-41a3-b2a7-9869e7dacf6a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:26.701873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50410ed4-805f-4480-9c57-cdf52a347544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:26.702786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50410ed4-805f-4480-9c57-cdf52a347544 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:26.702879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50410ed4-805f-4480-9c57-cdf52a347544 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:26.703125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50410ed4-805f-4480-9c57-cdf52a347544 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:26.704940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50410ed4-805f-4480-9c57-cdf52a347544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:26.706913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50410ed4-805f-4480-9c57-cdf52a347544 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:26.722715 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2944/5871] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:26 2022] GET /identity/v3/roles => generated 1881 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:48:26.723817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50410ed4-805f-4480-9c57-cdf52a347544 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:26.726474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-50410ed4-805f-4480-9c57-cdf52a347544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:26.764661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50410ed4-805f-4480-9c57-cdf52a347544 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:26.775880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de81293-214f-41eb-b390-2a025c8533e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:26.776805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de81293-214f-41eb-b390-2a025c8533e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:26.779949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de81293-214f-41eb-b390-2a025c8533e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:26.780358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de81293-214f-41eb-b390-2a025c8533e0 admin admin] PATH_INFO: `/v3/users/18d3c87c204946ffad3feb05bc6dfd53` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:26.783337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de81293-214f-41eb-b390-2a025c8533e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18d3c87c204946ffad3feb05bc6dfd53)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:26.786686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de81293-214f-41eb-b390-2a025c8533e0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:26.833105 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2928/5872] 10.222.0.20 () {58 vars in 1227 bytes} [Thu Oct 27 03:48:26 2022] DELETE /identity/v3/groups/fad53b7711ad463a86096509d5fbd048 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:48:26.834261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4f4bd-dde6-41a3-b2a7-9869e7dacf6a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:26.918841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4f4bd-dde6-41a3-b2a7-9869e7dacf6a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:26.924407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54026b-5379-4303-855c-5feff94616a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:26.925072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54026b-5379-4303-855c-5feff94616a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:26.925353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54026b-5379-4303-855c-5feff94616a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:26.925627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54026b-5379-4303-855c-5feff94616a7 admin admin] PATH_INFO: `/v3/projects/67716b96923c4535bf547ddcdd00409d/users/6b6ffd86f1bd4a079385e0a9bcd72c07/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:26.942012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54026b-5379-4303-855c-5feff94616a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67716b96923c4535bf547ddcdd00409d, user_id=6b6ffd86f1bd4a079385e0a9bcd72c07, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:26.944866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54026b-5379-4303-855c-5feff94616a7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:27.088334 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2929/5873] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:26 2022] PUT /identity/v3/projects/67716b96923c4535bf547ddcdd00409d/users/6b6ffd86f1bd4a079385e0a9bcd72c07/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:27.090228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54026b-5379-4303-855c-5feff94616a7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:27.110879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6de81293-214f-41eb-b390-2a025c8533e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18d3c87c204946ffad3feb05bc6dfd53'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:27.111958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6de81293-214f-41eb-b390-2a025c8533e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18d3c87c204946ffad3feb05bc6dfd53'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:27.128688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6de81293-214f-41eb-b390-2a025c8533e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18d3c87c204946ffad3feb05bc6dfd53'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:27.149837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6de81293-214f-41eb-b390-2a025c8533e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18d3c87c204946ffad3feb05bc6dfd53'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:27.150768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6de81293-214f-41eb-b390-2a025c8533e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18d3c87c204946ffad3feb05bc6dfd53'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:27.212150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54026b-5379-4303-855c-5feff94616a7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:27.216945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d3c58-0e10-4e8f-8af6-e33f8598e599 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:27.217608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d3c58-0e10-4e8f-8af6-e33f8598e599 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:27.217888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d3c58-0e10-4e8f-8af6-e33f8598e599 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:27.218205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d3c58-0e10-4e8f-8af6-e33f8598e599 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/roles/3c6e664362f343c08041a8b749178854` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:27.219694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d3c58-0e10-4e8f-8af6-e33f8598e599 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3c6e664362f343c08041a8b749178854)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:27.221382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d3c58-0e10-4e8f-8af6-e33f8598e599 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:27.250842 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2945/5874] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:26 2022] DELETE /identity/v3/users/18d3c87c204946ffad3feb05bc6dfd53 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:27.252031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de81293-214f-41eb-b390-2a025c8533e0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:27.253418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6de81293-214f-41eb-b390-2a025c8533e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:27.328678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de81293-214f-41eb-b390-2a025c8533e0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:27.330588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c88a1-31ef-46be-93ff-e0b2031f9175 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:27.331450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c88a1-31ef-46be-93ff-e0b2031f9175 service glance] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:27.331619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c88a1-31ef-46be-93ff-e0b2031f9175 service glance] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:27.331951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c88a1-31ef-46be-93ff-e0b2031f9175 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:27.333749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e84c88a1-31ef-46be-93ff-e0b2031f9175 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:27.353108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f34d3c58-0e10-4e8f-8af6-e33f8598e599 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invalidating the token cache because role 3c6e664362f343c08041a8b749178854 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:27.353439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f34d3c58-0e10-4e8f-8af6-e33f8598e599 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:27.357016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f34d3c58-0e10-4e8f-8af6-e33f8598e599 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:27.361082 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2930/5875] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:27 2022] DELETE /identity/v3/roles/3c6e664362f343c08041a8b749178854 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:27.361082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7ead7-9b17-4756-b085-ebcd85dd7c31 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:27.361082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7ead7-9b17-4756-b085-ebcd85dd7c31 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:27.361082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7ead7-9b17-4756-b085-ebcd85dd7c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:27.430070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-efd7ead7-9b17-4756-b085-ebcd85dd7c31 None None] MFA Rules not processed for user `6b6ffd86f1bd4a079385e0a9bcd72c07`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:27.431733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-efd7ead7-9b17-4756-b085-ebcd85dd7c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:27.483965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c88a1-31ef-46be-93ff-e0b2031f9175 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:27.485949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c88a1-31ef-46be-93ff-e0b2031f9175 service glance] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:27.499002 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2946/5876] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:48:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:48:27.500714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c88a1-31ef-46be-93ff-e0b2031f9175 service glance] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:27.503209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e84c88a1-31ef-46be-93ff-e0b2031f9175 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:27.551820 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2931/5877] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:27.560495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7ead7-9b17-4756-b085-ebcd85dd7c31 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:27.562694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-efd7ead7-9b17-4756-b085-ebcd85dd7c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:27.604222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c88a1-31ef-46be-93ff-e0b2031f9175 service glance] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:27.629664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:27.645888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7ead7-9b17-4756-b085-ebcd85dd7c31 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:27.649841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825cef7-87c3-433b-80cb-e3575f8c163b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:27.650490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825cef7-87c3-433b-80cb-e3575f8c163b service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:27.650797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825cef7-87c3-433b-80cb-e3575f8c163b service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:27.651075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825cef7-87c3-433b-80cb-e3575f8c163b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:27.660066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825cef7-87c3-433b-80cb-e3575f8c163b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:27.661523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825cef7-87c3-433b-80cb-e3575f8c163b service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:27.671572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50e12c-5317-4117-be34-9b677828b7ee tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:27.671766 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2932/5878] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:48:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:48:27.672641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50e12c-5317-4117-be34-9b677828b7ee tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:27.672926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50e12c-5317-4117-be34-9b677828b7ee tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:27.673030 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13348d58-f42a-4f27-8e8a-4f273e5f499c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:27.673208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50e12c-5317-4117-be34-9b677828b7ee tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/domains/4268881ad52c4eb9adb194b73b971d02` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:27.673327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13348d58-f42a-4f27-8e8a-4f273e5f499c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:27.673584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13348d58-f42a-4f27-8e8a-4f273e5f499c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:27.674526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50e12c-5317-4117-be34-9b677828b7ee tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4268881ad52c4eb9adb194b73b971d02)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:27.676265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50e12c-5317-4117-be34-9b677828b7ee tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:27.696162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-13348d58-f42a-4f27-8e8a-4f273e5f499c None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:27.697511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-13348d58-f42a-4f27-8e8a-4f273e5f499c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:27.708947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4b50e12c-5317-4117-be34-9b677828b7ee tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4268881ad52c4eb9adb194b73b971d02'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:27.710373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4b50e12c-5317-4117-be34-9b677828b7ee tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4268881ad52c4eb9adb194b73b971d02'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:27.729882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:27.763543 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2933/5879] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:48:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:27.771328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13348d58-f42a-4f27-8e8a-4f273e5f499c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:27.773205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-13348d58-f42a-4f27-8e8a-4f273e5f499c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:27.837974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4b50e12c-5317-4117-be34-9b677828b7ee tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4268881ad52c4eb9adb194b73b971d02'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:27.839003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4b50e12c-5317-4117-be34-9b677828b7ee tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4268881ad52c4eb9adb194b73b971d02'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:27.849118 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2947/5880] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:48:27 2022] PATCH /identity/v3/domains/4268881ad52c4eb9adb194b73b971d02 => generated 276 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:48:27.849118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50e12c-5317-4117-be34-9b677828b7ee tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:27.850966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4b50e12c-5317-4117-be34-9b677828b7ee tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:27.880575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13348d58-f42a-4f27-8e8a-4f273e5f499c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:27.996077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50e12c-5317-4117-be34-9b677828b7ee tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:28.001706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727ce9f-2232-41bb-a2e3-45be48853be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:28.003158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727ce9f-2232-41bb-a2e3-45be48853be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:28.003549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727ce9f-2232-41bb-a2e3-45be48853be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:28.004049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727ce9f-2232-41bb-a2e3-45be48853be1 admin admin] PATH_INFO: `/v3/projects/22265a03de2d478988f7a5ae2561e719` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:28.005078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9d4f3-aae4-4b41-a2fc-fcbd3bcd9b51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:28.005717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9d4f3-aae4-4b41-a2fc-fcbd3bcd9b51 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:28.005910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c727ce9f-2232-41bb-a2e3-45be48853be1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22265a03de2d478988f7a5ae2561e719)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:28.006083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9d4f3-aae4-4b41-a2fc-fcbd3bcd9b51 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:28.006297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9d4f3-aae4-4b41-a2fc-fcbd3bcd9b51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:28.008230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c727ce9f-2232-41bb-a2e3-45be48853be1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:28.011308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-96a9d4f3-aae4-4b41-a2fc-fcbd3bcd9b51 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:28.095262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9d4f3-aae4-4b41-a2fc-fcbd3bcd9b51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:28.097378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9d4f3-aae4-4b41-a2fc-fcbd3bcd9b51 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:28.111364 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2948/5881] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:48:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:48:28.113418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9d4f3-aae4-4b41-a2fc-fcbd3bcd9b51 service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:28.115075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-96a9d4f3-aae4-4b41-a2fc-fcbd3bcd9b51 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:28.148653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c727ce9f-2232-41bb-a2e3-45be48853be1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22265a03de2d478988f7a5ae2561e719', 'request_id': 'req-c727ce9f-2232-41bb-a2e3-45be48853be1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:28.224559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9d4f3-aae4-4b41-a2fc-fcbd3bcd9b51 service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:28.239291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c727ce9f-2232-41bb-a2e3-45be48853be1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22265a03de2d478988f7a5ae2561e719', 'request_id': 'req-c727ce9f-2232-41bb-a2e3-45be48853be1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:28.253403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c727ce9f-2232-41bb-a2e3-45be48853be1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22265a03de2d478988f7a5ae2561e719', 'request_id': 'req-c727ce9f-2232-41bb-a2e3-45be48853be1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:28.269226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c727ce9f-2232-41bb-a2e3-45be48853be1 admin admin] The token cache is being invalidate because project 22265a03de2d478988f7a5ae2561e719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:28.269537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c727ce9f-2232-41bb-a2e3-45be48853be1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:28.270269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c727ce9f-2232-41bb-a2e3-45be48853be1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:28.272416 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2934/5882] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:48:27 2022] DELETE /identity/v3/projects/22265a03de2d478988f7a5ae2561e719 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:28.277300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fad57-7aa7-4861-b065-e9d67e0ae94c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:28.277623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fad57-7aa7-4861-b065-e9d67e0ae94c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:28.278437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fad57-7aa7-4861-b065-e9d67e0ae94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:28.299668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:28.300681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:28.301242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:28.301887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/domains/4268881ad52c4eb9adb194b73b971d02` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:28.315942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4268881ad52c4eb9adb194b73b971d02)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:28.317809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b92fad57-7aa7-4861-b065-e9d67e0ae94c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:28.318240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:28.320380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b92fad57-7aa7-4861-b065-e9d67e0ae94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:28.343622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4268881ad52c4eb9adb194b73b971d02'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:28.356460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4268881ad52c4eb9adb194b73b971d02'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:28.400461 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2935/5883] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:28.408331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8b0df-8be4-4d1f-992d-cf3c330ed982 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:28.408621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8b0df-8be4-4d1f-992d-cf3c330ed982 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:28.408900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8b0df-8be4-4d1f-992d-cf3c330ed982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:28.431780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-45f8b0df-8be4-4d1f-992d-cf3c330ed982 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:28.433027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-45f8b0df-8be4-4d1f-992d-cf3c330ed982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:28.441243 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2936/5884] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:28.446108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8b0df-8be4-4d1f-992d-cf3c330ed982 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:28.460709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:28.466274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8b0df-8be4-4d1f-992d-cf3c330ed982 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:28.473361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe4a7f-bd3b-402b-8e5b-1ee0c6eb9d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:28.473987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe4a7f-bd3b-402b-8e5b-1ee0c6eb9d0c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:28.474319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe4a7f-bd3b-402b-8e5b-1ee0c6eb9d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:28.474600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe4a7f-bd3b-402b-8e5b-1ee0c6eb9d0c admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:28.475262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe4a7f-bd3b-402b-8e5b-1ee0c6eb9d0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:48:28.475570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe4a7f-bd3b-402b-8e5b-1ee0c6eb9d0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:28.477471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe4a7f-bd3b-402b-8e5b-1ee0c6eb9d0c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:28.495202 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2937/5885] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:48:28.496084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe4a7f-bd3b-402b-8e5b-1ee0c6eb9d0c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:28.504030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4268881ad52c4eb9adb194b73b971d02', 'request_id': 'req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:28.515868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe4a7f-bd3b-402b-8e5b-1ee0c6eb9d0c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:28.522809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4268881ad52c4eb9adb194b73b971d02', 'request_id': 'req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:28.531259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4268881ad52c4eb9adb194b73b971d02', 'request_id': 'req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:28.541777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:28.617941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] The token cache is being invalidate because project 4268881ad52c4eb9adb194b73b971d02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:28.617941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:28.619249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f57472-925a-4565-80e6-ac934f8b5b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:28.619667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:28.620361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f57472-925a-4565-80e6-ac934f8b5b69 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:28.620901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f57472-925a-4565-80e6-ac934f8b5b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:28.621277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f57472-925a-4565-80e6-ac934f8b5b69 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:28.624236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f57472-925a-4565-80e6-ac934f8b5b69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:28.627201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f57472-925a-4565-80e6-ac934f8b5b69 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:28.638186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4268881ad52c4eb9adb194b73b971d02', 'request_id': 'req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:28.640918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4268881ad52c4eb9adb194b73b971d02', 'request_id': 'req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:28.641741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4268881ad52c4eb9adb194b73b971d02', 'request_id': 'req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:28.660691 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2949/5886] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:48:28 2022] DELETE /identity/v3/domains/4268881ad52c4eb9adb194b73b971d02 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:28.664955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:28.682135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:28.746388 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2938/5887] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:48:28 2022] POST /identity/v3/projects => generated 403 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:28.747674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f57472-925a-4565-80e6-ac934f8b5b69 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:28.751756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-37f57472-925a-4565-80e6-ac934f8b5b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:28.817410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dbab7-b9b6-4039-9ab5-af7fa51ea2e4 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:28.873826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f57472-925a-4565-80e6-ac934f8b5b69 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:28.881611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230b0ba-dc7d-415f-8222-b8e20725b25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:28.882290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230b0ba-dc7d-415f-8222-b8e20725b25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:28.882623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230b0ba-dc7d-415f-8222-b8e20725b25a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:28.882894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230b0ba-dc7d-415f-8222-b8e20725b25a admin admin] PATH_INFO: `/v3/users/4fe2e814de124b98a9206248df24e040` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:28.884045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230b0ba-dc7d-415f-8222-b8e20725b25a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fe2e814de124b98a9206248df24e040)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:28.886012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230b0ba-dc7d-415f-8222-b8e20725b25a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:28.930176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be5091-d34f-4cb8-9fc6-8f65eef9bb7a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:28.930858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be5091-d34f-4cb8-9fc6-8f65eef9bb7a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:28.931144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be5091-d34f-4cb8-9fc6-8f65eef9bb7a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:28.931421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be5091-d34f-4cb8-9fc6-8f65eef9bb7a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/domains/305d786ab16e4a5bac505da4545b8a7d/users/4e215dbd38594c5c988704471b03ec34/roles/cfce367afe894e54ad8bd775074af9c0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:28.934898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be5091-d34f-4cb8-9fc6-8f65eef9bb7a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=305d786ab16e4a5bac505da4545b8a7d, user_id=4e215dbd38594c5c988704471b03ec34, role_id=cfce367afe894e54ad8bd775074af9c0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:28.937630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be5091-d34f-4cb8-9fc6-8f65eef9bb7a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:28.948033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-75be5091-d34f-4cb8-9fc6-8f65eef9bb7a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invalidating the token cache because role cfce367afe894e54ad8bd775074af9c0 was removed from user 4e215dbd38594c5c988704471b03ec34 on domain 305d786ab16e4a5bac505da4545b8a7d. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:28.948275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-75be5091-d34f-4cb8-9fc6-8f65eef9bb7a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:28.949056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-75be5091-d34f-4cb8-9fc6-8f65eef9bb7a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:29.048813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:29.066980 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2950/5888] 10.222.0.20 () {58 vars in 1464 bytes} [Thu Oct 27 03:48:28 2022] DELETE /identity/v3/domains/305d786ab16e4a5bac505da4545b8a7d/users/4e215dbd38594c5c988704471b03ec34/roles/cfce367afe894e54ad8bd775074af9c0 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:29.067949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be5091-d34f-4cb8-9fc6-8f65eef9bb7a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:29.069393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-75be5091-d34f-4cb8-9fc6-8f65eef9bb7a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:29.113399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9230b0ba-dc7d-415f-8222-b8e20725b25a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fe2e814de124b98a9206248df24e040'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:29.117411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9230b0ba-dc7d-415f-8222-b8e20725b25a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fe2e814de124b98a9206248df24e040'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:29.151718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9230b0ba-dc7d-415f-8222-b8e20725b25a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fe2e814de124b98a9206248df24e040'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:29.203351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9230b0ba-dc7d-415f-8222-b8e20725b25a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fe2e814de124b98a9206248df24e040'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:29.237738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be5091-d34f-4cb8-9fc6-8f65eef9bb7a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:29.248100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144ccc7-9ea1-4a6c-a70f-d48cc3ba80d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:29.248844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144ccc7-9ea1-4a6c-a70f-d48cc3ba80d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:29.249230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144ccc7-9ea1-4a6c-a70f-d48cc3ba80d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:29.250134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144ccc7-9ea1-4a6c-a70f-d48cc3ba80d5 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:29.250430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144ccc7-9ea1-4a6c-a70f-d48cc3ba80d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:29.252453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144ccc7-9ea1-4a6c-a70f-d48cc3ba80d5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:29.282814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9230b0ba-dc7d-415f-8222-b8e20725b25a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fe2e814de124b98a9206248df24e040'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:29.294144 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2939/5889] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:28 2022] DELETE /identity/v3/users/4fe2e814de124b98a9206248df24e040 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:29.294144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230b0ba-dc7d-415f-8222-b8e20725b25a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:29.294544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9230b0ba-dc7d-415f-8222-b8e20725b25a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:29.365738 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2951/5890] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:48:29 2022] POST /identity/v3/users => generated 302 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:29.367117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7963e-e86f-4c95-894e-4b304433b5bc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:29.367524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7963e-e86f-4c95-894e-4b304433b5bc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:29.367899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7963e-e86f-4c95-894e-4b304433b5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:29.377157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:29.404420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230b0ba-dc7d-415f-8222-b8e20725b25a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:29.404545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-acc7963e-e86f-4c95-894e-4b304433b5bc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:29.409428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-acc7963e-e86f-4c95-894e-4b304433b5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:29.413820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4ca10-8e67-48d0-bc1c-4c356f348fb6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:29.414520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4ca10-8e67-48d0-bc1c-4c356f348fb6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:29.414807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4ca10-8e67-48d0-bc1c-4c356f348fb6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:29.415084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4ca10-8e67-48d0-bc1c-4c356f348fb6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/roles/cfce367afe894e54ad8bd775074af9c0` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:29.416508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4ca10-8e67-48d0-bc1c-4c356f348fb6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cfce367afe894e54ad8bd775074af9c0)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:29.418573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4ca10-8e67-48d0-bc1c-4c356f348fb6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:29.487777 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2952/5891] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:29.489005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7963e-e86f-4c95-894e-4b304433b5bc None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:29.490405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-acc7963e-e86f-4c95-894e-4b304433b5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:29.503996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7963e-e86f-4c95-894e-4b304433b5bc None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:29.509128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b83cd9-2aa6-49af-8550-768357ef0b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:29.509861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b83cd9-2aa6-49af-8550-768357ef0b3b admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:29.510283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b83cd9-2aa6-49af-8550-768357ef0b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:29.510662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b83cd9-2aa6-49af-8550-768357ef0b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:29.511477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b83cd9-2aa6-49af-8550-768357ef0b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:29.513775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b83cd9-2aa6-49af-8550-768357ef0b3b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:29.525512 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2953/5892] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:29 2022] GET /identity/v3/roles => generated 1650 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:29.526493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b83cd9-2aa6-49af-8550-768357ef0b3b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:29.528344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-80b83cd9-2aa6-49af-8550-768357ef0b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:29.555874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7dd4ca10-8e67-48d0-bc1c-4c356f348fb6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invalidating the token cache because role cfce367afe894e54ad8bd775074af9c0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:29.555874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7dd4ca10-8e67-48d0-bc1c-4c356f348fb6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:29.555874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7dd4ca10-8e67-48d0-bc1c-4c356f348fb6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:29.555874 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2940/5893] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:29 2022] DELETE /identity/v3/roles/cfce367afe894e54ad8bd775074af9c0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:29.556838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4ca10-8e67-48d0-bc1c-4c356f348fb6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:29.560877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7dd4ca10-8e67-48d0-bc1c-4c356f348fb6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:29.675562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b83cd9-2aa6-49af-8550-768357ef0b3b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:29.709997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4ca10-8e67-48d0-bc1c-4c356f348fb6 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:29.719126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fe238-140f-4826-9e36-1a0a9a8e4b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:29.720126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fe238-140f-4826-9e36-1a0a9a8e4b2c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:29.720554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fe238-140f-4826-9e36-1a0a9a8e4b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:29.721000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fe238-140f-4826-9e36-1a0a9a8e4b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:29.722707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0fe238-140f-4826-9e36-1a0a9a8e4b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:29.724458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0fe238-140f-4826-9e36-1a0a9a8e4b2c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:29.740357 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2941/5894] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:29.741204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fe238-140f-4826-9e36-1a0a9a8e4b2c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:29.745276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fa0fe238-140f-4826-9e36-1a0a9a8e4b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:29.792989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c06ed4-5d7f-41d0-8570-3b9196efc7a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:29.793640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c06ed4-5d7f-41d0-8570-3b9196efc7a0 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:29.793926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c06ed4-5d7f-41d0-8570-3b9196efc7a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:29.794276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c06ed4-5d7f-41d0-8570-3b9196efc7a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:29.797101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-62c06ed4-5d7f-41d0-8570-3b9196efc7a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:29.813177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c06ed4-5d7f-41d0-8570-3b9196efc7a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:29.815170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c06ed4-5d7f-41d0-8570-3b9196efc7a0 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:29.828379 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2954/5895] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:48:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:48:29.829224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c06ed4-5d7f-41d0-8570-3b9196efc7a0 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:29.843671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fe238-140f-4826-9e36-1a0a9a8e4b2c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:29.843954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c06ed4-5d7f-41d0-8570-3b9196efc7a0 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:29.849143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132be12f-4a7e-46af-88cd-471c6e3d0a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:29.849627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166b165-8f64-4b33-b404-c39fc591c963 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:29.850320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132be12f-4a7e-46af-88cd-471c6e3d0a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:29.850453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166b165-8f64-4b33-b404-c39fc591c963 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:29.850791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166b165-8f64-4b33-b404-c39fc591c963 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:29.851021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132be12f-4a7e-46af-88cd-471c6e3d0a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:29.851251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166b165-8f64-4b33-b404-c39fc591c963 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/domains/305d786ab16e4a5bac505da4545b8a7d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:29.851614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132be12f-4a7e-46af-88cd-471c6e3d0a67 admin admin] PATH_INFO: `/v3/projects/a3d03faa410840e0ae6d7523188d63b6/users/2fc1e7eafd7948279f08eb5ad52f5609/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:29.852640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166b165-8f64-4b33-b404-c39fc591c963 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=305d786ab16e4a5bac505da4545b8a7d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:29.854439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166b165-8f64-4b33-b404-c39fc591c963 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:29.870747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132be12f-4a7e-46af-88cd-471c6e3d0a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d03faa410840e0ae6d7523188d63b6, user_id=2fc1e7eafd7948279f08eb5ad52f5609, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:29.874312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132be12f-4a7e-46af-88cd-471c6e3d0a67 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:29.883195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e166b165-8f64-4b33-b404-c39fc591c963 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '305d786ab16e4a5bac505da4545b8a7d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:29.884277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e166b165-8f64-4b33-b404-c39fc591c963 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '305d786ab16e4a5bac505da4545b8a7d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:29.955372 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2955/5896] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:29 2022] PUT /identity/v3/projects/a3d03faa410840e0ae6d7523188d63b6/users/2fc1e7eafd7948279f08eb5ad52f5609/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:29.960566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93104ca2-6f4b-48c3-96d7-643cbe2100b9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:29.960966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93104ca2-6f4b-48c3-96d7-643cbe2100b9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:29.961373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93104ca2-6f4b-48c3-96d7-643cbe2100b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:29.981470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-93104ca2-6f4b-48c3-96d7-643cbe2100b9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:29.982839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-93104ca2-6f4b-48c3-96d7-643cbe2100b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:30.015672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:30.024343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e166b165-8f64-4b33-b404-c39fc591c963 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '305d786ab16e4a5bac505da4545b8a7d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:30.029345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e166b165-8f64-4b33-b404-c39fc591c963 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '305d786ab16e4a5bac505da4545b8a7d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:30.033187 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2942/5897] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:48:29 2022] PATCH /identity/v3/domains/305d786ab16e4a5bac505da4545b8a7d => generated 277 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:48:30.036481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166b165-8f64-4b33-b404-c39fc591c963 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:30.037863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e166b165-8f64-4b33-b404-c39fc591c963 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:30.067972 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2956/5898] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:48:30.080377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93104ca2-6f4b-48c3-96d7-643cbe2100b9 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:30.082707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-93104ca2-6f4b-48c3-96d7-643cbe2100b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:30.236298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93104ca2-6f4b-48c3-96d7-643cbe2100b9 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:30.241119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320b233-3e81-4718-9d9b-b6da515cfa7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:30.241896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320b233-3e81-4718-9d9b-b6da515cfa7d service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:30.242380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320b233-3e81-4718-9d9b-b6da515cfa7d service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:30.249669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320b233-3e81-4718-9d9b-b6da515cfa7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:30.250054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166b165-8f64-4b33-b404-c39fc591c963 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:30.265377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320b233-3e81-4718-9d9b-b6da515cfa7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:30.271993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320b233-3e81-4718-9d9b-b6da515cfa7d service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:30.287914 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2957/5899] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:48:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:48:30.360732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074f5fe-27fe-47b0-9af9-6264edac5f21 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:30.361394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074f5fe-27fe-47b0-9af9-6264edac5f21 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:30.361684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074f5fe-27fe-47b0-9af9-6264edac5f21 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:30.362133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074f5fe-27fe-47b0-9af9-6264edac5f21 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/domains/305d786ab16e4a5bac505da4545b8a7d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:30.373953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074f5fe-27fe-47b0-9af9-6264edac5f21 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=305d786ab16e4a5bac505da4545b8a7d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:30.375844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074f5fe-27fe-47b0-9af9-6264edac5f21 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:30.400428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5074f5fe-27fe-47b0-9af9-6264edac5f21 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '305d786ab16e4a5bac505da4545b8a7d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:30.411374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5074f5fe-27fe-47b0-9af9-6264edac5f21 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '305d786ab16e4a5bac505da4545b8a7d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:30.563229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320b233-3e81-4718-9d9b-b6da515cfa7d service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:30.570497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d320b233-3e81-4718-9d9b-b6da515cfa7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:30.585197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5074f5fe-27fe-47b0-9af9-6264edac5f21 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '305d786ab16e4a5bac505da4545b8a7d', 'request_id': 'req-5074f5fe-27fe-47b0-9af9-6264edac5f21'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:30.618828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320b233-3e81-4718-9d9b-b6da515cfa7d service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:30.707264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b46d29-ed46-46f4-9d10-0d46edc0079c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:30.707943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b46d29-ed46-46f4-9d10-0d46edc0079c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:30.708231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b46d29-ed46-46f4-9d10-0d46edc0079c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:30.708512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b46d29-ed46-46f4-9d10-0d46edc0079c admin admin] PATH_INFO: `/v3/projects/ca9c45864f75485095bb9428892c55d8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:30.709702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b46d29-ed46-46f4-9d10-0d46edc0079c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca9c45864f75485095bb9428892c55d8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:30.711674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b46d29-ed46-46f4-9d10-0d46edc0079c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:31.106561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5074f5fe-27fe-47b0-9af9-6264edac5f21 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '305d786ab16e4a5bac505da4545b8a7d', 'request_id': 'req-5074f5fe-27fe-47b0-9af9-6264edac5f21'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:31.121401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5074f5fe-27fe-47b0-9af9-6264edac5f21 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '305d786ab16e4a5bac505da4545b8a7d', 'request_id': 'req-5074f5fe-27fe-47b0-9af9-6264edac5f21'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:31.158760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:31.176157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5074f5fe-27fe-47b0-9af9-6264edac5f21 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] The token cache is being invalidate because project 305d786ab16e4a5bac505da4545b8a7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:31.176807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5074f5fe-27fe-47b0-9af9-6264edac5f21 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:31.181628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5074f5fe-27fe-47b0-9af9-6264edac5f21 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:31.196712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c1b46d29-ed46-46f4-9d10-0d46edc0079c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca9c45864f75485095bb9428892c55d8', 'request_id': 'req-c1b46d29-ed46-46f4-9d10-0d46edc0079c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:31.224220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c1b46d29-ed46-46f4-9d10-0d46edc0079c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca9c45864f75485095bb9428892c55d8', 'request_id': 'req-c1b46d29-ed46-46f4-9d10-0d46edc0079c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:31.228554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5074f5fe-27fe-47b0-9af9-6264edac5f21 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '305d786ab16e4a5bac505da4545b8a7d', 'request_id': 'req-5074f5fe-27fe-47b0-9af9-6264edac5f21'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:31.238869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5074f5fe-27fe-47b0-9af9-6264edac5f21 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '305d786ab16e4a5bac505da4545b8a7d', 'request_id': 'req-5074f5fe-27fe-47b0-9af9-6264edac5f21'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:31.241013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5074f5fe-27fe-47b0-9af9-6264edac5f21 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '305d786ab16e4a5bac505da4545b8a7d', 'request_id': 'req-5074f5fe-27fe-47b0-9af9-6264edac5f21'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:31.241828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c1b46d29-ed46-46f4-9d10-0d46edc0079c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca9c45864f75485095bb9428892c55d8', 'request_id': 'req-c1b46d29-ed46-46f4-9d10-0d46edc0079c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:31.273214 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2943/5900] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:48:30 2022] DELETE /identity/v3/domains/305d786ab16e4a5bac505da4545b8a7d => generated 0 bytes in 1237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:48:31.282568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074f5fe-27fe-47b0-9af9-6264edac5f21 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:31.289905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5074f5fe-27fe-47b0-9af9-6264edac5f21 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:31.375009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c1b46d29-ed46-46f4-9d10-0d46edc0079c admin admin] The token cache is being invalidate because project ca9c45864f75485095bb9428892c55d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:31.375895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c1b46d29-ed46-46f4-9d10-0d46edc0079c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:31.376141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c1b46d29-ed46-46f4-9d10-0d46edc0079c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:31.377706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074f5fe-27fe-47b0-9af9-6264edac5f21 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:31.380358 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2958/5901] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:48:30 2022] DELETE /identity/v3/projects/ca9c45864f75485095bb9428892c55d8 => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:48:31.385495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b46d29-ed46-46f4-9d10-0d46edc0079c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:31.387744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c1b46d29-ed46-46f4-9d10-0d46edc0079c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:31.453635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fb5c6-6685-4624-ae5c-ba776e359452 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:31.454456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fb5c6-6685-4624-ae5c-ba776e359452 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:31.454742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fb5c6-6685-4624-ae5c-ba776e359452 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:31.455245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fb5c6-6685-4624-ae5c-ba776e359452 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:31.456429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428fb5c6-6685-4624-ae5c-ba776e359452 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:31.458073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428fb5c6-6685-4624-ae5c-ba776e359452 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:31.468011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:UPDATE=1,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:31.476860 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2944/5902] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:48:31.480213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fb5c6-6685-4624-ae5c-ba776e359452 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:31.488729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-428fb5c6-6685-4624-ae5c-ba776e359452 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:31.504733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b46d29-ed46-46f4-9d10-0d46edc0079c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:31.510751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca60abb-841a-4edb-bd94-699e834dadcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:31.511841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca60abb-841a-4edb-bd94-699e834dadcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:31.511841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca60abb-841a-4edb-bd94-699e834dadcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:31.512064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca60abb-841a-4edb-bd94-699e834dadcb admin admin] PATH_INFO: `/v3/users/b7fc7f7daec94aaca645f48af70c31db` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:31.514597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca60abb-841a-4edb-bd94-699e834dadcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7fc7f7daec94aaca645f48af70c31db)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:31.515258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca60abb-841a-4edb-bd94-699e834dadcb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:31.519130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fb5c6-6685-4624-ae5c-ba776e359452 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:31.531553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829dda5-f712-4ef9-907f-b7732ba7bfb8 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:31.532325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829dda5-f712-4ef9-907f-b7732ba7bfb8 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:31.532598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829dda5-f712-4ef9-907f-b7732ba7bfb8 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:31.532881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829dda5-f712-4ef9-907f-b7732ba7bfb8 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/projects/85f8bb3f5ec14274b796c838792c8116/users/04b15b545dd1482abd1bd125dd1921e2/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:31.535191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829dda5-f712-4ef9-907f-b7732ba7bfb8 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:create_grant(project_id=85f8bb3f5ec14274b796c838792c8116, user_id=04b15b545dd1482abd1bd125dd1921e2, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:31.538332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829dda5-f712-4ef9-907f-b7732ba7bfb8 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:31.631313 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2945/5903] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:31 2022] PUT /identity/v3/projects/85f8bb3f5ec14274b796c838792c8116/users/04b15b545dd1482abd1bd125dd1921e2/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:48:31.639580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829dda5-f712-4ef9-907f-b7732ba7bfb8 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:31.752820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cca60abb-841a-4edb-bd94-699e834dadcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7fc7f7daec94aaca645f48af70c31db'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:31.753727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cca60abb-841a-4edb-bd94-699e834dadcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7fc7f7daec94aaca645f48af70c31db'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:31.754000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829dda5-f712-4ef9-907f-b7732ba7bfb8 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:31.759980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b43bb-18ee-4b4d-84b5-54c099edf2f3 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:31.761225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b43bb-18ee-4b4d-84b5-54c099edf2f3 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:31.761695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b43bb-18ee-4b4d-84b5-54c099edf2f3 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:31.763773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cca60abb-841a-4edb-bd94-699e834dadcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7fc7f7daec94aaca645f48af70c31db'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:31.770473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b43bb-18ee-4b4d-84b5-54c099edf2f3 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:31.771567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b43bb-18ee-4b4d-84b5-54c099edf2f3 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:31.772991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b43bb-18ee-4b4d-84b5-54c099edf2f3 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:31.783851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cca60abb-841a-4edb-bd94-699e834dadcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7fc7f7daec94aaca645f48af70c31db'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:31.784749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cca60abb-841a-4edb-bd94-699e834dadcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7fc7f7daec94aaca645f48af70c31db'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:31.837825 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2946/5904] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:48:31 2022] GET /identity/v3/auth/projects => generated 826 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:48:31.841857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b43bb-18ee-4b4d-84b5-54c099edf2f3 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:31.844744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-943b43bb-18ee-4b4d-84b5-54c099edf2f3 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:31.853126 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2959/5905] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:31 2022] DELETE /identity/v3/users/b7fc7f7daec94aaca645f48af70c31db => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:31.859811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b43bb-18ee-4b4d-84b5-54c099edf2f3 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:31.941227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90832553-aed2-4656-bd3b-06e6ec565cc8 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:31.943688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90832553-aed2-4656-bd3b-06e6ec565cc8 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:31.943688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90832553-aed2-4656-bd3b-06e6ec565cc8 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:31.943688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90832553-aed2-4656-bd3b-06e6ec565cc8 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/projects/85f8bb3f5ec14274b796c838792c8116/users/04b15b545dd1482abd1bd125dd1921e2/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:31.946084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90832553-aed2-4656-bd3b-06e6ec565cc8 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=85f8bb3f5ec14274b796c838792c8116, user_id=04b15b545dd1482abd1bd125dd1921e2, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:31.949032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90832553-aed2-4656-bd3b-06e6ec565cc8 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:31.955837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-90832553-aed2-4656-bd3b-06e6ec565cc8 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invalidating the token cache because role 6e91e7a416ac452b86ec238a2b81bc07 was removed from user 04b15b545dd1482abd1bd125dd1921e2 on project 85f8bb3f5ec14274b796c838792c8116. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:31.956213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-90832553-aed2-4656-bd3b-06e6ec565cc8 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:31.957034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-90832553-aed2-4656-bd3b-06e6ec565cc8 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:32.094787 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2947/5906] 10.222.0.20 () {58 vars in 1467 bytes} [Thu Oct 27 03:48:31 2022] DELETE /identity/v3/projects/85f8bb3f5ec14274b796c838792c8116/users/04b15b545dd1482abd1bd125dd1921e2/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:48:32.099916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca60abb-841a-4edb-bd94-699e834dadcb admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:32.117134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca60abb-841a-4edb-bd94-699e834dadcb admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:32.210406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07caf4e0-4c92-4a67-85ab-7039b7847c30 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:32.211295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07caf4e0-4c92-4a67-85ab-7039b7847c30 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:32.212326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07caf4e0-4c92-4a67-85ab-7039b7847c30 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:32.212939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07caf4e0-4c92-4a67-85ab-7039b7847c30 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:32.213846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07caf4e0-4c92-4a67-85ab-7039b7847c30 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:32.218745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07caf4e0-4c92-4a67-85ab-7039b7847c30 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:32.314425 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2960/5907] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:48:32 2022] POST /identity/v3/users => generated 323 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:48:32.318246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90832553-aed2-4656-bd3b-06e6ec565cc8 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:32.325967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-90832553-aed2-4656-bd3b-06e6ec565cc8 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:32.358724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:32.362409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90832553-aed2-4656-bd3b-06e6ec565cc8 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:32.379546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46697934-3de1-4d42-9e03-a762257cf555 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:32.382347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46697934-3de1-4d42-9e03-a762257cf555 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:32.382639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46697934-3de1-4d42-9e03-a762257cf555 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:32.382927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46697934-3de1-4d42-9e03-a762257cf555 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:32.383967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46697934-3de1-4d42-9e03-a762257cf555 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:32.389913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46697934-3de1-4d42-9e03-a762257cf555 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:32.604326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07caf4e0-4c92-4a67-85ab-7039b7847c30 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:32.604888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-07caf4e0-4c92-4a67-85ab-7039b7847c30 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:32.624880 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2948/5908] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:48:32 2022] POST /identity/v3/projects => generated 364 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:32.626441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46697934-3de1-4d42-9e03-a762257cf555 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:32.758575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46697934-3de1-4d42-9e03-a762257cf555 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:32.765624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07caf4e0-4c92-4a67-85ab-7039b7847c30 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:32.769672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9debcb5-5e4f-4607-a874-d58102427b73 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:32.770555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9debcb5-5e4f-4607-a874-d58102427b73 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:32.770692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9debcb5-5e4f-4607-a874-d58102427b73 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:32.771268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9debcb5-5e4f-4607-a874-d58102427b73 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:32.773363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9debcb5-5e4f-4607-a874-d58102427b73 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:32.776734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9debcb5-5e4f-4607-a874-d58102427b73 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:32.872081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424d3b5-afce-4a74-8f2b-88858b7873c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:32.872081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424d3b5-afce-4a74-8f2b-88858b7873c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:32.872081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424d3b5-afce-4a74-8f2b-88858b7873c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:32.872311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424d3b5-afce-4a74-8f2b-88858b7873c6 admin admin] PATH_INFO: `/v3/projects/3eb0f9b843de45e591d841516ef7f8f2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:32.873928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424d3b5-afce-4a74-8f2b-88858b7873c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eb0f9b843de45e591d841516ef7f8f2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:32.876717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424d3b5-afce-4a74-8f2b-88858b7873c6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:32.927879 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2949/5909] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:48:32 2022] POST /identity/v3/projects => generated 362 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:32.928982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9debcb5-5e4f-4607-a874-d58102427b73 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:33.018724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9debcb5-5e4f-4607-a874-d58102427b73 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:33.023960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdd40d-25d7-4b9c-a6f7-dd80c7eadf39 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:33.024582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdd40d-25d7-4b9c-a6f7-dd80c7eadf39 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:33.024856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdd40d-25d7-4b9c-a6f7-dd80c7eadf39 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:33.025124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdd40d-25d7-4b9c-a6f7-dd80c7eadf39 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:33.025851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdd40d-25d7-4b9c-a6f7-dd80c7eadf39 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:33.027509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdd40d-25d7-4b9c-a6f7-dd80c7eadf39 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:33.050023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4424d3b5-afce-4a74-8f2b-88858b7873c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eb0f9b843de45e591d841516ef7f8f2', 'request_id': 'req-4424d3b5-afce-4a74-8f2b-88858b7873c6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:33.056838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4424d3b5-afce-4a74-8f2b-88858b7873c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eb0f9b843de45e591d841516ef7f8f2', 'request_id': 'req-4424d3b5-afce-4a74-8f2b-88858b7873c6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:33.063529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4424d3b5-afce-4a74-8f2b-88858b7873c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eb0f9b843de45e591d841516ef7f8f2', 'request_id': 'req-4424d3b5-afce-4a74-8f2b-88858b7873c6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:33.144365 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2950/5910] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:48:32 2022] POST /identity/v3/roles => generated 239 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:33.149065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdd40d-25d7-4b9c-a6f7-dd80c7eadf39 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:33.151058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4424d3b5-afce-4a74-8f2b-88858b7873c6 admin admin] The token cache is being invalidate because project 3eb0f9b843de45e591d841516ef7f8f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:33.151455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4424d3b5-afce-4a74-8f2b-88858b7873c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:33.159773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4424d3b5-afce-4a74-8f2b-88858b7873c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:33.166311 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2961/5911] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:48:32 2022] DELETE /identity/v3/projects/3eb0f9b843de45e591d841516ef7f8f2 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:48:33.166489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdd40d-25d7-4b9c-a6f7-dd80c7eadf39 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:33.169787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b351cd-7069-4591-b26e-5c105a6aa06d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:33.170442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b351cd-7069-4591-b26e-5c105a6aa06d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:33.170948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b351cd-7069-4591-b26e-5c105a6aa06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:33.207718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c5b351cd-7069-4591-b26e-5c105a6aa06d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:33.211144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c5b351cd-7069-4591-b26e-5c105a6aa06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:33.303356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a84dbf-3356-4d81-b9f7-7b2c3f105f29 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:33.305755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a84dbf-3356-4d81-b9f7-7b2c3f105f29 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:33.306489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a84dbf-3356-4d81-b9f7-7b2c3f105f29 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:33.306489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a84dbf-3356-4d81-b9f7-7b2c3f105f29 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/projects/a668e8b8c49f43b887f0b1fa221bc654/users/5ce1efee948f4aafbe270daf3c416df6/roles/aaf39a01872748c1a39d27d586abf544` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:33.326619 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2962/5912] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:48:33.328740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcabdd9-36d6-4f3b-b2d3-953fd6084c96 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:33.329027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcabdd9-36d6-4f3b-b2d3-953fd6084c96 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:33.338179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcabdd9-36d6-4f3b-b2d3-953fd6084c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:33.344082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a84dbf-3356-4d81-b9f7-7b2c3f105f29 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a668e8b8c49f43b887f0b1fa221bc654, user_id=5ce1efee948f4aafbe270daf3c416df6, role_id=aaf39a01872748c1a39d27d586abf544)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:33.349484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a84dbf-3356-4d81-b9f7-7b2c3f105f29 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:33.376542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-5fcabdd9-36d6-4f3b-b2d3-953fd6084c96 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:33.380120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5fcabdd9-36d6-4f3b-b2d3-953fd6084c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:33.393420 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2963/5913] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:48:33.398239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcabdd9-36d6-4f3b-b2d3-953fd6084c96 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:33.411353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcabdd9-36d6-4f3b-b2d3-953fd6084c96 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:33.419363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f83f2-a3b5-430f-ba32-647ae9f61b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:33.420404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f83f2-a3b5-430f-ba32-647ae9f61b5a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:33.420754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f83f2-a3b5-430f-ba32-647ae9f61b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:33.421111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f83f2-a3b5-430f-ba32-647ae9f61b5a admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:33.422136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f83f2-a3b5-430f-ba32-647ae9f61b5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:48:33.422526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f83f2-a3b5-430f-ba32-647ae9f61b5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:33.424730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f83f2-a3b5-430f-ba32-647ae9f61b5a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:33.442089 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2964/5914] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:48:33.445009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f83f2-a3b5-430f-ba32-647ae9f61b5a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:33.456535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f83f2-a3b5-430f-ba32-647ae9f61b5a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:33.463562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe2125-e01d-46e1-bf7a-3a8920babb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:33.463834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe2125-e01d-46e1-bf7a-3a8920babb11 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:33.464019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe2125-e01d-46e1-bf7a-3a8920babb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:33.464295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe2125-e01d-46e1-bf7a-3a8920babb11 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:33.465058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe2125-e01d-46e1-bf7a-3a8920babb11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:33.467485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe2125-e01d-46e1-bf7a-3a8920babb11 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:33.488590 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2951/5915] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:33 2022] PUT /identity/v3/projects/a668e8b8c49f43b887f0b1fa221bc654/users/5ce1efee948f4aafbe270daf3c416df6/roles/aaf39a01872748c1a39d27d586abf544 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:33.490592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a84dbf-3356-4d81-b9f7-7b2c3f105f29 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:33.494188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-66a84dbf-3356-4d81-b9f7-7b2c3f105f29 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:33.605804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a84dbf-3356-4d81-b9f7-7b2c3f105f29 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:33.621149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54bf4e-2df1-4cc3-b1ec-db08e2217f06 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:33.624919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54bf4e-2df1-4cc3-b1ec-db08e2217f06 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:33.624919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54bf4e-2df1-4cc3-b1ec-db08e2217f06 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:33.624919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54bf4e-2df1-4cc3-b1ec-db08e2217f06 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/projects/28bb576defb149f58583909b608745fa/users/5ce1efee948f4aafbe270daf3c416df6/roles/aaf39a01872748c1a39d27d586abf544` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:33.629453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54bf4e-2df1-4cc3-b1ec-db08e2217f06 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:create_grant(project_id=28bb576defb149f58583909b608745fa, user_id=5ce1efee948f4aafbe270daf3c416df6, role_id=aaf39a01872748c1a39d27d586abf544)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:33.640022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54bf4e-2df1-4cc3-b1ec-db08e2217f06 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:33.644450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:33.660529 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2965/5916] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:48:33 2022] POST /identity/v3/projects => generated 385 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:33.661699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe2125-e01d-46e1-bf7a-3a8920babb11 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:33.834102 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2952/5917] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:33 2022] PUT /identity/v3/projects/28bb576defb149f58583909b608745fa/users/5ce1efee948f4aafbe270daf3c416df6/roles/aaf39a01872748c1a39d27d586abf544 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:33.834102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:UPDATE=3,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:33.836687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c08f43-3f27-4fa4-b2b4-150aed596312 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:33.838448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c08f43-3f27-4fa4-b2b4-150aed596312 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:33.838959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c08f43-3f27-4fa4-b2b4-150aed596312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:33.847651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe2125-e01d-46e1-bf7a-3a8920babb11 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:33.880952 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d3c08f43-3f27-4fa4-b2b4-150aed596312 None None] MFA Rules not processed for user `5ce1efee948f4aafbe270daf3c416df6`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:33.894649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d3c08f43-3f27-4fa4-b2b4-150aed596312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:33.906878 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2953/5918] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:33 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:48:33.911144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f22e8e-0485-494d-a849-caf219fb9d7b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:33.911709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f22e8e-0485-494d-a849-caf219fb9d7b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:33.912304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f22e8e-0485-494d-a849-caf219fb9d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:33.953220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b6f22e8e-0485-494d-a849-caf219fb9d7b None None] MFA Rules not processed for user `5ce1efee948f4aafbe270daf3c416df6`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:33.956420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b6f22e8e-0485-494d-a849-caf219fb9d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:33.981974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe4cfc-962e-4aee-a156-0541edaba835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:33.982912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe4cfc-962e-4aee-a156-0541edaba835 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:33.983383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe4cfc-962e-4aee-a156-0541edaba835 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:33.983664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe4cfc-962e-4aee-a156-0541edaba835 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:33.984297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe4cfc-962e-4aee-a156-0541edaba835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:33.988467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe4cfc-962e-4aee-a156-0541edaba835 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:34.066620 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2954/5919] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:33 2022] POST /identity/v3/auth/tokens => generated 3225 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 27 03:48:34.070537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f22e8e-0485-494d-a849-caf219fb9d7b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:34.113299 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2966/5920] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:48:33 2022] POST /identity/v3/users => generated 293 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:34.117519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe4cfc-962e-4aee-a156-0541edaba835 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:34.162256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe4cfc-962e-4aee-a156-0541edaba835 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:34.177338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fab687-3589-4d3b-ad74-e6db204b2b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:34.178771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fab687-3589-4d3b-ad74-e6db204b2b1e admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:34.198095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fab687-3589-4d3b-ad74-e6db204b2b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:34.198609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fab687-3589-4d3b-ad74-e6db204b2b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:34.200951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fab687-3589-4d3b-ad74-e6db204b2b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:34.209032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fab687-3589-4d3b-ad74-e6db204b2b1e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:34.228109 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2967/5921] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:34 2022] GET /identity/v3/roles => generated 1650 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:48:34.229279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fab687-3589-4d3b-ad74-e6db204b2b1e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:34.241686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fab687-3589-4d3b-ad74-e6db204b2b1e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:34.246832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f22e8e-0485-494d-a849-caf219fb9d7b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:34.249712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1589bc-a1ef-497d-a203-4179d3e6170a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:34.250619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1589bc-a1ef-497d-a203-4179d3e6170a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:34.251114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1589bc-a1ef-497d-a203-4179d3e6170a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:34.251565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1589bc-a1ef-497d-a203-4179d3e6170a admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:34.252487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1589bc-a1ef-497d-a203-4179d3e6170a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:34.255223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1589bc-a1ef-497d-a203-4179d3e6170a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:34.255467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33b8d9-ba05-4b24-8891-9931a9bde6cb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:34.258771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33b8d9-ba05-4b24-8891-9931a9bde6cb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:34.258771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33b8d9-ba05-4b24-8891-9931a9bde6cb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:34.258771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33b8d9-ba05-4b24-8891-9931a9bde6cb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:34.276776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33b8d9-ba05-4b24-8891-9931a9bde6cb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:34.281771 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2968/5922] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:34 2022] GET /identity/v3/roles => generated 1650 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:34.282005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33b8d9-ba05-4b24-8891-9931a9bde6cb tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:34.282198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1589bc-a1ef-497d-a203-4179d3e6170a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:34.300322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1589bc-a1ef-497d-a203-4179d3e6170a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:34.306259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38267f01-db08-4a8a-b3f6-8789b28ad1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:34.307496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38267f01-db08-4a8a-b3f6-8789b28ad1b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:34.307786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38267f01-db08-4a8a-b3f6-8789b28ad1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:34.308066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38267f01-db08-4a8a-b3f6-8789b28ad1b1 admin admin] PATH_INFO: `/v3/projects/f080de92dd9849d1914a85f0f28cc19a/users/363cbeb57b7c4c2ca57c6c9777a451da/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:34.338228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38267f01-db08-4a8a-b3f6-8789b28ad1b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f080de92dd9849d1914a85f0f28cc19a, user_id=363cbeb57b7c4c2ca57c6c9777a451da, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:34.342194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38267f01-db08-4a8a-b3f6-8789b28ad1b1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:34.376537 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2955/5923] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Oct 27 03:48:34 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:34.382008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b5529-4905-41f7-a9b6-b5608ee3a805 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:34.385025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b5529-4905-41f7-a9b6-b5608ee3a805 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:34.385025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b5529-4905-41f7-a9b6-b5608ee3a805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:34.417097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9a6b5529-4905-41f7-a9b6-b5608ee3a805 None None] MFA Rules not processed for user `5ce1efee948f4aafbe270daf3c416df6`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:34.418020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9a6b5529-4905-41f7-a9b6-b5608ee3a805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:34.472997 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2969/5924] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:34 2022] PUT /identity/v3/projects/f080de92dd9849d1914a85f0f28cc19a/users/363cbeb57b7c4c2ca57c6c9777a451da/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:34.475629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da61346-8945-4758-a303-d59e3e588df9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:34.475915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da61346-8945-4758-a303-d59e3e588df9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:34.476193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da61346-8945-4758-a303-d59e3e588df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:34.543925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3da61346-8945-4758-a303-d59e3e588df9 None None] MFA Rules not processed for user `363cbeb57b7c4c2ca57c6c9777a451da`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:34.545525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3da61346-8945-4758-a303-d59e3e588df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:34.588984 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2956/5925] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:34 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 27 03:48:34.595249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b5529-4905-41f7-a9b6-b5608ee3a805 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:34.610165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b5529-4905-41f7-a9b6-b5608ee3a805 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:34.687433 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2970/5926] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:34.698402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da61346-8945-4758-a303-d59e3e588df9 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:34.777120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdb488-2468-49fe-b4d3-1992e90b9f90 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:34.778268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdb488-2468-49fe-b4d3-1992e90b9f90 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:34.778761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdb488-2468-49fe-b4d3-1992e90b9f90 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:34.779302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdb488-2468-49fe-b4d3-1992e90b9f90 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/roles/aaf39a01872748c1a39d27d586abf544` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:34.785054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdb488-2468-49fe-b4d3-1992e90b9f90 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:delete_role(role_id=aaf39a01872748c1a39d27d586abf544)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:34.786734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdb488-2468-49fe-b4d3-1992e90b9f90 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:34.836258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da61346-8945-4758-a303-d59e3e588df9 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:34.842879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b102ad-4116-405a-a757-6be9e72dcfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:34.843568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b102ad-4116-405a-a757-6be9e72dcfb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:34.844661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b102ad-4116-405a-a757-6be9e72dcfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:34.844966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b102ad-4116-405a-a757-6be9e72dcfb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:34.845666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b102ad-4116-405a-a757-6be9e72dcfb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:34.848273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b102ad-4116-405a-a757-6be9e72dcfb6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:35.020183 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2971/5927] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:48:34 2022] POST /identity/v3/projects => generated 383 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:35.025992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b102ad-4116-405a-a757-6be9e72dcfb6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:35.047463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f0bdb488-2468-49fe-b4d3-1992e90b9f90 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invalidating the token cache because role aaf39a01872748c1a39d27d586abf544 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:35.050610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f0bdb488-2468-49fe-b4d3-1992e90b9f90 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:35.050610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f0bdb488-2468-49fe-b4d3-1992e90b9f90 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:35.052240 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2957/5928] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:34 2022] DELETE /identity/v3/roles/aaf39a01872748c1a39d27d586abf544 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:35.056818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdb488-2468-49fe-b4d3-1992e90b9f90 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:35.061052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f0bdb488-2468-49fe-b4d3-1992e90b9f90 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:35.208025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b102ad-4116-405a-a757-6be9e72dcfb6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:35.277159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:35.280192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdb488-2468-49fe-b4d3-1992e90b9f90 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:35.302911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27c809-7207-46ee-82d5-0b9c2b0e609e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:35.303581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27c809-7207-46ee-82d5-0b9c2b0e609e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:35.303874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27c809-7207-46ee-82d5-0b9c2b0e609e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:35.304165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27c809-7207-46ee-82d5-0b9c2b0e609e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/projects/28bb576defb149f58583909b608745fa` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:35.306572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27c809-7207-46ee-82d5-0b9c2b0e609e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:delete_project(project_id=28bb576defb149f58583909b608745fa)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:35.313820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27c809-7207-46ee-82d5-0b9c2b0e609e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:35.370760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecb28b-21cb-43a7-b20f-121785f17301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:35.371563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecb28b-21cb-43a7-b20f-121785f17301 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:35.371849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecb28b-21cb-43a7-b20f-121785f17301 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:35.372571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecb28b-21cb-43a7-b20f-121785f17301 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:35.375457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecb28b-21cb-43a7-b20f-121785f17301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:35.376317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecb28b-21cb-43a7-b20f-121785f17301 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:35.485774 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2972/5929] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:48:35 2022] POST /identity/v3/users => generated 298 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:48:35.491587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecb28b-21cb-43a7-b20f-121785f17301 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:35.499506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3a27c809-7207-46ee-82d5-0b9c2b0e609e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28bb576defb149f58583909b608745fa', 'request_id': 'req-3a27c809-7207-46ee-82d5-0b9c2b0e609e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:35.511097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-11ecb28b-21cb-43a7-b20f-121785f17301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:35.541486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecb28b-21cb-43a7-b20f-121785f17301 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:35.613945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3a27c809-7207-46ee-82d5-0b9c2b0e609e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28bb576defb149f58583909b608745fa', 'request_id': 'req-3a27c809-7207-46ee-82d5-0b9c2b0e609e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:35.622540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3a27c809-7207-46ee-82d5-0b9c2b0e609e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28bb576defb149f58583909b608745fa', 'request_id': 'req-3a27c809-7207-46ee-82d5-0b9c2b0e609e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:35.633940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49912bb5-538f-4135-9aff-beccead716e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:35.634742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49912bb5-538f-4135-9aff-beccead716e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:35.635035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49912bb5-538f-4135-9aff-beccead716e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:35.635311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49912bb5-538f-4135-9aff-beccead716e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:35.636682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49912bb5-538f-4135-9aff-beccead716e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:35.655649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49912bb5-538f-4135-9aff-beccead716e0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:35.662058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3a27c809-7207-46ee-82d5-0b9c2b0e609e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] The token cache is being invalidate because project 28bb576defb149f58583909b608745fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:35.662058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3a27c809-7207-46ee-82d5-0b9c2b0e609e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:35.662058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3a27c809-7207-46ee-82d5-0b9c2b0e609e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:35.665839 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2958/5930] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:48:35 2022] DELETE /identity/v3/projects/28bb576defb149f58583909b608745fa => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:35.688937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27c809-7207-46ee-82d5-0b9c2b0e609e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:35.696800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3a27c809-7207-46ee-82d5-0b9c2b0e609e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:35.703169 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2973/5931] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:35.708799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49912bb5-538f-4135-9aff-beccead716e0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:35.719275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-49912bb5-538f-4135-9aff-beccead716e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:35.744939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49912bb5-538f-4135-9aff-beccead716e0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:35.758005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd96d2-dc9e-488a-ae9e-24f5dc922579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:35.758916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd96d2-dc9e-488a-ae9e-24f5dc922579 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:35.760876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd96d2-dc9e-488a-ae9e-24f5dc922579 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:35.760876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd96d2-dc9e-488a-ae9e-24f5dc922579 admin admin] PATH_INFO: `/v3/projects/6190ce79a1174dee95baee5ca2f3eb6e/users/c1892339633640df9ce6183f9efa7f78/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:35.795627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd96d2-dc9e-488a-ae9e-24f5dc922579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6190ce79a1174dee95baee5ca2f3eb6e, user_id=c1892339633640df9ce6183f9efa7f78, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:35.798753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd96d2-dc9e-488a-ae9e-24f5dc922579 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:35.839234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27c809-7207-46ee-82d5-0b9c2b0e609e tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:35.847484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b6ee7-c4ca-4dd0-a1da-c16092a407e2 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:35.848311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b6ee7-c4ca-4dd0-a1da-c16092a407e2 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:35.848686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b6ee7-c4ca-4dd0-a1da-c16092a407e2 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:35.854444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b6ee7-c4ca-4dd0-a1da-c16092a407e2 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/projects/28bb576defb149f58583909b608745fa` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:35.857743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b6ee7-c4ca-4dd0-a1da-c16092a407e2 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:delete_project(project_id=28bb576defb149f58583909b608745fa)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:35.859854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b6ee7-c4ca-4dd0-a1da-c16092a407e2 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:35.879932 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2974/5932] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:35 2022] PUT /identity/v3/projects/6190ce79a1174dee95baee5ca2f3eb6e/users/c1892339633640df9ce6183f9efa7f78/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:35.886749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-518b6ee7-c4ca-4dd0-a1da-c16092a407e2 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Could not find project: 28bb576defb149f58583909b608745fa.: keystone.exception.ProjectNotFound: Could not find project: 28bb576defb149f58583909b608745fa. Oct 27 03:48:35.886749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:48:35.886749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:48:35.886749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:48:35.886749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:48:35.886749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:48:35.886749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:48:35.886749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:48:35.886749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:48:35.886749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:48:35.886749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:48:35.886749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:48:35.886749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 27 03:48:35.886749 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 27 03:48:35.888477 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:48:35.888477 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:48:35.888477 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 27 03:48:35.888477 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 27 03:48:35.888477 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:48:35.888477 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:48:35.888477 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:48:35.888477 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:48:35.888477 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 28bb576defb149f58583909b608745fa. Oct 27 03:48:35.888477 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:48:35.889166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd96d2-dc9e-488a-ae9e-24f5dc922579 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:35.889256 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2959/5933] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:48:35 2022] DELETE /identity/v3/projects/28bb576defb149f58583909b608745fa => generated 113 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:48:35.891407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b6ee7-c4ca-4dd0-a1da-c16092a407e2 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:35.926975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b6ee7-c4ca-4dd0-a1da-c16092a407e2 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:36.027075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:36.032509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61287c32-4aa7-4974-832a-542a00d7139a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:36.037684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61287c32-4aa7-4974-832a-542a00d7139a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:36.037684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61287c32-4aa7-4974-832a-542a00d7139a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:36.037684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61287c32-4aa7-4974-832a-542a00d7139a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/projects/a668e8b8c49f43b887f0b1fa221bc654` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:36.037684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61287c32-4aa7-4974-832a-542a00d7139a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a668e8b8c49f43b887f0b1fa221bc654)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:36.038302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61287c32-4aa7-4974-832a-542a00d7139a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:36.067973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd96d2-dc9e-488a-ae9e-24f5dc922579 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:36.094182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f9305-8033-43f1-9415-0204080fb06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:36.094182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f9305-8033-43f1-9415-0204080fb06f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:36.094182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f9305-8033-43f1-9415-0204080fb06f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:36.094182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f9305-8033-43f1-9415-0204080fb06f admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:36.094963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f9305-8033-43f1-9415-0204080fb06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:36.094963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f9305-8033-43f1-9415-0204080fb06f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:36.117101 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2975/5934] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:36.121141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f9305-8033-43f1-9415-0204080fb06f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:36.145106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f9305-8033-43f1-9415-0204080fb06f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:36.171599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e3d43-4e81-48b7-8255-3d057f1c7a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:36.178120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e3d43-4e81-48b7-8255-3d057f1c7a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:36.178464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e3d43-4e81-48b7-8255-3d057f1c7a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:36.178894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e3d43-4e81-48b7-8255-3d057f1c7a64 admin admin] PATH_INFO: `/v3/projects/6190ce79a1174dee95baee5ca2f3eb6e/users/c1892339633640df9ce6183f9efa7f78/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:36.188820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e3d43-4e81-48b7-8255-3d057f1c7a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6190ce79a1174dee95baee5ca2f3eb6e, user_id=c1892339633640df9ce6183f9efa7f78, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:36.199976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e3d43-4e81-48b7-8255-3d057f1c7a64 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:36.206884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-61287c32-4aa7-4974-832a-542a00d7139a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a668e8b8c49f43b887f0b1fa221bc654', 'request_id': 'req-61287c32-4aa7-4974-832a-542a00d7139a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:36.231330 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2976/5935] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:36 2022] PUT /identity/v3/projects/6190ce79a1174dee95baee5ca2f3eb6e/users/c1892339633640df9ce6183f9efa7f78/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:36.250598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53d06b-fc1b-4c6a-a7b3-23df4614b70c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:36.250788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53d06b-fc1b-4c6a-a7b3-23df4614b70c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:36.251066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53d06b-fc1b-4c6a-a7b3-23df4614b70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:36.289624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-61287c32-4aa7-4974-832a-542a00d7139a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a668e8b8c49f43b887f0b1fa221bc654', 'request_id': 'req-61287c32-4aa7-4974-832a-542a00d7139a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:36.298878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-61287c32-4aa7-4974-832a-542a00d7139a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a668e8b8c49f43b887f0b1fa221bc654', 'request_id': 'req-61287c32-4aa7-4974-832a-542a00d7139a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:36.315108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ef53d06b-fc1b-4c6a-a7b3-23df4614b70c None None] MFA Rules not processed for user `c1892339633640df9ce6183f9efa7f78`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:36.319233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ef53d06b-fc1b-4c6a-a7b3-23df4614b70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:36.325011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-61287c32-4aa7-4974-832a-542a00d7139a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] The token cache is being invalidate because project a668e8b8c49f43b887f0b1fa221bc654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:36.327386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-61287c32-4aa7-4974-832a-542a00d7139a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:36.330322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-61287c32-4aa7-4974-832a-542a00d7139a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:36.336027 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2960/5936] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:48:35 2022] DELETE /identity/v3/projects/a668e8b8c49f43b887f0b1fa221bc654 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:36.337370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61287c32-4aa7-4974-832a-542a00d7139a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:36.339242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-61287c32-4aa7-4974-832a-542a00d7139a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:36.478559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61287c32-4aa7-4974-832a-542a00d7139a tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:36.500698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:36.531654 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2977/5937] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:48:36.546370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53d06b-fc1b-4c6a-a7b3-23df4614b70c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:36.548863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ef53d06b-fc1b-4c6a-a7b3-23df4614b70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:36.624013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc8d5d-99b0-4bf5-be9d-146bd9803c28 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:36.624958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc8d5d-99b0-4bf5-be9d-146bd9803c28 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:36.625501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc8d5d-99b0-4bf5-be9d-146bd9803c28 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:36.625883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc8d5d-99b0-4bf5-be9d-146bd9803c28 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/users/5ce1efee948f4aafbe270daf3c416df6` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:36.627557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc8d5d-99b0-4bf5-be9d-146bd9803c28 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5ce1efee948f4aafbe270daf3c416df6)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:36.634684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc8d5d-99b0-4bf5-be9d-146bd9803c28 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:36.709727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53d06b-fc1b-4c6a-a7b3-23df4614b70c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:36.721959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306358d-aa5c-4f35-8ca1-3722e0a48bb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:36.722909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306358d-aa5c-4f35-8ca1-3722e0a48bb1 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:36.723662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306358d-aa5c-4f35-8ca1-3722e0a48bb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:36.724525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306358d-aa5c-4f35-8ca1-3722e0a48bb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:36.732859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3306358d-aa5c-4f35-8ca1-3722e0a48bb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:36.831779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c4cc8d5d-99b0-4bf5-be9d-146bd9803c28 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ce1efee948f4aafbe270daf3c416df6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:36.837779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c4cc8d5d-99b0-4bf5-be9d-146bd9803c28 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ce1efee948f4aafbe270daf3c416df6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:36.851021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c4cc8d5d-99b0-4bf5-be9d-146bd9803c28 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ce1efee948f4aafbe270daf3c416df6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:36.877830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c4cc8d5d-99b0-4bf5-be9d-146bd9803c28 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ce1efee948f4aafbe270daf3c416df6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:36.895769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306358d-aa5c-4f35-8ca1-3722e0a48bb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:36.897387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306358d-aa5c-4f35-8ca1-3722e0a48bb1 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:36.908955 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2978/5938] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:48:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:48:36.970506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c4cc8d5d-99b0-4bf5-be9d-146bd9803c28 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ce1efee948f4aafbe270daf3c416df6'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:36.979951 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2961/5939] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:36 2022] DELETE /identity/v3/users/5ce1efee948f4aafbe270daf3c416df6 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:36.985640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:36.985803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306358d-aa5c-4f35-8ca1-3722e0a48bb1 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:37.001298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306358d-aa5c-4f35-8ca1-3722e0a48bb1 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:37.136024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb0c9c-9393-40d4-bd2e-1aefffcfb011 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:37.136679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb0c9c-9393-40d4-bd2e-1aefffcfb011 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:37.137499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb0c9c-9393-40d4-bd2e-1aefffcfb011 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:37.137778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb0c9c-9393-40d4-bd2e-1aefffcfb011 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/domains/0da57134c4f94e04ab3058ec063235d2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:37.156950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb0c9c-9393-40d4-bd2e-1aefffcfb011 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:48:37.164985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-6dbb0c9c-9393-40d4-bd2e-1aefffcfb011 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Could not find domain: 0da57134c4f94e04ab3058ec063235d2.: keystone.exception.DomainNotFound: Could not find domain: 0da57134c4f94e04ab3058ec063235d2. Oct 27 03:48:37.164985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:48:37.164985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 27 03:48:37.164985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 27 03:48:37.164985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:48:37.164985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:48:37.164985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:48:37.164985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:48:37.164985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0da57134c4f94e04ab3058ec063235d2. Oct 27 03:48:37.164985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:48:37.164985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:48:37.164985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:48:37.164985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:48:37.164985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:48:37.164985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:48:37.164985 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:48:37.168552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:48:37.168552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:48:37.168552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:48:37.168552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:48:37.168552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:48:37.168552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:48:37.168552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:48:37.168552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 27 03:48:37.168552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 27 03:48:37.168552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:48:37.168552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:48:37.168552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:48:37.168552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:48:37.168552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:48:37.168552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:48:37.168552 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:48:37.169493 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:48:37.169493 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:48:37.169493 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:48:37.169493 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:48:37.169493 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:48:37.169493 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:48:37.169493 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:48:37.169493 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:48:37.169493 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:48:37.169493 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:48:37.169493 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:48:37.169493 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:48:37.169493 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:48:37.169493 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 27 03:48:37.169493 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:48:37.169493 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0da57134c4f94e04ab3058ec063235d2. Oct 27 03:48:37.169493 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:48:37.171103 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2979/5940] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:48:36 2022] PATCH /identity/v3/domains/0da57134c4f94e04ab3058ec063235d2 => generated 112 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:48:37.171179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc8d5d-99b0-4bf5-be9d-146bd9803c28 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:37.172625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c4cc8d5d-99b0-4bf5-be9d-146bd9803c28 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:37.217604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc8d5d-99b0-4bf5-be9d-146bd9803c28 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:37.223481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab467c-05c0-4e65-aedf-e1639fa0a861 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:37.224146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab467c-05c0-4e65-aedf-e1639fa0a861 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:37.224436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab467c-05c0-4e65-aedf-e1639fa0a861 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:37.224718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab467c-05c0-4e65-aedf-e1639fa0a861 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/domains/8cbf547f4ace441dbfa25e8d0e937369` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:37.247310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab467c-05c0-4e65-aedf-e1639fa0a861 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:48:37.254888 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-7fab467c-05c0-4e65-aedf-e1639fa0a861 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Could not find domain: 8cbf547f4ace441dbfa25e8d0e937369.: keystone.exception.DomainNotFound: Could not find domain: 8cbf547f4ace441dbfa25e8d0e937369. Oct 27 03:48:37.254888 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:48:37.254888 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 27 03:48:37.254888 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 27 03:48:37.254888 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:48:37.254888 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:48:37.254888 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:48:37.254888 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:48:37.254888 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8cbf547f4ace441dbfa25e8d0e937369. Oct 27 03:48:37.254888 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:48:37.254888 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:48:37.254888 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:48:37.254888 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:48:37.254888 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:48:37.254888 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:48:37.254888 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:48:37.268144 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:48:37.268144 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:48:37.268144 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:48:37.268144 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:48:37.268144 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:48:37.268144 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:48:37.268144 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:48:37.268144 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 27 03:48:37.268144 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 27 03:48:37.268144 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:48:37.268144 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:48:37.268144 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:48:37.268144 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:48:37.268144 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:48:37.268144 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:48:37.268144 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:48:37.269044 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:48:37.269044 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:48:37.269044 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:48:37.269044 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:48:37.269044 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:48:37.269044 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:48:37.269044 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:48:37.269044 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:48:37.269044 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:48:37.269044 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:48:37.269044 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:48:37.269044 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:48:37.269044 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:48:37.269044 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 27 03:48:37.269044 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:48:37.269044 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8cbf547f4ace441dbfa25e8d0e937369. Oct 27 03:48:37.269044 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:48:37.269910 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2962/5941] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:48:37 2022] PATCH /identity/v3/domains/8cbf547f4ace441dbfa25e8d0e937369 => generated 112 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:48:37.269976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb0c9c-9393-40d4-bd2e-1aefffcfb011 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:37.282823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb0c9c-9393-40d4-bd2e-1aefffcfb011 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:37.294766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32cc1a-674d-457f-b99b-42843c2c151c tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:37.295962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32cc1a-674d-457f-b99b-42843c2c151c tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:37.296459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32cc1a-674d-457f-b99b-42843c2c151c tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:37.296911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32cc1a-674d-457f-b99b-42843c2c151c tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/domains/4268881ad52c4eb9adb194b73b971d02` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:37.314837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32cc1a-674d-457f-b99b-42843c2c151c tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:48:37.320280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-4c32cc1a-674d-457f-b99b-42843c2c151c tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Could not find domain: 4268881ad52c4eb9adb194b73b971d02.: keystone.exception.DomainNotFound: Could not find domain: 4268881ad52c4eb9adb194b73b971d02. Oct 27 03:48:37.320280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:48:37.320280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 27 03:48:37.320280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 27 03:48:37.320280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:48:37.320280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:48:37.320280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:48:37.320280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:48:37.320280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 4268881ad52c4eb9adb194b73b971d02. Oct 27 03:48:37.320280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:48:37.320280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:48:37.320280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:48:37.320280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:48:37.320280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:48:37.320280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:48:37.320280 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:48:37.321221 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:48:37.321221 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:48:37.321221 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:48:37.321221 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:48:37.321221 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:48:37.321221 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:48:37.321221 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:48:37.321221 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 27 03:48:37.321221 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 27 03:48:37.321221 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:48:37.321221 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:48:37.321221 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:48:37.321221 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:48:37.321221 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:48:37.321221 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:48:37.321221 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:48:37.322227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:48:37.322227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:48:37.322227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:48:37.322227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:48:37.322227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:48:37.322227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:48:37.322227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:48:37.322227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:48:37.322227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:48:37.322227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:48:37.322227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:48:37.322227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:48:37.322227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:48:37.322227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 27 03:48:37.322227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:48:37.322227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 4268881ad52c4eb9adb194b73b971d02. Oct 27 03:48:37.322227 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:48:37.327429 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2980/5942] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:48:37 2022] PATCH /identity/v3/domains/4268881ad52c4eb9adb194b73b971d02 => generated 112 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:48:37.331529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab467c-05c0-4e65-aedf-e1639fa0a861 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:37.347716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab467c-05c0-4e65-aedf-e1639fa0a861 tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:37.358880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:37.379195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc7b97-1da2-4e8e-ba7e-afb605a302ea tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04b15b545dd1482abd1bd125dd1921e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c362f5d7ee4caab801a4d50e69dfc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:37.379987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc7b97-1da2-4e8e-ba7e-afb605a302ea tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:37.380502 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc7b97-1da2-4e8e-ba7e-afb605a302ea tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:37.380876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc7b97-1da2-4e8e-ba7e-afb605a302ea tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] PATH_INFO: `/v3/domains/305d786ab16e4a5bac505da4545b8a7d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:37.391146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc7b97-1da2-4e8e-ba7e-afb605a302ea tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:48:37.401163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-45cc7b97-1da2-4e8e-ba7e-afb605a302ea tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Could not find domain: 305d786ab16e4a5bac505da4545b8a7d.: keystone.exception.DomainNotFound: Could not find domain: 305d786ab16e4a5bac505da4545b8a7d. Oct 27 03:48:37.401163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:48:37.401163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 27 03:48:37.401163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 27 03:48:37.401163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:48:37.401163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:48:37.401163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:48:37.401163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:48:37.401163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 305d786ab16e4a5bac505da4545b8a7d. Oct 27 03:48:37.401163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:48:37.401163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:48:37.401163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:48:37.401163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:48:37.401163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:48:37.401163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:48:37.401163 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:48:37.402417 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:48:37.402417 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:48:37.402417 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:48:37.402417 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:48:37.402417 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:48:37.402417 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:48:37.402417 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:48:37.402417 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 27 03:48:37.402417 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 27 03:48:37.402417 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:48:37.402417 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:48:37.402417 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:48:37.402417 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:48:37.402417 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:48:37.402417 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:48:37.402417 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:48:37.404396 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:48:37.404396 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:48:37.404396 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:48:37.404396 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:48:37.404396 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:48:37.404396 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:48:37.404396 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:48:37.404396 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:48:37.404396 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:48:37.404396 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:48:37.404396 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:48:37.404396 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:48:37.404396 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:48:37.404396 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 27 03:48:37.404396 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:48:37.404396 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 305d786ab16e4a5bac505da4545b8a7d. Oct 27 03:48:37.404396 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:48:37.406810 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2963/5943] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:48:37 2022] PATCH /identity/v3/domains/305d786ab16e4a5bac505da4545b8a7d => generated 112 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:48:37.407870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32cc1a-674d-457f-b99b-42843c2c151c tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:37.410550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4c32cc1a-674d-457f-b99b-42843c2c151c tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:37.496925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32cc1a-674d-457f-b99b-42843c2c151c tempest-TokensV3TestJSON-2084773938 tempest-TokensV3TestJSON-2084773938-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:37.502140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed401f1-fe79-4547-83a4-31071850d7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:37.502822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed401f1-fe79-4547-83a4-31071850d7ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:37.503140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed401f1-fe79-4547-83a4-31071850d7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:37.503517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed401f1-fe79-4547-83a4-31071850d7ec admin admin] PATH_INFO: `/v3/users/43044bc84a5a49908ac69ee4ac8bfb3d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:37.504767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed401f1-fe79-4547-83a4-31071850d7ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=43044bc84a5a49908ac69ee4ac8bfb3d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:37.506946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed401f1-fe79-4547-83a4-31071850d7ec admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:37.808011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ed401f1-fe79-4547-83a4-31071850d7ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43044bc84a5a49908ac69ee4ac8bfb3d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:37.810235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ed401f1-fe79-4547-83a4-31071850d7ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43044bc84a5a49908ac69ee4ac8bfb3d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:37.826979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ed401f1-fe79-4547-83a4-31071850d7ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43044bc84a5a49908ac69ee4ac8bfb3d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:37.857126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ed401f1-fe79-4547-83a4-31071850d7ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43044bc84a5a49908ac69ee4ac8bfb3d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:37.858139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ed401f1-fe79-4547-83a4-31071850d7ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43044bc84a5a49908ac69ee4ac8bfb3d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:37.948052 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2981/5944] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:37 2022] DELETE /identity/v3/users/43044bc84a5a49908ac69ee4ac8bfb3d => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:37.953698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77683c59-1870-4605-8740-1328e9fcfa88 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:37.954243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77683c59-1870-4605-8740-1328e9fcfa88 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:37.954712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77683c59-1870-4605-8740-1328e9fcfa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:37.995327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-77683c59-1870-4605-8740-1328e9fcfa88 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:37.997644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-77683c59-1870-4605-8740-1328e9fcfa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:38.087814 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2964/5945] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:38.098554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed401f1-fe79-4547-83a4-31071850d7ec admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:38.100146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7ed401f1-fe79-4547-83a4-31071850d7ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:38.147090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:38.215192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed401f1-fe79-4547-83a4-31071850d7ec admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:38.223531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880aaa4d-e8a9-4a01-8ce4-3853a574ec34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:38.225814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880aaa4d-e8a9-4a01-8ce4-3853a574ec34 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:38.226139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880aaa4d-e8a9-4a01-8ce4-3853a574ec34 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:38.226428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880aaa4d-e8a9-4a01-8ce4-3853a574ec34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:38.257038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880aaa4d-e8a9-4a01-8ce4-3853a574ec34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:38.258977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880aaa4d-e8a9-4a01-8ce4-3853a574ec34 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:38.279809 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2982/5946] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:48:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:48:38.921025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77683c59-1870-4605-8740-1328e9fcfa88 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:38.922668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-77683c59-1870-4605-8740-1328e9fcfa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:38.941099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:38.961058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77683c59-1870-4605-8740-1328e9fcfa88 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:38.963762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880aaa4d-e8a9-4a01-8ce4-3853a574ec34 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:38.969550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f7b93-068e-4e50-8697-91bccfdd7ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:38.970451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f7b93-068e-4e50-8697-91bccfdd7ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:38.970740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f7b93-068e-4e50-8697-91bccfdd7ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:38.971019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f7b93-068e-4e50-8697-91bccfdd7ee1 admin admin] PATH_INFO: `/v3/projects/85f8bb3f5ec14274b796c838792c8116` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:38.974709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f7b93-068e-4e50-8697-91bccfdd7ee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85f8bb3f5ec14274b796c838792c8116)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:38.980094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f7b93-068e-4e50-8697-91bccfdd7ee1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:38.980212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880aaa4d-e8a9-4a01-8ce4-3853a574ec34 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:38.992159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c29bd-11b2-4c41-8e51-971a73012c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:38.992736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c29bd-11b2-4c41-8e51-971a73012c78 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:38.993031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c29bd-11b2-4c41-8e51-971a73012c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:38.993329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c29bd-11b2-4c41-8e51-971a73012c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:38.997460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-af8c29bd-11b2-4c41-8e51-971a73012c78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:39.119606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c29bd-11b2-4c41-8e51-971a73012c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:39.138408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a56f7b93-068e-4e50-8697-91bccfdd7ee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85f8bb3f5ec14274b796c838792c8116', 'request_id': 'req-a56f7b93-068e-4e50-8697-91bccfdd7ee1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:39.139667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c29bd-11b2-4c41-8e51-971a73012c78 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:39.181685 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2983/5947] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:48:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:48:39.206486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a56f7b93-068e-4e50-8697-91bccfdd7ee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85f8bb3f5ec14274b796c838792c8116', 'request_id': 'req-a56f7b93-068e-4e50-8697-91bccfdd7ee1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:39.213696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a56f7b93-068e-4e50-8697-91bccfdd7ee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85f8bb3f5ec14274b796c838792c8116', 'request_id': 'req-a56f7b93-068e-4e50-8697-91bccfdd7ee1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:39.239505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a56f7b93-068e-4e50-8697-91bccfdd7ee1 admin admin] The token cache is being invalidate because project 85f8bb3f5ec14274b796c838792c8116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:39.239834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a56f7b93-068e-4e50-8697-91bccfdd7ee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:39.241350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a56f7b93-068e-4e50-8697-91bccfdd7ee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:39.246406 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2965/5948] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:48:38 2022] DELETE /identity/v3/projects/85f8bb3f5ec14274b796c838792c8116 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:39.250318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c29bd-11b2-4c41-8e51-971a73012c78 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:39.265411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c29bd-11b2-4c41-8e51-971a73012c78 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:39.370830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6fa18-9d1b-4760-a41a-e4f2839bc8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:39.371659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6fa18-9d1b-4760-a41a-e4f2839bc8dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:39.371969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6fa18-9d1b-4760-a41a-e4f2839bc8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:39.372251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6fa18-9d1b-4760-a41a-e4f2839bc8dc admin admin] PATH_INFO: `/v3/users/04b15b545dd1482abd1bd125dd1921e2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:39.374331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6fa18-9d1b-4760-a41a-e4f2839bc8dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=04b15b545dd1482abd1bd125dd1921e2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:39.376658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6fa18-9d1b-4760-a41a-e4f2839bc8dc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:40.041701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c9d6fa18-9d1b-4760-a41a-e4f2839bc8dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04b15b545dd1482abd1bd125dd1921e2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:40.042561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c9d6fa18-9d1b-4760-a41a-e4f2839bc8dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04b15b545dd1482abd1bd125dd1921e2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:40.053671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c9d6fa18-9d1b-4760-a41a-e4f2839bc8dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04b15b545dd1482abd1bd125dd1921e2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:40.085942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c9d6fa18-9d1b-4760-a41a-e4f2839bc8dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04b15b545dd1482abd1bd125dd1921e2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:40.087824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c9d6fa18-9d1b-4760-a41a-e4f2839bc8dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04b15b545dd1482abd1bd125dd1921e2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:40.243999 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2984/5949] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:39 2022] DELETE /identity/v3/users/04b15b545dd1482abd1bd125dd1921e2 => generated 0 bytes in 994 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:40.472552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:DELETE=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:41.654756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f7b93-068e-4e50-8697-91bccfdd7ee1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:41.656816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a56f7b93-068e-4e50-8697-91bccfdd7ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:41.689459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f7b93-068e-4e50-8697-91bccfdd7ee1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:41.871247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:41.895438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5c0af-b108-4dc2-a92d-3ee9c39fdeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:41.896517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5c0af-b108-4dc2-a92d-3ee9c39fdeea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:41.897013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5c0af-b108-4dc2-a92d-3ee9c39fdeea admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:41.897499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5c0af-b108-4dc2-a92d-3ee9c39fdeea admin admin] PATH_INFO: `/v3/projects/49c362f5d7ee4caab801a4d50e69dfc2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:41.903139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5c0af-b108-4dc2-a92d-3ee9c39fdeea admin admin] RBAC: Authorizing `identity:delete_project(project_id=49c362f5d7ee4caab801a4d50e69dfc2)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:41.914082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5c0af-b108-4dc2-a92d-3ee9c39fdeea admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:42.134291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-75d5c0af-b108-4dc2-a92d-3ee9c39fdeea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49c362f5d7ee4caab801a4d50e69dfc2', 'request_id': 'req-75d5c0af-b108-4dc2-a92d-3ee9c39fdeea'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:42.237919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-75d5c0af-b108-4dc2-a92d-3ee9c39fdeea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49c362f5d7ee4caab801a4d50e69dfc2', 'request_id': 'req-75d5c0af-b108-4dc2-a92d-3ee9c39fdeea'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:42.258012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-75d5c0af-b108-4dc2-a92d-3ee9c39fdeea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49c362f5d7ee4caab801a4d50e69dfc2', 'request_id': 'req-75d5c0af-b108-4dc2-a92d-3ee9c39fdeea'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:42.289501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-75d5c0af-b108-4dc2-a92d-3ee9c39fdeea admin admin] The token cache is being invalidate because project 49c362f5d7ee4caab801a4d50e69dfc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:42.290054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-75d5c0af-b108-4dc2-a92d-3ee9c39fdeea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:42.291148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-75d5c0af-b108-4dc2-a92d-3ee9c39fdeea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:42.296160 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2966/5950] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:48:41 2022] DELETE /identity/v3/projects/49c362f5d7ee4caab801a4d50e69dfc2 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:42.299933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6fa18-9d1b-4760-a41a-e4f2839bc8dc admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:42.301573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c9d6fa18-9d1b-4760-a41a-e4f2839bc8dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:42.318415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6fa18-9d1b-4760-a41a-e4f2839bc8dc admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:42.418635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:42.483871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b3916-3158-43f5-8c71-70384d838132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:42.484768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b3916-3158-43f5-8c71-70384d838132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:42.485230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b3916-3158-43f5-8c71-70384d838132 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:42.485583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b3916-3158-43f5-8c71-70384d838132 admin admin] PATH_INFO: `/v3/users/4e215dbd38594c5c988704471b03ec34` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:42.486900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b3916-3158-43f5-8c71-70384d838132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e215dbd38594c5c988704471b03ec34)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:42.494601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b3916-3158-43f5-8c71-70384d838132 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:42.756956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e98b3916-3158-43f5-8c71-70384d838132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e215dbd38594c5c988704471b03ec34'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:42.757795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e98b3916-3158-43f5-8c71-70384d838132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e215dbd38594c5c988704471b03ec34'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:42.770331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e98b3916-3158-43f5-8c71-70384d838132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e215dbd38594c5c988704471b03ec34'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:42.785289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e98b3916-3158-43f5-8c71-70384d838132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e215dbd38594c5c988704471b03ec34'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:42.791942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e98b3916-3158-43f5-8c71-70384d838132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e215dbd38594c5c988704471b03ec34'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:42.891169 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2985/5951] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:42 2022] DELETE /identity/v3/users/4e215dbd38594c5c988704471b03ec34 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:43.701017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:UPDATE=2,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:44.009640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:44.259958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fe38c-18b4-4381-bc95-c35b87bc8484 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:44.260483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fe38c-18b4-4381-bc95-c35b87bc8484 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:44.260954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fe38c-18b4-4381-bc95-c35b87bc8484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:44.312650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9d6fe38c-18b4-4381-bc95-c35b87bc8484 None None] MFA Rules not processed for user `2fc1e7eafd7948279f08eb5ad52f5609`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:44.314692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9d6fe38c-18b4-4381-bc95-c35b87bc8484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:44.453688 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2967/5952] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:44 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:44.458184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b3916-3158-43f5-8c71-70384d838132 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:44.459685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e98b3916-3158-43f5-8c71-70384d838132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:44.633034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b3916-3158-43f5-8c71-70384d838132 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:44.641388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac1e8d-3c49-4417-9395-5b808ce98f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:44.642784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac1e8d-3c49-4417-9395-5b808ce98f8f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:44.643284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac1e8d-3c49-4417-9395-5b808ce98f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:44.643712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac1e8d-3c49-4417-9395-5b808ce98f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:44.644651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac1e8d-3c49-4417-9395-5b808ce98f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:44.646817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac1e8d-3c49-4417-9395-5b808ce98f8f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:44.741690 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2986/5953] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:48:44 2022] POST /identity/v3/projects => generated 405 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:44.742931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fe38c-18b4-4381-bc95-c35b87bc8484 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:44.763575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fe38c-18b4-4381-bc95-c35b87bc8484 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:44.865074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac1e8d-3c49-4417-9395-5b808ce98f8f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:44.867061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fdac1e8d-3c49-4417-9395-5b808ce98f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:44.937987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e647f9-ea2f-4d91-9df1-3a1c27f79cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:44.938796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e647f9-ea2f-4d91-9df1-3a1c27f79cac admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:44.939194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e647f9-ea2f-4d91-9df1-3a1c27f79cac admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:44.939729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e647f9-ea2f-4d91-9df1-3a1c27f79cac admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:44.940437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e647f9-ea2f-4d91-9df1-3a1c27f79cac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:44.943208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e647f9-ea2f-4d91-9df1-3a1c27f79cac admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:45.037962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac1e8d-3c49-4417-9395-5b808ce98f8f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:45.058514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d552a-9e9b-418d-812b-1bbb26af5128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:45.059868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d552a-9e9b-418d-812b-1bbb26af5128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:45.060167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d552a-9e9b-418d-812b-1bbb26af5128 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:45.062682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d552a-9e9b-418d-812b-1bbb26af5128 admin admin] PATH_INFO: `/v3/users/3771098cc42a447eab2524a0682133e8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:45.064638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d552a-9e9b-418d-812b-1bbb26af5128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3771098cc42a447eab2524a0682133e8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:45.068629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d552a-9e9b-418d-812b-1bbb26af5128 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:45.079539 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2968/5954] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:48:44 2022] POST /identity/v3/users => generated 303 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:45.080532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e647f9-ea2f-4d91-9df1-3a1c27f79cac admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:45.085252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d5e647f9-ea2f-4d91-9df1-3a1c27f79cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:45.107919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:45.119917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e647f9-ea2f-4d91-9df1-3a1c27f79cac admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:45.141420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec874c-61e6-4601-8cd4-54dfbd5268bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:45.142200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec874c-61e6-4601-8cd4-54dfbd5268bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:45.142487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec874c-61e6-4601-8cd4-54dfbd5268bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:45.142815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec874c-61e6-4601-8cd4-54dfbd5268bf admin admin] PATH_INFO: `/v3/projects/013d62557ab4436d894fc22ad2635d1d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:45.144157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec874c-61e6-4601-8cd4-54dfbd5268bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=013d62557ab4436d894fc22ad2635d1d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:45.146427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec874c-61e6-4601-8cd4-54dfbd5268bf admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:45.377256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-999d552a-9e9b-418d-812b-1bbb26af5128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3771098cc42a447eab2524a0682133e8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:45.379751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-999d552a-9e9b-418d-812b-1bbb26af5128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3771098cc42a447eab2524a0682133e8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:45.381273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8fec874c-61e6-4601-8cd4-54dfbd5268bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '013d62557ab4436d894fc22ad2635d1d', 'request_id': 'req-8fec874c-61e6-4601-8cd4-54dfbd5268bf'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:45.402234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-999d552a-9e9b-418d-812b-1bbb26af5128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3771098cc42a447eab2524a0682133e8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:45.433063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-999d552a-9e9b-418d-812b-1bbb26af5128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3771098cc42a447eab2524a0682133e8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:45.434538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-999d552a-9e9b-418d-812b-1bbb26af5128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3771098cc42a447eab2524a0682133e8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:45.461210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:45.514578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8fec874c-61e6-4601-8cd4-54dfbd5268bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '013d62557ab4436d894fc22ad2635d1d', 'request_id': 'req-8fec874c-61e6-4601-8cd4-54dfbd5268bf'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:45.520983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8fec874c-61e6-4601-8cd4-54dfbd5268bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '013d62557ab4436d894fc22ad2635d1d', 'request_id': 'req-8fec874c-61e6-4601-8cd4-54dfbd5268bf'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:45.560069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8fec874c-61e6-4601-8cd4-54dfbd5268bf admin admin] The token cache is being invalidate because project 013d62557ab4436d894fc22ad2635d1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:45.560372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8fec874c-61e6-4601-8cd4-54dfbd5268bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:45.566467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8fec874c-61e6-4601-8cd4-54dfbd5268bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:45.568192 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2969/5955] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:48:45 2022] DELETE /identity/v3/projects/013d62557ab4436d894fc22ad2635d1d => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:45.569235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec874c-61e6-4601-8cd4-54dfbd5268bf admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:45.570883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8fec874c-61e6-4601-8cd4-54dfbd5268bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:45.616843 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2987/5956] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:44 2022] DELETE /identity/v3/users/3771098cc42a447eab2524a0682133e8 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:45.620286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9212a78-b3bf-4596-acae-45ae86928f26 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:45.621813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9212a78-b3bf-4596-acae-45ae86928f26 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:45.622225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9212a78-b3bf-4596-acae-45ae86928f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:45.728843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d9212a78-b3bf-4596-acae-45ae86928f26 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:45.733811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d9212a78-b3bf-4596-acae-45ae86928f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:45.832617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec874c-61e6-4601-8cd4-54dfbd5268bf admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:45.920707 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2988/5957] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:45.922458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807feef5-a582-42c2-beeb-cda760cb9ea2 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:45.922947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807feef5-a582-42c2-beeb-cda760cb9ea2 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:45.923557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807feef5-a582-42c2-beeb-cda760cb9ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:45.950187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0b17c-2c16-42e9-aaf7-1715e7c81ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:45.950827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0b17c-2c16-42e9-aaf7-1715e7c81ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:45.951116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0b17c-2c16-42e9-aaf7-1715e7c81ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:45.951404 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0b17c-2c16-42e9-aaf7-1715e7c81ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:45.952186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0b17c-2c16-42e9-aaf7-1715e7c81ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:45.953687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0b17c-2c16-42e9-aaf7-1715e7c81ef9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:45.983351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-807feef5-a582-42c2-beeb-cda760cb9ea2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:45.987364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-807feef5-a582-42c2-beeb-cda760cb9ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:45.990727 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2970/5958] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:45.992056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79e8d9-b5d3-4185-afcb-0de3a83d536f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:45.992351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79e8d9-b5d3-4185-afcb-0de3a83d536f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:45.992635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79e8d9-b5d3-4185-afcb-0de3a83d536f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:46.001689 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2989/5959] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:46.002909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807feef5-a582-42c2-beeb-cda760cb9ea2 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:46.032643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807feef5-a582-42c2-beeb-cda760cb9ea2 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:46.050428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97649c-ae8b-4315-8bed-35110ac848b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:46.051083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97649c-ae8b-4315-8bed-35110ac848b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:46.051365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97649c-ae8b-4315-8bed-35110ac848b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:46.051637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97649c-ae8b-4315-8bed-35110ac848b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:46.052289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97649c-ae8b-4315-8bed-35110ac848b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:46.054472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97649c-ae8b-4315-8bed-35110ac848b2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:46.059730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9f79e8d9-b5d3-4185-afcb-0de3a83d536f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:46.061367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9f79e8d9-b5d3-4185-afcb-0de3a83d536f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:46.074862 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2990/5960] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:46.078934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97649c-ae8b-4315-8bed-35110ac848b2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:46.095308 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2971/5961] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:46.099988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79e8d9-b5d3-4185-afcb-0de3a83d536f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:46.100544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97649c-ae8b-4315-8bed-35110ac848b2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:46.128828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79e8d9-b5d3-4185-afcb-0de3a83d536f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:46.142923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:46.145206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab37e6a-ae16-4cb7-bd21-6c79c4607ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:46.145838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab37e6a-ae16-4cb7-bd21-6c79c4607ace admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:46.146164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab37e6a-ae16-4cb7-bd21-6c79c4607ace admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:46.146449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab37e6a-ae16-4cb7-bd21-6c79c4607ace admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:46.147114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab37e6a-ae16-4cb7-bd21-6c79c4607ace admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:48:46.147425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab37e6a-ae16-4cb7-bd21-6c79c4607ace admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:46.149256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab37e6a-ae16-4cb7-bd21-6c79c4607ace admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:46.155703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c43bc-648d-4115-b53a-358eaf0c4b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:46.156737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c43bc-648d-4115-b53a-358eaf0c4b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:46.157217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c43bc-648d-4115-b53a-358eaf0c4b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:46.157687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c43bc-648d-4115-b53a-358eaf0c4b86 admin admin] PATH_INFO: `/v3/projects/ae6bd97041d843879dc0988741e0732a/users/530d04ccbfb7413790c8311a10c8cbee/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:46.196853 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2972/5962] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:48:46.197547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c43bc-648d-4115-b53a-358eaf0c4b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6bd97041d843879dc0988741e0732a, user_id=530d04ccbfb7413790c8311a10c8cbee, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:46.197869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab37e6a-ae16-4cb7-bd21-6c79c4607ace admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:46.201861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dab37e6a-ae16-4cb7-bd21-6c79c4607ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:46.211442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c43bc-648d-4115-b53a-358eaf0c4b86 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:46.348006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab37e6a-ae16-4cb7-bd21-6c79c4607ace admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:46.361583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a1c2f-4a45-4d60-9f0c-5ac48379ef55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:46.362255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a1c2f-4a45-4d60-9f0c-5ac48379ef55 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:46.362545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a1c2f-4a45-4d60-9f0c-5ac48379ef55 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:46.362828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a1c2f-4a45-4d60-9f0c-5ac48379ef55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:46.365522 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2991/5963] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:46 2022] PUT /identity/v3/projects/ae6bd97041d843879dc0988741e0732a/users/530d04ccbfb7413790c8311a10c8cbee/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:46.373226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c43bc-648d-4115-b53a-358eaf0c4b86 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:46.382166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a1c2f-4a45-4d60-9f0c-5ac48379ef55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:46.383851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a1c2f-4a45-4d60-9f0c-5ac48379ef55 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:46.406457 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2973/5964] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:48:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:48:46.609647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c43bc-648d-4115-b53a-358eaf0c4b86 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:46.642236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec4dfa-032b-4a42-ab57-67bdbad2b055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:46.644051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec4dfa-032b-4a42-ab57-67bdbad2b055 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:46.644478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec4dfa-032b-4a42-ab57-67bdbad2b055 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:46.644775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec4dfa-032b-4a42-ab57-67bdbad2b055 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:46.647587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec4dfa-032b-4a42-ab57-67bdbad2b055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:46.650443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec4dfa-032b-4a42-ab57-67bdbad2b055 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:46.807652 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2992/5965] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:48:46 2022] POST /identity/v3/projects => generated 393 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:46.811993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a1c2f-4a45-4d60-9f0c-5ac48379ef55 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:46.832376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a1c2f-4a45-4d60-9f0c-5ac48379ef55 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:46.889382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:46.982806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed491ac2-c0b2-4e6c-adc4-004602ad2b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:46.983509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed491ac2-c0b2-4e6c-adc4-004602ad2b0e admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:46.983821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed491ac2-c0b2-4e6c-adc4-004602ad2b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:46.984106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed491ac2-c0b2-4e6c-adc4-004602ad2b0e admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:46.984761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed491ac2-c0b2-4e6c-adc4-004602ad2b0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:46.986762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed491ac2-c0b2-4e6c-adc4-004602ad2b0e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:47.016119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:47.096280 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2974/5966] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:48:46 2022] POST /identity/v3/users => generated 297 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:47.100639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec4dfa-032b-4a42-ab57-67bdbad2b055 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:47.122462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec4dfa-032b-4a42-ab57-67bdbad2b055 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:47.139892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688104c-6aa8-461c-9151-c6eba918f3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:47.140769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688104c-6aa8-461c-9151-c6eba918f3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:47.141225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688104c-6aa8-461c-9151-c6eba918f3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:47.141694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688104c-6aa8-461c-9151-c6eba918f3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:47.142926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688104c-6aa8-461c-9151-c6eba918f3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:47.147510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688104c-6aa8-461c-9151-c6eba918f3a5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:47.194405 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2993/5967] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:47.200652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed491ac2-c0b2-4e6c-adc4-004602ad2b0e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:47.215399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed491ac2-c0b2-4e6c-adc4-004602ad2b0e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:47.222084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a24dc2-cc8b-4197-b208-e1b1347eb949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:47.223278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a24dc2-cc8b-4197-b208-e1b1347eb949 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:47.223802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a24dc2-cc8b-4197-b208-e1b1347eb949 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:47.224296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a24dc2-cc8b-4197-b208-e1b1347eb949 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:47.225256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a24dc2-cc8b-4197-b208-e1b1347eb949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:47.228221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a24dc2-cc8b-4197-b208-e1b1347eb949 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:47.242135 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2975/5968] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:47.246172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688104c-6aa8-461c-9151-c6eba918f3a5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:47.259331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688104c-6aa8-461c-9151-c6eba918f3a5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:47.278308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cd202-971c-438e-861b-1df8afb832e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:47.279289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cd202-971c-438e-861b-1df8afb832e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:47.280033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cd202-971c-438e-861b-1df8afb832e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:47.280406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cd202-971c-438e-861b-1df8afb832e7 admin admin] PATH_INFO: `/v3/projects/1164ccb261db4889803a11a93e198576/users/e64dceb72cd947d8ac635f71a77a9969/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:47.315415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531cd202-971c-438e-861b-1df8afb832e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1164ccb261db4889803a11a93e198576, user_id=e64dceb72cd947d8ac635f71a77a9969, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:47.319208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531cd202-971c-438e-861b-1df8afb832e7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:47.518290 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2994/5969] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:47 2022] PUT /identity/v3/projects/1164ccb261db4889803a11a93e198576/users/e64dceb72cd947d8ac635f71a77a9969/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:47.529811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75cdff-018b-4877-9f51-2a53dc94886c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:47.530129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75cdff-018b-4877-9f51-2a53dc94886c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:47.530412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75cdff-018b-4877-9f51-2a53dc94886c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:47.627705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ed75cdff-018b-4877-9f51-2a53dc94886c None None] MFA Rules not processed for user `e64dceb72cd947d8ac635f71a77a9969`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:47.629500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ed75cdff-018b-4877-9f51-2a53dc94886c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:47.765527 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2976/5970] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:47.770941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cd202-971c-438e-861b-1df8afb832e7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:47.798979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cd202-971c-438e-861b-1df8afb832e7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:47.803333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6e9bd-5464-44db-916c-5d64de207ebf tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64dceb72cd947d8ac635f71a77a9969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1164ccb261db4889803a11a93e198576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:47.804001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6e9bd-5464-44db-916c-5d64de207ebf tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:47.804430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6e9bd-5464-44db-916c-5d64de207ebf tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:47.804731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6e9bd-5464-44db-916c-5d64de207ebf tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] PATH_INFO: `/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:47.805410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6e9bd-5464-44db-916c-5d64de207ebf tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorizing `identity:create_application_credential(user_id=e64dceb72cd947d8ac635f71a77a9969)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:47.806617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6e9bd-5464-44db-916c-5d64de207ebf tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:48.068663 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2995/5971] 10.222.0.20 () {60 vars in 1314 bytes} [Thu Oct 27 03:48:47 2022] POST /identity/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials => generated 789 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:48.071790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75cdff-018b-4877-9f51-2a53dc94886c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:48.084715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75cdff-018b-4877-9f51-2a53dc94886c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:48.098474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ebb83-b48c-4e6e-8480-35da2e444f53 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64dceb72cd947d8ac635f71a77a9969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1164ccb261db4889803a11a93e198576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:48.100153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ebb83-b48c-4e6e-8480-35da2e444f53 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:48.103088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ebb83-b48c-4e6e-8480-35da2e444f53 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:48.105188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ebb83-b48c-4e6e-8480-35da2e444f53 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] PATH_INFO: `/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials/941cb1c794354db08b0e855dab4f9d97` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:48.140732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ebb83-b48c-4e6e-8480-35da2e444f53 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorizing `identity:get_application_credential(user_id=e64dceb72cd947d8ac635f71a77a9969, application_credential_id=941cb1c794354db08b0e855dab4f9d97)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:48.142637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ebb83-b48c-4e6e-8480-35da2e444f53 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:48.144960 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2977/5972] 10.222.0.20 () {58 vars in 1392 bytes} [Thu Oct 27 03:48:48 2022] GET /identity/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials/941cb1c794354db08b0e855dab4f9d97 => generated 689 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:48:48.151568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e515af-4400-4dbd-96e5-c7ca7fdcb445 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:48.152051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e515af-4400-4dbd-96e5-c7ca7fdcb445 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:48.153172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e515af-4400-4dbd-96e5-c7ca7fdcb445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:48.185135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-27e515af-4400-4dbd-96e5-c7ca7fdcb445 None None] MFA Rules not processed for user `e64dceb72cd947d8ac635f71a77a9969`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:48.193865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-27e515af-4400-4dbd-96e5-c7ca7fdcb445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:48.370942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:48.452849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ebb83-b48c-4e6e-8480-35da2e444f53 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:48.454713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ec4ebb83-b48c-4e6e-8480-35da2e444f53 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:48.509739 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2996/5973] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:48 2022] POST /identity/v3/auth/tokens => generated 3427 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 27 03:48:48.516827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e515af-4400-4dbd-96e5-c7ca7fdcb445 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:48.531076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e515af-4400-4dbd-96e5-c7ca7fdcb445 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:48.537864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d05e8b-d6d6-4694-b94b-ff4ef47690ff tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64dceb72cd947d8ac635f71a77a9969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1164ccb261db4889803a11a93e198576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:48.541438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d05e8b-d6d6-4694-b94b-ff4ef47690ff tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:48.541727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d05e8b-d6d6-4694-b94b-ff4ef47690ff tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:48.542001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d05e8b-d6d6-4694-b94b-ff4ef47690ff tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] PATH_INFO: `/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials/941cb1c794354db08b0e855dab4f9d97` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:48.544508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d05e8b-d6d6-4694-b94b-ff4ef47690ff tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e64dceb72cd947d8ac635f71a77a9969, application_credential_id=941cb1c794354db08b0e855dab4f9d97)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:48.546592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d05e8b-d6d6-4694-b94b-ff4ef47690ff tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:48.592327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ebb83-b48c-4e6e-8480-35da2e444f53 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:48.603567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da226e3-4291-4f8c-ba4e-a6a1ed865132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:48.604296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da226e3-4291-4f8c-ba4e-a6a1ed865132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:48.604569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da226e3-4291-4f8c-ba4e-a6a1ed865132 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:48.604902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da226e3-4291-4f8c-ba4e-a6a1ed865132 admin admin] PATH_INFO: `/v3/projects/115b85f8af8e491f85a80eeb979100a0` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:48.607018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da226e3-4291-4f8c-ba4e-a6a1ed865132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=115b85f8af8e491f85a80eeb979100a0)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:48.613762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da226e3-4291-4f8c-ba4e-a6a1ed865132 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:48.733003 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2997/5974] 10.222.0.20 () {58 vars in 1395 bytes} [Thu Oct 27 03:48:48 2022] DELETE /identity/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials/941cb1c794354db08b0e855dab4f9d97 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:48.739347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d05e8b-d6d6-4694-b94b-ff4ef47690ff tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:48.763600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d05e8b-d6d6-4694-b94b-ff4ef47690ff tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:48.782696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b5544-071e-4a05-a543-a6dcd513e0fd tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64dceb72cd947d8ac635f71a77a9969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1164ccb261db4889803a11a93e198576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:48.783591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b5544-071e-4a05-a543-a6dcd513e0fd tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:48.783967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b5544-071e-4a05-a543-a6dcd513e0fd tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:48.784326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b5544-071e-4a05-a543-a6dcd513e0fd tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] PATH_INFO: `/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:48.786527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b5544-071e-4a05-a543-a6dcd513e0fd tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorizing `identity:create_application_credential(user_id=e64dceb72cd947d8ac635f71a77a9969)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:48.787837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b5544-071e-4a05-a543-a6dcd513e0fd tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:48.822322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5da226e3-4291-4f8c-ba4e-a6a1ed865132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '115b85f8af8e491f85a80eeb979100a0', 'request_id': 'req-5da226e3-4291-4f8c-ba4e-a6a1ed865132'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:48.915726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5da226e3-4291-4f8c-ba4e-a6a1ed865132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '115b85f8af8e491f85a80eeb979100a0', 'request_id': 'req-5da226e3-4291-4f8c-ba4e-a6a1ed865132'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:48.935748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5da226e3-4291-4f8c-ba4e-a6a1ed865132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '115b85f8af8e491f85a80eeb979100a0', 'request_id': 'req-5da226e3-4291-4f8c-ba4e-a6a1ed865132'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:48.949965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5da226e3-4291-4f8c-ba4e-a6a1ed865132 admin admin] The token cache is being invalidate because project 115b85f8af8e491f85a80eeb979100a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:48.950649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5da226e3-4291-4f8c-ba4e-a6a1ed865132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:48.951529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5da226e3-4291-4f8c-ba4e-a6a1ed865132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:48.953127 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2978/5975] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:48:48 2022] DELETE /identity/v3/projects/115b85f8af8e491f85a80eeb979100a0 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:48.958218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df3a77-d090-4d0e-a43a-d4ee46254d45 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:48.958729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df3a77-d090-4d0e-a43a-d4ee46254d45 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:48.959011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df3a77-d090-4d0e-a43a-d4ee46254d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:48.981526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-19df3a77-d090-4d0e-a43a-d4ee46254d45 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:48.982838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-19df3a77-d090-4d0e-a43a-d4ee46254d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:49.008007 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2998/5976] 10.222.0.20 () {60 vars in 1315 bytes} [Thu Oct 27 03:48:48 2022] POST /identity/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials => generated 921 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:49.013455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b5544-071e-4a05-a543-a6dcd513e0fd tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:49.016657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ef1b5544-071e-4a05-a543-a6dcd513e0fd tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:49.060002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b5544-071e-4a05-a543-a6dcd513e0fd tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:49.089481 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2979/5977] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:48:49.098561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abea5e-98e7-4ee7-9488-14998e3569ab None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:49.099103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abea5e-98e7-4ee7-9488-14998e3569ab None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:49.099314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abea5e-98e7-4ee7-9488-14998e3569ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:49.129441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d1abea5e-98e7-4ee7-9488-14998e3569ab None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:49.130918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d1abea5e-98e7-4ee7-9488-14998e3569ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:49.151854 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2980/5978] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:49.156074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abea5e-98e7-4ee7-9488-14998e3569ab None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:49.156707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdbf2b-b00a-492b-a3f5-379a5ec5a93b tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64dceb72cd947d8ac635f71a77a9969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1164ccb261db4889803a11a93e198576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:49.157442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdbf2b-b00a-492b-a3f5-379a5ec5a93b tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:49.157735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdbf2b-b00a-492b-a3f5-379a5ec5a93b tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:49.158014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdbf2b-b00a-492b-a3f5-379a5ec5a93b tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] PATH_INFO: `/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials/7f6443c438e748fba994ed884ee62b98` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:49.188597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecdbf2b-b00a-492b-a3f5-379a5ec5a93b tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e64dceb72cd947d8ac635f71a77a9969, application_credential_id=7f6443c438e748fba994ed884ee62b98)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:49.190167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecdbf2b-b00a-492b-a3f5-379a5ec5a93b tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:49.209299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abea5e-98e7-4ee7-9488-14998e3569ab None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:49.222329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e133c-bb48-47c6-9d6e-4f6cfb8da50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:49.223010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e133c-bb48-47c6-9d6e-4f6cfb8da50b admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:49.223886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e133c-bb48-47c6-9d6e-4f6cfb8da50b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:49.225120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e133c-bb48-47c6-9d6e-4f6cfb8da50b admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:49.226210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e133c-bb48-47c6-9d6e-4f6cfb8da50b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:48:49.227954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e133c-bb48-47c6-9d6e-4f6cfb8da50b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:49.229543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e133c-bb48-47c6-9d6e-4f6cfb8da50b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:49.245699 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2981/5979] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:48:49.250833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e133c-bb48-47c6-9d6e-4f6cfb8da50b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:49.267313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e133c-bb48-47c6-9d6e-4f6cfb8da50b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:49.275539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f1edd-ec29-4983-b233-bb21a367f2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:49.276593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f1edd-ec29-4983-b233-bb21a367f2c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:49.277072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f1edd-ec29-4983-b233-bb21a367f2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:49.277562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f1edd-ec29-4983-b233-bb21a367f2c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:49.278936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f1edd-ec29-4983-b233-bb21a367f2c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:49.281329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f1edd-ec29-4983-b233-bb21a367f2c7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:49.297725 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 2999/5980] 10.222.0.20 () {58 vars in 1395 bytes} [Thu Oct 27 03:48:49 2022] DELETE /identity/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials/7f6443c438e748fba994ed884ee62b98 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:48:49.298872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdbf2b-b00a-492b-a3f5-379a5ec5a93b tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:49.311209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdbf2b-b00a-492b-a3f5-379a5ec5a93b tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:49.315677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f09bca-1eec-4649-a671-9f63a97a9391 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64dceb72cd947d8ac635f71a77a9969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1164ccb261db4889803a11a93e198576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:49.316509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f09bca-1eec-4649-a671-9f63a97a9391 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:49.316805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f09bca-1eec-4649-a671-9f63a97a9391 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:49.317089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f09bca-1eec-4649-a671-9f63a97a9391 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] PATH_INFO: `/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:49.317822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f09bca-1eec-4649-a671-9f63a97a9391 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorizing `identity:create_application_credential(user_id=e64dceb72cd947d8ac635f71a77a9969)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:49.319182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f09bca-1eec-4649-a671-9f63a97a9391 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:49.413810 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2982/5981] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:48:49 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:49.416664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f1edd-ec29-4983-b233-bb21a367f2c7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:49.538889 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3000/5982] 10.222.0.20 () {60 vars in 1315 bytes} [Thu Oct 27 03:48:49 2022] POST /identity/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials => generated 813 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:49.546005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f09bca-1eec-4649-a671-9f63a97a9391 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:49.557126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f1edd-ec29-4983-b233-bb21a367f2c7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:49.564324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6074494-60a2-4db9-ac4f-cf5e84d58b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:49.565194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6074494-60a2-4db9-ac4f-cf5e84d58b6e admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:49.565483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6074494-60a2-4db9-ac4f-cf5e84d58b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:49.566090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6074494-60a2-4db9-ac4f-cf5e84d58b6e admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:49.566802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6074494-60a2-4db9-ac4f-cf5e84d58b6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:49.569752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6074494-60a2-4db9-ac4f-cf5e84d58b6e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:49.573155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f09bca-1eec-4649-a671-9f63a97a9391 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:49.642064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7f9dd-7244-4f29-986f-091ea48ba6eb tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64dceb72cd947d8ac635f71a77a9969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1164ccb261db4889803a11a93e198576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:49.642709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7f9dd-7244-4f29-986f-091ea48ba6eb tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:49.642995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7f9dd-7244-4f29-986f-091ea48ba6eb tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:49.650353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7f9dd-7244-4f29-986f-091ea48ba6eb tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] PATH_INFO: `/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials/eec635b8773347358b28cb4535df6551` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:49.653324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7f9dd-7244-4f29-986f-091ea48ba6eb tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e64dceb72cd947d8ac635f71a77a9969, application_credential_id=eec635b8773347358b28cb4535df6551)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:49.654888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7f9dd-7244-4f29-986f-091ea48ba6eb tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:49.727346 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2983/5983] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:48:49 2022] POST /identity/v3/users => generated 292 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:49.734266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6074494-60a2-4db9-ac4f-cf5e84d58b6e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:49.750215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6074494-60a2-4db9-ac4f-cf5e84d58b6e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:49.755955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:49.770011 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3001/5984] 10.222.0.20 () {58 vars in 1395 bytes} [Thu Oct 27 03:48:49 2022] DELETE /identity/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials/eec635b8773347358b28cb4535df6551 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:49.776523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7f9dd-7244-4f29-986f-091ea48ba6eb tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:49.799592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7f9dd-7244-4f29-986f-091ea48ba6eb tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:49.813200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037cce5-3f4b-4c57-8ea8-7fc287bbf76f tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64dceb72cd947d8ac635f71a77a9969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1164ccb261db4889803a11a93e198576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:49.813200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037cce5-3f4b-4c57-8ea8-7fc287bbf76f tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:49.813421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037cce5-3f4b-4c57-8ea8-7fc287bbf76f tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:49.813658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037cce5-3f4b-4c57-8ea8-7fc287bbf76f tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] PATH_INFO: `/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:49.814318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3a7aa-fd2d-4005-a4d9-593636f300cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:49.814437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037cce5-3f4b-4c57-8ea8-7fc287bbf76f tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorizing `identity:create_application_credential(user_id=e64dceb72cd947d8ac635f71a77a9969)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:49.816121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037cce5-3f4b-4c57-8ea8-7fc287bbf76f tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:49.818615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3a7aa-fd2d-4005-a4d9-593636f300cc admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:49.820991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3a7aa-fd2d-4005-a4d9-593636f300cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:49.821373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3a7aa-fd2d-4005-a4d9-593636f300cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:49.825780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3a7aa-fd2d-4005-a4d9-593636f300cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:49.831452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3a7aa-fd2d-4005-a4d9-593636f300cc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:49.882068 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2984/5985] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:48:49.886447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3a7aa-fd2d-4005-a4d9-593636f300cc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:49.909877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3a7aa-fd2d-4005-a4d9-593636f300cc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:49.927470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bc2b1-e639-4cc8-aa7a-cc4d5235eebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:49.928925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bc2b1-e639-4cc8-aa7a-cc4d5235eebd admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:49.931436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bc2b1-e639-4cc8-aa7a-cc4d5235eebd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:49.934208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bc2b1-e639-4cc8-aa7a-cc4d5235eebd admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:49.935064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058bc2b1-e639-4cc8-aa7a-cc4d5235eebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:49.941197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058bc2b1-e639-4cc8-aa7a-cc4d5235eebd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:49.995212 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2985/5986] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:49.999603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bc2b1-e639-4cc8-aa7a-cc4d5235eebd admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:50.019429 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3002/5987] 10.222.0.20 () {60 vars in 1314 bytes} [Thu Oct 27 03:48:49 2022] POST /identity/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials => generated 789 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:50.023781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037cce5-3f4b-4c57-8ea8-7fc287bbf76f tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:50.026173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bc2b1-e639-4cc8-aa7a-cc4d5235eebd admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:50.038217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:50.048589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a0344-1b36-420a-83f4-580a847d7b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:50.050546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a0344-1b36-420a-83f4-580a847d7b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:50.055331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037cce5-3f4b-4c57-8ea8-7fc287bbf76f tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:50.055510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a0344-1b36-420a-83f4-580a847d7b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:50.056579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a0344-1b36-420a-83f4-580a847d7b86 admin admin] PATH_INFO: `/v3/projects/cc14a49f9b534978bf1ce77ce2e7bb59/users/4ee93fdea79840e59dab1a8305116e78/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:50.073692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e82e4-29f9-4f98-b1f8-277eab2083a2 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64dceb72cd947d8ac635f71a77a9969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1164ccb261db4889803a11a93e198576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:50.077870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e82e4-29f9-4f98-b1f8-277eab2083a2 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:50.078341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e82e4-29f9-4f98-b1f8-277eab2083a2 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:50.078756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e82e4-29f9-4f98-b1f8-277eab2083a2 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] PATH_INFO: `/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:50.082411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e82e4-29f9-4f98-b1f8-277eab2083a2 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorizing `identity:create_application_credential(user_id=e64dceb72cd947d8ac635f71a77a9969)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:50.083732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e82e4-29f9-4f98-b1f8-277eab2083a2 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:50.104004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a0344-1b36-420a-83f4-580a847d7b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc14a49f9b534978bf1ce77ce2e7bb59, user_id=4ee93fdea79840e59dab1a8305116e78, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:50.107530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a0344-1b36-420a-83f4-580a847d7b86 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:50.247117 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2986/5988] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:49 2022] PUT /identity/v3/projects/cc14a49f9b534978bf1ce77ce2e7bb59/users/4ee93fdea79840e59dab1a8305116e78/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:50.257639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16daf5cd-544c-487c-be73-e8a6d2a312e4 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:50.257929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16daf5cd-544c-487c-be73-e8a6d2a312e4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:50.258228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16daf5cd-544c-487c-be73-e8a6d2a312e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:50.379740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-16daf5cd-544c-487c-be73-e8a6d2a312e4 None None] MFA Rules not processed for user `4ee93fdea79840e59dab1a8305116e78`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:50.382616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-16daf5cd-544c-487c-be73-e8a6d2a312e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:50.383539 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3003/5989] 10.222.0.20 () {60 vars in 1314 bytes} [Thu Oct 27 03:48:50 2022] POST /identity/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials => generated 789 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:50.389966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e82e4-29f9-4f98-b1f8-277eab2083a2 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:50.414162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e82e4-29f9-4f98-b1f8-277eab2083a2 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:50.566602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4f214-abf0-44f0-aea0-2c9ce9af5125 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64dceb72cd947d8ac635f71a77a9969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1164ccb261db4889803a11a93e198576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:50.567849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4f214-abf0-44f0-aea0-2c9ce9af5125 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:50.569871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4f214-abf0-44f0-aea0-2c9ce9af5125 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:50.569871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4f214-abf0-44f0-aea0-2c9ce9af5125 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] PATH_INFO: `/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:50.569871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4f214-abf0-44f0-aea0-2c9ce9af5125 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorizing `identity:list_application_credentials(user_id=e64dceb72cd947d8ac635f71a77a9969)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:50.593329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4f214-abf0-44f0-aea0-2c9ce9af5125 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:50.593438 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2987/5990] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:48:50.599984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16daf5cd-544c-487c-be73-e8a6d2a312e4 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:50.602141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-16daf5cd-544c-487c-be73-e8a6d2a312e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:50.618582 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3004/5991] 10.222.0.20 () {58 vars in 1293 bytes} [Thu Oct 27 03:48:50 2022] GET /identity/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials => generated 1502 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:50.622844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4f214-abf0-44f0-aea0-2c9ce9af5125 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:50.641137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4f214-abf0-44f0-aea0-2c9ce9af5125 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:50.655784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb141e-5771-4368-bf82-e0de2de5043b tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64dceb72cd947d8ac635f71a77a9969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1164ccb261db4889803a11a93e198576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:50.656918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb141e-5771-4368-bf82-e0de2de5043b tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:50.658047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb141e-5771-4368-bf82-e0de2de5043b tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:50.658518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb141e-5771-4368-bf82-e0de2de5043b tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] PATH_INFO: `/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials/a38986d920524259b0b33c60256f1f8e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:50.682828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb141e-5771-4368-bf82-e0de2de5043b tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e64dceb72cd947d8ac635f71a77a9969, application_credential_id=a38986d920524259b0b33c60256f1f8e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:50.685284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb141e-5771-4368-bf82-e0de2de5043b tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:50.790066 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3005/5992] 10.222.0.20 () {58 vars in 1395 bytes} [Thu Oct 27 03:48:50 2022] DELETE /identity/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials/a38986d920524259b0b33c60256f1f8e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:50.794356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb141e-5771-4368-bf82-e0de2de5043b tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:50.817118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb141e-5771-4368-bf82-e0de2de5043b tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:50.819673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16daf5cd-544c-487c-be73-e8a6d2a312e4 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:50.830012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71b750-0753-45be-b880-a744850eb74a tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64dceb72cd947d8ac635f71a77a9969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1164ccb261db4889803a11a93e198576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:50.831632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71b750-0753-45be-b880-a744850eb74a tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:50.833675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71b750-0753-45be-b880-a744850eb74a tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:50.834177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71b750-0753-45be-b880-a744850eb74a tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] PATH_INFO: `/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials/aaae1ae73bf4493692d9a3973c2cf9c8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:50.835785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac99618-4f04-45c7-9fff-d0c2e8283940 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:50.836541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac99618-4f04-45c7-9fff-d0c2e8283940 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:50.836927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac99618-4f04-45c7-9fff-d0c2e8283940 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:50.837330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac99618-4f04-45c7-9fff-d0c2e8283940 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:50.863710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac99618-4f04-45c7-9fff-d0c2e8283940 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:50.865557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac99618-4f04-45c7-9fff-d0c2e8283940 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:50.866358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71b750-0753-45be-b880-a744850eb74a tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e64dceb72cd947d8ac635f71a77a9969, application_credential_id=aaae1ae73bf4493692d9a3973c2cf9c8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:50.868207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71b750-0753-45be-b880-a744850eb74a tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:50.889780 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2988/5993] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:48:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:48:50.930598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:51.016508 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3006/5994] 10.222.0.20 () {58 vars in 1395 bytes} [Thu Oct 27 03:48:50 2022] DELETE /identity/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials/aaae1ae73bf4493692d9a3973c2cf9c8 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:48:51.021312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:51.022831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac99618-4f04-45c7-9fff-d0c2e8283940 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:51.038028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac99618-4f04-45c7-9fff-d0c2e8283940 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:51.054357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f23898-68d7-4a7e-bbbe-3147060aa505 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64dceb72cd947d8ac635f71a77a9969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1164ccb261db4889803a11a93e198576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:51.059873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f23898-68d7-4a7e-bbbe-3147060aa505 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:51.060274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f23898-68d7-4a7e-bbbe-3147060aa505 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:51.060628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f23898-68d7-4a7e-bbbe-3147060aa505 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] PATH_INFO: `/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:51.061383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f23898-68d7-4a7e-bbbe-3147060aa505 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorizing `identity:create_application_credential(user_id=e64dceb72cd947d8ac635f71a77a9969)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:51.063337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f23898-68d7-4a7e-bbbe-3147060aa505 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:51.338487 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2989/5995] 10.222.0.20 () {60 vars in 1314 bytes} [Thu Oct 27 03:48:51 2022] POST /identity/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials => generated 788 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:51.342981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71b750-0753-45be-b880-a744850eb74a tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:51.356631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71b750-0753-45be-b880-a744850eb74a tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:51.368122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb5945-47dc-4eda-879e-37ae1b738a96 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64dceb72cd947d8ac635f71a77a9969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1164ccb261db4889803a11a93e198576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:51.368738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb5945-47dc-4eda-879e-37ae1b738a96 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:51.369187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb5945-47dc-4eda-879e-37ae1b738a96 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:51.369459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb5945-47dc-4eda-879e-37ae1b738a96 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] PATH_INFO: `/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:51.370281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb5945-47dc-4eda-879e-37ae1b738a96 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorizing `identity:create_application_credential(user_id=e64dceb72cd947d8ac635f71a77a9969)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:51.372093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb5945-47dc-4eda-879e-37ae1b738a96 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:51.617242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f23898-68d7-4a7e-bbbe-3147060aa505 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:51.618463 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3007/5996] 10.222.0.20 () {60 vars in 1314 bytes} [Thu Oct 27 03:48:51 2022] POST /identity/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials => generated 789 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:51.658918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f23898-68d7-4a7e-bbbe-3147060aa505 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:51.686760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dab500-a1e2-4fbe-8f42-12774047e03e tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64dceb72cd947d8ac635f71a77a9969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1164ccb261db4889803a11a93e198576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:51.687965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dab500-a1e2-4fbe-8f42-12774047e03e tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:51.689366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dab500-a1e2-4fbe-8f42-12774047e03e tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:51.694192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dab500-a1e2-4fbe-8f42-12774047e03e tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] PATH_INFO: `/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:51.703015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dab500-a1e2-4fbe-8f42-12774047e03e tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Adding query filter params (name=tempest-application_credential-1143339240) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:48:51.710553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dab500-a1e2-4fbe-8f42-12774047e03e tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorizing `identity:list_application_credentials(user_id=e64dceb72cd947d8ac635f71a77a9969)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:51.719418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dab500-a1e2-4fbe-8f42-12774047e03e tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:51.765277 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2990/5997] 10.222.0.20 () {58 vars in 1386 bytes} [Thu Oct 27 03:48:51 2022] GET /identity/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials?name=tempest-application_credential-1143339240 => generated 887 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:48:51.771105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb5945-47dc-4eda-879e-37ae1b738a96 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:51.835031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb5945-47dc-4eda-879e-37ae1b738a96 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:51.851156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b283d4-573a-4cb8-9b6a-123c3dda6da8 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64dceb72cd947d8ac635f71a77a9969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1164ccb261db4889803a11a93e198576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:51.851156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b283d4-573a-4cb8-9b6a-123c3dda6da8 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:51.851156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b283d4-573a-4cb8-9b6a-123c3dda6da8 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:51.851538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b283d4-573a-4cb8-9b6a-123c3dda6da8 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] PATH_INFO: `/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials/21733028674c4a4bbd0253aaf31fbf75` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:51.875625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b283d4-573a-4cb8-9b6a-123c3dda6da8 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e64dceb72cd947d8ac635f71a77a9969, application_credential_id=21733028674c4a4bbd0253aaf31fbf75)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:51.877566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b283d4-573a-4cb8-9b6a-123c3dda6da8 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:52.007902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dab500-a1e2-4fbe-8f42-12774047e03e tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:52.009419 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3008/5998] 10.222.0.20 () {58 vars in 1395 bytes} [Thu Oct 27 03:48:51 2022] DELETE /identity/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials/21733028674c4a4bbd0253aaf31fbf75 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:52.036432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dab500-a1e2-4fbe-8f42-12774047e03e tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:52.047772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a9c8e-9d2e-4298-b628-02e0e73ebead tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64dceb72cd947d8ac635f71a77a9969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1164ccb261db4889803a11a93e198576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:52.048454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a9c8e-9d2e-4298-b628-02e0e73ebead tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:52.048750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a9c8e-9d2e-4298-b628-02e0e73ebead tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:52.049036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a9c8e-9d2e-4298-b628-02e0e73ebead tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] PATH_INFO: `/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials/e2c896fa98d2406b9d1abc10013a4d66` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:52.082542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a9c8e-9d2e-4298-b628-02e0e73ebead tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e64dceb72cd947d8ac635f71a77a9969, application_credential_id=e2c896fa98d2406b9d1abc10013a4d66)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:52.085040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a9c8e-9d2e-4298-b628-02e0e73ebead tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:52.211130 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2991/5999] 10.222.0.20 () {58 vars in 1395 bytes} [Thu Oct 27 03:48:52 2022] DELETE /identity/v3/users/e64dceb72cd947d8ac635f71a77a9969/application_credentials/e2c896fa98d2406b9d1abc10013a4d66 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:52.211234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b283d4-573a-4cb8-9b6a-123c3dda6da8 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:52.214307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-05b283d4-573a-4cb8-9b6a-123c3dda6da8 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:52.474106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b283d4-573a-4cb8-9b6a-123c3dda6da8 tempest-ApplicationCredentialsV3Test-1294437535 tempest-ApplicationCredentialsV3Test-1294437535-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:52.487897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de363fad-bb54-4ed4-89cc-69e541940306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:52.488568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de363fad-bb54-4ed4-89cc-69e541940306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:52.488860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de363fad-bb54-4ed4-89cc-69e541940306 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:52.489145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de363fad-bb54-4ed4-89cc-69e541940306 admin admin] PATH_INFO: `/v3/users/e64dceb72cd947d8ac635f71a77a9969` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:52.490544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de363fad-bb54-4ed4-89cc-69e541940306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e64dceb72cd947d8ac635f71a77a9969)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:52.492599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de363fad-bb54-4ed4-89cc-69e541940306 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:52.494213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:52.814809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:52.819878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-de363fad-bb54-4ed4-89cc-69e541940306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e64dceb72cd947d8ac635f71a77a9969'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:52.829673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-de363fad-bb54-4ed4-89cc-69e541940306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e64dceb72cd947d8ac635f71a77a9969'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:52.841743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-de363fad-bb54-4ed4-89cc-69e541940306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e64dceb72cd947d8ac635f71a77a9969'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:52.966554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-de363fad-bb54-4ed4-89cc-69e541940306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e64dceb72cd947d8ac635f71a77a9969'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:52.995874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-de363fad-bb54-4ed4-89cc-69e541940306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e64dceb72cd947d8ac635f71a77a9969'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:53.158223 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3009/6000] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:48:52 2022] DELETE /identity/v3/users/e64dceb72cd947d8ac635f71a77a9969 => generated 0 bytes in 953 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:53.162788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623ca6a-7e8f-46e6-87ec-d404ca7285da None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:53.163273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623ca6a-7e8f-46e6-87ec-d404ca7285da None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:53.163729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623ca6a-7e8f-46e6-87ec-d404ca7285da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:53.209629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-3623ca6a-7e8f-46e6-87ec-d404ca7285da None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:53.211180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3623ca6a-7e8f-46e6-87ec-d404ca7285da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:53.383245 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2992/6001] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:53.395452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de363fad-bb54-4ed4-89cc-69e541940306 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:53.403146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-de363fad-bb54-4ed4-89cc-69e541940306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:53.519216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de363fad-bb54-4ed4-89cc-69e541940306 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:53.524522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eff1e6-758b-424e-9791-91433ac70915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:53.525172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eff1e6-758b-424e-9791-91433ac70915 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:53.525463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eff1e6-758b-424e-9791-91433ac70915 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:53.525749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eff1e6-758b-424e-9791-91433ac70915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:53.555609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eff1e6-758b-424e-9791-91433ac70915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:53.572827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eff1e6-758b-424e-9791-91433ac70915 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:53.582193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:53.611061 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3010/6002] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:48:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:48:53.910733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:54.151976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:54.804400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:54.935537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:55.215302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623ca6a-7e8f-46e6-87ec-d404ca7285da None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:55.217162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3623ca6a-7e8f-46e6-87ec-d404ca7285da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:55.247787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623ca6a-7e8f-46e6-87ec-d404ca7285da None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:55.263509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1812ad-8e9e-473f-9658-eeef39c618a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:55.264173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1812ad-8e9e-473f-9658-eeef39c618a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:55.264453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1812ad-8e9e-473f-9658-eeef39c618a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:55.264723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1812ad-8e9e-473f-9658-eeef39c618a3 admin admin] PATH_INFO: `/v3/projects/1164ccb261db4889803a11a93e198576` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:55.292597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1812ad-8e9e-473f-9658-eeef39c618a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1164ccb261db4889803a11a93e198576)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:55.302232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1812ad-8e9e-473f-9658-eeef39c618a3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:55.454615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0f1812ad-8e9e-473f-9658-eeef39c618a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1164ccb261db4889803a11a93e198576', 'request_id': 'req-0f1812ad-8e9e-473f-9658-eeef39c618a3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:55.581137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0f1812ad-8e9e-473f-9658-eeef39c618a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1164ccb261db4889803a11a93e198576', 'request_id': 'req-0f1812ad-8e9e-473f-9658-eeef39c618a3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:55.590691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0f1812ad-8e9e-473f-9658-eeef39c618a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1164ccb261db4889803a11a93e198576', 'request_id': 'req-0f1812ad-8e9e-473f-9658-eeef39c618a3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:55.618958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0f1812ad-8e9e-473f-9658-eeef39c618a3 admin admin] The token cache is being invalidate because project 1164ccb261db4889803a11a93e198576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:48:55.620008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0f1812ad-8e9e-473f-9658-eeef39c618a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:55.621661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0f1812ad-8e9e-473f-9658-eeef39c618a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:48:55.630510 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2993/6003] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:48:55 2022] DELETE /identity/v3/projects/1164ccb261db4889803a11a93e198576 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:55.631402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378b711-022d-467b-8281-066c683d57d1 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:55.638259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378b711-022d-467b-8281-066c683d57d1 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:55.638259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378b711-022d-467b-8281-066c683d57d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:55.689271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1378b711-022d-467b-8281-066c683d57d1 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:55.702582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1378b711-022d-467b-8281-066c683d57d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:55.826747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:55.915689 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3011/6004] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:55.925046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874a48a-0c51-47fd-a03c-50a041be62ad None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:55.925372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874a48a-0c51-47fd-a03c-50a041be62ad None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:55.925865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874a48a-0c51-47fd-a03c-50a041be62ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:55.963927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:55.989329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-7874a48a-0c51-47fd-a03c-50a041be62ad None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:56.002273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7874a48a-0c51-47fd-a03c-50a041be62ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:56.041258 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2994/6005] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:56.043951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378b711-022d-467b-8281-066c683d57d1 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:56.059885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378b711-022d-467b-8281-066c683d57d1 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:56.081506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5628abc-feac-418a-bcaf-075cefc92916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:56.082534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5628abc-feac-418a-bcaf-075cefc92916 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:56.082979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5628abc-feac-418a-bcaf-075cefc92916 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:56.083411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5628abc-feac-418a-bcaf-075cefc92916 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:56.084243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5628abc-feac-418a-bcaf-075cefc92916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:48:56.084708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5628abc-feac-418a-bcaf-075cefc92916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:56.092474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:56.094453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5628abc-feac-418a-bcaf-075cefc92916 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:56.122453 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3012/6006] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:48:56.126876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874a48a-0c51-47fd-a03c-50a041be62ad None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:56.139976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874a48a-0c51-47fd-a03c-50a041be62ad None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:56.153962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3fafb-8223-45de-8f73-9cbae0a6a5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:56.154861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3fafb-8223-45de-8f73-9cbae0a6a5e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:56.155309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3fafb-8223-45de-8f73-9cbae0a6a5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:56.155737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3fafb-8223-45de-8f73-9cbae0a6a5e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:56.156564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3fafb-8223-45de-8f73-9cbae0a6a5e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:56.159714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3fafb-8223-45de-8f73-9cbae0a6a5e7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:56.298359 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2995/6007] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:48:56 2022] POST /identity/v3/projects => generated 397 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:56.302607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5628abc-feac-418a-bcaf-075cefc92916 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:56.320369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5628abc-feac-418a-bcaf-075cefc92916 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:56.417449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202726d-fc97-4994-8400-69f09e55de42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:56.421558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202726d-fc97-4994-8400-69f09e55de42 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:56.421558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202726d-fc97-4994-8400-69f09e55de42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:56.421558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202726d-fc97-4994-8400-69f09e55de42 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:56.421558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202726d-fc97-4994-8400-69f09e55de42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:56.424149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202726d-fc97-4994-8400-69f09e55de42 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:56.525811 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3013/6008] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:48:56 2022] POST /identity/v3/users => generated 305 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:56.529776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3fafb-8223-45de-8f73-9cbae0a6a5e7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:56.565666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3fafb-8223-45de-8f73-9cbae0a6a5e7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:56.584269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9a6eb-0906-4a6c-8368-97ebfa77de55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:56.588691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9a6eb-0906-4a6c-8368-97ebfa77de55 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:56.588691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9a6eb-0906-4a6c-8368-97ebfa77de55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:56.588691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9a6eb-0906-4a6c-8368-97ebfa77de55 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:56.588691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9a6eb-0906-4a6c-8368-97ebfa77de55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:56.590324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9a6eb-0906-4a6c-8368-97ebfa77de55 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:56.629707 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2996/6009] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:56.643460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202726d-fc97-4994-8400-69f09e55de42 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:56.660412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202726d-fc97-4994-8400-69f09e55de42 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:56.672123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148193b-fe26-4cf1-919e-d778675f387c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:56.673033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148193b-fe26-4cf1-919e-d778675f387c admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:56.673510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148193b-fe26-4cf1-919e-d778675f387c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:56.673962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148193b-fe26-4cf1-919e-d778675f387c admin admin] PATH_INFO: `/v3/projects/02a4f0a5564f4b9db6842f2869e5b776/users/9669cb23b57a4709937528eb67e21feb/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:56.696466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148193b-fe26-4cf1-919e-d778675f387c admin admin] RBAC: Authorizing `identity:create_grant(project_id=02a4f0a5564f4b9db6842f2869e5b776, user_id=9669cb23b57a4709937528eb67e21feb, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:56.699248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148193b-fe26-4cf1-919e-d778675f387c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:56.760114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:56.833994 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3014/6010] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:56 2022] PUT /identity/v3/projects/02a4f0a5564f4b9db6842f2869e5b776/users/9669cb23b57a4709937528eb67e21feb/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:56.838313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9a6eb-0906-4a6c-8368-97ebfa77de55 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:56.854795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9a6eb-0906-4a6c-8368-97ebfa77de55 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:57.048381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754b2b8-e5a6-479e-ac23-77e5a3f0f1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:57.048841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754b2b8-e5a6-479e-ac23-77e5a3f0f1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:57.049112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754b2b8-e5a6-479e-ac23-77e5a3f0f1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:57.049391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754b2b8-e5a6-479e-ac23-77e5a3f0f1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:57.050075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754b2b8-e5a6-479e-ac23-77e5a3f0f1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:57.051717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754b2b8-e5a6-479e-ac23-77e5a3f0f1f5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:57.075498 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2997/6011] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:57.078347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148193b-fe26-4cf1-919e-d778675f387c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:57.093636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148193b-fe26-4cf1-919e-d778675f387c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:57.110790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6ba2c-ee0b-4eb0-950e-b4edf3cd7c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:57.111769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6ba2c-ee0b-4eb0-950e-b4edf3cd7c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:57.112297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6ba2c-ee0b-4eb0-950e-b4edf3cd7c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:57.112675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6ba2c-ee0b-4eb0-950e-b4edf3cd7c02 admin admin] PATH_INFO: `/v3/projects/02a4f0a5564f4b9db6842f2869e5b776/users/9669cb23b57a4709937528eb67e21feb/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:57.120272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6ba2c-ee0b-4eb0-950e-b4edf3cd7c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02a4f0a5564f4b9db6842f2869e5b776, user_id=9669cb23b57a4709937528eb67e21feb, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:57.126332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6ba2c-ee0b-4eb0-950e-b4edf3cd7c02 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:57.172578 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3015/6012] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:57 2022] PUT /identity/v3/projects/02a4f0a5564f4b9db6842f2869e5b776/users/9669cb23b57a4709937528eb67e21feb/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:48:57.190891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e938b25-3ac4-4bdb-b168-72d622b1dfc0 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:57.191500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e938b25-3ac4-4bdb-b168-72d622b1dfc0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:57.191935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e938b25-3ac4-4bdb-b168-72d622b1dfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:57.290337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5e938b25-3ac4-4bdb-b168-72d622b1dfc0 None None] MFA Rules not processed for user `9669cb23b57a4709937528eb67e21feb`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:57.291830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5e938b25-3ac4-4bdb-b168-72d622b1dfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:57.335761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:57.412422 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2998/6013] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:57 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:57.413019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6ba2c-ee0b-4eb0-950e-b4edf3cd7c02 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:57.513606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6ba2c-ee0b-4eb0-950e-b4edf3cd7c02 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:57.518848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9b5c0-32d0-4af0-ba8e-a8fbb45956a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:57.519892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9b5c0-32d0-4af0-ba8e-a8fbb45956a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:57.520365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9b5c0-32d0-4af0-ba8e-a8fbb45956a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:57.520932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9b5c0-32d0-4af0-ba8e-a8fbb45956a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:57.522080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9b5c0-32d0-4af0-ba8e-a8fbb45956a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:57.527573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9b5c0-32d0-4af0-ba8e-a8fbb45956a4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:57.533691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:57.683145 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3016/6014] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:48:57 2022] POST /identity/v3/projects => generated 397 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:48:57.688779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e938b25-3ac4-4bdb-b168-72d622b1dfc0 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:57.701370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e938b25-3ac4-4bdb-b168-72d622b1dfc0 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:57.867808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e4b42-ffcd-4f6a-8425-b0333b79810c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:57.868565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e4b42-ffcd-4f6a-8425-b0333b79810c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:57.868856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e4b42-ffcd-4f6a-8425-b0333b79810c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:57.869133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e4b42-ffcd-4f6a-8425-b0333b79810c admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:57.869781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e4b42-ffcd-4f6a-8425-b0333b79810c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:57.872501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e4b42-ffcd-4f6a-8425-b0333b79810c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:57.919174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:58.007330 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 2999/6015] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:48:57 2022] POST /identity/v3/users => generated 299 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:48:58.013601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9b5c0-32d0-4af0-ba8e-a8fbb45956a4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:58.031622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9b5c0-32d0-4af0-ba8e-a8fbb45956a4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:58.041383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:58.050585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa2ac2-3234-4196-beca-e7d26200e048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:58.052137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa2ac2-3234-4196-beca-e7d26200e048 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:58.052935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa2ac2-3234-4196-beca-e7d26200e048 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:58.053488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa2ac2-3234-4196-beca-e7d26200e048 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:58.054929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa2ac2-3234-4196-beca-e7d26200e048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:58.057997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa2ac2-3234-4196-beca-e7d26200e048 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:58.108914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e4b42-ffcd-4f6a-8425-b0333b79810c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:58.115663 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3017/6016] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:58.125817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e4b42-ffcd-4f6a-8425-b0333b79810c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:58.136284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617004c2-941e-4e61-82fd-5cb9409f3bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:58.142652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617004c2-941e-4e61-82fd-5cb9409f3bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:58.143293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617004c2-941e-4e61-82fd-5cb9409f3bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:58.143857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617004c2-941e-4e61-82fd-5cb9409f3bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:58.145005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617004c2-941e-4e61-82fd-5cb9409f3bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:58.147051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617004c2-941e-4e61-82fd-5cb9409f3bc1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:58.202239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa2ac2-3234-4196-beca-e7d26200e048 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:58.226855 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3000/6017] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:48:58.229592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa2ac2-3234-4196-beca-e7d26200e048 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:58.236677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962cdaa-97b9-466d-9184-3908da796757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:58.237598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962cdaa-97b9-466d-9184-3908da796757 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:58.238085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962cdaa-97b9-466d-9184-3908da796757 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:58.239368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962cdaa-97b9-466d-9184-3908da796757 admin admin] PATH_INFO: `/v3/projects/e7fcbc56c3474bdcbe613fbe54f9c421/users/4d13d131b81b45108d20871315ca04ba/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:58.271589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962cdaa-97b9-466d-9184-3908da796757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7fcbc56c3474bdcbe613fbe54f9c421, user_id=4d13d131b81b45108d20871315ca04ba, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:58.274750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962cdaa-97b9-466d-9184-3908da796757 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:58.280987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:58.441092 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3018/6018] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:48:58 2022] PUT /identity/v3/projects/e7fcbc56c3474bdcbe613fbe54f9c421/users/4d13d131b81b45108d20871315ca04ba/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:48:58.454366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15771c45-4859-4912-b235-416c0bb960e9 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:58.458050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15771c45-4859-4912-b235-416c0bb960e9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:58.458050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15771c45-4859-4912-b235-416c0bb960e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:58.502360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-15771c45-4859-4912-b235-416c0bb960e9 None None] MFA Rules not processed for user `4d13d131b81b45108d20871315ca04ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:48:58.504597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-15771c45-4859-4912-b235-416c0bb960e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:58.669355 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3001/6019] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:48:58 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:48:58.682254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962cdaa-97b9-466d-9184-3908da796757 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:48:58.686939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3962cdaa-97b9-466d-9184-3908da796757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:48:58.853783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:58.872649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962cdaa-97b9-466d-9184-3908da796757 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:48:58.881782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93586f7-aa2b-4451-bf25-928f9286ca59 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:48:58.882534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93586f7-aa2b-4451-bf25-928f9286ca59 service glance] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:48:58.887423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93586f7-aa2b-4451-bf25-928f9286ca59 service glance] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:48:58.888551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93586f7-aa2b-4451-bf25-928f9286ca59 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:48:59.062689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93586f7-aa2b-4451-bf25-928f9286ca59 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:48:59.064250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93586f7-aa2b-4451-bf25-928f9286ca59 service glance] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:48:59.108355 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3019/6020] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:48:58 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:49:00.022386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:00.669753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15771c45-4859-4912-b235-416c0bb960e9 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:00.748904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:00.791506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15771c45-4859-4912-b235-416c0bb960e9 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:00.801622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d2ca6-cf58-432f-bbfe-27a6f15dcfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:00.802679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d2ca6-cf58-432f-bbfe-27a6f15dcfdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:00.803137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d2ca6-cf58-432f-bbfe-27a6f15dcfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:00.803585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d2ca6-cf58-432f-bbfe-27a6f15dcfdf admin admin] PATH_INFO: `/v3/users/9669cb23b57a4709937528eb67e21feb` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:00.808608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d2ca6-cf58-432f-bbfe-27a6f15dcfdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9669cb23b57a4709937528eb67e21feb)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:00.811162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d2ca6-cf58-432f-bbfe-27a6f15dcfdf admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:01.085512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-211d2ca6-cf58-432f-bbfe-27a6f15dcfdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9669cb23b57a4709937528eb67e21feb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:01.088782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-211d2ca6-cf58-432f-bbfe-27a6f15dcfdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9669cb23b57a4709937528eb67e21feb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:01.102257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-211d2ca6-cf58-432f-bbfe-27a6f15dcfdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9669cb23b57a4709937528eb67e21feb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:01.149577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-211d2ca6-cf58-432f-bbfe-27a6f15dcfdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9669cb23b57a4709937528eb67e21feb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:01.272873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-211d2ca6-cf58-432f-bbfe-27a6f15dcfdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9669cb23b57a4709937528eb67e21feb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:01.285949 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3002/6021] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:49:00 2022] DELETE /identity/v3/users/9669cb23b57a4709937528eb67e21feb => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:01.287574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045101f6-b316-4fd9-ad23-fed54dfd99e3 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:01.287869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045101f6-b316-4fd9-ad23-fed54dfd99e3 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:01.288147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045101f6-b316-4fd9-ad23-fed54dfd99e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:01.362655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-045101f6-b316-4fd9-ad23-fed54dfd99e3 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:01.369708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-045101f6-b316-4fd9-ad23-fed54dfd99e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:01.569903 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3020/6022] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:01.590384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d2ca6-cf58-432f-bbfe-27a6f15dcfdf admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:01.594529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-211d2ca6-cf58-432f-bbfe-27a6f15dcfdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:01.711049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d2ca6-cf58-432f-bbfe-27a6f15dcfdf admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:01.719817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa033345-a114-4cdc-abc5-806397cc6162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:01.720663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa033345-a114-4cdc-abc5-806397cc6162 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:01.721111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa033345-a114-4cdc-abc5-806397cc6162 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:01.721558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa033345-a114-4cdc-abc5-806397cc6162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:01.739950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa033345-a114-4cdc-abc5-806397cc6162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:01.741699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa033345-a114-4cdc-abc5-806397cc6162 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:01.779833 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3003/6023] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:49:01.800612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:02.379269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045101f6-b316-4fd9-ad23-fed54dfd99e3 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:02.379269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-045101f6-b316-4fd9-ad23-fed54dfd99e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:02.382134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa033345-a114-4cdc-abc5-806397cc6162 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:02.387041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-aa033345-a114-4cdc-abc5-806397cc6162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:02.445442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa033345-a114-4cdc-abc5-806397cc6162 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:02.452713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045101f6-b316-4fd9-ad23-fed54dfd99e3 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:02.456863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:02.466568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4737168-e076-43ed-9d6b-4d615977ea12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:02.467224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4737168-e076-43ed-9d6b-4d615977ea12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:02.471158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2fc63-5d8e-44f1-b910-502258bdd626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:02.471158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2fc63-5d8e-44f1-b910-502258bdd626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:02.471158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2fc63-5d8e-44f1-b910-502258bdd626 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:02.471158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2fc63-5d8e-44f1-b910-502258bdd626 admin admin] PATH_INFO: `/v3/users/363cbeb57b7c4c2ca57c6c9777a451da` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:02.471746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4737168-e076-43ed-9d6b-4d615977ea12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:02.471746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4737168-e076-43ed-9d6b-4d615977ea12 admin admin] PATH_INFO: `/v3/users/90e9d7cd29034c978171ebe24ae2e004` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:02.503522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4737168-e076-43ed-9d6b-4d615977ea12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e9d7cd29034c978171ebe24ae2e004)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:02.504338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2fc63-5d8e-44f1-b910-502258bdd626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=363cbeb57b7c4c2ca57c6c9777a451da)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:02.509655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2fc63-5d8e-44f1-b910-502258bdd626 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:02.510137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4737168-e076-43ed-9d6b-4d615977ea12 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:02.919704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-05a2fc63-5d8e-44f1-b910-502258bdd626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '363cbeb57b7c4c2ca57c6c9777a451da'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:02.921138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-05a2fc63-5d8e-44f1-b910-502258bdd626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '363cbeb57b7c4c2ca57c6c9777a451da'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:02.938525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-05a2fc63-5d8e-44f1-b910-502258bdd626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '363cbeb57b7c4c2ca57c6c9777a451da'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:03.019553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-05a2fc63-5d8e-44f1-b910-502258bdd626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '363cbeb57b7c4c2ca57c6c9777a451da'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:03.021130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-05a2fc63-5d8e-44f1-b910-502258bdd626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '363cbeb57b7c4c2ca57c6c9777a451da'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:03.023400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c4737168-e076-43ed-9d6b-4d615977ea12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e9d7cd29034c978171ebe24ae2e004'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:03.031047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c4737168-e076-43ed-9d6b-4d615977ea12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e9d7cd29034c978171ebe24ae2e004'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:03.051233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c4737168-e076-43ed-9d6b-4d615977ea12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e9d7cd29034c978171ebe24ae2e004'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:03.070456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c4737168-e076-43ed-9d6b-4d615977ea12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e9d7cd29034c978171ebe24ae2e004'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:03.214782 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3021/6024] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:49:02 2022] DELETE /identity/v3/users/363cbeb57b7c4c2ca57c6c9777a451da => generated 0 bytes in 845 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:03.218401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35c3df-c444-41ad-8dc1-726da7ac2820 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:03.218618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35c3df-c444-41ad-8dc1-726da7ac2820 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:03.219069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35c3df-c444-41ad-8dc1-726da7ac2820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:03.250910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-be35c3df-c444-41ad-8dc1-726da7ac2820 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:03.252430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-be35c3df-c444-41ad-8dc1-726da7ac2820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:03.294878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c4737168-e076-43ed-9d6b-4d615977ea12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e9d7cd29034c978171ebe24ae2e004'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:03.315721 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3004/6025] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:49:02 2022] DELETE /identity/v3/users/90e9d7cd29034c978171ebe24ae2e004 => generated 0 bytes in 930 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:49:03.317267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20971901-7915-4321-9286-856c151251c8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:03.318517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20971901-7915-4321-9286-856c151251c8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:03.318949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20971901-7915-4321-9286-856c151251c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:03.360042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:03.403463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-20971901-7915-4321-9286-856c151251c8 None None] MFA Rules not processed for user `530d04ccbfb7413790c8311a10c8cbee`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:03.403463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-20971901-7915-4321-9286-856c151251c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:03.434627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:03.462096 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3022/6026] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:49:03.463936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095ca6f-ea27-4f73-9755-90d95f2b4907 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:03.464981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095ca6f-ea27-4f73-9755-90d95f2b4907 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:03.473809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095ca6f-ea27-4f73-9755-90d95f2b4907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:03.526553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3095ca6f-ea27-4f73-9755-90d95f2b4907 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:03.527964 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3005/6027] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:03 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:03.531852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3095ca6f-ea27-4f73-9755-90d95f2b4907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:03.531962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20971901-7915-4321-9286-856c151251c8 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:03.531962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-20971901-7915-4321-9286-856c151251c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:03.604067 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3023/6028] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:03.605040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095ca6f-ea27-4f73-9755-90d95f2b4907 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:03.609443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3095ca6f-ea27-4f73-9755-90d95f2b4907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:03.616240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20971901-7915-4321-9286-856c151251c8 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:03.621827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573c307-d481-4842-83b9-e34927db0f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:03.622899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573c307-d481-4842-83b9-e34927db0f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:03.623188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573c307-d481-4842-83b9-e34927db0f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:03.623596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573c307-d481-4842-83b9-e34927db0f6d admin admin] PATH_INFO: `/v3/projects/02a4f0a5564f4b9db6842f2869e5b776` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:03.624831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573c307-d481-4842-83b9-e34927db0f6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=02a4f0a5564f4b9db6842f2869e5b776)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:03.626863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573c307-d481-4842-83b9-e34927db0f6d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:03.690875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095ca6f-ea27-4f73-9755-90d95f2b4907 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:03.696508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aca429-37d2-4c44-8e99-d92b0b5cc533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:03.697142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aca429-37d2-4c44-8e99-d92b0b5cc533 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:03.697477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aca429-37d2-4c44-8e99-d92b0b5cc533 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:03.697759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aca429-37d2-4c44-8e99-d92b0b5cc533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:03.711861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aca429-37d2-4c44-8e99-d92b0b5cc533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:03.713556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aca429-37d2-4c44-8e99-d92b0b5cc533 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:03.728354 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3024/6029] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:49:03.729614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fa3f8-1828-4880-aa4b-93b79950b52c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:03.729944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fa3f8-1828-4880-aa4b-93b79950b52c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:03.730331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fa3f8-1828-4880-aa4b-93b79950b52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:03.774649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6a9fa3f8-1828-4880-aa4b-93b79950b52c None None] MFA Rules not processed for user `2fc1e7eafd7948279f08eb5ad52f5609`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:03.779076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6a9fa3f8-1828-4880-aa4b-93b79950b52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:03.784163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a573c307-d481-4842-83b9-e34927db0f6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02a4f0a5564f4b9db6842f2869e5b776', 'request_id': 'req-a573c307-d481-4842-83b9-e34927db0f6d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:03.815854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:03.895000 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3025/6030] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:03 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:03.900305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fa3f8-1828-4880-aa4b-93b79950b52c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:03.900975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a573c307-d481-4842-83b9-e34927db0f6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02a4f0a5564f4b9db6842f2869e5b776', 'request_id': 'req-a573c307-d481-4842-83b9-e34927db0f6d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:03.915596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a573c307-d481-4842-83b9-e34927db0f6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02a4f0a5564f4b9db6842f2869e5b776', 'request_id': 'req-a573c307-d481-4842-83b9-e34927db0f6d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:03.972015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a573c307-d481-4842-83b9-e34927db0f6d admin admin] The token cache is being invalidate because project 02a4f0a5564f4b9db6842f2869e5b776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:03.972015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a573c307-d481-4842-83b9-e34927db0f6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:03.972015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a573c307-d481-4842-83b9-e34927db0f6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:03.979817 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3006/6031] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:03 2022] DELETE /identity/v3/projects/02a4f0a5564f4b9db6842f2869e5b776 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:03.980976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573c307-d481-4842-83b9-e34927db0f6d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:03.990355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a573c307-d481-4842-83b9-e34927db0f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:04.072808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fa3f8-1828-4880-aa4b-93b79950b52c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:04.089049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5782b72-10a6-4658-a9b1-c4aca38581bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:04.090810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5782b72-10a6-4658-a9b1-c4aca38581bd service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:04.091434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5782b72-10a6-4658-a9b1-c4aca38581bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:04.095806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5782b72-10a6-4658-a9b1-c4aca38581bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:04.099956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d5782b72-10a6-4658-a9b1-c4aca38581bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:04.286841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573c307-d481-4842-83b9-e34927db0f6d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:04.301842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5782b72-10a6-4658-a9b1-c4aca38581bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:04.302411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9410a-53f9-489d-9d0a-613bd6990971 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:04.303015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9410a-53f9-489d-9d0a-613bd6990971 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:04.303464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9410a-53f9-489d-9d0a-613bd6990971 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:04.303754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9410a-53f9-489d-9d0a-613bd6990971 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:04.304077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5782b72-10a6-4658-a9b1-c4aca38581bd service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:04.307962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-afc9410a-53f9-489d-9d0a-613bd6990971 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:04.318711 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3026/6032] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:49:04.340182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc9410a-53f9-489d-9d0a-613bd6990971 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:04.346005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc9410a-53f9-489d-9d0a-613bd6990971 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:04.352761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5782b72-10a6-4658-a9b1-c4aca38581bd service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:04.357716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d5782b72-10a6-4658-a9b1-c4aca38581bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:04.368834 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3007/6033] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:03 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:49:04.400630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5782b72-10a6-4658-a9b1-c4aca38581bd service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:04.404565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:04.415369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f908eee-d61a-4782-a291-afa8cf48ef01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:04.416930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f908eee-d61a-4782-a291-afa8cf48ef01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:04.417969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f908eee-d61a-4782-a291-afa8cf48ef01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:04.419523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f908eee-d61a-4782-a291-afa8cf48ef01 admin admin] PATH_INFO: `/v3/users/4d13d131b81b45108d20871315ca04ba` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:04.422572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f908eee-d61a-4782-a291-afa8cf48ef01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d13d131b81b45108d20871315ca04ba)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:04.427976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f908eee-d61a-4782-a291-afa8cf48ef01 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:04.718910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8f908eee-d61a-4782-a291-afa8cf48ef01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d13d131b81b45108d20871315ca04ba'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:04.725507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8f908eee-d61a-4782-a291-afa8cf48ef01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d13d131b81b45108d20871315ca04ba'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:04.749917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8f908eee-d61a-4782-a291-afa8cf48ef01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d13d131b81b45108d20871315ca04ba'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:04.780608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8f908eee-d61a-4782-a291-afa8cf48ef01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d13d131b81b45108d20871315ca04ba'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:04.781830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8f908eee-d61a-4782-a291-afa8cf48ef01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d13d131b81b45108d20871315ca04ba'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:04.904549 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3027/6034] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:49:04 2022] DELETE /identity/v3/users/4d13d131b81b45108d20871315ca04ba => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:05.140866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:05.178406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9410a-53f9-489d-9d0a-613bd6990971 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:05.188172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f908eee-d61a-4782-a291-afa8cf48ef01 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:05.188374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-afc9410a-53f9-489d-9d0a-613bd6990971 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:05.188518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8f908eee-d61a-4782-a291-afa8cf48ef01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:05.239882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9410a-53f9-489d-9d0a-613bd6990971 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:05.446310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f908eee-d61a-4782-a291-afa8cf48ef01 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:05.460690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c188858-02da-4b13-a647-cafc6b2f3104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:05.462980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c188858-02da-4b13-a647-cafc6b2f3104 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:05.464766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c188858-02da-4b13-a647-cafc6b2f3104 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:05.470824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c188858-02da-4b13-a647-cafc6b2f3104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:05.479731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4f024-06d6-4dfd-80a9-dea8f42531d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:05.481025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4f024-06d6-4dfd-80a9-dea8f42531d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:05.481486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4f024-06d6-4dfd-80a9-dea8f42531d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:05.481933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4f024-06d6-4dfd-80a9-dea8f42531d3 admin admin] PATH_INFO: `/v3/projects/f080de92dd9849d1914a85f0f28cc19a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:05.485559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4f024-06d6-4dfd-80a9-dea8f42531d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f080de92dd9849d1914a85f0f28cc19a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:05.495986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8c188858-02da-4b13-a647-cafc6b2f3104 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:05.500767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4f024-06d6-4dfd-80a9-dea8f42531d3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:05.539462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c188858-02da-4b13-a647-cafc6b2f3104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:05.540657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c188858-02da-4b13-a647-cafc6b2f3104 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:05.572147 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3028/6035] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:49:05.575548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c188858-02da-4b13-a647-cafc6b2f3104 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:05.578752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8c188858-02da-4b13-a647-cafc6b2f3104 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:05.639769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c188858-02da-4b13-a647-cafc6b2f3104 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:05.645533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0966e7-8764-4e80-8c69-ac4a38d47550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:05.646243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0966e7-8764-4e80-8c69-ac4a38d47550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:05.646501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0966e7-8764-4e80-8c69-ac4a38d47550 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:05.647205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0966e7-8764-4e80-8c69-ac4a38d47550 admin admin] PATH_INFO: `/v3/projects/4623cd7593c54d5eab10068b239cc599` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:05.648405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0966e7-8764-4e80-8c69-ac4a38d47550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4623cd7593c54d5eab10068b239cc599)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:05.650576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0966e7-8764-4e80-8c69-ac4a38d47550 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:05.760125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-11b4f024-06d6-4dfd-80a9-dea8f42531d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f080de92dd9849d1914a85f0f28cc19a', 'request_id': 'req-11b4f024-06d6-4dfd-80a9-dea8f42531d3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:05.951454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-11b4f024-06d6-4dfd-80a9-dea8f42531d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f080de92dd9849d1914a85f0f28cc19a', 'request_id': 'req-11b4f024-06d6-4dfd-80a9-dea8f42531d3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:05.966262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-11b4f024-06d6-4dfd-80a9-dea8f42531d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f080de92dd9849d1914a85f0f28cc19a', 'request_id': 'req-11b4f024-06d6-4dfd-80a9-dea8f42531d3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:05.967947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8e0966e7-8764-4e80-8c69-ac4a38d47550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4623cd7593c54d5eab10068b239cc599', 'request_id': 'req-8e0966e7-8764-4e80-8c69-ac4a38d47550'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:05.989809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8e0966e7-8764-4e80-8c69-ac4a38d47550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4623cd7593c54d5eab10068b239cc599', 'request_id': 'req-8e0966e7-8764-4e80-8c69-ac4a38d47550'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:06.014963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8e0966e7-8764-4e80-8c69-ac4a38d47550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4623cd7593c54d5eab10068b239cc599', 'request_id': 'req-8e0966e7-8764-4e80-8c69-ac4a38d47550'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:06.017804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-11b4f024-06d6-4dfd-80a9-dea8f42531d3 admin admin] The token cache is being invalidate because project f080de92dd9849d1914a85f0f28cc19a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:06.018779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-11b4f024-06d6-4dfd-80a9-dea8f42531d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:06.019492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:06.021216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-11b4f024-06d6-4dfd-80a9-dea8f42531d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:06.034607 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3008/6036] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:05 2022] DELETE /identity/v3/projects/f080de92dd9849d1914a85f0f28cc19a => generated 0 bytes in 857 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:06.036168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4f024-06d6-4dfd-80a9-dea8f42531d3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:06.050993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-11b4f024-06d6-4dfd-80a9-dea8f42531d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:06.215950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8e0966e7-8764-4e80-8c69-ac4a38d47550 admin admin] The token cache is being invalidate because project 4623cd7593c54d5eab10068b239cc599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:06.217195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8e0966e7-8764-4e80-8c69-ac4a38d47550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:06.225838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8e0966e7-8764-4e80-8c69-ac4a38d47550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:06.232399 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3029/6037] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:05 2022] DELETE /identity/v3/projects/4623cd7593c54d5eab10068b239cc599 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:06.232399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0966e7-8764-4e80-8c69-ac4a38d47550 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:06.239395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4f024-06d6-4dfd-80a9-dea8f42531d3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:06.247399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8e0966e7-8764-4e80-8c69-ac4a38d47550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:06.388969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0966e7-8764-4e80-8c69-ac4a38d47550 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:06.397973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4d17d-3f07-4ffb-9d9b-7fb1c613c904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:06.398682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4d17d-3f07-4ffb-9d9b-7fb1c613c904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:06.406755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4d17d-3f07-4ffb-9d9b-7fb1c613c904 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:06.406755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4d17d-3f07-4ffb-9d9b-7fb1c613c904 admin admin] PATH_INFO: `/v3/projects/e7fcbc56c3474bdcbe613fbe54f9c421` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:06.406903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa3da9-5ae2-44f5-80f9-9cea9e8dbd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:06.406903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa3da9-5ae2-44f5-80f9-9cea9e8dbd33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:06.407060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4d17d-3f07-4ffb-9d9b-7fb1c613c904 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7fcbc56c3474bdcbe613fbe54f9c421)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:06.407143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa3da9-5ae2-44f5-80f9-9cea9e8dbd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:06.407143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa3da9-5ae2-44f5-80f9-9cea9e8dbd33 admin admin] PATH_INFO: `/v3/users/c1892339633640df9ce6183f9efa7f78` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:06.408316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa3da9-5ae2-44f5-80f9-9cea9e8dbd33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1892339633640df9ce6183f9efa7f78)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:06.410384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa3da9-5ae2-44f5-80f9-9cea9e8dbd33 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:06.422564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4d17d-3f07-4ffb-9d9b-7fb1c613c904 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:06.809787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-84d4d17d-3f07-4ffb-9d9b-7fb1c613c904 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7fcbc56c3474bdcbe613fbe54f9c421', 'request_id': 'req-84d4d17d-3f07-4ffb-9d9b-7fb1c613c904'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:06.827271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6baa3da9-5ae2-44f5-80f9-9cea9e8dbd33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1892339633640df9ce6183f9efa7f78'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:06.830847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6baa3da9-5ae2-44f5-80f9-9cea9e8dbd33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1892339633640df9ce6183f9efa7f78'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:06.850731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6baa3da9-5ae2-44f5-80f9-9cea9e8dbd33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1892339633640df9ce6183f9efa7f78'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:06.865989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6baa3da9-5ae2-44f5-80f9-9cea9e8dbd33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1892339633640df9ce6183f9efa7f78'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:06.866820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6baa3da9-5ae2-44f5-80f9-9cea9e8dbd33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1892339633640df9ce6183f9efa7f78'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:06.931677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-84d4d17d-3f07-4ffb-9d9b-7fb1c613c904 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7fcbc56c3474bdcbe613fbe54f9c421', 'request_id': 'req-84d4d17d-3f07-4ffb-9d9b-7fb1c613c904'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:06.947648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-84d4d17d-3f07-4ffb-9d9b-7fb1c613c904 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7fcbc56c3474bdcbe613fbe54f9c421', 'request_id': 'req-84d4d17d-3f07-4ffb-9d9b-7fb1c613c904'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:06.965894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-84d4d17d-3f07-4ffb-9d9b-7fb1c613c904 admin admin] The token cache is being invalidate because project e7fcbc56c3474bdcbe613fbe54f9c421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:06.966275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-84d4d17d-3f07-4ffb-9d9b-7fb1c613c904 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:06.967100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-84d4d17d-3f07-4ffb-9d9b-7fb1c613c904 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:06.969088 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3009/6038] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:06 2022] DELETE /identity/v3/projects/e7fcbc56c3474bdcbe613fbe54f9c421 => generated 0 bytes in 934 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:06.969926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4d17d-3f07-4ffb-9d9b-7fb1c613c904 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:06.971362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-84d4d17d-3f07-4ffb-9d9b-7fb1c613c904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:07.125618 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3030/6039] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:49:06 2022] DELETE /identity/v3/users/c1892339633640df9ce6183f9efa7f78 => generated 0 bytes in 887 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:07.131888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d290b-85a3-47f8-8487-b8f3e4dacc41 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:07.132439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d290b-85a3-47f8-8487-b8f3e4dacc41 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:07.138183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d290b-85a3-47f8-8487-b8f3e4dacc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:07.172028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f80d290b-85a3-47f8-8487-b8f3e4dacc41 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:07.173651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f80d290b-85a3-47f8-8487-b8f3e4dacc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:07.179874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4d17d-3f07-4ffb-9d9b-7fb1c613c904 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:07.306981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed46620-53f4-45eb-81ce-1a94dca283d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:07.307756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed46620-53f4-45eb-81ce-1a94dca283d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:07.310183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed46620-53f4-45eb-81ce-1a94dca283d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:07.310749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed46620-53f4-45eb-81ce-1a94dca283d0 admin admin] PATH_INFO: `/v3/users/e7397bbf2f0f48aca03f8083465067e4` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:07.324869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed46620-53f4-45eb-81ce-1a94dca283d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7397bbf2f0f48aca03f8083465067e4)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:07.328350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed46620-53f4-45eb-81ce-1a94dca283d0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:07.335227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:07.352157 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3031/6040] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:07.355486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc50cb5-e94e-403e-9fc9-3abd73a69bbe None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:07.356415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc50cb5-e94e-403e-9fc9-3abd73a69bbe None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:07.356415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc50cb5-e94e-403e-9fc9-3abd73a69bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:07.407047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2dc50cb5-e94e-403e-9fc9-3abd73a69bbe None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:07.408341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2dc50cb5-e94e-403e-9fc9-3abd73a69bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:07.420938 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3032/6041] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:07.422067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc50cb5-e94e-403e-9fc9-3abd73a69bbe None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:07.434879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc50cb5-e94e-403e-9fc9-3abd73a69bbe None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:07.444816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183acc8-cc38-49cc-8fb5-685ee4b21160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:07.446134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183acc8-cc38-49cc-8fb5-685ee4b21160 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:07.447351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183acc8-cc38-49cc-8fb5-685ee4b21160 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:07.447789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183acc8-cc38-49cc-8fb5-685ee4b21160 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:07.449926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183acc8-cc38-49cc-8fb5-685ee4b21160 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:49:07.450108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183acc8-cc38-49cc-8fb5-685ee4b21160 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:07.452428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183acc8-cc38-49cc-8fb5-685ee4b21160 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:07.478843 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3033/6042] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:07.478843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183acc8-cc38-49cc-8fb5-685ee4b21160 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:07.488243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183acc8-cc38-49cc-8fb5-685ee4b21160 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:07.510899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e3d12-1efa-4787-99b1-3efc3af9a64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:07.511969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e3d12-1efa-4787-99b1-3efc3af9a64d admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:07.517795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e3d12-1efa-4787-99b1-3efc3af9a64d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:07.519089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e3d12-1efa-4787-99b1-3efc3af9a64d admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:07.519417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e3d12-1efa-4787-99b1-3efc3af9a64d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:07.521765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e3d12-1efa-4787-99b1-3efc3af9a64d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:07.675280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7ed46620-53f4-45eb-81ce-1a94dca283d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7397bbf2f0f48aca03f8083465067e4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:07.675280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7ed46620-53f4-45eb-81ce-1a94dca283d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7397bbf2f0f48aca03f8083465067e4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:07.677430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7ed46620-53f4-45eb-81ce-1a94dca283d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7397bbf2f0f48aca03f8083465067e4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:07.736887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7ed46620-53f4-45eb-81ce-1a94dca283d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7397bbf2f0f48aca03f8083465067e4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:07.824064 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3034/6043] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:49:07 2022] POST /identity/v3/projects => generated 387 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:07.828916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e3d12-1efa-4787-99b1-3efc3af9a64d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:07.841559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a68e3d12-1efa-4787-99b1-3efc3af9a64d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:07.888709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7ed46620-53f4-45eb-81ce-1a94dca283d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7397bbf2f0f48aca03f8083465067e4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:07.895560 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3010/6044] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:49:06 2022] DELETE /identity/v3/users/e7397bbf2f0f48aca03f8083465067e4 => generated 0 bytes in 926 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:07.900555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed46620-53f4-45eb-81ce-1a94dca283d0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:07.903511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7ed46620-53f4-45eb-81ce-1a94dca283d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:07.958261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e3d12-1efa-4787-99b1-3efc3af9a64d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:08.139692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed46620-53f4-45eb-81ce-1a94dca283d0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:08.155338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8560f-b6d5-477f-aa8f-4aa8ad7f60ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:08.156308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8560f-b6d5-477f-aa8f-4aa8ad7f60ab admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:08.156922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8560f-b6d5-477f-aa8f-4aa8ad7f60ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:08.157567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8560f-b6d5-477f-aa8f-4aa8ad7f60ab admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:08.158609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8560f-b6d5-477f-aa8f-4aa8ad7f60ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:08.162388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8560f-b6d5-477f-aa8f-4aa8ad7f60ab admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:08.236556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259107c-3fb2-4936-892e-558d014d4088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:08.236556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259107c-3fb2-4936-892e-558d014d4088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:08.236556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259107c-3fb2-4936-892e-558d014d4088 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:08.243799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259107c-3fb2-4936-892e-558d014d4088 admin admin] PATH_INFO: `/v3/projects/6190ce79a1174dee95baee5ca2f3eb6e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:08.243799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259107c-3fb2-4936-892e-558d014d4088 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6190ce79a1174dee95baee5ca2f3eb6e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:08.245749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259107c-3fb2-4936-892e-558d014d4088 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:08.362493 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3011/6045] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:49:07 2022] POST /identity/v3/users => generated 294 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:08.365660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8560f-b6d5-477f-aa8f-4aa8ad7f60ab admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:08.378759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6af8560f-b6d5-477f-aa8f-4aa8ad7f60ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:08.425820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8560f-b6d5-477f-aa8f-4aa8ad7f60ab admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:08.439555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd8f54-4595-4af5-aa4f-2c845599fe42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:08.440957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd8f54-4595-4af5-aa4f-2c845599fe42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:08.441363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd8f54-4595-4af5-aa4f-2c845599fe42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:08.441765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd8f54-4595-4af5-aa4f-2c845599fe42 admin admin] PATH_INFO: `/v3/users/4ee93fdea79840e59dab1a8305116e78` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:08.443331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd8f54-4595-4af5-aa4f-2c845599fe42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ee93fdea79840e59dab1a8305116e78)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:08.445671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd8f54-4595-4af5-aa4f-2c845599fe42 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:08.491240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5259107c-3fb2-4936-892e-558d014d4088 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6190ce79a1174dee95baee5ca2f3eb6e', 'request_id': 'req-5259107c-3fb2-4936-892e-558d014d4088'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:08.510680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5259107c-3fb2-4936-892e-558d014d4088 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6190ce79a1174dee95baee5ca2f3eb6e', 'request_id': 'req-5259107c-3fb2-4936-892e-558d014d4088'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:08.520737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5259107c-3fb2-4936-892e-558d014d4088 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6190ce79a1174dee95baee5ca2f3eb6e', 'request_id': 'req-5259107c-3fb2-4936-892e-558d014d4088'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:08.603619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5259107c-3fb2-4936-892e-558d014d4088 admin admin] The token cache is being invalidate because project 6190ce79a1174dee95baee5ca2f3eb6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:08.604162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5259107c-3fb2-4936-892e-558d014d4088 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:08.605945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5259107c-3fb2-4936-892e-558d014d4088 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:08.611864 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3035/6046] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:07 2022] DELETE /identity/v3/projects/6190ce79a1174dee95baee5ca2f3eb6e => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:08.611864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259107c-3fb2-4936-892e-558d014d4088 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:08.615390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5259107c-3fb2-4936-892e-558d014d4088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:08.758634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c7cd8f54-4595-4af5-aa4f-2c845599fe42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee93fdea79840e59dab1a8305116e78'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:08.759815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c7cd8f54-4595-4af5-aa4f-2c845599fe42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee93fdea79840e59dab1a8305116e78'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:08.763886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259107c-3fb2-4936-892e-558d014d4088 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:08.772101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c7cd8f54-4595-4af5-aa4f-2c845599fe42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee93fdea79840e59dab1a8305116e78'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:08.775167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200881f-aac0-4750-87e0-0be66456686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:08.775928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200881f-aac0-4750-87e0-0be66456686c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:08.776480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200881f-aac0-4750-87e0-0be66456686c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:08.777982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200881f-aac0-4750-87e0-0be66456686c admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:08.778750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200881f-aac0-4750-87e0-0be66456686c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:08.782556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200881f-aac0-4750-87e0-0be66456686c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:08.804702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c7cd8f54-4595-4af5-aa4f-2c845599fe42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee93fdea79840e59dab1a8305116e78'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:08.805309 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3036/6047] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:08.806958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200881f-aac0-4750-87e0-0be66456686c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:08.809168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3200881f-aac0-4750-87e0-0be66456686c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:08.833505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200881f-aac0-4750-87e0-0be66456686c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:08.847397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c74e0-f7a2-40ac-b6ff-969140bd5336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:08.848087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c74e0-f7a2-40ac-b6ff-969140bd5336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:08.858865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c74e0-f7a2-40ac-b6ff-969140bd5336 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:08.859769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c74e0-f7a2-40ac-b6ff-969140bd5336 admin admin] PATH_INFO: `/v3/projects/592d85f7445943a0ad087bdcbb3a36ce` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:08.866002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c74e0-f7a2-40ac-b6ff-969140bd5336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=592d85f7445943a0ad087bdcbb3a36ce)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:08.868247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c74e0-f7a2-40ac-b6ff-969140bd5336 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:08.917034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c7cd8f54-4595-4af5-aa4f-2c845599fe42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee93fdea79840e59dab1a8305116e78'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:08.934089 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3012/6048] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:49:08 2022] DELETE /identity/v3/users/4ee93fdea79840e59dab1a8305116e78 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:08.934089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17bc59-0954-4837-aae4-eb59ceed931d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:08.934089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17bc59-0954-4837-aae4-eb59ceed931d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:08.934089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17bc59-0954-4837-aae4-eb59ceed931d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:08.976188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-aa17bc59-0954-4837-aae4-eb59ceed931d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:08.980616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-aa17bc59-0954-4837-aae4-eb59ceed931d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:09.147941 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3013/6049] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:09.149255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17bc59-0954-4837-aae4-eb59ceed931d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:09.160345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-aa17bc59-0954-4837-aae4-eb59ceed931d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:09.180043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17bc59-0954-4837-aae4-eb59ceed931d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:09.205309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-677c74e0-f7a2-40ac-b6ff-969140bd5336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '592d85f7445943a0ad087bdcbb3a36ce', 'request_id': 'req-677c74e0-f7a2-40ac-b6ff-969140bd5336'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:09.237641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-677c74e0-f7a2-40ac-b6ff-969140bd5336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '592d85f7445943a0ad087bdcbb3a36ce', 'request_id': 'req-677c74e0-f7a2-40ac-b6ff-969140bd5336'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:09.255228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-677c74e0-f7a2-40ac-b6ff-969140bd5336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '592d85f7445943a0ad087bdcbb3a36ce', 'request_id': 'req-677c74e0-f7a2-40ac-b6ff-969140bd5336'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:09.362255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc58f0-a67c-4bcb-965b-f4cae71f6f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:09.363418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc58f0-a67c-4bcb-965b-f4cae71f6f45 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:09.364314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc58f0-a67c-4bcb-965b-f4cae71f6f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:09.364787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc58f0-a67c-4bcb-965b-f4cae71f6f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:09.368533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc58f0-a67c-4bcb-965b-f4cae71f6f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:09.368533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc58f0-a67c-4bcb-965b-f4cae71f6f45 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:09.398439 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3014/6050] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:09.398439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453123b8-2c64-443c-8c95-d1d14d244d5a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:09.398722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453123b8-2c64-443c-8c95-d1d14d244d5a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:09.400218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453123b8-2c64-443c-8c95-d1d14d244d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:09.429911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-453123b8-2c64-443c-8c95-d1d14d244d5a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:09.431268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-453123b8-2c64-443c-8c95-d1d14d244d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:09.442972 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3015/6051] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:09.442972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f92226-b060-4979-a1c8-e2737a1ba4f7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:09.442972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f92226-b060-4979-a1c8-e2737a1ba4f7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:09.442972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f92226-b060-4979-a1c8-e2737a1ba4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:09.478966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:INSERT=2,keystone:SELECT=87,keystone:DELETE=11 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:09.482510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-677c74e0-f7a2-40ac-b6ff-969140bd5336 admin admin] The token cache is being invalidate because project 592d85f7445943a0ad087bdcbb3a36ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:09.482997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-677c74e0-f7a2-40ac-b6ff-969140bd5336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:09.484716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-677c74e0-f7a2-40ac-b6ff-969140bd5336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:09.490284 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3037/6052] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:08 2022] DELETE /identity/v3/projects/592d85f7445943a0ad087bdcbb3a36ce => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:09.491152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c74e0-f7a2-40ac-b6ff-969140bd5336 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:09.493078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-78f92226-b060-4979-a1c8-e2737a1ba4f7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:09.494344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-78f92226-b060-4979-a1c8-e2737a1ba4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:09.497539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-677c74e0-f7a2-40ac-b6ff-969140bd5336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:09.533623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c74e0-f7a2-40ac-b6ff-969140bd5336 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:09.534311 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3016/6053] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:09.540416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f92226-b060-4979-a1c8-e2737a1ba4f7 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:09.546697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb3bc9-9ff1-4325-9f11-290c87d0b8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:09.548169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-78f92226-b060-4979-a1c8-e2737a1ba4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:09.550014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb3bc9-9ff1-4325-9f11-290c87d0b8c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:09.550624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb3bc9-9ff1-4325-9f11-290c87d0b8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:09.552254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb3bc9-9ff1-4325-9f11-290c87d0b8c6 admin admin] PATH_INFO: `/v3/projects/40878788563346598c4446245f05c6f4/users/47e94ac529fc4ddf9f2c48a109c399ef/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:09.597569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:09.603868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb3bc9-9ff1-4325-9f11-290c87d0b8c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40878788563346598c4446245f05c6f4, user_id=47e94ac529fc4ddf9f2c48a109c399ef, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:09.610234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb3bc9-9ff1-4325-9f11-290c87d0b8c6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:09.726614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f92226-b060-4979-a1c8-e2737a1ba4f7 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:09.734924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a9e7d-ac6e-4133-886f-4fafd7535dc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:09.735830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a9e7d-ac6e-4133-886f-4fafd7535dc7 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:09.736320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a9e7d-ac6e-4133-886f-4fafd7535dc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:09.736821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a9e7d-ac6e-4133-886f-4fafd7535dc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:09.738776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-946a9e7d-ac6e-4133-886f-4fafd7535dc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:09.763409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a9e7d-ac6e-4133-886f-4fafd7535dc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:09.765994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a9e7d-ac6e-4133-886f-4fafd7535dc7 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:09.790584 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3017/6054] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:49:09.792234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c1223-34d5-4309-b8b6-c926bb6bb083 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:09.798129 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3038/6055] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:49:09 2022] PUT /identity/v3/projects/40878788563346598c4446245f05c6f4/users/47e94ac529fc4ddf9f2c48a109c399ef/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:09.798308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c1223-34d5-4309-b8b6-c926bb6bb083 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:09.798392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb3bc9-9ff1-4325-9f11-290c87d0b8c6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:09.798466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c1223-34d5-4309-b8b6-c926bb6bb083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:09.854325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-aa1c1223-34d5-4309-b8b6-c926bb6bb083 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:09.856475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-aa1c1223-34d5-4309-b8b6-c926bb6bb083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:10.008087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb3bc9-9ff1-4325-9f11-290c87d0b8c6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:10.020221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15d2f0-b05f-4103-951b-9830aedfab0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:10.020221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15d2f0-b05f-4103-951b-9830aedfab0f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:10.020221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15d2f0-b05f-4103-951b-9830aedfab0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:10.020221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15d2f0-b05f-4103-951b-9830aedfab0f admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:10.025345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15d2f0-b05f-4103-951b-9830aedfab0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:49:10.025345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15d2f0-b05f-4103-951b-9830aedfab0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:10.025345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15d2f0-b05f-4103-951b-9830aedfab0f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:10.051900 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3039/6056] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:10.055014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c57316-003e-4c80-8069-5ccaf66244e1 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:10.055455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c57316-003e-4c80-8069-5ccaf66244e1 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:10.055808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c57316-003e-4c80-8069-5ccaf66244e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:10.113940 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3018/6057] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:10.126969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c1223-34d5-4309-b8b6-c926bb6bb083 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:10.143411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-98c57316-003e-4c80-8069-5ccaf66244e1 None None] MFA Rules not processed for user `47e94ac529fc4ddf9f2c48a109c399ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:10.154744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-98c57316-003e-4c80-8069-5ccaf66244e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:10.155023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c1223-34d5-4309-b8b6-c926bb6bb083 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:10.168278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79250d1-c37f-4ed8-a0ce-9a900858822c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:10.168947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79250d1-c37f-4ed8-a0ce-9a900858822c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:10.169261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79250d1-c37f-4ed8-a0ce-9a900858822c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:10.169541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79250d1-c37f-4ed8-a0ce-9a900858822c admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:10.180899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79250d1-c37f-4ed8-a0ce-9a900858822c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:10.184004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79250d1-c37f-4ed8-a0ce-9a900858822c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:10.322764 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3019/6058] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:49:10 2022] POST /identity/v3/projects => generated 411 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:10.326361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41732586-8f5f-4f91-b5c7-d9796b1638af None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:10.326657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41732586-8f5f-4f91-b5c7-d9796b1638af None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:10.326937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41732586-8f5f-4f91-b5c7-d9796b1638af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:10.379067 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3040/6059] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:10.384334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c57316-003e-4c80-8069-5ccaf66244e1 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:10.399366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-41732586-8f5f-4f91-b5c7-d9796b1638af None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:10.400641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-41732586-8f5f-4f91-b5c7-d9796b1638af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:10.449859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c57316-003e-4c80-8069-5ccaf66244e1 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:10.628197 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3020/6060] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:10.629730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41732586-8f5f-4f91-b5c7-d9796b1638af None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:10.632233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-41732586-8f5f-4f91-b5c7-d9796b1638af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:10.655380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18027bf8-4298-4b76-bc00-f5b29f1b256f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:10.656233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18027bf8-4298-4b76-bc00-f5b29f1b256f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:10.656525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18027bf8-4298-4b76-bc00-f5b29f1b256f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:10.656807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18027bf8-4298-4b76-bc00-f5b29f1b256f admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:10.657498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18027bf8-4298-4b76-bc00-f5b29f1b256f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:10.659511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18027bf8-4298-4b76-bc00-f5b29f1b256f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:10.770854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41732586-8f5f-4f91-b5c7-d9796b1638af None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:10.774545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa0619-6f64-4f3b-b82d-12ccc8fa2e41 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:10.775192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa0619-6f64-4f3b-b82d-12ccc8fa2e41 service glance] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:10.775477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa0619-6f64-4f3b-b82d-12ccc8fa2e41 service glance] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:10.775760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa0619-6f64-4f3b-b82d-12ccc8fa2e41 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:10.798461 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3041/6061] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:49:10 2022] POST /identity/v3/users => generated 306 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:10.802909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18027bf8-4298-4b76-bc00-f5b29f1b256f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:10.819605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18027bf8-4298-4b76-bc00-f5b29f1b256f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:10.827815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a5826-fcda-4487-8977-14147ccc832d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:10.831673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a5826-fcda-4487-8977-14147ccc832d admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:10.831673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a5826-fcda-4487-8977-14147ccc832d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:10.831673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a5826-fcda-4487-8977-14147ccc832d admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:10.831673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a5826-fcda-4487-8977-14147ccc832d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:49:10.831673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a5826-fcda-4487-8977-14147ccc832d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:10.831673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a5826-fcda-4487-8977-14147ccc832d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:10.854771 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3042/6062] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:10.855725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a5826-fcda-4487-8977-14147ccc832d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:10.873816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a5826-fcda-4487-8977-14147ccc832d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:10.884509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa0619-6f64-4f3b-b82d-12ccc8fa2e41 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:10.885859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa0619-6f64-4f3b-b82d-12ccc8fa2e41 service glance] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:10.908045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:10.909145 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3021/6063] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:10 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:49:10.919488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8658689-ee60-471b-a3f7-136daa75f3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:10.921438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8658689-ee60-471b-a3f7-136daa75f3dc admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:10.921902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8658689-ee60-471b-a3f7-136daa75f3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:10.922410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8658689-ee60-471b-a3f7-136daa75f3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:10.923264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8658689-ee60-471b-a3f7-136daa75f3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:10.925000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa0619-6f64-4f3b-b82d-12ccc8fa2e41 service glance] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:10.925713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8658689-ee60-471b-a3f7-136daa75f3dc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:10.942728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1cfa0619-6f64-4f3b-b82d-12ccc8fa2e41 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:10.945248 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3043/6064] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:10.947467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8658689-ee60-471b-a3f7-136daa75f3dc admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:10.976858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8658689-ee60-471b-a3f7-136daa75f3dc admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:10.977491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa0619-6f64-4f3b-b82d-12ccc8fa2e41 service glance] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:10.985444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558828c-8a28-47b8-aa0c-57df6a5dd15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:10.986193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558828c-8a28-47b8-aa0c-57df6a5dd15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:10.986481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558828c-8a28-47b8-aa0c-57df6a5dd15a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:10.986761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558828c-8a28-47b8-aa0c-57df6a5dd15a admin admin] PATH_INFO: `/v3/projects/cc14a49f9b534978bf1ce77ce2e7bb59` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:10.991675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558828c-8a28-47b8-aa0c-57df6a5dd15a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc14a49f9b534978bf1ce77ce2e7bb59)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:10.994013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558828c-8a28-47b8-aa0c-57df6a5dd15a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:11.012370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eae4fe-e4d5-4b5e-bb37-1f43934121df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:11.013291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eae4fe-e4d5-4b5e-bb37-1f43934121df admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:11.013694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eae4fe-e4d5-4b5e-bb37-1f43934121df admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:11.014089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eae4fe-e4d5-4b5e-bb37-1f43934121df admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:11.015539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eae4fe-e4d5-4b5e-bb37-1f43934121df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:11.019591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eae4fe-e4d5-4b5e-bb37-1f43934121df admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:11.186982 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3044/6065] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:49:10 2022] POST /identity/v3/projects => generated 371 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:11.188175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eae4fe-e4d5-4b5e-bb37-1f43934121df admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:11.289653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c558828c-8a28-47b8-aa0c-57df6a5dd15a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc14a49f9b534978bf1ce77ce2e7bb59', 'request_id': 'req-c558828c-8a28-47b8-aa0c-57df6a5dd15a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:11.328752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:11.334332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eae4fe-e4d5-4b5e-bb37-1f43934121df admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:11.378665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c558828c-8a28-47b8-aa0c-57df6a5dd15a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc14a49f9b534978bf1ce77ce2e7bb59', 'request_id': 'req-c558828c-8a28-47b8-aa0c-57df6a5dd15a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:11.387301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c558828c-8a28-47b8-aa0c-57df6a5dd15a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc14a49f9b534978bf1ce77ce2e7bb59', 'request_id': 'req-c558828c-8a28-47b8-aa0c-57df6a5dd15a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:11.417396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c558828c-8a28-47b8-aa0c-57df6a5dd15a admin admin] The token cache is being invalidate because project cc14a49f9b534978bf1ce77ce2e7bb59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:11.418210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c558828c-8a28-47b8-aa0c-57df6a5dd15a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:11.418738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c558828c-8a28-47b8-aa0c-57df6a5dd15a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:11.425311 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3022/6066] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:10 2022] DELETE /identity/v3/projects/cc14a49f9b534978bf1ce77ce2e7bb59 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:11.426059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558828c-8a28-47b8-aa0c-57df6a5dd15a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:11.428909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c558828c-8a28-47b8-aa0c-57df6a5dd15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:11.480820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7434a-f4b5-47ac-9994-4794c5cc329f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:11.481552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7434a-f4b5-47ac-9994-4794c5cc329f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:11.482234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7434a-f4b5-47ac-9994-4794c5cc329f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:11.482721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7434a-f4b5-47ac-9994-4794c5cc329f admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:11.484829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7434a-f4b5-47ac-9994-4794c5cc329f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:11.488380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7434a-f4b5-47ac-9994-4794c5cc329f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:11.514833 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3045/6067] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:11.516848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a557bae-c091-4b2d-a6b9-73e0f4d135e6 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:11.517800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a557bae-c091-4b2d-a6b9-73e0f4d135e6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:11.518460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a557bae-c091-4b2d-a6b9-73e0f4d135e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:11.547776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558828c-8a28-47b8-aa0c-57df6a5dd15a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:11.551073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6a557bae-c091-4b2d-a6b9-73e0f4d135e6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:11.552698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6a557bae-c091-4b2d-a6b9-73e0f4d135e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:11.556262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33fee5-24fe-4711-b7af-d827a6ba4a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:11.556262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33fee5-24fe-4711-b7af-d827a6ba4a1c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:11.556262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33fee5-24fe-4711-b7af-d827a6ba4a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:11.556262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33fee5-24fe-4711-b7af-d827a6ba4a1c admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:11.556692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33fee5-24fe-4711-b7af-d827a6ba4a1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:11.559518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33fee5-24fe-4711-b7af-d827a6ba4a1c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:11.566351 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3046/6068] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:11.567507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a557bae-c091-4b2d-a6b9-73e0f4d135e6 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:11.569050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6a557bae-c091-4b2d-a6b9-73e0f4d135e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:11.587057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a557bae-c091-4b2d-a6b9-73e0f4d135e6 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:11.587730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae74da-6729-4856-8d25-16a8276a2df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:11.588407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae74da-6729-4856-8d25-16a8276a2df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:11.588693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae74da-6729-4856-8d25-16a8276a2df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:11.589067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae74da-6729-4856-8d25-16a8276a2df8 admin admin] PATH_INFO: `/v3/projects/21dd86f6b09a4e71afc84bb5bd0f24d6/users/2c1af19f57ef4ba797afc690a0acacfc/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:11.619010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae74da-6729-4856-8d25-16a8276a2df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21dd86f6b09a4e71afc84bb5bd0f24d6, user_id=2c1af19f57ef4ba797afc690a0acacfc, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:11.622454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae74da-6729-4856-8d25-16a8276a2df8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:11.684544 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3023/6069] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:49:11 2022] POST /identity/v3/users => generated 286 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:11.685786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afaf57-40df-4919-988a-46044627b65a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:11.686291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afaf57-40df-4919-988a-46044627b65a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:11.686601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afaf57-40df-4919-988a-46044627b65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:11.720093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f7afaf57-40df-4919-988a-46044627b65a None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:11.720093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f7afaf57-40df-4919-988a-46044627b65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:11.832897 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3024/6070] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:49:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:11.834928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d825d-1e69-435f-b86d-825300404310 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:11.835249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d825d-1e69-435f-b86d-825300404310 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:11.835584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d825d-1e69-435f-b86d-825300404310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:11.868913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ea0d825d-1e69-435f-b86d-825300404310 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:11.874124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ea0d825d-1e69-435f-b86d-825300404310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:11.895396 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3047/6071] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:49:11 2022] PUT /identity/v3/projects/21dd86f6b09a4e71afc84bb5bd0f24d6/users/2c1af19f57ef4ba797afc690a0acacfc/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:11.897930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae74da-6729-4856-8d25-16a8276a2df8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:12.051236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:12.056650 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3025/6072] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:12.057609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d825d-1e69-435f-b86d-825300404310 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:12.059013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ea0d825d-1e69-435f-b86d-825300404310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:12.112805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae74da-6729-4856-8d25-16a8276a2df8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:12.121512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09728832-b98e-40d1-9edc-7b2248b508be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:12.124784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09728832-b98e-40d1-9edc-7b2248b508be admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:12.125166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09728832-b98e-40d1-9edc-7b2248b508be admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:12.125520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09728832-b98e-40d1-9edc-7b2248b508be admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:12.126318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09728832-b98e-40d1-9edc-7b2248b508be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:12.135265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09728832-b98e-40d1-9edc-7b2248b508be admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:12.186120 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3048/6073] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:12.191716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b5c2e-b918-4196-b0e9-86a315ef1067 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:12.191716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b5c2e-b918-4196-b0e9-86a315ef1067 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:12.191990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b5c2e-b918-4196-b0e9-86a315ef1067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:12.200775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d825d-1e69-435f-b86d-825300404310 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:12.214729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04186c-0704-4664-9963-6469822f1b74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:12.214729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04186c-0704-4664-9963-6469822f1b74 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:12.214729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04186c-0704-4664-9963-6469822f1b74 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:12.215346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04186c-0704-4664-9963-6469822f1b74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:12.254269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4b5b5c2e-b918-4196-b0e9-86a315ef1067 None None] MFA Rules not processed for user `2c1af19f57ef4ba797afc690a0acacfc`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:12.256015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4b5b5c2e-b918-4196-b0e9-86a315ef1067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:12.400827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04186c-0704-4664-9963-6469822f1b74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:12.406225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04186c-0704-4664-9963-6469822f1b74 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:12.442148 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3026/6074] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:49:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:49:12.444048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04186c-0704-4664-9963-6469822f1b74 service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:12.458807 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3049/6075] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:12 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:12.462360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b5c2e-b918-4196-b0e9-86a315ef1067 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:12.475438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04186c-0704-4664-9963-6469822f1b74 service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:12.491991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b5c2e-b918-4196-b0e9-86a315ef1067 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:12.494125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed31ea-3968-42c3-a541-e41069cb762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:12.494764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed31ea-3968-42c3-a541-e41069cb762e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:12.495063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed31ea-3968-42c3-a541-e41069cb762e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:12.495911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed31ea-3968-42c3-a541-e41069cb762e admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:12.496907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed31ea-3968-42c3-a541-e41069cb762e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:49:12.497204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed31ea-3968-42c3-a541-e41069cb762e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:12.498933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed31ea-3968-42c3-a541-e41069cb762e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:12.521860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae125e-ead0-4415-950b-d1af4be6c7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:12.526091 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3027/6076] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:12.526284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae125e-ead0-4415-950b-d1af4be6c7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:12.526369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed31ea-3968-42c3-a541-e41069cb762e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:12.526460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae125e-ead0-4415-950b-d1af4be6c7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:12.526460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae125e-ead0-4415-950b-d1af4be6c7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:12.528295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae125e-ead0-4415-950b-d1af4be6c7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:12.535421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae125e-ead0-4415-950b-d1af4be6c7c9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:12.544967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed31ea-3968-42c3-a541-e41069cb762e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:12.566555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d85f6-014f-4703-a984-52bde00b4eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:12.567314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d85f6-014f-4703-a984-52bde00b4eed admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:12.567887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d85f6-014f-4703-a984-52bde00b4eed admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:12.568172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d85f6-014f-4703-a984-52bde00b4eed admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:12.569792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d85f6-014f-4703-a984-52bde00b4eed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:12.570299 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3050/6077] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:12.570809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d85f6-014f-4703-a984-52bde00b4eed admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:12.571671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae125e-ead0-4415-950b-d1af4be6c7c9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:12.585205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae125e-ead0-4415-950b-d1af4be6c7c9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:12.593997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887b96d-1e88-4867-bdb2-0aa19bbf2ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:12.594930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887b96d-1e88-4867-bdb2-0aa19bbf2ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:12.596064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887b96d-1e88-4867-bdb2-0aa19bbf2ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:12.596566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887b96d-1e88-4867-bdb2-0aa19bbf2ed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:12.597402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887b96d-1e88-4867-bdb2-0aa19bbf2ed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:12.616051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887b96d-1e88-4867-bdb2-0aa19bbf2ed7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:12.638898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:12.727587 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3051/6078] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:49:12 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:12.728703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887b96d-1e88-4867-bdb2-0aa19bbf2ed7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:12.786337 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3028/6079] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:49:12 2022] POST /identity/v3/projects => generated 409 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:12.791713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d85f6-014f-4703-a984-52bde00b4eed admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:12.850207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887b96d-1e88-4867-bdb2-0aa19bbf2ed7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:12.896156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d85f6-014f-4703-a984-52bde00b4eed admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:12.898134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:12.905079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b8c9a-f3d4-4aab-adc3-98f5c0477f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:12.905711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b8c9a-f3d4-4aab-adc3-98f5c0477f62 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:12.906182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b8c9a-f3d4-4aab-adc3-98f5c0477f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:12.906540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b8c9a-f3d4-4aab-adc3-98f5c0477f62 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:12.907182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b8c9a-f3d4-4aab-adc3-98f5c0477f62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:12.909363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b8c9a-f3d4-4aab-adc3-98f5c0477f62 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:12.940702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732d13e-8db4-474f-93a9-5218a911482b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:12.941359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732d13e-8db4-474f-93a9-5218a911482b admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:12.941651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732d13e-8db4-474f-93a9-5218a911482b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:12.941941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732d13e-8db4-474f-93a9-5218a911482b admin admin] PATH_INFO: `/v3/projects/83dd283857b445bf80d065afc1c8c7b4/users/b528053f80b247b8b917b970f9e950de/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:12.977989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732d13e-8db4-474f-93a9-5218a911482b admin admin] RBAC: Authorizing `identity:create_grant(project_id=83dd283857b445bf80d065afc1c8c7b4, user_id=b528053f80b247b8b917b970f9e950de, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:12.982605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732d13e-8db4-474f-93a9-5218a911482b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:13.060762 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3029/6080] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:49:12 2022] POST /identity/v3/users => generated 292 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:13.061911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b8c9a-f3d4-4aab-adc3-98f5c0477f62 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:13.106513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b8c9a-f3d4-4aab-adc3-98f5c0477f62 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:13.138502 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3052/6081] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:49:12 2022] PUT /identity/v3/projects/83dd283857b445bf80d065afc1c8c7b4/users/b528053f80b247b8b917b970f9e950de/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:13.139919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732d13e-8db4-474f-93a9-5218a911482b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:13.276377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732d13e-8db4-474f-93a9-5218a911482b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:13.289134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ef6ca-5f07-4047-bf72-5001fda59f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:13.293189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ef6ca-5f07-4047-bf72-5001fda59f99 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:13.294304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ef6ca-5f07-4047-bf72-5001fda59f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:13.294653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ef6ca-5f07-4047-bf72-5001fda59f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:13.296040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ef6ca-5f07-4047-bf72-5001fda59f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:13.303273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ef6ca-5f07-4047-bf72-5001fda59f99 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:13.303409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a87bd2-872d-4205-af2d-e4b56772bf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:13.303409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a87bd2-872d-4205-af2d-e4b56772bf66 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:13.303409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a87bd2-872d-4205-af2d-e4b56772bf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:13.303409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a87bd2-872d-4205-af2d-e4b56772bf66 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:13.303757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a87bd2-872d-4205-af2d-e4b56772bf66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:13.307609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a87bd2-872d-4205-af2d-e4b56772bf66 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:13.326020 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3053/6082] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:13.328687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ce015-329a-45cc-b940-183659881889 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:13.328979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ce015-329a-45cc-b940-183659881889 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:13.329253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ce015-329a-45cc-b940-183659881889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:13.388949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4d1ce015-329a-45cc-b940-183659881889 None None] MFA Rules not processed for user `b528053f80b247b8b917b970f9e950de`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:13.390199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4d1ce015-329a-45cc-b940-183659881889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:13.446480 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3030/6083] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:49:13 2022] POST /identity/v3/users => generated 311 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:13.448957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a87bd2-872d-4205-af2d-e4b56772bf66 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:13.463248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a87bd2-872d-4205-af2d-e4b56772bf66 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:13.469093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05a64c-2a57-48f7-a3d4-e0308e1242df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:13.470085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05a64c-2a57-48f7-a3d4-e0308e1242df admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:13.470377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05a64c-2a57-48f7-a3d4-e0308e1242df admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:13.470727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05a64c-2a57-48f7-a3d4-e0308e1242df admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:13.471547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05a64c-2a57-48f7-a3d4-e0308e1242df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:13.474938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05a64c-2a57-48f7-a3d4-e0308e1242df admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:13.499123 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3031/6084] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:13.500101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05a64c-2a57-48f7-a3d4-e0308e1242df admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:13.515366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05a64c-2a57-48f7-a3d4-e0308e1242df admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:13.529818 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3054/6085] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:13.529818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ce015-329a-45cc-b940-183659881889 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:13.536849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994f08e-dc80-4d23-b156-650c04fb0fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:13.536849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994f08e-dc80-4d23-b156-650c04fb0fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:13.536849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994f08e-dc80-4d23-b156-650c04fb0fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:13.536849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994f08e-dc80-4d23-b156-650c04fb0fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:13.537530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994f08e-dc80-4d23-b156-650c04fb0fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:13.537530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994f08e-dc80-4d23-b156-650c04fb0fc6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:13.541203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ce015-329a-45cc-b940-183659881889 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:13.564726 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3032/6086] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:13.564726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994f08e-dc80-4d23-b156-650c04fb0fc6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:13.566740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98588a7-f7f0-43c0-83dd-5234637c33aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:13.568209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98588a7-f7f0-43c0-83dd-5234637c33aa admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:13.568582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98588a7-f7f0-43c0-83dd-5234637c33aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:13.568960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98588a7-f7f0-43c0-83dd-5234637c33aa admin admin] PATH_INFO: `/v3/projects/117e018df9034874b552d08c7855bb9b/users/880b0b50fa3f4597afbd92d7d59e27ec/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:13.569053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0994f08e-dc80-4d23-b156-650c04fb0fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:13.612490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98588a7-f7f0-43c0-83dd-5234637c33aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=117e018df9034874b552d08c7855bb9b, user_id=880b0b50fa3f4597afbd92d7d59e27ec, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:13.616122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98588a7-f7f0-43c0-83dd-5234637c33aa admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:13.683395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994f08e-dc80-4d23-b156-650c04fb0fc6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:13.695761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c242244-089c-4342-a6aa-0037797cd673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:13.696412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c242244-089c-4342-a6aa-0037797cd673 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:13.696713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c242244-089c-4342-a6aa-0037797cd673 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:13.698086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c242244-089c-4342-a6aa-0037797cd673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:13.719511 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3055/6087] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:49:13 2022] PUT /identity/v3/projects/117e018df9034874b552d08c7855bb9b/users/880b0b50fa3f4597afbd92d7d59e27ec/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:13.728358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98588a7-f7f0-43c0-83dd-5234637c33aa admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:13.749411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c242244-089c-4342-a6aa-0037797cd673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:13.753267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c242244-089c-4342-a6aa-0037797cd673 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:13.782643 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3033/6088] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:49:13.784757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711768aa-ee4b-4c47-85d7-11b50fb095b1 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:13.785233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711768aa-ee4b-4c47-85d7-11b50fb095b1 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:13.785570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711768aa-ee4b-4c47-85d7-11b50fb095b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:13.893434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-711768aa-ee4b-4c47-85d7-11b50fb095b1 None None] MFA Rules not processed for user `880b0b50fa3f4597afbd92d7d59e27ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:13.893434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-711768aa-ee4b-4c47-85d7-11b50fb095b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:13.910653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98588a7-f7f0-43c0-83dd-5234637c33aa admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:13.924293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380d191-fbea-4090-9e7f-7b6b58355733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:13.924991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380d191-fbea-4090-9e7f-7b6b58355733 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:13.925270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380d191-fbea-4090-9e7f-7b6b58355733 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:13.925543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380d191-fbea-4090-9e7f-7b6b58355733 admin admin] PATH_INFO: `/v3/projects/b93be24b0106440ebaf21ae62e583ef2/users/7f215676af8a4f3986ddc62d1e66339b/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:13.962417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380d191-fbea-4090-9e7f-7b6b58355733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b93be24b0106440ebaf21ae62e583ef2, user_id=7f215676af8a4f3986ddc62d1e66339b, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:13.967229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380d191-fbea-4090-9e7f-7b6b58355733 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:14.018770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:14.035904 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3034/6089] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:14.037306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ebd5d-4385-4087-b47a-21068c4bd9b0 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:14.037705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ebd5d-4385-4087-b47a-21068c4bd9b0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:14.038185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ebd5d-4385-4087-b47a-21068c4bd9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:14.070587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-7c6ebd5d-4385-4087-b47a-21068c4bd9b0 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:14.075899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7c6ebd5d-4385-4087-b47a-21068c4bd9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:14.137939 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3056/6090] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:49:13 2022] PUT /identity/v3/projects/b93be24b0106440ebaf21ae62e583ef2/users/7f215676af8a4f3986ddc62d1e66339b/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:14.139455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380d191-fbea-4090-9e7f-7b6b58355733 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:14.265398 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3035/6091] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:49:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:14.266645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ebd5d-4385-4087-b47a-21068c4bd9b0 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:14.299667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380d191-fbea-4090-9e7f-7b6b58355733 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:14.305100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717303b8-d9d5-47b9-8215-818e649292a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:14.306449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717303b8-d9d5-47b9-8215-818e649292a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:14.306798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717303b8-d9d5-47b9-8215-818e649292a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:14.307141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717303b8-d9d5-47b9-8215-818e649292a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:14.307530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ebd5d-4385-4087-b47a-21068c4bd9b0 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:14.307999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717303b8-d9d5-47b9-8215-818e649292a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:14.314025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717303b8-d9d5-47b9-8215-818e649292a8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:14.341663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:14.350630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24189d-a996-4ad2-aa83-6b0833bd5cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:14.351513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24189d-a996-4ad2-aa83-6b0833bd5cfe admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:14.351982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24189d-a996-4ad2-aa83-6b0833bd5cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:14.352408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24189d-a996-4ad2-aa83-6b0833bd5cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:14.354503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24189d-a996-4ad2-aa83-6b0833bd5cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:14.361575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24189d-a996-4ad2-aa83-6b0833bd5cfe admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:14.389581 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3036/6092] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:14.392174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24189d-a996-4ad2-aa83-6b0833bd5cfe admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:14.455629 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3057/6093] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:49:14 2022] POST /identity/v3/projects => generated 383 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:14.456755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717303b8-d9d5-47b9-8215-818e649292a8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:14.660219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24189d-a996-4ad2-aa83-6b0833bd5cfe admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:14.738334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717303b8-d9d5-47b9-8215-818e649292a8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:14.770751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b2d0f-e583-4e14-99ce-8b7f7a6c9e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:14.771446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b2d0f-e583-4e14-99ce-8b7f7a6c9e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:14.771807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b2d0f-e583-4e14-99ce-8b7f7a6c9e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:14.776060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b2d0f-e583-4e14-99ce-8b7f7a6c9e24 admin admin] PATH_INFO: `/v3/projects/b93be24b0106440ebaf21ae62e583ef2/users/7f215676af8a4f3986ddc62d1e66339b/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:14.795974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b2d0f-e583-4e14-99ce-8b7f7a6c9e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b93be24b0106440ebaf21ae62e583ef2, user_id=7f215676af8a4f3986ddc62d1e66339b, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:14.807278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b2d0f-e583-4e14-99ce-8b7f7a6c9e24 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:14.844856 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3058/6094] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:49:14 2022] PUT /identity/v3/projects/b93be24b0106440ebaf21ae62e583ef2/users/7f215676af8a4f3986ddc62d1e66339b/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:14.844856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b2d0f-e583-4e14-99ce-8b7f7a6c9e24 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:14.872457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c1b1b-decd-4d57-b86b-8d444233641c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:14.874365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c1b1b-decd-4d57-b86b-8d444233641c service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:14.874765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c1b1b-decd-4d57-b86b-8d444233641c service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:14.878796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c1b1b-decd-4d57-b86b-8d444233641c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:15.042356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c1b1b-decd-4d57-b86b-8d444233641c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:15.045867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c1b1b-decd-4d57-b86b-8d444233641c service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:15.076791 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3037/6095] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:49:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:49:15.092037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b2d0f-e583-4e14-99ce-8b7f7a6c9e24 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:15.099498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2efb2-e3fe-4c9d-bb6c-1afd882d4b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:15.100347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2efb2-e3fe-4c9d-bb6c-1afd882d4b64 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:15.100802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2efb2-e3fe-4c9d-bb6c-1afd882d4b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:15.101230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2efb2-e3fe-4c9d-bb6c-1afd882d4b64 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:15.102183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2efb2-e3fe-4c9d-bb6c-1afd882d4b64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:15.106168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2efb2-e3fe-4c9d-bb6c-1afd882d4b64 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:15.114873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b788b-86e9-483a-a09a-e4a1209081d6 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:15.115167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b788b-86e9-483a-a09a-e4a1209081d6 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:15.115459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b788b-86e9-483a-a09a-e4a1209081d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:15.204149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:15.206020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e00b788b-86e9-483a-a09a-e4a1209081d6 None None] MFA Rules not processed for user `7f215676af8a4f3986ddc62d1e66339b`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:15.207306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e00b788b-86e9-483a-a09a-e4a1209081d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:15.265879 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3059/6096] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:49:14 2022] POST /identity/v3/users => generated 298 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:15.266346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2efb2-e3fe-4c9d-bb6c-1afd882d4b64 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:15.306003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2efb2-e3fe-4c9d-bb6c-1afd882d4b64 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:15.325883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64485dda-1aaf-498a-bc6c-982a990485d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:15.326656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64485dda-1aaf-498a-bc6c-982a990485d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:15.327015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64485dda-1aaf-498a-bc6c-982a990485d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:15.331653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64485dda-1aaf-498a-bc6c-982a990485d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:15.332681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64485dda-1aaf-498a-bc6c-982a990485d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:15.334585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64485dda-1aaf-498a-bc6c-982a990485d6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:15.375450 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3060/6097] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:15.386349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64485dda-1aaf-498a-bc6c-982a990485d6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:15.421623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64485dda-1aaf-498a-bc6c-982a990485d6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:15.423870 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3038/6098] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:15 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:15.447958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aa18b-5345-48cd-9ebf-24f3ab8c95eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:15.448695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aa18b-5345-48cd-9ebf-24f3ab8c95eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:15.448985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aa18b-5345-48cd-9ebf-24f3ab8c95eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:15.449264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aa18b-5345-48cd-9ebf-24f3ab8c95eb admin admin] PATH_INFO: `/v3/projects/ec070267dc98462c9793e692d075ffd4/users/257ea815e1f241e59455445dbb63f6e3/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:15.496078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81aa18b-5345-48cd-9ebf-24f3ab8c95eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec070267dc98462c9793e692d075ffd4, user_id=257ea815e1f241e59455445dbb63f6e3, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:15.509771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81aa18b-5345-48cd-9ebf-24f3ab8c95eb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:15.583298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b788b-86e9-483a-a09a-e4a1209081d6 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:15.585010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e00b788b-86e9-483a-a09a-e4a1209081d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:15.631666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:15.744347 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3061/6099] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:49:15 2022] PUT /identity/v3/projects/ec070267dc98462c9793e692d075ffd4/users/257ea815e1f241e59455445dbb63f6e3/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:15.749304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aa18b-5345-48cd-9ebf-24f3ab8c95eb admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:15.841104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b788b-86e9-483a-a09a-e4a1209081d6 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:16.038365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aa18b-5345-48cd-9ebf-24f3ab8c95eb admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:16.046556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79db2a-80bd-4fcb-8187-85c7b45e9286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:16.052348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79db2a-80bd-4fcb-8187-85c7b45e9286 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:16.052817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79db2a-80bd-4fcb-8187-85c7b45e9286 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:16.054328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79db2a-80bd-4fcb-8187-85c7b45e9286 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:16.055126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79db2a-80bd-4fcb-8187-85c7b45e9286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:16.061760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79db2a-80bd-4fcb-8187-85c7b45e9286 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:16.085418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a38f08-3687-49e8-89ba-668ec2ab61e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:16.085418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a38f08-3687-49e8-89ba-668ec2ab61e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:16.085418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a38f08-3687-49e8-89ba-668ec2ab61e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:16.085418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a38f08-3687-49e8-89ba-668ec2ab61e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:16.085806 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3062/6100] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:49:16.100466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79db2a-80bd-4fcb-8187-85c7b45e9286 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:16.165976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79db2a-80bd-4fcb-8187-85c7b45e9286 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:16.212066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ac11a-92d2-4f14-bdef-8d47f3ae31ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:16.212771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ac11a-92d2-4f14-bdef-8d47f3ae31ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:16.213062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ac11a-92d2-4f14-bdef-8d47f3ae31ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:16.213346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ac11a-92d2-4f14-bdef-8d47f3ae31ca admin admin] PATH_INFO: `/v3/projects/ec070267dc98462c9793e692d075ffd4/users/257ea815e1f241e59455445dbb63f6e3/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:16.223859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ac11a-92d2-4f14-bdef-8d47f3ae31ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec070267dc98462c9793e692d075ffd4, user_id=257ea815e1f241e59455445dbb63f6e3, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:16.245045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ac11a-92d2-4f14-bdef-8d47f3ae31ca admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:16.295562 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3063/6101] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:49:16 2022] PUT /identity/v3/projects/ec070267dc98462c9793e692d075ffd4/users/257ea815e1f241e59455445dbb63f6e3/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:16.297190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd8b02-f84d-4ab7-9280-eff18deabe8e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:16.297485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd8b02-f84d-4ab7-9280-eff18deabe8e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:16.297753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd8b02-f84d-4ab7-9280-eff18deabe8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:16.301452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a38f08-3687-49e8-89ba-668ec2ab61e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:16.304286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a38f08-3687-49e8-89ba-668ec2ab61e2 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:16.350148 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3039/6102] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:15 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 767 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:49:16.375980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-13cd8b02-f84d-4ab7-9280-eff18deabe8e None None] MFA Rules not processed for user `257ea815e1f241e59455445dbb63f6e3`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:16.377563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-13cd8b02-f84d-4ab7-9280-eff18deabe8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:16.626853 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3064/6103] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:16.632348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a38f08-3687-49e8-89ba-668ec2ab61e2 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:16.806834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a38f08-3687-49e8-89ba-668ec2ab61e2 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:16.818757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651bc8e-e9a8-42dd-be1c-88ddf081b02b tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257ea815e1f241e59455445dbb63f6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec070267dc98462c9793e692d075ffd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:16.819859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651bc8e-e9a8-42dd-be1c-88ddf081b02b tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:16.821257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651bc8e-e9a8-42dd-be1c-88ddf081b02b tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:16.821257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651bc8e-e9a8-42dd-be1c-88ddf081b02b tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:16.822350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651bc8e-e9a8-42dd-be1c-88ddf081b02b tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:16.826001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651bc8e-e9a8-42dd-be1c-88ddf081b02b tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:16.831942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be428c1d-3bd9-4f0c-8ecd-9d1cb0d32ade None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:16.832442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be428c1d-3bd9-4f0c-8ecd-9d1cb0d32ade None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:16.832998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be428c1d-3bd9-4f0c-8ecd-9d1cb0d32ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:16.871779 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-2651bc8e-e9a8-42dd-be1c-88ddf081b02b tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invalid input for field 'name': '' is too short Oct 27 03:49:16.871779 n-d-862769-1 devstack@keystone.service[82179]: Failed validating 'minLength' in schema['properties']['name']: Oct 27 03:49:16.871779 n-d-862769-1 devstack@keystone.service[82179]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 27 03:49:16.871779 n-d-862769-1 devstack@keystone.service[82179]: On instance['name']: Oct 27 03:49:16.871779 n-d-862769-1 devstack@keystone.service[82179]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 27 03:49:16.871779 n-d-862769-1 devstack@keystone.service[82179]: Failed validating 'minLength' in schema['properties']['name']: Oct 27 03:49:16.871779 n-d-862769-1 devstack@keystone.service[82179]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 27 03:49:16.871779 n-d-862769-1 devstack@keystone.service[82179]: On instance['name']: Oct 27 03:49:16.871779 n-d-862769-1 devstack@keystone.service[82179]: '' Oct 27 03:49:16.871779 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:49:16.871779 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 27 03:49:16.871779 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 27 03:49:16.871779 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:49:16.871779 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise error Oct 27 03:49:16.871779 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 27 03:49:16.871779 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:16.871779 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 27 03:49:16.871779 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 27 03:49:16.871779 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:16.871779 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application On instance['name']: Oct 27 03:49:16.871779 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application '' Oct 27 03:49:16.871779 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:16.871779 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:49:16.873702 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:16.873702 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:49:16.873702 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:49:16.873702 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:49:16.873702 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:49:16.873702 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:49:16.873702 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:49:16.873702 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:49:16.873702 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:49:16.873702 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:49:16.873702 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:49:16.873702 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:49:16.873702 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 27 03:49:16.873702 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 27 03:49:16.873702 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 27 03:49:16.873702 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 27 03:49:16.873702 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 27 03:49:16.874923 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 27 03:49:16.874923 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 27 03:49:16.874923 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:16.874923 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 27 03:49:16.874923 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 27 03:49:16.874923 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:16.874923 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application On instance['name']: Oct 27 03:49:16.874923 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application '' Oct 27 03:49:16.874923 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:16.897957 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3040/6104] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:49:16 2022] POST /identity/v3/domains => generated 283 bytes in 266 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 27 03:49:16.899874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651bc8e-e9a8-42dd-be1c-88ddf081b02b tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:16.944631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-be428c1d-3bd9-4f0c-8ecd-9d1cb0d32ade None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:16.949569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-be428c1d-3bd9-4f0c-8ecd-9d1cb0d32ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:16.952974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651bc8e-e9a8-42dd-be1c-88ddf081b02b tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:16.982601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:16.983510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92200866-b708-4a8d-8208-88e8f1d78226 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257ea815e1f241e59455445dbb63f6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec070267dc98462c9793e692d075ffd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:16.984294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92200866-b708-4a8d-8208-88e8f1d78226 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:16.985410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92200866-b708-4a8d-8208-88e8f1d78226 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:16.985803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92200866-b708-4a8d-8208-88e8f1d78226 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:16.988481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92200866-b708-4a8d-8208-88e8f1d78226 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:16.991737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92200866-b708-4a8d-8208-88e8f1d78226 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:17.028844 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-92200866-b708-4a8d-8208-88e8f1d78226 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 03:49:17.028844 n-d-862769-1 devstack@keystone.service[82179]: Failed validating 'maxLength' in schema['properties']['name']: Oct 27 03:49:17.028844 n-d-862769-1 devstack@keystone.service[82179]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 27 03:49:17.028844 n-d-862769-1 devstack@keystone.service[82179]: On instance['name']: Oct 27 03:49:17.028844 n-d-862769-1 devstack@keystone.service[82179]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 03:49:17.028844 n-d-862769-1 devstack@keystone.service[82179]: Failed validating 'maxLength' in schema['properties']['name']: Oct 27 03:49:17.028844 n-d-862769-1 devstack@keystone.service[82179]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 27 03:49:17.028844 n-d-862769-1 devstack@keystone.service[82179]: On instance['name']: Oct 27 03:49:17.028844 n-d-862769-1 devstack@keystone.service[82179]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 27 03:49:17.028844 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:49:17.028844 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 27 03:49:17.028844 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 27 03:49:17.028844 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:49:17.028844 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise error Oct 27 03:49:17.028844 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 03:49:17.028844 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:17.028844 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 27 03:49:17.028844 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 27 03:49:17.028844 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:17.030217 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application On instance['name']: Oct 27 03:49:17.030217 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 27 03:49:17.030217 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:17.030217 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:49:17.030217 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:17.030217 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:49:17.030217 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:49:17.030217 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:49:17.030217 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:49:17.030217 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:49:17.030217 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:49:17.030217 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:49:17.030217 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:49:17.030217 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:49:17.030217 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:49:17.030217 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:49:17.030217 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 27 03:49:17.030217 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 27 03:49:17.031333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 27 03:49:17.031333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 27 03:49:17.031333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 27 03:49:17.031333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 27 03:49:17.031333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 03:49:17.031333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:17.031333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 27 03:49:17.031333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 27 03:49:17.031333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:17.031333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application On instance['name']: Oct 27 03:49:17.031333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 27 03:49:17.031333 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:17.043342 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3041/6105] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:49:16 2022] POST /identity/v3/domains => generated 412 bytes in 144 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 27 03:49:17.053594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:17.056115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92200866-b708-4a8d-8208-88e8f1d78226 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:17.085516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92200866-b708-4a8d-8208-88e8f1d78226 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:17.105160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68268c-9328-4848-8ca6-558c4991ab5f tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257ea815e1f241e59455445dbb63f6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec070267dc98462c9793e692d075ffd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:17.105160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68268c-9328-4848-8ca6-558c4991ab5f tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:17.105160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68268c-9328-4848-8ca6-558c4991ab5f tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:17.105537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68268c-9328-4848-8ca6-558c4991ab5f tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:17.109989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68268c-9328-4848-8ca6-558c4991ab5f tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:17.112818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68268c-9328-4848-8ca6-558c4991ab5f tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:17.123314 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3065/6106] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:49:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:17.142852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be428c1d-3bd9-4f0c-8ecd-9d1cb0d32ade None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:17.240848 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3042/6107] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:49:17 2022] POST /identity/v3/domains => generated 275 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:17.243646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68268c-9328-4848-8ca6-558c4991ab5f tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:17.343021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be428c1d-3bd9-4f0c-8ecd-9d1cb0d32ade None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:17.456339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68268c-9328-4848-8ca6-558c4991ab5f tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:17.473519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091d017-4715-414f-ad9f-0df49fb6cd20 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257ea815e1f241e59455445dbb63f6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec070267dc98462c9793e692d075ffd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:17.475169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091d017-4715-414f-ad9f-0df49fb6cd20 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:17.475561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091d017-4715-414f-ad9f-0df49fb6cd20 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:17.475903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091d017-4715-414f-ad9f-0df49fb6cd20 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] PATH_INFO: `/v3/domains/24bd7cd6619b49679810c5a1e33ee4ef` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:17.500154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091d017-4715-414f-ad9f-0df49fb6cd20 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=24bd7cd6619b49679810c5a1e33ee4ef)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:17.502946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091d017-4715-414f-ad9f-0df49fb6cd20 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:17.518174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1146a44-c64d-45b2-94f4-07cc4f83581a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:17.519494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1146a44-c64d-45b2-94f4-07cc4f83581a service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:17.519794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1146a44-c64d-45b2-94f4-07cc4f83581a service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:17.521699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1146a44-c64d-45b2-94f4-07cc4f83581a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:17.584802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-1091d017-4715-414f-ad9f-0df49fb6cd20 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 27 03:49:17.584802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:49:17.584802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:49:17.584802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:49:17.584802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:49:17.584802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:49:17.584802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:49:17.584802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:49:17.584802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:49:17.584802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:49:17.584802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:49:17.584802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:49:17.584802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Oct 27 03:49:17.584802 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Oct 27 03:49:17.585868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:49:17.585868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:49:17.585868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Oct 27 03:49:17.585868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Oct 27 03:49:17.585868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Oct 27 03:49:17.585868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 27 03:49:17.585868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 27 03:49:17.585868 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:17.586445 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3043/6108] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:49:17 2022] DELETE /identity/v3/domains/24bd7cd6619b49679810c5a1e33ee4ef => generated 120 bytes in 343 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:49:17.590989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091d017-4715-414f-ad9f-0df49fb6cd20 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:17.610150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091d017-4715-414f-ad9f-0df49fb6cd20 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:17.622911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ca717-e3f5-4b7a-ac1e-c4e770d9b85b tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257ea815e1f241e59455445dbb63f6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec070267dc98462c9793e692d075ffd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:17.623625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ca717-e3f5-4b7a-ac1e-c4e770d9b85b tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:17.623943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ca717-e3f5-4b7a-ac1e-c4e770d9b85b tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:17.624236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ca717-e3f5-4b7a-ac1e-c4e770d9b85b tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] PATH_INFO: `/v3/domains/24bd7cd6619b49679810c5a1e33ee4ef` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:17.628258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ca717-e3f5-4b7a-ac1e-c4e770d9b85b tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=24bd7cd6619b49679810c5a1e33ee4ef)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:17.631662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ca717-e3f5-4b7a-ac1e-c4e770d9b85b tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:17.647846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1146a44-c64d-45b2-94f4-07cc4f83581a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:17.649890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1146a44-c64d-45b2-94f4-07cc4f83581a service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:17.674194 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3066/6109] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:49:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:49:17.685802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-149ca717-e3f5-4b7a-ac1e-c4e770d9b85b tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '24bd7cd6619b49679810c5a1e33ee4ef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:17.688996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-149ca717-e3f5-4b7a-ac1e-c4e770d9b85b tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '24bd7cd6619b49679810c5a1e33ee4ef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:17.808403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-149ca717-e3f5-4b7a-ac1e-c4e770d9b85b tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '24bd7cd6619b49679810c5a1e33ee4ef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:17.809572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-149ca717-e3f5-4b7a-ac1e-c4e770d9b85b tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '24bd7cd6619b49679810c5a1e33ee4ef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:17.812554 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3044/6110] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:49:17 2022] PATCH /identity/v3/domains/24bd7cd6619b49679810c5a1e33ee4ef => generated 276 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:49:17.822775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1146a44-c64d-45b2-94f4-07cc4f83581a service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:17.873632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1146a44-c64d-45b2-94f4-07cc4f83581a service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:17.888255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:18.010002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48508d30-aea4-4d04-8257-ff8813b6a60a tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257ea815e1f241e59455445dbb63f6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec070267dc98462c9793e692d075ffd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:18.011816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48508d30-aea4-4d04-8257-ff8813b6a60a tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:18.012524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48508d30-aea4-4d04-8257-ff8813b6a60a tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:18.012995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48508d30-aea4-4d04-8257-ff8813b6a60a tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] PATH_INFO: `/v3/domains/24bd7cd6619b49679810c5a1e33ee4ef` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:18.039636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48508d30-aea4-4d04-8257-ff8813b6a60a tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=24bd7cd6619b49679810c5a1e33ee4ef)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:18.047919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48508d30-aea4-4d04-8257-ff8813b6a60a tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:18.106843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-48508d30-aea4-4d04-8257-ff8813b6a60a tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '24bd7cd6619b49679810c5a1e33ee4ef'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:18.130063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-48508d30-aea4-4d04-8257-ff8813b6a60a tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '24bd7cd6619b49679810c5a1e33ee4ef'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:18.191221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:18.272931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-48508d30-aea4-4d04-8257-ff8813b6a60a tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24bd7cd6619b49679810c5a1e33ee4ef', 'request_id': 'req-48508d30-aea4-4d04-8257-ff8813b6a60a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:18.285289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-48508d30-aea4-4d04-8257-ff8813b6a60a tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24bd7cd6619b49679810c5a1e33ee4ef', 'request_id': 'req-48508d30-aea4-4d04-8257-ff8813b6a60a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:18.293393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-48508d30-aea4-4d04-8257-ff8813b6a60a tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24bd7cd6619b49679810c5a1e33ee4ef', 'request_id': 'req-48508d30-aea4-4d04-8257-ff8813b6a60a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:18.328236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:18.364203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-48508d30-aea4-4d04-8257-ff8813b6a60a tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] The token cache is being invalidate because project 24bd7cd6619b49679810c5a1e33ee4ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:18.365089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-48508d30-aea4-4d04-8257-ff8813b6a60a tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:18.368534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-48508d30-aea4-4d04-8257-ff8813b6a60a tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:18.394434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-48508d30-aea4-4d04-8257-ff8813b6a60a tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '24bd7cd6619b49679810c5a1e33ee4ef', 'request_id': 'req-48508d30-aea4-4d04-8257-ff8813b6a60a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:18.397766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-48508d30-aea4-4d04-8257-ff8813b6a60a tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '24bd7cd6619b49679810c5a1e33ee4ef', 'request_id': 'req-48508d30-aea4-4d04-8257-ff8813b6a60a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:18.399813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-48508d30-aea4-4d04-8257-ff8813b6a60a tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '24bd7cd6619b49679810c5a1e33ee4ef', 'request_id': 'req-48508d30-aea4-4d04-8257-ff8813b6a60a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:18.426090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ca717-e3f5-4b7a-ac1e-c4e770d9b85b tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:18.431307 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3067/6111] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:49:17 2022] DELETE /identity/v3/domains/24bd7cd6619b49679810c5a1e33ee4ef => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:49:18.431421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-149ca717-e3f5-4b7a-ac1e-c4e770d9b85b tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:18.466533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ca717-e3f5-4b7a-ac1e-c4e770d9b85b tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:18.518823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7736f2-cbf8-48df-8cf5-6abbd34b5b7b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:18.519411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7736f2-cbf8-48df-8cf5-6abbd34b5b7b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:18.523093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7736f2-cbf8-48df-8cf5-6abbd34b5b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:18.569885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7f7736f2-cbf8-48df-8cf5-6abbd34b5b7b None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:18.574661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7f7736f2-cbf8-48df-8cf5-6abbd34b5b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:18.611973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f1b18-0f17-46db-a0e8-f2ea4ceb8365 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257ea815e1f241e59455445dbb63f6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec070267dc98462c9793e692d075ffd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:18.612939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f1b18-0f17-46db-a0e8-f2ea4ceb8365 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:18.613538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f1b18-0f17-46db-a0e8-f2ea4ceb8365 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:18.615527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f1b18-0f17-46db-a0e8-f2ea4ceb8365 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] PATH_INFO: `/v3/domains/5170ac275da64c8b83ada4f53e427709` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:18.625787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f1b18-0f17-46db-a0e8-f2ea4ceb8365 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:49:18.633935 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-5d0f1b18-0f17-46db-a0e8-f2ea4ceb8365 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Could not find domain: 5170ac275da64c8b83ada4f53e427709.: keystone.exception.DomainNotFound: Could not find domain: 5170ac275da64c8b83ada4f53e427709. Oct 27 03:49:18.633935 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:49:18.633935 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 27 03:49:18.633935 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 27 03:49:18.633935 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:49:18.633935 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:49:18.633935 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:49:18.633935 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:49:18.633935 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 5170ac275da64c8b83ada4f53e427709. Oct 27 03:49:18.633935 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:18.633935 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:49:18.633935 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:18.633935 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:49:18.633935 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:49:18.633935 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:49:18.635165 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:49:18.635165 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:49:18.635165 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:49:18.635165 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:49:18.635165 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:49:18.635165 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:49:18.635165 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:49:18.635165 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:49:18.635165 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Oct 27 03:49:18.635165 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Oct 27 03:49:18.635165 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:49:18.635165 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:49:18.635165 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:49:18.635165 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:49:18.635165 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:49:18.635165 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:49:18.636315 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:49:18.636315 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:49:18.636315 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:49:18.636315 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:49:18.636315 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:49:18.636315 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:49:18.636315 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:49:18.636315 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:49:18.636315 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:49:18.636315 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:49:18.636315 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:49:18.636315 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:49:18.636315 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:49:18.636315 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:49:18.636315 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 27 03:49:18.636315 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:49:18.636315 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 5170ac275da64c8b83ada4f53e427709. Oct 27 03:49:18.637472 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:18.645002 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3045/6112] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:49:18 2022] DELETE /identity/v3/domains/5170ac275da64c8b83ada4f53e427709 => generated 112 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:49:18.645930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f1b18-0f17-46db-a0e8-f2ea4ceb8365 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:18.649163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5d0f1b18-0f17-46db-a0e8-f2ea4ceb8365 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:18.666888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f1b18-0f17-46db-a0e8-f2ea4ceb8365 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:18.675967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c1333-21b6-4cae-9803-4361fd600e13 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257ea815e1f241e59455445dbb63f6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec070267dc98462c9793e692d075ffd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:18.676599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c1333-21b6-4cae-9803-4361fd600e13 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:18.676891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c1333-21b6-4cae-9803-4361fd600e13 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:18.677173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c1333-21b6-4cae-9803-4361fd600e13 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:18.677846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c1333-21b6-4cae-9803-4361fd600e13 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:18.679981 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3068/6113] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:49:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:49:18.705016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7736f2-cbf8-48df-8cf5-6abbd34b5b7b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:18.707029 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7f7736f2-cbf8-48df-8cf5-6abbd34b5b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:18.707580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c1333-21b6-4cae-9803-4361fd600e13 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:18.841795 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3046/6114] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:49:18 2022] POST /identity/v3/domains => generated 252 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:18.847142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c1333-21b6-4cae-9803-4361fd600e13 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:18.863677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7736f2-cbf8-48df-8cf5-6abbd34b5b7b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:18.945838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c1333-21b6-4cae-9803-4361fd600e13 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:18.953022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ff676-95d1-4422-9975-f8d5d362ace8 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257ea815e1f241e59455445dbb63f6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec070267dc98462c9793e692d075ffd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:18.953630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ff676-95d1-4422-9975-f8d5d362ace8 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:18.953965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ff676-95d1-4422-9975-f8d5d362ace8 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:18.954482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ff676-95d1-4422-9975-f8d5d362ace8 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:18.955284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ff676-95d1-4422-9975-f8d5d362ace8 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:18.956944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ff676-95d1-4422-9975-f8d5d362ace8 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:19.046987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.sql.core [None req-115ff676-95d1-4422-9975-f8d5d362ace8 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-872984643' for key 'project.ixu_project_name_domain_id'") Oct 27 03:49:19.046987 n-d-862769-1 devstack@keystone.service[82179]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 03:49:19.046987 n-d-862769-1 devstack@keystone.service[82179]: [parameters: {'id': 'ebe27e82317547558923263c886b5557', 'name': 'tempest-domain-dup-872984643', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 27 03:49:19.046987 n-d-862769-1 devstack@keystone.service[82179]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82179) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 03:49:19.068506 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-115ff676-95d1-4422-9975-f8d5d362ace8 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-872984643.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-872984643. Oct 27 03:49:19.068506 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:49:19.068506 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 03:49:19.068506 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 03:49:19.068506 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 03:49:19.068506 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 03:49:19.068506 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 03:49:19.068506 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 03:49:19.068506 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 03:49:19.068506 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application conn.query(q) Oct 27 03:49:19.068506 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 03:49:19.068506 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 03:49:19.068506 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 03:49:19.069381 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application result.read() Oct 27 03:49:19.069381 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 03:49:19.069381 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 03:49:19.069381 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 03:49:19.069381 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 03:49:19.069381 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 03:49:19.069381 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 03:49:19.069381 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 03:49:19.069381 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 03:49:19.069381 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-872984643' for key 'project.ixu_project_name_domain_id'") Oct 27 03:49:19.069381 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:19.069381 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 27 03:49:19.069381 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:19.069381 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:49:19.069381 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 27 03:49:19.069381 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 27 03:49:19.069381 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 27 03:49:19.069381 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 27 03:49:19.070398 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 03:49:19.070398 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application next(self.gen) Oct 27 03:49:19.070398 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 27 03:49:19.070398 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application yield resource Oct 27 03:49:19.070398 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 03:49:19.070398 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application next(self.gen) Oct 27 03:49:19.070398 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 27 03:49:19.070398 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.session.rollback() Oct 27 03:49:19.070398 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:49:19.070398 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.force_reraise() Oct 27 03:49:19.070398 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:49:19.070398 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise self.value Oct 27 03:49:19.070398 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 27 03:49:19.070398 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 27 03:49:19.070398 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 27 03:49:19.070398 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application session.commit() Oct 27 03:49:19.070398 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 27 03:49:19.071388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 27 03:49:19.071388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 27 03:49:19.071388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._prepare_impl() Oct 27 03:49:19.071388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 27 03:49:19.071388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.session.flush() Oct 27 03:49:19.071388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 03:49:19.071388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._flush(objects) Oct 27 03:49:19.071388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 03:49:19.071388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 27 03:49:19.071388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 03:49:19.071388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application compat.raise_( Oct 27 03:49:19.071388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 03:49:19.071388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception Oct 27 03:49:19.071388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 03:49:19.071388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application flush_context.execute() Oct 27 03:49:19.071388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 03:49:19.071388 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rec.execute(self) Oct 27 03:49:19.072322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 03:49:19.072322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 27 03:49:19.072322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 03:49:19.072322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 27 03:49:19.072322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 27 03:49:19.072322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 27 03:49:19.072322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 03:49:19.072322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 03:49:19.072322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 03:49:19.072322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 27 03:49:19.072322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 03:49:19.072322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 27 03:49:19.072322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 03:49:19.072322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 27 03:49:19.072322 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 03:49:19.075601 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 03:49:19.075601 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 03:49:19.075601 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception Oct 27 03:49:19.075601 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 03:49:19.075601 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 03:49:19.075601 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 03:49:19.075601 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 03:49:19.075601 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 03:49:19.075601 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 03:49:19.075601 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 03:49:19.075601 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application conn.query(q) Oct 27 03:49:19.075601 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 03:49:19.075601 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 03:49:19.075601 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 03:49:19.075601 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application result.read() Oct 27 03:49:19.075601 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 03:49:19.075601 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 03:49:19.078272 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 03:49:19.078272 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 03:49:19.078272 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 03:49:19.078272 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 03:49:19.078272 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 03:49:19.078272 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 03:49:19.078272 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-872984643' for key 'project.ixu_project_name_domain_id'") Oct 27 03:49:19.078272 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 03:49:19.078272 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [parameters: {'id': 'ebe27e82317547558923263c886b5557', 'name': 'tempest-domain-dup-872984643', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 27 03:49:19.078272 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 03:49:19.078272 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:19.078272 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:49:19.078272 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:19.078272 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:49:19.085840 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 27 03:49:19.085840 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 27 03:49:19.085840 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 27 03:49:19.085840 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 27 03:49:19.085840 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-872984643. Oct 27 03:49:19.085840 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:19.085840 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:49:19.085840 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:19.085840 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:49:19.085840 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:49:19.085840 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:49:19.085840 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:49:19.085840 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:49:19.085840 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:49:19.085840 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:49:19.085840 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:49:19.085840 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:49:19.087132 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:49:19.087132 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:49:19.087132 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 27 03:49:19.087132 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 27 03:49:19.087132 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:49:19.087132 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:49:19.087132 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 27 03:49:19.087132 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 27 03:49:19.087132 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:49:19.087132 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:49:19.087132 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 27 03:49:19.087132 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 27 03:49:19.087132 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-872984643. Oct 27 03:49:19.087132 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:19.090503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67149be6-d70e-415a-982d-d3ebe0bf5a38 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:19.093934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67149be6-d70e-415a-982d-d3ebe0bf5a38 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:19.096103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67149be6-d70e-415a-982d-d3ebe0bf5a38 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:19.096221 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3047/6115] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:49:18 2022] POST /identity/v3/domains => generated 211 bytes in 248 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 27 03:49:19.096319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67149be6-d70e-415a-982d-d3ebe0bf5a38 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:19.099876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ff676-95d1-4422-9975-f8d5d362ace8 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:19.127778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ff676-95d1-4422-9975-f8d5d362ace8 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:19.148331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1cf5d-d730-417b-84db-14cfea81944d tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257ea815e1f241e59455445dbb63f6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec070267dc98462c9793e692d075ffd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:19.150565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1cf5d-d730-417b-84db-14cfea81944d tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:19.154183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1cf5d-d730-417b-84db-14cfea81944d tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:19.159321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1cf5d-d730-417b-84db-14cfea81944d tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] PATH_INFO: `/v3/domains/58c277caac13469cb552e16bfd24de78` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:19.169261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:19.204207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1cf5d-d730-417b-84db-14cfea81944d tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=58c277caac13469cb552e16bfd24de78)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:19.208157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1cf5d-d730-417b-84db-14cfea81944d tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:19.256387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8ed1cf5d-d730-417b-84db-14cfea81944d tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '58c277caac13469cb552e16bfd24de78'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:19.257656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8ed1cf5d-d730-417b-84db-14cfea81944d tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '58c277caac13469cb552e16bfd24de78'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:19.277269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67149be6-d70e-415a-982d-d3ebe0bf5a38 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:19.279736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67149be6-d70e-415a-982d-d3ebe0bf5a38 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:19.290128 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3069/6116] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:49:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 03:49:19.365792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8ed1cf5d-d730-417b-84db-14cfea81944d tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '58c277caac13469cb552e16bfd24de78'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:19.366566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8ed1cf5d-d730-417b-84db-14cfea81944d tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '58c277caac13469cb552e16bfd24de78'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:19.374006 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3048/6117] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:49:19 2022] PATCH /identity/v3/domains/58c277caac13469cb552e16bfd24de78 => generated 253 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:19.376483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67149be6-d70e-415a-982d-d3ebe0bf5a38 service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:19.398440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67149be6-d70e-415a-982d-d3ebe0bf5a38 service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:19.547021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b1bb8-8928-4021-8028-25de81f4eaca tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257ea815e1f241e59455445dbb63f6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec070267dc98462c9793e692d075ffd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:19.548500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b1bb8-8928-4021-8028-25de81f4eaca tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:19.548797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b1bb8-8928-4021-8028-25de81f4eaca tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:19.549079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b1bb8-8928-4021-8028-25de81f4eaca tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] PATH_INFO: `/v3/domains/58c277caac13469cb552e16bfd24de78` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:19.570812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b1bb8-8928-4021-8028-25de81f4eaca tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=58c277caac13469cb552e16bfd24de78)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:19.573868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b1bb8-8928-4021-8028-25de81f4eaca tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:19.611607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b01b1bb8-8928-4021-8028-25de81f4eaca tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '58c277caac13469cb552e16bfd24de78'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:19.625743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b01b1bb8-8928-4021-8028-25de81f4eaca tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '58c277caac13469cb552e16bfd24de78'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:19.714142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:19.801635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1cf5d-d730-417b-84db-14cfea81944d tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:19.803656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8ed1cf5d-d730-417b-84db-14cfea81944d tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:19.857753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b01b1bb8-8928-4021-8028-25de81f4eaca tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c277caac13469cb552e16bfd24de78', 'request_id': 'req-b01b1bb8-8928-4021-8028-25de81f4eaca'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:19.874660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b01b1bb8-8928-4021-8028-25de81f4eaca tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c277caac13469cb552e16bfd24de78', 'request_id': 'req-b01b1bb8-8928-4021-8028-25de81f4eaca'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:19.888988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b01b1bb8-8928-4021-8028-25de81f4eaca tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c277caac13469cb552e16bfd24de78', 'request_id': 'req-b01b1bb8-8928-4021-8028-25de81f4eaca'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:19.974668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b01b1bb8-8928-4021-8028-25de81f4eaca tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] The token cache is being invalidate because project 58c277caac13469cb552e16bfd24de78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:19.974668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b01b1bb8-8928-4021-8028-25de81f4eaca tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:19.975734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b01b1bb8-8928-4021-8028-25de81f4eaca tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:20.012735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b01b1bb8-8928-4021-8028-25de81f4eaca tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '58c277caac13469cb552e16bfd24de78', 'request_id': 'req-b01b1bb8-8928-4021-8028-25de81f4eaca'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:20.017215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b01b1bb8-8928-4021-8028-25de81f4eaca tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '58c277caac13469cb552e16bfd24de78', 'request_id': 'req-b01b1bb8-8928-4021-8028-25de81f4eaca'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:20.019177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b01b1bb8-8928-4021-8028-25de81f4eaca tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '58c277caac13469cb552e16bfd24de78', 'request_id': 'req-b01b1bb8-8928-4021-8028-25de81f4eaca'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:20.063164 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3070/6118] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:49:19 2022] DELETE /identity/v3/domains/58c277caac13469cb552e16bfd24de78 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:20.065504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b1bb8-8928-4021-8028-25de81f4eaca tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:20.069866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b01b1bb8-8928-4021-8028-25de81f4eaca tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:20.132156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1cf5d-d730-417b-84db-14cfea81944d tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:20.231505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b1bb8-8928-4021-8028-25de81f4eaca tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:20.237332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd7315-63d5-4dba-861b-d245a29f6775 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257ea815e1f241e59455445dbb63f6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec070267dc98462c9793e692d075ffd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:20.239686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd7315-63d5-4dba-861b-d245a29f6775 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:20.240060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd7315-63d5-4dba-861b-d245a29f6775 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:20.240426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd7315-63d5-4dba-861b-d245a29f6775 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] PATH_INFO: `/v3/domains/24bd7cd6619b49679810c5a1e33ee4ef` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:20.250504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd7315-63d5-4dba-861b-d245a29f6775 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:49:20.256042 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-6ccd7315-63d5-4dba-861b-d245a29f6775 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Could not find domain: 24bd7cd6619b49679810c5a1e33ee4ef.: keystone.exception.DomainNotFound: Could not find domain: 24bd7cd6619b49679810c5a1e33ee4ef. Oct 27 03:49:20.256042 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:49:20.256042 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 27 03:49:20.256042 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 27 03:49:20.256042 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:49:20.256042 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:49:20.256042 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:49:20.256042 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:49:20.256042 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 24bd7cd6619b49679810c5a1e33ee4ef. Oct 27 03:49:20.256042 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:49:20.256042 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:49:20.256042 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:49:20.256042 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:49:20.256042 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:49:20.256042 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:49:20.257163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:49:20.257163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:49:20.257163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:49:20.257163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:49:20.257163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:49:20.257163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:49:20.257163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:49:20.257163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:49:20.257163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 27 03:49:20.257163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 27 03:49:20.257163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:49:20.257163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:49:20.257163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:49:20.257163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:49:20.257163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:49:20.257163 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:49:20.261964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:49:20.261964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:49:20.261964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:49:20.261964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:49:20.261964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:49:20.261964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:49:20.261964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:49:20.261964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:49:20.261964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:49:20.261964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:49:20.261964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:49:20.261964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:49:20.261964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:49:20.261964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:49:20.261964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 27 03:49:20.261964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:49:20.261964 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 24bd7cd6619b49679810c5a1e33ee4ef. Oct 27 03:49:20.263303 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:49:20.263303 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3071/6119] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:49:20 2022] PATCH /identity/v3/domains/24bd7cd6619b49679810c5a1e33ee4ef => generated 112 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:49:20.263898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd7315-63d5-4dba-861b-d245a29f6775 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:20.265978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6ccd7315-63d5-4dba-861b-d245a29f6775 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:20.368199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac259371-72e6-4636-b5bb-1be228265de9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:20.369982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac259371-72e6-4636-b5bb-1be228265de9 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:20.370340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac259371-72e6-4636-b5bb-1be228265de9 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:20.370620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac259371-72e6-4636-b5bb-1be228265de9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:20.374802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ac259371-72e6-4636-b5bb-1be228265de9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:20.407046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac259371-72e6-4636-b5bb-1be228265de9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:20.421811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac259371-72e6-4636-b5bb-1be228265de9 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:20.423433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd7315-63d5-4dba-861b-d245a29f6775 tempest-DomainsNegativeTestJSON-1112246006 tempest-DomainsNegativeTestJSON-1112246006-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:20.436437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199bff4-f008-4d81-93ec-f42501c8e5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:20.437283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199bff4-f008-4d81-93ec-f42501c8e5b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:20.437526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199bff4-f008-4d81-93ec-f42501c8e5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:20.437802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199bff4-f008-4d81-93ec-f42501c8e5b2 admin admin] PATH_INFO: `/v3/users/880b0b50fa3f4597afbd92d7d59e27ec` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:20.440257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199bff4-f008-4d81-93ec-f42501c8e5b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=880b0b50fa3f4597afbd92d7d59e27ec)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:20.442296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199bff4-f008-4d81-93ec-f42501c8e5b2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:20.456875 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3049/6120] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:49:20.459290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35262c-e014-4f4c-90d5-351896a59705 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:20.459859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35262c-e014-4f4c-90d5-351896a59705 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:20.462668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35262c-e014-4f4c-90d5-351896a59705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:20.496200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ce35262c-e014-4f4c-90d5-351896a59705 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:20.497883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ce35262c-e014-4f4c-90d5-351896a59705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:20.605425 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3050/6121] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:49:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:20.606976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35262c-e014-4f4c-90d5-351896a59705 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:20.617159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ce35262c-e014-4f4c-90d5-351896a59705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:20.638333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35262c-e014-4f4c-90d5-351896a59705 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:20.644322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce0030-b9f9-4c3b-b08e-b4b6cddd9ac3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:20.645060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce0030-b9f9-4c3b-b08e-b4b6cddd9ac3 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:20.645660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce0030-b9f9-4c3b-b08e-b4b6cddd9ac3 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:20.646182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce0030-b9f9-4c3b-b08e-b4b6cddd9ac3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:20.648183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a9ce0030-b9f9-4c3b-b08e-b4b6cddd9ac3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:20.664671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce0030-b9f9-4c3b-b08e-b4b6cddd9ac3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:20.666693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce0030-b9f9-4c3b-b08e-b4b6cddd9ac3 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:20.681455 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3051/6122] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:49:20.693827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce0030-b9f9-4c3b-b08e-b4b6cddd9ac3 service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:20.700624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a9ce0030-b9f9-4c3b-b08e-b4b6cddd9ac3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:20.784424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9199bff4-f008-4d81-93ec-f42501c8e5b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '880b0b50fa3f4597afbd92d7d59e27ec'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:20.791406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9199bff4-f008-4d81-93ec-f42501c8e5b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '880b0b50fa3f4597afbd92d7d59e27ec'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:20.798286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce0030-b9f9-4c3b-b08e-b4b6cddd9ac3 service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:20.803294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9199bff4-f008-4d81-93ec-f42501c8e5b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '880b0b50fa3f4597afbd92d7d59e27ec'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:20.819322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6914f8-4502-4d35-9383-18cbb3dbfd6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:20.819768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6914f8-4502-4d35-9383-18cbb3dbfd6b service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:20.820293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6914f8-4502-4d35-9383-18cbb3dbfd6b service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:20.820747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6914f8-4502-4d35-9383-18cbb3dbfd6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:20.823564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8d6914f8-4502-4d35-9383-18cbb3dbfd6b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:20.837231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9199bff4-f008-4d81-93ec-f42501c8e5b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '880b0b50fa3f4597afbd92d7d59e27ec'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:20.838280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9199bff4-f008-4d81-93ec-f42501c8e5b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '880b0b50fa3f4597afbd92d7d59e27ec'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:20.849913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6914f8-4502-4d35-9383-18cbb3dbfd6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:20.851981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6914f8-4502-4d35-9383-18cbb3dbfd6b service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:20.864914 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3052/6123] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:49:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:49:21.003498 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3072/6124] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:49:20 2022] DELETE /identity/v3/users/880b0b50fa3f4597afbd92d7d59e27ec => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:21.008384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea43ba-a3a7-4c6a-bb21-b8b0bf990316 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:21.008826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea43ba-a3a7-4c6a-bb21-b8b0bf990316 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:21.009152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea43ba-a3a7-4c6a-bb21-b8b0bf990316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:21.055468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0aea43ba-a3a7-4c6a-bb21-b8b0bf990316 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:21.057151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0aea43ba-a3a7-4c6a-bb21-b8b0bf990316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:21.146427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199bff4-f008-4d81-93ec-f42501c8e5b2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:21.150065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9199bff4-f008-4d81-93ec-f42501c8e5b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:21.171855 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3053/6125] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:21.215857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea43ba-a3a7-4c6a-bb21-b8b0bf990316 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:21.217614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0aea43ba-a3a7-4c6a-bb21-b8b0bf990316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:21.313484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199bff4-f008-4d81-93ec-f42501c8e5b2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:21.327401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb252f-9bb4-49bd-9456-bf51e9b09ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:21.328066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb252f-9bb4-49bd-9456-bf51e9b09ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:21.328391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb252f-9bb4-49bd-9456-bf51e9b09ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:21.328777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb252f-9bb4-49bd-9456-bf51e9b09ebe admin admin] PATH_INFO: `/v3/users/ca2da57f02884a968d685b53a5399e46` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:21.330504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb252f-9bb4-49bd-9456-bf51e9b09ebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca2da57f02884a968d685b53a5399e46)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:21.332511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb252f-9bb4-49bd-9456-bf51e9b09ebe admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:21.337460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea43ba-a3a7-4c6a-bb21-b8b0bf990316 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:21.345574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105832c-5e52-4320-bdf6-b5185d39d558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:21.349711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105832c-5e52-4320-bdf6-b5185d39d558 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:21.349954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105832c-5e52-4320-bdf6-b5185d39d558 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:21.350283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105832c-5e52-4320-bdf6-b5185d39d558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:21.393487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105832c-5e52-4320-bdf6-b5185d39d558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:21.399850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105832c-5e52-4320-bdf6-b5185d39d558 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:21.416480 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3054/6126] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:49:21.454468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:21.534925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:21.547406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39594cde-15f0-41f1-9ab1-7e3531fee849 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:21.547406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39594cde-15f0-41f1-9ab1-7e3531fee849 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:21.547406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39594cde-15f0-41f1-9ab1-7e3531fee849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:21.588356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-39594cde-15f0-41f1-9ab1-7e3531fee849 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:21.591263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-39594cde-15f0-41f1-9ab1-7e3531fee849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:21.651508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d7cb252f-9bb4-49bd-9456-bf51e9b09ebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca2da57f02884a968d685b53a5399e46'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:21.654520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d7cb252f-9bb4-49bd-9456-bf51e9b09ebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca2da57f02884a968d685b53a5399e46'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:21.677270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d7cb252f-9bb4-49bd-9456-bf51e9b09ebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca2da57f02884a968d685b53a5399e46'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:21.703678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d7cb252f-9bb4-49bd-9456-bf51e9b09ebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca2da57f02884a968d685b53a5399e46'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:21.704785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d7cb252f-9bb4-49bd-9456-bf51e9b09ebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca2da57f02884a968d685b53a5399e46'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:21.729838 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3055/6127] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:21.745616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39594cde-15f0-41f1-9ab1-7e3531fee849 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:21.747282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-39594cde-15f0-41f1-9ab1-7e3531fee849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:21.833266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39594cde-15f0-41f1-9ab1-7e3531fee849 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:21.840941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56207f56-fe30-4d7c-a4db-aaac53d39f5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:21.841637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56207f56-fe30-4d7c-a4db-aaac53d39f5d service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:21.841929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56207f56-fe30-4d7c-a4db-aaac53d39f5d service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:21.842240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56207f56-fe30-4d7c-a4db-aaac53d39f5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:21.856119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56207f56-fe30-4d7c-a4db-aaac53d39f5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:21.857755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56207f56-fe30-4d7c-a4db-aaac53d39f5d service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:21.876162 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3073/6128] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:49:21 2022] DELETE /identity/v3/users/ca2da57f02884a968d685b53a5399e46 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:49:21.890417 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3056/6129] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:49:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 03:49:22.366962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb252f-9bb4-49bd-9456-bf51e9b09ebe admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:22.370963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d7cb252f-9bb4-49bd-9456-bf51e9b09ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:22.497653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56207f56-fe30-4d7c-a4db-aaac53d39f5d service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:22.500127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-56207f56-fe30-4d7c-a4db-aaac53d39f5d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:22.504185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb252f-9bb4-49bd-9456-bf51e9b09ebe admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:22.530991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a663c-2564-4c96-8cc1-294348c27e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:22.531303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56207f56-fe30-4d7c-a4db-aaac53d39f5d service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:22.531777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a663c-2564-4c96-8cc1-294348c27e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:22.531958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a663c-2564-4c96-8cc1-294348c27e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:22.532243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a663c-2564-4c96-8cc1-294348c27e57 admin admin] PATH_INFO: `/v3/projects/117e018df9034874b552d08c7855bb9b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:22.536353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a663c-2564-4c96-8cc1-294348c27e57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=117e018df9034874b552d08c7855bb9b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:22.539219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a663c-2564-4c96-8cc1-294348c27e57 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:22.560392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe1aec-efa8-4115-a056-306078dec254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:22.561353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe1aec-efa8-4115-a056-306078dec254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:22.561705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe1aec-efa8-4115-a056-306078dec254 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:22.564507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe1aec-efa8-4115-a056-306078dec254 admin admin] PATH_INFO: `/v3/users/47e94ac529fc4ddf9f2c48a109c399ef` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:22.567915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe1aec-efa8-4115-a056-306078dec254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47e94ac529fc4ddf9f2c48a109c399ef)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:22.570341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe1aec-efa8-4115-a056-306078dec254 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:22.754312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-547a663c-2564-4c96-8cc1-294348c27e57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '117e018df9034874b552d08c7855bb9b', 'request_id': 'req-547a663c-2564-4c96-8cc1-294348c27e57'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:22.765133 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-547a663c-2564-4c96-8cc1-294348c27e57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '117e018df9034874b552d08c7855bb9b', 'request_id': 'req-547a663c-2564-4c96-8cc1-294348c27e57'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:22.771071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-547a663c-2564-4c96-8cc1-294348c27e57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '117e018df9034874b552d08c7855bb9b', 'request_id': 'req-547a663c-2564-4c96-8cc1-294348c27e57'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:22.844116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-547a663c-2564-4c96-8cc1-294348c27e57 admin admin] The token cache is being invalidate because project 117e018df9034874b552d08c7855bb9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:22.844563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-547a663c-2564-4c96-8cc1-294348c27e57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:22.845337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-547a663c-2564-4c96-8cc1-294348c27e57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:22.847772 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3074/6130] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:22 2022] DELETE /identity/v3/projects/117e018df9034874b552d08c7855bb9b => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:22.848872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a663c-2564-4c96-8cc1-294348c27e57 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:22.852005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-547a663c-2564-4c96-8cc1-294348c27e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:22.853182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-51fe1aec-efa8-4115-a056-306078dec254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47e94ac529fc4ddf9f2c48a109c399ef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:22.853891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-51fe1aec-efa8-4115-a056-306078dec254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47e94ac529fc4ddf9f2c48a109c399ef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:22.854520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:22.865058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-51fe1aec-efa8-4115-a056-306078dec254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47e94ac529fc4ddf9f2c48a109c399ef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:22.883681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-51fe1aec-efa8-4115-a056-306078dec254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47e94ac529fc4ddf9f2c48a109c399ef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:22.989932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-51fe1aec-efa8-4115-a056-306078dec254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47e94ac529fc4ddf9f2c48a109c399ef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:22.997919 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3057/6131] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:49:22 2022] DELETE /identity/v3/users/47e94ac529fc4ddf9f2c48a109c399ef => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:49:23.003611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe1aec-efa8-4115-a056-306078dec254 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:23.003611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-51fe1aec-efa8-4115-a056-306078dec254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:23.010709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a663c-2564-4c96-8cc1-294348c27e57 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:23.100142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe1aec-efa8-4115-a056-306078dec254 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:23.107835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f207cf8-1e29-4a9b-a5e1-d06ec54f9068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:23.111834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f207cf8-1e29-4a9b-a5e1-d06ec54f9068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:23.112478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f207cf8-1e29-4a9b-a5e1-d06ec54f9068 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:23.112559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f207cf8-1e29-4a9b-a5e1-d06ec54f9068 admin admin] PATH_INFO: `/v3/users/257ea815e1f241e59455445dbb63f6e3` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:23.114389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f207cf8-1e29-4a9b-a5e1-d06ec54f9068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=257ea815e1f241e59455445dbb63f6e3)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:23.116489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f207cf8-1e29-4a9b-a5e1-d06ec54f9068 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:23.122657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e76649-a7a9-48d7-b02f-6ee602723c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:23.123806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e76649-a7a9-48d7-b02f-6ee602723c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:23.124438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e76649-a7a9-48d7-b02f-6ee602723c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:23.124953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e76649-a7a9-48d7-b02f-6ee602723c5f admin admin] PATH_INFO: `/v3/projects/86b90d4cb5eb42958248b6f82516ce19` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:23.127906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e76649-a7a9-48d7-b02f-6ee602723c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=86b90d4cb5eb42958248b6f82516ce19)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:23.152071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e76649-a7a9-48d7-b02f-6ee602723c5f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:23.360230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2f207cf8-1e29-4a9b-a5e1-d06ec54f9068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '257ea815e1f241e59455445dbb63f6e3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:23.361008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2f207cf8-1e29-4a9b-a5e1-d06ec54f9068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '257ea815e1f241e59455445dbb63f6e3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:23.366476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d8e76649-a7a9-48d7-b02f-6ee602723c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86b90d4cb5eb42958248b6f82516ce19', 'request_id': 'req-d8e76649-a7a9-48d7-b02f-6ee602723c5f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:23.379856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2f207cf8-1e29-4a9b-a5e1-d06ec54f9068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '257ea815e1f241e59455445dbb63f6e3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:23.381527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d8e76649-a7a9-48d7-b02f-6ee602723c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86b90d4cb5eb42958248b6f82516ce19', 'request_id': 'req-d8e76649-a7a9-48d7-b02f-6ee602723c5f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:23.398981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d8e76649-a7a9-48d7-b02f-6ee602723c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86b90d4cb5eb42958248b6f82516ce19', 'request_id': 'req-d8e76649-a7a9-48d7-b02f-6ee602723c5f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:23.411744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2f207cf8-1e29-4a9b-a5e1-d06ec54f9068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '257ea815e1f241e59455445dbb63f6e3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:23.514132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d8e76649-a7a9-48d7-b02f-6ee602723c5f admin admin] The token cache is being invalidate because project 86b90d4cb5eb42958248b6f82516ce19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:23.514664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d8e76649-a7a9-48d7-b02f-6ee602723c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:23.518591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d8e76649-a7a9-48d7-b02f-6ee602723c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:23.536728 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3075/6132] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:22 2022] DELETE /identity/v3/projects/86b90d4cb5eb42958248b6f82516ce19 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:23.537720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743089e-c0e4-4870-925d-ac3f24fe2820 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:23.538011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743089e-c0e4-4870-925d-ac3f24fe2820 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:23.542423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743089e-c0e4-4870-925d-ac3f24fe2820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:23.579646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2f207cf8-1e29-4a9b-a5e1-d06ec54f9068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '257ea815e1f241e59455445dbb63f6e3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:23.591076 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3058/6133] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:49:22 2022] DELETE /identity/v3/users/257ea815e1f241e59455445dbb63f6e3 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:23.591076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f70f5f-4412-40c3-adf5-cdc54c8adc29 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:23.591076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f70f5f-4412-40c3-adf5-cdc54c8adc29 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:23.591076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f70f5f-4412-40c3-adf5-cdc54c8adc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:23.681489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a743089e-c0e4-4870-925d-ac3f24fe2820 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:23.682904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a743089e-c0e4-4870-925d-ac3f24fe2820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:23.688441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:23.705582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f8f70f5f-4412-40c3-adf5-cdc54c8adc29 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:23.708587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f8f70f5f-4412-40c3-adf5-cdc54c8adc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:23.811678 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3059/6134] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:23.820364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f70f5f-4412-40c3-adf5-cdc54c8adc29 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:23.823545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f8f70f5f-4412-40c3-adf5-cdc54c8adc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:23.842986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f70f5f-4412-40c3-adf5-cdc54c8adc29 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:23.851186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd016d-87d3-4d79-bd16-d87eac5415d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:23.852508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd016d-87d3-4d79-bd16-d87eac5415d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:23.853008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd016d-87d3-4d79-bd16-d87eac5415d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:23.853527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd016d-87d3-4d79-bd16-d87eac5415d3 admin admin] PATH_INFO: `/v3/users/2c1af19f57ef4ba797afc690a0acacfc` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:23.855842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd016d-87d3-4d79-bd16-d87eac5415d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c1af19f57ef4ba797afc690a0acacfc)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:23.857560 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3076/6135] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:23.858909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4f5f7-d780-46a2-aed2-c71000b49438 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:23.859204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4f5f7-d780-46a2-aed2-c71000b49438 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:23.859505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4f5f7-d780-46a2-aed2-c71000b49438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:23.860678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd016d-87d3-4d79-bd16-d87eac5415d3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:23.888702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-dda4f5f7-d780-46a2-aed2-c71000b49438 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:23.892603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-dda4f5f7-d780-46a2-aed2-c71000b49438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:23.904815 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3077/6136] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:23.904815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4f5f7-d780-46a2-aed2-c71000b49438 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:23.904815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-dda4f5f7-d780-46a2-aed2-c71000b49438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:23.965241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4f5f7-d780-46a2-aed2-c71000b49438 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:23.969045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea394ae2-700c-4b16-a20b-bf7c40b0ea36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:23.969662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea394ae2-700c-4b16-a20b-bf7c40b0ea36 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:23.969951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea394ae2-700c-4b16-a20b-bf7c40b0ea36 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:23.970275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea394ae2-700c-4b16-a20b-bf7c40b0ea36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:23.979974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea394ae2-700c-4b16-a20b-bf7c40b0ea36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:23.981451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea394ae2-700c-4b16-a20b-bf7c40b0ea36 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:23.990978 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3078/6137] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:49:23.992534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea394ae2-700c-4b16-a20b-bf7c40b0ea36 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:24.006417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea394ae2-700c-4b16-a20b-bf7c40b0ea36 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:24.009476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb63dc-6907-4d06-8c5b-413e0c5b87ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:24.010174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb63dc-6907-4d06-8c5b-413e0c5b87ee admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:24.010470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb63dc-6907-4d06-8c5b-413e0c5b87ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:24.010847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb63dc-6907-4d06-8c5b-413e0c5b87ee admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:24.011509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb63dc-6907-4d06-8c5b-413e0c5b87ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:49:24.011926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb63dc-6907-4d06-8c5b-413e0c5b87ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:24.013535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb63dc-6907-4d06-8c5b-413e0c5b87ee admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:24.036965 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3079/6138] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:24.041037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb63dc-6907-4d06-8c5b-413e0c5b87ee admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:24.056155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb63dc-6907-4d06-8c5b-413e0c5b87ee admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:24.062703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c501c-145e-41b8-b45f-9952c5085904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:24.067218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c501c-145e-41b8-b45f-9952c5085904 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:24.067819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c501c-145e-41b8-b45f-9952c5085904 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:24.068526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c501c-145e-41b8-b45f-9952c5085904 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:24.070576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c501c-145e-41b8-b45f-9952c5085904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:24.074744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c501c-145e-41b8-b45f-9952c5085904 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:24.118708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-41fd016d-87d3-4d79-bd16-d87eac5415d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c1af19f57ef4ba797afc690a0acacfc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:24.119408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-41fd016d-87d3-4d79-bd16-d87eac5415d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c1af19f57ef4ba797afc690a0acacfc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:24.126847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-41fd016d-87d3-4d79-bd16-d87eac5415d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c1af19f57ef4ba797afc690a0acacfc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:24.140530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-41fd016d-87d3-4d79-bd16-d87eac5415d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c1af19f57ef4ba797afc690a0acacfc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:24.254060 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3080/6139] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:49:24 2022] POST /identity/v3/projects => generated 365 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:49:24.258161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c501c-145e-41b8-b45f-9952c5085904 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:24.259794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7c3c501c-145e-41b8-b45f-9952c5085904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:24.265823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-41fd016d-87d3-4d79-bd16-d87eac5415d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c1af19f57ef4ba797afc690a0acacfc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:24.274367 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3060/6140] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:49:23 2022] DELETE /identity/v3/users/2c1af19f57ef4ba797afc690a0acacfc => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:24.278730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4e1e6-d78c-430e-ab8d-703ce47232d0 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:24.279023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4e1e6-d78c-430e-ab8d-703ce47232d0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:24.283138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4e1e6-d78c-430e-ab8d-703ce47232d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:24.342105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d1d4e1e6-d78c-430e-ab8d-703ce47232d0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:24.342105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d1d4e1e6-d78c-430e-ab8d-703ce47232d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:24.418291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c501c-145e-41b8-b45f-9952c5085904 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:24.428448 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3061/6141] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:24.440675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4e1e6-d78c-430e-ab8d-703ce47232d0 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:24.442285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d1d4e1e6-d78c-430e-ab8d-703ce47232d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:24.512277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fc7aa-e92e-4621-bbf6-49167a7d8e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:24.512961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fc7aa-e92e-4621-bbf6-49167a7d8e51 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:24.513343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fc7aa-e92e-4621-bbf6-49167a7d8e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:24.513701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fc7aa-e92e-4621-bbf6-49167a7d8e51 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:24.514528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8fc7aa-e92e-4621-bbf6-49167a7d8e51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:24.516603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8fc7aa-e92e-4621-bbf6-49167a7d8e51 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:24.526786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4e1e6-d78c-430e-ab8d-703ce47232d0 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:24.530471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143cb6b-1c6f-4d7c-8c68-ff757de98515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:24.531091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143cb6b-1c6f-4d7c-8c68-ff757de98515 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:24.531371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143cb6b-1c6f-4d7c-8c68-ff757de98515 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:24.537518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143cb6b-1c6f-4d7c-8c68-ff757de98515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:24.541401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143cb6b-1c6f-4d7c-8c68-ff757de98515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:24.543000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143cb6b-1c6f-4d7c-8c68-ff757de98515 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:24.553155 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3062/6142] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:49:24.603704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143cb6b-1c6f-4d7c-8c68-ff757de98515 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:24.617437 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3081/6143] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:49:24 2022] POST /identity/v3/users => generated 283 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:24.622556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fc7aa-e92e-4621-bbf6-49167a7d8e51 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:24.623583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8143cb6b-1c6f-4d7c-8c68-ff757de98515 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:24.642611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fc7aa-e92e-4621-bbf6-49167a7d8e51 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:24.646266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143cb6b-1c6f-4d7c-8c68-ff757de98515 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:24.648544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c44caf-dcca-46ea-9e25-eb963933cadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:24.649228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c44caf-dcca-46ea-9e25-eb963933cadc admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:24.649521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c44caf-dcca-46ea-9e25-eb963933cadc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:24.650474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c44caf-dcca-46ea-9e25-eb963933cadc admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:24.651395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c44caf-dcca-46ea-9e25-eb963933cadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:24.655880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673bf0b-0de2-4aab-815a-3b8d1f53be44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:24.657315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673bf0b-0de2-4aab-815a-3b8d1f53be44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:24.661456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673bf0b-0de2-4aab-815a-3b8d1f53be44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:24.661456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673bf0b-0de2-4aab-815a-3b8d1f53be44 admin admin] PATH_INFO: `/v3/projects/ec070267dc98462c9793e692d075ffd4` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:24.661456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673bf0b-0de2-4aab-815a-3b8d1f53be44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec070267dc98462c9793e692d075ffd4)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:24.663812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673bf0b-0de2-4aab-815a-3b8d1f53be44 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:24.665938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c44caf-dcca-46ea-9e25-eb963933cadc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:24.730928 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3082/6144] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:24.735680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c44caf-dcca-46ea-9e25-eb963933cadc admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:24.743470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b4c44caf-dcca-46ea-9e25-eb963933cadc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:24.795551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c44caf-dcca-46ea-9e25-eb963933cadc admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:24.800587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262a292-320b-4f3e-b337-7c73248c1bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:24.801232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262a292-320b-4f3e-b337-7c73248c1bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:24.801517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262a292-320b-4f3e-b337-7c73248c1bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:24.801801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262a292-320b-4f3e-b337-7c73248c1bfb admin admin] PATH_INFO: `/v3/projects/40878788563346598c4446245f05c6f4` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:24.803118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262a292-320b-4f3e-b337-7c73248c1bfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=40878788563346598c4446245f05c6f4)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:24.804904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262a292-320b-4f3e-b337-7c73248c1bfb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:24.842199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9673bf0b-0de2-4aab-815a-3b8d1f53be44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec070267dc98462c9793e692d075ffd4', 'request_id': 'req-9673bf0b-0de2-4aab-815a-3b8d1f53be44'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:24.943598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:24.952943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9673bf0b-0de2-4aab-815a-3b8d1f53be44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec070267dc98462c9793e692d075ffd4', 'request_id': 'req-9673bf0b-0de2-4aab-815a-3b8d1f53be44'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:24.982724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d262a292-320b-4f3e-b337-7c73248c1bfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40878788563346598c4446245f05c6f4', 'request_id': 'req-d262a292-320b-4f3e-b337-7c73248c1bfb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:24.984342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9673bf0b-0de2-4aab-815a-3b8d1f53be44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec070267dc98462c9793e692d075ffd4', 'request_id': 'req-9673bf0b-0de2-4aab-815a-3b8d1f53be44'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:25.005146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d262a292-320b-4f3e-b337-7c73248c1bfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40878788563346598c4446245f05c6f4', 'request_id': 'req-d262a292-320b-4f3e-b337-7c73248c1bfb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:25.024145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d262a292-320b-4f3e-b337-7c73248c1bfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40878788563346598c4446245f05c6f4', 'request_id': 'req-d262a292-320b-4f3e-b337-7c73248c1bfb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:25.035670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9673bf0b-0de2-4aab-815a-3b8d1f53be44 admin admin] The token cache is being invalidate because project ec070267dc98462c9793e692d075ffd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:25.038536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9673bf0b-0de2-4aab-815a-3b8d1f53be44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:25.039817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9673bf0b-0de2-4aab-815a-3b8d1f53be44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:25.047202 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3063/6145] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:24 2022] DELETE /identity/v3/projects/ec070267dc98462c9793e692d075ffd4 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:49:25.056625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673bf0b-0de2-4aab-815a-3b8d1f53be44 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:25.060764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9673bf0b-0de2-4aab-815a-3b8d1f53be44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:25.104958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d262a292-320b-4f3e-b337-7c73248c1bfb admin admin] The token cache is being invalidate because project 40878788563346598c4446245f05c6f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:25.105342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d262a292-320b-4f3e-b337-7c73248c1bfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:25.106417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d262a292-320b-4f3e-b337-7c73248c1bfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:25.109202 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3083/6146] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:24 2022] DELETE /identity/v3/projects/40878788563346598c4446245f05c6f4 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:25.111524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de5396-45e0-4ba6-b54f-e6867368a00d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:25.113500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de5396-45e0-4ba6-b54f-e6867368a00d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:25.113809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de5396-45e0-4ba6-b54f-e6867368a00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:25.157284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-66de5396-45e0-4ba6-b54f-e6867368a00d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:25.158866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-66de5396-45e0-4ba6-b54f-e6867368a00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:25.266108 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3084/6147] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:25.273681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df020e6-b3b1-4cec-9508-421c7f0d4f47 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:25.277825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df020e6-b3b1-4cec-9508-421c7f0d4f47 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:25.284795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df020e6-b3b1-4cec-9508-421c7f0d4f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:25.300336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673bf0b-0de2-4aab-815a-3b8d1f53be44 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:25.359355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2df020e6-b3b1-4cec-9508-421c7f0d4f47 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:25.372304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2df020e6-b3b1-4cec-9508-421c7f0d4f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:25.375822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7b10e-6ab5-4222-a0d8-29d908dd686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:25.376476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7b10e-6ab5-4222-a0d8-29d908dd686c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:25.376759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7b10e-6ab5-4222-a0d8-29d908dd686c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:25.377035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7b10e-6ab5-4222-a0d8-29d908dd686c admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:25.384849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7b10e-6ab5-4222-a0d8-29d908dd686c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:25.386754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7b10e-6ab5-4222-a0d8-29d908dd686c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:25.409877 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3085/6148] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:25.410934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df020e6-b3b1-4cec-9508-421c7f0d4f47 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:25.413501 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3064/6149] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:25.413854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2df020e6-b3b1-4cec-9508-421c7f0d4f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:25.415818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75dd52-0fbb-44e6-ac42-5406d6bc935d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:25.415818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75dd52-0fbb-44e6-ac42-5406d6bc935d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:25.415818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75dd52-0fbb-44e6-ac42-5406d6bc935d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:25.434020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df020e6-b3b1-4cec-9508-421c7f0d4f47 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:25.447232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9f823-288a-41a2-a130-7fac27b45ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:25.448117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9f823-288a-41a2-a130-7fac27b45ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:25.449131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9f823-288a-41a2-a130-7fac27b45ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:25.449567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9f823-288a-41a2-a130-7fac27b45ff5 admin admin] PATH_INFO: `/v3/projects/21dd86f6b09a4e71afc84bb5bd0f24d6` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:25.452384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9f823-288a-41a2-a130-7fac27b45ff5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21dd86f6b09a4e71afc84bb5bd0f24d6)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:25.454532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9f823-288a-41a2-a130-7fac27b45ff5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:25.461311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4e75dd52-0fbb-44e6-ac42-5406d6bc935d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:25.464117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4e75dd52-0fbb-44e6-ac42-5406d6bc935d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:25.484641 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3065/6150] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:25.486377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af34fa-fc81-40f9-ad4f-88a757c9d24f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:25.486850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af34fa-fc81-40f9-ad4f-88a757c9d24f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:25.487350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af34fa-fc81-40f9-ad4f-88a757c9d24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:25.519052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d6af34fa-fc81-40f9-ad4f-88a757c9d24f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:25.520648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d6af34fa-fc81-40f9-ad4f-88a757c9d24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:25.529420 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3066/6151] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:25.530553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af34fa-fc81-40f9-ad4f-88a757c9d24f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:25.531973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d6af34fa-fc81-40f9-ad4f-88a757c9d24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:25.545560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af34fa-fc81-40f9-ad4f-88a757c9d24f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:25.549055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:25.553401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbd1aa-a589-48cb-b969-713d23cd0f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:25.554433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbd1aa-a589-48cb-b969-713d23cd0f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:25.554875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbd1aa-a589-48cb-b969-713d23cd0f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:25.555308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbd1aa-a589-48cb-b969-713d23cd0f6c admin admin] PATH_INFO: `/v3/projects/9ba078a4265c49cf80b2ef51af55cd2a/users/789a102dc64b45fb9d4a25f338ed723b/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:25.588491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7bc9f823-288a-41a2-a130-7fac27b45ff5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21dd86f6b09a4e71afc84bb5bd0f24d6', 'request_id': 'req-7bc9f823-288a-41a2-a130-7fac27b45ff5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:25.593478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbd1aa-a589-48cb-b969-713d23cd0f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba078a4265c49cf80b2ef51af55cd2a, user_id=789a102dc64b45fb9d4a25f338ed723b, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:25.595008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7bc9f823-288a-41a2-a130-7fac27b45ff5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21dd86f6b09a4e71afc84bb5bd0f24d6', 'request_id': 'req-7bc9f823-288a-41a2-a130-7fac27b45ff5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:25.597981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbd1aa-a589-48cb-b969-713d23cd0f6c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:25.600829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7bc9f823-288a-41a2-a130-7fac27b45ff5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21dd86f6b09a4e71afc84bb5bd0f24d6', 'request_id': 'req-7bc9f823-288a-41a2-a130-7fac27b45ff5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:25.674504 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3067/6152] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:49:25 2022] PUT /identity/v3/projects/9ba078a4265c49cf80b2ef51af55cd2a/users/789a102dc64b45fb9d4a25f338ed723b/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:25.674504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbd1aa-a589-48cb-b969-713d23cd0f6c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:25.727586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7bc9f823-288a-41a2-a130-7fac27b45ff5 admin admin] The token cache is being invalidate because project 21dd86f6b09a4e71afc84bb5bd0f24d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:25.727986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7bc9f823-288a-41a2-a130-7fac27b45ff5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:25.730053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7bc9f823-288a-41a2-a130-7fac27b45ff5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:25.736580 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3086/6153] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:25 2022] DELETE /identity/v3/projects/21dd86f6b09a4e71afc84bb5bd0f24d6 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:25.738373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9f823-288a-41a2-a130-7fac27b45ff5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:25.743520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7bc9f823-288a-41a2-a130-7fac27b45ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:25.873715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbd1aa-a589-48cb-b969-713d23cd0f6c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:25.879397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db078241-36eb-47f7-8d36-7529ed6b03bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:25.880276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db078241-36eb-47f7-8d36-7529ed6b03bc admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:25.880755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db078241-36eb-47f7-8d36-7529ed6b03bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:25.881177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db078241-36eb-47f7-8d36-7529ed6b03bc admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:25.882025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db078241-36eb-47f7-8d36-7529ed6b03bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:49:25.882727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db078241-36eb-47f7-8d36-7529ed6b03bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:25.884617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db078241-36eb-47f7-8d36-7529ed6b03bc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:25.904233 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3068/6154] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:25.906101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44b43e-a91e-4213-8510-2df47f1727c4 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:25.906524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44b43e-a91e-4213-8510-2df47f1727c4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:25.906993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44b43e-a91e-4213-8510-2df47f1727c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:25.922205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9f823-288a-41a2-a130-7fac27b45ff5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:25.935805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4f53a-a35d-4de3-84f4-c81f54c964a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:25.936606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4f53a-a35d-4de3-84f4-c81f54c964a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:25.936946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4f53a-a35d-4de3-84f4-c81f54c964a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:25.937330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4f53a-a35d-4de3-84f4-c81f54c964a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:25.938370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4f53a-a35d-4de3-84f4-c81f54c964a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:49:25.938771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4f53a-a35d-4de3-84f4-c81f54c964a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:25.943418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4f53a-a35d-4de3-84f4-c81f54c964a0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:25.973554 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3087/6155] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:25.974633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4f53a-a35d-4de3-84f4-c81f54c964a0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:25.980797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-abe4f53a-a35d-4de3-84f4-c81f54c964a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:25.985451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-dc44b43e-a91e-4213-8510-2df47f1727c4 None None] MFA Rules not processed for user `789a102dc64b45fb9d4a25f338ed723b`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:25.987233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dc44b43e-a91e-4213-8510-2df47f1727c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:26.011976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4f53a-a35d-4de3-84f4-c81f54c964a0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:26.028259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb6b52-d68e-41a7-9743-d65e2e98b225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:26.029038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb6b52-d68e-41a7-9743-d65e2e98b225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:26.029430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb6b52-d68e-41a7-9743-d65e2e98b225 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:26.029968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb6b52-d68e-41a7-9743-d65e2e98b225 admin admin] PATH_INFO: `/v3/users/7f215676af8a4f3986ddc62d1e66339b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:26.031457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb6b52-d68e-41a7-9743-d65e2e98b225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f215676af8a4f3986ddc62d1e66339b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:26.033590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb6b52-d68e-41a7-9743-d65e2e98b225 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:26.156044 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3069/6156] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:26.157026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44b43e-a91e-4213-8510-2df47f1727c4 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:26.158747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dc44b43e-a91e-4213-8510-2df47f1727c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:26.177486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44b43e-a91e-4213-8510-2df47f1727c4 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:26.205342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e7521-2713-48fd-bec9-81f694d79e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:26.205342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e7521-2713-48fd-bec9-81f694d79e29 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:26.205342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e7521-2713-48fd-bec9-81f694d79e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:26.205342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e7521-2713-48fd-bec9-81f694d79e29 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:26.205806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e7521-2713-48fd-bec9-81f694d79e29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:26.210462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e7521-2713-48fd-bec9-81f694d79e29 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:26.269504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8fdb6b52-d68e-41a7-9743-d65e2e98b225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f215676af8a4f3986ddc62d1e66339b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:26.270236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8fdb6b52-d68e-41a7-9743-d65e2e98b225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f215676af8a4f3986ddc62d1e66339b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:26.278277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8fdb6b52-d68e-41a7-9743-d65e2e98b225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f215676af8a4f3986ddc62d1e66339b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:26.282749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:26.296970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8fdb6b52-d68e-41a7-9743-d65e2e98b225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f215676af8a4f3986ddc62d1e66339b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:26.297725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8fdb6b52-d68e-41a7-9743-d65e2e98b225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f215676af8a4f3986ddc62d1e66339b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:26.349397 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3070/6157] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:49:26 2022] POST /identity/v3/projects => generated 371 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:26.350922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e7521-2713-48fd-bec9-81f694d79e29 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:26.356691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-095e7521-2713-48fd-bec9-81f694d79e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:26.375812 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3088/6158] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:49:25 2022] DELETE /identity/v3/users/7f215676af8a4f3986ddc62d1e66339b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:26.376114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:26.377324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb6b52-d68e-41a7-9743-d65e2e98b225 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:26.379498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8fdb6b52-d68e-41a7-9743-d65e2e98b225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:26.506808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e7521-2713-48fd-bec9-81f694d79e29 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:26.567494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb6b52-d68e-41a7-9743-d65e2e98b225 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:26.583320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2fa51-0f60-4b04-9a71-b15897f847dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:26.583584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2fa51-0f60-4b04-9a71-b15897f847dd service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:26.583809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2fa51-0f60-4b04-9a71-b15897f847dd service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:26.584085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2fa51-0f60-4b04-9a71-b15897f847dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:26.586003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e8d2fa51-0f60-4b04-9a71-b15897f847dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:26.647737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edfd54-b2f6-4275-8f77-2e67aab853f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:26.649200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edfd54-b2f6-4275-8f77-2e67aab853f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:26.649769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edfd54-b2f6-4275-8f77-2e67aab853f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:26.650662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edfd54-b2f6-4275-8f77-2e67aab853f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:26.652249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edfd54-b2f6-4275-8f77-2e67aab853f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:26.655005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edfd54-b2f6-4275-8f77-2e67aab853f0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:26.711429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2fa51-0f60-4b04-9a71-b15897f847dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:26.711429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2fa51-0f60-4b04-9a71-b15897f847dd service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:26.720346 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3089/6159] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:26 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:49:26.721167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2fa51-0f60-4b04-9a71-b15897f847dd service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:26.722630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e8d2fa51-0f60-4b04-9a71-b15897f847dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:26.792540 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3071/6160] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:49:26 2022] POST /identity/v3/projects => generated 385 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:26.796898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edfd54-b2f6-4275-8f77-2e67aab853f0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:26.799525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-93edfd54-b2f6-4275-8f77-2e67aab853f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:26.853502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2fa51-0f60-4b04-9a71-b15897f847dd service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:26.901758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edfd54-b2f6-4275-8f77-2e67aab853f0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:26.907842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe88ad6-dce3-450f-99de-1bbefc6c8849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:26.908771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe88ad6-dce3-450f-99de-1bbefc6c8849 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:26.909114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe88ad6-dce3-450f-99de-1bbefc6c8849 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:26.910278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe88ad6-dce3-450f-99de-1bbefc6c8849 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:26.910933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe88ad6-dce3-450f-99de-1bbefc6c8849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:26.912951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe88ad6-dce3-450f-99de-1bbefc6c8849 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:26.930954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04150a76-a511-4a89-b14e-5df0a7c8fa7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:26.933451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04150a76-a511-4a89-b14e-5df0a7c8fa7f service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:26.933451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04150a76-a511-4a89-b14e-5df0a7c8fa7f service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:26.933451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04150a76-a511-4a89-b14e-5df0a7c8fa7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:26.935296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-04150a76-a511-4a89-b14e-5df0a7c8fa7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:27.007600 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3072/6161] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:49:26 2022] POST /identity/v3/users => generated 286 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:27.007600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe88ad6-dce3-450f-99de-1bbefc6c8849 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:27.009976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-abe88ad6-dce3-450f-99de-1bbefc6c8849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:27.032324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe88ad6-dce3-450f-99de-1bbefc6c8849 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:27.038367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4be87-a22a-4a49-a81f-8dbe90fe42e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:27.039535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4be87-a22a-4a49-a81f-8dbe90fe42e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:27.039913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4be87-a22a-4a49-a81f-8dbe90fe42e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:27.040602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4be87-a22a-4a49-a81f-8dbe90fe42e5 admin admin] PATH_INFO: `/v3/projects/b93be24b0106440ebaf21ae62e583ef2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:27.042779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4be87-a22a-4a49-a81f-8dbe90fe42e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b93be24b0106440ebaf21ae62e583ef2)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:27.045757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4be87-a22a-4a49-a81f-8dbe90fe42e5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:27.064223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04150a76-a511-4a89-b14e-5df0a7c8fa7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:27.067267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04150a76-a511-4a89-b14e-5df0a7c8fa7f service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:27.080928 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3090/6162] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:49:27.081785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04150a76-a511-4a89-b14e-5df0a7c8fa7f service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:27.096240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04150a76-a511-4a89-b14e-5df0a7c8fa7f service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:27.102097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33397660-442d-42d3-a6dd-7f5af52dd7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:27.102942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33397660-442d-42d3-a6dd-7f5af52dd7f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:27.103558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33397660-442d-42d3-a6dd-7f5af52dd7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:27.103984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33397660-442d-42d3-a6dd-7f5af52dd7f6 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:27.105646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33397660-442d-42d3-a6dd-7f5af52dd7f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:27.108296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33397660-442d-42d3-a6dd-7f5af52dd7f6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:27.209290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-25c4be87-a22a-4a49-a81f-8dbe90fe42e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b93be24b0106440ebaf21ae62e583ef2', 'request_id': 'req-25c4be87-a22a-4a49-a81f-8dbe90fe42e5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:27.252059 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3091/6163] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:49:27 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:27.252183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33397660-442d-42d3-a6dd-7f5af52dd7f6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:27.274177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33397660-442d-42d3-a6dd-7f5af52dd7f6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:27.299466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-25c4be87-a22a-4a49-a81f-8dbe90fe42e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b93be24b0106440ebaf21ae62e583ef2', 'request_id': 'req-25c4be87-a22a-4a49-a81f-8dbe90fe42e5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:27.308987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-25c4be87-a22a-4a49-a81f-8dbe90fe42e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b93be24b0106440ebaf21ae62e583ef2', 'request_id': 'req-25c4be87-a22a-4a49-a81f-8dbe90fe42e5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:27.339033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-25c4be87-a22a-4a49-a81f-8dbe90fe42e5 admin admin] The token cache is being invalidate because project b93be24b0106440ebaf21ae62e583ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:27.339033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-25c4be87-a22a-4a49-a81f-8dbe90fe42e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:27.339033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-25c4be87-a22a-4a49-a81f-8dbe90fe42e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:27.355773 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3073/6164] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:27 2022] DELETE /identity/v3/projects/b93be24b0106440ebaf21ae62e583ef2 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:27.357000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4be87-a22a-4a49-a81f-8dbe90fe42e5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:27.360379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-25c4be87-a22a-4a49-a81f-8dbe90fe42e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:27.420119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b6529-7f29-4789-8ec0-563d308dce2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:27.421025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b6529-7f29-4789-8ec0-563d308dce2e admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:27.421301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b6529-7f29-4789-8ec0-563d308dce2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:27.421573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b6529-7f29-4789-8ec0-563d308dce2e admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:27.422288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b6529-7f29-4789-8ec0-563d308dce2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:27.424098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b6529-7f29-4789-8ec0-563d308dce2e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:27.439531 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3092/6165] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:27.441139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b3309-97a6-4440-837c-29c4f01a5362 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:27.441669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b3309-97a6-4440-837c-29c4f01a5362 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:27.441950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b3309-97a6-4440-837c-29c4f01a5362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:27.483779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7b0b3309-97a6-4440-837c-29c4f01a5362 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:27.485701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7b0b3309-97a6-4440-837c-29c4f01a5362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:27.500829 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3093/6166] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:27.504368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b3309-97a6-4440-837c-29c4f01a5362 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:27.510651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7b0b3309-97a6-4440-837c-29c4f01a5362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:27.526448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4be87-a22a-4a49-a81f-8dbe90fe42e5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:27.532675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f66f00-f14a-4a9c-b7ef-c1a640ae977e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:27.533048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b3309-97a6-4440-837c-29c4f01a5362 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:27.533414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f66f00-f14a-4a9c-b7ef-c1a640ae977e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:27.533701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f66f00-f14a-4a9c-b7ef-c1a640ae977e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:27.534620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f66f00-f14a-4a9c-b7ef-c1a640ae977e admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:27.535891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f66f00-f14a-4a9c-b7ef-c1a640ae977e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:27.539159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f66f00-f14a-4a9c-b7ef-c1a640ae977e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:27.552597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82264edb-0a98-42a3-9c6c-ddef03a797f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:27.553418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82264edb-0a98-42a3-9c6c-ddef03a797f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:27.554718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82264edb-0a98-42a3-9c6c-ddef03a797f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:27.554718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82264edb-0a98-42a3-9c6c-ddef03a797f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:27.556502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82264edb-0a98-42a3-9c6c-ddef03a797f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:27.556633 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3074/6167] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:27.559594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845e8a3-a041-43cc-8309-1fef7e205771 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:27.559594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845e8a3-a041-43cc-8309-1fef7e205771 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:27.559972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82264edb-0a98-42a3-9c6c-ddef03a797f1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:27.560088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845e8a3-a041-43cc-8309-1fef7e205771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:27.576156 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3094/6168] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:27.580369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82264edb-0a98-42a3-9c6c-ddef03a797f1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:27.591584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82264edb-0a98-42a3-9c6c-ddef03a797f1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:27.597368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c6638-9c79-4f05-b2ae-59527ecd9319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:27.598121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c6638-9c79-4f05-b2ae-59527ecd9319 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:27.598481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c6638-9c79-4f05-b2ae-59527ecd9319 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:27.598832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c6638-9c79-4f05-b2ae-59527ecd9319 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:27.600405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c6638-9c79-4f05-b2ae-59527ecd9319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:27.602263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c6638-9c79-4f05-b2ae-59527ecd9319 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:27.615893 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3095/6169] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:27.617041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c6638-9c79-4f05-b2ae-59527ecd9319 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:27.628388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9845e8a3-a041-43cc-8309-1fef7e205771 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:27.629909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c6638-9c79-4f05-b2ae-59527ecd9319 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:27.630800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9845e8a3-a041-43cc-8309-1fef7e205771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:27.637032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabd5c9-3159-4253-8e20-1cfa744656ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:27.637809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabd5c9-3159-4253-8e20-1cfa744656ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:27.640123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabd5c9-3159-4253-8e20-1cfa744656ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:27.640123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabd5c9-3159-4253-8e20-1cfa744656ed admin admin] PATH_INFO: `/v3/projects/be5419b79d774f6197809c506438ff89/users/63f6d445ec84459bab7e81410675282c/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:27.653634 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3075/6170] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:27.654713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845e8a3-a041-43cc-8309-1fef7e205771 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:27.664487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabd5c9-3159-4253-8e20-1cfa744656ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=be5419b79d774f6197809c506438ff89, user_id=63f6d445ec84459bab7e81410675282c, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:27.669933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabd5c9-3159-4253-8e20-1cfa744656ed admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:27.676267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845e8a3-a041-43cc-8309-1fef7e205771 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:27.684387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6bdc8-db34-4e43-ad49-12e72de0d894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:27.686488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6bdc8-db34-4e43-ad49-12e72de0d894 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:27.686488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6bdc8-db34-4e43-ad49-12e72de0d894 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:27.686488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6bdc8-db34-4e43-ad49-12e72de0d894 admin admin] PATH_INFO: `/v3/projects/ffaacfdebc2a4107b95fd1cdcca28a4e/users/3d3608a7972c410d84a8559778b133f2/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:27.707501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6bdc8-db34-4e43-ad49-12e72de0d894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffaacfdebc2a4107b95fd1cdcca28a4e, user_id=3d3608a7972c410d84a8559778b133f2, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:27.711656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6bdc8-db34-4e43-ad49-12e72de0d894 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:27.786415 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3096/6171] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:49:27 2022] PUT /identity/v3/projects/be5419b79d774f6197809c506438ff89/users/63f6d445ec84459bab7e81410675282c/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:27.797068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabd5c9-3159-4253-8e20-1cfa744656ed admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:27.818478 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3076/6172] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:49:27 2022] PUT /identity/v3/projects/ffaacfdebc2a4107b95fd1cdcca28a4e/users/3d3608a7972c410d84a8559778b133f2/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:27.818478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c94d4-e5e5-469d-8280-083d8623337b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:27.818478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c94d4-e5e5-469d-8280-083d8623337b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:27.818478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c94d4-e5e5-469d-8280-083d8623337b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:27.868123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d15c94d4-e5e5-469d-8280-083d8623337b None None] MFA Rules not processed for user `63f6d445ec84459bab7e81410675282c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:27.869761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d15c94d4-e5e5-469d-8280-083d8623337b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:27.947763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabd5c9-3159-4253-8e20-1cfa744656ed admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:28.041260 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3077/6173] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:28.044008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8277e8-3039-4686-b3e3-c9438ec65d6a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:28.044500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8277e8-3039-4686-b3e3-c9438ec65d6a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:28.045023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8277e8-3039-4686-b3e3-c9438ec65d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:28.098349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-cc8277e8-3039-4686-b3e3-c9438ec65d6a None None] MFA Rules not processed for user `3d3608a7972c410d84a8559778b133f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:28.098349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cc8277e8-3039-4686-b3e3-c9438ec65d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:28.112125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d6604-677e-4d2e-bd73-b65d98e3fd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:28.114677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d6604-677e-4d2e-bd73-b65d98e3fd68 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:28.116761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d6604-677e-4d2e-bd73-b65d98e3fd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:28.117057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d6604-677e-4d2e-bd73-b65d98e3fd68 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:28.118878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d6604-677e-4d2e-bd73-b65d98e3fd68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:49:28.119202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d6604-677e-4d2e-bd73-b65d98e3fd68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:28.126871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d6604-677e-4d2e-bd73-b65d98e3fd68 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:28.166819 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3097/6174] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:28.168950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d6604-677e-4d2e-bd73-b65d98e3fd68 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:28.178719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:28.224457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d6604-677e-4d2e-bd73-b65d98e3fd68 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:28.240838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7361fb2-65a4-461b-995d-1de3c5f801c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:28.241644 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3078/6175] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:28.243461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8277e8-3039-4686-b3e3-c9438ec65d6a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:28.244084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7361fb2-65a4-461b-995d-1de3c5f801c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:28.244595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7361fb2-65a4-461b-995d-1de3c5f801c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:28.247984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7361fb2-65a4-461b-995d-1de3c5f801c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:28.248906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7361fb2-65a4-461b-995d-1de3c5f801c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:28.255930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7361fb2-65a4-461b-995d-1de3c5f801c3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:28.273036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8277e8-3039-4686-b3e3-c9438ec65d6a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:28.278143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:28.289427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6edcbe-daae-4846-9e5a-d0d11e2e1e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:28.290280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6edcbe-daae-4846-9e5a-d0d11e2e1e03 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:28.293417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6edcbe-daae-4846-9e5a-d0d11e2e1e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:28.294339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6edcbe-daae-4846-9e5a-d0d11e2e1e03 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:28.296096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6edcbe-daae-4846-9e5a-d0d11e2e1e03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:28.301456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6edcbe-daae-4846-9e5a-d0d11e2e1e03 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:28.400148 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3098/6176] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:49:28 2022] POST /identity/v3/projects => generated 369 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:28.404489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7361fb2-65a4-461b-995d-1de3c5f801c3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:28.433574 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3079/6177] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:49:28 2022] POST /identity/v3/projects => generated 391 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:28.436117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6edcbe-daae-4846-9e5a-d0d11e2e1e03 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:28.541123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7361fb2-65a4-461b-995d-1de3c5f801c3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:28.589896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6edcbe-daae-4846-9e5a-d0d11e2e1e03 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:28.604940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b1aca-0fb5-467b-b08f-cb488f783283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:28.606683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b1aca-0fb5-467b-b08f-cb488f783283 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:28.607113 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b1aca-0fb5-467b-b08f-cb488f783283 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:28.607671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b1aca-0fb5-467b-b08f-cb488f783283 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:28.610209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b1aca-0fb5-467b-b08f-cb488f783283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:28.613375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b1aca-0fb5-467b-b08f-cb488f783283 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:28.662430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd62726-00d5-405b-b521-0deb8c938e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:28.663218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd62726-00d5-405b-b521-0deb8c938e79 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:28.664021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd62726-00d5-405b-b521-0deb8c938e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:28.664441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd62726-00d5-405b-b521-0deb8c938e79 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:28.665484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd62726-00d5-405b-b521-0deb8c938e79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:28.668072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd62726-00d5-405b-b521-0deb8c938e79 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:28.731540 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3080/6178] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:49:28 2022] POST /identity/v3/users => generated 291 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:28.732521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b1aca-0fb5-467b-b08f-cb488f783283 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:28.757074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b1aca-0fb5-467b-b08f-cb488f783283 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:28.763590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd6966-040c-4739-b051-59e78c2ad044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:28.764377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd6966-040c-4739-b051-59e78c2ad044 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:28.764766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd6966-040c-4739-b051-59e78c2ad044 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:28.765148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd6966-040c-4739-b051-59e78c2ad044 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:28.765990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd6966-040c-4739-b051-59e78c2ad044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:28.768633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd6966-040c-4739-b051-59e78c2ad044 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:28.794911 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3099/6179] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:49:28 2022] POST /identity/v3/projects => generated 381 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:28.796267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd62726-00d5-405b-b521-0deb8c938e79 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:28.909674 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3081/6180] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:49:28 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:28.911381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd6966-040c-4739-b051-59e78c2ad044 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:28.954059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd6966-040c-4739-b051-59e78c2ad044 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:28.987691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd62726-00d5-405b-b521-0deb8c938e79 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:28.999148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253fb6d-f3c8-43e9-b537-1c461e837718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:28.999795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253fb6d-f3c8-43e9-b537-1c461e837718 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:29.000080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253fb6d-f3c8-43e9-b537-1c461e837718 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:29.000365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253fb6d-f3c8-43e9-b537-1c461e837718 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:29.005650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253fb6d-f3c8-43e9-b537-1c461e837718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:29.007514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253fb6d-f3c8-43e9-b537-1c461e837718 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:29.047140 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3100/6181] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:29.047140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253fb6d-f3c8-43e9-b537-1c461e837718 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:29.077261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253fb6d-f3c8-43e9-b537-1c461e837718 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:29.101276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf62bd6-ff20-4726-aa7d-8a3c30b1a047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:29.122271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf62bd6-ff20-4726-aa7d-8a3c30b1a047 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:29.122271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf62bd6-ff20-4726-aa7d-8a3c30b1a047 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:29.122271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf62bd6-ff20-4726-aa7d-8a3c30b1a047 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:29.122271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf62bd6-ff20-4726-aa7d-8a3c30b1a047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:29.122271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf62bd6-ff20-4726-aa7d-8a3c30b1a047 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:29.146295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c605f7-8883-4fe2-ba46-557db4e7a949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:29.146935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c605f7-8883-4fe2-ba46-557db4e7a949 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:29.147222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c605f7-8883-4fe2-ba46-557db4e7a949 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:29.147503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c605f7-8883-4fe2-ba46-557db4e7a949 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:29.149077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c605f7-8883-4fe2-ba46-557db4e7a949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:29.157445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c605f7-8883-4fe2-ba46-557db4e7a949 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:29.165361 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3101/6182] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:29.168801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf62bd6-ff20-4726-aa7d-8a3c30b1a047 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:29.190802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:29.197831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf62bd6-ff20-4726-aa7d-8a3c30b1a047 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:29.218911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:29.225343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58659946-f195-4c66-9417-84033b49e2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:29.225343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58659946-f195-4c66-9417-84033b49e2b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:29.225343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58659946-f195-4c66-9417-84033b49e2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:29.225343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58659946-f195-4c66-9417-84033b49e2b0 admin admin] PATH_INFO: `/v3/projects/e73c7eb4a462406b833aebfc25eef5aa/users/88d8038dbc774a6c836a84d59bdaeb43/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:29.264648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58659946-f195-4c66-9417-84033b49e2b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e73c7eb4a462406b833aebfc25eef5aa, user_id=88d8038dbc774a6c836a84d59bdaeb43, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:29.269539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58659946-f195-4c66-9417-84033b49e2b0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:29.313129 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3082/6183] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:49:28 2022] POST /identity/v3/users => generated 297 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:29.314349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c605f7-8883-4fe2-ba46-557db4e7a949 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:29.337708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c605f7-8883-4fe2-ba46-557db4e7a949 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:29.353354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad28ca6-97d9-4857-b6de-16ab57a0a6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:29.364864 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3102/6184] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:49:29 2022] PUT /identity/v3/projects/e73c7eb4a462406b833aebfc25eef5aa/users/88d8038dbc774a6c836a84d59bdaeb43/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:29.365946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58659946-f195-4c66-9417-84033b49e2b0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:29.367035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad28ca6-97d9-4857-b6de-16ab57a0a6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:29.368155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad28ca6-97d9-4857-b6de-16ab57a0a6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:29.371426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad28ca6-97d9-4857-b6de-16ab57a0a6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:29.373585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad28ca6-97d9-4857-b6de-16ab57a0a6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:29.376802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad28ca6-97d9-4857-b6de-16ab57a0a6f7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:29.433224 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3083/6185] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:29.434724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad28ca6-97d9-4857-b6de-16ab57a0a6f7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:29.498407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad28ca6-97d9-4857-b6de-16ab57a0a6f7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:29.672818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58659946-f195-4c66-9417-84033b49e2b0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:29.678988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b1507-48f9-4273-a51a-02c90a1b97a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:29.680453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b1507-48f9-4273-a51a-02c90a1b97a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:29.680746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b1507-48f9-4273-a51a-02c90a1b97a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:29.681080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b1507-48f9-4273-a51a-02c90a1b97a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:29.683318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b1507-48f9-4273-a51a-02c90a1b97a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:29.686912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b1507-48f9-4273-a51a-02c90a1b97a3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:29.702894 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3103/6186] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:29.704086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b1507-48f9-4273-a51a-02c90a1b97a3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:29.717415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b1507-48f9-4273-a51a-02c90a1b97a3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:29.725510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438584b-b744-426d-b714-513e71f51de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:29.727587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438584b-b744-426d-b714-513e71f51de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:29.728159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438584b-b744-426d-b714-513e71f51de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:29.728461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438584b-b744-426d-b714-513e71f51de8 admin admin] PATH_INFO: `/v3/projects/41e1632d7dd94151b7129b3bc6eaa263/users/2f26b834442448759b6ca3288bba5967/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:29.743922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77399e63-fba8-483c-acbd-5efcd27c5b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:29.744627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77399e63-fba8-483c-acbd-5efcd27c5b99 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:29.746196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77399e63-fba8-483c-acbd-5efcd27c5b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:29.746575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77399e63-fba8-483c-acbd-5efcd27c5b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:29.747353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77399e63-fba8-483c-acbd-5efcd27c5b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:29.749061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77399e63-fba8-483c-acbd-5efcd27c5b99 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:29.772868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438584b-b744-426d-b714-513e71f51de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41e1632d7dd94151b7129b3bc6eaa263, user_id=2f26b834442448759b6ca3288bba5967, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:29.781320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438584b-b744-426d-b714-513e71f51de8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:29.784781 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3084/6187] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:29.790493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77399e63-fba8-483c-acbd-5efcd27c5b99 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:29.816535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77399e63-fba8-483c-acbd-5efcd27c5b99 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:29.834680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e4f90-d1b5-4f3b-8b07-448da40ae88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:29.835131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e4f90-d1b5-4f3b-8b07-448da40ae88c admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:29.835510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e4f90-d1b5-4f3b-8b07-448da40ae88c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:29.835891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e4f90-d1b5-4f3b-8b07-448da40ae88c admin admin] PATH_INFO: `/v3/projects/e3ae57db6ee14a0891d6c88bc058716f/users/36af0ddba9884e3abf8421c3f70f8beb/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:29.885067 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3104/6188] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:49:29 2022] PUT /identity/v3/projects/41e1632d7dd94151b7129b3bc6eaa263/users/2f26b834442448759b6ca3288bba5967/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:29.887901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438584b-b744-426d-b714-513e71f51de8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:29.904405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e4f90-d1b5-4f3b-8b07-448da40ae88c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ae57db6ee14a0891d6c88bc058716f, user_id=36af0ddba9884e3abf8421c3f70f8beb, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:29.905563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:29.910568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e4f90-d1b5-4f3b-8b07-448da40ae88c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:29.934412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:30.033074 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3085/6189] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:49:29 2022] PUT /identity/v3/projects/e3ae57db6ee14a0891d6c88bc058716f/users/36af0ddba9884e3abf8421c3f70f8beb/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:30.035086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5ab52-937f-45d2-94d0-deb99cbfd658 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:30.035979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5ab52-937f-45d2-94d0-deb99cbfd658 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:30.036721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5ab52-937f-45d2-94d0-deb99cbfd658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:30.078376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438584b-b744-426d-b714-513e71f51de8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:30.133166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b0a5ab52-937f-45d2-94d0-deb99cbfd658 None None] MFA Rules not processed for user `2f26b834442448759b6ca3288bba5967`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:30.136355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b0a5ab52-937f-45d2-94d0-deb99cbfd658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:30.322383 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3086/6190] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:30.324352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5ab52-937f-45d2-94d0-deb99cbfd658 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:30.341448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9a6e4-f524-450f-93e0-c8bae8f1a91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:30.342575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9a6e4-f524-450f-93e0-c8bae8f1a91d admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:30.343016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9a6e4-f524-450f-93e0-c8bae8f1a91d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:30.356477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9a6e4-f524-450f-93e0-c8bae8f1a91d admin admin] PATH_INFO: `/v3/projects/e73c7eb4a462406b833aebfc25eef5aa/users/88d8038dbc774a6c836a84d59bdaeb43/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:30.370461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9a6e4-f524-450f-93e0-c8bae8f1a91d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e73c7eb4a462406b833aebfc25eef5aa, user_id=88d8038dbc774a6c836a84d59bdaeb43, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:30.374734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9a6e4-f524-450f-93e0-c8bae8f1a91d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:30.391383 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3105/6191] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:49:29 2022] PUT /identity/v3/projects/e73c7eb4a462406b833aebfc25eef5aa/users/88d8038dbc774a6c836a84d59bdaeb43/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:30.404989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30134c62-abed-41ce-af93-8bcd07d6f507 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:30.408170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30134c62-abed-41ce-af93-8bcd07d6f507 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:30.408685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30134c62-abed-41ce-af93-8bcd07d6f507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:30.490257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5ab52-937f-45d2-94d0-deb99cbfd658 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:30.499749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:30.505105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-30134c62-abed-41ce-af93-8bcd07d6f507 None None] MFA Rules not processed for user `88d8038dbc774a6c836a84d59bdaeb43`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:30.507088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-30134c62-abed-41ce-af93-8bcd07d6f507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:30.719644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03807a-a5fe-4a26-97e8-ddaad6d80274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:30.721655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03807a-a5fe-4a26-97e8-ddaad6d80274 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:30.723609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03807a-a5fe-4a26-97e8-ddaad6d80274 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:30.726384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03807a-a5fe-4a26-97e8-ddaad6d80274 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:30.726384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03807a-a5fe-4a26-97e8-ddaad6d80274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:30.730699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03807a-a5fe-4a26-97e8-ddaad6d80274 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:30.769547 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3087/6192] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:30.775101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03807a-a5fe-4a26-97e8-ddaad6d80274 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:30.779843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5e03807a-a5fe-4a26-97e8-ddaad6d80274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:30.860096 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3106/6193] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:30.860895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30134c62-abed-41ce-af93-8bcd07d6f507 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:30.893024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30134c62-abed-41ce-af93-8bcd07d6f507 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:30.908418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:30.915795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68a142-8caa-445a-a28b-92e9f617b82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:30.915795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68a142-8caa-445a-a28b-92e9f617b82e admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:30.916171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68a142-8caa-445a-a28b-92e9f617b82e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:30.916686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68a142-8caa-445a-a28b-92e9f617b82e admin admin] PATH_INFO: `/v3/projects/e3ae57db6ee14a0891d6c88bc058716f/users/36af0ddba9884e3abf8421c3f70f8beb/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:30.922346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68a142-8caa-445a-a28b-92e9f617b82e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ae57db6ee14a0891d6c88bc058716f, user_id=36af0ddba9884e3abf8421c3f70f8beb, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:30.928250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68a142-8caa-445a-a28b-92e9f617b82e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:30.943004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03807a-a5fe-4a26-97e8-ddaad6d80274 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:30.954473 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3107/6194] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:49:30 2022] PUT /identity/v3/projects/e3ae57db6ee14a0891d6c88bc058716f/users/36af0ddba9884e3abf8421c3f70f8beb/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:30.955740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68a142-8caa-445a-a28b-92e9f617b82e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:30.962930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:31.065695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b182de9-e96e-4cb4-9322-d300beaf6e0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:31.066576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b182de9-e96e-4cb4-9322-d300beaf6e0b service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:31.066969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b182de9-e96e-4cb4-9322-d300beaf6e0b service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:31.067606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b182de9-e96e-4cb4-9322-d300beaf6e0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:31.122395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68a142-8caa-445a-a28b-92e9f617b82e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:31.146449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3487e8c-0750-4a7d-931a-5a8c70f9f3c6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:31.147629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3487e8c-0750-4a7d-931a-5a8c70f9f3c6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:31.147931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3487e8c-0750-4a7d-931a-5a8c70f9f3c6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:31.148409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3487e8c-0750-4a7d-931a-5a8c70f9f3c6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:31.149558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3487e8c-0750-4a7d-931a-5a8c70f9f3c6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:31.152040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3487e8c-0750-4a7d-931a-5a8c70f9f3c6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:31.206767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b182de9-e96e-4cb4-9322-d300beaf6e0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:31.208250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b182de9-e96e-4cb4-9322-d300beaf6e0b service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:31.228877 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3088/6195] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:30 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:49:31.236449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035302e-4ab1-45b0-9724-942b233bb9b8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:31.236449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035302e-4ab1-45b0-9724-942b233bb9b8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:31.236449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035302e-4ab1-45b0-9724-942b233bb9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:31.277527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b035302e-4ab1-45b0-9724-942b233bb9b8 None None] MFA Rules not processed for user `36af0ddba9884e3abf8421c3f70f8beb`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:31.279378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b035302e-4ab1-45b0-9724-942b233bb9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:31.293173 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3108/6196] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:49:30 2022] POST /identity/v3/services => generated 289 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:31.298003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3487e8c-0750-4a7d-931a-5a8c70f9f3c6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:31.384067 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3089/6197] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:31 2022] POST /identity/v3/auth/tokens => generated 3458 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:31.390425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035302e-4ab1-45b0-9724-942b233bb9b8 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:31.419516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035302e-4ab1-45b0-9724-942b233bb9b8 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:31.426756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527e81f-cca1-4f8b-9802-c8341f9bc07b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:31.427509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527e81f-cca1-4f8b-9802-c8341f9bc07b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:31.427895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527e81f-cca1-4f8b-9802-c8341f9bc07b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:31.428276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527e81f-cca1-4f8b-9802-c8341f9bc07b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:31.429235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527e81f-cca1-4f8b-9802-c8341f9bc07b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:31.431151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527e81f-cca1-4f8b-9802-c8341f9bc07b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:31.449904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3487e8c-0750-4a7d-931a-5a8c70f9f3c6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:31.451076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b0c82-26be-4434-9421-05bb0e0c0992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:31.451847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b0c82-26be-4434-9421-05bb0e0c0992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:31.452229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b0c82-26be-4434-9421-05bb0e0c0992 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:31.452927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b0c82-26be-4434-9421-05bb0e0c0992 admin admin] PATH_INFO: `/v3/users/2f26b834442448759b6ca3288bba5967` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:31.454423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b0c82-26be-4434-9421-05bb0e0c0992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f26b834442448759b6ca3288bba5967)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:31.456474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b0c82-26be-4434-9421-05bb0e0c0992 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:31.608081 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-a527e81f-cca1-4f8b-9802-c8341f9bc07b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-328412362. To ensure interoperability, identifiers should be a valid uuid. Oct 27 03:49:31.608081 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 27 03:49:31.608081 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:49:31.765472 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3090/6198] 10.222.0.20 () {60 vars in 1156 bytes} [Thu Oct 27 03:49:31 2022] POST /identity/v3/endpoints => generated 359 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:31.768069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527e81f-cca1-4f8b-9802-c8341f9bc07b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:31.769766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e55b0c82-26be-4434-9421-05bb0e0c0992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f26b834442448759b6ca3288bba5967'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:31.770586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e55b0c82-26be-4434-9421-05bb0e0c0992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f26b834442448759b6ca3288bba5967'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:31.788168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e55b0c82-26be-4434-9421-05bb0e0c0992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f26b834442448759b6ca3288bba5967'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:31.827665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527e81f-cca1-4f8b-9802-c8341f9bc07b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:31.839734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfbb07-3dba-4357-a65f-8c8eee3e746d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:31.842109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfbb07-3dba-4357-a65f-8c8eee3e746d service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:31.845902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfbb07-3dba-4357-a65f-8c8eee3e746d service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:31.845902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfbb07-3dba-4357-a65f-8c8eee3e746d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:31.847373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e55b0c82-26be-4434-9421-05bb0e0c0992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f26b834442448759b6ca3288bba5967'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:31.848579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e55b0c82-26be-4434-9421-05bb0e0c0992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f26b834442448759b6ca3288bba5967'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:31.848800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3ebfbb07-3dba-4357-a65f-8c8eee3e746d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:31.878798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfbb07-3dba-4357-a65f-8c8eee3e746d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:31.884060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfbb07-3dba-4357-a65f-8c8eee3e746d service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:31.904821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:31.943411 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3109/6199] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:49:31 2022] DELETE /identity/v3/users/2f26b834442448759b6ca3288bba5967 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:31.945035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b0c82-26be-4434-9421-05bb0e0c0992 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:31.949291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e55b0c82-26be-4434-9421-05bb0e0c0992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:31.950976 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3091/6200] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:31 2022] GET /identity/v3/auth/tokens => generated 3639 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:49:31.952356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992343f-0c8c-4027-8b38-941e9fbe9270 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:31.953826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992343f-0c8c-4027-8b38-941e9fbe9270 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:31.954814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992343f-0c8c-4027-8b38-941e9fbe9270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:32.002853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e992343f-0c8c-4027-8b38-941e9fbe9270 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:32.004136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e992343f-0c8c-4027-8b38-941e9fbe9270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:32.187752 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3092/6201] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:31 2022] POST /identity/v3/auth/tokens => generated 3553 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:32.232254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992343f-0c8c-4027-8b38-941e9fbe9270 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:32.234178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e992343f-0c8c-4027-8b38-941e9fbe9270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:32.273448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b0c82-26be-4434-9421-05bb0e0c0992 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:32.325232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee70abd-b6e4-48d3-9fe3-6a3f5576e36e tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:32.326160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee70abd-b6e4-48d3-9fe3-6a3f5576e36e tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:32.326567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee70abd-b6e4-48d3-9fe3-6a3f5576e36e tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:32.326932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee70abd-b6e4-48d3-9fe3-6a3f5576e36e tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/regions/tempest-region-328412362` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:32.327756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee70abd-b6e4-48d3-9fe3-6a3f5576e36e tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-328412362)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:32.331006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee70abd-b6e4-48d3-9fe3-6a3f5576e36e tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:32.337216 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3110/6202] 10.222.0.20 () {58 vars in 1203 bytes} [Thu Oct 27 03:49:31 2022] GET /identity/v3/regions/tempest-region-328412362 => generated 178 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:32.338991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee70abd-b6e4-48d3-9fe3-6a3f5576e36e tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:32.361359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee70abd-b6e4-48d3-9fe3-6a3f5576e36e tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:32.375840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7367636-a645-42eb-832e-dfff572786fb tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:32.376680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7367636-a645-42eb-832e-dfff572786fb tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:32.377071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7367636-a645-42eb-832e-dfff572786fb tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:32.378068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7367636-a645-42eb-832e-dfff572786fb tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:32.378906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7367636-a645-42eb-832e-dfff572786fb tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:32.383138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992343f-0c8c-4027-8b38-941e9fbe9270 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:32.384630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7367636-a645-42eb-832e-dfff572786fb tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:32.391128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db348a5c-5ce1-454d-81f4-04c1a385c731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:32.391970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db348a5c-5ce1-454d-81f4-04c1a385c731 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:32.392257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db348a5c-5ce1-454d-81f4-04c1a385c731 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:32.392538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db348a5c-5ce1-454d-81f4-04c1a385c731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:32.444083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db348a5c-5ce1-454d-81f4-04c1a385c731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:32.450756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db348a5c-5ce1-454d-81f4-04c1a385c731 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:32.491354 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3093/6203] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:32 2022] GET /identity/v3/auth/tokens => generated 3553 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:49:32.508876 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3111/6204] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:49:32 2022] POST /identity/v3/services => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:32.509398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db348a5c-5ce1-454d-81f4-04c1a385c731 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:32.539169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db348a5c-5ce1-454d-81f4-04c1a385c731 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:32.592015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a4b10-083f-4a33-87bc-ae32ba5f77e0 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:32.592698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a4b10-083f-4a33-87bc-ae32ba5f77e0 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:32.592992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a4b10-083f-4a33-87bc-ae32ba5f77e0 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:32.593285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a4b10-083f-4a33-87bc-ae32ba5f77e0 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:32.593973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a4b10-083f-4a33-87bc-ae32ba5f77e0 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:32.597005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a4b10-083f-4a33-87bc-ae32ba5f77e0 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:32.751154 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-036a4b10-083f-4a33-87bc-ae32ba5f77e0 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-301895639. To ensure interoperability, identifiers should be a valid uuid. Oct 27 03:49:32.751154 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 27 03:49:32.751154 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:49:32.753635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:32.898309 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3094/6205] 10.222.0.20 () {60 vars in 1156 bytes} [Thu Oct 27 03:49:32 2022] POST /identity/v3/endpoints => generated 360 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:49:32.899598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7367636-a645-42eb-832e-dfff572786fb tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:32.921825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7367636-a645-42eb-832e-dfff572786fb tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:32.972507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64246176-ad16-4503-a87f-127fe5e501f4 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:32.972507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64246176-ad16-4503-a87f-127fe5e501f4 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:32.972507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64246176-ad16-4503-a87f-127fe5e501f4 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:32.973267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64246176-ad16-4503-a87f-127fe5e501f4 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/regions/tempest-region-301895639` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:32.973267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64246176-ad16-4503-a87f-127fe5e501f4 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-301895639)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:32.974466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64246176-ad16-4503-a87f-127fe5e501f4 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:32.983354 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3112/6206] 10.222.0.20 () {58 vars in 1203 bytes} [Thu Oct 27 03:49:32 2022] GET /identity/v3/regions/tempest-region-301895639 => generated 178 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:32.984839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a4b10-083f-4a33-87bc-ae32ba5f77e0 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:33.018102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a4b10-083f-4a33-87bc-ae32ba5f77e0 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:33.060096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804ec14-eca8-4b32-947b-432153155de1 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:33.061412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804ec14-eca8-4b32-947b-432153155de1 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:33.061590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804ec14-eca8-4b32-947b-432153155de1 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:33.061874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804ec14-eca8-4b32-947b-432153155de1 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:33.062619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804ec14-eca8-4b32-947b-432153155de1 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:33.064460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804ec14-eca8-4b32-947b-432153155de1 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:33.247408 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-c804ec14-eca8-4b32-947b-432153155de1 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1109832632. To ensure interoperability, identifiers should be a valid uuid. Oct 27 03:49:33.247408 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 27 03:49:33.247408 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:49:33.373111 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3095/6207] 10.222.0.20 () {60 vars in 1156 bytes} [Thu Oct 27 03:49:32 2022] POST /identity/v3/endpoints => generated 361 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:33.376970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64246176-ad16-4503-a87f-127fe5e501f4 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:33.391518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64246176-ad16-4503-a87f-127fe5e501f4 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:33.419675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70c08a-60f7-41e4-beab-775636aa3d90 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:33.420805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70c08a-60f7-41e4-beab-775636aa3d90 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:33.423971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70c08a-60f7-41e4-beab-775636aa3d90 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:33.423971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70c08a-60f7-41e4-beab-775636aa3d90 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/regions/tempest-region-1109832632` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:33.423971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70c08a-60f7-41e4-beab-775636aa3d90 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1109832632)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:33.430889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70c08a-60f7-41e4-beab-775636aa3d90 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:33.437283 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3113/6208] 10.222.0.20 () {58 vars in 1206 bytes} [Thu Oct 27 03:49:33 2022] GET /identity/v3/regions/tempest-region-1109832632 => generated 180 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:33.439012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804ec14-eca8-4b32-947b-432153155de1 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:33.459958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804ec14-eca8-4b32-947b-432153155de1 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:33.471954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64638743-eec5-444e-8b6c-e84ee06eaef7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:33.474559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64638743-eec5-444e-8b6c-e84ee06eaef7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:33.475118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64638743-eec5-444e-8b6c-e84ee06eaef7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:33.475748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64638743-eec5-444e-8b6c-e84ee06eaef7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:33.483022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64638743-eec5-444e-8b6c-e84ee06eaef7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:33.483022 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-64638743-eec5-444e-8b6c-e84ee06eaef7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:49:33.483022 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:49:33.483022 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:49:33.483022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64638743-eec5-444e-8b6c-e84ee06eaef7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:33.504244 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3096/6209] 10.222.0.20 () {58 vars in 1134 bytes} [Thu Oct 27 03:49:33 2022] GET /identity/v3/endpoints => generated 4394 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:49:33.512192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70c08a-60f7-41e4-beab-775636aa3d90 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:33.528479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64638743-eec5-444e-8b6c-e84ee06eaef7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:33.532456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-64638743-eec5-444e-8b6c-e84ee06eaef7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:33.536563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70c08a-60f7-41e4-beab-775636aa3d90 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:33.556981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592976f8-214e-49b3-9553-d0506089183b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:33.558231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592976f8-214e-49b3-9553-d0506089183b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:33.558518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592976f8-214e-49b3-9553-d0506089183b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:33.565633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592976f8-214e-49b3-9553-d0506089183b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/endpoints/5f47fe36a8994593859840a3582f2a15` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:33.601574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592976f8-214e-49b3-9553-d0506089183b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=5f47fe36a8994593859840a3582f2a15)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:33.609400 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-592976f8-214e-49b3-9553-d0506089183b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:49:33.609400 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:49:33.609400 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:49:33.633369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592976f8-214e-49b3-9553-d0506089183b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:33.640509 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3114/6210] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:33 2022] GET /identity/v3/endpoints/5f47fe36a8994593859840a3582f2a15 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:33.645570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592976f8-214e-49b3-9553-d0506089183b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:33.666089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64638743-eec5-444e-8b6c-e84ee06eaef7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:33.704084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36d8d0-7924-4c57-bd44-d4ab9d60e104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:33.705186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36d8d0-7924-4c57-bd44-d4ab9d60e104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:33.705487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36d8d0-7924-4c57-bd44-d4ab9d60e104 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:33.705753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36d8d0-7924-4c57-bd44-d4ab9d60e104 admin admin] PATH_INFO: `/v3/projects/41e1632d7dd94151b7129b3bc6eaa263` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:33.706781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592976f8-214e-49b3-9553-d0506089183b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:33.707244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36d8d0-7924-4c57-bd44-d4ab9d60e104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41e1632d7dd94151b7129b3bc6eaa263)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:33.711820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36d8d0-7924-4c57-bd44-d4ab9d60e104 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:33.722741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbaa0c-a8d8-469a-a44b-dfec279c9293 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:33.723414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbaa0c-a8d8-469a-a44b-dfec279c9293 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:33.723689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbaa0c-a8d8-469a-a44b-dfec279c9293 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:33.723970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbaa0c-a8d8-469a-a44b-dfec279c9293 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/endpoints/5f47fe36a8994593859840a3582f2a15` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:33.726170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbaa0c-a8d8-469a-a44b-dfec279c9293 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=5f47fe36a8994593859840a3582f2a15)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:33.728281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbaa0c-a8d8-469a-a44b-dfec279c9293 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:33.818921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-67fbaa0c-a8d8-469a-a44b-dfec279c9293 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '5f47fe36a8994593859840a3582f2a15', 'request_id': 'req-67fbaa0c-a8d8-469a-a44b-dfec279c9293'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:33.819804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:33.834273 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3115/6211] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:33 2022] DELETE /identity/v3/endpoints/5f47fe36a8994593859840a3582f2a15 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:49:33.838129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbaa0c-a8d8-469a-a44b-dfec279c9293 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:33.904331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbaa0c-a8d8-469a-a44b-dfec279c9293 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:33.926381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb36d8d0-7924-4c57-bd44-d4ab9d60e104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41e1632d7dd94151b7129b3bc6eaa263', 'request_id': 'req-bb36d8d0-7924-4c57-bd44-d4ab9d60e104'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:34.031844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb36d8d0-7924-4c57-bd44-d4ab9d60e104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41e1632d7dd94151b7129b3bc6eaa263', 'request_id': 'req-bb36d8d0-7924-4c57-bd44-d4ab9d60e104'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:34.047427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb36d8d0-7924-4c57-bd44-d4ab9d60e104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41e1632d7dd94151b7129b3bc6eaa263', 'request_id': 'req-bb36d8d0-7924-4c57-bd44-d4ab9d60e104'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:34.052457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362fe30-b995-4f75-a588-6198e0a6fe05 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:34.053117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362fe30-b995-4f75-a588-6198e0a6fe05 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:34.053391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362fe30-b995-4f75-a588-6198e0a6fe05 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:34.054074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362fe30-b995-4f75-a588-6198e0a6fe05 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:34.054388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362fe30-b995-4f75-a588-6198e0a6fe05 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:34.058778 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-d362fe30-b995-4f75-a588-6198e0a6fe05 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:49:34.058778 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:49:34.058778 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:49:34.059686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362fe30-b995-4f75-a588-6198e0a6fe05 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:34.083861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb36d8d0-7924-4c57-bd44-d4ab9d60e104 admin admin] The token cache is being invalidate because project 41e1632d7dd94151b7129b3bc6eaa263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:34.083861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb36d8d0-7924-4c57-bd44-d4ab9d60e104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:34.084088 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3116/6212] 10.222.0.20 () {58 vars in 1134 bytes} [Thu Oct 27 03:49:33 2022] GET /identity/v3/endpoints => generated 4046 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:34.084166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bb36d8d0-7924-4c57-bd44-d4ab9d60e104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:34.084166 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3097/6213] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:33 2022] DELETE /identity/v3/projects/41e1632d7dd94151b7129b3bc6eaa263 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:49:34.091055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36d8d0-7924-4c57-bd44-d4ab9d60e104 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:34.092604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e42aa1-be7e-4bbc-982a-87f83ac683b2 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:34.092899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e42aa1-be7e-4bbc-982a-87f83ac683b2 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:34.093183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e42aa1-be7e-4bbc-982a-87f83ac683b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:34.097252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bb36d8d0-7924-4c57-bd44-d4ab9d60e104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:34.135863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36d8d0-7924-4c57-bd44-d4ab9d60e104 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:34.144507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-39e42aa1-be7e-4bbc-982a-87f83ac683b2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:34.152810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-39e42aa1-be7e-4bbc-982a-87f83ac683b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:34.153282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50d0c2-175a-4f4d-9802-c511025cf54e tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:34.153282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50d0c2-175a-4f4d-9802-c511025cf54e tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:34.153282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50d0c2-175a-4f4d-9802-c511025cf54e tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:34.153549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50d0c2-175a-4f4d-9802-c511025cf54e tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/endpoints/5f47fe36a8994593859840a3582f2a15` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:34.165740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50d0c2-175a-4f4d-9802-c511025cf54e tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:49:34.187134 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-7e50d0c2-175a-4f4d-9802-c511025cf54e tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Could not find endpoint: 5f47fe36a8994593859840a3582f2a15.: keystone.exception.EndpointNotFound: Could not find endpoint: 5f47fe36a8994593859840a3582f2a15. Oct 27 03:49:34.187134 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:49:34.187134 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Oct 27 03:49:34.187134 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Oct 27 03:49:34.187134 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 27 03:49:34.187134 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._iter().one() Oct 27 03:49:34.187134 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 27 03:49:34.187134 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._only_one_row( Oct 27 03:49:34.187134 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 27 03:49:34.187134 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 27 03:49:34.187134 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 27 03:49:34.187134 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:34.187134 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:49:34.187134 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:34.187134 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:49:34.187134 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Oct 27 03:49:34.188310 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Oct 27 03:49:34.188310 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Oct 27 03:49:34.188310 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Oct 27 03:49:34.188310 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Oct 27 03:49:34.188310 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 27 03:49:34.188310 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 5f47fe36a8994593859840a3582f2a15. Oct 27 03:49:34.188310 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:34.188310 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:49:34.188310 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:34.188310 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:49:34.188310 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:49:34.188310 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:49:34.188310 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:49:34.188310 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:49:34.188310 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:49:34.188310 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:49:34.188310 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:49:34.189413 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:49:34.189413 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:49:34.189413 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:49:34.189413 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Oct 27 03:49:34.189413 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Oct 27 03:49:34.189413 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:49:34.189413 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:49:34.189413 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:49:34.189413 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:49:34.189413 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:49:34.189413 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:49:34.189413 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:49:34.189413 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:49:34.189413 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:49:34.189413 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:49:34.189413 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:49:34.190358 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:49:34.190358 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:49:34.190358 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:49:34.190358 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:49:34.190358 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:49:34.190358 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:49:34.190358 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:49:34.190358 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:49:34.190358 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:49:34.190358 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Oct 27 03:49:34.190358 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 27 03:49:34.190358 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 5f47fe36a8994593859840a3582f2a15. Oct 27 03:49:34.190358 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:49:34.190358 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3098/6214] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:34 2022] DELETE /identity/v3/endpoints/5f47fe36a8994593859840a3582f2a15 => generated 114 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:49:34.195015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50d0c2-175a-4f4d-9802-c511025cf54e tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:34.221643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50d0c2-175a-4f4d-9802-c511025cf54e tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:34.229514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e04f2d-d1e1-45a6-b842-90367182bc3a tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:34.230209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e04f2d-d1e1-45a6-b842-90367182bc3a tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:34.230503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e04f2d-d1e1-45a6-b842-90367182bc3a tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:34.230788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e04f2d-d1e1-45a6-b842-90367182bc3a tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/regions/tempest-region-1109832632` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:34.231392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e04f2d-d1e1-45a6-b842-90367182bc3a tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1109832632)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:34.233160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e04f2d-d1e1-45a6-b842-90367182bc3a tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:34.292590 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3117/6215] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:34 2022] POST /identity/v3/auth/tokens => generated 3867 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:34.301613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6053b8e-6efa-4feb-a290-c2e003bca566 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:34.301915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6053b8e-6efa-4feb-a290-c2e003bca566 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:34.302280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6053b8e-6efa-4feb-a290-c2e003bca566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:34.344870 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3099/6216] 10.222.0.20 () {58 vars in 1209 bytes} [Thu Oct 27 03:49:34 2022] DELETE /identity/v3/regions/tempest-region-1109832632 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:34.350139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e04f2d-d1e1-45a6-b842-90367182bc3a tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:34.368327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b6053b8e-6efa-4feb-a290-c2e003bca566 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:34.370561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b6053b8e-6efa-4feb-a290-c2e003bca566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:34.431863 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3118/6217] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:34 2022] POST /identity/v3/auth/tokens => generated 3867 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:49:34.435790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6053b8e-6efa-4feb-a290-c2e003bca566 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:34.467294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e04f2d-d1e1-45a6-b842-90367182bc3a tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:34.489170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6053b8e-6efa-4feb-a290-c2e003bca566 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:34.491813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd56b1-29bd-43c2-9b31-7ad89200eafd tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:34.492504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd56b1-29bd-43c2-9b31-7ad89200eafd tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:34.492799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd56b1-29bd-43c2-9b31-7ad89200eafd tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:34.493085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd56b1-29bd-43c2-9b31-7ad89200eafd tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:34.493742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd56b1-29bd-43c2-9b31-7ad89200eafd tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:34.496081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd56b1-29bd-43c2-9b31-7ad89200eafd tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:34.514234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e53db-cc6c-44fd-8675-ff499c4f8b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:34.515187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e53db-cc6c-44fd-8675-ff499c4f8b3d admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:34.515564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e53db-cc6c-44fd-8675-ff499c4f8b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:34.515849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e53db-cc6c-44fd-8675-ff499c4f8b3d admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:34.521997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e53db-cc6c-44fd-8675-ff499c4f8b3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:49:34.522381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e53db-cc6c-44fd-8675-ff499c4f8b3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:34.528482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e53db-cc6c-44fd-8675-ff499c4f8b3d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:34.545730 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3100/6218] 10.222.0.20 () {58 vars in 1134 bytes} [Thu Oct 27 03:49:34 2022] GET /identity/v3/endpoints => generated 4046 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:34.547275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd56b1-29bd-43c2-9b31-7ad89200eafd tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:34.567781 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3119/6219] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:49:34.577076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e53db-cc6c-44fd-8675-ff499c4f8b3d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:34.583353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd56b1-29bd-43c2-9b31-7ad89200eafd tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:34.590344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab73ef0-b26c-40f3-92a6-9af662f6aa0a tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:34.590973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab73ef0-b26c-40f3-92a6-9af662f6aa0a tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:34.591258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab73ef0-b26c-40f3-92a6-9af662f6aa0a tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:34.591534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab73ef0-b26c-40f3-92a6-9af662f6aa0a tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:34.592198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab73ef0-b26c-40f3-92a6-9af662f6aa0a tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Adding query filter params (service_id=aa03c2ff95f94eec98552189d03f0328) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:49:34.592505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab73ef0-b26c-40f3-92a6-9af662f6aa0a tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:34.598098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab73ef0-b26c-40f3-92a6-9af662f6aa0a tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:34.613497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e53db-cc6c-44fd-8675-ff499c4f8b3d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:34.615168 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3101/6220] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 03:49:34 2022] GET /identity/v3/endpoints?service_id=aa03c2ff95f94eec98552189d03f0328 => generated 501 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:34.620054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab73ef0-b26c-40f3-92a6-9af662f6aa0a tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:34.627920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70bfc2-a793-4015-8f81-c0c6f096e905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:34.629654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70bfc2-a793-4015-8f81-c0c6f096e905 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:34.632285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab73ef0-b26c-40f3-92a6-9af662f6aa0a tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:34.638064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb7339-0af9-4ec3-8295-5469daa9995f tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:34.638981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb7339-0af9-4ec3-8295-5469daa9995f tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:34.639343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb7339-0af9-4ec3-8295-5469daa9995f tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:34.639695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb7339-0af9-4ec3-8295-5469daa9995f tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:34.640430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb7339-0af9-4ec3-8295-5469daa9995f tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Adding query filter params (service_id=aad6b8941bcb4949bf01707f3edf6fe4) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:49:34.640911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb7339-0af9-4ec3-8295-5469daa9995f tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:34.642710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70bfc2-a793-4015-8f81-c0c6f096e905 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:34.642839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb7339-0af9-4ec3-8295-5469daa9995f tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:34.646921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70bfc2-a793-4015-8f81-c0c6f096e905 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:34.650172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70bfc2-a793-4015-8f81-c0c6f096e905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:34.653789 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3102/6221] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 03:49:34 2022] GET /identity/v3/endpoints?service_id=aad6b8941bcb4949bf01707f3edf6fe4 => generated 502 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:49:34.654858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb7339-0af9-4ec3-8295-5469daa9995f tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:34.659820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70bfc2-a793-4015-8f81-c0c6f096e905 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:34.668432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb7339-0af9-4ec3-8295-5469daa9995f tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:34.678915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2467a-ad06-4f17-8fe4-80793c059da6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:34.679677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2467a-ad06-4f17-8fe4-80793c059da6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:34.682008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2467a-ad06-4f17-8fe4-80793c059da6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:34.682821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2467a-ad06-4f17-8fe4-80793c059da6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:34.685013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2467a-ad06-4f17-8fe4-80793c059da6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:49:34.685708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2467a-ad06-4f17-8fe4-80793c059da6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:34.693366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2467a-ad06-4f17-8fe4-80793c059da6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:34.714912 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3103/6222] 10.222.0.20 () {58 vars in 1167 bytes} [Thu Oct 27 03:49:34 2022] GET /identity/v3/endpoints?interface=public => generated 3404 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:34.715697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2467a-ad06-4f17-8fe4-80793c059da6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:34.746236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2467a-ad06-4f17-8fe4-80793c059da6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:34.767205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b8f95-944e-44e7-939e-5701809e933d tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:34.768478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b8f95-944e-44e7-939e-5701809e933d tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:34.769925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b8f95-944e-44e7-939e-5701809e933d tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:34.769925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b8f95-944e-44e7-939e-5701809e933d tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:34.772281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b8f95-944e-44e7-939e-5701809e933d tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:49:34.772743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b8f95-944e-44e7-939e-5701809e933d tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:34.776767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b8f95-944e-44e7-939e-5701809e933d tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:34.796527 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3104/6223] 10.222.0.20 () {58 vars in 1171 bytes} [Thu Oct 27 03:49:34 2022] GET /identity/v3/endpoints?interface=internal => generated 477 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:34.797937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b8f95-944e-44e7-939e-5701809e933d tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:34.816932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b8f95-944e-44e7-939e-5701809e933d tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:34.833695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed6f7a-d168-4f4f-87ed-30ae813caae8 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:34.834414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed6f7a-d168-4f4f-87ed-30ae813caae8 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:34.834711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed6f7a-d168-4f4f-87ed-30ae813caae8 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:34.834997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed6f7a-d168-4f4f-87ed-30ae813caae8 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:34.835679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed6f7a-d168-4f4f-87ed-30ae813caae8 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:34.837344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed6f7a-d168-4f4f-87ed-30ae813caae8 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:34.891449 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3120/6224] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:49:34 2022] POST /identity/v3/projects => generated 373 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:34.894060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70bfc2-a793-4015-8f81-c0c6f096e905 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:35.018954 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3105/6225] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:49:34 2022] POST /identity/v3/services => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:35.023026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed6f7a-d168-4f4f-87ed-30ae813caae8 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:35.048497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70bfc2-a793-4015-8f81-c0c6f096e905 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:35.097777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596291bb-d491-4fab-b2d3-5cfd063c074f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:35.098721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed6f7a-d168-4f4f-87ed-30ae813caae8 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:35.100512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596291bb-d491-4fab-b2d3-5cfd063c074f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:35.101269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596291bb-d491-4fab-b2d3-5cfd063c074f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:35.103419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596291bb-d491-4fab-b2d3-5cfd063c074f admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:35.104199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596291bb-d491-4fab-b2d3-5cfd063c074f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:35.114324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596291bb-d491-4fab-b2d3-5cfd063c074f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:35.125673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:35.250197 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3121/6226] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:49:34 2022] POST /identity/v3/users => generated 287 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:35.255383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596291bb-d491-4fab-b2d3-5cfd063c074f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:35.276205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e0467-9c0c-4d7a-9412-51d397596199 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:35.279776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e0467-9c0c-4d7a-9412-51d397596199 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:35.279776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e0467-9c0c-4d7a-9412-51d397596199 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:35.279776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e0467-9c0c-4d7a-9412-51d397596199 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:35.279776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e0467-9c0c-4d7a-9412-51d397596199 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:35.281754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e0467-9c0c-4d7a-9412-51d397596199 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:35.283777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596291bb-d491-4fab-b2d3-5cfd063c074f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:35.301185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c577794-d8f2-48e3-b46e-7cb77def2754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:35.301958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c577794-d8f2-48e3-b46e-7cb77def2754 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:35.302270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c577794-d8f2-48e3-b46e-7cb77def2754 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:35.302564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c577794-d8f2-48e3-b46e-7cb77def2754 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:35.303225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c577794-d8f2-48e3-b46e-7cb77def2754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:35.304905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c577794-d8f2-48e3-b46e-7cb77def2754 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:35.330599 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3122/6227] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:49:35.335316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c577794-d8f2-48e3-b46e-7cb77def2754 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:35.353493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c577794-d8f2-48e3-b46e-7cb77def2754 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:35.373763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae6be5-806b-419c-8120-9d07408886d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:35.376758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae6be5-806b-419c-8120-9d07408886d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:35.377207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae6be5-806b-419c-8120-9d07408886d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:35.377660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae6be5-806b-419c-8120-9d07408886d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:35.378507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae6be5-806b-419c-8120-9d07408886d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:35.383572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae6be5-806b-419c-8120-9d07408886d8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:35.411451 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3123/6228] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:49:35.413221 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-0e4e0467-9c0c-4d7a-9412-51d397596199 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-152537287. To ensure interoperability, identifiers should be a valid uuid. Oct 27 03:49:35.413221 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 27 03:49:35.413221 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:49:35.414386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae6be5-806b-419c-8120-9d07408886d8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:35.436558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae6be5-806b-419c-8120-9d07408886d8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:35.473450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc2baa-b38a-4578-ae07-7aaec4202840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:35.474194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc2baa-b38a-4578-ae07-7aaec4202840 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:35.474526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc2baa-b38a-4578-ae07-7aaec4202840 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:35.474747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc2baa-b38a-4578-ae07-7aaec4202840 admin admin] PATH_INFO: `/v3/projects/caa154dfd0e648999029ef7d607fc995/users/a77b3e09383c4a3c98e866bba687132f/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:35.514756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc2baa-b38a-4578-ae07-7aaec4202840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caa154dfd0e648999029ef7d607fc995, user_id=a77b3e09383c4a3c98e866bba687132f, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:35.517865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc2baa-b38a-4578-ae07-7aaec4202840 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:35.530938 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3106/6229] 10.222.0.20 () {60 vars in 1156 bytes} [Thu Oct 27 03:49:35 2022] POST /identity/v3/endpoints => generated 358 bytes in 508 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:35.534865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e0467-9c0c-4d7a-9412-51d397596199 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:35.592766 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3124/6230] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:49:35 2022] PUT /identity/v3/projects/caa154dfd0e648999029ef7d607fc995/users/a77b3e09383c4a3c98e866bba687132f/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:35.600467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e0467-9c0c-4d7a-9412-51d397596199 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:35.603542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a89f5-5e39-4c73-93d4-00c62a282283 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:35.603983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a89f5-5e39-4c73-93d4-00c62a282283 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:35.604369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a89f5-5e39-4c73-93d4-00c62a282283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:35.708898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-233a89f5-5e39-4c73-93d4-00c62a282283 None None] MFA Rules not processed for user `a77b3e09383c4a3c98e866bba687132f`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:35.715715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-233a89f5-5e39-4c73-93d4-00c62a282283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:35.844705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58a922-8e29-4195-b083-28ecfedf9bd7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:35.849384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58a922-8e29-4195-b083-28ecfedf9bd7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:35.849733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58a922-8e29-4195-b083-28ecfedf9bd7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:35.850072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58a922-8e29-4195-b083-28ecfedf9bd7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/regions/tempest-region-152537287` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:35.854969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58a922-8e29-4195-b083-28ecfedf9bd7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-152537287)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:35.857247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58a922-8e29-4195-b083-28ecfedf9bd7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:35.868153 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3107/6231] 10.222.0.20 () {58 vars in 1203 bytes} [Thu Oct 27 03:49:35 2022] GET /identity/v3/regions/tempest-region-152537287 => generated 178 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:49:35.871611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58a922-8e29-4195-b083-28ecfedf9bd7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:35.904256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58a922-8e29-4195-b083-28ecfedf9bd7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:35.922957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240f776-a33d-45c1-9051-f5e6ef29f608 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:35.923619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240f776-a33d-45c1-9051-f5e6ef29f608 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:35.923950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240f776-a33d-45c1-9051-f5e6ef29f608 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:35.930767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240f776-a33d-45c1-9051-f5e6ef29f608 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/endpoints/e88690d5b3d544afb10a694263826efe` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:35.942180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240f776-a33d-45c1-9051-f5e6ef29f608 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=e88690d5b3d544afb10a694263826efe)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:35.947321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240f776-a33d-45c1-9051-f5e6ef29f608 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:36.004479 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3125/6232] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:35 2022] POST /identity/v3/auth/tokens => generated 4193 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:49:36.091327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a89f5-5e39-4c73-93d4-00c62a282283 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:36.092776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-233a89f5-5e39-4c73-93d4-00c62a282283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:36.110051 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-b240f776-a33d-45c1-9051-f5e6ef29f608 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1403101917. To ensure interoperability, identifiers should be a valid uuid. Oct 27 03:49:36.110051 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 27 03:49:36.110051 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:49:36.133744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:36.294201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a89f5-5e39-4c73-93d4-00c62a282283 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:36.315594 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3108/6233] 10.222.0.20 () {60 vars in 1256 bytes} [Thu Oct 27 03:49:35 2022] PATCH /identity/v3/endpoints/e88690d5b3d544afb10a694263826efe => generated 363 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:36.319677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240f776-a33d-45c1-9051-f5e6ef29f608 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:36.371277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b267758-6473-400a-b7f2-b31bf06c3f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:36.372169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b267758-6473-400a-b7f2-b31bf06c3f2a service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:36.372462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b267758-6473-400a-b7f2-b31bf06c3f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:36.372747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b267758-6473-400a-b7f2-b31bf06c3f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:36.394082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240f776-a33d-45c1-9051-f5e6ef29f608 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:36.403572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b267758-6473-400a-b7f2-b31bf06c3f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:36.410965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e20f60-dd46-4c11-a2ee-2a88251435d7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:36.410965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e20f60-dd46-4c11-a2ee-2a88251435d7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:36.410965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e20f60-dd46-4c11-a2ee-2a88251435d7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:36.411403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e20f60-dd46-4c11-a2ee-2a88251435d7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/regions/tempest-region-1403101917` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:36.411482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b267758-6473-400a-b7f2-b31bf06c3f2a service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:36.411556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e20f60-dd46-4c11-a2ee-2a88251435d7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1403101917)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:36.411556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e20f60-dd46-4c11-a2ee-2a88251435d7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:36.419763 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3109/6234] 10.222.0.20 () {58 vars in 1206 bytes} [Thu Oct 27 03:49:36 2022] GET /identity/v3/regions/tempest-region-1403101917 => generated 180 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:36.422497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e20f60-dd46-4c11-a2ee-2a88251435d7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:36.453187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e20f60-dd46-4c11-a2ee-2a88251435d7 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:36.477023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d171ff1-022e-4c3c-9e40-377e6d69750c tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:36.477567 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3126/6235] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:36 2022] GET /identity/v3/auth/tokens => generated 4011 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:49:36.478533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d171ff1-022e-4c3c-9e40-377e6d69750c tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:36.479447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d171ff1-022e-4c3c-9e40-377e6d69750c tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:36.479883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d171ff1-022e-4c3c-9e40-377e6d69750c tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/endpoints/e88690d5b3d544afb10a694263826efe` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:36.487468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d171ff1-022e-4c3c-9e40-377e6d69750c tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=e88690d5b3d544afb10a694263826efe)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:36.488613 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-9d171ff1-022e-4c3c-9e40-377e6d69750c tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:49:36.488613 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:49:36.488613 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:49:36.489827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d171ff1-022e-4c3c-9e40-377e6d69750c tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:36.579026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9d171ff1-022e-4c3c-9e40-377e6d69750c tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'e88690d5b3d544afb10a694263826efe', 'request_id': 'req-9d171ff1-022e-4c3c-9e40-377e6d69750c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:36.617100 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3110/6236] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:36 2022] DELETE /identity/v3/endpoints/e88690d5b3d544afb10a694263826efe => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:36.621833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b267758-6473-400a-b7f2-b31bf06c3f2a service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:36.644946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b267758-6473-400a-b7f2-b31bf06c3f2a service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:36.712899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f58e18-44cb-455c-abca-8aebbba61208 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:36.713809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f58e18-44cb-455c-abca-8aebbba61208 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:36.714130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f58e18-44cb-455c-abca-8aebbba61208 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:36.718227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f58e18-44cb-455c-abca-8aebbba61208 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/regions/tempest-region-1403101917` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:36.718227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f58e18-44cb-455c-abca-8aebbba61208 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1403101917)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:36.719257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f58e18-44cb-455c-abca-8aebbba61208 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:36.826428 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-65f58e18-44cb-455c-abca-8aebbba61208 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1403101917. To ensure interoperability, identifiers should be a valid uuid. Oct 27 03:49:36.826428 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 27 03:49:36.826428 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:49:36.847249 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3127/6237] 10.222.0.20 () {58 vars in 1209 bytes} [Thu Oct 27 03:49:36 2022] DELETE /identity/v3/regions/tempest-region-1403101917 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:36.851659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d171ff1-022e-4c3c-9e40-377e6d69750c tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:36.868262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d171ff1-022e-4c3c-9e40-377e6d69750c tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:36.889960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41375b7e-468a-4423-a1e6-89761bf8a426 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:36.890694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41375b7e-468a-4423-a1e6-89761bf8a426 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:36.892741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41375b7e-468a-4423-a1e6-89761bf8a426 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:36.892741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41375b7e-468a-4423-a1e6-89761bf8a426 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/regions/tempest-region-152537287` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:36.892741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41375b7e-468a-4423-a1e6-89761bf8a426 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-152537287)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:36.893537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41375b7e-468a-4423-a1e6-89761bf8a426 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:37.003248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:37.011457 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3111/6238] 10.222.0.20 () {58 vars in 1206 bytes} [Thu Oct 27 03:49:36 2022] DELETE /identity/v3/regions/tempest-region-152537287 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:37.021022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f58e18-44cb-455c-abca-8aebbba61208 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:37.060704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f58e18-44cb-455c-abca-8aebbba61208 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:37.137568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845a1c7-1da9-430a-91bb-97a9ccaea371 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:37.141779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845a1c7-1da9-430a-91bb-97a9ccaea371 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:37.141779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845a1c7-1da9-430a-91bb-97a9ccaea371 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:37.141779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845a1c7-1da9-430a-91bb-97a9ccaea371 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/services/06ed2eac105b416c90e9bb7a3b6cd887` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:37.141779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d845a1c7-1da9-430a-91bb-97a9ccaea371 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:delete_service(service_id=06ed2eac105b416c90e9bb7a3b6cd887)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:37.141779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d845a1c7-1da9-430a-91bb-97a9ccaea371 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:37.404696 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3128/6239] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:37 2022] DELETE /identity/v3/services/06ed2eac105b416c90e9bb7a3b6cd887 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:37.410814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41375b7e-468a-4423-a1e6-89761bf8a426 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:37.435882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41375b7e-468a-4423-a1e6-89761bf8a426 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:37.475055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1265c1-e39d-4cfb-981d-a8b2b44bd89b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:37.475607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1265c1-e39d-4cfb-981d-a8b2b44bd89b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:37.475889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1265c1-e39d-4cfb-981d-a8b2b44bd89b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:37.476402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1265c1-e39d-4cfb-981d-a8b2b44bd89b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/endpoints/972f45b3302e4e43832e49076f2377e3` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:37.493433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1265c1-e39d-4cfb-981d-a8b2b44bd89b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=972f45b3302e4e43832e49076f2377e3)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:37.496169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1265c1-e39d-4cfb-981d-a8b2b44bd89b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:37.577985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4a1265c1-e39d-4cfb-981d-a8b2b44bd89b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '972f45b3302e4e43832e49076f2377e3', 'request_id': 'req-4a1265c1-e39d-4cfb-981d-a8b2b44bd89b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:37.599571 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3112/6240] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:37 2022] DELETE /identity/v3/endpoints/972f45b3302e4e43832e49076f2377e3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:37.603648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845a1c7-1da9-430a-91bb-97a9ccaea371 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:37.626488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845a1c7-1da9-430a-91bb-97a9ccaea371 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:37.630427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:37.648465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efc53f-7645-498c-afea-b96759f718c6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:37.649357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efc53f-7645-498c-afea-b96759f718c6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:37.649886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efc53f-7645-498c-afea-b96759f718c6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:37.650408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efc53f-7645-498c-afea-b96759f718c6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/regions/tempest-region-301895639` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:37.651805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efc53f-7645-498c-afea-b96759f718c6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-301895639)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:37.664796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efc53f-7645-498c-afea-b96759f718c6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:37.761642 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-e1efc53f-7645-498c-afea-b96759f718c6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-301895639. To ensure interoperability, identifiers should be a valid uuid. Oct 27 03:49:37.761642 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 27 03:49:37.761642 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:49:37.774482 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3129/6241] 10.222.0.20 () {58 vars in 1206 bytes} [Thu Oct 27 03:49:37 2022] DELETE /identity/v3/regions/tempest-region-301895639 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:37.775674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1265c1-e39d-4cfb-981d-a8b2b44bd89b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:37.796997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1265c1-e39d-4cfb-981d-a8b2b44bd89b tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:37.848720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd3ebf-cfc9-48c7-9f90-5bbd60827498 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:37.849578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd3ebf-cfc9-48c7-9f90-5bbd60827498 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:37.849869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd3ebf-cfc9-48c7-9f90-5bbd60827498 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:37.850218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd3ebf-cfc9-48c7-9f90-5bbd60827498 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/services/aad6b8941bcb4949bf01707f3edf6fe4` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:37.850823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd3ebf-cfc9-48c7-9f90-5bbd60827498 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:delete_service(service_id=aad6b8941bcb4949bf01707f3edf6fe4)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:37.852536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd3ebf-cfc9-48c7-9f90-5bbd60827498 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:37.970698 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3113/6242] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:37 2022] DELETE /identity/v3/services/aad6b8941bcb4949bf01707f3edf6fe4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:37.974975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efc53f-7645-498c-afea-b96759f718c6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:37.985271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:37.992477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efc53f-7645-498c-afea-b96759f718c6 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:38.043445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35480209-c44d-4a10-b383-f7d442230ba9 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:38.046565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35480209-c44d-4a10-b383-f7d442230ba9 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:38.050112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35480209-c44d-4a10-b383-f7d442230ba9 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:38.050440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35480209-c44d-4a10-b383-f7d442230ba9 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/endpoints/147e8c98a0584e01bc312014a06b9cfb` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:38.076816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35480209-c44d-4a10-b383-f7d442230ba9 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=147e8c98a0584e01bc312014a06b9cfb)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:38.078542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35480209-c44d-4a10-b383-f7d442230ba9 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:38.219768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-35480209-c44d-4a10-b383-f7d442230ba9 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '147e8c98a0584e01bc312014a06b9cfb', 'request_id': 'req-35480209-c44d-4a10-b383-f7d442230ba9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:38.243685 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3130/6243] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:37 2022] DELETE /identity/v3/endpoints/147e8c98a0584e01bc312014a06b9cfb => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:38.245036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd3ebf-cfc9-48c7-9f90-5bbd60827498 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:38.276186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd3ebf-cfc9-48c7-9f90-5bbd60827498 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:38.349668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca294a-ed43-4dba-ab3e-50f5981520e2 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:38.349668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca294a-ed43-4dba-ab3e-50f5981520e2 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:38.349668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca294a-ed43-4dba-ab3e-50f5981520e2 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:38.350285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca294a-ed43-4dba-ab3e-50f5981520e2 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/regions/tempest-region-328412362` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:38.350285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca294a-ed43-4dba-ab3e-50f5981520e2 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-328412362)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:38.351741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca294a-ed43-4dba-ab3e-50f5981520e2 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:38.465567 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3114/6244] 10.222.0.20 () {58 vars in 1206 bytes} [Thu Oct 27 03:49:38 2022] DELETE /identity/v3/regions/tempest-region-328412362 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:38.481697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35480209-c44d-4a10-b383-f7d442230ba9 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:38.506784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35480209-c44d-4a10-b383-f7d442230ba9 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:38.570597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3675367-134d-4a0b-ad94-948d4384f1a1 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d8038dbc774a6c836a84d59bdaeb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e73c7eb4a462406b833aebfc25eef5aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:38.571259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3675367-134d-4a0b-ad94-948d4384f1a1 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:38.571553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3675367-134d-4a0b-ad94-948d4384f1a1 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:38.573187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3675367-134d-4a0b-ad94-948d4384f1a1 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] PATH_INFO: `/v3/services/aa03c2ff95f94eec98552189d03f0328` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:38.574117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3675367-134d-4a0b-ad94-948d4384f1a1 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorizing `identity:delete_service(service_id=aa03c2ff95f94eec98552189d03f0328)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:38.578490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3675367-134d-4a0b-ad94-948d4384f1a1 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:38.745748 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3131/6245] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:38 2022] DELETE /identity/v3/services/aa03c2ff95f94eec98552189d03f0328 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:38.746323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca294a-ed43-4dba-ab3e-50f5981520e2 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:38.748717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ceca294a-ed43-4dba-ab3e-50f5981520e2 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:38.853402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:38.901805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca294a-ed43-4dba-ab3e-50f5981520e2 tempest-EndPointsTestJSON-308301636 tempest-EndPointsTestJSON-308301636-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:38.945358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bf887-d934-4b53-b12a-dff6aa9682ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:38.947257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bf887-d934-4b53-b12a-dff6aa9682ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:38.951683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bf887-d934-4b53-b12a-dff6aa9682ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:38.951683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bf887-d934-4b53-b12a-dff6aa9682ec admin admin] PATH_INFO: `/v3/users/63f6d445ec84459bab7e81410675282c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:38.951914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bf887-d934-4b53-b12a-dff6aa9682ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=63f6d445ec84459bab7e81410675282c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:38.957161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bf887-d934-4b53-b12a-dff6aa9682ec admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:39.167864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:39.281924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a01bf887-d934-4b53-b12a-dff6aa9682ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63f6d445ec84459bab7e81410675282c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:39.290522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a01bf887-d934-4b53-b12a-dff6aa9682ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63f6d445ec84459bab7e81410675282c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:39.309722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a01bf887-d934-4b53-b12a-dff6aa9682ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63f6d445ec84459bab7e81410675282c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:39.330324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a01bf887-d934-4b53-b12a-dff6aa9682ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63f6d445ec84459bab7e81410675282c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:39.423906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a01bf887-d934-4b53-b12a-dff6aa9682ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63f6d445ec84459bab7e81410675282c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:39.433284 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3115/6246] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:49:38 2022] DELETE /identity/v3/users/63f6d445ec84459bab7e81410675282c => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:39.437668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fb802-e347-4a75-b90e-dfa9c3814002 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:39.438195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fb802-e347-4a75-b90e-dfa9c3814002 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:39.439352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fb802-e347-4a75-b90e-dfa9c3814002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:39.500125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-252fb802-e347-4a75-b90e-dfa9c3814002 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:39.510016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-252fb802-e347-4a75-b90e-dfa9c3814002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:39.698666 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3132/6247] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:49:39.727489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bf887-d934-4b53-b12a-dff6aa9682ec admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:39.736115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a01bf887-d934-4b53-b12a-dff6aa9682ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:40.009227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bf887-d934-4b53-b12a-dff6aa9682ec admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:40.018951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb72d2-c49b-42f7-829e-fc3313911346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:40.020146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb72d2-c49b-42f7-829e-fc3313911346 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:40.020518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb72d2-c49b-42f7-829e-fc3313911346 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:40.020807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb72d2-c49b-42f7-829e-fc3313911346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:40.065627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb72d2-c49b-42f7-829e-fc3313911346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:40.068328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb72d2-c49b-42f7-829e-fc3313911346 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:40.098676 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3116/6248] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:49:40.722466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=83,keystone:DELETE=12,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:40.981434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:41.662138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fb802-e347-4a75-b90e-dfa9c3814002 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:41.665107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-252fb802-e347-4a75-b90e-dfa9c3814002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:41.693479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fb802-e347-4a75-b90e-dfa9c3814002 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:41.708316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6478eb-03c3-41fa-ac1a-90db5f52ed33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:41.711814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6478eb-03c3-41fa-ac1a-90db5f52ed33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:41.712119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6478eb-03c3-41fa-ac1a-90db5f52ed33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:41.725866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6478eb-03c3-41fa-ac1a-90db5f52ed33 admin admin] PATH_INFO: `/v3/users/3d3608a7972c410d84a8559778b133f2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:41.727287 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6478eb-03c3-41fa-ac1a-90db5f52ed33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d3608a7972c410d84a8559778b133f2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:41.729297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6478eb-03c3-41fa-ac1a-90db5f52ed33 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:41.974087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8d6478eb-03c3-41fa-ac1a-90db5f52ed33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d3608a7972c410d84a8559778b133f2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:41.975073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8d6478eb-03c3-41fa-ac1a-90db5f52ed33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d3608a7972c410d84a8559778b133f2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:41.995378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8d6478eb-03c3-41fa-ac1a-90db5f52ed33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d3608a7972c410d84a8559778b133f2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:42.029577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8d6478eb-03c3-41fa-ac1a-90db5f52ed33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d3608a7972c410d84a8559778b133f2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:42.030667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8d6478eb-03c3-41fa-ac1a-90db5f52ed33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d3608a7972c410d84a8559778b133f2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:42.045023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb72d2-c49b-42f7-829e-fc3313911346 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:42.047055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-67cb72d2-c49b-42f7-829e-fc3313911346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:42.067943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb72d2-c49b-42f7-829e-fc3313911346 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:42.085330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3aecd-ffd1-4d11-a26d-42de47fe4707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:42.086903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3aecd-ffd1-4d11-a26d-42de47fe4707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:42.087197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3aecd-ffd1-4d11-a26d-42de47fe4707 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:42.087484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3aecd-ffd1-4d11-a26d-42de47fe4707 admin admin] PATH_INFO: `/v3/users/b528053f80b247b8b917b970f9e950de` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:42.090252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3aecd-ffd1-4d11-a26d-42de47fe4707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b528053f80b247b8b917b970f9e950de)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:42.094380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3aecd-ffd1-4d11-a26d-42de47fe4707 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:42.182586 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3133/6249] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:49:41 2022] DELETE /identity/v3/users/3d3608a7972c410d84a8559778b133f2 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:42.182586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6478eb-03c3-41fa-ac1a-90db5f52ed33 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:42.182896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8d6478eb-03c3-41fa-ac1a-90db5f52ed33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:42.340222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:42.366776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-70b3aecd-ffd1-4d11-a26d-42de47fe4707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b528053f80b247b8b917b970f9e950de'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:42.366776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-70b3aecd-ffd1-4d11-a26d-42de47fe4707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b528053f80b247b8b917b970f9e950de'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:42.367118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6478eb-03c3-41fa-ac1a-90db5f52ed33 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:42.388981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787263c-38f7-497c-bce5-30722ceb1f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:42.389575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787263c-38f7-497c-bce5-30722ceb1f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:42.389855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787263c-38f7-497c-bce5-30722ceb1f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:42.395622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-70b3aecd-ffd1-4d11-a26d-42de47fe4707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b528053f80b247b8b917b970f9e950de'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:42.396649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787263c-38f7-497c-bce5-30722ceb1f8a admin admin] PATH_INFO: `/v3/projects/be5419b79d774f6197809c506438ff89` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:42.400075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787263c-38f7-497c-bce5-30722ceb1f8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=be5419b79d774f6197809c506438ff89)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:42.413366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787263c-38f7-497c-bce5-30722ceb1f8a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:42.451103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-70b3aecd-ffd1-4d11-a26d-42de47fe4707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b528053f80b247b8b917b970f9e950de'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:42.558554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-70b3aecd-ffd1-4d11-a26d-42de47fe4707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b528053f80b247b8b917b970f9e950de'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:42.584649 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3117/6250] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:49:42 2022] DELETE /identity/v3/users/b528053f80b247b8b917b970f9e950de => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:42.586257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712a752-5f8d-4173-8cde-372695bde37a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:42.586582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712a752-5f8d-4173-8cde-372695bde37a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:42.586863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712a752-5f8d-4173-8cde-372695bde37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:42.616173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4787263c-38f7-497c-bce5-30722ceb1f8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be5419b79d774f6197809c506438ff89', 'request_id': 'req-4787263c-38f7-497c-bce5-30722ceb1f8a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:42.639123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4787263c-38f7-497c-bce5-30722ceb1f8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be5419b79d774f6197809c506438ff89', 'request_id': 'req-4787263c-38f7-497c-bce5-30722ceb1f8a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:42.657118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6712a752-5f8d-4173-8cde-372695bde37a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:42.657118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6712a752-5f8d-4173-8cde-372695bde37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:42.660737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4787263c-38f7-497c-bce5-30722ceb1f8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be5419b79d774f6197809c506438ff89', 'request_id': 'req-4787263c-38f7-497c-bce5-30722ceb1f8a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:42.824451 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3118/6251] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:42.826422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8af88b-2275-41d2-bb60-db2ff8c2d2ab None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:42.842416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8af88b-2275-41d2-bb60-db2ff8c2d2ab None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:42.843071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8af88b-2275-41d2-bb60-db2ff8c2d2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:42.853372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4787263c-38f7-497c-bce5-30722ceb1f8a admin admin] The token cache is being invalidate because project be5419b79d774f6197809c506438ff89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:42.857483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4787263c-38f7-497c-bce5-30722ceb1f8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:42.858105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4787263c-38f7-497c-bce5-30722ceb1f8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:42.861632 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3134/6252] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:42 2022] DELETE /identity/v3/projects/be5419b79d774f6197809c506438ff89 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:42.862762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787263c-38f7-497c-bce5-30722ceb1f8a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:42.867421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4787263c-38f7-497c-bce5-30722ceb1f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:42.872852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8f8af88b-2275-41d2-bb60-db2ff8c2d2ab None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:42.875022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8f8af88b-2275-41d2-bb60-db2ff8c2d2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:42.889444 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3119/6253] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:42.895141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8af88b-2275-41d2-bb60-db2ff8c2d2ab None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:42.896870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8f8af88b-2275-41d2-bb60-db2ff8c2d2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:42.914202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8af88b-2275-41d2-bb60-db2ff8c2d2ab None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:42.933396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a670c-70b9-4be9-9000-3a56a9757a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:42.934922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a670c-70b9-4be9-9000-3a56a9757a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:42.935291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a670c-70b9-4be9-9000-3a56a9757a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:42.935646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a670c-70b9-4be9-9000-3a56a9757a59 admin admin] PATH_INFO: `/v3/users/88d8038dbc774a6c836a84d59bdaeb43` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:42.937251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a670c-70b9-4be9-9000-3a56a9757a59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88d8038dbc774a6c836a84d59bdaeb43)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:42.941018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a670c-70b9-4be9-9000-3a56a9757a59 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:42.986276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:43.001992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:43.094516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787263c-38f7-497c-bce5-30722ceb1f8a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:43.211452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f84a670c-70b9-4be9-9000-3a56a9757a59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88d8038dbc774a6c836a84d59bdaeb43'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:43.215198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f84a670c-70b9-4be9-9000-3a56a9757a59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88d8038dbc774a6c836a84d59bdaeb43'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:43.269646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f84a670c-70b9-4be9-9000-3a56a9757a59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88d8038dbc774a6c836a84d59bdaeb43'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:43.311161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f84a670c-70b9-4be9-9000-3a56a9757a59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88d8038dbc774a6c836a84d59bdaeb43'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:43.332554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c4ac8-34d8-44c8-b2c1-5e660896a1e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:43.333114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c4ac8-34d8-44c8-b2c1-5e660896a1e5 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:43.333602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c4ac8-34d8-44c8-b2c1-5e660896a1e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:43.333890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c4ac8-34d8-44c8-b2c1-5e660896a1e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:43.346228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-463c4ac8-34d8-44c8-b2c1-5e660896a1e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:43.408729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c4ac8-34d8-44c8-b2c1-5e660896a1e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:43.413087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c4ac8-34d8-44c8-b2c1-5e660896a1e5 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:43.427380 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3135/6254] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:49:43.442500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c4ac8-34d8-44c8-b2c1-5e660896a1e5 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:43.448656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f84a670c-70b9-4be9-9000-3a56a9757a59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88d8038dbc774a6c836a84d59bdaeb43'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:43.459437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-463c4ac8-34d8-44c8-b2c1-5e660896a1e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:43.461143 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3120/6255] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:49:42 2022] DELETE /identity/v3/users/88d8038dbc774a6c836a84d59bdaeb43 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:43.517817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c4ac8-34d8-44c8-b2c1-5e660896a1e5 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:43.712049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d92dc8-9b3f-4ef6-8b2d-2f31aba349cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:43.718625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d92dc8-9b3f-4ef6-8b2d-2f31aba349cc service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:43.719159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d92dc8-9b3f-4ef6-8b2d-2f31aba349cc service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:43.719593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d92dc8-9b3f-4ef6-8b2d-2f31aba349cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:43.723533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-28d92dc8-9b3f-4ef6-8b2d-2f31aba349cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:43.879267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d92dc8-9b3f-4ef6-8b2d-2f31aba349cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:43.881325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d92dc8-9b3f-4ef6-8b2d-2f31aba349cc service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:43.908820 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3136/6256] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:49:44.219404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:44.265277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:44.956713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:45.013426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:45.122163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a670c-70b9-4be9-9000-3a56a9757a59 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:45.123929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f84a670c-70b9-4be9-9000-3a56a9757a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:45.159112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a670c-70b9-4be9-9000-3a56a9757a59 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:45.172814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b569e-fed8-4eb5-a704-2d5fc6ee4ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:45.173781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b569e-fed8-4eb5-a704-2d5fc6ee4ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:45.174311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b569e-fed8-4eb5-a704-2d5fc6ee4ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:45.175406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b569e-fed8-4eb5-a704-2d5fc6ee4ee0 admin admin] PATH_INFO: `/v3/projects/e73c7eb4a462406b833aebfc25eef5aa` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:45.179754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b569e-fed8-4eb5-a704-2d5fc6ee4ee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e73c7eb4a462406b833aebfc25eef5aa)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:45.206274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b569e-fed8-4eb5-a704-2d5fc6ee4ee0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:45.221879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d92dc8-9b3f-4ef6-8b2d-2f31aba349cc service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:45.222359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-28d92dc8-9b3f-4ef6-8b2d-2f31aba349cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:45.248972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d92dc8-9b3f-4ef6-8b2d-2f31aba349cc service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:45.269662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14c481-b426-4413-95e9-9129f5d751f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:45.271643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14c481-b426-4413-95e9-9129f5d751f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:45.271938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14c481-b426-4413-95e9-9129f5d751f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:45.272273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14c481-b426-4413-95e9-9129f5d751f0 admin admin] PATH_INFO: `/v3/projects/83dd283857b445bf80d065afc1c8c7b4` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:45.278651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14c481-b426-4413-95e9-9129f5d751f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83dd283857b445bf80d065afc1c8c7b4)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:45.285008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14c481-b426-4413-95e9-9129f5d751f0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:45.418366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9c5b569e-fed8-4eb5-a704-2d5fc6ee4ee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e73c7eb4a462406b833aebfc25eef5aa', 'request_id': 'req-9c5b569e-fed8-4eb5-a704-2d5fc6ee4ee0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:45.502883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9c5b569e-fed8-4eb5-a704-2d5fc6ee4ee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e73c7eb4a462406b833aebfc25eef5aa', 'request_id': 'req-9c5b569e-fed8-4eb5-a704-2d5fc6ee4ee0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:45.532825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9c5b569e-fed8-4eb5-a704-2d5fc6ee4ee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e73c7eb4a462406b833aebfc25eef5aa', 'request_id': 'req-9c5b569e-fed8-4eb5-a704-2d5fc6ee4ee0'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:45.536841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ce14c481-b426-4413-95e9-9129f5d751f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83dd283857b445bf80d065afc1c8c7b4', 'request_id': 'req-ce14c481-b426-4413-95e9-9129f5d751f0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:45.569437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ce14c481-b426-4413-95e9-9129f5d751f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83dd283857b445bf80d065afc1c8c7b4', 'request_id': 'req-ce14c481-b426-4413-95e9-9129f5d751f0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:45.579893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9c5b569e-fed8-4eb5-a704-2d5fc6ee4ee0 admin admin] The token cache is being invalidate because project e73c7eb4a462406b833aebfc25eef5aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:45.580187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9c5b569e-fed8-4eb5-a704-2d5fc6ee4ee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:45.586201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9c5b569e-fed8-4eb5-a704-2d5fc6ee4ee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:45.592881 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3121/6257] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:45 2022] DELETE /identity/v3/projects/e73c7eb4a462406b833aebfc25eef5aa => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:45.595642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b569e-fed8-4eb5-a704-2d5fc6ee4ee0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:45.596837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ce14c481-b426-4413-95e9-9129f5d751f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83dd283857b445bf80d065afc1c8c7b4', 'request_id': 'req-ce14c481-b426-4413-95e9-9129f5d751f0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:45.603329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9c5b569e-fed8-4eb5-a704-2d5fc6ee4ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:45.679530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ce14c481-b426-4413-95e9-9129f5d751f0 admin admin] The token cache is being invalidate because project 83dd283857b445bf80d065afc1c8c7b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:45.679836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ce14c481-b426-4413-95e9-9129f5d751f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:45.681083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ce14c481-b426-4413-95e9-9129f5d751f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:45.689806 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3137/6258] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:45 2022] DELETE /identity/v3/projects/83dd283857b445bf80d065afc1c8c7b4 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:45.689806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f73fa-134e-4032-9a6e-1bbef06753c4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:45.689806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f73fa-134e-4032-9a6e-1bbef06753c4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:45.689806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f73fa-134e-4032-9a6e-1bbef06753c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:45.747422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e58f73fa-134e-4032-9a6e-1bbef06753c4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:45.748857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e58f73fa-134e-4032-9a6e-1bbef06753c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:45.844195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b569e-fed8-4eb5-a704-2d5fc6ee4ee0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:45.940850 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3138/6259] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:45.942947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aef750-98f6-4ae7-b780-f3e3e3f63ba4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:45.943389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aef750-98f6-4ae7-b780-f3e3e3f63ba4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:45.943801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aef750-98f6-4ae7-b780-f3e3e3f63ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:45.969357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-71aef750-98f6-4ae7-b780-f3e3e3f63ba4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:45.970930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-71aef750-98f6-4ae7-b780-f3e3e3f63ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:45.980181 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3139/6260] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:45.989295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd8de7-0c25-42ee-a39b-1392beea183d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:45.995128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:45.996390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd8de7-0c25-42ee-a39b-1392beea183d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:45.996871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd8de7-0c25-42ee-a39b-1392beea183d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:46.039580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876602d-fbf2-4f31-9835-471577652e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:46.041397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876602d-fbf2-4f31-9835-471577652e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:46.041683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876602d-fbf2-4f31-9835-471577652e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:46.041955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876602d-fbf2-4f31-9835-471577652e62 admin admin] PATH_INFO: `/v3/projects/ffaacfdebc2a4107b95fd1cdcca28a4e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:46.043401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876602d-fbf2-4f31-9835-471577652e62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffaacfdebc2a4107b95fd1cdcca28a4e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:46.046052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876602d-fbf2-4f31-9835-471577652e62 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:46.056586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-31dd8de7-0c25-42ee-a39b-1392beea183d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:46.057853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-31dd8de7-0c25-42ee-a39b-1392beea183d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:46.073236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:46.082423 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3140/6261] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:46.083714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f94173-22a7-4f4f-a045-8822138d653c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:46.083999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f94173-22a7-4f4f-a045-8822138d653c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:46.084272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f94173-22a7-4f4f-a045-8822138d653c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:46.131387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-82f94173-22a7-4f4f-a045-8822138d653c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:46.135886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-82f94173-22a7-4f4f-a045-8822138d653c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:46.159576 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3141/6262] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:46.178193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f94173-22a7-4f4f-a045-8822138d653c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:46.198310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f94173-22a7-4f4f-a045-8822138d653c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:46.227880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4cd324-5dff-4cc3-b6f2-52d7fc8ec205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:46.228556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cd324-5dff-4cc3-b6f2-52d7fc8ec205 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:46.238201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cd324-5dff-4cc3-b6f2-52d7fc8ec205 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:46.238570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cd324-5dff-4cc3-b6f2-52d7fc8ec205 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:46.239290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4cd324-5dff-4cc3-b6f2-52d7fc8ec205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:49:46.239604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4cd324-5dff-4cc3-b6f2-52d7fc8ec205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:46.250804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4cd324-5dff-4cc3-b6f2-52d7fc8ec205 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:46.254152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e876602d-fbf2-4f31-9835-471577652e62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffaacfdebc2a4107b95fd1cdcca28a4e', 'request_id': 'req-e876602d-fbf2-4f31-9835-471577652e62'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:46.289322 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3142/6263] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:46.297659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4cd324-5dff-4cc3-b6f2-52d7fc8ec205 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:46.335430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4cd324-5dff-4cc3-b6f2-52d7fc8ec205 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:46.338935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e876602d-fbf2-4f31-9835-471577652e62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffaacfdebc2a4107b95fd1cdcca28a4e', 'request_id': 'req-e876602d-fbf2-4f31-9835-471577652e62'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:46.350944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e876602d-fbf2-4f31-9835-471577652e62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffaacfdebc2a4107b95fd1cdcca28a4e', 'request_id': 'req-e876602d-fbf2-4f31-9835-471577652e62'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:46.394832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e876602d-fbf2-4f31-9835-471577652e62 admin admin] The token cache is being invalidate because project ffaacfdebc2a4107b95fd1cdcca28a4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:46.394832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e876602d-fbf2-4f31-9835-471577652e62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:46.395542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e876602d-fbf2-4f31-9835-471577652e62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:46.401072 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3122/6264] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:45 2022] DELETE /identity/v3/projects/ffaacfdebc2a4107b95fd1cdcca28a4e => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:46.402648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876602d-fbf2-4f31-9835-471577652e62 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:46.409577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e876602d-fbf2-4f31-9835-471577652e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:46.524891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edb9cd-cf71-4ece-88c8-daa7c4e053ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:46.525563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edb9cd-cf71-4ece-88c8-daa7c4e053ca admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:46.525860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edb9cd-cf71-4ece-88c8-daa7c4e053ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:46.526986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edb9cd-cf71-4ece-88c8-daa7c4e053ca admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:46.527943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edb9cd-cf71-4ece-88c8-daa7c4e053ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:49:46.531890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edb9cd-cf71-4ece-88c8-daa7c4e053ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:46.536931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edb9cd-cf71-4ece-88c8-daa7c4e053ca admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:46.580034 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3143/6265] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:46.584139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edb9cd-cf71-4ece-88c8-daa7c4e053ca admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:46.589453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-70edb9cd-cf71-4ece-88c8-daa7c4e053ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:46.620022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876602d-fbf2-4f31-9835-471577652e62 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:46.627110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edb9cd-cf71-4ece-88c8-daa7c4e053ca admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:46.635943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e40daa-6284-404c-b92f-4f05aa3289d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:46.636785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361481d-2986-498c-80c7-df6d5de6f7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:46.637454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361481d-2986-498c-80c7-df6d5de6f7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:46.638688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e40daa-6284-404c-b92f-4f05aa3289d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:46.638969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e40daa-6284-404c-b92f-4f05aa3289d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:46.639247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e40daa-6284-404c-b92f-4f05aa3289d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:46.639854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361481d-2986-498c-80c7-df6d5de6f7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:46.640205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361481d-2986-498c-80c7-df6d5de6f7a7 admin admin] PATH_INFO: `/v3/users/36af0ddba9884e3abf8421c3f70f8beb` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:46.641359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e40daa-6284-404c-b92f-4f05aa3289d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:46.642892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361481d-2986-498c-80c7-df6d5de6f7a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36af0ddba9884e3abf8421c3f70f8beb)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:46.645818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e40daa-6284-404c-b92f-4f05aa3289d8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:46.648531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361481d-2986-498c-80c7-df6d5de6f7a7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:46.847850 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3123/6266] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:49:46 2022] POST /identity/v3/projects => generated 389 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:46.847850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e40daa-6284-404c-b92f-4f05aa3289d8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:46.851499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-88e40daa-6284-404c-b92f-4f05aa3289d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:46.990369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:47.048418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e40daa-6284-404c-b92f-4f05aa3289d8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:47.065382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774f9ef-02d4-43ef-9a7c-730f59dae09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:47.066917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774f9ef-02d4-43ef-9a7c-730f59dae09e admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:47.067365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774f9ef-02d4-43ef-9a7c-730f59dae09e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:47.067795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774f9ef-02d4-43ef-9a7c-730f59dae09e admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:47.068745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774f9ef-02d4-43ef-9a7c-730f59dae09e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:47.073530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774f9ef-02d4-43ef-9a7c-730f59dae09e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:47.077622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6361481d-2986-498c-80c7-df6d5de6f7a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36af0ddba9884e3abf8421c3f70f8beb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:47.086704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6361481d-2986-498c-80c7-df6d5de6f7a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36af0ddba9884e3abf8421c3f70f8beb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:47.131653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6361481d-2986-498c-80c7-df6d5de6f7a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36af0ddba9884e3abf8421c3f70f8beb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:47.151946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:47.196063 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3124/6267] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:49:46 2022] POST /identity/v3/projects => generated 357 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:47.196063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774f9ef-02d4-43ef-9a7c-730f59dae09e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:47.197244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9774f9ef-02d4-43ef-9a7c-730f59dae09e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:47.224497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6361481d-2986-498c-80c7-df6d5de6f7a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36af0ddba9884e3abf8421c3f70f8beb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:47.225269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6361481d-2986-498c-80c7-df6d5de6f7a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36af0ddba9884e3abf8421c3f70f8beb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:47.345640 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3144/6268] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:49:46 2022] DELETE /identity/v3/users/36af0ddba9884e3abf8421c3f70f8beb => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:47.360933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361481d-2986-498c-80c7-df6d5de6f7a7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:47.367614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6361481d-2986-498c-80c7-df6d5de6f7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:47.392454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774f9ef-02d4-43ef-9a7c-730f59dae09e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:47.436687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:47.544484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:47.567753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5397ad-f2cb-4561-b9b2-55f58ce41738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:47.568783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5397ad-f2cb-4561-b9b2-55f58ce41738 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:47.569219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5397ad-f2cb-4561-b9b2-55f58ce41738 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:47.569670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5397ad-f2cb-4561-b9b2-55f58ce41738 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:47.570676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5397ad-f2cb-4561-b9b2-55f58ce41738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:47.576951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:47.578378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5397ad-f2cb-4561-b9b2-55f58ce41738 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:47.669811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361481d-2986-498c-80c7-df6d5de6f7a7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:47.687945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399cfaf-0cc3-4812-9e99-faabc089fbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:47.688757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399cfaf-0cc3-4812-9e99-faabc089fbaa admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:47.689043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399cfaf-0cc3-4812-9e99-faabc089fbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:47.689324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399cfaf-0cc3-4812-9e99-faabc089fbaa admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:47.689956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399cfaf-0cc3-4812-9e99-faabc089fbaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:47.693115 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3125/6269] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:49:47 2022] POST /identity/v3/users => generated 295 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:47.695870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5397ad-f2cb-4561-b9b2-55f58ce41738 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:47.700423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399cfaf-0cc3-4812-9e99-faabc089fbaa admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:47.716358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5397ad-f2cb-4561-b9b2-55f58ce41738 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:47.732101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb9c59-a165-467e-80b1-731ca6760bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:47.732749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb9c59-a165-467e-80b1-731ca6760bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:47.733033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb9c59-a165-467e-80b1-731ca6760bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:47.733310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb9c59-a165-467e-80b1-731ca6760bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:47.733973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb9c59-a165-467e-80b1-731ca6760bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:47.740028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb9c59-a165-467e-80b1-731ca6760bb2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:47.772178 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3126/6270] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:49:47.773429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb9c59-a165-467e-80b1-731ca6760bb2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:47.799095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb9c59-a165-467e-80b1-731ca6760bb2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:47.812147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2bbbc-6fb1-4dde-ad49-9a9d445cddcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:47.812794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2bbbc-6fb1-4dde-ad49-9a9d445cddcd admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:47.813530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2bbbc-6fb1-4dde-ad49-9a9d445cddcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:47.813824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2bbbc-6fb1-4dde-ad49-9a9d445cddcd admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:47.814523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2bbbc-6fb1-4dde-ad49-9a9d445cddcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:47.820016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2bbbc-6fb1-4dde-ad49-9a9d445cddcd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:47.836896 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3145/6271] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:49:47 2022] POST /identity/v3/users => generated 279 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:47.843764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:47.845364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399cfaf-0cc3-4812-9e99-faabc089fbaa admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:47.854234 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3127/6272] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:47.859624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2bbbc-6fb1-4dde-ad49-9a9d445cddcd admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:47.870477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399cfaf-0cc3-4812-9e99-faabc089fbaa admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:47.889258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:47.906487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2bbbc-6fb1-4dde-ad49-9a9d445cddcd admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:47.906651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802e233-da6d-4dbe-beea-723409e7d3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:47.911035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802e233-da6d-4dbe-beea-723409e7d3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:47.911393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802e233-da6d-4dbe-beea-723409e7d3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:47.911912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802e233-da6d-4dbe-beea-723409e7d3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:47.912694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802e233-da6d-4dbe-beea-723409e7d3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:47.922022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802e233-da6d-4dbe-beea-723409e7d3e2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:47.925842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e87ac-bd8b-44ed-a171-425ad6d310d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:47.926583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e87ac-bd8b-44ed-a171-425ad6d310d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:47.926868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e87ac-bd8b-44ed-a171-425ad6d310d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:47.929409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e87ac-bd8b-44ed-a171-425ad6d310d0 admin admin] PATH_INFO: `/v3/projects/f936f25a3d4c4a26be3b5fb1fd9aaf28/users/e4aaa78f685c4f1081b43e79c988e5df/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:47.953704 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3146/6273] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:49:47.957480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802e233-da6d-4dbe-beea-723409e7d3e2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:47.981958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802e233-da6d-4dbe-beea-723409e7d3e2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:47.985632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e87ac-bd8b-44ed-a171-425ad6d310d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f936f25a3d4c4a26be3b5fb1fd9aaf28, user_id=e4aaa78f685c4f1081b43e79c988e5df, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:47.993205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e87ac-bd8b-44ed-a171-425ad6d310d0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:48.002173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4beff4a-d202-48a7-b366-051952658542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:48.003139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4beff4a-d202-48a7-b366-051952658542 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:48.003591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4beff4a-d202-48a7-b366-051952658542 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:48.004020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4beff4a-d202-48a7-b366-051952658542 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:48.004827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4beff4a-d202-48a7-b366-051952658542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:48.007232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4beff4a-d202-48a7-b366-051952658542 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:48.030618 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3147/6274] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:48.034654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4beff4a-d202-48a7-b366-051952658542 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:48.065012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4beff4a-d202-48a7-b366-051952658542 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:48.077195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ebf5e-b943-4c02-8a52-5c30160b71bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:48.078602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ebf5e-b943-4c02-8a52-5c30160b71bb admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:48.079072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ebf5e-b943-4c02-8a52-5c30160b71bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:48.082755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ebf5e-b943-4c02-8a52-5c30160b71bb admin admin] PATH_INFO: `/v3/projects/aa5ae1020e4f4b70bb89f91c20337c1f/users/1453ccdc45fb408fae28f60d10cf7a3d/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:48.114448 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3128/6275] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:49:47 2022] PUT /identity/v3/projects/f936f25a3d4c4a26be3b5fb1fd9aaf28/users/e4aaa78f685c4f1081b43e79c988e5df/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:48.118140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ebf5e-b943-4c02-8a52-5c30160b71bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa5ae1020e4f4b70bb89f91c20337c1f, user_id=1453ccdc45fb408fae28f60d10cf7a3d, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:48.124999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ebf5e-b943-4c02-8a52-5c30160b71bb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:48.125376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3b311-f38d-4ba1-b574-2464063e606e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:48.125947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3b311-f38d-4ba1-b574-2464063e606e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:48.126283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3b311-f38d-4ba1-b574-2464063e606e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:48.134952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:48.213840 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3148/6276] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:49:48 2022] PUT /identity/v3/projects/aa5ae1020e4f4b70bb89f91c20337c1f/users/1453ccdc45fb408fae28f60d10cf7a3d/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:49:48.247448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ffeba-2d1e-47f8-91e8-84211c48de15 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:48.250880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ffeba-2d1e-47f8-91e8-84211c48de15 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:48.251327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ffeba-2d1e-47f8-91e8-84211c48de15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:48.269814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ade3b311-f38d-4ba1-b574-2464063e606e None None] MFA Rules not processed for user `e4aaa78f685c4f1081b43e79c988e5df`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:48.273109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ade3b311-f38d-4ba1-b574-2464063e606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:48.339989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:48.381555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-561ffeba-2d1e-47f8-91e8-84211c48de15 None None] MFA Rules not processed for user `1453ccdc45fb408fae28f60d10cf7a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:48.386930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-561ffeba-2d1e-47f8-91e8-84211c48de15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:48.548027 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3129/6277] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:49:48.552090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3b311-f38d-4ba1-b574-2464063e606e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:48.555089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ade3b311-f38d-4ba1-b574-2464063e606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:48.606544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:48.627453 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3149/6278] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:48.628756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ffeba-2d1e-47f8-91e8-84211c48de15 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:48.729465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3b311-f38d-4ba1-b574-2464063e606e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:48.749210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b206a-e205-4c73-9e2d-e8c5f037ff89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:48.749895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b206a-e205-4c73-9e2d-e8c5f037ff89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:48.750210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b206a-e205-4c73-9e2d-e8c5f037ff89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:48.750493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b206a-e205-4c73-9e2d-e8c5f037ff89 admin admin] PATH_INFO: `/v3/projects/e3ae57db6ee14a0891d6c88bc058716f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:48.752591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b206a-e205-4c73-9e2d-e8c5f037ff89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ae57db6ee14a0891d6c88bc058716f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:48.754708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b206a-e205-4c73-9e2d-e8c5f037ff89 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:48.788333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ffeba-2d1e-47f8-91e8-84211c48de15 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:48.796414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:48.801053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc67681-ab06-4ece-9c0c-1ac1c7282760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:48.801904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc67681-ab06-4ece-9c0c-1ac1c7282760 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:48.803558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc67681-ab06-4ece-9c0c-1ac1c7282760 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:48.806623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc67681-ab06-4ece-9c0c-1ac1c7282760 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:48.807911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc67681-ab06-4ece-9c0c-1ac1c7282760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:48.812207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc67681-ab06-4ece-9c0c-1ac1c7282760 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:48.938212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-408b206a-e205-4c73-9e2d-e8c5f037ff89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ae57db6ee14a0891d6c88bc058716f', 'request_id': 'req-408b206a-e205-4c73-9e2d-e8c5f037ff89'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:48.956202 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3150/6279] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:49:48 2022] POST /identity/v3/projects => generated 387 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:48.956202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc67681-ab06-4ece-9c0c-1ac1c7282760 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:49.053613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:49.081447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-408b206a-e205-4c73-9e2d-e8c5f037ff89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ae57db6ee14a0891d6c88bc058716f', 'request_id': 'req-408b206a-e205-4c73-9e2d-e8c5f037ff89'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:49.093934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-408b206a-e205-4c73-9e2d-e8c5f037ff89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ae57db6ee14a0891d6c88bc058716f', 'request_id': 'req-408b206a-e205-4c73-9e2d-e8c5f037ff89'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:49.137756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc67681-ab06-4ece-9c0c-1ac1c7282760 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:49.141119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-408b206a-e205-4c73-9e2d-e8c5f037ff89 admin admin] The token cache is being invalidate because project e3ae57db6ee14a0891d6c88bc058716f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:49.143087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-408b206a-e205-4c73-9e2d-e8c5f037ff89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:49.147034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-408b206a-e205-4c73-9e2d-e8c5f037ff89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:49.151355 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3130/6280] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:48 2022] DELETE /identity/v3/projects/e3ae57db6ee14a0891d6c88bc058716f => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:49.152252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b206a-e205-4c73-9e2d-e8c5f037ff89 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:49.154938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-408b206a-e205-4c73-9e2d-e8c5f037ff89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:49.157443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94021ca9-6c5c-426b-a605-bc2fa40df461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:49.162883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94021ca9-6c5c-426b-a605-bc2fa40df461 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:49.162883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94021ca9-6c5c-426b-a605-bc2fa40df461 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:49.162883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94021ca9-6c5c-426b-a605-bc2fa40df461 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:49.162883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94021ca9-6c5c-426b-a605-bc2fa40df461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:49.167848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94021ca9-6c5c-426b-a605-bc2fa40df461 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:49.351003 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3151/6281] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:49:48 2022] POST /identity/v3/projects => generated 355 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:49.356557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18bd69-cf5d-46b9-b75b-31eae5c61d14 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:49.356871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18bd69-cf5d-46b9-b75b-31eae5c61d14 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:49.357153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18bd69-cf5d-46b9-b75b-31eae5c61d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:49.379072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b206a-e205-4c73-9e2d-e8c5f037ff89 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:49.433582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-eb18bd69-cf5d-46b9-b75b-31eae5c61d14 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:49.436969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-eb18bd69-cf5d-46b9-b75b-31eae5c61d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:49.522277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dd397-3fbf-4c22-a2a7-a9e9e7fe5308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:49.523157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dd397-3fbf-4c22-a2a7-a9e9e7fe5308 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:49.523590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dd397-3fbf-4c22-a2a7-a9e9e7fe5308 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:49.524014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dd397-3fbf-4c22-a2a7-a9e9e7fe5308 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:49.525474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508dd397-3fbf-4c22-a2a7-a9e9e7fe5308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:49.530383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508dd397-3fbf-4c22-a2a7-a9e9e7fe5308 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:49.608210 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3152/6282] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:49.609678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18bd69-cf5d-46b9-b75b-31eae5c61d14 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:49.616835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-eb18bd69-cf5d-46b9-b75b-31eae5c61d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:49.646679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18bd69-cf5d-46b9-b75b-31eae5c61d14 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:49.659674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6134a6-96cf-4650-b806-f4ea8b995051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:49.661683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6134a6-96cf-4650-b806-f4ea8b995051 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:49.667827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6134a6-96cf-4650-b806-f4ea8b995051 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:49.668467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6134a6-96cf-4650-b806-f4ea8b995051 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:49.669508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6134a6-96cf-4650-b806-f4ea8b995051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:49.675648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6134a6-96cf-4650-b806-f4ea8b995051 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:49.694724 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3131/6283] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:49:49 2022] POST /identity/v3/users => generated 300 bytes in 543 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:49.696235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9fa0d-6779-4ea1-9678-34a6ee441d1f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:49.696674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9fa0d-6779-4ea1-9678-34a6ee441d1f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:49.698130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9fa0d-6779-4ea1-9678-34a6ee441d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:49.753851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-fae9fa0d-6779-4ea1-9678-34a6ee441d1f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:49.755140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fae9fa0d-6779-4ea1-9678-34a6ee441d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:49.779885 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3132/6284] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:49.783709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9fa0d-6779-4ea1-9678-34a6ee441d1f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:49.799190 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3153/6285] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:49:49 2022] POST /identity/v3/users => generated 284 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:49.799879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6134a6-96cf-4650-b806-f4ea8b995051 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:49.807678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9fa0d-6779-4ea1-9678-34a6ee441d1f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:49.827642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6134a6-96cf-4650-b806-f4ea8b995051 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:49.834462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1c7b4-ce30-4cf4-8187-0854b0f98f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:49.840836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1c7b4-ce30-4cf4-8187-0854b0f98f3a admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:49.841890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1c7b4-ce30-4cf4-8187-0854b0f98f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:49.841890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1c7b4-ce30-4cf4-8187-0854b0f98f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:49.842476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1c7b4-ce30-4cf4-8187-0854b0f98f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:49.845374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ec806-2db5-4702-92db-55e9093c5db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:49.846339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ec806-2db5-4702-92db-55e9093c5db3 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:49.846666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ec806-2db5-4702-92db-55e9093c5db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:49.847198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ec806-2db5-4702-92db-55e9093c5db3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:49.847839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1c7b4-ce30-4cf4-8187-0854b0f98f3a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:49.847974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ec806-2db5-4702-92db-55e9093c5db3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:49:49.848185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ec806-2db5-4702-92db-55e9093c5db3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:49.852768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ec806-2db5-4702-92db-55e9093c5db3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:49.897246 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3154/6287] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:49.897407 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3133/6287] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:49.898668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ec806-2db5-4702-92db-55e9093c5db3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:49.898798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1c7b4-ce30-4cf4-8187-0854b0f98f3a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:49.919164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1c7b4-ce30-4cf4-8187-0854b0f98f3a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:49.921686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ec806-2db5-4702-92db-55e9093c5db3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:49.937951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad518a-daf9-407a-85ed-0f84ca6e0104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:49.939159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad518a-daf9-407a-85ed-0f84ca6e0104 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:49.939715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad518a-daf9-407a-85ed-0f84ca6e0104 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:49.941185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:49.941336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9d4f2-d2f6-4ed1-bf90-ce041911c07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:49.941794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9d4f2-d2f6-4ed1-bf90-ce041911c07f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:49.942026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad518a-daf9-407a-85ed-0f84ca6e0104 admin admin] PATH_INFO: `/v3/projects/ead94a5de240407eb147b1dbdaaa0e32/users/a8ebbf7d970a490eb82dcbf0a4d6f018/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:49.942170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9d4f2-d2f6-4ed1-bf90-ce041911c07f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:49.942379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9d4f2-d2f6-4ed1-bf90-ce041911c07f admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:49.943570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9d4f2-d2f6-4ed1-bf90-ce041911c07f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:49.952721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9d4f2-d2f6-4ed1-bf90-ce041911c07f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:49.971679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad518a-daf9-407a-85ed-0f84ca6e0104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ead94a5de240407eb147b1dbdaaa0e32, user_id=a8ebbf7d970a490eb82dcbf0a4d6f018, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:49.975403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad518a-daf9-407a-85ed-0f84ca6e0104 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:49.996004 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3155/6288] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:49.996004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9d4f2-d2f6-4ed1-bf90-ce041911c07f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:50.032792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9d4f2-d2f6-4ed1-bf90-ce041911c07f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:50.045683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae9c88-37c3-4444-aec3-a1159374b5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:50.046403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae9c88-37c3-4444-aec3-a1159374b5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:50.046695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae9c88-37c3-4444-aec3-a1159374b5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:50.046975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae9c88-37c3-4444-aec3-a1159374b5e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:50.047624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae9c88-37c3-4444-aec3-a1159374b5e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:50.057820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae9c88-37c3-4444-aec3-a1159374b5e8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:50.151992 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3134/6289] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:49:49 2022] PUT /identity/v3/projects/ead94a5de240407eb147b1dbdaaa0e32/users/a8ebbf7d970a490eb82dcbf0a4d6f018/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:50.154204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad518a-daf9-407a-85ed-0f84ca6e0104 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:50.203687 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3156/6290] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:49:49 2022] POST /identity/v3/projects => generated 389 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:50.205040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae9c88-37c3-4444-aec3-a1159374b5e8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:50.290476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:50.418606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad518a-daf9-407a-85ed-0f84ca6e0104 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:50.492768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae9c88-37c3-4444-aec3-a1159374b5e8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:50.503584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd257888-1e47-42fe-9079-f9915eda5dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:50.506112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd257888-1e47-42fe-9079-f9915eda5dab admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:50.506663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd257888-1e47-42fe-9079-f9915eda5dab admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:50.507154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd257888-1e47-42fe-9079-f9915eda5dab admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:50.524408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd257888-1e47-42fe-9079-f9915eda5dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:50.524408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd257888-1e47-42fe-9079-f9915eda5dab admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:50.553060 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3157/6291] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:50.561901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd257888-1e47-42fe-9079-f9915eda5dab admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:50.572084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bede6-cf9b-4114-9515-9e63b3ae7be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:50.573174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bede6-cf9b-4114-9515-9e63b3ae7be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:50.573651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bede6-cf9b-4114-9515-9e63b3ae7be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:50.574176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bede6-cf9b-4114-9515-9e63b3ae7be4 admin admin] PATH_INFO: `/v3/projects/af6ba0689ad442b0be3a93b71e17dd0c/users/07b22d9c881e4e289eabbc4cedbd91fe/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:50.585749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd257888-1e47-42fe-9079-f9915eda5dab admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:50.598420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b8d7d-638f-42d4-9345-6e8339a465cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:50.599643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b8d7d-638f-42d4-9345-6e8339a465cd admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:50.600198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b8d7d-638f-42d4-9345-6e8339a465cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:50.601413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bede6-cf9b-4114-9515-9e63b3ae7be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af6ba0689ad442b0be3a93b71e17dd0c, user_id=07b22d9c881e4e289eabbc4cedbd91fe, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:50.602360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b8d7d-638f-42d4-9345-6e8339a465cd admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:50.603083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b8d7d-638f-42d4-9345-6e8339a465cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:50.605512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bede6-cf9b-4114-9515-9e63b3ae7be4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:50.612536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b8d7d-638f-42d4-9345-6e8339a465cd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:50.725615 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3135/6292] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:49:50 2022] PUT /identity/v3/projects/af6ba0689ad442b0be3a93b71e17dd0c/users/07b22d9c881e4e289eabbc4cedbd91fe/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:50.726994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bede6-cf9b-4114-9515-9e63b3ae7be4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:50.742168 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3158/6293] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:49:50 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:50.744007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b8d7d-638f-42d4-9345-6e8339a465cd admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:50.787334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b8d7d-638f-42d4-9345-6e8339a465cd admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:50.908357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bede6-cf9b-4114-9515-9e63b3ae7be4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:50.916945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb8db2-b185-4337-a22b-c65035a28d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:50.917706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb8db2-b185-4337-a22b-c65035a28d74 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:50.918138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb8db2-b185-4337-a22b-c65035a28d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:50.918771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb8db2-b185-4337-a22b-c65035a28d74 admin admin] PATH_INFO: `/v3/projects/ead94a5de240407eb147b1dbdaaa0e32/users/a8ebbf7d970a490eb82dcbf0a4d6f018/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:50.924388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb8db2-b185-4337-a22b-c65035a28d74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ead94a5de240407eb147b1dbdaaa0e32, user_id=a8ebbf7d970a490eb82dcbf0a4d6f018, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:50.929768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb8db2-b185-4337-a22b-c65035a28d74 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:50.966597 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3136/6294] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:49:50 2022] PUT /identity/v3/projects/ead94a5de240407eb147b1dbdaaa0e32/users/a8ebbf7d970a490eb82dcbf0a4d6f018/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:50.968189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb8db2-b185-4337-a22b-c65035a28d74 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:50.992116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c964cf0-b6f0-4b2e-b6c7-95ed83ce9cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:50.993029 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c964cf0-b6f0-4b2e-b6c7-95ed83ce9cea admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:50.995034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c964cf0-b6f0-4b2e-b6c7-95ed83ce9cea admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:50.995549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c964cf0-b6f0-4b2e-b6c7-95ed83ce9cea admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:50.996384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c964cf0-b6f0-4b2e-b6c7-95ed83ce9cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:50.999005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c964cf0-b6f0-4b2e-b6c7-95ed83ce9cea admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:51.015800 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3159/6295] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:51.017563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722c524-4ccf-45da-84ee-c158f180f2c3 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:51.018167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722c524-4ccf-45da-84ee-c158f180f2c3 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:51.018581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722c524-4ccf-45da-84ee-c158f180f2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:51.120464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6722c524-4ccf-45da-84ee-c158f180f2c3 None None] MFA Rules not processed for user `a8ebbf7d970a490eb82dcbf0a4d6f018`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:51.123086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6722c524-4ccf-45da-84ee-c158f180f2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:51.157273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:51.231850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb8db2-b185-4337-a22b-c65035a28d74 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:51.245240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66ba5c-13e4-4967-b691-73c41569fa31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:51.246499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66ba5c-13e4-4967-b691-73c41569fa31 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:51.247003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66ba5c-13e4-4967-b691-73c41569fa31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:51.247472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66ba5c-13e4-4967-b691-73c41569fa31 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:51.248380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66ba5c-13e4-4967-b691-73c41569fa31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:51.252912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66ba5c-13e4-4967-b691-73c41569fa31 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:51.306443 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3137/6296] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:51.307196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66ba5c-13e4-4967-b691-73c41569fa31 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:51.332293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66ba5c-13e4-4967-b691-73c41569fa31 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:51.340481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:51.344435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1c4a6-a179-4ffb-b3e6-9213ac9288ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:51.345604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1c4a6-a179-4ffb-b3e6-9213ac9288ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:51.345893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1c4a6-a179-4ffb-b3e6-9213ac9288ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:51.346278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1c4a6-a179-4ffb-b3e6-9213ac9288ac admin admin] PATH_INFO: `/v3/projects/af6ba0689ad442b0be3a93b71e17dd0c/users/07b22d9c881e4e289eabbc4cedbd91fe/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:51.348993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1c4a6-a179-4ffb-b3e6-9213ac9288ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=af6ba0689ad442b0be3a93b71e17dd0c, user_id=07b22d9c881e4e289eabbc4cedbd91fe, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:51.353374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1c4a6-a179-4ffb-b3e6-9213ac9288ac admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:51.373862 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3160/6297] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:51 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:51.374878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722c524-4ccf-45da-84ee-c158f180f2c3 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:51.402426 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3138/6298] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:49:51 2022] PUT /identity/v3/projects/af6ba0689ad442b0be3a93b71e17dd0c/users/07b22d9c881e4e289eabbc4cedbd91fe/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:51.405575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1c4a6-a179-4ffb-b3e6-9213ac9288ac admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:51.432470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722c524-4ccf-45da-84ee-c158f180f2c3 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:51.549080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0bfa0-467d-4bb0-a830-766570890de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:51.550350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0bfa0-467d-4bb0-a830-766570890de4 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:51.550830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0bfa0-467d-4bb0-a830-766570890de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:51.551278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0bfa0-467d-4bb0-a830-766570890de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:51.552582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0bfa0-467d-4bb0-a830-766570890de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:51.581371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0bfa0-467d-4bb0-a830-766570890de4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:51.602920 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3161/6299] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:51.610874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e93ca8-d5f6-4f9b-9ca1-280f481a8424 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:51.617168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e93ca8-d5f6-4f9b-9ca1-280f481a8424 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:51.617168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e93ca8-d5f6-4f9b-9ca1-280f481a8424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:51.681874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1c4a6-a179-4ffb-b3e6-9213ac9288ac admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:51.705564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18064d63-d6a3-4ec6-868d-4d1a22d94ee4 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ebbf7d970a490eb82dcbf0a4d6f018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ead94a5de240407eb147b1dbdaaa0e32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:51.706265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18064d63-d6a3-4ec6-868d-4d1a22d94ee4 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:51.706553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18064d63-d6a3-4ec6-868d-4d1a22d94ee4 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:51.706873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18064d63-d6a3-4ec6-868d-4d1a22d94ee4 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] PATH_INFO: `/v3/projects/f936f25a3d4c4a26be3b5fb1fd9aaf28` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:51.715692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18064d63-d6a3-4ec6-868d-4d1a22d94ee4 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Authorizing `identity:get_project(project_id=f936f25a3d4c4a26be3b5fb1fd9aaf28)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:51.726832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18064d63-d6a3-4ec6-868d-4d1a22d94ee4 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:51.733944 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3139/6300] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:49:51 2022] GET /identity/v3/projects/f936f25a3d4c4a26be3b5fb1fd9aaf28 => generated 389 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:51.734831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18064d63-d6a3-4ec6-868d-4d1a22d94ee4 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:51.748513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-08e93ca8-d5f6-4f9b-9ca1-280f481a8424 None None] MFA Rules not processed for user `07b22d9c881e4e289eabbc4cedbd91fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:51.752712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-08e93ca8-d5f6-4f9b-9ca1-280f481a8424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:51.799463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18064d63-d6a3-4ec6-868d-4d1a22d94ee4 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:51.828105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf983b1-bf73-435d-ad25-a116e1aa33ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:51.828105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf983b1-bf73-435d-ad25-a116e1aa33ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:51.828105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf983b1-bf73-435d-ad25-a116e1aa33ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:51.828105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf983b1-bf73-435d-ad25-a116e1aa33ec admin admin] PATH_INFO: `/v3/projects/247d973b18304f64b8fbddfe2a012424/users/40a728220eb2467fa5ece65102deed36/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:51.878919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf983b1-bf73-435d-ad25-a116e1aa33ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=247d973b18304f64b8fbddfe2a012424, user_id=40a728220eb2467fa5ece65102deed36, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:51.883076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf983b1-bf73-435d-ad25-a116e1aa33ec admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:51.993288 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3162/6301] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:51.994960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e93ca8-d5f6-4f9b-9ca1-280f481a8424 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:52.001352 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3140/6302] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:49:51 2022] PUT /identity/v3/projects/247d973b18304f64b8fbddfe2a012424/users/40a728220eb2467fa5ece65102deed36/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:52.006990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf983b1-bf73-435d-ad25-a116e1aa33ec admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:52.012323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dcf983b1-bf73-435d-ad25-a116e1aa33ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:52.012667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:52.029338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e93ca8-d5f6-4f9b-9ca1-280f481a8424 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:52.068377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:52.240444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01192b8d-0c72-40de-bdb1-ad0082c831c6 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ebbf7d970a490eb82dcbf0a4d6f018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ead94a5de240407eb147b1dbdaaa0e32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:52.244016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01192b8d-0c72-40de-bdb1-ad0082c831c6 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:52.244016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01192b8d-0c72-40de-bdb1-ad0082c831c6 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:52.244016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01192b8d-0c72-40de-bdb1-ad0082c831c6 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:52.247075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01192b8d-0c72-40de-bdb1-ad0082c831c6 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:52.251685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01192b8d-0c72-40de-bdb1-ad0082c831c6 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:52.274414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf983b1-bf73-435d-ad25-a116e1aa33ec admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:52.284007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a858e-169a-47b5-aab5-c754f0e9b518 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:52.284652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a858e-169a-47b5-aab5-c754f0e9b518 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:52.288300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a858e-169a-47b5-aab5-c754f0e9b518 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:52.288626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a858e-169a-47b5-aab5-c754f0e9b518 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:52.299770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:52.429964 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3163/6303] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Oct 27 03:49:51 2022] POST /identity/v3/projects => generated 338 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:52.433837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d2d44-8c1b-4dc4-b1ba-4590f572b6da None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:52.436228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d2d44-8c1b-4dc4-b1ba-4590f572b6da None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:52.436770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d2d44-8c1b-4dc4-b1ba-4590f572b6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:52.487985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a858e-169a-47b5-aab5-c754f0e9b518 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:52.492228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a858e-169a-47b5-aab5-c754f0e9b518 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:52.501709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3b3d2d44-8c1b-4dc4-b1ba-4590f572b6da None None] MFA Rules not processed for user `40a728220eb2467fa5ece65102deed36`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:52.503352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3b3d2d44-8c1b-4dc4-b1ba-4590f572b6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:52.549262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:52.555984 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3141/6304] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:49:52.557821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a858e-169a-47b5-aab5-c754f0e9b518 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:52.581438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a858e-169a-47b5-aab5-c754f0e9b518 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:52.682572 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3164/6305] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:52.752704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d2d44-8c1b-4dc4-b1ba-4590f572b6da None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:52.754252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3b3d2d44-8c1b-4dc4-b1ba-4590f572b6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:52.765256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3596b85-2edd-4bdb-9888-30cad8c16fc3 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ebbf7d970a490eb82dcbf0a4d6f018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ead94a5de240407eb147b1dbdaaa0e32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:52.767284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3596b85-2edd-4bdb-9888-30cad8c16fc3 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:52.773093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3596b85-2edd-4bdb-9888-30cad8c16fc3 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:52.773093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3596b85-2edd-4bdb-9888-30cad8c16fc3 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:52.773093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3596b85-2edd-4bdb-9888-30cad8c16fc3 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:52.778665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3596b85-2edd-4bdb-9888-30cad8c16fc3 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:52.825014 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3142/6306] 10.222.0.20 () {58 vars in 1131 bytes} [Thu Oct 27 03:49:52 2022] GET /identity/v3/projects => generated 6918 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:52.826285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3596b85-2edd-4bdb-9888-30cad8c16fc3 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:52.862557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3596b85-2edd-4bdb-9888-30cad8c16fc3 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:52.894941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58869b-47b0-475e-96e6-1f24ecea1135 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ebbf7d970a490eb82dcbf0a4d6f018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ead94a5de240407eb147b1dbdaaa0e32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:52.897921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58869b-47b0-475e-96e6-1f24ecea1135 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:52.898260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58869b-47b0-475e-96e6-1f24ecea1135 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:52.898543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58869b-47b0-475e-96e6-1f24ecea1135 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] PATH_INFO: `/v3/projects/f936f25a3d4c4a26be3b5fb1fd9aaf28` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:52.907210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58869b-47b0-475e-96e6-1f24ecea1135 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Authorizing `identity:get_project(project_id=f936f25a3d4c4a26be3b5fb1fd9aaf28)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:52.912904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58869b-47b0-475e-96e6-1f24ecea1135 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:52.918413 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3143/6307] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:49:52 2022] GET /identity/v3/projects/f936f25a3d4c4a26be3b5fb1fd9aaf28 => generated 389 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:52.919026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58869b-47b0-475e-96e6-1f24ecea1135 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:52.927664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:52.928556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4d58869b-47b0-475e-96e6-1f24ecea1135 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:53.022182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d2d44-8c1b-4dc4-b1ba-4590f572b6da None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:53.033104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2ce75-edf3-4839-8197-a1d8cc6f7389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:53.033740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2ce75-edf3-4839-8197-a1d8cc6f7389 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:53.034023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2ce75-edf3-4839-8197-a1d8cc6f7389 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:53.034408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2ce75-edf3-4839-8197-a1d8cc6f7389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:53.077826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2ce75-edf3-4839-8197-a1d8cc6f7389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:53.079371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2ce75-edf3-4839-8197-a1d8cc6f7389 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:53.104471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58869b-47b0-475e-96e6-1f24ecea1135 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:53.107032 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3165/6308] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:49:53.108006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2ce75-edf3-4839-8197-a1d8cc6f7389 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:53.116576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e7e77-09fb-4f85-88f4-27304c14215a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:53.118305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e7e77-09fb-4f85-88f4-27304c14215a service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:53.121093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e7e77-09fb-4f85-88f4-27304c14215a service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:53.121462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e7e77-09fb-4f85-88f4-27304c14215a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:53.127939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ff3e7e77-09fb-4f85-88f4-27304c14215a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:53.144826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2ce75-edf3-4839-8197-a1d8cc6f7389 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:53.165102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccec56-72c7-45a9-91d2-8db72540f898 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ebbf7d970a490eb82dcbf0a4d6f018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ead94a5de240407eb147b1dbdaaa0e32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:53.166815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccec56-72c7-45a9-91d2-8db72540f898 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:53.169092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccec56-72c7-45a9-91d2-8db72540f898 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:53.169542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccec56-72c7-45a9-91d2-8db72540f898 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] PATH_INFO: `/v3/projects/af72b9e124e94c8a867d0796e5c8a9e9` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:53.173002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ccec56-72c7-45a9-91d2-8db72540f898 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Authorizing `identity:get_project(project_id=af72b9e124e94c8a867d0796e5c8a9e9)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:53.175314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:53.177350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ccec56-72c7-45a9-91d2-8db72540f898 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:53.206570 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3166/6309] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:49:53 2022] GET /identity/v3/projects/af72b9e124e94c8a867d0796e5c8a9e9 => generated 338 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:53.208028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccec56-72c7-45a9-91d2-8db72540f898 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:53.253167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccec56-72c7-45a9-91d2-8db72540f898 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:53.266265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79c155-d294-461b-92e9-9244dae941a6 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ebbf7d970a490eb82dcbf0a4d6f018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ead94a5de240407eb147b1dbdaaa0e32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:53.266910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79c155-d294-461b-92e9-9244dae941a6 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:53.268906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79c155-d294-461b-92e9-9244dae941a6 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:53.269217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79c155-d294-461b-92e9-9244dae941a6 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:53.269873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79c155-d294-461b-92e9-9244dae941a6 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:53.272561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79c155-d294-461b-92e9-9244dae941a6 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:53.307418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e7e77-09fb-4f85-88f4-27304c14215a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:53.309596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e7e77-09fb-4f85-88f4-27304c14215a service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:53.336994 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3167/6310] 10.222.0.20 () {58 vars in 1131 bytes} [Thu Oct 27 03:49:53 2022] GET /identity/v3/projects => generated 6918 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:53.347707 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3144/6311] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:49:53.348086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79c155-d294-461b-92e9-9244dae941a6 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:53.371175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:53.389900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79c155-d294-461b-92e9-9244dae941a6 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:53.409513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33609e02-3a50-4c86-a1c6-e8a549879581 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ebbf7d970a490eb82dcbf0a4d6f018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ead94a5de240407eb147b1dbdaaa0e32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:53.412136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33609e02-3a50-4c86-a1c6-e8a549879581 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:53.412489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33609e02-3a50-4c86-a1c6-e8a549879581 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:53.412771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33609e02-3a50-4c86-a1c6-e8a549879581 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:53.413473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33609e02-3a50-4c86-a1c6-e8a549879581 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:49:53.413789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33609e02-3a50-4c86-a1c6-e8a549879581 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:53.419927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33609e02-3a50-4c86-a1c6-e8a549879581 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:53.480835 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3168/6312] 10.222.0.20 () {58 vars in 1166 bytes} [Thu Oct 27 03:49:53 2022] GET /identity/v3/projects?domain_id=default => generated 6587 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:53.482422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e7e77-09fb-4f85-88f4-27304c14215a service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:53.504289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e7e77-09fb-4f85-88f4-27304c14215a service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:53.532477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dd368-795c-45e4-8e36-3993a411adb5 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ebbf7d970a490eb82dcbf0a4d6f018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ead94a5de240407eb147b1dbdaaa0e32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:53.533128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dd368-795c-45e4-8e36-3993a411adb5 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:53.534555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dd368-795c-45e4-8e36-3993a411adb5 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:53.534851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dd368-795c-45e4-8e36-3993a411adb5 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:53.536840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1dd368-795c-45e4-8e36-3993a411adb5 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:53.544048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1dd368-795c-45e4-8e36-3993a411adb5 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:53.592090 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3145/6313] 10.222.0.20 () {58 vars in 1131 bytes} [Thu Oct 27 03:49:53 2022] GET /identity/v3/projects => generated 6918 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:53.597053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33609e02-3a50-4c86-a1c6-e8a549879581 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:53.612548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33609e02-3a50-4c86-a1c6-e8a549879581 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:53.618858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f32ce7-0df1-44a9-a2e1-99ad5663e6a6 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ebbf7d970a490eb82dcbf0a4d6f018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ead94a5de240407eb147b1dbdaaa0e32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:53.620947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f32ce7-0df1-44a9-a2e1-99ad5663e6a6 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:53.622127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f32ce7-0df1-44a9-a2e1-99ad5663e6a6 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:53.622468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f32ce7-0df1-44a9-a2e1-99ad5663e6a6 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:53.626502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f32ce7-0df1-44a9-a2e1-99ad5663e6a6 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:49:53.626502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f32ce7-0df1-44a9-a2e1-99ad5663e6a6 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:53.627602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f32ce7-0df1-44a9-a2e1-99ad5663e6a6 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:53.684050 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3169/6314] 10.222.0.20 () {58 vars in 1166 bytes} [Thu Oct 27 03:49:53 2022] GET /identity/v3/projects?domain_id=default => generated 6587 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:53.688630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dd368-795c-45e4-8e36-3993a411adb5 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:53.704875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dd368-795c-45e4-8e36-3993a411adb5 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:53.732919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504fdb1-4076-4659-8ce9-1c6e4d5f2f74 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ebbf7d970a490eb82dcbf0a4d6f018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ead94a5de240407eb147b1dbdaaa0e32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:53.732919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504fdb1-4076-4659-8ce9-1c6e4d5f2f74 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:53.733769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504fdb1-4076-4659-8ce9-1c6e4d5f2f74 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:53.733769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504fdb1-4076-4659-8ce9-1c6e4d5f2f74 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:53.735455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504fdb1-4076-4659-8ce9-1c6e4d5f2f74 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:53.738135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504fdb1-4076-4659-8ce9-1c6e4d5f2f74 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:53.805900 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3146/6315] 10.222.0.20 () {58 vars in 1131 bytes} [Thu Oct 27 03:49:53 2022] GET /identity/v3/projects => generated 6918 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:49:53.810305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f32ce7-0df1-44a9-a2e1-99ad5663e6a6 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:53.818446 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:53.826258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f32ce7-0df1-44a9-a2e1-99ad5663e6a6 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:53.848390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95150561-dbe9-4ad8-9131-0e9e95bad5f8 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ebbf7d970a490eb82dcbf0a4d6f018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ead94a5de240407eb147b1dbdaaa0e32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:53.849545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95150561-dbe9-4ad8-9131-0e9e95bad5f8 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:53.853828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95150561-dbe9-4ad8-9131-0e9e95bad5f8 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:53.854223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95150561-dbe9-4ad8-9131-0e9e95bad5f8 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:53.854988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95150561-dbe9-4ad8-9131-0e9e95bad5f8 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1347702859) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:49:53.861159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95150561-dbe9-4ad8-9131-0e9e95bad5f8 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:53.864357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95150561-dbe9-4ad8-9131-0e9e95bad5f8 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:53.946586 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3170/6316] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Oct 27 03:49:53 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1347702859 => generated 537 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:53.954136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504fdb1-4076-4659-8ce9-1c6e4d5f2f74 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:53.972845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504fdb1-4076-4659-8ce9-1c6e4d5f2f74 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:53.986624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb54d83-33e7-4407-a9c0-656548eba71f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:53.986918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb54d83-33e7-4407-a9c0-656548eba71f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:53.987199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb54d83-33e7-4407-a9c0-656548eba71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:54.005145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cb409-c7fb-475a-ac0e-175d4bc65c91 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ebbf7d970a490eb82dcbf0a4d6f018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ead94a5de240407eb147b1dbdaaa0e32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:54.005846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cb409-c7fb-475a-ac0e-175d4bc65c91 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:54.006883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cb409-c7fb-475a-ac0e-175d4bc65c91 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:54.008386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cb409-c7fb-475a-ac0e-175d4bc65c91 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] PATH_INFO: `/v3/projects/af72b9e124e94c8a867d0796e5c8a9e9` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:54.011447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cb409-c7fb-475a-ac0e-175d4bc65c91 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Authorizing `identity:delete_project(project_id=af72b9e124e94c8a867d0796e5c8a9e9)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:54.018088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cb409-c7fb-475a-ac0e-175d4bc65c91 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:54.065105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-efb54d83-33e7-4407-a9c0-656548eba71f None None] MFA Rules not processed for user `66ba627e73834b84b1ee6514e1facd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:54.066400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-efb54d83-33e7-4407-a9c0-656548eba71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:54.310868 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3171/6317] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:54.310868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb54d83-33e7-4407-a9c0-656548eba71f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:54.310868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-efb54d83-33e7-4407-a9c0-656548eba71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:54.348126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:54.389235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bf1cb409-c7fb-475a-ac0e-175d4bc65c91 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af72b9e124e94c8a867d0796e5c8a9e9', 'request_id': 'req-bf1cb409-c7fb-475a-ac0e-175d4bc65c91'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:54.467814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb54d83-33e7-4407-a9c0-656548eba71f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:54.578265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc298c-9a67-4e40-a79c-f441c710e3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:54.579205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc298c-9a67-4e40-a79c-f441c710e3a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:54.579656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc298c-9a67-4e40-a79c-f441c710e3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:54.580255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc298c-9a67-4e40-a79c-f441c710e3a5 admin admin] PATH_INFO: `/v3/users/2fc1e7eafd7948279f08eb5ad52f5609` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:54.581638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc298c-9a67-4e40-a79c-f441c710e3a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fc1e7eafd7948279f08eb5ad52f5609)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:54.583945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc298c-9a67-4e40-a79c-f441c710e3a5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:54.921721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bf1cb409-c7fb-475a-ac0e-175d4bc65c91 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af72b9e124e94c8a867d0796e5c8a9e9', 'request_id': 'req-bf1cb409-c7fb-475a-ac0e-175d4bc65c91'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:54.930404 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bf1cb409-c7fb-475a-ac0e-175d4bc65c91 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af72b9e124e94c8a867d0796e5c8a9e9', 'request_id': 'req-bf1cb409-c7fb-475a-ac0e-175d4bc65c91'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:54.966674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bf1cb409-c7fb-475a-ac0e-175d4bc65c91 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] The token cache is being invalidate because project af72b9e124e94c8a867d0796e5c8a9e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:54.967713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bf1cb409-c7fb-475a-ac0e-175d4bc65c91 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:54.969402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bf1cb409-c7fb-475a-ac0e-175d4bc65c91 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:54.972107 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3147/6318] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:53 2022] DELETE /identity/v3/projects/af72b9e124e94c8a867d0796e5c8a9e9 => generated 0 bytes in 1019 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:54.976067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cb409-c7fb-475a-ac0e-175d4bc65c91 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:54.983310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bf1cb409-c7fb-475a-ac0e-175d4bc65c91 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:55.017308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cb409-c7fb-475a-ac0e-175d4bc65c91 tempest-ListProjectsStaticTestJSON-513611652 tempest-ListProjectsStaticTestJSON-513611652-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:55.021670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b8bc298c-9a67-4e40-a79c-f441c710e3a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fc1e7eafd7948279f08eb5ad52f5609'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:55.025126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b8bc298c-9a67-4e40-a79c-f441c710e3a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fc1e7eafd7948279f08eb5ad52f5609'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:55.030183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6150677-f61f-432d-99fc-57ca00c6532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:55.031089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6150677-f61f-432d-99fc-57ca00c6532d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:55.031478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6150677-f61f-432d-99fc-57ca00c6532d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:55.031863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6150677-f61f-432d-99fc-57ca00c6532d admin admin] PATH_INFO: `/v3/users/e4aaa78f685c4f1081b43e79c988e5df` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:55.033876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6150677-f61f-432d-99fc-57ca00c6532d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4aaa78f685c4f1081b43e79c988e5df)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:55.035941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6150677-f61f-432d-99fc-57ca00c6532d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:55.038766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b8bc298c-9a67-4e40-a79c-f441c710e3a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fc1e7eafd7948279f08eb5ad52f5609'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:55.053175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b8bc298c-9a67-4e40-a79c-f441c710e3a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fc1e7eafd7948279f08eb5ad52f5609'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:55.054919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b8bc298c-9a67-4e40-a79c-f441c710e3a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fc1e7eafd7948279f08eb5ad52f5609'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:55.133710 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3172/6319] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:49:54 2022] DELETE /identity/v3/users/2fc1e7eafd7948279f08eb5ad52f5609 => generated 0 bytes in 862 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:55.361277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d6150677-f61f-432d-99fc-57ca00c6532d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4aaa78f685c4f1081b43e79c988e5df'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:55.363093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d6150677-f61f-432d-99fc-57ca00c6532d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4aaa78f685c4f1081b43e79c988e5df'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:55.387488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d6150677-f61f-432d-99fc-57ca00c6532d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4aaa78f685c4f1081b43e79c988e5df'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:55.424019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d6150677-f61f-432d-99fc-57ca00c6532d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4aaa78f685c4f1081b43e79c988e5df'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:55.604156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d6150677-f61f-432d-99fc-57ca00c6532d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4aaa78f685c4f1081b43e79c988e5df'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:55.625225 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3148/6320] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:49:54 2022] DELETE /identity/v3/users/e4aaa78f685c4f1081b43e79c988e5df => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:55.630095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a374d8-6490-4c4a-8c69-2738f05e69ae None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:55.630659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a374d8-6490-4c4a-8c69-2738f05e69ae None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:55.631174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a374d8-6490-4c4a-8c69-2738f05e69ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:55.682443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a5a374d8-6490-4c4a-8c69-2738f05e69ae None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:55.685366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a5a374d8-6490-4c4a-8c69-2738f05e69ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:55.716951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:55.822641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6150677-f61f-432d-99fc-57ca00c6532d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:55.823822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d6150677-f61f-432d-99fc-57ca00c6532d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:55.910948 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3173/6321] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:55.929617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a374d8-6490-4c4a-8c69-2738f05e69ae None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:55.930850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a5a374d8-6490-4c4a-8c69-2738f05e69ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:55.977181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6150677-f61f-432d-99fc-57ca00c6532d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:56.008772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991253ae-25d9-435f-a6c5-d1926c45572f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:56.009450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991253ae-25d9-435f-a6c5-d1926c45572f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:56.010353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991253ae-25d9-435f-a6c5-d1926c45572f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:56.010643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991253ae-25d9-435f-a6c5-d1926c45572f admin admin] PATH_INFO: `/v3/projects/a3d03faa410840e0ae6d7523188d63b6` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:56.019022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991253ae-25d9-435f-a6c5-d1926c45572f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3d03faa410840e0ae6d7523188d63b6)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:56.020968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991253ae-25d9-435f-a6c5-d1926c45572f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:56.095501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a374d8-6490-4c4a-8c69-2738f05e69ae None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:56.105863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f139a10-c64b-4ba3-a706-8ce3564e66ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:56.107453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f139a10-c64b-4ba3-a706-8ce3564e66ca service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:56.107979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f139a10-c64b-4ba3-a706-8ce3564e66ca service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:56.111302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f139a10-c64b-4ba3-a706-8ce3564e66ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:56.145091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f139a10-c64b-4ba3-a706-8ce3564e66ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:56.145409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:56.156523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f139a10-c64b-4ba3-a706-8ce3564e66ca service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:56.179556 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3174/6322] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:49:56.244719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-991253ae-25d9-435f-a6c5-d1926c45572f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3d03faa410840e0ae6d7523188d63b6', 'request_id': 'req-991253ae-25d9-435f-a6c5-d1926c45572f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:56.336670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-991253ae-25d9-435f-a6c5-d1926c45572f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3d03faa410840e0ae6d7523188d63b6', 'request_id': 'req-991253ae-25d9-435f-a6c5-d1926c45572f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:56.356015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-991253ae-25d9-435f-a6c5-d1926c45572f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3d03faa410840e0ae6d7523188d63b6', 'request_id': 'req-991253ae-25d9-435f-a6c5-d1926c45572f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:56.384059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f139a10-c64b-4ba3-a706-8ce3564e66ca service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:56.386187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6f139a10-c64b-4ba3-a706-8ce3564e66ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:56.390330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-991253ae-25d9-435f-a6c5-d1926c45572f admin admin] The token cache is being invalidate because project a3d03faa410840e0ae6d7523188d63b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:56.390772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-991253ae-25d9-435f-a6c5-d1926c45572f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:56.392067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-991253ae-25d9-435f-a6c5-d1926c45572f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:56.397152 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3149/6323] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:55 2022] DELETE /identity/v3/projects/a3d03faa410840e0ae6d7523188d63b6 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:56.401478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991253ae-25d9-435f-a6c5-d1926c45572f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:56.405126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-991253ae-25d9-435f-a6c5-d1926c45572f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:56.421248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f139a10-c64b-4ba3-a706-8ce3564e66ca service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:56.518832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991253ae-25d9-435f-a6c5-d1926c45572f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:56.535172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f56128-272b-4c36-9dc9-aae295be64e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:56.536027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f56128-272b-4c36-9dc9-aae295be64e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:56.536508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f56128-272b-4c36-9dc9-aae295be64e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:56.537086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f56128-272b-4c36-9dc9-aae295be64e3 admin admin] PATH_INFO: `/v3/users/530d04ccbfb7413790c8311a10c8cbee` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:56.538960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f56128-272b-4c36-9dc9-aae295be64e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=530d04ccbfb7413790c8311a10c8cbee)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:56.542385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f56128-272b-4c36-9dc9-aae295be64e3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:56.574296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322ada0-b003-49f9-8ddc-dea546ff1787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:56.575291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322ada0-b003-49f9-8ddc-dea546ff1787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:56.575745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322ada0-b003-49f9-8ddc-dea546ff1787 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:56.576797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322ada0-b003-49f9-8ddc-dea546ff1787 admin admin] PATH_INFO: `/v3/users/789a102dc64b45fb9d4a25f338ed723b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:56.581076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322ada0-b003-49f9-8ddc-dea546ff1787 admin admin] RBAC: Authorizing `identity:delete_user(user_id=789a102dc64b45fb9d4a25f338ed723b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:56.585768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322ada0-b003-49f9-8ddc-dea546ff1787 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:56.789159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2322ada0-b003-49f9-8ddc-dea546ff1787 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '789a102dc64b45fb9d4a25f338ed723b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:56.790386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2322ada0-b003-49f9-8ddc-dea546ff1787 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '789a102dc64b45fb9d4a25f338ed723b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:56.812643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2322ada0-b003-49f9-8ddc-dea546ff1787 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '789a102dc64b45fb9d4a25f338ed723b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:56.834899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f2f56128-272b-4c36-9dc9-aae295be64e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '530d04ccbfb7413790c8311a10c8cbee'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:56.836035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f2f56128-272b-4c36-9dc9-aae295be64e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '530d04ccbfb7413790c8311a10c8cbee'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:56.841855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2322ada0-b003-49f9-8ddc-dea546ff1787 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '789a102dc64b45fb9d4a25f338ed723b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:56.842922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2322ada0-b003-49f9-8ddc-dea546ff1787 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '789a102dc64b45fb9d4a25f338ed723b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:56.856632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f2f56128-272b-4c36-9dc9-aae295be64e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '530d04ccbfb7413790c8311a10c8cbee'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:56.911255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f2f56128-272b-4c36-9dc9-aae295be64e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '530d04ccbfb7413790c8311a10c8cbee'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:56.949796 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3175/6324] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:49:56 2022] DELETE /identity/v3/users/789a102dc64b45fb9d4a25f338ed723b => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:49:56.961486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537fa74-7535-4b27-a59a-1bd0298d2e6b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:56.961486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537fa74-7535-4b27-a59a-1bd0298d2e6b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:56.961486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537fa74-7535-4b27-a59a-1bd0298d2e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:57.006688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f2f56128-272b-4c36-9dc9-aae295be64e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '530d04ccbfb7413790c8311a10c8cbee'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:57.012642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d537fa74-7535-4b27-a59a-1bd0298d2e6b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:57.014496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d537fa74-7535-4b27-a59a-1bd0298d2e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:57.016651 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3150/6325] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:49:56 2022] DELETE /identity/v3/users/530d04ccbfb7413790c8311a10c8cbee => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:57.206179 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3176/6326] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:57.224283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:57.233443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f56128-272b-4c36-9dc9-aae295be64e3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:57.235359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f2f56128-272b-4c36-9dc9-aae295be64e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:57.393416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f56128-272b-4c36-9dc9-aae295be64e3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:57.398825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778be8d5-93ea-48ae-9be8-873bf90535da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:57.402227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778be8d5-93ea-48ae-9be8-873bf90535da service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:57.402736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778be8d5-93ea-48ae-9be8-873bf90535da service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:57.404202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778be8d5-93ea-48ae-9be8-873bf90535da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:57.433472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778be8d5-93ea-48ae-9be8-873bf90535da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:57.441928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778be8d5-93ea-48ae-9be8-873bf90535da service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:57.479426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537fa74-7535-4b27-a59a-1bd0298d2e6b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:57.479426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d537fa74-7535-4b27-a59a-1bd0298d2e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:57.493148 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3151/6327] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:49:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:49:57.494993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537fa74-7535-4b27-a59a-1bd0298d2e6b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:57.500395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146ebe7-4c9d-4caa-b1a7-c9df68718443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:57.501760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146ebe7-4c9d-4caa-b1a7-c9df68718443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:57.502364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146ebe7-4c9d-4caa-b1a7-c9df68718443 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:57.502911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146ebe7-4c9d-4caa-b1a7-c9df68718443 admin admin] PATH_INFO: `/v3/projects/f936f25a3d4c4a26be3b5fb1fd9aaf28` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:57.504548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146ebe7-4c9d-4caa-b1a7-c9df68718443 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f936f25a3d4c4a26be3b5fb1fd9aaf28)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:57.506718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146ebe7-4c9d-4caa-b1a7-c9df68718443 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:57.705188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9146ebe7-4c9d-4caa-b1a7-c9df68718443 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f936f25a3d4c4a26be3b5fb1fd9aaf28', 'request_id': 'req-9146ebe7-4c9d-4caa-b1a7-c9df68718443'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:57.715900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9146ebe7-4c9d-4caa-b1a7-c9df68718443 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f936f25a3d4c4a26be3b5fb1fd9aaf28', 'request_id': 'req-9146ebe7-4c9d-4caa-b1a7-c9df68718443'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:57.722084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9146ebe7-4c9d-4caa-b1a7-c9df68718443 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f936f25a3d4c4a26be3b5fb1fd9aaf28', 'request_id': 'req-9146ebe7-4c9d-4caa-b1a7-c9df68718443'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:57.869540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9146ebe7-4c9d-4caa-b1a7-c9df68718443 admin admin] The token cache is being invalidate because project f936f25a3d4c4a26be3b5fb1fd9aaf28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:57.869540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9146ebe7-4c9d-4caa-b1a7-c9df68718443 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:57.869540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9146ebe7-4c9d-4caa-b1a7-c9df68718443 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:57.871143 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3177/6328] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:57 2022] DELETE /identity/v3/projects/f936f25a3d4c4a26be3b5fb1fd9aaf28 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:57.875449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778be8d5-93ea-48ae-9be8-873bf90535da service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:57.905906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778be8d5-93ea-48ae-9be8-873bf90535da service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:57.916492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146ebe7-4c9d-4caa-b1a7-c9df68718443 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:57.917984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9146ebe7-4c9d-4caa-b1a7-c9df68718443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:58.063483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:58.095742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146ebe7-4c9d-4caa-b1a7-c9df68718443 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:58.109379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90648c84-0c21-4782-a7ba-16a44cc14f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:58.115920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90648c84-0c21-4782-a7ba-16a44cc14f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:58.115920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90648c84-0c21-4782-a7ba-16a44cc14f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:58.115920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90648c84-0c21-4782-a7ba-16a44cc14f7d admin admin] PATH_INFO: `/v3/projects/ae6bd97041d843879dc0988741e0732a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:58.115920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90648c84-0c21-4782-a7ba-16a44cc14f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae6bd97041d843879dc0988741e0732a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:58.117497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90648c84-0c21-4782-a7ba-16a44cc14f7d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:58.218822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6a5b3-89a1-4ab4-bb21-1a0c293ae9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:58.221069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6a5b3-89a1-4ab4-bb21-1a0c293ae9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:58.221069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6a5b3-89a1-4ab4-bb21-1a0c293ae9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:58.235540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6a5b3-89a1-4ab4-bb21-1a0c293ae9e8 admin admin] PATH_INFO: `/v3/users/a8ebbf7d970a490eb82dcbf0a4d6f018` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:58.244770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6a5b3-89a1-4ab4-bb21-1a0c293ae9e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8ebbf7d970a490eb82dcbf0a4d6f018)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:58.248381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6a5b3-89a1-4ab4-bb21-1a0c293ae9e8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:58.310410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:58.335952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-90648c84-0c21-4782-a7ba-16a44cc14f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae6bd97041d843879dc0988741e0732a', 'request_id': 'req-90648c84-0c21-4782-a7ba-16a44cc14f7d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:58.343794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-90648c84-0c21-4782-a7ba-16a44cc14f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae6bd97041d843879dc0988741e0732a', 'request_id': 'req-90648c84-0c21-4782-a7ba-16a44cc14f7d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:58.370658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-90648c84-0c21-4782-a7ba-16a44cc14f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae6bd97041d843879dc0988741e0732a', 'request_id': 'req-90648c84-0c21-4782-a7ba-16a44cc14f7d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:58.457185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-90648c84-0c21-4782-a7ba-16a44cc14f7d admin admin] The token cache is being invalidate because project ae6bd97041d843879dc0988741e0732a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:58.457718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-90648c84-0c21-4782-a7ba-16a44cc14f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:58.470706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-90648c84-0c21-4782-a7ba-16a44cc14f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:58.474545 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3178/6329] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:57 2022] DELETE /identity/v3/projects/ae6bd97041d843879dc0988741e0732a => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:49:58.475605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90648c84-0c21-4782-a7ba-16a44cc14f7d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:58.496699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-90648c84-0c21-4782-a7ba-16a44cc14f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:58.569296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4de6a5b3-89a1-4ab4-bb21-1a0c293ae9e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8ebbf7d970a490eb82dcbf0a4d6f018'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:58.571317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4de6a5b3-89a1-4ab4-bb21-1a0c293ae9e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8ebbf7d970a490eb82dcbf0a4d6f018'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:58.593063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4de6a5b3-89a1-4ab4-bb21-1a0c293ae9e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8ebbf7d970a490eb82dcbf0a4d6f018'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:58.637328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4de6a5b3-89a1-4ab4-bb21-1a0c293ae9e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8ebbf7d970a490eb82dcbf0a4d6f018'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:58.695083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90648c84-0c21-4782-a7ba-16a44cc14f7d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:58.703689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224141bc-ff8e-44d3-8121-04472da45eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:58.704929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224141bc-ff8e-44d3-8121-04472da45eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:58.705936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224141bc-ff8e-44d3-8121-04472da45eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:58.706578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224141bc-ff8e-44d3-8121-04472da45eb0 admin admin] PATH_INFO: `/v3/projects/9ba078a4265c49cf80b2ef51af55cd2a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:58.708245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224141bc-ff8e-44d3-8121-04472da45eb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ba078a4265c49cf80b2ef51af55cd2a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:58.710488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224141bc-ff8e-44d3-8121-04472da45eb0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:58.756758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4de6a5b3-89a1-4ab4-bb21-1a0c293ae9e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8ebbf7d970a490eb82dcbf0a4d6f018'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:58.770369 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3152/6330] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:49:57 2022] DELETE /identity/v3/users/a8ebbf7d970a490eb82dcbf0a4d6f018 => generated 0 bytes in 891 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:58.772286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f910c4-ee7c-4f50-93ec-c901079432fc None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:58.772759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f910c4-ee7c-4f50-93ec-c901079432fc None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:58.773200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f910c4-ee7c-4f50-93ec-c901079432fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:58.863032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-47f910c4-ee7c-4f50-93ec-c901079432fc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:58.863032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-47f910c4-ee7c-4f50-93ec-c901079432fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:58.940980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-224141bc-ff8e-44d3-8121-04472da45eb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ba078a4265c49cf80b2ef51af55cd2a', 'request_id': 'req-224141bc-ff8e-44d3-8121-04472da45eb0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:58.958905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-224141bc-ff8e-44d3-8121-04472da45eb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ba078a4265c49cf80b2ef51af55cd2a', 'request_id': 'req-224141bc-ff8e-44d3-8121-04472da45eb0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:58.979470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-224141bc-ff8e-44d3-8121-04472da45eb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ba078a4265c49cf80b2ef51af55cd2a', 'request_id': 'req-224141bc-ff8e-44d3-8121-04472da45eb0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:59.031390 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3153/6331] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:59.039084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140a5c5-8f6b-4168-b795-76973ec43513 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:59.039571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140a5c5-8f6b-4168-b795-76973ec43513 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:59.040060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140a5c5-8f6b-4168-b795-76973ec43513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:59.073355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b140a5c5-8f6b-4168-b795-76973ec43513 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:59.075086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b140a5c5-8f6b-4168-b795-76973ec43513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:59.082346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-224141bc-ff8e-44d3-8121-04472da45eb0 admin admin] The token cache is being invalidate because project 9ba078a4265c49cf80b2ef51af55cd2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:49:59.082483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-224141bc-ff8e-44d3-8121-04472da45eb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:59.084674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-224141bc-ff8e-44d3-8121-04472da45eb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:49:59.090441 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3179/6332] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:49:58 2022] DELETE /identity/v3/projects/9ba078a4265c49cf80b2ef51af55cd2a => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:49:59.096650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c981959-c4a3-4359-9889-49901fec7368 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:59.097285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c981959-c4a3-4359-9889-49901fec7368 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:59.098428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c981959-c4a3-4359-9889-49901fec7368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:59.148284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9c981959-c4a3-4359-9889-49901fec7368 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:59.150107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9c981959-c4a3-4359-9889-49901fec7368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:59.268410 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3154/6333] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:59.274157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140a5c5-8f6b-4168-b795-76973ec43513 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:59.293785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140a5c5-8f6b-4168-b795-76973ec43513 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:59.304786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1fc0d-3c44-48ef-ac81-49a9c5d72d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:59.305774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1fc0d-3c44-48ef-ac81-49a9c5d72d87 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:59.306083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1fc0d-3c44-48ef-ac81-49a9c5d72d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:59.307084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1fc0d-3c44-48ef-ac81-49a9c5d72d87 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:59.307769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1fc0d-3c44-48ef-ac81-49a9c5d72d87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:49:59.308081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1fc0d-3c44-48ef-ac81-49a9c5d72d87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:59.309921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1fc0d-3c44-48ef-ac81-49a9c5d72d87 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:59.359061 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3155/6334] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:59.367158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1fc0d-3c44-48ef-ac81-49a9c5d72d87 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:59.368979 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3180/6335] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:59.377881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9695e58-1274-46d4-b295-542bbb17e86e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:59.383043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9695e58-1274-46d4-b295-542bbb17e86e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:59.383043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9695e58-1274-46d4-b295-542bbb17e86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:59.407900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1fc0d-3c44-48ef-ac81-49a9c5d72d87 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:59.432573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b899ab-1e35-4451-9813-8a2d5282908d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:59.433580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b9695e58-1274-46d4-b295-542bbb17e86e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:49:59.435647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b899ab-1e35-4451-9813-8a2d5282908d admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:59.436279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b899ab-1e35-4451-9813-8a2d5282908d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:59.438555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b899ab-1e35-4451-9813-8a2d5282908d admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:59.439441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b899ab-1e35-4451-9813-8a2d5282908d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:59.444397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b899ab-1e35-4451-9813-8a2d5282908d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:59.454398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b9695e58-1274-46d4-b295-542bbb17e86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:49:59.482800 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3181/6336] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:49:59.495921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9695e58-1274-46d4-b295-542bbb17e86e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:59.539188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9695e58-1274-46d4-b295-542bbb17e86e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:59.559637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e01956-2eef-45d9-a19c-0fb7baa949de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:59.560284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e01956-2eef-45d9-a19c-0fb7baa949de admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:59.562062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e01956-2eef-45d9-a19c-0fb7baa949de admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:59.562347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e01956-2eef-45d9-a19c-0fb7baa949de admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:59.563024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e01956-2eef-45d9-a19c-0fb7baa949de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:49:59.563332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e01956-2eef-45d9-a19c-0fb7baa949de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:59.569749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e01956-2eef-45d9-a19c-0fb7baa949de admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:59.618552 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3182/6337] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:49:59.622167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e01956-2eef-45d9-a19c-0fb7baa949de admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:59.655615 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3156/6338] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:49:59 2022] POST /identity/v3/projects => generated 365 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:49:59.666092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e01956-2eef-45d9-a19c-0fb7baa949de admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:59.666291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b899ab-1e35-4451-9813-8a2d5282908d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:49:59.823524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a1e9c-1b06-4326-a3e2-4706128dc3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:59.824190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a1e9c-1b06-4326-a3e2-4706128dc3df admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:59.824442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a1e9c-1b06-4326-a3e2-4706128dc3df admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:59.824723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a1e9c-1b06-4326-a3e2-4706128dc3df admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:59.826737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a1e9c-1b06-4326-a3e2-4706128dc3df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:59.828960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a1e9c-1b06-4326-a3e2-4706128dc3df admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:49:59.885228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b899ab-1e35-4451-9813-8a2d5282908d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:49:59.892279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de7116-745f-48e7-93e0-df64dfbb4f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:49:59.896057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de7116-745f-48e7-93e0-df64dfbb4f6e admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:49:59.896419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de7116-745f-48e7-93e0-df64dfbb4f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:49:59.896701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de7116-745f-48e7-93e0-df64dfbb4f6e admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:49:59.897569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de7116-745f-48e7-93e0-df64dfbb4f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:49:59.901258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de7116-745f-48e7-93e0-df64dfbb4f6e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:00.816122 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3157/6339] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:49:59 2022] POST /identity/v3/users => generated 283 bytes in 1154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:00.818144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de7116-745f-48e7-93e0-df64dfbb4f6e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:00.824506 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3183/6340] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:49:59 2022] POST /identity/v3/projects => generated 377 bytes in 1199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:00.824506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a1e9c-1b06-4326-a3e2-4706128dc3df admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:00.825946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-52de7116-745f-48e7-93e0-df64dfbb4f6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:00.897675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de7116-745f-48e7-93e0-df64dfbb4f6e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:01.060645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a1e9c-1b06-4326-a3e2-4706128dc3df admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:01.081676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b0f65-5b1e-452a-9b1e-935cf0c428a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:01.082532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b0f65-5b1e-452a-9b1e-935cf0c428a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:01.084234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b0f65-5b1e-452a-9b1e-935cf0c428a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:01.084770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b0f65-5b1e-452a-9b1e-935cf0c428a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:01.086369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b0f65-5b1e-452a-9b1e-935cf0c428a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:01.088452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:01.091268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b0f65-5b1e-452a-9b1e-935cf0c428a6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:01.092378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcea6e8-cca9-4e91-a6d4-60b92d904beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:01.093038 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcea6e8-cca9-4e91-a6d4-60b92d904beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:01.093324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcea6e8-cca9-4e91-a6d4-60b92d904beb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:01.093599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcea6e8-cca9-4e91-a6d4-60b92d904beb admin admin] PATH_INFO: `/v3/projects/ead94a5de240407eb147b1dbdaaa0e32` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:01.095100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcea6e8-cca9-4e91-a6d4-60b92d904beb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ead94a5de240407eb147b1dbdaaa0e32)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:01.097249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcea6e8-cca9-4e91-a6d4-60b92d904beb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:01.130196 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3184/6341] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:01.134458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b0f65-5b1e-452a-9b1e-935cf0c428a6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:01.174713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b0f65-5b1e-452a-9b1e-935cf0c428a6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:01.205141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65099ae0-b1ce-41a9-b59d-7dd7fbf8c681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:01.205303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65099ae0-b1ce-41a9-b59d-7dd7fbf8c681 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:01.205518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65099ae0-b1ce-41a9-b59d-7dd7fbf8c681 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:01.205860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65099ae0-b1ce-41a9-b59d-7dd7fbf8c681 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:01.206552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65099ae0-b1ce-41a9-b59d-7dd7fbf8c681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:01.208777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65099ae0-b1ce-41a9-b59d-7dd7fbf8c681 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:01.254814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3dcea6e8-cca9-4e91-a6d4-60b92d904beb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ead94a5de240407eb147b1dbdaaa0e32', 'request_id': 'req-3dcea6e8-cca9-4e91-a6d4-60b92d904beb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:01.372815 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3185/6342] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:01 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:01.374383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65099ae0-b1ce-41a9-b59d-7dd7fbf8c681 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:01.395424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65099ae0-b1ce-41a9-b59d-7dd7fbf8c681 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:01.412894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3dcea6e8-cca9-4e91-a6d4-60b92d904beb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ead94a5de240407eb147b1dbdaaa0e32', 'request_id': 'req-3dcea6e8-cca9-4e91-a6d4-60b92d904beb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:01.428464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3dcea6e8-cca9-4e91-a6d4-60b92d904beb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ead94a5de240407eb147b1dbdaaa0e32', 'request_id': 'req-3dcea6e8-cca9-4e91-a6d4-60b92d904beb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:01.481371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3dcea6e8-cca9-4e91-a6d4-60b92d904beb admin admin] The token cache is being invalidate because project ead94a5de240407eb147b1dbdaaa0e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:01.482614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3dcea6e8-cca9-4e91-a6d4-60b92d904beb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:01.485681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3dcea6e8-cca9-4e91-a6d4-60b92d904beb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:01.488599 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3158/6343] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:00 2022] DELETE /identity/v3/projects/ead94a5de240407eb147b1dbdaaa0e32 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:01.491384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcea6e8-cca9-4e91-a6d4-60b92d904beb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:01.491384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3dcea6e8-cca9-4e91-a6d4-60b92d904beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:01.556099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9b313-4a12-43c4-8820-08375b90f42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:01.556892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9b313-4a12-43c4-8820-08375b90f42f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:01.557240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9b313-4a12-43c4-8820-08375b90f42f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:01.557585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9b313-4a12-43c4-8820-08375b90f42f admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:01.558375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9b313-4a12-43c4-8820-08375b90f42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:01.560115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9b313-4a12-43c4-8820-08375b90f42f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:01.576437 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3186/6344] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:01.581349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76b832-e3f5-44fe-bd50-be275f775a68 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:01.581349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76b832-e3f5-44fe-bd50-be275f775a68 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:01.581621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76b832-e3f5-44fe-bd50-be275f775a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:01.625699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3d76b832-e3f5-44fe-bd50-be275f775a68 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:01.626727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3d76b832-e3f5-44fe-bd50-be275f775a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:01.630293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcea6e8-cca9-4e91-a6d4-60b92d904beb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:01.642160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c283b85-7a6b-407d-a732-888d5fd209d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:01.642812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c283b85-7a6b-407d-a732-888d5fd209d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:01.643102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c283b85-7a6b-407d-a732-888d5fd209d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:01.643384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c283b85-7a6b-407d-a732-888d5fd209d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:01.644111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c283b85-7a6b-407d-a732-888d5fd209d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:01.648444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c283b85-7a6b-407d-a732-888d5fd209d3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:01.656762 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3187/6345] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:01.657664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76b832-e3f5-44fe-bd50-be275f775a68 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:01.661461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3d76b832-e3f5-44fe-bd50-be275f775a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:01.677810 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3159/6346] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:01.677810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbd1ee-2af2-41e8-8e6d-2f323987e220 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:01.677810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbd1ee-2af2-41e8-8e6d-2f323987e220 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:01.677810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbd1ee-2af2-41e8-8e6d-2f323987e220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:01.688879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76b832-e3f5-44fe-bd50-be275f775a68 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:01.708043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e83b9-1053-460a-8867-f78228d780dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:01.708486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e83b9-1053-460a-8867-f78228d780dc admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:01.708775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e83b9-1053-460a-8867-f78228d780dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:01.709859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e83b9-1053-460a-8867-f78228d780dc admin admin] PATH_INFO: `/v3/projects/669734ab7b7e4110a78bebf2327456e9/users/9c8177d2c62d4dc0b93129506b54cbf1/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:01.730968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-07bbd1ee-2af2-41e8-8e6d-2f323987e220 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:01.734358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-07bbd1ee-2af2-41e8-8e6d-2f323987e220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:01.744300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e83b9-1053-460a-8867-f78228d780dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=669734ab7b7e4110a78bebf2327456e9, user_id=9c8177d2c62d4dc0b93129506b54cbf1, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:01.751368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e83b9-1053-460a-8867-f78228d780dc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:01.762143 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3160/6347] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:01.763064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbd1ee-2af2-41e8-8e6d-2f323987e220 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:01.780885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbd1ee-2af2-41e8-8e6d-2f323987e220 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:01.790672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f77dc-ff8b-4103-b955-21db44d71b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:01.791320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f77dc-ff8b-4103-b955-21db44d71b96 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:01.791622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f77dc-ff8b-4103-b955-21db44d71b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:01.791888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f77dc-ff8b-4103-b955-21db44d71b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:01.793683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f77dc-ff8b-4103-b955-21db44d71b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:01.795039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f77dc-ff8b-4103-b955-21db44d71b96 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:01.801961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:01.834818 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3161/6348] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:01.835769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f77dc-ff8b-4103-b955-21db44d71b96 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:01.859430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f77dc-ff8b-4103-b955-21db44d71b96 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:01.890125 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3188/6349] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:01 2022] PUT /identity/v3/projects/669734ab7b7e4110a78bebf2327456e9/users/9c8177d2c62d4dc0b93129506b54cbf1/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:01.900898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e83b9-1053-460a-8867-f78228d780dc admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:01.906090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e41f1-ead1-4d4c-8c13-883eaad7221e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:01.906742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e41f1-ead1-4d4c-8c13-883eaad7221e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:01.911704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e41f1-ead1-4d4c-8c13-883eaad7221e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:01.912886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e41f1-ead1-4d4c-8c13-883eaad7221e admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:01.913619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e41f1-ead1-4d4c-8c13-883eaad7221e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:50:01.913946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e41f1-ead1-4d4c-8c13-883eaad7221e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:01.921804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e41f1-ead1-4d4c-8c13-883eaad7221e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:01.970179 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3162/6350] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:01.971655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8708e-36e5-46b8-aaa9-608c173edafb None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:01.972014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8708e-36e5-46b8-aaa9-608c173edafb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:01.974610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8708e-36e5-46b8-aaa9-608c173edafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:02.093671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e5f8708e-36e5-46b8-aaa9-608c173edafb None None] MFA Rules not processed for user `9c8177d2c62d4dc0b93129506b54cbf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:02.097142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e5f8708e-36e5-46b8-aaa9-608c173edafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:02.107848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e83b9-1053-460a-8867-f78228d780dc admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:02.126010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7a778-fe17-4443-9259-28b2055d9898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:02.127650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7a778-fe17-4443-9259-28b2055d9898 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:02.128378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7a778-fe17-4443-9259-28b2055d9898 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:02.129036 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7a778-fe17-4443-9259-28b2055d9898 admin admin] PATH_INFO: `/v3/projects/f2387544050b4ccb8b97310b7bffe1bc/users/2083833c3660430a9930e1615887ec5e/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:02.148108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7a778-fe17-4443-9259-28b2055d9898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2387544050b4ccb8b97310b7bffe1bc, user_id=2083833c3660430a9930e1615887ec5e, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:02.152001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7a778-fe17-4443-9259-28b2055d9898 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:02.257236 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3189/6351] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:01 2022] PUT /identity/v3/projects/f2387544050b4ccb8b97310b7bffe1bc/users/2083833c3660430a9930e1615887ec5e/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:02.258439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7a778-fe17-4443-9259-28b2055d9898 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:02.298702 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3163/6352] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:02.309252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4649362-2772-400a-b8ee-f88e40127854 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:02.309252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4649362-2772-400a-b8ee-f88e40127854 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:02.309252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4649362-2772-400a-b8ee-f88e40127854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:02.412623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a4649362-2772-400a-b8ee-f88e40127854 None None] MFA Rules not processed for user `2083833c3660430a9930e1615887ec5e`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:02.414889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a4649362-2772-400a-b8ee-f88e40127854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:02.493050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7a778-fe17-4443-9259-28b2055d9898 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:02.510582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664ee01-09e0-4f59-a125-1af6af9f904b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:02.512573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664ee01-09e0-4f59-a125-1af6af9f904b admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:02.513283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664ee01-09e0-4f59-a125-1af6af9f904b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:02.515503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664ee01-09e0-4f59-a125-1af6af9f904b admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:02.521661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664ee01-09e0-4f59-a125-1af6af9f904b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:02.522202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664ee01-09e0-4f59-a125-1af6af9f904b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:02.620642 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3164/6353] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:02.625035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4649362-2772-400a-b8ee-f88e40127854 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:02.626500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a4649362-2772-400a-b8ee-f88e40127854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:02.695887 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3190/6354] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:02 2022] POST /identity/v3/projects => generated 367 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:02.698821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664ee01-09e0-4f59-a125-1af6af9f904b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:02.784003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:02.849079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4649362-2772-400a-b8ee-f88e40127854 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:02.883999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664ee01-09e0-4f59-a125-1af6af9f904b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:02.908523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99ec06-5b6b-4001-af59-b4467c7bf35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:02.909314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99ec06-5b6b-4001-af59-b4467c7bf35a admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:02.909700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99ec06-5b6b-4001-af59-b4467c7bf35a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:02.912159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99ec06-5b6b-4001-af59-b4467c7bf35a admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:02.913023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99ec06-5b6b-4001-af59-b4467c7bf35a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:02.917923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99ec06-5b6b-4001-af59-b4467c7bf35a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:03.032864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb6f00-1799-4949-a5c8-1703820fe943 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:03.033237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb6f00-1799-4949-a5c8-1703820fe943 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:03.038351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb6f00-1799-4949-a5c8-1703820fe943 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:03.038681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb6f00-1799-4949-a5c8-1703820fe943 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:03.107363 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3191/6355] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:02 2022] POST /identity/v3/projects => generated 377 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:03.108440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99ec06-5b6b-4001-af59-b4467c7bf35a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:03.201413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb6f00-1799-4949-a5c8-1703820fe943 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:03.203489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb6f00-1799-4949-a5c8-1703820fe943 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:03.248384 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3165/6356] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:50:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:50:03.251383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb6f00-1799-4949-a5c8-1703820fe943 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:03.272763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb6f00-1799-4949-a5c8-1703820fe943 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:03.316152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:03.389744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99ec06-5b6b-4001-af59-b4467c7bf35a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:03.410881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3f51c-9161-4afc-a065-1f9a32210b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:03.411681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3f51c-9161-4afc-a065-1f9a32210b61 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:03.412104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3f51c-9161-4afc-a065-1f9a32210b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:03.412445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3f51c-9161-4afc-a065-1f9a32210b61 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:03.413190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3f51c-9161-4afc-a065-1f9a32210b61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:03.419073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3f51c-9161-4afc-a065-1f9a32210b61 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:03.422745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7f6a3-9771-42a5-947f-dd8059e7553d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:03.423394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7f6a3-9771-42a5-947f-dd8059e7553d admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:03.423686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7f6a3-9771-42a5-947f-dd8059e7553d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:03.429253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7f6a3-9771-42a5-947f-dd8059e7553d admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:03.429253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7f6a3-9771-42a5-947f-dd8059e7553d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:03.429253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7f6a3-9771-42a5-947f-dd8059e7553d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:03.551662 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3166/6358] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:03 2022] POST /identity/v3/users => generated 295 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:03.552499 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3192/6358] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:03 2022] POST /identity/v3/users => generated 284 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:03.553741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7f6a3-9771-42a5-947f-dd8059e7553d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:03.554407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3f51c-9161-4afc-a065-1f9a32210b61 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:03.600553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3f51c-9161-4afc-a065-1f9a32210b61 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:03.600953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7f6a3-9771-42a5-947f-dd8059e7553d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:03.611524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a51b9-fc36-4d53-b157-d4b7ff466f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:03.612510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4866f20-ba95-4fad-9195-14208a3103b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:03.613920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a51b9-fc36-4d53-b157-d4b7ff466f3a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:03.614738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4866f20-ba95-4fad-9195-14208a3103b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:03.615202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a51b9-fc36-4d53-b157-d4b7ff466f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:03.615693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4866f20-ba95-4fad-9195-14208a3103b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:03.616166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a51b9-fc36-4d53-b157-d4b7ff466f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:03.616594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4866f20-ba95-4fad-9195-14208a3103b6 admin admin] PATH_INFO: `/v3/users/9c8177d2c62d4dc0b93129506b54cbf1` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:03.619447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a51b9-fc36-4d53-b157-d4b7ff466f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:03.622067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4866f20-ba95-4fad-9195-14208a3103b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c8177d2c62d4dc0b93129506b54cbf1)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:03.625572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a51b9-fc36-4d53-b157-d4b7ff466f3a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:03.627027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4866f20-ba95-4fad-9195-14208a3103b6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:03.666286 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3193/6359] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:03.667909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a51b9-fc36-4d53-b157-d4b7ff466f3a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:03.695299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a51b9-fc36-4d53-b157-d4b7ff466f3a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:03.716466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca66dc-5203-44bb-8c01-02593d37f991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:03.717456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca66dc-5203-44bb-8c01-02593d37f991 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:03.718004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca66dc-5203-44bb-8c01-02593d37f991 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:03.718824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca66dc-5203-44bb-8c01-02593d37f991 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:03.719744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca66dc-5203-44bb-8c01-02593d37f991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:03.721665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca66dc-5203-44bb-8c01-02593d37f991 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:03.749403 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3194/6360] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:03.753648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca66dc-5203-44bb-8c01-02593d37f991 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:03.784575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca66dc-5203-44bb-8c01-02593d37f991 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:03.794311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbeff4-88d0-4b61-8d6d-ec11baf05467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:03.794311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbeff4-88d0-4b61-8d6d-ec11baf05467 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:03.794311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbeff4-88d0-4b61-8d6d-ec11baf05467 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:03.794311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbeff4-88d0-4b61-8d6d-ec11baf05467 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:03.795670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbeff4-88d0-4b61-8d6d-ec11baf05467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:03.818276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbeff4-88d0-4b61-8d6d-ec11baf05467 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:03.827286 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3195/6361] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:03.832429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbeff4-88d0-4b61-8d6d-ec11baf05467 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:03.844298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbeff4-88d0-4b61-8d6d-ec11baf05467 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:03.849836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6f0a8-920c-4884-b2ff-7e2d1c690c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:03.850589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6f0a8-920c-4884-b2ff-7e2d1c690c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:03.851166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6f0a8-920c-4884-b2ff-7e2d1c690c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:03.851458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6f0a8-920c-4884-b2ff-7e2d1c690c63 admin admin] PATH_INFO: `/v3/projects/9dd49f3652264b84b685dca4bb8ef50d/users/2ca180f57ac048be8d48488cc206a1f7/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:03.873965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6f0a8-920c-4884-b2ff-7e2d1c690c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd49f3652264b84b685dca4bb8ef50d, user_id=2ca180f57ac048be8d48488cc206a1f7, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:03.883971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6f0a8-920c-4884-b2ff-7e2d1c690c63 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:03.925282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b4866f20-ba95-4fad-9195-14208a3103b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c8177d2c62d4dc0b93129506b54cbf1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:03.926413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b4866f20-ba95-4fad-9195-14208a3103b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c8177d2c62d4dc0b93129506b54cbf1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:03.949587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b4866f20-ba95-4fad-9195-14208a3103b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c8177d2c62d4dc0b93129506b54cbf1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:03.976068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b4866f20-ba95-4fad-9195-14208a3103b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c8177d2c62d4dc0b93129506b54cbf1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:04.010717 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3196/6362] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:03 2022] PUT /identity/v3/projects/9dd49f3652264b84b685dca4bb8ef50d/users/2ca180f57ac048be8d48488cc206a1f7/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:04.023202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6f0a8-920c-4884-b2ff-7e2d1c690c63 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:04.028321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-74d6f0a8-920c-4884-b2ff-7e2d1c690c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:04.063916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b4866f20-ba95-4fad-9195-14208a3103b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c8177d2c62d4dc0b93129506b54cbf1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:04.072878 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3167/6363] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:03 2022] DELETE /identity/v3/users/9c8177d2c62d4dc0b93129506b54cbf1 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:04.076226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4866f20-ba95-4fad-9195-14208a3103b6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:04.077008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b4866f20-ba95-4fad-9195-14208a3103b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:04.306629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6f0a8-920c-4884-b2ff-7e2d1c690c63 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:04.321470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:04.335354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8dfb1-b8cf-4a4f-a50e-ef4e0138a885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:04.337439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8dfb1-b8cf-4a4f-a50e-ef4e0138a885 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:04.339715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8dfb1-b8cf-4a4f-a50e-ef4e0138a885 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:04.343671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8dfb1-b8cf-4a4f-a50e-ef4e0138a885 admin admin] PATH_INFO: `/v3/projects/088418dd4e4d4385a7c8294b7497ec59/users/1696d72b73904b16bbde9509d94148db/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:04.345729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4866f20-ba95-4fad-9195-14208a3103b6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:04.364673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d710e3-9cf0-4b23-99a1-6a45777bf3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:04.365837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d710e3-9cf0-4b23-99a1-6a45777bf3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:04.370717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d710e3-9cf0-4b23-99a1-6a45777bf3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:04.371131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d710e3-9cf0-4b23-99a1-6a45777bf3c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:04.371939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d710e3-9cf0-4b23-99a1-6a45777bf3c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:04.376675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d710e3-9cf0-4b23-99a1-6a45777bf3c8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:04.397714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8dfb1-b8cf-4a4f-a50e-ef4e0138a885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=088418dd4e4d4385a7c8294b7497ec59, user_id=1696d72b73904b16bbde9509d94148db, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:04.401691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8dfb1-b8cf-4a4f-a50e-ef4e0138a885 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:04.410211 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3168/6364] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:04.420841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44c0b1-c010-446a-9d22-d285e3d30ad0 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:04.421250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44c0b1-c010-446a-9d22-d285e3d30ad0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:04.424020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44c0b1-c010-446a-9d22-d285e3d30ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:04.474849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-cd44c0b1-c010-446a-9d22-d285e3d30ad0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:04.476547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cd44c0b1-c010-446a-9d22-d285e3d30ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:04.512773 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3169/6365] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:04.512773 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44c0b1-c010-446a-9d22-d285e3d30ad0 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:04.521887 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3197/6366] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:04 2022] PUT /identity/v3/projects/088418dd4e4d4385a7c8294b7497ec59/users/1696d72b73904b16bbde9509d94148db/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:04.538943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c07b7b-ad57-41e1-b119-021c42de504f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:04.539408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c07b7b-ad57-41e1-b119-021c42de504f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:04.539780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c07b7b-ad57-41e1-b119-021c42de504f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:04.550431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44c0b1-c010-446a-9d22-d285e3d30ad0 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:04.596342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-40c07b7b-ad57-41e1-b119-021c42de504f None None] MFA Rules not processed for user `1696d72b73904b16bbde9509d94148db`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:04.598389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-40c07b7b-ad57-41e1-b119-021c42de504f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:04.651002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:04.697628 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3198/6367] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:50:04.698873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c07b7b-ad57-41e1-b119-021c42de504f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:04.703051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-40c07b7b-ad57-41e1-b119-021c42de504f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:04.703213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0471b-a740-4c80-86cf-f616033f98a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:04.704540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0471b-a740-4c80-86cf-f616033f98a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:04.704990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0471b-a740-4c80-86cf-f616033f98a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:04.705716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0471b-a740-4c80-86cf-f616033f98a2 admin admin] PATH_INFO: `/v3/projects/9dd49f3652264b84b685dca4bb8ef50d/users/2ca180f57ac048be8d48488cc206a1f7/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:04.708094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0471b-a740-4c80-86cf-f616033f98a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd49f3652264b84b685dca4bb8ef50d, user_id=2ca180f57ac048be8d48488cc206a1f7, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:04.710995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0471b-a740-4c80-86cf-f616033f98a2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:04.736575 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3170/6368] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:04 2022] PUT /identity/v3/projects/9dd49f3652264b84b685dca4bb8ef50d/users/2ca180f57ac048be8d48488cc206a1f7/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:04.737618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0471b-a740-4c80-86cf-f616033f98a2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:04.806181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c07b7b-ad57-41e1-b119-021c42de504f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:04.899194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0471b-a740-4c80-86cf-f616033f98a2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:04.913260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b3f26-3f07-468e-84ec-4d87903a6b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:04.914233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b3f26-3f07-468e-84ec-4d87903a6b7c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:04.914512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b3f26-3f07-468e-84ec-4d87903a6b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:04.914965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b3f26-3f07-468e-84ec-4d87903a6b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:04.915944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b3f26-3f07-468e-84ec-4d87903a6b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:04.919700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b3f26-3f07-468e-84ec-4d87903a6b7c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:04.953162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c60570-0fe6-493c-86c5-9a6beb8a0b2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:04.958452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c60570-0fe6-493c-86c5-9a6beb8a0b2e service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:04.969105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c60570-0fe6-493c-86c5-9a6beb8a0b2e service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:04.969105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c60570-0fe6-493c-86c5-9a6beb8a0b2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:04.984840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c60570-0fe6-493c-86c5-9a6beb8a0b2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:04.987744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c60570-0fe6-493c-86c5-9a6beb8a0b2e service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:05.030341 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3199/6369] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:50:05.032341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7993d-8a5b-4dee-b8d7-6086eb4619fe None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:05.033441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7993d-8a5b-4dee-b8d7-6086eb4619fe None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:05.034712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7993d-8a5b-4dee-b8d7-6086eb4619fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:05.103526 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3171/6370] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:04 2022] POST /identity/v3/projects => generated 367 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:05.104502 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b3f26-3f07-468e-84ec-4d87903a6b7c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:05.116220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-5dd7993d-8a5b-4dee-b8d7-6086eb4619fe None None] MFA Rules not processed for user `2ca180f57ac048be8d48488cc206a1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:05.117670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5dd7993d-8a5b-4dee-b8d7-6086eb4619fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:05.313569 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3200/6371] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:05.318502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7993d-8a5b-4dee-b8d7-6086eb4619fe None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:05.335775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7993d-8a5b-4dee-b8d7-6086eb4619fe None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:05.347592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b3f26-3f07-468e-84ec-4d87903a6b7c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:05.352460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331300b-a5c5-4b2f-83c9-925bd27c85e7 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ca180f57ac048be8d48488cc206a1f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dd49f3652264b84b685dca4bb8ef50d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:05.353484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331300b-a5c5-4b2f-83c9-925bd27c85e7 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:05.353995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331300b-a5c5-4b2f-83c9-925bd27c85e7 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:05.354540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331300b-a5c5-4b2f-83c9-925bd27c85e7 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:05.355445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331300b-a5c5-4b2f-83c9-925bd27c85e7 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:05.362232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331300b-a5c5-4b2f-83c9-925bd27c85e7 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:05.364736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f262f53-7da5-4fd1-bc89-59fe32059a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:05.365380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f262f53-7da5-4fd1-bc89-59fe32059a0e admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:05.365669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f262f53-7da5-4fd1-bc89-59fe32059a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:05.366338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f262f53-7da5-4fd1-bc89-59fe32059a0e admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:05.367000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f262f53-7da5-4fd1-bc89-59fe32059a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:05.369605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f262f53-7da5-4fd1-bc89-59fe32059a0e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:05.471216 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3201/6372] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:50:05 2022] POST /identity/v3/domains => generated 246 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:05.476301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331300b-a5c5-4b2f-83c9-925bd27c85e7 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:05.520307 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3172/6373] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:05 2022] POST /identity/v3/users => generated 290 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:05.521786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f262f53-7da5-4fd1-bc89-59fe32059a0e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:05.568560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f262f53-7da5-4fd1-bc89-59fe32059a0e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:05.674835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331300b-a5c5-4b2f-83c9-925bd27c85e7 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:05.682941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e40ae0-5429-413c-9675-f72abfb29e3a tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ca180f57ac048be8d48488cc206a1f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dd49f3652264b84b685dca4bb8ef50d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:05.683716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e40ae0-5429-413c-9675-f72abfb29e3a tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:05.684597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e40ae0-5429-413c-9675-f72abfb29e3a tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:05.685836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e40ae0-5429-413c-9675-f72abfb29e3a tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:05.686802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e40ae0-5429-413c-9675-f72abfb29e3a tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:05.689374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e40ae0-5429-413c-9675-f72abfb29e3a tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:05.781452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b212551-51d3-4b5d-9add-01d79e638f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:05.782493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b212551-51d3-4b5d-9add-01d79e638f2d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:05.783994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b212551-51d3-4b5d-9add-01d79e638f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:05.784533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b212551-51d3-4b5d-9add-01d79e638f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:05.785372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b212551-51d3-4b5d-9add-01d79e638f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:05.798786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b212551-51d3-4b5d-9add-01d79e638f2d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:05.846921 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3202/6374] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:05 2022] POST /identity/v3/projects => generated 409 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:05.852535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e40ae0-5429-413c-9675-f72abfb29e3a tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:05.855225 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3173/6375] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:05.872103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b212551-51d3-4b5d-9add-01d79e638f2d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:05.915005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b212551-51d3-4b5d-9add-01d79e638f2d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:05.965281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:06.012988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=12 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:06.064619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e40ae0-5429-413c-9675-f72abfb29e3a tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:06.080064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674554b-f99c-4031-8d93-36f84a8f954c tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ca180f57ac048be8d48488cc206a1f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dd49f3652264b84b685dca4bb8ef50d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:06.080064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674554b-f99c-4031-8d93-36f84a8f954c tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:06.080248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674554b-f99c-4031-8d93-36f84a8f954c tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:06.080938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674554b-f99c-4031-8d93-36f84a8f954c tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:06.081604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674554b-f99c-4031-8d93-36f84a8f954c tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:06.094751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674554b-f99c-4031-8d93-36f84a8f954c tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:06.100920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18d65f-8bf4-484e-ba4f-cc21328676ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:06.101865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18d65f-8bf4-484e-ba4f-cc21328676ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:06.102340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18d65f-8bf4-484e-ba4f-cc21328676ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:06.102788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18d65f-8bf4-484e-ba4f-cc21328676ad admin admin] PATH_INFO: `/v3/projects/e54a0d25549e4f90a816ef4425575f29/users/789689f163184bb9b3b7548fde5a5b33/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:06.142985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18d65f-8bf4-484e-ba4f-cc21328676ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=e54a0d25549e4f90a816ef4425575f29, user_id=789689f163184bb9b3b7548fde5a5b33, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:06.148897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18d65f-8bf4-484e-ba4f-cc21328676ad admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:06.221517 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3203/6376] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:05 2022] POST /identity/v3/users => generated 348 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:06.229381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674554b-f99c-4031-8d93-36f84a8f954c tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:06.250349 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3174/6377] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:05 2022] PUT /identity/v3/projects/e54a0d25549e4f90a816ef4425575f29/users/789689f163184bb9b3b7548fde5a5b33/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:06.252401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674554b-f99c-4031-8d93-36f84a8f954c tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:06.255038 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18d65f-8bf4-484e-ba4f-cc21328676ad admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:06.388435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18d65f-8bf4-484e-ba4f-cc21328676ad admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:06.394184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72d13e-7d5b-4213-9605-77b0605ed43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:06.394826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72d13e-7d5b-4213-9605-77b0605ed43c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:06.395110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72d13e-7d5b-4213-9605-77b0605ed43c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:06.395385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72d13e-7d5b-4213-9605-77b0605ed43c admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:06.396232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72d13e-7d5b-4213-9605-77b0605ed43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:06.398115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72d13e-7d5b-4213-9605-77b0605ed43c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:06.423730 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3175/6378] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:50:06.428500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72d13e-7d5b-4213-9605-77b0605ed43c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:06.439959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa42485-05b6-45ca-a7c7-328650b7b165 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ca180f57ac048be8d48488cc206a1f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dd49f3652264b84b685dca4bb8ef50d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:06.442360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa42485-05b6-45ca-a7c7-328650b7b165 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:06.442360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa42485-05b6-45ca-a7c7-328650b7b165 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:06.442360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa42485-05b6-45ca-a7c7-328650b7b165 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:06.442360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa42485-05b6-45ca-a7c7-328650b7b165 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:06.444622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa42485-05b6-45ca-a7c7-328650b7b165 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:06.454330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72d13e-7d5b-4213-9605-77b0605ed43c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:06.464682 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3204/6379] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:06.466289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0efc33-6c3b-4cda-b928-a4582dc922c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:06.470574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0efc33-6c3b-4cda-b928-a4582dc922c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:06.470574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0efc33-6c3b-4cda-b928-a4582dc922c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:06.470574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0efc33-6c3b-4cda-b928-a4582dc922c7 admin admin] PATH_INFO: `/v3/projects/e54a0d25549e4f90a816ef4425575f29/users/789689f163184bb9b3b7548fde5a5b33/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:06.472322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa42485-05b6-45ca-a7c7-328650b7b165 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:06.473760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0efc33-6c3b-4cda-b928-a4582dc922c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e54a0d25549e4f90a816ef4425575f29, user_id=789689f163184bb9b3b7548fde5a5b33, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:06.487384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa42485-05b6-45ca-a7c7-328650b7b165 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:06.494232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0efc33-6c3b-4cda-b928-a4582dc922c7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:06.500115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32518963-410d-4992-a9f3-687ae185456f tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ca180f57ac048be8d48488cc206a1f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dd49f3652264b84b685dca4bb8ef50d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:06.501392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32518963-410d-4992-a9f3-687ae185456f tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:06.501907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32518963-410d-4992-a9f3-687ae185456f tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:06.503054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32518963-410d-4992-a9f3-687ae185456f tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] PATH_INFO: `/v3/projects/3c18c556086f44dc8a1d54f4577de7a7/users/ec804ce0cd2841f7b0a032b3ee974702/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:06.536041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32518963-410d-4992-a9f3-687ae185456f tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3c18c556086f44dc8a1d54f4577de7a7, user_id=ec804ce0cd2841f7b0a032b3ee974702, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:06.539488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32518963-410d-4992-a9f3-687ae185456f tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:06.555672 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3176/6380] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:06 2022] PUT /identity/v3/projects/e54a0d25549e4f90a816ef4425575f29/users/789689f163184bb9b3b7548fde5a5b33/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:06.560263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e5e91-a889-42c3-91e3-0d2145341b91 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:06.560639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e5e91-a889-42c3-91e3-0d2145341b91 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:06.560928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e5e91-a889-42c3-91e3-0d2145341b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:06.633300 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3205/6381] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:06 2022] PUT /identity/v3/projects/3c18c556086f44dc8a1d54f4577de7a7/users/ec804ce0cd2841f7b0a032b3ee974702/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:06.636227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f30f0-a3fe-4676-8e78-623fb1722df4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:06.636798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f30f0-a3fe-4676-8e78-623fb1722df4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:06.641852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f30f0-a3fe-4676-8e78-623fb1722df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:06.645892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f48e5e91-a889-42c3-91e3-0d2145341b91 None None] MFA Rules not processed for user `789689f163184bb9b3b7548fde5a5b33`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:06.647178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f48e5e91-a889-42c3-91e3-0d2145341b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:06.756078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:06.883299 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3177/6382] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:06.890264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e5e91-a889-42c3-91e3-0d2145341b91 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:06.897665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9d1f30f0-a3fe-4676-8e78-623fb1722df4 None None] MFA Rules not processed for user `ec804ce0cd2841f7b0a032b3ee974702`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:06.899779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9d1f30f0-a3fe-4676-8e78-623fb1722df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:06.917160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e5e91-a889-42c3-91e3-0d2145341b91 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:06.933062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfb8b2-5ab6-41ef-80d6-7183f9b4ab8d tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:06.933778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfb8b2-5ab6-41ef-80d6-7183f9b4ab8d tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:06.934182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfb8b2-5ab6-41ef-80d6-7183f9b4ab8d tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:06.934541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfb8b2-5ab6-41ef-80d6-7183f9b4ab8d tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:06.935717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfb8b2-5ab6-41ef-80d6-7183f9b4ab8d tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:06.945931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfb8b2-5ab6-41ef-80d6-7183f9b4ab8d tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:06.949258 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3206/6383] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:06 2022] POST /identity/v3/auth/tokens => generated 3363 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:06.952477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f30f0-a3fe-4676-8e78-623fb1722df4 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:06.958338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9d1f30f0-a3fe-4676-8e78-623fb1722df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:06.991743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:07.066660 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3178/6384] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:06 2022] POST /identity/v3/projects => generated 359 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:07.068466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bd3e1-11cc-49c7-8ab8-98916291fa9c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:07.068903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bd3e1-11cc-49c7-8ab8-98916291fa9c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:07.069841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bd3e1-11cc-49c7-8ab8-98916291fa9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:07.125597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f30f0-a3fe-4676-8e78-623fb1722df4 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:07.308702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-cf6bd3e1-11cc-49c7-8ab8-98916291fa9c None None] MFA Rules not processed for user `ec804ce0cd2841f7b0a032b3ee974702`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:07.311104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cf6bd3e1-11cc-49c7-8ab8-98916291fa9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:07.321865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56beb736-1b00-4cc3-9323-36708e622732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:07.322922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56beb736-1b00-4cc3-9323-36708e622732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:07.323816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56beb736-1b00-4cc3-9323-36708e622732 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:07.325105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56beb736-1b00-4cc3-9323-36708e622732 admin admin] PATH_INFO: `/v3/projects/669734ab7b7e4110a78bebf2327456e9` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:07.327845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56beb736-1b00-4cc3-9323-36708e622732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=669734ab7b7e4110a78bebf2327456e9)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:07.329529 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3179/6385] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:07 2022] POST /identity/v3/auth/tokens => generated 3363 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:07.332250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bd3e1-11cc-49c7-8ab8-98916291fa9c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:07.334348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56beb736-1b00-4cc3-9323-36708e622732 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:07.498487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bd3e1-11cc-49c7-8ab8-98916291fa9c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:07.510807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fcdb6-9703-4d13-83f4-1e5fdcffa1e3 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:07.511964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fcdb6-9703-4d13-83f4-1e5fdcffa1e3 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:07.512386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fcdb6-9703-4d13-83f4-1e5fdcffa1e3 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:07.512770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fcdb6-9703-4d13-83f4-1e5fdcffa1e3 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:07.513659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fcdb6-9703-4d13-83f4-1e5fdcffa1e3 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:07.516696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fcdb6-9703-4d13-83f4-1e5fdcffa1e3 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:07.550905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-56beb736-1b00-4cc3-9323-36708e622732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '669734ab7b7e4110a78bebf2327456e9', 'request_id': 'req-56beb736-1b00-4cc3-9323-36708e622732'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:07.562450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-56beb736-1b00-4cc3-9323-36708e622732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '669734ab7b7e4110a78bebf2327456e9', 'request_id': 'req-56beb736-1b00-4cc3-9323-36708e622732'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:07.569063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-56beb736-1b00-4cc3-9323-36708e622732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '669734ab7b7e4110a78bebf2327456e9', 'request_id': 'req-56beb736-1b00-4cc3-9323-36708e622732'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:07.620024 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3180/6386] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:07 2022] POST /identity/v3/users => generated 416 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:07.622972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fcdb6-9703-4d13-83f4-1e5fdcffa1e3 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:07.640603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fcdb6-9703-4d13-83f4-1e5fdcffa1e3 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:07.669723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-56beb736-1b00-4cc3-9323-36708e622732 admin admin] The token cache is being invalidate because project 669734ab7b7e4110a78bebf2327456e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:07.670025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-56beb736-1b00-4cc3-9323-36708e622732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:07.675060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-56beb736-1b00-4cc3-9323-36708e622732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:07.677098 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3207/6387] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:06 2022] DELETE /identity/v3/projects/669734ab7b7e4110a78bebf2327456e9 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:07.678133 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56beb736-1b00-4cc3-9323-36708e622732 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:07.684759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-56beb736-1b00-4cc3-9323-36708e622732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:07.812563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a2dd8-77ad-4fe4-abb1-83675423f405 tempest-test_project-2022384074 tempest-user-1225011622] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec804ce0cd2841f7b0a032b3ee974702', 'user_domain_id': '5609b8e972e047a7bf81006d023d93f3', 'system_scope': None, 'project_id': '3c18c556086f44dc8a1d54f4577de7a7', 'project_domain_id': '5609b8e972e047a7bf81006d023d93f3', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:07.813919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a2dd8-77ad-4fe4-abb1-83675423f405 tempest-test_project-2022384074 tempest-user-1225011622] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:07.815174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a2dd8-77ad-4fe4-abb1-83675423f405 tempest-test_project-2022384074 tempest-user-1225011622] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:07.816386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a2dd8-77ad-4fe4-abb1-83675423f405 tempest-test_project-2022384074 tempest-user-1225011622] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:07.818528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-618a2dd8-77ad-4fe4-abb1-83675423f405 tempest-test_project-2022384074 tempest-user-1225011622] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:07.842081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a2dd8-77ad-4fe4-abb1-83675423f405 tempest-test_project-2022384074 tempest-user-1225011622] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:07.845251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a2dd8-77ad-4fe4-abb1-83675423f405 tempest-test_project-2022384074 tempest-user-1225011622] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:07.861766 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3181/6388] 10.222.0.20 () {56 vars in 1284 bytes} [Thu Oct 27 03:50:07 2022] GET /identity/v3/auth/tokens => generated 3363 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:50:07.866179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54d760-c130-4abf-8990-b6e4119827d0 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:07.866595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54d760-c130-4abf-8990-b6e4119827d0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:07.867335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54d760-c130-4abf-8990-b6e4119827d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:07.904254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56beb736-1b00-4cc3-9323-36708e622732 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:07.918513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cd841-b846-41d6-8f3c-8c62c22b0497 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:07.923552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cd841-b846-41d6-8f3c-8c62c22b0497 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:07.924041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cd841-b846-41d6-8f3c-8c62c22b0497 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:07.924530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cd841-b846-41d6-8f3c-8c62c22b0497 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/users/9e2bb56eb48b40c88a85558b8f0c549c` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:07.928007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ef54d760-c130-4abf-8990-b6e4119827d0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:07.929731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ef54d760-c130-4abf-8990-b6e4119827d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:07.936384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:07.962150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cd841-b846-41d6-8f3c-8c62c22b0497 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:get_user(user_id=9e2bb56eb48b40c88a85558b8f0c549c)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:07.965299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cd841-b846-41d6-8f3c-8c62c22b0497 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:07.967336 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3208/6389] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 03:50:07 2022] GET /identity/v3/users/9e2bb56eb48b40c88a85558b8f0c549c => generated 416 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:07.972289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cd841-b846-41d6-8f3c-8c62c22b0497 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:07.979741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-429cd841-b846-41d6-8f3c-8c62c22b0497 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:08.152179 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3182/6390] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:08.156454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54d760-c130-4abf-8990-b6e4119827d0 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:08.172184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cd841-b846-41d6-8f3c-8c62c22b0497 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:08.185730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71390d3-a647-4a36-b92b-c1060aa3dce4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ca180f57ac048be8d48488cc206a1f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dd49f3652264b84b685dca4bb8ef50d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:08.186738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71390d3-a647-4a36-b92b-c1060aa3dce4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:08.187037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71390d3-a647-4a36-b92b-c1060aa3dce4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:08.187320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71390d3-a647-4a36-b92b-c1060aa3dce4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] PATH_INFO: `/v3/users/ec804ce0cd2841f7b0a032b3ee974702` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:08.188387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54d760-c130-4abf-8990-b6e4119827d0 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:08.190628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71390d3-a647-4a36-b92b-c1060aa3dce4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ec804ce0cd2841f7b0a032b3ee974702)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:08.192580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71390d3-a647-4a36-b92b-c1060aa3dce4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:08.227208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2223fe3-ebca-45c3-be81-bb765de17ce8 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:08.229535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2223fe3-ebca-45c3-be81-bb765de17ce8 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:08.229833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2223fe3-ebca-45c3-be81-bb765de17ce8 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:08.230199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2223fe3-ebca-45c3-be81-bb765de17ce8 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/users/9e2bb56eb48b40c88a85558b8f0c549c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:08.232225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2223fe3-ebca-45c3-be81-bb765de17ce8 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9e2bb56eb48b40c88a85558b8f0c549c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:08.234467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2223fe3-ebca-45c3-be81-bb765de17ce8 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:08.269478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:08.390140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b2223fe3-ebca-45c3-be81-bb765de17ce8 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e2bb56eb48b40c88a85558b8f0c549c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:08.391559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b2223fe3-ebca-45c3-be81-bb765de17ce8 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e2bb56eb48b40c88a85558b8f0c549c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:08.410589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b2223fe3-ebca-45c3-be81-bb765de17ce8 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e2bb56eb48b40c88a85558b8f0c549c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:08.435769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b2223fe3-ebca-45c3-be81-bb765de17ce8 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e2bb56eb48b40c88a85558b8f0c549c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:08.505440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c71390d3-a647-4a36-b92b-c1060aa3dce4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec804ce0cd2841f7b0a032b3ee974702'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:08.505440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c71390d3-a647-4a36-b92b-c1060aa3dce4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec804ce0cd2841f7b0a032b3ee974702'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:08.525823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c71390d3-a647-4a36-b92b-c1060aa3dce4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec804ce0cd2841f7b0a032b3ee974702'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:08.555138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b2223fe3-ebca-45c3-be81-bb765de17ce8 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e2bb56eb48b40c88a85558b8f0c549c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:08.563185 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3183/6391] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:08 2022] DELETE /identity/v3/users/9e2bb56eb48b40c88a85558b8f0c549c => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:08.564532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2198957-1017-4a03-850d-903604f39a8b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:08.573465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2198957-1017-4a03-850d-903604f39a8b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:08.573465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2198957-1017-4a03-850d-903604f39a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:08.573667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c71390d3-a647-4a36-b92b-c1060aa3dce4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec804ce0cd2841f7b0a032b3ee974702'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:08.573667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c71390d3-a647-4a36-b92b-c1060aa3dce4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec804ce0cd2841f7b0a032b3ee974702'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:08.596999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c2198957-1017-4a03-850d-903604f39a8b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:08.597200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c2198957-1017-4a03-850d-903604f39a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:08.648660 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3209/6392] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:07 2022] DELETE /identity/v3/users/ec804ce0cd2841f7b0a032b3ee974702 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:08.652911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71390d3-a647-4a36-b92b-c1060aa3dce4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:08.655578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c71390d3-a647-4a36-b92b-c1060aa3dce4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:08.765730 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3184/6393] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:08.766411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2198957-1017-4a03-850d-903604f39a8b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:08.767756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c2198957-1017-4a03-850d-903604f39a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:08.770230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71390d3-a647-4a36-b92b-c1060aa3dce4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:08.780650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8027994-412f-4331-ab16-63dd2cf1d991 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:08.784531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8027994-412f-4331-ab16-63dd2cf1d991 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:08.784531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8027994-412f-4331-ab16-63dd2cf1d991 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:08.784531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8027994-412f-4331-ab16-63dd2cf1d991 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects/1e30422cd8b049de95ef5f581834ac94` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:08.784805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8027994-412f-4331-ab16-63dd2cf1d991 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1e30422cd8b049de95ef5f581834ac94)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:08.788104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8027994-412f-4331-ab16-63dd2cf1d991 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:08.883912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2198957-1017-4a03-850d-903604f39a8b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:08.986229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e8027994-412f-4331-ab16-63dd2cf1d991 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e30422cd8b049de95ef5f581834ac94', 'request_id': 'req-e8027994-412f-4331-ab16-63dd2cf1d991'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:08.996584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e8027994-412f-4331-ab16-63dd2cf1d991 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e30422cd8b049de95ef5f581834ac94', 'request_id': 'req-e8027994-412f-4331-ab16-63dd2cf1d991'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:09.002169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9e9c2-648e-4a5a-b8d6-249f028c82f3 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ca180f57ac048be8d48488cc206a1f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dd49f3652264b84b685dca4bb8ef50d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:09.002986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9e9c2-648e-4a5a-b8d6-249f028c82f3 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:09.003353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9e9c2-648e-4a5a-b8d6-249f028c82f3 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:09.003833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9e9c2-648e-4a5a-b8d6-249f028c82f3 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] PATH_INFO: `/v3/projects/3c18c556086f44dc8a1d54f4577de7a7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:09.007476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e8027994-412f-4331-ab16-63dd2cf1d991 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e30422cd8b049de95ef5f581834ac94', 'request_id': 'req-e8027994-412f-4331-ab16-63dd2cf1d991'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:09.013358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9e9c2-648e-4a5a-b8d6-249f028c82f3 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3c18c556086f44dc8a1d54f4577de7a7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:09.020114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9e9c2-648e-4a5a-b8d6-249f028c82f3 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:09.083250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e8027994-412f-4331-ab16-63dd2cf1d991 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] The token cache is being invalidate because project 1e30422cd8b049de95ef5f581834ac94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:09.085506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e8027994-412f-4331-ab16-63dd2cf1d991 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:09.086899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e8027994-412f-4331-ab16-63dd2cf1d991 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:09.091611 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3210/6394] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:08 2022] DELETE /identity/v3/projects/1e30422cd8b049de95ef5f581834ac94 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:09.093233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8027994-412f-4331-ab16-63dd2cf1d991 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:09.097960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e8027994-412f-4331-ab16-63dd2cf1d991 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:09.188868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2fe9e9c2-648e-4a5a-b8d6-249f028c82f3 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c18c556086f44dc8a1d54f4577de7a7', 'request_id': 'req-2fe9e9c2-648e-4a5a-b8d6-249f028c82f3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:09.246560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2fe9e9c2-648e-4a5a-b8d6-249f028c82f3 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c18c556086f44dc8a1d54f4577de7a7', 'request_id': 'req-2fe9e9c2-648e-4a5a-b8d6-249f028c82f3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:09.258011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2fe9e9c2-648e-4a5a-b8d6-249f028c82f3 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c18c556086f44dc8a1d54f4577de7a7', 'request_id': 'req-2fe9e9c2-648e-4a5a-b8d6-249f028c82f3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:09.281294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2fe9e9c2-648e-4a5a-b8d6-249f028c82f3 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] The token cache is being invalidate because project 3c18c556086f44dc8a1d54f4577de7a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:09.281601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2fe9e9c2-648e-4a5a-b8d6-249f028c82f3 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:09.284243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2fe9e9c2-648e-4a5a-b8d6-249f028c82f3 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:09.297298 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3185/6395] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:08 2022] DELETE /identity/v3/projects/3c18c556086f44dc8a1d54f4577de7a7 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:09.297991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8027994-412f-4331-ab16-63dd2cf1d991 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:09.298762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9e9c2-648e-4a5a-b8d6-249f028c82f3 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:09.298762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2fe9e9c2-648e-4a5a-b8d6-249f028c82f3 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:09.465710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cb891-b2ba-4974-a732-1d0370ec6cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:09.466379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cb891-b2ba-4974-a732-1d0370ec6cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:09.466661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cb891-b2ba-4974-a732-1d0370ec6cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:09.466938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cb891-b2ba-4974-a732-1d0370ec6cf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:09.467900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949cb891-b2ba-4974-a732-1d0370ec6cf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:50:09.468361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949cb891-b2ba-4974-a732-1d0370ec6cf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:09.470086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949cb891-b2ba-4974-a732-1d0370ec6cf9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:09.489124 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3211/6396] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:09.489697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cb891-b2ba-4974-a732-1d0370ec6cf9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:09.491938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-949cb891-b2ba-4974-a732-1d0370ec6cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:09.517505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9e9c2-648e-4a5a-b8d6-249f028c82f3 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:09.536554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e04c0-d601-4d8f-bb34-75945471a2ed tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:09.538668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e04c0-d601-4d8f-bb34-75945471a2ed tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:09.538980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e04c0-d601-4d8f-bb34-75945471a2ed tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:09.546399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e04c0-d601-4d8f-bb34-75945471a2ed tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:09.546399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e04c0-d601-4d8f-bb34-75945471a2ed tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:09.550231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e04c0-d601-4d8f-bb34-75945471a2ed tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:09.614767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cb891-b2ba-4974-a732-1d0370ec6cf9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:09.629966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20d186-4550-407b-9f78-319b81e29c7d tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ca180f57ac048be8d48488cc206a1f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dd49f3652264b84b685dca4bb8ef50d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:09.630771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20d186-4550-407b-9f78-319b81e29c7d tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:09.632058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20d186-4550-407b-9f78-319b81e29c7d tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:09.632058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20d186-4550-407b-9f78-319b81e29c7d tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] PATH_INFO: `/v3/domains/5609b8e972e047a7bf81006d023d93f3` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:09.635585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20d186-4550-407b-9f78-319b81e29c7d tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5609b8e972e047a7bf81006d023d93f3)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:09.638999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20d186-4550-407b-9f78-319b81e29c7d tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:09.658506 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3186/6397] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:09 2022] POST /identity/v3/projects => generated 348 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:09.658506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e04c0-d601-4d8f-bb34-75945471a2ed tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:09.661199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-947e04c0-d601-4d8f-bb34-75945471a2ed tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:09.698338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7b20d186-4550-407b-9f78-319b81e29c7d tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5609b8e972e047a7bf81006d023d93f3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:09.701413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7b20d186-4550-407b-9f78-319b81e29c7d tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5609b8e972e047a7bf81006d023d93f3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:09.843979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7b20d186-4550-407b-9f78-319b81e29c7d tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5609b8e972e047a7bf81006d023d93f3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:09.845337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7b20d186-4550-407b-9f78-319b81e29c7d tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5609b8e972e047a7bf81006d023d93f3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:09.849117 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3212/6398] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:50:09 2022] PATCH /identity/v3/domains/5609b8e972e047a7bf81006d023d93f3 => generated 247 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:09.850209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20d186-4550-407b-9f78-319b81e29c7d tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:09.852904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7b20d186-4550-407b-9f78-319b81e29c7d tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:09.853292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e04c0-d601-4d8f-bb34-75945471a2ed tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:09.972303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e042aa7-9894-46cb-9a15-af4a947a402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:09.973783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e042aa7-9894-46cb-9a15-af4a947a402b admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:09.974093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e042aa7-9894-46cb-9a15-af4a947a402b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:09.974378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e042aa7-9894-46cb-9a15-af4a947a402b admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:09.975032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e042aa7-9894-46cb-9a15-af4a947a402b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:09.977009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e042aa7-9894-46cb-9a15-af4a947a402b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:09.999894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20d186-4550-407b-9f78-319b81e29c7d tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:10.009999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e626e56-ebec-4f54-805d-0850fa43a474 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:10.010665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e626e56-ebec-4f54-805d-0850fa43a474 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:10.010958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e626e56-ebec-4f54-805d-0850fa43a474 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:10.011250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e626e56-ebec-4f54-805d-0850fa43a474 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:10.011942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e626e56-ebec-4f54-805d-0850fa43a474 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:50:10.012702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e626e56-ebec-4f54-805d-0850fa43a474 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:10.018407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e626e56-ebec-4f54-805d-0850fa43a474 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:10.024136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:10.034666 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3213/6399] 10.222.0.20 () {58 vars in 1160 bytes} [Thu Oct 27 03:50:09 2022] GET /identity/v3/projects?is_domain=True => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:10.034666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e626e56-ebec-4f54-805d-0850fa43a474 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:10.038384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9e626e56-ebec-4f54-805d-0850fa43a474 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:10.146291 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3187/6400] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:09 2022] POST /identity/v3/projects => generated 365 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:10.146291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e042aa7-9894-46cb-9a15-af4a947a402b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:10.171226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e626e56-ebec-4f54-805d-0850fa43a474 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:10.390076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:10.418545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fd5db-4d9b-4ec3-8113-4a905d9298f4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ca180f57ac048be8d48488cc206a1f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dd49f3652264b84b685dca4bb8ef50d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:10.422720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e042aa7-9894-46cb-9a15-af4a947a402b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:10.422844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fd5db-4d9b-4ec3-8113-4a905d9298f4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:10.422844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fd5db-4d9b-4ec3-8113-4a905d9298f4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:10.422844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fd5db-4d9b-4ec3-8113-4a905d9298f4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] PATH_INFO: `/v3/domains/5609b8e972e047a7bf81006d023d93f3` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:10.447049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4dac6-f50c-4ac7-9118-f46a5cbdd48b tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:10.451451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4dac6-f50c-4ac7-9118-f46a5cbdd48b tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:10.451451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4dac6-f50c-4ac7-9118-f46a5cbdd48b tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:10.451451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4dac6-f50c-4ac7-9118-f46a5cbdd48b tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:10.451451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4dac6-f50c-4ac7-9118-f46a5cbdd48b tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:10.451451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4dac6-f50c-4ac7-9118-f46a5cbdd48b tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:10.457708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726fd5db-4d9b-4ec3-8113-4a905d9298f4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5609b8e972e047a7bf81006d023d93f3)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:10.459593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726fd5db-4d9b-4ec3-8113-4a905d9298f4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:10.494582 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3188/6401] 10.222.0.20 () {58 vars in 1128 bytes} [Thu Oct 27 03:50:10 2022] GET /identity/v3/domains => generated 1065 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:10.494887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4dac6-f50c-4ac7-9118-f46a5cbdd48b tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:10.508820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-726fd5db-4d9b-4ec3-8113-4a905d9298f4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5609b8e972e047a7bf81006d023d93f3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:10.508959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a9d4dac6-f50c-4ac7-9118-f46a5cbdd48b tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:10.528481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-726fd5db-4d9b-4ec3-8113-4a905d9298f4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5609b8e972e047a7bf81006d023d93f3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:10.702669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-726fd5db-4d9b-4ec3-8113-4a905d9298f4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5609b8e972e047a7bf81006d023d93f3', 'request_id': 'req-726fd5db-4d9b-4ec3-8113-4a905d9298f4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:10.721592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-726fd5db-4d9b-4ec3-8113-4a905d9298f4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5609b8e972e047a7bf81006d023d93f3', 'request_id': 'req-726fd5db-4d9b-4ec3-8113-4a905d9298f4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:10.735720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-726fd5db-4d9b-4ec3-8113-4a905d9298f4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5609b8e972e047a7bf81006d023d93f3', 'request_id': 'req-726fd5db-4d9b-4ec3-8113-4a905d9298f4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:10.750775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4dac6-f50c-4ac7-9118-f46a5cbdd48b tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:10.850070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-726fd5db-4d9b-4ec3-8113-4a905d9298f4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] The token cache is being invalidate because project 5609b8e972e047a7bf81006d023d93f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:10.850070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-726fd5db-4d9b-4ec3-8113-4a905d9298f4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:10.850070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-726fd5db-4d9b-4ec3-8113-4a905d9298f4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:10.864930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-726fd5db-4d9b-4ec3-8113-4a905d9298f4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5609b8e972e047a7bf81006d023d93f3', 'request_id': 'req-726fd5db-4d9b-4ec3-8113-4a905d9298f4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:10.865673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-726fd5db-4d9b-4ec3-8113-4a905d9298f4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5609b8e972e047a7bf81006d023d93f3', 'request_id': 'req-726fd5db-4d9b-4ec3-8113-4a905d9298f4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:10.866334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-726fd5db-4d9b-4ec3-8113-4a905d9298f4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5609b8e972e047a7bf81006d023d93f3', 'request_id': 'req-726fd5db-4d9b-4ec3-8113-4a905d9298f4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:10.892404 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3214/6402] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:50:10 2022] DELETE /identity/v3/domains/5609b8e972e047a7bf81006d023d93f3 => generated 0 bytes in 858 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:10.895405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fd5db-4d9b-4ec3-8113-4a905d9298f4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:10.901164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-726fd5db-4d9b-4ec3-8113-4a905d9298f4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:10.926837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fe606-b74b-441a-8544-36e6f8bc96c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:10.927465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fe606-b74b-441a-8544-36e6f8bc96c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:10.927747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fe606-b74b-441a-8544-36e6f8bc96c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:10.928022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fe606-b74b-441a-8544-36e6f8bc96c2 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:10.928663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3fe606-b74b-441a-8544-36e6f8bc96c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:10.931669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3fe606-b74b-441a-8544-36e6f8bc96c2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:11.054227 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3189/6403] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:10 2022] POST /identity/v3/users => generated 283 bytes in 559 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:11.055414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fe606-b74b-441a-8544-36e6f8bc96c2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:11.064427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2b3fe606-b74b-441a-8544-36e6f8bc96c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:11.108630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fd5db-4d9b-4ec3-8113-4a905d9298f4 tempest-TestDefaultProjectId-1801598456 tempest-TestDefaultProjectId-1801598456-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:11.128134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d251d6-f2aa-4803-999b-6658a9f5934f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:11.129916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d251d6-f2aa-4803-999b-6658a9f5934f service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:11.131743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d251d6-f2aa-4803-999b-6658a9f5934f service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:11.132035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d251d6-f2aa-4803-999b-6658a9f5934f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:11.134446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-75d251d6-f2aa-4803-999b-6658a9f5934f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:11.170013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d251d6-f2aa-4803-999b-6658a9f5934f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:11.173302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d251d6-f2aa-4803-999b-6658a9f5934f service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:11.199158 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3215/6404] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:50:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:50:11.201113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d251d6-f2aa-4803-999b-6658a9f5934f service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:11.208586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-75d251d6-f2aa-4803-999b-6658a9f5934f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:11.287792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fe606-b74b-441a-8544-36e6f8bc96c2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:11.295796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d251d6-f2aa-4803-999b-6658a9f5934f service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:11.307877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f29203-2323-4bd4-bcd0-6d49ec0ab925 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:11.316784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f29203-2323-4bd4-bcd0-6d49ec0ab925 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:11.317716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f29203-2323-4bd4-bcd0-6d49ec0ab925 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:11.318921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f29203-2323-4bd4-bcd0-6d49ec0ab925 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects/f73b4a10751846b28f7f399febbe63d9` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:11.323105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23204e8e-8924-4d89-8c5e-5296c98a9197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:11.323997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f29203-2323-4bd4-bcd0-6d49ec0ab925 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:update_project(project_id=f73b4a10751846b28f7f399febbe63d9)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:11.331597 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-72f29203-2323-4bd4-bcd0-6d49ec0ab925 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:50:11.331597 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:50:11.331597 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:50:11.333606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23204e8e-8924-4d89-8c5e-5296c98a9197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:11.333606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23204e8e-8924-4d89-8c5e-5296c98a9197 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:11.333606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23204e8e-8924-4d89-8c5e-5296c98a9197 admin admin] PATH_INFO: `/v3/users/2083833c3660430a9930e1615887ec5e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:11.338199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f29203-2323-4bd4-bcd0-6d49ec0ab925 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:11.344831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23204e8e-8924-4d89-8c5e-5296c98a9197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2083833c3660430a9930e1615887ec5e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:11.361307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23204e8e-8924-4d89-8c5e-5296c98a9197 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:11.404905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-72f29203-2323-4bd4-bcd0-6d49ec0ab925 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f73b4a10751846b28f7f399febbe63d9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:11.412806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:11.416774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-72f29203-2323-4bd4-bcd0-6d49ec0ab925 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f73b4a10751846b28f7f399febbe63d9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:11.566425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-72f29203-2323-4bd4-bcd0-6d49ec0ab925 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f73b4a10751846b28f7f399febbe63d9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:11.570722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-72f29203-2323-4bd4-bcd0-6d49ec0ab925 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f73b4a10751846b28f7f399febbe63d9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:11.573216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:11.580138 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3190/6405] 10.222.0.20 () {60 vars in 1252 bytes} [Thu Oct 27 03:50:11 2022] PATCH /identity/v3/projects/f73b4a10751846b28f7f399febbe63d9 => generated 362 bytes in 525 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:11.582365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f29203-2323-4bd4-bcd0-6d49ec0ab925 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:11.585332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-72f29203-2323-4bd4-bcd0-6d49ec0ab925 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:11.647897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-23204e8e-8924-4d89-8c5e-5296c98a9197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2083833c3660430a9930e1615887ec5e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:11.648850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-23204e8e-8924-4d89-8c5e-5296c98a9197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2083833c3660430a9930e1615887ec5e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:11.661637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-23204e8e-8924-4d89-8c5e-5296c98a9197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2083833c3660430a9930e1615887ec5e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:11.687002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-23204e8e-8924-4d89-8c5e-5296c98a9197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2083833c3660430a9930e1615887ec5e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:11.690377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-23204e8e-8924-4d89-8c5e-5296c98a9197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2083833c3660430a9930e1615887ec5e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:11.784453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f29203-2323-4bd4-bcd0-6d49ec0ab925 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:11.797210 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3216/6406] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:11 2022] DELETE /identity/v3/users/2083833c3660430a9930e1615887ec5e => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:11.798283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23204e8e-8924-4d89-8c5e-5296c98a9197 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:11.803216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-23204e8e-8924-4d89-8c5e-5296c98a9197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:11.804653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a6bfd-6431-44f1-8975-1409d26996c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:11.805417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a6bfd-6431-44f1-8975-1409d26996c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:11.805803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a6bfd-6431-44f1-8975-1409d26996c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:11.806356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a6bfd-6431-44f1-8975-1409d26996c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:11.807213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a6bfd-6431-44f1-8975-1409d26996c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:11.809094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a6bfd-6431-44f1-8975-1409d26996c1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:11.833581 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3191/6407] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:11.835406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2a1bf-b8a2-4419-b3a9-26b462bb83fd None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:11.835762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2a1bf-b8a2-4419-b3a9-26b462bb83fd None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:11.836149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2a1bf-b8a2-4419-b3a9-26b462bb83fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:11.878501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-43b2a1bf-b8a2-4419-b3a9-26b462bb83fd None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:11.880380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-43b2a1bf-b8a2-4419-b3a9-26b462bb83fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:11.956307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23204e8e-8924-4d89-8c5e-5296c98a9197 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:11.961341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:11.962293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:11.962411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:11.962694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects/f73b4a10751846b28f7f399febbe63d9` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:11.991992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f73b4a10751846b28f7f399febbe63d9)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:11.997313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:12.013622 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3192/6408] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:12.023290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f73b4a10751846b28f7f399febbe63d9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:12.023998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2a1bf-b8a2-4419-b3a9-26b462bb83fd None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:12.031657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-43b2a1bf-b8a2-4419-b3a9-26b462bb83fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:12.037108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f73b4a10751846b28f7f399febbe63d9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:12.066301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2a1bf-b8a2-4419-b3a9-26b462bb83fd None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:12.074646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a410886-7ca7-4c71-8144-9d220a7dbc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:12.075415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a410886-7ca7-4c71-8144-9d220a7dbc74 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:12.075758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a410886-7ca7-4c71-8144-9d220a7dbc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:12.075961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a410886-7ca7-4c71-8144-9d220a7dbc74 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:12.076679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a410886-7ca7-4c71-8144-9d220a7dbc74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:12.078656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a410886-7ca7-4c71-8144-9d220a7dbc74 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:12.100628 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3193/6409] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:12.101720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a410886-7ca7-4c71-8144-9d220a7dbc74 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:12.108044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7a410886-7ca7-4c71-8144-9d220a7dbc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:12.189549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:12.205324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f73b4a10751846b28f7f399febbe63d9', 'request_id': 'req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:12.222864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f73b4a10751846b28f7f399febbe63d9', 'request_id': 'req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:12.235155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f73b4a10751846b28f7f399febbe63d9', 'request_id': 'req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:12.287968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a410886-7ca7-4c71-8144-9d220a7dbc74 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:12.355189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] The token cache is being invalidate because project f73b4a10751846b28f7f399febbe63d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:12.355391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:12.356932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:12.374027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f73b4a10751846b28f7f399febbe63d9', 'request_id': 'req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:12.375523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f73b4a10751846b28f7f399febbe63d9', 'request_id': 'req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:12.376847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f73b4a10751846b28f7f399febbe63d9', 'request_id': 'req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:12.399452 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3217/6410] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:11 2022] DELETE /identity/v3/projects/f73b4a10751846b28f7f399febbe63d9 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:12.400705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:12.404432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:12.408838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dd457-c41e-43d9-83a3-c1af56a0948b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:12.409056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dd457-c41e-43d9-83a3-c1af56a0948b service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:12.409386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dd457-c41e-43d9-83a3-c1af56a0948b service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:12.409681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dd457-c41e-43d9-83a3-c1af56a0948b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:12.412210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cd9dd457-c41e-43d9-83a3-c1af56a0948b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:12.539618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dd457-c41e-43d9-83a3-c1af56a0948b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:12.541942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dd457-c41e-43d9-83a3-c1af56a0948b service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:12.554094 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3194/6411] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:50:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:50:12.555055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c96b5d-a05e-4f38-9fb0-8d523c7ce133 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:12.555400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dd457-c41e-43d9-83a3-c1af56a0948b service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:12.557445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cd9dd457-c41e-43d9-83a3-c1af56a0948b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:12.564886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7d711-ff19-4dd9-b5bb-58217a543d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:12.566002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7d711-ff19-4dd9-b5bb-58217a543d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:12.566473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7d711-ff19-4dd9-b5bb-58217a543d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:12.567614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7d711-ff19-4dd9-b5bb-58217a543d78 admin admin] PATH_INFO: `/v3/projects/e2cca4b32bdf4ebdad181afc86294ce8/users/adb550286b42468e93f89a49b3f3bf16/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:12.616720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7d711-ff19-4dd9-b5bb-58217a543d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2cca4b32bdf4ebdad181afc86294ce8, user_id=adb550286b42468e93f89a49b3f3bf16, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:12.625218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7d711-ff19-4dd9-b5bb-58217a543d78 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:12.706869 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3218/6412] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:12 2022] PUT /identity/v3/projects/e2cca4b32bdf4ebdad181afc86294ce8/users/adb550286b42468e93f89a49b3f3bf16/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:12.719485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951eb9e7-c60c-4e40-93fd-dddbe5171d3d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:12.719809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951eb9e7-c60c-4e40-93fd-dddbe5171d3d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:12.724628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951eb9e7-c60c-4e40-93fd-dddbe5171d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:12.774972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dd457-c41e-43d9-83a3-c1af56a0948b service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:12.842141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-951eb9e7-c60c-4e40-93fd-dddbe5171d3d None None] MFA Rules not processed for user `adb550286b42468e93f89a49b3f3bf16`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:12.843735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-951eb9e7-c60c-4e40-93fd-dddbe5171d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:12.892745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:12.926304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ae4e1-304a-4d75-945f-7b16933e34ca tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:12.926905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ae4e1-304a-4d75-945f-7b16933e34ca tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:12.927185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ae4e1-304a-4d75-945f-7b16933e34ca tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:12.927706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ae4e1-304a-4d75-945f-7b16933e34ca tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:12.928412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ae4e1-304a-4d75-945f-7b16933e34ca tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:12.932692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ae4e1-304a-4d75-945f-7b16933e34ca tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:13.037732 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3219/6413] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:13.044453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951eb9e7-c60c-4e40-93fd-dddbe5171d3d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:13.066981 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3195/6414] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:12 2022] POST /identity/v3/projects => generated 359 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:13.068477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ae4e1-304a-4d75-945f-7b16933e34ca tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:13.231511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951eb9e7-c60c-4e40-93fd-dddbe5171d3d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:13.232966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ae4e1-304a-4d75-945f-7b16933e34ca tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:13.250129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3c6d6-dc3d-44ee-b23f-028a4642f743 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:13.250899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3c6d6-dc3d-44ee-b23f-028a4642f743 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:13.251193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3c6d6-dc3d-44ee-b23f-028a4642f743 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:13.251620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3c6d6-dc3d-44ee-b23f-028a4642f743 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects/01bf99fda0fc4934973bde05b3bd13f8` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:13.253156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3c6d6-dc3d-44ee-b23f-028a4642f743 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:get_project(project_id=01bf99fda0fc4934973bde05b3bd13f8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:13.260268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3c6d6-dc3d-44ee-b23f-028a4642f743 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:13.270050 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3196/6415] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:50:13 2022] GET /identity/v3/projects/01bf99fda0fc4934973bde05b3bd13f8 => generated 359 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:50:13.271110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3c6d6-dc3d-44ee-b23f-028a4642f743 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:13.286228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3c6d6-dc3d-44ee-b23f-028a4642f743 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:13.293572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc90d9-0ad8-4334-9d29-30d8442d4736 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:13.296095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc90d9-0ad8-4334-9d29-30d8442d4736 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:13.296095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc90d9-0ad8-4334-9d29-30d8442d4736 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:13.296095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc90d9-0ad8-4334-9d29-30d8442d4736 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects/01bf99fda0fc4934973bde05b3bd13f8` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:13.297308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc90d9-0ad8-4334-9d29-30d8442d4736 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:delete_project(project_id=01bf99fda0fc4934973bde05b3bd13f8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:13.299509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc90d9-0ad8-4334-9d29-30d8442d4736 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:13.373955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9787249-5a2d-43b3-b656-f3e7ae59c588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:13.374653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9787249-5a2d-43b3-b656-f3e7ae59c588 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:13.374935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9787249-5a2d-43b3-b656-f3e7ae59c588 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:13.375208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9787249-5a2d-43b3-b656-f3e7ae59c588 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:13.375852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9787249-5a2d-43b3-b656-f3e7ae59c588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:13.377802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9787249-5a2d-43b3-b656-f3e7ae59c588 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:13.552147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d4cc90d9-0ad8-4334-9d29-30d8442d4736 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01bf99fda0fc4934973bde05b3bd13f8', 'request_id': 'req-d4cc90d9-0ad8-4334-9d29-30d8442d4736'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:13.663461 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3220/6416] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:13 2022] POST /identity/v3/projects => generated 369 bytes in 621 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:50:13.670861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9787249-5a2d-43b3-b656-f3e7ae59c588 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:13.715495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d4cc90d9-0ad8-4334-9d29-30d8442d4736 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01bf99fda0fc4934973bde05b3bd13f8', 'request_id': 'req-d4cc90d9-0ad8-4334-9d29-30d8442d4736'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:13.727972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d4cc90d9-0ad8-4334-9d29-30d8442d4736 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01bf99fda0fc4934973bde05b3bd13f8', 'request_id': 'req-d4cc90d9-0ad8-4334-9d29-30d8442d4736'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:13.739535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d4cc90d9-0ad8-4334-9d29-30d8442d4736 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] The token cache is being invalidate because project 01bf99fda0fc4934973bde05b3bd13f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:13.739887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d4cc90d9-0ad8-4334-9d29-30d8442d4736 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:13.740902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d4cc90d9-0ad8-4334-9d29-30d8442d4736 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:13.742978 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3197/6417] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:13 2022] DELETE /identity/v3/projects/01bf99fda0fc4934973bde05b3bd13f8 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:13.749470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc90d9-0ad8-4334-9d29-30d8442d4736 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:13.751836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d4cc90d9-0ad8-4334-9d29-30d8442d4736 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:13.783152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9787249-5a2d-43b3-b656-f3e7ae59c588 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:13.803700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99ca39-7c6a-4fb5-bb95-5b3ecb5af751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:13.804428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99ca39-7c6a-4fb5-bb95-5b3ecb5af751 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:13.804715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99ca39-7c6a-4fb5-bb95-5b3ecb5af751 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:13.805001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99ca39-7c6a-4fb5-bb95-5b3ecb5af751 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:13.806878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99ca39-7c6a-4fb5-bb95-5b3ecb5af751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:13.812938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99ca39-7c6a-4fb5-bb95-5b3ecb5af751 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:13.856248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc90d9-0ad8-4334-9d29-30d8442d4736 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:13.941468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e3cbe-50f4-4ee8-be4c-5573df727159 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:13.942158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e3cbe-50f4-4ee8-be4c-5573df727159 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:13.942421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e3cbe-50f4-4ee8-be4c-5573df727159 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:13.942704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e3cbe-50f4-4ee8-be4c-5573df727159 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:13.943349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e3cbe-50f4-4ee8-be4c-5573df727159 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:13.945235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e3cbe-50f4-4ee8-be4c-5573df727159 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:13.963464 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3221/6418] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:13 2022] POST /identity/v3/users => generated 291 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:50:13.964338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99ca39-7c6a-4fb5-bb95-5b3ecb5af751 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:13.965970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1c99ca39-7c6a-4fb5-bb95-5b3ecb5af751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:13.981271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99ca39-7c6a-4fb5-bb95-5b3ecb5af751 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:13.986977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e3d6a-3b0e-4fbc-8174-6cf840ab4935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:13.990984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e3d6a-3b0e-4fbc-8174-6cf840ab4935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:13.993948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e3d6a-3b0e-4fbc-8174-6cf840ab4935 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:13.995828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e3d6a-3b0e-4fbc-8174-6cf840ab4935 admin admin] PATH_INFO: `/v3/projects/f2387544050b4ccb8b97310b7bffe1bc` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:13.999834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e3d6a-3b0e-4fbc-8174-6cf840ab4935 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2387544050b4ccb8b97310b7bffe1bc)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:14.010223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e3d6a-3b0e-4fbc-8174-6cf840ab4935 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:14.094006 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3198/6419] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:13 2022] POST /identity/v3/projects => generated 360 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:14.096500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e3cbe-50f4-4ee8-be4c-5573df727159 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:14.110097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-980e3cbe-50f4-4ee8-be4c-5573df727159 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:14.214356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e3cbe-50f4-4ee8-be4c-5573df727159 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:14.220515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e78904-aa5d-46f8-8987-7029d12b9d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:14.226281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e78904-aa5d-46f8-8987-7029d12b9d55 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:14.226281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e78904-aa5d-46f8-8987-7029d12b9d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:14.226281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e78904-aa5d-46f8-8987-7029d12b9d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:14.226281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e78904-aa5d-46f8-8987-7029d12b9d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:14.226281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e78904-aa5d-46f8-8987-7029d12b9d55 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:14.240819 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3199/6420] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:14.241418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e78904-aa5d-46f8-8987-7029d12b9d55 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:14.288771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2a7e3d6a-3b0e-4fbc-8174-6cf840ab4935 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2387544050b4ccb8b97310b7bffe1bc', 'request_id': 'req-2a7e3d6a-3b0e-4fbc-8174-6cf840ab4935'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:14.302150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2a7e3d6a-3b0e-4fbc-8174-6cf840ab4935 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2387544050b4ccb8b97310b7bffe1bc', 'request_id': 'req-2a7e3d6a-3b0e-4fbc-8174-6cf840ab4935'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:14.303774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:14.314600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2a7e3d6a-3b0e-4fbc-8174-6cf840ab4935 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2387544050b4ccb8b97310b7bffe1bc', 'request_id': 'req-2a7e3d6a-3b0e-4fbc-8174-6cf840ab4935'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:14.380647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e78904-aa5d-46f8-8987-7029d12b9d55 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:14.430211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2a7e3d6a-3b0e-4fbc-8174-6cf840ab4935 admin admin] The token cache is being invalidate because project f2387544050b4ccb8b97310b7bffe1bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:14.430211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2a7e3d6a-3b0e-4fbc-8174-6cf840ab4935 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:14.430211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2a7e3d6a-3b0e-4fbc-8174-6cf840ab4935 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:14.430211 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3222/6421] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:13 2022] DELETE /identity/v3/projects/f2387544050b4ccb8b97310b7bffe1bc => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:14.430211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e3d6a-3b0e-4fbc-8174-6cf840ab4935 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:14.436424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2a7e3d6a-3b0e-4fbc-8174-6cf840ab4935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:14.473359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7627b0-d854-4a84-8662-3a89edae0b2c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:14.474261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7627b0-d854-4a84-8662-3a89edae0b2c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:14.474552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7627b0-d854-4a84-8662-3a89edae0b2c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:14.474825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7627b0-d854-4a84-8662-3a89edae0b2c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects/c2f1bc170d254acbbc5b9751743486eb` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:14.476488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7627b0-d854-4a84-8662-3a89edae0b2c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:get_project(project_id=c2f1bc170d254acbbc5b9751743486eb)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:14.482683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7627b0-d854-4a84-8662-3a89edae0b2c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:14.487679 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3200/6422] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:50:14 2022] GET /identity/v3/projects/c2f1bc170d254acbbc5b9751743486eb => generated 360 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:14.488552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7627b0-d854-4a84-8662-3a89edae0b2c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:14.496463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3f7627b0-d854-4a84-8662-3a89edae0b2c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:14.585667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e3d6a-3b0e-4fbc-8174-6cf840ab4935 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:14.594353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e3ad3-9f1f-4982-b3ca-7aa0d86a312f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:14.595365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e3ad3-9f1f-4982-b3ca-7aa0d86a312f admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:14.595861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e3ad3-9f1f-4982-b3ca-7aa0d86a312f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:14.598940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e3ad3-9f1f-4982-b3ca-7aa0d86a312f admin admin] PATH_INFO: `/v3/projects/836480e15b044223b9c182223bb75c12/users/af95b36ae4fc4fffb589933feed17d22/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:14.606359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7627b0-d854-4a84-8662-3a89edae0b2c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:14.611656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f0cfb-21c5-4f77-a182-c48988334fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:14.612310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f0cfb-21c5-4f77-a182-c48988334fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:14.612942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f0cfb-21c5-4f77-a182-c48988334fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:14.613303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f0cfb-21c5-4f77-a182-c48988334fe2 admin admin] PATH_INFO: `/v3/users/2ca180f57ac048be8d48488cc206a1f7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:14.614776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f0cfb-21c5-4f77-a182-c48988334fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca180f57ac048be8d48488cc206a1f7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:14.617168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f0cfb-21c5-4f77-a182-c48988334fe2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:14.617881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e3ad3-9f1f-4982-b3ca-7aa0d86a312f admin admin] RBAC: Authorizing `identity:create_grant(project_id=836480e15b044223b9c182223bb75c12, user_id=af95b36ae4fc4fffb589933feed17d22, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:14.621828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e3ad3-9f1f-4982-b3ca-7aa0d86a312f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:14.726937 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3223/6423] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:14 2022] PUT /identity/v3/projects/836480e15b044223b9c182223bb75c12/users/af95b36ae4fc4fffb589933feed17d22/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:14.729902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e3ad3-9f1f-4982-b3ca-7aa0d86a312f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:14.734257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-aa8e3ad3-9f1f-4982-b3ca-7aa0d86a312f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:14.753790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:14.900355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-057f0cfb-21c5-4f77-a182-c48988334fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca180f57ac048be8d48488cc206a1f7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:14.907056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-057f0cfb-21c5-4f77-a182-c48988334fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca180f57ac048be8d48488cc206a1f7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:14.965184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-057f0cfb-21c5-4f77-a182-c48988334fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca180f57ac048be8d48488cc206a1f7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:15.037466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-057f0cfb-21c5-4f77-a182-c48988334fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca180f57ac048be8d48488cc206a1f7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:15.060900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e3ad3-9f1f-4982-b3ca-7aa0d86a312f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:15.080625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947daef1-564a-4a04-8e54-f98de768d2f0 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:15.081327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947daef1-564a-4a04-8e54-f98de768d2f0 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:15.083490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947daef1-564a-4a04-8e54-f98de768d2f0 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:15.083822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947daef1-564a-4a04-8e54-f98de768d2f0 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects/c2f1bc170d254acbbc5b9751743486eb` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:15.086753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947daef1-564a-4a04-8e54-f98de768d2f0 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c2f1bc170d254acbbc5b9751743486eb)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:15.092321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947daef1-564a-4a04-8e54-f98de768d2f0 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:15.122227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-057f0cfb-21c5-4f77-a182-c48988334fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca180f57ac048be8d48488cc206a1f7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:15.130720 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3201/6424] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:14 2022] DELETE /identity/v3/users/2ca180f57ac048be8d48488cc206a1f7 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:15.131567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f0cfb-21c5-4f77-a182-c48988334fe2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:15.133908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-057f0cfb-21c5-4f77-a182-c48988334fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:15.375448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-947daef1-564a-4a04-8e54-f98de768d2f0 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2f1bc170d254acbbc5b9751743486eb', 'request_id': 'req-947daef1-564a-4a04-8e54-f98de768d2f0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:15.413612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-947daef1-564a-4a04-8e54-f98de768d2f0 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2f1bc170d254acbbc5b9751743486eb', 'request_id': 'req-947daef1-564a-4a04-8e54-f98de768d2f0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:15.436273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-947daef1-564a-4a04-8e54-f98de768d2f0 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2f1bc170d254acbbc5b9751743486eb', 'request_id': 'req-947daef1-564a-4a04-8e54-f98de768d2f0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:15.494499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f0cfb-21c5-4f77-a182-c48988334fe2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:15.623896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-947daef1-564a-4a04-8e54-f98de768d2f0 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] The token cache is being invalidate because project c2f1bc170d254acbbc5b9751743486eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:15.624650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-947daef1-564a-4a04-8e54-f98de768d2f0 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:15.626049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-947daef1-564a-4a04-8e54-f98de768d2f0 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:15.628732 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3224/6425] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:14 2022] DELETE /identity/v3/projects/c2f1bc170d254acbbc5b9751743486eb => generated 0 bytes in 901 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:15.634312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947daef1-564a-4a04-8e54-f98de768d2f0 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:15.638948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-947daef1-564a-4a04-8e54-f98de768d2f0 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:15.664503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8942d76-4e81-4096-a1e6-6d2315729261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:15.666492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8942d76-4e81-4096-a1e6-6d2315729261 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:15.668013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8942d76-4e81-4096-a1e6-6d2315729261 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:15.668355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8942d76-4e81-4096-a1e6-6d2315729261 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:15.670122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8942d76-4e81-4096-a1e6-6d2315729261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:15.675642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8942d76-4e81-4096-a1e6-6d2315729261 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:15.726113 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3202/6426] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 595 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:15.732191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8942d76-4e81-4096-a1e6-6d2315729261 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:15.736249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e8942d76-4e81-4096-a1e6-6d2315729261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:15.786496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8942d76-4e81-4096-a1e6-6d2315729261 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:15.809092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8e5f4-553a-4ff8-a098-28916ddc1029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:15.810251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8e5f4-553a-4ff8-a098-28916ddc1029 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:15.812291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8e5f4-553a-4ff8-a098-28916ddc1029 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:15.813547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8e5f4-553a-4ff8-a098-28916ddc1029 admin admin] PATH_INFO: `/v3/projects/836480e15b044223b9c182223bb75c12/users/af95b36ae4fc4fffb589933feed17d22/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:15.824275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947daef1-564a-4a04-8e54-f98de768d2f0 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:15.826318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8e5f4-553a-4ff8-a098-28916ddc1029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=836480e15b044223b9c182223bb75c12, user_id=af95b36ae4fc4fffb589933feed17d22, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:15.832223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8e5f4-553a-4ff8-a098-28916ddc1029 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:15.847342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1d923-3793-4804-8ee7-dea7dd5a3bd6 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:15.847988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1d923-3793-4804-8ee7-dea7dd5a3bd6 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:15.848277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1d923-3793-4804-8ee7-dea7dd5a3bd6 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:15.848559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1d923-3793-4804-8ee7-dea7dd5a3bd6 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:15.849204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1d923-3793-4804-8ee7-dea7dd5a3bd6 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:15.851144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1d923-3793-4804-8ee7-dea7dd5a3bd6 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:15.884929 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3203/6427] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:15 2022] PUT /identity/v3/projects/836480e15b044223b9c182223bb75c12/users/af95b36ae4fc4fffb589933feed17d22/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:15.994337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960cb8e-eebe-4683-8e00-ea7377e3e23a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:15.994990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960cb8e-eebe-4683-8e00-ea7377e3e23a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:15.994990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960cb8e-eebe-4683-8e00-ea7377e3e23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:16.067003 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3225/6428] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Oct 27 03:50:15 2022] POST /identity/v3/projects => generated 347 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:16.071274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1d923-3793-4804-8ee7-dea7dd5a3bd6 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:16.081893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b960cb8e-eebe-4683-8e00-ea7377e3e23a None None] MFA Rules not processed for user `af95b36ae4fc4fffb589933feed17d22`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:16.083491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b960cb8e-eebe-4683-8e00-ea7377e3e23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:16.189685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:16.625506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1d923-3793-4804-8ee7-dea7dd5a3bd6 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:16.625506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c5973-0aa1-4072-b601-49953a4b394f tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:16.625506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c5973-0aa1-4072-b601-49953a4b394f tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:16.626922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c5973-0aa1-4072-b601-49953a4b394f tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:16.626922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c5973-0aa1-4072-b601-49953a4b394f tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects/9c059905b3e34a208a64fe02a633e686` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:16.627171 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3204/6429] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:50:16.627499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c5973-0aa1-4072-b601-49953a4b394f tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:get_project(project_id=9c059905b3e34a208a64fe02a633e686)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:16.627499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c5973-0aa1-4072-b601-49953a4b394f tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:16.627499 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3226/6430] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:50:16 2022] GET /identity/v3/projects/9c059905b3e34a208a64fe02a633e686 => generated 347 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:16.628174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960cb8e-eebe-4683-8e00-ea7377e3e23a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:16.628355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c5973-0aa1-4072-b601-49953a4b394f tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:16.628764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960cb8e-eebe-4683-8e00-ea7377e3e23a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:16.628898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c5973-0aa1-4072-b601-49953a4b394f tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:16.628898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e97155-c366-4e05-8a28-ce29817d0686 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af95b36ae4fc4fffb589933feed17d22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836480e15b044223b9c182223bb75c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:16.628898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e97155-c366-4e05-8a28-ce29817d0686 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:16.629230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e97155-c366-4e05-8a28-ce29817d0686 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:16.629230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e97155-c366-4e05-8a28-ce29817d0686 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:16.629230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e97155-c366-4e05-8a28-ce29817d0686 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:16.629703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722e09a-eb67-4938-ace0-4d48ff5fe83a tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:16.629703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722e09a-eb67-4938-ace0-4d48ff5fe83a tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:16.629703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722e09a-eb67-4938-ace0-4d48ff5fe83a tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:16.629947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722e09a-eb67-4938-ace0-4d48ff5fe83a tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects/9c059905b3e34a208a64fe02a633e686` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:16.629947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722e09a-eb67-4938-ace0-4d48ff5fe83a tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9c059905b3e34a208a64fe02a633e686)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:16.636920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e97155-c366-4e05-8a28-ce29817d0686 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:16.637353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722e09a-eb67-4938-ace0-4d48ff5fe83a tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:16.732451 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3227/6431] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Oct 27 03:50:16 2022] POST /identity/v3/services => generated 241 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:16.733456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e97155-c366-4e05-8a28-ce29817d0686 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:16.755574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c722e09a-eb67-4938-ace0-4d48ff5fe83a tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c059905b3e34a208a64fe02a633e686', 'request_id': 'req-c722e09a-eb67-4938-ace0-4d48ff5fe83a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:16.811869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e97155-c366-4e05-8a28-ce29817d0686 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:16.914395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2be67-a578-4936-8eaf-32e900c6268c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af95b36ae4fc4fffb589933feed17d22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836480e15b044223b9c182223bb75c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:16.918929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2be67-a578-4936-8eaf-32e900c6268c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:16.919241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2be67-a578-4936-8eaf-32e900c6268c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:16.919527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2be67-a578-4936-8eaf-32e900c6268c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] PATH_INFO: `/v3/services/c629f2d714d343509259a66f509943db` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:16.920170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a2be67-a578-4936-8eaf-32e900c6268c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c629f2d714d343509259a66f509943db)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:16.923347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a2be67-a578-4936-8eaf-32e900c6268c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:16.967638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c722e09a-eb67-4938-ace0-4d48ff5fe83a tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c059905b3e34a208a64fe02a633e686', 'request_id': 'req-c722e09a-eb67-4938-ace0-4d48ff5fe83a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:16.979032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c722e09a-eb67-4938-ace0-4d48ff5fe83a tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c059905b3e34a208a64fe02a633e686', 'request_id': 'req-c722e09a-eb67-4938-ace0-4d48ff5fe83a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:17.024318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c722e09a-eb67-4938-ace0-4d48ff5fe83a tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] The token cache is being invalidate because project 9c059905b3e34a208a64fe02a633e686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:17.025522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c722e09a-eb67-4938-ace0-4d48ff5fe83a tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:17.037995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c722e09a-eb67-4938-ace0-4d48ff5fe83a tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:17.040107 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3205/6432] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:16 2022] DELETE /identity/v3/projects/9c059905b3e34a208a64fe02a633e686 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:17.055230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722e09a-eb67-4938-ace0-4d48ff5fe83a tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:17.062300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c722e09a-eb67-4938-ace0-4d48ff5fe83a tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:17.072651 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3228/6433] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:16 2022] DELETE /identity/v3/services/c629f2d714d343509259a66f509943db => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:17.078249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2be67-a578-4936-8eaf-32e900c6268c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:17.086589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-56a2be67-a578-4936-8eaf-32e900c6268c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:17.121941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:17.142832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2be67-a578-4936-8eaf-32e900c6268c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:17.152448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a03096-cd3b-4800-8026-f31a2b55d8a4 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af95b36ae4fc4fffb589933feed17d22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836480e15b044223b9c182223bb75c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:17.153224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a03096-cd3b-4800-8026-f31a2b55d8a4 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:17.155063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a03096-cd3b-4800-8026-f31a2b55d8a4 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:17.156243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a03096-cd3b-4800-8026-f31a2b55d8a4 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:17.157048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a03096-cd3b-4800-8026-f31a2b55d8a4 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:17.160652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a03096-cd3b-4800-8026-f31a2b55d8a4 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:17.255462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722e09a-eb67-4938-ace0-4d48ff5fe83a tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:17.297845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36213500-9734-4e96-a113-6e64ac4c9eb3 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:17.303065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36213500-9734-4e96-a113-6e64ac4c9eb3 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:17.303065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36213500-9734-4e96-a113-6e64ac4c9eb3 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:17.303065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36213500-9734-4e96-a113-6e64ac4c9eb3 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:17.303065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36213500-9734-4e96-a113-6e64ac4c9eb3 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:17.303065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36213500-9734-4e96-a113-6e64ac4c9eb3 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:17.343285 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3229/6434] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:17 2022] POST /identity/v3/services => generated 287 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:17.346680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a03096-cd3b-4800-8026-f31a2b55d8a4 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:17.378134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a03096-cd3b-4800-8026-f31a2b55d8a4 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:17.389353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615e808-208a-40a9-85e0-343df089bee2 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af95b36ae4fc4fffb589933feed17d22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836480e15b044223b9c182223bb75c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:17.390671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615e808-208a-40a9-85e0-343df089bee2 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:17.390959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615e808-208a-40a9-85e0-343df089bee2 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:17.391359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615e808-208a-40a9-85e0-343df089bee2 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] PATH_INFO: `/v3/services/20d8173c73bf4eb59b31d1d6e4083865` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:17.394151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615e808-208a-40a9-85e0-343df089bee2 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorizing `identity:update_service(service_id=20d8173c73bf4eb59b31d1d6e4083865)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:17.400944 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-7615e808-208a-40a9-85e0-343df089bee2 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:50:17.400944 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:50:17.400944 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:50:17.400944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615e808-208a-40a9-85e0-343df089bee2 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:17.442995 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3206/6435] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:50:17 2022] POST /identity/v3/domains => generated 275 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:17.444061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36213500-9734-4e96-a113-6e64ac4c9eb3 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:17.446480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-36213500-9734-4e96-a113-6e64ac4c9eb3 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:17.554201 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3230/6436] 10.222.0.20 () {60 vars in 1252 bytes} [Thu Oct 27 03:50:17 2022] PATCH /identity/v3/services/20d8173c73bf4eb59b31d1d6e4083865 => generated 281 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:50:17.554201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615e808-208a-40a9-85e0-343df089bee2 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:17.596805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36213500-9734-4e96-a113-6e64ac4c9eb3 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:17.604432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615e808-208a-40a9-85e0-343df089bee2 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:17.643434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f62a46-9e1e-4d91-a2ec-55b13edbc0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:17.643434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f62a46-9e1e-4d91-a2ec-55b13edbc0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:17.643434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f62a46-9e1e-4d91-a2ec-55b13edbc0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:17.643434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f62a46-9e1e-4d91-a2ec-55b13edbc0d1 admin admin] PATH_INFO: `/v3/projects/9dd49f3652264b84b685dca4bb8ef50d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:17.643867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f62a46-9e1e-4d91-a2ec-55b13edbc0d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dd49f3652264b84b685dca4bb8ef50d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:17.644810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f62a46-9e1e-4d91-a2ec-55b13edbc0d1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:17.768736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9139a36-4150-4360-85ed-e47dd54ff513 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:17.769606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9139a36-4150-4360-85ed-e47dd54ff513 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:17.770175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9139a36-4150-4360-85ed-e47dd54ff513 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:17.777978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9139a36-4150-4360-85ed-e47dd54ff513 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:17.777978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9139a36-4150-4360-85ed-e47dd54ff513 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:17.777978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9139a36-4150-4360-85ed-e47dd54ff513 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:17.866015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f5f62a46-9e1e-4d91-a2ec-55b13edbc0d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd49f3652264b84b685dca4bb8ef50d', 'request_id': 'req-f5f62a46-9e1e-4d91-a2ec-55b13edbc0d1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:18.024071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f5f62a46-9e1e-4d91-a2ec-55b13edbc0d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd49f3652264b84b685dca4bb8ef50d', 'request_id': 'req-f5f62a46-9e1e-4d91-a2ec-55b13edbc0d1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:18.037015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f5f62a46-9e1e-4d91-a2ec-55b13edbc0d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd49f3652264b84b685dca4bb8ef50d', 'request_id': 'req-f5f62a46-9e1e-4d91-a2ec-55b13edbc0d1'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:18.050419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f5f62a46-9e1e-4d91-a2ec-55b13edbc0d1 admin admin] The token cache is being invalidate because project 9dd49f3652264b84b685dca4bb8ef50d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:18.052476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f5f62a46-9e1e-4d91-a2ec-55b13edbc0d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:18.053388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f5f62a46-9e1e-4d91-a2ec-55b13edbc0d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:18.056865 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3207/6437] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:17 2022] DELETE /identity/v3/projects/9dd49f3652264b84b685dca4bb8ef50d => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:18.061906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f62a46-9e1e-4d91-a2ec-55b13edbc0d1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:18.065830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f5f62a46-9e1e-4d91-a2ec-55b13edbc0d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:18.090587 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3231/6438] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:17 2022] POST /identity/v3/projects => generated 405 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:18.094842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62654b-fa94-4bf2-bbcf-e2db344382d2 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:18.095767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62654b-fa94-4bf2-bbcf-e2db344382d2 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:18.096499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62654b-fa94-4bf2-bbcf-e2db344382d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:18.136212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3c62654b-fa94-4bf2-bbcf-e2db344382d2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:18.140375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3c62654b-fa94-4bf2-bbcf-e2db344382d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:18.238748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f62a46-9e1e-4d91-a2ec-55b13edbc0d1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:18.294543 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3232/6439] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:18 2022] POST /identity/v3/auth/tokens => generated 3371 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:18.295836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62654b-fa94-4bf2-bbcf-e2db344382d2 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:18.297807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3c62654b-fa94-4bf2-bbcf-e2db344382d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:18.335315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:18.359175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852dcade-6a94-4631-865d-24bdccd7bc1c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af95b36ae4fc4fffb589933feed17d22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836480e15b044223b9c182223bb75c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:18.359870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852dcade-6a94-4631-865d-24bdccd7bc1c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:18.360165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852dcade-6a94-4631-865d-24bdccd7bc1c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:18.360717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852dcade-6a94-4631-865d-24bdccd7bc1c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] PATH_INFO: `/v3/services/20d8173c73bf4eb59b31d1d6e4083865` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:18.361336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852dcade-6a94-4631-865d-24bdccd7bc1c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorizing `identity:get_service(service_id=20d8173c73bf4eb59b31d1d6e4083865)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:18.363589 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-852dcade-6a94-4631-865d-24bdccd7bc1c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:50:18.363589 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:50:18.363589 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:50:18.364507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852dcade-6a94-4631-865d-24bdccd7bc1c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:18.384755 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3208/6440] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:50:18 2022] GET /identity/v3/services/20d8173c73bf4eb59b31d1d6e4083865 => generated 281 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:18.388617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a7e6c-095a-4c2a-8cbc-1abbf6ee6a19 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:18.392179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a7e6c-095a-4c2a-8cbc-1abbf6ee6a19 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:18.393327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a7e6c-095a-4c2a-8cbc-1abbf6ee6a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:18.459043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62654b-fa94-4bf2-bbcf-e2db344382d2 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:18.464002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-fd6a7e6c-095a-4c2a-8cbc-1abbf6ee6a19 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:18.467300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fd6a7e6c-095a-4c2a-8cbc-1abbf6ee6a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:18.473924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd90851-f357-4610-b9d9-e19a2ea4503e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:18.475439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd90851-f357-4610-b9d9-e19a2ea4503e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:18.475731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd90851-f357-4610-b9d9-e19a2ea4503e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:18.476010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd90851-f357-4610-b9d9-e19a2ea4503e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects/507ea13ac7414f9bb7152027cbc9edec` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:18.479470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd90851-f357-4610-b9d9-e19a2ea4503e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:get_project(project_id=507ea13ac7414f9bb7152027cbc9edec)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:18.484442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd90851-f357-4610-b9d9-e19a2ea4503e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:18.490713 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3233/6441] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:50:18 2022] GET /identity/v3/projects/507ea13ac7414f9bb7152027cbc9edec => generated 405 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:18.491504 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3209/6442] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:18 2022] POST /identity/v3/auth/tokens => generated 3371 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:18.493772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a7e6c-095a-4c2a-8cbc-1abbf6ee6a19 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:18.495901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd90851-f357-4610-b9d9-e19a2ea4503e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:18.516819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a7e6c-095a-4c2a-8cbc-1abbf6ee6a19 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:18.519601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd90851-f357-4610-b9d9-e19a2ea4503e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:18.528447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1831327-53ac-4bc0-abca-94896966974c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:18.529660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ea053-dccb-412a-b93e-8ab0728e2c65 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af95b36ae4fc4fffb589933feed17d22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836480e15b044223b9c182223bb75c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:18.529806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1831327-53ac-4bc0-abca-94896966974c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:18.529900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ea053-dccb-412a-b93e-8ab0728e2c65 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:18.529900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ea053-dccb-412a-b93e-8ab0728e2c65 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:18.530181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ea053-dccb-412a-b93e-8ab0728e2c65 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] PATH_INFO: `/v3/services/20d8173c73bf4eb59b31d1d6e4083865` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:18.530376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1831327-53ac-4bc0-abca-94896966974c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:18.530869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1831327-53ac-4bc0-abca-94896966974c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects/507ea13ac7414f9bb7152027cbc9edec` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:18.530987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ea053-dccb-412a-b93e-8ab0728e2c65 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorizing `identity:delete_service(service_id=20d8173c73bf4eb59b31d1d6e4083865)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:18.532846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ea053-dccb-412a-b93e-8ab0728e2c65 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:18.533068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1831327-53ac-4bc0-abca-94896966974c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:delete_project(project_id=507ea13ac7414f9bb7152027cbc9edec)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:18.537908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1831327-53ac-4bc0-abca-94896966974c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:18.674835 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3234/6443] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:18 2022] DELETE /identity/v3/services/20d8173c73bf4eb59b31d1d6e4083865 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:18.674835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ea053-dccb-412a-b93e-8ab0728e2c65 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:18.691100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ea053-dccb-412a-b93e-8ab0728e2c65 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:18.696063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa74e3-2597-4e77-a0e4-4905d1c40e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:18.696862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa74e3-2597-4e77-a0e4-4905d1c40e06 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:18.697023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa74e3-2597-4e77-a0e4-4905d1c40e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:18.697290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa74e3-2597-4e77-a0e4-4905d1c40e06 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:18.697953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa74e3-2597-4e77-a0e4-4905d1c40e06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:50:18.698291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa74e3-2597-4e77-a0e4-4905d1c40e06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:18.700120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa74e3-2597-4e77-a0e4-4905d1c40e06 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:18.714866 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3235/6444] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:18.715831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa74e3-2597-4e77-a0e4-4905d1c40e06 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:18.721371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a1831327-53ac-4bc0-abca-94896966974c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '507ea13ac7414f9bb7152027cbc9edec', 'request_id': 'req-a1831327-53ac-4bc0-abca-94896966974c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:18.741524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa74e3-2597-4e77-a0e4-4905d1c40e06 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:18.824793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d23fd8-6c32-495a-87a2-f27050bbdb32 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af95b36ae4fc4fffb589933feed17d22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836480e15b044223b9c182223bb75c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:18.825958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a1831327-53ac-4bc0-abca-94896966974c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '507ea13ac7414f9bb7152027cbc9edec', 'request_id': 'req-a1831327-53ac-4bc0-abca-94896966974c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:18.826317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d23fd8-6c32-495a-87a2-f27050bbdb32 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:18.827202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d23fd8-6c32-495a-87a2-f27050bbdb32 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:18.831819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d23fd8-6c32-495a-87a2-f27050bbdb32 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] PATH_INFO: `/v3/services/20d8173c73bf4eb59b31d1d6e4083865` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:18.837986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d23fd8-6c32-495a-87a2-f27050bbdb32 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorizing `identity:get_service(service_id=20d8173c73bf4eb59b31d1d6e4083865)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:18.837986 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-f9d23fd8-6c32-495a-87a2-f27050bbdb32 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:50:18.837986 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:50:18.837986 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:50:18.837986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d23fd8-6c32-495a-87a2-f27050bbdb32 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:18.847834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a1831327-53ac-4bc0-abca-94896966974c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '507ea13ac7414f9bb7152027cbc9edec', 'request_id': 'req-a1831327-53ac-4bc0-abca-94896966974c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:18.852514 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application [None req-f9d23fd8-6c32-495a-87a2-f27050bbdb32 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Could not find service: 20d8173c73bf4eb59b31d1d6e4083865.: keystone.exception.ServiceNotFound: Could not find service: 20d8173c73bf4eb59b31d1d6e4083865. Oct 27 03:50:18.852514 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:50:18.852514 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 03:50:18.852514 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 03:50:18.852514 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 03:50:18.852514 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 03:50:18.852514 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 03:50:18.852514 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:50:18.852514 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 20d8173c73bf4eb59b31d1d6e4083865. Oct 27 03:50:18.852514 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:50:18.852514 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:50:18.852514 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:50:18.852514 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:50:18.852514 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:50:18.852514 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:50:18.854430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:50:18.854430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:50:18.854430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:50:18.854430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:50:18.854430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:50:18.854430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:50:18.854430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:50:18.854430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:50:18.854430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 03:50:18.854430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 03:50:18.854430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 03:50:18.854430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 03:50:18.854430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:50:18.854430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:50:18.854430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:50:18.854430 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:50:18.855615 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:50:18.855615 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:50:18.855615 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:50:18.855615 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application with Lock( Oct 27 03:50:18.855615 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:50:18.855615 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:50:18.855615 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:50:18.855615 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:50:18.855615 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:50:18.855615 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:50:18.855615 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:50:18.855615 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:50:18.855615 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 03:50:18.855615 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:50:18.855615 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 20d8173c73bf4eb59b31d1d6e4083865. Oct 27 03:50:18.855615 n-d-862769-1 devstack@keystone.service[82180]: ERROR keystone.server.flask.application Oct 27 03:50:18.856570 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3236/6445] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:50:18 2022] GET /identity/v3/services/20d8173c73bf4eb59b31d1d6e4083865 => generated 113 bytes in 140 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:50:18.856570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d23fd8-6c32-495a-87a2-f27050bbdb32 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:18.880072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a1831327-53ac-4bc0-abca-94896966974c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] The token cache is being invalidate because project 507ea13ac7414f9bb7152027cbc9edec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:18.880467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a1831327-53ac-4bc0-abca-94896966974c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:18.881253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a1831327-53ac-4bc0-abca-94896966974c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:18.886597 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3210/6446] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:18 2022] DELETE /identity/v3/projects/507ea13ac7414f9bb7152027cbc9edec => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:18.887438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1831327-53ac-4bc0-abca-94896966974c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:18.890443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a1831327-53ac-4bc0-abca-94896966974c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:18.917976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1831327-53ac-4bc0-abca-94896966974c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:18.925120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc20729-2a38-4aee-ab2b-065034e754a1 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af95b36ae4fc4fffb589933feed17d22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836480e15b044223b9c182223bb75c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:18.925679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc20729-2a38-4aee-ab2b-065034e754a1 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:18.926698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc20729-2a38-4aee-ab2b-065034e754a1 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:18.926848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc20729-2a38-4aee-ab2b-065034e754a1 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:18.928083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc20729-2a38-4aee-ab2b-065034e754a1 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:18.929300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc20729-2a38-4aee-ab2b-065034e754a1 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:18.983563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d23fd8-6c32-495a-87a2-f27050bbdb32 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:19.006346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6d825-f48f-4a6f-8f4c-18a969f54427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:19.007170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6d825-f48f-4a6f-8f4c-18a969f54427 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:19.007561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6d825-f48f-4a6f-8f4c-18a969f54427 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:19.008741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6d825-f48f-4a6f-8f4c-18a969f54427 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:19.010104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6d825-f48f-4a6f-8f4c-18a969f54427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:19.013540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6d825-f48f-4a6f-8f4c-18a969f54427 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:19.130072 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3211/6447] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:18 2022] POST /identity/v3/services => generated 275 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:19.130072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc20729-2a38-4aee-ab2b-065034e754a1 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:19.132265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-abc20729-2a38-4aee-ab2b-065034e754a1 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:19.182796 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3237/6448] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:18 2022] POST /identity/v3/projects => generated 385 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:19.182796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6d825-f48f-4a6f-8f4c-18a969f54427 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:19.308929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc20729-2a38-4aee-ab2b-065034e754a1 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:19.365374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:19.390767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6d825-f48f-4a6f-8f4c-18a969f54427 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:19.452185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6e3dc-e088-47f9-bdac-02983f06de4c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af95b36ae4fc4fffb589933feed17d22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836480e15b044223b9c182223bb75c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:19.469346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6e3dc-e088-47f9-bdac-02983f06de4c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:19.470896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc98af1-ac6a-48f8-90bd-066091c06dc4 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:19.471744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6e3dc-e088-47f9-bdac-02983f06de4c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:19.472046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6e3dc-e088-47f9-bdac-02983f06de4c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:19.472382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc98af1-ac6a-48f8-90bd-066091c06dc4 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:19.472728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6e3dc-e088-47f9-bdac-02983f06de4c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:19.473034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc98af1-ac6a-48f8-90bd-066091c06dc4 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:19.473471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc98af1-ac6a-48f8-90bd-066091c06dc4 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/domains/111fefcdceef4d61835d5ec629c1bf72` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:19.475694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc98af1-ac6a-48f8-90bd-066091c06dc4 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=111fefcdceef4d61835d5ec629c1bf72)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:19.477469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc98af1-ac6a-48f8-90bd-066091c06dc4 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:19.477926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6e3dc-e088-47f9-bdac-02983f06de4c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:19.535399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6fc98af1-ac6a-48f8-90bd-066091c06dc4 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '111fefcdceef4d61835d5ec629c1bf72'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:19.537526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6fc98af1-ac6a-48f8-90bd-066091c06dc4 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '111fefcdceef4d61835d5ec629c1bf72'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:19.614967 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3238/6449] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:19 2022] POST /identity/v3/services => generated 274 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:19.616316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6e3dc-e088-47f9-bdac-02983f06de4c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:19.620274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-88f6e3dc-e088-47f9-bdac-02983f06de4c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:19.698214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6fc98af1-ac6a-48f8-90bd-066091c06dc4 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '111fefcdceef4d61835d5ec629c1bf72'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:19.699922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6fc98af1-ac6a-48f8-90bd-066091c06dc4 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '111fefcdceef4d61835d5ec629c1bf72'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:19.705574 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3212/6450] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:50:19 2022] PATCH /identity/v3/domains/111fefcdceef4d61835d5ec629c1bf72 => generated 276 bytes in 577 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:19.706428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc98af1-ac6a-48f8-90bd-066091c06dc4 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:19.711712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6fc98af1-ac6a-48f8-90bd-066091c06dc4 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:19.766909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6e3dc-e088-47f9-bdac-02983f06de4c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:19.866196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc98af1-ac6a-48f8-90bd-066091c06dc4 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:19.890773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de02be-ba86-43db-8484-60457b55b9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:19.891411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de02be-ba86-43db-8484-60457b55b9a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:19.891698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de02be-ba86-43db-8484-60457b55b9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:19.891967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de02be-ba86-43db-8484-60457b55b9a3 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:19.892646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de02be-ba86-43db-8484-60457b55b9a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:19.892786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cd4bb-8279-4194-bda0-35f1992d3f55 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af95b36ae4fc4fffb589933feed17d22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836480e15b044223b9c182223bb75c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:19.893472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cd4bb-8279-4194-bda0-35f1992d3f55 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:19.893762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cd4bb-8279-4194-bda0-35f1992d3f55 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:19.894059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cd4bb-8279-4194-bda0-35f1992d3f55 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:19.894733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de02be-ba86-43db-8484-60457b55b9a3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:19.894844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cd4bb-8279-4194-bda0-35f1992d3f55 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:19.896569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cd4bb-8279-4194-bda0-35f1992d3f55 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:19.993422 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3239/6451] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:19 2022] POST /identity/v3/users => generated 293 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:19.997996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de02be-ba86-43db-8484-60457b55b9a3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:20.004930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-66de02be-ba86-43db-8484-60457b55b9a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:20.014301 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3213/6452] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:19 2022] POST /identity/v3/services => generated 273 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:20.017677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cd4bb-8279-4194-bda0-35f1992d3f55 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:20.022435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-797cd4bb-8279-4194-bda0-35f1992d3f55 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:20.083923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cd4bb-8279-4194-bda0-35f1992d3f55 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:20.104961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b25f84-3997-499f-8621-c9c60ac45038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:20.104961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b25f84-3997-499f-8621-c9c60ac45038 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:20.104961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b25f84-3997-499f-8621-c9c60ac45038 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:20.107022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b25f84-3997-499f-8621-c9c60ac45038 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:20.107836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b25f84-3997-499f-8621-c9c60ac45038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:20.109514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b25f84-3997-499f-8621-c9c60ac45038 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:20.162750 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3214/6453] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:20.169253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b25f84-3997-499f-8621-c9c60ac45038 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:20.177130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de02be-ba86-43db-8484-60457b55b9a3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:20.216047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b25f84-3997-499f-8621-c9c60ac45038 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:20.222438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca45d11-9b58-41b9-8c84-9872ff4aa044 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:20.223268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca45d11-9b58-41b9-8c84-9872ff4aa044 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:20.223602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f56d5-2e74-420c-943c-fef19d6eea84 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af95b36ae4fc4fffb589933feed17d22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836480e15b044223b9c182223bb75c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:20.223739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca45d11-9b58-41b9-8c84-9872ff4aa044 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:20.224149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca45d11-9b58-41b9-8c84-9872ff4aa044 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/domains/111fefcdceef4d61835d5ec629c1bf72` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:20.226756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:20.238207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f56d5-2e74-420c-943c-fef19d6eea84 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:20.238503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f56d5-2e74-420c-943c-fef19d6eea84 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:20.238792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f56d5-2e74-420c-943c-fef19d6eea84 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:20.239826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f56d5-2e74-420c-943c-fef19d6eea84 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:20.241060 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-ed4f56d5-2e74-420c-943c-fef19d6eea84 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:50:20.241060 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:50:20.241060 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:50:20.241977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f56d5-2e74-420c-943c-fef19d6eea84 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:20.251605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca45d11-9b58-41b9-8c84-9872ff4aa044 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=111fefcdceef4d61835d5ec629c1bf72)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:20.256739 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3215/6454] 10.222.0.20 () {58 vars in 1131 bytes} [Thu Oct 27 03:50:20 2022] GET /identity/v3/services => generated 2977 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:20.257692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f56d5-2e74-420c-943c-fef19d6eea84 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:20.260919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca45d11-9b58-41b9-8c84-9872ff4aa044 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:20.286862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f56d5-2e74-420c-943c-fef19d6eea84 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:20.307533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2ca45d11-9b58-41b9-8c84-9872ff4aa044 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '111fefcdceef4d61835d5ec629c1bf72'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:20.315027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98715233-e687-41ae-b4fb-aa055ffe7e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:20.317287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98715233-e687-41ae-b4fb-aa055ffe7e78 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:20.318111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98715233-e687-41ae-b4fb-aa055ffe7e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:20.318696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98715233-e687-41ae-b4fb-aa055ffe7e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:20.319513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98715233-e687-41ae-b4fb-aa055ffe7e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:20.322294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98715233-e687-41ae-b4fb-aa055ffe7e78 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:20.324764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2ca45d11-9b58-41b9-8c84-9872ff4aa044 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '111fefcdceef4d61835d5ec629c1bf72'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:20.337942 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3216/6455] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:20.345869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98715233-e687-41ae-b4fb-aa055ffe7e78 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:20.360869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98715233-e687-41ae-b4fb-aa055ffe7e78 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:20.369256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0607475-eebe-4b15-bcf8-16b1eefc6a16 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af95b36ae4fc4fffb589933feed17d22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836480e15b044223b9c182223bb75c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:20.371075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0607475-eebe-4b15-bcf8-16b1eefc6a16 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:20.371858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0607475-eebe-4b15-bcf8-16b1eefc6a16 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:20.372360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0607475-eebe-4b15-bcf8-16b1eefc6a16 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:20.373381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0607475-eebe-4b15-bcf8-16b1eefc6a16 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1907921073) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:50:20.373889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0607475-eebe-4b15-bcf8-16b1eefc6a16 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:20.376022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0607475-eebe-4b15-bcf8-16b1eefc6a16 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:20.381696 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3217/6456] 10.222.0.20 () {58 vars in 1222 bytes} [Thu Oct 27 03:50:20 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1907921073 => generated 418 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:20.382764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0607475-eebe-4b15-bcf8-16b1eefc6a16 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:20.407723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0607475-eebe-4b15-bcf8-16b1eefc6a16 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:20.414281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc79377-8a9c-4838-b18c-f81c219d57b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:20.416670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc79377-8a9c-4838-b18c-f81c219d57b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:20.417091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc79377-8a9c-4838-b18c-f81c219d57b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:20.417424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc79377-8a9c-4838-b18c-f81c219d57b6 admin admin] PATH_INFO: `/v3/projects/66e34cb9fe0940c68057c3727acf8b05/users/67153b1933ff4c11a243161892c0bd17/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:20.444112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc79377-8a9c-4838-b18c-f81c219d57b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e34cb9fe0940c68057c3727acf8b05, user_id=67153b1933ff4c11a243161892c0bd17, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:20.449005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc79377-8a9c-4838-b18c-f81c219d57b6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:20.597138 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3218/6457] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:20 2022] PUT /identity/v3/projects/66e34cb9fe0940c68057c3727acf8b05/users/67153b1933ff4c11a243161892c0bd17/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:20.610806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc79377-8a9c-4838-b18c-f81c219d57b6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:20.651749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2ca45d11-9b58-41b9-8c84-9872ff4aa044 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '111fefcdceef4d61835d5ec629c1bf72', 'request_id': 'req-2ca45d11-9b58-41b9-8c84-9872ff4aa044'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:20.667808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2ca45d11-9b58-41b9-8c84-9872ff4aa044 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '111fefcdceef4d61835d5ec629c1bf72', 'request_id': 'req-2ca45d11-9b58-41b9-8c84-9872ff4aa044'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:20.682502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2ca45d11-9b58-41b9-8c84-9872ff4aa044 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '111fefcdceef4d61835d5ec629c1bf72', 'request_id': 'req-2ca45d11-9b58-41b9-8c84-9872ff4aa044'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:20.856555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc79377-8a9c-4838-b18c-f81c219d57b6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:20.857525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2ca45d11-9b58-41b9-8c84-9872ff4aa044 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] The token cache is being invalidate because project 111fefcdceef4d61835d5ec629c1bf72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:20.857836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2ca45d11-9b58-41b9-8c84-9872ff4aa044 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:20.860556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2ca45d11-9b58-41b9-8c84-9872ff4aa044 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:20.881759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2ca45d11-9b58-41b9-8c84-9872ff4aa044 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '111fefcdceef4d61835d5ec629c1bf72', 'request_id': 'req-2ca45d11-9b58-41b9-8c84-9872ff4aa044'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:20.882645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2ca45d11-9b58-41b9-8c84-9872ff4aa044 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '111fefcdceef4d61835d5ec629c1bf72', 'request_id': 'req-2ca45d11-9b58-41b9-8c84-9872ff4aa044'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:20.884143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2ca45d11-9b58-41b9-8c84-9872ff4aa044 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '111fefcdceef4d61835d5ec629c1bf72', 'request_id': 'req-2ca45d11-9b58-41b9-8c84-9872ff4aa044'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:20.914311 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3240/6458] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:50:19 2022] DELETE /identity/v3/domains/111fefcdceef4d61835d5ec629c1bf72 => generated 0 bytes in 920 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:20.918768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb7285-c9ee-4e16-bc20-58a262f87c01 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:20.918768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb7285-c9ee-4e16-bc20-58a262f87c01 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:20.918768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb7285-c9ee-4e16-bc20-58a262f87c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:20.954767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0acb7285-c9ee-4e16-bc20-58a262f87c01 None None] MFA Rules not processed for user `67153b1933ff4c11a243161892c0bd17`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:20.957406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0acb7285-c9ee-4e16-bc20-58a262f87c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:21.012223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871ca1d-03f6-47f7-83c1-7a1d567e464f tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af95b36ae4fc4fffb589933feed17d22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836480e15b044223b9c182223bb75c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:21.012876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871ca1d-03f6-47f7-83c1-7a1d567e464f tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:21.013166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871ca1d-03f6-47f7-83c1-7a1d567e464f tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:21.013499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871ca1d-03f6-47f7-83c1-7a1d567e464f tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] PATH_INFO: `/v3/services` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:21.014187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871ca1d-03f6-47f7-83c1-7a1d567e464f tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1320444796) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:50:21.014504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871ca1d-03f6-47f7-83c1-7a1d567e464f tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:21.018477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871ca1d-03f6-47f7-83c1-7a1d567e464f tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:21.028592 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3219/6459] 10.222.0.20 () {58 vars in 1222 bytes} [Thu Oct 27 03:50:20 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1320444796 => generated 417 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:21.028592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871ca1d-03f6-47f7-83c1-7a1d567e464f tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:21.034018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e871ca1d-03f6-47f7-83c1-7a1d567e464f tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:21.082705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:21.144733 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3241/6460] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:20 2022] POST /identity/v3/auth/tokens => generated 3763 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:21.149946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb7285-c9ee-4e16-bc20-58a262f87c01 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:21.151983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0acb7285-c9ee-4e16-bc20-58a262f87c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:21.160516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871ca1d-03f6-47f7-83c1-7a1d567e464f tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:21.173492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb7285-c9ee-4e16-bc20-58a262f87c01 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:21.175520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d432e2c-466f-4a0e-87f4-823121a3ed27 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:21.176960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d432e2c-466f-4a0e-87f4-823121a3ed27 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:21.177458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d432e2c-466f-4a0e-87f4-823121a3ed27 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:21.177918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d432e2c-466f-4a0e-87f4-823121a3ed27 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:21.178803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d432e2c-466f-4a0e-87f4-823121a3ed27 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:21.179233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bba694-476a-4240-9db2-b4f60328130e tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af95b36ae4fc4fffb589933feed17d22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836480e15b044223b9c182223bb75c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:21.187725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bba694-476a-4240-9db2-b4f60328130e tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:21.187725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bba694-476a-4240-9db2-b4f60328130e tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:21.187725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bba694-476a-4240-9db2-b4f60328130e tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:21.187725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bba694-476a-4240-9db2-b4f60328130e tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-362806214) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:50:21.187725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bba694-476a-4240-9db2-b4f60328130e tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:21.195298 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-31bba694-476a-4240-9db2-b4f60328130e tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:50:21.195298 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:50:21.195298 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:50:21.195298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bba694-476a-4240-9db2-b4f60328130e tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:21.196211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d432e2c-466f-4a0e-87f4-823121a3ed27 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:21.196397 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3242/6461] 10.222.0.20 () {58 vars in 1220 bytes} [Thu Oct 27 03:50:21 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-362806214 => generated 415 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:21.198204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bba694-476a-4240-9db2-b4f60328130e tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:21.204454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-31bba694-476a-4240-9db2-b4f60328130e tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:21.355814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bba694-476a-4240-9db2-b4f60328130e tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:21.373341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511642e-d764-4541-b83e-3fcab71808b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:21.375789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511642e-d764-4541-b83e-3fcab71808b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:21.376263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511642e-d764-4541-b83e-3fcab71808b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:21.376494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511642e-d764-4541-b83e-3fcab71808b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:21.377201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511642e-d764-4541-b83e-3fcab71808b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:21.382649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511642e-d764-4541-b83e-3fcab71808b2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:21.400794 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3220/6462] 10.222.0.20 () {60 vars in 1149 bytes} [Thu Oct 27 03:50:21 2022] POST /identity/v3/domains => generated 276 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:21.401859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d432e2c-466f-4a0e-87f4-823121a3ed27 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:21.557783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d432e2c-466f-4a0e-87f4-823121a3ed27 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:21.570351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f7925-418b-4e0a-aab6-098de51d85c2 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af95b36ae4fc4fffb589933feed17d22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836480e15b044223b9c182223bb75c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:21.572484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f7925-418b-4e0a-aab6-098de51d85c2 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:21.573891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f7925-418b-4e0a-aab6-098de51d85c2 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:21.574235 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3243/6463] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:21 2022] POST /identity/v3/projects => generated 383 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:21.574637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f7925-418b-4e0a-aab6-098de51d85c2 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] PATH_INFO: `/v3/services/c3800836ca7549d3bc6cf5b526597032` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:21.575082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511642e-d764-4541-b83e-3fcab71808b2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:21.575800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f7925-418b-4e0a-aab6-098de51d85c2 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c3800836ca7549d3bc6cf5b526597032)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:21.579276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f7925-418b-4e0a-aab6-098de51d85c2 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:21.725970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511642e-d764-4541-b83e-3fcab71808b2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:21.733883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42eeab-bf22-4535-a3c3-1816c20dacbd tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:21.735141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42eeab-bf22-4535-a3c3-1816c20dacbd tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:21.735603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42eeab-bf22-4535-a3c3-1816c20dacbd tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:21.736068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42eeab-bf22-4535-a3c3-1816c20dacbd tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:21.736928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42eeab-bf22-4535-a3c3-1816c20dacbd tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:21.743308 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3221/6464] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:21 2022] DELETE /identity/v3/services/c3800836ca7549d3bc6cf5b526597032 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:21.743308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f7925-418b-4e0a-aab6-098de51d85c2 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:21.744303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42eeab-bf22-4535-a3c3-1816c20dacbd tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:21.940275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f7925-418b-4e0a-aab6-098de51d85c2 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:21.970149 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3244/6465] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:21 2022] POST /identity/v3/projects => generated 408 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:21.971031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42eeab-bf22-4535-a3c3-1816c20dacbd tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:22.138854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea39cc-4835-482f-9452-6666f4f35d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:22.142356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea39cc-4835-482f-9452-6666f4f35d95 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:22.142664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea39cc-4835-482f-9452-6666f4f35d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:22.142947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea39cc-4835-482f-9452-6666f4f35d95 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:22.143617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea39cc-4835-482f-9452-6666f4f35d95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:22.150256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea39cc-4835-482f-9452-6666f4f35d95 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:22.177204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42eeab-bf22-4535-a3c3-1816c20dacbd tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:22.220007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570bca4-38d6-4adb-abac-74810b11524c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af95b36ae4fc4fffb589933feed17d22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836480e15b044223b9c182223bb75c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:22.220818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570bca4-38d6-4adb-abac-74810b11524c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:22.221235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570bca4-38d6-4adb-abac-74810b11524c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:22.221621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570bca4-38d6-4adb-abac-74810b11524c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] PATH_INFO: `/v3/services/5e057c6586fd46feb6b82ab8a9d787a0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:22.222691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570bca4-38d6-4adb-abac-74810b11524c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorizing `identity:delete_service(service_id=5e057c6586fd46feb6b82ab8a9d787a0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:22.226390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570bca4-38d6-4adb-abac-74810b11524c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:22.365684 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3245/6466] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:21 2022] DELETE /identity/v3/services/5e057c6586fd46feb6b82ab8a9d787a0 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:22.366336 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3222/6467] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:21 2022] POST /identity/v3/users => generated 298 bytes in 622 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:22.367178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea39cc-4835-482f-9452-6666f4f35d95 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:22.367782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570bca4-38d6-4adb-abac-74810b11524c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:22.492307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea39cc-4835-482f-9452-6666f4f35d95 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:22.510025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9164e85-b1e5-4eb1-8299-84f42f0d9b41 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af95b36ae4fc4fffb589933feed17d22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836480e15b044223b9c182223bb75c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:22.510724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9164e85-b1e5-4eb1-8299-84f42f0d9b41 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:22.511182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9164e85-b1e5-4eb1-8299-84f42f0d9b41 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:22.511467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9164e85-b1e5-4eb1-8299-84f42f0d9b41 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] PATH_INFO: `/v3/services/1b3e4df5b0014935883c2e147e9195e1` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:22.512225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9164e85-b1e5-4eb1-8299-84f42f0d9b41 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1b3e4df5b0014935883c2e147e9195e1)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:22.513943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9164e85-b1e5-4eb1-8299-84f42f0d9b41 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:22.569053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570bca4-38d6-4adb-abac-74810b11524c tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:22.575970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634d8cf-9b6b-49b3-9efd-a0b618a0826e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:22.576730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634d8cf-9b6b-49b3-9efd-a0b618a0826e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:22.577044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634d8cf-9b6b-49b3-9efd-a0b618a0826e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:22.577345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634d8cf-9b6b-49b3-9efd-a0b618a0826e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:22.578179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634d8cf-9b6b-49b3-9efd-a0b618a0826e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:22.581456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634d8cf-9b6b-49b3-9efd-a0b618a0826e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:22.652973 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3223/6468] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:22 2022] DELETE /identity/v3/services/1b3e4df5b0014935883c2e147e9195e1 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:22.654966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9164e85-b1e5-4eb1-8299-84f42f0d9b41 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:22.755751 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3246/6469] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:22 2022] POST /identity/v3/projects => generated 403 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:22.759650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634d8cf-9b6b-49b3-9efd-a0b618a0826e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:22.768490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2634d8cf-9b6b-49b3-9efd-a0b618a0826e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:22.832152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9164e85-b1e5-4eb1-8299-84f42f0d9b41 tempest-ServicesTestJSON-1567787274 tempest-ServicesTestJSON-1567787274-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:22.955368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a61679-059d-46cc-a36c-5cceac238db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:22.956130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a61679-059d-46cc-a36c-5cceac238db0 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:22.956734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a61679-059d-46cc-a36c-5cceac238db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:22.957254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a61679-059d-46cc-a36c-5cceac238db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:22.958027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a61679-059d-46cc-a36c-5cceac238db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:22.960253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a61679-059d-46cc-a36c-5cceac238db0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:22.973315 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3224/6470] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:22.974710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a61679-059d-46cc-a36c-5cceac238db0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:22.981126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634d8cf-9b6b-49b3-9efd-a0b618a0826e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:22.999044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1ccc0-3628-4b71-b93a-c9100457e580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:22.999718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1ccc0-3628-4b71-b93a-c9100457e580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:23.000019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1ccc0-3628-4b71-b93a-c9100457e580 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:23.000309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1ccc0-3628-4b71-b93a-c9100457e580 admin admin] PATH_INFO: `/v3/users/adb550286b42468e93f89a49b3f3bf16` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:23.008777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1ccc0-3628-4b71-b93a-c9100457e580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adb550286b42468e93f89a49b3f3bf16)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:23.011388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1ccc0-3628-4b71-b93a-c9100457e580 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:23.146129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a61679-059d-46cc-a36c-5cceac238db0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:23.154668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa4250-d2a5-4d47-8e53-0dc4abe87956 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:23.155619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa4250-d2a5-4d47-8e53-0dc4abe87956 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:23.156112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa4250-d2a5-4d47-8e53-0dc4abe87956 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:23.156589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa4250-d2a5-4d47-8e53-0dc4abe87956 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects/f17507e231254ea6a32a43092d13113d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:23.158407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa4250-d2a5-4d47-8e53-0dc4abe87956 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f17507e231254ea6a32a43092d13113d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:23.161212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa4250-d2a5-4d47-8e53-0dc4abe87956 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:23.300233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:23.425581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cdfa4250-d2a5-4d47-8e53-0dc4abe87956 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f17507e231254ea6a32a43092d13113d', 'request_id': 'req-cdfa4250-d2a5-4d47-8e53-0dc4abe87956'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:23.432082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-99a1ccc0-3628-4b71-b93a-c9100457e580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adb550286b42468e93f89a49b3f3bf16'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:23.441370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-99a1ccc0-3628-4b71-b93a-c9100457e580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adb550286b42468e93f89a49b3f3bf16'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:23.463154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-99a1ccc0-3628-4b71-b93a-c9100457e580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adb550286b42468e93f89a49b3f3bf16'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:23.493415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-99a1ccc0-3628-4b71-b93a-c9100457e580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adb550286b42468e93f89a49b3f3bf16'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:23.494118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-99a1ccc0-3628-4b71-b93a-c9100457e580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adb550286b42468e93f89a49b3f3bf16'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:23.572572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cdfa4250-d2a5-4d47-8e53-0dc4abe87956 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f17507e231254ea6a32a43092d13113d', 'request_id': 'req-cdfa4250-d2a5-4d47-8e53-0dc4abe87956'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:23.584465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cdfa4250-d2a5-4d47-8e53-0dc4abe87956 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f17507e231254ea6a32a43092d13113d', 'request_id': 'req-cdfa4250-d2a5-4d47-8e53-0dc4abe87956'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:23.596228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:23.599456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cdfa4250-d2a5-4d47-8e53-0dc4abe87956 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] The token cache is being invalidate because project f17507e231254ea6a32a43092d13113d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:23.599869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cdfa4250-d2a5-4d47-8e53-0dc4abe87956 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:23.600769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cdfa4250-d2a5-4d47-8e53-0dc4abe87956 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:23.606725 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3225/6471] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:22 2022] DELETE /identity/v3/projects/f17507e231254ea6a32a43092d13113d => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:23.607732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa4250-d2a5-4d47-8e53-0dc4abe87956 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:23.609693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cdfa4250-d2a5-4d47-8e53-0dc4abe87956 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:23.705677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa4250-d2a5-4d47-8e53-0dc4abe87956 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:23.713693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9e50c-3905-4ca4-a8c4-0dd77f5caed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:23.714944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9e50c-3905-4ca4-a8c4-0dd77f5caed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:23.715422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9e50c-3905-4ca4-a8c4-0dd77f5caed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:23.715904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9e50c-3905-4ca4-a8c4-0dd77f5caed5 admin admin] PATH_INFO: `/v3/projects/84216476be35433b9b381bd180a2eec5/users/47765b06e2e54740ba4247dedb98c7ba/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:23.734315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9e50c-3905-4ca4-a8c4-0dd77f5caed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84216476be35433b9b381bd180a2eec5, user_id=47765b06e2e54740ba4247dedb98c7ba, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:23.737138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9e50c-3905-4ca4-a8c4-0dd77f5caed5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:23.827286 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3247/6472] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:22 2022] DELETE /identity/v3/users/adb550286b42468e93f89a49b3f3bf16 => generated 0 bytes in 1071 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:23.831682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1ccc0-3628-4b71-b93a-c9100457e580 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:23.831682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-99a1ccc0-3628-4b71-b93a-c9100457e580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:23.952402 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3226/6473] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:23 2022] PUT /identity/v3/projects/84216476be35433b9b381bd180a2eec5/users/47765b06e2e54740ba4247dedb98c7ba/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:23.954336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2998a80-f506-49b0-8a6f-7cfa5985b08f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:23.954782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2998a80-f506-49b0-8a6f-7cfa5985b08f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:23.955619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2998a80-f506-49b0-8a6f-7cfa5985b08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:23.976802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1ccc0-3628-4b71-b93a-c9100457e580 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:23.985253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c2998a80-f506-49b0-8a6f-7cfa5985b08f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:23.986325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c2998a80-f506-49b0-8a6f-7cfa5985b08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:24.159434 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3227/6474] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:24.165920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2998a80-f506-49b0-8a6f-7cfa5985b08f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:24.173582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08130fb-da49-4376-b674-a1fde943d965 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:24.174525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08130fb-da49-4376-b674-a1fde943d965 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:24.184553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08130fb-da49-4376-b674-a1fde943d965 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:24.185102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08130fb-da49-4376-b674-a1fde943d965 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects/003b3b012e76424db254743859b839fc` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:24.187229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2998a80-f506-49b0-8a6f-7cfa5985b08f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:24.189321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08130fb-da49-4376-b674-a1fde943d965 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:delete_project(project_id=003b3b012e76424db254743859b839fc)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:24.191374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08130fb-da49-4376-b674-a1fde943d965 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:24.210952 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a532abd-e834-487e-b442-abaeec51d1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:24.211937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a532abd-e834-487e-b442-abaeec51d1ca admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:24.212219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a532abd-e834-487e-b442-abaeec51d1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:24.212493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a532abd-e834-487e-b442-abaeec51d1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:24.213148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a532abd-e834-487e-b442-abaeec51d1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:24.215794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a532abd-e834-487e-b442-abaeec51d1ca admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:24.242905 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3228/6475] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:24.246219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a532abd-e834-487e-b442-abaeec51d1ca admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:24.252415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7a532abd-e834-487e-b442-abaeec51d1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:24.365482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e08130fb-da49-4376-b674-a1fde943d965 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '003b3b012e76424db254743859b839fc', 'request_id': 'req-e08130fb-da49-4376-b674-a1fde943d965'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:24.377386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e08130fb-da49-4376-b674-a1fde943d965 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '003b3b012e76424db254743859b839fc', 'request_id': 'req-e08130fb-da49-4376-b674-a1fde943d965'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:24.399067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e08130fb-da49-4376-b674-a1fde943d965 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '003b3b012e76424db254743859b839fc', 'request_id': 'req-e08130fb-da49-4376-b674-a1fde943d965'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:24.458886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a532abd-e834-487e-b442-abaeec51d1ca admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:24.502734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e08130fb-da49-4376-b674-a1fde943d965 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] The token cache is being invalidate because project 003b3b012e76424db254743859b839fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:24.503788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e08130fb-da49-4376-b674-a1fde943d965 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:24.505702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e08130fb-da49-4376-b674-a1fde943d965 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:24.508341 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3248/6476] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:23 2022] DELETE /identity/v3/projects/003b3b012e76424db254743859b839fc => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:24.511043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08130fb-da49-4376-b674-a1fde943d965 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:24.513496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e08130fb-da49-4376-b674-a1fde943d965 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:24.555169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e3cc3-96d1-4736-8772-169885c926d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:24.555169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e3cc3-96d1-4736-8772-169885c926d0 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:24.555169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e3cc3-96d1-4736-8772-169885c926d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:24.555169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e3cc3-96d1-4736-8772-169885c926d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:24.560369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-324e3cc3-96d1-4736-8772-169885c926d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:24.621160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08130fb-da49-4376-b674-a1fde943d965 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:24.628514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d8e5c-4292-4a6c-b39f-18de9efe6854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:24.628514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d8e5c-4292-4a6c-b39f-18de9efe6854 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:24.628514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d8e5c-4292-4a6c-b39f-18de9efe6854 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:24.628514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d8e5c-4292-4a6c-b39f-18de9efe6854 admin admin] PATH_INFO: `/v3/projects/84216476be35433b9b381bd180a2eec5/users/47765b06e2e54740ba4247dedb98c7ba/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:24.631031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d8e5c-4292-4a6c-b39f-18de9efe6854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84216476be35433b9b381bd180a2eec5, user_id=47765b06e2e54740ba4247dedb98c7ba, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:24.635462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d8e5c-4292-4a6c-b39f-18de9efe6854 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:24.647325 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3249/6477] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:24 2022] PUT /identity/v3/projects/84216476be35433b9b381bd180a2eec5/users/47765b06e2e54740ba4247dedb98c7ba/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:24.654949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d8e5c-4292-4a6c-b39f-18de9efe6854 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:24.656239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e3cc3-96d1-4736-8772-169885c926d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:24.657715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e3cc3-96d1-4736-8772-169885c926d0 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:24.667009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5f4d8e5c-4292-4a6c-b39f-18de9efe6854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:24.675720 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3229/6478] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:50:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:50:24.676961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144da87e-287a-4c75-a3b2-150fd6f91028 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:24.677251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144da87e-287a-4c75-a3b2-150fd6f91028 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:24.677521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144da87e-287a-4c75-a3b2-150fd6f91028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:24.714644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-144da87e-287a-4c75-a3b2-150fd6f91028 None None] MFA Rules not processed for user `47765b06e2e54740ba4247dedb98c7ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:24.716090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-144da87e-287a-4c75-a3b2-150fd6f91028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:24.801180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d8e5c-4292-4a6c-b39f-18de9efe6854 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:24.814400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683aeeb-271b-4df5-b5f0-61cec0f02daa tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:24.816590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683aeeb-271b-4df5-b5f0-61cec0f02daa tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:24.818159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683aeeb-271b-4df5-b5f0-61cec0f02daa tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:24.818614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683aeeb-271b-4df5-b5f0-61cec0f02daa tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/domains/3ad4488306684a61a3bbb2a12bd1169d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:24.822410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683aeeb-271b-4df5-b5f0-61cec0f02daa tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3ad4488306684a61a3bbb2a12bd1169d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:24.828642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683aeeb-271b-4df5-b5f0-61cec0f02daa tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:24.864008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5683aeeb-271b-4df5-b5f0-61cec0f02daa tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3ad4488306684a61a3bbb2a12bd1169d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:24.865231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5683aeeb-271b-4df5-b5f0-61cec0f02daa tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3ad4488306684a61a3bbb2a12bd1169d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:24.901161 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3230/6479] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:24 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:24.906167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144da87e-287a-4c75-a3b2-150fd6f91028 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:24.936088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144da87e-287a-4c75-a3b2-150fd6f91028 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:24.996298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5683aeeb-271b-4df5-b5f0-61cec0f02daa tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3ad4488306684a61a3bbb2a12bd1169d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:24.997561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5683aeeb-271b-4df5-b5f0-61cec0f02daa tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3ad4488306684a61a3bbb2a12bd1169d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:25.011404 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3250/6480] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:50:24 2022] PATCH /identity/v3/domains/3ad4488306684a61a3bbb2a12bd1169d => generated 277 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:25.012385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683aeeb-271b-4df5-b5f0-61cec0f02daa tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:25.017486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5683aeeb-271b-4df5-b5f0-61cec0f02daa tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:25.124927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45375f6e-529e-40c0-bcb5-674c1364ff8b tempest-ProjectsNegativeTestJSON-682104278 tempest-ProjectsNegativeTestJSON-682104278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47765b06e2e54740ba4247dedb98c7ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84216476be35433b9b381bd180a2eec5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:25.125574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45375f6e-529e-40c0-bcb5-674c1364ff8b tempest-ProjectsNegativeTestJSON-682104278 tempest-ProjectsNegativeTestJSON-682104278-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:25.130369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45375f6e-529e-40c0-bcb5-674c1364ff8b tempest-ProjectsNegativeTestJSON-682104278 tempest-ProjectsNegativeTestJSON-682104278-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:25.130369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45375f6e-529e-40c0-bcb5-674c1364ff8b tempest-ProjectsNegativeTestJSON-682104278 tempest-ProjectsNegativeTestJSON-682104278-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:25.130878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45375f6e-529e-40c0-bcb5-674c1364ff8b tempest-ProjectsNegativeTestJSON-682104278 tempest-ProjectsNegativeTestJSON-682104278-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:25.135518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45375f6e-529e-40c0-bcb5-674c1364ff8b tempest-ProjectsNegativeTestJSON-682104278 tempest-ProjectsNegativeTestJSON-682104278-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:25.151598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:25.208488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:25.263191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683aeeb-271b-4df5-b5f0-61cec0f02daa tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:25.270222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999a08f-33dd-40f0-9473-9bbc0451b64e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:25.271021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999a08f-33dd-40f0-9473-9bbc0451b64e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:25.271401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999a08f-33dd-40f0-9473-9bbc0451b64e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:25.274260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999a08f-33dd-40f0-9473-9bbc0451b64e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/domains/3ad4488306684a61a3bbb2a12bd1169d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:25.286494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999a08f-33dd-40f0-9473-9bbc0451b64e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3ad4488306684a61a3bbb2a12bd1169d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:25.288755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999a08f-33dd-40f0-9473-9bbc0451b64e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:25.323458 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3231/6481] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:24 2022] POST /identity/v3/projects => generated 359 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:50:25.324650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45375f6e-529e-40c0-bcb5-674c1364ff8b tempest-ProjectsNegativeTestJSON-682104278 tempest-ProjectsNegativeTestJSON-682104278-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:25.334390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-45375f6e-529e-40c0-bcb5-674c1364ff8b tempest-ProjectsNegativeTestJSON-682104278 tempest-ProjectsNegativeTestJSON-682104278-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:25.377612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9999a08f-33dd-40f0-9473-9bbc0451b64e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3ad4488306684a61a3bbb2a12bd1169d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:25.439999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9999a08f-33dd-40f0-9473-9bbc0451b64e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3ad4488306684a61a3bbb2a12bd1169d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:25.588519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9999a08f-33dd-40f0-9473-9bbc0451b64e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ad4488306684a61a3bbb2a12bd1169d', 'request_id': 'req-9999a08f-33dd-40f0-9473-9bbc0451b64e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:25.607089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9999a08f-33dd-40f0-9473-9bbc0451b64e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ad4488306684a61a3bbb2a12bd1169d', 'request_id': 'req-9999a08f-33dd-40f0-9473-9bbc0451b64e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:25.622292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9999a08f-33dd-40f0-9473-9bbc0451b64e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ad4488306684a61a3bbb2a12bd1169d', 'request_id': 'req-9999a08f-33dd-40f0-9473-9bbc0451b64e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:25.634348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45375f6e-529e-40c0-bcb5-674c1364ff8b tempest-ProjectsNegativeTestJSON-682104278 tempest-ProjectsNegativeTestJSON-682104278-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:25.767049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9999a08f-33dd-40f0-9473-9bbc0451b64e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] The token cache is being invalidate because project 3ad4488306684a61a3bbb2a12bd1169d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:25.767356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9999a08f-33dd-40f0-9473-9bbc0451b64e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:25.769113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9999a08f-33dd-40f0-9473-9bbc0451b64e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:25.798350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9999a08f-33dd-40f0-9473-9bbc0451b64e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3ad4488306684a61a3bbb2a12bd1169d', 'request_id': 'req-9999a08f-33dd-40f0-9473-9bbc0451b64e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:25.798728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9999a08f-33dd-40f0-9473-9bbc0451b64e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3ad4488306684a61a3bbb2a12bd1169d', 'request_id': 'req-9999a08f-33dd-40f0-9473-9bbc0451b64e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:25.801214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9999a08f-33dd-40f0-9473-9bbc0451b64e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3ad4488306684a61a3bbb2a12bd1169d', 'request_id': 'req-9999a08f-33dd-40f0-9473-9bbc0451b64e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:25.829511 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3251/6482] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:50:25 2022] DELETE /identity/v3/domains/3ad4488306684a61a3bbb2a12bd1169d => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:25.846429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999a08f-33dd-40f0-9473-9bbc0451b64e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:25.849855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9999a08f-33dd-40f0-9473-9bbc0451b64e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:25.861924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f932bb8-4978-466c-afbc-414368420f67 tempest-ProjectsNegativeTestJSON-1163655640 tempest-ProjectsNegativeTestJSON-1163655640-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67153b1933ff4c11a243161892c0bd17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e34cb9fe0940c68057c3727acf8b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:25.862676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f932bb8-4978-466c-afbc-414368420f67 tempest-ProjectsNegativeTestJSON-1163655640 tempest-ProjectsNegativeTestJSON-1163655640-project] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:25.862974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f932bb8-4978-466c-afbc-414368420f67 tempest-ProjectsNegativeTestJSON-1163655640 tempest-ProjectsNegativeTestJSON-1163655640-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:25.863263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f932bb8-4978-466c-afbc-414368420f67 tempest-ProjectsNegativeTestJSON-1163655640 tempest-ProjectsNegativeTestJSON-1163655640-project] PATH_INFO: `/v3/projects/8fd88ad05c1a48eb9b56e4c33b5cfbea` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:25.865180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f932bb8-4978-466c-afbc-414368420f67 tempest-ProjectsNegativeTestJSON-1163655640 tempest-ProjectsNegativeTestJSON-1163655640-project] RBAC: Authorizing `identity:delete_project(project_id=8fd88ad05c1a48eb9b56e4c33b5cfbea)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:25.879334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-8f932bb8-4978-466c-afbc-414368420f67 tempest-ProjectsNegativeTestJSON-1163655640 tempest-ProjectsNegativeTestJSON-1163655640-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 27 03:50:25.879334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:50:25.879334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:50:25.879334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:50:25.879334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:50:25.879334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:50:25.879334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:50:25.879334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:50:25.879334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:50:25.879334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:50:25.879334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:50:25.879334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:50:25.879334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Oct 27 03:50:25.879334 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 27 03:50:25.880247 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 27 03:50:25.880247 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 27 03:50:25.880247 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 27 03:50:25.880247 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 27 03:50:25.880247 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:50:25.880247 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 27 03:50:25.880247 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 27 03:50:25.880247 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:50:25.885856 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3232/6483] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:25 2022] DELETE /identity/v3/projects/8fd88ad05c1a48eb9b56e4c33b5cfbea => generated 136 bytes in 562 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:50:25.886944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f932bb8-4978-466c-afbc-414368420f67 tempest-ProjectsNegativeTestJSON-1163655640 tempest-ProjectsNegativeTestJSON-1163655640-project] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:25.894714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:25.899109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8f932bb8-4978-466c-afbc-414368420f67 tempest-ProjectsNegativeTestJSON-1163655640 tempest-ProjectsNegativeTestJSON-1163655640-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:26.047455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999a08f-33dd-40f0-9473-9bbc0451b64e tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:26.060985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e4ad8-3ee9-4bc3-9922-9709995b90ea tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:26.061634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e4ad8-3ee9-4bc3-9922-9709995b90ea tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:26.065214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e4ad8-3ee9-4bc3-9922-9709995b90ea tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:26.065214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e4ad8-3ee9-4bc3-9922-9709995b90ea tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:26.065214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e4ad8-3ee9-4bc3-9922-9709995b90ea tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:26.066075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e4ad8-3ee9-4bc3-9922-9709995b90ea tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:26.072492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f932bb8-4978-466c-afbc-414368420f67 tempest-ProjectsNegativeTestJSON-1163655640 tempest-ProjectsNegativeTestJSON-1163655640-project] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:26.080980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecbd0f-639c-4efc-85f5-1e10d7944464 tempest-ProjectsNegativeTestJSON-682104278 tempest-ProjectsNegativeTestJSON-682104278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47765b06e2e54740ba4247dedb98c7ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84216476be35433b9b381bd180a2eec5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:26.081484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecbd0f-639c-4efc-85f5-1e10d7944464 tempest-ProjectsNegativeTestJSON-682104278 tempest-ProjectsNegativeTestJSON-682104278-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:26.081775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecbd0f-639c-4efc-85f5-1e10d7944464 tempest-ProjectsNegativeTestJSON-682104278 tempest-ProjectsNegativeTestJSON-682104278-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:26.083244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecbd0f-639c-4efc-85f5-1e10d7944464 tempest-ProjectsNegativeTestJSON-682104278 tempest-ProjectsNegativeTestJSON-682104278-project-admin] PATH_INFO: `/v3/projects/8fd88ad05c1a48eb9b56e4c33b5cfbea` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:26.093867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ecbd0f-639c-4efc-85f5-1e10d7944464 tempest-ProjectsNegativeTestJSON-682104278 tempest-ProjectsNegativeTestJSON-682104278-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8fd88ad05c1a48eb9b56e4c33b5cfbea)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:26.096671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ecbd0f-639c-4efc-85f5-1e10d7944464 tempest-ProjectsNegativeTestJSON-682104278 tempest-ProjectsNegativeTestJSON-682104278-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:26.260774 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3252/6484] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:25 2022] POST /identity/v3/projects => generated 378 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:26.264970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e4ad8-3ee9-4bc3-9922-9709995b90ea tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:26.330397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:26.384640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-50ecbd0f-639c-4efc-85f5-1e10d7944464 tempest-ProjectsNegativeTestJSON-682104278 tempest-ProjectsNegativeTestJSON-682104278-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fd88ad05c1a48eb9b56e4c33b5cfbea', 'request_id': 'req-50ecbd0f-639c-4efc-85f5-1e10d7944464'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:26.407833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e4ad8-3ee9-4bc3-9922-9709995b90ea tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:26.509390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-50ecbd0f-639c-4efc-85f5-1e10d7944464 tempest-ProjectsNegativeTestJSON-682104278 tempest-ProjectsNegativeTestJSON-682104278-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fd88ad05c1a48eb9b56e4c33b5cfbea', 'request_id': 'req-50ecbd0f-639c-4efc-85f5-1e10d7944464'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:26.520184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-50ecbd0f-639c-4efc-85f5-1e10d7944464 tempest-ProjectsNegativeTestJSON-682104278 tempest-ProjectsNegativeTestJSON-682104278-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fd88ad05c1a48eb9b56e4c33b5cfbea', 'request_id': 'req-50ecbd0f-639c-4efc-85f5-1e10d7944464'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:26.544565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-50ecbd0f-639c-4efc-85f5-1e10d7944464 tempest-ProjectsNegativeTestJSON-682104278 tempest-ProjectsNegativeTestJSON-682104278-project-admin] The token cache is being invalidate because project 8fd88ad05c1a48eb9b56e4c33b5cfbea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:26.545963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-50ecbd0f-639c-4efc-85f5-1e10d7944464 tempest-ProjectsNegativeTestJSON-682104278 tempest-ProjectsNegativeTestJSON-682104278-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:26.546930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-50ecbd0f-639c-4efc-85f5-1e10d7944464 tempest-ProjectsNegativeTestJSON-682104278 tempest-ProjectsNegativeTestJSON-682104278-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:26.550647 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3233/6485] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:25 2022] DELETE /identity/v3/projects/8fd88ad05c1a48eb9b56e4c33b5cfbea => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:26.557163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecbd0f-639c-4efc-85f5-1e10d7944464 tempest-ProjectsNegativeTestJSON-682104278 tempest-ProjectsNegativeTestJSON-682104278-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:26.558448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-50ecbd0f-639c-4efc-85f5-1e10d7944464 tempest-ProjectsNegativeTestJSON-682104278 tempest-ProjectsNegativeTestJSON-682104278-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:26.587041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69d7d7-818f-4ba9-aa9d-83ce0d65c6a7 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:26.588116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69d7d7-818f-4ba9-aa9d-83ce0d65c6a7 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:26.588799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69d7d7-818f-4ba9-aa9d-83ce0d65c6a7 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:26.589971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69d7d7-818f-4ba9-aa9d-83ce0d65c6a7 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects/6453ba7b8e2045e1abaa38800c5e0c84` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:26.592167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69d7d7-818f-4ba9-aa9d-83ce0d65c6a7 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:get_project(project_id=6453ba7b8e2045e1abaa38800c5e0c84)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:26.596452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69d7d7-818f-4ba9-aa9d-83ce0d65c6a7 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:26.603714 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3253/6486] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:50:26 2022] GET /identity/v3/projects/6453ba7b8e2045e1abaa38800c5e0c84 => generated 378 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:26.603714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69d7d7-818f-4ba9-aa9d-83ce0d65c6a7 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:26.615497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8b69d7d7-818f-4ba9-aa9d-83ce0d65c6a7 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:26.707592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecbd0f-639c-4efc-85f5-1e10d7944464 tempest-ProjectsNegativeTestJSON-682104278 tempest-ProjectsNegativeTestJSON-682104278-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:26.721628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a92dc6-3262-499e-b9b7-e140a9244a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:26.723604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a92dc6-3262-499e-b9b7-e140a9244a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:26.724159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a92dc6-3262-499e-b9b7-e140a9244a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:26.725060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a92dc6-3262-499e-b9b7-e140a9244a99 admin admin] PATH_INFO: `/v3/projects/e2cca4b32bdf4ebdad181afc86294ce8` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:26.726389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a92dc6-3262-499e-b9b7-e140a9244a99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2cca4b32bdf4ebdad181afc86294ce8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:26.728682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a92dc6-3262-499e-b9b7-e140a9244a99 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:26.769622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69d7d7-818f-4ba9-aa9d-83ce0d65c6a7 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:26.778179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e961fe-d130-403b-badd-0c51d13f9304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:26.779367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e961fe-d130-403b-badd-0c51d13f9304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:26.779734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e961fe-d130-403b-badd-0c51d13f9304 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:26.780078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e961fe-d130-403b-badd-0c51d13f9304 admin admin] PATH_INFO: `/v3/users/67153b1933ff4c11a243161892c0bd17` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:26.781660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e961fe-d130-403b-badd-0c51d13f9304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67153b1933ff4c11a243161892c0bd17)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:26.784016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e961fe-d130-403b-badd-0c51d13f9304 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:26.864060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a0a92dc6-3262-499e-b9b7-e140a9244a99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2cca4b32bdf4ebdad181afc86294ce8', 'request_id': 'req-a0a92dc6-3262-499e-b9b7-e140a9244a99'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:26.972715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a0a92dc6-3262-499e-b9b7-e140a9244a99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2cca4b32bdf4ebdad181afc86294ce8', 'request_id': 'req-a0a92dc6-3262-499e-b9b7-e140a9244a99'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:26.992001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a0a92dc6-3262-499e-b9b7-e140a9244a99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2cca4b32bdf4ebdad181afc86294ce8', 'request_id': 'req-a0a92dc6-3262-499e-b9b7-e140a9244a99'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:27.026477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a0a92dc6-3262-499e-b9b7-e140a9244a99 admin admin] The token cache is being invalidate because project e2cca4b32bdf4ebdad181afc86294ce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:27.026947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a0a92dc6-3262-499e-b9b7-e140a9244a99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:27.030496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a0a92dc6-3262-499e-b9b7-e140a9244a99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:27.032865 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3234/6487] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:26 2022] DELETE /identity/v3/projects/e2cca4b32bdf4ebdad181afc86294ce8 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:27.033701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a92dc6-3262-499e-b9b7-e140a9244a99 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:27.037946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a0a92dc6-3262-499e-b9b7-e140a9244a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:27.049643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d8e961fe-d130-403b-badd-0c51d13f9304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67153b1933ff4c11a243161892c0bd17'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:27.050812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d8e961fe-d130-403b-badd-0c51d13f9304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67153b1933ff4c11a243161892c0bd17'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:27.065506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d8e961fe-d130-403b-badd-0c51d13f9304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67153b1933ff4c11a243161892c0bd17'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:27.094270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d8e961fe-d130-403b-badd-0c51d13f9304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67153b1933ff4c11a243161892c0bd17'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:27.110106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d8e961fe-d130-403b-badd-0c51d13f9304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67153b1933ff4c11a243161892c0bd17'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:27.185836 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3254/6488] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:26 2022] DELETE /identity/v3/users/67153b1933ff4c11a243161892c0bd17 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:27.188166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e961fe-d130-403b-badd-0c51d13f9304 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:27.188926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d8e961fe-d130-403b-badd-0c51d13f9304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:27.189813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a92dc6-3262-499e-b9b7-e140a9244a99 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:27.324812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e961fe-d130-403b-badd-0c51d13f9304 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:27.336266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61baa153-2ece-43ef-880e-3b7808c4d75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:27.336975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baa153-2ece-43ef-880e-3b7808c4d75d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:27.337793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baa153-2ece-43ef-880e-3b7808c4d75d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:27.340575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baa153-2ece-43ef-880e-3b7808c4d75d admin admin] PATH_INFO: `/v3/users/40a728220eb2467fa5ece65102deed36` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:27.343083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61baa153-2ece-43ef-880e-3b7808c4d75d admin admin] RBAC: Authorizing `identity:delete_user(user_id=40a728220eb2467fa5ece65102deed36)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:27.345443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2ba80-c04f-47f6-81d0-7c69d2d50469 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:27.346105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2ba80-c04f-47f6-81d0-7c69d2d50469 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:27.346399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2ba80-c04f-47f6-81d0-7c69d2d50469 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:27.346684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2ba80-c04f-47f6-81d0-7c69d2d50469 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:27.348871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61baa153-2ece-43ef-880e-3b7808c4d75d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:27.351801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2ba80-c04f-47f6-81d0-7c69d2d50469 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:27.356611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2ba80-c04f-47f6-81d0-7c69d2d50469 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:27.401776 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3235/6489] 10.222.0.20 () {58 vars in 1131 bytes} [Thu Oct 27 03:50:27 2022] GET /identity/v3/projects => generated 6880 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:27.401776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2ba80-c04f-47f6-81d0-7c69d2d50469 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:27.403888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-def2ba80-c04f-47f6-81d0-7c69d2d50469 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:27.419964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2ba80-c04f-47f6-81d0-7c69d2d50469 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:27.425036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e7b9c-2e13-4e31-8e16-c1c97762c412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:27.425681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e7b9c-2e13-4e31-8e16-c1c97762c412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:27.425980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e7b9c-2e13-4e31-8e16-c1c97762c412 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:27.426276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e7b9c-2e13-4e31-8e16-c1c97762c412 admin admin] PATH_INFO: `/v3/users/af95b36ae4fc4fffb589933feed17d22` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:27.427414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e7b9c-2e13-4e31-8e16-c1c97762c412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af95b36ae4fc4fffb589933feed17d22)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:27.429354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e7b9c-2e13-4e31-8e16-c1c97762c412 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:27.564844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-61baa153-2ece-43ef-880e-3b7808c4d75d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40a728220eb2467fa5ece65102deed36'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:27.565563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-61baa153-2ece-43ef-880e-3b7808c4d75d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40a728220eb2467fa5ece65102deed36'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:27.575048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-61baa153-2ece-43ef-880e-3b7808c4d75d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40a728220eb2467fa5ece65102deed36'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:27.593743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-61baa153-2ece-43ef-880e-3b7808c4d75d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40a728220eb2467fa5ece65102deed36'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:27.594630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-61baa153-2ece-43ef-880e-3b7808c4d75d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40a728220eb2467fa5ece65102deed36'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:27.627059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a43e7b9c-2e13-4e31-8e16-c1c97762c412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af95b36ae4fc4fffb589933feed17d22'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:27.627905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a43e7b9c-2e13-4e31-8e16-c1c97762c412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af95b36ae4fc4fffb589933feed17d22'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:27.637045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a43e7b9c-2e13-4e31-8e16-c1c97762c412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af95b36ae4fc4fffb589933feed17d22'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:27.653179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a43e7b9c-2e13-4e31-8e16-c1c97762c412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af95b36ae4fc4fffb589933feed17d22'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:27.670104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=11 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:27.704771 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3255/6490] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:27 2022] DELETE /identity/v3/users/40a728220eb2467fa5ece65102deed36 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:27.710269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f56a4-24e3-436a-8191-86b607ffbd7d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:27.710269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f56a4-24e3-436a-8191-86b607ffbd7d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:27.710269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f56a4-24e3-436a-8191-86b607ffbd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:27.738149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ae9f56a4-24e3-436a-8191-86b607ffbd7d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:27.739549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ae9f56a4-24e3-436a-8191-86b607ffbd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:27.828938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a43e7b9c-2e13-4e31-8e16-c1c97762c412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af95b36ae4fc4fffb589933feed17d22'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:27.851522 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3236/6491] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:27 2022] DELETE /identity/v3/users/af95b36ae4fc4fffb589933feed17d22 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:27.853858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e7b9c-2e13-4e31-8e16-c1c97762c412 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:27.871613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a43e7b9c-2e13-4e31-8e16-c1c97762c412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:27.916318 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3256/6492] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:27.924182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6d506-59d2-44c2-810f-d43bd826f58a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:27.924501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6d506-59d2-44c2-810f-d43bd826f58a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:27.924847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6d506-59d2-44c2-810f-d43bd826f58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:27.984669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-21a6d506-59d2-44c2-810f-d43bd826f58a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:27.985978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-21a6d506-59d2-44c2-810f-d43bd826f58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:28.049156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e7b9c-2e13-4e31-8e16-c1c97762c412 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:28.068753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31024d-cc83-4689-926f-ab05b24b3e2f tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:28.070609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31024d-cc83-4689-926f-ab05b24b3e2f tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:28.070609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31024d-cc83-4689-926f-ab05b24b3e2f tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:28.070609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31024d-cc83-4689-926f-ab05b24b3e2f tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects/6453ba7b8e2045e1abaa38800c5e0c84` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:28.074936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc31024d-cc83-4689-926f-ab05b24b3e2f tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6453ba7b8e2045e1abaa38800c5e0c84)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:28.080380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc31024d-cc83-4689-926f-ab05b24b3e2f tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:28.187810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:28.199201 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3257/6493] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:28.199605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6d506-59d2-44c2-810f-d43bd826f58a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:28.204768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-21a6d506-59d2-44c2-810f-d43bd826f58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:28.363508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cc31024d-cc83-4689-926f-ab05b24b3e2f tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6453ba7b8e2045e1abaa38800c5e0c84', 'request_id': 'req-cc31024d-cc83-4689-926f-ab05b24b3e2f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:28.386386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6d506-59d2-44c2-810f-d43bd826f58a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:28.486070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cc31024d-cc83-4689-926f-ab05b24b3e2f tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6453ba7b8e2045e1abaa38800c5e0c84', 'request_id': 'req-cc31024d-cc83-4689-926f-ab05b24b3e2f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:28.495272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cc31024d-cc83-4689-926f-ab05b24b3e2f tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6453ba7b8e2045e1abaa38800c5e0c84', 'request_id': 'req-cc31024d-cc83-4689-926f-ab05b24b3e2f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:28.499917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4062ab4-ad90-41e6-af83-909cec3e1808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:28.500563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4062ab4-ad90-41e6-af83-909cec3e1808 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:28.500872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4062ab4-ad90-41e6-af83-909cec3e1808 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:28.501354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4062ab4-ad90-41e6-af83-909cec3e1808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:28.510083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cc31024d-cc83-4689-926f-ab05b24b3e2f tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] The token cache is being invalidate because project 6453ba7b8e2045e1abaa38800c5e0c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:28.510446 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cc31024d-cc83-4689-926f-ab05b24b3e2f tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:28.511192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cc31024d-cc83-4689-926f-ab05b24b3e2f tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:28.513559 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3237/6494] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:27 2022] DELETE /identity/v3/projects/6453ba7b8e2045e1abaa38800c5e0c84 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:28.514479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31024d-cc83-4689-926f-ab05b24b3e2f tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:28.516211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cc31024d-cc83-4689-926f-ab05b24b3e2f tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:28.535787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31024d-cc83-4689-926f-ab05b24b3e2f tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:28.542895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357a1a2-e7cf-4fd1-9ab9-6626823add9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:28.546015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357a1a2-e7cf-4fd1-9ab9-6626823add9e service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:28.547475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357a1a2-e7cf-4fd1-9ab9-6626823add9e service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:28.547768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357a1a2-e7cf-4fd1-9ab9-6626823add9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:28.557059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c357a1a2-e7cf-4fd1-9ab9-6626823add9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:28.637521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4062ab4-ad90-41e6-af83-909cec3e1808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:28.640921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4062ab4-ad90-41e6-af83-909cec3e1808 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:28.663079 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3258/6495] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:50:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:50:28.667660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4062ab4-ad90-41e6-af83-909cec3e1808 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:28.689893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357a1a2-e7cf-4fd1-9ab9-6626823add9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:28.691747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357a1a2-e7cf-4fd1-9ab9-6626823add9e service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:28.709801 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3238/6496] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:50:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:50:28.807279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4062ab4-ad90-41e6-af83-909cec3e1808 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:28.807279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ed633-41dd-4f05-b91c-ad91c6ebf660 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:28.812998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ed633-41dd-4f05-b91c-ad91c6ebf660 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:28.812998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ed633-41dd-4f05-b91c-ad91c6ebf660 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:28.812998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ed633-41dd-4f05-b91c-ad91c6ebf660 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:28.812998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ed633-41dd-4f05-b91c-ad91c6ebf660 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:28.812998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ed633-41dd-4f05-b91c-ad91c6ebf660 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:28.955492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:28.999616 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3259/6497] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Oct 27 03:50:28 2022] POST /identity/v3/projects => generated 346 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:29.003381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357a1a2-e7cf-4fd1-9ab9-6626823add9e service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:29.005202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c357a1a2-e7cf-4fd1-9ab9-6626823add9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:29.030455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357a1a2-e7cf-4fd1-9ab9-6626823add9e service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:29.173670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5a35e-168b-42b7-8914-69f5dba70f3c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:29.175423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5a35e-168b-42b7-8914-69f5dba70f3c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:29.176263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5a35e-168b-42b7-8914-69f5dba70f3c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:29.177520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5a35e-168b-42b7-8914-69f5dba70f3c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects/3e97b3edd48f4065a260a006c0db8540` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:29.181533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5a35e-168b-42b7-8914-69f5dba70f3c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:update_project(project_id=3e97b3edd48f4065a260a006c0db8540)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:29.183798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5a35e-168b-42b7-8914-69f5dba70f3c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:29.316400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ed633-41dd-4f05-b91c-ad91c6ebf660 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:29.316400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-486ed633-41dd-4f05-b91c-ad91c6ebf660 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:29.332866 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3239/6498] 10.222.0.20 () {60 vars in 1252 bytes} [Thu Oct 27 03:50:29 2022] PATCH /identity/v3/projects/3e97b3edd48f4065a260a006c0db8540 => generated 359 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:29.338662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5a35e-168b-42b7-8914-69f5dba70f3c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:29.359034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5a35e-168b-42b7-8914-69f5dba70f3c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:29.371615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e2eb1-3fb7-4260-a5d9-1ea67777d586 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:29.372500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e2eb1-3fb7-4260-a5d9-1ea67777d586 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:29.373007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e2eb1-3fb7-4260-a5d9-1ea67777d586 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:29.373476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e2eb1-3fb7-4260-a5d9-1ea67777d586 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects/3e97b3edd48f4065a260a006c0db8540` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:29.388400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e2eb1-3fb7-4260-a5d9-1ea67777d586 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:get_project(project_id=3e97b3edd48f4065a260a006c0db8540)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:29.391086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e2eb1-3fb7-4260-a5d9-1ea67777d586 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:29.393625 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3240/6499] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:50:29 2022] GET /identity/v3/projects/3e97b3edd48f4065a260a006c0db8540 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:29.397564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e2eb1-3fb7-4260-a5d9-1ea67777d586 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:29.424575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e2eb1-3fb7-4260-a5d9-1ea67777d586 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:29.449279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3b206-a96b-4021-846b-1a7019338145 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:29.450443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3b206-a96b-4021-846b-1a7019338145 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:29.450736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3b206-a96b-4021-846b-1a7019338145 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:29.451019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3b206-a96b-4021-846b-1a7019338145 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects/3e97b3edd48f4065a260a006c0db8540` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:29.460518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3b206-a96b-4021-846b-1a7019338145 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3e97b3edd48f4065a260a006c0db8540)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:29.462546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3b206-a96b-4021-846b-1a7019338145 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:29.503197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ed633-41dd-4f05-b91c-ad91c6ebf660 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:29.515694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe841f70-6990-4971-a4b8-40d44d51a368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:29.516453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe841f70-6990-4971-a4b8-40d44d51a368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:29.516742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe841f70-6990-4971-a4b8-40d44d51a368 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:29.517025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe841f70-6990-4971-a4b8-40d44d51a368 admin admin] PATH_INFO: `/v3/projects/836480e15b044223b9c182223bb75c12` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:29.524209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe841f70-6990-4971-a4b8-40d44d51a368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=836480e15b044223b9c182223bb75c12)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:29.530069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe841f70-6990-4971-a4b8-40d44d51a368 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:29.582340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:29.674334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f1d3b206-a96b-4021-846b-1a7019338145 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e97b3edd48f4065a260a006c0db8540', 'request_id': 'req-f1d3b206-a96b-4021-846b-1a7019338145'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:29.744007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fe841f70-6990-4971-a4b8-40d44d51a368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '836480e15b044223b9c182223bb75c12', 'request_id': 'req-fe841f70-6990-4971-a4b8-40d44d51a368'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:29.764459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fe841f70-6990-4971-a4b8-40d44d51a368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '836480e15b044223b9c182223bb75c12', 'request_id': 'req-fe841f70-6990-4971-a4b8-40d44d51a368'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:29.769878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fe841f70-6990-4971-a4b8-40d44d51a368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '836480e15b044223b9c182223bb75c12', 'request_id': 'req-fe841f70-6990-4971-a4b8-40d44d51a368'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:29.808280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f1d3b206-a96b-4021-846b-1a7019338145 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e97b3edd48f4065a260a006c0db8540', 'request_id': 'req-f1d3b206-a96b-4021-846b-1a7019338145'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:29.818138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f1d3b206-a96b-4021-846b-1a7019338145 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e97b3edd48f4065a260a006c0db8540', 'request_id': 'req-f1d3b206-a96b-4021-846b-1a7019338145'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:29.850424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f1d3b206-a96b-4021-846b-1a7019338145 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] The token cache is being invalidate because project 3e97b3edd48f4065a260a006c0db8540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:29.851947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f1d3b206-a96b-4021-846b-1a7019338145 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:29.860101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f1d3b206-a96b-4021-846b-1a7019338145 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:29.862876 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3241/6500] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:29 2022] DELETE /identity/v3/projects/3e97b3edd48f4065a260a006c0db8540 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:29.863849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3b206-a96b-4021-846b-1a7019338145 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:29.865824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f1d3b206-a96b-4021-846b-1a7019338145 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:29.903447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fe841f70-6990-4971-a4b8-40d44d51a368 admin admin] The token cache is being invalidate because project 836480e15b044223b9c182223bb75c12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:29.904131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fe841f70-6990-4971-a4b8-40d44d51a368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:29.905252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fe841f70-6990-4971-a4b8-40d44d51a368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:29.907254 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3260/6501] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:29 2022] DELETE /identity/v3/projects/836480e15b044223b9c182223bb75c12 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:29.912201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe841f70-6990-4971-a4b8-40d44d51a368 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:29.917182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fe841f70-6990-4971-a4b8-40d44d51a368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:30.095838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3b206-a96b-4021-846b-1a7019338145 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:30.167314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe841f70-6990-4971-a4b8-40d44d51a368 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:30.204905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692fb38-eee5-4323-8e42-ba039666ed6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:30.205598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692fb38-eee5-4323-8e42-ba039666ed6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:30.206565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692fb38-eee5-4323-8e42-ba039666ed6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:30.206855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692fb38-eee5-4323-8e42-ba039666ed6c admin admin] PATH_INFO: `/v3/projects/66e34cb9fe0940c68057c3727acf8b05` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:30.207535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28f103-2639-42af-929b-e2740f6ff054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:30.208176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692fb38-eee5-4323-8e42-ba039666ed6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=66e34cb9fe0940c68057c3727acf8b05)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:30.208970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28f103-2639-42af-929b-e2740f6ff054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:30.210499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692fb38-eee5-4323-8e42-ba039666ed6c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:30.211175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28f103-2639-42af-929b-e2740f6ff054 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:30.211614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28f103-2639-42af-929b-e2740f6ff054 admin admin] PATH_INFO: `/v3/projects/247d973b18304f64b8fbddfe2a012424` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:30.216378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28f103-2639-42af-929b-e2740f6ff054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=247d973b18304f64b8fbddfe2a012424)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:30.223679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28f103-2639-42af-929b-e2740f6ff054 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:30.373785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5692fb38-eee5-4323-8e42-ba039666ed6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66e34cb9fe0940c68057c3727acf8b05', 'request_id': 'req-5692fb38-eee5-4323-8e42-ba039666ed6c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:30.382469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1f28f103-2639-42af-929b-e2740f6ff054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '247d973b18304f64b8fbddfe2a012424', 'request_id': 'req-1f28f103-2639-42af-929b-e2740f6ff054'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:30.396332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1f28f103-2639-42af-929b-e2740f6ff054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '247d973b18304f64b8fbddfe2a012424', 'request_id': 'req-1f28f103-2639-42af-929b-e2740f6ff054'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:30.412791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1f28f103-2639-42af-929b-e2740f6ff054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '247d973b18304f64b8fbddfe2a012424', 'request_id': 'req-1f28f103-2639-42af-929b-e2740f6ff054'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:30.466400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5692fb38-eee5-4323-8e42-ba039666ed6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66e34cb9fe0940c68057c3727acf8b05', 'request_id': 'req-5692fb38-eee5-4323-8e42-ba039666ed6c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:30.491057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5692fb38-eee5-4323-8e42-ba039666ed6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66e34cb9fe0940c68057c3727acf8b05', 'request_id': 'req-5692fb38-eee5-4323-8e42-ba039666ed6c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:30.528098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5692fb38-eee5-4323-8e42-ba039666ed6c admin admin] The token cache is being invalidate because project 66e34cb9fe0940c68057c3727acf8b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:30.528457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5692fb38-eee5-4323-8e42-ba039666ed6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:30.529190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5692fb38-eee5-4323-8e42-ba039666ed6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:30.537759 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3242/6502] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:29 2022] DELETE /identity/v3/projects/66e34cb9fe0940c68057c3727acf8b05 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:30.538876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692fb38-eee5-4323-8e42-ba039666ed6c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:30.542142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5692fb38-eee5-4323-8e42-ba039666ed6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:30.564035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1f28f103-2639-42af-929b-e2740f6ff054 admin admin] The token cache is being invalidate because project 247d973b18304f64b8fbddfe2a012424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:30.564499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1f28f103-2639-42af-929b-e2740f6ff054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:30.565581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1f28f103-2639-42af-929b-e2740f6ff054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:30.575185 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3261/6503] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:29 2022] DELETE /identity/v3/projects/247d973b18304f64b8fbddfe2a012424 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:30.578854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955c79f-7b1b-42cb-bc5d-e2bdc8079608 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:30.579535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955c79f-7b1b-42cb-bc5d-e2bdc8079608 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:30.579988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955c79f-7b1b-42cb-bc5d-e2bdc8079608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:30.617047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d955c79f-7b1b-42cb-bc5d-e2bdc8079608 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:30.620047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d955c79f-7b1b-42cb-bc5d-e2bdc8079608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:30.734553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692fb38-eee5-4323-8e42-ba039666ed6c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:30.779760 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3262/6504] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:30.781651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955c79f-7b1b-42cb-bc5d-e2bdc8079608 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:30.788192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d955c79f-7b1b-42cb-bc5d-e2bdc8079608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:30.821394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955c79f-7b1b-42cb-bc5d-e2bdc8079608 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:30.823862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:30.843028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0fd59-baf8-4d11-9d75-c4af299cd08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:30.843642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0fd59-baf8-4d11-9d75-c4af299cd08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:30.846453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0fd59-baf8-4d11-9d75-c4af299cd08c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:30.846763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0fd59-baf8-4d11-9d75-c4af299cd08c admin admin] PATH_INFO: `/v3/users/47765b06e2e54740ba4247dedb98c7ba` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:30.849324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0fd59-baf8-4d11-9d75-c4af299cd08c admin admin] RBAC: Authorizing `identity:delete_user(user_id=47765b06e2e54740ba4247dedb98c7ba)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:30.853660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0fd59-baf8-4d11-9d75-c4af299cd08c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:30.918350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a360f0a-6d39-4e74-b43e-6ef93b1c8e13 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:30.918993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a360f0a-6d39-4e74-b43e-6ef93b1c8e13 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:30.919283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a360f0a-6d39-4e74-b43e-6ef93b1c8e13 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:30.919566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a360f0a-6d39-4e74-b43e-6ef93b1c8e13 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:30.920225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a360f0a-6d39-4e74-b43e-6ef93b1c8e13 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:30.922714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a360f0a-6d39-4e74-b43e-6ef93b1c8e13 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:31.031360 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3243/6505] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:30 2022] POST /identity/v3/projects => generated 360 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:31.031360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312e79e-0db2-4a14-adf8-9678dfe105ad None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:31.031360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312e79e-0db2-4a14-adf8-9678dfe105ad None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:31.031360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312e79e-0db2-4a14-adf8-9678dfe105ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:31.063090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a7f0fd59-baf8-4d11-9d75-c4af299cd08c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47765b06e2e54740ba4247dedb98c7ba'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:31.063935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a7f0fd59-baf8-4d11-9d75-c4af299cd08c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47765b06e2e54740ba4247dedb98c7ba'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:31.064852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b312e79e-0db2-4a14-adf8-9678dfe105ad None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:31.068238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b312e79e-0db2-4a14-adf8-9678dfe105ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:31.079684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a7f0fd59-baf8-4d11-9d75-c4af299cd08c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47765b06e2e54740ba4247dedb98c7ba'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:31.103571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a7f0fd59-baf8-4d11-9d75-c4af299cd08c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47765b06e2e54740ba4247dedb98c7ba'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:31.104450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a7f0fd59-baf8-4d11-9d75-c4af299cd08c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47765b06e2e54740ba4247dedb98c7ba'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:31.161140 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3244/6506] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:31.162788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abf800-6220-46bb-a37f-5d0acd6628e7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:31.163075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abf800-6220-46bb-a37f-5d0acd6628e7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:31.163348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abf800-6220-46bb-a37f-5d0acd6628e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:31.173144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:31.201594 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3263/6507] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:30 2022] DELETE /identity/v3/users/47765b06e2e54740ba4247dedb98c7ba => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:31.202609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0fd59-baf8-4d11-9d75-c4af299cd08c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:31.211374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-85abf800-6220-46bb-a37f-5d0acd6628e7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:31.213800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a7f0fd59-baf8-4d11-9d75-c4af299cd08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:31.216456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-85abf800-6220-46bb-a37f-5d0acd6628e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:31.362539 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3245/6508] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:31.362539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e3b56-1365-4f2a-b936-e396ad76ed6e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:31.363016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e3b56-1365-4f2a-b936-e396ad76ed6e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:31.363016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e3b56-1365-4f2a-b936-e396ad76ed6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:31.396101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-da4e3b56-1365-4f2a-b936-e396ad76ed6e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:31.396862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0fd59-baf8-4d11-9d75-c4af299cd08c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:31.397725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-da4e3b56-1365-4f2a-b936-e396ad76ed6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:31.403357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6032898-64dd-4d9a-9e78-ac7a260e60a0 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:31.507794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6032898-64dd-4d9a-9e78-ac7a260e60a0 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:31.507794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6032898-64dd-4d9a-9e78-ac7a260e60a0 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:31.507794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6032898-64dd-4d9a-9e78-ac7a260e60a0 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects/3de5f28a02734ee28c1848f884b5793f` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:31.507794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6032898-64dd-4d9a-9e78-ac7a260e60a0 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:update_project(project_id=3de5f28a02734ee28c1848f884b5793f)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:31.509980 n-d-862769-1 devstack@keystone.service[82180]: WARNING py.warnings [None req-a6032898-64dd-4d9a-9e78-ac7a260e60a0 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:50:31.509980 n-d-862769-1 devstack@keystone.service[82180]: warnings.warn(msg) Oct 27 03:50:31.509980 n-d-862769-1 devstack@keystone.service[82180]: Oct 27 03:50:31.510276 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3246/6509] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:31.510276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e3b56-1365-4f2a-b936-e396ad76ed6e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:31.510458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6032898-64dd-4d9a-9e78-ac7a260e60a0 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:31.510552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e3b56-1365-4f2a-b936-e396ad76ed6e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:31.510552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e943fc-b73d-4939-aa21-2c056051dc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:31.510552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e943fc-b73d-4939-aa21-2c056051dc3c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:31.510552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e943fc-b73d-4939-aa21-2c056051dc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:31.510922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e943fc-b73d-4939-aa21-2c056051dc3c admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:31.510922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e943fc-b73d-4939-aa21-2c056051dc3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:50:31.510922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e943fc-b73d-4939-aa21-2c056051dc3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:31.510922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e943fc-b73d-4939-aa21-2c056051dc3c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:31.510922 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3247/6510] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:31.510922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e943fc-b73d-4939-aa21-2c056051dc3c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:31.511411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e943fc-b73d-4939-aa21-2c056051dc3c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:31.513572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c859f4-c1dd-47cd-b6d9-10c9fbb5ca4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:31.514073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c859f4-c1dd-47cd-b6d9-10c9fbb5ca4e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:31.514385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c859f4-c1dd-47cd-b6d9-10c9fbb5ca4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:31.514667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c859f4-c1dd-47cd-b6d9-10c9fbb5ca4e admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:31.515363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c859f4-c1dd-47cd-b6d9-10c9fbb5ca4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:50:31.515679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c859f4-c1dd-47cd-b6d9-10c9fbb5ca4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:31.518491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c859f4-c1dd-47cd-b6d9-10c9fbb5ca4e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:31.535795 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3248/6511] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:31.540844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c859f4-c1dd-47cd-b6d9-10c9fbb5ca4e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:31.552101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c859f4-c1dd-47cd-b6d9-10c9fbb5ca4e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:31.558531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cd3cf-a3d2-412d-a2f6-0f3dbdcf5199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:31.558906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cd3cf-a3d2-412d-a2f6-0f3dbdcf5199 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:31.559190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cd3cf-a3d2-412d-a2f6-0f3dbdcf5199 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:31.559504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cd3cf-a3d2-412d-a2f6-0f3dbdcf5199 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:31.560232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cd3cf-a3d2-412d-a2f6-0f3dbdcf5199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:31.562418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cd3cf-a3d2-412d-a2f6-0f3dbdcf5199 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:31.947365 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3249/6512] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:31 2022] POST /identity/v3/projects => generated 369 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:31.951051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cd3cf-a3d2-412d-a2f6-0f3dbdcf5199 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:31.956562 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3264/6513] 10.222.0.20 () {60 vars in 1252 bytes} [Thu Oct 27 03:50:31 2022] PATCH /identity/v3/projects/3de5f28a02734ee28c1848f884b5793f => generated 372 bytes in 754 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:31.963371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6032898-64dd-4d9a-9e78-ac7a260e60a0 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:32.032906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6032898-64dd-4d9a-9e78-ac7a260e60a0 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:32.145383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:32.167345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:32.222924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cd3cf-a3d2-412d-a2f6-0f3dbdcf5199 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:32.231285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f77cc-50d5-4260-b057-6b6187e7710f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:32.232303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f77cc-50d5-4260-b057-6b6187e7710f admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:32.233018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f77cc-50d5-4260-b057-6b6187e7710f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:32.233306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f77cc-50d5-4260-b057-6b6187e7710f admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:32.234328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f77cc-50d5-4260-b057-6b6187e7710f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:32.237037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f77cc-50d5-4260-b057-6b6187e7710f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:32.261901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41922bc2-1f81-4823-8790-dfb7f07eab07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:32.263861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41922bc2-1f81-4823-8790-dfb7f07eab07 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:32.265790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41922bc2-1f81-4823-8790-dfb7f07eab07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:32.266105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41922bc2-1f81-4823-8790-dfb7f07eab07 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:32.267790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41922bc2-1f81-4823-8790-dfb7f07eab07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:32.271326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41922bc2-1f81-4823-8790-dfb7f07eab07 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:32.347020 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3250/6514] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:31 2022] POST /identity/v3/projects => generated 371 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:32.348635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f77cc-50d5-4260-b057-6b6187e7710f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:32.464091 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3265/6515] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:31 2022] POST /identity/v3/users => generated 285 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:32.465021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41922bc2-1f81-4823-8790-dfb7f07eab07 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:32.493801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41922bc2-1f81-4823-8790-dfb7f07eab07 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:32.501367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f77cc-50d5-4260-b057-6b6187e7710f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:32.509217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe936c4d-e2ec-46f2-a2bb-786110f90290 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:32.510297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe936c4d-e2ec-46f2-a2bb-786110f90290 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:32.512617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe936c4d-e2ec-46f2-a2bb-786110f90290 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:32.512617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe936c4d-e2ec-46f2-a2bb-786110f90290 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects/3de5f28a02734ee28c1848f884b5793f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:32.531424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe936c4d-e2ec-46f2-a2bb-786110f90290 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:get_project(project_id=3de5f28a02734ee28c1848f884b5793f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:32.534327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe936c4d-e2ec-46f2-a2bb-786110f90290 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:32.543040 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3251/6516] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:50:32 2022] GET /identity/v3/projects/3de5f28a02734ee28c1848f884b5793f => generated 359 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:32.546306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe936c4d-e2ec-46f2-a2bb-786110f90290 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:32.549855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fe936c4d-e2ec-46f2-a2bb-786110f90290 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:32.647957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8c380-eb58-4c1e-9ff6-7be08d63f6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:32.654424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8c380-eb58-4c1e-9ff6-7be08d63f6ab admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:32.659881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8c380-eb58-4c1e-9ff6-7be08d63f6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:32.666323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8c380-eb58-4c1e-9ff6-7be08d63f6ab admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:32.666323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8c380-eb58-4c1e-9ff6-7be08d63f6ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:32.666323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8c380-eb58-4c1e-9ff6-7be08d63f6ab admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:32.724638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe936c4d-e2ec-46f2-a2bb-786110f90290 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:32.736986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eee3c8-4e8f-4618-ae73-5f96218bbd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:32.738067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eee3c8-4e8f-4618-ae73-5f96218bbd43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:32.738519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eee3c8-4e8f-4618-ae73-5f96218bbd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:32.738965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eee3c8-4e8f-4618-ae73-5f96218bbd43 admin admin] PATH_INFO: `/v3/projects/84216476be35433b9b381bd180a2eec5` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:32.740312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eee3c8-4e8f-4618-ae73-5f96218bbd43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84216476be35433b9b381bd180a2eec5)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:32.742452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eee3c8-4e8f-4618-ae73-5f96218bbd43 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:32.809243 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3266/6517] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:32 2022] POST /identity/v3/users => generated 286 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:32.813008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8c380-eb58-4c1e-9ff6-7be08d63f6ab admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:32.821609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8c380-eb58-4c1e-9ff6-7be08d63f6ab admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:32.826477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb0528-c4d7-44bc-b2cc-61b9eed4f81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:32.827624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb0528-c4d7-44bc-b2cc-61b9eed4f81a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:32.827944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb0528-c4d7-44bc-b2cc-61b9eed4f81a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:32.828226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb0528-c4d7-44bc-b2cc-61b9eed4f81a admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:32.831078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb0528-c4d7-44bc-b2cc-61b9eed4f81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:32.832724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb0528-c4d7-44bc-b2cc-61b9eed4f81a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:32.850920 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3267/6518] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:32.852374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb0528-c4d7-44bc-b2cc-61b9eed4f81a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:32.867545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb0528-c4d7-44bc-b2cc-61b9eed4f81a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:32.898214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-21eee3c8-4e8f-4618-ae73-5f96218bbd43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84216476be35433b9b381bd180a2eec5', 'request_id': 'req-21eee3c8-4e8f-4618-ae73-5f96218bbd43'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:32.966068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd9d55-d52c-4f75-8ae1-b89bd907307c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:32.968113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd9d55-d52c-4f75-8ae1-b89bd907307c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:32.968586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd9d55-d52c-4f75-8ae1-b89bd907307c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:32.969429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd9d55-d52c-4f75-8ae1-b89bd907307c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects/3de5f28a02734ee28c1848f884b5793f` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:32.971686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-21eee3c8-4e8f-4618-ae73-5f96218bbd43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84216476be35433b9b381bd180a2eec5', 'request_id': 'req-21eee3c8-4e8f-4618-ae73-5f96218bbd43'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:32.972092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd9d55-d52c-4f75-8ae1-b89bd907307c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3de5f28a02734ee28c1848f884b5793f)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:32.974661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd9d55-d52c-4f75-8ae1-b89bd907307c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:32.980787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-21eee3c8-4e8f-4618-ae73-5f96218bbd43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84216476be35433b9b381bd180a2eec5', 'request_id': 'req-21eee3c8-4e8f-4618-ae73-5f96218bbd43'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:32.998408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-21eee3c8-4e8f-4618-ae73-5f96218bbd43 admin admin] The token cache is being invalidate because project 84216476be35433b9b381bd180a2eec5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:32.999114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-21eee3c8-4e8f-4618-ae73-5f96218bbd43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:32.999987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-21eee3c8-4e8f-4618-ae73-5f96218bbd43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:33.001917 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3252/6519] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:32 2022] DELETE /identity/v3/projects/84216476be35433b9b381bd180a2eec5 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:33.010555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eee3c8-4e8f-4618-ae73-5f96218bbd43 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:33.012300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-21eee3c8-4e8f-4618-ae73-5f96218bbd43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:33.111380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eee3c8-4e8f-4618-ae73-5f96218bbd43 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:33.118933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:33.134327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-acfd9d55-d52c-4f75-8ae1-b89bd907307c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de5f28a02734ee28c1848f884b5793f', 'request_id': 'req-acfd9d55-d52c-4f75-8ae1-b89bd907307c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:33.149144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-acfd9d55-d52c-4f75-8ae1-b89bd907307c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de5f28a02734ee28c1848f884b5793f', 'request_id': 'req-acfd9d55-d52c-4f75-8ae1-b89bd907307c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:33.166554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-acfd9d55-d52c-4f75-8ae1-b89bd907307c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de5f28a02734ee28c1848f884b5793f', 'request_id': 'req-acfd9d55-d52c-4f75-8ae1-b89bd907307c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:33.235399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:33.244732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07724b36-85ed-47bc-913e-567525b1fa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:33.248387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07724b36-85ed-47bc-913e-567525b1fa93 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:33.248387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07724b36-85ed-47bc-913e-567525b1fa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:33.248387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07724b36-85ed-47bc-913e-567525b1fa93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:33.248387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07724b36-85ed-47bc-913e-567525b1fa93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:33.249089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07724b36-85ed-47bc-913e-567525b1fa93 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:33.263318 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3253/6520] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:33.264294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07724b36-85ed-47bc-913e-567525b1fa93 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:33.266857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-07724b36-85ed-47bc-913e-567525b1fa93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:33.284301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07724b36-85ed-47bc-913e-567525b1fa93 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:33.289319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e7a52-328d-48b4-8a6e-9fafd20f6a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:33.290161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e7a52-328d-48b4-8a6e-9fafd20f6a41 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:33.290526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e7a52-328d-48b4-8a6e-9fafd20f6a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:33.290878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e7a52-328d-48b4-8a6e-9fafd20f6a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:33.291609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e7a52-328d-48b4-8a6e-9fafd20f6a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:33.293400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e7a52-328d-48b4-8a6e-9fafd20f6a41 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:33.311283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-acfd9d55-d52c-4f75-8ae1-b89bd907307c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] The token cache is being invalidate because project 3de5f28a02734ee28c1848f884b5793f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:33.311587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-acfd9d55-d52c-4f75-8ae1-b89bd907307c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:33.313352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-acfd9d55-d52c-4f75-8ae1-b89bd907307c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:33.318339 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3268/6521] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:32 2022] DELETE /identity/v3/projects/3de5f28a02734ee28c1848f884b5793f => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:33.324688 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3254/6522] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:33.329390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e7a52-328d-48b4-8a6e-9fafd20f6a41 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:33.329538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b9b5a-7225-49b8-8c81-afd7792e308e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:33.329538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b9b5a-7225-49b8-8c81-afd7792e308e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:33.334090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b9b5a-7225-49b8-8c81-afd7792e308e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:33.335035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-356e7a52-328d-48b4-8a6e-9fafd20f6a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:33.352996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e7a52-328d-48b4-8a6e-9fafd20f6a41 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:33.359517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d69edd-1692-4366-8497-f2bde9d44d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:33.361492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d69edd-1692-4366-8497-f2bde9d44d4d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:33.361856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d69edd-1692-4366-8497-f2bde9d44d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:33.362238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d69edd-1692-4366-8497-f2bde9d44d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:33.363165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d69edd-1692-4366-8497-f2bde9d44d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:33.365179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d69edd-1692-4366-8497-f2bde9d44d4d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:33.382670 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3255/6523] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:33.384449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d69edd-1692-4366-8497-f2bde9d44d4d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:33.388408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b3d69edd-1692-4366-8497-f2bde9d44d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:33.397270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d48b9b5a-7225-49b8-8c81-afd7792e308e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:33.402607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d48b9b5a-7225-49b8-8c81-afd7792e308e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:33.434775 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3269/6524] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:33.434775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b9b5a-7225-49b8-8c81-afd7792e308e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:33.434775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d48b9b5a-7225-49b8-8c81-afd7792e308e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:33.474884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b9b5a-7225-49b8-8c81-afd7792e308e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:33.491268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558fdc6-7b24-44c1-8ce6-004b519a0f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:33.491798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d69edd-1692-4366-8497-f2bde9d44d4d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:33.497808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558fdc6-7b24-44c1-8ce6-004b519a0f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:33.497808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558fdc6-7b24-44c1-8ce6-004b519a0f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:33.497808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558fdc6-7b24-44c1-8ce6-004b519a0f0b admin admin] PATH_INFO: `/v3/projects/353267f54ec74dfa85376caea4440d69/users/89a6da1842e745e9bedcb9fd23210690/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:33.501955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483cc184-7679-4659-a521-b31644985437 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:33.502880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cc184-7679-4659-a521-b31644985437 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:33.503252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cc184-7679-4659-a521-b31644985437 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:33.503671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cc184-7679-4659-a521-b31644985437 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:33.504622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483cc184-7679-4659-a521-b31644985437 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:33.508002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483cc184-7679-4659-a521-b31644985437 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:33.524068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558fdc6-7b24-44c1-8ce6-004b519a0f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=353267f54ec74dfa85376caea4440d69, user_id=89a6da1842e745e9bedcb9fd23210690, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:33.526894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558fdc6-7b24-44c1-8ce6-004b519a0f0b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:33.613788 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3270/6525] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:33 2022] PUT /identity/v3/projects/353267f54ec74dfa85376caea4440d69/users/89a6da1842e745e9bedcb9fd23210690/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:33.613788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558fdc6-7b24-44c1-8ce6-004b519a0f0b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:33.662989 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3256/6526] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:33 2022] POST /identity/v3/projects => generated 354 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:33.664427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3174d0c-4a93-4b4f-8319-854ea176842f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:33.665365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3174d0c-4a93-4b4f-8319-854ea176842f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:33.665687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3174d0c-4a93-4b4f-8319-854ea176842f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:33.714434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f3174d0c-4a93-4b4f-8319-854ea176842f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:33.720452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f3174d0c-4a93-4b4f-8319-854ea176842f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:33.732587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558fdc6-7b24-44c1-8ce6-004b519a0f0b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:33.871320 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3257/6527] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:33.873866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595df5f2-14bb-4d77-9da9-d96a7c7d81bd None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:33.874649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595df5f2-14bb-4d77-9da9-d96a7c7d81bd None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:33.874926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595df5f2-14bb-4d77-9da9-d96a7c7d81bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:33.879545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb075f43-c85a-4c92-a2f3-00dc14392397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:33.880248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb075f43-c85a-4c92-a2f3-00dc14392397 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:33.880530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb075f43-c85a-4c92-a2f3-00dc14392397 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:33.880807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb075f43-c85a-4c92-a2f3-00dc14392397 admin admin] PATH_INFO: `/v3/projects/770e9d59282240eb8d7ffa431ff94068/users/9b11092b4a824f739100f1a9bb86822d/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:33.913655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb075f43-c85a-4c92-a2f3-00dc14392397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=770e9d59282240eb8d7ffa431ff94068, user_id=9b11092b4a824f739100f1a9bb86822d, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:33.922265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb075f43-c85a-4c92-a2f3-00dc14392397 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:33.935688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-595df5f2-14bb-4d77-9da9-d96a7c7d81bd None None] MFA Rules not processed for user `89a6da1842e745e9bedcb9fd23210690`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:33.937305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-595df5f2-14bb-4d77-9da9-d96a7c7d81bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:34.019624 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3271/6528] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:33 2022] PUT /identity/v3/projects/770e9d59282240eb8d7ffa431ff94068/users/9b11092b4a824f739100f1a9bb86822d/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:34.021203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb075f43-c85a-4c92-a2f3-00dc14392397 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:34.055106 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3258/6529] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:34.057026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595df5f2-14bb-4d77-9da9-d96a7c7d81bd None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:34.075727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595df5f2-14bb-4d77-9da9-d96a7c7d81bd None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:34.158470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb075f43-c85a-4c92-a2f3-00dc14392397 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:34.166797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269695a2-2112-4bdd-b821-ce89b40c9e17 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:34.166797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269695a2-2112-4bdd-b821-ce89b40c9e17 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:34.167150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269695a2-2112-4bdd-b821-ce89b40c9e17 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:34.167356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269695a2-2112-4bdd-b821-ce89b40c9e17 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects/a805929ebc664bb2986a9b69b2431b16` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:34.168634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269695a2-2112-4bdd-b821-ce89b40c9e17 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:update_project(project_id=a805929ebc664bb2986a9b69b2431b16)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:34.171177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269695a2-2112-4bdd-b821-ce89b40c9e17 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:34.186394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:34.207371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82641a-3c6a-45ea-ac23-ebcf21beca33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:34.208009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82641a-3c6a-45ea-ac23-ebcf21beca33 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:34.208292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82641a-3c6a-45ea-ac23-ebcf21beca33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:34.208569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82641a-3c6a-45ea-ac23-ebcf21beca33 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:34.209234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82641a-3c6a-45ea-ac23-ebcf21beca33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:50:34.209545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82641a-3c6a-45ea-ac23-ebcf21beca33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:34.211492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82641a-3c6a-45ea-ac23-ebcf21beca33 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:34.248029 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3259/6530] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:50:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:34.249538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc0124-d564-498e-8f70-4b872a973d35 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:34.249832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc0124-d564-498e-8f70-4b872a973d35 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:34.250139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc0124-d564-498e-8f70-4b872a973d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:34.315504 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3272/6531] 10.222.0.20 () {60 vars in 1252 bytes} [Thu Oct 27 03:50:34 2022] PATCH /identity/v3/projects/a805929ebc664bb2986a9b69b2431b16 => generated 369 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:34.315504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269695a2-2112-4bdd-b821-ce89b40c9e17 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:34.317389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-edcc0124-d564-498e-8f70-4b872a973d35 None None] MFA Rules not processed for user `9b11092b4a824f739100f1a9bb86822d`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:34.318660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-edcc0124-d564-498e-8f70-4b872a973d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:34.466664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:34.571937 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3260/6532] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:34.572936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc0124-d564-498e-8f70-4b872a973d35 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:34.598859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc0124-d564-498e-8f70-4b872a973d35 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:34.610727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269695a2-2112-4bdd-b821-ce89b40c9e17 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:34.615393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1a326-591d-482f-b5ac-4f9851ab9fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:34.615393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1a326-591d-482f-b5ac-4f9851ab9fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:34.615393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1a326-591d-482f-b5ac-4f9851ab9fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:34.615393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1a326-591d-482f-b5ac-4f9851ab9fc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:34.615759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1a326-591d-482f-b5ac-4f9851ab9fc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:34.615759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1a326-591d-482f-b5ac-4f9851ab9fc7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:34.622627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817c4f4-fc1e-4955-90c7-79849f0d67d7 tempest-TestApiDiscovery-1213574296 tempest-TestApiDiscovery-1213574296-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a6da1842e745e9bedcb9fd23210690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '353267f54ec74dfa85376caea4440d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:34.628182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817c4f4-fc1e-4955-90c7-79849f0d67d7 tempest-TestApiDiscovery-1213574296 tempest-TestApiDiscovery-1213574296-project] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:34.628838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817c4f4-fc1e-4955-90c7-79849f0d67d7 tempest-TestApiDiscovery-1213574296 tempest-TestApiDiscovery-1213574296-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:34.629994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817c4f4-fc1e-4955-90c7-79849f0d67d7 tempest-TestApiDiscovery-1213574296 tempest-TestApiDiscovery-1213574296-project] PATH_INFO: `/v3` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:34.640363 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3273/6533] 10.222.0.20 () {58 vars in 1104 bytes} [Thu Oct 27 03:50:34 2022] GET /identity/v3 => generated 255 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:34.641452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817c4f4-fc1e-4955-90c7-79849f0d67d7 tempest-TestApiDiscovery-1213574296 tempest-TestApiDiscovery-1213574296-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:34.738949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817c4f4-fc1e-4955-90c7-79849f0d67d7 tempest-TestApiDiscovery-1213574296 tempest-TestApiDiscovery-1213574296-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:34.754969 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3261/6534] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:34 2022] POST /identity/v3/projects => generated 387 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:34.756552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1a326-591d-482f-b5ac-4f9851ab9fc7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:34.761569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedba0e-7a8d-46fb-a70b-e247d7501e18 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:34.762524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedba0e-7a8d-46fb-a70b-e247d7501e18 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:34.764020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedba0e-7a8d-46fb-a70b-e247d7501e18 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:34.764020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedba0e-7a8d-46fb-a70b-e247d7501e18 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects/a805929ebc664bb2986a9b69b2431b16` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:34.764461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c1c1a326-591d-482f-b5ac-4f9851ab9fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:34.807456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedba0e-7a8d-46fb-a70b-e247d7501e18 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:get_project(project_id=a805929ebc664bb2986a9b69b2431b16)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:34.816213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:34.816796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedba0e-7a8d-46fb-a70b-e247d7501e18 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:34.829554 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3274/6535] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:50:34 2022] GET /identity/v3/projects/a805929ebc664bb2986a9b69b2431b16 => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:34.829554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedba0e-7a8d-46fb-a70b-e247d7501e18 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:34.882487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedba0e-7a8d-46fb-a70b-e247d7501e18 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:34.942672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1a326-591d-482f-b5ac-4f9851ab9fc7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:34.955827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fb1a2-5f4f-44ed-a098-a40a1f7263e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:34.956637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fb1a2-5f4f-44ed-a098-a40a1f7263e4 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:34.956927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fb1a2-5f4f-44ed-a098-a40a1f7263e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:34.957205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fb1a2-5f4f-44ed-a098-a40a1f7263e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:34.977989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:35.032820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6581223-2b6b-4cba-a812-2b3b5680da69 tempest-TestApiDiscovery-1213574296 tempest-TestApiDiscovery-1213574296-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a6da1842e745e9bedcb9fd23210690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '353267f54ec74dfa85376caea4440d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:35.034647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6581223-2b6b-4cba-a812-2b3b5680da69 tempest-TestApiDiscovery-1213574296 tempest-TestApiDiscovery-1213574296-project] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:35.036246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6581223-2b6b-4cba-a812-2b3b5680da69 tempest-TestApiDiscovery-1213574296 tempest-TestApiDiscovery-1213574296-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:35.037116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6581223-2b6b-4cba-a812-2b3b5680da69 tempest-TestApiDiscovery-1213574296 tempest-TestApiDiscovery-1213574296-project] PATH_INFO: `/v3` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:35.040878 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3275/6536] 10.222.0.20 () {58 vars in 1104 bytes} [Thu Oct 27 03:50:34 2022] GET /identity/v3 => generated 255 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:35.049802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6581223-2b6b-4cba-a812-2b3b5680da69 tempest-TestApiDiscovery-1213574296 tempest-TestApiDiscovery-1213574296-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:35.102430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0fb1a2-5f4f-44ed-a098-a40a1f7263e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:35.104252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0fb1a2-5f4f-44ed-a098-a40a1f7263e4 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:35.118707 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3262/6537] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:50:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:50:35.120090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fb1a2-5f4f-44ed-a098-a40a1f7263e4 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:35.234442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6581223-2b6b-4cba-a812-2b3b5680da69 tempest-TestApiDiscovery-1213574296 tempest-TestApiDiscovery-1213574296-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:35.246805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a632d-2687-481d-ac11-05969f9c58f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:35.247445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a632d-2687-481d-ac11-05969f9c58f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:35.247740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a632d-2687-481d-ac11-05969f9c58f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:35.248019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a632d-2687-481d-ac11-05969f9c58f1 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:35.248666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a632d-2687-481d-ac11-05969f9c58f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:35.250738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a632d-2687-481d-ac11-05969f9c58f1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:35.308858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fb1a2-5f4f-44ed-a098-a40a1f7263e4 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:35.315108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:35.322119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a882f-c9cc-4fab-91e8-c108e3d9c080 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:35.322841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a882f-c9cc-4fab-91e8-c108e3d9c080 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:35.323466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a882f-c9cc-4fab-91e8-c108e3d9c080 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:35.323466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a882f-c9cc-4fab-91e8-c108e3d9c080 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/projects/a805929ebc664bb2986a9b69b2431b16` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:35.326429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a882f-c9cc-4fab-91e8-c108e3d9c080 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a805929ebc664bb2986a9b69b2431b16)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:35.330429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a882f-c9cc-4fab-91e8-c108e3d9c080 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:35.378609 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3276/6538] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:35 2022] POST /identity/v3/users => generated 300 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:35.379630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a632d-2687-481d-ac11-05969f9c58f1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:35.404464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a632d-2687-481d-ac11-05969f9c58f1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:35.421928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628f5b2-c26a-4f79-aea9-e9163bab0808 tempest-TestApiDiscovery-1213574296 tempest-TestApiDiscovery-1213574296-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a6da1842e745e9bedcb9fd23210690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '353267f54ec74dfa85376caea4440d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:35.422604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628f5b2-c26a-4f79-aea9-e9163bab0808 tempest-TestApiDiscovery-1213574296 tempest-TestApiDiscovery-1213574296-project] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:35.422899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628f5b2-c26a-4f79-aea9-e9163bab0808 tempest-TestApiDiscovery-1213574296 tempest-TestApiDiscovery-1213574296-project] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:35.423169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628f5b2-c26a-4f79-aea9-e9163bab0808 tempest-TestApiDiscovery-1213574296 tempest-TestApiDiscovery-1213574296-project] PATH_INFO: `/v3` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:35.425050 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3277/6539] 10.222.0.20 () {58 vars in 1104 bytes} [Thu Oct 27 03:50:35 2022] GET /identity/v3 => generated 255 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:35.432884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628f5b2-c26a-4f79-aea9-e9163bab0808 tempest-TestApiDiscovery-1213574296 tempest-TestApiDiscovery-1213574296-project] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:35.440999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:35.442443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7628f5b2-c26a-4f79-aea9-e9163bab0808 tempest-TestApiDiscovery-1213574296 tempest-TestApiDiscovery-1213574296-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:35.476184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628f5b2-c26a-4f79-aea9-e9163bab0808 tempest-TestApiDiscovery-1213574296 tempest-TestApiDiscovery-1213574296-project] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:35.492509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1080dd5-4b75-41da-99bd-659f3e1a30c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:35.494008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1080dd5-4b75-41da-99bd-659f3e1a30c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:35.494503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1080dd5-4b75-41da-99bd-659f3e1a30c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:35.494940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1080dd5-4b75-41da-99bd-659f3e1a30c6 admin admin] PATH_INFO: `/v3/users/1453ccdc45fb408fae28f60d10cf7a3d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:35.496398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1080dd5-4b75-41da-99bd-659f3e1a30c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1453ccdc45fb408fae28f60d10cf7a3d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:35.498779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1080dd5-4b75-41da-99bd-659f3e1a30c6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:35.505362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fb1a882f-c9cc-4fab-91e8-c108e3d9c080 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a805929ebc664bb2986a9b69b2431b16', 'request_id': 'req-fb1a882f-c9cc-4fab-91e8-c108e3d9c080'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:35.600195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fb1a882f-c9cc-4fab-91e8-c108e3d9c080 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a805929ebc664bb2986a9b69b2431b16', 'request_id': 'req-fb1a882f-c9cc-4fab-91e8-c108e3d9c080'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:35.611566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fb1a882f-c9cc-4fab-91e8-c108e3d9c080 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a805929ebc664bb2986a9b69b2431b16', 'request_id': 'req-fb1a882f-c9cc-4fab-91e8-c108e3d9c080'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:35.628460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fb1a882f-c9cc-4fab-91e8-c108e3d9c080 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] The token cache is being invalidate because project a805929ebc664bb2986a9b69b2431b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:35.631734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fb1a882f-c9cc-4fab-91e8-c108e3d9c080 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:35.631734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fb1a882f-c9cc-4fab-91e8-c108e3d9c080 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:35.633427 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3263/6540] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:35 2022] DELETE /identity/v3/projects/a805929ebc664bb2986a9b69b2431b16 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:35.639199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a882f-c9cc-4fab-91e8-c108e3d9c080 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:35.640888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fb1a882f-c9cc-4fab-91e8-c108e3d9c080 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:35.709542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a1080dd5-4b75-41da-99bd-659f3e1a30c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1453ccdc45fb408fae28f60d10cf7a3d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:35.715666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a1080dd5-4b75-41da-99bd-659f3e1a30c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1453ccdc45fb408fae28f60d10cf7a3d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:35.739864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:35.741023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a1080dd5-4b75-41da-99bd-659f3e1a30c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1453ccdc45fb408fae28f60d10cf7a3d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:35.756441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a882f-c9cc-4fab-91e8-c108e3d9c080 tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:35.760858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c9bf1-e449-42dd-8906-249ada60d1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:35.761699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c9bf1-e449-42dd-8906-249ada60d1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:35.762262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c9bf1-e449-42dd-8906-249ada60d1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:35.762647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c9bf1-e449-42dd-8906-249ada60d1d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:35.763476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c9bf1-e449-42dd-8906-249ada60d1d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:35.765474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c9bf1-e449-42dd-8906-249ada60d1d4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:35.780352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a1080dd5-4b75-41da-99bd-659f3e1a30c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1453ccdc45fb408fae28f60d10cf7a3d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:35.781180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a1080dd5-4b75-41da-99bd-659f3e1a30c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1453ccdc45fb408fae28f60d10cf7a3d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:35.782104 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3264/6541] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:35.783771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e353ac-5518-4f70-853d-ea16beee91f9 None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:35.784145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e353ac-5518-4f70-853d-ea16beee91f9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:35.784468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e353ac-5518-4f70-853d-ea16beee91f9 None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:35.786344 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3265/6542] 10.222.0.20 () {56 vars in 895 bytes} [Thu Oct 27 03:50:35 2022] GET /identity/ => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:50:35.787425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e353ac-5518-4f70-853d-ea16beee91f9 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:35.790988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-90e353ac-5518-4f70-853d-ea16beee91f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:35.892717 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3278/6543] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:35 2022] DELETE /identity/v3/users/1453ccdc45fb408fae28f60d10cf7a3d => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:35.892717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1080dd5-4b75-41da-99bd-659f3e1a30c6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:35.895058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a1080dd5-4b75-41da-99bd-659f3e1a30c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:35.922831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e353ac-5518-4f70-853d-ea16beee91f9 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:36.014670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:36.061840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:36.102302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d421315-fc66-4b45-9cd6-f5484a666d9c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:36.105907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d421315-fc66-4b45-9cd6-f5484a666d9c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:36.106327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d421315-fc66-4b45-9cd6-f5484a666d9c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:36.107230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d421315-fc66-4b45-9cd6-f5484a666d9c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/domains/3ad4488306684a61a3bbb2a12bd1169d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:36.139697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1080dd5-4b75-41da-99bd-659f3e1a30c6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:36.141429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d421315-fc66-4b45-9cd6-f5484a666d9c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:50:36.142239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:36.152763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddca99-f1bb-45cb-90d7-73731405aff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:36.161095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-0d421315-fc66-4b45-9cd6-f5484a666d9c tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Could not find domain: 3ad4488306684a61a3bbb2a12bd1169d.: keystone.exception.DomainNotFound: Could not find domain: 3ad4488306684a61a3bbb2a12bd1169d. Oct 27 03:50:36.161095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:50:36.161095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 27 03:50:36.161095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 27 03:50:36.161095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:50:36.161095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:50:36.161095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:50:36.161095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:50:36.161095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3ad4488306684a61a3bbb2a12bd1169d. Oct 27 03:50:36.161095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:50:36.161095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:50:36.161095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:50:36.161095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:50:36.161095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:50:36.161095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:50:36.161095 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:50:36.162355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:50:36.162355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:50:36.162355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:50:36.162355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:50:36.162355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:50:36.162355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:50:36.162355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:50:36.162355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 27 03:50:36.162355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 27 03:50:36.162355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:50:36.162355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:50:36.162355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:50:36.162355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:50:36.162355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:50:36.162355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:50:36.162355 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:50:36.163865 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:50:36.163865 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:50:36.163865 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:50:36.163865 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:50:36.163865 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:50:36.163865 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:50:36.163865 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:50:36.163865 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:50:36.163865 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:50:36.163865 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:50:36.163865 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:50:36.163865 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:50:36.163865 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:50:36.163865 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 27 03:50:36.163865 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:50:36.163865 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3ad4488306684a61a3bbb2a12bd1169d. Oct 27 03:50:36.163865 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:50:36.165683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddca99-f1bb-45cb-90d7-73731405aff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:36.165683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddca99-f1bb-45cb-90d7-73731405aff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:36.165683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddca99-f1bb-45cb-90d7-73731405aff6 admin admin] PATH_INFO: `/v3/projects/202624c683bf4864820d7164d9ab89de/users/597dbf9e536b458bbe4eb009d3501965/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:36.167428 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3266/6544] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:50:35 2022] PATCH /identity/v3/domains/3ad4488306684a61a3bbb2a12bd1169d => generated 112 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:50:36.172531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81227a15-3f57-47ca-b452-a57405acf10b None None] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:36.172821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81227a15-3f57-47ca-b452-a57405acf10b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:36.173104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81227a15-3f57-47ca-b452-a57405acf10b None None] PATH_INFO: `/` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:36.182473 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3267/6545] 10.222.0.20 () {56 vars in 895 bytes} [Thu Oct 27 03:50:36 2022] GET /identity/ => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 03:50:36.199192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a1dd5-dc78-4706-9476-a73eb1ecf1bc None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:36.199558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a1dd5-dc78-4706-9476-a73eb1ecf1bc None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:36.204035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a1dd5-dc78-4706-9476-a73eb1ecf1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:36.220330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddca99-f1bb-45cb-90d7-73731405aff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=202624c683bf4864820d7164d9ab89de, user_id=597dbf9e536b458bbe4eb009d3501965, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:36.225115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddca99-f1bb-45cb-90d7-73731405aff6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:36.249090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e18a1dd5-dc78-4706-9476-a73eb1ecf1bc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:36.254096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:36.254670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e18a1dd5-dc78-4706-9476-a73eb1ecf1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:36.265080 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3268/6546] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:36.265956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a1dd5-dc78-4706-9476-a73eb1ecf1bc None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:36.286844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a1dd5-dc78-4706-9476-a73eb1ecf1bc None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:36.311258 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3279/6547] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:35 2022] PUT /identity/v3/projects/202624c683bf4864820d7164d9ab89de/users/597dbf9e536b458bbe4eb009d3501965/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:36.311361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddca99-f1bb-45cb-90d7-73731405aff6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:36.314554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c6ddca99-f1bb-45cb-90d7-73731405aff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:36.317888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a67ab-13be-4fce-8b0b-dd679f595fce tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789689f163184bb9b3b7548fde5a5b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54a0d25549e4f90a816ef4425575f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:36.322395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a67ab-13be-4fce-8b0b-dd679f595fce tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:36.322727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a67ab-13be-4fce-8b0b-dd679f595fce tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:36.323015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a67ab-13be-4fce-8b0b-dd679f595fce tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] PATH_INFO: `/v3/domains/111fefcdceef4d61835d5ec629c1bf72` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:36.354093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a67ab-13be-4fce-8b0b-dd679f595fce tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 03:50:36.379026 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-704a67ab-13be-4fce-8b0b-dd679f595fce tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Could not find domain: 111fefcdceef4d61835d5ec629c1bf72.: keystone.exception.DomainNotFound: Could not find domain: 111fefcdceef4d61835d5ec629c1bf72. Oct 27 03:50:36.379026 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:50:36.379026 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 27 03:50:36.379026 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 27 03:50:36.379026 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 03:50:36.379026 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 03:50:36.379026 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 03:50:36.379026 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 03:50:36.379026 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 111fefcdceef4d61835d5ec629c1bf72. Oct 27 03:50:36.379026 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:50:36.379026 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 03:50:36.379026 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:50:36.379026 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:50:36.379026 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:50:36.379026 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:50:36.379026 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:50:36.380087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:50:36.380087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:50:36.380087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:50:36.380087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:50:36.380087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:50:36.380087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:50:36.380087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:50:36.380087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 27 03:50:36.380087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 27 03:50:36.380087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 03:50:36.380087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 03:50:36.380087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 03:50:36.380087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 03:50:36.380087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:50:36.380087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:50:36.380087 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 03:50:36.381016 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 03:50:36.381016 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 03:50:36.381016 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 03:50:36.381016 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 03:50:36.381016 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application with Lock( Oct 27 03:50:36.381016 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 03:50:36.381016 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self._enter() Oct 27 03:50:36.381016 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 03:50:36.381016 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 03:50:36.381016 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 03:50:36.381016 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.creator() Oct 27 03:50:36.381016 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 03:50:36.381016 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application created_value = creator( Oct 27 03:50:36.381016 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 27 03:50:36.381016 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 03:50:36.381016 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 111fefcdceef4d61835d5ec629c1bf72. Oct 27 03:50:36.381016 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:50:36.382011 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3269/6548] 10.222.0.20 () {60 vars in 1249 bytes} [Thu Oct 27 03:50:36 2022] PATCH /identity/v3/domains/111fefcdceef4d61835d5ec629c1bf72 => generated 112 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:50:36.384209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a67ab-13be-4fce-8b0b-dd679f595fce tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:36.392239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-704a67ab-13be-4fce-8b0b-dd679f595fce tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:36.462244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:36.638618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddca99-f1bb-45cb-90d7-73731405aff6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:36.638618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3362b23-183b-480a-8ba2-cc6bfbc2b745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:36.638618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3362b23-183b-480a-8ba2-cc6bfbc2b745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:36.638618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3362b23-183b-480a-8ba2-cc6bfbc2b745 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:36.640441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3362b23-183b-480a-8ba2-cc6bfbc2b745 admin admin] PATH_INFO: `/v3/users/89a6da1842e745e9bedcb9fd23210690` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:36.640441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3362b23-183b-480a-8ba2-cc6bfbc2b745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89a6da1842e745e9bedcb9fd23210690)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:36.640441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3362b23-183b-480a-8ba2-cc6bfbc2b745 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:36.641424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a67ab-13be-4fce-8b0b-dd679f595fce tempest-ProjectsTestJSON-143209358 tempest-ProjectsTestJSON-143209358-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:36.645838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b1bca-970f-4b54-a587-44932cf7a31e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:36.646591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b1bca-970f-4b54-a587-44932cf7a31e service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:36.646858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b1bca-970f-4b54-a587-44932cf7a31e service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:36.647141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b1bca-970f-4b54-a587-44932cf7a31e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:36.659384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b1bca-970f-4b54-a587-44932cf7a31e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:36.661498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b1bca-970f-4b54-a587-44932cf7a31e service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:36.690894 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3270/6549] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:50:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:50:36.692134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b1bca-970f-4b54-a587-44932cf7a31e service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:36.732594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b1bca-970f-4b54-a587-44932cf7a31e service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:36.750782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e24f08-e1a4-428f-b5ce-2a9ffa5f634c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:36.751420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e24f08-e1a4-428f-b5ce-2a9ffa5f634c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:36.751705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e24f08-e1a4-428f-b5ce-2a9ffa5f634c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:36.752164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e24f08-e1a4-428f-b5ce-2a9ffa5f634c admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:36.752833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e24f08-e1a4-428f-b5ce-2a9ffa5f634c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:36.761060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e24f08-e1a4-428f-b5ce-2a9ffa5f634c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:36.795768 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3271/6550] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:36.796741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e24f08-e1a4-428f-b5ce-2a9ffa5f634c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:36.804732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e6e24f08-e1a4-428f-b5ce-2a9ffa5f634c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:36.846529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e24f08-e1a4-428f-b5ce-2a9ffa5f634c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:36.875265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416539c7-093f-4bb6-8600-dca2e03e0fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:36.875941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416539c7-093f-4bb6-8600-dca2e03e0fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:36.876227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416539c7-093f-4bb6-8600-dca2e03e0fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:36.876503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416539c7-093f-4bb6-8600-dca2e03e0fa4 admin admin] PATH_INFO: `/v3/users/1696d72b73904b16bbde9509d94148db` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:36.882927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416539c7-093f-4bb6-8600-dca2e03e0fa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1696d72b73904b16bbde9509d94148db)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:36.885630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416539c7-093f-4bb6-8600-dca2e03e0fa4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:36.933962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c3362b23-183b-480a-8ba2-cc6bfbc2b745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89a6da1842e745e9bedcb9fd23210690'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:36.935227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c3362b23-183b-480a-8ba2-cc6bfbc2b745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89a6da1842e745e9bedcb9fd23210690'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:36.943602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c3362b23-183b-480a-8ba2-cc6bfbc2b745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89a6da1842e745e9bedcb9fd23210690'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:36.979411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c3362b23-183b-480a-8ba2-cc6bfbc2b745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89a6da1842e745e9bedcb9fd23210690'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:36.979411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c3362b23-183b-480a-8ba2-cc6bfbc2b745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89a6da1842e745e9bedcb9fd23210690'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:37.106388 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3280/6551] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:36 2022] DELETE /identity/v3/users/89a6da1842e745e9bedcb9fd23210690 => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:37.109957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3362b23-183b-480a-8ba2-cc6bfbc2b745 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:37.109957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c3362b23-183b-480a-8ba2-cc6bfbc2b745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:37.183936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:37.220999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-416539c7-093f-4bb6-8600-dca2e03e0fa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1696d72b73904b16bbde9509d94148db'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:37.226605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-416539c7-093f-4bb6-8600-dca2e03e0fa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1696d72b73904b16bbde9509d94148db'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:37.239066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-416539c7-093f-4bb6-8600-dca2e03e0fa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1696d72b73904b16bbde9509d94148db'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:37.266194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-416539c7-093f-4bb6-8600-dca2e03e0fa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1696d72b73904b16bbde9509d94148db'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:37.354642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-416539c7-093f-4bb6-8600-dca2e03e0fa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1696d72b73904b16bbde9509d94148db'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:37.362120 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3272/6552] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:36 2022] DELETE /identity/v3/users/1696d72b73904b16bbde9509d94148db => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:37.363256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416539c7-093f-4bb6-8600-dca2e03e0fa4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:37.371219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-416539c7-093f-4bb6-8600-dca2e03e0fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:37.532994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416539c7-093f-4bb6-8600-dca2e03e0fa4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:37.550359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef8059-8ff5-40ea-84ff-bbbf6c1bb46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:37.550359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef8059-8ff5-40ea-84ff-bbbf6c1bb46a admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:37.550359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef8059-8ff5-40ea-84ff-bbbf6c1bb46a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:37.550359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef8059-8ff5-40ea-84ff-bbbf6c1bb46a admin admin] PATH_INFO: `/v3/projects/202624c683bf4864820d7164d9ab89de/users/597dbf9e536b458bbe4eb009d3501965/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:37.551113 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef8059-8ff5-40ea-84ff-bbbf6c1bb46a admin admin] RBAC: Authorizing `identity:create_grant(project_id=202624c683bf4864820d7164d9ab89de, user_id=597dbf9e536b458bbe4eb009d3501965, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:37.556332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef8059-8ff5-40ea-84ff-bbbf6c1bb46a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:37.578975 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3273/6553] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:37 2022] PUT /identity/v3/projects/202624c683bf4864820d7164d9ab89de/users/597dbf9e536b458bbe4eb009d3501965/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:37.580093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30210eb-ec37-41cd-a70d-dc219e2363d8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:37.580452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30210eb-ec37-41cd-a70d-dc219e2363d8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:37.580741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30210eb-ec37-41cd-a70d-dc219e2363d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:37.623606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3362b23-183b-480a-8ba2-cc6bfbc2b745 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:37.661380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c30210eb-ec37-41cd-a70d-dc219e2363d8 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:37.662671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c30210eb-ec37-41cd-a70d-dc219e2363d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:37.759701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0dc61-9ea9-4107-ae6f-eacd13319a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:37.761408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0dc61-9ea9-4107-ae6f-eacd13319a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:37.761706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0dc61-9ea9-4107-ae6f-eacd13319a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:37.761984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0dc61-9ea9-4107-ae6f-eacd13319a54 admin admin] PATH_INFO: `/v3/users/9b11092b4a824f739100f1a9bb86822d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:37.765562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0dc61-9ea9-4107-ae6f-eacd13319a54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b11092b4a824f739100f1a9bb86822d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:37.773087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0dc61-9ea9-4107-ae6f-eacd13319a54 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:37.784480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:37.789132 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3274/6554] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:37.791119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8087362-4a50-4312-83d2-0904507eb069 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:37.791408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8087362-4a50-4312-83d2-0904507eb069 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:37.791686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8087362-4a50-4312-83d2-0904507eb069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:37.834774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:37.857259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a8087362-4a50-4312-83d2-0904507eb069 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:37.873183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a8087362-4a50-4312-83d2-0904507eb069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:37.886571 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3275/6555] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:37.888019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8087362-4a50-4312-83d2-0904507eb069 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:37.891783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a8087362-4a50-4312-83d2-0904507eb069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:37.912822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8087362-4a50-4312-83d2-0904507eb069 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:37.928358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe71b8-ceae-4e99-9921-5ac09a327337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:37.929196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe71b8-ceae-4e99-9921-5ac09a327337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:37.929480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe71b8-ceae-4e99-9921-5ac09a327337 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:37.929753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe71b8-ceae-4e99-9921-5ac09a327337 admin admin] PATH_INFO: `/v3/projects/aa5ae1020e4f4b70bb89f91c20337c1f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:37.936417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe71b8-ceae-4e99-9921-5ac09a327337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa5ae1020e4f4b70bb89f91c20337c1f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:37.942426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe71b8-ceae-4e99-9921-5ac09a327337 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:38.020224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fcf0dc61-9ea9-4107-ae6f-eacd13319a54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b11092b4a824f739100f1a9bb86822d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:38.020802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fcf0dc61-9ea9-4107-ae6f-eacd13319a54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b11092b4a824f739100f1a9bb86822d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:38.031796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fcf0dc61-9ea9-4107-ae6f-eacd13319a54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b11092b4a824f739100f1a9bb86822d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:38.057420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fcf0dc61-9ea9-4107-ae6f-eacd13319a54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b11092b4a824f739100f1a9bb86822d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:38.064183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fcf0dc61-9ea9-4107-ae6f-eacd13319a54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b11092b4a824f739100f1a9bb86822d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:38.121572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-30fe71b8-ceae-4e99-9921-5ac09a327337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa5ae1020e4f4b70bb89f91c20337c1f', 'request_id': 'req-30fe71b8-ceae-4e99-9921-5ac09a327337'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:38.153449 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3281/6556] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:37 2022] DELETE /identity/v3/users/9b11092b4a824f739100f1a9bb86822d => generated 0 bytes in 1044 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:38.157203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1bfe22-969c-448d-8cef-29afee26648b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:38.157203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1bfe22-969c-448d-8cef-29afee26648b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:38.157433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1bfe22-969c-448d-8cef-29afee26648b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:38.224206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-30fe71b8-ceae-4e99-9921-5ac09a327337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa5ae1020e4f4b70bb89f91c20337c1f', 'request_id': 'req-30fe71b8-ceae-4e99-9921-5ac09a327337'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:38.233571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-30fe71b8-ceae-4e99-9921-5ac09a327337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa5ae1020e4f4b70bb89f91c20337c1f', 'request_id': 'req-30fe71b8-ceae-4e99-9921-5ac09a327337'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:38.272902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-30fe71b8-ceae-4e99-9921-5ac09a327337 admin admin] The token cache is being invalidate because project aa5ae1020e4f4b70bb89f91c20337c1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:38.273197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-30fe71b8-ceae-4e99-9921-5ac09a327337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:38.277915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-30fe71b8-ceae-4e99-9921-5ac09a327337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:38.285295 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3276/6557] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:37 2022] DELETE /identity/v3/projects/aa5ae1020e4f4b70bb89f91c20337c1f => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:38.292178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe71b8-ceae-4e99-9921-5ac09a327337 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:38.295723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-30fe71b8-ceae-4e99-9921-5ac09a327337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:38.296788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8a1bfe22-969c-448d-8cef-29afee26648b None None] MFA Rules not processed for user `597dbf9e536b458bbe4eb009d3501965`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:38.299577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8a1bfe22-969c-448d-8cef-29afee26648b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:38.450026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe71b8-ceae-4e99-9921-5ac09a327337 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:38.479002 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3282/6558] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:38 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:38.479002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1bfe22-969c-448d-8cef-29afee26648b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:38.480579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8a1bfe22-969c-448d-8cef-29afee26648b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:38.497512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:38.572926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:38.580605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfe46b-4e31-41c5-8336-313d75228ac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:38.582086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfe46b-4e31-41c5-8336-313d75228ac9 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:38.585072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfe46b-4e31-41c5-8336-313d75228ac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:38.586133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfe46b-4e31-41c5-8336-313d75228ac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:38.594844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c6cfe46b-4e31-41c5-8336-313d75228ac9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:38.637019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:38.652995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1bfe22-969c-448d-8cef-29afee26648b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:38.666944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccdab2-5cb8-45bd-bf22-e1e2c14b1215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:38.668457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccdab2-5cb8-45bd-bf22-e1e2c14b1215 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:38.670131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccdab2-5cb8-45bd-bf22-e1e2c14b1215 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:38.671241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccdab2-5cb8-45bd-bf22-e1e2c14b1215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:38.693181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-19ccdab2-5cb8-45bd-bf22-e1e2c14b1215 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:38.717851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfe46b-4e31-41c5-8336-313d75228ac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:38.720338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfe46b-4e31-41c5-8336-313d75228ac9 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:38.753080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:38.756577 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3277/6559] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:50:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:50:38.759084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2538e-1ad9-4a81-8d0b-787f87b2ce87 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:38.760307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2538e-1ad9-4a81-8d0b-787f87b2ce87 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:38.761678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2538e-1ad9-4a81-8d0b-787f87b2ce87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:38.803601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-85d2538e-1ad9-4a81-8d0b-787f87b2ce87 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:38.812058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-85d2538e-1ad9-4a81-8d0b-787f87b2ce87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:38.835151 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3278/6560] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:38.837122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2538e-1ad9-4a81-8d0b-787f87b2ce87 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:38.847048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-85d2538e-1ad9-4a81-8d0b-787f87b2ce87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:38.855005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:38.877652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ccdab2-5cb8-45bd-bf22-e1e2c14b1215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:38.879753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ccdab2-5cb8-45bd-bf22-e1e2c14b1215 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:38.887263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2538e-1ad9-4a81-8d0b-787f87b2ce87 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:38.892791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:38.899777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08abf50-419c-4ab1-bded-c21fd5a914bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:38.901365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08abf50-419c-4ab1-bded-c21fd5a914bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:38.902495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08abf50-419c-4ab1-bded-c21fd5a914bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:38.903553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08abf50-419c-4ab1-bded-c21fd5a914bc admin admin] PATH_INFO: `/v3/users/07b22d9c881e4e289eabbc4cedbd91fe` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:38.904902 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3283/6561] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:50:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:50:38.906077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccdab2-5cb8-45bd-bf22-e1e2c14b1215 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:38.906225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08abf50-419c-4ab1-bded-c21fd5a914bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=07b22d9c881e4e289eabbc4cedbd91fe)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:38.912523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-19ccdab2-5cb8-45bd-bf22-e1e2c14b1215 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:38.913747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08abf50-419c-4ab1-bded-c21fd5a914bc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:38.950771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccdab2-5cb8-45bd-bf22-e1e2c14b1215 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:38.963049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb3019-f021-42aa-b85a-8252baf17880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:38.965574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb3019-f021-42aa-b85a-8252baf17880 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:38.965574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb3019-f021-42aa-b85a-8252baf17880 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:38.965574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb3019-f021-42aa-b85a-8252baf17880 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:38.970219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb3019-f021-42aa-b85a-8252baf17880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:38.972858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb3019-f021-42aa-b85a-8252baf17880 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:39.075156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:39.095001 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3284/6562] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:38 2022] POST /identity/v3/projects => generated 387 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:39.097285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb3019-f021-42aa-b85a-8252baf17880 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:39.163342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:39.228445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d08abf50-419c-4ab1-bded-c21fd5a914bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07b22d9c881e4e289eabbc4cedbd91fe'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:39.232529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d08abf50-419c-4ab1-bded-c21fd5a914bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07b22d9c881e4e289eabbc4cedbd91fe'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:39.246647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d08abf50-419c-4ab1-bded-c21fd5a914bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07b22d9c881e4e289eabbc4cedbd91fe'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:39.290069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb3019-f021-42aa-b85a-8252baf17880 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:39.301697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d08abf50-419c-4ab1-bded-c21fd5a914bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07b22d9c881e4e289eabbc4cedbd91fe'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:39.307096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea436f7-0ab4-4685-aad2-c0ff24095176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:39.307739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea436f7-0ab4-4685-aad2-c0ff24095176 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:39.308025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea436f7-0ab4-4685-aad2-c0ff24095176 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:39.308303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea436f7-0ab4-4685-aad2-c0ff24095176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:39.319074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-aea436f7-0ab4-4685-aad2-c0ff24095176 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:39.414248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d08abf50-419c-4ab1-bded-c21fd5a914bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07b22d9c881e4e289eabbc4cedbd91fe'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:39.423125 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3279/6563] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:38 2022] DELETE /identity/v3/users/07b22d9c881e4e289eabbc4cedbd91fe => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:39.427373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08abf50-419c-4ab1-bded-c21fd5a914bc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:39.435487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d08abf50-419c-4ab1-bded-c21fd5a914bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:39.497905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:39.501971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea436f7-0ab4-4685-aad2-c0ff24095176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:39.503757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea436f7-0ab4-4685-aad2-c0ff24095176 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:39.529423 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3285/6564] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:50:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:50:39.591591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:39.652495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08abf50-419c-4ab1-bded-c21fd5a914bc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:39.658343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4d9f1-0eea-4cf9-96ba-85fce3827408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:39.658982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4d9f1-0eea-4cf9-96ba-85fce3827408 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:39.659273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4d9f1-0eea-4cf9-96ba-85fce3827408 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:39.659683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4d9f1-0eea-4cf9-96ba-85fce3827408 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:39.660667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4d9f1-0eea-4cf9-96ba-85fce3827408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:39.684890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4d9f1-0eea-4cf9-96ba-85fce3827408 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:39.708767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:39.831981 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3280/6565] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:39 2022] POST /identity/v3/users => generated 294 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:39.835993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea436f7-0ab4-4685-aad2-c0ff24095176 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:39.848599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea436f7-0ab4-4685-aad2-c0ff24095176 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:39.858841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b3e88-ac3d-4746-9e52-d90f1e56f0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:39.859863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b3e88-ac3d-4746-9e52-d90f1e56f0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:39.860645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b3e88-ac3d-4746-9e52-d90f1e56f0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:39.861105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b3e88-ac3d-4746-9e52-d90f1e56f0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:39.862127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b3e88-ac3d-4746-9e52-d90f1e56f0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:39.863957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b3e88-ac3d-4746-9e52-d90f1e56f0a2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:39.900281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4d9f1-0eea-4cf9-96ba-85fce3827408 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:39.902136 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3286/6566] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:39.917708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4d9f1-0eea-4cf9-96ba-85fce3827408 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:39.932276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a8733-5dab-4cee-891d-d24ea3022eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:39.933149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a8733-5dab-4cee-891d-d24ea3022eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:39.933747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a8733-5dab-4cee-891d-d24ea3022eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:39.934130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a8733-5dab-4cee-891d-d24ea3022eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:39.934882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a8733-5dab-4cee-891d-d24ea3022eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:39.936660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a8733-5dab-4cee-891d-d24ea3022eb0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:39.963739 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3281/6567] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:39.965029 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b3e88-ac3d-4746-9e52-d90f1e56f0a2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:39.977341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b3e88-ac3d-4746-9e52-d90f1e56f0a2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:39.983250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513edd5-fff3-48cc-89de-8087bdc74c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:39.983978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513edd5-fff3-48cc-89de-8087bdc74c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:39.984197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513edd5-fff3-48cc-89de-8087bdc74c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:39.984480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513edd5-fff3-48cc-89de-8087bdc74c1c admin admin] PATH_INFO: `/v3/projects/ca1836866b464603bd859b443649713c/users/6e05d6d2e7114a41ab37935117d0902b/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:39.990667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a8733-5dab-4cee-891d-d24ea3022eb0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:39.993883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-102a8733-5dab-4cee-891d-d24ea3022eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:40.005290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513edd5-fff3-48cc-89de-8087bdc74c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1836866b464603bd859b443649713c, user_id=6e05d6d2e7114a41ab37935117d0902b, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:40.012135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:40.012285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513edd5-fff3-48cc-89de-8087bdc74c1c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:40.020548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a8733-5dab-4cee-891d-d24ea3022eb0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:40.033563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc33a60-20a2-41b2-a3b9-bb8fe18aea3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:40.035249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc33a60-20a2-41b2-a3b9-bb8fe18aea3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:40.040696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc33a60-20a2-41b2-a3b9-bb8fe18aea3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:40.040696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc33a60-20a2-41b2-a3b9-bb8fe18aea3d admin admin] PATH_INFO: `/v3/projects/088418dd4e4d4385a7c8294b7497ec59` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:40.040696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc33a60-20a2-41b2-a3b9-bb8fe18aea3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=088418dd4e4d4385a7c8294b7497ec59)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:40.040696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc33a60-20a2-41b2-a3b9-bb8fe18aea3d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:40.128870 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3287/6568] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:39 2022] PUT /identity/v3/projects/ca1836866b464603bd859b443649713c/users/6e05d6d2e7114a41ab37935117d0902b/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:40.134207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333c3e2-7f36-45d9-b4a7-a4f1f4317a96 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:40.134589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333c3e2-7f36-45d9-b4a7-a4f1f4317a96 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:40.135012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333c3e2-7f36-45d9-b4a7-a4f1f4317a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:40.171109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:40.252508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6fc33a60-20a2-41b2-a3b9-bb8fe18aea3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '088418dd4e4d4385a7c8294b7497ec59', 'request_id': 'req-6fc33a60-20a2-41b2-a3b9-bb8fe18aea3d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:40.281564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1333c3e2-7f36-45d9-b4a7-a4f1f4317a96 None None] MFA Rules not processed for user `6e05d6d2e7114a41ab37935117d0902b`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:40.283849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1333c3e2-7f36-45d9-b4a7-a4f1f4317a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:40.359951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6fc33a60-20a2-41b2-a3b9-bb8fe18aea3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '088418dd4e4d4385a7c8294b7497ec59', 'request_id': 'req-6fc33a60-20a2-41b2-a3b9-bb8fe18aea3d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:40.375103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6fc33a60-20a2-41b2-a3b9-bb8fe18aea3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '088418dd4e4d4385a7c8294b7497ec59', 'request_id': 'req-6fc33a60-20a2-41b2-a3b9-bb8fe18aea3d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:40.404798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6fc33a60-20a2-41b2-a3b9-bb8fe18aea3d admin admin] The token cache is being invalidate because project 088418dd4e4d4385a7c8294b7497ec59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:40.405504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6fc33a60-20a2-41b2-a3b9-bb8fe18aea3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:40.407347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6fc33a60-20a2-41b2-a3b9-bb8fe18aea3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:40.417018 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3282/6569] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:39 2022] DELETE /identity/v3/projects/088418dd4e4d4385a7c8294b7497ec59 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:40.434060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc33a60-20a2-41b2-a3b9-bb8fe18aea3d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:40.434060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6fc33a60-20a2-41b2-a3b9-bb8fe18aea3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:40.480573 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3288/6570] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:40.495971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333c3e2-7f36-45d9-b4a7-a4f1f4317a96 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:40.497897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1333c3e2-7f36-45d9-b4a7-a4f1f4317a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:40.643301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333c3e2-7f36-45d9-b4a7-a4f1f4317a96 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:40.653605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9140413-8087-411d-9981-8b5c3d2d63a1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:40.654275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9140413-8087-411d-9981-8b5c3d2d63a1 service glance] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:40.654816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9140413-8087-411d-9981-8b5c3d2d63a1 service glance] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:40.655131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9140413-8087-411d-9981-8b5c3d2d63a1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:40.658868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d9140413-8087-411d-9981-8b5c3d2d63a1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:40.691990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc33a60-20a2-41b2-a3b9-bb8fe18aea3d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:40.698497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf185f2-9b7c-47fb-9b68-d9e33994b6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:40.699167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf185f2-9b7c-47fb-9b68-d9e33994b6a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:40.699452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf185f2-9b7c-47fb-9b68-d9e33994b6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:40.699732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf185f2-9b7c-47fb-9b68-d9e33994b6a1 admin admin] PATH_INFO: `/v3/users/789689f163184bb9b3b7548fde5a5b33` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:40.700913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf185f2-9b7c-47fb-9b68-d9e33994b6a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=789689f163184bb9b3b7548fde5a5b33)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:40.702996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf185f2-9b7c-47fb-9b68-d9e33994b6a1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:40.749533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:40.822907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9140413-8087-411d-9981-8b5c3d2d63a1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:40.824717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9140413-8087-411d-9981-8b5c3d2d63a1 service glance] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:40.835897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:40.879022 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3289/6571] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:50:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:50:40.880579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9140413-8087-411d-9981-8b5c3d2d63a1 service glance] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:40.882165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d9140413-8087-411d-9981-8b5c3d2d63a1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:40.908620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9140413-8087-411d-9981-8b5c3d2d63a1 service glance] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:40.915108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0f40e-2170-4877-af38-9466b3891172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:40.916285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0f40e-2170-4877-af38-9466b3891172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:40.917047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0f40e-2170-4877-af38-9466b3891172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:40.917543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0f40e-2170-4877-af38-9466b3891172 admin admin] PATH_INFO: `/v3/projects/af6ba0689ad442b0be3a93b71e17dd0c` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:40.919349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0f40e-2170-4877-af38-9466b3891172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af6ba0689ad442b0be3a93b71e17dd0c)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:40.921786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0f40e-2170-4877-af38-9466b3891172 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:40.991820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-adf185f2-9b7c-47fb-9b68-d9e33994b6a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '789689f163184bb9b3b7548fde5a5b33'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:40.992618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-adf185f2-9b7c-47fb-9b68-d9e33994b6a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '789689f163184bb9b3b7548fde5a5b33'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:41.012741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-adf185f2-9b7c-47fb-9b68-d9e33994b6a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '789689f163184bb9b3b7548fde5a5b33'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:41.064233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-adf185f2-9b7c-47fb-9b68-d9e33994b6a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '789689f163184bb9b3b7548fde5a5b33'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:41.094707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ebe0f40e-2170-4877-af38-9466b3891172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af6ba0689ad442b0be3a93b71e17dd0c', 'request_id': 'req-ebe0f40e-2170-4877-af38-9466b3891172'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:41.112830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ebe0f40e-2170-4877-af38-9466b3891172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af6ba0689ad442b0be3a93b71e17dd0c', 'request_id': 'req-ebe0f40e-2170-4877-af38-9466b3891172'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:41.118411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ebe0f40e-2170-4877-af38-9466b3891172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af6ba0689ad442b0be3a93b71e17dd0c', 'request_id': 'req-ebe0f40e-2170-4877-af38-9466b3891172'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:41.149299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-adf185f2-9b7c-47fb-9b68-d9e33994b6a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '789689f163184bb9b3b7548fde5a5b33'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:41.157470 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3283/6572] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:40 2022] DELETE /identity/v3/users/789689f163184bb9b3b7548fde5a5b33 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:41.158388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf185f2-9b7c-47fb-9b68-d9e33994b6a1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:41.166145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-adf185f2-9b7c-47fb-9b68-d9e33994b6a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:41.252437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ebe0f40e-2170-4877-af38-9466b3891172 admin admin] The token cache is being invalidate because project af6ba0689ad442b0be3a93b71e17dd0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:41.257829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ebe0f40e-2170-4877-af38-9466b3891172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:41.257829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ebe0f40e-2170-4877-af38-9466b3891172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:41.257829 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3290/6573] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:40 2022] DELETE /identity/v3/projects/af6ba0689ad442b0be3a93b71e17dd0c => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:41.257829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0f40e-2170-4877-af38-9466b3891172 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:41.260893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ebe0f40e-2170-4877-af38-9466b3891172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:41.332792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf185f2-9b7c-47fb-9b68-d9e33994b6a1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:41.339746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd41439-65d6-46ad-a60c-52f75f68a668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:41.340640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd41439-65d6-46ad-a60c-52f75f68a668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:41.343054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd41439-65d6-46ad-a60c-52f75f68a668 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:41.343054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd41439-65d6-46ad-a60c-52f75f68a668 admin admin] PATH_INFO: `/v3/projects/770e9d59282240eb8d7ffa431ff94068` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:41.344016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd41439-65d6-46ad-a60c-52f75f68a668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=770e9d59282240eb8d7ffa431ff94068)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:41.345967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd41439-65d6-46ad-a60c-52f75f68a668 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:41.381654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0f40e-2170-4877-af38-9466b3891172 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:41.389811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f06ec-21ad-43d8-b0aa-5b02d272eaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:41.390647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f06ec-21ad-43d8-b0aa-5b02d272eaae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:41.391041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f06ec-21ad-43d8-b0aa-5b02d272eaae admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:41.391415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f06ec-21ad-43d8-b0aa-5b02d272eaae admin admin] PATH_INFO: `/v3/projects/353267f54ec74dfa85376caea4440d69` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:41.395930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f06ec-21ad-43d8-b0aa-5b02d272eaae admin admin] RBAC: Authorizing `identity:delete_project(project_id=353267f54ec74dfa85376caea4440d69)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:41.400637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f06ec-21ad-43d8-b0aa-5b02d272eaae admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:41.548046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dbd41439-65d6-46ad-a60c-52f75f68a668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '770e9d59282240eb8d7ffa431ff94068', 'request_id': 'req-dbd41439-65d6-46ad-a60c-52f75f68a668'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:41.629378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fa7f06ec-21ad-43d8-b0aa-5b02d272eaae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '353267f54ec74dfa85376caea4440d69', 'request_id': 'req-fa7f06ec-21ad-43d8-b0aa-5b02d272eaae'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:41.642019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fa7f06ec-21ad-43d8-b0aa-5b02d272eaae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '353267f54ec74dfa85376caea4440d69', 'request_id': 'req-fa7f06ec-21ad-43d8-b0aa-5b02d272eaae'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:41.657726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dbd41439-65d6-46ad-a60c-52f75f68a668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '770e9d59282240eb8d7ffa431ff94068', 'request_id': 'req-dbd41439-65d6-46ad-a60c-52f75f68a668'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:41.660403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fa7f06ec-21ad-43d8-b0aa-5b02d272eaae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '353267f54ec74dfa85376caea4440d69', 'request_id': 'req-fa7f06ec-21ad-43d8-b0aa-5b02d272eaae'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:41.676592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dbd41439-65d6-46ad-a60c-52f75f68a668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '770e9d59282240eb8d7ffa431ff94068', 'request_id': 'req-dbd41439-65d6-46ad-a60c-52f75f68a668'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:41.719226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dbd41439-65d6-46ad-a60c-52f75f68a668 admin admin] The token cache is being invalidate because project 770e9d59282240eb8d7ffa431ff94068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:41.719892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dbd41439-65d6-46ad-a60c-52f75f68a668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:41.721969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dbd41439-65d6-46ad-a60c-52f75f68a668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:41.723633 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3284/6574] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:41 2022] DELETE /identity/v3/projects/770e9d59282240eb8d7ffa431ff94068 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:41.729060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6db16-9028-4f8b-a512-12858f0686e6 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:41.729361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6db16-9028-4f8b-a512-12858f0686e6 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:41.733137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6db16-9028-4f8b-a512-12858f0686e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:41.779419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1ff6db16-9028-4f8b-a512-12858f0686e6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:41.782511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1ff6db16-9028-4f8b-a512-12858f0686e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:41.793879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fa7f06ec-21ad-43d8-b0aa-5b02d272eaae admin admin] The token cache is being invalidate because project 353267f54ec74dfa85376caea4440d69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:41.796265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fa7f06ec-21ad-43d8-b0aa-5b02d272eaae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:41.796265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fa7f06ec-21ad-43d8-b0aa-5b02d272eaae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:41.799664 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3291/6575] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:41 2022] DELETE /identity/v3/projects/353267f54ec74dfa85376caea4440d69 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:41.800532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f06ec-21ad-43d8-b0aa-5b02d272eaae admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:41.813191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fa7f06ec-21ad-43d8-b0aa-5b02d272eaae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:41.982313 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3285/6576] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:41.982313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f3e72-398b-44c2-a87d-39839e87ed0d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:41.982313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f3e72-398b-44c2-a87d-39839e87ed0d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:41.982313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f3e72-398b-44c2-a87d-39839e87ed0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:42.051110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f27f3e72-398b-44c2-a87d-39839e87ed0d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:42.053554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f27f3e72-398b-44c2-a87d-39839e87ed0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:42.061532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f06ec-21ad-43d8-b0aa-5b02d272eaae admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:42.083384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f62143-3ce7-4f8c-8051-8f6facaab298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:42.085841 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3286/6577] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:42.094102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f62143-3ce7-4f8c-8051-8f6facaab298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:42.095188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f62143-3ce7-4f8c-8051-8f6facaab298 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:42.095500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f62143-3ce7-4f8c-8051-8f6facaab298 admin admin] PATH_INFO: `/v3/users/597dbf9e536b458bbe4eb009d3501965` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:42.098814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264bfde-5501-49dc-ba57-d887bba9945c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:42.099166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264bfde-5501-49dc-ba57-d887bba9945c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:42.099430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264bfde-5501-49dc-ba57-d887bba9945c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:42.109808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f62143-3ce7-4f8c-8051-8f6facaab298 admin admin] RBAC: Authorizing `identity:delete_user(user_id=597dbf9e536b458bbe4eb009d3501965)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:42.119235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f62143-3ce7-4f8c-8051-8f6facaab298 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:42.176273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-2264bfde-5501-49dc-ba57-d887bba9945c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:42.211253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2264bfde-5501-49dc-ba57-d887bba9945c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:42.228269 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3287/6578] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:42.240477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39c956-d9b0-4236-a9e6-3a5872353eb4 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:42.241528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39c956-d9b0-4236-a9e6-3a5872353eb4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:42.241528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39c956-d9b0-4236-a9e6-3a5872353eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:42.300236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5e39c956-d9b0-4236-a9e6-3a5872353eb4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:42.302152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5e39c956-d9b0-4236-a9e6-3a5872353eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:42.336869 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3288/6579] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:42.338529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2df8b-17da-4a2b-bc24-dc5b3306da3a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:42.339678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2df8b-17da-4a2b-bc24-dc5b3306da3a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:42.341770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2df8b-17da-4a2b-bc24-dc5b3306da3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:42.387154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-19e2df8b-17da-4a2b-bc24-dc5b3306da3a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:42.393453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-19e2df8b-17da-4a2b-bc24-dc5b3306da3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:42.409358 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3289/6580] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:42.411375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89d818-94ab-47f1-8893-b0759808d62b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:42.411862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89d818-94ab-47f1-8893-b0759808d62b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:42.412400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89d818-94ab-47f1-8893-b0759808d62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:42.446185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9a89d818-94ab-47f1-8893-b0759808d62b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:42.448057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9a89d818-94ab-47f1-8893-b0759808d62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:42.468618 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3290/6581] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:42.470011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89d818-94ab-47f1-8893-b0759808d62b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:42.488235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89d818-94ab-47f1-8893-b0759808d62b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:42.501761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ceba4-07cf-459c-83a1-f4401063e78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:42.502724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ceba4-07cf-459c-83a1-f4401063e78f admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:42.503237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ceba4-07cf-459c-83a1-f4401063e78f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:42.505201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ceba4-07cf-459c-83a1-f4401063e78f admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:42.508945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ceba4-07cf-459c-83a1-f4401063e78f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:50:42.509508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ceba4-07cf-459c-83a1-f4401063e78f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:42.512524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ceba4-07cf-459c-83a1-f4401063e78f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:42.549583 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3291/6582] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:42.550573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ceba4-07cf-459c-83a1-f4401063e78f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:42.574569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ceba4-07cf-459c-83a1-f4401063e78f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:42.580710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f520ec-4890-4096-8162-3c77954de1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:42.581431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f520ec-4890-4096-8162-3c77954de1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:42.595335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f520ec-4890-4096-8162-3c77954de1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:42.596455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f520ec-4890-4096-8162-3c77954de1b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:42.599968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f520ec-4890-4096-8162-3c77954de1b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:50:42.600374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f520ec-4890-4096-8162-3c77954de1b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:42.602758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f520ec-4890-4096-8162-3c77954de1b6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:42.624613 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3292/6583] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:42.625831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f520ec-4890-4096-8162-3c77954de1b6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:42.645150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f520ec-4890-4096-8162-3c77954de1b6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:42.675047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82909fd8-591a-4bca-b3d2-953fe9447f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:42.675497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82909fd8-591a-4bca-b3d2-953fe9447f09 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:42.676800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82909fd8-591a-4bca-b3d2-953fe9447f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:42.679492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82909fd8-591a-4bca-b3d2-953fe9447f09 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:42.680894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82909fd8-591a-4bca-b3d2-953fe9447f09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:50:42.683011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82909fd8-591a-4bca-b3d2-953fe9447f09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:42.687559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82909fd8-591a-4bca-b3d2-953fe9447f09 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:42.721846 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3293/6584] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:42.724234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82909fd8-591a-4bca-b3d2-953fe9447f09 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:42.761458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82909fd8-591a-4bca-b3d2-953fe9447f09 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:42.774814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0455f3-6323-4da2-a200-3bee1391ff21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:42.775816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0455f3-6323-4da2-a200-3bee1391ff21 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:42.776219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0455f3-6323-4da2-a200-3bee1391ff21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:42.776563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0455f3-6323-4da2-a200-3bee1391ff21 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:42.779725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0455f3-6323-4da2-a200-3bee1391ff21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:42.781742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0455f3-6323-4da2-a200-3bee1391ff21 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:42.805092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30f62143-3ce7-4f8c-8051-8f6facaab298 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '597dbf9e536b458bbe4eb009d3501965'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:42.806222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30f62143-3ce7-4f8c-8051-8f6facaab298 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '597dbf9e536b458bbe4eb009d3501965'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:42.839115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30f62143-3ce7-4f8c-8051-8f6facaab298 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '597dbf9e536b458bbe4eb009d3501965'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:42.873017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30f62143-3ce7-4f8c-8051-8f6facaab298 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '597dbf9e536b458bbe4eb009d3501965'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:42.876802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30f62143-3ce7-4f8c-8051-8f6facaab298 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '597dbf9e536b458bbe4eb009d3501965'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:42.886865 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3294/6585] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:42 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:42.886865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0455f3-6323-4da2-a200-3bee1391ff21 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:42.889065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6b0455f3-6323-4da2-a200-3bee1391ff21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:42.942209 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3292/6586] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:41 2022] DELETE /identity/v3/users/597dbf9e536b458bbe4eb009d3501965 => generated 0 bytes in 1142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:42.943260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f62143-3ce7-4f8c-8051-8f6facaab298 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:42.949450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-30f62143-3ce7-4f8c-8051-8f6facaab298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:43.071635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0455f3-6323-4da2-a200-3bee1391ff21 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:43.112116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f62143-3ce7-4f8c-8051-8f6facaab298 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:43.138838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e33e6-ecb8-4d4e-aa9c-2b3e135364b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:43.142289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e33e6-ecb8-4d4e-aa9c-2b3e135364b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:43.144478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e33e6-ecb8-4d4e-aa9c-2b3e135364b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:43.147104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e33e6-ecb8-4d4e-aa9c-2b3e135364b6 admin admin] PATH_INFO: `/v3/projects/e54a0d25549e4f90a816ef4425575f29` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:43.151014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e33e6-ecb8-4d4e-aa9c-2b3e135364b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e54a0d25549e4f90a816ef4425575f29)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:43.156530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e33e6-ecb8-4d4e-aa9c-2b3e135364b6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:43.283154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08382f4-a8fd-45ae-926d-08d2a1fe8898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:43.283622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08382f4-a8fd-45ae-926d-08d2a1fe8898 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:43.286374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:43.290400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08382f4-a8fd-45ae-926d-08d2a1fe8898 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:43.290400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08382f4-a8fd-45ae-926d-08d2a1fe8898 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:43.290400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08382f4-a8fd-45ae-926d-08d2a1fe8898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:43.291568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08382f4-a8fd-45ae-926d-08d2a1fe8898 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:43.349129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:43.390275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-046e33e6-ecb8-4d4e-aa9c-2b3e135364b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e54a0d25549e4f90a816ef4425575f29', 'request_id': 'req-046e33e6-ecb8-4d4e-aa9c-2b3e135364b6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:43.399643 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3295/6587] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:42 2022] POST /identity/v3/projects => generated 373 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:43.403753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08382f4-a8fd-45ae-926d-08d2a1fe8898 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:43.405156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-046e33e6-ecb8-4d4e-aa9c-2b3e135364b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e54a0d25549e4f90a816ef4425575f29', 'request_id': 'req-046e33e6-ecb8-4d4e-aa9c-2b3e135364b6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:43.408273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f08382f4-a8fd-45ae-926d-08d2a1fe8898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:43.418164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-046e33e6-ecb8-4d4e-aa9c-2b3e135364b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e54a0d25549e4f90a816ef4425575f29', 'request_id': 'req-046e33e6-ecb8-4d4e-aa9c-2b3e135364b6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:43.504493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-046e33e6-ecb8-4d4e-aa9c-2b3e135364b6 admin admin] The token cache is being invalidate because project e54a0d25549e4f90a816ef4425575f29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:43.504802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-046e33e6-ecb8-4d4e-aa9c-2b3e135364b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:43.510840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-046e33e6-ecb8-4d4e-aa9c-2b3e135364b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:43.517054 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3293/6588] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:42 2022] DELETE /identity/v3/projects/e54a0d25549e4f90a816ef4425575f29 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:43.518016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e33e6-ecb8-4d4e-aa9c-2b3e135364b6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:43.521037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-046e33e6-ecb8-4d4e-aa9c-2b3e135364b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:43.544998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08382f4-a8fd-45ae-926d-08d2a1fe8898 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:43.571340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d537c-9aa0-49cd-a4ec-b5a0ccc3a8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:43.571994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d537c-9aa0-49cd-a4ec-b5a0ccc3a8f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:43.573362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d537c-9aa0-49cd-a4ec-b5a0ccc3a8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:43.573362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d537c-9aa0-49cd-a4ec-b5a0ccc3a8f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:43.573607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d537c-9aa0-49cd-a4ec-b5a0ccc3a8f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:43.575465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d537c-9aa0-49cd-a4ec-b5a0ccc3a8f5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:43.688470 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3296/6589] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:43 2022] POST /identity/v3/projects => generated 379 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:43.690138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685e631-b9e6-446f-8097-2ced8f56575f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:43.690608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685e631-b9e6-446f-8097-2ced8f56575f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:43.691044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685e631-b9e6-446f-8097-2ced8f56575f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:43.702260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e33e6-ecb8-4d4e-aa9c-2b3e135364b6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:43.758998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-7685e631-b9e6-446f-8097-2ced8f56575f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:43.760487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7685e631-b9e6-446f-8097-2ced8f56575f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:43.816731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7110f1d-b208-4069-a7cd-45ffee0e20e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:43.818081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7110f1d-b208-4069-a7cd-45ffee0e20e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:43.819168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7110f1d-b208-4069-a7cd-45ffee0e20e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:43.824867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7110f1d-b208-4069-a7cd-45ffee0e20e6 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:43.824867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7110f1d-b208-4069-a7cd-45ffee0e20e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:43.826328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7110f1d-b208-4069-a7cd-45ffee0e20e6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:43.945343 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3297/6590] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:43.949211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685e631-b9e6-446f-8097-2ced8f56575f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:43.949211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7685e631-b9e6-446f-8097-2ced8f56575f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:43.976289 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3294/6591] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:43 2022] POST /identity/v3/users => generated 290 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:43.976289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fb115-27e5-4ba0-bb69-34426f934210 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:43.976289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fb115-27e5-4ba0-bb69-34426f934210 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:43.976289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fb115-27e5-4ba0-bb69-34426f934210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:43.983208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685e631-b9e6-446f-8097-2ced8f56575f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:43.998342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df564bc-b0f3-4017-a02e-020bad4c7974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:44.001439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df564bc-b0f3-4017-a02e-020bad4c7974 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:44.001439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df564bc-b0f3-4017-a02e-020bad4c7974 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:44.001665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df564bc-b0f3-4017-a02e-020bad4c7974 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:44.005386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df564bc-b0f3-4017-a02e-020bad4c7974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:44.013794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df564bc-b0f3-4017-a02e-020bad4c7974 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:44.033575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-171fb115-27e5-4ba0-bb69-34426f934210 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:44.034856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-171fb115-27e5-4ba0-bb69-34426f934210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:44.051734 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3295/6592] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:44.054406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fb115-27e5-4ba0-bb69-34426f934210 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:44.060238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-171fb115-27e5-4ba0-bb69-34426f934210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:44.099775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fb115-27e5-4ba0-bb69-34426f934210 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:44.115176 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3298/6593] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:43 2022] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:44.121088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df564bc-b0f3-4017-a02e-020bad4c7974 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:44.121088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3df564bc-b0f3-4017-a02e-020bad4c7974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:44.125302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86808405-f2a8-4458-821c-5bd957fc2bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:44.126328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86808405-f2a8-4458-821c-5bd957fc2bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:44.127697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86808405-f2a8-4458-821c-5bd957fc2bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:44.128285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86808405-f2a8-4458-821c-5bd957fc2bf9 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:44.130209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86808405-f2a8-4458-821c-5bd957fc2bf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:44.135772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86808405-f2a8-4458-821c-5bd957fc2bf9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:44.228174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df564bc-b0f3-4017-a02e-020bad4c7974 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:44.234898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80752c71-e331-40f6-ae59-a83efa72d38c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:44.234898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80752c71-e331-40f6-ae59-a83efa72d38c service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:44.234898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80752c71-e331-40f6-ae59-a83efa72d38c service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:44.234898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80752c71-e331-40f6-ae59-a83efa72d38c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:44.249186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80752c71-e331-40f6-ae59-a83efa72d38c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:44.263687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80752c71-e331-40f6-ae59-a83efa72d38c service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:44.283800 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3299/6594] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:50:44.285075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80752c71-e331-40f6-ae59-a83efa72d38c service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:44.288775 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3296/6595] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:44 2022] POST /identity/v3/users => generated 290 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:44.290365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d166b7-170b-4f91-be45-1ee1c1818a30 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:44.290787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d166b7-170b-4f91-be45-1ee1c1818a30 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:44.291180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d166b7-170b-4f91-be45-1ee1c1818a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:44.300831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80752c71-e331-40f6-ae59-a83efa72d38c service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:44.313414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bde140-4614-41f1-972a-452adb7ed526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:44.314183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bde140-4614-41f1-972a-452adb7ed526 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:44.314480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bde140-4614-41f1-972a-452adb7ed526 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:44.314750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bde140-4614-41f1-972a-452adb7ed526 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:44.315411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bde140-4614-41f1-972a-452adb7ed526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:44.317049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bde140-4614-41f1-972a-452adb7ed526 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:44.345955 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3300/6596] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:44.345955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bde140-4614-41f1-972a-452adb7ed526 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:44.355277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b6d166b7-170b-4f91-be45-1ee1c1818a30 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:44.357346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b6d166b7-170b-4f91-be45-1ee1c1818a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:44.364340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bde140-4614-41f1-972a-452adb7ed526 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:44.375462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:44.382146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f130064-2bea-4994-9945-ff79647a0846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:44.382792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f130064-2bea-4994-9945-ff79647a0846 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:44.383105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f130064-2bea-4994-9945-ff79647a0846 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:44.383918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f130064-2bea-4994-9945-ff79647a0846 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:44.384582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f130064-2bea-4994-9945-ff79647a0846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:44.386237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f130064-2bea-4994-9945-ff79647a0846 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:44.389891 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3297/6597] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:44.389891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d166b7-170b-4f91-be45-1ee1c1818a30 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:44.422827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d166b7-170b-4f91-be45-1ee1c1818a30 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:44.423122 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3301/6598] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:44.424355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f130064-2bea-4994-9945-ff79647a0846 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:44.433284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d3319-cd81-444c-a2d7-54dd90b62e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:44.434128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d3319-cd81-444c-a2d7-54dd90b62e4b admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:44.434378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d3319-cd81-444c-a2d7-54dd90b62e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:44.434649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d3319-cd81-444c-a2d7-54dd90b62e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:44.435301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d3319-cd81-444c-a2d7-54dd90b62e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:44.437591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d3319-cd81-444c-a2d7-54dd90b62e4b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:44.455209 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3298/6599] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:44.455209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d3319-cd81-444c-a2d7-54dd90b62e4b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:44.461334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f130064-2bea-4994-9945-ff79647a0846 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:44.478403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa95980-bb46-47ff-b61c-7be994bc364d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:44.479083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa95980-bb46-47ff-b61c-7be994bc364d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:44.479331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa95980-bb46-47ff-b61c-7be994bc364d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:44.479607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa95980-bb46-47ff-b61c-7be994bc364d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:44.480272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa95980-bb46-47ff-b61c-7be994bc364d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:44.482617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa95980-bb46-47ff-b61c-7be994bc364d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:44.483121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d3319-cd81-444c-a2d7-54dd90b62e4b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:44.497900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13675ba-e8a1-4ad7-b243-79c8915070b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:44.498744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13675ba-e8a1-4ad7-b243-79c8915070b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:44.499037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13675ba-e8a1-4ad7-b243-79c8915070b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:44.499391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13675ba-e8a1-4ad7-b243-79c8915070b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:44.500732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13675ba-e8a1-4ad7-b243-79c8915070b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:50:44.501038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13675ba-e8a1-4ad7-b243-79c8915070b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:44.503556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13675ba-e8a1-4ad7-b243-79c8915070b6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:44.509923 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3302/6600] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:44.511504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa95980-bb46-47ff-b61c-7be994bc364d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:44.532739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa95980-bb46-47ff-b61c-7be994bc364d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:44.539415 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3299/6601] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:44.541934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28371ef7-e0e7-4d45-9ee9-02b925813ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:44.542638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28371ef7-e0e7-4d45-9ee9-02b925813ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:44.543106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28371ef7-e0e7-4d45-9ee9-02b925813ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:44.544576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13675ba-e8a1-4ad7-b243-79c8915070b6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:44.545184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28371ef7-e0e7-4d45-9ee9-02b925813ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:44.546316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28371ef7-e0e7-4d45-9ee9-02b925813ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:44.550587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28371ef7-e0e7-4d45-9ee9-02b925813ce4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:44.578478 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3303/6602] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:44.579596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28371ef7-e0e7-4d45-9ee9-02b925813ce4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:44.589218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13675ba-e8a1-4ad7-b243-79c8915070b6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:44.596896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2058b0-e788-4a57-838e-e1ea8f42e33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:44.597564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2058b0-e788-4a57-838e-e1ea8f42e33a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:44.603625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2058b0-e788-4a57-838e-e1ea8f42e33a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:44.603625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2058b0-e788-4a57-838e-e1ea8f42e33a admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:44.603625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2058b0-e788-4a57-838e-e1ea8f42e33a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:44.603625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2058b0-e788-4a57-838e-e1ea8f42e33a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:44.606271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28371ef7-e0e7-4d45-9ee9-02b925813ce4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:44.619942 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3300/6603] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:44.620956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2058b0-e788-4a57-838e-e1ea8f42e33a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:44.622063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0ee3b-e346-4a16-8b46-dd356066cdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:44.622754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0ee3b-e346-4a16-8b46-dd356066cdd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:44.623290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0ee3b-e346-4a16-8b46-dd356066cdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:44.624341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0ee3b-e346-4a16-8b46-dd356066cdd3 admin admin] PATH_INFO: `/v3/projects/2a130f04b9ce4128b7bd7b8217e9f49a/users/71433daac9564a47b539e5f7c800bb98/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:44.638803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2058b0-e788-4a57-838e-e1ea8f42e33a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:44.648841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0ee3b-e346-4a16-8b46-dd356066cdd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a130f04b9ce4128b7bd7b8217e9f49a, user_id=71433daac9564a47b539e5f7c800bb98, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:44.650566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1d00f-abec-4ab9-92ab-c7bf443a3464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:44.652615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0ee3b-e346-4a16-8b46-dd356066cdd3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:44.653814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1d00f-abec-4ab9-92ab-c7bf443a3464 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:44.654130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1d00f-abec-4ab9-92ab-c7bf443a3464 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:44.654415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1d00f-abec-4ab9-92ab-c7bf443a3464 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:44.657615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1d00f-abec-4ab9-92ab-c7bf443a3464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:44.661340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1d00f-abec-4ab9-92ab-c7bf443a3464 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:44.686813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:44.721082 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3304/6604] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:44 2022] PUT /identity/v3/projects/2a130f04b9ce4128b7bd7b8217e9f49a/users/71433daac9564a47b539e5f7c800bb98/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:44.723093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0ee3b-e346-4a16-8b46-dd356066cdd3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:44.775099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:44.831363 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3301/6605] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:44 2022] POST /identity/v3/projects => generated 365 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:44.833189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1d00f-abec-4ab9-92ab-c7bf443a3464 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:44.846310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0ee3b-e346-4a16-8b46-dd356066cdd3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:44.915495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:44.966125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:45.009508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1d00f-abec-4ab9-92ab-c7bf443a3464 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:45.022194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919618a-11f9-4ead-9279-2595fe17836f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:45.022859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919618a-11f9-4ead-9279-2595fe17836f admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:45.024443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d705a-c0ef-420d-a0c4-4c4ea476167e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:45.028354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d705a-c0ef-420d-a0c4-4c4ea476167e admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:45.028515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919618a-11f9-4ead-9279-2595fe17836f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:45.028515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919618a-11f9-4ead-9279-2595fe17836f admin admin] PATH_INFO: `/v3/projects/150ebe4fc47d40148e10e85228e2e17b/users/b493d4c3f45e4cb6b7a18e40b7ea5f18/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:45.029024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d705a-c0ef-420d-a0c4-4c4ea476167e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:45.029334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d705a-c0ef-420d-a0c4-4c4ea476167e admin admin] PATH_INFO: `/v3/projects/d00182c443f940e6abfda4bea252fea2/users/0edcae34419f403982b6a892f76df1db/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:45.093532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d705a-c0ef-420d-a0c4-4c4ea476167e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00182c443f940e6abfda4bea252fea2, user_id=0edcae34419f403982b6a892f76df1db, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:45.095414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919618a-11f9-4ead-9279-2595fe17836f admin admin] RBAC: Authorizing `identity:create_grant(project_id=150ebe4fc47d40148e10e85228e2e17b, user_id=b493d4c3f45e4cb6b7a18e40b7ea5f18, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:45.098379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919618a-11f9-4ead-9279-2595fe17836f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:45.104778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d705a-c0ef-420d-a0c4-4c4ea476167e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:45.232246 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3305/6606] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:44 2022] PUT /identity/v3/projects/150ebe4fc47d40148e10e85228e2e17b/users/b493d4c3f45e4cb6b7a18e40b7ea5f18/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:45.237015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff5777-5170-4224-af1c-4bd3863fd805 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:45.254283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff5777-5170-4224-af1c-4bd3863fd805 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:45.254283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff5777-5170-4224-af1c-4bd3863fd805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:45.257176 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3302/6607] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:44 2022] PUT /identity/v3/projects/d00182c443f940e6abfda4bea252fea2/users/0edcae34419f403982b6a892f76df1db/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:45.257557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d705a-c0ef-420d-a0c4-4c4ea476167e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:45.341651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d6ff5777-5170-4224-af1c-4bd3863fd805 None None] MFA Rules not processed for user `71433daac9564a47b539e5f7c800bb98`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:45.343850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d6ff5777-5170-4224-af1c-4bd3863fd805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:45.439339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d705a-c0ef-420d-a0c4-4c4ea476167e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:45.445380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7891e7-399c-434e-9428-f64f1311e21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:45.446927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7891e7-399c-434e-9428-f64f1311e21d admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:45.447451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7891e7-399c-434e-9428-f64f1311e21d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:45.448036 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7891e7-399c-434e-9428-f64f1311e21d admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:45.448837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7891e7-399c-434e-9428-f64f1311e21d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:45.451768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7891e7-399c-434e-9428-f64f1311e21d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:45.490576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:45.534425 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3306/6608] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:45.535479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff5777-5170-4224-af1c-4bd3863fd805 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:45.537312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d6ff5777-5170-4224-af1c-4bd3863fd805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:45.555637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff5777-5170-4224-af1c-4bd3863fd805 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:45.573095 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3303/6609] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:45 2022] POST /identity/v3/users => generated 283 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:45.575569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55f084-823e-4a1c-8bc9-57eb59045c65 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:45.575569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55f084-823e-4a1c-8bc9-57eb59045c65 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:45.575795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55f084-823e-4a1c-8bc9-57eb59045c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:45.580269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2590e0e-7607-4719-bc72-fea1a1de51d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:45.581704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2590e0e-7607-4719-bc72-fea1a1de51d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:45.583816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2590e0e-7607-4719-bc72-fea1a1de51d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:45.584721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2590e0e-7607-4719-bc72-fea1a1de51d3 admin admin] PATH_INFO: `/v3/projects/202624c683bf4864820d7164d9ab89de` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:45.589318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2590e0e-7607-4719-bc72-fea1a1de51d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=202624c683bf4864820d7164d9ab89de)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:45.595146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2590e0e-7607-4719-bc72-fea1a1de51d3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:45.597876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:45.630158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1f55f084-823e-4a1c-8bc9-57eb59045c65 None None] MFA Rules not processed for user `b493d4c3f45e4cb6b7a18e40b7ea5f18`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:45.631523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1f55f084-823e-4a1c-8bc9-57eb59045c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:45.745531 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3304/6610] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:45.756061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc403d0a-3e1b-449f-9fcf-64a0768c7c63 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:45.756929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc403d0a-3e1b-449f-9fcf-64a0768c7c63 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:45.757724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc403d0a-3e1b-449f-9fcf-64a0768c7c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:45.761499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a2590e0e-7607-4719-bc72-fea1a1de51d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '202624c683bf4864820d7164d9ab89de', 'request_id': 'req-a2590e0e-7607-4719-bc72-fea1a1de51d3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:45.814654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-bc403d0a-3e1b-449f-9fcf-64a0768c7c63 None None] MFA Rules not processed for user `0edcae34419f403982b6a892f76df1db`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:45.816555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bc403d0a-3e1b-449f-9fcf-64a0768c7c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:45.863045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a2590e0e-7607-4719-bc72-fea1a1de51d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '202624c683bf4864820d7164d9ab89de', 'request_id': 'req-a2590e0e-7607-4719-bc72-fea1a1de51d3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:45.873781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a2590e0e-7607-4719-bc72-fea1a1de51d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '202624c683bf4864820d7164d9ab89de', 'request_id': 'req-a2590e0e-7607-4719-bc72-fea1a1de51d3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:45.904273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a2590e0e-7607-4719-bc72-fea1a1de51d3 admin admin] The token cache is being invalidate because project 202624c683bf4864820d7164d9ab89de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:45.906676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a2590e0e-7607-4719-bc72-fea1a1de51d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:45.911332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a2590e0e-7607-4719-bc72-fea1a1de51d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:45.913842 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3307/6611] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:45 2022] DELETE /identity/v3/projects/202624c683bf4864820d7164d9ab89de => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:45.917056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2590e0e-7607-4719-bc72-fea1a1de51d3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:45.921160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a2590e0e-7607-4719-bc72-fea1a1de51d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:45.950109 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3305/6612] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:45.950109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc403d0a-3e1b-449f-9fcf-64a0768c7c63 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:45.950109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bc403d0a-3e1b-449f-9fcf-64a0768c7c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:46.007773 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2590e0e-7607-4719-bc72-fea1a1de51d3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:46.013594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c638148-80d6-402c-bc64-5e6e967cd3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:46.014275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c638148-80d6-402c-bc64-5e6e967cd3be admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:46.014674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c638148-80d6-402c-bc64-5e6e967cd3be admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:46.015068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c638148-80d6-402c-bc64-5e6e967cd3be admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:46.015710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c638148-80d6-402c-bc64-5e6e967cd3be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:46.017812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c638148-80d6-402c-bc64-5e6e967cd3be admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:46.027859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc403d0a-3e1b-449f-9fcf-64a0768c7c63 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:46.035441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60adb3-9d6c-47cf-93d4-41b2bec90bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:46.036585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60adb3-9d6c-47cf-93d4-41b2bec90bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:46.037248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60adb3-9d6c-47cf-93d4-41b2bec90bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:46.037765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60adb3-9d6c-47cf-93d4-41b2bec90bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:46.038682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60adb3-9d6c-47cf-93d4-41b2bec90bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:46.041051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60adb3-9d6c-47cf-93d4-41b2bec90bf4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:46.078185 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3306/6613] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:46.080697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60adb3-9d6c-47cf-93d4-41b2bec90bf4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:46.087229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9a60adb3-9d6c-47cf-93d4-41b2bec90bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:46.142132 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3308/6614] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:45 2022] POST /identity/v3/projects => generated 379 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:46.143607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c638148-80d6-402c-bc64-5e6e967cd3be admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:46.147138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8c638148-80d6-402c-bc64-5e6e967cd3be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:46.243141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:46.252363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:46.254367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c638148-80d6-402c-bc64-5e6e967cd3be admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:46.260467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60adb3-9d6c-47cf-93d4-41b2bec90bf4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:46.264903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c58491-fd05-4970-98b4-b62af1c11273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:46.265577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c58491-fd05-4970-98b4-b62af1c11273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:46.265895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c58491-fd05-4970-98b4-b62af1c11273 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:46.269470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c58491-fd05-4970-98b4-b62af1c11273 admin admin] PATH_INFO: `/v3/users/6e05d6d2e7114a41ab37935117d0902b` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:46.271291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c58491-fd05-4970-98b4-b62af1c11273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e05d6d2e7114a41ab37935117d0902b)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:46.273299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c58491-fd05-4970-98b4-b62af1c11273 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:46.339517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:46.380320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413d0cd-98bd-4f3d-88dd-eecde37949db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:46.380854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413d0cd-98bd-4f3d-88dd-eecde37949db service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:46.381286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413d0cd-98bd-4f3d-88dd-eecde37949db service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:46.381571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413d0cd-98bd-4f3d-88dd-eecde37949db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:46.386920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5413d0cd-98bd-4f3d-88dd-eecde37949db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:46.434949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:46.523083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413d0cd-98bd-4f3d-88dd-eecde37949db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:46.524586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413d0cd-98bd-4f3d-88dd-eecde37949db service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:46.543459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c8c58491-fd05-4970-98b4-b62af1c11273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e05d6d2e7114a41ab37935117d0902b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:46.556013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c8c58491-fd05-4970-98b4-b62af1c11273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e05d6d2e7114a41ab37935117d0902b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:46.556595 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3307/6615] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:50:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:50:46.556595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413d0cd-98bd-4f3d-88dd-eecde37949db service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:46.556595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5413d0cd-98bd-4f3d-88dd-eecde37949db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:46.560152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c8c58491-fd05-4970-98b4-b62af1c11273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e05d6d2e7114a41ab37935117d0902b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:46.568579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413d0cd-98bd-4f3d-88dd-eecde37949db service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:46.580642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd9b08-0b02-4fb6-9245-1437be3ec5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:46.581553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd9b08-0b02-4fb6-9245-1437be3ec5bd admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:46.582074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd9b08-0b02-4fb6-9245-1437be3ec5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:46.582745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c8c58491-fd05-4970-98b4-b62af1c11273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e05d6d2e7114a41ab37935117d0902b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:46.584724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd9b08-0b02-4fb6-9245-1437be3ec5bd admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:46.585495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd9b08-0b02-4fb6-9245-1437be3ec5bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:46.588427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd9b08-0b02-4fb6-9245-1437be3ec5bd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:46.674479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c8c58491-fd05-4970-98b4-b62af1c11273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e05d6d2e7114a41ab37935117d0902b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:46.682432 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3309/6616] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:46 2022] DELETE /identity/v3/users/6e05d6d2e7114a41ab37935117d0902b => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:46.683304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c58491-fd05-4970-98b4-b62af1c11273 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:46.689679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c8c58491-fd05-4970-98b4-b62af1c11273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:46.754446 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3308/6617] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:46 2022] POST /identity/v3/projects => generated 381 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:46.755472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd9b08-0b02-4fb6-9245-1437be3ec5bd admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:46.757775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cbdd9b08-0b02-4fb6-9245-1437be3ec5bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:46.874840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c58491-fd05-4970-98b4-b62af1c11273 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:46.887861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd9b08-0b02-4fb6-9245-1437be3ec5bd admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:46.888639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd1288-4240-414b-8248-3abad7855c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:46.889570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd1288-4240-414b-8248-3abad7855c5c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:46.895235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd1288-4240-414b-8248-3abad7855c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:46.895662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd1288-4240-414b-8248-3abad7855c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:46.901623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd1288-4240-414b-8248-3abad7855c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:46.901757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b578b5-0bbc-48f3-b16d-2ee18a818d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:46.901757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b578b5-0bbc-48f3-b16d-2ee18a818d6f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:46.901757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b578b5-0bbc-48f3-b16d-2ee18a818d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:46.901757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b578b5-0bbc-48f3-b16d-2ee18a818d6f admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:46.902154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b578b5-0bbc-48f3-b16d-2ee18a818d6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:46.902255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd1288-4240-414b-8248-3abad7855c5c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:46.908687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b578b5-0bbc-48f3-b16d-2ee18a818d6f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:46.948593 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3310/6618] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:46.948593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd1288-4240-414b-8248-3abad7855c5c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:46.962870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-02cd1288-4240-414b-8248-3abad7855c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:46.985610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd1288-4240-414b-8248-3abad7855c5c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:46.997852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681233c9-51ee-45a0-9a56-3ac92dd69687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:46.998616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681233c9-51ee-45a0-9a56-3ac92dd69687 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:47.005359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681233c9-51ee-45a0-9a56-3ac92dd69687 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:47.009796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681233c9-51ee-45a0-9a56-3ac92dd69687 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:47.010551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681233c9-51ee-45a0-9a56-3ac92dd69687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:47.013245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681233c9-51ee-45a0-9a56-3ac92dd69687 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:47.048349 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3309/6619] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:46 2022] POST /identity/v3/users => generated 296 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:47.050372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b578b5-0bbc-48f3-b16d-2ee18a818d6f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:47.115915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b578b5-0bbc-48f3-b16d-2ee18a818d6f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:47.128486 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3311/6620] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:46 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:47.128486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681233c9-51ee-45a0-9a56-3ac92dd69687 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:47.135769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c903219-ec57-4aa4-ae5b-103ca1052067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:47.136600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c903219-ec57-4aa4-ae5b-103ca1052067 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:47.136894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c903219-ec57-4aa4-ae5b-103ca1052067 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:47.137184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c903219-ec57-4aa4-ae5b-103ca1052067 admin admin] PATH_INFO: `/v3/projects/80fd10b00d764825a0b9a3666af03c84/users/86a8f248bc09470c8aa4b1d75887361b/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:47.151159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681233c9-51ee-45a0-9a56-3ac92dd69687 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:47.154553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:47.166732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fdc09-3c1a-4223-986e-c511c3722d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:47.167711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fdc09-3c1a-4223-986e-c511c3722d35 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:47.168221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fdc09-3c1a-4223-986e-c511c3722d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:47.169367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fdc09-3c1a-4223-986e-c511c3722d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:47.170900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fdc09-3c1a-4223-986e-c511c3722d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:47.174500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fdc09-3c1a-4223-986e-c511c3722d35 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:47.179596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c903219-ec57-4aa4-ae5b-103ca1052067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80fd10b00d764825a0b9a3666af03c84, user_id=86a8f248bc09470c8aa4b1d75887361b, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:47.187895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c903219-ec57-4aa4-ae5b-103ca1052067 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:47.201938 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3312/6621] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:47.203277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fdc09-3c1a-4223-986e-c511c3722d35 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:47.213300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:47.222873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fdc09-3c1a-4223-986e-c511c3722d35 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:47.231124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529209c-2fac-4912-9ebd-e8c57518b1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:47.231913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529209c-2fac-4912-9ebd-e8c57518b1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:47.232136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529209c-2fac-4912-9ebd-e8c57518b1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:47.232423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529209c-2fac-4912-9ebd-e8c57518b1c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:47.233254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529209c-2fac-4912-9ebd-e8c57518b1c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:47.241966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529209c-2fac-4912-9ebd-e8c57518b1c3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:47.252712 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3313/6622] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:47.253898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529209c-2fac-4912-9ebd-e8c57518b1c3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:47.267194 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3310/6623] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:47 2022] PUT /identity/v3/projects/80fd10b00d764825a0b9a3666af03c84/users/86a8f248bc09470c8aa4b1d75887361b/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:47.268380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c903219-ec57-4aa4-ae5b-103ca1052067 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:47.290645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529209c-2fac-4912-9ebd-e8c57518b1c3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:47.366141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:47.455050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c903219-ec57-4aa4-ae5b-103ca1052067 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:47.481866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990434f-3cae-4abe-bf0c-5071cc3f4e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:47.484480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990434f-3cae-4abe-bf0c-5071cc3f4e98 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:47.490156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990434f-3cae-4abe-bf0c-5071cc3f4e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:47.490156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990434f-3cae-4abe-bf0c-5071cc3f4e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:47.490156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990434f-3cae-4abe-bf0c-5071cc3f4e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:47.492991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990434f-3cae-4abe-bf0c-5071cc3f4e98 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:47.493972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83a741-c7ce-4622-9a5a-1eeae7f09868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:47.513256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83a741-c7ce-4622-9a5a-1eeae7f09868 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:47.517764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83a741-c7ce-4622-9a5a-1eeae7f09868 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:47.518200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83a741-c7ce-4622-9a5a-1eeae7f09868 admin admin] PATH_INFO: `/v3/projects/70796c11d62942e2b789261a811d570c/users/040be10bbb874614be64381928ad3d60/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:47.555868 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3311/6624] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:47.558050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656eb39-637d-4ab7-af05-559826a0c6ba None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:47.561012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656eb39-637d-4ab7-af05-559826a0c6ba None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:47.563608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656eb39-637d-4ab7-af05-559826a0c6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:47.575940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83a741-c7ce-4622-9a5a-1eeae7f09868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70796c11d62942e2b789261a811d570c, user_id=040be10bbb874614be64381928ad3d60, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:47.580947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83a741-c7ce-4622-9a5a-1eeae7f09868 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:47.648265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-5656eb39-637d-4ab7-af05-559826a0c6ba None None] MFA Rules not processed for user `86a8f248bc09470c8aa4b1d75887361b`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:47.652370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5656eb39-637d-4ab7-af05-559826a0c6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:47.684187 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3314/6625] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:47 2022] PUT /identity/v3/projects/70796c11d62942e2b789261a811d570c/users/040be10bbb874614be64381928ad3d60/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:47.686395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83a741-c7ce-4622-9a5a-1eeae7f09868 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:47.693793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dd83a741-c7ce-4622-9a5a-1eeae7f09868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:47.793029 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3312/6626] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:47.793885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656eb39-637d-4ab7-af05-559826a0c6ba None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:47.814597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656eb39-637d-4ab7-af05-559826a0c6ba None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:47.858257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83a741-c7ce-4622-9a5a-1eeae7f09868 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:47.874005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d19c83-cd9d-43f1-87ef-f6e0388e6235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:47.875000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d19c83-cd9d-43f1-87ef-f6e0388e6235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:47.875548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d19c83-cd9d-43f1-87ef-f6e0388e6235 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:47.875724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d19c83-cd9d-43f1-87ef-f6e0388e6235 admin admin] PATH_INFO: `/v3/users/6b6ffd86f1bd4a079385e0a9bcd72c07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:47.880271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d19c83-cd9d-43f1-87ef-f6e0388e6235 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6ffd86f1bd4a079385e0a9bcd72c07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:47.882640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d19c83-cd9d-43f1-87ef-f6e0388e6235 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:47.948802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad2314-14fb-45b7-a871-74bc772f8084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:47.949729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad2314-14fb-45b7-a871-74bc772f8084 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:47.950157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad2314-14fb-45b7-a871-74bc772f8084 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:47.950542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad2314-14fb-45b7-a871-74bc772f8084 admin admin] PATH_INFO: `/v3/projects/9d94fc0689124a62becb0ae45ffddd34/users/58d351389b2c4b9e8b351c08420952cf/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:47.972040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad2314-14fb-45b7-a871-74bc772f8084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d94fc0689124a62becb0ae45ffddd34, user_id=58d351389b2c4b9e8b351c08420952cf, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:47.978345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad2314-14fb-45b7-a871-74bc772f8084 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:48.083211 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3313/6627] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:47 2022] PUT /identity/v3/projects/9d94fc0689124a62becb0ae45ffddd34/users/58d351389b2c4b9e8b351c08420952cf/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:48.096823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad2314-14fb-45b7-a871-74bc772f8084 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:48.116827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:48.147788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-93d19c83-cd9d-43f1-87ef-f6e0388e6235 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6ffd86f1bd4a079385e0a9bcd72c07'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:48.155411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-93d19c83-cd9d-43f1-87ef-f6e0388e6235 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6ffd86f1bd4a079385e0a9bcd72c07'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:48.180788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-93d19c83-cd9d-43f1-87ef-f6e0388e6235 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6ffd86f1bd4a079385e0a9bcd72c07'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:48.234519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-93d19c83-cd9d-43f1-87ef-f6e0388e6235 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6ffd86f1bd4a079385e0a9bcd72c07'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:48.311161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad2314-14fb-45b7-a871-74bc772f8084 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:48.317196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17523ca4-a433-4357-bcb6-4cfec25d78ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:48.318129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17523ca4-a433-4357-bcb6-4cfec25d78ba admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:48.318589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17523ca4-a433-4357-bcb6-4cfec25d78ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:48.319033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17523ca4-a433-4357-bcb6-4cfec25d78ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:48.319865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17523ca4-a433-4357-bcb6-4cfec25d78ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:48.327285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17523ca4-a433-4357-bcb6-4cfec25d78ba admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:48.346533 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3314/6628] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:48.346533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17523ca4-a433-4357-bcb6-4cfec25d78ba admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:48.353065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-17523ca4-a433-4357-bcb6-4cfec25d78ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:48.388556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-93d19c83-cd9d-43f1-87ef-f6e0388e6235 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6ffd86f1bd4a079385e0a9bcd72c07'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:48.389251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17523ca4-a433-4357-bcb6-4cfec25d78ba admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:48.396387 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3315/6629] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:47 2022] DELETE /identity/v3/users/6b6ffd86f1bd4a079385e0a9bcd72c07 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:48.397463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d19c83-cd9d-43f1-87ef-f6e0388e6235 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:48.399769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-93d19c83-cd9d-43f1-87ef-f6e0388e6235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:48.402065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:48.404434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e972761-a1ab-4dd4-9840-3a368b1976c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:48.405097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e972761-a1ab-4dd4-9840-3a368b1976c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:48.405385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e972761-a1ab-4dd4-9840-3a368b1976c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:48.406013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e972761-a1ab-4dd4-9840-3a368b1976c7 admin admin] PATH_INFO: `/v3/projects/ca1836866b464603bd859b443649713c` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:48.410547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e972761-a1ab-4dd4-9840-3a368b1976c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca1836866b464603bd859b443649713c)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:48.412985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e972761-a1ab-4dd4-9840-3a368b1976c7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:48.549043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d19c83-cd9d-43f1-87ef-f6e0388e6235 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:48.575025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c023ba-8df0-4f52-a07b-981714d3ca21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:48.581816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c023ba-8df0-4f52-a07b-981714d3ca21 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:48.582294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c023ba-8df0-4f52-a07b-981714d3ca21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:48.582680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c023ba-8df0-4f52-a07b-981714d3ca21 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:48.584746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c023ba-8df0-4f52-a07b-981714d3ca21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:48.589717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c023ba-8df0-4f52-a07b-981714d3ca21 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:48.609010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3e972761-a1ab-4dd4-9840-3a368b1976c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca1836866b464603bd859b443649713c', 'request_id': 'req-3e972761-a1ab-4dd4-9840-3a368b1976c7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:48.624475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3e972761-a1ab-4dd4-9840-3a368b1976c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca1836866b464603bd859b443649713c', 'request_id': 'req-3e972761-a1ab-4dd4-9840-3a368b1976c7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:48.638297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3e972761-a1ab-4dd4-9840-3a368b1976c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca1836866b464603bd859b443649713c', 'request_id': 'req-3e972761-a1ab-4dd4-9840-3a368b1976c7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:48.762557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3e972761-a1ab-4dd4-9840-3a368b1976c7 admin admin] The token cache is being invalidate because project ca1836866b464603bd859b443649713c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:48.762912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3e972761-a1ab-4dd4-9840-3a368b1976c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:48.764239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3e972761-a1ab-4dd4-9840-3a368b1976c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:48.767197 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3315/6630] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:48 2022] DELETE /identity/v3/projects/ca1836866b464603bd859b443649713c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:48.770108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426191e-d628-4b08-ba5a-0c0b0b3cbd1c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:48.771946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426191e-d628-4b08-ba5a-0c0b0b3cbd1c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:48.772297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426191e-d628-4b08-ba5a-0c0b0b3cbd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:48.802901 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3316/6631] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:48 2022] POST /identity/v3/projects => generated 365 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:48.802901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c023ba-8df0-4f52-a07b-981714d3ca21 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:48.804732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b1c023ba-8df0-4f52-a07b-981714d3ca21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:48.850841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1426191e-d628-4b08-ba5a-0c0b0b3cbd1c None None] MFA Rules not processed for user `58d351389b2c4b9e8b351c08420952cf`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:48.853504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1426191e-d628-4b08-ba5a-0c0b0b3cbd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:48.944597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c023ba-8df0-4f52-a07b-981714d3ca21 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:48.963998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480baa0a-1ded-41c7-b97d-d92468fe414b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:48.964798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480baa0a-1ded-41c7-b97d-d92468fe414b admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:48.968174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480baa0a-1ded-41c7-b97d-d92468fe414b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:48.968541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480baa0a-1ded-41c7-b97d-d92468fe414b admin admin] PATH_INFO: `/v3/projects/70796c11d62942e2b789261a811d570c/users/040be10bbb874614be64381928ad3d60/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:48.974649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480baa0a-1ded-41c7-b97d-d92468fe414b admin admin] RBAC: Authorizing `identity:create_grant(project_id=70796c11d62942e2b789261a811d570c, user_id=040be10bbb874614be64381928ad3d60, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:48.988475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480baa0a-1ded-41c7-b97d-d92468fe414b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:49.015812 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3317/6632] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:48 2022] PUT /identity/v3/projects/70796c11d62942e2b789261a811d570c/users/040be10bbb874614be64381928ad3d60/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:49.017545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94f222-c16c-4ea1-a7d4-5864197eeb2e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:49.017917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94f222-c16c-4ea1-a7d4-5864197eeb2e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:49.018335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94f222-c16c-4ea1-a7d4-5864197eeb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:49.037582 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3316/6633] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:49.041068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe494c-8f84-4161-bc74-f44251899ac9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:49.041362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe494c-8f84-4161-bc74-f44251899ac9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:49.045000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe494c-8f84-4161-bc74-f44251899ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:49.085639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-bd94f222-c16c-4ea1-a7d4-5864197eeb2e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:49.089788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bd94f222-c16c-4ea1-a7d4-5864197eeb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:49.093077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ccbe494c-8f84-4161-bc74-f44251899ac9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:49.094340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ccbe494c-8f84-4161-bc74-f44251899ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:49.242091 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3318/6634] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:49.243350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94f222-c16c-4ea1-a7d4-5864197eeb2e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:49.254525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bd94f222-c16c-4ea1-a7d4-5864197eeb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:49.272828 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3317/6635] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:49.274789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf74d8-f879-424a-a715-0d286bbb6c44 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:49.275085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf74d8-f879-424a-a715-0d286bbb6c44 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:49.281622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf74d8-f879-424a-a715-0d286bbb6c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:49.303872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94f222-c16c-4ea1-a7d4-5864197eeb2e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:49.308392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:49.317992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3a784-2abd-4d37-90a6-56fad15e3ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:49.318658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3a784-2abd-4d37-90a6-56fad15e3ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:49.318956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3a784-2abd-4d37-90a6-56fad15e3ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:49.319235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3a784-2abd-4d37-90a6-56fad15e3ee5 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:49.319908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3a784-2abd-4d37-90a6-56fad15e3ee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:49.323555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3a784-2abd-4d37-90a6-56fad15e3ee5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:49.343810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-dfbf74d8-f879-424a-a715-0d286bbb6c44 None None] MFA Rules not processed for user `040be10bbb874614be64381928ad3d60`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:49.345063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-dfbf74d8-f879-424a-a715-0d286bbb6c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:49.454755 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3319/6636] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:49 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:49.455788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3a784-2abd-4d37-90a6-56fad15e3ee5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:49.463609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-70b3a784-2abd-4d37-90a6-56fad15e3ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:49.484609 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3318/6637] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:49.486238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc1883-f60d-4416-87b9-e796aee7ee3b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:49.486993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc1883-f60d-4416-87b9-e796aee7ee3b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:49.487440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc1883-f60d-4416-87b9-e796aee7ee3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:49.516300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3afc1883-f60d-4416-87b9-e796aee7ee3b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:49.518430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3afc1883-f60d-4416-87b9-e796aee7ee3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:49.539398 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3319/6638] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:49.540724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc1883-f60d-4416-87b9-e796aee7ee3b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:49.543614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3afc1883-f60d-4416-87b9-e796aee7ee3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:49.610640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3a784-2abd-4d37-90a6-56fad15e3ee5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:49.617042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21543707-a2f3-43e0-b5d8-adc6bc7b41db tempest-IdentityV3ProjectsTest-633951064 tempest-IdentityV3ProjectsTest-633951064-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0edcae34419f403982b6a892f76df1db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00182c443f940e6abfda4bea252fea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:49.619660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21543707-a2f3-43e0-b5d8-adc6bc7b41db tempest-IdentityV3ProjectsTest-633951064 tempest-IdentityV3ProjectsTest-633951064-project] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:49.619660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21543707-a2f3-43e0-b5d8-adc6bc7b41db tempest-IdentityV3ProjectsTest-633951064 tempest-IdentityV3ProjectsTest-633951064-project] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:49.619660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21543707-a2f3-43e0-b5d8-adc6bc7b41db tempest-IdentityV3ProjectsTest-633951064 tempest-IdentityV3ProjectsTest-633951064-project] PATH_INFO: `/v3/users/0edcae34419f403982b6a892f76df1db/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:49.622444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21543707-a2f3-43e0-b5d8-adc6bc7b41db tempest-IdentityV3ProjectsTest-633951064 tempest-IdentityV3ProjectsTest-633951064-project] RBAC: Authorizing `identity:list_user_projects(user_id=0edcae34419f403982b6a892f76df1db)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:49.622981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21543707-a2f3-43e0-b5d8-adc6bc7b41db tempest-IdentityV3ProjectsTest-633951064 tempest-IdentityV3ProjectsTest-633951064-project] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:49.636069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc1883-f60d-4416-87b9-e796aee7ee3b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:49.641376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715e964-acf6-441b-b9f4-92cbdce014f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:49.642668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715e964-acf6-441b-b9f4-92cbdce014f7 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:49.644182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715e964-acf6-441b-b9f4-92cbdce014f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:49.644661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715e964-acf6-441b-b9f4-92cbdce014f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:49.658358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715e964-acf6-441b-b9f4-92cbdce014f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:49.660359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715e964-acf6-441b-b9f4-92cbdce014f7 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:49.677870 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3320/6639] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:50:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:50:49.679068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715e964-acf6-441b-b9f4-92cbdce014f7 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:49.682966 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3320/6640] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:50:49 2022] GET /identity/v3/users/0edcae34419f403982b6a892f76df1db/projects => generated 515 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:49.683898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21543707-a2f3-43e0-b5d8-adc6bc7b41db tempest-IdentityV3ProjectsTest-633951064 tempest-IdentityV3ProjectsTest-633951064-project] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:49.686477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-21543707-a2f3-43e0-b5d8-adc6bc7b41db tempest-IdentityV3ProjectsTest-633951064 tempest-IdentityV3ProjectsTest-633951064-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:49.693109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715e964-acf6-441b-b9f4-92cbdce014f7 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:49.700287 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ea95b-f06e-46a1-9c23-7f797a544f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:49.702414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ea95b-f06e-46a1-9c23-7f797a544f4a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:49.702825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ea95b-f06e-46a1-9c23-7f797a544f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:49.703243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ea95b-f06e-46a1-9c23-7f797a544f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:49.704190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ea95b-f06e-46a1-9c23-7f797a544f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:49.706981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ea95b-f06e-46a1-9c23-7f797a544f4a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:49.720959 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3321/6641] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:49.722223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ea95b-f06e-46a1-9c23-7f797a544f4a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:49.738330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ea95b-f06e-46a1-9c23-7f797a544f4a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:49.752727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadcb81-3e2c-4bf3-915d-bf5d131bc0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:49.753528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadcb81-3e2c-4bf3-915d-bf5d131bc0df admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:49.754445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadcb81-3e2c-4bf3-915d-bf5d131bc0df admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:49.757325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadcb81-3e2c-4bf3-915d-bf5d131bc0df admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:49.760888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadcb81-3e2c-4bf3-915d-bf5d131bc0df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:50:49.761319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadcb81-3e2c-4bf3-915d-bf5d131bc0df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:49.763091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadcb81-3e2c-4bf3-915d-bf5d131bc0df admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:49.791182 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3322/6642] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:49.792364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6e9f7-8892-4f28-b02f-e551f7e68670 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:49.792756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6e9f7-8892-4f28-b02f-e551f7e68670 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:49.793135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6e9f7-8892-4f28-b02f-e551f7e68670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:49.816936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:49.835863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21543707-a2f3-43e0-b5d8-adc6bc7b41db tempest-IdentityV3ProjectsTest-633951064 tempest-IdentityV3ProjectsTest-633951064-project] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:49.844864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cebfa-82d1-4f70-a832-6d1d0bbac823 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:49.845756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cebfa-82d1-4f70-a832-6d1d0bbac823 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:49.846186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cebfa-82d1-4f70-a832-6d1d0bbac823 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:49.846574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cebfa-82d1-4f70-a832-6d1d0bbac823 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:49.850206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ceb6e9f7-8892-4f28-b02f-e551f7e68670 None None] MFA Rules not processed for user `0edcae34419f403982b6a892f76df1db`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:49.857003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ceb6e9f7-8892-4f28-b02f-e551f7e68670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:49.859771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cebfa-82d1-4f70-a832-6d1d0bbac823 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:49.861723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cebfa-82d1-4f70-a832-6d1d0bbac823 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:49.878841 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3323/6643] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:49.881941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6e9f7-8892-4f28-b02f-e551f7e68670 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:49.884603 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3321/6644] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:50:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:50:49.888278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cebfa-82d1-4f70-a832-6d1d0bbac823 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:49.911324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6e9f7-8892-4f28-b02f-e551f7e68670 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:49.919423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cebfa-82d1-4f70-a832-6d1d0bbac823 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:49.921253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbb57c-7d58-4716-95be-4605a3f72fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:49.921961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbb57c-7d58-4716-95be-4605a3f72fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:49.922270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbb57c-7d58-4716-95be-4605a3f72fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:49.922551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbb57c-7d58-4716-95be-4605a3f72fb8 admin admin] PATH_INFO: `/v3/projects/1ac98d0b3ca44e8d9c9c223533ff1e73/users/5d7d7c6b46ed47b0a5c989fefe215061/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:49.936143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383aaf5-f60d-49d7-aae8-1d7c92808ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:49.937947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383aaf5-f60d-49d7-aae8-1d7c92808ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:49.939876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383aaf5-f60d-49d7-aae8-1d7c92808ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:49.940367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383aaf5-f60d-49d7-aae8-1d7c92808ce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:49.943984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383aaf5-f60d-49d7-aae8-1d7c92808ce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:49.952159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383aaf5-f60d-49d7-aae8-1d7c92808ce2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:49.976027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bbb57c-7d58-4716-95be-4605a3f72fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac98d0b3ca44e8d9c9c223533ff1e73, user_id=5d7d7c6b46ed47b0a5c989fefe215061, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:49.985817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bbb57c-7d58-4716-95be-4605a3f72fb8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:50.080836 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3324/6645] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:49 2022] PUT /identity/v3/projects/1ac98d0b3ca44e8d9c9c223533ff1e73/users/5d7d7c6b46ed47b0a5c989fefe215061/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:50.082286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e7410-de17-4eb3-a6b3-32fc552a3f6f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:50.082573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e7410-de17-4eb3-a6b3-32fc552a3f6f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:50.082852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e7410-de17-4eb3-a6b3-32fc552a3f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:50.088686 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3322/6646] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:49 2022] POST /identity/v3/projects => generated 371 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:50.093028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383aaf5-f60d-49d7-aae8-1d7c92808ce2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:50.126457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-eb4e7410-de17-4eb3-a6b3-32fc552a3f6f None None] MFA Rules not processed for user `0edcae34419f403982b6a892f76df1db`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:50.127866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-eb4e7410-de17-4eb3-a6b3-32fc552a3f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:50.257265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383aaf5-f60d-49d7-aae8-1d7c92808ce2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:50.264194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1c19b-880f-43ae-870e-18aaae4fde89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:50.264770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1c19b-880f-43ae-870e-18aaae4fde89 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:50.265172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1c19b-880f-43ae-870e-18aaae4fde89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:50.265551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1c19b-880f-43ae-870e-18aaae4fde89 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:50.266543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1c19b-880f-43ae-870e-18aaae4fde89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:50.269138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1c19b-880f-43ae-870e-18aaae4fde89 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:50.272146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:50.297751 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3323/6647] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:50.301076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1c19b-880f-43ae-870e-18aaae4fde89 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:50.304917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.models.token_model [None req-eb4e7410-de17-4eb3-a6b3-32fc552a3f6f None None] User 0edcae34419f403982b6a892f76df1db has no access to project 9d94fc0689124a62becb0ae45ffddd34 {{(pid=82180) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Oct 27 03:50:50.318183 n-d-862769-1 devstack@keystone.service[82180]: WARNING keystone.server.flask.application [None req-eb4e7410-de17-4eb3-a6b3-32fc552a3f6f None None] Authorization failed. The request you have made requires authentication. from 10.222.0.20: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 27 03:50:50.326832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1c19b-880f-43ae-870e-18aaae4fde89 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:50.330158 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3325/6648] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:50 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 245 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 27 03:50:50.331325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e7410-de17-4eb3-a6b3-32fc552a3f6f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:50.341237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68469d85-9483-4e48-81ba-87c9d3bb2b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:50.342907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68469d85-9483-4e48-81ba-87c9d3bb2b03 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:50.345001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68469d85-9483-4e48-81ba-87c9d3bb2b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:50.345416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68469d85-9483-4e48-81ba-87c9d3bb2b03 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:50.346285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68469d85-9483-4e48-81ba-87c9d3bb2b03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:50.351004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68469d85-9483-4e48-81ba-87c9d3bb2b03 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:50.354012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e7410-de17-4eb3-a6b3-32fc552a3f6f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:50.359069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da631fa-4398-4676-a9d7-c70664ac2e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:50.359828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da631fa-4398-4676-a9d7-c70664ac2e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:50.360193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da631fa-4398-4676-a9d7-c70664ac2e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:50.360541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da631fa-4398-4676-a9d7-c70664ac2e68 admin admin] PATH_INFO: `/v3/projects/1ac98d0b3ca44e8d9c9c223533ff1e73/users/5d7d7c6b46ed47b0a5c989fefe215061/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:50.366127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da631fa-4398-4676-a9d7-c70664ac2e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac98d0b3ca44e8d9c9c223533ff1e73, user_id=5d7d7c6b46ed47b0a5c989fefe215061, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:50.370908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da631fa-4398-4676-a9d7-c70664ac2e68 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:50.392310 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3326/6649] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:50 2022] PUT /identity/v3/projects/1ac98d0b3ca44e8d9c9c223533ff1e73/users/5d7d7c6b46ed47b0a5c989fefe215061/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:50.393511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da631fa-4398-4676-a9d7-c70664ac2e68 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:50.395620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7da631fa-4398-4676-a9d7-c70664ac2e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:50.466401 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3324/6650] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:50 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:50.471499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95617d70-5852-4bc5-9fbe-0d64109a1c2d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:50.471961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95617d70-5852-4bc5-9fbe-0d64109a1c2d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:50.473236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95617d70-5852-4bc5-9fbe-0d64109a1c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:50.537561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da631fa-4398-4676-a9d7-c70664ac2e68 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:50.548042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-95617d70-5852-4bc5-9fbe-0d64109a1c2d None None] MFA Rules not processed for user `5d7d7c6b46ed47b0a5c989fefe215061`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:50.548042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-95617d70-5852-4bc5-9fbe-0d64109a1c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:50.550308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6cdab-0745-4ea7-804b-aca13cdd98ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:50.551024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6cdab-0745-4ea7-804b-aca13cdd98ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:50.551311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6cdab-0745-4ea7-804b-aca13cdd98ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:50.551589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6cdab-0745-4ea7-804b-aca13cdd98ae admin admin] PATH_INFO: `/v3/users/0edcae34419f403982b6a892f76df1db` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:50.553254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6cdab-0745-4ea7-804b-aca13cdd98ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=0edcae34419f403982b6a892f76df1db)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:50.556843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6cdab-0745-4ea7-804b-aca13cdd98ae admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:50.676500 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3325/6651] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:50.677847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95617d70-5852-4bc5-9fbe-0d64109a1c2d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:50.696053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95617d70-5852-4bc5-9fbe-0d64109a1c2d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:50.704047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5421b8-4347-450b-8779-a43bb93964cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:50.704803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5421b8-4347-450b-8779-a43bb93964cf admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:50.705093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5421b8-4347-450b-8779-a43bb93964cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:50.705371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5421b8-4347-450b-8779-a43bb93964cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:50.706046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5421b8-4347-450b-8779-a43bb93964cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:50.708012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5421b8-4347-450b-8779-a43bb93964cf admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:50.722206 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3326/6652] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:50.726219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:50.728227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5421b8-4347-450b-8779-a43bb93964cf admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:50.752662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5421b8-4347-450b-8779-a43bb93964cf admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:50.760547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d207d4-3bd7-4f95-902a-137e5847713a tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:50.761188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d207d4-3bd7-4f95-902a-137e5847713a tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:50.761477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d207d4-3bd7-4f95-902a-137e5847713a tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:50.761759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d207d4-3bd7-4f95-902a-137e5847713a tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:50.762545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d207d4-3bd7-4f95-902a-137e5847713a tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:50.764559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d207d4-3bd7-4f95-902a-137e5847713a tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:50.846930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-32d6cdab-0745-4ea7-804b-aca13cdd98ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0edcae34419f403982b6a892f76df1db'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:50.848402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-32d6cdab-0745-4ea7-804b-aca13cdd98ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0edcae34419f403982b6a892f76df1db'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:50.871060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-32d6cdab-0745-4ea7-804b-aca13cdd98ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0edcae34419f403982b6a892f76df1db'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:50.889219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-32d6cdab-0745-4ea7-804b-aca13cdd98ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0edcae34419f403982b6a892f76df1db'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:50.890316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-32d6cdab-0745-4ea7-804b-aca13cdd98ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0edcae34419f403982b6a892f76df1db'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:50.931254 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3327/6653] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:50 2022] POST /identity/v3/projects => generated 360 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:50.931254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d207d4-3bd7-4f95-902a-137e5847713a tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:50.932819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d6d207d4-3bd7-4f95-902a-137e5847713a tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:51.002242 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3327/6654] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:50 2022] DELETE /identity/v3/users/0edcae34419f403982b6a892f76df1db => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:51.003431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6cdab-0745-4ea7-804b-aca13cdd98ae admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:51.005859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-32d6cdab-0745-4ea7-804b-aca13cdd98ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:51.088249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d207d4-3bd7-4f95-902a-137e5847713a tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:51.184849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6cdab-0745-4ea7-804b-aca13cdd98ae admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:51.199135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81df794-78f2-4c00-8a42-19c4f1c1f60b tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:51.199789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81df794-78f2-4c00-8a42-19c4f1c1f60b tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:51.200136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81df794-78f2-4c00-8a42-19c4f1c1f60b tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:51.200423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81df794-78f2-4c00-8a42-19c4f1c1f60b tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:51.201074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81df794-78f2-4c00-8a42-19c4f1c1f60b tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:51.208530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81df794-78f2-4c00-8a42-19c4f1c1f60b tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:51.242959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:51.244757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6864c-2cf8-4538-8d22-b65df30f4f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:51.246469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6864c-2cf8-4538-8d22-b65df30f4f03 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:51.246947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6864c-2cf8-4538-8d22-b65df30f4f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:51.247229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6864c-2cf8-4538-8d22-b65df30f4f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:51.248484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6864c-2cf8-4538-8d22-b65df30f4f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:51.251109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6864c-2cf8-4538-8d22-b65df30f4f03 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:51.269038 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3328/6655] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:51.269970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6864c-2cf8-4538-8d22-b65df30f4f03 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:51.276919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1cf6864c-2cf8-4538-8d22-b65df30f4f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:51.300980 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3328/6656] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:51 2022] POST /identity/v3/users => generated 371 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:51.302657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5ff6e-e780-40bb-8844-6f3b2589db45 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:51.305507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5ff6e-e780-40bb-8844-6f3b2589db45 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:51.305822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5ff6e-e780-40bb-8844-6f3b2589db45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:51.318292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6864c-2cf8-4538-8d22-b65df30f4f03 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:51.325049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd5937-43a9-40ab-9fc8-a242ad669753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:51.331253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd5937-43a9-40ab-9fc8-a242ad669753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:51.331253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd5937-43a9-40ab-9fc8-a242ad669753 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:51.331253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd5937-43a9-40ab-9fc8-a242ad669753 admin admin] PATH_INFO: `/v3/projects/67716b96923c4535bf547ddcdd00409d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:51.331253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd5937-43a9-40ab-9fc8-a242ad669753 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67716b96923c4535bf547ddcdd00409d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:51.331253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd5937-43a9-40ab-9fc8-a242ad669753 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:51.356953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ffd5ff6e-e780-40bb-8844-6f3b2589db45 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:51.362263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ffd5ff6e-e780-40bb-8844-6f3b2589db45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:51.382146 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3329/6657] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:51.383751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5ff6e-e780-40bb-8844-6f3b2589db45 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:51.423193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5ff6e-e780-40bb-8844-6f3b2589db45 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:51.428742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc828b2-2480-4757-9957-4caaeaf8cefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:51.429663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc828b2-2480-4757-9957-4caaeaf8cefc admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:51.430705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc828b2-2480-4757-9957-4caaeaf8cefc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:51.431143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc828b2-2480-4757-9957-4caaeaf8cefc admin admin] PATH_INFO: `/v3/projects/7f7b49f5d2e442e3a5024bf28ee4d230/users/12d63a8d75fd4474b85c745cc523f478/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:51.450815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc828b2-2480-4757-9957-4caaeaf8cefc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7b49f5d2e442e3a5024bf28ee4d230, user_id=12d63a8d75fd4474b85c745cc523f478, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:51.452635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc828b2-2480-4757-9957-4caaeaf8cefc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:51.569604 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3330/6658] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:51 2022] PUT /identity/v3/projects/7f7b49f5d2e442e3a5024bf28ee4d230/users/12d63a8d75fd4474b85c745cc523f478/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:51.573481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc828b2-2480-4757-9957-4caaeaf8cefc admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:51.589407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e1dd5937-43a9-40ab-9fc8-a242ad669753 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67716b96923c4535bf547ddcdd00409d', 'request_id': 'req-e1dd5937-43a9-40ab-9fc8-a242ad669753'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:51.589636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:51.639778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e1dd5937-43a9-40ab-9fc8-a242ad669753 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67716b96923c4535bf547ddcdd00409d', 'request_id': 'req-e1dd5937-43a9-40ab-9fc8-a242ad669753'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:51.652170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e1dd5937-43a9-40ab-9fc8-a242ad669753 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67716b96923c4535bf547ddcdd00409d', 'request_id': 'req-e1dd5937-43a9-40ab-9fc8-a242ad669753'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:51.666192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e1dd5937-43a9-40ab-9fc8-a242ad669753 admin admin] The token cache is being invalidate because project 67716b96923c4535bf547ddcdd00409d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:51.666886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e1dd5937-43a9-40ab-9fc8-a242ad669753 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:51.667872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e1dd5937-43a9-40ab-9fc8-a242ad669753 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:51.669682 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3329/6659] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:51 2022] DELETE /identity/v3/projects/67716b96923c4535bf547ddcdd00409d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:51.674157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd5937-43a9-40ab-9fc8-a242ad669753 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:51.675795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e1dd5937-43a9-40ab-9fc8-a242ad669753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:51.732585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc828b2-2480-4757-9957-4caaeaf8cefc admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:51.745320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db930eca-4843-437c-ba53-bda11a94dbab tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:51.746598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db930eca-4843-437c-ba53-bda11a94dbab tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:51.746896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db930eca-4843-437c-ba53-bda11a94dbab tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:51.747178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db930eca-4843-437c-ba53-bda11a94dbab tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/users/4a33331594de4056b4f19c4f7f4e566f` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:51.780635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db930eca-4843-437c-ba53-bda11a94dbab tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:get_user(user_id=4a33331594de4056b4f19c4f7f4e566f)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:51.789291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db930eca-4843-437c-ba53-bda11a94dbab tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:51.790643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd5937-43a9-40ab-9fc8-a242ad669753 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:51.793502 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3331/6660] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 03:50:51 2022] GET /identity/v3/users/4a33331594de4056b4f19c4f7f4e566f => generated 371 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:51.794407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db930eca-4843-437c-ba53-bda11a94dbab tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:51.797684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-db930eca-4843-437c-ba53-bda11a94dbab tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:51.950805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465cb7f-7c36-472f-8dee-e46907c39826 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '040be10bbb874614be64381928ad3d60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70796c11d62942e2b789261a811d570c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:51.952981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465cb7f-7c36-472f-8dee-e46907c39826 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:51.953572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465cb7f-7c36-472f-8dee-e46907c39826 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:51.954069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465cb7f-7c36-472f-8dee-e46907c39826 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:51.954641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db930eca-4843-437c-ba53-bda11a94dbab tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:51.955000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465cb7f-7c36-472f-8dee-e46907c39826 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:50:51.955493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465cb7f-7c36-472f-8dee-e46907c39826 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:51.957417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465cb7f-7c36-472f-8dee-e46907c39826 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:51.967961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30f05d-a918-4e28-a1d7-471eb00de6e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:51.968843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30f05d-a918-4e28-a1d7-471eb00de6e6 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:51.969292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30f05d-a918-4e28-a1d7-471eb00de6e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:51.970816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30f05d-a918-4e28-a1d7-471eb00de6e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:51.977085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-dd30f05d-a918-4e28-a1d7-471eb00de6e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:51.980797 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3330/6661] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:51.985414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd2738-7847-4ed9-b8c3-15fed497303f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:51.985641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd2738-7847-4ed9-b8c3-15fed497303f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:51.988218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd2738-7847-4ed9-b8c3-15fed497303f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:52.035125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-55fd2738-7847-4ed9-b8c3-15fed497303f None None] MFA Rules not processed for user `12d63a8d75fd4474b85c745cc523f478`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:52.037216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-55fd2738-7847-4ed9-b8c3-15fed497303f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:52.087262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:52.122531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30f05d-a918-4e28-a1d7-471eb00de6e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:52.124319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30f05d-a918-4e28-a1d7-471eb00de6e6 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:52.137667 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3332/6662] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:50:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:50:52.140545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a98258-0fa4-4677-ab8d-6639a1492525 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:52.141003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a98258-0fa4-4677-ab8d-6639a1492525 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:52.141434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a98258-0fa4-4677-ab8d-6639a1492525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:52.165544 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3331/6663] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:52.167089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd2738-7847-4ed9-b8c3-15fed497303f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:52.169975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-55fd2738-7847-4ed9-b8c3-15fed497303f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:52.175197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e5a98258-0fa4-4677-ab8d-6639a1492525 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:52.181399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e5a98258-0fa4-4677-ab8d-6639a1492525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:52.196182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd2738-7847-4ed9-b8c3-15fed497303f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:52.204283 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3333/6664] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:52.204792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeca11d-a7ba-42da-9654-420010792752 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:52.205116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a98258-0fa4-4677-ab8d-6639a1492525 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:52.212312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeca11d-a7ba-42da-9654-420010792752 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:52.212312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeca11d-a7ba-42da-9654-420010792752 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:52.212312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeca11d-a7ba-42da-9654-420010792752 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/users/4a33331594de4056b4f19c4f7f4e566f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:52.214496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeca11d-a7ba-42da-9654-420010792752 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4a33331594de4056b4f19c4f7f4e566f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:52.223753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a98258-0fa4-4677-ab8d-6639a1492525 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:52.231880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeca11d-a7ba-42da-9654-420010792752 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:52.232112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df557d24-62a2-4e43-8acf-b27d4c760cfe tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '040be10bbb874614be64381928ad3d60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70796c11d62942e2b789261a811d570c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:52.232112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df557d24-62a2-4e43-8acf-b27d4c760cfe tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:52.232288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df557d24-62a2-4e43-8acf-b27d4c760cfe tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:52.232577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df557d24-62a2-4e43-8acf-b27d4c760cfe tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:52.233533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df557d24-62a2-4e43-8acf-b27d4c760cfe tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:52.235860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df557d24-62a2-4e43-8acf-b27d4c760cfe tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:52.280807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:52.409540 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3334/6665] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:52 2022] POST /identity/v3/projects => generated 352 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:52.409540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df557d24-62a2-4e43-8acf-b27d4c760cfe tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:52.409540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-df557d24-62a2-4e43-8acf-b27d4c760cfe tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:52.473718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6aeca11d-a7ba-42da-9654-420010792752 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a33331594de4056b4f19c4f7f4e566f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:52.474536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6aeca11d-a7ba-42da-9654-420010792752 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a33331594de4056b4f19c4f7f4e566f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:52.490640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6aeca11d-a7ba-42da-9654-420010792752 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a33331594de4056b4f19c4f7f4e566f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:52.524846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6aeca11d-a7ba-42da-9654-420010792752 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a33331594de4056b4f19c4f7f4e566f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:52.538877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df557d24-62a2-4e43-8acf-b27d4c760cfe tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:52.546640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71a37d-1860-4f96-9a84-7843d85db7ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:52.555528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71a37d-1860-4f96-9a84-7843d85db7ea service glance] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:52.555528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71a37d-1860-4f96-9a84-7843d85db7ea service glance] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:52.555528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71a37d-1860-4f96-9a84-7843d85db7ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:52.555528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ab71a37d-1860-4f96-9a84-7843d85db7ea service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:52.622296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6aeca11d-a7ba-42da-9654-420010792752 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a33331594de4056b4f19c4f7f4e566f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:52.635170 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3332/6666] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:52 2022] DELETE /identity/v3/users/4a33331594de4056b4f19c4f7f4e566f => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:52.635170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca251a5-0d72-45ca-9678-a57d26d069f3 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:52.635170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca251a5-0d72-45ca-9678-a57d26d069f3 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:52.635170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca251a5-0d72-45ca-9678-a57d26d069f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:52.666779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71a37d-1860-4f96-9a84-7843d85db7ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:52.668716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71a37d-1860-4f96-9a84-7843d85db7ea service glance] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:52.690050 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3335/6667] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:50:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:50:52.690185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-dca251a5-0d72-45ca-9678-a57d26d069f3 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:52.690914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71a37d-1860-4f96-9a84-7843d85db7ea service glance] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:52.691596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dca251a5-0d72-45ca-9678-a57d26d069f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:52.692415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ab71a37d-1860-4f96-9a84-7843d85db7ea service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:52.794329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:52.878843 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3333/6668] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:52.879569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca251a5-0d72-45ca-9678-a57d26d069f3 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:52.882017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71a37d-1860-4f96-9a84-7843d85db7ea service glance] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:52.883601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dca251a5-0d72-45ca-9678-a57d26d069f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:52.997093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a9ad7-bd2d-4d20-a515-38e8af28cd93 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '040be10bbb874614be64381928ad3d60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70796c11d62942e2b789261a811d570c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:52.999562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a9ad7-bd2d-4d20-a515-38e8af28cd93 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:53.000096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a9ad7-bd2d-4d20-a515-38e8af28cd93 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:53.000741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a9ad7-bd2d-4d20-a515-38e8af28cd93 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:53.002701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a9ad7-bd2d-4d20-a515-38e8af28cd93 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:50:53.003360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a9ad7-bd2d-4d20-a515-38e8af28cd93 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:53.005578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a9ad7-bd2d-4d20-a515-38e8af28cd93 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:53.032492 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3336/6669] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:53.033943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a9ad7-bd2d-4d20-a515-38e8af28cd93 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:53.056069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a9ad7-bd2d-4d20-a515-38e8af28cd93 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:53.056069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc892cf-47ea-4a1e-aede-675d20c47f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:53.056265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca251a5-0d72-45ca-9678-a57d26d069f3 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:53.056370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc892cf-47ea-4a1e-aede-675d20c47f53 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:53.056838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc892cf-47ea-4a1e-aede-675d20c47f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:53.057327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc892cf-47ea-4a1e-aede-675d20c47f53 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:53.058022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc892cf-47ea-4a1e-aede-675d20c47f53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:50:53.058364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc892cf-47ea-4a1e-aede-675d20c47f53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:53.060657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc892cf-47ea-4a1e-aede-675d20c47f53 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:53.074090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbbc7d-a6a9-4516-9afc-39f3ab09a345 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:53.074777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbbc7d-a6a9-4516-9afc-39f3ab09a345 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:53.075140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbbc7d-a6a9-4516-9afc-39f3ab09a345 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:53.075426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbbc7d-a6a9-4516-9afc-39f3ab09a345 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/projects/1ad1f90575dc4622b720066f728c0cb5` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:53.079627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbbc7d-a6a9-4516-9afc-39f3ab09a345 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1ad1f90575dc4622b720066f728c0cb5)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:53.090594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbbc7d-a6a9-4516-9afc-39f3ab09a345 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:53.099539 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3337/6670] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:53.104650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc892cf-47ea-4a1e-aede-675d20c47f53 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:53.147262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc892cf-47ea-4a1e-aede-675d20c47f53 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:53.160343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d89b3-405c-40cf-8003-546d43549910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:53.161103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d89b3-405c-40cf-8003-546d43549910 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:53.161460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d89b3-405c-40cf-8003-546d43549910 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:53.163295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d89b3-405c-40cf-8003-546d43549910 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:53.165497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d89b3-405c-40cf-8003-546d43549910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:53.169865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d89b3-405c-40cf-8003-546d43549910 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:53.288935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8dcbbc7d-a6a9-4516-9afc-39f3ab09a345 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ad1f90575dc4622b720066f728c0cb5', 'request_id': 'req-8dcbbc7d-a6a9-4516-9afc-39f3ab09a345'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:53.308849 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3338/6671] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:53 2022] POST /identity/v3/projects => generated 375 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:50:53.308849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d89b3-405c-40cf-8003-546d43549910 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:53.310891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-731d89b3-405c-40cf-8003-546d43549910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:53.366816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:53.392051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d89b3-405c-40cf-8003-546d43549910 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:53.399880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b9dd7-c470-4a87-b146-3b0ff9188406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:53.400566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b9dd7-c470-4a87-b146-3b0ff9188406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:53.400853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b9dd7-c470-4a87-b146-3b0ff9188406 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:53.401133 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b9dd7-c470-4a87-b146-3b0ff9188406 admin admin] PATH_INFO: `/v3/projects/d00182c443f940e6abfda4bea252fea2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:53.402467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b9dd7-c470-4a87-b146-3b0ff9188406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d00182c443f940e6abfda4bea252fea2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:53.405398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b9dd7-c470-4a87-b146-3b0ff9188406 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:53.406356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8dcbbc7d-a6a9-4516-9afc-39f3ab09a345 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ad1f90575dc4622b720066f728c0cb5', 'request_id': 'req-8dcbbc7d-a6a9-4516-9afc-39f3ab09a345'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:53.419169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8dcbbc7d-a6a9-4516-9afc-39f3ab09a345 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ad1f90575dc4622b720066f728c0cb5', 'request_id': 'req-8dcbbc7d-a6a9-4516-9afc-39f3ab09a345'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:53.441173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8dcbbc7d-a6a9-4516-9afc-39f3ab09a345 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] The token cache is being invalidate because project 1ad1f90575dc4622b720066f728c0cb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:53.441476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8dcbbc7d-a6a9-4516-9afc-39f3ab09a345 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:53.443080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8dcbbc7d-a6a9-4516-9afc-39f3ab09a345 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:53.449263 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3334/6672] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:52 2022] DELETE /identity/v3/projects/1ad1f90575dc4622b720066f728c0cb5 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:53.450530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbbc7d-a6a9-4516-9afc-39f3ab09a345 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:53.456775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8dcbbc7d-a6a9-4516-9afc-39f3ab09a345 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:53.549700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbbc7d-a6a9-4516-9afc-39f3ab09a345 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:53.631892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35baf111-9e2a-4fd2-9ec2-43b75fe33231 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '040be10bbb874614be64381928ad3d60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70796c11d62942e2b789261a811d570c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:53.632607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35baf111-9e2a-4fd2-9ec2-43b75fe33231 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:53.633427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35baf111-9e2a-4fd2-9ec2-43b75fe33231 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:53.633709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35baf111-9e2a-4fd2-9ec2-43b75fe33231 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] PATH_INFO: `/v3/projects/34541ac52b964a4ba08d6d18b001fb5b` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:53.635114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35baf111-9e2a-4fd2-9ec2-43b75fe33231 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] RBAC: Authorizing `identity:delete_project(project_id=34541ac52b964a4ba08d6d18b001fb5b)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:53.637089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35baf111-9e2a-4fd2-9ec2-43b75fe33231 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:53.673547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9c2b9dd7-c470-4a87-b146-3b0ff9188406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd00182c443f940e6abfda4bea252fea2', 'request_id': 'req-9c2b9dd7-c470-4a87-b146-3b0ff9188406'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:53.694792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9c2b9dd7-c470-4a87-b146-3b0ff9188406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd00182c443f940e6abfda4bea252fea2', 'request_id': 'req-9c2b9dd7-c470-4a87-b146-3b0ff9188406'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:53.701902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9c2b9dd7-c470-4a87-b146-3b0ff9188406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd00182c443f940e6abfda4bea252fea2', 'request_id': 'req-9c2b9dd7-c470-4a87-b146-3b0ff9188406'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:53.838900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9c2b9dd7-c470-4a87-b146-3b0ff9188406 admin admin] The token cache is being invalidate because project d00182c443f940e6abfda4bea252fea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:53.839984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9c2b9dd7-c470-4a87-b146-3b0ff9188406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:53.842130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9c2b9dd7-c470-4a87-b146-3b0ff9188406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:53.848906 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3339/6673] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:53 2022] DELETE /identity/v3/projects/d00182c443f940e6abfda4bea252fea2 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:53.848906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b9dd7-c470-4a87-b146-3b0ff9188406 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:53.850290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9c2b9dd7-c470-4a87-b146-3b0ff9188406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:53.892175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:53.933896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-35baf111-9e2a-4fd2-9ec2-43b75fe33231 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34541ac52b964a4ba08d6d18b001fb5b', 'request_id': 'req-35baf111-9e2a-4fd2-9ec2-43b75fe33231'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:54.061985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b9dd7-c470-4a87-b146-3b0ff9188406 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:54.069331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-35baf111-9e2a-4fd2-9ec2-43b75fe33231 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34541ac52b964a4ba08d6d18b001fb5b', 'request_id': 'req-35baf111-9e2a-4fd2-9ec2-43b75fe33231'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:54.079052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-35baf111-9e2a-4fd2-9ec2-43b75fe33231 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34541ac52b964a4ba08d6d18b001fb5b', 'request_id': 'req-35baf111-9e2a-4fd2-9ec2-43b75fe33231'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:54.105044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:54.119541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-35baf111-9e2a-4fd2-9ec2-43b75fe33231 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] The token cache is being invalidate because project 34541ac52b964a4ba08d6d18b001fb5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:54.119848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-35baf111-9e2a-4fd2-9ec2-43b75fe33231 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:54.120632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-35baf111-9e2a-4fd2-9ec2-43b75fe33231 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:54.125746 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3335/6674] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:53 2022] DELETE /identity/v3/projects/34541ac52b964a4ba08d6d18b001fb5b => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:54.126960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35baf111-9e2a-4fd2-9ec2-43b75fe33231 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:54.141650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-35baf111-9e2a-4fd2-9ec2-43b75fe33231 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:54.203383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657040ac-0a9e-491d-9d55-f91245d32351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:54.212727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657040ac-0a9e-491d-9d55-f91245d32351 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:54.212727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657040ac-0a9e-491d-9d55-f91245d32351 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:54.212727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657040ac-0a9e-491d-9d55-f91245d32351 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:54.212727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657040ac-0a9e-491d-9d55-f91245d32351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:54.214418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657040ac-0a9e-491d-9d55-f91245d32351 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:54.317121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35baf111-9e2a-4fd2-9ec2-43b75fe33231 tempest-VolumeQuotaClassesTest-523258620 tempest-VolumeQuotaClassesTest-523258620-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:54.325304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ddb9b-86a7-4a57-a978-9d1d197eca7e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:54.326147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ddb9b-86a7-4a57-a978-9d1d197eca7e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:54.326454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ddb9b-86a7-4a57-a978-9d1d197eca7e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:54.326989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ddb9b-86a7-4a57-a978-9d1d197eca7e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:54.327378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ddb9b-86a7-4a57-a978-9d1d197eca7e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:54.329363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ddb9b-86a7-4a57-a978-9d1d197eca7e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:54.413728 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3340/6675] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:53 2022] POST /identity/v3/users => generated 288 bytes in 568 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:54.416117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657040ac-0a9e-491d-9d55-f91245d32351 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:54.418505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-657040ac-0a9e-491d-9d55-f91245d32351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:54.436647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657040ac-0a9e-491d-9d55-f91245d32351 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:54.453078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34376d5-1d7c-4457-a0c1-647beb431a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:54.453443 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3336/6676] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:54 2022] POST /identity/v3/projects => generated 358 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:54.454437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ddb9b-86a7-4a57-a978-9d1d197eca7e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:54.455554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34376d5-1d7c-4457-a0c1-647beb431a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:54.456161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34376d5-1d7c-4457-a0c1-647beb431a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:54.456657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34376d5-1d7c-4457-a0c1-647beb431a94 admin admin] PATH_INFO: `/v3/users/58d351389b2c4b9e8b351c08420952cf` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:54.459016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34376d5-1d7c-4457-a0c1-647beb431a94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58d351389b2c4b9e8b351c08420952cf)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:54.461444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34376d5-1d7c-4457-a0c1-647beb431a94 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:54.464750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d22ddb9b-86a7-4a57-a978-9d1d197eca7e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:54.553191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ddb9b-86a7-4a57-a978-9d1d197eca7e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:54.569634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd607d09-7c2b-4222-88af-691d93bf8832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:54.571056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd607d09-7c2b-4222-88af-691d93bf8832 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:54.575888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd607d09-7c2b-4222-88af-691d93bf8832 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:54.577024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd607d09-7c2b-4222-88af-691d93bf8832 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:54.577832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd607d09-7c2b-4222-88af-691d93bf8832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:54.586296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd607d09-7c2b-4222-88af-691d93bf8832 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:54.602058 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3337/6677] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:54.603037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd607d09-7c2b-4222-88af-691d93bf8832 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:54.685944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd607d09-7c2b-4222-88af-691d93bf8832 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:54.691791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb23935-51dc-403b-9726-3afe2c07c310 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:54.692596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb23935-51dc-403b-9726-3afe2c07c310 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:54.692992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb23935-51dc-403b-9726-3afe2c07c310 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:54.693383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb23935-51dc-403b-9726-3afe2c07c310 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:54.694413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb23935-51dc-403b-9726-3afe2c07c310 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:54.696702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb23935-51dc-403b-9726-3afe2c07c310 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:54.719451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d34376d5-1d7c-4457-a0c1-647beb431a94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58d351389b2c4b9e8b351c08420952cf'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:54.720562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d34376d5-1d7c-4457-a0c1-647beb431a94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58d351389b2c4b9e8b351c08420952cf'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:54.735677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d34376d5-1d7c-4457-a0c1-647beb431a94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58d351389b2c4b9e8b351c08420952cf'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:54.751494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d34376d5-1d7c-4457-a0c1-647beb431a94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58d351389b2c4b9e8b351c08420952cf'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:54.752595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d34376d5-1d7c-4457-a0c1-647beb431a94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58d351389b2c4b9e8b351c08420952cf'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:54.865748 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3338/6679] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:54 2022] POST /identity/v3/users => generated 414 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:54.866694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb23935-51dc-403b-9726-3afe2c07c310 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:54.868390 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3341/6679] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:54 2022] DELETE /identity/v3/users/58d351389b2c4b9e8b351c08420952cf => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:54.870891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34376d5-1d7c-4457-a0c1-647beb431a94 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:54.873864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6fb23935-51dc-403b-9726-3afe2c07c310 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:54.874827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d34376d5-1d7c-4457-a0c1-647beb431a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:54.909154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb23935-51dc-403b-9726-3afe2c07c310 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:55.070141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34376d5-1d7c-4457-a0c1-647beb431a94 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:55.082629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633435c9-7e38-4913-a09e-a57a63f0a757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:55.083998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633435c9-7e38-4913-a09e-a57a63f0a757 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:55.083998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633435c9-7e38-4913-a09e-a57a63f0a757 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:55.090921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d31f0-cefe-40e2-80df-27b9bc1be3b9 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:55.090921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d31f0-cefe-40e2-80df-27b9bc1be3b9 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:55.090921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d31f0-cefe-40e2-80df-27b9bc1be3b9 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:55.091552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d31f0-cefe-40e2-80df-27b9bc1be3b9 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:55.091552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d31f0-cefe-40e2-80df-27b9bc1be3b9 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:55.091552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d31f0-cefe-40e2-80df-27b9bc1be3b9 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:55.091816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633435c9-7e38-4913-a09e-a57a63f0a757 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:55.099067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633435c9-7e38-4913-a09e-a57a63f0a757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:55.101552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633435c9-7e38-4913-a09e-a57a63f0a757 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:55.114528 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3339/6680] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:55.115846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633435c9-7e38-4913-a09e-a57a63f0a757 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:55.117789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-633435c9-7e38-4913-a09e-a57a63f0a757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:55.136556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633435c9-7e38-4913-a09e-a57a63f0a757 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:55.154393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb3094-48c0-4d20-b385-2902b923b63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:55.155878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb3094-48c0-4d20-b385-2902b923b63d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:55.156176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb3094-48c0-4d20-b385-2902b923b63d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:55.156489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb3094-48c0-4d20-b385-2902b923b63d admin admin] PATH_INFO: `/v3/users/71433daac9564a47b539e5f7c800bb98` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:55.158302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb3094-48c0-4d20-b385-2902b923b63d admin admin] RBAC: Authorizing `identity:delete_user(user_id=71433daac9564a47b539e5f7c800bb98)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:55.166110 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3342/6681] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:50:54 2022] POST /identity/v3/roles => generated 239 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:55.174241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d31f0-cefe-40e2-80df-27b9bc1be3b9 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:55.174480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb3094-48c0-4d20-b385-2902b923b63d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:55.214055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d31f0-cefe-40e2-80df-27b9bc1be3b9 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:55.224638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45826828-ae34-495b-b58b-06bced00a224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:55.225336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45826828-ae34-495b-b58b-06bced00a224 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:55.225610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45826828-ae34-495b-b58b-06bced00a224 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:55.226093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45826828-ae34-495b-b58b-06bced00a224 admin admin] PATH_INFO: `/v3/projects/e24a8e1b1a76497dabbc59a4d786642e/users/ae678d85d278473e97fd9a25cae43f0c/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:55.251858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45826828-ae34-495b-b58b-06bced00a224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e24a8e1b1a76497dabbc59a4d786642e, user_id=ae678d85d278473e97fd9a25cae43f0c, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:55.254914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45826828-ae34-495b-b58b-06bced00a224 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:55.468982 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3343/6682] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:55 2022] PUT /identity/v3/projects/e24a8e1b1a76497dabbc59a4d786642e/users/ae678d85d278473e97fd9a25cae43f0c/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:55.471025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45826828-ae34-495b-b58b-06bced00a224 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:55.548344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45826828-ae34-495b-b58b-06bced00a224 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:55.553194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec96b8-ae2c-4a87-b37d-fe236fa5e0c6 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:55.553847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec96b8-ae2c-4a87-b37d-fe236fa5e0c6 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:55.571803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec96b8-ae2c-4a87-b37d-fe236fa5e0c6 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:55.571803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec96b8-ae2c-4a87-b37d-fe236fa5e0c6 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/users/eb11e3d61a3744c0b9466b64d0dc00f6` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:55.571803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec96b8-ae2c-4a87-b37d-fe236fa5e0c6 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:get_user(user_id=eb11e3d61a3744c0b9466b64d0dc00f6)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:55.574248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec96b8-ae2c-4a87-b37d-fe236fa5e0c6 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:55.577222 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3344/6683] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 03:50:55 2022] GET /identity/v3/users/eb11e3d61a3744c0b9466b64d0dc00f6 => generated 414 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:55.582598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec96b8-ae2c-4a87-b37d-fe236fa5e0c6 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:55.582598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c0ec96b8-ae2c-4a87-b37d-fe236fa5e0c6 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:55.607002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:55.633879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5cdb3094-48c0-4d20-b385-2902b923b63d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71433daac9564a47b539e5f7c800bb98'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:55.636639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5cdb3094-48c0-4d20-b385-2902b923b63d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71433daac9564a47b539e5f7c800bb98'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:55.657004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5cdb3094-48c0-4d20-b385-2902b923b63d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71433daac9564a47b539e5f7c800bb98'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:55.685297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5cdb3094-48c0-4d20-b385-2902b923b63d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71433daac9564a47b539e5f7c800bb98'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:55.695153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec96b8-ae2c-4a87-b37d-fe236fa5e0c6 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:55.706887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12372e94-3440-4067-94f4-ab028f47b10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:55.708066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12372e94-3440-4067-94f4-ab028f47b10b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:55.708066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12372e94-3440-4067-94f4-ab028f47b10b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:55.708257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12372e94-3440-4067-94f4-ab028f47b10b admin admin] PATH_INFO: `/v3/users/12d63a8d75fd4474b85c745cc523f478` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:55.709373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12372e94-3440-4067-94f4-ab028f47b10b admin admin] RBAC: Authorizing `identity:delete_user(user_id=12d63a8d75fd4474b85c745cc523f478)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:55.711890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12372e94-3440-4067-94f4-ab028f47b10b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:55.819066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5cdb3094-48c0-4d20-b385-2902b923b63d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71433daac9564a47b539e5f7c800bb98'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:55.826765 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3340/6684] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:55 2022] DELETE /identity/v3/users/71433daac9564a47b539e5f7c800bb98 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:55.828224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa5318-8740-4249-8ca9-f28ce593ce1a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:55.828595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa5318-8740-4249-8ca9-f28ce593ce1a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:55.828939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa5318-8740-4249-8ca9-f28ce593ce1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:55.863956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-39fa5318-8740-4249-8ca9-f28ce593ce1a None None] MFA Rules not processed for user `ae678d85d278473e97fd9a25cae43f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:55.865195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-39fa5318-8740-4249-8ca9-f28ce593ce1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:55.904606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:55.958429 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3341/6685] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:55.959469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa5318-8740-4249-8ca9-f28ce593ce1a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:55.960851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-39fa5318-8740-4249-8ca9-f28ce593ce1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:56.012273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-12372e94-3440-4067-94f4-ab028f47b10b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12d63a8d75fd4474b85c745cc523f478'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:56.014294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-12372e94-3440-4067-94f4-ab028f47b10b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12d63a8d75fd4474b85c745cc523f478'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:56.027372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-12372e94-3440-4067-94f4-ab028f47b10b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12d63a8d75fd4474b85c745cc523f478'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:56.053216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-12372e94-3440-4067-94f4-ab028f47b10b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12d63a8d75fd4474b85c745cc523f478'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:56.053991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-12372e94-3440-4067-94f4-ab028f47b10b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12d63a8d75fd4474b85c745cc523f478'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:56.061520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa5318-8740-4249-8ca9-f28ce593ce1a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:56.067609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79a455-491c-4f5a-ae69-d3352f83d38e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:56.068391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79a455-491c-4f5a-ae69-d3352f83d38e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:56.073174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79a455-491c-4f5a-ae69-d3352f83d38e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:56.073174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79a455-491c-4f5a-ae69-d3352f83d38e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/roles/19613342631a44e08787b4bf94cc2ee4` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:56.073174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79a455-491c-4f5a-ae69-d3352f83d38e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:get_role(role_id=19613342631a44e08787b4bf94cc2ee4)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:56.073174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79a455-491c-4f5a-ae69-d3352f83d38e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:56.078472 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3342/6686] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 03:50:55 2022] GET /identity/v3/roles/19613342631a44e08787b4bf94cc2ee4 => generated 239 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:56.078472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42445708-8b7d-4cf6-b844-6a6914f47f76 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:56.078875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42445708-8b7d-4cf6-b844-6a6914f47f76 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:56.079750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42445708-8b7d-4cf6-b844-6a6914f47f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:56.107463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-42445708-8b7d-4cf6-b844-6a6914f47f76 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:56.108996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-42445708-8b7d-4cf6-b844-6a6914f47f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:56.186390 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3343/6687] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:56.186390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42445708-8b7d-4cf6-b844-6a6914f47f76 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:56.186390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-42445708-8b7d-4cf6-b844-6a6914f47f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:56.199603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42445708-8b7d-4cf6-b844-6a6914f47f76 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:56.208070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3fd54-7d33-43ec-b946-f1462b8fc7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:56.208782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3fd54-7d33-43ec-b946-f1462b8fc7eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:56.209206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3fd54-7d33-43ec-b946-f1462b8fc7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:56.212163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3fd54-7d33-43ec-b946-f1462b8fc7eb admin admin] PATH_INFO: `/v3/projects/9d94fc0689124a62becb0ae45ffddd34` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:56.212343 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3345/6688] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:55 2022] DELETE /identity/v3/users/12d63a8d75fd4474b85c745cc523f478 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:56.212468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3fd54-7d33-43ec-b946-f1462b8fc7eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d94fc0689124a62becb0ae45ffddd34)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:56.212564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12372e94-3440-4067-94f4-ab028f47b10b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:56.213797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3fd54-7d33-43ec-b946-f1462b8fc7eb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:56.213987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-12372e94-3440-4067-94f4-ab028f47b10b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:56.288633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12372e94-3440-4067-94f4-ab028f47b10b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:56.295093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b171da0-6bd1-40ce-85e0-3fceb48459c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:56.296238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b171da0-6bd1-40ce-85e0-3fceb48459c0 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:56.296659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b171da0-6bd1-40ce-85e0-3fceb48459c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:56.297057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b171da0-6bd1-40ce-85e0-3fceb48459c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:56.299395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5b171da0-6bd1-40ce-85e0-3fceb48459c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:56.374543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-11b3fd54-7d33-43ec-b946-f1462b8fc7eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d94fc0689124a62becb0ae45ffddd34', 'request_id': 'req-11b3fd54-7d33-43ec-b946-f1462b8fc7eb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:56.382954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b171da0-6bd1-40ce-85e0-3fceb48459c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:56.384600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b171da0-6bd1-40ce-85e0-3fceb48459c0 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:56.400640 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3346/6689] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:50:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:50:56.401665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b171da0-6bd1-40ce-85e0-3fceb48459c0 service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:56.403206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5b171da0-6bd1-40ce-85e0-3fceb48459c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:56.479700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b171da0-6bd1-40ce-85e0-3fceb48459c0 service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:56.515091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-11b3fd54-7d33-43ec-b946-f1462b8fc7eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d94fc0689124a62becb0ae45ffddd34', 'request_id': 'req-11b3fd54-7d33-43ec-b946-f1462b8fc7eb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:56.522635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-11b3fd54-7d33-43ec-b946-f1462b8fc7eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d94fc0689124a62becb0ae45ffddd34', 'request_id': 'req-11b3fd54-7d33-43ec-b946-f1462b8fc7eb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:56.548837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-11b3fd54-7d33-43ec-b946-f1462b8fc7eb admin admin] The token cache is being invalidate because project 9d94fc0689124a62becb0ae45ffddd34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:56.549589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-11b3fd54-7d33-43ec-b946-f1462b8fc7eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:56.552341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-11b3fd54-7d33-43ec-b946-f1462b8fc7eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:56.560081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad1f9b-0d30-45f0-af63-4da0420e0eab tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:56.560959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad1f9b-0d30-45f0-af63-4da0420e0eab tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:56.561442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad1f9b-0d30-45f0-af63-4da0420e0eab tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:56.561731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad1f9b-0d30-45f0-af63-4da0420e0eab tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:56.562553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad1f9b-0d30-45f0-af63-4da0420e0eab tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:56.564424 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3344/6690] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:56 2022] DELETE /identity/v3/projects/9d94fc0689124a62becb0ae45ffddd34 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:56.565415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3fd54-7d33-43ec-b946-f1462b8fc7eb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:56.568825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-11b3fd54-7d33-43ec-b946-f1462b8fc7eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:56.571851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad1f9b-0d30-45f0-af63-4da0420e0eab tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:56.671127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3fd54-7d33-43ec-b946-f1462b8fc7eb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:56.675593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b7f85-328d-4cae-b55d-d7f491c88442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:56.676229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b7f85-328d-4cae-b55d-d7f491c88442 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:56.676691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b7f85-328d-4cae-b55d-d7f491c88442 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:56.676973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b7f85-328d-4cae-b55d-d7f491c88442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:56.678888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-667b7f85-328d-4cae-b55d-d7f491c88442 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:56.767173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b7f85-328d-4cae-b55d-d7f491c88442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:56.768650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b7f85-328d-4cae-b55d-d7f491c88442 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:56.780345 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3345/6691] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:50:56.781722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f909d7e-df46-42f3-bd12-24da979b5cf9 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:56.782017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f909d7e-df46-42f3-bd12-24da979b5cf9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:56.782334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f909d7e-df46-42f3-bd12-24da979b5cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:56.785542 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3347/6692] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:56 2022] POST /identity/v3/projects => generated 360 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:56.787883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092871ea-b968-40b9-a52d-136dcb2eae67 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:56.788640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092871ea-b968-40b9-a52d-136dcb2eae67 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:56.789730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092871ea-b968-40b9-a52d-136dcb2eae67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:56.813482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1f909d7e-df46-42f3-bd12-24da979b5cf9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:56.815176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1f909d7e-df46-42f3-bd12-24da979b5cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:56.832746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-092871ea-b968-40b9-a52d-136dcb2eae67 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:56.835291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-092871ea-b968-40b9-a52d-136dcb2eae67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:56.914124 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3346/6693] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:56.915210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f909d7e-df46-42f3-bd12-24da979b5cf9 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:56.917255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1f909d7e-df46-42f3-bd12-24da979b5cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:56.952317 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3348/6694] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:56.953243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092871ea-b968-40b9-a52d-136dcb2eae67 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:57.008788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f909d7e-df46-42f3-bd12-24da979b5cf9 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:57.015089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd53de6-4472-4a51-80e5-70a2215427c2 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:57.016027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd53de6-4472-4a51-80e5-70a2215427c2 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:57.016484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd53de6-4472-4a51-80e5-70a2215427c2 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:57.016912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd53de6-4472-4a51-80e5-70a2215427c2 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/projects/9b632671f2384b949a051fd7964d3fc3` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:57.018820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd53de6-4472-4a51-80e5-70a2215427c2 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:get_project(project_id=9b632671f2384b949a051fd7964d3fc3)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:57.021722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd53de6-4472-4a51-80e5-70a2215427c2 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:57.025417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092871ea-b968-40b9-a52d-136dcb2eae67 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:57.026240 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3347/6695] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:50:56 2022] GET /identity/v3/projects/9b632671f2384b949a051fd7964d3fc3 => generated 360 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:57.028703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629677c-a45a-477e-9804-ab3d43fefdb9 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:57.029071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629677c-a45a-477e-9804-ab3d43fefdb9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:57.029451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629677c-a45a-477e-9804-ab3d43fefdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:57.029757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a770d5-9e36-4be4-ae16-e04c744819fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:57.030534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a770d5-9e36-4be4-ae16-e04c744819fa service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:57.030945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a770d5-9e36-4be4-ae16-e04c744819fa service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:57.031315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a770d5-9e36-4be4-ae16-e04c744819fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:57.042071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a770d5-9e36-4be4-ae16-e04c744819fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:57.044984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a770d5-9e36-4be4-ae16-e04c744819fa service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:57.058117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8629677c-a45a-477e-9804-ab3d43fefdb9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:57.058814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8629677c-a45a-477e-9804-ab3d43fefdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:57.066867 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3349/6696] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:50:57.067851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a770d5-9e36-4be4-ae16-e04c744819fa service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:57.088685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a770d5-9e36-4be4-ae16-e04c744819fa service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:57.094793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09c4e9-d0bb-40c9-b990-332ddf90ba33 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:57.099745 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3348/6697] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:57.102479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629677c-a45a-477e-9804-ab3d43fefdb9 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:57.104769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09c4e9-d0bb-40c9-b990-332ddf90ba33 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:57.105350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09c4e9-d0bb-40c9-b990-332ddf90ba33 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:57.106075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09c4e9-d0bb-40c9-b990-332ddf90ba33 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/projects/9b632671f2384b949a051fd7964d3fc3/users/eb11e3d61a3744c0b9466b64d0dc00f6/roles/19613342631a44e08787b4bf94cc2ee4` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:57.113458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09c4e9-d0bb-40c9-b990-332ddf90ba33 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9b632671f2384b949a051fd7964d3fc3, user_id=eb11e3d61a3744c0b9466b64d0dc00f6, role_id=19613342631a44e08787b4bf94cc2ee4)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:57.123629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09c4e9-d0bb-40c9-b990-332ddf90ba33 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:57.128651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629677c-a45a-477e-9804-ab3d43fefdb9 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:57.134302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209fd02-2f45-4840-9e25-165cf44672dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:57.134945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209fd02-2f45-4840-9e25-165cf44672dc admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:57.135543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209fd02-2f45-4840-9e25-165cf44672dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:57.135832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209fd02-2f45-4840-9e25-165cf44672dc admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:57.136634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209fd02-2f45-4840-9e25-165cf44672dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:50:57.137027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209fd02-2f45-4840-9e25-165cf44672dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:57.139802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209fd02-2f45-4840-9e25-165cf44672dc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:57.158080 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3349/6698] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:57.161603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209fd02-2f45-4840-9e25-165cf44672dc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:57.177253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209fd02-2f45-4840-9e25-165cf44672dc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:57.199172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2223a71-d217-406a-8e6d-2365040bc49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:57.200058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2223a71-d217-406a-8e6d-2365040bc49a admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:57.200058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2223a71-d217-406a-8e6d-2365040bc49a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:57.200703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2223a71-d217-406a-8e6d-2365040bc49a admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:57.202704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2223a71-d217-406a-8e6d-2365040bc49a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:57.205953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2223a71-d217-406a-8e6d-2365040bc49a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:57.250288 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3350/6699] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:57 2022] PUT /identity/v3/projects/9b632671f2384b949a051fd7964d3fc3/users/eb11e3d61a3744c0b9466b64d0dc00f6/roles/19613342631a44e08787b4bf94cc2ee4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:57.254484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09c4e9-d0bb-40c9-b990-332ddf90ba33 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:57.306006 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3350/6700] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:57 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:57.307634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2223a71-d217-406a-8e6d-2365040bc49a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:57.368842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09c4e9-d0bb-40c9-b990-332ddf90ba33 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:57.373753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:57.460123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2223a71-d217-406a-8e6d-2365040bc49a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:57.469226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdf8f6-9d7f-459c-902d-e0ebd755c245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:57.469874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdf8f6-9d7f-459c-902d-e0ebd755c245 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:57.470255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdf8f6-9d7f-459c-902d-e0ebd755c245 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:57.470531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdf8f6-9d7f-459c-902d-e0ebd755c245 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:57.471214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdf8f6-9d7f-459c-902d-e0ebd755c245 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:57.473346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdf8f6-9d7f-459c-902d-e0ebd755c245 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:57.514172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae76077-a0ba-4ed0-ac8d-d7660b5d1c37 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:57.514830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae76077-a0ba-4ed0-ac8d-d7660b5d1c37 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:57.515089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae76077-a0ba-4ed0-ac8d-d7660b5d1c37 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:57.515373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae76077-a0ba-4ed0-ac8d-d7660b5d1c37 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:57.516015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae76077-a0ba-4ed0-ac8d-d7660b5d1c37 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:57.517890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae76077-a0ba-4ed0-ac8d-d7660b5d1c37 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:57.609445 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3351/6701] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:50:57 2022] POST /identity/v3/users => generated 296 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:57.620962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdf8f6-9d7f-459c-902d-e0ebd755c245 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:57.632519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdf8f6-9d7f-459c-902d-e0ebd755c245 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:57.637897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0a895-fb83-4c7e-810c-b58102c2b2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:57.638491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0a895-fb83-4c7e-810c-b58102c2b2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:57.638774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0a895-fb83-4c7e-810c-b58102c2b2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:57.639047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0a895-fb83-4c7e-810c-b58102c2b2b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:57.639839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0a895-fb83-4c7e-810c-b58102c2b2b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:57.641443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0a895-fb83-4c7e-810c-b58102c2b2b8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:57.659195 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3352/6702] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:57 2022] GET /identity/v3/roles => generated 1650 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:57.660160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0a895-fb83-4c7e-810c-b58102c2b2b8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:57.674685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0a895-fb83-4c7e-810c-b58102c2b2b8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:57.680690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715de7a-cba0-4c83-b480-7681cc83f223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:57.681635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715de7a-cba0-4c83-b480-7681cc83f223 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:57.682158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715de7a-cba0-4c83-b480-7681cc83f223 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:57.682614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715de7a-cba0-4c83-b480-7681cc83f223 admin admin] PATH_INFO: `/v3/projects/77fd803cce394295853b7b1d48e47d16/users/2ae018d6d9db438c9cd0f23f03025e91/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:57.710395 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3351/6703] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:57 2022] POST /identity/v3/projects => generated 360 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:50:57.712779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae76077-a0ba-4ed0-ac8d-d7660b5d1c37 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:57.723430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5ae76077-a0ba-4ed0-ac8d-d7660b5d1c37 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:57.806311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715de7a-cba0-4c83-b480-7681cc83f223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77fd803cce394295853b7b1d48e47d16, user_id=2ae018d6d9db438c9cd0f23f03025e91, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:57.813540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715de7a-cba0-4c83-b480-7681cc83f223 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:57.868636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:57.875943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae76077-a0ba-4ed0-ac8d-d7660b5d1c37 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:57.887039 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01f05b-79ca-4a4b-9c4c-29d47df596ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:57.887733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01f05b-79ca-4a4b-9c4c-29d47df596ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:57.888068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01f05b-79ca-4a4b-9c4c-29d47df596ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:57.888287 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01f05b-79ca-4a4b-9c4c-29d47df596ae admin admin] PATH_INFO: `/v3/projects/2a130f04b9ce4128b7bd7b8217e9f49a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:57.889478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c01f05b-79ca-4a4b-9c4c-29d47df596ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a130f04b9ce4128b7bd7b8217e9f49a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:57.897381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c01f05b-79ca-4a4b-9c4c-29d47df596ae admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:57.903820 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3353/6704] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:57 2022] PUT /identity/v3/projects/77fd803cce394295853b7b1d48e47d16/users/2ae018d6d9db438c9cd0f23f03025e91/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:57.904842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715de7a-cba0-4c83-b480-7681cc83f223 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:58.037531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715de7a-cba0-4c83-b480-7681cc83f223 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:58.044363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c25c29-8675-4d60-8c48-0171a0e590e4 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:58.051280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c25c29-8675-4d60-8c48-0171a0e590e4 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:58.051280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c25c29-8675-4d60-8c48-0171a0e590e4 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:58.060165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c25c29-8675-4d60-8c48-0171a0e590e4 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/projects/f4973188c8f045d48c2db7113e174043` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:58.065279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c25c29-8675-4d60-8c48-0171a0e590e4 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:get_project(project_id=f4973188c8f045d48c2db7113e174043)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:58.072387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c25c29-8675-4d60-8c48-0171a0e590e4 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:58.073573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2c01f05b-79ca-4a4b-9c4c-29d47df596ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a130f04b9ce4128b7bd7b8217e9f49a', 'request_id': 'req-2c01f05b-79ca-4a4b-9c4c-29d47df596ae'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:58.077253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:58.081189 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3354/6705] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:50:57 2022] GET /identity/v3/projects/f4973188c8f045d48c2db7113e174043 => generated 360 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:58.082235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c25c29-8675-4d60-8c48-0171a0e590e4 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:58.110129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2c01f05b-79ca-4a4b-9c4c-29d47df596ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a130f04b9ce4128b7bd7b8217e9f49a', 'request_id': 'req-2c01f05b-79ca-4a4b-9c4c-29d47df596ae'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:58.131583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2c01f05b-79ca-4a4b-9c4c-29d47df596ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a130f04b9ce4128b7bd7b8217e9f49a', 'request_id': 'req-2c01f05b-79ca-4a4b-9c4c-29d47df596ae'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:58.229310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2c01f05b-79ca-4a4b-9c4c-29d47df596ae admin admin] The token cache is being invalidate because project 2a130f04b9ce4128b7bd7b8217e9f49a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:58.229972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2c01f05b-79ca-4a4b-9c4c-29d47df596ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:58.232927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2c01f05b-79ca-4a4b-9c4c-29d47df596ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:58.235276 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3352/6706] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:57 2022] DELETE /identity/v3/projects/2a130f04b9ce4128b7bd7b8217e9f49a => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:58.236101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01f05b-79ca-4a4b-9c4c-29d47df596ae admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:58.237623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2c01f05b-79ca-4a4b-9c4c-29d47df596ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:58.254611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c25c29-8675-4d60-8c48-0171a0e590e4 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:58.387668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03be2f-d199-44b3-9395-54760d67f162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:58.388307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03be2f-d199-44b3-9395-54760d67f162 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:58.388592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03be2f-d199-44b3-9395-54760d67f162 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:58.388871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03be2f-d199-44b3-9395-54760d67f162 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:58.389533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03be2f-d199-44b3-9395-54760d67f162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:58.391459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03be2f-d199-44b3-9395-54760d67f162 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:58.417776 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3355/6707] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:50:58 2022] GET /identity/v3/roles => generated 1650 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:50:58.417776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03be2f-d199-44b3-9395-54760d67f162 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:58.421418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01f05b-79ca-4a4b-9c4c-29d47df596ae admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:58.423416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7a03be2f-d199-44b3-9395-54760d67f162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:58.430811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f01a5-4f91-4676-b917-c2a0b80ef123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:58.432352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f01a5-4f91-4676-b917-c2a0b80ef123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:58.432352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f01a5-4f91-4676-b917-c2a0b80ef123 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:58.432843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f01a5-4f91-4676-b917-c2a0b80ef123 admin admin] PATH_INFO: `/v3/projects/7f7b49f5d2e442e3a5024bf28ee4d230` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:58.434363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f01a5-4f91-4676-b917-c2a0b80ef123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f7b49f5d2e442e3a5024bf28ee4d230)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:58.436844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f01a5-4f91-4676-b917-c2a0b80ef123 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:58.597651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-687f01a5-4f91-4676-b917-c2a0b80ef123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f7b49f5d2e442e3a5024bf28ee4d230', 'request_id': 'req-687f01a5-4f91-4676-b917-c2a0b80ef123'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:58.615791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03be2f-d199-44b3-9395-54760d67f162 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:58.622766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-687f01a5-4f91-4676-b917-c2a0b80ef123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f7b49f5d2e442e3a5024bf28ee4d230', 'request_id': 'req-687f01a5-4f91-4676-b917-c2a0b80ef123'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:58.637994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-687f01a5-4f91-4676-b917-c2a0b80ef123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f7b49f5d2e442e3a5024bf28ee4d230', 'request_id': 'req-687f01a5-4f91-4676-b917-c2a0b80ef123'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:58.743946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-687f01a5-4f91-4676-b917-c2a0b80ef123 admin admin] The token cache is being invalidate because project 7f7b49f5d2e442e3a5024bf28ee4d230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:50:58.744249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-687f01a5-4f91-4676-b917-c2a0b80ef123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:58.745188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-687f01a5-4f91-4676-b917-c2a0b80ef123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:58.754838 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3353/6708] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:58 2022] DELETE /identity/v3/projects/7f7b49f5d2e442e3a5024bf28ee4d230 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:58.754838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f01a5-4f91-4676-b917-c2a0b80ef123 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:58.759954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-687f01a5-4f91-4676-b917-c2a0b80ef123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:58.782813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95323f39-7e97-4939-828a-ba26fb846182 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:58.783513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95323f39-7e97-4939-828a-ba26fb846182 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:58.783803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95323f39-7e97-4939-828a-ba26fb846182 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:58.784087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95323f39-7e97-4939-828a-ba26fb846182 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/projects/f4973188c8f045d48c2db7113e174043/users/eb11e3d61a3744c0b9466b64d0dc00f6/roles/19613342631a44e08787b4bf94cc2ee4` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:58.798947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95323f39-7e97-4939-828a-ba26fb846182 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f4973188c8f045d48c2db7113e174043, user_id=eb11e3d61a3744c0b9466b64d0dc00f6, role_id=19613342631a44e08787b4bf94cc2ee4)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:58.806479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95323f39-7e97-4939-828a-ba26fb846182 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:58.898131 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3356/6709] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:58 2022] PUT /identity/v3/projects/f4973188c8f045d48c2db7113e174043/users/eb11e3d61a3744c0b9466b64d0dc00f6/roles/19613342631a44e08787b4bf94cc2ee4 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:58.898905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95323f39-7e97-4939-828a-ba26fb846182 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:58.902515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-95323f39-7e97-4939-828a-ba26fb846182 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:58.953427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f01a5-4f91-4676-b917-c2a0b80ef123 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:59.054068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95323f39-7e97-4939-828a-ba26fb846182 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:59.068183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e8803-ce3f-4c40-abb0-6e1871dcacd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:59.068881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e8803-ce3f-4c40-abb0-6e1871dcacd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:59.069170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e8803-ce3f-4c40-abb0-6e1871dcacd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:59.069484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e8803-ce3f-4c40-abb0-6e1871dcacd9 admin admin] PATH_INFO: `/v3/projects/77fd803cce394295853b7b1d48e47d16/users/2ae018d6d9db438c9cd0f23f03025e91/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:59.074730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e8803-ce3f-4c40-abb0-6e1871dcacd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77fd803cce394295853b7b1d48e47d16, user_id=2ae018d6d9db438c9cd0f23f03025e91, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:59.080198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e8803-ce3f-4c40-abb0-6e1871dcacd9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:59.081782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4492ab1-87bd-4950-98ba-8d2ed15f93c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:59.082519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4492ab1-87bd-4950-98ba-8d2ed15f93c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:59.082851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4492ab1-87bd-4950-98ba-8d2ed15f93c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:59.092876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4492ab1-87bd-4950-98ba-8d2ed15f93c4 admin admin] PATH_INFO: `/v3/users/040be10bbb874614be64381928ad3d60` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:59.092876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4492ab1-87bd-4950-98ba-8d2ed15f93c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=040be10bbb874614be64381928ad3d60)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:59.092876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4492ab1-87bd-4950-98ba-8d2ed15f93c4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:59.103400 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3357/6710] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:50:58 2022] PUT /identity/v3/projects/77fd803cce394295853b7b1d48e47d16/users/2ae018d6d9db438c9cd0f23f03025e91/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:59.105583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cfee2-9464-48de-a76a-76bd1909dfc8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:59.105914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cfee2-9464-48de-a76a-76bd1909dfc8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:59.106216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cfee2-9464-48de-a76a-76bd1909dfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:59.168541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5b4cfee2-9464-48de-a76a-76bd1909dfc8 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:59.171626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5b4cfee2-9464-48de-a76a-76bd1909dfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:59.286101 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3358/6711] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:59.287330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cfee2-9464-48de-a76a-76bd1909dfc8 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:59.288902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5b4cfee2-9464-48de-a76a-76bd1909dfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:59.308877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:59.374005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cfee2-9464-48de-a76a-76bd1909dfc8 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:59.380007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f0e4a-d0dc-4ee1-9170-749d6b7fe594 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:59.380687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f0e4a-d0dc-4ee1-9170-749d6b7fe594 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:59.380980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f0e4a-d0dc-4ee1-9170-749d6b7fe594 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:59.386022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f0e4a-d0dc-4ee1-9170-749d6b7fe594 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/users/eb11e3d61a3744c0b9466b64d0dc00f6/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:59.386022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f0e4a-d0dc-4ee1-9170-749d6b7fe594 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=eb11e3d61a3744c0b9466b64d0dc00f6)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:59.386022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f0e4a-d0dc-4ee1-9170-749d6b7fe594 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:59.410260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f4492ab1-87bd-4950-98ba-8d2ed15f93c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '040be10bbb874614be64381928ad3d60'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:59.411170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f4492ab1-87bd-4950-98ba-8d2ed15f93c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '040be10bbb874614be64381928ad3d60'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:59.434597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f4492ab1-87bd-4950-98ba-8d2ed15f93c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '040be10bbb874614be64381928ad3d60'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:59.493096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f4492ab1-87bd-4950-98ba-8d2ed15f93c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '040be10bbb874614be64381928ad3d60'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:59.496144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f4492ab1-87bd-4950-98ba-8d2ed15f93c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '040be10bbb874614be64381928ad3d60'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:50:59.506178 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3359/6712] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:50:59 2022] GET /identity/v3/users/eb11e3d61a3744c0b9466b64d0dc00f6/projects => generated 844 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:50:59.508388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec97cc-6cce-4036-8a76-cbc5f3e7030e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:59.510470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec97cc-6cce-4036-8a76-cbc5f3e7030e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:59.510965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec97cc-6cce-4036-8a76-cbc5f3e7030e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:59.577950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-19ec97cc-6cce-4036-8a76-cbc5f3e7030e None None] MFA Rules not processed for user `2ae018d6d9db438c9cd0f23f03025e91`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:59.579483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-19ec97cc-6cce-4036-8a76-cbc5f3e7030e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:59.635744 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3354/6713] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:50:58 2022] DELETE /identity/v3/users/040be10bbb874614be64381928ad3d60 => generated 0 bytes in 883 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:50:59.641313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ef68b-1825-40b2-8b62-063b04c9ebe9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:59.641783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ef68b-1825-40b2-8b62-063b04c9ebe9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:59.642183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ef68b-1825-40b2-8b62-063b04c9ebe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:59.648993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:59.696980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-009ef68b-1825-40b2-8b62-063b04c9ebe9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:50:59.698352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-009ef68b-1825-40b2-8b62-063b04c9ebe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:59.754133 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3360/6714] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:59.755535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec97cc-6cce-4036-8a76-cbc5f3e7030e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:59.757756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-19ec97cc-6cce-4036-8a76-cbc5f3e7030e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:59.773301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec97cc-6cce-4036-8a76-cbc5f3e7030e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:59.830723 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3355/6715] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:50:59.831801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ef68b-1825-40b2-8b62-063b04c9ebe9 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:50:59.835199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-009ef68b-1825-40b2-8b62-063b04c9ebe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:50:59.853978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ef68b-1825-40b2-8b62-063b04c9ebe9 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:50:59.868191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c55a3-a8ac-4ea7-a0d0-62791a5a2b3e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:59.868860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c55a3-a8ac-4ea7-a0d0-62791a5a2b3e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:59.869148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c55a3-a8ac-4ea7-a0d0-62791a5a2b3e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:59.869429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c55a3-a8ac-4ea7-a0d0-62791a5a2b3e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/projects/f4973188c8f045d48c2db7113e174043` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:59.870994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c55a3-a8ac-4ea7-a0d0-62791a5a2b3e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f4973188c8f045d48c2db7113e174043)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:59.874989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba03433-cda0-4788-9aa1-1d3dab453013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:50:59.875436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba03433-cda0-4788-9aa1-1d3dab453013 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:50:59.875720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba03433-cda0-4788-9aa1-1d3dab453013 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:50:59.876003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba03433-cda0-4788-9aa1-1d3dab453013 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:50:59.876641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba03433-cda0-4788-9aa1-1d3dab453013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:50:59.878594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba03433-cda0-4788-9aa1-1d3dab453013 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:50:59.881649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c55a3-a8ac-4ea7-a0d0-62791a5a2b3e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:00.030440 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3356/6716] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:50:59 2022] POST /identity/v3/projects => generated 379 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:00.032379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba03433-cda0-4788-9aa1-1d3dab453013 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:00.159377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f16c55a3-a8ac-4ea7-a0d0-62791a5a2b3e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4973188c8f045d48c2db7113e174043', 'request_id': 'req-f16c55a3-a8ac-4ea7-a0d0-62791a5a2b3e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:00.210624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba03433-cda0-4788-9aa1-1d3dab453013 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:00.278616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f16c55a3-a8ac-4ea7-a0d0-62791a5a2b3e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4973188c8f045d48c2db7113e174043', 'request_id': 'req-f16c55a3-a8ac-4ea7-a0d0-62791a5a2b3e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:00.305063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f16c55a3-a8ac-4ea7-a0d0-62791a5a2b3e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4973188c8f045d48c2db7113e174043', 'request_id': 'req-f16c55a3-a8ac-4ea7-a0d0-62791a5a2b3e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:00.307310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137947ba-950c-44a5-b158-b112825a311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:00.308505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137947ba-950c-44a5-b158-b112825a311d admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:00.309019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137947ba-950c-44a5-b158-b112825a311d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:00.310617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137947ba-950c-44a5-b158-b112825a311d admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:00.311928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137947ba-950c-44a5-b158-b112825a311d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:51:00.316956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137947ba-950c-44a5-b158-b112825a311d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:00.316956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137947ba-950c-44a5-b158-b112825a311d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:00.343437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f16c55a3-a8ac-4ea7-a0d0-62791a5a2b3e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] The token cache is being invalidate because project f4973188c8f045d48c2db7113e174043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:00.345004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f16c55a3-a8ac-4ea7-a0d0-62791a5a2b3e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:00.345340 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3357/6717] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:51:00.346491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137947ba-950c-44a5-b158-b112825a311d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:00.352127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f16c55a3-a8ac-4ea7-a0d0-62791a5a2b3e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:00.354723 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3361/6718] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:50:59 2022] DELETE /identity/v3/projects/f4973188c8f045d48c2db7113e174043 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:00.355851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c55a3-a8ac-4ea7-a0d0-62791a5a2b3e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:00.358127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f16c55a3-a8ac-4ea7-a0d0-62791a5a2b3e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:00.369426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-137947ba-950c-44a5-b158-b112825a311d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:00.392272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c55a3-a8ac-4ea7-a0d0-62791a5a2b3e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:00.402252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256f810-bfb0-419f-b5d7-7d70e3bcbaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:00.403206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256f810-bfb0-419f-b5d7-7d70e3bcbaaa admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:00.404259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256f810-bfb0-419f-b5d7-7d70e3bcbaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:00.404754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256f810-bfb0-419f-b5d7-7d70e3bcbaaa admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:00.404876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137947ba-950c-44a5-b158-b112825a311d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:00.405688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256f810-bfb0-419f-b5d7-7d70e3bcbaaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:00.409835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256f810-bfb0-419f-b5d7-7d70e3bcbaaa admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:00.418228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba21c4-74f3-41ca-b1fa-6f1977cf3baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:00.419157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba21c4-74f3-41ca-b1fa-6f1977cf3baa admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:00.419569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba21c4-74f3-41ca-b1fa-6f1977cf3baa admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:00.419941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba21c4-74f3-41ca-b1fa-6f1977cf3baa admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:00.421096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba21c4-74f3-41ca-b1fa-6f1977cf3baa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:00.423422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba21c4-74f3-41ca-b1fa-6f1977cf3baa admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:00.556306 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3358/6719] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:51:00 2022] POST /identity/v3/users => generated 290 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:00.556565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba21c4-74f3-41ca-b1fa-6f1977cf3baa admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:00.561273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c2ba21c4-74f3-41ca-b1fa-6f1977cf3baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:00.566857 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3362/6720] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:51:00 2022] POST /identity/v3/projects => generated 381 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:00.577461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256f810-bfb0-419f-b5d7-7d70e3bcbaaa admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:00.585360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2256f810-bfb0-419f-b5d7-7d70e3bcbaaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:00.672060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba21c4-74f3-41ca-b1fa-6f1977cf3baa admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:00.717613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256f810-bfb0-419f-b5d7-7d70e3bcbaaa admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:00.727178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f39158-92f5-4b77-a204-cbd2f43eeaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:00.728141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f39158-92f5-4b77-a204-cbd2f43eeaaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:00.729336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f39158-92f5-4b77-a204-cbd2f43eeaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:00.731275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f39158-92f5-4b77-a204-cbd2f43eeaaf admin admin] PATH_INFO: `/v3/projects/70796c11d62942e2b789261a811d570c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:00.732783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f39158-92f5-4b77-a204-cbd2f43eeaaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=70796c11d62942e2b789261a811d570c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:00.737855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f39158-92f5-4b77-a204-cbd2f43eeaaf admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:00.778380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4771e88-c5ee-4102-86a0-4ac09f8e1385 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:00.779101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4771e88-c5ee-4102-86a0-4ac09f8e1385 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:00.779399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4771e88-c5ee-4102-86a0-4ac09f8e1385 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:00.779695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4771e88-c5ee-4102-86a0-4ac09f8e1385 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/projects/9b632671f2384b949a051fd7964d3fc3` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:00.781067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4771e88-c5ee-4102-86a0-4ac09f8e1385 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9b632671f2384b949a051fd7964d3fc3)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:00.783139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4771e88-c5ee-4102-86a0-4ac09f8e1385 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:00.905399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-53f39158-92f5-4b77-a204-cbd2f43eeaaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70796c11d62942e2b789261a811d570c', 'request_id': 'req-53f39158-92f5-4b77-a204-cbd2f43eeaaf'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:01.008372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c4771e88-c5ee-4102-86a0-4ac09f8e1385 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b632671f2384b949a051fd7964d3fc3', 'request_id': 'req-c4771e88-c5ee-4102-86a0-4ac09f8e1385'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:01.017141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-53f39158-92f5-4b77-a204-cbd2f43eeaaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70796c11d62942e2b789261a811d570c', 'request_id': 'req-53f39158-92f5-4b77-a204-cbd2f43eeaaf'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:01.024236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c4771e88-c5ee-4102-86a0-4ac09f8e1385 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b632671f2384b949a051fd7964d3fc3', 'request_id': 'req-c4771e88-c5ee-4102-86a0-4ac09f8e1385'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:01.035646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c4771e88-c5ee-4102-86a0-4ac09f8e1385 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b632671f2384b949a051fd7964d3fc3', 'request_id': 'req-c4771e88-c5ee-4102-86a0-4ac09f8e1385'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:01.042445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-53f39158-92f5-4b77-a204-cbd2f43eeaaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70796c11d62942e2b789261a811d570c', 'request_id': 'req-53f39158-92f5-4b77-a204-cbd2f43eeaaf'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:01.070022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-53f39158-92f5-4b77-a204-cbd2f43eeaaf admin admin] The token cache is being invalidate because project 70796c11d62942e2b789261a811d570c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:01.071054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-53f39158-92f5-4b77-a204-cbd2f43eeaaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:01.071829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-53f39158-92f5-4b77-a204-cbd2f43eeaaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:01.077447 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3363/6721] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:51:00 2022] DELETE /identity/v3/projects/70796c11d62942e2b789261a811d570c => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:01.078490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f39158-92f5-4b77-a204-cbd2f43eeaaf admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:01.080012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-53f39158-92f5-4b77-a204-cbd2f43eeaaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:01.150941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c4771e88-c5ee-4102-86a0-4ac09f8e1385 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] The token cache is being invalidate because project 9b632671f2384b949a051fd7964d3fc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:01.151948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c4771e88-c5ee-4102-86a0-4ac09f8e1385 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:01.151948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c4771e88-c5ee-4102-86a0-4ac09f8e1385 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:01.153711 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3359/6722] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:51:00 2022] DELETE /identity/v3/projects/9b632671f2384b949a051fd7964d3fc3 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:01.155456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4771e88-c5ee-4102-86a0-4ac09f8e1385 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:01.156946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c4771e88-c5ee-4102-86a0-4ac09f8e1385 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:01.212176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f39158-92f5-4b77-a204-cbd2f43eeaaf admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:01.323357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4771e88-c5ee-4102-86a0-4ac09f8e1385 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:01.333291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:01.343925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140c092-8cf8-4787-8b3b-78da21053dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:01.344608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140c092-8cf8-4787-8b3b-78da21053dcc admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:01.346310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140c092-8cf8-4787-8b3b-78da21053dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:01.349219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140c092-8cf8-4787-8b3b-78da21053dcc admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:01.351879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140c092-8cf8-4787-8b3b-78da21053dcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:01.353655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140c092-8cf8-4787-8b3b-78da21053dcc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:01.369539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67783824-002e-46f8-83d0-6dfd21c65aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:01.373474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67783824-002e-46f8-83d0-6dfd21c65aeb admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:01.375810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67783824-002e-46f8-83d0-6dfd21c65aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:01.376859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67783824-002e-46f8-83d0-6dfd21c65aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:01.377982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67783824-002e-46f8-83d0-6dfd21c65aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:01.383534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67783824-002e-46f8-83d0-6dfd21c65aeb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:01.410310 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3364/6723] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:01 2022] GET /identity/v3/roles => generated 1650 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:01.411694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca604d-8576-4c89-bf4d-cdf69eaf6f9e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:01.411990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca604d-8576-4c89-bf4d-cdf69eaf6f9e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:01.412422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca604d-8576-4c89-bf4d-cdf69eaf6f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:01.441306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b9ca604d-8576-4c89-bf4d-cdf69eaf6f9e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:01.442589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b9ca604d-8576-4c89-bf4d-cdf69eaf6f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:01.450730 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3360/6724] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:51:01 2022] POST /identity/v3/users => generated 291 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:01.451834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140c092-8cf8-4787-8b3b-78da21053dcc admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:01.453629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e140c092-8cf8-4787-8b3b-78da21053dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:01.461127 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3365/6725] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:01.468394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca604d-8576-4c89-bf4d-cdf69eaf6f9e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:01.468394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b9ca604d-8576-4c89-bf4d-cdf69eaf6f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:01.482498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca604d-8576-4c89-bf4d-cdf69eaf6f9e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:01.489978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba905e7-3432-4068-be1c-b1b95b99685f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:01.490807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba905e7-3432-4068-be1c-b1b95b99685f admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:01.490972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba905e7-3432-4068-be1c-b1b95b99685f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:01.491258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba905e7-3432-4068-be1c-b1b95b99685f admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:01.491927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba905e7-3432-4068-be1c-b1b95b99685f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:01.498273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba905e7-3432-4068-be1c-b1b95b99685f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:01.529843 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3366/6726] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:01 2022] GET /identity/v3/roles => generated 1650 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:01.530848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba905e7-3432-4068-be1c-b1b95b99685f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:01.572229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba905e7-3432-4068-be1c-b1b95b99685f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:01.591841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feec506-3d08-4203-a948-00699cee9d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:01.592464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feec506-3d08-4203-a948-00699cee9d4f admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:01.592750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feec506-3d08-4203-a948-00699cee9d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:01.593037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feec506-3d08-4203-a948-00699cee9d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:01.593686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feec506-3d08-4203-a948-00699cee9d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:01.600004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feec506-3d08-4203-a948-00699cee9d4f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:01.604534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140c092-8cf8-4787-8b3b-78da21053dcc admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:01.625853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fa833-daa4-4b59-baa1-552cb81a9102 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:01.625853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fa833-daa4-4b59-baa1-552cb81a9102 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:01.625853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fa833-daa4-4b59-baa1-552cb81a9102 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:01.626219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fa833-daa4-4b59-baa1-552cb81a9102 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/roles/19613342631a44e08787b4bf94cc2ee4` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:01.626219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4fa833-daa4-4b59-baa1-552cb81a9102 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:delete_role(role_id=19613342631a44e08787b4bf94cc2ee4)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:01.627232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4fa833-daa4-4b59-baa1-552cb81a9102 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:01.632029 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3367/6727] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:01 2022] GET /identity/v3/roles => generated 1650 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:01.633996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb164a2-5609-4e76-aaea-bbe06eecedba None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:01.634710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb164a2-5609-4e76-aaea-bbe06eecedba None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:01.634710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb164a2-5609-4e76-aaea-bbe06eecedba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:01.689398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4cb164a2-5609-4e76-aaea-bbe06eecedba None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:01.693883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4cb164a2-5609-4e76-aaea-bbe06eecedba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:01.718049 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3368/6728] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:01.719889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb164a2-5609-4e76-aaea-bbe06eecedba None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:01.750613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb164a2-5609-4e76-aaea-bbe06eecedba None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:01.756225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8f081-e6c1-4482-86b4-ac23ae3a8cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:01.757195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8f081-e6c1-4482-86b4-ac23ae3a8cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:01.757495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8f081-e6c1-4482-86b4-ac23ae3a8cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:01.759068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8f081-e6c1-4482-86b4-ac23ae3a8cc4 admin admin] PATH_INFO: `/v3/projects/d56d483218be4f9aae67bf893b1d71df/users/6e38f410b5b5410ead2ec1f95755ee62/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:01.776200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8f081-e6c1-4482-86b4-ac23ae3a8cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d56d483218be4f9aae67bf893b1d71df, user_id=6e38f410b5b5410ead2ec1f95755ee62, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:01.779560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8f081-e6c1-4482-86b4-ac23ae3a8cc4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:01.793496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2f4fa833-daa4-4b59-baa1-552cb81a9102 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invalidating the token cache because role 19613342631a44e08787b4bf94cc2ee4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:01.793496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2f4fa833-daa4-4b59-baa1-552cb81a9102 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:01.793496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2f4fa833-daa4-4b59-baa1-552cb81a9102 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:01.794381 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3361/6729] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:51:01 2022] DELETE /identity/v3/roles/19613342631a44e08787b4bf94cc2ee4 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:01.795389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fa833-daa4-4b59-baa1-552cb81a9102 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:01.797182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2f4fa833-daa4-4b59-baa1-552cb81a9102 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:01.875566 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3369/6730] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:51:01 2022] PUT /identity/v3/projects/d56d483218be4f9aae67bf893b1d71df/users/6e38f410b5b5410ead2ec1f95755ee62/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:01.876667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8f081-e6c1-4482-86b4-ac23ae3a8cc4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:01.882414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fad8f081-e6c1-4482-86b4-ac23ae3a8cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:01.896139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:01.925955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fa833-daa4-4b59-baa1-552cb81a9102 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:02.075938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8f081-e6c1-4482-86b4-ac23ae3a8cc4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:02.091218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9ebe8-bb33-4247-8b52-59cfd503049a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:02.092239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3518ecd-86df-4d8e-88bf-447198e86e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:02.093711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9ebe8-bb33-4247-8b52-59cfd503049a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:02.094929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9ebe8-bb33-4247-8b52-59cfd503049a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:02.095444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9ebe8-bb33-4247-8b52-59cfd503049a admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:02.097228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9ebe8-bb33-4247-8b52-59cfd503049a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:02.105099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9ebe8-bb33-4247-8b52-59cfd503049a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:02.105711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3518ecd-86df-4d8e-88bf-447198e86e12 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:02.107695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3518ecd-86df-4d8e-88bf-447198e86e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:02.108162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3518ecd-86df-4d8e-88bf-447198e86e12 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:02.110007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3518ecd-86df-4d8e-88bf-447198e86e12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:51:02.111266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3518ecd-86df-4d8e-88bf-447198e86e12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:02.114115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3518ecd-86df-4d8e-88bf-447198e86e12 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:02.140307 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3362/6731] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:02.140824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9ebe8-bb33-4247-8b52-59cfd503049a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:02.145797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6cb9ebe8-bb33-4247-8b52-59cfd503049a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:02.155250 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3370/6732] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:51:02.156628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e65f0-e6ff-4447-8b19-90a3636d6866 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:02.156916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e65f0-e6ff-4447-8b19-90a3636d6866 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:02.157204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e65f0-e6ff-4447-8b19-90a3636d6866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:02.235897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ea6e65f0-e6ff-4447-8b19-90a3636d6866 None None] MFA Rules not processed for user `6e38f410b5b5410ead2ec1f95755ee62`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:02.240252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ea6e65f0-e6ff-4447-8b19-90a3636d6866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:02.346431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9ebe8-bb33-4247-8b52-59cfd503049a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:02.352840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184b18d-f228-4fa2-9914-0c4a17fcb8ac tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:02.353979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184b18d-f228-4fa2-9914-0c4a17fcb8ac tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:02.354878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184b18d-f228-4fa2-9914-0c4a17fcb8ac tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:02.354878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184b18d-f228-4fa2-9914-0c4a17fcb8ac tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/users/eb11e3d61a3744c0b9466b64d0dc00f6` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:02.355944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184b18d-f228-4fa2-9914-0c4a17fcb8ac tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:delete_user(user_id=eb11e3d61a3744c0b9466b64d0dc00f6)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:02.367855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184b18d-f228-4fa2-9914-0c4a17fcb8ac tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:02.418972 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3371/6733] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:02.420254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e65f0-e6ff-4447-8b19-90a3636d6866 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:02.452589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e65f0-e6ff-4447-8b19-90a3636d6866 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:02.469618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca5cdd-ab19-491c-a6af-5701ded4c923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:02.470353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca5cdd-ab19-491c-a6af-5701ded4c923 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:02.470639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca5cdd-ab19-491c-a6af-5701ded4c923 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:02.472188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca5cdd-ab19-491c-a6af-5701ded4c923 admin admin] PATH_INFO: `/v3/projects/1625f24abb9143a28908c57f29ff9f29/users/13f3a60c5fb44b77baf860451490e501/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:02.493161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:02.512049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca5cdd-ab19-491c-a6af-5701ded4c923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1625f24abb9143a28908c57f29ff9f29, user_id=13f3a60c5fb44b77baf860451490e501, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:02.514934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca5cdd-ab19-491c-a6af-5701ded4c923 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:02.575984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9184b18d-f228-4fa2-9914-0c4a17fcb8ac tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb11e3d61a3744c0b9466b64d0dc00f6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:02.576935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9184b18d-f228-4fa2-9914-0c4a17fcb8ac tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb11e3d61a3744c0b9466b64d0dc00f6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:02.597943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9184b18d-f228-4fa2-9914-0c4a17fcb8ac tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb11e3d61a3744c0b9466b64d0dc00f6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:02.616530 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3372/6734] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:51:02 2022] PUT /identity/v3/projects/1625f24abb9143a28908c57f29ff9f29/users/13f3a60c5fb44b77baf860451490e501/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:02.627115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca5cdd-ab19-491c-a6af-5701ded4c923 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:02.629686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9184b18d-f228-4fa2-9914-0c4a17fcb8ac tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb11e3d61a3744c0b9466b64d0dc00f6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:02.631038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9184b18d-f228-4fa2-9914-0c4a17fcb8ac tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb11e3d61a3744c0b9466b64d0dc00f6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:02.634685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-25ca5cdd-ab19-491c-a6af-5701ded4c923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:02.741977 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3363/6735] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:51:02 2022] DELETE /identity/v3/users/eb11e3d61a3744c0b9466b64d0dc00f6 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:02.743662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184b18d-f228-4fa2-9914-0c4a17fcb8ac tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:02.749383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9184b18d-f228-4fa2-9914-0c4a17fcb8ac tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:02.809198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca5cdd-ab19-491c-a6af-5701ded4c923 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:02.880558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184b18d-f228-4fa2-9914-0c4a17fcb8ac tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:02.885802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd23867-332d-4bc3-aa55-2c312adfe2fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:02.886558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd23867-332d-4bc3-aa55-2c312adfe2fa service glance] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:02.886852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd23867-332d-4bc3-aa55-2c312adfe2fa service glance] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:02.887134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd23867-332d-4bc3-aa55-2c312adfe2fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:02.889314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8cd23867-332d-4bc3-aa55-2c312adfe2fa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:02.922534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5adaaa-b3f0-4cd5-b15c-aeacab15c30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:02.923222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5adaaa-b3f0-4cd5-b15c-aeacab15c30e admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:02.923702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5adaaa-b3f0-4cd5-b15c-aeacab15c30e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:02.923981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5adaaa-b3f0-4cd5-b15c-aeacab15c30e admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:02.924145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:02.925526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5adaaa-b3f0-4cd5-b15c-aeacab15c30e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:02.929898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5adaaa-b3f0-4cd5-b15c-aeacab15c30e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:03.024689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd23867-332d-4bc3-aa55-2c312adfe2fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:03.028452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd23867-332d-4bc3-aa55-2c312adfe2fa service glance] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:03.053762 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3373/6736] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:51:02 2022] POST /identity/v3/projects => generated 385 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:03.056173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab21fce-64bb-4a56-86e9-44143eac28d2 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:03.058870 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3364/6737] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:02 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:51:03.060812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd23867-332d-4bc3-aa55-2c312adfe2fa service glance] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:03.064921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8cd23867-332d-4bc3-aa55-2c312adfe2fa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:03.066553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab21fce-64bb-4a56-86e9-44143eac28d2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:03.070861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab21fce-64bb-4a56-86e9-44143eac28d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:03.176678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1ab21fce-64bb-4a56-86e9-44143eac28d2 None None] MFA Rules not processed for user `13f3a60c5fb44b77baf860451490e501`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:03.178703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1ab21fce-64bb-4a56-86e9-44143eac28d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:03.261929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd23867-332d-4bc3-aa55-2c312adfe2fa service glance] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:03.288294 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3374/6738] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:03.290401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab21fce-64bb-4a56-86e9-44143eac28d2 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:03.381566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2032d8-fe75-40e6-a9d5-877a614f3430 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:03.382297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2032d8-fe75-40e6-a9d5-877a614f3430 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:03.382676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2032d8-fe75-40e6-a9d5-877a614f3430 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:03.382967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2032d8-fe75-40e6-a9d5-877a614f3430 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/projects/f672d2a0ce5f4fa484b6f71d857cfa70` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:03.390364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2032d8-fe75-40e6-a9d5-877a614f3430 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f672d2a0ce5f4fa484b6f71d857cfa70)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:03.397081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2032d8-fe75-40e6-a9d5-877a614f3430 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:03.413120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab21fce-64bb-4a56-86e9-44143eac28d2 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:03.422932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1ee5e-e831-4d1f-8b2d-757b7ed1ebc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:03.424214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1ee5e-e831-4d1f-8b2d-757b7ed1ebc1 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:03.424936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1ee5e-e831-4d1f-8b2d-757b7ed1ebc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:03.425621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1ee5e-e831-4d1f-8b2d-757b7ed1ebc1 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:03.427561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1ee5e-e831-4d1f-8b2d-757b7ed1ebc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:03.432984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1ee5e-e831-4d1f-8b2d-757b7ed1ebc1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:03.593555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7a2032d8-fe75-40e6-a9d5-877a614f3430 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f672d2a0ce5f4fa484b6f71d857cfa70', 'request_id': 'req-7a2032d8-fe75-40e6-a9d5-877a614f3430'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:03.603100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7a2032d8-fe75-40e6-a9d5-877a614f3430 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f672d2a0ce5f4fa484b6f71d857cfa70', 'request_id': 'req-7a2032d8-fe75-40e6-a9d5-877a614f3430'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:03.611893 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3375/6739] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:51:03 2022] POST /identity/v3/users => generated 293 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:03.612773 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1ee5e-e831-4d1f-8b2d-757b7ed1ebc1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:03.641650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7a2032d8-fe75-40e6-a9d5-877a614f3430 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f672d2a0ce5f4fa484b6f71d857cfa70', 'request_id': 'req-7a2032d8-fe75-40e6-a9d5-877a614f3430'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:03.754880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7a2032d8-fe75-40e6-a9d5-877a614f3430 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] The token cache is being invalidate because project f672d2a0ce5f4fa484b6f71d857cfa70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:03.755180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7a2032d8-fe75-40e6-a9d5-877a614f3430 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:03.759818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7a2032d8-fe75-40e6-a9d5-877a614f3430 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:03.761283 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3365/6740] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:51:03 2022] DELETE /identity/v3/projects/f672d2a0ce5f4fa484b6f71d857cfa70 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:03.762199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2032d8-fe75-40e6-a9d5-877a614f3430 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:03.765827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7a2032d8-fe75-40e6-a9d5-877a614f3430 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:03.771214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1ee5e-e831-4d1f-8b2d-757b7ed1ebc1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:03.841231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:03.927980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2032d8-fe75-40e6-a9d5-877a614f3430 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:03.930103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf630b56-4a66-4ed6-b583-82716bed7bad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:03.930901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf630b56-4a66-4ed6-b583-82716bed7bad service glance] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:03.932707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf630b56-4a66-4ed6-b583-82716bed7bad service glance] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:03.933104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf630b56-4a66-4ed6-b583-82716bed7bad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:03.946774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97d58d-c253-4084-b387-1ad395c88037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:03.947931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97d58d-c253-4084-b387-1ad395c88037 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:03.949465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97d58d-c253-4084-b387-1ad395c88037 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:03.949914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97d58d-c253-4084-b387-1ad395c88037 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:03.951141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97d58d-c253-4084-b387-1ad395c88037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:03.956240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97d58d-c253-4084-b387-1ad395c88037 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:03.960037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bf630b56-4a66-4ed6-b583-82716bed7bad service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:03.980504 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3366/6741] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:03.982872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97d58d-c253-4084-b387-1ad395c88037 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:03.986972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6c97d58d-c253-4084-b387-1ad395c88037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:04.110913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf630b56-4a66-4ed6-b583-82716bed7bad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:04.114470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf630b56-4a66-4ed6-b583-82716bed7bad service glance] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:04.120497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97d58d-c253-4084-b387-1ad395c88037 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:04.136738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd6ae9-2e9c-464b-b9d6-b4016d7e6f01 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:04.137408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd6ae9-2e9c-464b-b9d6-b4016d7e6f01 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:04.137705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd6ae9-2e9c-464b-b9d6-b4016d7e6f01 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:04.137993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd6ae9-2e9c-464b-b9d6-b4016d7e6f01 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/users/86a8f248bc09470c8aa4b1d75887361b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:04.139384 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3376/6742] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:51:04.140575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf630b56-4a66-4ed6-b583-82716bed7bad service glance] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:04.143285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd6ae9-2e9c-464b-b9d6-b4016d7e6f01 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:update_user(user_id=86a8f248bc09470c8aa4b1d75887361b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:04.145273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd6ae9-2e9c-464b-b9d6-b4016d7e6f01 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:04.157629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:04.179271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf630b56-4a66-4ed6-b583-82716bed7bad service glance] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:04.199483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73f601-5549-451e-8c38-beed7a441faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:04.205444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73f601-5549-451e-8c38-beed7a441faa admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:04.205444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73f601-5549-451e-8c38-beed7a441faa admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:04.206240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73f601-5549-451e-8c38-beed7a441faa admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:04.207023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73f601-5549-451e-8c38-beed7a441faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:04.214707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73f601-5549-451e-8c38-beed7a441faa admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:04.242682 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3377/6743] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:04.248526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73f601-5549-451e-8c38-beed7a441faa admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:04.281423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73f601-5549-451e-8c38-beed7a441faa admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:04.294076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d637074-0895-4943-94e4-7f489e6e82c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:04.299607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d637074-0895-4943-94e4-7f489e6e82c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:04.300058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d637074-0895-4943-94e4-7f489e6e82c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:04.300492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d637074-0895-4943-94e4-7f489e6e82c3 admin admin] PATH_INFO: `/v3/projects/8b62e2e983d7438ca1d5a3c63e15ac8c/users/f83851c79d7e4f78976b6e3ecea565d2/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:04.324452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9ccd6ae9-2e9c-464b-b9d6-b4016d7e6f01 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '86a8f248bc09470c8aa4b1d75887361b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:04.377095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d637074-0895-4943-94e4-7f489e6e82c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b62e2e983d7438ca1d5a3c63e15ac8c, user_id=f83851c79d7e4f78976b6e3ecea565d2, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:04.383580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d637074-0895-4943-94e4-7f489e6e82c3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:04.393939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:04.411343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9ccd6ae9-2e9c-464b-b9d6-b4016d7e6f01 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invalidating the token cache because user 86a8f248bc09470c8aa4b1d75887361b was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:04.411707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9ccd6ae9-2e9c-464b-b9d6-b4016d7e6f01 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:04.412399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9ccd6ae9-2e9c-464b-b9d6-b4016d7e6f01 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:04.415453 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3367/6744] 10.222.0.20 () {60 vars in 1243 bytes} [Thu Oct 27 03:51:03 2022] PATCH /identity/v3/users/86a8f248bc09470c8aa4b1d75887361b => generated 296 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:51:04.419526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431179d-6ab3-4d98-8689-429911a758e1 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:04.420153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431179d-6ab3-4d98-8689-429911a758e1 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:04.420153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431179d-6ab3-4d98-8689-429911a758e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:04.463821 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3378/6745] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:51:04 2022] PUT /identity/v3/projects/8b62e2e983d7438ca1d5a3c63e15ac8c/users/f83851c79d7e4f78976b6e3ecea565d2/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:04.476973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f396a05-e140-4f23-a5c1-fca825182282 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:04.478713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f396a05-e140-4f23-a5c1-fca825182282 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:04.479081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f396a05-e140-4f23-a5c1-fca825182282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:04.496234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4431179d-6ab3-4d98-8689-429911a758e1 None None] MFA Rules not processed for user `86a8f248bc09470c8aa4b1d75887361b`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:04.498578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4431179d-6ab3-4d98-8689-429911a758e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:04.505548 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3368/6746] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:04 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 03:51:04.513005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431179d-6ab3-4d98-8689-429911a758e1 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:04.514440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4431179d-6ab3-4d98-8689-429911a758e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:04.550756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1f396a05-e140-4f23-a5c1-fca825182282 None None] MFA Rules not processed for user `f83851c79d7e4f78976b6e3ecea565d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:04.552361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1f396a05-e140-4f23-a5c1-fca825182282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:04.655784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431179d-6ab3-4d98-8689-429911a758e1 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:04.664457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:04.675180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e03087-060c-4d3d-b1fe-341bad2b9fb6 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:04.681565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e03087-060c-4d3d-b1fe-341bad2b9fb6 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:04.682165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e03087-060c-4d3d-b1fe-341bad2b9fb6 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:04.682711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e03087-060c-4d3d-b1fe-341bad2b9fb6 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/users/86a8f248bc09470c8aa4b1d75887361b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:04.684283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e03087-060c-4d3d-b1fe-341bad2b9fb6 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:update_user(user_id=86a8f248bc09470c8aa4b1d75887361b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:04.686649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e03087-060c-4d3d-b1fe-341bad2b9fb6 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:04.704007 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3379/6747] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:04.861041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f396a05-e140-4f23-a5c1-fca825182282 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:04.863254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1f396a05-e140-4f23-a5c1-fca825182282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:04.876689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-33e03087-060c-4d3d-b1fe-341bad2b9fb6 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '86a8f248bc09470c8aa4b1d75887361b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:04.977221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-33e03087-060c-4d3d-b1fe-341bad2b9fb6 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invalidating the token cache because user 86a8f248bc09470c8aa4b1d75887361b was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:04.977802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-33e03087-060c-4d3d-b1fe-341bad2b9fb6 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:04.978302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-33e03087-060c-4d3d-b1fe-341bad2b9fb6 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:04.980162 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3369/6748] 10.222.0.20 () {60 vars in 1243 bytes} [Thu Oct 27 03:51:04 2022] PATCH /identity/v3/users/86a8f248bc09470c8aa4b1d75887361b => generated 296 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:51:04.981427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e03087-060c-4d3d-b1fe-341bad2b9fb6 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:04.984659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-33e03087-060c-4d3d-b1fe-341bad2b9fb6 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:05.011198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f396a05-e140-4f23-a5c1-fca825182282 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:05.014467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e03087-060c-4d3d-b1fe-341bad2b9fb6 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:05.018514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b63c6-1714-49e6-9fe4-1c4758b105fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:05.018514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b63c6-1714-49e6-9fe4-1c4758b105fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:05.018514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b63c6-1714-49e6-9fe4-1c4758b105fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:05.018899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b63c6-1714-49e6-9fe4-1c4758b105fb admin admin] PATH_INFO: `/v3/users/2ae018d6d9db438c9cd0f23f03025e91` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:05.021278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b63c6-1714-49e6-9fe4-1c4758b105fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ae018d6d9db438c9cd0f23f03025e91)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:05.025055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b63c6-1714-49e6-9fe4-1c4758b105fb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:05.027186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ba291-b101-415e-82b5-85392123f965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:05.027851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ba291-b101-415e-82b5-85392123f965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:05.028141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ba291-b101-415e-82b5-85392123f965 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:05.028422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ba291-b101-415e-82b5-85392123f965 admin admin] PATH_INFO: `/v3/users/13f3a60c5fb44b77baf860451490e501` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:05.034414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ba291-b101-415e-82b5-85392123f965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13f3a60c5fb44b77baf860451490e501)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:05.036396 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ba291-b101-415e-82b5-85392123f965 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:05.292415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e03b63c6-1714-49e6-9fe4-1c4758b105fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ae018d6d9db438c9cd0f23f03025e91'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:05.293669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e03b63c6-1714-49e6-9fe4-1c4758b105fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ae018d6d9db438c9cd0f23f03025e91'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:05.302141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e03b63c6-1714-49e6-9fe4-1c4758b105fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ae018d6d9db438c9cd0f23f03025e91'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:05.310076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-760ba291-b101-415e-82b5-85392123f965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13f3a60c5fb44b77baf860451490e501'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:05.310778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-760ba291-b101-415e-82b5-85392123f965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13f3a60c5fb44b77baf860451490e501'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:05.318590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e03b63c6-1714-49e6-9fe4-1c4758b105fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ae018d6d9db438c9cd0f23f03025e91'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:05.325218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-760ba291-b101-415e-82b5-85392123f965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13f3a60c5fb44b77baf860451490e501'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:05.357356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-760ba291-b101-415e-82b5-85392123f965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13f3a60c5fb44b77baf860451490e501'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:05.358750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-760ba291-b101-415e-82b5-85392123f965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13f3a60c5fb44b77baf860451490e501'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:05.393923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e03b63c6-1714-49e6-9fe4-1c4758b105fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ae018d6d9db438c9cd0f23f03025e91'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:05.407434 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3380/6749] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:51:04 2022] DELETE /identity/v3/users/2ae018d6d9db438c9cd0f23f03025e91 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:51:05.408320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b63c6-1714-49e6-9fe4-1c4758b105fb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:05.409800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e03b63c6-1714-49e6-9fe4-1c4758b105fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:05.505245 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3370/6750] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:51:04 2022] DELETE /identity/v3/users/13f3a60c5fb44b77baf860451490e501 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:05.506314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ba291-b101-415e-82b5-85392123f965 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:05.508385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-760ba291-b101-415e-82b5-85392123f965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:05.528378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b63c6-1714-49e6-9fe4-1c4758b105fb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:05.614786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ba291-b101-415e-82b5-85392123f965 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:05.624964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255302ee-e40e-4838-95f5-451c0c70d4f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:05.624964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255302ee-e40e-4838-95f5-451c0c70d4f4 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:05.624964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255302ee-e40e-4838-95f5-451c0c70d4f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:05.624964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255302ee-e40e-4838-95f5-451c0c70d4f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:05.626897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-255302ee-e40e-4838-95f5-451c0c70d4f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:05.631026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b411bc-69c0-483d-896b-d9fac006f43b tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:05.632496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b411bc-69c0-483d-896b-d9fac006f43b tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:05.632688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b411bc-69c0-483d-896b-d9fac006f43b tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:05.632976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b411bc-69c0-483d-896b-d9fac006f43b tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/users/86a8f248bc09470c8aa4b1d75887361b` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:05.672719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b411bc-69c0-483d-896b-d9fac006f43b tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:update_user(user_id=86a8f248bc09470c8aa4b1d75887361b)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:05.673814 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-96b411bc-69c0-483d-896b-d9fac006f43b tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:51:05.673814 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:51:05.673814 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:51:05.677293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b411bc-69c0-483d-896b-d9fac006f43b tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:05.783297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255302ee-e40e-4838-95f5-451c0c70d4f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:05.784842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255302ee-e40e-4838-95f5-451c0c70d4f4 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:05.797236 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3371/6751] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:51:05.798693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7eeebf-a99d-4494-b8c8-caa9e71e5003 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:05.798983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7eeebf-a99d-4494-b8c8-caa9e71e5003 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:05.799264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7eeebf-a99d-4494-b8c8-caa9e71e5003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:05.820443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-96b411bc-69c0-483d-896b-d9fac006f43b tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '86a8f248bc09470c8aa4b1d75887361b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:05.848160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7a7eeebf-a99d-4494-b8c8-caa9e71e5003 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:05.858268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7a7eeebf-a99d-4494-b8c8-caa9e71e5003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:05.902403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-96b411bc-69c0-483d-896b-d9fac006f43b tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invalidating the token cache because user 86a8f248bc09470c8aa4b1d75887361b was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:05.902714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-96b411bc-69c0-483d-896b-d9fac006f43b tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:05.903373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-96b411bc-69c0-483d-896b-d9fac006f43b tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:05.907995 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3381/6752] 10.222.0.20 () {60 vars in 1243 bytes} [Thu Oct 27 03:51:05 2022] PATCH /identity/v3/users/86a8f248bc09470c8aa4b1d75887361b => generated 296 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:51:05.909586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94177a6-4964-49c6-9c45-52dfc82e1413 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:05.911872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94177a6-4964-49c6-9c45-52dfc82e1413 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:05.911872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94177a6-4964-49c6-9c45-52dfc82e1413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:06.002610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c94177a6-4964-49c6-9c45-52dfc82e1413 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:06.004373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c94177a6-4964-49c6-9c45-52dfc82e1413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:06.018607 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3372/6753] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:06.032129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7eeebf-a99d-4494-b8c8-caa9e71e5003 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:06.034247 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3382/6754] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:06.035737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e9b32-5801-4a32-b422-1df920f9e670 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:06.036195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e9b32-5801-4a32-b422-1df920f9e670 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:06.036633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e9b32-5801-4a32-b422-1df920f9e670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:06.045931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7a7eeebf-a99d-4494-b8c8-caa9e71e5003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:06.069072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:06.075486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7eeebf-a99d-4494-b8c8-caa9e71e5003 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:06.094312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdbc42-3ab8-4a57-aea6-3f84d45b15ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:06.096319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdbc42-3ab8-4a57-aea6-3f84d45b15ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:06.096785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdbc42-3ab8-4a57-aea6-3f84d45b15ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:06.097962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdbc42-3ab8-4a57-aea6-3f84d45b15ab admin admin] PATH_INFO: `/v3/users/f83851c79d7e4f78976b6e3ecea565d2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:06.100608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cdbc42-3ab8-4a57-aea6-3f84d45b15ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f83851c79d7e4f78976b6e3ecea565d2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:06.103168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cdbc42-3ab8-4a57-aea6-3f84d45b15ab admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:06.150897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-506e9b32-5801-4a32-b422-1df920f9e670 None None] MFA Rules not processed for user `86a8f248bc09470c8aa4b1d75887361b`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:06.153020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-506e9b32-5801-4a32-b422-1df920f9e670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:06.173562 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3383/6755] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:06 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:51:06.183847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e9b32-5801-4a32-b422-1df920f9e670 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:06.187447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-506e9b32-5801-4a32-b422-1df920f9e670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:06.273952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:06.310676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e9b32-5801-4a32-b422-1df920f9e670 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:06.317823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396860c-3fb8-451c-8a2c-39584b7bda0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:06.317823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396860c-3fb8-451c-8a2c-39584b7bda0e service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:06.317823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396860c-3fb8-451c-8a2c-39584b7bda0e service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:06.317823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396860c-3fb8-451c-8a2c-39584b7bda0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:06.329266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396860c-3fb8-451c-8a2c-39584b7bda0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:06.331091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396860c-3fb8-451c-8a2c-39584b7bda0e service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:06.346940 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3384/6756] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:51:06.347710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396860c-3fb8-451c-8a2c-39584b7bda0e service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:06.363363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396860c-3fb8-451c-8a2c-39584b7bda0e service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:06.368786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae2a4e-883a-4e8c-bbb0-4980b80398a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:06.369994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae2a4e-883a-4e8c-bbb0-4980b80398a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:06.370580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae2a4e-883a-4e8c-bbb0-4980b80398a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:06.371668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae2a4e-883a-4e8c-bbb0-4980b80398a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:06.383109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae2a4e-883a-4e8c-bbb0-4980b80398a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:06.385009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae2a4e-883a-4e8c-bbb0-4980b80398a3 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:06.389848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-84cdbc42-3ab8-4a57-aea6-3f84d45b15ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f83851c79d7e4f78976b6e3ecea565d2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:06.393937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-84cdbc42-3ab8-4a57-aea6-3f84d45b15ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f83851c79d7e4f78976b6e3ecea565d2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:06.400442 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3385/6757] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:51:06.402431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae2a4e-883a-4e8c-bbb0-4980b80398a3 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:06.405209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6fae2a4e-883a-4e8c-bbb0-4980b80398a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:06.422640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-84cdbc42-3ab8-4a57-aea6-3f84d45b15ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f83851c79d7e4f78976b6e3ecea565d2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:06.432405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae2a4e-883a-4e8c-bbb0-4980b80398a3 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:06.447021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf3b03-042f-4ab3-8873-1a1997b8c394 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:06.447686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf3b03-042f-4ab3-8873-1a1997b8c394 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:06.447975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf3b03-042f-4ab3-8873-1a1997b8c394 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:06.448332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf3b03-042f-4ab3-8873-1a1997b8c394 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/users/86a8f248bc09470c8aa4b1d75887361b` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:06.449832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf3b03-042f-4ab3-8873-1a1997b8c394 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:update_user(user_id=86a8f248bc09470c8aa4b1d75887361b)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:06.452552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf3b03-042f-4ab3-8873-1a1997b8c394 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:06.457807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-84cdbc42-3ab8-4a57-aea6-3f84d45b15ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f83851c79d7e4f78976b6e3ecea565d2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:06.461888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-84cdbc42-3ab8-4a57-aea6-3f84d45b15ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f83851c79d7e4f78976b6e3ecea565d2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:06.624921 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3373/6758] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:51:06 2022] DELETE /identity/v3/users/f83851c79d7e4f78976b6e3ecea565d2 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:06.630295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f12014-2d44-4942-9c16-f8b91590054f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:06.630493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2cdf3b03-042f-4ab3-8873-1a1997b8c394 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '86a8f248bc09470c8aa4b1d75887361b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:06.630834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f12014-2d44-4942-9c16-f8b91590054f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:06.631221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f12014-2d44-4942-9c16-f8b91590054f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:06.676825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-66f12014-2d44-4942-9c16-f8b91590054f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:06.678169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-66f12014-2d44-4942-9c16-f8b91590054f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:06.714239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2cdf3b03-042f-4ab3-8873-1a1997b8c394 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invalidating the token cache because user 86a8f248bc09470c8aa4b1d75887361b was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:06.714656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2cdf3b03-042f-4ab3-8873-1a1997b8c394 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:06.715264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2cdf3b03-042f-4ab3-8873-1a1997b8c394 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:06.729445 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3386/6759] 10.222.0.20 () {60 vars in 1243 bytes} [Thu Oct 27 03:51:06 2022] PATCH /identity/v3/users/86a8f248bc09470c8aa4b1d75887361b => generated 296 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:51:06.736284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf3b03-042f-4ab3-8873-1a1997b8c394 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:06.739695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2cdf3b03-042f-4ab3-8873-1a1997b8c394 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:06.784525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf3b03-042f-4ab3-8873-1a1997b8c394 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:06.824439 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3374/6760] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:51:06.860873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f12014-2d44-4942-9c16-f8b91590054f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:06.862737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-66f12014-2d44-4942-9c16-f8b91590054f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:07.036741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9219ea4-c9af-410e-a0fc-3262e48f8280 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:07.037399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9219ea4-c9af-410e-a0fc-3262e48f8280 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:07.037760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9219ea4-c9af-410e-a0fc-3262e48f8280 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:07.038146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9219ea4-c9af-410e-a0fc-3262e48f8280 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:07.039402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9219ea4-c9af-410e-a0fc-3262e48f8280 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:07.041721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9219ea4-c9af-410e-a0fc-3262e48f8280 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:07.051317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:07.068639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f12014-2d44-4942-9c16-f8b91590054f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:07.080805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaeb5bd-d93c-47ff-b879-832c879bbc81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:07.081979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaeb5bd-d93c-47ff-b879-832c879bbc81 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:07.083426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaeb5bd-d93c-47ff-b879-832c879bbc81 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:07.083990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaeb5bd-d93c-47ff-b879-832c879bbc81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:07.113689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaeb5bd-d93c-47ff-b879-832c879bbc81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:07.116374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaeb5bd-d93c-47ff-b879-832c879bbc81 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:07.146194 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3375/6761] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:51:07.184409 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3387/6762] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Oct 27 03:51:06 2022] POST /identity/v3/users => generated 264 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:07.185693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaeb5bd-d93c-47ff-b879-832c879bbc81 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:07.205525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaeb5bd-d93c-47ff-b879-832c879bbc81 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:07.222545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db204a1d-733c-436c-80ec-2dc42d7e197d tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:07.223420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db204a1d-733c-436c-80ec-2dc42d7e197d tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:07.224228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db204a1d-733c-436c-80ec-2dc42d7e197d tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:07.225422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db204a1d-733c-436c-80ec-2dc42d7e197d tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/users/809aff72cd4e4b798b61fd2493804a98/password` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:07.307664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9219ea4-c9af-410e-a0fc-3262e48f8280 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:07.309690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f9219ea4-c9af-410e-a0fc-3262e48f8280 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:07.343648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9219ea4-c9af-410e-a0fc-3262e48f8280 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:07.349611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1b1b4-b7b1-4126-bbaf-b81afe463e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:07.350259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1b1b4-b7b1-4126-bbaf-b81afe463e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:07.350547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1b1b4-b7b1-4126-bbaf-b81afe463e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:07.350828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1b1b4-b7b1-4126-bbaf-b81afe463e61 admin admin] PATH_INFO: `/v3/projects/1625f24abb9143a28908c57f29ff9f29` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:07.359005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1b1b4-b7b1-4126-bbaf-b81afe463e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1625f24abb9143a28908c57f29ff9f29)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:07.361128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1b1b4-b7b1-4126-bbaf-b81afe463e61 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:07.377366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-db204a1d-733c-436c-80ec-2dc42d7e197d tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '809aff72cd4e4b798b61fd2493804a98'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:07.451369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:07.483483 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3376/6763] 10.222.0.20 () {60 vars in 1269 bytes} [Thu Oct 27 03:51:07 2022] POST /identity/v3/users/809aff72cd4e4b798b61fd2493804a98/password => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:07.512083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-71e1b1b4-b7b1-4126-bbaf-b81afe463e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1625f24abb9143a28908c57f29ff9f29', 'request_id': 'req-71e1b1b4-b7b1-4126-bbaf-b81afe463e61'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:07.635163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-71e1b1b4-b7b1-4126-bbaf-b81afe463e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1625f24abb9143a28908c57f29ff9f29', 'request_id': 'req-71e1b1b4-b7b1-4126-bbaf-b81afe463e61'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:07.643896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-71e1b1b4-b7b1-4126-bbaf-b81afe463e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1625f24abb9143a28908c57f29ff9f29', 'request_id': 'req-71e1b1b4-b7b1-4126-bbaf-b81afe463e61'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:07.662466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-71e1b1b4-b7b1-4126-bbaf-b81afe463e61 admin admin] The token cache is being invalidate because project 1625f24abb9143a28908c57f29ff9f29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:07.662663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-71e1b1b4-b7b1-4126-bbaf-b81afe463e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:07.663572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-71e1b1b4-b7b1-4126-bbaf-b81afe463e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:07.671331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3375188-bc96-4009-8b49-c43925fcf613 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:07.672093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3375188-bc96-4009-8b49-c43925fcf613 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:07.672480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3375188-bc96-4009-8b49-c43925fcf613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:07.682027 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3388/6764] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:51:07 2022] DELETE /identity/v3/projects/1625f24abb9143a28908c57f29ff9f29 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:51:07.703024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1b1b4-b7b1-4126-bbaf-b81afe463e61 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:07.704628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-71e1b1b4-b7b1-4126-bbaf-b81afe463e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:07.705218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e3375188-bc96-4009-8b49-c43925fcf613 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:07.706791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e3375188-bc96-4009-8b49-c43925fcf613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:07.811985 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3377/6765] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:07.822469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff7228-299c-4aae-ad33-de1921243eca None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:07.823213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff7228-299c-4aae-ad33-de1921243eca None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:07.823592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff7228-299c-4aae-ad33-de1921243eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:07.845048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1b1b4-b7b1-4126-bbaf-b81afe463e61 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:07.855757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-48ff7228-299c-4aae-ad33-de1921243eca None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:07.857517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-48ff7228-299c-4aae-ad33-de1921243eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:07.865962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990afc3b-56fe-4ee4-96af-bccdeee684ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:07.865962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990afc3b-56fe-4ee4-96af-bccdeee684ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:07.865962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990afc3b-56fe-4ee4-96af-bccdeee684ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:07.865962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990afc3b-56fe-4ee4-96af-bccdeee684ed admin admin] PATH_INFO: `/v3/projects/77fd803cce394295853b7b1d48e47d16` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:07.869357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990afc3b-56fe-4ee4-96af-bccdeee684ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=77fd803cce394295853b7b1d48e47d16)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:07.872916 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3378/6766] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:07.876517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990afc3b-56fe-4ee4-96af-bccdeee684ed admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:07.879479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff7228-299c-4aae-ad33-de1921243eca None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:07.894550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff7228-299c-4aae-ad33-de1921243eca None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:07.903996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3aabc1-0a40-425e-8acc-9a7861fbdf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:07.904887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3aabc1-0a40-425e-8acc-9a7861fbdf95 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:07.905328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3aabc1-0a40-425e-8acc-9a7861fbdf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:07.905908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3aabc1-0a40-425e-8acc-9a7861fbdf95 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:07.907354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3aabc1-0a40-425e-8acc-9a7861fbdf95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:51:07.907852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3aabc1-0a40-425e-8acc-9a7861fbdf95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:07.909974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3aabc1-0a40-425e-8acc-9a7861fbdf95 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:07.930342 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3379/6767] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:51:07.932002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3aabc1-0a40-425e-8acc-9a7861fbdf95 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:07.943996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3aabc1-0a40-425e-8acc-9a7861fbdf95 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:07.950056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3e797-64c3-4d33-98c0-75943da59409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:07.950978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3e797-64c3-4d33-98c0-75943da59409 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:07.951520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3e797-64c3-4d33-98c0-75943da59409 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:07.951909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3e797-64c3-4d33-98c0-75943da59409 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:07.952611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d3e797-64c3-4d33-98c0-75943da59409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:07.954780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d3e797-64c3-4d33-98c0-75943da59409 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:08.108633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-990afc3b-56fe-4ee4-96af-bccdeee684ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77fd803cce394295853b7b1d48e47d16', 'request_id': 'req-990afc3b-56fe-4ee4-96af-bccdeee684ed'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:08.140008 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3380/6768] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:51:07 2022] POST /identity/v3/projects => generated 389 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:08.144039 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3e797-64c3-4d33-98c0-75943da59409 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:08.212068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-990afc3b-56fe-4ee4-96af-bccdeee684ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77fd803cce394295853b7b1d48e47d16', 'request_id': 'req-990afc3b-56fe-4ee4-96af-bccdeee684ed'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:08.222718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-990afc3b-56fe-4ee4-96af-bccdeee684ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77fd803cce394295853b7b1d48e47d16', 'request_id': 'req-990afc3b-56fe-4ee4-96af-bccdeee684ed'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:08.249970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-990afc3b-56fe-4ee4-96af-bccdeee684ed admin admin] The token cache is being invalidate because project 77fd803cce394295853b7b1d48e47d16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:08.254778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-990afc3b-56fe-4ee4-96af-bccdeee684ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:08.260904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-990afc3b-56fe-4ee4-96af-bccdeee684ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:08.266129 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3389/6769] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:51:07 2022] DELETE /identity/v3/projects/77fd803cce394295853b7b1d48e47d16 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:08.269205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990afc3b-56fe-4ee4-96af-bccdeee684ed admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:08.278497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-990afc3b-56fe-4ee4-96af-bccdeee684ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:08.305061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3e797-64c3-4d33-98c0-75943da59409 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:08.317406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e3495-107d-4612-b0bc-ab7a3e255e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:08.319659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e3495-107d-4612-b0bc-ab7a3e255e92 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:08.320203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e3495-107d-4612-b0bc-ab7a3e255e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:08.320885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e3495-107d-4612-b0bc-ab7a3e255e92 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:08.323025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e3495-107d-4612-b0bc-ab7a3e255e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:08.326625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e3495-107d-4612-b0bc-ab7a3e255e92 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:08.387440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:08.425660 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3381/6770] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:51:08 2022] POST /identity/v3/users => generated 295 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:08.427319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e3495-107d-4612-b0bc-ab7a3e255e92 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:08.431956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990afc3b-56fe-4ee4-96af-bccdeee684ed admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:08.432496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-590e3495-107d-4612-b0bc-ab7a3e255e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:08.455008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e6c1e-5942-49bd-8348-de2e05be23ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:08.457061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e6c1e-5942-49bd-8348-de2e05be23ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:08.457375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e6c1e-5942-49bd-8348-de2e05be23ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:08.457617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e6c1e-5942-49bd-8348-de2e05be23ef admin admin] PATH_INFO: `/v3/users/6e38f410b5b5410ead2ec1f95755ee62` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:08.460206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e6c1e-5942-49bd-8348-de2e05be23ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e38f410b5b5410ead2ec1f95755ee62)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:08.466268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e3495-107d-4612-b0bc-ab7a3e255e92 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:08.478084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e6c1e-5942-49bd-8348-de2e05be23ef admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:08.484138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea71935-c44b-49cf-b710-6e0931738d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:08.484338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea71935-c44b-49cf-b710-6e0931738d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:08.484750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea71935-c44b-49cf-b710-6e0931738d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:08.485476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea71935-c44b-49cf-b710-6e0931738d41 admin admin] PATH_INFO: `/v3/projects/8b62e2e983d7438ca1d5a3c63e15ac8c` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:08.490507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea71935-c44b-49cf-b710-6e0931738d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b62e2e983d7438ca1d5a3c63e15ac8c)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:08.493213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea71935-c44b-49cf-b710-6e0931738d41 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:08.714430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dd9e6c1e-5942-49bd-8348-de2e05be23ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e38f410b5b5410ead2ec1f95755ee62'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:08.715427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dd9e6c1e-5942-49bd-8348-de2e05be23ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e38f410b5b5410ead2ec1f95755ee62'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:08.717107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ea71935-c44b-49cf-b710-6e0931738d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b62e2e983d7438ca1d5a3c63e15ac8c', 'request_id': 'req-7ea71935-c44b-49cf-b710-6e0931738d41'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:08.737753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ea71935-c44b-49cf-b710-6e0931738d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b62e2e983d7438ca1d5a3c63e15ac8c', 'request_id': 'req-7ea71935-c44b-49cf-b710-6e0931738d41'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:08.742723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dd9e6c1e-5942-49bd-8348-de2e05be23ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e38f410b5b5410ead2ec1f95755ee62'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:08.752946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ea71935-c44b-49cf-b710-6e0931738d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b62e2e983d7438ca1d5a3c63e15ac8c', 'request_id': 'req-7ea71935-c44b-49cf-b710-6e0931738d41'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:08.764475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dd9e6c1e-5942-49bd-8348-de2e05be23ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e38f410b5b5410ead2ec1f95755ee62'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:08.891108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ea71935-c44b-49cf-b710-6e0931738d41 admin admin] The token cache is being invalidate because project 8b62e2e983d7438ca1d5a3c63e15ac8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:08.891472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ea71935-c44b-49cf-b710-6e0931738d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:08.892160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ea71935-c44b-49cf-b710-6e0931738d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:08.898137 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3382/6771] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:51:08 2022] DELETE /identity/v3/projects/8b62e2e983d7438ca1d5a3c63e15ac8c => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:08.898137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea71935-c44b-49cf-b710-6e0931738d41 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:08.898137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7ea71935-c44b-49cf-b710-6e0931738d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:08.988138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dd9e6c1e-5942-49bd-8348-de2e05be23ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e38f410b5b5410ead2ec1f95755ee62'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:08.998183 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3390/6772] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:51:08 2022] DELETE /identity/v3/users/6e38f410b5b5410ead2ec1f95755ee62 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:09.000275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e7ab4-e841-4b28-9733-9248d80f66b4 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:09.000819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e7ab4-e841-4b28-9733-9248d80f66b4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:09.001250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e7ab4-e841-4b28-9733-9248d80f66b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:09.002528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea71935-c44b-49cf-b710-6e0931738d41 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:09.059450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-330e7ab4-e841-4b28-9733-9248d80f66b4 None None] MFA Rules not processed for user `809aff72cd4e4b798b61fd2493804a98`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:09.063268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-330e7ab4-e841-4b28-9733-9248d80f66b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:09.074664 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3391/6773] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:08 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 03:51:09.076028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9913a25-6299-4798-9867-ec2238b9f3f9 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:09.076327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9913a25-6299-4798-9867-ec2238b9f3f9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:09.076604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9913a25-6299-4798-9867-ec2238b9f3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:09.131238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c9913a25-6299-4798-9867-ec2238b9f3f9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:09.132587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c9913a25-6299-4798-9867-ec2238b9f3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:09.135121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6abc1-7846-4037-81d0-fcd672560e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:09.142720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6abc1-7846-4037-81d0-fcd672560e76 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:09.142720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6abc1-7846-4037-81d0-fcd672560e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:09.142720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6abc1-7846-4037-81d0-fcd672560e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:09.142720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6abc1-7846-4037-81d0-fcd672560e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:09.142720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6abc1-7846-4037-81d0-fcd672560e76 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:09.152885 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3392/6774] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:09.153861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9913a25-6299-4798-9867-ec2238b9f3f9 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:09.156055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c9913a25-6299-4798-9867-ec2238b9f3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:09.198237 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3383/6775] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:09.203791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d97e7-1bd9-4e23-a5e6-c01251d320a4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:09.204053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d97e7-1bd9-4e23-a5e6-c01251d320a4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:09.204450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d97e7-1bd9-4e23-a5e6-c01251d320a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:09.241617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-bb4d97e7-1bd9-4e23-a5e6-c01251d320a4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:09.243975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bb4d97e7-1bd9-4e23-a5e6-c01251d320a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:09.255144 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3384/6776] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:09.256331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d97e7-1bd9-4e23-a5e6-c01251d320a4 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:09.272854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d97e7-1bd9-4e23-a5e6-c01251d320a4 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:09.280671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11efe8-8ca3-4ac2-8df9-7e9092bdf1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:09.284873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11efe8-8ca3-4ac2-8df9-7e9092bdf1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:09.284873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11efe8-8ca3-4ac2-8df9-7e9092bdf1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:09.284873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11efe8-8ca3-4ac2-8df9-7e9092bdf1a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:09.284873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11efe8-8ca3-4ac2-8df9-7e9092bdf1a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:09.285514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11efe8-8ca3-4ac2-8df9-7e9092bdf1a2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:09.298477 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3385/6777] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:09.299613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11efe8-8ca3-4ac2-8df9-7e9092bdf1a2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:09.313612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11efe8-8ca3-4ac2-8df9-7e9092bdf1a2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:09.319125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb4531-bd71-42a6-a9f1-7544068a7b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:09.321649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb4531-bd71-42a6-a9f1-7544068a7b2f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:09.322431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb4531-bd71-42a6-a9f1-7544068a7b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:09.322892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb4531-bd71-42a6-a9f1-7544068a7b2f admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:09.324350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb4531-bd71-42a6-a9f1-7544068a7b2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:51:09.324828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb4531-bd71-42a6-a9f1-7544068a7b2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:09.327116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb4531-bd71-42a6-a9f1-7544068a7b2f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:09.339054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:09.350427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9913a25-6299-4798-9867-ec2238b9f3f9 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:09.352165 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3386/6778] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:51:09.353570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb4531-bd71-42a6-a9f1-7544068a7b2f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:09.364797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986dd265-8403-41c9-bfe1-5a336fc099a5 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:09.365678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986dd265-8403-41c9-bfe1-5a336fc099a5 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:09.366156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986dd265-8403-41c9-bfe1-5a336fc099a5 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:09.366935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986dd265-8403-41c9-bfe1-5a336fc099a5 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:09.376435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb4531-bd71-42a6-a9f1-7544068a7b2f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:09.382859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986dd265-8403-41c9-bfe1-5a336fc099a5 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:09.389539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986dd265-8403-41c9-bfe1-5a336fc099a5 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:09.392237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a1abe-595c-4a46-90ed-549a6527f699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:09.394189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a1abe-595c-4a46-90ed-549a6527f699 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:09.395604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a1abe-595c-4a46-90ed-549a6527f699 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:09.396058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a1abe-595c-4a46-90ed-549a6527f699 admin admin] PATH_INFO: `/v3/projects/eabde01787854fdbaedc472b9d79bffa/users/8d00d79ff91e4b419a09b0b65d5d425e/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:09.403535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:09.417209 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3393/6779] 10.222.0.20 () {56 vars in 1263 bytes} [Thu Oct 27 03:51:09 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 03:51:09.418444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986dd265-8403-41c9-bfe1-5a336fc099a5 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:09.437971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a1abe-595c-4a46-90ed-549a6527f699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eabde01787854fdbaedc472b9d79bffa, user_id=8d00d79ff91e4b419a09b0b65d5d425e, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:09.441348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986dd265-8403-41c9-bfe1-5a336fc099a5 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:09.445248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a1abe-595c-4a46-90ed-549a6527f699 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:09.458387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56a0e9-d354-4570-967a-7795c08f4c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:09.459020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56a0e9-d354-4570-967a-7795c08f4c90 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:09.459300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56a0e9-d354-4570-967a-7795c08f4c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:09.459574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56a0e9-d354-4570-967a-7795c08f4c90 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:09.460213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56a0e9-d354-4570-967a-7795c08f4c90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:09.463172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56a0e9-d354-4570-967a-7795c08f4c90 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:09.535274 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3387/6780] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:51:09 2022] PUT /identity/v3/projects/eabde01787854fdbaedc472b9d79bffa/users/8d00d79ff91e4b419a09b0b65d5d425e/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:09.536583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a1abe-595c-4a46-90ed-549a6527f699 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:09.574962 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3394/6781] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:51:09 2022] POST /identity/v3/projects => generated 367 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:09.579643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a55271-f8de-44b1-8217-21d3b153c5b9 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:09.580130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a55271-f8de-44b1-8217-21d3b153c5b9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:09.582362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a55271-f8de-44b1-8217-21d3b153c5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:09.649885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a1abe-595c-4a46-90ed-549a6527f699 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:09.686153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b6a55271-f8de-44b1-8217-21d3b153c5b9 None None] MFA Rules not processed for user `8d00d79ff91e4b419a09b0b65d5d425e`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:09.688690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b6a55271-f8de-44b1-8217-21d3b153c5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:09.803548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a2973-8dc4-41ba-afc0-b8895da06057 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:09.804919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a2973-8dc4-41ba-afc0-b8895da06057 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:09.805368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a2973-8dc4-41ba-afc0-b8895da06057 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:09.805752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a2973-8dc4-41ba-afc0-b8895da06057 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/users/809aff72cd4e4b798b61fd2493804a98` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:09.807232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a2973-8dc4-41ba-afc0-b8895da06057 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:delete_user(user_id=809aff72cd4e4b798b61fd2493804a98)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:09.809537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a2973-8dc4-41ba-afc0-b8895da06057 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:09.908988 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3395/6782] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:09.909567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a55271-f8de-44b1-8217-21d3b153c5b9 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:09.971952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-299a2973-8dc4-41ba-afc0-b8895da06057 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '809aff72cd4e4b798b61fd2493804a98'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:09.972763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-299a2973-8dc4-41ba-afc0-b8895da06057 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '809aff72cd4e4b798b61fd2493804a98'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:09.992670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-299a2973-8dc4-41ba-afc0-b8895da06057 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '809aff72cd4e4b798b61fd2493804a98'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:10.028937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-299a2973-8dc4-41ba-afc0-b8895da06057 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '809aff72cd4e4b798b61fd2493804a98'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:10.029732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-299a2973-8dc4-41ba-afc0-b8895da06057 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '809aff72cd4e4b798b61fd2493804a98'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:10.113865 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3388/6783] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:51:09 2022] DELETE /identity/v3/users/809aff72cd4e4b798b61fd2493804a98 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:10.114298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:10.115320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a2973-8dc4-41ba-afc0-b8895da06057 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:10.124159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-299a2973-8dc4-41ba-afc0-b8895da06057 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:10.159331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a55271-f8de-44b1-8217-21d3b153c5b9 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:10.329536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a2973-8dc4-41ba-afc0-b8895da06057 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:10.339923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbaece1-569e-4f4e-88b6-df292c897e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:10.340989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaece1-569e-4f4e-88b6-df292c897e25 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:10.341378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaece1-569e-4f4e-88b6-df292c897e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:10.341945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaece1-569e-4f4e-88b6-df292c897e25 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:10.343046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbaece1-569e-4f4e-88b6-df292c897e25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:10.343496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51766ea-0efe-4573-a4c3-4300009af24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:10.344818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51766ea-0efe-4573-a4c3-4300009af24a admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:10.345425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbaece1-569e-4f4e-88b6-df292c897e25 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:10.347867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51766ea-0efe-4573-a4c3-4300009af24a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:10.348565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51766ea-0efe-4573-a4c3-4300009af24a admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:10.349395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51766ea-0efe-4573-a4c3-4300009af24a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:10.357186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51766ea-0efe-4573-a4c3-4300009af24a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:10.370257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:10.443599 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3396/6784] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:51:09 2022] POST /identity/v3/users => generated 284 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:10.445543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbaece1-569e-4f4e-88b6-df292c897e25 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:10.452326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fbbaece1-569e-4f4e-88b6-df292c897e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:10.515471 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3389/6785] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:51:10 2022] POST /identity/v3/projects => generated 389 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:10.519105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51766ea-0efe-4573-a4c3-4300009af24a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:10.527173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b51766ea-0efe-4573-a4c3-4300009af24a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:10.613392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbaece1-569e-4f4e-88b6-df292c897e25 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:10.719633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51766ea-0efe-4573-a4c3-4300009af24a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:10.726271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a60f10-adaf-4658-bede-3ce09fcf78e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:10.727207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a60f10-adaf-4658-bede-3ce09fcf78e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:10.727901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a60f10-adaf-4658-bede-3ce09fcf78e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:10.728441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a60f10-adaf-4658-bede-3ce09fcf78e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:10.729761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233f2f1-4090-4805-ae1c-196506e71729 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:10.729944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a60f10-adaf-4658-bede-3ce09fcf78e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:10.730417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233f2f1-4090-4805-ae1c-196506e71729 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:10.730701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233f2f1-4090-4805-ae1c-196506e71729 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:10.730980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233f2f1-4090-4805-ae1c-196506e71729 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:10.732094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a60f10-adaf-4658-bede-3ce09fcf78e3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:10.733832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233f2f1-4090-4805-ae1c-196506e71729 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:10.738627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233f2f1-4090-4805-ae1c-196506e71729 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:10.755518 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3390/6786] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:10.756532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a60f10-adaf-4658-bede-3ce09fcf78e3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:10.782696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a60f10-adaf-4658-bede-3ce09fcf78e3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:10.796320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cb813-0a8b-41af-99f2-bcd4788e9edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:10.798079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cb813-0a8b-41af-99f2-bcd4788e9edd admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:10.798079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cb813-0a8b-41af-99f2-bcd4788e9edd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:10.798079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cb813-0a8b-41af-99f2-bcd4788e9edd admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:10.798386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730cb813-0a8b-41af-99f2-bcd4788e9edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:10.806871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730cb813-0a8b-41af-99f2-bcd4788e9edd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:10.820190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:10.856835 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3397/6787] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:51:10 2022] POST /identity/v3/users => generated 364 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:10.858412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233f2f1-4090-4805-ae1c-196506e71729 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:10.874664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:10.889479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233f2f1-4090-4805-ae1c-196506e71729 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:10.898640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80ffcf-94e9-4a21-a42f-52a7fe0d9867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:10.899289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80ffcf-94e9-4a21-a42f-52a7fe0d9867 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:10.899571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80ffcf-94e9-4a21-a42f-52a7fe0d9867 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:10.899825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80ffcf-94e9-4a21-a42f-52a7fe0d9867 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:10.900497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80ffcf-94e9-4a21-a42f-52a7fe0d9867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:10.902381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80ffcf-94e9-4a21-a42f-52a7fe0d9867 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:10.934817 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3398/6788] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:10.934817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80ffcf-94e9-4a21-a42f-52a7fe0d9867 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:10.963860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80ffcf-94e9-4a21-a42f-52a7fe0d9867 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:10.965996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1536f-da29-4655-86b2-a878d2427a1c tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:10.966869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1536f-da29-4655-86b2-a878d2427a1c tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:10.967348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1536f-da29-4655-86b2-a878d2427a1c tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:10.967858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1536f-da29-4655-86b2-a878d2427a1c tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:10.968670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1536f-da29-4655-86b2-a878d2427a1c tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:10.972224 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3391/6789] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:51:10 2022] POST /identity/v3/users => generated 301 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:10.972224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cb813-0a8b-41af-99f2-bcd4788e9edd admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:10.974726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1536f-da29-4655-86b2-a878d2427a1c tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:10.991983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cb813-0a8b-41af-99f2-bcd4788e9edd admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:11.005850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ff7cc-21ef-45c3-93c1-57898256ccb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:11.006557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ff7cc-21ef-45c3-93c1-57898256ccb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:11.006902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ff7cc-21ef-45c3-93c1-57898256ccb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:11.007192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ff7cc-21ef-45c3-93c1-57898256ccb4 admin admin] PATH_INFO: `/v3/projects/ba902eecffdc4d849b377b79e6c71079/users/1ed17cf2e6ed4874a68fce1bf1be6efb/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:11.030298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ff7cc-21ef-45c3-93c1-57898256ccb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba902eecffdc4d849b377b79e6c71079, user_id=1ed17cf2e6ed4874a68fce1bf1be6efb, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:11.040632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ff7cc-21ef-45c3-93c1-57898256ccb4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:11.140621 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3399/6790] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:51:10 2022] POST /identity/v3/projects => generated 359 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:11.143029 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1536f-da29-4655-86b2-a878d2427a1c tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:11.148946 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3392/6791] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:51:10 2022] PUT /identity/v3/projects/ba902eecffdc4d849b377b79e6c71079/users/1ed17cf2e6ed4874a68fce1bf1be6efb/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:11.150654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ff7cc-21ef-45c3-93c1-57898256ccb4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:11.319563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1536f-da29-4655-86b2-a878d2427a1c tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:11.337897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ff7cc-21ef-45c3-93c1-57898256ccb4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:11.350655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6958e70-a064-46c3-a2f2-557b0a3de9e0 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:11.351885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6958e70-a064-46c3-a2f2-557b0a3de9e0 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:11.352175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6958e70-a064-46c3-a2f2-557b0a3de9e0 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:11.352460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6958e70-a064-46c3-a2f2-557b0a3de9e0 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/users/218d07e553fd4fd7a7cb4fab50648459` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:11.382179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6958e70-a064-46c3-a2f2-557b0a3de9e0 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:update_user(user_id=218d07e553fd4fd7a7cb4fab50648459)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:11.384205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6958e70-a064-46c3-a2f2-557b0a3de9e0 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:11.440093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:11.486151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425cc0c-c72e-4db4-90cd-a9e1842a03a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:11.487555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425cc0c-c72e-4db4-90cd-a9e1842a03a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:11.488006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425cc0c-c72e-4db4-90cd-a9e1842a03a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:11.488620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425cc0c-c72e-4db4-90cd-a9e1842a03a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:11.490084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425cc0c-c72e-4db4-90cd-a9e1842a03a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:11.495358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425cc0c-c72e-4db4-90cd-a9e1842a03a3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:11.508453 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3400/6792] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:11.510155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a34cd9-7e47-4ff2-8d65-065e5a40f5ac None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:11.511364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a34cd9-7e47-4ff2-8d65-065e5a40f5ac None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:11.512318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a34cd9-7e47-4ff2-8d65-065e5a40f5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:11.550727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a7a34cd9-7e47-4ff2-8d65-065e5a40f5ac None None] MFA Rules not processed for user `1ed17cf2e6ed4874a68fce1bf1be6efb`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:11.553000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a7a34cd9-7e47-4ff2-8d65-065e5a40f5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:11.591003 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3393/6793] 10.222.0.20 () {60 vars in 1244 bytes} [Thu Oct 27 03:51:11 2022] PATCH /identity/v3/users/218d07e553fd4fd7a7cb4fab50648459 => generated 524 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:51:11.593106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6958e70-a064-46c3-a2f2-557b0a3de9e0 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:11.602496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f6958e70-a064-46c3-a2f2-557b0a3de9e0 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:11.653475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:11.659866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6958e70-a064-46c3-a2f2-557b0a3de9e0 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:11.674519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63441d83-a987-419c-8e3b-6f06be52da0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:11.675296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63441d83-a987-419c-8e3b-6f06be52da0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:11.675587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63441d83-a987-419c-8e3b-6f06be52da0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:11.675909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63441d83-a987-419c-8e3b-6f06be52da0b admin admin] PATH_INFO: `/v3/projects/d56d483218be4f9aae67bf893b1d71df` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:11.680057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63441d83-a987-419c-8e3b-6f06be52da0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d56d483218be4f9aae67bf893b1d71df)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:11.683517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63441d83-a987-419c-8e3b-6f06be52da0b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:11.725411 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3401/6794] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:11.730576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a34cd9-7e47-4ff2-8d65-065e5a40f5ac None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:11.750965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a34cd9-7e47-4ff2-8d65-065e5a40f5ac None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:11.756612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d75f0-4554-4634-a726-2141e63e0c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:11.758140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d75f0-4554-4634-a726-2141e63e0c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:11.758534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d75f0-4554-4634-a726-2141e63e0c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:11.759051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d75f0-4554-4634-a726-2141e63e0c19 admin admin] PATH_INFO: `/v3/projects/32a143401f474a72a78e3df3077cf8b7/users/89cbc027dfbf4bb0a598350fda52d724/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:11.781268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d75f0-4554-4634-a726-2141e63e0c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a143401f474a72a78e3df3077cf8b7, user_id=89cbc027dfbf4bb0a598350fda52d724, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:11.784257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d75f0-4554-4634-a726-2141e63e0c19 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:11.857678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:11.871078 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3402/6795] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:51:11 2022] PUT /identity/v3/projects/32a143401f474a72a78e3df3077cf8b7/users/89cbc027dfbf4bb0a598350fda52d724/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:11.871078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d75f0-4554-4634-a726-2141e63e0c19 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:11.898650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-63441d83-a987-419c-8e3b-6f06be52da0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd56d483218be4f9aae67bf893b1d71df', 'request_id': 'req-63441d83-a987-419c-8e3b-6f06be52da0b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:11.911780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-63441d83-a987-419c-8e3b-6f06be52da0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd56d483218be4f9aae67bf893b1d71df', 'request_id': 'req-63441d83-a987-419c-8e3b-6f06be52da0b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:11.921086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-63441d83-a987-419c-8e3b-6f06be52da0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd56d483218be4f9aae67bf893b1d71df', 'request_id': 'req-63441d83-a987-419c-8e3b-6f06be52da0b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:11.970392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d75f0-4554-4634-a726-2141e63e0c19 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:12.052725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-63441d83-a987-419c-8e3b-6f06be52da0b admin admin] The token cache is being invalidate because project d56d483218be4f9aae67bf893b1d71df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:12.053397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-63441d83-a987-419c-8e3b-6f06be52da0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:12.054814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-63441d83-a987-419c-8e3b-6f06be52da0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:12.057580 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3394/6796] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:51:11 2022] DELETE /identity/v3/projects/d56d483218be4f9aae67bf893b1d71df => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:12.059712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63441d83-a987-419c-8e3b-6f06be52da0b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:12.062496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-63441d83-a987-419c-8e3b-6f06be52da0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:12.071929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587606e7-53a3-4b83-846c-26f513f2ef7a tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:12.073823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587606e7-53a3-4b83-846c-26f513f2ef7a tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:12.074177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587606e7-53a3-4b83-846c-26f513f2ef7a tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:12.074468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587606e7-53a3-4b83-846c-26f513f2ef7a tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/users/218d07e553fd4fd7a7cb4fab50648459` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:12.102021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587606e7-53a3-4b83-846c-26f513f2ef7a tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:get_user(user_id=218d07e553fd4fd7a7cb4fab50648459)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:12.107431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587606e7-53a3-4b83-846c-26f513f2ef7a tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:12.113471 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3403/6797] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 03:51:11 2022] GET /identity/v3/users/218d07e553fd4fd7a7cb4fab50648459 => generated 390 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:51:12.114503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587606e7-53a3-4b83-846c-26f513f2ef7a tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:12.121583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-587606e7-53a3-4b83-846c-26f513f2ef7a tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:12.203454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63441d83-a987-419c-8e3b-6f06be52da0b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:12.217919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:12.233063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6648652-bfda-4f6c-9973-f9e1969ac12b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:12.233661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6648652-bfda-4f6c-9973-f9e1969ac12b service glance] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:12.233952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6648652-bfda-4f6c-9973-f9e1969ac12b service glance] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:12.234299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6648652-bfda-4f6c-9973-f9e1969ac12b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:12.236497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d6648652-bfda-4f6c-9973-f9e1969ac12b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:12.268923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587606e7-53a3-4b83-846c-26f513f2ef7a tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:12.279122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd09bfe-0881-42dc-873b-fa938fed1ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:12.280809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd09bfe-0881-42dc-873b-fa938fed1ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:12.281964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd09bfe-0881-42dc-873b-fa938fed1ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:12.284057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd09bfe-0881-42dc-873b-fa938fed1ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:12.285469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd09bfe-0881-42dc-873b-fa938fed1ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:12.287862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd09bfe-0881-42dc-873b-fa938fed1ba1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:12.302005 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3404/6798] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:12.303429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c9ba8-ea5e-48c3-b350-c1ebadec4a7a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:12.303824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c9ba8-ea5e-48c3-b350-c1ebadec4a7a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:12.304359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c9ba8-ea5e-48c3-b350-c1ebadec4a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:12.327456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-511c9ba8-ea5e-48c3-b350-c1ebadec4a7a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:12.328974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-511c9ba8-ea5e-48c3-b350-c1ebadec4a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:12.341596 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3405/6799] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:12.342696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c9ba8-ea5e-48c3-b350-c1ebadec4a7a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:12.344562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-511c9ba8-ea5e-48c3-b350-c1ebadec4a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:12.372846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c9ba8-ea5e-48c3-b350-c1ebadec4a7a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:12.381921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da91bee-5fb7-4860-836f-a3d6184c8ae4 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:12.385910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da91bee-5fb7-4860-836f-a3d6184c8ae4 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:12.386234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da91bee-5fb7-4860-836f-a3d6184c8ae4 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:12.386520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da91bee-5fb7-4860-836f-a3d6184c8ae4 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/projects/3cb4716846c2426c958d99c1af76d582` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:12.390108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da91bee-5fb7-4860-836f-a3d6184c8ae4 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3cb4716846c2426c958d99c1af76d582)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:12.398575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da91bee-5fb7-4860-836f-a3d6184c8ae4 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:12.399943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6648652-bfda-4f6c-9973-f9e1969ac12b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:12.401610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6648652-bfda-4f6c-9973-f9e1969ac12b service glance] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:12.412559 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3395/6800] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:51:12.413531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6648652-bfda-4f6c-9973-f9e1969ac12b service glance] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:12.443738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6648652-bfda-4f6c-9973-f9e1969ac12b service glance] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:12.453203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19346b-fe3c-4a3b-a345-92f09a6160af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:12.454636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19346b-fe3c-4a3b-a345-92f09a6160af admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:12.454936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19346b-fe3c-4a3b-a345-92f09a6160af admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:12.455224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19346b-fe3c-4a3b-a345-92f09a6160af admin admin] PATH_INFO: `/v3/projects/32a143401f474a72a78e3df3077cf8b7/users/89cbc027dfbf4bb0a598350fda52d724/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:12.457843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19346b-fe3c-4a3b-a345-92f09a6160af admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a143401f474a72a78e3df3077cf8b7, user_id=89cbc027dfbf4bb0a598350fda52d724, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:12.462832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19346b-fe3c-4a3b-a345-92f09a6160af admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:12.482460 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3396/6801] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:51:12 2022] PUT /identity/v3/projects/32a143401f474a72a78e3df3077cf8b7/users/89cbc027dfbf4bb0a598350fda52d724/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:12.484631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a68f20-58ec-489c-b792-6f6167c23288 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:12.485141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a68f20-58ec-489c-b792-6f6167c23288 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:12.485564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a68f20-58ec-489c-b792-6f6167c23288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:12.524487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-31a68f20-58ec-489c-b792-6f6167c23288 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:12.525896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-31a68f20-58ec-489c-b792-6f6167c23288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:12.632749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1da91bee-5fb7-4860-836f-a3d6184c8ae4 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb4716846c2426c958d99c1af76d582', 'request_id': 'req-1da91bee-5fb7-4860-836f-a3d6184c8ae4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:12.651441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:12.654749 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3397/6802] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:12.654749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429294a-9248-477a-afc1-78c7b0cc7cea None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:12.655632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429294a-9248-477a-afc1-78c7b0cc7cea None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:12.656656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429294a-9248-477a-afc1-78c7b0cc7cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:12.702699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1da91bee-5fb7-4860-836f-a3d6184c8ae4 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb4716846c2426c958d99c1af76d582', 'request_id': 'req-1da91bee-5fb7-4860-836f-a3d6184c8ae4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:12.717435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1da91bee-5fb7-4860-836f-a3d6184c8ae4 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb4716846c2426c958d99c1af76d582', 'request_id': 'req-1da91bee-5fb7-4860-836f-a3d6184c8ae4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:12.733974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d429294a-9248-477a-afc1-78c7b0cc7cea None None] MFA Rules not processed for user `89cbc027dfbf4bb0a598350fda52d724`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:12.736782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d429294a-9248-477a-afc1-78c7b0cc7cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:12.738799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1da91bee-5fb7-4860-836f-a3d6184c8ae4 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] The token cache is being invalidate because project 3cb4716846c2426c958d99c1af76d582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:12.739101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1da91bee-5fb7-4860-836f-a3d6184c8ae4 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:12.740747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1da91bee-5fb7-4860-836f-a3d6184c8ae4 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:12.749159 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3406/6803] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:51:12 2022] DELETE /identity/v3/projects/3cb4716846c2426c958d99c1af76d582 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:12.750164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da91bee-5fb7-4860-836f-a3d6184c8ae4 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:12.753129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1da91bee-5fb7-4860-836f-a3d6184c8ae4 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:12.909590 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3398/6804] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:12 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:12.910527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429294a-9248-477a-afc1-78c7b0cc7cea None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:12.923202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da91bee-5fb7-4860-836f-a3d6184c8ae4 tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:12.926470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d429294a-9248-477a-afc1-78c7b0cc7cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:12.940535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23188b-937d-4d6a-a321-ad00dc2b7d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:12.941173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23188b-937d-4d6a-a321-ad00dc2b7d6a admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:12.941460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23188b-937d-4d6a-a321-ad00dc2b7d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:12.941739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23188b-937d-4d6a-a321-ad00dc2b7d6a admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:12.942441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23188b-937d-4d6a-a321-ad00dc2b7d6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:51:12.942755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23188b-937d-4d6a-a321-ad00dc2b7d6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:12.949052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23188b-937d-4d6a-a321-ad00dc2b7d6a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:12.981228 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3407/6805] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:51:12.982664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23188b-937d-4d6a-a321-ad00dc2b7d6a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:12.993210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3b23188b-937d-4d6a-a321-ad00dc2b7d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:13.057866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:13.144303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23188b-937d-4d6a-a321-ad00dc2b7d6a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:13.401254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06d937-0783-4a3a-b812-12d1f65fe958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:13.401254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06d937-0783-4a3a-b812-12d1f65fe958 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:13.401254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06d937-0783-4a3a-b812-12d1f65fe958 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:13.401254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06d937-0783-4a3a-b812-12d1f65fe958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:13.402691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bd06d937-0783-4a3a-b812-12d1f65fe958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:13.402971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429294a-9248-477a-afc1-78c7b0cc7cea None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:13.402971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e29e7b-a039-482b-a082-1419d82b701e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7d7c6b46ed47b0a5c989fefe215061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:13.402971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e29e7b-a039-482b-a082-1419d82b701e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:13.403568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e29e7b-a039-482b-a082-1419d82b701e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:13.403568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e29e7b-a039-482b-a082-1419d82b701e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] PATH_INFO: `/v3/users/218d07e553fd4fd7a7cb4fab50648459` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:13.403568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e29e7b-a039-482b-a082-1419d82b701e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorizing `identity:delete_user(user_id=218d07e553fd4fd7a7cb4fab50648459)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:13.403568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e29e7b-a039-482b-a082-1419d82b701e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:13.403891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06d937-0783-4a3a-b812-12d1f65fe958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:13.403891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06d937-0783-4a3a-b812-12d1f65fe958 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:13.403891 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3408/6806] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:12 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:51:13.403891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06d937-0783-4a3a-b812-12d1f65fe958 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:13.403891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06d937-0783-4a3a-b812-12d1f65fe958 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:13.404279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2903db-0584-427a-9a4e-eb159c894fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:13.404279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2903db-0584-427a-9a4e-eb159c894fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:13.404279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2903db-0584-427a-9a4e-eb159c894fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:13.404279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2903db-0584-427a-9a4e-eb159c894fd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:13.404604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2903db-0584-427a-9a4e-eb159c894fd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:13.404604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2903db-0584-427a-9a4e-eb159c894fd3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:13.597264 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3409/6807] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:51:13 2022] POST /identity/v3/projects => generated 363 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:13.597836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2903db-0584-427a-9a4e-eb159c894fd3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:13.632534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-74e29e7b-a039-482b-a082-1419d82b701e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '218d07e553fd4fd7a7cb4fab50648459'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:13.633308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-74e29e7b-a039-482b-a082-1419d82b701e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '218d07e553fd4fd7a7cb4fab50648459'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:13.658533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-74e29e7b-a039-482b-a082-1419d82b701e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '218d07e553fd4fd7a7cb4fab50648459'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:13.682178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-74e29e7b-a039-482b-a082-1419d82b701e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '218d07e553fd4fd7a7cb4fab50648459'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:13.685138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-74e29e7b-a039-482b-a082-1419d82b701e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '218d07e553fd4fd7a7cb4fab50648459'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:13.741344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2903db-0584-427a-9a4e-eb159c894fd3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:13.749861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b1c9a-a257-4b51-9e81-02031ced84e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:13.751132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b1c9a-a257-4b51-9e81-02031ced84e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:13.751906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b1c9a-a257-4b51-9e81-02031ced84e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:13.752397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b1c9a-a257-4b51-9e81-02031ced84e0 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:13.753210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b1c9a-a257-4b51-9e81-02031ced84e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:13.756298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b1c9a-a257-4b51-9e81-02031ced84e0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:13.785744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:13.796934 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3399/6808] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:51:12 2022] DELETE /identity/v3/users/218d07e553fd4fd7a7cb4fab50648459 => generated 0 bytes in 887 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:13.802575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e29e7b-a039-482b-a082-1419d82b701e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:13.805214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-74e29e7b-a039-482b-a082-1419d82b701e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:13.837015 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3410/6809] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:51:13 2022] POST /identity/v3/users => generated 282 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:13.841553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b1c9a-a257-4b51-9e81-02031ced84e0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:13.845798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f34b1c9a-a257-4b51-9e81-02031ced84e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:13.870273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b1c9a-a257-4b51-9e81-02031ced84e0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:13.985900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e29e7b-a039-482b-a082-1419d82b701e tempest-UsersV3TestJSON-235958580 tempest-UsersV3TestJSON-235958580-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:13.995437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a452c-07d4-40e1-81a8-6e20def1485a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:13.997151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a452c-07d4-40e1-81a8-6e20def1485a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:13.997980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a452c-07d4-40e1-81a8-6e20def1485a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:13.998617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a452c-07d4-40e1-81a8-6e20def1485a admin admin] PATH_INFO: `/v3/users/86a8f248bc09470c8aa4b1d75887361b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:14.000192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f420b53-d100-408b-bcc8-3712f71c12dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:14.000916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f420b53-d100-408b-bcc8-3712f71c12dc admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:14.001300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f420b53-d100-408b-bcc8-3712f71c12dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:14.002275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f420b53-d100-408b-bcc8-3712f71c12dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:14.004646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f420b53-d100-408b-bcc8-3712f71c12dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:14.008214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f420b53-d100-408b-bcc8-3712f71c12dc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:14.025524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a452c-07d4-40e1-81a8-6e20def1485a admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a8f248bc09470c8aa4b1d75887361b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:14.027937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a452c-07d4-40e1-81a8-6e20def1485a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:14.032090 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3411/6810] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:51:14.033157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f420b53-d100-408b-bcc8-3712f71c12dc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:14.046306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f420b53-d100-408b-bcc8-3712f71c12dc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:14.052231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b263e2b-9c19-44ec-b24d-a87dc209d031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:14.053079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b263e2b-9c19-44ec-b24d-a87dc209d031 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:14.053540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b263e2b-9c19-44ec-b24d-a87dc209d031 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:14.053815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b263e2b-9c19-44ec-b24d-a87dc209d031 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:14.055146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b263e2b-9c19-44ec-b24d-a87dc209d031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:14.056783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b263e2b-9c19-44ec-b24d-a87dc209d031 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:14.090381 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3412/6811] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:14.103038 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b263e2b-9c19-44ec-b24d-a87dc209d031 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:14.146663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b263e2b-9c19-44ec-b24d-a87dc209d031 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:14.164520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151eae6-7505-40cc-b4be-98e15108a779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:14.165617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151eae6-7505-40cc-b4be-98e15108a779 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:14.167990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151eae6-7505-40cc-b4be-98e15108a779 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:14.169918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151eae6-7505-40cc-b4be-98e15108a779 admin admin] PATH_INFO: `/v3/projects/b1820ce35f6242a297e4fe6f812186a4/users/8a7d854e8f1040dca381840135ddbcdc/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:14.228646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151eae6-7505-40cc-b4be-98e15108a779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1820ce35f6242a297e4fe6f812186a4, user_id=8a7d854e8f1040dca381840135ddbcdc, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:14.235634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151eae6-7505-40cc-b4be-98e15108a779 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:14.302274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4d1a452c-07d4-40e1-81a8-6e20def1485a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a8f248bc09470c8aa4b1d75887361b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:14.304820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4d1a452c-07d4-40e1-81a8-6e20def1485a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a8f248bc09470c8aa4b1d75887361b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:14.333286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4d1a452c-07d4-40e1-81a8-6e20def1485a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a8f248bc09470c8aa4b1d75887361b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:14.363186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4d1a452c-07d4-40e1-81a8-6e20def1485a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a8f248bc09470c8aa4b1d75887361b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:14.364123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4d1a452c-07d4-40e1-81a8-6e20def1485a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a8f248bc09470c8aa4b1d75887361b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:14.370129 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3413/6812] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:51:14 2022] PUT /identity/v3/projects/b1820ce35f6242a297e4fe6f812186a4/users/8a7d854e8f1040dca381840135ddbcdc/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:14.384409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4dbd4-04b2-456b-873e-8afb215aa308 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:14.384761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4dbd4-04b2-456b-873e-8afb215aa308 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:14.385098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4dbd4-04b2-456b-873e-8afb215aa308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:14.441877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e8b4dbd4-04b2-456b-873e-8afb215aa308 None None] MFA Rules not processed for user `8a7d854e8f1040dca381840135ddbcdc`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:14.445782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e8b4dbd4-04b2-456b-873e-8afb215aa308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:14.482296 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3400/6813] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:51:13 2022] DELETE /identity/v3/users/86a8f248bc09470c8aa4b1d75887361b => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:51:14.486085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fe267-15f4-4dea-9e97-c8fa2d437547 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:14.486389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fe267-15f4-4dea-9e97-c8fa2d437547 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:14.486668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fe267-15f4-4dea-9e97-c8fa2d437547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:14.576238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1a5fe267-15f4-4dea-9e97-c8fa2d437547 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:14.583424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1a5fe267-15f4-4dea-9e97-c8fa2d437547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:14.622699 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3414/6814] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:14.631747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4dbd4-04b2-456b-873e-8afb215aa308 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:14.634689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e8b4dbd4-04b2-456b-873e-8afb215aa308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:14.730794 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3401/6815] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:51:14.750402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4dbd4-04b2-456b-873e-8afb215aa308 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:14.817775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fe267-15f4-4dea-9e97-c8fa2d437547 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:14.821002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1a5fe267-15f4-4dea-9e97-c8fa2d437547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:14.899163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc021ee-55f4-4f60-9897-d1707fb26726 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:14.900331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc021ee-55f4-4f60-9897-d1707fb26726 service glance] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:14.900814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc021ee-55f4-4f60-9897-d1707fb26726 service glance] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:14.901258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc021ee-55f4-4f60-9897-d1707fb26726 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:14.937653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:14.951482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fe267-15f4-4dea-9e97-c8fa2d437547 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:14.961249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949af47-8376-4135-a3ae-605c48536787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:14.962058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949af47-8376-4135-a3ae-605c48536787 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:14.962431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949af47-8376-4135-a3ae-605c48536787 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:14.962837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949af47-8376-4135-a3ae-605c48536787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:14.985885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949af47-8376-4135-a3ae-605c48536787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:14.990079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949af47-8376-4135-a3ae-605c48536787 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:15.022674 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3402/6816] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:51:15.046308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:15.098803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc021ee-55f4-4f60-9897-d1707fb26726 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:15.107238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc021ee-55f4-4f60-9897-d1707fb26726 service glance] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:15.148295 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3415/6817] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:51:15.662550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:16.022644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:16.394785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949af47-8376-4135-a3ae-605c48536787 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:16.396349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f949af47-8376-4135-a3ae-605c48536787 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:16.413810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949af47-8376-4135-a3ae-605c48536787 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:16.460342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046dc8c-e482-42f5-aaa0-c6ee8a9ab77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:16.461212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046dc8c-e482-42f5-aaa0-c6ee8a9ab77a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:16.461498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046dc8c-e482-42f5-aaa0-c6ee8a9ab77a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:16.461779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046dc8c-e482-42f5-aaa0-c6ee8a9ab77a admin admin] PATH_INFO: `/v3/users/8a7d854e8f1040dca381840135ddbcdc` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:16.464908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046dc8c-e482-42f5-aaa0-c6ee8a9ab77a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a7d854e8f1040dca381840135ddbcdc)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:16.470527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046dc8c-e482-42f5-aaa0-c6ee8a9ab77a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:16.767897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3046dc8c-e482-42f5-aaa0-c6ee8a9ab77a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a7d854e8f1040dca381840135ddbcdc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:16.776794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3046dc8c-e482-42f5-aaa0-c6ee8a9ab77a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a7d854e8f1040dca381840135ddbcdc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:16.810021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3046dc8c-e482-42f5-aaa0-c6ee8a9ab77a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a7d854e8f1040dca381840135ddbcdc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:16.861836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3046dc8c-e482-42f5-aaa0-c6ee8a9ab77a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a7d854e8f1040dca381840135ddbcdc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:16.864642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3046dc8c-e482-42f5-aaa0-c6ee8a9ab77a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a7d854e8f1040dca381840135ddbcdc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:16.899641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc021ee-55f4-4f60-9897-d1707fb26726 service glance] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:16.902067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ccc021ee-55f4-4f60-9897-d1707fb26726 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:16.950362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc021ee-55f4-4f60-9897-d1707fb26726 service glance] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:16.955920 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3403/6818] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:51:16 2022] DELETE /identity/v3/users/8a7d854e8f1040dca381840135ddbcdc => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:16.961579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:16.963848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52038971-8137-4b38-86c2-93e28e99bc54 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:16.965403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52038971-8137-4b38-86c2-93e28e99bc54 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:16.965403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52038971-8137-4b38-86c2-93e28e99bc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:17.019374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:17.031814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-52038971-8137-4b38-86c2-93e28e99bc54 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:17.042176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-52038971-8137-4b38-86c2-93e28e99bc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:17.147575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c883aa2-5d74-4023-aec6-9813cd9f3109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:17.148307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c883aa2-5d74-4023-aec6-9813cd9f3109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:17.148588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c883aa2-5d74-4023-aec6-9813cd9f3109 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:17.149044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c883aa2-5d74-4023-aec6-9813cd9f3109 admin admin] PATH_INFO: `/v3/projects/80fd10b00d764825a0b9a3666af03c84` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:17.151339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c883aa2-5d74-4023-aec6-9813cd9f3109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80fd10b00d764825a0b9a3666af03c84)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:17.153929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c883aa2-5d74-4023-aec6-9813cd9f3109 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:17.248961 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3404/6819] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:17.328876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52038971-8137-4b38-86c2-93e28e99bc54 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:17.331552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-52038971-8137-4b38-86c2-93e28e99bc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:17.373848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0c883aa2-5d74-4023-aec6-9813cd9f3109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80fd10b00d764825a0b9a3666af03c84', 'request_id': 'req-0c883aa2-5d74-4023-aec6-9813cd9f3109'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:17.467960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0c883aa2-5d74-4023-aec6-9813cd9f3109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80fd10b00d764825a0b9a3666af03c84', 'request_id': 'req-0c883aa2-5d74-4023-aec6-9813cd9f3109'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:17.480117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0c883aa2-5d74-4023-aec6-9813cd9f3109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80fd10b00d764825a0b9a3666af03c84', 'request_id': 'req-0c883aa2-5d74-4023-aec6-9813cd9f3109'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:17.504781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0c883aa2-5d74-4023-aec6-9813cd9f3109 admin admin] The token cache is being invalidate because project 80fd10b00d764825a0b9a3666af03c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:17.505208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0c883aa2-5d74-4023-aec6-9813cd9f3109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:17.506776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0c883aa2-5d74-4023-aec6-9813cd9f3109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:17.510366 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3416/6820] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:51:16 2022] DELETE /identity/v3/projects/80fd10b00d764825a0b9a3666af03c84 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:17.513966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c883aa2-5d74-4023-aec6-9813cd9f3109 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:17.517070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0c883aa2-5d74-4023-aec6-9813cd9f3109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:17.567397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52038971-8137-4b38-86c2-93e28e99bc54 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:17.693771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c883aa2-5d74-4023-aec6-9813cd9f3109 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:17.700432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87470822-2e05-4c6c-a5a6-8614ada7676a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:17.701417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87470822-2e05-4c6c-a5a6-8614ada7676a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:17.701760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87470822-2e05-4c6c-a5a6-8614ada7676a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:17.702093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87470822-2e05-4c6c-a5a6-8614ada7676a admin admin] PATH_INFO: `/v3/users/5d7d7c6b46ed47b0a5c989fefe215061` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:17.703950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87470822-2e05-4c6c-a5a6-8614ada7676a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d7d7c6b46ed47b0a5c989fefe215061)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:17.705484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87470822-2e05-4c6c-a5a6-8614ada7676a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:17.752152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f1489-a987-43b6-b359-2391b2e4af44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:17.753474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f1489-a987-43b6-b359-2391b2e4af44 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:17.755723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f1489-a987-43b6-b359-2391b2e4af44 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:17.756277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f1489-a987-43b6-b359-2391b2e4af44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:17.764755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7a6f1489-a987-43b6-b359-2391b2e4af44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:17.806746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f1489-a987-43b6-b359-2391b2e4af44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:17.809010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f1489-a987-43b6-b359-2391b2e4af44 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:17.840045 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3405/6821] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:51:17.967510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-87470822-2e05-4c6c-a5a6-8614ada7676a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d7d7c6b46ed47b0a5c989fefe215061'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:17.969927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-87470822-2e05-4c6c-a5a6-8614ada7676a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d7d7c6b46ed47b0a5c989fefe215061'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:17.982913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:17.992776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-87470822-2e05-4c6c-a5a6-8614ada7676a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d7d7c6b46ed47b0a5c989fefe215061'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:18.016474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-87470822-2e05-4c6c-a5a6-8614ada7676a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d7d7c6b46ed47b0a5c989fefe215061'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:18.063068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:18.085027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-87470822-2e05-4c6c-a5a6-8614ada7676a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d7d7c6b46ed47b0a5c989fefe215061'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:18.099479 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3417/6822] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:51:17 2022] DELETE /identity/v3/users/5d7d7c6b46ed47b0a5c989fefe215061 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:19.068504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:19.433899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:19.779385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f1489-a987-43b6-b359-2391b2e4af44 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:19.781049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7a6f1489-a987-43b6-b359-2391b2e4af44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:19.800903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f1489-a987-43b6-b359-2391b2e4af44 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:19.919516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:19.969899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fd4a4-4329-49f9-af08-297ec2c580d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:19.974438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fd4a4-4329-49f9-af08-297ec2c580d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:19.978567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fd4a4-4329-49f9-af08-297ec2c580d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:19.978567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fd4a4-4329-49f9-af08-297ec2c580d8 admin admin] PATH_INFO: `/v3/projects/b1820ce35f6242a297e4fe6f812186a4` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:19.982770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fd4a4-4329-49f9-af08-297ec2c580d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1820ce35f6242a297e4fe6f812186a4)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:19.991131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fd4a4-4329-49f9-af08-297ec2c580d8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:20.087833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:20.203527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c58fd4a4-4329-49f9-af08-297ec2c580d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1820ce35f6242a297e4fe6f812186a4', 'request_id': 'req-c58fd4a4-4329-49f9-af08-297ec2c580d8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:20.222139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c58fd4a4-4329-49f9-af08-297ec2c580d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1820ce35f6242a297e4fe6f812186a4', 'request_id': 'req-c58fd4a4-4329-49f9-af08-297ec2c580d8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:20.236182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c58fd4a4-4329-49f9-af08-297ec2c580d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1820ce35f6242a297e4fe6f812186a4', 'request_id': 'req-c58fd4a4-4329-49f9-af08-297ec2c580d8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:20.360614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c58fd4a4-4329-49f9-af08-297ec2c580d8 admin admin] The token cache is being invalidate because project b1820ce35f6242a297e4fe6f812186a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:20.361783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c58fd4a4-4329-49f9-af08-297ec2c580d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:20.362066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c58fd4a4-4329-49f9-af08-297ec2c580d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:20.368617 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3406/6823] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:51:19 2022] DELETE /identity/v3/projects/b1820ce35f6242a297e4fe6f812186a4 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:20.369878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559d2ba-3648-493a-b1c5-8a3e310aa2c4 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:20.371484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559d2ba-3648-493a-b1c5-8a3e310aa2c4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:20.371778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559d2ba-3648-493a-b1c5-8a3e310aa2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:20.442138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6559d2ba-3648-493a-b1c5-8a3e310aa2c4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:20.444547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6559d2ba-3648-493a-b1c5-8a3e310aa2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:20.571785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:20.603368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:20.669679 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3418/6824] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:20.678895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051593f6-973e-43d2-9755-606f5be7f14f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:20.679382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051593f6-973e-43d2-9755-606f5be7f14f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:20.679786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051593f6-973e-43d2-9755-606f5be7f14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:20.688058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:20.743688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:20.760299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:20.780054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-051593f6-973e-43d2-9755-606f5be7f14f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:20.781676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-051593f6-973e-43d2-9755-606f5be7f14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:20.824690 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3407/6825] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:20.825071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559d2ba-3648-493a-b1c5-8a3e310aa2c4 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:20.827128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:20.845358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559d2ba-3648-493a-b1c5-8a3e310aa2c4 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:20.875658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650ee6f-1940-462c-b8ef-5e0363e6f951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:20.876589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650ee6f-1940-462c-b8ef-5e0363e6f951 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:20.877368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650ee6f-1940-462c-b8ef-5e0363e6f951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:20.877830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650ee6f-1940-462c-b8ef-5e0363e6f951 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:20.878787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650ee6f-1940-462c-b8ef-5e0363e6f951 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:51:20.879260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650ee6f-1940-462c-b8ef-5e0363e6f951 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:20.881372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650ee6f-1940-462c-b8ef-5e0363e6f951 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:20.908512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:20.930468 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3419/6826] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:51:20.931340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051593f6-973e-43d2-9755-606f5be7f14f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:20.948851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:20.958006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051593f6-973e-43d2-9755-606f5be7f14f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:20.998687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546055c-dbf6-483f-93d0-5ec65a824ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:21.013361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546055c-dbf6-483f-93d0-5ec65a824ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:21.015222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546055c-dbf6-483f-93d0-5ec65a824ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:21.017482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546055c-dbf6-483f-93d0-5ec65a824ad0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:21.018458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546055c-dbf6-483f-93d0-5ec65a824ad0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:21.026978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546055c-dbf6-483f-93d0-5ec65a824ad0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:21.102902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:21.175260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:21.208467 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3408/6827] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:51:20 2022] POST /identity/v3/projects => generated 355 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:21.213523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650ee6f-1940-462c-b8ef-5e0363e6f951 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:21.232503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650ee6f-1940-462c-b8ef-5e0363e6f951 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:21.246860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:21.444204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8e458-d6eb-4982-9b25-8db22c44ebe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:21.445439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8e458-d6eb-4982-9b25-8db22c44ebe6 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:21.445730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8e458-d6eb-4982-9b25-8db22c44ebe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:21.446346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8e458-d6eb-4982-9b25-8db22c44ebe6 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:21.446985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8e458-d6eb-4982-9b25-8db22c44ebe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:21.448837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8e458-d6eb-4982-9b25-8db22c44ebe6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:21.518313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546055c-dbf6-483f-93d0-5ec65a824ad0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:21.521197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e546055c-dbf6-483f-93d0-5ec65a824ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:21.547106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546055c-dbf6-483f-93d0-5ec65a824ad0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:21.565615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7255a-b728-4890-baa9-5132a48a8fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:21.565615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7255a-b728-4890-baa9-5132a48a8fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:21.565615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7255a-b728-4890-baa9-5132a48a8fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:21.565615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7255a-b728-4890-baa9-5132a48a8fb9 admin admin] PATH_INFO: `/v3/projects/1ac98d0b3ca44e8d9c9c223533ff1e73` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:21.568972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7255a-b728-4890-baa9-5132a48a8fb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ac98d0b3ca44e8d9c9c223533ff1e73)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:21.569337 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3420/6828] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:51:21 2022] POST /identity/v3/users => generated 278 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:51:21.574074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8e458-d6eb-4982-9b25-8db22c44ebe6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:21.575366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7255a-b728-4890-baa9-5132a48a8fb9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:21.618752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8e458-d6eb-4982-9b25-8db22c44ebe6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:21.643690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee486159-a60d-4279-93c4-21b0a55fae3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:21.644701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee486159-a60d-4279-93c4-21b0a55fae3a admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:21.645142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee486159-a60d-4279-93c4-21b0a55fae3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:21.645570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee486159-a60d-4279-93c4-21b0a55fae3a admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:21.646426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee486159-a60d-4279-93c4-21b0a55fae3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:21.656340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee486159-a60d-4279-93c4-21b0a55fae3a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:21.702124 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3421/6829] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:21.706510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee486159-a60d-4279-93c4-21b0a55fae3a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:21.735875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee486159-a60d-4279-93c4-21b0a55fae3a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:21.742842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:21.749071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0a263-f00b-45cb-b3ef-8dfa801fb276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:21.751506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0a263-f00b-45cb-b3ef-8dfa801fb276 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:21.754216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0a263-f00b-45cb-b3ef-8dfa801fb276 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:21.755091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0a263-f00b-45cb-b3ef-8dfa801fb276 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:21.756272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0a263-f00b-45cb-b3ef-8dfa801fb276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:21.763856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0a263-f00b-45cb-b3ef-8dfa801fb276 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:21.867686 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3422/6830] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:21.872054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0a263-f00b-45cb-b3ef-8dfa801fb276 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:21.877142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-46e7255a-b728-4890-baa9-5132a48a8fb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'request_id': 'req-46e7255a-b728-4890-baa9-5132a48a8fb9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:21.907468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-46e7255a-b728-4890-baa9-5132a48a8fb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'request_id': 'req-46e7255a-b728-4890-baa9-5132a48a8fb9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:21.918369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0a263-f00b-45cb-b3ef-8dfa801fb276 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:21.931681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-46e7255a-b728-4890-baa9-5132a48a8fb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ac98d0b3ca44e8d9c9c223533ff1e73', 'request_id': 'req-46e7255a-b728-4890-baa9-5132a48a8fb9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:22.055438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030ee35-8588-4591-99cd-3d6c4d2ba09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:22.056945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030ee35-8588-4591-99cd-3d6c4d2ba09b admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:22.057330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030ee35-8588-4591-99cd-3d6c4d2ba09b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:22.058149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030ee35-8588-4591-99cd-3d6c4d2ba09b admin admin] PATH_INFO: `/v3/projects/44de778248b04971941fdc2576b103c3/users/2fb06db395044a768b408ae1a7c3bbf5/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:22.102188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-46e7255a-b728-4890-baa9-5132a48a8fb9 admin admin] The token cache is being invalidate because project 1ac98d0b3ca44e8d9c9c223533ff1e73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:22.102683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-46e7255a-b728-4890-baa9-5132a48a8fb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:22.103652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-46e7255a-b728-4890-baa9-5132a48a8fb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:22.106326 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3409/6831] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:51:21 2022] DELETE /identity/v3/projects/1ac98d0b3ca44e8d9c9c223533ff1e73 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:22.113855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a4f4f-1b37-4b00-a9fd-97d5c92d1448 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:22.114919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:22.115223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a4f4f-1b37-4b00-a9fd-97d5c92d1448 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:22.115650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a4f4f-1b37-4b00-a9fd-97d5c92d1448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:22.136297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030ee35-8588-4591-99cd-3d6c4d2ba09b admin admin] RBAC: Authorizing `identity:create_grant(project_id=44de778248b04971941fdc2576b103c3, user_id=2fb06db395044a768b408ae1a7c3bbf5, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:22.156652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030ee35-8588-4591-99cd-3d6c4d2ba09b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:22.192132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-305a4f4f-1b37-4b00-a9fd-97d5c92d1448 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:22.195240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-305a4f4f-1b37-4b00-a9fd-97d5c92d1448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:22.213031 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3410/6832] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:22.222329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6c33b-87ff-4a10-9bbe-fe675066441e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:22.223945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6c33b-87ff-4a10-9bbe-fe675066441e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:22.224459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6c33b-87ff-4a10-9bbe-fe675066441e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:22.257584 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3423/6833] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:51:21 2022] PUT /identity/v3/projects/44de778248b04971941fdc2576b103c3/users/2fb06db395044a768b408ae1a7c3bbf5/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:22.271836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19783e-719b-4919-bdc0-f75830d10253 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:22.271836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19783e-719b-4919-bdc0-f75830d10253 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:22.271836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19783e-719b-4919-bdc0-f75830d10253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:22.356307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-aff6c33b-87ff-4a10-9bbe-fe675066441e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:22.357982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-aff6c33b-87ff-4a10-9bbe-fe675066441e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:22.396215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-2b19783e-719b-4919-bdc0-f75830d10253 None None] MFA Rules not processed for user `2fb06db395044a768b408ae1a7c3bbf5`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:22.401165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2b19783e-719b-4919-bdc0-f75830d10253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:22.561418 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3411/6834] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:22.563803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6c33b-87ff-4a10-9bbe-fe675066441e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:22.587767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:22.611227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6c33b-87ff-4a10-9bbe-fe675066441e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:22.632881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded25cd0-2f41-4e7a-9c06-cf199f8d88b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:22.633318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded25cd0-2f41-4e7a-9c06-cf199f8d88b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:22.633602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded25cd0-2f41-4e7a-9c06-cf199f8d88b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:22.642527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded25cd0-2f41-4e7a-9c06-cf199f8d88b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:22.643594 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3424/6835] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:22 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:22.645595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded25cd0-2f41-4e7a-9c06-cf199f8d88b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:51:22.645918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded25cd0-2f41-4e7a-9c06-cf199f8d88b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:22.646778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19783e-719b-4919-bdc0-f75830d10253 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:22.649526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2b19783e-719b-4919-bdc0-f75830d10253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:22.650970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded25cd0-2f41-4e7a-9c06-cf199f8d88b4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:22.686622 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3412/6836] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:51:22.697532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded25cd0-2f41-4e7a-9c06-cf199f8d88b4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:22.702985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19783e-719b-4919-bdc0-f75830d10253 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:22.720072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded25cd0-2f41-4e7a-9c06-cf199f8d88b4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:22.722863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b731d-7d22-4859-b123-224bcf417c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:22.727908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b731d-7d22-4859-b123-224bcf417c22 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:22.728609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b731d-7d22-4859-b123-224bcf417c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:22.737426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ce0ed-3716-42fe-b8db-0bfdac5e26da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:22.738245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ce0ed-3716-42fe-b8db-0bfdac5e26da admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:22.738642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ce0ed-3716-42fe-b8db-0bfdac5e26da admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:22.739592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ce0ed-3716-42fe-b8db-0bfdac5e26da admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:22.739722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b731d-7d22-4859-b123-224bcf417c22 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:22.739823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ce0ed-3716-42fe-b8db-0bfdac5e26da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:22.739927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b731d-7d22-4859-b123-224bcf417c22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:22.742641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ce0ed-3716-42fe-b8db-0bfdac5e26da admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:22.744115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b731d-7d22-4859-b123-224bcf417c22 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:22.811354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:22.853198 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3413/6837] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:51:22 2022] POST /identity/v3/projects => generated 397 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:22.857221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ce0ed-3716-42fe-b8db-0bfdac5e26da admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:22.928683 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3425/6838] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:51:22 2022] POST /identity/v3/projects => generated 357 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:22.933273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b731d-7d22-4859-b123-224bcf417c22 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:22.936838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:23.052839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ce0ed-3716-42fe-b8db-0bfdac5e26da admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:23.054618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:23.118938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b731d-7d22-4859-b123-224bcf417c22 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:23.123996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a1c6f-fe93-4eaa-b814-2c140d5bef0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:23.124737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a1c6f-fe93-4eaa-b814-2c140d5bef0a admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:23.125081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a1c6f-fe93-4eaa-b814-2c140d5bef0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:23.125415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a1c6f-fe93-4eaa-b814-2c140d5bef0a admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:23.126347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a1c6f-fe93-4eaa-b814-2c140d5bef0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:23.128523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a1c6f-fe93-4eaa-b814-2c140d5bef0a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:23.154131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:23.198637 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3426/6839] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:51:22 2022] POST /identity/v3/users => generated 285 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:23.200121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a1c6f-fe93-4eaa-b814-2c140d5bef0a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:23.247645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a1c6f-fe93-4eaa-b814-2c140d5bef0a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:23.249059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dd9f3-0280-43fd-a397-f0cdec6593e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:23.249748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dd9f3-0280-43fd-a397-f0cdec6593e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:23.250204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dd9f3-0280-43fd-a397-f0cdec6593e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:23.250485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dd9f3-0280-43fd-a397-f0cdec6593e6 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:23.251185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6dd9f3-0280-43fd-a397-f0cdec6593e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:23.255936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6dd9f3-0280-43fd-a397-f0cdec6593e6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:23.262161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f50d3-ab06-4435-9c06-49f8630414f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:23.264511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f50d3-ab06-4435-9c06-49f8630414f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:23.265044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f50d3-ab06-4435-9c06-49f8630414f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:23.266816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f50d3-ab06-4435-9c06-49f8630414f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:23.267998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f50d3-ab06-4435-9c06-49f8630414f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:23.274081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f50d3-ab06-4435-9c06-49f8630414f0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:23.297303 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3427/6840] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:23.298983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:23.303654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f50d3-ab06-4435-9c06-49f8630414f0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:23.328414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f50d3-ab06-4435-9c06-49f8630414f0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:23.338157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebe147-4a5b-403c-b1d8-80bf46b92530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:23.338861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebe147-4a5b-403c-b1d8-80bf46b92530 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:23.339326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebe147-4a5b-403c-b1d8-80bf46b92530 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:23.339622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebe147-4a5b-403c-b1d8-80bf46b92530 admin admin] PATH_INFO: `/v3/projects/792d5456df744b85b728691b61f80185/users/e99c30ce50974747873973be021d79f4/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:23.353271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:23.366875 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3414/6841] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:51:22 2022] POST /identity/v3/users => generated 305 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:23.368042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dd9f3-0280-43fd-a397-f0cdec6593e6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:23.383998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dd9f3-0280-43fd-a397-f0cdec6593e6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:23.397396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ebe147-4a5b-403c-b1d8-80bf46b92530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=792d5456df744b85b728691b61f80185, user_id=e99c30ce50974747873973be021d79f4, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:23.408567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ebe147-4a5b-403c-b1d8-80bf46b92530 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:23.410251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b08dd-e272-4bdc-b141-56c2fd6517e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:23.414291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b08dd-e272-4bdc-b141-56c2fd6517e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:23.414651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b08dd-e272-4bdc-b141-56c2fd6517e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:23.419082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b08dd-e272-4bdc-b141-56c2fd6517e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:23.419082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b08dd-e272-4bdc-b141-56c2fd6517e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:23.419082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b08dd-e272-4bdc-b141-56c2fd6517e3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:23.445861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:23.467776 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3415/6842] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:23.484422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b08dd-e272-4bdc-b141-56c2fd6517e3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:23.512458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b08dd-e272-4bdc-b141-56c2fd6517e3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:23.527445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e93ae-4f44-4873-ad0c-339e02e7d401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:23.530838 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3428/6843] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:51:23 2022] PUT /identity/v3/projects/792d5456df744b85b728691b61f80185/users/e99c30ce50974747873973be021d79f4/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:23.535036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebe147-4a5b-403c-b1d8-80bf46b92530 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:23.535736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e93ae-4f44-4873-ad0c-339e02e7d401 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:23.536096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e93ae-4f44-4873-ad0c-339e02e7d401 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:23.536382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e93ae-4f44-4873-ad0c-339e02e7d401 admin admin] PATH_INFO: `/v3/projects/1e89d8351d0548e5ba4b189189169700/users/03928b0beea54d1f9aface877b48a2b7/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:23.657027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:23.676498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e93ae-4f44-4873-ad0c-339e02e7d401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e89d8351d0548e5ba4b189189169700, user_id=03928b0beea54d1f9aface877b48a2b7, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:23.682159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e93ae-4f44-4873-ad0c-339e02e7d401 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:23.710862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:23.797347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebe147-4a5b-403c-b1d8-80bf46b92530 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:23.803479 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3416/6844] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:51:23 2022] PUT /identity/v3/projects/1e89d8351d0548e5ba4b189189169700/users/03928b0beea54d1f9aface877b48a2b7/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:23.803479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e93ae-4f44-4873-ad0c-339e02e7d401 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:23.804712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c91e93ae-4f44-4873-ad0c-339e02e7d401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:23.927500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e93ae-4f44-4873-ad0c-339e02e7d401 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:23.943753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc16d75-93e8-4dee-b4c5-7e672e596ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:23.944423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc16d75-93e8-4dee-b4c5-7e672e596ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:23.945251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc16d75-93e8-4dee-b4c5-7e672e596ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:23.945535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc16d75-93e8-4dee-b4c5-7e672e596ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:23.946228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc16d75-93e8-4dee-b4c5-7e672e596ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:23.946786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439d109-bdbc-4505-9dad-9524bb921c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:23.947602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439d109-bdbc-4505-9dad-9524bb921c94 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:23.947866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc16d75-93e8-4dee-b4c5-7e672e596ca8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:23.950490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439d109-bdbc-4505-9dad-9524bb921c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:23.950964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439d109-bdbc-4505-9dad-9524bb921c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:23.956664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b439d109-bdbc-4505-9dad-9524bb921c94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:23.964554 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3429/6845] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:23.965577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc16d75-93e8-4dee-b4c5-7e672e596ca8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:23.976874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc16d75-93e8-4dee-b4c5-7e672e596ca8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:23.983341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:23.983514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39230999-40a2-44de-83df-e7f3fde23495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:23.984350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39230999-40a2-44de-83df-e7f3fde23495 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:23.984764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39230999-40a2-44de-83df-e7f3fde23495 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:23.985147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39230999-40a2-44de-83df-e7f3fde23495 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:23.985915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39230999-40a2-44de-83df-e7f3fde23495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:23.987657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39230999-40a2-44de-83df-e7f3fde23495 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:24.012961 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3430/6846] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:24.013933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39230999-40a2-44de-83df-e7f3fde23495 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:24.039795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39230999-40a2-44de-83df-e7f3fde23495 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:24.054458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60fc23-2dd6-440c-8e92-2fd5b3892935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:24.061921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=84,keystone:UPDATE=1,keystone:INSERT=6,keystone:DELETE=9 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:24.062789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60fc23-2dd6-440c-8e92-2fd5b3892935 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:24.063246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60fc23-2dd6-440c-8e92-2fd5b3892935 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:24.067511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60fc23-2dd6-440c-8e92-2fd5b3892935 admin admin] PATH_INFO: `/v3/projects/792d5456df744b85b728691b61f80185/users/e99c30ce50974747873973be021d79f4/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:24.067511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60fc23-2dd6-440c-8e92-2fd5b3892935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=792d5456df744b85b728691b61f80185, user_id=e99c30ce50974747873973be021d79f4, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:24.070937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60fc23-2dd6-440c-8e92-2fd5b3892935 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:24.097880 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3431/6847] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:51:24 2022] PUT /identity/v3/projects/792d5456df744b85b728691b61f80185/users/e99c30ce50974747873973be021d79f4/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:24.098836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60fc23-2dd6-440c-8e92-2fd5b3892935 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:24.111124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:24.121687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439d109-bdbc-4505-9dad-9524bb921c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:24.127195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439d109-bdbc-4505-9dad-9524bb921c94 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:24.147100 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3417/6848] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:23 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:51:24.151554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73041c6-2725-4ce9-828e-edee27dc25d7 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:24.151554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73041c6-2725-4ce9-828e-edee27dc25d7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:24.154370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73041c6-2725-4ce9-828e-edee27dc25d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:24.237857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c73041c6-2725-4ce9-828e-edee27dc25d7 None None] MFA Rules not processed for user `e99c30ce50974747873973be021d79f4`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:24.239438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c73041c6-2725-4ce9-828e-edee27dc25d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:24.244429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60fc23-2dd6-440c-8e92-2fd5b3892935 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:24.259446 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada91836-9518-4285-9ff4-0db583d85f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:24.262730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada91836-9518-4285-9ff4-0db583d85f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:24.263152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada91836-9518-4285-9ff4-0db583d85f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:24.263340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada91836-9518-4285-9ff4-0db583d85f8f admin admin] PATH_INFO: `/v3/projects/1e89d8351d0548e5ba4b189189169700/users/03928b0beea54d1f9aface877b48a2b7/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:24.269718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada91836-9518-4285-9ff4-0db583d85f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e89d8351d0548e5ba4b189189169700, user_id=03928b0beea54d1f9aface877b48a2b7, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:24.278717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada91836-9518-4285-9ff4-0db583d85f8f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:24.304670 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3432/6849] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:51:24 2022] PUT /identity/v3/projects/1e89d8351d0548e5ba4b189189169700/users/03928b0beea54d1f9aface877b48a2b7/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:24.317673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2329c88-aff3-449e-aeed-f89ee24ba4aa None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:24.317968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2329c88-aff3-449e-aeed-f89ee24ba4aa None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:24.318272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2329c88-aff3-449e-aeed-f89ee24ba4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:24.394449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:24.397499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f2329c88-aff3-449e-aeed-f89ee24ba4aa None None] MFA Rules not processed for user `03928b0beea54d1f9aface877b48a2b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:24.399666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f2329c88-aff3-449e-aeed-f89ee24ba4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:24.448997 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3418/6850] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:24 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:24.449926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73041c6-2725-4ce9-828e-edee27dc25d7 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:24.469764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73041c6-2725-4ce9-828e-edee27dc25d7 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:24.559247 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3433/6851] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:24 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:24.564661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2329c88-aff3-449e-aeed-f89ee24ba4aa None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:24.607331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b199c85-cb7e-4859-ae5a-84bec3a58a42 tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e99c30ce50974747873973be021d79f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d5456df744b85b728691b61f80185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:24.607944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b199c85-cb7e-4859-ae5a-84bec3a58a42 tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:24.608236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b199c85-cb7e-4859-ae5a-84bec3a58a42 tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:24.608811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b199c85-cb7e-4859-ae5a-84bec3a58a42 tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:24.609486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b199c85-cb7e-4859-ae5a-84bec3a58a42 tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:51:24.609801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b199c85-cb7e-4859-ae5a-84bec3a58a42 tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:24.611981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b199c85-cb7e-4859-ae5a-84bec3a58a42 tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:24.618726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:24.656848 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3419/6852] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:51:24.659461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b199c85-cb7e-4859-ae5a-84bec3a58a42 tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:24.693490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b199c85-cb7e-4859-ae5a-84bec3a58a42 tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:24.702167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728c601-69be-4205-8248-16cc2f31529c tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e99c30ce50974747873973be021d79f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d5456df744b85b728691b61f80185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:24.703051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728c601-69be-4205-8248-16cc2f31529c tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:24.703789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728c601-69be-4205-8248-16cc2f31529c tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:24.704233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728c601-69be-4205-8248-16cc2f31529c tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:24.705041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728c601-69be-4205-8248-16cc2f31529c tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:24.707553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728c601-69be-4205-8248-16cc2f31529c tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:24.720497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:24.794801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2329c88-aff3-449e-aeed-f89ee24ba4aa None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:24.811907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccda9bf-6b9c-4065-a931-6124447bb9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:24.812667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccda9bf-6b9c-4065-a931-6124447bb9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:24.813055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccda9bf-6b9c-4065-a931-6124447bb9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:24.813435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccda9bf-6b9c-4065-a931-6124447bb9e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:24.814214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccda9bf-6b9c-4065-a931-6124447bb9e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:24.816339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccda9bf-6b9c-4065-a931-6124447bb9e3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:24.878247 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3420/6853] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:51:24 2022] POST /identity/v3/projects => generated 349 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:24.880762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728c601-69be-4205-8248-16cc2f31529c tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:24.895363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:24.957583 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3434/6854] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:51:24 2022] POST /identity/v3/projects => generated 397 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:24.962205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccda9bf-6b9c-4065-a931-6124447bb9e3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:25.014610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728c601-69be-4205-8248-16cc2f31529c tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:25.116089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccda9bf-6b9c-4065-a931-6124447bb9e3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:25.122191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea111da-fd3c-4ac9-b3ad-643e5c3ed44f tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e99c30ce50974747873973be021d79f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d5456df744b85b728691b61f80185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:25.122762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24dcda0-d8e0-4c66-a58d-f6a5f1729cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:25.123416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea111da-fd3c-4ac9-b3ad-643e5c3ed44f tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:25.123627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dcda0-d8e0-4c66-a58d-f6a5f1729cef admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:25.123868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dcda0-d8e0-4c66-a58d-f6a5f1729cef admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:25.124146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dcda0-d8e0-4c66-a58d-f6a5f1729cef admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:25.124706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea111da-fd3c-4ac9-b3ad-643e5c3ed44f tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:25.127966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24dcda0-d8e0-4c66-a58d-f6a5f1729cef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:25.127966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24dcda0-d8e0-4c66-a58d-f6a5f1729cef admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:25.128791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea111da-fd3c-4ac9-b3ad-643e5c3ed44f tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:25.129797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea111da-fd3c-4ac9-b3ad-643e5c3ed44f tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:51:25.131393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea111da-fd3c-4ac9-b3ad-643e5c3ed44f tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:25.138302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea111da-fd3c-4ac9-b3ad-643e5c3ed44f tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:25.175491 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3421/6855] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:51:25.212379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea111da-fd3c-4ac9-b3ad-643e5c3ed44f tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:25.214639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3ea111da-fd3c-4ac9-b3ad-643e5c3ed44f tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:25.282174 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3435/6856] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:51:24 2022] POST /identity/v3/users => generated 299 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:25.284869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24dcda0-d8e0-4c66-a58d-f6a5f1729cef admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:25.303391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24dcda0-d8e0-4c66-a58d-f6a5f1729cef admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:25.311185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5f8e2-bfda-48df-87ce-f752bad41ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:25.312074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5f8e2-bfda-48df-87ce-f752bad41ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:25.312531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5f8e2-bfda-48df-87ce-f752bad41ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:25.313408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5f8e2-bfda-48df-87ce-f752bad41ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:25.314347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5f8e2-bfda-48df-87ce-f752bad41ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:25.317046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5f8e2-bfda-48df-87ce-f752bad41ff1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:25.371367 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3436/6857] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:25.373698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5f8e2-bfda-48df-87ce-f752bad41ff1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:25.382998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:25.385214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea111da-fd3c-4ac9-b3ad-643e5c3ed44f tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:25.395143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5f8e2-bfda-48df-87ce-f752bad41ff1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:25.403904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273964da-ec77-4735-ac3d-3cc8249f199c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:25.404589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273964da-ec77-4735-ac3d-3cc8249f199c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:25.404875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273964da-ec77-4735-ac3d-3cc8249f199c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:25.405153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273964da-ec77-4735-ac3d-3cc8249f199c admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:25.406428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273964da-ec77-4735-ac3d-3cc8249f199c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:25.406636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da469e8d-f75b-4195-891d-b6fa7aca6ded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:25.407669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da469e8d-f75b-4195-891d-b6fa7aca6ded service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:25.407964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da469e8d-f75b-4195-891d-b6fa7aca6ded service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:25.408245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da469e8d-f75b-4195-891d-b6fa7aca6ded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:25.408510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273964da-ec77-4735-ac3d-3cc8249f199c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:25.430380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da469e8d-f75b-4195-891d-b6fa7aca6ded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:25.436773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da469e8d-f75b-4195-891d-b6fa7aca6ded service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:25.440737 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3437/6858] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:25.448937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273964da-ec77-4735-ac3d-3cc8249f199c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:25.471443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273964da-ec77-4735-ac3d-3cc8249f199c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:25.477383 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3422/6859] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:25 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:51:25.486269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c7c42-38fa-4d7c-9381-f35579c555c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:25.486965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c7c42-38fa-4d7c-9381-f35579c555c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:25.487245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c7c42-38fa-4d7c-9381-f35579c555c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:25.487517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c7c42-38fa-4d7c-9381-f35579c555c3 admin admin] PATH_INFO: `/v3/projects/0cb21872495448e9abe6cde5fbb2915c/users/de457c7a922c4e83961aece01849414e/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:25.519183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c7c42-38fa-4d7c-9381-f35579c555c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb21872495448e9abe6cde5fbb2915c, user_id=de457c7a922c4e83961aece01849414e, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:25.526658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c7c42-38fa-4d7c-9381-f35579c555c3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:25.590559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:25.633514 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3438/6860] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:51:25 2022] PUT /identity/v3/projects/0cb21872495448e9abe6cde5fbb2915c/users/de457c7a922c4e83961aece01849414e/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:25.635550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbae8e1-0b3a-4df0-b429-897b2d81ee80 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:25.635550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbae8e1-0b3a-4df0-b429-897b2d81ee80 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:25.635550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbae8e1-0b3a-4df0-b429-897b2d81ee80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:25.716848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-bbbae8e1-0b3a-4df0-b429-897b2d81ee80 None None] MFA Rules not processed for user `de457c7a922c4e83961aece01849414e`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:25.718734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bbbae8e1-0b3a-4df0-b429-897b2d81ee80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:25.937156 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3423/6861] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:25 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:25.959337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c7c42-38fa-4d7c-9381-f35579c555c3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:25.959337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-183c7c42-38fa-4d7c-9381-f35579c555c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:26.172850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c7c42-38fa-4d7c-9381-f35579c555c3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:26.183798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730c3cd-bdf0-43bd-811e-c38cd0d83f1d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:26.183798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730c3cd-bdf0-43bd-811e-c38cd0d83f1d service glance] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:26.184175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730c3cd-bdf0-43bd-811e-c38cd0d83f1d service glance] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:26.186248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730c3cd-bdf0-43bd-811e-c38cd0d83f1d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:26.367781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730c3cd-bdf0-43bd-811e-c38cd0d83f1d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:26.375629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730c3cd-bdf0-43bd-811e-c38cd0d83f1d service glance] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:26.400200 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3439/6862] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:25 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:51:26.413740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbae8e1-0b3a-4df0-b429-897b2d81ee80 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:26.548373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:26.618728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbae8e1-0b3a-4df0-b429-897b2d81ee80 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:26.632336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:26.635676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0383a3-e025-4da3-83b4-ed870d429095 tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e99c30ce50974747873973be021d79f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d5456df744b85b728691b61f80185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:26.639214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0383a3-e025-4da3-83b4-ed870d429095 tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:26.639214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0383a3-e025-4da3-83b4-ed870d429095 tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:26.639214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0383a3-e025-4da3-83b4-ed870d429095 tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] PATH_INFO: `/v3/projects/a4c4f68ef5284b4483507aaba28f7f3b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:26.639214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0383a3-e025-4da3-83b4-ed870d429095 tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a4c4f68ef5284b4483507aaba28f7f3b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:26.642522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0383a3-e025-4da3-83b4-ed870d429095 tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:26.820833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2a0383a3-e025-4da3-83b4-ed870d429095 tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4c4f68ef5284b4483507aaba28f7f3b', 'request_id': 'req-2a0383a3-e025-4da3-83b4-ed870d429095'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:26.835575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2a0383a3-e025-4da3-83b4-ed870d429095 tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4c4f68ef5284b4483507aaba28f7f3b', 'request_id': 'req-2a0383a3-e025-4da3-83b4-ed870d429095'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:26.867349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2a0383a3-e025-4da3-83b4-ed870d429095 tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4c4f68ef5284b4483507aaba28f7f3b', 'request_id': 'req-2a0383a3-e025-4da3-83b4-ed870d429095'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:26.985634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2a0383a3-e025-4da3-83b4-ed870d429095 tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] The token cache is being invalidate because project a4c4f68ef5284b4483507aaba28f7f3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:26.985932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2a0383a3-e025-4da3-83b4-ed870d429095 tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:26.987374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2a0383a3-e025-4da3-83b4-ed870d429095 tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:26.990503 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3424/6863] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:51:26 2022] DELETE /identity/v3/projects/a4c4f68ef5284b4483507aaba28f7f3b => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:27.313348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:27.664776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730c3cd-bdf0-43bd-811e-c38cd0d83f1d service glance] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:27.759293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:27.859665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:27.864204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730c3cd-bdf0-43bd-811e-c38cd0d83f1d service glance] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:28.058577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b6e16-07ce-44b4-99ca-389c7471ff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:28.058577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b6e16-07ce-44b4-99ca-389c7471ff32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:28.058577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b6e16-07ce-44b4-99ca-389c7471ff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:28.058577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b6e16-07ce-44b4-99ca-389c7471ff32 admin admin] PATH_INFO: `/v3/users/2fb06db395044a768b408ae1a7c3bbf5` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:28.070269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b6e16-07ce-44b4-99ca-389c7471ff32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fb06db395044a768b408ae1a7c3bbf5)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:28.078771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b6e16-07ce-44b4-99ca-389c7471ff32 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:28.104064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0383a3-e025-4da3-83b4-ed870d429095 tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:28.105750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2a0383a3-e025-4da3-83b4-ed870d429095 tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:28.167643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0383a3-e025-4da3-83b4-ed870d429095 tempest-QuotasTest-1796680957 tempest-QuotasTest-1796680957-project-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:28.188301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35dabc-76f6-420d-9b93-8dc8f2b48d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:28.189183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35dabc-76f6-420d-9b93-8dc8f2b48d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:28.189653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35dabc-76f6-420d-9b93-8dc8f2b48d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:28.190137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35dabc-76f6-420d-9b93-8dc8f2b48d8d admin admin] PATH_INFO: `/v3/users/03928b0beea54d1f9aface877b48a2b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:28.192706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35dabc-76f6-420d-9b93-8dc8f2b48d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=03928b0beea54d1f9aface877b48a2b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:28.195583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35dabc-76f6-420d-9b93-8dc8f2b48d8d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:28.388791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e55b6e16-07ce-44b4-99ca-389c7471ff32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fb06db395044a768b408ae1a7c3bbf5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:28.393920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e55b6e16-07ce-44b4-99ca-389c7471ff32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fb06db395044a768b408ae1a7c3bbf5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:28.428351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e55b6e16-07ce-44b4-99ca-389c7471ff32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fb06db395044a768b408ae1a7c3bbf5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:28.466278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e55b6e16-07ce-44b4-99ca-389c7471ff32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fb06db395044a768b408ae1a7c3bbf5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:28.498837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6e35dabc-76f6-420d-9b93-8dc8f2b48d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03928b0beea54d1f9aface877b48a2b7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:28.500679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6e35dabc-76f6-420d-9b93-8dc8f2b48d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03928b0beea54d1f9aface877b48a2b7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:28.520729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6e35dabc-76f6-420d-9b93-8dc8f2b48d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03928b0beea54d1f9aface877b48a2b7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:28.544568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6e35dabc-76f6-420d-9b93-8dc8f2b48d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03928b0beea54d1f9aface877b48a2b7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:28.547125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6e35dabc-76f6-420d-9b93-8dc8f2b48d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03928b0beea54d1f9aface877b48a2b7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:28.607027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e55b6e16-07ce-44b4-99ca-389c7471ff32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fb06db395044a768b408ae1a7c3bbf5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:28.615224 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3440/6864] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:51:27 2022] DELETE /identity/v3/users/2fb06db395044a768b408ae1a7c3bbf5 => generated 0 bytes in 951 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:28.620124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f7d6b-8451-4522-aa95-4de4133e83f2 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:28.620645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f7d6b-8451-4522-aa95-4de4133e83f2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:28.621147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f7d6b-8451-4522-aa95-4de4133e83f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:28.673935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-521f7d6b-8451-4522-aa95-4de4133e83f2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:28.675964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-521f7d6b-8451-4522-aa95-4de4133e83f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:28.707541 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3425/6865] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:51:28 2022] DELETE /identity/v3/users/03928b0beea54d1f9aface877b48a2b7 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:51:28.712223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe3d8c-e122-43c0-a0ad-591ebe5d6f01 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:28.712540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe3d8c-e122-43c0-a0ad-591ebe5d6f01 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:28.712916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe3d8c-e122-43c0-a0ad-591ebe5d6f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:28.756389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-5efe3d8c-e122-43c0-a0ad-591ebe5d6f01 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:28.756389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5efe3d8c-e122-43c0-a0ad-591ebe5d6f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:28.810588 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3441/6866] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:51:28.839871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f7d6b-8451-4522-aa95-4de4133e83f2 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:28.841715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-521f7d6b-8451-4522-aa95-4de4133e83f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:28.889370 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3426/6867] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:51:28.974596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe3d8c-e122-43c0-a0ad-591ebe5d6f01 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:28.976804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f7d6b-8451-4522-aa95-4de4133e83f2 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:29.188225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe3d8c-e122-43c0-a0ad-591ebe5d6f01 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:29.192465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49cb3d-ce58-4b08-b299-61dc4ceec711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:29.193104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49cb3d-ce58-4b08-b299-61dc4ceec711 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:29.193390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49cb3d-ce58-4b08-b299-61dc4ceec711 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:29.193669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49cb3d-ce58-4b08-b299-61dc4ceec711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:29.200511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962bbf3-4ef3-4253-aaab-94311c74db85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:29.201782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962bbf3-4ef3-4253-aaab-94311c74db85 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:29.205832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962bbf3-4ef3-4253-aaab-94311c74db85 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:29.205832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962bbf3-4ef3-4253-aaab-94311c74db85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:29.234777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49cb3d-ce58-4b08-b299-61dc4ceec711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:29.240115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49cb3d-ce58-4b08-b299-61dc4ceec711 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:29.248625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962bbf3-4ef3-4253-aaab-94311c74db85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:29.250397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962bbf3-4ef3-4253-aaab-94311c74db85 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:29.271758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:29.281819 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3442/6868] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:51:29.292756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:29.295099 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3427/6869] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:51:29.881439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:30.370561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:30.479292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:30.727220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49cb3d-ce58-4b08-b299-61dc4ceec711 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:30.728838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7f49cb3d-ce58-4b08-b299-61dc4ceec711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:30.770296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962bbf3-4ef3-4253-aaab-94311c74db85 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:30.771988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a962bbf3-4ef3-4253-aaab-94311c74db85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:30.781074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49cb3d-ce58-4b08-b299-61dc4ceec711 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:30.814163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962bbf3-4ef3-4253-aaab-94311c74db85 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:30.815133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694e4b2-a9c4-4bc9-92b2-4fed02b1e944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:30.816927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694e4b2-a9c4-4bc9-92b2-4fed02b1e944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:30.818022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694e4b2-a9c4-4bc9-92b2-4fed02b1e944 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:30.818339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694e4b2-a9c4-4bc9-92b2-4fed02b1e944 admin admin] PATH_INFO: `/v3/projects/1e89d8351d0548e5ba4b189189169700` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:30.824217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694e4b2-a9c4-4bc9-92b2-4fed02b1e944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e89d8351d0548e5ba4b189189169700)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:30.828606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694e4b2-a9c4-4bc9-92b2-4fed02b1e944 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:30.839936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ed3b7-2fdd-4fd6-97c8-ac53a69d7eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:30.840616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ed3b7-2fdd-4fd6-97c8-ac53a69d7eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:30.840935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ed3b7-2fdd-4fd6-97c8-ac53a69d7eff admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:30.841283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ed3b7-2fdd-4fd6-97c8-ac53a69d7eff admin admin] PATH_INFO: `/v3/projects/44de778248b04971941fdc2576b103c3` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:30.845752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ed3b7-2fdd-4fd6-97c8-ac53a69d7eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=44de778248b04971941fdc2576b103c3)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:30.848455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ed3b7-2fdd-4fd6-97c8-ac53a69d7eff admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:31.012081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:31.022878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c694e4b2-a9c4-4bc9-92b2-4fed02b1e944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e89d8351d0548e5ba4b189189169700', 'request_id': 'req-c694e4b2-a9c4-4bc9-92b2-4fed02b1e944'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:31.055010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8b8ed3b7-2fdd-4fd6-97c8-ac53a69d7eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44de778248b04971941fdc2576b103c3', 'request_id': 'req-8b8ed3b7-2fdd-4fd6-97c8-ac53a69d7eff'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:31.071253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8b8ed3b7-2fdd-4fd6-97c8-ac53a69d7eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44de778248b04971941fdc2576b103c3', 'request_id': 'req-8b8ed3b7-2fdd-4fd6-97c8-ac53a69d7eff'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:31.097706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c694e4b2-a9c4-4bc9-92b2-4fed02b1e944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e89d8351d0548e5ba4b189189169700', 'request_id': 'req-c694e4b2-a9c4-4bc9-92b2-4fed02b1e944'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:31.104251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8b8ed3b7-2fdd-4fd6-97c8-ac53a69d7eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44de778248b04971941fdc2576b103c3', 'request_id': 'req-8b8ed3b7-2fdd-4fd6-97c8-ac53a69d7eff'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:31.105309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c694e4b2-a9c4-4bc9-92b2-4fed02b1e944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e89d8351d0548e5ba4b189189169700', 'request_id': 'req-c694e4b2-a9c4-4bc9-92b2-4fed02b1e944'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:31.128974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c694e4b2-a9c4-4bc9-92b2-4fed02b1e944 admin admin] The token cache is being invalidate because project 1e89d8351d0548e5ba4b189189169700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:31.129519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c694e4b2-a9c4-4bc9-92b2-4fed02b1e944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:31.131301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c694e4b2-a9c4-4bc9-92b2-4fed02b1e944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:31.135775 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3443/6870] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:51:30 2022] DELETE /identity/v3/projects/1e89d8351d0548e5ba4b189189169700 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:31.139668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694e4b2-a9c4-4bc9-92b2-4fed02b1e944 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:31.146219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c694e4b2-a9c4-4bc9-92b2-4fed02b1e944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:31.216197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8b8ed3b7-2fdd-4fd6-97c8-ac53a69d7eff admin admin] The token cache is being invalidate because project 44de778248b04971941fdc2576b103c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:31.216197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8b8ed3b7-2fdd-4fd6-97c8-ac53a69d7eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:31.217518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8b8ed3b7-2fdd-4fd6-97c8-ac53a69d7eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:31.222061 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3428/6871] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:51:30 2022] DELETE /identity/v3/projects/44de778248b04971941fdc2576b103c3 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:31.226095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ed3b7-2fdd-4fd6-97c8-ac53a69d7eff admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:31.228933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8b8ed3b7-2fdd-4fd6-97c8-ac53a69d7eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:31.354157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694e4b2-a9c4-4bc9-92b2-4fed02b1e944 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:31.443205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ed3b7-2fdd-4fd6-97c8-ac53a69d7eff admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:31.459556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b817748-9396-4e1b-9220-c29c3843f69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:31.461823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b817748-9396-4e1b-9220-c29c3843f69f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:31.464938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b817748-9396-4e1b-9220-c29c3843f69f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:31.464938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b817748-9396-4e1b-9220-c29c3843f69f admin admin] PATH_INFO: `/v3/users/e99c30ce50974747873973be021d79f4` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:31.467491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b817748-9396-4e1b-9220-c29c3843f69f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e99c30ce50974747873973be021d79f4)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:31.472726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b817748-9396-4e1b-9220-c29c3843f69f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:31.521960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df895091-150d-45e3-a0ba-3447efea519d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:31.523534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df895091-150d-45e3-a0ba-3447efea519d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:31.523823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df895091-150d-45e3-a0ba-3447efea519d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:31.524110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df895091-150d-45e3-a0ba-3447efea519d admin admin] PATH_INFO: `/v3/users/de457c7a922c4e83961aece01849414e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:31.525304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df895091-150d-45e3-a0ba-3447efea519d admin admin] RBAC: Authorizing `identity:delete_user(user_id=de457c7a922c4e83961aece01849414e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:31.527320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df895091-150d-45e3-a0ba-3447efea519d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:31.774595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9b817748-9396-4e1b-9220-c29c3843f69f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e99c30ce50974747873973be021d79f4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:31.776260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9b817748-9396-4e1b-9220-c29c3843f69f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e99c30ce50974747873973be021d79f4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:31.781969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:31.787463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-df895091-150d-45e3-a0ba-3447efea519d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de457c7a922c4e83961aece01849414e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:31.788946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-df895091-150d-45e3-a0ba-3447efea519d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de457c7a922c4e83961aece01849414e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:31.796432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9b817748-9396-4e1b-9220-c29c3843f69f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e99c30ce50974747873973be021d79f4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:31.808069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-df895091-150d-45e3-a0ba-3447efea519d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de457c7a922c4e83961aece01849414e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:31.825672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9b817748-9396-4e1b-9220-c29c3843f69f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e99c30ce50974747873973be021d79f4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:31.826532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9b817748-9396-4e1b-9220-c29c3843f69f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e99c30ce50974747873973be021d79f4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:31.852524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-df895091-150d-45e3-a0ba-3447efea519d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de457c7a922c4e83961aece01849414e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:31.987077 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3429/6872] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:51:31 2022] DELETE /identity/v3/users/e99c30ce50974747873973be021d79f4 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:32.062190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-df895091-150d-45e3-a0ba-3447efea519d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de457c7a922c4e83961aece01849414e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:32.071413 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3444/6873] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:51:31 2022] DELETE /identity/v3/users/de457c7a922c4e83961aece01849414e => generated 0 bytes in 932 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:32.437353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b817748-9396-4e1b-9220-c29c3843f69f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:32.439964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9b817748-9396-4e1b-9220-c29c3843f69f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:32.706509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df895091-150d-45e3-a0ba-3447efea519d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:32.708163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-df895091-150d-45e3-a0ba-3447efea519d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:32.737042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b817748-9396-4e1b-9220-c29c3843f69f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:32.865307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d77a4-056b-48f3-ad8d-0283a24a78fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:32.865307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d77a4-056b-48f3-ad8d-0283a24a78fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:32.865307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d77a4-056b-48f3-ad8d-0283a24a78fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:32.865307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d77a4-056b-48f3-ad8d-0283a24a78fb admin admin] PATH_INFO: `/v3/users/8d00d79ff91e4b419a09b0b65d5d425e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:32.867012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d77a4-056b-48f3-ad8d-0283a24a78fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d00d79ff91e4b419a09b0b65d5d425e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:32.871940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d77a4-056b-48f3-ad8d-0283a24a78fb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:32.908413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df895091-150d-45e3-a0ba-3447efea519d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:32.914276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=11 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:32.931764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84cb676-e596-4c20-b6c5-0783c0f84776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:32.932854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cb676-e596-4c20-b6c5-0783c0f84776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:32.936881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cb676-e596-4c20-b6c5-0783c0f84776 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:32.940019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cb676-e596-4c20-b6c5-0783c0f84776 admin admin] PATH_INFO: `/v3/users/ae678d85d278473e97fd9a25cae43f0c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:32.943229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84cb676-e596-4c20-b6c5-0783c0f84776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae678d85d278473e97fd9a25cae43f0c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:32.952883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84cb676-e596-4c20-b6c5-0783c0f84776 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:33.067887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:33.094366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e75d77a4-056b-48f3-ad8d-0283a24a78fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d00d79ff91e4b419a09b0b65d5d425e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:33.095066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e75d77a4-056b-48f3-ad8d-0283a24a78fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d00d79ff91e4b419a09b0b65d5d425e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:33.109682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e75d77a4-056b-48f3-ad8d-0283a24a78fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d00d79ff91e4b419a09b0b65d5d425e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:33.144027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e75d77a4-056b-48f3-ad8d-0283a24a78fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d00d79ff91e4b419a09b0b65d5d425e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:33.144027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e75d77a4-056b-48f3-ad8d-0283a24a78fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d00d79ff91e4b419a09b0b65d5d425e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:33.272129 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3430/6874] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:51:32 2022] DELETE /identity/v3/users/8d00d79ff91e4b419a09b0b65d5d425e => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:33.275791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a921a-d30d-4e5f-8060-90b26934b8d5 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:33.276089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a921a-d30d-4e5f-8060-90b26934b8d5 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:33.276982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a921a-d30d-4e5f-8060-90b26934b8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:33.327908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b84cb676-e596-4c20-b6c5-0783c0f84776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae678d85d278473e97fd9a25cae43f0c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:33.337072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b84cb676-e596-4c20-b6c5-0783c0f84776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae678d85d278473e97fd9a25cae43f0c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:33.398893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d95a921a-d30d-4e5f-8060-90b26934b8d5 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:33.399099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b84cb676-e596-4c20-b6c5-0783c0f84776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae678d85d278473e97fd9a25cae43f0c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:33.400743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d95a921a-d30d-4e5f-8060-90b26934b8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:33.468083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b84cb676-e596-4c20-b6c5-0783c0f84776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae678d85d278473e97fd9a25cae43f0c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:33.541795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b84cb676-e596-4c20-b6c5-0783c0f84776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae678d85d278473e97fd9a25cae43f0c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:33.550167 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3445/6875] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:51:32 2022] DELETE /identity/v3/users/ae678d85d278473e97fd9a25cae43f0c => generated 0 bytes in 844 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:51:33.558376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a0260-d6a0-4578-baff-0f852bf9ef96 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:33.558990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a0260-d6a0-4578-baff-0f852bf9ef96 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:33.559475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a0260-d6a0-4578-baff-0f852bf9ef96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:33.598518 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3431/6876] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:51:33.630561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-986a0260-d6a0-4578-baff-0f852bf9ef96 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:33.634794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-986a0260-d6a0-4578-baff-0f852bf9ef96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:33.653633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a921a-d30d-4e5f-8060-90b26934b8d5 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:33.655382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d95a921a-d30d-4e5f-8060-90b26934b8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:33.803935 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3446/6877] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:51:33.805706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:33.811798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a0260-d6a0-4578-baff-0f852bf9ef96 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:33.818380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-986a0260-d6a0-4578-baff-0f852bf9ef96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:33.822247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a921a-d30d-4e5f-8060-90b26934b8d5 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:33.857940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a0260-d6a0-4578-baff-0f852bf9ef96 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:33.883024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210772c5-9607-4e26-a2c6-d3e130e58521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:33.884724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210772c5-9607-4e26-a2c6-d3e130e58521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:33.886896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210772c5-9607-4e26-a2c6-d3e130e58521 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:33.888273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210772c5-9607-4e26-a2c6-d3e130e58521 admin admin] PATH_INFO: `/v3/projects/0cb21872495448e9abe6cde5fbb2915c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:33.893660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210772c5-9607-4e26-a2c6-d3e130e58521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cb21872495448e9abe6cde5fbb2915c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:33.898295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210772c5-9607-4e26-a2c6-d3e130e58521 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:33.986837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a0ba2-75b0-47b6-9fff-91db37c5da89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:33.987621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a0ba2-75b0-47b6-9fff-91db37c5da89 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:33.988381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a0ba2-75b0-47b6-9fff-91db37c5da89 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:33.988381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a0ba2-75b0-47b6-9fff-91db37c5da89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:34.009793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a0ba2-75b0-47b6-9fff-91db37c5da89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:34.011440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a0ba2-75b0-47b6-9fff-91db37c5da89 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:34.066154 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3432/6878] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:51:34.066154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a0ba2-75b0-47b6-9fff-91db37c5da89 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:34.066154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a0ba2-75b0-47b6-9fff-91db37c5da89 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:34.077669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da076a93-585b-4229-9eed-25c06d153015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:34.079950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da076a93-585b-4229-9eed-25c06d153015 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:34.081158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da076a93-585b-4229-9eed-25c06d153015 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:34.082330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da076a93-585b-4229-9eed-25c06d153015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:34.103861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da076a93-585b-4229-9eed-25c06d153015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:34.107184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da076a93-585b-4229-9eed-25c06d153015 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:34.135828 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3433/6879] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:51:34.138598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da076a93-585b-4229-9eed-25c06d153015 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:34.140820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-da076a93-585b-4229-9eed-25c06d153015 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:34.175506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da076a93-585b-4229-9eed-25c06d153015 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:34.192140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3ba7d-fb52-4882-81f0-21c28d931475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:34.192864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3ba7d-fb52-4882-81f0-21c28d931475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:34.193208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3ba7d-fb52-4882-81f0-21c28d931475 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:34.193548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3ba7d-fb52-4882-81f0-21c28d931475 admin admin] PATH_INFO: `/v3/projects/792d5456df744b85b728691b61f80185` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:34.198106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3ba7d-fb52-4882-81f0-21c28d931475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=792d5456df744b85b728691b61f80185)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:34.203495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3ba7d-fb52-4882-81f0-21c28d931475 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:34.248027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-210772c5-9607-4e26-a2c6-d3e130e58521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb21872495448e9abe6cde5fbb2915c', 'request_id': 'req-210772c5-9607-4e26-a2c6-d3e130e58521'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:34.339408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-210772c5-9607-4e26-a2c6-d3e130e58521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb21872495448e9abe6cde5fbb2915c', 'request_id': 'req-210772c5-9607-4e26-a2c6-d3e130e58521'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:34.352327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-210772c5-9607-4e26-a2c6-d3e130e58521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb21872495448e9abe6cde5fbb2915c', 'request_id': 'req-210772c5-9607-4e26-a2c6-d3e130e58521'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:34.373241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a5c3ba7d-fb52-4882-81f0-21c28d931475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '792d5456df744b85b728691b61f80185', 'request_id': 'req-a5c3ba7d-fb52-4882-81f0-21c28d931475'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:34.391047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a5c3ba7d-fb52-4882-81f0-21c28d931475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '792d5456df744b85b728691b61f80185', 'request_id': 'req-a5c3ba7d-fb52-4882-81f0-21c28d931475'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:34.393658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-210772c5-9607-4e26-a2c6-d3e130e58521 admin admin] The token cache is being invalidate because project 0cb21872495448e9abe6cde5fbb2915c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:34.394723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-210772c5-9607-4e26-a2c6-d3e130e58521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:34.398267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-210772c5-9607-4e26-a2c6-d3e130e58521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:34.402056 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3447/6880] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:51:33 2022] DELETE /identity/v3/projects/0cb21872495448e9abe6cde5fbb2915c => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:34.408439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158e902-1cb7-4c7f-8883-e76c8fad5ca1 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:34.408725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158e902-1cb7-4c7f-8883-e76c8fad5ca1 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:34.409218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158e902-1cb7-4c7f-8883-e76c8fad5ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:34.411528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a5c3ba7d-fb52-4882-81f0-21c28d931475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '792d5456df744b85b728691b61f80185', 'request_id': 'req-a5c3ba7d-fb52-4882-81f0-21c28d931475'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:34.457343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1158e902-1cb7-4c7f-8883-e76c8fad5ca1 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:34.458827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1158e902-1cb7-4c7f-8883-e76c8fad5ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:34.645071 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3448/6881] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:34.662483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d2c0e-3679-4ccb-ad3d-ba83f1587766 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:34.662778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d2c0e-3679-4ccb-ad3d-ba83f1587766 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:34.663629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d2c0e-3679-4ccb-ad3d-ba83f1587766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:34.716825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6d3d2c0e-3679-4ccb-ad3d-ba83f1587766 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:34.718115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6d3d2c0e-3679-4ccb-ad3d-ba83f1587766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:34.728618 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3449/6882] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:34.732488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d2c0e-3679-4ccb-ad3d-ba83f1587766 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:34.743292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d2c0e-3679-4ccb-ad3d-ba83f1587766 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:34.748691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38897d78-1705-4c35-ae5a-fba8b014c7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:34.749502 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38897d78-1705-4c35-ae5a-fba8b014c7fb admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:34.749888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38897d78-1705-4c35-ae5a-fba8b014c7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:34.750472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38897d78-1705-4c35-ae5a-fba8b014c7fb admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:34.751464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38897d78-1705-4c35-ae5a-fba8b014c7fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:51:34.752085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38897d78-1705-4c35-ae5a-fba8b014c7fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:34.755035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38897d78-1705-4c35-ae5a-fba8b014c7fb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:34.779425 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3450/6883] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:51:34.783806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38897d78-1705-4c35-ae5a-fba8b014c7fb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:34.799727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38897d78-1705-4c35-ae5a-fba8b014c7fb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:34.810349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b1cdc-c30d-4c07-8770-54abb9d078ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:34.811506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b1cdc-c30d-4c07-8770-54abb9d078ba admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:34.812659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b1cdc-c30d-4c07-8770-54abb9d078ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:34.812982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b1cdc-c30d-4c07-8770-54abb9d078ba admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:34.813672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b1cdc-c30d-4c07-8770-54abb9d078ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:34.815674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b1cdc-c30d-4c07-8770-54abb9d078ba admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:34.826755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a5c3ba7d-fb52-4882-81f0-21c28d931475 admin admin] The token cache is being invalidate because project 792d5456df744b85b728691b61f80185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:34.831249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a5c3ba7d-fb52-4882-81f0-21c28d931475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:34.831249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a5c3ba7d-fb52-4882-81f0-21c28d931475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:34.836316 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3434/6884] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:51:34 2022] DELETE /identity/v3/projects/792d5456df744b85b728691b61f80185 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:34.841913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442aab3-6590-49a1-a3c1-f1c92b3bf8de None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:34.842257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442aab3-6590-49a1-a3c1-f1c92b3bf8de None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:34.842532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442aab3-6590-49a1-a3c1-f1c92b3bf8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:34.885468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6442aab3-6590-49a1-a3c1-f1c92b3bf8de None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:34.890396 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6442aab3-6590-49a1-a3c1-f1c92b3bf8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:34.905380 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3435/6885] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:34.914587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8a2aa-8110-4dde-9e91-fa78c3fef923 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:34.915027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8a2aa-8110-4dde-9e91-fa78c3fef923 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:34.915313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8a2aa-8110-4dde-9e91-fa78c3fef923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:34.962421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-fad8a2aa-8110-4dde-9e91-fa78c3fef923 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:34.968621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fad8a2aa-8110-4dde-9e91-fa78c3fef923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:34.986005 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3436/6886] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:51:34.987677 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3451/6887] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:51:34 2022] POST /identity/v3/projects => generated 361 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:34.988728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8a2aa-8110-4dde-9e91-fa78c3fef923 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:34.990186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fad8a2aa-8110-4dde-9e91-fa78c3fef923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:35.015576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8a2aa-8110-4dde-9e91-fa78c3fef923 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:35.016891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b1cdc-c30d-4c07-8770-54abb9d078ba admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:35.070128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:35.137791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af619a1-b0f5-4c0a-9c27-c0e4701601ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:35.143565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af619a1-b0f5-4c0a-9c27-c0e4701601ed admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:35.143565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af619a1-b0f5-4c0a-9c27-c0e4701601ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:35.143565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af619a1-b0f5-4c0a-9c27-c0e4701601ed admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:35.143565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af619a1-b0f5-4c0a-9c27-c0e4701601ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:35.143565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af619a1-b0f5-4c0a-9c27-c0e4701601ed admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:35.204619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b1cdc-c30d-4c07-8770-54abb9d078ba admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:35.223118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9dbf3-7c0e-4566-b93f-8fd767c3a816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:35.224035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9dbf3-7c0e-4566-b93f-8fd767c3a816 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:35.224321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9dbf3-7c0e-4566-b93f-8fd767c3a816 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:35.224599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9dbf3-7c0e-4566-b93f-8fd767c3a816 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:35.225292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9dbf3-7c0e-4566-b93f-8fd767c3a816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:51:35.225781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9dbf3-7c0e-4566-b93f-8fd767c3a816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:35.227263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9dbf3-7c0e-4566-b93f-8fd767c3a816 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:35.261290 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3452/6888] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:51:35.266319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9dbf3-7c0e-4566-b93f-8fd767c3a816 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:35.288765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9dbf3-7c0e-4566-b93f-8fd767c3a816 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:35.298761 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3437/6889] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:51:34 2022] POST /identity/v3/users => generated 281 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:35.303266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af619a1-b0f5-4c0a-9c27-c0e4701601ed admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:35.308634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1c067-626b-4fe9-9592-00653c2c9c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:35.309504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1c067-626b-4fe9-9592-00653c2c9c7e admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:35.309793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1c067-626b-4fe9-9592-00653c2c9c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:35.310108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1c067-626b-4fe9-9592-00653c2c9c7e admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:35.310760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1c067-626b-4fe9-9592-00653c2c9c7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:35.315877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1c067-626b-4fe9-9592-00653c2c9c7e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:35.325587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af619a1-b0f5-4c0a-9c27-c0e4701601ed admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:35.340136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130dfb84-eda4-489c-aa66-0031f9131fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:35.341002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dfb84-eda4-489c-aa66-0031f9131fec admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:35.341368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dfb84-eda4-489c-aa66-0031f9131fec admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:35.341911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dfb84-eda4-489c-aa66-0031f9131fec admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:35.343505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130dfb84-eda4-489c-aa66-0031f9131fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:35.347684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130dfb84-eda4-489c-aa66-0031f9131fec admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:35.369396 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3438/6890] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:35.374980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130dfb84-eda4-489c-aa66-0031f9131fec admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:35.393916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130dfb84-eda4-489c-aa66-0031f9131fec admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:35.410451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c062fa-fa53-49b7-a1a8-0a7cfff00c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:35.411447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c062fa-fa53-49b7-a1a8-0a7cfff00c7c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:35.411835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c062fa-fa53-49b7-a1a8-0a7cfff00c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:35.412458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c062fa-fa53-49b7-a1a8-0a7cfff00c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:35.413935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c062fa-fa53-49b7-a1a8-0a7cfff00c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:35.415663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c062fa-fa53-49b7-a1a8-0a7cfff00c7c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:35.441844 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3439/6891] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:35.448266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c062fa-fa53-49b7-a1a8-0a7cfff00c7c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:35.450134 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3453/6892] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:51:35 2022] POST /identity/v3/projects => generated 381 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:35.451325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1c067-626b-4fe9-9592-00653c2c9c7e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:35.462909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:35.472976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c062fa-fa53-49b7-a1a8-0a7cfff00c7c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:35.583422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1c067-626b-4fe9-9592-00653c2c9c7e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:35.591293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f65818-4518-430d-b306-791139faf3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:35.604279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f985700-9689-45c1-8830-452853ac49f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:35.605059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f985700-9689-45c1-8830-452853ac49f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:35.605424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f985700-9689-45c1-8830-452853ac49f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:35.605899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f985700-9689-45c1-8830-452853ac49f3 admin admin] PATH_INFO: `/v3/projects/d8fc3491484a407aaed540fe6bb71e62/users/dde00761eef34ae6bdf36e9e3c4c37d7/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:35.606243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f65818-4518-430d-b306-791139faf3cb admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:35.606596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f65818-4518-430d-b306-791139faf3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:35.606901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f65818-4518-430d-b306-791139faf3cb admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:35.611095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f65818-4518-430d-b306-791139faf3cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:35.620762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f65818-4518-430d-b306-791139faf3cb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:35.645265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f985700-9689-45c1-8830-452853ac49f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8fc3491484a407aaed540fe6bb71e62, user_id=dde00761eef34ae6bdf36e9e3c4c37d7, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:35.648285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f985700-9689-45c1-8830-452853ac49f3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:35.755773 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3440/6893] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:51:35 2022] PUT /identity/v3/projects/d8fc3491484a407aaed540fe6bb71e62/users/dde00761eef34ae6bdf36e9e3c4c37d7/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:35.758433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f985700-9689-45c1-8830-452853ac49f3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:35.761240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1f985700-9689-45c1-8830-452853ac49f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:35.784121 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3454/6894] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:51:35 2022] POST /identity/v3/users => generated 291 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:35.785668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d0677-3d2c-47cd-a4ee-28463b8a37cf None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:35.786026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d0677-3d2c-47cd-a4ee-28463b8a37cf None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:35.786427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d0677-3d2c-47cd-a4ee-28463b8a37cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:35.826955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f35d0677-3d2c-47cd-a4ee-28463b8a37cf None None] MFA Rules not processed for user `dde00761eef34ae6bdf36e9e3c4c37d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:35.828601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f35d0677-3d2c-47cd-a4ee-28463b8a37cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:35.937646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f985700-9689-45c1-8830-452853ac49f3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:35.953489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26447159-e012-44a1-9fba-214125c386fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:35.955785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26447159-e012-44a1-9fba-214125c386fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:35.955997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26447159-e012-44a1-9fba-214125c386fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:35.956279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26447159-e012-44a1-9fba-214125c386fc admin admin] PATH_INFO: `/v3/projects/eabde01787854fdbaedc472b9d79bffa` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:35.962595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26447159-e012-44a1-9fba-214125c386fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=eabde01787854fdbaedc472b9d79bffa)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:35.968133 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26447159-e012-44a1-9fba-214125c386fc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:36.008489 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3455/6895] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:36.009408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d0677-3d2c-47cd-a4ee-28463b8a37cf None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:36.042914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d0677-3d2c-47cd-a4ee-28463b8a37cf None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:36.051196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f25a9-7d53-408e-b136-2a62b099b136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:36.052287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f25a9-7d53-408e-b136-2a62b099b136 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:36.052490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f25a9-7d53-408e-b136-2a62b099b136 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:36.052824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f25a9-7d53-408e-b136-2a62b099b136 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:36.054057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f25a9-7d53-408e-b136-2a62b099b136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:36.057664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f25a9-7d53-408e-b136-2a62b099b136 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:36.072854 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3456/6896] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:36.073897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f25a9-7d53-408e-b136-2a62b099b136 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:36.086907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f25a9-7d53-408e-b136-2a62b099b136 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:36.097027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974e60-0384-421a-b4ec-5e12d5fe60ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:36.097875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974e60-0384-421a-b4ec-5e12d5fe60ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:36.098282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974e60-0384-421a-b4ec-5e12d5fe60ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:36.098659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974e60-0384-421a-b4ec-5e12d5fe60ca admin admin] PATH_INFO: `/v3/users/dde00761eef34ae6bdf36e9e3c4c37d7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:36.100141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b974e60-0384-421a-b4ec-5e12d5fe60ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=dde00761eef34ae6bdf36e9e3c4c37d7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:36.105734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b974e60-0384-421a-b4ec-5e12d5fe60ca admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:36.173142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-26447159-e012-44a1-9fba-214125c386fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eabde01787854fdbaedc472b9d79bffa', 'request_id': 'req-26447159-e012-44a1-9fba-214125c386fc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:36.191599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-26447159-e012-44a1-9fba-214125c386fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eabde01787854fdbaedc472b9d79bffa', 'request_id': 'req-26447159-e012-44a1-9fba-214125c386fc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:36.212936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-26447159-e012-44a1-9fba-214125c386fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eabde01787854fdbaedc472b9d79bffa', 'request_id': 'req-26447159-e012-44a1-9fba-214125c386fc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:36.348258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-26447159-e012-44a1-9fba-214125c386fc admin admin] The token cache is being invalidate because project eabde01787854fdbaedc472b9d79bffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:36.348831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-26447159-e012-44a1-9fba-214125c386fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:36.350273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-26447159-e012-44a1-9fba-214125c386fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:36.352906 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3441/6897] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:51:35 2022] DELETE /identity/v3/projects/eabde01787854fdbaedc472b9d79bffa => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:36.357498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26447159-e012-44a1-9fba-214125c386fc admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:36.360041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-26447159-e012-44a1-9fba-214125c386fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:36.361227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4b974e60-0384-421a-b4ec-5e12d5fe60ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dde00761eef34ae6bdf36e9e3c4c37d7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:36.363974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4b974e60-0384-421a-b4ec-5e12d5fe60ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dde00761eef34ae6bdf36e9e3c4c37d7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:36.382801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4b974e60-0384-421a-b4ec-5e12d5fe60ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dde00761eef34ae6bdf36e9e3c4c37d7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:36.418103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4b974e60-0384-421a-b4ec-5e12d5fe60ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dde00761eef34ae6bdf36e9e3c4c37d7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:36.433381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:36.527611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26447159-e012-44a1-9fba-214125c386fc admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:36.533888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-4b974e60-0384-421a-b4ec-5e12d5fe60ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dde00761eef34ae6bdf36e9e3c4c37d7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:36.539982 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3457/6898] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:51:36 2022] DELETE /identity/v3/users/dde00761eef34ae6bdf36e9e3c4c37d7 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:36.543273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974e60-0384-421a-b4ec-5e12d5fe60ca admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:36.545967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4b974e60-0384-421a-b4ec-5e12d5fe60ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:36.559841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125ba04-2d62-4885-912e-05a69127c5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:36.563646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125ba04-2d62-4885-912e-05a69127c5cb admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:36.563992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125ba04-2d62-4885-912e-05a69127c5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:36.564441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125ba04-2d62-4885-912e-05a69127c5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:36.567178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125ba04-2d62-4885-912e-05a69127c5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:36.585463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125ba04-2d62-4885-912e-05a69127c5cb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:36.611544 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3442/6899] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:36.613063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb19db0-9760-4c5e-b6b1-8cbaa4b7e288 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:36.613183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb19db0-9760-4c5e-b6b1-8cbaa4b7e288 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:36.613418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb19db0-9760-4c5e-b6b1-8cbaa4b7e288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:36.671646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-dcb19db0-9760-4c5e-b6b1-8cbaa4b7e288 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:36.672915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-dcb19db0-9760-4c5e-b6b1-8cbaa4b7e288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:36.730172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974e60-0384-421a-b4ec-5e12d5fe60ca admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:36.737459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed2887-4140-4447-8daf-46c1fe588124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:36.738162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed2887-4140-4447-8daf-46c1fe588124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:36.738453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed2887-4140-4447-8daf-46c1fe588124 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:36.738737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed2887-4140-4447-8daf-46c1fe588124 admin admin] PATH_INFO: `/v3/users/89cbc027dfbf4bb0a598350fda52d724` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:36.740142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed2887-4140-4447-8daf-46c1fe588124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89cbc027dfbf4bb0a598350fda52d724)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:36.743085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed2887-4140-4447-8daf-46c1fe588124 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:36.764771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:36.824465 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3443/6900] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:36.825691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb19db0-9760-4c5e-b6b1-8cbaa4b7e288 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:36.829769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-dcb19db0-9760-4c5e-b6b1-8cbaa4b7e288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:36.879228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb19db0-9760-4c5e-b6b1-8cbaa4b7e288 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:36.895369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b21a5f-1dcd-4960-a95e-38d84ae57f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:36.896497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b21a5f-1dcd-4960-a95e-38d84ae57f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:36.896988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b21a5f-1dcd-4960-a95e-38d84ae57f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:36.898214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b21a5f-1dcd-4960-a95e-38d84ae57f19 admin admin] PATH_INFO: `/v3/projects/e24a8e1b1a76497dabbc59a4d786642e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:36.899937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b21a5f-1dcd-4960-a95e-38d84ae57f19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e24a8e1b1a76497dabbc59a4d786642e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:36.905230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b21a5f-1dcd-4960-a95e-38d84ae57f19 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:37.016442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a9ed2887-4140-4447-8daf-46c1fe588124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89cbc027dfbf4bb0a598350fda52d724'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:37.022737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a9ed2887-4140-4447-8daf-46c1fe588124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89cbc027dfbf4bb0a598350fda52d724'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:37.062084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a9ed2887-4140-4447-8daf-46c1fe588124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89cbc027dfbf4bb0a598350fda52d724'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:37.062212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-57b21a5f-1dcd-4960-a95e-38d84ae57f19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e24a8e1b1a76497dabbc59a4d786642e', 'request_id': 'req-57b21a5f-1dcd-4960-a95e-38d84ae57f19'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:37.069117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-57b21a5f-1dcd-4960-a95e-38d84ae57f19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e24a8e1b1a76497dabbc59a4d786642e', 'request_id': 'req-57b21a5f-1dcd-4960-a95e-38d84ae57f19'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:37.093764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-57b21a5f-1dcd-4960-a95e-38d84ae57f19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e24a8e1b1a76497dabbc59a4d786642e', 'request_id': 'req-57b21a5f-1dcd-4960-a95e-38d84ae57f19'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:37.104664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a9ed2887-4140-4447-8daf-46c1fe588124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89cbc027dfbf4bb0a598350fda52d724'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:37.216615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-57b21a5f-1dcd-4960-a95e-38d84ae57f19 admin admin] The token cache is being invalidate because project e24a8e1b1a76497dabbc59a4d786642e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:37.217146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-57b21a5f-1dcd-4960-a95e-38d84ae57f19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:37.217723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-57b21a5f-1dcd-4960-a95e-38d84ae57f19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:37.219905 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3444/6901] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:51:36 2022] DELETE /identity/v3/projects/e24a8e1b1a76497dabbc59a4d786642e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:37.220500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b21a5f-1dcd-4960-a95e-38d84ae57f19 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:37.225943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-57b21a5f-1dcd-4960-a95e-38d84ae57f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:37.228367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:37.298633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a9ed2887-4140-4447-8daf-46c1fe588124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89cbc027dfbf4bb0a598350fda52d724'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:37.318011 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3458/6902] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:51:36 2022] DELETE /identity/v3/users/89cbc027dfbf4bb0a598350fda52d724 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:37.326456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed2887-4140-4447-8daf-46c1fe588124 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:37.330434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a9ed2887-4140-4447-8daf-46c1fe588124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:37.453231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b21a5f-1dcd-4960-a95e-38d84ae57f19 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:37.592307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed2887-4140-4447-8daf-46c1fe588124 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:37.600064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4924f7-0283-418e-85f2-bc6b0cb07916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:37.601270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4924f7-0283-418e-85f2-bc6b0cb07916 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:37.601551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4924f7-0283-418e-85f2-bc6b0cb07916 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:37.601826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4924f7-0283-418e-85f2-bc6b0cb07916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:37.605423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d54278-90f2-4b4d-89f7-85d5e52eb58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:37.606163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d54278-90f2-4b4d-89f7-85d5e52eb58c admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:37.606446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d54278-90f2-4b4d-89f7-85d5e52eb58c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:37.606722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d54278-90f2-4b4d-89f7-85d5e52eb58c admin admin] PATH_INFO: `/v3/projects/f3ce59d3a34647acb85bc6aa8ffb70de/users/cd4d39180be04cad93d52b6aefe4d16c/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:37.610541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4a4924f7-0283-418e-85f2-bc6b0cb07916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:37.616898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:37.657115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4924f7-0283-418e-85f2-bc6b0cb07916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:37.658755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4924f7-0283-418e-85f2-bc6b0cb07916 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:37.664840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d54278-90f2-4b4d-89f7-85d5e52eb58c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3ce59d3a34647acb85bc6aa8ffb70de, user_id=cd4d39180be04cad93d52b6aefe4d16c, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:37.667884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d54278-90f2-4b4d-89f7-85d5e52eb58c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:37.675128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:37.683752 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3459/6903] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:51:37.808819 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3445/6904] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:51:37 2022] PUT /identity/v3/projects/f3ce59d3a34647acb85bc6aa8ffb70de/users/cd4d39180be04cad93d52b6aefe4d16c/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:37.824098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335dc88-8079-4b2b-8b1b-f1953de80302 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:37.824502 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335dc88-8079-4b2b-8b1b-f1953de80302 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:37.824635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335dc88-8079-4b2b-8b1b-f1953de80302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:37.869477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a335dc88-8079-4b2b-8b1b-f1953de80302 None None] MFA Rules not processed for user `cd4d39180be04cad93d52b6aefe4d16c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:37.871462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a335dc88-8079-4b2b-8b1b-f1953de80302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:37.977104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:37.984525 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3460/6905] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:38.003174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d54278-90f2-4b4d-89f7-85d5e52eb58c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:38.008246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c5d54278-90f2-4b4d-89f7-85d5e52eb58c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:38.110448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d54278-90f2-4b4d-89f7-85d5e52eb58c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:38.118595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04061e60-ba7a-48e2-8ab4-bbadc5a9b6d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:38.123220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04061e60-ba7a-48e2-8ab4-bbadc5a9b6d8 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:38.123220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04061e60-ba7a-48e2-8ab4-bbadc5a9b6d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:38.123220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04061e60-ba7a-48e2-8ab4-bbadc5a9b6d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:38.144781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04061e60-ba7a-48e2-8ab4-bbadc5a9b6d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:38.148461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04061e60-ba7a-48e2-8ab4-bbadc5a9b6d8 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:38.170144 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3446/6906] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:51:38.256010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:38.571413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:39.044257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:39.087093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335dc88-8079-4b2b-8b1b-f1953de80302 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:39.088542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a335dc88-8079-4b2b-8b1b-f1953de80302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:39.105445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04061e60-ba7a-48e2-8ab4-bbadc5a9b6d8 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:39.116200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-04061e60-ba7a-48e2-8ab4-bbadc5a9b6d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:39.250211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335dc88-8079-4b2b-8b1b-f1953de80302 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:39.255906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f4cf7-5023-4f97-9ca9-244d2b3e6621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:39.257695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f4cf7-5023-4f97-9ca9-244d2b3e6621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:39.258195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f4cf7-5023-4f97-9ca9-244d2b3e6621 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:39.258855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f4cf7-5023-4f97-9ca9-244d2b3e6621 admin admin] PATH_INFO: `/v3/projects/32a143401f474a72a78e3df3077cf8b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:39.260389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f4cf7-5023-4f97-9ca9-244d2b3e6621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a143401f474a72a78e3df3077cf8b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:39.262969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f4cf7-5023-4f97-9ca9-244d2b3e6621 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:39.299198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04061e60-ba7a-48e2-8ab4-bbadc5a9b6d8 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:39.328987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c0934-0a37-4df4-868e-4b51055b655d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:39.330128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c0934-0a37-4df4-868e-4b51055b655d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:39.330649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c0934-0a37-4df4-868e-4b51055b655d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:39.331152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c0934-0a37-4df4-868e-4b51055b655d admin admin] PATH_INFO: `/v3/projects/d8fc3491484a407aaed540fe6bb71e62` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:39.332800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c0934-0a37-4df4-868e-4b51055b655d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8fc3491484a407aaed540fe6bb71e62)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:39.335478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c0934-0a37-4df4-868e-4b51055b655d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:39.404845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-533f4cf7-5023-4f97-9ca9-244d2b3e6621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a143401f474a72a78e3df3077cf8b7', 'request_id': 'req-533f4cf7-5023-4f97-9ca9-244d2b3e6621'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:39.493899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-533f4cf7-5023-4f97-9ca9-244d2b3e6621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a143401f474a72a78e3df3077cf8b7', 'request_id': 'req-533f4cf7-5023-4f97-9ca9-244d2b3e6621'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:39.495546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-533f4cf7-5023-4f97-9ca9-244d2b3e6621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a143401f474a72a78e3df3077cf8b7', 'request_id': 'req-533f4cf7-5023-4f97-9ca9-244d2b3e6621'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:39.504062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-429c0934-0a37-4df4-868e-4b51055b655d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8fc3491484a407aaed540fe6bb71e62', 'request_id': 'req-429c0934-0a37-4df4-868e-4b51055b655d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:39.511763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-533f4cf7-5023-4f97-9ca9-244d2b3e6621 admin admin] The token cache is being invalidate because project 32a143401f474a72a78e3df3077cf8b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:39.512461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-533f4cf7-5023-4f97-9ca9-244d2b3e6621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:39.513410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-533f4cf7-5023-4f97-9ca9-244d2b3e6621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:39.515189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-429c0934-0a37-4df4-868e-4b51055b655d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8fc3491484a407aaed540fe6bb71e62', 'request_id': 'req-429c0934-0a37-4df4-868e-4b51055b655d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:39.519034 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3461/6907] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:51:39 2022] DELETE /identity/v3/projects/32a143401f474a72a78e3df3077cf8b7 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:39.524694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958516b-2660-4949-a60d-329c10289e0e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:39.524694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958516b-2660-4949-a60d-329c10289e0e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:39.524694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958516b-2660-4949-a60d-329c10289e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:39.530132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-429c0934-0a37-4df4-868e-4b51055b655d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8fc3491484a407aaed540fe6bb71e62', 'request_id': 'req-429c0934-0a37-4df4-868e-4b51055b655d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:39.549952 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8958516b-2660-4949-a60d-329c10289e0e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:39.551921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8958516b-2660-4949-a60d-329c10289e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:39.632912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-429c0934-0a37-4df4-868e-4b51055b655d admin admin] The token cache is being invalidate because project d8fc3491484a407aaed540fe6bb71e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:51:39.633432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-429c0934-0a37-4df4-868e-4b51055b655d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:39.634390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-429c0934-0a37-4df4-868e-4b51055b655d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:51:39.640271 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3447/6908] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:51:39 2022] DELETE /identity/v3/projects/d8fc3491484a407aaed540fe6bb71e62 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:39.642203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ae86e-75e3-4ef5-86e0-d88b1c30f89f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:39.642486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ae86e-75e3-4ef5-86e0-d88b1c30f89f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:39.642831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ae86e-75e3-4ef5-86e0-d88b1c30f89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:39.658284 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3462/6909] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:39.670886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03b3b2-8c76-4fd8-ac28-a7fe667eacd1 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:39.672398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03b3b2-8c76-4fd8-ac28-a7fe667eacd1 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:39.672675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03b3b2-8c76-4fd8-ac28-a7fe667eacd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:39.683600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-474ae86e-75e3-4ef5-86e0-d88b1c30f89f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:39.688929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-474ae86e-75e3-4ef5-86e0-d88b1c30f89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:39.704124 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3448/6910] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:39.707244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4d7ad-3f4c-447a-91d9-91e1ae00b179 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:39.707752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4d7ad-3f4c-447a-91d9-91e1ae00b179 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:39.708178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4d7ad-3f4c-447a-91d9-91e1ae00b179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:39.740139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-3a03b3b2-8c76-4fd8-ac28-a7fe667eacd1 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:39.751885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3a03b3b2-8c76-4fd8-ac28-a7fe667eacd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:39.771685 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3463/6911] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:51:39.782103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03b3b2-8c76-4fd8-ac28-a7fe667eacd1 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:39.796911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c5c4d7ad-3f4c-447a-91d9-91e1ae00b179 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:39.800524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c5c4d7ad-3f4c-447a-91d9-91e1ae00b179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:39.806016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03b3b2-8c76-4fd8-ac28-a7fe667eacd1 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:39.829678 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3449/6912] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:39.831224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf5fe4-4188-4de5-a196-4055282edea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:39.831224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf5fe4-4188-4de5-a196-4055282edea2 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:39.831661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf5fe4-4188-4de5-a196-4055282edea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:39.831661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf5fe4-4188-4de5-a196-4055282edea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:39.832296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf5fe4-4188-4de5-a196-4055282edea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:51:39.832612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf5fe4-4188-4de5-a196-4055282edea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:39.832871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4d7ad-3f4c-447a-91d9-91e1ae00b179 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:39.834306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf5fe4-4188-4de5-a196-4055282edea2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:39.853485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4d7ad-3f4c-447a-91d9-91e1ae00b179 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:39.860809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb580e-3634-4e8b-be2b-207e12a2ec56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:39.862445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb580e-3634-4e8b-be2b-207e12a2ec56 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:39.862445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb580e-3634-4e8b-be2b-207e12a2ec56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:39.863944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb580e-3634-4e8b-be2b-207e12a2ec56 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:39.865135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb580e-3634-4e8b-be2b-207e12a2ec56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:51:39.865613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb580e-3634-4e8b-be2b-207e12a2ec56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:39.867438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb580e-3634-4e8b-be2b-207e12a2ec56 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:39.878175 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3464/6913] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:51:39.980031 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3450/6914] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:51:39.984488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf5fe4-4188-4de5-a196-4055282edea2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:39.995871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb580e-3634-4e8b-be2b-207e12a2ec56 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:40.013298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf5fe4-4188-4de5-a196-4055282edea2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:40.031184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d701b-2055-452f-9cb7-58179731e2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:40.031807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb580e-3634-4e8b-be2b-207e12a2ec56 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:40.031964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d701b-2055-452f-9cb7-58179731e2a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:40.032106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d701b-2055-452f-9cb7-58179731e2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:40.032389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d701b-2055-452f-9cb7-58179731e2a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:40.033043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d701b-2055-452f-9cb7-58179731e2a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:40.035028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d701b-2055-452f-9cb7-58179731e2a1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:40.038926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddc81a-a25b-46b3-baa2-eae6fe328776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:40.039675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddc81a-a25b-46b3-baa2-eae6fe328776 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:40.040079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddc81a-a25b-46b3-baa2-eae6fe328776 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:40.040459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddc81a-a25b-46b3-baa2-eae6fe328776 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:40.041617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddc81a-a25b-46b3-baa2-eae6fe328776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:40.045037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddc81a-a25b-46b3-baa2-eae6fe328776 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:40.228041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:UPDATE=2,keystone:DELETE=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:40.457187 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3451/6915] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:51:39 2022] POST /identity/v3/projects => generated 383 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:40.462461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddc81a-a25b-46b3-baa2-eae6fe328776 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:40.465313 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3465/6916] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:51:39 2022] POST /identity/v3/projects => generated 369 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:40.469913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d701b-2055-452f-9cb7-58179731e2a1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:40.569954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddc81a-a25b-46b3-baa2-eae6fe328776 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:40.613241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d701b-2055-452f-9cb7-58179731e2a1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:40.643752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48539b-a380-4ab9-a099-3335142304a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:40.644532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48539b-a380-4ab9-a099-3335142304a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:40.644679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48539b-a380-4ab9-a099-3335142304a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:40.644949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48539b-a380-4ab9-a099-3335142304a5 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:40.645599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48539b-a380-4ab9-a099-3335142304a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:40.648175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48539b-a380-4ab9-a099-3335142304a5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:40.654354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364ef77-7b30-42dd-87ae-2d41433ba48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:40.655859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364ef77-7b30-42dd-87ae-2d41433ba48b admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:40.656491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364ef77-7b30-42dd-87ae-2d41433ba48b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:40.656929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364ef77-7b30-42dd-87ae-2d41433ba48b admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:40.658356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364ef77-7b30-42dd-87ae-2d41433ba48b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:40.663418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364ef77-7b30-42dd-87ae-2d41433ba48b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:40.750794 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3452/6917] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:51:40 2022] POST /identity/v3/users => generated 292 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:40.757265 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3466/6918] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:51:40 2022] POST /identity/v3/users => generated 285 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:40.757751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364ef77-7b30-42dd-87ae-2d41433ba48b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:40.761860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48539b-a380-4ab9-a099-3335142304a5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:40.787246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48539b-a380-4ab9-a099-3335142304a5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:40.788593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364ef77-7b30-42dd-87ae-2d41433ba48b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:40.799675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6cdc9-0616-4eb6-a584-0f49900f7ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:40.800511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6cdc9-0616-4eb6-a584-0f49900f7ccf admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:40.800971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6cdc9-0616-4eb6-a584-0f49900f7ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:40.801419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6cdc9-0616-4eb6-a584-0f49900f7ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:40.802267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6cdc9-0616-4eb6-a584-0f49900f7ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:40.805104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6cdc9-0616-4eb6-a584-0f49900f7ccf admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:40.807606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae560f-9bf7-47ef-b9ae-2dc40d03b37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:40.810359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae560f-9bf7-47ef-b9ae-2dc40d03b37e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:40.810875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae560f-9bf7-47ef-b9ae-2dc40d03b37e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:40.812562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae560f-9bf7-47ef-b9ae-2dc40d03b37e admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:40.814863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae560f-9bf7-47ef-b9ae-2dc40d03b37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:40.821181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae560f-9bf7-47ef-b9ae-2dc40d03b37e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:40.821422 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3453/6919] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:40.822517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6cdc9-0616-4eb6-a584-0f49900f7ccf admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:40.838278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:40.844762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6cdc9-0616-4eb6-a584-0f49900f7ccf admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:40.852959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f24dd-6ca9-48d9-a832-111ada5797f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:40.854654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f24dd-6ca9-48d9-a832-111ada5797f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:40.855161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f24dd-6ca9-48d9-a832-111ada5797f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:40.855445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f24dd-6ca9-48d9-a832-111ada5797f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:40.856075 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3467/6920] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:40.857128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae560f-9bf7-47ef-b9ae-2dc40d03b37e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:40.859882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f24dd-6ca9-48d9-a832-111ada5797f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:40.862967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f24dd-6ca9-48d9-a832-111ada5797f9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:40.885862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae560f-9bf7-47ef-b9ae-2dc40d03b37e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:40.891759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9601349-8d5d-4466-82cd-4b61f290c27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:40.892612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9601349-8d5d-4466-82cd-4b61f290c27e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:40.893188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9601349-8d5d-4466-82cd-4b61f290c27e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:40.893980 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3454/6921] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:40.894559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9601349-8d5d-4466-82cd-4b61f290c27e admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:40.895470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9601349-8d5d-4466-82cd-4b61f290c27e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:40.895957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f24dd-6ca9-48d9-a832-111ada5797f9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:40.899678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9601349-8d5d-4466-82cd-4b61f290c27e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:40.909831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f24dd-6ca9-48d9-a832-111ada5797f9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:40.916439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033bb60-6137-47be-9bb8-6a76ee70c669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:40.917386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033bb60-6137-47be-9bb8-6a76ee70c669 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:40.917703 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3468/6922] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:40.921298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033bb60-6137-47be-9bb8-6a76ee70c669 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:40.921626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033bb60-6137-47be-9bb8-6a76ee70c669 admin admin] PATH_INFO: `/v3/projects/b1011bdef619442ab777fd27dfc99265/users/e97034f23aa644ffb6bb7f599ca60403/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:40.923170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9601349-8d5d-4466-82cd-4b61f290c27e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:40.939843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033bb60-6137-47be-9bb8-6a76ee70c669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1011bdef619442ab777fd27dfc99265, user_id=e97034f23aa644ffb6bb7f599ca60403, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:40.940712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9601349-8d5d-4466-82cd-4b61f290c27e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:40.942885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033bb60-6137-47be-9bb8-6a76ee70c669 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:40.948558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ddce2-9afd-4573-8da3-1d87283ca774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:40.949371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ddce2-9afd-4573-8da3-1d87283ca774 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:40.949790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ddce2-9afd-4573-8da3-1d87283ca774 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:40.950174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ddce2-9afd-4573-8da3-1d87283ca774 admin admin] PATH_INFO: `/v3/projects/afc2154af7ff450f9e17c2b571dba846/users/fc97f7dbe02a45c7ae85c9ea5b9080c7/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:40.966544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ddce2-9afd-4573-8da3-1d87283ca774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afc2154af7ff450f9e17c2b571dba846, user_id=fc97f7dbe02a45c7ae85c9ea5b9080c7, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:40.970293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ddce2-9afd-4573-8da3-1d87283ca774 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:41.040661 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3455/6923] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:51:40 2022] PUT /identity/v3/projects/b1011bdef619442ab777fd27dfc99265/users/e97034f23aa644ffb6bb7f599ca60403/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:41.052575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a39883-f1a6-47e3-bb96-ad665701bacd None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:41.053113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a39883-f1a6-47e3-bb96-ad665701bacd None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:41.054019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a39883-f1a6-47e3-bb96-ad665701bacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:41.058787 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3469/6924] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:51:40 2022] PUT /identity/v3/projects/afc2154af7ff450f9e17c2b571dba846/users/fc97f7dbe02a45c7ae85c9ea5b9080c7/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:41.069133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de767c-f078-4dbe-b2cc-eaa483191855 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:41.069433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de767c-f078-4dbe-b2cc-eaa483191855 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:41.069697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de767c-f078-4dbe-b2cc-eaa483191855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:41.102724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f3de767c-f078-4dbe-b2cc-eaa483191855 None None] MFA Rules not processed for user `fc97f7dbe02a45c7ae85c9ea5b9080c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:41.104064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f3de767c-f078-4dbe-b2cc-eaa483191855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:41.115272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b4a39883-f1a6-47e3-bb96-ad665701bacd None None] MFA Rules not processed for user `e97034f23aa644ffb6bb7f599ca60403`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:41.119494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b4a39883-f1a6-47e3-bb96-ad665701bacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:41.213672 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3470/6925] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:51:41.234166 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3456/6926] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:51:41.237491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de767c-f078-4dbe-b2cc-eaa483191855 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:41.278026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a39883-f1a6-47e3-bb96-ad665701bacd None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:41.280475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b4a39883-f1a6-47e3-bb96-ad665701bacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:41.336002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de767c-f078-4dbe-b2cc-eaa483191855 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:41.345553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec9d0b-b494-4b33-b38f-36a2f1cb62f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:41.345553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec9d0b-b494-4b33-b38f-36a2f1cb62f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:41.345553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec9d0b-b494-4b33-b38f-36a2f1cb62f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:41.345553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec9d0b-b494-4b33-b38f-36a2f1cb62f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:41.356150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec9d0b-b494-4b33-b38f-36a2f1cb62f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:41.358742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a39883-f1a6-47e3-bb96-ad665701bacd None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:41.360378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec9d0b-b494-4b33-b38f-36a2f1cb62f0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:41.364122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febb620-b721-4e1b-a6da-ccecfe4083da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:41.364933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febb620-b721-4e1b-a6da-ccecfe4083da service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:41.365318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febb620-b721-4e1b-a6da-ccecfe4083da service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:41.365692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febb620-b721-4e1b-a6da-ccecfe4083da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:41.377594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febb620-b721-4e1b-a6da-ccecfe4083da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:41.379668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febb620-b721-4e1b-a6da-ccecfe4083da service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:41.392200 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3457/6927] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:51:41.660287 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3471/6928] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:51:41 2022] POST /identity/v3/projects => generated 383 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:41.664189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febb620-b721-4e1b-a6da-ccecfe4083da service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:41.675568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febb620-b721-4e1b-a6da-ccecfe4083da service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:41.753792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:41.782516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9547f-ff01-4741-9f0f-b1e0983efd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:41.783251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9547f-ff01-4741-9f0f-b1e0983efd8d admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:41.783592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9547f-ff01-4741-9f0f-b1e0983efd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:41.783983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9547f-ff01-4741-9f0f-b1e0983efd8d admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:41.785682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9547f-ff01-4741-9f0f-b1e0983efd8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:41.789006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9547f-ff01-4741-9f0f-b1e0983efd8d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:41.854649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec9d0b-b494-4b33-b38f-36a2f1cb62f0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:41.856630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-22ec9d0b-b494-4b33-b38f-36a2f1cb62f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:41.910162 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3458/6929] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:51:41 2022] POST /identity/v3/users => generated 292 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:41.914484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9547f-ff01-4741-9f0f-b1e0983efd8d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:41.945031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9547f-ff01-4741-9f0f-b1e0983efd8d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:41.957691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668633ce-75cd-4fd1-a5d2-b04b4e4b1e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:41.958645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668633ce-75cd-4fd1-a5d2-b04b4e4b1e48 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:41.961999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668633ce-75cd-4fd1-a5d2-b04b4e4b1e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:41.962501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668633ce-75cd-4fd1-a5d2-b04b4e4b1e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:41.963919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668633ce-75cd-4fd1-a5d2-b04b4e4b1e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:41.966146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668633ce-75cd-4fd1-a5d2-b04b4e4b1e48 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:41.990335 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3459/6930] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:41.998360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668633ce-75cd-4fd1-a5d2-b04b4e4b1e48 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:42.016799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668633ce-75cd-4fd1-a5d2-b04b4e4b1e48 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:42.019376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec9d0b-b494-4b33-b38f-36a2f1cb62f0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:42.027516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba69909-3eaf-42ff-905e-2407b53ab5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:42.028849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba69909-3eaf-42ff-905e-2407b53ab5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:42.033501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba69909-3eaf-42ff-905e-2407b53ab5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:42.033501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba69909-3eaf-42ff-905e-2407b53ab5b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:42.033501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba69909-3eaf-42ff-905e-2407b53ab5b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:42.033833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c03882-417b-4296-bd2a-6f8ede37d5af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:42.033833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c03882-417b-4296-bd2a-6f8ede37d5af service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:42.033833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c03882-417b-4296-bd2a-6f8ede37d5af service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:42.033833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c03882-417b-4296-bd2a-6f8ede37d5af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:42.036438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba69909-3eaf-42ff-905e-2407b53ab5b5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:42.040717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-55c03882-417b-4296-bd2a-6f8ede37d5af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:42.074532 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3460/6931] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:42.078869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:42.080189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba69909-3eaf-42ff-905e-2407b53ab5b5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:42.083432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c03882-417b-4296-bd2a-6f8ede37d5af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:42.090858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c03882-417b-4296-bd2a-6f8ede37d5af service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:42.104433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba69909-3eaf-42ff-905e-2407b53ab5b5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:42.113331 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3472/6932] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:51:42.117939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd74382-1043-4347-a5a4-be1d2c97d9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:42.118921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd74382-1043-4347-a5a4-be1d2c97d9e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:42.119397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd74382-1043-4347-a5a4-be1d2c97d9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:42.119868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd74382-1043-4347-a5a4-be1d2c97d9e8 admin admin] PATH_INFO: `/v3/projects/1e8217c041684da2aff7a8332ae62538/users/6262a69ed5c94beaabf44f6cdf7bcf51/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:42.140543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd74382-1043-4347-a5a4-be1d2c97d9e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e8217c041684da2aff7a8332ae62538, user_id=6262a69ed5c94beaabf44f6cdf7bcf51, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:42.143349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd74382-1043-4347-a5a4-be1d2c97d9e8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:42.250823 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3461/6933] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:51:42 2022] PUT /identity/v3/projects/1e8217c041684da2aff7a8332ae62538/users/6262a69ed5c94beaabf44f6cdf7bcf51/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:42.347660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdd18b-0119-4b76-ab33-a1ae707bd417 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:42.348047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdd18b-0119-4b76-ab33-a1ae707bd417 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:42.354512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdd18b-0119-4b76-ab33-a1ae707bd417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:42.393278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d0fdd18b-0119-4b76-ab33-a1ae707bd417 None None] MFA Rules not processed for user `6262a69ed5c94beaabf44f6cdf7bcf51`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:42.394804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d0fdd18b-0119-4b76-ab33-a1ae707bd417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:42.519664 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3473/6934] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:42.525266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd74382-1043-4347-a5a4-be1d2c97d9e8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:42.655823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd74382-1043-4347-a5a4-be1d2c97d9e8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:42.659827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045192b6-b8ae-465b-94e3-e4730949d1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:42.660930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045192b6-b8ae-465b-94e3-e4730949d1ec admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:42.661340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045192b6-b8ae-465b-94e3-e4730949d1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:42.661718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045192b6-b8ae-465b-94e3-e4730949d1ec admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:42.663294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045192b6-b8ae-465b-94e3-e4730949d1ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:42.666249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045192b6-b8ae-465b-94e3-e4730949d1ec admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:42.767121 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3462/6935] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:51:42 2022] POST /identity/v3/projects => generated 383 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:42.771425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdd18b-0119-4b76-ab33-a1ae707bd417 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:42.795405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdd18b-0119-4b76-ab33-a1ae707bd417 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:42.995101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9c307-f4fc-4074-a9dd-055db3e48bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:42.995742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9c307-f4fc-4074-a9dd-055db3e48bec admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:42.998565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9c307-f4fc-4074-a9dd-055db3e48bec admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:42.998865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9c307-f4fc-4074-a9dd-055db3e48bec admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:43.000704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9c307-f4fc-4074-a9dd-055db3e48bec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:43.005359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9c307-f4fc-4074-a9dd-055db3e48bec admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:43.174112 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3474/6936] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:51:42 2022] POST /identity/v3/users => generated 298 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:51:43.175001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045192b6-b8ae-465b-94e3-e4730949d1ec admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:43.214782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045192b6-b8ae-465b-94e3-e4730949d1ec admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:43.224339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb61836-8000-4f8c-aa33-eab809bd89fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:43.225748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb61836-8000-4f8c-aa33-eab809bd89fd admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:43.226249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb61836-8000-4f8c-aa33-eab809bd89fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:43.226699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb61836-8000-4f8c-aa33-eab809bd89fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:43.227681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb61836-8000-4f8c-aa33-eab809bd89fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:43.229460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb61836-8000-4f8c-aa33-eab809bd89fd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:43.248992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9c307-f4fc-4074-a9dd-055db3e48bec admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:43.284433 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3463/6937] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:43.293999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9c307-f4fc-4074-a9dd-055db3e48bec admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:43.303014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d338ced-f5fe-4f75-9aa4-047950f5427d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:43.306852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d338ced-f5fe-4f75-9aa4-047950f5427d admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:43.306852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d338ced-f5fe-4f75-9aa4-047950f5427d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:43.306852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d338ced-f5fe-4f75-9aa4-047950f5427d admin admin] PATH_INFO: `/v3/projects/067406e013f34e098f701d272f13139b/users/966cf03c5a564ae3bdef22bb96d37069/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:43.332862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d338ced-f5fe-4f75-9aa4-047950f5427d admin admin] RBAC: Authorizing `identity:create_grant(project_id=067406e013f34e098f701d272f13139b, user_id=966cf03c5a564ae3bdef22bb96d37069, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:43.341656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d338ced-f5fe-4f75-9aa4-047950f5427d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:43.382228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:43.425584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb61836-8000-4f8c-aa33-eab809bd89fd admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:43.429451 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3475/6938] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:51:43 2022] PUT /identity/v3/projects/067406e013f34e098f701d272f13139b/users/966cf03c5a564ae3bdef22bb96d37069/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:43.465501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb61836-8000-4f8c-aa33-eab809bd89fd admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:43.570643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:43.638692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d855d-06ce-4e67-bb4f-12288e320e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:43.639833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d855d-06ce-4e67-bb4f-12288e320e8d admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:43.640521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d855d-06ce-4e67-bb4f-12288e320e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:43.641078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d855d-06ce-4e67-bb4f-12288e320e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:43.642159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d855d-06ce-4e67-bb4f-12288e320e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:43.646689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d855d-06ce-4e67-bb4f-12288e320e8d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:43.679504 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3464/6939] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:51:43.680513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d338ced-f5fe-4f75-9aa4-047950f5427d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:43.698135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d338ced-f5fe-4f75-9aa4-047950f5427d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:43.717329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cfa0e-e594-4f60-bc88-4558a1293f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:43.717901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cfa0e-e594-4f60-bc88-4558a1293f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:43.722241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cfa0e-e594-4f60-bc88-4558a1293f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:43.722549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cfa0e-e594-4f60-bc88-4558a1293f8b admin admin] PATH_INFO: `/v3/projects/067406e013f34e098f701d272f13139b/users/966cf03c5a564ae3bdef22bb96d37069/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:43.731633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cfa0e-e594-4f60-bc88-4558a1293f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=067406e013f34e098f701d272f13139b, user_id=966cf03c5a564ae3bdef22bb96d37069, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:43.743694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cfa0e-e594-4f60-bc88-4558a1293f8b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:43.795270 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3476/6940] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:51:43 2022] PUT /identity/v3/projects/067406e013f34e098f701d272f13139b/users/966cf03c5a564ae3bdef22bb96d37069/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:51:43.833761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cb225-5e3e-4e10-9f5c-13384f7ac001 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:43.834557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cb225-5e3e-4e10-9f5c-13384f7ac001 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:43.835579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cb225-5e3e-4e10-9f5c-13384f7ac001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:43.906737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6c3cb225-5e3e-4e10-9f5c-13384f7ac001 None None] MFA Rules not processed for user `966cf03c5a564ae3bdef22bb96d37069`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:51:43.906737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6c3cb225-5e3e-4e10-9f5c-13384f7ac001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:44.029144 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3465/6941] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:51:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:51:44.043701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cfa0e-e594-4f60-bc88-4558a1293f8b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:44.044775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1b0cfa0e-e594-4f60-bc88-4558a1293f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:44.188923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cfa0e-e594-4f60-bc88-4558a1293f8b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:44.200532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae986133-4d83-4fa5-b97c-49c358441f82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:44.201316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae986133-4d83-4fa5-b97c-49c358441f82 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:44.205068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae986133-4d83-4fa5-b97c-49c358441f82 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:44.205466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae986133-4d83-4fa5-b97c-49c358441f82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:44.364118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae986133-4d83-4fa5-b97c-49c358441f82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:44.366430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae986133-4d83-4fa5-b97c-49c358441f82 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:44.384266 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3477/6942] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:51:44.497662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:44.748497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:45.043024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cb225-5e3e-4e10-9f5c-13384f7ac001 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:45.045087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6c3cb225-5e3e-4e10-9f5c-13384f7ac001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:45.170996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cb225-5e3e-4e10-9f5c-13384f7ac001 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:45.176067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8560b3-dfb7-4691-8f28-8f4522755ca7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:45.179663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8560b3-dfb7-4691-8f28-8f4522755ca7 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:45.179663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8560b3-dfb7-4691-8f28-8f4522755ca7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:45.179663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8560b3-dfb7-4691-8f28-8f4522755ca7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:45.181634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2f8560b3-dfb7-4691-8f28-8f4522755ca7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:45.384918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8560b3-dfb7-4691-8f28-8f4522755ca7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:45.386896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8560b3-dfb7-4691-8f28-8f4522755ca7 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:45.455065 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3466/6943] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:51:45.916194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:46.107829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:46.387664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:47.085030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:48.009473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:48.805611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:49.644907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:50.953483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:51.468616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:54.004709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:55.285325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:56.015346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:56.629729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae986133-4d83-4fa5-b97c-49c358441f82 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:51:56.638267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:56.648844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae986133-4d83-4fa5-b97c-49c358441f82 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:51:56.659456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e0eba-e7a2-469b-b58d-e30caec43ff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:51:56.660661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e0eba-e7a2-469b-b58d-e30caec43ff2 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:51:56.660956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e0eba-e7a2-469b-b58d-e30caec43ff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:51:56.661236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e0eba-e7a2-469b-b58d-e30caec43ff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:51:56.671954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-832e0eba-e7a2-469b-b58d-e30caec43ff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:51:56.685038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:56.733658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e0eba-e7a2-469b-b58d-e30caec43ff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:51:56.743592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e0eba-e7a2-469b-b58d-e30caec43ff2 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:51:56.775854 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3478/6944] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:51:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:51:57.816632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:59.426440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:00.846304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:02.570804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:04.175132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:05.033045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:07.130316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:09.904052 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8560b3-dfb7-4691-8f28-8f4522755ca7 service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:09.932862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8560b3-dfb7-4691-8f28-8f4522755ca7 service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:09.948040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0153b35-fa42-44d9-a773-9b36568335d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:09.952421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0153b35-fa42-44d9-a773-9b36568335d9 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:09.952906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0153b35-fa42-44d9-a773-9b36568335d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:09.953358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0153b35-fa42-44d9-a773-9b36568335d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:09.990444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0153b35-fa42-44d9-a773-9b36568335d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:09.994524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0153b35-fa42-44d9-a773-9b36568335d9 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:10.020017 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3467/6945] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:52:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:52:11.708102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e0eba-e7a2-469b-b58d-e30caec43ff2 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:11.708102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-832e0eba-e7a2-469b-b58d-e30caec43ff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:11.851686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e0eba-e7a2-469b-b58d-e30caec43ff2 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:11.866197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd674f86-b565-4a61-876f-6d0cc4a25d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:11.866869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd674f86-b565-4a61-876f-6d0cc4a25d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:11.867156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd674f86-b565-4a61-876f-6d0cc4a25d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:11.867428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd674f86-b565-4a61-876f-6d0cc4a25d09 admin admin] PATH_INFO: `/v3/users/cd4d39180be04cad93d52b6aefe4d16c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:11.869550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd674f86-b565-4a61-876f-6d0cc4a25d09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd4d39180be04cad93d52b6aefe4d16c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:11.872596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd674f86-b565-4a61-876f-6d0cc4a25d09 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:12.105541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fd674f86-b565-4a61-876f-6d0cc4a25d09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd4d39180be04cad93d52b6aefe4d16c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:12.107788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fd674f86-b565-4a61-876f-6d0cc4a25d09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd4d39180be04cad93d52b6aefe4d16c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:12.131769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fd674f86-b565-4a61-876f-6d0cc4a25d09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd4d39180be04cad93d52b6aefe4d16c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:12.149027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fd674f86-b565-4a61-876f-6d0cc4a25d09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd4d39180be04cad93d52b6aefe4d16c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:12.280024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fd674f86-b565-4a61-876f-6d0cc4a25d09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd4d39180be04cad93d52b6aefe4d16c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:12.288526 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3479/6946] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:52:11 2022] DELETE /identity/v3/users/cd4d39180be04cad93d52b6aefe4d16c => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:52:12.295886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfb2c7-7adf-4f16-9ac0-bd395da65344 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:12.295886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfb2c7-7adf-4f16-9ac0-bd395da65344 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:12.295886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfb2c7-7adf-4f16-9ac0-bd395da65344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:12.351361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-febfb2c7-7adf-4f16-9ac0-bd395da65344 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:52:12.356648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-febfb2c7-7adf-4f16-9ac0-bd395da65344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:12.457137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:12.602697 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3468/6947] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:52:12.696310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd674f86-b565-4a61-876f-6d0cc4a25d09 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:12.698166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fd674f86-b565-4a61-876f-6d0cc4a25d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:12.853969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd674f86-b565-4a61-876f-6d0cc4a25d09 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:12.859585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90537c4d-c55f-483a-b488-e74d5d690ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:12.862319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90537c4d-c55f-483a-b488-e74d5d690ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:12.863029 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90537c4d-c55f-483a-b488-e74d5d690ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:12.865955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90537c4d-c55f-483a-b488-e74d5d690ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:12.885311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90537c4d-c55f-483a-b488-e74d5d690ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:12.888441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90537c4d-c55f-483a-b488-e74d5d690ef2 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:12.904348 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3480/6948] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:52:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:52:13.245146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfb2c7-7adf-4f16-9ac0-bd395da65344 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:13.246916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-febfb2c7-7adf-4f16-9ac0-bd395da65344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:13.268541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfb2c7-7adf-4f16-9ac0-bd395da65344 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:13.280454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e03b9-2b0b-4590-807b-20d58e29a1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:13.281386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e03b9-2b0b-4590-807b-20d58e29a1ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:13.281893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e03b9-2b0b-4590-807b-20d58e29a1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:13.282874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e03b9-2b0b-4590-807b-20d58e29a1ae admin admin] PATH_INFO: `/v3/projects/f3ce59d3a34647acb85bc6aa8ffb70de` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:13.284591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e03b9-2b0b-4590-807b-20d58e29a1ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3ce59d3a34647acb85bc6aa8ffb70de)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:13.288980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e03b9-2b0b-4590-807b-20d58e29a1ae admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:13.596176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-732e03b9-2b0b-4590-807b-20d58e29a1ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3ce59d3a34647acb85bc6aa8ffb70de', 'request_id': 'req-732e03b9-2b0b-4590-807b-20d58e29a1ae'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:13.633713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a1a0f-09a8-4a75-b7b6-070ad408b398 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:13.634323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a1a0f-09a8-4a75-b7b6-070ad408b398 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:13.634907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a1a0f-09a8-4a75-b7b6-070ad408b398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:13.645299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-732e03b9-2b0b-4590-807b-20d58e29a1ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3ce59d3a34647acb85bc6aa8ffb70de', 'request_id': 'req-732e03b9-2b0b-4590-807b-20d58e29a1ae'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:13.658527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-732e03b9-2b0b-4590-807b-20d58e29a1ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3ce59d3a34647acb85bc6aa8ffb70de', 'request_id': 'req-732e03b9-2b0b-4590-807b-20d58e29a1ae'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:13.672399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-800a1a0f-09a8-4a75-b7b6-070ad408b398 None None] MFA Rules not processed for user `66ba627e73834b84b1ee6514e1facd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:52:13.674004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-800a1a0f-09a8-4a75-b7b6-070ad408b398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:13.703876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:13.769194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-732e03b9-2b0b-4590-807b-20d58e29a1ae admin admin] The token cache is being invalidate because project f3ce59d3a34647acb85bc6aa8ffb70de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:52:13.769498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-732e03b9-2b0b-4590-807b-20d58e29a1ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:13.770671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-732e03b9-2b0b-4590-807b-20d58e29a1ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:13.772433 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3469/6949] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:52:13 2022] DELETE /identity/v3/projects/f3ce59d3a34647acb85bc6aa8ffb70de => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:52:13.777254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b448a57-e830-4da9-9238-7fb790a01217 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:13.777548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b448a57-e830-4da9-9238-7fb790a01217 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:13.777827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b448a57-e830-4da9-9238-7fb790a01217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:13.799165 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3481/6950] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:52:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:52:13.829084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3b448a57-e830-4da9-9238-7fb790a01217 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:52:13.830684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3b448a57-e830-4da9-9238-7fb790a01217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:13.975143 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3470/6951] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:52:13.982662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d760567-5907-48d2-81b4-be0767b068f8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:13.983576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d760567-5907-48d2-81b4-be0767b068f8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:13.984154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d760567-5907-48d2-81b4-be0767b068f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:14.028954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4d760567-5907-48d2-81b4-be0767b068f8 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:52:14.030696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4d760567-5907-48d2-81b4-be0767b068f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:14.057473 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3482/6952] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:52:14.058510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b448a57-e830-4da9-9238-7fb790a01217 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:14.077029 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b448a57-e830-4da9-9238-7fb790a01217 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:14.084395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60a485-adfd-40e2-a8bb-a880dda67b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:14.090282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60a485-adfd-40e2-a8bb-a880dda67b0f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:14.090282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60a485-adfd-40e2-a8bb-a880dda67b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:14.090282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60a485-adfd-40e2-a8bb-a880dda67b0f admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:14.090282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60a485-adfd-40e2-a8bb-a880dda67b0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:52:14.090282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60a485-adfd-40e2-a8bb-a880dda67b0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:14.090282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60a485-adfd-40e2-a8bb-a880dda67b0f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:14.118226 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3471/6953] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:52:14.123259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d760567-5907-48d2-81b4-be0767b068f8 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:14.146702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d760567-5907-48d2-81b4-be0767b068f8 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:14.159496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66718802-1eba-46b8-9402-d308e551ac91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:14.160144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66718802-1eba-46b8-9402-d308e551ac91 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:14.160429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66718802-1eba-46b8-9402-d308e551ac91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:14.160705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66718802-1eba-46b8-9402-d308e551ac91 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:14.161357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66718802-1eba-46b8-9402-d308e551ac91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:14.163411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66718802-1eba-46b8-9402-d308e551ac91 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:14.274944 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3483/6954] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:52:14 2022] POST /identity/v3/projects => generated 359 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:52:14.279518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60a485-adfd-40e2-a8bb-a880dda67b0f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:14.298418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60a485-adfd-40e2-a8bb-a880dda67b0f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:14.388970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:14.451312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99d35b-6dca-4088-8050-64d3458f8f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:14.452327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99d35b-6dca-4088-8050-64d3458f8f79 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:14.452622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99d35b-6dca-4088-8050-64d3458f8f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:14.452916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99d35b-6dca-4088-8050-64d3458f8f79 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:14.453581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99d35b-6dca-4088-8050-64d3458f8f79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:14.455583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99d35b-6dca-4088-8050-64d3458f8f79 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:14.646883 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3472/6955] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:52:14 2022] POST /identity/v3/users => generated 280 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:52:14.651096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66718802-1eba-46b8-9402-d308e551ac91 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:14.671475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66718802-1eba-46b8-9402-d308e551ac91 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:14.705650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691b793-c9e8-4df6-a992-ab6499516b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:14.706572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691b793-c9e8-4df6-a992-ab6499516b74 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:14.706962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691b793-c9e8-4df6-a992-ab6499516b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:14.707390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691b793-c9e8-4df6-a992-ab6499516b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:14.708162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691b793-c9e8-4df6-a992-ab6499516b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:14.710581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691b793-c9e8-4df6-a992-ab6499516b74 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:14.736132 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3484/6956] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:52:14.742944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99d35b-6dca-4088-8050-64d3458f8f79 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:14.756668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99d35b-6dca-4088-8050-64d3458f8f79 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:14.784862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3cb27-f4ce-47df-9389-59eda173c6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:14.789277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3cb27-f4ce-47df-9389-59eda173c6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:14.790303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3cb27-f4ce-47df-9389-59eda173c6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:14.791273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3cb27-f4ce-47df-9389-59eda173c6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:14.791979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3cb27-f4ce-47df-9389-59eda173c6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:14.801609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3cb27-f4ce-47df-9389-59eda173c6d5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:14.843363 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3473/6957] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:52:14.844964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691b793-c9e8-4df6-a992-ab6499516b74 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:14.857238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691b793-c9e8-4df6-a992-ab6499516b74 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:14.875223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84560131-3ded-4e19-a52f-3aeecd99c9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:14.876183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84560131-3ded-4e19-a52f-3aeecd99c9e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:14.876472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84560131-3ded-4e19-a52f-3aeecd99c9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:14.876754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84560131-3ded-4e19-a52f-3aeecd99c9e4 admin admin] PATH_INFO: `/v3/projects/a5e1b2405a3d4d5b8c66efa9dad94750/users/208fa2580bc04c66a14e4ef617c1a830/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:14.914291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84560131-3ded-4e19-a52f-3aeecd99c9e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e1b2405a3d4d5b8c66efa9dad94750, user_id=208fa2580bc04c66a14e4ef617c1a830, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:14.926654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84560131-3ded-4e19-a52f-3aeecd99c9e4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:15.073800 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3485/6958] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:52:14 2022] PUT /identity/v3/projects/a5e1b2405a3d4d5b8c66efa9dad94750/users/208fa2580bc04c66a14e4ef617c1a830/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:52:15.084644 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db78e8-27ca-4db5-8c9d-774c75d8fd84 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:15.084964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db78e8-27ca-4db5-8c9d-774c75d8fd84 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:15.085225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db78e8-27ca-4db5-8c9d-774c75d8fd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:15.142847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b8db78e8-27ca-4db5-8c9d-774c75d8fd84 None None] MFA Rules not processed for user `208fa2580bc04c66a14e4ef617c1a830`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:52:15.144117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b8db78e8-27ca-4db5-8c9d-774c75d8fd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:15.308994 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3474/6959] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:52:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:52:15.358813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84560131-3ded-4e19-a52f-3aeecd99c9e4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:15.360727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-84560131-3ded-4e19-a52f-3aeecd99c9e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:15.539059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84560131-3ded-4e19-a52f-3aeecd99c9e4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:15.563020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23accf15-0d6b-49ad-b99f-b0e0e6e5d73b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:15.564047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23accf15-0d6b-49ad-b99f-b0e0e6e5d73b service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:15.564409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23accf15-0d6b-49ad-b99f-b0e0e6e5d73b service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:15.564752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23accf15-0d6b-49ad-b99f-b0e0e6e5d73b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:15.591089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23accf15-0d6b-49ad-b99f-b0e0e6e5d73b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:15.592681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23accf15-0d6b-49ad-b99f-b0e0e6e5d73b service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:15.627811 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3486/6960] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:52:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:52:16.354546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db78e8-27ca-4db5-8c9d-774c75d8fd84 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:16.356117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b8db78e8-27ca-4db5-8c9d-774c75d8fd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:16.497893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db78e8-27ca-4db5-8c9d-774c75d8fd84 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:16.519463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b854c5-04c0-4a7d-8055-6e0fdad47221 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:16.519463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b854c5-04c0-4a7d-8055-6e0fdad47221 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:16.519463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b854c5-04c0-4a7d-8055-6e0fdad47221 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:16.519463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b854c5-04c0-4a7d-8055-6e0fdad47221 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:16.519842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-30b854c5-04c0-4a7d-8055-6e0fdad47221 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:16.564777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b854c5-04c0-4a7d-8055-6e0fdad47221 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:16.569743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b854c5-04c0-4a7d-8055-6e0fdad47221 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:16.616183 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3475/6961] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:52:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:52:22.809718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23accf15-0d6b-49ad-b99f-b0e0e6e5d73b service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:22.823317 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23accf15-0d6b-49ad-b99f-b0e0e6e5d73b service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:22.841116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b854c5-04c0-4a7d-8055-6e0fdad47221 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:22.847039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352eb11-b170-4d4f-89e1-679ca29a91e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:22.849486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352eb11-b170-4d4f-89e1-679ca29a91e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:22.849486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352eb11-b170-4d4f-89e1-679ca29a91e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:22.849486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352eb11-b170-4d4f-89e1-679ca29a91e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:22.851540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0352eb11-b170-4d4f-89e1-679ca29a91e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:22.869415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352eb11-b170-4d4f-89e1-679ca29a91e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:22.871210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352eb11-b170-4d4f-89e1-679ca29a91e2 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:22.886678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b854c5-04c0-4a7d-8055-6e0fdad47221 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:22.895454 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3487/6962] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:52:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:52:22.906870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6292f3-f527-4b59-b8ad-a67747eeb510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:22.907517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6292f3-f527-4b59-b8ad-a67747eeb510 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:22.910753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6292f3-f527-4b59-b8ad-a67747eeb510 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:22.910753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6292f3-f527-4b59-b8ad-a67747eeb510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:22.918274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ad6292f3-f527-4b59-b8ad-a67747eeb510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:22.968992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:23.051109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6292f3-f527-4b59-b8ad-a67747eeb510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:23.053051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6292f3-f527-4b59-b8ad-a67747eeb510 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:23.076910 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3476/6963] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:52:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:52:27.148735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352eb11-b170-4d4f-89e1-679ca29a91e2 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:27.151108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0352eb11-b170-4d4f-89e1-679ca29a91e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:27.256853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:27.331488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352eb11-b170-4d4f-89e1-679ca29a91e2 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:27.340354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b887e0-3896-4f37-bcb3-6ec04170931a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:27.340988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b887e0-3896-4f37-bcb3-6ec04170931a service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:27.341508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b887e0-3896-4f37-bcb3-6ec04170931a service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:27.341945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b887e0-3896-4f37-bcb3-6ec04170931a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:27.344025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a1b887e0-3896-4f37-bcb3-6ec04170931a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:27.371203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b887e0-3896-4f37-bcb3-6ec04170931a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:27.374166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b887e0-3896-4f37-bcb3-6ec04170931a service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:27.404735 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3488/6964] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:52:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:52:29.108110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6292f3-f527-4b59-b8ad-a67747eeb510 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:29.109628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ad6292f3-f527-4b59-b8ad-a67747eeb510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:29.244655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6292f3-f527-4b59-b8ad-a67747eeb510 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:29.249508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371172cb-a01d-4523-b0aa-db2f2a18af2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:29.250234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371172cb-a01d-4523-b0aa-db2f2a18af2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:29.250557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371172cb-a01d-4523-b0aa-db2f2a18af2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:29.250770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371172cb-a01d-4523-b0aa-db2f2a18af2f admin admin] PATH_INFO: `/v3/users/1ed17cf2e6ed4874a68fce1bf1be6efb` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:29.252156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371172cb-a01d-4523-b0aa-db2f2a18af2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ed17cf2e6ed4874a68fce1bf1be6efb)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:29.254234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371172cb-a01d-4523-b0aa-db2f2a18af2f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:29.467417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-371172cb-a01d-4523-b0aa-db2f2a18af2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ed17cf2e6ed4874a68fce1bf1be6efb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:29.468424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-371172cb-a01d-4523-b0aa-db2f2a18af2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ed17cf2e6ed4874a68fce1bf1be6efb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:29.486182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-371172cb-a01d-4523-b0aa-db2f2a18af2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ed17cf2e6ed4874a68fce1bf1be6efb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:29.511033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-371172cb-a01d-4523-b0aa-db2f2a18af2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ed17cf2e6ed4874a68fce1bf1be6efb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:29.519657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-371172cb-a01d-4523-b0aa-db2f2a18af2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ed17cf2e6ed4874a68fce1bf1be6efb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:29.675933 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3477/6965] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:52:29 2022] DELETE /identity/v3/users/1ed17cf2e6ed4874a68fce1bf1be6efb => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:52:29.678631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3a34f-4ca9-4d1c-be9f-c067f71dcedd None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:29.679130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3a34f-4ca9-4d1c-be9f-c067f71dcedd None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:29.679219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3a34f-4ca9-4d1c-be9f-c067f71dcedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:29.720183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-94c3a34f-4ca9-4d1c-be9f-c067f71dcedd None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:52:29.721852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-94c3a34f-4ca9-4d1c-be9f-c067f71dcedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:29.826284 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3489/6966] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:52:29.841555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371172cb-a01d-4523-b0aa-db2f2a18af2f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:29.846468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-371172cb-a01d-4523-b0aa-db2f2a18af2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:29.976632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:30.016253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371172cb-a01d-4523-b0aa-db2f2a18af2f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:30.035142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa40db-fcc7-4540-8fcb-be657baf8b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:30.035142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa40db-fcc7-4540-8fcb-be657baf8b10 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:30.035142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa40db-fcc7-4540-8fcb-be657baf8b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:30.035142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa40db-fcc7-4540-8fcb-be657baf8b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:30.048483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa40db-fcc7-4540-8fcb-be657baf8b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:30.050239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa40db-fcc7-4540-8fcb-be657baf8b10 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:30.066490 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3478/6967] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:52:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:52:31.497341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3a34f-4ca9-4d1c-be9f-c067f71dcedd None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:31.499391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-94c3a34f-4ca9-4d1c-be9f-c067f71dcedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:31.515486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3a34f-4ca9-4d1c-be9f-c067f71dcedd None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:31.520975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3a71f-553b-4d1c-9ab6-a3724c75ae4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:31.521883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3a71f-553b-4d1c-9ab6-a3724c75ae4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:31.522321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3a71f-553b-4d1c-9ab6-a3724c75ae4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:31.522843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3a71f-553b-4d1c-9ab6-a3724c75ae4e admin admin] PATH_INFO: `/v3/projects/ba902eecffdc4d849b377b79e6c71079` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:31.524085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3a71f-553b-4d1c-9ab6-a3724c75ae4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba902eecffdc4d849b377b79e6c71079)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:31.526248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3a71f-553b-4d1c-9ab6-a3724c75ae4e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:31.680196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fbc3a71f-553b-4d1c-9ab6-a3724c75ae4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba902eecffdc4d849b377b79e6c71079', 'request_id': 'req-fbc3a71f-553b-4d1c-9ab6-a3724c75ae4e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:31.781588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fbc3a71f-553b-4d1c-9ab6-a3724c75ae4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba902eecffdc4d849b377b79e6c71079', 'request_id': 'req-fbc3a71f-553b-4d1c-9ab6-a3724c75ae4e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:31.792631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fbc3a71f-553b-4d1c-9ab6-a3724c75ae4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba902eecffdc4d849b377b79e6c71079', 'request_id': 'req-fbc3a71f-553b-4d1c-9ab6-a3724c75ae4e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:31.819114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fbc3a71f-553b-4d1c-9ab6-a3724c75ae4e admin admin] The token cache is being invalidate because project ba902eecffdc4d849b377b79e6c71079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:52:31.820246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fbc3a71f-553b-4d1c-9ab6-a3724c75ae4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:31.821160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fbc3a71f-553b-4d1c-9ab6-a3724c75ae4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:31.823298 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3490/6968] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:52:31 2022] DELETE /identity/v3/projects/ba902eecffdc4d849b377b79e6c71079 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:52:31.829036 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a19899-02ca-4a0f-8d4a-54d0818d5ce7 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:31.830234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a19899-02ca-4a0f-8d4a-54d0818d5ce7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:31.830666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a19899-02ca-4a0f-8d4a-54d0818d5ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:31.855208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c6a19899-02ca-4a0f-8d4a-54d0818d5ce7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:52:31.867904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c6a19899-02ca-4a0f-8d4a-54d0818d5ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:31.973277 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3479/6969] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:52:32.088429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3440d24-0d69-4863-b9b2-045d500ce17d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:32.089114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3440d24-0d69-4863-b9b2-045d500ce17d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:32.089607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3440d24-0d69-4863-b9b2-045d500ce17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:32.129592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d3440d24-0d69-4863-b9b2-045d500ce17d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:52:32.131198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d3440d24-0d69-4863-b9b2-045d500ce17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:32.150349 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3491/6970] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:52:32.165799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a19899-02ca-4a0f-8d4a-54d0818d5ce7 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:32.178153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a19899-02ca-4a0f-8d4a-54d0818d5ce7 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:32.208842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e4cdc-9a15-4888-bd8d-088d026fbfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:32.209481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e4cdc-9a15-4888-bd8d-088d026fbfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:32.209764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e4cdc-9a15-4888-bd8d-088d026fbfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:32.210067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e4cdc-9a15-4888-bd8d-088d026fbfc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:32.210735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e4cdc-9a15-4888-bd8d-088d026fbfc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:52:32.211037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e4cdc-9a15-4888-bd8d-088d026fbfc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:32.213614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e4cdc-9a15-4888-bd8d-088d026fbfc6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:32.230720 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3480/6971] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:52:32.237775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3440d24-0d69-4863-b9b2-045d500ce17d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:32.248458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3440d24-0d69-4863-b9b2-045d500ce17d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:32.255307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cdb682-2863-45d3-a6a0-db204ee7e4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:32.256427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdb682-2863-45d3-a6a0-db204ee7e4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:32.256871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdb682-2863-45d3-a6a0-db204ee7e4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:32.257314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdb682-2863-45d3-a6a0-db204ee7e4d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:32.258165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cdb682-2863-45d3-a6a0-db204ee7e4d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:32.260962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cdb682-2863-45d3-a6a0-db204ee7e4d4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:32.410516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e4cdc-9a15-4888-bd8d-088d026fbfc6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:32.416686 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3492/6972] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:52:32 2022] POST /identity/v3/projects => generated 391 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:52:32.424219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e4cdc-9a15-4888-bd8d-088d026fbfc6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:32.554342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215a9d8-20b1-4c7d-8efc-0aff15a8b9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:32.555143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215a9d8-20b1-4c7d-8efc-0aff15a8b9b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:32.556249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215a9d8-20b1-4c7d-8efc-0aff15a8b9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:32.556651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215a9d8-20b1-4c7d-8efc-0aff15a8b9b3 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:32.557720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215a9d8-20b1-4c7d-8efc-0aff15a8b9b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:32.560096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215a9d8-20b1-4c7d-8efc-0aff15a8b9b3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:32.775547 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3481/6973] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:52:32 2022] POST /identity/v3/users => generated 296 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:52:32.779964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cdb682-2863-45d3-a6a0-db204ee7e4d4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:32.791529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cdb682-2863-45d3-a6a0-db204ee7e4d4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:32.802927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1a63a-debe-4a9c-a0d3-1a4aa06054fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:32.803833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1a63a-debe-4a9c-a0d3-1a4aa06054fd admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:32.804307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1a63a-debe-4a9c-a0d3-1a4aa06054fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:32.804742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1a63a-debe-4a9c-a0d3-1a4aa06054fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:32.807155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1a63a-debe-4a9c-a0d3-1a4aa06054fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:32.809009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1a63a-debe-4a9c-a0d3-1a4aa06054fd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:32.828201 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3493/6974] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:52:32.829305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215a9d8-20b1-4c7d-8efc-0aff15a8b9b3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:32.845779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215a9d8-20b1-4c7d-8efc-0aff15a8b9b3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:32.859920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb82973-8406-4bb6-9197-3a2caef697e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:32.860862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb82973-8406-4bb6-9197-3a2caef697e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:32.861838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb82973-8406-4bb6-9197-3a2caef697e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:32.862263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb82973-8406-4bb6-9197-3a2caef697e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:32.866866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb82973-8406-4bb6-9197-3a2caef697e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:32.868837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb82973-8406-4bb6-9197-3a2caef697e6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:32.896653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1a63a-debe-4a9c-a0d3-1a4aa06054fd admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:32.909469 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3482/6975] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:52:32.913674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1a63a-debe-4a9c-a0d3-1a4aa06054fd admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:32.927764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598ae70-df2b-430d-9f71-a7ebfd508fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:32.929017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598ae70-df2b-430d-9f71-a7ebfd508fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:32.929544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598ae70-df2b-430d-9f71-a7ebfd508fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:32.930017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598ae70-df2b-430d-9f71-a7ebfd508fb9 admin admin] PATH_INFO: `/v3/projects/a432dda4903145278d79210121b3f77d/users/a2ea55b400c24827a28e816ea2a225aa/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:32.993621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:33.006427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598ae70-df2b-430d-9f71-a7ebfd508fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a432dda4903145278d79210121b3f77d, user_id=a2ea55b400c24827a28e816ea2a225aa, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:33.015903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598ae70-df2b-430d-9f71-a7ebfd508fb9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:33.108227 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3494/6976] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:52:32 2022] PUT /identity/v3/projects/a432dda4903145278d79210121b3f77d/users/a2ea55b400c24827a28e816ea2a225aa/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:52:33.119401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325565ad-d5c9-4ae1-b724-d7d95af881cc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:33.120711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325565ad-d5c9-4ae1-b724-d7d95af881cc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:33.121143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325565ad-d5c9-4ae1-b724-d7d95af881cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:33.158921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-325565ad-d5c9-4ae1-b724-d7d95af881cc None None] MFA Rules not processed for user `a2ea55b400c24827a28e816ea2a225aa`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:52:33.160585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-325565ad-d5c9-4ae1-b724-d7d95af881cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:33.238376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:33.273936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598ae70-df2b-430d-9f71-a7ebfd508fb9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:33.277428 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3483/6977] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:52:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:52:33.397795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598ae70-df2b-430d-9f71-a7ebfd508fb9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:33.410856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d4fff-a885-4649-a0da-75971a46eecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:33.412892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d4fff-a885-4649-a0da-75971a46eecc admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:33.413503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d4fff-a885-4649-a0da-75971a46eecc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:33.415362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d4fff-a885-4649-a0da-75971a46eecc admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:33.416390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d4fff-a885-4649-a0da-75971a46eecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:33.434577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d4fff-a885-4649-a0da-75971a46eecc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:33.627605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325565ad-d5c9-4ae1-b724-d7d95af881cc None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:33.638997 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3495/6978] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:52:33 2022] POST /identity/v3/projects => generated 393 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:52:33.642856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325565ad-d5c9-4ae1-b724-d7d95af881cc None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:33.738863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c1cbc-5d01-4411-a936-5abab2526471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:33.740522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c1cbc-5d01-4411-a936-5abab2526471 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:33.741103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c1cbc-5d01-4411-a936-5abab2526471 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:33.741394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c1cbc-5d01-4411-a936-5abab2526471 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:33.742180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c1cbc-5d01-4411-a936-5abab2526471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:33.745279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c1cbc-5d01-4411-a936-5abab2526471 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:33.908926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d4fff-a885-4649-a0da-75971a46eecc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:33.919075 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3484/6979] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:52:33 2022] POST /identity/v3/users => generated 303 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:52:33.927829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d4fff-a885-4649-a0da-75971a46eecc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:33.933940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b4400-a274-4280-822a-8e903230188b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:33.935807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b4400-a274-4280-822a-8e903230188b admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:33.936260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b4400-a274-4280-822a-8e903230188b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:33.936720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b4400-a274-4280-822a-8e903230188b admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:33.937764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b4400-a274-4280-822a-8e903230188b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:33.940066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b4400-a274-4280-822a-8e903230188b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:33.960043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c1cbc-5d01-4411-a936-5abab2526471 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:33.971117 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3496/6980] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:52:33.972752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c1cbc-5d01-4411-a936-5abab2526471 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:33.986188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985a4b4-bc01-45b2-ae31-bfe9951eb6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:33.987446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985a4b4-bc01-45b2-ae31-bfe9951eb6e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:33.988217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985a4b4-bc01-45b2-ae31-bfe9951eb6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:33.988670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985a4b4-bc01-45b2-ae31-bfe9951eb6e8 admin admin] PATH_INFO: `/v3/projects/ae9151e0cac8482384bd1629d6227841/users/b4c62e547884403f8f5f4820a845c757/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:34.022083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985a4b4-bc01-45b2-ae31-bfe9951eb6e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9151e0cac8482384bd1629d6227841, user_id=b4c62e547884403f8f5f4820a845c757, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:34.029151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985a4b4-bc01-45b2-ae31-bfe9951eb6e8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:34.125531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b4400-a274-4280-822a-8e903230188b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:34.144703 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3485/6981] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:52:33 2022] PUT /identity/v3/projects/ae9151e0cac8482384bd1629d6227841/users/b4c62e547884403f8f5f4820a845c757/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:52:34.153367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b4400-a274-4280-822a-8e903230188b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:34.279037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92dd79a-1472-4b34-9859-74d602a6e45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:34.280539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dd79a-1472-4b34-9859-74d602a6e45f admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:34.281693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dd79a-1472-4b34-9859-74d602a6e45f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:34.282695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dd79a-1472-4b34-9859-74d602a6e45f admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:34.283770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92dd79a-1472-4b34-9859-74d602a6e45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:34.287299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92dd79a-1472-4b34-9859-74d602a6e45f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:34.308612 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3497/6982] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:52:34.319416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985a4b4-bc01-45b2-ae31-bfe9951eb6e8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:34.335658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985a4b4-bc01-45b2-ae31-bfe9951eb6e8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:34.351350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12240c3-a1f4-4957-b1ea-cabe003060c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:34.354377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12240c3-a1f4-4957-b1ea-cabe003060c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:34.356386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12240c3-a1f4-4957-b1ea-cabe003060c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:34.357285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12240c3-a1f4-4957-b1ea-cabe003060c0 admin admin] PATH_INFO: `/v3/projects/ae9151e0cac8482384bd1629d6227841/users/b4c62e547884403f8f5f4820a845c757/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:34.359819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12240c3-a1f4-4957-b1ea-cabe003060c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9151e0cac8482384bd1629d6227841, user_id=b4c62e547884403f8f5f4820a845c757, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:34.363430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12240c3-a1f4-4957-b1ea-cabe003060c0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:34.380059 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3486/6983] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:52:34 2022] PUT /identity/v3/projects/ae9151e0cac8482384bd1629d6227841/users/b4c62e547884403f8f5f4820a845c757/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:52:34.393428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d1797-f108-4dbc-b3f0-b8092c0d5f14 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:34.393428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d1797-f108-4dbc-b3f0-b8092c0d5f14 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:34.393428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d1797-f108-4dbc-b3f0-b8092c0d5f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:34.439537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-7e7d1797-f108-4dbc-b3f0-b8092c0d5f14 None None] MFA Rules not processed for user `b4c62e547884403f8f5f4820a845c757`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:52:34.440745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7e7d1797-f108-4dbc-b3f0-b8092c0d5f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:34.516434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:34.548594 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3498/6984] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:52:34 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:52:34.562823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12240c3-a1f4-4957-b1ea-cabe003060c0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:34.564584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f12240c3-a1f4-4957-b1ea-cabe003060c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:34.678422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12240c3-a1f4-4957-b1ea-cabe003060c0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:34.686293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fa2f3-5dc6-4616-95a4-62030d7a54ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:34.687079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fa2f3-5dc6-4616-95a4-62030d7a54ad service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:34.687711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fa2f3-5dc6-4616-95a4-62030d7a54ad service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:34.688097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fa2f3-5dc6-4616-95a4-62030d7a54ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:34.734296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:34.776641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fa2f3-5dc6-4616-95a4-62030d7a54ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:34.779146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fa2f3-5dc6-4616-95a4-62030d7a54ad service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:34.799648 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3487/6985] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:52:34 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:52:36.603185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d1797-f108-4dbc-b3f0-b8092c0d5f14 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:36.607511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7e7d1797-f108-4dbc-b3f0-b8092c0d5f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:36.653956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d1797-f108-4dbc-b3f0-b8092c0d5f14 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:36.683553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2d01d-10fd-47e4-a854-9dea0253316c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:36.684545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2d01d-10fd-47e4-a854-9dea0253316c service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:36.685055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2d01d-10fd-47e4-a854-9dea0253316c service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:36.685559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2d01d-10fd-47e4-a854-9dea0253316c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:36.692629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-81b2d01d-10fd-47e4-a854-9dea0253316c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:36.721850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2d01d-10fd-47e4-a854-9dea0253316c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:36.729160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2d01d-10fd-47e4-a854-9dea0253316c service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:36.762093 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3499/6986] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:52:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:52:37.799764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fa2f3-5dc6-4616-95a4-62030d7a54ad service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:37.820032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fa2f3-5dc6-4616-95a4-62030d7a54ad service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:37.831486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03faf5ef-66bc-4a68-889d-8c8f81fb8f1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:37.832688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03faf5ef-66bc-4a68-889d-8c8f81fb8f1c service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:37.833204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03faf5ef-66bc-4a68-889d-8c8f81fb8f1c service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:37.833683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03faf5ef-66bc-4a68-889d-8c8f81fb8f1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:37.836232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-03faf5ef-66bc-4a68-889d-8c8f81fb8f1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:37.936962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03faf5ef-66bc-4a68-889d-8c8f81fb8f1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:37.939058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03faf5ef-66bc-4a68-889d-8c8f81fb8f1c service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:37.950432 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3488/6987] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:52:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:52:44.940106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2d01d-10fd-47e4-a854-9dea0253316c service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:44.941902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-81b2d01d-10fd-47e4-a854-9dea0253316c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:45.088261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2d01d-10fd-47e4-a854-9dea0253316c service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:45.101392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f16339-ffba-4dbe-9be1-721848faf9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:45.102742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f16339-ffba-4dbe-9be1-721848faf9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:45.103304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f16339-ffba-4dbe-9be1-721848faf9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:45.103785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f16339-ffba-4dbe-9be1-721848faf9f2 admin admin] PATH_INFO: `/v3/users/b493d4c3f45e4cb6b7a18e40b7ea5f18` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:45.105350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f16339-ffba-4dbe-9be1-721848faf9f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b493d4c3f45e4cb6b7a18e40b7ea5f18)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:45.110655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f16339-ffba-4dbe-9be1-721848faf9f2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:45.385006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-76f16339-ffba-4dbe-9be1-721848faf9f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b493d4c3f45e4cb6b7a18e40b7ea5f18'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:45.386163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-76f16339-ffba-4dbe-9be1-721848faf9f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b493d4c3f45e4cb6b7a18e40b7ea5f18'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:45.401030 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-76f16339-ffba-4dbe-9be1-721848faf9f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b493d4c3f45e4cb6b7a18e40b7ea5f18'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:45.421783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-76f16339-ffba-4dbe-9be1-721848faf9f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b493d4c3f45e4cb6b7a18e40b7ea5f18'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:45.538954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-76f16339-ffba-4dbe-9be1-721848faf9f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b493d4c3f45e4cb6b7a18e40b7ea5f18'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:45.550751 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3500/6988] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:52:44 2022] DELETE /identity/v3/users/b493d4c3f45e4cb6b7a18e40b7ea5f18 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:52:45.553433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dbe2c-e23d-4635-8148-ac47425691af None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:45.554327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dbe2c-e23d-4635-8148-ac47425691af None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:45.554915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dbe2c-e23d-4635-8148-ac47425691af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:45.596089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-de4dbe2c-e23d-4635-8148-ac47425691af None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:52:45.597666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-de4dbe2c-e23d-4635-8148-ac47425691af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:45.743829 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3489/6989] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:52:45.772944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f16339-ffba-4dbe-9be1-721848faf9f2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:45.775642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-76f16339-ffba-4dbe-9be1-721848faf9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:45.789721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dbe2c-e23d-4635-8148-ac47425691af None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:45.791743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-de4dbe2c-e23d-4635-8148-ac47425691af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:45.798566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f16339-ffba-4dbe-9be1-721848faf9f2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:45.812453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeadd62-e827-4595-bb9b-0352b9113d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:45.813581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeadd62-e827-4595-bb9b-0352b9113d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:45.816089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeadd62-e827-4595-bb9b-0352b9113d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:45.816089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeadd62-e827-4595-bb9b-0352b9113d32 admin admin] PATH_INFO: `/v3/users/e97034f23aa644ffb6bb7f599ca60403` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:45.816542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeadd62-e827-4595-bb9b-0352b9113d32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e97034f23aa644ffb6bb7f599ca60403)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:45.819919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeadd62-e827-4595-bb9b-0352b9113d32 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:45.891413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dbe2c-e23d-4635-8148-ac47425691af None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:45.897579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf58f4-837b-4e09-ac36-fe8ea23a3823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:45.898710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf58f4-837b-4e09-ac36-fe8ea23a3823 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:45.899162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf58f4-837b-4e09-ac36-fe8ea23a3823 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:45.899601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf58f4-837b-4e09-ac36-fe8ea23a3823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:45.928472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf58f4-837b-4e09-ac36-fe8ea23a3823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:45.930382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf58f4-837b-4e09-ac36-fe8ea23a3823 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:45.953946 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3490/6990] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:52:46.091018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:46.095421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5eeadd62-e827-4595-bb9b-0352b9113d32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e97034f23aa644ffb6bb7f599ca60403'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:46.096449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5eeadd62-e827-4595-bb9b-0352b9113d32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e97034f23aa644ffb6bb7f599ca60403'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:46.121031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5eeadd62-e827-4595-bb9b-0352b9113d32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e97034f23aa644ffb6bb7f599ca60403'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:46.144589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5eeadd62-e827-4595-bb9b-0352b9113d32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e97034f23aa644ffb6bb7f599ca60403'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:46.257329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5eeadd62-e827-4595-bb9b-0352b9113d32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e97034f23aa644ffb6bb7f599ca60403'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:46.276660 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3501/6991] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:52:45 2022] DELETE /identity/v3/users/e97034f23aa644ffb6bb7f599ca60403 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:52:46.287736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fbfc1-5242-4943-b382-4d4d52984181 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:46.288073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fbfc1-5242-4943-b382-4d4d52984181 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:46.288350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fbfc1-5242-4943-b382-4d4d52984181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:46.321275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ee9fbfc1-5242-4943-b382-4d4d52984181 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:52:46.323330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ee9fbfc1-5242-4943-b382-4d4d52984181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:46.336413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:46.401324 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3491/6992] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:52:46.473623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeadd62-e827-4595-bb9b-0352b9113d32 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:46.475535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5eeadd62-e827-4595-bb9b-0352b9113d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:46.485929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fbfc1-5242-4943-b382-4d4d52984181 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:46.487871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ee9fbfc1-5242-4943-b382-4d4d52984181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:46.521874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fbfc1-5242-4943-b382-4d4d52984181 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:46.544942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8dd80-34f1-47e9-984c-e1e3e8f15491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:46.547100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8dd80-34f1-47e9-984c-e1e3e8f15491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:46.550530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8dd80-34f1-47e9-984c-e1e3e8f15491 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:46.550530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8dd80-34f1-47e9-984c-e1e3e8f15491 admin admin] PATH_INFO: `/v3/projects/150ebe4fc47d40148e10e85228e2e17b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:46.550530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8dd80-34f1-47e9-984c-e1e3e8f15491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=150ebe4fc47d40148e10e85228e2e17b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:46.559497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8dd80-34f1-47e9-984c-e1e3e8f15491 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:46.652171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeadd62-e827-4595-bb9b-0352b9113d32 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:46.659502 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831b9b9-9390-4614-b305-635154b90c3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:46.660032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831b9b9-9390-4614-b305-635154b90c3a service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:46.660533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831b9b9-9390-4614-b305-635154b90c3a service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:46.661539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831b9b9-9390-4614-b305-635154b90c3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:46.697132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831b9b9-9390-4614-b305-635154b90c3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:46.698888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831b9b9-9390-4614-b305-635154b90c3a service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:46.722191 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3502/6993] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:52:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:52:46.800248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b2f8dd80-34f1-47e9-984c-e1e3e8f15491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '150ebe4fc47d40148e10e85228e2e17b', 'request_id': 'req-b2f8dd80-34f1-47e9-984c-e1e3e8f15491'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:46.808828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b2f8dd80-34f1-47e9-984c-e1e3e8f15491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '150ebe4fc47d40148e10e85228e2e17b', 'request_id': 'req-b2f8dd80-34f1-47e9-984c-e1e3e8f15491'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:46.818402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b2f8dd80-34f1-47e9-984c-e1e3e8f15491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '150ebe4fc47d40148e10e85228e2e17b', 'request_id': 'req-b2f8dd80-34f1-47e9-984c-e1e3e8f15491'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:46.937320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b2f8dd80-34f1-47e9-984c-e1e3e8f15491 admin admin] The token cache is being invalidate because project 150ebe4fc47d40148e10e85228e2e17b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:52:46.937749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b2f8dd80-34f1-47e9-984c-e1e3e8f15491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:46.940792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b2f8dd80-34f1-47e9-984c-e1e3e8f15491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:46.944963 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3492/6994] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:52:46 2022] DELETE /identity/v3/projects/150ebe4fc47d40148e10e85228e2e17b => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:52:46.949680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd22e0-b139-4de6-b0ea-2c995bf42ea9 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:46.949974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd22e0-b139-4de6-b0ea-2c995bf42ea9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:46.950283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd22e0-b139-4de6-b0ea-2c995bf42ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:46.984712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-21cd22e0-b139-4de6-b0ea-2c995bf42ea9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:52:46.986532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-21cd22e0-b139-4de6-b0ea-2c995bf42ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:47.171325 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3503/6995] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:52:47.180945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e1979-9bc2-4295-8b26-9cfceb70f5d8 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:47.181246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e1979-9bc2-4295-8b26-9cfceb70f5d8 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:47.181588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e1979-9bc2-4295-8b26-9cfceb70f5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:47.214395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-651e1979-9bc2-4295-8b26-9cfceb70f5d8 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:52:47.217563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-651e1979-9bc2-4295-8b26-9cfceb70f5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:47.253928 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3493/6996] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:52:47.255704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd22e0-b139-4de6-b0ea-2c995bf42ea9 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:47.273370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd22e0-b139-4de6-b0ea-2c995bf42ea9 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:47.293407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aed14a-99ee-4ea2-9295-fd00463c9d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:47.294150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aed14a-99ee-4ea2-9295-fd00463c9d46 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:47.294427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aed14a-99ee-4ea2-9295-fd00463c9d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:47.294717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aed14a-99ee-4ea2-9295-fd00463c9d46 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:47.295986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aed14a-99ee-4ea2-9295-fd00463c9d46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:52:47.296348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aed14a-99ee-4ea2-9295-fd00463c9d46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:47.298906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aed14a-99ee-4ea2-9295-fd00463c9d46 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:47.325267 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3504/6997] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:52:47.329730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e1979-9bc2-4295-8b26-9cfceb70f5d8 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:47.345511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e1979-9bc2-4295-8b26-9cfceb70f5d8 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:47.356394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998b0a4-aff7-46d1-9a51-463434e4d25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:47.356394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998b0a4-aff7-46d1-9a51-463434e4d25f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:47.356394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998b0a4-aff7-46d1-9a51-463434e4d25f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:47.356394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998b0a4-aff7-46d1-9a51-463434e4d25f admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:47.356935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998b0a4-aff7-46d1-9a51-463434e4d25f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:47.358541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998b0a4-aff7-46d1-9a51-463434e4d25f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:47.468891 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3494/6998] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:52:47 2022] POST /identity/v3/projects => generated 389 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:52:47.474086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aed14a-99ee-4ea2-9295-fd00463c9d46 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:47.505472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aed14a-99ee-4ea2-9295-fd00463c9d46 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:47.551942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998b0a4-aff7-46d1-9a51-463434e4d25f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:47.554364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7998b0a4-aff7-46d1-9a51-463434e4d25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:47.659450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd63a1-e322-4654-8310-d220c626d1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:47.660478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd63a1-e322-4654-8310-d220c626d1d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:47.661093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd63a1-e322-4654-8310-d220c626d1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:47.663120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd63a1-e322-4654-8310-d220c626d1d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:47.664200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd63a1-e322-4654-8310-d220c626d1d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:47.666663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd63a1-e322-4654-8310-d220c626d1d6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:47.686213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998b0a4-aff7-46d1-9a51-463434e4d25f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:47.690817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418be3ed-ed59-443e-be9f-68e48c45d967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:47.691676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418be3ed-ed59-443e-be9f-68e48c45d967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:47.692640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418be3ed-ed59-443e-be9f-68e48c45d967 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:47.693030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418be3ed-ed59-443e-be9f-68e48c45d967 admin admin] PATH_INFO: `/v3/projects/b1011bdef619442ab777fd27dfc99265` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:47.694524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418be3ed-ed59-443e-be9f-68e48c45d967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1011bdef619442ab777fd27dfc99265)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:47.696701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418be3ed-ed59-443e-be9f-68e48c45d967 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:47.712788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:47.799207 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3505/6999] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:52:47 2022] POST /identity/v3/users => generated 295 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:52:47.800666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd63a1-e322-4654-8310-d220c626d1d6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:47.837371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd63a1-e322-4654-8310-d220c626d1d6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:47.853318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-418be3ed-ed59-443e-be9f-68e48c45d967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1011bdef619442ab777fd27dfc99265', 'request_id': 'req-418be3ed-ed59-443e-be9f-68e48c45d967'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:47.871863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-418be3ed-ed59-443e-be9f-68e48c45d967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1011bdef619442ab777fd27dfc99265', 'request_id': 'req-418be3ed-ed59-443e-be9f-68e48c45d967'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:47.878816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:47.890819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-418be3ed-ed59-443e-be9f-68e48c45d967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1011bdef619442ab777fd27dfc99265', 'request_id': 'req-418be3ed-ed59-443e-be9f-68e48c45d967'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:47.965135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7de2d-4ec8-4fd2-bfbb-68cd0c91ca77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:47.966110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7de2d-4ec8-4fd2-bfbb-68cd0c91ca77 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:47.966774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7de2d-4ec8-4fd2-bfbb-68cd0c91ca77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:47.966941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7de2d-4ec8-4fd2-bfbb-68cd0c91ca77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:47.968114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7de2d-4ec8-4fd2-bfbb-68cd0c91ca77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:47.970065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7de2d-4ec8-4fd2-bfbb-68cd0c91ca77 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:47.988861 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3506/7000] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:52:47.994985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-418be3ed-ed59-443e-be9f-68e48c45d967 admin admin] The token cache is being invalidate because project b1011bdef619442ab777fd27dfc99265 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:52:48.002379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-418be3ed-ed59-443e-be9f-68e48c45d967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:48.002379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-418be3ed-ed59-443e-be9f-68e48c45d967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:48.002379 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3495/7001] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:52:47 2022] DELETE /identity/v3/projects/b1011bdef619442ab777fd27dfc99265 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:52:48.002693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7de2d-4ec8-4fd2-bfbb-68cd0c91ca77 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:48.003923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-94c7de2d-4ec8-4fd2-bfbb-68cd0c91ca77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:48.006387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418be3ed-ed59-443e-be9f-68e48c45d967 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:48.009843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-418be3ed-ed59-443e-be9f-68e48c45d967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:48.046871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7de2d-4ec8-4fd2-bfbb-68cd0c91ca77 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:48.049491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418be3ed-ed59-443e-be9f-68e48c45d967 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:48.085043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c57de7-45a2-4147-8f33-e3202e33cd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:48.085891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d39114-253e-42a8-aa78-38c1d381f0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:48.091005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c57de7-45a2-4147-8f33-e3202e33cd4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:48.092551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d39114-253e-42a8-aa78-38c1d381f0cb admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:48.092934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c57de7-45a2-4147-8f33-e3202e33cd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:48.093966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d39114-253e-42a8-aa78-38c1d381f0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:48.094748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d39114-253e-42a8-aa78-38c1d381f0cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:48.095082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c57de7-45a2-4147-8f33-e3202e33cd4e admin admin] PATH_INFO: `/v3/users/6262a69ed5c94beaabf44f6cdf7bcf51` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:48.096221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d39114-253e-42a8-aa78-38c1d381f0cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:48.099705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c57de7-45a2-4147-8f33-e3202e33cd4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6262a69ed5c94beaabf44f6cdf7bcf51)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:48.105706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d39114-253e-42a8-aa78-38c1d381f0cb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:48.110079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c57de7-45a2-4147-8f33-e3202e33cd4e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:48.156217 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3507/7002] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:52:48.162396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d39114-253e-42a8-aa78-38c1d381f0cb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:48.208777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d39114-253e-42a8-aa78-38c1d381f0cb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:48.229135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539d643-6a6a-413b-bbdd-c87dabe6f081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:48.230982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539d643-6a6a-413b-bbdd-c87dabe6f081 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:48.236534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539d643-6a6a-413b-bbdd-c87dabe6f081 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:48.236534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539d643-6a6a-413b-bbdd-c87dabe6f081 admin admin] PATH_INFO: `/v3/projects/0f6a52885d8f4cdc86043a36d180be36/users/55946cbad1344d6682d63c6eca830800/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:48.251552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539d643-6a6a-413b-bbdd-c87dabe6f081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f6a52885d8f4cdc86043a36d180be36, user_id=55946cbad1344d6682d63c6eca830800, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:48.262778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539d643-6a6a-413b-bbdd-c87dabe6f081 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:48.391723 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3508/7003] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:52:48 2022] PUT /identity/v3/projects/0f6a52885d8f4cdc86043a36d180be36/users/55946cbad1344d6682d63c6eca830800/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:52:48.400181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8f76e-13e4-4c96-8283-b7baa7df4590 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:48.400743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8f76e-13e4-4c96-8283-b7baa7df4590 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:48.401197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8f76e-13e4-4c96-8283-b7baa7df4590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:48.490283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-3ab8f76e-13e4-4c96-8283-b7baa7df4590 None None] MFA Rules not processed for user `55946cbad1344d6682d63c6eca830800`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:52:48.490873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-09c57de7-45a2-4147-8f33-e3202e33cd4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6262a69ed5c94beaabf44f6cdf7bcf51'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:48.491970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-09c57de7-45a2-4147-8f33-e3202e33cd4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6262a69ed5c94beaabf44f6cdf7bcf51'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:48.494598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3ab8f76e-13e4-4c96-8283-b7baa7df4590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:48.512356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-09c57de7-45a2-4147-8f33-e3202e33cd4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6262a69ed5c94beaabf44f6cdf7bcf51'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:48.552574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-09c57de7-45a2-4147-8f33-e3202e33cd4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6262a69ed5c94beaabf44f6cdf7bcf51'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:48.554539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-09c57de7-45a2-4147-8f33-e3202e33cd4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6262a69ed5c94beaabf44f6cdf7bcf51'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:48.639087 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3509/7004] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:52:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:52:48.664923 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3496/7005] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:52:48 2022] DELETE /identity/v3/users/6262a69ed5c94beaabf44f6cdf7bcf51 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:52:48.665289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8f76e-13e4-4c96-8283-b7baa7df4590 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:48.666792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3ab8f76e-13e4-4c96-8283-b7baa7df4590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:48.760805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8f76e-13e4-4c96-8283-b7baa7df4590 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:48.842235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d21766-d080-4e55-ba6f-5048b81d5828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:48.844189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d21766-d080-4e55-ba6f-5048b81d5828 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:48.844551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d21766-d080-4e55-ba6f-5048b81d5828 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:48.844893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d21766-d080-4e55-ba6f-5048b81d5828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:49.001808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d21766-d080-4e55-ba6f-5048b81d5828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:49.005995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d21766-d080-4e55-ba6f-5048b81d5828 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:49.024899 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3510/7006] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:52:48 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:52:49.175479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c57de7-45a2-4147-8f33-e3202e33cd4e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:49.178258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-09c57de7-45a2-4147-8f33-e3202e33cd4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:49.203971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c57de7-45a2-4147-8f33-e3202e33cd4e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:49.221525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fe9ad-735f-4e13-9a87-f515b0c81b9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:49.226646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fe9ad-735f-4e13-9a87-f515b0c81b9f service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:49.231388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fe9ad-735f-4e13-9a87-f515b0c81b9f service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:49.231388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fe9ad-735f-4e13-9a87-f515b0c81b9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:49.240618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-657fe9ad-735f-4e13-9a87-f515b0c81b9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:49.386589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:49.404654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fe9ad-735f-4e13-9a87-f515b0c81b9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:49.406167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fe9ad-735f-4e13-9a87-f515b0c81b9f service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:49.432716 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3497/7007] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:52:49 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:52:50.330646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d21766-d080-4e55-ba6f-5048b81d5828 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:50.332311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e0d21766-d080-4e55-ba6f-5048b81d5828 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:50.447939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d21766-d080-4e55-ba6f-5048b81d5828 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:50.453891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d15022-8e14-4dae-808b-d152c84538c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:50.454703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d15022-8e14-4dae-808b-d152c84538c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:50.456288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d15022-8e14-4dae-808b-d152c84538c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:50.456288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d15022-8e14-4dae-808b-d152c84538c9 admin admin] PATH_INFO: `/v3/projects/1e8217c041684da2aff7a8332ae62538` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:50.457692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d15022-8e14-4dae-808b-d152c84538c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e8217c041684da2aff7a8332ae62538)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:50.460771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d15022-8e14-4dae-808b-d152c84538c9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:50.843363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:50.848188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-94d15022-8e14-4dae-808b-d152c84538c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e8217c041684da2aff7a8332ae62538', 'request_id': 'req-94d15022-8e14-4dae-808b-d152c84538c9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:50.917777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-94d15022-8e14-4dae-808b-d152c84538c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e8217c041684da2aff7a8332ae62538', 'request_id': 'req-94d15022-8e14-4dae-808b-d152c84538c9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:50.932844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-94d15022-8e14-4dae-808b-d152c84538c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e8217c041684da2aff7a8332ae62538', 'request_id': 'req-94d15022-8e14-4dae-808b-d152c84538c9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:50.952931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-94d15022-8e14-4dae-808b-d152c84538c9 admin admin] The token cache is being invalidate because project 1e8217c041684da2aff7a8332ae62538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:52:50.954004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-94d15022-8e14-4dae-808b-d152c84538c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:50.954856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-94d15022-8e14-4dae-808b-d152c84538c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:50.956704 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3511/7008] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:52:50 2022] DELETE /identity/v3/projects/1e8217c041684da2aff7a8332ae62538 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:52:50.961177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fe9ad-735f-4e13-9a87-f515b0c81b9f service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:50.980148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fe9ad-735f-4e13-9a87-f515b0c81b9f service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:50.995463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:51.087640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a0019-2b60-46fe-9c13-08c6b1800354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:51.088306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a0019-2b60-46fe-9c13-08c6b1800354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:51.089044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a0019-2b60-46fe-9c13-08c6b1800354 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:51.089337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a0019-2b60-46fe-9c13-08c6b1800354 admin admin] PATH_INFO: `/v3/users/966cf03c5a564ae3bdef22bb96d37069` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:51.090747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a0019-2b60-46fe-9c13-08c6b1800354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=966cf03c5a564ae3bdef22bb96d37069)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:51.093401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a0019-2b60-46fe-9c13-08c6b1800354 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:51.324765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8a0a0019-2b60-46fe-9c13-08c6b1800354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '966cf03c5a564ae3bdef22bb96d37069'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:51.325617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8a0a0019-2b60-46fe-9c13-08c6b1800354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '966cf03c5a564ae3bdef22bb96d37069'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:51.334423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8a0a0019-2b60-46fe-9c13-08c6b1800354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '966cf03c5a564ae3bdef22bb96d37069'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:51.356562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8a0a0019-2b60-46fe-9c13-08c6b1800354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '966cf03c5a564ae3bdef22bb96d37069'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:51.357316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8a0a0019-2b60-46fe-9c13-08c6b1800354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '966cf03c5a564ae3bdef22bb96d37069'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:51.464688 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3498/7009] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:52:50 2022] DELETE /identity/v3/users/966cf03c5a564ae3bdef22bb96d37069 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:52:53.517201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d15022-8e14-4dae-808b-d152c84538c9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:53.518788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-94d15022-8e14-4dae-808b-d152c84538c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:53.532141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d15022-8e14-4dae-808b-d152c84538c9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:53.640288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88997f6c-c9ba-4b08-b6ae-24ca80077168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:53.647816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88997f6c-c9ba-4b08-b6ae-24ca80077168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:53.647816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88997f6c-c9ba-4b08-b6ae-24ca80077168 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:53.647816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88997f6c-c9ba-4b08-b6ae-24ca80077168 admin admin] PATH_INFO: `/v3/projects/067406e013f34e098f701d272f13139b` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:53.647816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88997f6c-c9ba-4b08-b6ae-24ca80077168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=067406e013f34e098f701d272f13139b)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:53.647816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88997f6c-c9ba-4b08-b6ae-24ca80077168 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:53.819009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-88997f6c-c9ba-4b08-b6ae-24ca80077168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '067406e013f34e098f701d272f13139b', 'request_id': 'req-88997f6c-c9ba-4b08-b6ae-24ca80077168'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:53.889669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-88997f6c-c9ba-4b08-b6ae-24ca80077168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '067406e013f34e098f701d272f13139b', 'request_id': 'req-88997f6c-c9ba-4b08-b6ae-24ca80077168'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:53.899260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-88997f6c-c9ba-4b08-b6ae-24ca80077168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '067406e013f34e098f701d272f13139b', 'request_id': 'req-88997f6c-c9ba-4b08-b6ae-24ca80077168'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:53.922449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-88997f6c-c9ba-4b08-b6ae-24ca80077168 admin admin] The token cache is being invalidate because project 067406e013f34e098f701d272f13139b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:52:53.923008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-88997f6c-c9ba-4b08-b6ae-24ca80077168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:53.928039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-88997f6c-c9ba-4b08-b6ae-24ca80077168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:52:53.929889 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3512/7010] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:52:53 2022] DELETE /identity/v3/projects/067406e013f34e098f701d272f13139b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:52:53.936397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb6053-291b-4391-b7dc-dc5ea565197a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:53.936950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb6053-291b-4391-b7dc-dc5ea565197a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:53.937922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb6053-291b-4391-b7dc-dc5ea565197a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:53.966110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7deb6053-291b-4391-b7dc-dc5ea565197a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:52:53.967735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7deb6053-291b-4391-b7dc-dc5ea565197a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:54.058822 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3499/7011] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:52:54.072295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017077c4-cb61-49a5-9f15-69bc29da4671 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:54.072592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017077c4-cb61-49a5-9f15-69bc29da4671 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:54.081297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017077c4-cb61-49a5-9f15-69bc29da4671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:54.129553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-017077c4-cb61-49a5-9f15-69bc29da4671 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:52:54.135343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-017077c4-cb61-49a5-9f15-69bc29da4671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:54.162657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb6053-291b-4391-b7dc-dc5ea565197a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:54.177436 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3513/7012] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:52:54.193782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb6053-291b-4391-b7dc-dc5ea565197a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:54.204888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdc4aa-bb8d-4e13-b161-356424a9b51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:54.205811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdc4aa-bb8d-4e13-b161-356424a9b51c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:54.206321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdc4aa-bb8d-4e13-b161-356424a9b51c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:54.206983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdc4aa-bb8d-4e13-b161-356424a9b51c admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:54.208426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecdc4aa-bb8d-4e13-b161-356424a9b51c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:52:54.208889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecdc4aa-bb8d-4e13-b161-356424a9b51c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:54.213014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecdc4aa-bb8d-4e13-b161-356424a9b51c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:54.247672 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3500/7013] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:52:54.251319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017077c4-cb61-49a5-9f15-69bc29da4671 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:54.265147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017077c4-cb61-49a5-9f15-69bc29da4671 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:54.290413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8e17a-341e-453e-b556-35af5dd060f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:54.291084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8e17a-341e-453e-b556-35af5dd060f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:54.292749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8e17a-341e-453e-b556-35af5dd060f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:54.293036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8e17a-341e-453e-b556-35af5dd060f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:54.293801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8e17a-341e-453e-b556-35af5dd060f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:54.296493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8e17a-341e-453e-b556-35af5dd060f3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:54.411259 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3514/7014] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:52:54 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:52:54.411566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdc4aa-bb8d-4e13-b161-356424a9b51c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:54.430018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdc4aa-bb8d-4e13-b161-356424a9b51c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:54.447762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:54.549805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285bf84-4b38-4e37-a5bf-f0cc1eb2efbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:54.550921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285bf84-4b38-4e37-a5bf-f0cc1eb2efbf admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:54.551911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285bf84-4b38-4e37-a5bf-f0cc1eb2efbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:54.552260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285bf84-4b38-4e37-a5bf-f0cc1eb2efbf admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:54.553024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285bf84-4b38-4e37-a5bf-f0cc1eb2efbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:54.555240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285bf84-4b38-4e37-a5bf-f0cc1eb2efbf admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:54.684677 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3501/7015] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:52:54 2022] POST /identity/v3/users => generated 288 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:52:54.688706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8e17a-341e-453e-b556-35af5dd060f3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:54.705601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8e17a-341e-453e-b556-35af5dd060f3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:54.711614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16aa5e5-87cf-4150-a357-038bf4dac0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:54.712691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16aa5e5-87cf-4150-a357-038bf4dac0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:54.713132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16aa5e5-87cf-4150-a357-038bf4dac0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:54.713697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16aa5e5-87cf-4150-a357-038bf4dac0e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:54.714859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16aa5e5-87cf-4150-a357-038bf4dac0e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:54.716741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16aa5e5-87cf-4150-a357-038bf4dac0e7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:54.738230 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3515/7016] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:52:54.743071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285bf84-4b38-4e37-a5bf-f0cc1eb2efbf admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:54.757314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285bf84-4b38-4e37-a5bf-f0cc1eb2efbf admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:54.763977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a877a-9a52-4239-8884-17711da15da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:54.764791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a877a-9a52-4239-8884-17711da15da0 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:54.765127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a877a-9a52-4239-8884-17711da15da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:54.765469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a877a-9a52-4239-8884-17711da15da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:54.767469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a877a-9a52-4239-8884-17711da15da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:54.769110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a877a-9a52-4239-8884-17711da15da0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:54.788489 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3502/7017] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:52:54.792062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16aa5e5-87cf-4150-a357-038bf4dac0e7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:54.812490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16aa5e5-87cf-4150-a357-038bf4dac0e7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:54.820805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8170da-d6ad-4016-a870-2ecec7073756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:54.822107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8170da-d6ad-4016-a870-2ecec7073756 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:54.822751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8170da-d6ad-4016-a870-2ecec7073756 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:54.823331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8170da-d6ad-4016-a870-2ecec7073756 admin admin] PATH_INFO: `/v3/projects/987ae0fcb0b34ec189a3c6d884e00ad4/users/d3d5876fcf8845a4b91e7add305a0518/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:54.858552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8170da-d6ad-4016-a870-2ecec7073756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=987ae0fcb0b34ec189a3c6d884e00ad4, user_id=d3d5876fcf8845a4b91e7add305a0518, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:54.863223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8170da-d6ad-4016-a870-2ecec7073756 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:54.983792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:55.009105 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3516/7018] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:52:54 2022] PUT /identity/v3/projects/987ae0fcb0b34ec189a3c6d884e00ad4/users/d3d5876fcf8845a4b91e7add305a0518/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:52:55.021119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa151d-9c66-4f2d-ad91-ee68d85058be None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:55.021687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa151d-9c66-4f2d-ad91-ee68d85058be None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:55.021790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa151d-9c66-4f2d-ad91-ee68d85058be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:55.082309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-95aa151d-9c66-4f2d-ad91-ee68d85058be None None] MFA Rules not processed for user `d3d5876fcf8845a4b91e7add305a0518`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:52:55.084439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-95aa151d-9c66-4f2d-ad91-ee68d85058be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:55.217070 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3503/7019] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:52:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:52:55.222287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8170da-d6ad-4016-a870-2ecec7073756 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:55.352734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8170da-d6ad-4016-a870-2ecec7073756 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:55.358632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eeb883-1e6c-4f6e-a1af-ebb01e8e6129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:55.359330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eeb883-1e6c-4f6e-a1af-ebb01e8e6129 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:55.359668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eeb883-1e6c-4f6e-a1af-ebb01e8e6129 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:55.359942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eeb883-1e6c-4f6e-a1af-ebb01e8e6129 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:55.360580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eeb883-1e6c-4f6e-a1af-ebb01e8e6129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:55.362661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eeb883-1e6c-4f6e-a1af-ebb01e8e6129 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:55.507541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa151d-9c66-4f2d-ad91-ee68d85058be None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:55.508468 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3517/7020] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:52:55 2022] POST /identity/v3/projects => generated 375 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:52:55.525792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa151d-9c66-4f2d-ad91-ee68d85058be None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:55.587438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354300a-4a6a-4354-a972-70effd580e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:55.588069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354300a-4a6a-4354-a972-70effd580e22 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:55.588426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354300a-4a6a-4354-a972-70effd580e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:55.588785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354300a-4a6a-4354-a972-70effd580e22 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:55.589489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354300a-4a6a-4354-a972-70effd580e22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:55.591543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354300a-4a6a-4354-a972-70effd580e22 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:55.677788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eeb883-1e6c-4f6e-a1af-ebb01e8e6129 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:55.679023 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3504/7021] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:52:55 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:52:55.693071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eeb883-1e6c-4f6e-a1af-ebb01e8e6129 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:55.702955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214710ed-a9c3-443c-8383-0fbe3229d2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:55.705969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214710ed-a9c3-443c-8383-0fbe3229d2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:55.706495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214710ed-a9c3-443c-8383-0fbe3229d2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:55.706966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214710ed-a9c3-443c-8383-0fbe3229d2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:55.709718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214710ed-a9c3-443c-8383-0fbe3229d2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:55.711820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214710ed-a9c3-443c-8383-0fbe3229d2e4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:55.742355 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3518/7022] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:52:55.743926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354300a-4a6a-4354-a972-70effd580e22 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:55.764199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354300a-4a6a-4354-a972-70effd580e22 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:55.774286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90bb48-5eef-4718-951f-28ba4c6311c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:55.775432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90bb48-5eef-4718-951f-28ba4c6311c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:55.775897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90bb48-5eef-4718-951f-28ba4c6311c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:55.776338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90bb48-5eef-4718-951f-28ba4c6311c5 admin admin] PATH_INFO: `/v3/projects/f04ae48318dc4eb7811727f263df1b4e/users/a524bd87f8ac4cb983834e437d0cc47e/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:55.816804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90bb48-5eef-4718-951f-28ba4c6311c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f04ae48318dc4eb7811727f263df1b4e, user_id=a524bd87f8ac4cb983834e437d0cc47e, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:55.819743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90bb48-5eef-4718-951f-28ba4c6311c5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:55.928796 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3505/7023] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:52:55 2022] PUT /identity/v3/projects/f04ae48318dc4eb7811727f263df1b4e/users/a524bd87f8ac4cb983834e437d0cc47e/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:52:55.932925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214710ed-a9c3-443c-8383-0fbe3229d2e4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:55.946628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214710ed-a9c3-443c-8383-0fbe3229d2e4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:56.090835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543bb64-67a9-4d6b-8ee4-b3e7ac7aee53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:56.092093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543bb64-67a9-4d6b-8ee4-b3e7ac7aee53 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:56.097196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543bb64-67a9-4d6b-8ee4-b3e7ac7aee53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:56.097196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543bb64-67a9-4d6b-8ee4-b3e7ac7aee53 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:56.097196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543bb64-67a9-4d6b-8ee4-b3e7ac7aee53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:56.097196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543bb64-67a9-4d6b-8ee4-b3e7ac7aee53 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:56.111791 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3519/7024] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:52:56.120562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90bb48-5eef-4718-951f-28ba4c6311c5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:56.158782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90bb48-5eef-4718-951f-28ba4c6311c5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:56.168888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2cc93-ba18-4ac4-8987-37cd82d56fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:56.168888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2cc93-ba18-4ac4-8987-37cd82d56fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:56.168888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2cc93-ba18-4ac4-8987-37cd82d56fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:56.175519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2cc93-ba18-4ac4-8987-37cd82d56fa2 admin admin] PATH_INFO: `/v3/projects/f04ae48318dc4eb7811727f263df1b4e/users/a524bd87f8ac4cb983834e437d0cc47e/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:56.183522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2cc93-ba18-4ac4-8987-37cd82d56fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f04ae48318dc4eb7811727f263df1b4e, user_id=a524bd87f8ac4cb983834e437d0cc47e, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:56.186523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2cc93-ba18-4ac4-8987-37cd82d56fa2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:56.205278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:56.218116 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3506/7025] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:52:56 2022] PUT /identity/v3/projects/f04ae48318dc4eb7811727f263df1b4e/users/a524bd87f8ac4cb983834e437d0cc47e/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:52:56.223649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25e9cf-899a-4a6e-a213-e7dc29fe547c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:56.224024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25e9cf-899a-4a6e-a213-e7dc29fe547c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:56.224373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25e9cf-899a-4a6e-a213-e7dc29fe547c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:56.259063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9c25e9cf-899a-4a6e-a213-e7dc29fe547c None None] MFA Rules not processed for user `a524bd87f8ac4cb983834e437d0cc47e`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:52:56.272307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9c25e9cf-899a-4a6e-a213-e7dc29fe547c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:56.355543 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3520/7026] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:52:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:52:56.380618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2cc93-ba18-4ac4-8987-37cd82d56fa2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:56.384053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-28e2cc93-ba18-4ac4-8987-37cd82d56fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:56.511216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2cc93-ba18-4ac4-8987-37cd82d56fa2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:56.515537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fb20f-f5dd-40f5-9a0f-d470c7a889b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:56.516369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fb20f-f5dd-40f5-9a0f-d470c7a889b0 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:56.516655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fb20f-f5dd-40f5-9a0f-d470c7a889b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:56.516935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fb20f-f5dd-40f5-9a0f-d470c7a889b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:56.530477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fb20f-f5dd-40f5-9a0f-d470c7a889b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:56.532054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fb20f-f5dd-40f5-9a0f-d470c7a889b0 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:56.543935 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3507/7027] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:52:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:52:57.151723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:57.494248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf48ee2-7cdd-4052-8bc1-2839e4df21ed None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:57.502588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf48ee2-7cdd-4052-8bc1-2839e4df21ed None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:57.504779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf48ee2-7cdd-4052-8bc1-2839e4df21ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:57.574766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9cf48ee2-7cdd-4052-8bc1-2839e4df21ed None None] MFA Rules not processed for user `a2ea55b400c24827a28e816ea2a225aa`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:52:57.576028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9cf48ee2-7cdd-4052-8bc1-2839e4df21ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:57.747524 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3521/7028] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:52:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:52:59.033684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fb20f-f5dd-40f5-9a0f-d470c7a889b0 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:52:59.035716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e30fb20f-f5dd-40f5-9a0f-d470c7a889b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:59.056811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fb20f-f5dd-40f5-9a0f-d470c7a889b0 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:52:59.069799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcfd9b8-4b2a-465f-b4e5-8b4407a45a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:52:59.070485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfd9b8-4b2a-465f-b4e5-8b4407a45a7d service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:52:59.070777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfd9b8-4b2a-465f-b4e5-8b4407a45a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:52:59.071059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfd9b8-4b2a-465f-b4e5-8b4407a45a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:52:59.077860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6dcfd9b8-4b2a-465f-b4e5-8b4407a45a7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:52:59.107416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcfd9b8-4b2a-465f-b4e5-8b4407a45a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:52:59.109156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcfd9b8-4b2a-465f-b4e5-8b4407a45a7d service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:52:59.126999 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3508/7029] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:52:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:02.758649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf48ee2-7cdd-4052-8bc1-2839e4df21ed None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:02.893439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf48ee2-7cdd-4052-8bc1-2839e4df21ed None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:02.902761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7129d-d61f-4b95-a872-d23209f5bc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:02.903713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7129d-d61f-4b95-a872-d23209f5bc93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:02.904164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7129d-d61f-4b95-a872-d23209f5bc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:02.904648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7129d-d61f-4b95-a872-d23209f5bc93 admin admin] PATH_INFO: `/v3/users/d3d5876fcf8845a4b91e7add305a0518` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:02.906063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7129d-d61f-4b95-a872-d23209f5bc93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3d5876fcf8845a4b91e7add305a0518)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:02.909873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7129d-d61f-4b95-a872-d23209f5bc93 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:03.177876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cea7129d-d61f-4b95-a872-d23209f5bc93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3d5876fcf8845a4b91e7add305a0518'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:03.193183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cea7129d-d61f-4b95-a872-d23209f5bc93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3d5876fcf8845a4b91e7add305a0518'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:03.235993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cea7129d-d61f-4b95-a872-d23209f5bc93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3d5876fcf8845a4b91e7add305a0518'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:03.275045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cea7129d-d61f-4b95-a872-d23209f5bc93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3d5876fcf8845a4b91e7add305a0518'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:03.375122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cea7129d-d61f-4b95-a872-d23209f5bc93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3d5876fcf8845a4b91e7add305a0518'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:03.390670 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3522/7030] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:53:02 2022] DELETE /identity/v3/users/d3d5876fcf8845a4b91e7add305a0518 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:03.392625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4622045-f6f2-4d5d-88e8-63a5f856716d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:03.393080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4622045-f6f2-4d5d-88e8-63a5f856716d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:03.393181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4622045-f6f2-4d5d-88e8-63a5f856716d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:03.423231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d4622045-f6f2-4d5d-88e8-63a5f856716d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:03.425031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d4622045-f6f2-4d5d-88e8-63a5f856716d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:03.514923 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3509/7031] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:53:03.526532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7129d-d61f-4b95-a872-d23209f5bc93 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:03.529037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cea7129d-d61f-4b95-a872-d23209f5bc93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:03.623660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:03.706833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7129d-d61f-4b95-a872-d23209f5bc93 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:03.711909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc1017-f03d-41a5-a51e-704a9dba13c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:03.713155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc1017-f03d-41a5-a51e-704a9dba13c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:03.713155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc1017-f03d-41a5-a51e-704a9dba13c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:03.713408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc1017-f03d-41a5-a51e-704a9dba13c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:03.736158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc1017-f03d-41a5-a51e-704a9dba13c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:03.738708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc1017-f03d-41a5-a51e-704a9dba13c5 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:03.760698 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3523/7032] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:05.217059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4622045-f6f2-4d5d-88e8-63a5f856716d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:05.218798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d4622045-f6f2-4d5d-88e8-63a5f856716d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:05.253229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4622045-f6f2-4d5d-88e8-63a5f856716d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:05.268286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86d7b3-d808-48d0-befc-d6eb6d03bf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:05.269216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86d7b3-d808-48d0-befc-d6eb6d03bf37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:05.269770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86d7b3-d808-48d0-befc-d6eb6d03bf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:05.270079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86d7b3-d808-48d0-befc-d6eb6d03bf37 admin admin] PATH_INFO: `/v3/projects/987ae0fcb0b34ec189a3c6d884e00ad4` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:05.272633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86d7b3-d808-48d0-befc-d6eb6d03bf37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=987ae0fcb0b34ec189a3c6d884e00ad4)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:05.275375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86d7b3-d808-48d0-befc-d6eb6d03bf37 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:05.459590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2e86d7b3-d808-48d0-befc-d6eb6d03bf37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '987ae0fcb0b34ec189a3c6d884e00ad4', 'request_id': 'req-2e86d7b3-d808-48d0-befc-d6eb6d03bf37'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:05.487685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2e86d7b3-d808-48d0-befc-d6eb6d03bf37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '987ae0fcb0b34ec189a3c6d884e00ad4', 'request_id': 'req-2e86d7b3-d808-48d0-befc-d6eb6d03bf37'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:05.502160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:05.510796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2e86d7b3-d808-48d0-befc-d6eb6d03bf37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '987ae0fcb0b34ec189a3c6d884e00ad4', 'request_id': 'req-2e86d7b3-d808-48d0-befc-d6eb6d03bf37'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:05.624567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2e86d7b3-d808-48d0-befc-d6eb6d03bf37 admin admin] The token cache is being invalidate because project 987ae0fcb0b34ec189a3c6d884e00ad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:53:05.625336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2e86d7b3-d808-48d0-befc-d6eb6d03bf37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:05.626698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2e86d7b3-d808-48d0-befc-d6eb6d03bf37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:05.631375 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3510/7033] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:53:05 2022] DELETE /identity/v3/projects/987ae0fcb0b34ec189a3c6d884e00ad4 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:05.635236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc1017-f03d-41a5-a51e-704a9dba13c5 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:05.651025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc1017-f03d-41a5-a51e-704a9dba13c5 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:05.808828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7cd18-5cb0-4a09-a79e-acdc82e0c3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:05.810187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7cd18-5cb0-4a09-a79e-acdc82e0c3eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:05.810701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7cd18-5cb0-4a09-a79e-acdc82e0c3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:05.811213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7cd18-5cb0-4a09-a79e-acdc82e0c3eb admin admin] PATH_INFO: `/v3/users/a524bd87f8ac4cb983834e437d0cc47e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:05.816261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7cd18-5cb0-4a09-a79e-acdc82e0c3eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a524bd87f8ac4cb983834e437d0cc47e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:05.823935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7cd18-5cb0-4a09-a79e-acdc82e0c3eb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:06.110705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-65a7cd18-5cb0-4a09-a79e-acdc82e0c3eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a524bd87f8ac4cb983834e437d0cc47e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:06.114673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-65a7cd18-5cb0-4a09-a79e-acdc82e0c3eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a524bd87f8ac4cb983834e437d0cc47e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:06.156123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-65a7cd18-5cb0-4a09-a79e-acdc82e0c3eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a524bd87f8ac4cb983834e437d0cc47e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:06.196195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-65a7cd18-5cb0-4a09-a79e-acdc82e0c3eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a524bd87f8ac4cb983834e437d0cc47e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:06.290201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-65a7cd18-5cb0-4a09-a79e-acdc82e0c3eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a524bd87f8ac4cb983834e437d0cc47e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:06.304526 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3524/7034] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:53:05 2022] DELETE /identity/v3/users/a524bd87f8ac4cb983834e437d0cc47e => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:08.022126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86d7b3-d808-48d0-befc-d6eb6d03bf37 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:08.024314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2e86d7b3-d808-48d0-befc-d6eb6d03bf37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:08.149607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86d7b3-d808-48d0-befc-d6eb6d03bf37 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:08.225503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7bb6f-cc5f-44df-9a58-9704d7148a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:08.226308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7bb6f-cc5f-44df-9a58-9704d7148a89 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:08.226712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7bb6f-cc5f-44df-9a58-9704d7148a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:08.227086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7bb6f-cc5f-44df-9a58-9704d7148a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:08.229290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e6b7bb6f-cc5f-44df-9a58-9704d7148a89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:08.243930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7bb6f-cc5f-44df-9a58-9704d7148a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:08.245629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7bb6f-cc5f-44df-9a58-9704d7148a89 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:08.259953 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3511/7035] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:08.388835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7cd18-5cb0-4a09-a79e-acdc82e0c3eb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:08.393443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-65a7cd18-5cb0-4a09-a79e-acdc82e0c3eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:08.486437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:08.525725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7cd18-5cb0-4a09-a79e-acdc82e0c3eb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:08.540290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bc24e-99ef-4b14-bc85-035b4a27e2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:08.540959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bc24e-99ef-4b14-bc85-035b4a27e2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:08.541247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bc24e-99ef-4b14-bc85-035b4a27e2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:08.541527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bc24e-99ef-4b14-bc85-035b4a27e2e4 admin admin] PATH_INFO: `/v3/projects/f04ae48318dc4eb7811727f263df1b4e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:08.544568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bc24e-99ef-4b14-bc85-035b4a27e2e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f04ae48318dc4eb7811727f263df1b4e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:08.549982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bc24e-99ef-4b14-bc85-035b4a27e2e4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:08.733149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f59bc24e-99ef-4b14-bc85-035b4a27e2e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f04ae48318dc4eb7811727f263df1b4e', 'request_id': 'req-f59bc24e-99ef-4b14-bc85-035b4a27e2e4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:08.872940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f59bc24e-99ef-4b14-bc85-035b4a27e2e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f04ae48318dc4eb7811727f263df1b4e', 'request_id': 'req-f59bc24e-99ef-4b14-bc85-035b4a27e2e4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:08.894859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f59bc24e-99ef-4b14-bc85-035b4a27e2e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f04ae48318dc4eb7811727f263df1b4e', 'request_id': 'req-f59bc24e-99ef-4b14-bc85-035b4a27e2e4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:08.938682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f59bc24e-99ef-4b14-bc85-035b4a27e2e4 admin admin] The token cache is being invalidate because project f04ae48318dc4eb7811727f263df1b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:53:08.939236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f59bc24e-99ef-4b14-bc85-035b4a27e2e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:08.940253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f59bc24e-99ef-4b14-bc85-035b4a27e2e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:08.944202 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3525/7036] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:53:08 2022] DELETE /identity/v3/projects/f04ae48318dc4eb7811727f263df1b4e => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:08.949514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156bf21-89f9-466e-adc6-3f01194e92d8 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:08.949810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156bf21-89f9-466e-adc6-3f01194e92d8 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:08.950123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156bf21-89f9-466e-adc6-3f01194e92d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:08.989157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6156bf21-89f9-466e-adc6-3f01194e92d8 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:08.990098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6156bf21-89f9-466e-adc6-3f01194e92d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:09.168587 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3512/7037] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:09.178860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3d5d0-8408-4618-ac3a-24eef4870ff6 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:09.179145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3d5d0-8408-4618-ac3a-24eef4870ff6 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:09.179608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3d5d0-8408-4618-ac3a-24eef4870ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:09.217489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c1d3d5d0-8408-4618-ac3a-24eef4870ff6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:09.219188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c1d3d5d0-8408-4618-ac3a-24eef4870ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:09.253073 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3526/7038] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:09.253205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156bf21-89f9-466e-adc6-3f01194e92d8 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:09.272386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156bf21-89f9-466e-adc6-3f01194e92d8 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:09.296799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64093d49-77de-4bac-a99a-8a86c8c88452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:09.297518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64093d49-77de-4bac-a99a-8a86c8c88452 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:09.297868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64093d49-77de-4bac-a99a-8a86c8c88452 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:09.298177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64093d49-77de-4bac-a99a-8a86c8c88452 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:09.298902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64093d49-77de-4bac-a99a-8a86c8c88452 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:53:09.299162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64093d49-77de-4bac-a99a-8a86c8c88452 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:09.303047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64093d49-77de-4bac-a99a-8a86c8c88452 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:09.359507 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3513/7039] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:53:09.360767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3d5d0-8408-4618-ac3a-24eef4870ff6 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:09.376949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3d5d0-8408-4618-ac3a-24eef4870ff6 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:09.388260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b292369-f06e-449c-a7e9-0a6436192a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:09.389256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b292369-f06e-449c-a7e9-0a6436192a27 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:09.390270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b292369-f06e-449c-a7e9-0a6436192a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:09.390799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b292369-f06e-449c-a7e9-0a6436192a27 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:09.391810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b292369-f06e-449c-a7e9-0a6436192a27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:09.394062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b292369-f06e-449c-a7e9-0a6436192a27 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:09.565649 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3527/7040] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:53:09 2022] POST /identity/v3/projects => generated 367 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:09.573220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64093d49-77de-4bac-a99a-8a86c8c88452 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:09.603599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64093d49-77de-4bac-a99a-8a86c8c88452 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:09.647105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:09.682172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ef0bc-529f-4ccf-84fe-4b2bef71a554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:09.682800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ef0bc-529f-4ccf-84fe-4b2bef71a554 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:09.683136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ef0bc-529f-4ccf-84fe-4b2bef71a554 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:09.683478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ef0bc-529f-4ccf-84fe-4b2bef71a554 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:09.684179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ef0bc-529f-4ccf-84fe-4b2bef71a554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:09.686341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ef0bc-529f-4ccf-84fe-4b2bef71a554 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:09.802388 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3514/7041] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:53:09 2022] POST /identity/v3/users => generated 284 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:09.804577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b292369-f06e-449c-a7e9-0a6436192a27 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:09.815520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b292369-f06e-449c-a7e9-0a6436192a27 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:09.824980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109d139-c124-44fc-a2c3-7e5be13b57ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:09.825670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109d139-c124-44fc-a2c3-7e5be13b57ac admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:09.825956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109d139-c124-44fc-a2c3-7e5be13b57ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:09.826262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109d139-c124-44fc-a2c3-7e5be13b57ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:09.826979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109d139-c124-44fc-a2c3-7e5be13b57ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:09.829529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109d139-c124-44fc-a2c3-7e5be13b57ac admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:09.842663 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3528/7042] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:53:09.851515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ef0bc-529f-4ccf-84fe-4b2bef71a554 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:09.860474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ef0bc-529f-4ccf-84fe-4b2bef71a554 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:09.867326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3cdf6-1360-4f10-a6be-87ff938a5805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:09.868144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3cdf6-1360-4f10-a6be-87ff938a5805 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:09.869120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3cdf6-1360-4f10-a6be-87ff938a5805 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:09.869616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3cdf6-1360-4f10-a6be-87ff938a5805 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:09.870423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3cdf6-1360-4f10-a6be-87ff938a5805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:09.872526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3cdf6-1360-4f10-a6be-87ff938a5805 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:09.888426 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3515/7043] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:09.889897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109d139-c124-44fc-a2c3-7e5be13b57ac admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:09.901323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109d139-c124-44fc-a2c3-7e5be13b57ac admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:09.907568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0186a-48e8-4ba7-9ad7-6823866c6d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:09.910161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0186a-48e8-4ba7-9ad7-6823866c6d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:09.910161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0186a-48e8-4ba7-9ad7-6823866c6d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:09.910161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0186a-48e8-4ba7-9ad7-6823866c6d97 admin admin] PATH_INFO: `/v3/projects/c9a1e90d598d4e3d81421a1ea09e6364/users/6579fd6852a54edc813d7de75c774dd2/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:09.928383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e0186a-48e8-4ba7-9ad7-6823866c6d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9a1e90d598d4e3d81421a1ea09e6364, user_id=6579fd6852a54edc813d7de75c774dd2, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:09.931986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e0186a-48e8-4ba7-9ad7-6823866c6d97 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:10.026555 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3529/7044] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:53:09 2022] PUT /identity/v3/projects/c9a1e90d598d4e3d81421a1ea09e6364/users/6579fd6852a54edc813d7de75c774dd2/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:10.038411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e7784-1a4d-4f94-9896-66ce1d692a3c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:10.039840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e7784-1a4d-4f94-9896-66ce1d692a3c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:10.040676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e7784-1a4d-4f94-9896-66ce1d692a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:10.106945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-111e7784-1a4d-4f94-9896-66ce1d692a3c None None] MFA Rules not processed for user `6579fd6852a54edc813d7de75c774dd2`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:10.113133 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-111e7784-1a4d-4f94-9896-66ce1d692a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:10.268882 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3516/7045] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:10.273784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0186a-48e8-4ba7-9ad7-6823866c6d97 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:10.390026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0186a-48e8-4ba7-9ad7-6823866c6d97 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:10.403343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336cc97-e356-49c6-a236-3caeced74a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:10.404178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336cc97-e356-49c6-a236-3caeced74a6c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:10.404648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336cc97-e356-49c6-a236-3caeced74a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:10.405151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336cc97-e356-49c6-a236-3caeced74a6c admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:10.406068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336cc97-e356-49c6-a236-3caeced74a6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:10.409028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336cc97-e356-49c6-a236-3caeced74a6c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:10.429135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:10.572670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e7784-1a4d-4f94-9896-66ce1d692a3c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:10.578755 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3530/7046] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:53:10 2022] POST /identity/v3/projects => generated 369 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:10.584691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e7784-1a4d-4f94-9896-66ce1d692a3c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:10.740460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad91207-bdaa-4b76-91cb-4e78698e86bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:10.743215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad91207-bdaa-4b76-91cb-4e78698e86bd admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:10.743587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad91207-bdaa-4b76-91cb-4e78698e86bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:10.743988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad91207-bdaa-4b76-91cb-4e78698e86bd admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:10.744657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad91207-bdaa-4b76-91cb-4e78698e86bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:10.747048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad91207-bdaa-4b76-91cb-4e78698e86bd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:10.848023 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3517/7047] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:53:10 2022] POST /identity/v3/users => generated 291 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:53:10.851663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336cc97-e356-49c6-a236-3caeced74a6c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:10.869374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336cc97-e356-49c6-a236-3caeced74a6c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:10.876499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425c803-d0a5-4290-8767-9721a820deba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:10.878184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425c803-d0a5-4290-8767-9721a820deba admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:10.878184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425c803-d0a5-4290-8767-9721a820deba admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:10.878184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425c803-d0a5-4290-8767-9721a820deba admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:10.879706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425c803-d0a5-4290-8767-9721a820deba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:10.883152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425c803-d0a5-4290-8767-9721a820deba admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:10.901878 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3531/7048] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:10.905313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad91207-bdaa-4b76-91cb-4e78698e86bd admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:10.917017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad91207-bdaa-4b76-91cb-4e78698e86bd admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:10.929368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2a5e1-6901-4c22-a291-34033bb1a387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:10.929936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2a5e1-6901-4c22-a291-34033bb1a387 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:10.930371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2a5e1-6901-4c22-a291-34033bb1a387 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:10.930603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2a5e1-6901-4c22-a291-34033bb1a387 admin admin] PATH_INFO: `/v3/projects/2aa9ef2777ef4752bee9a86728f49841/users/f8900403325944bfbbe2d3032c25db28/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:10.949973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2a5e1-6901-4c22-a291-34033bb1a387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa9ef2777ef4752bee9a86728f49841, user_id=f8900403325944bfbbe2d3032c25db28, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:10.953709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2a5e1-6901-4c22-a291-34033bb1a387 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:11.038454 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3518/7049] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:53:10 2022] PUT /identity/v3/projects/2aa9ef2777ef4752bee9a86728f49841/users/f8900403325944bfbbe2d3032c25db28/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:53:11.042412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425c803-d0a5-4290-8767-9721a820deba admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:11.058237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425c803-d0a5-4290-8767-9721a820deba admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:11.196916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b6e97-7c24-4acc-b717-cbfdc1180c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:11.204616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b6e97-7c24-4acc-b717-cbfdc1180c1c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:11.204616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b6e97-7c24-4acc-b717-cbfdc1180c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:11.204616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b6e97-7c24-4acc-b717-cbfdc1180c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:11.204616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b6e97-7c24-4acc-b717-cbfdc1180c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:11.204616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b6e97-7c24-4acc-b717-cbfdc1180c1c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:11.218774 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3532/7050] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:11.219860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2a5e1-6901-4c22-a291-34033bb1a387 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:11.238372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2a5e1-6901-4c22-a291-34033bb1a387 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:11.249812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667f665-b228-41b6-afdf-32bf93d49361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:11.265409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667f665-b228-41b6-afdf-32bf93d49361 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:11.265791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667f665-b228-41b6-afdf-32bf93d49361 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:11.266279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667f665-b228-41b6-afdf-32bf93d49361 admin admin] PATH_INFO: `/v3/projects/2aa9ef2777ef4752bee9a86728f49841/users/f8900403325944bfbbe2d3032c25db28/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:11.274921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667f665-b228-41b6-afdf-32bf93d49361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa9ef2777ef4752bee9a86728f49841, user_id=f8900403325944bfbbe2d3032c25db28, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:11.286270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667f665-b228-41b6-afdf-32bf93d49361 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:11.296134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:11.316481 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3519/7051] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:53:11 2022] PUT /identity/v3/projects/2aa9ef2777ef4752bee9a86728f49841/users/f8900403325944bfbbe2d3032c25db28/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:53:11.328795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e57eaa-012b-41b8-b696-6bffcc5cb412 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:11.329103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e57eaa-012b-41b8-b696-6bffcc5cb412 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:11.329635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e57eaa-012b-41b8-b696-6bffcc5cb412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:11.407217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-42e57eaa-012b-41b8-b696-6bffcc5cb412 None None] MFA Rules not processed for user `f8900403325944bfbbe2d3032c25db28`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:11.409644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-42e57eaa-012b-41b8-b696-6bffcc5cb412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:11.475884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667f665-b228-41b6-afdf-32bf93d49361 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:11.478556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7667f665-b228-41b6-afdf-32bf93d49361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:11.532761 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3533/7052] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:11.617546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e57eaa-012b-41b8-b696-6bffcc5cb412 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:11.619435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-42e57eaa-012b-41b8-b696-6bffcc5cb412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:11.696626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667f665-b228-41b6-afdf-32bf93d49361 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:11.715482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46caa1c9-b3bb-4da2-a67d-2d36e38a5be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:11.716080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46caa1c9-b3bb-4da2-a67d-2d36e38a5be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:11.716529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46caa1c9-b3bb-4da2-a67d-2d36e38a5be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:11.716663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46caa1c9-b3bb-4da2-a67d-2d36e38a5be3 admin admin] PATH_INFO: `/v3/users/fc97f7dbe02a45c7ae85c9ea5b9080c7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:11.717908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46caa1c9-b3bb-4da2-a67d-2d36e38a5be3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc97f7dbe02a45c7ae85c9ea5b9080c7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:11.719801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46caa1c9-b3bb-4da2-a67d-2d36e38a5be3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:11.750210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e57eaa-012b-41b8-b696-6bffcc5cb412 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:11.761883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6791a-e38a-4066-9731-1836e0d4cdfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:11.762754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6791a-e38a-4066-9731-1836e0d4cdfd service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:11.763228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6791a-e38a-4066-9731-1836e0d4cdfd service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:11.763677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6791a-e38a-4066-9731-1836e0d4cdfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:11.786681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6791a-e38a-4066-9731-1836e0d4cdfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:11.788491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6791a-e38a-4066-9731-1836e0d4cdfd service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:11.811868 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3534/7053] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:11 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:11.958478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-46caa1c9-b3bb-4da2-a67d-2d36e38a5be3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc97f7dbe02a45c7ae85c9ea5b9080c7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:11.960469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-46caa1c9-b3bb-4da2-a67d-2d36e38a5be3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc97f7dbe02a45c7ae85c9ea5b9080c7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:11.974606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-46caa1c9-b3bb-4da2-a67d-2d36e38a5be3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc97f7dbe02a45c7ae85c9ea5b9080c7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:12.001582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-46caa1c9-b3bb-4da2-a67d-2d36e38a5be3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc97f7dbe02a45c7ae85c9ea5b9080c7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:12.003268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-46caa1c9-b3bb-4da2-a67d-2d36e38a5be3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc97f7dbe02a45c7ae85c9ea5b9080c7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:12.118695 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3520/7054] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:53:11 2022] DELETE /identity/v3/users/fc97f7dbe02a45c7ae85c9ea5b9080c7 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:53:12.123411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b156d-799c-4360-ad9a-a370ba4135b2 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:12.130651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b156d-799c-4360-ad9a-a370ba4135b2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:12.130651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b156d-799c-4360-ad9a-a370ba4135b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:12.165463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-978b156d-799c-4360-ad9a-a370ba4135b2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:12.167244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-978b156d-799c-4360-ad9a-a370ba4135b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:12.285396 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3535/7055] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:12.315075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46caa1c9-b3bb-4da2-a67d-2d36e38a5be3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:12.317557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-46caa1c9-b3bb-4da2-a67d-2d36e38a5be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:12.357471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:12.464536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46caa1c9-b3bb-4da2-a67d-2d36e38a5be3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:12.471272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4806e8-8d97-40db-90c1-3012380bfa1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:12.473781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4806e8-8d97-40db-90c1-3012380bfa1b service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:12.474480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4806e8-8d97-40db-90c1-3012380bfa1b service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:12.474968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4806e8-8d97-40db-90c1-3012380bfa1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:12.490921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4806e8-8d97-40db-90c1-3012380bfa1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:12.492713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4806e8-8d97-40db-90c1-3012380bfa1b service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:12.519494 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3521/7056] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:13.568453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b156d-799c-4360-ad9a-a370ba4135b2 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:13.570112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-978b156d-799c-4360-ad9a-a370ba4135b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:13.585302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b156d-799c-4360-ad9a-a370ba4135b2 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:13.596129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e15b81-edaa-4ae8-82e6-18da02498b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:13.596129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e15b81-edaa-4ae8-82e6-18da02498b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:13.596129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e15b81-edaa-4ae8-82e6-18da02498b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:13.596129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e15b81-edaa-4ae8-82e6-18da02498b34 admin admin] PATH_INFO: `/v3/projects/afc2154af7ff450f9e17c2b571dba846` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:13.596517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e15b81-edaa-4ae8-82e6-18da02498b34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afc2154af7ff450f9e17c2b571dba846)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:13.598611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e15b81-edaa-4ae8-82e6-18da02498b34 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:13.759590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-78e15b81-edaa-4ae8-82e6-18da02498b34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afc2154af7ff450f9e17c2b571dba846', 'request_id': 'req-78e15b81-edaa-4ae8-82e6-18da02498b34'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:13.843159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-78e15b81-edaa-4ae8-82e6-18da02498b34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afc2154af7ff450f9e17c2b571dba846', 'request_id': 'req-78e15b81-edaa-4ae8-82e6-18da02498b34'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:13.855529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-78e15b81-edaa-4ae8-82e6-18da02498b34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afc2154af7ff450f9e17c2b571dba846', 'request_id': 'req-78e15b81-edaa-4ae8-82e6-18da02498b34'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:13.886475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-78e15b81-edaa-4ae8-82e6-18da02498b34 admin admin] The token cache is being invalidate because project afc2154af7ff450f9e17c2b571dba846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:53:13.887178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-78e15b81-edaa-4ae8-82e6-18da02498b34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:13.887988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-78e15b81-edaa-4ae8-82e6-18da02498b34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:13.891540 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3536/7057] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:53:13 2022] DELETE /identity/v3/projects/afc2154af7ff450f9e17c2b571dba846 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:13.897194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e4db8-3e3b-4576-b2ba-2458a66f0e11 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:13.897660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e4db8-3e3b-4576-b2ba-2458a66f0e11 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:13.898296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e4db8-3e3b-4576-b2ba-2458a66f0e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:13.949625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f66e4db8-3e3b-4576-b2ba-2458a66f0e11 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:13.952393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f66e4db8-3e3b-4576-b2ba-2458a66f0e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:13.970312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:14.060453 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3522/7058] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:14.069776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1922d-8aed-4411-8f8f-9b121ac7c0e6 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:14.070140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1922d-8aed-4411-8f8f-9b121ac7c0e6 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:14.070423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1922d-8aed-4411-8f8f-9b121ac7c0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:14.112147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-73e1922d-8aed-4411-8f8f-9b121ac7c0e6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:14.114831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-73e1922d-8aed-4411-8f8f-9b121ac7c0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:14.130574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e4db8-3e3b-4576-b2ba-2458a66f0e11 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:14.142077 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3537/7059] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:14.142595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e4db8-3e3b-4576-b2ba-2458a66f0e11 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:14.149075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98643cd-0c62-4a37-8ef5-c99e30c9d035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:14.150161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98643cd-0c62-4a37-8ef5-c99e30c9d035 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:14.153969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98643cd-0c62-4a37-8ef5-c99e30c9d035 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:14.153969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98643cd-0c62-4a37-8ef5-c99e30c9d035 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:14.153969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98643cd-0c62-4a37-8ef5-c99e30c9d035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:53:14.153969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98643cd-0c62-4a37-8ef5-c99e30c9d035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:14.153969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98643cd-0c62-4a37-8ef5-c99e30c9d035 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:14.170335 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3523/7060] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:53:14.175364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1922d-8aed-4411-8f8f-9b121ac7c0e6 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:14.203294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1922d-8aed-4411-8f8f-9b121ac7c0e6 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:14.209928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602560d0-89da-400f-afb1-f0def78429e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:14.210700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602560d0-89da-400f-afb1-f0def78429e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:14.210986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602560d0-89da-400f-afb1-f0def78429e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:14.211266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602560d0-89da-400f-afb1-f0def78429e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:14.211908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602560d0-89da-400f-afb1-f0def78429e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:14.216262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602560d0-89da-400f-afb1-f0def78429e2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:14.348511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98643cd-0c62-4a37-8ef5-c99e30c9d035 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:14.360004 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3538/7061] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:53:14 2022] POST /identity/v3/projects => generated 369 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:14.363126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98643cd-0c62-4a37-8ef5-c99e30c9d035 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:14.537625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a1665-2d6c-42ba-b730-b7d5740a1af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:14.538805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a1665-2d6c-42ba-b730-b7d5740a1af7 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:14.543107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a1665-2d6c-42ba-b730-b7d5740a1af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:14.543107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a1665-2d6c-42ba-b730-b7d5740a1af7 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:14.543107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a1665-2d6c-42ba-b730-b7d5740a1af7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:14.545183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a1665-2d6c-42ba-b730-b7d5740a1af7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:14.749081 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3524/7062] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:53:14 2022] POST /identity/v3/users => generated 285 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:14.754089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602560d0-89da-400f-afb1-f0def78429e2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:14.773354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602560d0-89da-400f-afb1-f0def78429e2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:14.782848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ff60d-7705-442f-a0ef-6258d85c1c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:14.783498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ff60d-7705-442f-a0ef-6258d85c1c9c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:14.783785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ff60d-7705-442f-a0ef-6258d85c1c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:14.784068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ff60d-7705-442f-a0ef-6258d85c1c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:14.784757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ff60d-7705-442f-a0ef-6258d85c1c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:14.792612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ff60d-7705-442f-a0ef-6258d85c1c9c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:14.819845 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3539/7063] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:14.823963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a1665-2d6c-42ba-b730-b7d5740a1af7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:14.841777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a1665-2d6c-42ba-b730-b7d5740a1af7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:14.865586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e283a-2172-4bf2-a069-226a29294534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:14.866794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e283a-2172-4bf2-a069-226a29294534 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:14.869205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e283a-2172-4bf2-a069-226a29294534 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:14.869600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e283a-2172-4bf2-a069-226a29294534 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:14.874119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e283a-2172-4bf2-a069-226a29294534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:14.884694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e283a-2172-4bf2-a069-226a29294534 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:14.922248 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3525/7064] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:14.923865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ff60d-7705-442f-a0ef-6258d85c1c9c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:14.948699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ff60d-7705-442f-a0ef-6258d85c1c9c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:14.964487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3747c2-4fc8-47af-8f89-90d53e84ddc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:14.965181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3747c2-4fc8-47af-8f89-90d53e84ddc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:14.965470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3747c2-4fc8-47af-8f89-90d53e84ddc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:14.965752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3747c2-4fc8-47af-8f89-90d53e84ddc8 admin admin] PATH_INFO: `/v3/projects/a796b6f4bdd445ab82339d53b0ff4471/users/6bda914eef2e48d4b26a274b05683929/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:15.013623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3747c2-4fc8-47af-8f89-90d53e84ddc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a796b6f4bdd445ab82339d53b0ff4471, user_id=6bda914eef2e48d4b26a274b05683929, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:15.022603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3747c2-4fc8-47af-8f89-90d53e84ddc8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:15.134317 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3540/7065] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:53:14 2022] PUT /identity/v3/projects/a796b6f4bdd445ab82339d53b0ff4471/users/6bda914eef2e48d4b26a274b05683929/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:15.145423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc8815-2c52-4a58-af6c-3912c1d261bb None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:15.145712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc8815-2c52-4a58-af6c-3912c1d261bb None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:15.146236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc8815-2c52-4a58-af6c-3912c1d261bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:15.216244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2fcc8815-2c52-4a58-af6c-3912c1d261bb None None] MFA Rules not processed for user `6bda914eef2e48d4b26a274b05683929`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:15.224766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2fcc8815-2c52-4a58-af6c-3912c1d261bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:15.391391 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3526/7066] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:15.446624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3747c2-4fc8-47af-8f89-90d53e84ddc8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:15.449413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8e3747c2-4fc8-47af-8f89-90d53e84ddc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:15.519388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:15.590025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3747c2-4fc8-47af-8f89-90d53e84ddc8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:15.599974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c85c6-758c-4828-b4fd-39d8683363f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:15.600996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c85c6-758c-4828-b4fd-39d8683363f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:15.600996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c85c6-758c-4828-b4fd-39d8683363f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:15.601400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c85c6-758c-4828-b4fd-39d8683363f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:15.630764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c85c6-758c-4828-b4fd-39d8683363f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:15.635456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c85c6-758c-4828-b4fd-39d8683363f9 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:15.658995 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3541/7067] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:16.122553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc8815-2c52-4a58-af6c-3912c1d261bb None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:16.125322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2fcc8815-2c52-4a58-af6c-3912c1d261bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:16.151655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:16.260284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc8815-2c52-4a58-af6c-3912c1d261bb None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:16.273242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c95a82-a3f9-4a1c-85f1-28ba58a306d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:16.274759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c95a82-a3f9-4a1c-85f1-28ba58a306d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:16.275451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c95a82-a3f9-4a1c-85f1-28ba58a306d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:16.276080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c95a82-a3f9-4a1c-85f1-28ba58a306d6 admin admin] PATH_INFO: `/v3/users/6579fd6852a54edc813d7de75c774dd2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:16.285562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c95a82-a3f9-4a1c-85f1-28ba58a306d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6579fd6852a54edc813d7de75c774dd2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:16.285562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c95a82-a3f9-4a1c-85f1-28ba58a306d6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:16.522652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-19c95a82-a3f9-4a1c-85f1-28ba58a306d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6579fd6852a54edc813d7de75c774dd2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:16.523346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-19c95a82-a3f9-4a1c-85f1-28ba58a306d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6579fd6852a54edc813d7de75c774dd2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:16.531874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-19c95a82-a3f9-4a1c-85f1-28ba58a306d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6579fd6852a54edc813d7de75c774dd2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:16.552931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-19c95a82-a3f9-4a1c-85f1-28ba58a306d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6579fd6852a54edc813d7de75c774dd2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:16.554059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-19c95a82-a3f9-4a1c-85f1-28ba58a306d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6579fd6852a54edc813d7de75c774dd2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:16.704493 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3527/7068] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:53:16 2022] DELETE /identity/v3/users/6579fd6852a54edc813d7de75c774dd2 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:16.705731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac710e-f0ec-4504-8d45-42e8a9406906 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:16.706196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac710e-f0ec-4504-8d45-42e8a9406906 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:16.706312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac710e-f0ec-4504-8d45-42e8a9406906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:16.740829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a8ac710e-f0ec-4504-8d45-42e8a9406906 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:16.743811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a8ac710e-f0ec-4504-8d45-42e8a9406906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:16.835114 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3542/7069] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:16.866171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c95a82-a3f9-4a1c-85f1-28ba58a306d6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:16.869399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-19c95a82-a3f9-4a1c-85f1-28ba58a306d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:16.980250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c95a82-a3f9-4a1c-85f1-28ba58a306d6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:16.989127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c7ce3-a852-4a92-8393-6293d2a88e01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:16.990227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c7ce3-a852-4a92-8393-6293d2a88e01 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:16.990406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c7ce3-a852-4a92-8393-6293d2a88e01 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:16.990752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c7ce3-a852-4a92-8393-6293d2a88e01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:17.002501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c7ce3-a852-4a92-8393-6293d2a88e01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:17.004905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c7ce3-a852-4a92-8393-6293d2a88e01 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:17.020876 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3528/7070] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:18.829798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac710e-f0ec-4504-8d45-42e8a9406906 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:18.832559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a8ac710e-f0ec-4504-8d45-42e8a9406906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:18.855539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac710e-f0ec-4504-8d45-42e8a9406906 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:18.867460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd22217-70d2-4742-a182-f29acfcb9959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:18.868410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd22217-70d2-4742-a182-f29acfcb9959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:18.868927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd22217-70d2-4742-a182-f29acfcb9959 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:18.869435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd22217-70d2-4742-a182-f29acfcb9959 admin admin] PATH_INFO: `/v3/projects/c9a1e90d598d4e3d81421a1ea09e6364` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:18.872014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd22217-70d2-4742-a182-f29acfcb9959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9a1e90d598d4e3d81421a1ea09e6364)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:18.875505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd22217-70d2-4742-a182-f29acfcb9959 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:19.100660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6dd22217-70d2-4742-a182-f29acfcb9959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9a1e90d598d4e3d81421a1ea09e6364', 'request_id': 'req-6dd22217-70d2-4742-a182-f29acfcb9959'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:19.214588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6dd22217-70d2-4742-a182-f29acfcb9959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9a1e90d598d4e3d81421a1ea09e6364', 'request_id': 'req-6dd22217-70d2-4742-a182-f29acfcb9959'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:19.228755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6dd22217-70d2-4742-a182-f29acfcb9959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9a1e90d598d4e3d81421a1ea09e6364', 'request_id': 'req-6dd22217-70d2-4742-a182-f29acfcb9959'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:19.245215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6dd22217-70d2-4742-a182-f29acfcb9959 admin admin] The token cache is being invalidate because project c9a1e90d598d4e3d81421a1ea09e6364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:53:19.246261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6dd22217-70d2-4742-a182-f29acfcb9959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:19.247293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6dd22217-70d2-4742-a182-f29acfcb9959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:19.263723 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3543/7071] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:53:18 2022] DELETE /identity/v3/projects/c9a1e90d598d4e3d81421a1ea09e6364 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:19.268509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c7ce3-a852-4a92-8393-6293d2a88e01 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:19.284836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c7ce3-a852-4a92-8393-6293d2a88e01 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:19.393825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:19.489591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63530a31-47ae-4a6a-a6e4-1617ee040dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:19.490321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63530a31-47ae-4a6a-a6e4-1617ee040dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:19.490612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63530a31-47ae-4a6a-a6e4-1617ee040dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:19.490897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63530a31-47ae-4a6a-a6e4-1617ee040dd0 admin admin] PATH_INFO: `/v3/users/f8900403325944bfbbe2d3032c25db28` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:19.495561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63530a31-47ae-4a6a-a6e4-1617ee040dd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8900403325944bfbbe2d3032c25db28)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:19.503276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63530a31-47ae-4a6a-a6e4-1617ee040dd0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:19.766586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-63530a31-47ae-4a6a-a6e4-1617ee040dd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8900403325944bfbbe2d3032c25db28'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:19.769310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-63530a31-47ae-4a6a-a6e4-1617ee040dd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8900403325944bfbbe2d3032c25db28'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:19.791244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-63530a31-47ae-4a6a-a6e4-1617ee040dd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8900403325944bfbbe2d3032c25db28'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:19.852111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-63530a31-47ae-4a6a-a6e4-1617ee040dd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8900403325944bfbbe2d3032c25db28'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:19.853739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-63530a31-47ae-4a6a-a6e4-1617ee040dd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8900403325944bfbbe2d3032c25db28'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:19.993656 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3529/7072] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:53:19 2022] DELETE /identity/v3/users/f8900403325944bfbbe2d3032c25db28 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:21.480330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd22217-70d2-4742-a182-f29acfcb9959 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:21.481937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6dd22217-70d2-4742-a182-f29acfcb9959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:21.505724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd22217-70d2-4742-a182-f29acfcb9959 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:21.608433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:21.623492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b76097-de19-4377-8b5b-2029813afb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:21.624229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b76097-de19-4377-8b5b-2029813afb33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:21.624685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b76097-de19-4377-8b5b-2029813afb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:21.624969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b76097-de19-4377-8b5b-2029813afb33 admin admin] PATH_INFO: `/v3/projects/2aa9ef2777ef4752bee9a86728f49841` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:21.626212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b76097-de19-4377-8b5b-2029813afb33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aa9ef2777ef4752bee9a86728f49841)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:21.630666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b76097-de19-4377-8b5b-2029813afb33 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:21.861628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5b76097-de19-4377-8b5b-2029813afb33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aa9ef2777ef4752bee9a86728f49841', 'request_id': 'req-a5b76097-de19-4377-8b5b-2029813afb33'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:21.963930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5b76097-de19-4377-8b5b-2029813afb33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aa9ef2777ef4752bee9a86728f49841', 'request_id': 'req-a5b76097-de19-4377-8b5b-2029813afb33'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:21.975083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5b76097-de19-4377-8b5b-2029813afb33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aa9ef2777ef4752bee9a86728f49841', 'request_id': 'req-a5b76097-de19-4377-8b5b-2029813afb33'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:21.989673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5b76097-de19-4377-8b5b-2029813afb33 admin admin] The token cache is being invalidate because project 2aa9ef2777ef4752bee9a86728f49841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:53:21.990252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5b76097-de19-4377-8b5b-2029813afb33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:21.991156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5b76097-de19-4377-8b5b-2029813afb33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:21.993139 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3544/7073] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:53:21 2022] DELETE /identity/v3/projects/2aa9ef2777ef4752bee9a86728f49841 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:22.002553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1dca1-6692-46c2-8834-27dc99cbbe21 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:22.005595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1dca1-6692-46c2-8834-27dc99cbbe21 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:22.006777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1dca1-6692-46c2-8834-27dc99cbbe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:22.061548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-03a1dca1-6692-46c2-8834-27dc99cbbe21 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:22.062674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-03a1dca1-6692-46c2-8834-27dc99cbbe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:22.140335 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3530/7074] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:22.150680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0171c63-2da4-4e93-a2d7-16fbd9e973ae None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:22.150966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0171c63-2da4-4e93-a2d7-16fbd9e973ae None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:22.151244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0171c63-2da4-4e93-a2d7-16fbd9e973ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:22.181464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e0171c63-2da4-4e93-a2d7-16fbd9e973ae None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:22.182786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e0171c63-2da4-4e93-a2d7-16fbd9e973ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:22.193599 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3545/7075] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:53:22.198219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1dca1-6692-46c2-8834-27dc99cbbe21 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:22.216608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1dca1-6692-46c2-8834-27dc99cbbe21 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:22.231445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78cc7c-42dc-4054-ae75-5fc272d1341c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:22.232096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78cc7c-42dc-4054-ae75-5fc272d1341c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:22.232386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78cc7c-42dc-4054-ae75-5fc272d1341c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:22.232664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78cc7c-42dc-4054-ae75-5fc272d1341c admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:22.243218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78cc7c-42dc-4054-ae75-5fc272d1341c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:53:22.243545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78cc7c-42dc-4054-ae75-5fc272d1341c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:22.245358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78cc7c-42dc-4054-ae75-5fc272d1341c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:22.261625 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3531/7076] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:53:22.270287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0171c63-2da4-4e93-a2d7-16fbd9e973ae None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:22.281716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0171c63-2da4-4e93-a2d7-16fbd9e973ae None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:22.288637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a4cc4-6d7b-4449-b894-5961cb862c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:22.289428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a4cc4-6d7b-4449-b894-5961cb862c8c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:22.289824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a4cc4-6d7b-4449-b894-5961cb862c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:22.290241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a4cc4-6d7b-4449-b894-5961cb862c8c admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:22.291003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a4cc4-6d7b-4449-b894-5961cb862c8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:22.293890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a4cc4-6d7b-4449-b894-5961cb862c8c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:22.424084 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3546/7077] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:53:22 2022] POST /identity/v3/projects => generated 397 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:22.426523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78cc7c-42dc-4054-ae75-5fc272d1341c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:22.467275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78cc7c-42dc-4054-ae75-5fc272d1341c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:22.537844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:22.565186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41789f6e-2bb4-4bfc-a878-633ce0383a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:22.565884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41789f6e-2bb4-4bfc-a878-633ce0383a8d admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:22.566194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41789f6e-2bb4-4bfc-a878-633ce0383a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:22.566471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41789f6e-2bb4-4bfc-a878-633ce0383a8d admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:22.567300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41789f6e-2bb4-4bfc-a878-633ce0383a8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:22.569488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41789f6e-2bb4-4bfc-a878-633ce0383a8d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:22.684126 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3532/7078] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:53:22 2022] POST /identity/v3/users => generated 299 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:22.689165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a4cc4-6d7b-4449-b894-5961cb862c8c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:22.717426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a4cc4-6d7b-4449-b894-5961cb862c8c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:22.743485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f9e6c-d547-457a-a7a6-300ce44ce269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:22.745334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f9e6c-d547-457a-a7a6-300ce44ce269 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:22.747582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f9e6c-d547-457a-a7a6-300ce44ce269 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:22.748625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f9e6c-d547-457a-a7a6-300ce44ce269 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:22.750987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f9e6c-d547-457a-a7a6-300ce44ce269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:22.756633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f9e6c-d547-457a-a7a6-300ce44ce269 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:22.786743 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3547/7079] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:53:22.789046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41789f6e-2bb4-4bfc-a878-633ce0383a8d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:22.808131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41789f6e-2bb4-4bfc-a878-633ce0383a8d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:22.821215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b0d5f-bc8d-46ab-ac3e-ad0429c12282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:22.822179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b0d5f-bc8d-46ab-ac3e-ad0429c12282 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:22.822777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b0d5f-bc8d-46ab-ac3e-ad0429c12282 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:22.823844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b0d5f-bc8d-46ab-ac3e-ad0429c12282 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:22.824893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b0d5f-bc8d-46ab-ac3e-ad0429c12282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:22.829741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b0d5f-bc8d-46ab-ac3e-ad0429c12282 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:22.852699 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3533/7080] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:22.852981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f9e6c-d547-457a-a7a6-300ce44ce269 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:22.865501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f9e6c-d547-457a-a7a6-300ce44ce269 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:22.871288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7148814-fedc-47ec-97d1-6f20c748eb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:22.872024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7148814-fedc-47ec-97d1-6f20c748eb73 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:22.872388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7148814-fedc-47ec-97d1-6f20c748eb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:22.872743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7148814-fedc-47ec-97d1-6f20c748eb73 admin admin] PATH_INFO: `/v3/projects/7ca2d8e42a8846b282980db1e9f62304/users/876c3d670e1346d0b2e734ac0cc19b9f/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:22.939168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7148814-fedc-47ec-97d1-6f20c748eb73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca2d8e42a8846b282980db1e9f62304, user_id=876c3d670e1346d0b2e734ac0cc19b9f, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:22.942465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7148814-fedc-47ec-97d1-6f20c748eb73 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:23.040568 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3548/7081] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:53:22 2022] PUT /identity/v3/projects/7ca2d8e42a8846b282980db1e9f62304/users/876c3d670e1346d0b2e734ac0cc19b9f/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:23.051960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf1b17-d0fa-4efb-9dab-83758d86fb84 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:23.052549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf1b17-d0fa-4efb-9dab-83758d86fb84 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:23.052549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf1b17-d0fa-4efb-9dab-83758d86fb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:23.112386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e3cf1b17-d0fa-4efb-9dab-83758d86fb84 None None] MFA Rules not processed for user `876c3d670e1346d0b2e734ac0cc19b9f`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:23.118789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e3cf1b17-d0fa-4efb-9dab-83758d86fb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:23.237227 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3534/7082] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:23 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:23.242722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7148814-fedc-47ec-97d1-6f20c748eb73 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:23.403477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7148814-fedc-47ec-97d1-6f20c748eb73 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:23.414151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65dc94c-6634-4a51-afb8-ffd4bc0420c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:23.414151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65dc94c-6634-4a51-afb8-ffd4bc0420c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:23.414151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65dc94c-6634-4a51-afb8-ffd4bc0420c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:23.415206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65dc94c-6634-4a51-afb8-ffd4bc0420c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:23.416400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65dc94c-6634-4a51-afb8-ffd4bc0420c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:23.419343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65dc94c-6634-4a51-afb8-ffd4bc0420c4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:23.533345 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3549/7083] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:53:23 2022] POST /identity/v3/projects => generated 397 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:23.543473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf1b17-d0fa-4efb-9dab-83758d86fb84 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:23.555822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf1b17-d0fa-4efb-9dab-83758d86fb84 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:23.629029 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b154e-1e0e-4a12-83cd-201544ec8ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:23.630365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b154e-1e0e-4a12-83cd-201544ec8ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:23.630872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b154e-1e0e-4a12-83cd-201544ec8ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:23.631312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b154e-1e0e-4a12-83cd-201544ec8ee1 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:23.632258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b154e-1e0e-4a12-83cd-201544ec8ee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:23.635011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b154e-1e0e-4a12-83cd-201544ec8ee1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:23.736329 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3535/7084] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:53:23 2022] POST /identity/v3/users => generated 305 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:23.741144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65dc94c-6634-4a51-afb8-ffd4bc0420c4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:23.749474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:23.754154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65dc94c-6634-4a51-afb8-ffd4bc0420c4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:23.774500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1c297-d469-4c96-b175-5269bf077f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:23.775418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c297-d469-4c96-b175-5269bf077f39 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:23.776002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c297-d469-4c96-b175-5269bf077f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:23.777203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c297-d469-4c96-b175-5269bf077f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:23.778808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1c297-d469-4c96-b175-5269bf077f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:23.782372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1c297-d469-4c96-b175-5269bf077f39 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:23.824449 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3550/7085] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:23.824977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b154e-1e0e-4a12-83cd-201544ec8ee1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:23.841149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b154e-1e0e-4a12-83cd-201544ec8ee1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:23.846176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbb445-8f4c-47c3-9cc4-ef4b5457c00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:23.847567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbb445-8f4c-47c3-9cc4-ef4b5457c00c admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:23.847949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbb445-8f4c-47c3-9cc4-ef4b5457c00c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:23.848330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbb445-8f4c-47c3-9cc4-ef4b5457c00c admin admin] PATH_INFO: `/v3/projects/686bf18f99204e8fbc4d183d844ba4c1/users/cb41c88f3e9d4793817d43a15c8c02ac/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:23.869684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbb445-8f4c-47c3-9cc4-ef4b5457c00c admin admin] RBAC: Authorizing `identity:create_grant(project_id=686bf18f99204e8fbc4d183d844ba4c1, user_id=cb41c88f3e9d4793817d43a15c8c02ac, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:23.873081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbb445-8f4c-47c3-9cc4-ef4b5457c00c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:23.950641 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3536/7086] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:53:23 2022] PUT /identity/v3/projects/686bf18f99204e8fbc4d183d844ba4c1/users/cb41c88f3e9d4793817d43a15c8c02ac/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:23.955476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1c297-d469-4c96-b175-5269bf077f39 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:23.970946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1c297-d469-4c96-b175-5269bf077f39 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:24.064760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d36a4-e72f-4abb-9d6f-bdfd3760e865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:24.065429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d36a4-e72f-4abb-9d6f-bdfd3760e865 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:24.066619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d36a4-e72f-4abb-9d6f-bdfd3760e865 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:24.067265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d36a4-e72f-4abb-9d6f-bdfd3760e865 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:24.069534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d36a4-e72f-4abb-9d6f-bdfd3760e865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:24.071295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d36a4-e72f-4abb-9d6f-bdfd3760e865 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:24.094153 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3551/7087] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:24.098839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbb445-8f4c-47c3-9cc4-ef4b5457c00c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:24.110847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbb445-8f4c-47c3-9cc4-ef4b5457c00c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:24.116037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1cc159-4984-4c4e-b2f5-4cd09876aa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:24.116715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1cc159-4984-4c4e-b2f5-4cd09876aa1b admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:24.116998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1cc159-4984-4c4e-b2f5-4cd09876aa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:24.117567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1cc159-4984-4c4e-b2f5-4cd09876aa1b admin admin] PATH_INFO: `/v3/projects/686bf18f99204e8fbc4d183d844ba4c1/users/cb41c88f3e9d4793817d43a15c8c02ac/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:24.119708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1cc159-4984-4c4e-b2f5-4cd09876aa1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=686bf18f99204e8fbc4d183d844ba4c1, user_id=cb41c88f3e9d4793817d43a15c8c02ac, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:24.122641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1cc159-4984-4c4e-b2f5-4cd09876aa1b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:24.131388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:24.138517 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3537/7088] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:53:24 2022] PUT /identity/v3/projects/686bf18f99204e8fbc4d183d844ba4c1/users/cb41c88f3e9d4793817d43a15c8c02ac/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:24.150369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c280074-d05f-44f2-86b5-885ef0dd1a5f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:24.151813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c280074-d05f-44f2-86b5-885ef0dd1a5f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:24.152200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c280074-d05f-44f2-86b5-885ef0dd1a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:24.192596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0c280074-d05f-44f2-86b5-885ef0dd1a5f None None] MFA Rules not processed for user `cb41c88f3e9d4793817d43a15c8c02ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:24.194403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0c280074-d05f-44f2-86b5-885ef0dd1a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:24.339301 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3552/7089] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:24 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:24.362409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1cc159-4984-4c4e-b2f5-4cd09876aa1b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:24.368655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0d1cc159-4984-4c4e-b2f5-4cd09876aa1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:24.496123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1cc159-4984-4c4e-b2f5-4cd09876aa1b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:24.500754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8765f-a84c-4e46-81a9-6b64cb2f086d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:24.501378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8765f-a84c-4e46-81a9-6b64cb2f086d service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:24.501659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8765f-a84c-4e46-81a9-6b64cb2f086d service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:24.501933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8765f-a84c-4e46-81a9-6b64cb2f086d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:24.652897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8765f-a84c-4e46-81a9-6b64cb2f086d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:24.655264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8765f-a84c-4e46-81a9-6b64cb2f086d service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:24.666315 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3538/7090] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:24 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:24.870741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c280074-d05f-44f2-86b5-885ef0dd1a5f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:24.872257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0c280074-d05f-44f2-86b5-885ef0dd1a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:25.015761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c280074-d05f-44f2-86b5-885ef0dd1a5f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:25.024905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de889274-e81f-455d-b18d-310050fc4bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:25.026076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de889274-e81f-455d-b18d-310050fc4bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:25.026584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de889274-e81f-455d-b18d-310050fc4bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:25.027075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de889274-e81f-455d-b18d-310050fc4bcf admin admin] PATH_INFO: `/v3/users/55946cbad1344d6682d63c6eca830800` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:25.028651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de889274-e81f-455d-b18d-310050fc4bcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=55946cbad1344d6682d63c6eca830800)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:25.031350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de889274-e81f-455d-b18d-310050fc4bcf admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:25.077307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:25.379189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-de889274-e81f-455d-b18d-310050fc4bcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55946cbad1344d6682d63c6eca830800'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:25.380092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-de889274-e81f-455d-b18d-310050fc4bcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55946cbad1344d6682d63c6eca830800'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:25.401188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-de889274-e81f-455d-b18d-310050fc4bcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55946cbad1344d6682d63c6eca830800'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:25.425409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-de889274-e81f-455d-b18d-310050fc4bcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55946cbad1344d6682d63c6eca830800'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:25.554829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-de889274-e81f-455d-b18d-310050fc4bcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55946cbad1344d6682d63c6eca830800'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:25.563028 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3553/7091] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:53:24 2022] DELETE /identity/v3/users/55946cbad1344d6682d63c6eca830800 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:25.567752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa854a-6670-491b-8af0-3efaa2049377 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:25.568886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa854a-6670-491b-8af0-3efaa2049377 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:25.569669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa854a-6670-491b-8af0-3efaa2049377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:25.594784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-90fa854a-6670-491b-8af0-3efaa2049377 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:25.596965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-90fa854a-6670-491b-8af0-3efaa2049377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:25.679744 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3539/7092] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:25.695903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de889274-e81f-455d-b18d-310050fc4bcf admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:25.697204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-de889274-e81f-455d-b18d-310050fc4bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:25.792815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de889274-e81f-455d-b18d-310050fc4bcf admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:25.797497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98e446-8d07-447e-9486-c9864ae936ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:25.798316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98e446-8d07-447e-9486-c9864ae936ee service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:25.798675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98e446-8d07-447e-9486-c9864ae936ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:25.799674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98e446-8d07-447e-9486-c9864ae936ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:25.820919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98e446-8d07-447e-9486-c9864ae936ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:25.820919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98e446-8d07-447e-9486-c9864ae936ee service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:25.834942 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3554/7093] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:25.922086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa854a-6670-491b-8af0-3efaa2049377 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:25.934397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-90fa854a-6670-491b-8af0-3efaa2049377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:26.034994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:26.095457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa854a-6670-491b-8af0-3efaa2049377 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:26.105217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842fb6b-c0cd-46b4-91e8-a45b5a853608 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:26.105862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842fb6b-c0cd-46b4-91e8-a45b5a853608 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:26.106334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842fb6b-c0cd-46b4-91e8-a45b5a853608 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:26.106618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842fb6b-c0cd-46b4-91e8-a45b5a853608 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:26.108609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9842fb6b-c0cd-46b4-91e8-a45b5a853608 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:26.199459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842fb6b-c0cd-46b4-91e8-a45b5a853608 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:26.201142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842fb6b-c0cd-46b4-91e8-a45b5a853608 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:26.228379 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3540/7094] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:25 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:26.458836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98e446-8d07-447e-9486-c9864ae936ee service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:26.460373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7c98e446-8d07-447e-9486-c9864ae936ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:26.475881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98e446-8d07-447e-9486-c9864ae936ee service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:26.515792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce0ed9-d3e6-4356-aeed-e4b5506b9599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:26.521213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce0ed9-d3e6-4356-aeed-e4b5506b9599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:26.534227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce0ed9-d3e6-4356-aeed-e4b5506b9599 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:26.534227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce0ed9-d3e6-4356-aeed-e4b5506b9599 admin admin] PATH_INFO: `/v3/projects/0f6a52885d8f4cdc86043a36d180be36` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:26.534227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce0ed9-d3e6-4356-aeed-e4b5506b9599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f6a52885d8f4cdc86043a36d180be36)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:26.534227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce0ed9-d3e6-4356-aeed-e4b5506b9599 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:26.754525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cdce0ed9-d3e6-4356-aeed-e4b5506b9599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f6a52885d8f4cdc86043a36d180be36', 'request_id': 'req-cdce0ed9-d3e6-4356-aeed-e4b5506b9599'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:26.837559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cdce0ed9-d3e6-4356-aeed-e4b5506b9599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f6a52885d8f4cdc86043a36d180be36', 'request_id': 'req-cdce0ed9-d3e6-4356-aeed-e4b5506b9599'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:26.847571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cdce0ed9-d3e6-4356-aeed-e4b5506b9599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f6a52885d8f4cdc86043a36d180be36', 'request_id': 'req-cdce0ed9-d3e6-4356-aeed-e4b5506b9599'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:26.875553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cdce0ed9-d3e6-4356-aeed-e4b5506b9599 admin admin] The token cache is being invalidate because project 0f6a52885d8f4cdc86043a36d180be36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:53:26.876348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cdce0ed9-d3e6-4356-aeed-e4b5506b9599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:26.877055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cdce0ed9-d3e6-4356-aeed-e4b5506b9599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:26.879856 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3555/7095] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:53:26 2022] DELETE /identity/v3/projects/0f6a52885d8f4cdc86043a36d180be36 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:26.884732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce91a5f-e20b-4305-945b-520631274780 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:26.885269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce91a5f-e20b-4305-945b-520631274780 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:26.885504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce91a5f-e20b-4305-945b-520631274780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:26.919505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0ce91a5f-e20b-4305-945b-520631274780 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:26.921281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0ce91a5f-e20b-4305-945b-520631274780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:27.103015 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3541/7096] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:27.108223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b5e0d-5734-475a-9ead-218f0c5b2b2c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:27.108223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b5e0d-5734-475a-9ead-218f0c5b2b2c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:27.108223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b5e0d-5734-475a-9ead-218f0c5b2b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:27.135574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-117b5e0d-5734-475a-9ead-218f0c5b2b2c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:27.142606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-117b5e0d-5734-475a-9ead-218f0c5b2b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:27.152361 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3556/7097] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:27.153254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce91a5f-e20b-4305-945b-520631274780 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:27.170660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce91a5f-e20b-4305-945b-520631274780 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:27.176266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfc00a-f52f-484a-a27b-b22c7a32f2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:27.176897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfc00a-f52f-484a-a27b-b22c7a32f2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:27.177183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfc00a-f52f-484a-a27b-b22c7a32f2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:27.177462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfc00a-f52f-484a-a27b-b22c7a32f2a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:27.178256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfc00a-f52f-484a-a27b-b22c7a32f2a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:53:27.178568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfc00a-f52f-484a-a27b-b22c7a32f2a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:27.180589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfc00a-f52f-484a-a27b-b22c7a32f2a2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:27.204410 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3542/7098] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:53:27.212662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b5e0d-5734-475a-9ead-218f0c5b2b2c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:27.219250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b5e0d-5734-475a-9ead-218f0c5b2b2c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:27.232763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58266c-91f9-4a31-a940-9e2c70a5f330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:27.240821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58266c-91f9-4a31-a940-9e2c70a5f330 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:27.240821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58266c-91f9-4a31-a940-9e2c70a5f330 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:27.240821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58266c-91f9-4a31-a940-9e2c70a5f330 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:27.240821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58266c-91f9-4a31-a940-9e2c70a5f330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:27.244621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58266c-91f9-4a31-a940-9e2c70a5f330 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:27.295250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:27.394094 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3557/7099] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:53:27 2022] POST /identity/v3/projects => generated 379 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:27.398425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfc00a-f52f-484a-a27b-b22c7a32f2a2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:27.415095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfc00a-f52f-484a-a27b-b22c7a32f2a2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:27.540416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0627d-9e2f-4d9c-b86e-ce0f83039067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:27.541272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0627d-9e2f-4d9c-b86e-ce0f83039067 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:27.541661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0627d-9e2f-4d9c-b86e-ce0f83039067 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:27.543163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0627d-9e2f-4d9c-b86e-ce0f83039067 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:27.545068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0627d-9e2f-4d9c-b86e-ce0f83039067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:27.548546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0627d-9e2f-4d9c-b86e-ce0f83039067 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:27.651179 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3543/7100] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:53:27 2022] POST /identity/v3/users => generated 290 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:27.651582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58266c-91f9-4a31-a940-9e2c70a5f330 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:27.668409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58266c-91f9-4a31-a940-9e2c70a5f330 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:27.680840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c3bd7-0488-4a0c-8da5-a65dac8344cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:27.681999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c3bd7-0488-4a0c-8da5-a65dac8344cf admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:27.683867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c3bd7-0488-4a0c-8da5-a65dac8344cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:27.684255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c3bd7-0488-4a0c-8da5-a65dac8344cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:27.686819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c3bd7-0488-4a0c-8da5-a65dac8344cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:27.688587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c3bd7-0488-4a0c-8da5-a65dac8344cf admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:27.712433 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3558/7101] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:53:27.716935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0627d-9e2f-4d9c-b86e-ce0f83039067 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:27.730067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:27.733569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0627d-9e2f-4d9c-b86e-ce0f83039067 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:27.744563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02474c-a59d-4661-bcf7-3a61e010cec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:27.745315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02474c-a59d-4661-bcf7-3a61e010cec5 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:27.745602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02474c-a59d-4661-bcf7-3a61e010cec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:27.745880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02474c-a59d-4661-bcf7-3a61e010cec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:27.746606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02474c-a59d-4661-bcf7-3a61e010cec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:27.749280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02474c-a59d-4661-bcf7-3a61e010cec5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:27.772155 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3544/7102] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:27.776243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c3bd7-0488-4a0c-8da5-a65dac8344cf admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:27.787437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c3bd7-0488-4a0c-8da5-a65dac8344cf admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:27.792783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393885a-6c63-47b1-9506-7660b05ea3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:27.793866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393885a-6c63-47b1-9506-7660b05ea3cd admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:27.794543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393885a-6c63-47b1-9506-7660b05ea3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:27.795043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393885a-6c63-47b1-9506-7660b05ea3cd admin admin] PATH_INFO: `/v3/projects/a7ac3f05a6af49719322facefa902213/users/bc4295f40a944e1489c7ba2560043f07/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:27.816449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393885a-6c63-47b1-9506-7660b05ea3cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ac3f05a6af49719322facefa902213, user_id=bc4295f40a944e1489c7ba2560043f07, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:27.819709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393885a-6c63-47b1-9506-7660b05ea3cd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:27.911921 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3559/7103] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:53:27 2022] PUT /identity/v3/projects/a7ac3f05a6af49719322facefa902213/users/bc4295f40a944e1489c7ba2560043f07/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:27.913797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212241c8-532b-4a9e-adaa-07fb22c34ffd None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:27.914286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212241c8-532b-4a9e-adaa-07fb22c34ffd None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:27.914440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212241c8-532b-4a9e-adaa-07fb22c34ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:27.971522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-212241c8-532b-4a9e-adaa-07fb22c34ffd None None] MFA Rules not processed for user `bc4295f40a944e1489c7ba2560043f07`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:27.973980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-212241c8-532b-4a9e-adaa-07fb22c34ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:28.067741 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3545/7104] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:28.110018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393885a-6c63-47b1-9506-7660b05ea3cd admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:28.114222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e393885a-6c63-47b1-9506-7660b05ea3cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:28.334971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393885a-6c63-47b1-9506-7660b05ea3cd admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:28.345606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cb26b-f312-48fd-8991-9501914e0239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:28.347576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cb26b-f312-48fd-8991-9501914e0239 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:28.348052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cb26b-f312-48fd-8991-9501914e0239 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:28.348408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cb26b-f312-48fd-8991-9501914e0239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:28.383822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cb26b-f312-48fd-8991-9501914e0239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:28.385466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cb26b-f312-48fd-8991-9501914e0239 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:28.397974 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3560/7105] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:28.430687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212241c8-532b-4a9e-adaa-07fb22c34ffd None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:28.546003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212241c8-532b-4a9e-adaa-07fb22c34ffd None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:28.553407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee211e-5017-4f53-8f66-f68a45d34d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:28.554314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee211e-5017-4f53-8f66-f68a45d34d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:28.555300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee211e-5017-4f53-8f66-f68a45d34d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:28.555300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee211e-5017-4f53-8f66-f68a45d34d88 admin admin] PATH_INFO: `/v3/users/bc4295f40a944e1489c7ba2560043f07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:28.556163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee211e-5017-4f53-8f66-f68a45d34d88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc4295f40a944e1489c7ba2560043f07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:28.559143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee211e-5017-4f53-8f66-f68a45d34d88 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:28.905845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bfee211e-5017-4f53-8f66-f68a45d34d88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc4295f40a944e1489c7ba2560043f07'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:28.906996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bfee211e-5017-4f53-8f66-f68a45d34d88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc4295f40a944e1489c7ba2560043f07'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:28.915685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bfee211e-5017-4f53-8f66-f68a45d34d88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc4295f40a944e1489c7ba2560043f07'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:28.931628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bfee211e-5017-4f53-8f66-f68a45d34d88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc4295f40a944e1489c7ba2560043f07'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:28.932618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bfee211e-5017-4f53-8f66-f68a45d34d88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc4295f40a944e1489c7ba2560043f07'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:29.050451 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3546/7106] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:53:28 2022] DELETE /identity/v3/users/bc4295f40a944e1489c7ba2560043f07 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:29.053996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd733f-32ba-4121-8e06-53a521b851f1 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:29.055790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd733f-32ba-4121-8e06-53a521b851f1 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:29.056066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd733f-32ba-4121-8e06-53a521b851f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:29.082088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5bdd733f-32ba-4121-8e06-53a521b851f1 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:29.087166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5bdd733f-32ba-4121-8e06-53a521b851f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:29.168746 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3561/7107] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:29.183177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee211e-5017-4f53-8f66-f68a45d34d88 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:29.185356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bfee211e-5017-4f53-8f66-f68a45d34d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:29.260863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:29.306364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee211e-5017-4f53-8f66-f68a45d34d88 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:29.323930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c82f2-c4dc-465d-b40e-48729935bbd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:29.324567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c82f2-c4dc-465d-b40e-48729935bbd4 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:29.324849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c82f2-c4dc-465d-b40e-48729935bbd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:29.325603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c82f2-c4dc-465d-b40e-48729935bbd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:29.351958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c82f2-c4dc-465d-b40e-48729935bbd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:29.353435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c82f2-c4dc-465d-b40e-48729935bbd4 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:29.377502 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3547/7108] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:30.304572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd733f-32ba-4121-8e06-53a521b851f1 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:30.306135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5bdd733f-32ba-4121-8e06-53a521b851f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:30.325769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd733f-32ba-4121-8e06-53a521b851f1 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:30.342211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5326845-92d4-4795-ad56-0fc668899d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:30.342890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5326845-92d4-4795-ad56-0fc668899d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:30.343181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5326845-92d4-4795-ad56-0fc668899d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:30.343607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5326845-92d4-4795-ad56-0fc668899d6a admin admin] PATH_INFO: `/v3/users/a77b3e09383c4a3c98e866bba687132f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:30.348054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5326845-92d4-4795-ad56-0fc668899d6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a77b3e09383c4a3c98e866bba687132f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:30.352323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5326845-92d4-4795-ad56-0fc668899d6a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:30.705436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5326845-92d4-4795-ad56-0fc668899d6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a77b3e09383c4a3c98e866bba687132f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:30.707293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5326845-92d4-4795-ad56-0fc668899d6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a77b3e09383c4a3c98e866bba687132f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:30.721176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:30.730608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5326845-92d4-4795-ad56-0fc668899d6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a77b3e09383c4a3c98e866bba687132f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:30.761937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5326845-92d4-4795-ad56-0fc668899d6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a77b3e09383c4a3c98e866bba687132f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:30.865218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a5326845-92d4-4795-ad56-0fc668899d6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a77b3e09383c4a3c98e866bba687132f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:30.872170 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3562/7109] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:53:30 2022] DELETE /identity/v3/users/a77b3e09383c4a3c98e866bba687132f => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:30.877621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3abbd-baad-4c8e-b087-3bf4427ae772 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:30.878756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3abbd-baad-4c8e-b087-3bf4427ae772 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:30.878756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3abbd-baad-4c8e-b087-3bf4427ae772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:30.924132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-cdc3abbd-baad-4c8e-b087-3bf4427ae772 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:30.932650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cdc3abbd-baad-4c8e-b087-3bf4427ae772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:30.960387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5326845-92d4-4795-ad56-0fc668899d6a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:30.962967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a5326845-92d4-4795-ad56-0fc668899d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:31.106283 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3548/7110] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:31.146105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5326845-92d4-4795-ad56-0fc668899d6a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:31.164625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d54f8-4a36-47e4-b8f8-be9642807149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:31.166721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d54f8-4a36-47e4-b8f8-be9642807149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:31.167303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d54f8-4a36-47e4-b8f8-be9642807149 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:31.172062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d54f8-4a36-47e4-b8f8-be9642807149 admin admin] PATH_INFO: `/v3/projects/a7ac3f05a6af49719322facefa902213` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:31.174194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d54f8-4a36-47e4-b8f8-be9642807149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7ac3f05a6af49719322facefa902213)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:31.178175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d54f8-4a36-47e4-b8f8-be9642807149 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:31.252915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3abbd-baad-4c8e-b087-3bf4427ae772 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:31.257792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cdc3abbd-baad-4c8e-b087-3bf4427ae772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:31.375431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-048d54f8-4a36-47e4-b8f8-be9642807149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7ac3f05a6af49719322facefa902213', 'request_id': 'req-048d54f8-4a36-47e4-b8f8-be9642807149'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:31.471311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-048d54f8-4a36-47e4-b8f8-be9642807149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7ac3f05a6af49719322facefa902213', 'request_id': 'req-048d54f8-4a36-47e4-b8f8-be9642807149'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:31.480384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-048d54f8-4a36-47e4-b8f8-be9642807149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7ac3f05a6af49719322facefa902213', 'request_id': 'req-048d54f8-4a36-47e4-b8f8-be9642807149'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:31.517072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-048d54f8-4a36-47e4-b8f8-be9642807149 admin admin] The token cache is being invalidate because project a7ac3f05a6af49719322facefa902213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:53:31.517377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-048d54f8-4a36-47e4-b8f8-be9642807149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:31.518065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-048d54f8-4a36-47e4-b8f8-be9642807149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:31.521931 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3563/7111] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:53:30 2022] DELETE /identity/v3/projects/a7ac3f05a6af49719322facefa902213 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:53:31.527925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a2c0d-7d2b-4f58-aded-b50486217438 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:31.528213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a2c0d-7d2b-4f58-aded-b50486217438 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:31.531633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a2c0d-7d2b-4f58-aded-b50486217438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:31.533290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3abbd-baad-4c8e-b087-3bf4427ae772 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:31.572417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4c3a2c0d-7d2b-4f58-aded-b50486217438 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:31.578198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4c3a2c0d-7d2b-4f58-aded-b50486217438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:31.653692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2510b-dfa7-49c5-b32c-155f6eded6c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:31.654510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2510b-dfa7-49c5-b32c-155f6eded6c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:31.654945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2510b-dfa7-49c5-b32c-155f6eded6c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:31.655388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2510b-dfa7-49c5-b32c-155f6eded6c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:31.657201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-87c2510b-dfa7-49c5-b32c-155f6eded6c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:31.676859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:31.725690 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3564/7112] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:53:31.735167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abad7ee-a0a1-4213-850f-871463a638a6 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:31.735800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abad7ee-a0a1-4213-850f-871463a638a6 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:31.736148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abad7ee-a0a1-4213-850f-871463a638a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:31.760685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6abad7ee-a0a1-4213-850f-871463a638a6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:31.765012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6abad7ee-a0a1-4213-850f-871463a638a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:31.765654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2510b-dfa7-49c5-b32c-155f6eded6c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:31.767491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2510b-dfa7-49c5-b32c-155f6eded6c1 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:31.774885 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3565/7113] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:31.777031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abad7ee-a0a1-4213-850f-871463a638a6 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:31.784091 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3549/7114] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:31.793075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abad7ee-a0a1-4213-850f-871463a638a6 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:31.800802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582de822-724d-4026-9566-ced7785588cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:31.801587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582de822-724d-4026-9566-ced7785588cb admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:31.801968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582de822-724d-4026-9566-ced7785588cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:31.802407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582de822-724d-4026-9566-ced7785588cb admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:31.803172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582de822-724d-4026-9566-ced7785588cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:53:31.803582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582de822-724d-4026-9566-ced7785588cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:31.805378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582de822-724d-4026-9566-ced7785588cb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:31.826305 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3566/7115] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:53:31.833179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2510b-dfa7-49c5-b32c-155f6eded6c1 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:31.845701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2510b-dfa7-49c5-b32c-155f6eded6c1 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:31.853803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54f6d4-49ed-4a90-8777-db8679859797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:31.854417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54f6d4-49ed-4a90-8777-db8679859797 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:31.854698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54f6d4-49ed-4a90-8777-db8679859797 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:31.854971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54f6d4-49ed-4a90-8777-db8679859797 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:31.855659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54f6d4-49ed-4a90-8777-db8679859797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:31.862119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54f6d4-49ed-4a90-8777-db8679859797 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:31.976329 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3550/7116] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:53:31 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:31.977534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582de822-724d-4026-9566-ced7785588cb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:31.991459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582de822-724d-4026-9566-ced7785588cb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:32.076654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7b372-715d-435a-ab25-d91a9707ed2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:32.077574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7b372-715d-435a-ab25-d91a9707ed2c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:32.078153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7b372-715d-435a-ab25-d91a9707ed2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:32.078652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7b372-715d-435a-ab25-d91a9707ed2c admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:32.080255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7b372-715d-435a-ab25-d91a9707ed2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:32.083647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7b372-715d-435a-ab25-d91a9707ed2c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:32.219630 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3567/7117] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:53:31 2022] POST /identity/v3/users => generated 294 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:53:32.225197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54f6d4-49ed-4a90-8777-db8679859797 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:32.236734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54f6d4-49ed-4a90-8777-db8679859797 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:32.244423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0397d-019b-4d8f-844e-ce8c3e973088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:32.245268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0397d-019b-4d8f-844e-ce8c3e973088 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:32.245727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0397d-019b-4d8f-844e-ce8c3e973088 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:32.246244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0397d-019b-4d8f-844e-ce8c3e973088 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:32.247273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0397d-019b-4d8f-844e-ce8c3e973088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:32.250959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0397d-019b-4d8f-844e-ce8c3e973088 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:32.263887 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3551/7118] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:53:32.267928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7b372-715d-435a-ab25-d91a9707ed2c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:32.283015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7b372-715d-435a-ab25-d91a9707ed2c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:32.288244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0397d-019b-4d8f-844e-ce8c3e973088 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:32.290501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4cf0397d-019b-4d8f-844e-ce8c3e973088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:32.303154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78897a79-87d3-470c-be65-88a939a63c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:32.303784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78897a79-87d3-470c-be65-88a939a63c95 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:32.304070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78897a79-87d3-470c-be65-88a939a63c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:32.304341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78897a79-87d3-470c-be65-88a939a63c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:32.308873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78897a79-87d3-470c-be65-88a939a63c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:32.312640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78897a79-87d3-470c-be65-88a939a63c95 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:32.322451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0397d-019b-4d8f-844e-ce8c3e973088 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:32.332363 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3568/7119] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:53:32.333099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471aa85d-cdf3-4792-ae0b-98bdfe0c228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:32.334125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471aa85d-cdf3-4792-ae0b-98bdfe0c228c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:32.334573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471aa85d-cdf3-4792-ae0b-98bdfe0c228c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:32.334970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471aa85d-cdf3-4792-ae0b-98bdfe0c228c admin admin] PATH_INFO: `/v3/projects/caa154dfd0e648999029ef7d607fc995` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:32.336179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78897a79-87d3-470c-be65-88a939a63c95 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:32.349296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78897a79-87d3-470c-be65-88a939a63c95 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:32.349883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471aa85d-cdf3-4792-ae0b-98bdfe0c228c admin admin] RBAC: Authorizing `identity:delete_project(project_id=caa154dfd0e648999029ef7d607fc995)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:32.352353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471aa85d-cdf3-4792-ae0b-98bdfe0c228c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:32.359785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c996acd-6f03-403d-9aab-e5f9792b87fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:32.363276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c996acd-6f03-403d-9aab-e5f9792b87fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:32.363803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c996acd-6f03-403d-9aab-e5f9792b87fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:32.364349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c996acd-6f03-403d-9aab-e5f9792b87fc admin admin] PATH_INFO: `/v3/projects/4237f45796894508877970979c3fe8bf/users/166a86ef3a9e47d1b1eb78451853c630/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:32.391000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c996acd-6f03-403d-9aab-e5f9792b87fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4237f45796894508877970979c3fe8bf, user_id=166a86ef3a9e47d1b1eb78451853c630, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:32.407473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c996acd-6f03-403d-9aab-e5f9792b87fc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:32.600310 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3569/7120] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:53:32 2022] PUT /identity/v3/projects/4237f45796894508877970979c3fe8bf/users/166a86ef3a9e47d1b1eb78451853c630/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:53:32.610836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2982198-ffc4-49c6-9477-c1fcb48a9417 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:32.611394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2982198-ffc4-49c6-9477-c1fcb48a9417 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:32.611779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2982198-ffc4-49c6-9477-c1fcb48a9417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:32.633483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-471aa85d-cdf3-4792-ae0b-98bdfe0c228c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caa154dfd0e648999029ef7d607fc995', 'request_id': 'req-471aa85d-cdf3-4792-ae0b-98bdfe0c228c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:32.652500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-471aa85d-cdf3-4792-ae0b-98bdfe0c228c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caa154dfd0e648999029ef7d607fc995', 'request_id': 'req-471aa85d-cdf3-4792-ae0b-98bdfe0c228c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:32.668470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-471aa85d-cdf3-4792-ae0b-98bdfe0c228c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caa154dfd0e648999029ef7d607fc995', 'request_id': 'req-471aa85d-cdf3-4792-ae0b-98bdfe0c228c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:32.685128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e2982198-ffc4-49c6-9477-c1fcb48a9417 None None] MFA Rules not processed for user `166a86ef3a9e47d1b1eb78451853c630`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:32.687508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e2982198-ffc4-49c6-9477-c1fcb48a9417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:32.745198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-471aa85d-cdf3-4792-ae0b-98bdfe0c228c admin admin] The token cache is being invalidate because project caa154dfd0e648999029ef7d607fc995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:53:32.745512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-471aa85d-cdf3-4792-ae0b-98bdfe0c228c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:32.748972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-471aa85d-cdf3-4792-ae0b-98bdfe0c228c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:32.752175 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3552/7121] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:53:32 2022] DELETE /identity/v3/projects/caa154dfd0e648999029ef7d607fc995 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:32.772630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8181f-d34d-40cc-abd6-ad175b5a523b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:32.776033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8181f-d34d-40cc-abd6-ad175b5a523b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:32.776859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8181f-d34d-40cc-abd6-ad175b5a523b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:32.827035 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3570/7122] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:32.828492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-50a8181f-d34d-40cc-abd6-ad175b5a523b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:32.830939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-50a8181f-d34d-40cc-abd6-ad175b5a523b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:32.832763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2982198-ffc4-49c6-9477-c1fcb48a9417 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:32.835080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e2982198-ffc4-49c6-9477-c1fcb48a9417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:32.928589 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3553/7123] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:32.936436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deca611-1ba2-40c1-8389-c43a6e87ae47 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:32.936725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deca611-1ba2-40c1-8389-c43a6e87ae47 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:32.937002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deca611-1ba2-40c1-8389-c43a6e87ae47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:32.942631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2982198-ffc4-49c6-9477-c1fcb48a9417 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:32.946069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:32.947564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63981e-7835-4566-ba3d-ffd01ddc529c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:32.948185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63981e-7835-4566-ba3d-ffd01ddc529c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:32.948461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63981e-7835-4566-ba3d-ffd01ddc529c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:32.948735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63981e-7835-4566-ba3d-ffd01ddc529c admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:32.949375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63981e-7835-4566-ba3d-ffd01ddc529c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:32.951855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63981e-7835-4566-ba3d-ffd01ddc529c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:32.960289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6deca611-1ba2-40c1-8389-c43a6e87ae47 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:32.961601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6deca611-1ba2-40c1-8389-c43a6e87ae47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:32.977478 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3554/7124] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:53:32.981744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deca611-1ba2-40c1-8389-c43a6e87ae47 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:32.996732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deca611-1ba2-40c1-8389-c43a6e87ae47 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:33.002776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64277a94-32a7-41a4-9f4f-31c7edbd1664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:33.003455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64277a94-32a7-41a4-9f4f-31c7edbd1664 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:33.003744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64277a94-32a7-41a4-9f4f-31c7edbd1664 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:33.004022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64277a94-32a7-41a4-9f4f-31c7edbd1664 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:33.004733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64277a94-32a7-41a4-9f4f-31c7edbd1664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:53:33.005197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64277a94-32a7-41a4-9f4f-31c7edbd1664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:33.007198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64277a94-32a7-41a4-9f4f-31c7edbd1664 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:33.020840 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3555/7125] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:53:33.025481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64277a94-32a7-41a4-9f4f-31c7edbd1664 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:33.041680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64277a94-32a7-41a4-9f4f-31c7edbd1664 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:33.048285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef7b0f-e7a8-45fa-b8d3-79aff17610f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:33.049144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef7b0f-e7a8-45fa-b8d3-79aff17610f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:33.049445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef7b0f-e7a8-45fa-b8d3-79aff17610f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:33.050809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef7b0f-e7a8-45fa-b8d3-79aff17610f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:33.051456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef7b0f-e7a8-45fa-b8d3-79aff17610f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:33.053814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef7b0f-e7a8-45fa-b8d3-79aff17610f7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:33.061792 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3571/7126] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:53:32 2022] POST /identity/v3/projects => generated 385 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:53:33.062941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63981e-7835-4566-ba3d-ffd01ddc529c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:33.148950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:33.159080 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3556/7127] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:53:33 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:33.165457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef7b0f-e7a8-45fa-b8d3-79aff17610f7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:33.169136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63981e-7835-4566-ba3d-ffd01ddc529c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:33.301035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef7b0f-e7a8-45fa-b8d3-79aff17610f7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:33.307262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb547a5-68e1-4462-a027-4aaf80b851ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:33.308130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb547a5-68e1-4462-a027-4aaf80b851ae admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:33.308579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb547a5-68e1-4462-a027-4aaf80b851ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:33.309017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb547a5-68e1-4462-a027-4aaf80b851ae admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:33.310126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb547a5-68e1-4462-a027-4aaf80b851ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:33.312703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb547a5-68e1-4462-a027-4aaf80b851ae admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:33.333347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0955506-0918-44c6-8af7-9973090a99f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:33.333986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0955506-0918-44c6-8af7-9973090a99f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:33.334917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0955506-0918-44c6-8af7-9973090a99f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:33.335212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0955506-0918-44c6-8af7-9973090a99f9 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:33.337433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0955506-0918-44c6-8af7-9973090a99f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:33.342460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0955506-0918-44c6-8af7-9973090a99f9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:33.435082 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3557/7128] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:53:33 2022] POST /identity/v3/users => generated 289 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:33.437287 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb547a5-68e1-4462-a027-4aaf80b851ae admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:33.450473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb547a5-68e1-4462-a027-4aaf80b851ae admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:33.462427 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3572/7129] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:53:33 2022] POST /identity/v3/users => generated 293 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:33.463223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d526a-23e5-4178-8d53-398537a7ffe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:33.467958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d526a-23e5-4178-8d53-398537a7ffe3 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:33.467958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d526a-23e5-4178-8d53-398537a7ffe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:33.467958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d526a-23e5-4178-8d53-398537a7ffe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:33.467958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d526a-23e5-4178-8d53-398537a7ffe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:33.468408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d526a-23e5-4178-8d53-398537a7ffe3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:33.470942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0955506-0918-44c6-8af7-9973090a99f9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:33.488126 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3558/7130] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:53:33.488672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0955506-0918-44c6-8af7-9973090a99f9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:33.489932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d526a-23e5-4178-8d53-398537a7ffe3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:33.493837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ceb63f-ba3c-42ad-8d93-d2d6c94dba7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:33.496664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceb63f-ba3c-42ad-8d93-d2d6c94dba7c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:33.496664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceb63f-ba3c-42ad-8d93-d2d6c94dba7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:33.496664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceb63f-ba3c-42ad-8d93-d2d6c94dba7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:33.496664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ceb63f-ba3c-42ad-8d93-d2d6c94dba7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:33.499465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ceb63f-ba3c-42ad-8d93-d2d6c94dba7c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:33.502449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d526a-23e5-4178-8d53-398537a7ffe3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:33.509688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afca652-81b6-4086-8779-0441dce81656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:33.510418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afca652-81b6-4086-8779-0441dce81656 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:33.510642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afca652-81b6-4086-8779-0441dce81656 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:33.510922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afca652-81b6-4086-8779-0441dce81656 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:33.511633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afca652-81b6-4086-8779-0441dce81656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:33.513176 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3573/7131] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:33.514170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afca652-81b6-4086-8779-0441dce81656 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:33.517500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ceb63f-ba3c-42ad-8d93-d2d6c94dba7c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:33.546201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ceb63f-ba3c-42ad-8d93-d2d6c94dba7c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:33.559070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e082b2-ee4f-4b97-bc13-6602b5f86777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:33.560819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e082b2-ee4f-4b97-bc13-6602b5f86777 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:33.561378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e082b2-ee4f-4b97-bc13-6602b5f86777 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:33.562014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e082b2-ee4f-4b97-bc13-6602b5f86777 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:33.563061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e082b2-ee4f-4b97-bc13-6602b5f86777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:33.566053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e082b2-ee4f-4b97-bc13-6602b5f86777 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:33.583903 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3574/7132] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:33.588787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e082b2-ee4f-4b97-bc13-6602b5f86777 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:33.603046 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3559/7133] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:33.606182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afca652-81b6-4086-8779-0441dce81656 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:33.611840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e082b2-ee4f-4b97-bc13-6602b5f86777 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:33.621348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fa670-b982-41b1-b2aa-d0f475f79031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:33.622777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fa670-b982-41b1-b2aa-d0f475f79031 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:33.623170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fa670-b982-41b1-b2aa-d0f475f79031 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:33.623611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fa670-b982-41b1-b2aa-d0f475f79031 admin admin] PATH_INFO: `/v3/projects/8b5b6366944046b4b279d93acfe65835/users/f156ff0846e84967a16e4b8107eedf4e/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:33.624263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afca652-81b6-4086-8779-0441dce81656 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:33.632427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c23f1a-fc99-435c-b417-ad4847821671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:33.634339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c23f1a-fc99-435c-b417-ad4847821671 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:33.634339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c23f1a-fc99-435c-b417-ad4847821671 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:33.634339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c23f1a-fc99-435c-b417-ad4847821671 admin admin] PATH_INFO: `/v3/projects/0680394b30e8488e92a62bf530d8bf6e/users/221b50c21fcb42929f7bfeb10a29d900/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:33.659228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c23f1a-fc99-435c-b417-ad4847821671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0680394b30e8488e92a62bf530d8bf6e, user_id=221b50c21fcb42929f7bfeb10a29d900, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:33.659517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fa670-b982-41b1-b2aa-d0f475f79031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5b6366944046b4b279d93acfe65835, user_id=f156ff0846e84967a16e4b8107eedf4e, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:33.659721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c23f1a-fc99-435c-b417-ad4847821671 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:33.664703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fa670-b982-41b1-b2aa-d0f475f79031 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:33.776463 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3560/7134] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:53:33 2022] PUT /identity/v3/projects/0680394b30e8488e92a62bf530d8bf6e/users/221b50c21fcb42929f7bfeb10a29d900/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:33.787761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d95f2-29f1-46a6-a9eb-ee4871f36380 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:33.788185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d95f2-29f1-46a6-a9eb-ee4871f36380 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:33.796426 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3575/7135] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:53:33 2022] PUT /identity/v3/projects/8b5b6366944046b4b279d93acfe65835/users/f156ff0846e84967a16e4b8107eedf4e/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:33.801761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d95f2-29f1-46a6-a9eb-ee4871f36380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:33.801899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa636dfd-1be6-4478-903a-817738bfcaa7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:33.801899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa636dfd-1be6-4478-903a-817738bfcaa7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:33.801899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa636dfd-1be6-4478-903a-817738bfcaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:33.830310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-225d95f2-29f1-46a6-a9eb-ee4871f36380 None None] MFA Rules not processed for user `221b50c21fcb42929f7bfeb10a29d900`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:33.831581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-225d95f2-29f1-46a6-a9eb-ee4871f36380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:33.853385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-fa636dfd-1be6-4478-903a-817738bfcaa7 None None] MFA Rules not processed for user `f156ff0846e84967a16e4b8107eedf4e`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:33.856838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fa636dfd-1be6-4478-903a-817738bfcaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:33.943568 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3561/7136] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:53:33.957460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d95f2-29f1-46a6-a9eb-ee4871f36380 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:33.959537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-225d95f2-29f1-46a6-a9eb-ee4871f36380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:33.973932 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3576/7137] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:53:33.975158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa636dfd-1be6-4478-903a-817738bfcaa7 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:34.051557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d95f2-29f1-46a6-a9eb-ee4871f36380 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:34.056928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4805d-ffeb-4863-b76b-7bddc90a87a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:34.057765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4805d-ffeb-4863-b76b-7bddc90a87a2 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:34.058093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4805d-ffeb-4863-b76b-7bddc90a87a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:34.058435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4805d-ffeb-4863-b76b-7bddc90a87a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:34.067908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4805d-ffeb-4863-b76b-7bddc90a87a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:34.069391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4805d-ffeb-4863-b76b-7bddc90a87a2 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:34.074534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa636dfd-1be6-4478-903a-817738bfcaa7 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:34.076834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d4510-ddbb-4691-b294-096085b42fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:34.077661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d4510-ddbb-4691-b294-096085b42fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:34.078131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d4510-ddbb-4691-b294-096085b42fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:34.078581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d4510-ddbb-4691-b294-096085b42fd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:34.079369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d4510-ddbb-4691-b294-096085b42fd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:34.080546 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3562/7138] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:53:34.083469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d4510-ddbb-4691-b294-096085b42fd3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:34.093455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4805d-ffeb-4863-b76b-7bddc90a87a2 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:34.108442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4805d-ffeb-4863-b76b-7bddc90a87a2 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:34.125380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7243cd9-082f-4ca9-82d0-af977ad18693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:34.126389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7243cd9-082f-4ca9-82d0-af977ad18693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:34.126669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7243cd9-082f-4ca9-82d0-af977ad18693 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:34.126952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7243cd9-082f-4ca9-82d0-af977ad18693 admin admin] PATH_INFO: `/v3/users/221b50c21fcb42929f7bfeb10a29d900` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:34.128680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7243cd9-082f-4ca9-82d0-af977ad18693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=221b50c21fcb42929f7bfeb10a29d900)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:34.130895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7243cd9-082f-4ca9-82d0-af977ad18693 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:34.213598 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3577/7139] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:53:33 2022] POST /identity/v3/projects => generated 387 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:34.218203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d4510-ddbb-4691-b294-096085b42fd3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:34.313926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d4510-ddbb-4691-b294-096085b42fd3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:34.320804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fe0f1-9b6f-442d-b50b-1a5d00ec823a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:34.321455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fe0f1-9b6f-442d-b50b-1a5d00ec823a admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:34.321796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fe0f1-9b6f-442d-b50b-1a5d00ec823a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:34.322352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fe0f1-9b6f-442d-b50b-1a5d00ec823a admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:34.323325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fe0f1-9b6f-442d-b50b-1a5d00ec823a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:34.327983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fe0f1-9b6f-442d-b50b-1a5d00ec823a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:34.377085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:34.394902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a7243cd9-082f-4ca9-82d0-af977ad18693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '221b50c21fcb42929f7bfeb10a29d900'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:34.396658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a7243cd9-082f-4ca9-82d0-af977ad18693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '221b50c21fcb42929f7bfeb10a29d900'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:34.441922 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3578/7140] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:53:34 2022] POST /identity/v3/users => generated 300 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:53:34.443024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a7243cd9-082f-4ca9-82d0-af977ad18693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '221b50c21fcb42929f7bfeb10a29d900'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:34.445871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fe0f1-9b6f-442d-b50b-1a5d00ec823a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:34.448951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b71fe0f1-9b6f-442d-b50b-1a5d00ec823a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:34.502523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a7243cd9-082f-4ca9-82d0-af977ad18693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '221b50c21fcb42929f7bfeb10a29d900'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:34.506107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a7243cd9-082f-4ca9-82d0-af977ad18693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '221b50c21fcb42929f7bfeb10a29d900'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:34.508010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fe0f1-9b6f-442d-b50b-1a5d00ec823a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:34.519686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a144fc-ac17-479b-8f72-abc0bdc1e513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:34.520571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a144fc-ac17-479b-8f72-abc0bdc1e513 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:34.525642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a144fc-ac17-479b-8f72-abc0bdc1e513 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:34.526244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a144fc-ac17-479b-8f72-abc0bdc1e513 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:34.527181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a144fc-ac17-479b-8f72-abc0bdc1e513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:34.529169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a144fc-ac17-479b-8f72-abc0bdc1e513 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:34.544033 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3579/7141] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:53:34.548019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a144fc-ac17-479b-8f72-abc0bdc1e513 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:34.561930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a144fc-ac17-479b-8f72-abc0bdc1e513 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:34.568989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37159d7c-6932-458c-bf09-d5438f48ce50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:34.569929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37159d7c-6932-458c-bf09-d5438f48ce50 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:34.570497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37159d7c-6932-458c-bf09-d5438f48ce50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:34.571208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37159d7c-6932-458c-bf09-d5438f48ce50 admin admin] PATH_INFO: `/v3/projects/a9ca506065c44e049060f27f5126b80d/users/601dccb25bcd4f19b68c082447e41095/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:34.581872 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3563/7142] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:53:34 2022] DELETE /identity/v3/users/221b50c21fcb42929f7bfeb10a29d900 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:53:34.586554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4044c77-9a45-4a39-bc65-99e859d1d2fb None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:34.587105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4044c77-9a45-4a39-bc65-99e859d1d2fb None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:34.587572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4044c77-9a45-4a39-bc65-99e859d1d2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:34.592703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37159d7c-6932-458c-bf09-d5438f48ce50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ca506065c44e049060f27f5126b80d, user_id=601dccb25bcd4f19b68c082447e41095, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:34.596439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37159d7c-6932-458c-bf09-d5438f48ce50 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:34.606194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:34.621687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c4044c77-9a45-4a39-bc65-99e859d1d2fb None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:34.623228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c4044c77-9a45-4a39-bc65-99e859d1d2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:34.703240 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3564/7144] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:53:34.706251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4044c77-9a45-4a39-bc65-99e859d1d2fb None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:34.717091 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3580/7144] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:53:34 2022] PUT /identity/v3/projects/a9ca506065c44e049060f27f5126b80d/users/601dccb25bcd4f19b68c082447e41095/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:53:34.718094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37159d7c-6932-458c-bf09-d5438f48ce50 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:34.720066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-37159d7c-6932-458c-bf09-d5438f48ce50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:34.721894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4044c77-9a45-4a39-bc65-99e859d1d2fb None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:34.886094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863eee5-11cf-452a-bb31-02e833713e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:34.886760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863eee5-11cf-452a-bb31-02e833713e1b admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:34.887051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863eee5-11cf-452a-bb31-02e833713e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:34.887334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863eee5-11cf-452a-bb31-02e833713e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:34.888005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863eee5-11cf-452a-bb31-02e833713e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:34.889697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863eee5-11cf-452a-bb31-02e833713e1b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:34.929717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37159d7c-6932-458c-bf09-d5438f48ce50 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:34.936769 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3565/7145] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:53:34.941288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863eee5-11cf-452a-bb31-02e833713e1b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:34.949865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68839d4-d067-4b7f-8ffe-d3644518a628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:34.950535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68839d4-d067-4b7f-8ffe-d3644518a628 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:34.950824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68839d4-d067-4b7f-8ffe-d3644518a628 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:34.951102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68839d4-d067-4b7f-8ffe-d3644518a628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:34.961647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863eee5-11cf-452a-bb31-02e833713e1b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:34.971047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68839d4-d067-4b7f-8ffe-d3644518a628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:34.975027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68839d4-d067-4b7f-8ffe-d3644518a628 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:34.982145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d982a3-6e97-4094-898b-4cc6900ce4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:34.982849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d982a3-6e97-4094-898b-4cc6900ce4c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:34.983137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d982a3-6e97-4094-898b-4cc6900ce4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:34.983484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d982a3-6e97-4094-898b-4cc6900ce4c5 admin admin] PATH_INFO: `/v3/projects/a9ca506065c44e049060f27f5126b80d/users/601dccb25bcd4f19b68c082447e41095/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:34.988004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d982a3-6e97-4094-898b-4cc6900ce4c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ca506065c44e049060f27f5126b80d, user_id=601dccb25bcd4f19b68c082447e41095, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:34.992408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d982a3-6e97-4094-898b-4cc6900ce4c5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:35.004152 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3581/7146] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:35.023330 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3566/7147] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:53:34 2022] PUT /identity/v3/projects/a9ca506065c44e049060f27f5126b80d/users/601dccb25bcd4f19b68c082447e41095/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:35.137277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3677bc-e8d2-4a3d-956a-90a5557671dd None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:35.138748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3677bc-e8d2-4a3d-956a-90a5557671dd None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:35.138748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3677bc-e8d2-4a3d-956a-90a5557671dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:35.178661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-bb3677bc-e8d2-4a3d-956a-90a5557671dd None None] MFA Rules not processed for user `601dccb25bcd4f19b68c082447e41095`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:35.179975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bb3677bc-e8d2-4a3d-956a-90a5557671dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:35.197091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:35.284024 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3582/7148] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:35.296610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d982a3-6e97-4094-898b-4cc6900ce4c5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:35.298380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-43d982a3-6e97-4094-898b-4cc6900ce4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:35.305641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3677bc-e8d2-4a3d-956a-90a5557671dd None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:35.307624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bb3677bc-e8d2-4a3d-956a-90a5557671dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:35.404108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:35.460741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d982a3-6e97-4094-898b-4cc6900ce4c5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:35.463077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3677bc-e8d2-4a3d-956a-90a5557671dd None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:35.467826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023655dd-0a26-46ee-80f8-65250a21fba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:35.468834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023655dd-0a26-46ee-80f8-65250a21fba9 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:35.469283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023655dd-0a26-46ee-80f8-65250a21fba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:35.469572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023655dd-0a26-46ee-80f8-65250a21fba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:35.481566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc33282-061f-4b41-a81a-9a2db0b61d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:35.482351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc33282-061f-4b41-a81a-9a2db0b61d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:35.482644 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc33282-061f-4b41-a81a-9a2db0b61d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:35.482933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc33282-061f-4b41-a81a-9a2db0b61d59 admin admin] PATH_INFO: `/v3/users/208fa2580bc04c66a14e4ef617c1a830` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:35.488780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023655dd-0a26-46ee-80f8-65250a21fba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:35.490266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc33282-061f-4b41-a81a-9a2db0b61d59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=208fa2580bc04c66a14e4ef617c1a830)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:35.490954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023655dd-0a26-46ee-80f8-65250a21fba9 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:35.492447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc33282-061f-4b41-a81a-9a2db0b61d59 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:35.507170 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3583/7149] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:35 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:35.735395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1dc33282-061f-4b41-a81a-9a2db0b61d59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '208fa2580bc04c66a14e4ef617c1a830'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:35.736161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1dc33282-061f-4b41-a81a-9a2db0b61d59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '208fa2580bc04c66a14e4ef617c1a830'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:35.743881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1dc33282-061f-4b41-a81a-9a2db0b61d59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '208fa2580bc04c66a14e4ef617c1a830'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:35.757947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023655dd-0a26-46ee-80f8-65250a21fba9 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:35.762073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-023655dd-0a26-46ee-80f8-65250a21fba9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:35.777023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1dc33282-061f-4b41-a81a-9a2db0b61d59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '208fa2580bc04c66a14e4ef617c1a830'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:35.778367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1dc33282-061f-4b41-a81a-9a2db0b61d59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '208fa2580bc04c66a14e4ef617c1a830'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:35.788490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023655dd-0a26-46ee-80f8-65250a21fba9 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:35.796165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef2d27-83bb-4d6c-ae1e-4a11cdc15a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:35.796893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef2d27-83bb-4d6c-ae1e-4a11cdc15a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:35.797186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef2d27-83bb-4d6c-ae1e-4a11cdc15a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:35.797466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef2d27-83bb-4d6c-ae1e-4a11cdc15a60 admin admin] PATH_INFO: `/v3/projects/0680394b30e8488e92a62bf530d8bf6e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:35.799070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef2d27-83bb-4d6c-ae1e-4a11cdc15a60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0680394b30e8488e92a62bf530d8bf6e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:35.801613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef2d27-83bb-4d6c-ae1e-4a11cdc15a60 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:35.870111 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3567/7150] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:53:35 2022] DELETE /identity/v3/users/208fa2580bc04c66a14e4ef617c1a830 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:35.871557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c00fc0-d2bc-493a-8abf-56692e76ddfc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:35.872326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c00fc0-d2bc-493a-8abf-56692e76ddfc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:35.872326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c00fc0-d2bc-493a-8abf-56692e76ddfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:35.897484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a0c00fc0-d2bc-493a-8abf-56692e76ddfc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:35.899213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a0c00fc0-d2bc-493a-8abf-56692e76ddfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:35.971418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e2ef2d27-83bb-4d6c-ae1e-4a11cdc15a60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0680394b30e8488e92a62bf530d8bf6e', 'request_id': 'req-e2ef2d27-83bb-4d6c-ae1e-4a11cdc15a60'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:36.003953 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3568/7151] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:53:36.019082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c00fc0-d2bc-493a-8abf-56692e76ddfc None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:36.020580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a0c00fc0-d2bc-493a-8abf-56692e76ddfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:36.056158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e2ef2d27-83bb-4d6c-ae1e-4a11cdc15a60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0680394b30e8488e92a62bf530d8bf6e', 'request_id': 'req-e2ef2d27-83bb-4d6c-ae1e-4a11cdc15a60'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:36.061855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e2ef2d27-83bb-4d6c-ae1e-4a11cdc15a60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0680394b30e8488e92a62bf530d8bf6e', 'request_id': 'req-e2ef2d27-83bb-4d6c-ae1e-4a11cdc15a60'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:36.077555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e2ef2d27-83bb-4d6c-ae1e-4a11cdc15a60 admin admin] The token cache is being invalidate because project 0680394b30e8488e92a62bf530d8bf6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:53:36.078338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e2ef2d27-83bb-4d6c-ae1e-4a11cdc15a60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:36.079278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e2ef2d27-83bb-4d6c-ae1e-4a11cdc15a60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:36.081178 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3584/7152] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:53:35 2022] DELETE /identity/v3/projects/0680394b30e8488e92a62bf530d8bf6e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:36.086236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585987ef-4f9f-4d96-9421-380e17700990 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:36.086429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585987ef-4f9f-4d96-9421-380e17700990 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:36.086769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585987ef-4f9f-4d96-9421-380e17700990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:36.109770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-585987ef-4f9f-4d96-9421-380e17700990 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:36.111181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-585987ef-4f9f-4d96-9421-380e17700990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:36.111887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c00fc0-d2bc-493a-8abf-56692e76ddfc None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:36.216396 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe388f-3e57-465c-b661-632893424e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:36.217080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe388f-3e57-465c-b661-632893424e71 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:36.217292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe388f-3e57-465c-b661-632893424e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:36.217573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe388f-3e57-465c-b661-632893424e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:36.219386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1cfe388f-3e57-465c-b661-632893424e71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:36.227019 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3585/7153] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:53:36.238394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64b20a-8bcf-4de2-b22b-b2f3000ca12f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:36.238689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64b20a-8bcf-4de2-b22b-b2f3000ca12f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:36.238972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64b20a-8bcf-4de2-b22b-b2f3000ca12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:36.248364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe388f-3e57-465c-b661-632893424e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:36.252069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe388f-3e57-465c-b661-632893424e71 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:36.273044 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3569/7154] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:53:36.279902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5a64b20a-8bcf-4de2-b22b-b2f3000ca12f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:36.281186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5a64b20a-8bcf-4de2-b22b-b2f3000ca12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:36.290390 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3586/7155] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:36.295011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe388f-3e57-465c-b661-632893424e71 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:36.309970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe388f-3e57-465c-b661-632893424e71 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:36.324868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc91e4-cc33-43ba-a42e-ffe00e3f4bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:36.330410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc91e4-cc33-43ba-a42e-ffe00e3f4bbf admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:36.332183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc91e4-cc33-43ba-a42e-ffe00e3f4bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:36.332714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc91e4-cc33-43ba-a42e-ffe00e3f4bbf admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:36.333996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc91e4-cc33-43ba-a42e-ffe00e3f4bbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:53:36.334462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc91e4-cc33-43ba-a42e-ffe00e3f4bbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:36.337199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc91e4-cc33-43ba-a42e-ffe00e3f4bbf admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:36.355194 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3570/7156] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:53:36.359253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64b20a-8bcf-4de2-b22b-b2f3000ca12f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:36.370460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64b20a-8bcf-4de2-b22b-b2f3000ca12f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:36.375027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:36.378814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b93623-2e37-4db6-86e8-e311ba77f021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:36.379557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b93623-2e37-4db6-86e8-e311ba77f021 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:36.379961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b93623-2e37-4db6-86e8-e311ba77f021 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:36.380326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b93623-2e37-4db6-86e8-e311ba77f021 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:36.381073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b93623-2e37-4db6-86e8-e311ba77f021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:36.383320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b93623-2e37-4db6-86e8-e311ba77f021 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:36.537488 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3587/7157] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:53:36 2022] POST /identity/v3/projects => generated 375 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:36.545590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc91e4-cc33-43ba-a42e-ffe00e3f4bbf admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:36.572534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc91e4-cc33-43ba-a42e-ffe00e3f4bbf admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:36.654989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:36.673605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794f6c1-49a9-4cbe-bb31-2fbc3d159662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:36.677953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794f6c1-49a9-4cbe-bb31-2fbc3d159662 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:36.677953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794f6c1-49a9-4cbe-bb31-2fbc3d159662 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:36.677953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794f6c1-49a9-4cbe-bb31-2fbc3d159662 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:36.677953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794f6c1-49a9-4cbe-bb31-2fbc3d159662 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:36.678335 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794f6c1-49a9-4cbe-bb31-2fbc3d159662 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:36.795248 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3571/7158] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:53:36 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:36.799371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b93623-2e37-4db6-86e8-e311ba77f021 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:36.811034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b93623-2e37-4db6-86e8-e311ba77f021 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:36.816653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3b08e-aaff-4030-9976-2036b0f409d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:36.817354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3b08e-aaff-4030-9976-2036b0f409d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:36.817737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3b08e-aaff-4030-9976-2036b0f409d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:36.818081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3b08e-aaff-4030-9976-2036b0f409d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:36.820536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3b08e-aaff-4030-9976-2036b0f409d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:36.822655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3b08e-aaff-4030-9976-2036b0f409d6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:36.842001 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3588/7159] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:36.842176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794f6c1-49a9-4cbe-bb31-2fbc3d159662 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:36.843909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6794f6c1-49a9-4cbe-bb31-2fbc3d159662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:36.850089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3b08e-aaff-4030-9976-2036b0f409d6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:36.861872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794f6c1-49a9-4cbe-bb31-2fbc3d159662 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:36.870427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b067f15-5bd4-4564-9cd8-4f278f33f5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:36.871152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b067f15-5bd4-4564-9cd8-4f278f33f5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:36.871446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b067f15-5bd4-4564-9cd8-4f278f33f5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:36.871736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b067f15-5bd4-4564-9cd8-4f278f33f5a7 admin admin] PATH_INFO: `/v3/projects/a5e1b2405a3d4d5b8c66efa9dad94750` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:36.873533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b067f15-5bd4-4564-9cd8-4f278f33f5a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5e1b2405a3d4d5b8c66efa9dad94750)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:36.875063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3b08e-aaff-4030-9976-2036b0f409d6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:36.875658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b067f15-5bd4-4564-9cd8-4f278f33f5a7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:36.885562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b5276-4a02-4865-95b4-fc101bac5c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:36.886397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b5276-4a02-4865-95b4-fc101bac5c32 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:36.886692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b5276-4a02-4865-95b4-fc101bac5c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:36.886966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b5276-4a02-4865-95b4-fc101bac5c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:36.887634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b5276-4a02-4865-95b4-fc101bac5c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:36.889273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b5276-4a02-4865-95b4-fc101bac5c32 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:36.941995 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3589/7160] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:36.943548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b5276-4a02-4865-95b4-fc101bac5c32 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:36.946939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-156b5276-4a02-4865-95b4-fc101bac5c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:37.058508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b5276-4a02-4865-95b4-fc101bac5c32 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:37.062451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee452b6d-14b6-49ff-b876-3d16ffaf9b08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:37.063306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee452b6d-14b6-49ff-b876-3d16ffaf9b08 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:37.063552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee452b6d-14b6-49ff-b876-3d16ffaf9b08 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:37.063937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee452b6d-14b6-49ff-b876-3d16ffaf9b08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:37.066085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ee452b6d-14b6-49ff-b876-3d16ffaf9b08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:37.087451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2b067f15-5bd4-4564-9cd8-4f278f33f5a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5e1b2405a3d4d5b8c66efa9dad94750', 'request_id': 'req-2b067f15-5bd4-4564-9cd8-4f278f33f5a7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:37.095529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2b067f15-5bd4-4564-9cd8-4f278f33f5a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5e1b2405a3d4d5b8c66efa9dad94750', 'request_id': 'req-2b067f15-5bd4-4564-9cd8-4f278f33f5a7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:37.103929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2b067f15-5bd4-4564-9cd8-4f278f33f5a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5e1b2405a3d4d5b8c66efa9dad94750', 'request_id': 'req-2b067f15-5bd4-4564-9cd8-4f278f33f5a7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:37.168877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee452b6d-14b6-49ff-b876-3d16ffaf9b08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:37.170647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee452b6d-14b6-49ff-b876-3d16ffaf9b08 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:37.181486 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3590/7161] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:36 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:37.182977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee452b6d-14b6-49ff-b876-3d16ffaf9b08 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:37.210775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee452b6d-14b6-49ff-b876-3d16ffaf9b08 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:37.216298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2b067f15-5bd4-4564-9cd8-4f278f33f5a7 admin admin] The token cache is being invalidate because project a5e1b2405a3d4d5b8c66efa9dad94750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:53:37.216740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2b067f15-5bd4-4564-9cd8-4f278f33f5a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:37.218261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2b067f15-5bd4-4564-9cd8-4f278f33f5a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:37.225480 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3572/7162] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:53:36 2022] DELETE /identity/v3/projects/a5e1b2405a3d4d5b8c66efa9dad94750 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:37.227197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beba5c2-1ff7-4239-84e5-45dc68187498 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:37.227581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beba5c2-1ff7-4239-84e5-45dc68187498 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:37.227963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beba5c2-1ff7-4239-84e5-45dc68187498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:37.266279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8beba5c2-1ff7-4239-84e5-45dc68187498 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:37.269181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8beba5c2-1ff7-4239-84e5-45dc68187498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:37.339381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b8504-df5e-464c-91d6-d98db4c00ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:37.340038 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b8504-df5e-464c-91d6-d98db4c00ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:37.340380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b8504-df5e-464c-91d6-d98db4c00ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:37.340664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b8504-df5e-464c-91d6-d98db4c00ad5 admin admin] PATH_INFO: `/v3/projects/4de380c386254d2699dd46fc97a179ff/users/97fddc74d42a4280b4ffa80150591a7f/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:37.370916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b8504-df5e-464c-91d6-d98db4c00ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de380c386254d2699dd46fc97a179ff, user_id=97fddc74d42a4280b4ffa80150591a7f, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:37.377653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b8504-df5e-464c-91d6-d98db4c00ad5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:37.392722 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3573/7163] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:37.400524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cde50-dd01-4bf6-8518-e6d8363dd23f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:37.400835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cde50-dd01-4bf6-8518-e6d8363dd23f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:37.401118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cde50-dd01-4bf6-8518-e6d8363dd23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:37.422673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-886cde50-dd01-4bf6-8518-e6d8363dd23f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:37.423882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-886cde50-dd01-4bf6-8518-e6d8363dd23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:37.433299 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3574/7164] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:53:37.437068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cde50-dd01-4bf6-8518-e6d8363dd23f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:37.457437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cde50-dd01-4bf6-8518-e6d8363dd23f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:37.457437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc77a2-388c-4f34-bc18-7ab96d993835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:37.457437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc77a2-388c-4f34-bc18-7ab96d993835 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:37.457437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc77a2-388c-4f34-bc18-7ab96d993835 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:37.457937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc77a2-388c-4f34-bc18-7ab96d993835 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:37.457937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc77a2-388c-4f34-bc18-7ab96d993835 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:53:37.457937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc77a2-388c-4f34-bc18-7ab96d993835 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:37.460628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc77a2-388c-4f34-bc18-7ab96d993835 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:37.476781 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3575/7165] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:53:37.478063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc77a2-388c-4f34-bc18-7ab96d993835 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:37.485528 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3591/7166] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:53:37 2022] PUT /identity/v3/projects/4de380c386254d2699dd46fc97a179ff/users/97fddc74d42a4280b4ffa80150591a7f/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:37.494291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc77a2-388c-4f34-bc18-7ab96d993835 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:37.500503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8802b-02dd-4fdd-904a-7f373d174c43 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:37.500838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8802b-02dd-4fdd-904a-7f373d174c43 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:37.501165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8802b-02dd-4fdd-904a-7f373d174c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:37.542919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-85f8802b-02dd-4fdd-904a-7f373d174c43 None None] MFA Rules not processed for user `97fddc74d42a4280b4ffa80150591a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:37.544142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-85f8802b-02dd-4fdd-904a-7f373d174c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:37.594959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5b129-2888-4b27-ae7c-3060bd16ee0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:37.596192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5b129-2888-4b27-ae7c-3060bd16ee0d admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:37.597384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5b129-2888-4b27-ae7c-3060bd16ee0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:37.597852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5b129-2888-4b27-ae7c-3060bd16ee0d admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:37.598649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5b129-2888-4b27-ae7c-3060bd16ee0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:37.600973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5b129-2888-4b27-ae7c-3060bd16ee0d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:37.617882 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3592/7167] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:53:37.632755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8802b-02dd-4fdd-904a-7f373d174c43 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:37.634389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-85f8802b-02dd-4fdd-904a-7f373d174c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:37.677054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:37.741410 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3576/7168] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:53:37 2022] POST /identity/v3/projects => generated 385 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:53:37.742213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8802b-02dd-4fdd-904a-7f373d174c43 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:37.747434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5b129-2888-4b27-ae7c-3060bd16ee0d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:37.837884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761bd87-9cb4-4bf8-befe-5d71de947f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:37.838699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761bd87-9cb4-4bf8-befe-5d71de947f04 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:37.839518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761bd87-9cb4-4bf8-befe-5d71de947f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:37.839518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761bd87-9cb4-4bf8-befe-5d71de947f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:37.889083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5b129-2888-4b27-ae7c-3060bd16ee0d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:37.897074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a681bb-be02-474d-afd4-a03354db5c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:37.897859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a681bb-be02-474d-afd4-a03354db5c05 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:37.898397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a681bb-be02-474d-afd4-a03354db5c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:37.898748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a681bb-be02-474d-afd4-a03354db5c05 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:37.899460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a681bb-be02-474d-afd4-a03354db5c05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:37.902165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a681bb-be02-474d-afd4-a03354db5c05 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:37.926730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761bd87-9cb4-4bf8-befe-5d71de947f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:37.928434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761bd87-9cb4-4bf8-befe-5d71de947f04 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:37.941740 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3593/7169] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:53:38.003993 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3577/7170] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:53:37 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:38.008172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761bd87-9cb4-4bf8-befe-5d71de947f04 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:38.020575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761bd87-9cb4-4bf8-befe-5d71de947f04 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:38.025677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ce21c-6b85-4acc-8c8e-1584d7cdc545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:38.027010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ce21c-6b85-4acc-8c8e-1584d7cdc545 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:38.027010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ce21c-6b85-4acc-8c8e-1584d7cdc545 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:38.027010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ce21c-6b85-4acc-8c8e-1584d7cdc545 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:38.028125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ce21c-6b85-4acc-8c8e-1584d7cdc545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:38.029355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ce21c-6b85-4acc-8c8e-1584d7cdc545 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:38.039906 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3594/7171] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:38.050451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a681bb-be02-474d-afd4-a03354db5c05 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:38.062022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a681bb-be02-474d-afd4-a03354db5c05 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:38.068134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005675d3-18fd-48bc-a43a-302ad8693d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:38.068883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005675d3-18fd-48bc-a43a-302ad8693d6f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:38.074289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005675d3-18fd-48bc-a43a-302ad8693d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:38.074832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005675d3-18fd-48bc-a43a-302ad8693d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:38.075588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005675d3-18fd-48bc-a43a-302ad8693d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:38.077250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005675d3-18fd-48bc-a43a-302ad8693d6f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:38.093976 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3578/7172] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:53:38.099137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ce21c-6b85-4acc-8c8e-1584d7cdc545 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:38.110677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ce21c-6b85-4acc-8c8e-1584d7cdc545 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:38.117130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31bab8-31e7-488c-9277-e90b9f835a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:38.117927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31bab8-31e7-488c-9277-e90b9f835a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:38.119312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31bab8-31e7-488c-9277-e90b9f835a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:38.119312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31bab8-31e7-488c-9277-e90b9f835a0b admin admin] PATH_INFO: `/v3/projects/fbcd60340e3b4bc89a238422bb3bbb4a/users/94f7f729d00542ffbca889bece2af3dd/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:38.143875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31bab8-31e7-488c-9277-e90b9f835a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbcd60340e3b4bc89a238422bb3bbb4a, user_id=94f7f729d00542ffbca889bece2af3dd, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:38.147030 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31bab8-31e7-488c-9277-e90b9f835a0b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:38.242252 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3595/7173] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:53:38 2022] PUT /identity/v3/projects/fbcd60340e3b4bc89a238422bb3bbb4a/users/94f7f729d00542ffbca889bece2af3dd/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:38.253875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb673711-3a85-4419-b091-8beb0ca99709 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:38.254414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb673711-3a85-4419-b091-8beb0ca99709 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:38.254666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb673711-3a85-4419-b091-8beb0ca99709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:38.286856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-eb673711-3a85-4419-b091-8beb0ca99709 None None] MFA Rules not processed for user `94f7f729d00542ffbca889bece2af3dd`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:38.288196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-eb673711-3a85-4419-b091-8beb0ca99709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:38.385633 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3579/7174] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:38.400876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31bab8-31e7-488c-9277-e90b9f835a0b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:38.402574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7f31bab8-31e7-488c-9277-e90b9f835a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:38.489079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31bab8-31e7-488c-9277-e90b9f835a0b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:38.494677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fa511-27f1-4152-86e5-2335064d6c7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:38.495315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fa511-27f1-4152-86e5-2335064d6c7d service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:38.495601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fa511-27f1-4152-86e5-2335064d6c7d service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:38.495878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fa511-27f1-4152-86e5-2335064d6c7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:38.509628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21fa511-27f1-4152-86e5-2335064d6c7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:38.509628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21fa511-27f1-4152-86e5-2335064d6c7d service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:38.520795 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3596/7175] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:38.901104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb673711-3a85-4419-b091-8beb0ca99709 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:38.967537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb673711-3a85-4419-b091-8beb0ca99709 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:38.973497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff9e0a-3360-45be-90bb-d68386bd12cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:38.974605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff9e0a-3360-45be-90bb-d68386bd12cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:38.975055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff9e0a-3360-45be-90bb-d68386bd12cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:38.975500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff9e0a-3360-45be-90bb-d68386bd12cd admin admin] PATH_INFO: `/v3/users/94f7f729d00542ffbca889bece2af3dd` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:38.976775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff9e0a-3360-45be-90bb-d68386bd12cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=94f7f729d00542ffbca889bece2af3dd)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:38.978977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff9e0a-3360-45be-90bb-d68386bd12cd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:38.999083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:39.230437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:39.276932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-daff9e0a-3360-45be-90bb-d68386bd12cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94f7f729d00542ffbca889bece2af3dd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:39.277720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-daff9e0a-3360-45be-90bb-d68386bd12cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94f7f729d00542ffbca889bece2af3dd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:39.286890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-daff9e0a-3360-45be-90bb-d68386bd12cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94f7f729d00542ffbca889bece2af3dd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:39.302554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-daff9e0a-3360-45be-90bb-d68386bd12cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94f7f729d00542ffbca889bece2af3dd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:39.303292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-daff9e0a-3360-45be-90bb-d68386bd12cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94f7f729d00542ffbca889bece2af3dd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:39.415192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fa511-27f1-4152-86e5-2335064d6c7d service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:39.419466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d21fa511-27f1-4152-86e5-2335064d6c7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:39.438327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fa511-27f1-4152-86e5-2335064d6c7d service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:39.445226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514f7b9-b7d2-4a03-856c-6045c3130865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:39.447243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514f7b9-b7d2-4a03-856c-6045c3130865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:39.454709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514f7b9-b7d2-4a03-856c-6045c3130865 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:39.454709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514f7b9-b7d2-4a03-856c-6045c3130865 admin admin] PATH_INFO: `/v3/users/97fddc74d42a4280b4ffa80150591a7f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:39.454709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514f7b9-b7d2-4a03-856c-6045c3130865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97fddc74d42a4280b4ffa80150591a7f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:39.455076 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3580/7176] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:53:38 2022] DELETE /identity/v3/users/94f7f729d00542ffbca889bece2af3dd => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:39.455184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514f7b9-b7d2-4a03-856c-6045c3130865 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:39.455293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86517c02-bae8-4b32-9c50-3a7f52637027 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:39.455293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86517c02-bae8-4b32-9c50-3a7f52637027 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:39.455293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86517c02-bae8-4b32-9c50-3a7f52637027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:39.481146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-86517c02-bae8-4b32-9c50-3a7f52637027 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:39.489036 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-86517c02-bae8-4b32-9c50-3a7f52637027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:39.574631 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3581/7177] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:39.591500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86517c02-bae8-4b32-9c50-3a7f52637027 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:39.593289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-86517c02-bae8-4b32-9c50-3a7f52637027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:39.667001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86517c02-bae8-4b32-9c50-3a7f52637027 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:39.673795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8c939-9df5-4dc5-a434-91401648a312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:39.675473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8c939-9df5-4dc5-a434-91401648a312 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:39.676861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8c939-9df5-4dc5-a434-91401648a312 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:39.679122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8c939-9df5-4dc5-a434-91401648a312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:39.695152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8c939-9df5-4dc5-a434-91401648a312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:39.698162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8c939-9df5-4dc5-a434-91401648a312 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:39.707540 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3582/7178] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:39.725519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:39.785079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6514f7b9-b7d2-4a03-856c-6045c3130865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97fddc74d42a4280b4ffa80150591a7f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:39.786344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6514f7b9-b7d2-4a03-856c-6045c3130865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97fddc74d42a4280b4ffa80150591a7f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:39.804953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6514f7b9-b7d2-4a03-856c-6045c3130865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97fddc74d42a4280b4ffa80150591a7f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:39.818687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6514f7b9-b7d2-4a03-856c-6045c3130865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97fddc74d42a4280b4ffa80150591a7f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:39.913910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6514f7b9-b7d2-4a03-856c-6045c3130865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97fddc74d42a4280b4ffa80150591a7f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:39.921257 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3597/7179] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:53:39 2022] DELETE /identity/v3/users/97fddc74d42a4280b4ffa80150591a7f => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:39.926145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33506b51-917b-4d13-909a-7227bc5f58af None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:39.926723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33506b51-917b-4d13-909a-7227bc5f58af None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:39.927222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33506b51-917b-4d13-909a-7227bc5f58af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:39.965864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-33506b51-917b-4d13-909a-7227bc5f58af None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:39.967806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-33506b51-917b-4d13-909a-7227bc5f58af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:40.060575 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3583/7180] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:40.070492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514f7b9-b7d2-4a03-856c-6045c3130865 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:40.077870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6514f7b9-b7d2-4a03-856c-6045c3130865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:40.115312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33506b51-917b-4d13-909a-7227bc5f58af None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:40.116910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-33506b51-917b-4d13-909a-7227bc5f58af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:40.142578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33506b51-917b-4d13-909a-7227bc5f58af None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:40.146097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514f7b9-b7d2-4a03-856c-6045c3130865 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:40.147808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0921fe8-c220-4e09-8b37-25729f6b5ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:40.148754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0921fe8-c220-4e09-8b37-25729f6b5ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:40.149043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0921fe8-c220-4e09-8b37-25729f6b5ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:40.149846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0921fe8-c220-4e09-8b37-25729f6b5ac0 admin admin] PATH_INFO: `/v3/users/876c3d670e1346d0b2e734ac0cc19b9f` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:40.150829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0921fe8-c220-4e09-8b37-25729f6b5ac0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=876c3d670e1346d0b2e734ac0cc19b9f)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:40.153313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0921fe8-c220-4e09-8b37-25729f6b5ac0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:40.154561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b57f28-1509-4e39-b566-50ea69dd9716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:40.155374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b57f28-1509-4e39-b566-50ea69dd9716 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:40.155671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b57f28-1509-4e39-b566-50ea69dd9716 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:40.156674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b57f28-1509-4e39-b566-50ea69dd9716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:40.178072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b57f28-1509-4e39-b566-50ea69dd9716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:40.179311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b57f28-1509-4e39-b566-50ea69dd9716 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:40.203237 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3598/7181] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:40.318987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b57f28-1509-4e39-b566-50ea69dd9716 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:40.320919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-23b57f28-1509-4e39-b566-50ea69dd9716 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:40.344971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b57f28-1509-4e39-b566-50ea69dd9716 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:40.348525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927486c8-4a95-44d2-ae50-082b4ab4a186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:40.349338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927486c8-4a95-44d2-ae50-082b4ab4a186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:40.349482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927486c8-4a95-44d2-ae50-082b4ab4a186 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:40.349814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927486c8-4a95-44d2-ae50-082b4ab4a186 admin admin] PATH_INFO: `/v3/projects/fbcd60340e3b4bc89a238422bb3bbb4a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:40.351459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927486c8-4a95-44d2-ae50-082b4ab4a186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbcd60340e3b4bc89a238422bb3bbb4a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:40.353632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927486c8-4a95-44d2-ae50-082b4ab4a186 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:40.459102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b0921fe8-c220-4e09-8b37-25729f6b5ac0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '876c3d670e1346d0b2e734ac0cc19b9f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:40.459852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b0921fe8-c220-4e09-8b37-25729f6b5ac0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '876c3d670e1346d0b2e734ac0cc19b9f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:40.468596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b0921fe8-c220-4e09-8b37-25729f6b5ac0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '876c3d670e1346d0b2e734ac0cc19b9f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:40.481384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b0921fe8-c220-4e09-8b37-25729f6b5ac0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '876c3d670e1346d0b2e734ac0cc19b9f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:40.482165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-b0921fe8-c220-4e09-8b37-25729f6b5ac0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '876c3d670e1346d0b2e734ac0cc19b9f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:40.536953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-927486c8-4a95-44d2-ae50-082b4ab4a186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbcd60340e3b4bc89a238422bb3bbb4a', 'request_id': 'req-927486c8-4a95-44d2-ae50-082b4ab4a186'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:40.620921 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3584/7182] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:53:40 2022] DELETE /identity/v3/users/876c3d670e1346d0b2e734ac0cc19b9f => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:40.625301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a326d39-0b80-4fe1-b1f5-3509a45a9c9d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:40.625592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a326d39-0b80-4fe1-b1f5-3509a45a9c9d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:40.625869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a326d39-0b80-4fe1-b1f5-3509a45a9c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:40.666648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6a326d39-0b80-4fe1-b1f5-3509a45a9c9d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:40.673731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6a326d39-0b80-4fe1-b1f5-3509a45a9c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:40.696675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-927486c8-4a95-44d2-ae50-082b4ab4a186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbcd60340e3b4bc89a238422bb3bbb4a', 'request_id': 'req-927486c8-4a95-44d2-ae50-082b4ab4a186'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:40.704849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-927486c8-4a95-44d2-ae50-082b4ab4a186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbcd60340e3b4bc89a238422bb3bbb4a', 'request_id': 'req-927486c8-4a95-44d2-ae50-082b4ab4a186'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:40.720736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-927486c8-4a95-44d2-ae50-082b4ab4a186 admin admin] The token cache is being invalidate because project fbcd60340e3b4bc89a238422bb3bbb4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:53:40.721050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-927486c8-4a95-44d2-ae50-082b4ab4a186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:40.722401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-927486c8-4a95-44d2-ae50-082b4ab4a186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:40.724235 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3599/7183] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:53:40 2022] DELETE /identity/v3/projects/fbcd60340e3b4bc89a238422bb3bbb4a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:53:40.732006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17445aca-2d94-4ea9-8745-7e796abcb8e2 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:40.732938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17445aca-2d94-4ea9-8745-7e796abcb8e2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:40.733392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17445aca-2d94-4ea9-8745-7e796abcb8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:40.758696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-17445aca-2d94-4ea9-8745-7e796abcb8e2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:40.760160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-17445aca-2d94-4ea9-8745-7e796abcb8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:40.777542 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3585/7184] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:53:40.787145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a326d39-0b80-4fe1-b1f5-3509a45a9c9d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:40.788512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6a326d39-0b80-4fe1-b1f5-3509a45a9c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:40.829084 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3600/7185] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:40.836799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30bf9a-eb1d-4df5-8bd7-a7a423bf5d06 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:40.837111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30bf9a-eb1d-4df5-8bd7-a7a423bf5d06 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:40.841905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30bf9a-eb1d-4df5-8bd7-a7a423bf5d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:40.851930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a326d39-0b80-4fe1-b1f5-3509a45a9c9d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:40.856265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d929c44-a5af-4af8-8ff6-2531bb6e1150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:40.857028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d929c44-a5af-4af8-8ff6-2531bb6e1150 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:40.857308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d929c44-a5af-4af8-8ff6-2531bb6e1150 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:40.857600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d929c44-a5af-4af8-8ff6-2531bb6e1150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:40.858258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-3d30bf9a-eb1d-4df5-8bd7-a7a423bf5d06 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:40.859764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3d30bf9a-eb1d-4df5-8bd7-a7a423bf5d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:40.867443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d929c44-a5af-4af8-8ff6-2531bb6e1150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:40.868215 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3601/7186] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:53:40.869107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d929c44-a5af-4af8-8ff6-2531bb6e1150 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:40.879662 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3586/7187] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:53:40.880488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30bf9a-eb1d-4df5-8bd7-a7a423bf5d06 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:40.890676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30bf9a-eb1d-4df5-8bd7-a7a423bf5d06 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:40.896073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74dd838-2a58-4c16-b165-e15e366db430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:40.896674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dd838-2a58-4c16-b165-e15e366db430 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:40.896952 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dd838-2a58-4c16-b165-e15e366db430 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:40.897341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dd838-2a58-4c16-b165-e15e366db430 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:40.898163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74dd838-2a58-4c16-b165-e15e366db430 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:53:40.908837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74dd838-2a58-4c16-b165-e15e366db430 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:40.908837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74dd838-2a58-4c16-b165-e15e366db430 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:40.918164 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3602/7188] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:53:40.922211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d929c44-a5af-4af8-8ff6-2531bb6e1150 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:40.951163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d929c44-a5af-4af8-8ff6-2531bb6e1150 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:40.958446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4c806-e769-4627-ad71-23d4c4a921de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:40.959294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4c806-e769-4627-ad71-23d4c4a921de admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:40.959746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4c806-e769-4627-ad71-23d4c4a921de admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:40.960294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4c806-e769-4627-ad71-23d4c4a921de admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:40.961115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4c806-e769-4627-ad71-23d4c4a921de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:40.963546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4c806-e769-4627-ad71-23d4c4a921de admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:40.996998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74dd838-2a58-4c16-b165-e15e366db430 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:40.999056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c74dd838-2a58-4c16-b165-e15e366db430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:41.022577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74dd838-2a58-4c16-b165-e15e366db430 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:41.035364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322a697-dd0a-44eb-a0b4-8846f2a1f329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:41.036356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322a697-dd0a-44eb-a0b4-8846f2a1f329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:41.036737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322a697-dd0a-44eb-a0b4-8846f2a1f329 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:41.037209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322a697-dd0a-44eb-a0b4-8846f2a1f329 admin admin] PATH_INFO: `/v3/projects/4de380c386254d2699dd46fc97a179ff` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:41.042989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322a697-dd0a-44eb-a0b4-8846f2a1f329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4de380c386254d2699dd46fc97a179ff)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:41.048455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322a697-dd0a-44eb-a0b4-8846f2a1f329 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:41.134283 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3587/7189] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:53:40 2022] POST /identity/v3/projects => generated 359 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:53:41.138149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4c806-e769-4627-ad71-23d4c4a921de admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:41.233127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4c806-e769-4627-ad71-23d4c4a921de admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:41.243043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9322a697-dd0a-44eb-a0b4-8846f2a1f329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4de380c386254d2699dd46fc97a179ff', 'request_id': 'req-9322a697-dd0a-44eb-a0b4-8846f2a1f329'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:41.318513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2cfb0-010e-45fd-b7ab-4c53f0f7cfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:41.319183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2cfb0-010e-45fd-b7ab-4c53f0f7cfe0 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:41.319484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2cfb0-010e-45fd-b7ab-4c53f0f7cfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:41.319766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2cfb0-010e-45fd-b7ab-4c53f0f7cfe0 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:41.320478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2cfb0-010e-45fd-b7ab-4c53f0f7cfe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:41.322478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2cfb0-010e-45fd-b7ab-4c53f0f7cfe0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:41.356046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9322a697-dd0a-44eb-a0b4-8846f2a1f329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4de380c386254d2699dd46fc97a179ff', 'request_id': 'req-9322a697-dd0a-44eb-a0b4-8846f2a1f329'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:41.364361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9322a697-dd0a-44eb-a0b4-8846f2a1f329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4de380c386254d2699dd46fc97a179ff', 'request_id': 'req-9322a697-dd0a-44eb-a0b4-8846f2a1f329'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:41.375893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9322a697-dd0a-44eb-a0b4-8846f2a1f329 admin admin] The token cache is being invalidate because project 4de380c386254d2699dd46fc97a179ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:53:41.376116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9322a697-dd0a-44eb-a0b4-8846f2a1f329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:41.376783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9322a697-dd0a-44eb-a0b4-8846f2a1f329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:41.378919 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3603/7190] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:53:40 2022] DELETE /identity/v3/projects/4de380c386254d2699dd46fc97a179ff => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:53:41.382203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322a697-dd0a-44eb-a0b4-8846f2a1f329 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:41.383145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9322a697-dd0a-44eb-a0b4-8846f2a1f329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:41.397087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322a697-dd0a-44eb-a0b4-8846f2a1f329 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:41.402922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bac42e-7ec2-4a61-8572-ca1eb735ed0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:41.403648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bac42e-7ec2-4a61-8572-ca1eb735ed0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:41.413246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bac42e-7ec2-4a61-8572-ca1eb735ed0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:41.413246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bac42e-7ec2-4a61-8572-ca1eb735ed0f admin admin] PATH_INFO: `/v3/projects/7ca2d8e42a8846b282980db1e9f62304` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:41.413246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bac42e-7ec2-4a61-8572-ca1eb735ed0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ca2d8e42a8846b282980db1e9f62304)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:41.413246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bac42e-7ec2-4a61-8572-ca1eb735ed0f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:41.472905 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3588/7191] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:53:41 2022] POST /identity/v3/users => generated 280 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:41.474452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf7107-9bff-42c1-9f1e-651716d96bcc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:41.474748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf7107-9bff-42c1-9f1e-651716d96bcc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:41.475030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf7107-9bff-42c1-9f1e-651716d96bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:41.501092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9dbf7107-9bff-42c1-9f1e-651716d96bcc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:41.502418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9dbf7107-9bff-42c1-9f1e-651716d96bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:41.513411 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3589/7192] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:41.514255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf7107-9bff-42c1-9f1e-651716d96bcc None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:41.515500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9dbf7107-9bff-42c1-9f1e-651716d96bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:41.528106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf7107-9bff-42c1-9f1e-651716d96bcc None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:41.540911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d5bac42e-7ec2-4a61-8572-ca1eb735ed0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ca2d8e42a8846b282980db1e9f62304', 'request_id': 'req-d5bac42e-7ec2-4a61-8572-ca1eb735ed0f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:41.556981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:41.592252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bb5ba-26b5-4de1-8ac3-e00eb7278f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:41.593205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bb5ba-26b5-4de1-8ac3-e00eb7278f1f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:41.593684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bb5ba-26b5-4de1-8ac3-e00eb7278f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:41.593967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bb5ba-26b5-4de1-8ac3-e00eb7278f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:41.594907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1bb5ba-26b5-4de1-8ac3-e00eb7278f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:41.596329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1bb5ba-26b5-4de1-8ac3-e00eb7278f1f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:41.610081 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3590/7193] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:41.610081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be9fb1-870f-4147-8eaa-78dc40a740cf None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:41.610081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be9fb1-870f-4147-8eaa-78dc40a740cf None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:41.610081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be9fb1-870f-4147-8eaa-78dc40a740cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:41.630054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a4be9fb1-870f-4147-8eaa-78dc40a740cf None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:41.631214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a4be9fb1-870f-4147-8eaa-78dc40a740cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:41.641484 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3591/7194] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:41.641484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be9fb1-870f-4147-8eaa-78dc40a740cf None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:41.651172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be9fb1-870f-4147-8eaa-78dc40a740cf None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:41.656100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff4fee-5891-4419-8ee7-47df2ccc6b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:41.656720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff4fee-5891-4419-8ee7-47df2ccc6b06 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:41.657007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff4fee-5891-4419-8ee7-47df2ccc6b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:41.657289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff4fee-5891-4419-8ee7-47df2ccc6b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:41.657946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff4fee-5891-4419-8ee7-47df2ccc6b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:41.659888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff4fee-5891-4419-8ee7-47df2ccc6b06 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:41.670597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d5bac42e-7ec2-4a61-8572-ca1eb735ed0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ca2d8e42a8846b282980db1e9f62304', 'request_id': 'req-d5bac42e-7ec2-4a61-8572-ca1eb735ed0f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:41.681310 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3592/7195] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:41.684814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d5bac42e-7ec2-4a61-8572-ca1eb735ed0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ca2d8e42a8846b282980db1e9f62304', 'request_id': 'req-d5bac42e-7ec2-4a61-8572-ca1eb735ed0f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:41.685561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff4fee-5891-4419-8ee7-47df2ccc6b06 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:41.699129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff4fee-5891-4419-8ee7-47df2ccc6b06 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:41.704830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d5bac42e-7ec2-4a61-8572-ca1eb735ed0f admin admin] The token cache is being invalidate because project 7ca2d8e42a8846b282980db1e9f62304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:53:41.705410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d5bac42e-7ec2-4a61-8572-ca1eb735ed0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:41.707345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d5bac42e-7ec2-4a61-8572-ca1eb735ed0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:41.707507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae936a53-db5f-4731-a090-25569d927b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:41.708967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae936a53-db5f-4731-a090-25569d927b87 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:41.708967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae936a53-db5f-4731-a090-25569d927b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:41.708967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae936a53-db5f-4731-a090-25569d927b87 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:41.717593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae936a53-db5f-4731-a090-25569d927b87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:53:41.717593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae936a53-db5f-4731-a090-25569d927b87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:41.717593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae936a53-db5f-4731-a090-25569d927b87 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:41.717882 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3604/7196] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:53:41 2022] DELETE /identity/v3/projects/7ca2d8e42a8846b282980db1e9f62304 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:41.717882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bac42e-7ec2-4a61-8572-ca1eb735ed0f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:41.717882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d5bac42e-7ec2-4a61-8572-ca1eb735ed0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:41.735539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bac42e-7ec2-4a61-8572-ca1eb735ed0f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:41.735826 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3593/7197] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:53:41.736921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae936a53-db5f-4731-a090-25569d927b87 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:41.739504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ae936a53-db5f-4731-a090-25569d927b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:41.741208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338df21-5726-4da6-9e89-511298b78612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:41.741935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338df21-5726-4da6-9e89-511298b78612 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:41.742446 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338df21-5726-4da6-9e89-511298b78612 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:41.742816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338df21-5726-4da6-9e89-511298b78612 admin admin] PATH_INFO: `/v3/projects/412efc174a98498fb4e4f250eed77bd3/users/e45eb7db4e1c49339e58401fe8935f59/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:41.757523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae936a53-db5f-4731-a090-25569d927b87 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:41.760063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338df21-5726-4da6-9e89-511298b78612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=412efc174a98498fb4e4f250eed77bd3, user_id=e45eb7db4e1c49339e58401fe8935f59, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:41.762860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bf063-fe64-4172-b740-344e5574f3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:41.763007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338df21-5726-4da6-9e89-511298b78612 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:41.763844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bf063-fe64-4172-b740-344e5574f3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:41.764169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bf063-fe64-4172-b740-344e5574f3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:41.764675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bf063-fe64-4172-b740-344e5574f3a8 admin admin] PATH_INFO: `/v3/users/cb41c88f3e9d4793817d43a15c8c02ac` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:41.767888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8bf063-fe64-4172-b740-344e5574f3a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb41c88f3e9d4793817d43a15c8c02ac)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:41.770734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8bf063-fe64-4172-b740-344e5574f3a8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:41.888978 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3605/7198] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:53:41 2022] PUT /identity/v3/projects/412efc174a98498fb4e4f250eed77bd3/users/e45eb7db4e1c49339e58401fe8935f59/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:41.888978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338df21-5726-4da6-9e89-511298b78612 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:41.890887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5338df21-5726-4da6-9e89-511298b78612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:41.991701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:41.996158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338df21-5726-4da6-9e89-511298b78612 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:42.008798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f0b92-c29a-4cf6-8de7-056cc78e97e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:42.009424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f0b92-c29a-4cf6-8de7-056cc78e97e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:42.009920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f0b92-c29a-4cf6-8de7-056cc78e97e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:42.010249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f0b92-c29a-4cf6-8de7-056cc78e97e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:42.010960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f0b92-c29a-4cf6-8de7-056cc78e97e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:42.012912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f0b92-c29a-4cf6-8de7-056cc78e97e2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:42.078410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1d8bf063-fe64-4172-b740-344e5574f3a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb41c88f3e9d4793817d43a15c8c02ac'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:42.079413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1d8bf063-fe64-4172-b740-344e5574f3a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb41c88f3e9d4793817d43a15c8c02ac'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:42.093233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1d8bf063-fe64-4172-b740-344e5574f3a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb41c88f3e9d4793817d43a15c8c02ac'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:42.123695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1d8bf063-fe64-4172-b740-344e5574f3a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb41c88f3e9d4793817d43a15c8c02ac'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:42.125661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1d8bf063-fe64-4172-b740-344e5574f3a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb41c88f3e9d4793817d43a15c8c02ac'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:42.153730 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3606/7199] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:53:41 2022] POST /identity/v3/projects => generated 375 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:42.155567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a194c2-aa10-420d-b542-281c4b384277 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:42.156180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a194c2-aa10-420d-b542-281c4b384277 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:42.156826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a194c2-aa10-420d-b542-281c4b384277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:42.194410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-91a194c2-aa10-420d-b542-281c4b384277 None None] MFA Rules not processed for user `e45eb7db4e1c49339e58401fe8935f59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:42.204284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-91a194c2-aa10-420d-b542-281c4b384277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:42.232414 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3594/7200] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:53:41 2022] DELETE /identity/v3/users/cb41c88f3e9d4793817d43a15c8c02ac => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:42.236453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bf063-fe64-4172-b740-344e5574f3a8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:42.236453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1d8bf063-fe64-4172-b740-344e5574f3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:42.297069 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3607/7201] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:42.313131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a194c2-aa10-420d-b542-281c4b384277 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:42.315069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-91a194c2-aa10-420d-b542-281c4b384277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:42.352185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bf063-fe64-4172-b740-344e5574f3a8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:42.360865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94ea01-f9ad-450b-b450-6092bf11b12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:42.361631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94ea01-f9ad-450b-b450-6092bf11b12d admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:42.363616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94ea01-f9ad-450b-b450-6092bf11b12d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:42.363911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94ea01-f9ad-450b-b450-6092bf11b12d admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:42.364558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94ea01-f9ad-450b-b450-6092bf11b12d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:42.366607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94ea01-f9ad-450b-b450-6092bf11b12d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:42.433348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a194c2-aa10-420d-b542-281c4b384277 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:42.507899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce42cdd-2ea4-482e-b871-6633260009ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:42.508480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce42cdd-2ea4-482e-b871-6633260009ea service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:42.508808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce42cdd-2ea4-482e-b871-6633260009ea service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:42.509146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce42cdd-2ea4-482e-b871-6633260009ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:42.525260 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3595/7202] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:53:42 2022] POST /identity/v3/users => generated 288 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:42.533635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94ea01-f9ad-450b-b450-6092bf11b12d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:42.555081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94ea01-f9ad-450b-b450-6092bf11b12d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:42.559880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b63b30-22b5-497e-a6fc-697a8d3016f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:42.560655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b63b30-22b5-497e-a6fc-697a8d3016f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:42.560805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b63b30-22b5-497e-a6fc-697a8d3016f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:42.561032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b63b30-22b5-497e-a6fc-697a8d3016f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:42.561955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b63b30-22b5-497e-a6fc-697a8d3016f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:42.563615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b63b30-22b5-497e-a6fc-697a8d3016f1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:42.576981 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3596/7203] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:53:42.581527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b63b30-22b5-497e-a6fc-697a8d3016f1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:42.594171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b63b30-22b5-497e-a6fc-697a8d3016f1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:42.598970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14ebf1-e800-41ad-bae1-8fd96d1bf4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:42.599581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ebf1-e800-41ad-bae1-8fd96d1bf4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:42.599862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ebf1-e800-41ad-bae1-8fd96d1bf4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:42.600142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ebf1-e800-41ad-bae1-8fd96d1bf4b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:42.600890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14ebf1-e800-41ad-bae1-8fd96d1bf4b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:42.602609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14ebf1-e800-41ad-bae1-8fd96d1bf4b2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:42.610969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce42cdd-2ea4-482e-b871-6633260009ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:42.610969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce42cdd-2ea4-482e-b871-6633260009ea service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:42.614719 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3597/7204] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:53:42.618946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14ebf1-e800-41ad-bae1-8fd96d1bf4b2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:42.620547 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3608/7205] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:42 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:53:42.635871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14ebf1-e800-41ad-bae1-8fd96d1bf4b2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:42.641619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973bbcf-f33e-419d-93bc-2eb94e5caa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:42.642324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973bbcf-f33e-419d-93bc-2eb94e5caa45 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:42.651096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973bbcf-f33e-419d-93bc-2eb94e5caa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:42.651096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973bbcf-f33e-419d-93bc-2eb94e5caa45 admin admin] PATH_INFO: `/v3/projects/9a8c44a5483649d59adb08766ff80f29/users/76ab26a8a56d4e05a803792dcafbb2cf/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:42.658801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973bbcf-f33e-419d-93bc-2eb94e5caa45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a8c44a5483649d59adb08766ff80f29, user_id=76ab26a8a56d4e05a803792dcafbb2cf, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:42.661646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973bbcf-f33e-419d-93bc-2eb94e5caa45 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:42.747417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce42cdd-2ea4-482e-b871-6633260009ea service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:42.749020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6ce42cdd-2ea4-482e-b871-6633260009ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:42.774716 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3598/7206] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:53:42 2022] PUT /identity/v3/projects/9a8c44a5483649d59adb08766ff80f29/users/76ab26a8a56d4e05a803792dcafbb2cf/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:42.790220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332de5e5-ea7a-44a5-9d30-4587a8de8212 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:42.790944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332de5e5-ea7a-44a5-9d30-4587a8de8212 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:42.791536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332de5e5-ea7a-44a5-9d30-4587a8de8212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:42.796544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce42cdd-2ea4-482e-b871-6633260009ea service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:42.860476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:42.884316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-332de5e5-ea7a-44a5-9d30-4587a8de8212 None None] MFA Rules not processed for user `76ab26a8a56d4e05a803792dcafbb2cf`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:42.886374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-332de5e5-ea7a-44a5-9d30-4587a8de8212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:42.963778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ce4ce-99d8-4e84-ae0e-e15629fd9307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:42.966489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ce4ce-99d8-4e84-ae0e-e15629fd9307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:42.966489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ce4ce-99d8-4e84-ae0e-e15629fd9307 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:42.966489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ce4ce-99d8-4e84-ae0e-e15629fd9307 admin admin] PATH_INFO: `/v3/projects/686bf18f99204e8fbc4d183d844ba4c1` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:42.966904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ce4ce-99d8-4e84-ae0e-e15629fd9307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=686bf18f99204e8fbc4d183d844ba4c1)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:42.973684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ce4ce-99d8-4e84-ae0e-e15629fd9307 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:42.999752 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3599/7207] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:43.017687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332de5e5-ea7a-44a5-9d30-4587a8de8212 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:43.019130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-332de5e5-ea7a-44a5-9d30-4587a8de8212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:43.081056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332de5e5-ea7a-44a5-9d30-4587a8de8212 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:43.084791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb380a7e-4b2a-4fec-a566-b6706f6cf69b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:43.085447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb380a7e-4b2a-4fec-a566-b6706f6cf69b service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:43.085729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb380a7e-4b2a-4fec-a566-b6706f6cf69b service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:43.086008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb380a7e-4b2a-4fec-a566-b6706f6cf69b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:43.097828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb380a7e-4b2a-4fec-a566-b6706f6cf69b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:43.100620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb380a7e-4b2a-4fec-a566-b6706f6cf69b service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:43.109213 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3600/7208] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:53:43.129968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb380a7e-4b2a-4fec-a566-b6706f6cf69b service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:43.139600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb380a7e-4b2a-4fec-a566-b6706f6cf69b service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:43.145165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd23ea-4c89-42b0-bd94-072b4421ff47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:43.145832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd23ea-4c89-42b0-bd94-072b4421ff47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:43.146171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd23ea-4c89-42b0-bd94-072b4421ff47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:43.146442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd23ea-4c89-42b0-bd94-072b4421ff47 admin admin] PATH_INFO: `/v3/users/76ab26a8a56d4e05a803792dcafbb2cf` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:43.147924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd23ea-4c89-42b0-bd94-072b4421ff47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76ab26a8a56d4e05a803792dcafbb2cf)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:43.149973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd23ea-4c89-42b0-bd94-072b4421ff47 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:43.194690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-433ce4ce-99d8-4e84-ae0e-e15629fd9307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '686bf18f99204e8fbc4d183d844ba4c1', 'request_id': 'req-433ce4ce-99d8-4e84-ae0e-e15629fd9307'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:43.293928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-433ce4ce-99d8-4e84-ae0e-e15629fd9307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '686bf18f99204e8fbc4d183d844ba4c1', 'request_id': 'req-433ce4ce-99d8-4e84-ae0e-e15629fd9307'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:43.301021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-433ce4ce-99d8-4e84-ae0e-e15629fd9307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '686bf18f99204e8fbc4d183d844ba4c1', 'request_id': 'req-433ce4ce-99d8-4e84-ae0e-e15629fd9307'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:43.315881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-433ce4ce-99d8-4e84-ae0e-e15629fd9307 admin admin] The token cache is being invalidate because project 686bf18f99204e8fbc4d183d844ba4c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:53:43.316169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-433ce4ce-99d8-4e84-ae0e-e15629fd9307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:43.316843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-433ce4ce-99d8-4e84-ae0e-e15629fd9307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:43.318373 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3609/7209] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:53:42 2022] DELETE /identity/v3/projects/686bf18f99204e8fbc4d183d844ba4c1 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:43.323252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31b393-a36c-4bf3-b47d-b1a1bc8b03bd None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:43.323542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31b393-a36c-4bf3-b47d-b1a1bc8b03bd None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:43.323874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31b393-a36c-4bf3-b47d-b1a1bc8b03bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:43.328501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:43.350700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8f31b393-a36c-4bf3-b47d-b1a1bc8b03bd None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:43.351936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8f31b393-a36c-4bf3-b47d-b1a1bc8b03bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:43.414272 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3610/7210] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:43.423863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deee247-7bfd-4812-baf7-6fb9cc305dae None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:43.424409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deee247-7bfd-4812-baf7-6fb9cc305dae None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:43.425307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deee247-7bfd-4812-baf7-6fb9cc305dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:43.463212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1deee247-7bfd-4812-baf7-6fb9cc305dae None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:43.463932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-33bd23ea-4c89-42b0-bd94-072b4421ff47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76ab26a8a56d4e05a803792dcafbb2cf'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:43.464287 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-33bd23ea-4c89-42b0-bd94-072b4421ff47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76ab26a8a56d4e05a803792dcafbb2cf'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:43.466394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1deee247-7bfd-4812-baf7-6fb9cc305dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:43.483727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-33bd23ea-4c89-42b0-bd94-072b4421ff47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76ab26a8a56d4e05a803792dcafbb2cf'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:43.483955 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3611/7211] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:53:43.486087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deee247-7bfd-4812-baf7-6fb9cc305dae None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:43.500791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deee247-7bfd-4812-baf7-6fb9cc305dae None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:43.501606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-33bd23ea-4c89-42b0-bd94-072b4421ff47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76ab26a8a56d4e05a803792dcafbb2cf'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:43.501838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-33bd23ea-4c89-42b0-bd94-072b4421ff47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76ab26a8a56d4e05a803792dcafbb2cf'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:43.512940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14385424-ec2d-42a8-8a03-d81b2fd3941b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:43.517115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14385424-ec2d-42a8-8a03-d81b2fd3941b admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:43.517281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14385424-ec2d-42a8-8a03-d81b2fd3941b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:43.517577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14385424-ec2d-42a8-8a03-d81b2fd3941b admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:43.518523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14385424-ec2d-42a8-8a03-d81b2fd3941b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:53:43.520087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14385424-ec2d-42a8-8a03-d81b2fd3941b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:43.520666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14385424-ec2d-42a8-8a03-d81b2fd3941b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:43.539987 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3612/7212] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:53:43.545677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14385424-ec2d-42a8-8a03-d81b2fd3941b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:43.555233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14385424-ec2d-42a8-8a03-d81b2fd3941b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:43.560055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b8d7c-85cb-4541-984f-92f49f606319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:43.560663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b8d7c-85cb-4541-984f-92f49f606319 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:43.560958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b8d7c-85cb-4541-984f-92f49f606319 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:43.561243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b8d7c-85cb-4541-984f-92f49f606319 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:43.562011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b8d7c-85cb-4541-984f-92f49f606319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:43.564826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b8d7c-85cb-4541-984f-92f49f606319 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:43.633264 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3601/7213] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:53:43 2022] DELETE /identity/v3/users/76ab26a8a56d4e05a803792dcafbb2cf => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:43.635481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2b4df-f283-4122-aa1c-00712c1179f8 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:43.635805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2b4df-f283-4122-aa1c-00712c1179f8 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:43.636118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2b4df-f283-4122-aa1c-00712c1179f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:43.664462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d3b2b4df-f283-4122-aa1c-00712c1179f8 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:43.665603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d3b2b4df-f283-4122-aa1c-00712c1179f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:43.727247 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3613/7214] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:53:43 2022] POST /identity/v3/projects => generated 375 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:53:43.731581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b8d7c-85cb-4541-984f-92f49f606319 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:43.753555 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3602/7215] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:43.755778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2b4df-f283-4122-aa1c-00712c1179f8 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:43.757990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d3b2b4df-f283-4122-aa1c-00712c1179f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:43.881547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2b4df-f283-4122-aa1c-00712c1179f8 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:43.882426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b8d7c-85cb-4541-984f-92f49f606319 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:43.894237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283297c-4250-4e21-9321-48fa4d548233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:43.899069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283297c-4250-4e21-9321-48fa4d548233 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:43.899373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283297c-4250-4e21-9321-48fa4d548233 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:43.899656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283297c-4250-4e21-9321-48fa4d548233 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:43.900331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283297c-4250-4e21-9321-48fa4d548233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:43.902330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283297c-4250-4e21-9321-48fa4d548233 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:43.991546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfc6b1-e316-49d9-a2a3-d7f0deb8f536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:43.992397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfc6b1-e316-49d9-a2a3-d7f0deb8f536 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:43.992904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfc6b1-e316-49d9-a2a3-d7f0deb8f536 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:43.993388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfc6b1-e316-49d9-a2a3-d7f0deb8f536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:44.005244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfc6b1-e316-49d9-a2a3-d7f0deb8f536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:44.006889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfc6b1-e316-49d9-a2a3-d7f0deb8f536 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:44.017915 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3603/7216] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:53:44.087458 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3614/7217] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:53:43 2022] POST /identity/v3/users => generated 288 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:44.089195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfc6b1-e316-49d9-a2a3-d7f0deb8f536 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:44.113073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfc6b1-e316-49d9-a2a3-d7f0deb8f536 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:44.127381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18b1a4-67f4-4e3b-9060-701c047b320e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:44.128205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18b1a4-67f4-4e3b-9060-701c047b320e admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:44.128560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18b1a4-67f4-4e3b-9060-701c047b320e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:44.129356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18b1a4-67f4-4e3b-9060-701c047b320e admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:44.129715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18b1a4-67f4-4e3b-9060-701c047b320e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:44.131686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18b1a4-67f4-4e3b-9060-701c047b320e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:44.153927 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3604/7218] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:44.156750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283297c-4250-4e21-9321-48fa4d548233 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:44.171540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283297c-4250-4e21-9321-48fa4d548233 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:44.177926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4eb5cd-f9fd-44d5-82ce-017a96757351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:44.178853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eb5cd-f9fd-44d5-82ce-017a96757351 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:44.180299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eb5cd-f9fd-44d5-82ce-017a96757351 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:44.180821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eb5cd-f9fd-44d5-82ce-017a96757351 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:44.181914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4eb5cd-f9fd-44d5-82ce-017a96757351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:44.183822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4eb5cd-f9fd-44d5-82ce-017a96757351 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:44.201948 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3615/7219] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:44.205593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18b1a4-67f4-4e3b-9060-701c047b320e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:44.216831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18b1a4-67f4-4e3b-9060-701c047b320e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:44.223298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4673d-0b49-4a96-9ae1-df99431c10e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:44.224171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4673d-0b49-4a96-9ae1-df99431c10e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:44.224451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4673d-0b49-4a96-9ae1-df99431c10e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:44.224727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4673d-0b49-4a96-9ae1-df99431c10e2 admin admin] PATH_INFO: `/v3/projects/cdd647fa7f924b8aa08a5cd8418bc0f8/users/4758a82a8fc549f28252bb3b5446d194/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:44.246249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4673d-0b49-4a96-9ae1-df99431c10e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdd647fa7f924b8aa08a5cd8418bc0f8, user_id=4758a82a8fc549f28252bb3b5446d194, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:44.249194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4673d-0b49-4a96-9ae1-df99431c10e2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:44.409704 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3605/7220] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:53:44 2022] PUT /identity/v3/projects/cdd647fa7f924b8aa08a5cd8418bc0f8/users/4758a82a8fc549f28252bb3b5446d194/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:44.420380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241b8ec-dda2-4f03-ae69-4cced0a9ca2f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:44.421058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241b8ec-dda2-4f03-ae69-4cced0a9ca2f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:44.421390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241b8ec-dda2-4f03-ae69-4cced0a9ca2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:44.468852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4673d-0b49-4a96-9ae1-df99431c10e2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:44.470721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-31d4673d-0b49-4a96-9ae1-df99431c10e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:44.480335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9241b8ec-dda2-4f03-ae69-4cced0a9ca2f None None] MFA Rules not processed for user `4758a82a8fc549f28252bb3b5446d194`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:44.482629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9241b8ec-dda2-4f03-ae69-4cced0a9ca2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:44.562675 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3616/7221] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:44.573139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241b8ec-dda2-4f03-ae69-4cced0a9ca2f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:44.610905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4673d-0b49-4a96-9ae1-df99431c10e2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:44.616819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba633353-3ec2-44b7-b4f2-6523ef390d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:44.617519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba633353-3ec2-44b7-b4f2-6523ef390d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:44.622224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba633353-3ec2-44b7-b4f2-6523ef390d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:44.622487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba633353-3ec2-44b7-b4f2-6523ef390d63 admin admin] PATH_INFO: `/v3/users/6bda914eef2e48d4b26a274b05683929` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:44.623749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba633353-3ec2-44b7-b4f2-6523ef390d63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bda914eef2e48d4b26a274b05683929)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:44.625708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba633353-3ec2-44b7-b4f2-6523ef390d63 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:44.676215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241b8ec-dda2-4f03-ae69-4cced0a9ca2f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:44.685201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed355d-91f6-4f46-a718-86bc66a840a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:44.686287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed355d-91f6-4f46-a718-86bc66a840a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:44.686789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed355d-91f6-4f46-a718-86bc66a840a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:44.687345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed355d-91f6-4f46-a718-86bc66a840a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:44.688389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed355d-91f6-4f46-a718-86bc66a840a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:44.692740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed355d-91f6-4f46-a718-86bc66a840a2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:44.833491 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3617/7222] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:53:44 2022] POST /identity/v3/projects => generated 375 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:44.840677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed355d-91f6-4f46-a718-86bc66a840a2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:44.889659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:44.923379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed355d-91f6-4f46-a718-86bc66a840a2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:44.930275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfd7a4-5352-4972-a7ef-14dd59e47cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:44.938298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfd7a4-5352-4972-a7ef-14dd59e47cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:44.938298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfd7a4-5352-4972-a7ef-14dd59e47cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:44.938298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfd7a4-5352-4972-a7ef-14dd59e47cd0 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:44.938298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dfd7a4-5352-4972-a7ef-14dd59e47cd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:44.938298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dfd7a4-5352-4972-a7ef-14dd59e47cd0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:44.994575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ba633353-3ec2-44b7-b4f2-6523ef390d63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bda914eef2e48d4b26a274b05683929'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:44.999622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ba633353-3ec2-44b7-b4f2-6523ef390d63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bda914eef2e48d4b26a274b05683929'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:45.010433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ba633353-3ec2-44b7-b4f2-6523ef390d63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bda914eef2e48d4b26a274b05683929'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:45.033807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ba633353-3ec2-44b7-b4f2-6523ef390d63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bda914eef2e48d4b26a274b05683929'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:45.035062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ba633353-3ec2-44b7-b4f2-6523ef390d63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bda914eef2e48d4b26a274b05683929'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:45.097954 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3618/7223] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:53:44 2022] POST /identity/v3/users => generated 294 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:45.098866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfd7a4-5352-4972-a7ef-14dd59e47cd0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:45.100536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a0dfd7a4-5352-4972-a7ef-14dd59e47cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:45.117155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfd7a4-5352-4972-a7ef-14dd59e47cd0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:45.126111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e716d7-f92d-496b-9b29-b6ae5353c268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:45.129958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e716d7-f92d-496b-9b29-b6ae5353c268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:45.129958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e716d7-f92d-496b-9b29-b6ae5353c268 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:45.129958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e716d7-f92d-496b-9b29-b6ae5353c268 admin admin] PATH_INFO: `/v3/projects/9a8c44a5483649d59adb08766ff80f29` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:45.129958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e716d7-f92d-496b-9b29-b6ae5353c268 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a8c44a5483649d59adb08766ff80f29)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:45.130677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e716d7-f92d-496b-9b29-b6ae5353c268 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:45.146618 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3606/7224] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:53:44 2022] DELETE /identity/v3/users/6bda914eef2e48d4b26a274b05683929 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:53:45.147522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba633353-3ec2-44b7-b4f2-6523ef390d63 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:45.150498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ba633353-3ec2-44b7-b4f2-6523ef390d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:45.242516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba633353-3ec2-44b7-b4f2-6523ef390d63 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:45.247598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94780a9a-f6a9-4d20-a603-0a10774245ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:45.248212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94780a9a-f6a9-4d20-a603-0a10774245ef admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:45.248494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94780a9a-f6a9-4d20-a603-0a10774245ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:45.248769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94780a9a-f6a9-4d20-a603-0a10774245ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:45.249445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94780a9a-f6a9-4d20-a603-0a10774245ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:45.251223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94780a9a-f6a9-4d20-a603-0a10774245ef admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:45.263506 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3607/7225] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:45.265094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002bff3-e440-4ed2-b27f-50aef6d03d5d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:45.265252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002bff3-e440-4ed2-b27f-50aef6d03d5d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:45.265536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002bff3-e440-4ed2-b27f-50aef6d03d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:45.278966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-06e716d7-f92d-496b-9b29-b6ae5353c268 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a8c44a5483649d59adb08766ff80f29', 'request_id': 'req-06e716d7-f92d-496b-9b29-b6ae5353c268'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:45.294941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b002bff3-e440-4ed2-b27f-50aef6d03d5d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:45.294941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b002bff3-e440-4ed2-b27f-50aef6d03d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:45.369065 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3608/7226] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:45.372567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002bff3-e440-4ed2-b27f-50aef6d03d5d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:45.382419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002bff3-e440-4ed2-b27f-50aef6d03d5d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:45.387530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceace0e-a1cc-460b-8568-49297466cff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:45.388355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceace0e-a1cc-460b-8568-49297466cff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:45.388906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceace0e-a1cc-460b-8568-49297466cff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:45.388906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceace0e-a1cc-460b-8568-49297466cff2 admin admin] PATH_INFO: `/v3/projects/70b21a0d219f448fa2ca3bc8574a8c86/users/aab3abe7abbd4fe28d63c022c402a3c8/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:45.396562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-06e716d7-f92d-496b-9b29-b6ae5353c268 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a8c44a5483649d59adb08766ff80f29', 'request_id': 'req-06e716d7-f92d-496b-9b29-b6ae5353c268'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:45.404904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-06e716d7-f92d-496b-9b29-b6ae5353c268 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a8c44a5483649d59adb08766ff80f29', 'request_id': 'req-06e716d7-f92d-496b-9b29-b6ae5353c268'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:45.406068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceace0e-a1cc-460b-8568-49297466cff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b21a0d219f448fa2ca3bc8574a8c86, user_id=aab3abe7abbd4fe28d63c022c402a3c8, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:45.409303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceace0e-a1cc-460b-8568-49297466cff2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:45.420691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-06e716d7-f92d-496b-9b29-b6ae5353c268 admin admin] The token cache is being invalidate because project 9a8c44a5483649d59adb08766ff80f29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:53:45.421347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-06e716d7-f92d-496b-9b29-b6ae5353c268 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:45.422130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-06e716d7-f92d-496b-9b29-b6ae5353c268 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:45.423719 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3619/7227] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:53:45 2022] DELETE /identity/v3/projects/9a8c44a5483649d59adb08766ff80f29 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:45.426208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e716d7-f92d-496b-9b29-b6ae5353c268 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:45.426540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-06e716d7-f92d-496b-9b29-b6ae5353c268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:45.489804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e716d7-f92d-496b-9b29-b6ae5353c268 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:45.494527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e0b61-3f84-4b5a-8a8c-b94056e91ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:45.495577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e0b61-3f84-4b5a-8a8c-b94056e91ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:45.495577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e0b61-3f84-4b5a-8a8c-b94056e91ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:45.495809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e0b61-3f84-4b5a-8a8c-b94056e91ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:45.497835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9d4e0b61-3f84-4b5a-8a8c-b94056e91ba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:45.515790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e0b61-3f84-4b5a-8a8c-b94056e91ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:45.520351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e0b61-3f84-4b5a-8a8c-b94056e91ba4 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:45.534061 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3620/7228] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:45.535302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28641b98-678a-4685-b7ea-ca91127c5c57 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:45.535591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28641b98-678a-4685-b7ea-ca91127c5c57 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:45.535869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28641b98-678a-4685-b7ea-ca91127c5c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:45.539649 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3609/7229] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:53:45 2022] PUT /identity/v3/projects/70b21a0d219f448fa2ca3bc8574a8c86/users/aab3abe7abbd4fe28d63c022c402a3c8/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:45.544596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceace0e-a1cc-460b-8568-49297466cff2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:45.546966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5ceace0e-a1cc-460b-8568-49297466cff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:45.567267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-28641b98-678a-4685-b7ea-ca91127c5c57 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:45.568518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-28641b98-678a-4685-b7ea-ca91127c5c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:45.706459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceace0e-a1cc-460b-8568-49297466cff2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:45.719586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f07f15-7c44-4d9e-920a-eb40eb5e50e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:45.720264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f07f15-7c44-4d9e-920a-eb40eb5e50e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:45.727955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f07f15-7c44-4d9e-920a-eb40eb5e50e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:45.728289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f07f15-7c44-4d9e-920a-eb40eb5e50e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:45.728993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f07f15-7c44-4d9e-920a-eb40eb5e50e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:45.730685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f07f15-7c44-4d9e-920a-eb40eb5e50e1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:45.756330 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3621/7230] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:45.766109 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3610/7231] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:45.766524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacce34-1ff4-468a-b701-46f634408deb None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:45.767020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacce34-1ff4-468a-b701-46f634408deb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:45.767467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacce34-1ff4-468a-b701-46f634408deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:45.770585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f07f15-7c44-4d9e-920a-eb40eb5e50e1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:45.783929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f07f15-7c44-4d9e-920a-eb40eb5e50e1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:45.793353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef0867-48db-483c-8100-86bfbd2fc58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:45.793599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef0867-48db-483c-8100-86bfbd2fc58c admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:45.793854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef0867-48db-483c-8100-86bfbd2fc58c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:45.794131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef0867-48db-483c-8100-86bfbd2fc58c admin admin] PATH_INFO: `/v3/projects/70b21a0d219f448fa2ca3bc8574a8c86/users/aab3abe7abbd4fe28d63c022c402a3c8/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:45.800659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef0867-48db-483c-8100-86bfbd2fc58c admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b21a0d219f448fa2ca3bc8574a8c86, user_id=aab3abe7abbd4fe28d63c022c402a3c8, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:45.804597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef0867-48db-483c-8100-86bfbd2fc58c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:45.826396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-cdacce34-1ff4-468a-b701-46f634408deb None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:45.827772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cdacce34-1ff4-468a-b701-46f634408deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:45.834230 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3611/7232] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:53:45 2022] PUT /identity/v3/projects/70b21a0d219f448fa2ca3bc8574a8c86/users/aab3abe7abbd4fe28d63c022c402a3c8/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:45.850471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5845ea-fd2b-4998-9bc5-61eb9f4805e0 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:45.851020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5845ea-fd2b-4998-9bc5-61eb9f4805e0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:45.852761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5845ea-fd2b-4998-9bc5-61eb9f4805e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:45.925268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9b5845ea-fd2b-4998-9bc5-61eb9f4805e0 None None] MFA Rules not processed for user `aab3abe7abbd4fe28d63c022c402a3c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:45.927107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9b5845ea-fd2b-4998-9bc5-61eb9f4805e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:45.958562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:45.969510 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3622/7233] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:45.973739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdacce34-1ff4-468a-b701-46f634408deb None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:45.986660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdacce34-1ff4-468a-b701-46f634408deb None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:45.992150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf8255-bccf-41e5-99d1-99f52ff0abaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:45.993432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf8255-bccf-41e5-99d1-99f52ff0abaf admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:45.993890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf8255-bccf-41e5-99d1-99f52ff0abaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:45.994217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf8255-bccf-41e5-99d1-99f52ff0abaf admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:45.994873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf8255-bccf-41e5-99d1-99f52ff0abaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:53:45.995202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf8255-bccf-41e5-99d1-99f52ff0abaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:45.996805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf8255-bccf-41e5-99d1-99f52ff0abaf admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:46.015008 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3623/7234] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:53:46.020191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf8255-bccf-41e5-99d1-99f52ff0abaf admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:46.041211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf8255-bccf-41e5-99d1-99f52ff0abaf admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:46.046677 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3612/7235] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:53:46.048360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5845ea-fd2b-4998-9bc5-61eb9f4805e0 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:46.056216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9b5845ea-fd2b-4998-9bc5-61eb9f4805e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:46.056542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742907ee-8f4d-4c03-87cb-097dfae85c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:46.056542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742907ee-8f4d-4c03-87cb-097dfae85c18 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:46.056542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742907ee-8f4d-4c03-87cb-097dfae85c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:46.056542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742907ee-8f4d-4c03-87cb-097dfae85c18 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:46.057072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742907ee-8f4d-4c03-87cb-097dfae85c18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:46.059067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742907ee-8f4d-4c03-87cb-097dfae85c18 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:46.066832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5845ea-fd2b-4998-9bc5-61eb9f4805e0 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:46.073404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b4817-f29d-4776-98f3-b37ad2d58df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:46.085812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b4817-f29d-4776-98f3-b37ad2d58df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:46.085812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b4817-f29d-4776-98f3-b37ad2d58df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:46.085812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b4817-f29d-4776-98f3-b37ad2d58df2 admin admin] PATH_INFO: `/v3/projects/a796b6f4bdd445ab82339d53b0ff4471` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:46.085812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b4817-f29d-4776-98f3-b37ad2d58df2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a796b6f4bdd445ab82339d53b0ff4471)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:46.085812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b4817-f29d-4776-98f3-b37ad2d58df2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:46.206502 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3624/7236] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:53:46 2022] POST /identity/v3/projects => generated 371 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:46.207398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742907ee-8f4d-4c03-87cb-097dfae85c18 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:46.208985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-742907ee-8f4d-4c03-87cb-097dfae85c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:46.265928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a56b4817-f29d-4776-98f3-b37ad2d58df2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a796b6f4bdd445ab82339d53b0ff4471', 'request_id': 'req-a56b4817-f29d-4776-98f3-b37ad2d58df2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:46.278750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a56b4817-f29d-4776-98f3-b37ad2d58df2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a796b6f4bdd445ab82339d53b0ff4471', 'request_id': 'req-a56b4817-f29d-4776-98f3-b37ad2d58df2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:46.288644 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a56b4817-f29d-4776-98f3-b37ad2d58df2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a796b6f4bdd445ab82339d53b0ff4471', 'request_id': 'req-a56b4817-f29d-4776-98f3-b37ad2d58df2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:46.316788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742907ee-8f4d-4c03-87cb-097dfae85c18 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:46.374619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81771c7e-ee3b-4bf6-9a39-d0381f4a2065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:46.376577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81771c7e-ee3b-4bf6-9a39-d0381f4a2065 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:46.376962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81771c7e-ee3b-4bf6-9a39-d0381f4a2065 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:46.377387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81771c7e-ee3b-4bf6-9a39-d0381f4a2065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:46.416299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a56b4817-f29d-4776-98f3-b37ad2d58df2 admin admin] The token cache is being invalidate because project a796b6f4bdd445ab82339d53b0ff4471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:53:46.417852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a56b4817-f29d-4776-98f3-b37ad2d58df2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:46.417852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a56b4817-f29d-4776-98f3-b37ad2d58df2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:46.423213 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3613/7237] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:53:46 2022] DELETE /identity/v3/projects/a796b6f4bdd445ab82339d53b0ff4471 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:46.424350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b4817-f29d-4776-98f3-b37ad2d58df2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:46.425896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a56b4817-f29d-4776-98f3-b37ad2d58df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:46.466475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81771c7e-ee3b-4bf6-9a39-d0381f4a2065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:46.468363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81771c7e-ee3b-4bf6-9a39-d0381f4a2065 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:46.481105 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3625/7238] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:46.488043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff02c77-5ab8-49d0-8c50-914bc2959822 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:46.488043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff02c77-5ab8-49d0-8c50-914bc2959822 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:46.488043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff02c77-5ab8-49d0-8c50-914bc2959822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:46.509253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b4817-f29d-4776-98f3-b37ad2d58df2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:46.521722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c1f54-42ce-4cfd-81a0-eaa59ec1af00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:46.528359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c1f54-42ce-4cfd-81a0-eaa59ec1af00 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:46.528359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c1f54-42ce-4cfd-81a0-eaa59ec1af00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:46.528359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c1f54-42ce-4cfd-81a0-eaa59ec1af00 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:46.528359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c1f54-42ce-4cfd-81a0-eaa59ec1af00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:46.528359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c1f54-42ce-4cfd-81a0-eaa59ec1af00 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:46.530904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8ff02c77-5ab8-49d0-8c50-914bc2959822 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:46.533342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8ff02c77-5ab8-49d0-8c50-914bc2959822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:46.547042 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3626/7239] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:46.556260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03287868-e022-4e62-a218-981a4ce127f7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:46.556611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03287868-e022-4e62-a218-981a4ce127f7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:46.556989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03287868-e022-4e62-a218-981a4ce127f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:46.580035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-03287868-e022-4e62-a218-981a4ce127f7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:46.581354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-03287868-e022-4e62-a218-981a4ce127f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:46.598077 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3627/7240] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:46.602057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03287868-e022-4e62-a218-981a4ce127f7 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:46.618180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03287868-e022-4e62-a218-981a4ce127f7 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:46.624578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6ed6c-1c55-476d-ba93-084eaa65bce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:46.635193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6ed6c-1c55-476d-ba93-084eaa65bce2 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:46.635193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6ed6c-1c55-476d-ba93-084eaa65bce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:46.635193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6ed6c-1c55-476d-ba93-084eaa65bce2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:46.635193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6ed6c-1c55-476d-ba93-084eaa65bce2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:53:46.635193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6ed6c-1c55-476d-ba93-084eaa65bce2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:46.635193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6ed6c-1c55-476d-ba93-084eaa65bce2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:46.646289 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3628/7241] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:53:46.651032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6ed6c-1c55-476d-ba93-084eaa65bce2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:46.664497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6ed6c-1c55-476d-ba93-084eaa65bce2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:46.672392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855573c-19fe-43b4-943e-91e5a30d49cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:46.683451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855573c-19fe-43b4-943e-91e5a30d49cc admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:46.683451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855573c-19fe-43b4-943e-91e5a30d49cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:46.683451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855573c-19fe-43b4-943e-91e5a30d49cc admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:46.683451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855573c-19fe-43b4-943e-91e5a30d49cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:46.683451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855573c-19fe-43b4-943e-91e5a30d49cc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:46.714444 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3614/7242] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:53:46 2022] POST /identity/v3/users => generated 286 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:46.722055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c1f54-42ce-4cfd-81a0-eaa59ec1af00 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:46.730142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c1f54-42ce-4cfd-81a0-eaa59ec1af00 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:46.736856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5eb161-6d2c-4af1-8213-f85b625bf062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:46.737479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5eb161-6d2c-4af1-8213-f85b625bf062 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:46.737767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5eb161-6d2c-4af1-8213-f85b625bf062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:46.738059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5eb161-6d2c-4af1-8213-f85b625bf062 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:46.738783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5eb161-6d2c-4af1-8213-f85b625bf062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:46.740463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5eb161-6d2c-4af1-8213-f85b625bf062 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:46.752378 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3615/7243] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:53:46.756714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5eb161-6d2c-4af1-8213-f85b625bf062 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:46.776142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5eb161-6d2c-4af1-8213-f85b625bf062 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:46.790840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740ab82-22f6-4983-b4e1-8fbe07183bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:46.791702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740ab82-22f6-4983-b4e1-8fbe07183bdd admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:46.794002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740ab82-22f6-4983-b4e1-8fbe07183bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:46.794666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740ab82-22f6-4983-b4e1-8fbe07183bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:46.798649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740ab82-22f6-4983-b4e1-8fbe07183bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:46.798649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740ab82-22f6-4983-b4e1-8fbe07183bdd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:46.811937 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3616/7244] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:46.817676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740ab82-22f6-4983-b4e1-8fbe07183bdd admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:46.836988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740ab82-22f6-4983-b4e1-8fbe07183bdd admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:46.840281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031af99-89d7-4e03-a2a5-8211258445a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:46.840281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031af99-89d7-4e03-a2a5-8211258445a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:46.840281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031af99-89d7-4e03-a2a5-8211258445a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:46.840678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031af99-89d7-4e03-a2a5-8211258445a0 admin admin] PATH_INFO: `/v3/projects/7679bfe752984192ba5b629fd4ed5696/users/d96c445a930244d69e219fa9c3b7a022/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:46.856407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031af99-89d7-4e03-a2a5-8211258445a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7679bfe752984192ba5b629fd4ed5696, user_id=d96c445a930244d69e219fa9c3b7a022, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:46.859949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031af99-89d7-4e03-a2a5-8211258445a0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:46.881193 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3629/7245] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:53:46 2022] POST /identity/v3/projects => generated 359 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:46.886233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855573c-19fe-43b4-943e-91e5a30d49cc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:47.013391 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3617/7246] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:53:46 2022] PUT /identity/v3/projects/7679bfe752984192ba5b629fd4ed5696/users/d96c445a930244d69e219fa9c3b7a022/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:47.015130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c081d-92ba-400d-870b-a7793be1cd47 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:47.016262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c081d-92ba-400d-870b-a7793be1cd47 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:47.016623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c081d-92ba-400d-870b-a7793be1cd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:47.100127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855573c-19fe-43b4-943e-91e5a30d49cc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:47.207039 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-578c081d-92ba-400d-870b-a7793be1cd47 None None] MFA Rules not processed for user `d96c445a930244d69e219fa9c3b7a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:47.208869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-578c081d-92ba-400d-870b-a7793be1cd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:47.253350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:47.374939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf9268-ba3f-460a-a9c3-0e4d8d57d0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:47.375233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf9268-ba3f-460a-a9c3-0e4d8d57d0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:47.375555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf9268-ba3f-460a-a9c3-0e4d8d57d0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:47.375813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf9268-ba3f-460a-a9c3-0e4d8d57d0c5 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:47.376718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf9268-ba3f-460a-a9c3-0e4d8d57d0c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:47.379337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf9268-ba3f-460a-a9c3-0e4d8d57d0c5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:47.405455 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3618/7247] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:53:47.406246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c081d-92ba-400d-870b-a7793be1cd47 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:47.421764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c081d-92ba-400d-870b-a7793be1cd47 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:47.436806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcaebf-386d-4190-a209-897e3ca14219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:47.436806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcaebf-386d-4190-a209-897e3ca14219 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:47.436806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcaebf-386d-4190-a209-897e3ca14219 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:47.436806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcaebf-386d-4190-a209-897e3ca14219 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:47.437193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcaebf-386d-4190-a209-897e3ca14219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:47.437193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcaebf-386d-4190-a209-897e3ca14219 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:47.530087 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3630/7248] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:53:46 2022] POST /identity/v3/users => generated 280 bytes in 644 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:47.530087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf9268-ba3f-460a-a9c3-0e4d8d57d0c5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:47.534331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-15bf9268-ba3f-460a-a9c3-0e4d8d57d0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:47.573678 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3619/7249] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:53:47 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:47.575530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcaebf-386d-4190-a209-897e3ca14219 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:47.678323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf9268-ba3f-460a-a9c3-0e4d8d57d0c5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:47.701327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcaebf-386d-4190-a209-897e3ca14219 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:47.708817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8be385-4256-4858-b51c-9a8dfdb28098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:47.711124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8be385-4256-4858-b51c-9a8dfdb28098 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:47.711387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8be385-4256-4858-b51c-9a8dfdb28098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:47.711651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8be385-4256-4858-b51c-9a8dfdb28098 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:47.712409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8be385-4256-4858-b51c-9a8dfdb28098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:47.714166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8be385-4256-4858-b51c-9a8dfdb28098 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:47.725345 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3620/7250] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:47.726048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8be385-4256-4858-b51c-9a8dfdb28098 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:47.740283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8be385-4256-4858-b51c-9a8dfdb28098 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:47.745333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf61fe3-e113-41c8-b073-caa46156b4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:47.745943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf61fe3-e113-41c8-b073-caa46156b4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:47.746318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf61fe3-e113-41c8-b073-caa46156b4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:47.746598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf61fe3-e113-41c8-b073-caa46156b4c6 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:47.747225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf61fe3-e113-41c8-b073-caa46156b4c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:47.749597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf61fe3-e113-41c8-b073-caa46156b4c6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:47.780430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69e313-e445-4025-9058-8ab269926442 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:47.780430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69e313-e445-4025-9058-8ab269926442 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:47.780430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69e313-e445-4025-9058-8ab269926442 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:47.780430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69e313-e445-4025-9058-8ab269926442 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:47.785062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6a69e313-e445-4025-9058-8ab269926442 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:47.894525 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3621/7251] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:53:47 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:53:47.894525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf61fe3-e113-41c8-b073-caa46156b4c6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:47.909310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69e313-e445-4025-9058-8ab269926442 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:47.910974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69e313-e445-4025-9058-8ab269926442 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:47.914375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf61fe3-e113-41c8-b073-caa46156b4c6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:47.920647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3450db9-744a-4135-a7a1-3e1da96d5fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:47.922309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3450db9-744a-4135-a7a1-3e1da96d5fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:47.922309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3450db9-744a-4135-a7a1-3e1da96d5fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:47.922309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3450db9-744a-4135-a7a1-3e1da96d5fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:47.929997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3450db9-744a-4135-a7a1-3e1da96d5fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:47.929997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3450db9-744a-4135-a7a1-3e1da96d5fb3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:47.945745 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3622/7252] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:47.946745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3450db9-744a-4135-a7a1-3e1da96d5fb3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:47.946987 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3631/7253] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:47.949802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69e313-e445-4025-9058-8ab269926442 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:47.971857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3450db9-744a-4135-a7a1-3e1da96d5fb3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:47.979911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69e313-e445-4025-9058-8ab269926442 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:47.981937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310c145-58e9-44a9-94f2-7103958ae670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:47.983705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310c145-58e9-44a9-94f2-7103958ae670 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:47.983993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310c145-58e9-44a9-94f2-7103958ae670 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:47.985100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310c145-58e9-44a9-94f2-7103958ae670 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:47.985836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310c145-58e9-44a9-94f2-7103958ae670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:47.989635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310c145-58e9-44a9-94f2-7103958ae670 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:48.005990 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3623/7254] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:48.007008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72064c01-7c38-4776-b367-1d7f5dacb84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:48.009838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310c145-58e9-44a9-94f2-7103958ae670 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:48.011145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72064c01-7c38-4776-b367-1d7f5dacb84d admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:48.012561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72064c01-7c38-4776-b367-1d7f5dacb84d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:48.012561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72064c01-7c38-4776-b367-1d7f5dacb84d admin admin] PATH_INFO: `/v3/projects/41d2faf0d2cc4727b94307fb1de5397f/users/775ee148168a478e8c120fa435e35ee9/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:48.031615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310c145-58e9-44a9-94f2-7103958ae670 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:48.039584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e85c8-c716-4dcd-8c40-67ce82ee8165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:48.040666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e85c8-c716-4dcd-8c40-67ce82ee8165 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:48.041111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e85c8-c716-4dcd-8c40-67ce82ee8165 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:48.041718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e85c8-c716-4dcd-8c40-67ce82ee8165 admin admin] PATH_INFO: `/v3/projects/efd5f6476aec416eaba63e8b84a81ba1/users/c636b691e52d4deeb27f9b6eb0ad33d9/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:48.046755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72064c01-7c38-4776-b367-1d7f5dacb84d admin admin] RBAC: Authorizing `identity:create_grant(project_id=41d2faf0d2cc4727b94307fb1de5397f, user_id=775ee148168a478e8c120fa435e35ee9, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:48.050734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72064c01-7c38-4776-b367-1d7f5dacb84d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:48.071108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e85c8-c716-4dcd-8c40-67ce82ee8165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd5f6476aec416eaba63e8b84a81ba1, user_id=c636b691e52d4deeb27f9b6eb0ad33d9, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:48.075304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e85c8-c716-4dcd-8c40-67ce82ee8165 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:48.159737 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3632/7255] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:53:47 2022] PUT /identity/v3/projects/41d2faf0d2cc4727b94307fb1de5397f/users/775ee148168a478e8c120fa435e35ee9/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:53:48.175523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dd2b9-db22-4fc8-93a6-4b45486d68a3 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:48.175900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dd2b9-db22-4fc8-93a6-4b45486d68a3 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:48.176098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dd2b9-db22-4fc8-93a6-4b45486d68a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:48.232197 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3624/7256] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:53:48 2022] PUT /identity/v3/projects/efd5f6476aec416eaba63e8b84a81ba1/users/c636b691e52d4deeb27f9b6eb0ad33d9/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:48.239203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-3c4dd2b9-db22-4fc8-93a6-4b45486d68a3 None None] MFA Rules not processed for user `775ee148168a478e8c120fa435e35ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:48.239203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3c4dd2b9-db22-4fc8-93a6-4b45486d68a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:48.243047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e85c8-c716-4dcd-8c40-67ce82ee8165 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:48.351202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e85c8-c716-4dcd-8c40-67ce82ee8165 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:48.359456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5205f6-c03e-4585-9ff2-a4918eeaa132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:48.360098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5205f6-c03e-4585-9ff2-a4918eeaa132 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:48.360381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5205f6-c03e-4585-9ff2-a4918eeaa132 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:48.360654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5205f6-c03e-4585-9ff2-a4918eeaa132 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:48.361315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5205f6-c03e-4585-9ff2-a4918eeaa132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:48.363510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5205f6-c03e-4585-9ff2-a4918eeaa132 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:48.411152 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3625/7257] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:53:48.415265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5205f6-c03e-4585-9ff2-a4918eeaa132 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:48.442545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5205f6-c03e-4585-9ff2-a4918eeaa132 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:48.448595 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3633/7258] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:48.467305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee4e70-b6c2-4941-8ba1-376d062d57a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:48.467305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee4e70-b6c2-4941-8ba1-376d062d57a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:48.467305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee4e70-b6c2-4941-8ba1-376d062d57a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:48.467305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee4e70-b6c2-4941-8ba1-376d062d57a5 admin admin] PATH_INFO: `/v3/projects/efd5f6476aec416eaba63e8b84a81ba1/users/c636b691e52d4deeb27f9b6eb0ad33d9/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:48.467748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:48.474950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dd2b9-db22-4fc8-93a6-4b45486d68a3 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:48.475825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee4e70-b6c2-4941-8ba1-376d062d57a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd5f6476aec416eaba63e8b84a81ba1, user_id=c636b691e52d4deeb27f9b6eb0ad33d9, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:48.477624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3c4dd2b9-db22-4fc8-93a6-4b45486d68a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:48.491587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee4e70-b6c2-4941-8ba1-376d062d57a5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:48.551550 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3626/7259] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:53:48 2022] PUT /identity/v3/projects/efd5f6476aec416eaba63e8b84a81ba1/users/c636b691e52d4deeb27f9b6eb0ad33d9/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:48.553492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59984206-ef0f-45f8-82ba-495a8291fd3f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:48.553846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59984206-ef0f-45f8-82ba-495a8291fd3f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:48.557429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59984206-ef0f-45f8-82ba-495a8291fd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:48.675800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-59984206-ef0f-45f8-82ba-495a8291fd3f None None] MFA Rules not processed for user `c636b691e52d4deeb27f9b6eb0ad33d9`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:48.677349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-59984206-ef0f-45f8-82ba-495a8291fd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:48.682708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dd2b9-db22-4fc8-93a6-4b45486d68a3 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:48.793311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61c099-8b1c-4fab-a355-a0c72e343400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:48.794074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61c099-8b1c-4fab-a355-a0c72e343400 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:48.794390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61c099-8b1c-4fab-a355-a0c72e343400 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:48.794693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61c099-8b1c-4fab-a355-a0c72e343400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:48.824626 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3627/7260] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:48.840948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59984206-ef0f-45f8-82ba-495a8291fd3f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:48.842920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-59984206-ef0f-45f8-82ba-495a8291fd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:48.988593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59984206-ef0f-45f8-82ba-495a8291fd3f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:48.989607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61c099-8b1c-4fab-a355-a0c72e343400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:48.991241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61c099-8b1c-4fab-a355-a0c72e343400 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:49.010061 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3634/7261] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:48 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:49.020668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4d126-6c0e-411b-bdda-046fee223a5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:49.025647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4d126-6c0e-411b-bdda-046fee223a5c service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:49.025932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4d126-6c0e-411b-bdda-046fee223a5c service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:49.026272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4d126-6c0e-411b-bdda-046fee223a5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:49.058661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4d126-6c0e-411b-bdda-046fee223a5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:49.063329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4d126-6c0e-411b-bdda-046fee223a5c service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:49.079839 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3628/7262] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:53:49.478613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61c099-8b1c-4fab-a355-a0c72e343400 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:49.523653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61c099-8b1c-4fab-a355-a0c72e343400 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:49.547628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a2607-cf72-4fbe-b05b-4ad25c94ffcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:49.550206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a2607-cf72-4fbe-b05b-4ad25c94ffcc service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:49.551988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a2607-cf72-4fbe-b05b-4ad25c94ffcc service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:49.552427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a2607-cf72-4fbe-b05b-4ad25c94ffcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:49.655071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a2607-cf72-4fbe-b05b-4ad25c94ffcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:49.656678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a2607-cf72-4fbe-b05b-4ad25c94ffcc service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:49.668080 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3635/7263] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:50.381765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:50.757923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:53.560309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:53.916872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:55.205482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:56.367668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4d126-6c0e-411b-bdda-046fee223a5c service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:56.371866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3cd4d126-6c0e-411b-bdda-046fee223a5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:56.527731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4d126-6c0e-411b-bdda-046fee223a5c service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:56.539215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:56.544664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de422470-3dbe-4cbd-b863-3cfd0bee9fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:56.545380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de422470-3dbe-4cbd-b863-3cfd0bee9fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:56.545662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de422470-3dbe-4cbd-b863-3cfd0bee9fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:56.546269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de422470-3dbe-4cbd-b863-3cfd0bee9fa8 admin admin] PATH_INFO: `/v3/users/166a86ef3a9e47d1b1eb78451853c630` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:56.548415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de422470-3dbe-4cbd-b863-3cfd0bee9fa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=166a86ef3a9e47d1b1eb78451853c630)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:56.556641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de422470-3dbe-4cbd-b863-3cfd0bee9fa8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:57.057521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-de422470-3dbe-4cbd-b863-3cfd0bee9fa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '166a86ef3a9e47d1b1eb78451853c630'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:57.058694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-de422470-3dbe-4cbd-b863-3cfd0bee9fa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '166a86ef3a9e47d1b1eb78451853c630'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:57.073744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-de422470-3dbe-4cbd-b863-3cfd0bee9fa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '166a86ef3a9e47d1b1eb78451853c630'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:57.089514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-de422470-3dbe-4cbd-b863-3cfd0bee9fa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '166a86ef3a9e47d1b1eb78451853c630'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:57.091084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-de422470-3dbe-4cbd-b863-3cfd0bee9fa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '166a86ef3a9e47d1b1eb78451853c630'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:57.194468 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3629/7264] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:53:56 2022] DELETE /identity/v3/users/166a86ef3a9e47d1b1eb78451853c630 => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:57.199294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80727aa-1793-4cfc-8b20-fbc3ef603ff4 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:57.199787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80727aa-1793-4cfc-8b20-fbc3ef603ff4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:57.200002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80727aa-1793-4cfc-8b20-fbc3ef603ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:57.223352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e80727aa-1793-4cfc-8b20-fbc3ef603ff4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:53:57.224665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e80727aa-1793-4cfc-8b20-fbc3ef603ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:57.297362 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3636/7265] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:53:57.309018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de422470-3dbe-4cbd-b863-3cfd0bee9fa8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:57.310937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-de422470-3dbe-4cbd-b863-3cfd0bee9fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:57.429021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de422470-3dbe-4cbd-b863-3cfd0bee9fa8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:57.434844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d662655-72bb-48bc-acfa-5e82671b3cbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:57.435488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d662655-72bb-48bc-acfa-5e82671b3cbd service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:57.435828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d662655-72bb-48bc-acfa-5e82671b3cbd service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:57.436113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d662655-72bb-48bc-acfa-5e82671b3cbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:57.450268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d662655-72bb-48bc-acfa-5e82671b3cbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:57.451801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d662655-72bb-48bc-acfa-5e82671b3cbd service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:57.469281 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3630/7266] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:53:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:53:58.145998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80727aa-1793-4cfc-8b20-fbc3ef603ff4 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:58.147615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e80727aa-1793-4cfc-8b20-fbc3ef603ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:53:58.164089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80727aa-1793-4cfc-8b20-fbc3ef603ff4 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:58.194246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:58.194246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f4cf0-d45a-49a5-820e-351537973896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:58.194246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f4cf0-d45a-49a5-820e-351537973896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:58.194246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f4cf0-d45a-49a5-820e-351537973896 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:58.196356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f4cf0-d45a-49a5-820e-351537973896 admin admin] PATH_INFO: `/v3/projects/4237f45796894508877970979c3fe8bf` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:58.196356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f4cf0-d45a-49a5-820e-351537973896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4237f45796894508877970979c3fe8bf)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:58.196356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f4cf0-d45a-49a5-820e-351537973896 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:58.444034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9c6f4cf0-d45a-49a5-820e-351537973896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4237f45796894508877970979c3fe8bf', 'request_id': 'req-9c6f4cf0-d45a-49a5-820e-351537973896'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:58.574594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9c6f4cf0-d45a-49a5-820e-351537973896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4237f45796894508877970979c3fe8bf', 'request_id': 'req-9c6f4cf0-d45a-49a5-820e-351537973896'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:58.583664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9c6f4cf0-d45a-49a5-820e-351537973896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4237f45796894508877970979c3fe8bf', 'request_id': 'req-9c6f4cf0-d45a-49a5-820e-351537973896'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:58.599082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9c6f4cf0-d45a-49a5-820e-351537973896 admin admin] The token cache is being invalidate because project 4237f45796894508877970979c3fe8bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:53:58.599876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9c6f4cf0-d45a-49a5-820e-351537973896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:58.600963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9c6f4cf0-d45a-49a5-820e-351537973896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:58.603993 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3637/7267] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:53:58 2022] DELETE /identity/v3/projects/4237f45796894508877970979c3fe8bf => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:58.608135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d662655-72bb-48bc-acfa-5e82671b3cbd service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:58.620571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d662655-72bb-48bc-acfa-5e82671b3cbd service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:53:58.720871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998b8c2-bddb-4e71-b8b3-b9a286b839c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:53:58.722280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998b8c2-bddb-4e71-b8b3-b9a286b839c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:53:58.722682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998b8c2-bddb-4e71-b8b3-b9a286b839c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:53:58.723184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998b8c2-bddb-4e71-b8b3-b9a286b839c2 admin admin] PATH_INFO: `/v3/users/f156ff0846e84967a16e4b8107eedf4e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:53:58.724896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998b8c2-bddb-4e71-b8b3-b9a286b839c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f156ff0846e84967a16e4b8107eedf4e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:53:58.727820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998b8c2-bddb-4e71-b8b3-b9a286b839c2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:53:58.993388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e998b8c2-bddb-4e71-b8b3-b9a286b839c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f156ff0846e84967a16e4b8107eedf4e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:58.994435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e998b8c2-bddb-4e71-b8b3-b9a286b839c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f156ff0846e84967a16e4b8107eedf4e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:59.003116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e998b8c2-bddb-4e71-b8b3-b9a286b839c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f156ff0846e84967a16e4b8107eedf4e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:59.021706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e998b8c2-bddb-4e71-b8b3-b9a286b839c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f156ff0846e84967a16e4b8107eedf4e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:59.023089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e998b8c2-bddb-4e71-b8b3-b9a286b839c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f156ff0846e84967a16e4b8107eedf4e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:53:59.111090 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3631/7268] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:53:58 2022] DELETE /identity/v3/users/f156ff0846e84967a16e4b8107eedf4e => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:53:59.309204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:59.745428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:59.890004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f4cf0-d45a-49a5-820e-351537973896 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:53:59.891853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9c6f4cf0-d45a-49a5-820e-351537973896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:00.063318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f4cf0-d45a-49a5-820e-351537973896 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:00.124968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998b8c2-bddb-4e71-b8b3-b9a286b839c2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:00.126492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e998b8c2-bddb-4e71-b8b3-b9a286b839c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:00.168981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100e497-8dea-4530-a05c-fb7c8e0db9a6 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab3abe7abbd4fe28d63c022c402a3c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70b21a0d219f448fa2ca3bc8574a8c86', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:00.169609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100e497-8dea-4530-a05c-fb7c8e0db9a6 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:00.169960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100e497-8dea-4530-a05c-fb7c8e0db9a6 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:00.170324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100e497-8dea-4530-a05c-fb7c8e0db9a6 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:00.171304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100e497-8dea-4530-a05c-fb7c8e0db9a6 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:54:00.171679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100e497-8dea-4530-a05c-fb7c8e0db9a6 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:00.174727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100e497-8dea-4530-a05c-fb7c8e0db9a6 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:00.225433 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3638/7269] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:54:00.242541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100e497-8dea-4530-a05c-fb7c8e0db9a6 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:00.247996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7100e497-8dea-4530-a05c-fb7c8e0db9a6 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:00.292982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100e497-8dea-4530-a05c-fb7c8e0db9a6 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:00.308505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf0b8e-1be2-4de4-aa96-edc9bc645d80 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab3abe7abbd4fe28d63c022c402a3c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70b21a0d219f448fa2ca3bc8574a8c86', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:00.309154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf0b8e-1be2-4de4-aa96-edc9bc645d80 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:00.309444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf0b8e-1be2-4de4-aa96-edc9bc645d80 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:00.309834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf0b8e-1be2-4de4-aa96-edc9bc645d80 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:00.310513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf0b8e-1be2-4de4-aa96-edc9bc645d80 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:00.316578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf0b8e-1be2-4de4-aa96-edc9bc645d80 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:00.329730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998b8c2-bddb-4e71-b8b3-b9a286b839c2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:00.346701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc4c88-65ea-4d3f-b49e-221344435d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:00.352416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc4c88-65ea-4d3f-b49e-221344435d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:00.352961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc4c88-65ea-4d3f-b49e-221344435d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:00.353403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc4c88-65ea-4d3f-b49e-221344435d07 admin admin] PATH_INFO: `/v3/projects/8b5b6366944046b4b279d93acfe65835` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:00.357068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc4c88-65ea-4d3f-b49e-221344435d07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5b6366944046b4b279d93acfe65835)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:00.359970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc4c88-65ea-4d3f-b49e-221344435d07 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:00.486952 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3639/7270] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:54:00 2022] POST /identity/v3/projects => generated 349 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:54:00.490958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf0b8e-1be2-4de4-aa96-edc9bc645d80 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:00.563477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2fbc4c88-65ea-4d3f-b49e-221344435d07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5b6366944046b4b279d93acfe65835', 'request_id': 'req-2fbc4c88-65ea-4d3f-b49e-221344435d07'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:00.571422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2fbc4c88-65ea-4d3f-b49e-221344435d07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5b6366944046b4b279d93acfe65835', 'request_id': 'req-2fbc4c88-65ea-4d3f-b49e-221344435d07'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:00.588814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2fbc4c88-65ea-4d3f-b49e-221344435d07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5b6366944046b4b279d93acfe65835', 'request_id': 'req-2fbc4c88-65ea-4d3f-b49e-221344435d07'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:00.612640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf0b8e-1be2-4de4-aa96-edc9bc645d80 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:00.709141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2fbc4c88-65ea-4d3f-b49e-221344435d07 admin admin] The token cache is being invalidate because project 8b5b6366944046b4b279d93acfe65835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:54:00.709438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2fbc4c88-65ea-4d3f-b49e-221344435d07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:00.710336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2fbc4c88-65ea-4d3f-b49e-221344435d07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:00.713240 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3632/7271] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:54:00 2022] DELETE /identity/v3/projects/8b5b6366944046b4b279d93acfe65835 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:54:00.717872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc4c88-65ea-4d3f-b49e-221344435d07 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:00.720583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2fbc4c88-65ea-4d3f-b49e-221344435d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:00.775376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e973f7b-4bca-49d7-b392-9f062238f6f8 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab3abe7abbd4fe28d63c022c402a3c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70b21a0d219f448fa2ca3bc8574a8c86', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:00.776012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e973f7b-4bca-49d7-b392-9f062238f6f8 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:00.776307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e973f7b-4bca-49d7-b392-9f062238f6f8 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:00.776714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e973f7b-4bca-49d7-b392-9f062238f6f8 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:00.777367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e973f7b-4bca-49d7-b392-9f062238f6f8 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:54:00.777552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e973f7b-4bca-49d7-b392-9f062238f6f8 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:00.779616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e973f7b-4bca-49d7-b392-9f062238f6f8 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:00.818580 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3640/7272] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:54:00.885309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc4c88-65ea-4d3f-b49e-221344435d07 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:00.900374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4205419-310f-4cde-a369-338280d27c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:00.901210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4205419-310f-4cde-a369-338280d27c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:00.901588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4205419-310f-4cde-a369-338280d27c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:00.901968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4205419-310f-4cde-a369-338280d27c88 admin admin] PATH_INFO: `/v3/users/601dccb25bcd4f19b68c082447e41095` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:00.904938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4205419-310f-4cde-a369-338280d27c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=601dccb25bcd4f19b68c082447e41095)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:00.908296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4205419-310f-4cde-a369-338280d27c88 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:01.207956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d4205419-310f-4cde-a369-338280d27c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '601dccb25bcd4f19b68c082447e41095'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:01.214709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d4205419-310f-4cde-a369-338280d27c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '601dccb25bcd4f19b68c082447e41095'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:01.228049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d4205419-310f-4cde-a369-338280d27c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '601dccb25bcd4f19b68c082447e41095'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:01.261899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d4205419-310f-4cde-a369-338280d27c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '601dccb25bcd4f19b68c082447e41095'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:01.265013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d4205419-310f-4cde-a369-338280d27c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '601dccb25bcd4f19b68c082447e41095'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:01.395487 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3633/7273] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:54:00 2022] DELETE /identity/v3/users/601dccb25bcd4f19b68c082447e41095 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:54:01.615256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:02.268578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:02.573106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e973f7b-4bca-49d7-b392-9f062238f6f8 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:02.575879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0e973f7b-4bca-49d7-b392-9f062238f6f8 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:02.592507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e973f7b-4bca-49d7-b392-9f062238f6f8 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:02.637811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4205419-310f-4cde-a369-338280d27c88 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:02.639896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d4205419-310f-4cde-a369-338280d27c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:02.742973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062a101-32a6-466c-b74d-9f02735e3e35 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab3abe7abbd4fe28d63c022c402a3c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70b21a0d219f448fa2ca3bc8574a8c86', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:02.743819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062a101-32a6-466c-b74d-9f02735e3e35 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:02.744105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062a101-32a6-466c-b74d-9f02735e3e35 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:02.744385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062a101-32a6-466c-b74d-9f02735e3e35 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] PATH_INFO: `/v3/projects/619966063d5c44b0b7442fbbeeef988a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:02.745651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062a101-32a6-466c-b74d-9f02735e3e35 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] RBAC: Authorizing `identity:delete_project(project_id=619966063d5c44b0b7442fbbeeef988a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:02.747717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062a101-32a6-466c-b74d-9f02735e3e35 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:02.792347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4205419-310f-4cde-a369-338280d27c88 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:02.814585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825ab04-79d2-43d8-81b3-4fca2002996f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:02.816593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825ab04-79d2-43d8-81b3-4fca2002996f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:02.817450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825ab04-79d2-43d8-81b3-4fca2002996f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:02.817918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825ab04-79d2-43d8-81b3-4fca2002996f admin admin] PATH_INFO: `/v3/projects/a9ca506065c44e049060f27f5126b80d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:02.821887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825ab04-79d2-43d8-81b3-4fca2002996f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ca506065c44e049060f27f5126b80d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:02.824438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825ab04-79d2-43d8-81b3-4fca2002996f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:02.956786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1062a101-32a6-466c-b74d-9f02735e3e35 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '619966063d5c44b0b7442fbbeeef988a', 'request_id': 'req-1062a101-32a6-466c-b74d-9f02735e3e35'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:02.976666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2825ab04-79d2-43d8-81b3-4fca2002996f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ca506065c44e049060f27f5126b80d', 'request_id': 'req-2825ab04-79d2-43d8-81b3-4fca2002996f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:02.990375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2825ab04-79d2-43d8-81b3-4fca2002996f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ca506065c44e049060f27f5126b80d', 'request_id': 'req-2825ab04-79d2-43d8-81b3-4fca2002996f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:03.019987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2825ab04-79d2-43d8-81b3-4fca2002996f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ca506065c44e049060f27f5126b80d', 'request_id': 'req-2825ab04-79d2-43d8-81b3-4fca2002996f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:03.053848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1062a101-32a6-466c-b74d-9f02735e3e35 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '619966063d5c44b0b7442fbbeeef988a', 'request_id': 'req-1062a101-32a6-466c-b74d-9f02735e3e35'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:03.074262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1062a101-32a6-466c-b74d-9f02735e3e35 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '619966063d5c44b0b7442fbbeeef988a', 'request_id': 'req-1062a101-32a6-466c-b74d-9f02735e3e35'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:03.123227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1062a101-32a6-466c-b74d-9f02735e3e35 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] The token cache is being invalidate because project 619966063d5c44b0b7442fbbeeef988a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:54:03.123572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1062a101-32a6-466c-b74d-9f02735e3e35 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:03.132306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1062a101-32a6-466c-b74d-9f02735e3e35 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:03.134363 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3641/7274] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:54:02 2022] DELETE /identity/v3/projects/619966063d5c44b0b7442fbbeeef988a => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:54:03.135182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062a101-32a6-466c-b74d-9f02735e3e35 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:03.136650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1062a101-32a6-466c-b74d-9f02735e3e35 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:03.151427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2825ab04-79d2-43d8-81b3-4fca2002996f admin admin] The token cache is being invalidate because project a9ca506065c44e049060f27f5126b80d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:54:03.152769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2825ab04-79d2-43d8-81b3-4fca2002996f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:03.153866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-2825ab04-79d2-43d8-81b3-4fca2002996f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:03.161649 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3634/7275] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:54:02 2022] DELETE /identity/v3/projects/a9ca506065c44e049060f27f5126b80d => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:54:03.163472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f7821-9845-49d3-b3a9-b4bce81bab24 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:03.163935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f7821-9845-49d3-b3a9-b4bce81bab24 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:03.170436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f7821-9845-49d3-b3a9-b4bce81bab24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:03.206961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ae8f7821-9845-49d3-b3a9-b4bce81bab24 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:54:03.210978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ae8f7821-9845-49d3-b3a9-b4bce81bab24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:03.298554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062a101-32a6-466c-b74d-9f02735e3e35 tempest-RoutersIpV6AdminTest-792731709 tempest-RoutersIpV6AdminTest-792731709-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:03.373507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:03.414374 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3635/7276] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:54:03.415715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f7821-9845-49d3-b3a9-b4bce81bab24 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:03.425359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ae8f7821-9845-49d3-b3a9-b4bce81bab24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:03.467390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea265f-b3b6-49c4-bec8-4498b62fa7f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:03.467390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea265f-b3b6-49c4-bec8-4498b62fa7f4 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:03.467390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea265f-b3b6-49c4-bec8-4498b62fa7f4 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:03.467390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea265f-b3b6-49c4-bec8-4498b62fa7f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:03.467768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-99ea265f-b3b6-49c4-bec8-4498b62fa7f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:03.492727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea265f-b3b6-49c4-bec8-4498b62fa7f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:03.496277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea265f-b3b6-49c4-bec8-4498b62fa7f4 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:03.529637 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3642/7277] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:54:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:54:03.548300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a17b75-a97c-4689-914a-7622fd34f9aa None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:03.548662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a17b75-a97c-4689-914a-7622fd34f9aa None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:03.548846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f7821-9845-49d3-b3a9-b4bce81bab24 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:03.560998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2178d-2a7a-4b49-a4ad-5ca83eb0e68f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:03.561770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2178d-2a7a-4b49-a4ad-5ca83eb0e68f service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:03.562191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2178d-2a7a-4b49-a4ad-5ca83eb0e68f service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:03.562590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2178d-2a7a-4b49-a4ad-5ca83eb0e68f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:03.563113 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a17b75-a97c-4689-914a-7622fd34f9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:03.567056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-39f2178d-2a7a-4b49-a4ad-5ca83eb0e68f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:03.638480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:03.651253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-67a17b75-a97c-4689-914a-7622fd34f9aa None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:54:03.656023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-67a17b75-a97c-4689-914a-7622fd34f9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:03.682422 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3643/7278] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:54:03.685230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a17b75-a97c-4689-914a-7622fd34f9aa None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:03.709005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a17b75-a97c-4689-914a-7622fd34f9aa None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:03.723321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f3c0d-0693-4d85-8bbf-03542438793d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:03.723321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f3c0d-0693-4d85-8bbf-03542438793d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:03.723321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f3c0d-0693-4d85-8bbf-03542438793d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:03.723751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f3c0d-0693-4d85-8bbf-03542438793d admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:03.728903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f3c0d-0693-4d85-8bbf-03542438793d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:54:03.729233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f3c0d-0693-4d85-8bbf-03542438793d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:03.731032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f3c0d-0693-4d85-8bbf-03542438793d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:03.732445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f2178d-2a7a-4b49-a4ad-5ca83eb0e68f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:03.737662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f2178d-2a7a-4b49-a4ad-5ca83eb0e68f service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:03.762019 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3644/7279] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:54:03.766300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f3c0d-0693-4d85-8bbf-03542438793d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:03.784381 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3636/7280] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:54:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:54:03.792068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f3c0d-0693-4d85-8bbf-03542438793d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:03.816470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fee9f4-4360-427d-be6e-6e04a2b4be18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:03.816733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fee9f4-4360-427d-be6e-6e04a2b4be18 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:03.816945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fee9f4-4360-427d-be6e-6e04a2b4be18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:03.817219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fee9f4-4360-427d-be6e-6e04a2b4be18 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:03.817824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fee9f4-4360-427d-be6e-6e04a2b4be18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:03.819783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fee9f4-4360-427d-be6e-6e04a2b4be18 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:03.938977 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3645/7281] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:54:03 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:54:03.944011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2178d-2a7a-4b49-a4ad-5ca83eb0e68f service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:03.968638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2178d-2a7a-4b49-a4ad-5ca83eb0e68f service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:04.150497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38f08a-89e1-41f7-bcf4-275729c4075b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:04.151563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38f08a-89e1-41f7-bcf4-275729c4075b admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:04.152094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38f08a-89e1-41f7-bcf4-275729c4075b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:04.153548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38f08a-89e1-41f7-bcf4-275729c4075b admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:04.154982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38f08a-89e1-41f7-bcf4-275729c4075b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:04.160748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38f08a-89e1-41f7-bcf4-275729c4075b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:04.265118 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3637/7282] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:54:03 2022] POST /identity/v3/users => generated 290 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:54:04.266108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fee9f4-4360-427d-be6e-6e04a2b4be18 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:04.281361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fee9f4-4360-427d-be6e-6e04a2b4be18 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:04.294068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759fb4c-052a-4eff-8beb-7cb8175a7d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:04.294068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759fb4c-052a-4eff-8beb-7cb8175a7d2a admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:04.294068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759fb4c-052a-4eff-8beb-7cb8175a7d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:04.298951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759fb4c-052a-4eff-8beb-7cb8175a7d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:04.300264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759fb4c-052a-4eff-8beb-7cb8175a7d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:04.301713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759fb4c-052a-4eff-8beb-7cb8175a7d2a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:04.327232 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3646/7283] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:54:04.332561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38f08a-89e1-41f7-bcf4-275729c4075b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:04.356989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38f08a-89e1-41f7-bcf4-275729c4075b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:04.386913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5247d-e106-4b64-a430-a3cac8a269e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:04.388272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5247d-e106-4b64-a430-a3cac8a269e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:04.388930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5247d-e106-4b64-a430-a3cac8a269e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:04.389417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5247d-e106-4b64-a430-a3cac8a269e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:04.390403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5247d-e106-4b64-a430-a3cac8a269e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:04.392283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5247d-e106-4b64-a430-a3cac8a269e8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:04.423391 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3638/7284] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:54:04.424789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759fb4c-052a-4eff-8beb-7cb8175a7d2a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:04.438636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759fb4c-052a-4eff-8beb-7cb8175a7d2a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:04.450997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5247d-e106-4b64-a430-a3cac8a269e8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:04.453012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3ca5247d-e106-4b64-a430-a3cac8a269e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:04.456074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d4d6a-11ab-4645-8d29-65fae2e9f6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:04.456776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d4d6a-11ab-4645-8d29-65fae2e9f6c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:04.457362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d4d6a-11ab-4645-8d29-65fae2e9f6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:04.457500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d4d6a-11ab-4645-8d29-65fae2e9f6c4 admin admin] PATH_INFO: `/v3/projects/8593f43fe09d4e85ac6527d4aac2f542/users/63d5cd82cabd49498acd8cf1a0fe10aa/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:04.524875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d4d6a-11ab-4645-8d29-65fae2e9f6c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8593f43fe09d4e85ac6527d4aac2f542, user_id=63d5cd82cabd49498acd8cf1a0fe10aa, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:04.524875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d4d6a-11ab-4645-8d29-65fae2e9f6c4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:04.634292 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3647/7285] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:54:04 2022] PUT /identity/v3/projects/8593f43fe09d4e85ac6527d4aac2f542/users/63d5cd82cabd49498acd8cf1a0fe10aa/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:54:04.652969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe030def-0f76-4d8e-a804-41d431f645ad None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:04.659126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe030def-0f76-4d8e-a804-41d431f645ad None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:04.660330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe030def-0f76-4d8e-a804-41d431f645ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:04.705230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5247d-e106-4b64-a430-a3cac8a269e8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:04.772250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-fe030def-0f76-4d8e-a804-41d431f645ad None None] MFA Rules not processed for user `63d5cd82cabd49498acd8cf1a0fe10aa`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:54:04.776295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fe030def-0f76-4d8e-a804-41d431f645ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:04.846190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:04.846422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71f92e-2f96-45fa-a8be-feaccc158d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:04.846422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71f92e-2f96-45fa-a8be-feaccc158d93 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:04.846422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71f92e-2f96-45fa-a8be-feaccc158d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:04.846422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71f92e-2f96-45fa-a8be-feaccc158d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:04.847169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9b71f92e-2f96-45fa-a8be-feaccc158d93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:04.874537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71f92e-2f96-45fa-a8be-feaccc158d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:04.877399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71f92e-2f96-45fa-a8be-feaccc158d93 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:04.899470 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3639/7286] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:54:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:54:04.949416 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3648/7287] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:54:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:54:04.957380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:04.959433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71f92e-2f96-45fa-a8be-feaccc158d93 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:05.094621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71f92e-2f96-45fa-a8be-feaccc158d93 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:05.108057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ba600-3a54-4cd6-925b-7dd7cb8678d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:05.109222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ba600-3a54-4cd6-925b-7dd7cb8678d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:05.109805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ba600-3a54-4cd6-925b-7dd7cb8678d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:05.110269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ba600-3a54-4cd6-925b-7dd7cb8678d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:05.111966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ba600-3a54-4cd6-925b-7dd7cb8678d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:05.114303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ba600-3a54-4cd6-925b-7dd7cb8678d2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:05.235475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe030def-0f76-4d8e-a804-41d431f645ad None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:05.237022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fe030def-0f76-4d8e-a804-41d431f645ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:05.255969 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3640/7288] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:54:04 2022] POST /identity/v3/projects => generated 377 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:54:05.260351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ba600-3a54-4cd6-925b-7dd7cb8678d2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:05.385344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe030def-0f76-4d8e-a804-41d431f645ad None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:05.497057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ba600-3a54-4cd6-925b-7dd7cb8678d2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:05.503914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479c126-3e5e-406c-9e9a-815c92836920 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:05.504550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479c126-3e5e-406c-9e9a-815c92836920 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:05.504830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479c126-3e5e-406c-9e9a-815c92836920 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:05.505121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479c126-3e5e-406c-9e9a-815c92836920 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:05.509366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0479c126-3e5e-406c-9e9a-815c92836920 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:05.512466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afb028-2153-4526-9181-f78320567d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:05.513110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afb028-2153-4526-9181-f78320567d79 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:05.513391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afb028-2153-4526-9181-f78320567d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:05.515322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afb028-2153-4526-9181-f78320567d79 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:05.516057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afb028-2153-4526-9181-f78320567d79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:05.519227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afb028-2153-4526-9181-f78320567d79 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:05.543097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479c126-3e5e-406c-9e9a-815c92836920 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:05.543097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479c126-3e5e-406c-9e9a-815c92836920 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:05.570416 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3649/7289] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:54:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:54:05.685642 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3641/7290] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:54:05 2022] POST /identity/v3/users => generated 289 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:54:05.687511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479c126-3e5e-406c-9e9a-815c92836920 service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:05.693178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:05.713224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479c126-3e5e-406c-9e9a-815c92836920 service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:05.724954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a508d-b244-4b23-a8c2-bbc2c63c6ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:05.725745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a508d-b244-4b23-a8c2-bbc2c63c6ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:05.726150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a508d-b244-4b23-a8c2-bbc2c63c6ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:05.726521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a508d-b244-4b23-a8c2-bbc2c63c6ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:05.727304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a508d-b244-4b23-a8c2-bbc2c63c6ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:05.734571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a508d-b244-4b23-a8c2-bbc2c63c6ec5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:05.762858 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3650/7291] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:54:05.766842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afb028-2153-4526-9181-f78320567d79 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:05.790972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afb028-2153-4526-9181-f78320567d79 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:05.806863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6381a-5ac0-441f-a913-ffc0d8c352da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:05.808617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6381a-5ac0-441f-a913-ffc0d8c352da admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:05.809008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6381a-5ac0-441f-a913-ffc0d8c352da admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:05.809385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6381a-5ac0-441f-a913-ffc0d8c352da admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:05.810195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6381a-5ac0-441f-a913-ffc0d8c352da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:05.813913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6381a-5ac0-441f-a913-ffc0d8c352da admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:05.825647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:05.843924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a508d-b244-4b23-a8c2-bbc2c63c6ec5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:05.853832 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3642/7292] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:54:05.868822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a508d-b244-4b23-a8c2-bbc2c63c6ec5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:05.886417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a1a30-ab26-4b6c-96a1-9df7b19b49a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:05.887450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a1a30-ab26-4b6c-96a1-9df7b19b49a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:05.887932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a1a30-ab26-4b6c-96a1-9df7b19b49a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:05.888485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a1a30-ab26-4b6c-96a1-9df7b19b49a2 admin admin] PATH_INFO: `/v3/projects/8c58e92b13bf4362bfafbb36d9d91d2d/users/21095afa4851457b93c3f1f580cf3455/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:05.931047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a1a30-ab26-4b6c-96a1-9df7b19b49a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c58e92b13bf4362bfafbb36d9d91d2d, user_id=21095afa4851457b93c3f1f580cf3455, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:05.933936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a1a30-ab26-4b6c-96a1-9df7b19b49a2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:06.046460 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3651/7293] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:54:05 2022] PUT /identity/v3/projects/8c58e92b13bf4362bfafbb36d9d91d2d/users/21095afa4851457b93c3f1f580cf3455/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:54:06.057322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9dbef-f0bb-4e8c-a1e3-d460c995860d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:06.057589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9dbef-f0bb-4e8c-a1e3-d460c995860d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:06.057872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9dbef-f0bb-4e8c-a1e3-d460c995860d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:06.068220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:06.085807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a1a30-ab26-4b6c-96a1-9df7b19b49a2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:06.115026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-fef9dbef-f0bb-4e8c-a1e3-d460c995860d None None] MFA Rules not processed for user `21095afa4851457b93c3f1f580cf3455`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:54:06.115026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fef9dbef-f0bb-4e8c-a1e3-d460c995860d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:06.188156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a1a30-ab26-4b6c-96a1-9df7b19b49a2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:06.196903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71739166-ac8c-4861-ad0b-7b22c65b29bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:06.197906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71739166-ac8c-4861-ad0b-7b22c65b29bf service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:06.198554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71739166-ac8c-4861-ad0b-7b22c65b29bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:06.199038 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71739166-ac8c-4861-ad0b-7b22c65b29bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:06.202093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-71739166-ac8c-4861-ad0b-7b22c65b29bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:06.263649 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3643/7294] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:54:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:54:06.264819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9dbef-f0bb-4e8c-a1e3-d460c995860d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:06.369006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9dbef-f0bb-4e8c-a1e3-d460c995860d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:06.381407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a254e6-7912-4131-93e4-40305772e92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:06.385655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a254e6-7912-4131-93e4-40305772e92e admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:06.385655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a254e6-7912-4131-93e4-40305772e92e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:06.385655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a254e6-7912-4131-93e4-40305772e92e admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:06.385655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a254e6-7912-4131-93e4-40305772e92e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:06.385655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a254e6-7912-4131-93e4-40305772e92e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:06.386128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71739166-ac8c-4861-ad0b-7b22c65b29bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:06.387330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71739166-ac8c-4861-ad0b-7b22c65b29bf service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:06.421117 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3652/7295] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:54:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:54:06.522632 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3644/7296] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:54:06 2022] POST /identity/v3/projects => generated 379 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:54:06.527061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71739166-ac8c-4861-ad0b-7b22c65b29bf service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:06.542815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71739166-ac8c-4861-ad0b-7b22c65b29bf service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:06.679626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc476bf-7590-4a25-8fc3-7957528d39ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:06.680398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc476bf-7590-4a25-8fc3-7957528d39ed admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:06.680686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc476bf-7590-4a25-8fc3-7957528d39ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:06.680966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc476bf-7590-4a25-8fc3-7957528d39ed admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:06.681603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc476bf-7590-4a25-8fc3-7957528d39ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:06.684082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc476bf-7590-4a25-8fc3-7957528d39ed admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:06.804897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:06.813395 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3653/7297] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:54:06 2022] POST /identity/v3/users => generated 296 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:54:06.820007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a254e6-7912-4131-93e4-40305772e92e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:06.832283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a254e6-7912-4131-93e4-40305772e92e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:06.838399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdaeb37-c333-4e44-8e91-f078e73c1da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:06.839031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdaeb37-c333-4e44-8e91-f078e73c1da1 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:06.839315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdaeb37-c333-4e44-8e91-f078e73c1da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:06.839913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdaeb37-c333-4e44-8e91-f078e73c1da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:06.840500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdaeb37-c333-4e44-8e91-f078e73c1da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:06.842150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdaeb37-c333-4e44-8e91-f078e73c1da1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:06.854150 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3645/7298] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:54:06.858760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc476bf-7590-4a25-8fc3-7957528d39ed admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:06.872719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc476bf-7590-4a25-8fc3-7957528d39ed admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:06.881203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adea779-b216-45cd-88ee-e8454f820422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:06.881203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adea779-b216-45cd-88ee-e8454f820422 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:06.881203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adea779-b216-45cd-88ee-e8454f820422 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:06.881203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adea779-b216-45cd-88ee-e8454f820422 admin admin] PATH_INFO: `/v3/projects/3b03cea0184c4d3dbaf844794f27cb8d/users/2ed103cd45574e09834ef75e1c643268/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:06.898024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adea779-b216-45cd-88ee-e8454f820422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b03cea0184c4d3dbaf844794f27cb8d, user_id=2ed103cd45574e09834ef75e1c643268, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:06.901237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adea779-b216-45cd-88ee-e8454f820422 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:07.007180 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3654/7299] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:54:06 2022] PUT /identity/v3/projects/3b03cea0184c4d3dbaf844794f27cb8d/users/2ed103cd45574e09834ef75e1c643268/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:54:07.009253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdaeb37-c333-4e44-8e91-f078e73c1da1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:07.044992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdaeb37-c333-4e44-8e91-f078e73c1da1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:07.221362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d634a-b2be-4f62-b344-021ce33b8ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:07.222024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d634a-b2be-4f62-b344-021ce33b8ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:07.222333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d634a-b2be-4f62-b344-021ce33b8ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:07.222605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d634a-b2be-4f62-b344-021ce33b8ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:07.225413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d634a-b2be-4f62-b344-021ce33b8ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:07.227382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d634a-b2be-4f62-b344-021ce33b8ac9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:07.250125 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3646/7300] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:54:07.257689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adea779-b216-45cd-88ee-e8454f820422 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:07.281379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adea779-b216-45cd-88ee-e8454f820422 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:07.297219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b46c2-037b-463c-a6b2-901696b98a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:07.298323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b46c2-037b-463c-a6b2-901696b98a13 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:07.299808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b46c2-037b-463c-a6b2-901696b98a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:07.300712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b46c2-037b-463c-a6b2-901696b98a13 admin admin] PATH_INFO: `/v3/projects/3b03cea0184c4d3dbaf844794f27cb8d/users/2ed103cd45574e09834ef75e1c643268/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:07.303068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b46c2-037b-463c-a6b2-901696b98a13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b03cea0184c4d3dbaf844794f27cb8d, user_id=2ed103cd45574e09834ef75e1c643268, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:07.312036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b46c2-037b-463c-a6b2-901696b98a13 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:07.359820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa260c-da9e-4467-8eee-854559d148e3 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:07.363696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa260c-da9e-4467-8eee-854559d148e3 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:07.363696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa260c-da9e-4467-8eee-854559d148e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:07.363914 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3655/7301] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:54:07 2022] PUT /identity/v3/projects/3b03cea0184c4d3dbaf844794f27cb8d/users/2ed103cd45574e09834ef75e1c643268/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:54:07.416266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-15fa260c-da9e-4467-8eee-854559d148e3 None None] MFA Rules not processed for user `2ed103cd45574e09834ef75e1c643268`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:54:07.417509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-15fa260c-da9e-4467-8eee-854559d148e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:07.581889 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3647/7302] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:54:07 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:54:07.595389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b46c2-037b-463c-a6b2-901696b98a13 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:07.599631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-857b46c2-037b-463c-a6b2-901696b98a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:07.749158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b46c2-037b-463c-a6b2-901696b98a13 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:07.760046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6f7f4-c60e-40c1-ac45-2b36f92390bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:07.761422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6f7f4-c60e-40c1-ac45-2b36f92390bd service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:07.761879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6f7f4-c60e-40c1-ac45-2b36f92390bd service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:07.762352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6f7f4-c60e-40c1-ac45-2b36f92390bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:07.774265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6f7f4-c60e-40c1-ac45-2b36f92390bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:07.775909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6f7f4-c60e-40c1-ac45-2b36f92390bd service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:07.799626 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3656/7303] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:54:07 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:54:07.978108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa260c-da9e-4467-8eee-854559d148e3 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:07.980270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-15fa260c-da9e-4467-8eee-854559d148e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:08.005873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa260c-da9e-4467-8eee-854559d148e3 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:08.025788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c5950-9760-48ab-a9e3-6185a0788dec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:08.026856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c5950-9760-48ab-a9e3-6185a0788dec service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:08.030286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c5950-9760-48ab-a9e3-6185a0788dec service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:08.030286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c5950-9760-48ab-a9e3-6185a0788dec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:08.116955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:08.187178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c5950-9760-48ab-a9e3-6185a0788dec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:08.191432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c5950-9760-48ab-a9e3-6185a0788dec service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:08.230893 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3648/7304] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:54:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:54:09.068933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:09.776646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:11.782238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:12.233450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:14.123279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:14.384707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:16.513367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:17.954372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6f7f4-c60e-40c1-ac45-2b36f92390bd service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:17.956678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-21f6f7f4-c60e-40c1-ac45-2b36f92390bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:18.018774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:18.117353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6f7f4-c60e-40c1-ac45-2b36f92390bd service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:18.144068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e847aa-1de2-4fe7-ae1b-7f43d0da70ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:18.144754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e847aa-1de2-4fe7-ae1b-7f43d0da70ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:18.145046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e847aa-1de2-4fe7-ae1b-7f43d0da70ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:18.145340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e847aa-1de2-4fe7-ae1b-7f43d0da70ad admin admin] PATH_INFO: `/v3/users/775ee148168a478e8c120fa435e35ee9` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:18.146599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e847aa-1de2-4fe7-ae1b-7f43d0da70ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=775ee148168a478e8c120fa435e35ee9)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:18.148697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e847aa-1de2-4fe7-ae1b-7f43d0da70ad admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:18.469520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:18.495113 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-17e847aa-1de2-4fe7-ae1b-7f43d0da70ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '775ee148168a478e8c120fa435e35ee9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:18.495700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-17e847aa-1de2-4fe7-ae1b-7f43d0da70ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '775ee148168a478e8c120fa435e35ee9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:18.513997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-17e847aa-1de2-4fe7-ae1b-7f43d0da70ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '775ee148168a478e8c120fa435e35ee9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:18.622325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-17e847aa-1de2-4fe7-ae1b-7f43d0da70ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '775ee148168a478e8c120fa435e35ee9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:18.701921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-17e847aa-1de2-4fe7-ae1b-7f43d0da70ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '775ee148168a478e8c120fa435e35ee9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:18.710156 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3657/7305] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:54:17 2022] DELETE /identity/v3/users/775ee148168a478e8c120fa435e35ee9 => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:54:18.716406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8980b-220c-4baa-b142-5ba27ec81ba3 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:18.716406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8980b-220c-4baa-b142-5ba27ec81ba3 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:18.716406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8980b-220c-4baa-b142-5ba27ec81ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:18.819792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f1d8980b-220c-4baa-b142-5ba27ec81ba3 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:54:18.828729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f1d8980b-220c-4baa-b142-5ba27ec81ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:18.958396 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3649/7306] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:54:18.986428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e847aa-1de2-4fe7-ae1b-7f43d0da70ad admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:18.991449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-17e847aa-1de2-4fe7-ae1b-7f43d0da70ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:19.154997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e847aa-1de2-4fe7-ae1b-7f43d0da70ad admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:19.174156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687969a1-df37-4989-8dad-99b2ef06fc0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:19.174156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687969a1-df37-4989-8dad-99b2ef06fc0f service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:19.174156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687969a1-df37-4989-8dad-99b2ef06fc0f service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:19.174156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687969a1-df37-4989-8dad-99b2ef06fc0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:19.209411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687969a1-df37-4989-8dad-99b2ef06fc0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:19.212202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687969a1-df37-4989-8dad-99b2ef06fc0f service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:19.261031 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3658/7307] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:54:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:54:19.292986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:19.496091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8980b-220c-4baa-b142-5ba27ec81ba3 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:19.503554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f1d8980b-220c-4baa-b142-5ba27ec81ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:19.519949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8980b-220c-4baa-b142-5ba27ec81ba3 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:19.530742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e49466-9718-40ac-990c-3fd38367a6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:19.531415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e49466-9718-40ac-990c-3fd38367a6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:19.531698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e49466-9718-40ac-990c-3fd38367a6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:19.532034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e49466-9718-40ac-990c-3fd38367a6d2 admin admin] PATH_INFO: `/v3/users/63d5cd82cabd49498acd8cf1a0fe10aa` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:19.535674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e49466-9718-40ac-990c-3fd38367a6d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d5cd82cabd49498acd8cf1a0fe10aa)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:19.541706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e49466-9718-40ac-990c-3fd38367a6d2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:19.890905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-22e49466-9718-40ac-990c-3fd38367a6d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d5cd82cabd49498acd8cf1a0fe10aa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:19.893327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-22e49466-9718-40ac-990c-3fd38367a6d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d5cd82cabd49498acd8cf1a0fe10aa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:19.944025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-22e49466-9718-40ac-990c-3fd38367a6d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d5cd82cabd49498acd8cf1a0fe10aa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:20.025472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-22e49466-9718-40ac-990c-3fd38367a6d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d5cd82cabd49498acd8cf1a0fe10aa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:20.045695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-22e49466-9718-40ac-990c-3fd38367a6d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d5cd82cabd49498acd8cf1a0fe10aa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:20.182223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e71d7-4938-4162-91ff-2d29edf33321 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:20.183194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e71d7-4938-4162-91ff-2d29edf33321 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:20.183673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e71d7-4938-4162-91ff-2d29edf33321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:20.186637 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3650/7308] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:54:19 2022] DELETE /identity/v3/users/63d5cd82cabd49498acd8cf1a0fe10aa => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:54:20.239703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e49466-9718-40ac-990c-3fd38367a6d2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:20.241192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-22e49466-9718-40ac-990c-3fd38367a6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:20.241530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-528e71d7-4938-4162-91ff-2d29edf33321 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:54:20.242890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-528e71d7-4938-4162-91ff-2d29edf33321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:20.388240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:20.401608 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3659/7309] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:54:20.416277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e49466-9718-40ac-990c-3fd38367a6d2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:20.431548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e71d7-4938-4162-91ff-2d29edf33321 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:20.435122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-528e71d7-4938-4162-91ff-2d29edf33321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:20.435277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfb507-2cd9-43dd-8256-a211118c7691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:20.436035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfb507-2cd9-43dd-8256-a211118c7691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:20.436322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfb507-2cd9-43dd-8256-a211118c7691 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:20.436602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfb507-2cd9-43dd-8256-a211118c7691 admin admin] PATH_INFO: `/v3/projects/41d2faf0d2cc4727b94307fb1de5397f` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:20.437856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfb507-2cd9-43dd-8256-a211118c7691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41d2faf0d2cc4727b94307fb1de5397f)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:20.449626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfb507-2cd9-43dd-8256-a211118c7691 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:20.586060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e71d7-4938-4162-91ff-2d29edf33321 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:20.599960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde7ef4-7dba-4068-911a-b02fc7462919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:20.601502 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde7ef4-7dba-4068-911a-b02fc7462919 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:20.602004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde7ef4-7dba-4068-911a-b02fc7462919 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:20.602513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde7ef4-7dba-4068-911a-b02fc7462919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:20.612935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:20.624211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde7ef4-7dba-4068-911a-b02fc7462919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:20.634049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde7ef4-7dba-4068-911a-b02fc7462919 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:20.662937 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3660/7310] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:54:20.762709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0dbfb507-2cd9-43dd-8256-a211118c7691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41d2faf0d2cc4727b94307fb1de5397f', 'request_id': 'req-0dbfb507-2cd9-43dd-8256-a211118c7691'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:20.786561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0dbfb507-2cd9-43dd-8256-a211118c7691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41d2faf0d2cc4727b94307fb1de5397f', 'request_id': 'req-0dbfb507-2cd9-43dd-8256-a211118c7691'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:20.815249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0dbfb507-2cd9-43dd-8256-a211118c7691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41d2faf0d2cc4727b94307fb1de5397f', 'request_id': 'req-0dbfb507-2cd9-43dd-8256-a211118c7691'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:20.923098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0dbfb507-2cd9-43dd-8256-a211118c7691 admin admin] The token cache is being invalidate because project 41d2faf0d2cc4727b94307fb1de5397f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:54:20.925976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0dbfb507-2cd9-43dd-8256-a211118c7691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:20.925976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0dbfb507-2cd9-43dd-8256-a211118c7691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:20.933544 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3651/7311] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:54:20 2022] DELETE /identity/v3/projects/41d2faf0d2cc4727b94307fb1de5397f => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:54:20.934900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65118c21-3392-497b-8d94-87fa5287704e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:20.935203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65118c21-3392-497b-8d94-87fa5287704e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:20.935533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65118c21-3392-497b-8d94-87fa5287704e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:21.027788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-65118c21-3392-497b-8d94-87fa5287704e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:54:21.028765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-65118c21-3392-497b-8d94-87fa5287704e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:21.254788 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3661/7312] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:54:21.265949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19f8ab-479b-4101-aae3-04b607b80e21 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:21.272541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19f8ab-479b-4101-aae3-04b607b80e21 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:21.272541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19f8ab-479b-4101-aae3-04b607b80e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:21.319189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-5f19f8ab-479b-4101-aae3-04b607b80e21 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:54:21.320468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5f19f8ab-479b-4101-aae3-04b607b80e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:21.346385 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3652/7313] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:54:21.346512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65118c21-3392-497b-8d94-87fa5287704e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:21.363016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65118c21-3392-497b-8d94-87fa5287704e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:21.376522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bea03e-35ac-46ff-81b7-3058755c157c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:21.378243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bea03e-35ac-46ff-81b7-3058755c157c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:21.378670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bea03e-35ac-46ff-81b7-3058755c157c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:21.379108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bea03e-35ac-46ff-81b7-3058755c157c admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:21.379986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bea03e-35ac-46ff-81b7-3058755c157c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:54:21.380451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bea03e-35ac-46ff-81b7-3058755c157c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:21.382265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bea03e-35ac-46ff-81b7-3058755c157c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:21.408278 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3662/7314] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:54:21.414600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19f8ab-479b-4101-aae3-04b607b80e21 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:21.426325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19f8ab-479b-4101-aae3-04b607b80e21 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:21.453115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca738b9f-2fb7-4165-8474-127afcb3d09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:21.453115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca738b9f-2fb7-4165-8474-127afcb3d09e admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:21.453115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca738b9f-2fb7-4165-8474-127afcb3d09e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:21.453115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca738b9f-2fb7-4165-8474-127afcb3d09e admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:21.453646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca738b9f-2fb7-4165-8474-127afcb3d09e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:21.453646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca738b9f-2fb7-4165-8474-127afcb3d09e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:21.610083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bea03e-35ac-46ff-81b7-3058755c157c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:21.617477 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3653/7315] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:54:21 2022] POST /identity/v3/projects => generated 377 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:54:21.627608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bea03e-35ac-46ff-81b7-3058755c157c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:21.771752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c2b20-2307-4422-9848-624a13e4343a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:21.773181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c2b20-2307-4422-9848-624a13e4343a admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:21.773181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c2b20-2307-4422-9848-624a13e4343a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:21.773181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c2b20-2307-4422-9848-624a13e4343a admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:21.773557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c2b20-2307-4422-9848-624a13e4343a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:21.775796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c2b20-2307-4422-9848-624a13e4343a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:21.889890 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3663/7316] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:54:21 2022] POST /identity/v3/users => generated 289 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:54:21.900413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca738b9f-2fb7-4165-8474-127afcb3d09e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:21.930429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca738b9f-2fb7-4165-8474-127afcb3d09e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:21.948133 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56ddcb-377f-439f-9b6c-7b729767cd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:21.949384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56ddcb-377f-439f-9b6c-7b729767cd1d admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:21.949775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56ddcb-377f-439f-9b6c-7b729767cd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:21.950201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56ddcb-377f-439f-9b6c-7b729767cd1d admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:21.950969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56ddcb-377f-439f-9b6c-7b729767cd1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:21.952829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56ddcb-377f-439f-9b6c-7b729767cd1d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:21.976751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c2b20-2307-4422-9848-624a13e4343a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:22.002218 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3654/7317] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:54:22.020359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c2b20-2307-4422-9848-624a13e4343a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:22.035365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f2962-b1da-40e5-850e-226fa6a440ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:22.036105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f2962-b1da-40e5-850e-226fa6a440ac admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:22.036508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f2962-b1da-40e5-850e-226fa6a440ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:22.037014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f2962-b1da-40e5-850e-226fa6a440ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:22.037807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f2962-b1da-40e5-850e-226fa6a440ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:22.040256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f2962-b1da-40e5-850e-226fa6a440ac admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:22.070520 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3664/7318] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:54:22.072875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56ddcb-377f-439f-9b6c-7b729767cd1d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:22.115988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56ddcb-377f-439f-9b6c-7b729767cd1d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:22.132536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096aff19-296e-4d42-8658-2b411883aef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:22.133321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aff19-296e-4d42-8658-2b411883aef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:22.133607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aff19-296e-4d42-8658-2b411883aef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:22.133884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aff19-296e-4d42-8658-2b411883aef5 admin admin] PATH_INFO: `/v3/projects/8a582cd691904ae6992be60ad7947ebb/users/85cc9c47e5014d1492f9a69d32fabcf4/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:22.203722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096aff19-296e-4d42-8658-2b411883aef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a582cd691904ae6992be60ad7947ebb, user_id=85cc9c47e5014d1492f9a69d32fabcf4, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:22.207944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096aff19-296e-4d42-8658-2b411883aef5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:22.332682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f2962-b1da-40e5-850e-226fa6a440ac admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:22.335015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bf8f2962-b1da-40e5-850e-226fa6a440ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:22.369479 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3655/7319] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:54:22 2022] PUT /identity/v3/projects/8a582cd691904ae6992be60ad7947ebb/users/85cc9c47e5014d1492f9a69d32fabcf4/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:54:22.370327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f2962-b1da-40e5-850e-226fa6a440ac admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:22.382089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f28ab-df0a-453e-86fc-27d97edc832f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:22.382676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f28ab-df0a-453e-86fc-27d97edc832f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:22.382955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f28ab-df0a-453e-86fc-27d97edc832f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:22.444379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c10f28ab-df0a-453e-86fc-27d97edc832f None None] MFA Rules not processed for user `85cc9c47e5014d1492f9a69d32fabcf4`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:54:22.445628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c10f28ab-df0a-453e-86fc-27d97edc832f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:22.547662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be5b95-4559-429d-a943-e8d5d601532c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:22.549145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be5b95-4559-429d-a943-e8d5d601532c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:22.553354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be5b95-4559-429d-a943-e8d5d601532c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:22.553354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be5b95-4559-429d-a943-e8d5d601532c admin admin] PATH_INFO: `/v3/projects/8593f43fe09d4e85ac6527d4aac2f542` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:22.553354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be5b95-4559-429d-a943-e8d5d601532c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8593f43fe09d4e85ac6527d4aac2f542)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:22.555702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be5b95-4559-429d-a943-e8d5d601532c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:22.561645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:22.637547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:22.680716 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3656/7320] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:54:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:54:22.727076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f28ab-df0a-453e-86fc-27d97edc832f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:22.728867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c10f28ab-df0a-453e-86fc-27d97edc832f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:22.830275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f28ab-df0a-453e-86fc-27d97edc832f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:22.873514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-20be5b95-4559-429d-a943-e8d5d601532c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8593f43fe09d4e85ac6527d4aac2f542', 'request_id': 'req-20be5b95-4559-429d-a943-e8d5d601532c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:22.960450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9001f5-25a8-4689-9b0c-561b7ba7c745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:22.961117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9001f5-25a8-4689-9b0c-561b7ba7c745 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:22.961405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9001f5-25a8-4689-9b0c-561b7ba7c745 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:22.961894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9001f5-25a8-4689-9b0c-561b7ba7c745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:23.014371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-20be5b95-4559-429d-a943-e8d5d601532c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8593f43fe09d4e85ac6527d4aac2f542', 'request_id': 'req-20be5b95-4559-429d-a943-e8d5d601532c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:23.030442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-20be5b95-4559-429d-a943-e8d5d601532c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8593f43fe09d4e85ac6527d4aac2f542', 'request_id': 'req-20be5b95-4559-429d-a943-e8d5d601532c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:23.061577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-20be5b95-4559-429d-a943-e8d5d601532c admin admin] The token cache is being invalidate because project 8593f43fe09d4e85ac6527d4aac2f542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:54:23.061919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-20be5b95-4559-429d-a943-e8d5d601532c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:23.062706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-20be5b95-4559-429d-a943-e8d5d601532c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:23.086216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9001f5-25a8-4689-9b0c-561b7ba7c745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:23.098863 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3665/7321] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:54:22 2022] DELETE /identity/v3/projects/8593f43fe09d4e85ac6527d4aac2f542 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:54:23.102101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9001f5-25a8-4689-9b0c-561b7ba7c745 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:23.109897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be5b95-4559-429d-a943-e8d5d601532c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:23.114979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-20be5b95-4559-429d-a943-e8d5d601532c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:23.129591 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3657/7322] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:54:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:54:23.300944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be5b95-4559-429d-a943-e8d5d601532c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:23.318765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20759485-3595-41c9-b418-cf2b004edc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:23.319424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20759485-3595-41c9-b418-cf2b004edc91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:23.319779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20759485-3595-41c9-b418-cf2b004edc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:23.322258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20759485-3595-41c9-b418-cf2b004edc91 admin admin] PATH_INFO: `/v3/users/21095afa4851457b93c3f1f580cf3455` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:23.322258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20759485-3595-41c9-b418-cf2b004edc91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21095afa4851457b93c3f1f580cf3455)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:23.323655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20759485-3595-41c9-b418-cf2b004edc91 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:23.770751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-20759485-3595-41c9-b418-cf2b004edc91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21095afa4851457b93c3f1f580cf3455'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:23.776195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-20759485-3595-41c9-b418-cf2b004edc91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21095afa4851457b93c3f1f580cf3455'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:23.789634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-20759485-3595-41c9-b418-cf2b004edc91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21095afa4851457b93c3f1f580cf3455'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:23.833081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-20759485-3595-41c9-b418-cf2b004edc91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21095afa4851457b93c3f1f580cf3455'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:23.938760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-20759485-3595-41c9-b418-cf2b004edc91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21095afa4851457b93c3f1f580cf3455'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:23.951066 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3666/7323] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:54:23 2022] DELETE /identity/v3/users/21095afa4851457b93c3f1f580cf3455 => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:54:24.854134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9001f5-25a8-4689-9b0c-561b7ba7c745 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:24.879223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9001f5-25a8-4689-9b0c-561b7ba7c745 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:24.994573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79f3a2-60e5-452e-b476-7837b837c793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:24.995638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79f3a2-60e5-452e-b476-7837b837c793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:24.996077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79f3a2-60e5-452e-b476-7837b837c793 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:24.996682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79f3a2-60e5-452e-b476-7837b837c793 admin admin] PATH_INFO: `/v3/projects/8c58e92b13bf4362bfafbb36d9d91d2d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:24.997980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79f3a2-60e5-452e-b476-7837b837c793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c58e92b13bf4362bfafbb36d9d91d2d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:25.000244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79f3a2-60e5-452e-b476-7837b837c793 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:25.268836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4d79f3a2-60e5-452e-b476-7837b837c793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c58e92b13bf4362bfafbb36d9d91d2d', 'request_id': 'req-4d79f3a2-60e5-452e-b476-7837b837c793'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:25.281965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4d79f3a2-60e5-452e-b476-7837b837c793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c58e92b13bf4362bfafbb36d9d91d2d', 'request_id': 'req-4d79f3a2-60e5-452e-b476-7837b837c793'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:25.289012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4d79f3a2-60e5-452e-b476-7837b837c793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c58e92b13bf4362bfafbb36d9d91d2d', 'request_id': 'req-4d79f3a2-60e5-452e-b476-7837b837c793'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:25.413022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4d79f3a2-60e5-452e-b476-7837b837c793 admin admin] The token cache is being invalidate because project 8c58e92b13bf4362bfafbb36d9d91d2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:54:25.413324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4d79f3a2-60e5-452e-b476-7837b837c793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:25.414020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4d79f3a2-60e5-452e-b476-7837b837c793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:25.416262 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3658/7324] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:54:24 2022] DELETE /identity/v3/projects/8c58e92b13bf4362bfafbb36d9d91d2d => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:54:25.422225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20759485-3595-41c9-b418-cf2b004edc91 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:25.424321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-20759485-3595-41c9-b418-cf2b004edc91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:25.456025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20759485-3595-41c9-b418-cf2b004edc91 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:25.466517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:25.544150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:25.544328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda543d-10ba-4e38-b8fc-773391c96457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:25.545040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda543d-10ba-4e38-b8fc-773391c96457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:25.545189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda543d-10ba-4e38-b8fc-773391c96457 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:25.545475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda543d-10ba-4e38-b8fc-773391c96457 admin admin] PATH_INFO: `/v3/users/2ed103cd45574e09834ef75e1c643268` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:25.547554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda543d-10ba-4e38-b8fc-773391c96457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ed103cd45574e09834ef75e1c643268)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:25.566342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda543d-10ba-4e38-b8fc-773391c96457 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:25.745292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79f3a2-60e5-452e-b476-7837b837c793 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:25.746606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4d79f3a2-60e5-452e-b476-7837b837c793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:25.902609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79f3a2-60e5-452e-b476-7837b837c793 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:25.910369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbff63-27bd-49da-a1f4-4f85809936b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:25.911282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbff63-27bd-49da-a1f4-4f85809936b3 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:25.911797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbff63-27bd-49da-a1f4-4f85809936b3 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:25.912265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbff63-27bd-49da-a1f4-4f85809936b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:25.914502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-56dbff63-27bd-49da-a1f4-4f85809936b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:25.938614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbff63-27bd-49da-a1f4-4f85809936b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:25.940933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbff63-27bd-49da-a1f4-4f85809936b3 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:25.966509 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3659/7325] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:54:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:54:25.976849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bbda543d-10ba-4e38-b8fc-773391c96457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ed103cd45574e09834ef75e1c643268'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:25.981472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bbda543d-10ba-4e38-b8fc-773391c96457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ed103cd45574e09834ef75e1c643268'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:26.011523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bbda543d-10ba-4e38-b8fc-773391c96457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ed103cd45574e09834ef75e1c643268'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:26.026810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bbda543d-10ba-4e38-b8fc-773391c96457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ed103cd45574e09834ef75e1c643268'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:26.170369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bbda543d-10ba-4e38-b8fc-773391c96457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ed103cd45574e09834ef75e1c643268'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:26.188704 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3667/7326] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:54:25 2022] DELETE /identity/v3/users/2ed103cd45574e09834ef75e1c643268 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:54:27.510228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbff63-27bd-49da-a1f4-4f85809936b3 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:27.526811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-56dbff63-27bd-49da-a1f4-4f85809936b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:27.590726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbff63-27bd-49da-a1f4-4f85809936b3 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:27.838423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c35ba-86fd-4715-bf54-e8f890a93f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:27.839097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c35ba-86fd-4715-bf54-e8f890a93f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:27.849490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c35ba-86fd-4715-bf54-e8f890a93f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:27.849490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c35ba-86fd-4715-bf54-e8f890a93f9e admin admin] PATH_INFO: `/v3/projects/3b03cea0184c4d3dbaf844794f27cb8d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:27.849490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c35ba-86fd-4715-bf54-e8f890a93f9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b03cea0184c4d3dbaf844794f27cb8d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:27.855676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c35ba-86fd-4715-bf54-e8f890a93f9e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:27.929655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:28.123955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1f6c35ba-86fd-4715-bf54-e8f890a93f9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b03cea0184c4d3dbaf844794f27cb8d', 'request_id': 'req-1f6c35ba-86fd-4715-bf54-e8f890a93f9e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:28.132876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1f6c35ba-86fd-4715-bf54-e8f890a93f9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b03cea0184c4d3dbaf844794f27cb8d', 'request_id': 'req-1f6c35ba-86fd-4715-bf54-e8f890a93f9e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:28.142899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1f6c35ba-86fd-4715-bf54-e8f890a93f9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b03cea0184c4d3dbaf844794f27cb8d', 'request_id': 'req-1f6c35ba-86fd-4715-bf54-e8f890a93f9e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:28.254433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1f6c35ba-86fd-4715-bf54-e8f890a93f9e admin admin] The token cache is being invalidate because project 3b03cea0184c4d3dbaf844794f27cb8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:54:28.255102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1f6c35ba-86fd-4715-bf54-e8f890a93f9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:28.260136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1f6c35ba-86fd-4715-bf54-e8f890a93f9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:28.267796 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3660/7327] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:54:27 2022] DELETE /identity/v3/projects/3b03cea0184c4d3dbaf844794f27cb8d => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:54:28.269905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dffa9f-cac2-4827-9419-7030845baf30 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:28.270904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dffa9f-cac2-4827-9419-7030845baf30 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:28.271387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dffa9f-cac2-4827-9419-7030845baf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:28.309781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-82dffa9f-cac2-4827-9419-7030845baf30 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:54:28.323641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-82dffa9f-cac2-4827-9419-7030845baf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:28.418766 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3668/7328] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:54:28.435214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b15466-145b-4a6c-be1a-e40c6e94259f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:28.436990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b15466-145b-4a6c-be1a-e40c6e94259f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:28.437267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b15466-145b-4a6c-be1a-e40c6e94259f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:28.491813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-37b15466-145b-4a6c-be1a-e40c6e94259f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:54:28.497210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-37b15466-145b-4a6c-be1a-e40c6e94259f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:28.542626 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3661/7329] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:54:28.556742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dffa9f-cac2-4827-9419-7030845baf30 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:28.569918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dffa9f-cac2-4827-9419-7030845baf30 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:28.577327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ba3be-048f-4a72-bf71-76b04d96b080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:28.578208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ba3be-048f-4a72-bf71-76b04d96b080 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:28.578669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ba3be-048f-4a72-bf71-76b04d96b080 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:28.579099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ba3be-048f-4a72-bf71-76b04d96b080 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:28.580779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ba3be-048f-4a72-bf71-76b04d96b080 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:54:28.581466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ba3be-048f-4a72-bf71-76b04d96b080 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:28.583804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ba3be-048f-4a72-bf71-76b04d96b080 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:28.598668 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3669/7330] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:54:28.603853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b15466-145b-4a6c-be1a-e40c6e94259f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:28.616999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b15466-145b-4a6c-be1a-e40c6e94259f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:28.635659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d22ed3-6654-4dad-9e85-82e5c000a79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:28.636447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d22ed3-6654-4dad-9e85-82e5c000a79c admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:28.636729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d22ed3-6654-4dad-9e85-82e5c000a79c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:28.637008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d22ed3-6654-4dad-9e85-82e5c000a79c admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:28.637693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d22ed3-6654-4dad-9e85-82e5c000a79c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:28.639929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d22ed3-6654-4dad-9e85-82e5c000a79c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:28.896148 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3662/7331] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:54:28 2022] POST /identity/v3/projects => generated 381 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:54:28.897825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ba3be-048f-4a72-bf71-76b04d96b080 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:28.910981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ba3be-048f-4a72-bf71-76b04d96b080 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:28.928945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:29.108295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036e015-ea95-460d-908c-b7e94afa7c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:29.108959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036e015-ea95-460d-908c-b7e94afa7c70 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:29.109241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036e015-ea95-460d-908c-b7e94afa7c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:29.109624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036e015-ea95-460d-908c-b7e94afa7c70 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:29.110364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036e015-ea95-460d-908c-b7e94afa7c70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:29.113059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036e015-ea95-460d-908c-b7e94afa7c70 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:29.235411 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3670/7332] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:54:28 2022] POST /identity/v3/users => generated 291 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:54:29.239363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d22ed3-6654-4dad-9e85-82e5c000a79c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:29.267750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d22ed3-6654-4dad-9e85-82e5c000a79c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:29.284276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f042d6-4d83-40c9-b6e0-ef0ccde60126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:29.285310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f042d6-4d83-40c9-b6e0-ef0ccde60126 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:29.285568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f042d6-4d83-40c9-b6e0-ef0ccde60126 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:29.286082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f042d6-4d83-40c9-b6e0-ef0ccde60126 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:29.286861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f042d6-4d83-40c9-b6e0-ef0ccde60126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:29.288733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f042d6-4d83-40c9-b6e0-ef0ccde60126 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:29.312558 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3663/7333] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:54:29.316901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036e015-ea95-460d-908c-b7e94afa7c70 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:29.332805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036e015-ea95-460d-908c-b7e94afa7c70 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:29.340551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c34a3a-6703-489c-adcc-c1be6042e818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:29.342099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c34a3a-6703-489c-adcc-c1be6042e818 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:29.342775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c34a3a-6703-489c-adcc-c1be6042e818 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:29.343414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c34a3a-6703-489c-adcc-c1be6042e818 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:29.344907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c34a3a-6703-489c-adcc-c1be6042e818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:29.348899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c34a3a-6703-489c-adcc-c1be6042e818 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:29.364193 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3671/7334] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:54:29.368822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f042d6-4d83-40c9-b6e0-ef0ccde60126 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:29.385218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f042d6-4d83-40c9-b6e0-ef0ccde60126 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:29.386954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2b424-e201-49dc-b932-b72d855ad7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:29.388153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2b424-e201-49dc-b932-b72d855ad7fa admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:29.388437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2b424-e201-49dc-b932-b72d855ad7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:29.388934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2b424-e201-49dc-b932-b72d855ad7fa admin admin] PATH_INFO: `/v3/projects/eb9a8b3536fd4dd5945d3f2a69b0ecf2/users/7b72c879647e4a4db86fe70d5594470d/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:29.409277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2b424-e201-49dc-b932-b72d855ad7fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9a8b3536fd4dd5945d3f2a69b0ecf2, user_id=7b72c879647e4a4db86fe70d5594470d, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:29.412836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2b424-e201-49dc-b932-b72d855ad7fa admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:29.519103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcfb27-ea8e-4d5f-97e5-fbefa675cd75 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:29.519378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcfb27-ea8e-4d5f-97e5-fbefa675cd75 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:29.534826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcfb27-ea8e-4d5f-97e5-fbefa675cd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:29.535468 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3664/7335] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:54:29 2022] PUT /identity/v3/projects/eb9a8b3536fd4dd5945d3f2a69b0ecf2/users/7b72c879647e4a4db86fe70d5594470d/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:54:29.587923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1cdcfb27-ea8e-4d5f-97e5-fbefa675cd75 None None] MFA Rules not processed for user `7b72c879647e4a4db86fe70d5594470d`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:54:29.589836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1cdcfb27-ea8e-4d5f-97e5-fbefa675cd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:29.763135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2b424-e201-49dc-b932-b72d855ad7fa admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:29.763709 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3672/7336] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:54:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:54:29.903234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2b424-e201-49dc-b932-b72d855ad7fa admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:29.914984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1c6fc-53e3-410e-a163-3d2a625c7d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:29.915735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1c6fc-53e3-410e-a163-3d2a625c7d4c admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:29.915956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1c6fc-53e3-410e-a163-3d2a625c7d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:29.918844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1c6fc-53e3-410e-a163-3d2a625c7d4c admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:29.919564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1c6fc-53e3-410e-a163-3d2a625c7d4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:29.922289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1c6fc-53e3-410e-a163-3d2a625c7d4c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:30.025599 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3665/7337] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:54:29 2022] POST /identity/v3/projects => generated 381 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:54:30.030141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcfb27-ea8e-4d5f-97e5-fbefa675cd75 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:30.052230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcfb27-ea8e-4d5f-97e5-fbefa675cd75 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:30.169630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1930a3-ae84-46c7-8000-99d54e3f9848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:30.169880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1930a3-ae84-46c7-8000-99d54e3f9848 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:30.170415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1930a3-ae84-46c7-8000-99d54e3f9848 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:30.170702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1930a3-ae84-46c7-8000-99d54e3f9848 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:30.171801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1930a3-ae84-46c7-8000-99d54e3f9848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:30.174495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1930a3-ae84-46c7-8000-99d54e3f9848 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:30.322627 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3673/7338] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:54:30 2022] POST /identity/v3/users => generated 297 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:54:30.327480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1c6fc-53e3-410e-a163-3d2a625c7d4c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:30.346747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1c6fc-53e3-410e-a163-3d2a625c7d4c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:30.351980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8c849-460e-4c00-88fa-c37e0d88e902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:30.352671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8c849-460e-4c00-88fa-c37e0d88e902 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:30.352960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8c849-460e-4c00-88fa-c37e0d88e902 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:30.353241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8c849-460e-4c00-88fa-c37e0d88e902 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:30.353897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8c849-460e-4c00-88fa-c37e0d88e902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:30.355710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8c849-460e-4c00-88fa-c37e0d88e902 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:30.369143 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3666/7339] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:54:30.373792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1930a3-ae84-46c7-8000-99d54e3f9848 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:30.385499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1930a3-ae84-46c7-8000-99d54e3f9848 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:30.400407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564bd0f-4b6e-4715-89a0-f3a44eb060fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:30.403759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564bd0f-4b6e-4715-89a0-f3a44eb060fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:30.403759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564bd0f-4b6e-4715-89a0-f3a44eb060fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:30.403759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564bd0f-4b6e-4715-89a0-f3a44eb060fe admin admin] PATH_INFO: `/v3/projects/df4d0acde2624b9f80729d4f00fb260e/users/da6a7857fd4a4ab7be99ff2ed8554fb4/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:30.435839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564bd0f-4b6e-4715-89a0-f3a44eb060fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4d0acde2624b9f80729d4f00fb260e, user_id=da6a7857fd4a4ab7be99ff2ed8554fb4, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:30.439429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564bd0f-4b6e-4715-89a0-f3a44eb060fe admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:30.547553 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3674/7340] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:54:30 2022] PUT /identity/v3/projects/df4d0acde2624b9f80729d4f00fb260e/users/da6a7857fd4a4ab7be99ff2ed8554fb4/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:54:30.552160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8c849-460e-4c00-88fa-c37e0d88e902 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:30.565733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8c849-460e-4c00-88fa-c37e0d88e902 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:30.739839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543763f-27c9-46e4-b865-578e296cc175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:30.740486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543763f-27c9-46e4-b865-578e296cc175 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:30.740770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543763f-27c9-46e4-b865-578e296cc175 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:30.741047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543763f-27c9-46e4-b865-578e296cc175 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:30.741873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543763f-27c9-46e4-b865-578e296cc175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:30.743814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543763f-27c9-46e4-b865-578e296cc175 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:30.775155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:30.777631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564bd0f-4b6e-4715-89a0-f3a44eb060fe admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:30.778576 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3667/7341] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:54:30.789073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564bd0f-4b6e-4715-89a0-f3a44eb060fe admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:30.802306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98580657-bbac-40c6-a8e9-4501355a5380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:30.803466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98580657-bbac-40c6-a8e9-4501355a5380 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:30.803466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98580657-bbac-40c6-a8e9-4501355a5380 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:30.803685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98580657-bbac-40c6-a8e9-4501355a5380 admin admin] PATH_INFO: `/v3/projects/df4d0acde2624b9f80729d4f00fb260e/users/da6a7857fd4a4ab7be99ff2ed8554fb4/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:30.807544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98580657-bbac-40c6-a8e9-4501355a5380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4d0acde2624b9f80729d4f00fb260e, user_id=da6a7857fd4a4ab7be99ff2ed8554fb4, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:30.810265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98580657-bbac-40c6-a8e9-4501355a5380 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:30.845791 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3675/7342] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:54:30 2022] PUT /identity/v3/projects/df4d0acde2624b9f80729d4f00fb260e/users/da6a7857fd4a4ab7be99ff2ed8554fb4/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:54:30.850883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb59b88-1a80-460b-9d69-be560547d58a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:30.851544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb59b88-1a80-460b-9d69-be560547d58a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:30.852157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb59b88-1a80-460b-9d69-be560547d58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:30.907812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-5bb59b88-1a80-460b-9d69-be560547d58a None None] MFA Rules not processed for user `da6a7857fd4a4ab7be99ff2ed8554fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:54:30.911079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5bb59b88-1a80-460b-9d69-be560547d58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:31.008018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:31.117288 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3668/7343] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:54:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:54:31.129188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98580657-bbac-40c6-a8e9-4501355a5380 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:31.132453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-98580657-bbac-40c6-a8e9-4501355a5380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:31.250729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98580657-bbac-40c6-a8e9-4501355a5380 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:31.260451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266f508-f5a8-4291-9aaa-447f4e893f2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:31.261267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266f508-f5a8-4291-9aaa-447f4e893f2a service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:31.261553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266f508-f5a8-4291-9aaa-447f4e893f2a service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:31.265084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266f508-f5a8-4291-9aaa-447f4e893f2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:31.399585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266f508-f5a8-4291-9aaa-447f4e893f2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:31.401611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266f508-f5a8-4291-9aaa-447f4e893f2a service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:31.414324 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3676/7344] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:54:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:54:41.272423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb59b88-1a80-460b-9d69-be560547d58a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:41.274605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5bb59b88-1a80-460b-9d69-be560547d58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:41.367433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb59b88-1a80-460b-9d69-be560547d58a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:41.379221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6e1a0-529f-4bc5-ac07-a49611f572cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:41.380403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6e1a0-529f-4bc5-ac07-a49611f572cc service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:41.380923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6e1a0-529f-4bc5-ac07-a49611f572cc service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:41.381463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6e1a0-529f-4bc5-ac07-a49611f572cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:41.383696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7ad6e1a0-529f-4bc5-ac07-a49611f572cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:41.444439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6e1a0-529f-4bc5-ac07-a49611f572cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:41.447980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6e1a0-529f-4bc5-ac07-a49611f572cc service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:41.497625 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3669/7345] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:54:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:54:42.060241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=56,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:43.350529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266f508-f5a8-4291-9aaa-447f4e893f2a service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:43.354174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c266f508-f5a8-4291-9aaa-447f4e893f2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:43.440399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266f508-f5a8-4291-9aaa-447f4e893f2a service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:43.448582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af681f8-fe78-4bcc-8972-2befbb26de95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:43.449655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af681f8-fe78-4bcc-8972-2befbb26de95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:43.450242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af681f8-fe78-4bcc-8972-2befbb26de95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:43.450724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af681f8-fe78-4bcc-8972-2befbb26de95 admin admin] PATH_INFO: `/v3/users/85cc9c47e5014d1492f9a69d32fabcf4` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:43.455702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af681f8-fe78-4bcc-8972-2befbb26de95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85cc9c47e5014d1492f9a69d32fabcf4)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:43.458854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af681f8-fe78-4bcc-8972-2befbb26de95 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:43.747042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6af681f8-fe78-4bcc-8972-2befbb26de95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85cc9c47e5014d1492f9a69d32fabcf4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:43.749447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6af681f8-fe78-4bcc-8972-2befbb26de95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85cc9c47e5014d1492f9a69d32fabcf4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:43.774492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6af681f8-fe78-4bcc-8972-2befbb26de95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85cc9c47e5014d1492f9a69d32fabcf4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:43.805003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6af681f8-fe78-4bcc-8972-2befbb26de95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85cc9c47e5014d1492f9a69d32fabcf4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:43.915289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6af681f8-fe78-4bcc-8972-2befbb26de95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85cc9c47e5014d1492f9a69d32fabcf4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:43.923384 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3677/7346] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:54:43 2022] DELETE /identity/v3/users/85cc9c47e5014d1492f9a69d32fabcf4 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:54:43.927959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6b1b1-62f7-4fe1-92cf-3cb2318c7c15 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:43.928852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6b1b1-62f7-4fe1-92cf-3cb2318c7c15 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:43.929307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6b1b1-62f7-4fe1-92cf-3cb2318c7c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:43.965842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e6c6b1b1-62f7-4fe1-92cf-3cb2318c7c15 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:54:43.970675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e6c6b1b1-62f7-4fe1-92cf-3cb2318c7c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:44.025188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:44.102600 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3670/7347] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:54:44.110590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af681f8-fe78-4bcc-8972-2befbb26de95 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:44.112530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6af681f8-fe78-4bcc-8972-2befbb26de95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:44.263340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af681f8-fe78-4bcc-8972-2befbb26de95 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:44.270648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ff3e0-d216-4594-96ff-81dde98b86fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:44.271400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ff3e0-d216-4594-96ff-81dde98b86fe service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:44.271749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ff3e0-d216-4594-96ff-81dde98b86fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:44.272097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ff3e0-d216-4594-96ff-81dde98b86fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:44.286358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ff3e0-d216-4594-96ff-81dde98b86fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:44.289103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ff3e0-d216-4594-96ff-81dde98b86fe service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:44.305798 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3678/7348] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:54:45.530396 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6b1b1-62f7-4fe1-92cf-3cb2318c7c15 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:45.532473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e6c6b1b1-62f7-4fe1-92cf-3cb2318c7c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:45.554091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6b1b1-62f7-4fe1-92cf-3cb2318c7c15 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:45.577220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639d4ec-fb41-46f9-aece-5af9a4506c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:45.581941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639d4ec-fb41-46f9-aece-5af9a4506c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:45.582305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639d4ec-fb41-46f9-aece-5af9a4506c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:45.582599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639d4ec-fb41-46f9-aece-5af9a4506c9a admin admin] PATH_INFO: `/v3/projects/8a582cd691904ae6992be60ad7947ebb` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:45.584091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639d4ec-fb41-46f9-aece-5af9a4506c9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a582cd691904ae6992be60ad7947ebb)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:45.586049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639d4ec-fb41-46f9-aece-5af9a4506c9a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:45.746448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6639d4ec-fb41-46f9-aece-5af9a4506c9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a582cd691904ae6992be60ad7947ebb', 'request_id': 'req-6639d4ec-fb41-46f9-aece-5af9a4506c9a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:45.753858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6639d4ec-fb41-46f9-aece-5af9a4506c9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a582cd691904ae6992be60ad7947ebb', 'request_id': 'req-6639d4ec-fb41-46f9-aece-5af9a4506c9a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:45.760647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6639d4ec-fb41-46f9-aece-5af9a4506c9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a582cd691904ae6992be60ad7947ebb', 'request_id': 'req-6639d4ec-fb41-46f9-aece-5af9a4506c9a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:45.869778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6639d4ec-fb41-46f9-aece-5af9a4506c9a admin admin] The token cache is being invalidate because project 8a582cd691904ae6992be60ad7947ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:54:45.870132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6639d4ec-fb41-46f9-aece-5af9a4506c9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:45.870835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6639d4ec-fb41-46f9-aece-5af9a4506c9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:54:45.872390 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3671/7349] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:54:45 2022] DELETE /identity/v3/projects/8a582cd691904ae6992be60ad7947ebb => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:54:45.878080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5bfaa-89db-4263-9f3d-33fd5e31e399 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:45.878639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5bfaa-89db-4263-9f3d-33fd5e31e399 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:45.878639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5bfaa-89db-4263-9f3d-33fd5e31e399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:45.902659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1cf5bfaa-89db-4263-9f3d-33fd5e31e399 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:54:45.903935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1cf5bfaa-89db-4263-9f3d-33fd5e31e399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:45.923975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:45.972498 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3679/7350] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:54:45.980027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ee169-5882-4fca-8a11-370ac9ea63b9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:45.982614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ee169-5882-4fca-8a11-370ac9ea63b9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:45.982923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ee169-5882-4fca-8a11-370ac9ea63b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:46.021153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a51ee169-5882-4fca-8a11-370ac9ea63b9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:54:46.023245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a51ee169-5882-4fca-8a11-370ac9ea63b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:46.034298 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3672/7351] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:54:46.037540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5bfaa-89db-4263-9f3d-33fd5e31e399 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:46.054967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5bfaa-89db-4263-9f3d-33fd5e31e399 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:46.060212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ffe8f-2cb6-446a-90b3-f0c0417c1cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:46.060849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ffe8f-2cb6-446a-90b3-f0c0417c1cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:46.061131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ffe8f-2cb6-446a-90b3-f0c0417c1cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:46.061408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ffe8f-2cb6-446a-90b3-f0c0417c1cc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:46.062347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ffe8f-2cb6-446a-90b3-f0c0417c1cc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:54:46.062988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ffe8f-2cb6-446a-90b3-f0c0417c1cc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:46.065191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ffe8f-2cb6-446a-90b3-f0c0417c1cc8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:46.082104 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3680/7352] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:54:46.084709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ee169-5882-4fca-8a11-370ac9ea63b9 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:46.115641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ee169-5882-4fca-8a11-370ac9ea63b9 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:46.128500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d64645-8b33-4d08-8d52-d2f784b87e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:46.129284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d64645-8b33-4d08-8d52-d2f784b87e1b admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:46.129688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d64645-8b33-4d08-8d52-d2f784b87e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:46.130085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d64645-8b33-4d08-8d52-d2f784b87e1b admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:46.130830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d64645-8b33-4d08-8d52-d2f784b87e1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:46.132877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d64645-8b33-4d08-8d52-d2f784b87e1b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:46.416664 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3673/7353] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:54:46 2022] POST /identity/v3/projects => generated 381 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:54:46.421557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ffe8f-2cb6-446a-90b3-f0c0417c1cc8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:46.434744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ffe8f-2cb6-446a-90b3-f0c0417c1cc8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:46.542957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04641c13-6746-42ed-82d9-366172fc20d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:46.543847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04641c13-6746-42ed-82d9-366172fc20d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:46.544229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04641c13-6746-42ed-82d9-366172fc20d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:46.544615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04641c13-6746-42ed-82d9-366172fc20d9 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:46.545340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04641c13-6746-42ed-82d9-366172fc20d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:46.548688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04641c13-6746-42ed-82d9-366172fc20d9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:46.695367 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3681/7354] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:54:46 2022] POST /identity/v3/users => generated 291 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:54:46.696656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d64645-8b33-4d08-8d52-d2f784b87e1b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:46.717903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d64645-8b33-4d08-8d52-d2f784b87e1b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:46.722763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc3852-1de3-4db3-9697-f3ecc283dfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:46.723688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc3852-1de3-4db3-9697-f3ecc283dfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:46.724211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc3852-1de3-4db3-9697-f3ecc283dfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:46.725521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc3852-1de3-4db3-9697-f3ecc283dfd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:46.726497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc3852-1de3-4db3-9697-f3ecc283dfd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:46.730658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc3852-1de3-4db3-9697-f3ecc283dfd2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:46.745495 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3674/7355] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:54:46.749852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04641c13-6746-42ed-82d9-366172fc20d9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:46.771783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04641c13-6746-42ed-82d9-366172fc20d9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:46.777111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f2fa0-79c5-4df4-ad12-3440a12bb5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:46.777812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f2fa0-79c5-4df4-ad12-3440a12bb5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:46.778212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f2fa0-79c5-4df4-ad12-3440a12bb5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:46.778565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f2fa0-79c5-4df4-ad12-3440a12bb5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:46.779295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f2fa0-79c5-4df4-ad12-3440a12bb5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:46.780989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f2fa0-79c5-4df4-ad12-3440a12bb5a1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:46.797233 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3682/7356] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:54:46.801620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc3852-1de3-4db3-9697-f3ecc283dfd2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:46.820856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc3852-1de3-4db3-9697-f3ecc283dfd2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:46.827232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5ef27-6761-46b4-bdeb-7d3a734de03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:46.828237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5ef27-6761-46b4-bdeb-7d3a734de03e admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:46.828797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5ef27-6761-46b4-bdeb-7d3a734de03e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:46.829288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5ef27-6761-46b4-bdeb-7d3a734de03e admin admin] PATH_INFO: `/v3/projects/3c2a3e4f2abb492d96086efdb160fec9/users/e202f23abb3c4489a239360957e18d1d/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:46.848794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5ef27-6761-46b4-bdeb-7d3a734de03e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c2a3e4f2abb492d96086efdb160fec9, user_id=e202f23abb3c4489a239360957e18d1d, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:46.852704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5ef27-6761-46b4-bdeb-7d3a734de03e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:46.962734 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3675/7357] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:54:46 2022] PUT /identity/v3/projects/3c2a3e4f2abb492d96086efdb160fec9/users/e202f23abb3c4489a239360957e18d1d/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:54:46.972852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fee0ec-30e4-4575-9ed9-33dcbc56d756 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:46.973391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fee0ec-30e4-4575-9ed9-33dcbc56d756 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:46.973391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fee0ec-30e4-4575-9ed9-33dcbc56d756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:47.018930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b5fee0ec-30e4-4575-9ed9-33dcbc56d756 None None] MFA Rules not processed for user `e202f23abb3c4489a239360957e18d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:54:47.020411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b5fee0ec-30e4-4575-9ed9-33dcbc56d756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:47.153005 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3683/7358] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:54:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:54:47.154075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5ef27-6761-46b4-bdeb-7d3a734de03e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:47.227336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fee0ec-30e4-4575-9ed9-33dcbc56d756 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:47.228845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b5fee0ec-30e4-4575-9ed9-33dcbc56d756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:47.244614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:47.286209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5ef27-6761-46b4-bdeb-7d3a734de03e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:47.293033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36775176-2527-4feb-874f-32afa03c5540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:47.293937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36775176-2527-4feb-874f-32afa03c5540 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:47.294321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36775176-2527-4feb-874f-32afa03c5540 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:47.294720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36775176-2527-4feb-874f-32afa03c5540 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:47.295474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36775176-2527-4feb-874f-32afa03c5540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:47.297907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36775176-2527-4feb-874f-32afa03c5540 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:47.329841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:47.424656 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3676/7359] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:54:47 2022] POST /identity/v3/projects => generated 381 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:54:47.435484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36775176-2527-4feb-874f-32afa03c5540 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:47.448413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fee0ec-30e4-4575-9ed9-33dcbc56d756 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:47.553772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36775176-2527-4feb-874f-32afa03c5540 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:47.560516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2caf80-6d00-4517-b455-69933d5ac519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:47.561217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2caf80-6d00-4517-b455-69933d5ac519 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:47.561771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2caf80-6d00-4517-b455-69933d5ac519 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:47.561911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2caf80-6d00-4517-b455-69933d5ac519 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:47.562552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2caf80-6d00-4517-b455-69933d5ac519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:47.564721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2caf80-6d00-4517-b455-69933d5ac519 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:47.633467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08260c58-cc70-4887-a67e-bdbf413f781d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:47.633467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08260c58-cc70-4887-a67e-bdbf413f781d service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:47.635733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08260c58-cc70-4887-a67e-bdbf413f781d service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:47.635733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08260c58-cc70-4887-a67e-bdbf413f781d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:47.638690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-08260c58-cc70-4887-a67e-bdbf413f781d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:47.694291 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3677/7360] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:54:47 2022] POST /identity/v3/users => generated 297 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:54:47.697762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2caf80-6d00-4517-b455-69933d5ac519 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:47.718900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2caf80-6d00-4517-b455-69933d5ac519 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:47.736686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28271b2b-f333-4c81-bbf5-bdab4ded0144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:47.737457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08260c58-cc70-4887-a67e-bdbf413f781d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:47.737912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28271b2b-f333-4c81-bbf5-bdab4ded0144 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:47.738621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28271b2b-f333-4c81-bbf5-bdab4ded0144 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:47.739096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28271b2b-f333-4c81-bbf5-bdab4ded0144 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:47.740169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08260c58-cc70-4887-a67e-bdbf413f781d service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:47.740941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28271b2b-f333-4c81-bbf5-bdab4ded0144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:47.745840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28271b2b-f333-4c81-bbf5-bdab4ded0144 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:47.769222 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3678/7361] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:54:47.773771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28271b2b-f333-4c81-bbf5-bdab4ded0144 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:47.783545 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3684/7362] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:54:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:54:47.802450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28271b2b-f333-4c81-bbf5-bdab4ded0144 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:47.818649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7689f-fac0-4309-b69a-94dfca52fa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:47.820567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7689f-fac0-4309-b69a-94dfca52fa22 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:47.820567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7689f-fac0-4309-b69a-94dfca52fa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:47.820567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7689f-fac0-4309-b69a-94dfca52fa22 admin admin] PATH_INFO: `/v3/projects/e3f5002b97164951ba7d6fc4d48a9735/users/e41d5db4094242d6a8e5c0b3dd467af4/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:47.854608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7689f-fac0-4309-b69a-94dfca52fa22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3f5002b97164951ba7d6fc4d48a9735, user_id=e41d5db4094242d6a8e5c0b3dd467af4, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:47.863402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7689f-fac0-4309-b69a-94dfca52fa22 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:47.970707 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3679/7363] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:54:47 2022] PUT /identity/v3/projects/e3f5002b97164951ba7d6fc4d48a9735/users/e41d5db4094242d6a8e5c0b3dd467af4/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:54:47.975282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08260c58-cc70-4887-a67e-bdbf413f781d service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:47.989713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08260c58-cc70-4887-a67e-bdbf413f781d service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:48.082889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab264e9-6824-461d-80e6-4d662f2c9907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:48.082889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab264e9-6824-461d-80e6-4d662f2c9907 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:48.082889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab264e9-6824-461d-80e6-4d662f2c9907 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:48.082889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab264e9-6824-461d-80e6-4d662f2c9907 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:48.083463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab264e9-6824-461d-80e6-4d662f2c9907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:48.083551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab264e9-6824-461d-80e6-4d662f2c9907 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:48.095593 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3685/7364] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:54:48.099825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7689f-fac0-4309-b69a-94dfca52fa22 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:48.111886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7689f-fac0-4309-b69a-94dfca52fa22 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:48.116680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2add8-7a8f-4346-8844-1335cff7e67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:48.117504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2add8-7a8f-4346-8844-1335cff7e67c admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:48.117787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2add8-7a8f-4346-8844-1335cff7e67c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:48.118091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2add8-7a8f-4346-8844-1335cff7e67c admin admin] PATH_INFO: `/v3/projects/e3f5002b97164951ba7d6fc4d48a9735/users/e41d5db4094242d6a8e5c0b3dd467af4/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:48.120074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2add8-7a8f-4346-8844-1335cff7e67c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3f5002b97164951ba7d6fc4d48a9735, user_id=e41d5db4094242d6a8e5c0b3dd467af4, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:48.122803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2add8-7a8f-4346-8844-1335cff7e67c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:48.140379 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3680/7365] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:54:48 2022] PUT /identity/v3/projects/e3f5002b97164951ba7d6fc4d48a9735/users/e41d5db4094242d6a8e5c0b3dd467af4/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:54:48.145888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c515b-8520-40d1-baca-b0575f8af042 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:48.146204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c515b-8520-40d1-baca-b0575f8af042 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:48.146483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c515b-8520-40d1-baca-b0575f8af042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:48.186887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-bf1c515b-8520-40d1-baca-b0575f8af042 None None] MFA Rules not processed for user `e41d5db4094242d6a8e5c0b3dd467af4`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:54:48.188376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bf1c515b-8520-40d1-baca-b0575f8af042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:48.292244 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3686/7366] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:54:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:54:48.431836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2add8-7a8f-4346-8844-1335cff7e67c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:48.433840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0ca2add8-7a8f-4346-8844-1335cff7e67c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:48.447104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:48.510786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2add8-7a8f-4346-8844-1335cff7e67c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:48.515197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f226da9-db0b-4cd8-9848-5db2bb5f06eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:48.516095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f226da9-db0b-4cd8-9848-5db2bb5f06eb service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:48.516562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f226da9-db0b-4cd8-9848-5db2bb5f06eb service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:48.516944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f226da9-db0b-4cd8-9848-5db2bb5f06eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:48.527564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f226da9-db0b-4cd8-9848-5db2bb5f06eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:48.529169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f226da9-db0b-4cd8-9848-5db2bb5f06eb service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:48.543757 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3681/7367] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:54:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:54:48.810827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c515b-8520-40d1-baca-b0575f8af042 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:54:48.812459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bf1c515b-8520-40d1-baca-b0575f8af042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:54:48.844424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c515b-8520-40d1-baca-b0575f8af042 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:54:48.857946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66239221-a160-43ad-8b49-ac90d4df0189 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:54:48.858435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66239221-a160-43ad-8b49-ac90d4df0189 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:54:48.858822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66239221-a160-43ad-8b49-ac90d4df0189 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:54:48.863489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66239221-a160-43ad-8b49-ac90d4df0189 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:54:49.024697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66239221-a160-43ad-8b49-ac90d4df0189 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:54:49.028641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66239221-a160-43ad-8b49-ac90d4df0189 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:54:49.041871 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3687/7368] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:54:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:54:58.720373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=86,keystone:INSERT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:59.036449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=72 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:05.767330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f226da9-db0b-4cd8-9848-5db2bb5f06eb service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:05.769172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9f226da9-db0b-4cd8-9848-5db2bb5f06eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:05.915516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f226da9-db0b-4cd8-9848-5db2bb5f06eb service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:05.919415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376ddd9-201d-4133-b059-a565437e70d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:05.920832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376ddd9-201d-4133-b059-a565437e70d4 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:05.922702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376ddd9-201d-4133-b059-a565437e70d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:05.924620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376ddd9-201d-4133-b059-a565437e70d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:05.931234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a376ddd9-201d-4133-b059-a565437e70d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:06.087296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376ddd9-201d-4133-b059-a565437e70d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:06.088824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376ddd9-201d-4133-b059-a565437e70d4 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:06.107197 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3682/7369] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:55:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:55:07.390302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66239221-a160-43ad-8b49-ac90d4df0189 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:07.392344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-66239221-a160-43ad-8b49-ac90d4df0189 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:07.781011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66239221-a160-43ad-8b49-ac90d4df0189 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:07.788856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49439803-d1c0-4ddf-a364-850e64f7f284 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:07.789154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49439803-d1c0-4ddf-a364-850e64f7f284 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:07.789671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49439803-d1c0-4ddf-a364-850e64f7f284 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:07.790148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49439803-d1c0-4ddf-a364-850e64f7f284 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:07.792327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-49439803-d1c0-4ddf-a364-850e64f7f284 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:07.838087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49439803-d1c0-4ddf-a364-850e64f7f284 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:07.851091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49439803-d1c0-4ddf-a364-850e64f7f284 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:07.902619 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3688/7370] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:55:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:55:08.899550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376ddd9-201d-4133-b059-a565437e70d4 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:08.901587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a376ddd9-201d-4133-b059-a565437e70d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:08.935887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376ddd9-201d-4133-b059-a565437e70d4 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:08.955557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81943779-2d9c-43f7-afb4-530626287394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:08.956242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81943779-2d9c-43f7-afb4-530626287394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:08.956526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81943779-2d9c-43f7-afb4-530626287394 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:08.956804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81943779-2d9c-43f7-afb4-530626287394 admin admin] PATH_INFO: `/v3/users/66ba627e73834b84b1ee6514e1facd1c` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:08.968030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81943779-2d9c-43f7-afb4-530626287394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66ba627e73834b84b1ee6514e1facd1c)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:08.970866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81943779-2d9c-43f7-afb4-530626287394 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:09.270122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-81943779-2d9c-43f7-afb4-530626287394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66ba627e73834b84b1ee6514e1facd1c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:09.271038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-81943779-2d9c-43f7-afb4-530626287394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66ba627e73834b84b1ee6514e1facd1c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:09.280723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-81943779-2d9c-43f7-afb4-530626287394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66ba627e73834b84b1ee6514e1facd1c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:09.295362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-81943779-2d9c-43f7-afb4-530626287394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66ba627e73834b84b1ee6514e1facd1c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:09.296663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-81943779-2d9c-43f7-afb4-530626287394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66ba627e73834b84b1ee6514e1facd1c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:09.398325 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3683/7371] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:55:08 2022] DELETE /identity/v3/users/66ba627e73834b84b1ee6514e1facd1c => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:09.565645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49439803-d1c0-4ddf-a364-850e64f7f284 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:09.583382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-49439803-d1c0-4ddf-a364-850e64f7f284 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:09.633460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49439803-d1c0-4ddf-a364-850e64f7f284 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:09.784695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed5e66-bca9-4e83-8cd1-96943094ff33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:09.785593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed5e66-bca9-4e83-8cd1-96943094ff33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:09.786085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed5e66-bca9-4e83-8cd1-96943094ff33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:09.786572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed5e66-bca9-4e83-8cd1-96943094ff33 admin admin] PATH_INFO: `/v3/users/4758a82a8fc549f28252bb3b5446d194` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:09.787939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed5e66-bca9-4e83-8cd1-96943094ff33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4758a82a8fc549f28252bb3b5446d194)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:09.790186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed5e66-bca9-4e83-8cd1-96943094ff33 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:10.161576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-73ed5e66-bca9-4e83-8cd1-96943094ff33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4758a82a8fc549f28252bb3b5446d194'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:10.164187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-73ed5e66-bca9-4e83-8cd1-96943094ff33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4758a82a8fc549f28252bb3b5446d194'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:10.210133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-73ed5e66-bca9-4e83-8cd1-96943094ff33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4758a82a8fc549f28252bb3b5446d194'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:10.297476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-73ed5e66-bca9-4e83-8cd1-96943094ff33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4758a82a8fc549f28252bb3b5446d194'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:10.425528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-73ed5e66-bca9-4e83-8cd1-96943094ff33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4758a82a8fc549f28252bb3b5446d194'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:10.437165 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3689/7372] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:55:09 2022] DELETE /identity/v3/users/4758a82a8fc549f28252bb3b5446d194 => generated 0 bytes in 872 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:10.442017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7e463-c375-4d3d-908c-72c0691929b3 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:10.442515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7e463-c375-4d3d-908c-72c0691929b3 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:10.442796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7e463-c375-4d3d-908c-72c0691929b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:10.493320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-fbb7e463-c375-4d3d-908c-72c0691929b3 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:10.497647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fbb7e463-c375-4d3d-908c-72c0691929b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:10.543002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:10.672898 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3684/7373] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:10.709679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed5e66-bca9-4e83-8cd1-96943094ff33 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:10.711336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-73ed5e66-bca9-4e83-8cd1-96943094ff33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:10.722710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:10.903469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed5e66-bca9-4e83-8cd1-96943094ff33 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:10.912814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d8c6a-f404-4c0c-8d14-4401a95a491a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:10.920205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d8c6a-f404-4c0c-8d14-4401a95a491a service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:10.920205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d8c6a-f404-4c0c-8d14-4401a95a491a service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:10.920205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d8c6a-f404-4c0c-8d14-4401a95a491a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:10.945566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d8c6a-f404-4c0c-8d14-4401a95a491a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:10.945566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d8c6a-f404-4c0c-8d14-4401a95a491a service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:10.969496 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3690/7374] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:55:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:55:11.029570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7e463-c375-4d3d-908c-72c0691929b3 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:11.031302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fbb7e463-c375-4d3d-908c-72c0691929b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:11.066569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7e463-c375-4d3d-908c-72c0691929b3 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:11.079521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d6954-57d8-46f1-aaa8-fe4d7720b3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:11.080432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d6954-57d8-46f1-aaa8-fe4d7720b3d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:11.080900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d6954-57d8-46f1-aaa8-fe4d7720b3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:11.081529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d6954-57d8-46f1-aaa8-fe4d7720b3d5 admin admin] PATH_INFO: `/v3/projects/aead91140df544faa492b8fd1952db8c` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:11.086789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d6954-57d8-46f1-aaa8-fe4d7720b3d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aead91140df544faa492b8fd1952db8c)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:11.092981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d6954-57d8-46f1-aaa8-fe4d7720b3d5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:11.349334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e16d6954-57d8-46f1-aaa8-fe4d7720b3d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aead91140df544faa492b8fd1952db8c', 'request_id': 'req-e16d6954-57d8-46f1-aaa8-fe4d7720b3d5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:11.357619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e16d6954-57d8-46f1-aaa8-fe4d7720b3d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aead91140df544faa492b8fd1952db8c', 'request_id': 'req-e16d6954-57d8-46f1-aaa8-fe4d7720b3d5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:11.364666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e16d6954-57d8-46f1-aaa8-fe4d7720b3d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aead91140df544faa492b8fd1952db8c', 'request_id': 'req-e16d6954-57d8-46f1-aaa8-fe4d7720b3d5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:11.499057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e16d6954-57d8-46f1-aaa8-fe4d7720b3d5 admin admin] The token cache is being invalidate because project aead91140df544faa492b8fd1952db8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:55:11.500524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e16d6954-57d8-46f1-aaa8-fe4d7720b3d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:11.500845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e16d6954-57d8-46f1-aaa8-fe4d7720b3d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:11.535046 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3685/7375] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:55:11 2022] DELETE /identity/v3/projects/aead91140df544faa492b8fd1952db8c => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:11.537872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d8c6a-f404-4c0c-8d14-4401a95a491a service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:11.538849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbba6f6-eaf2-493d-a4ad-67bff5e216b3 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:11.539470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbba6f6-eaf2-493d-a4ad-67bff5e216b3 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:11.539808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbba6f6-eaf2-493d-a4ad-67bff5e216b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:11.540313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7b3d8c6a-f404-4c0c-8d14-4401a95a491a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:11.563057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d8c6a-f404-4c0c-8d14-4401a95a491a service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:11.657789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7dbba6f6-eaf2-493d-a4ad-67bff5e216b3 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:11.659434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7dbba6f6-eaf2-493d-a4ad-67bff5e216b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:11.667136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327d1e2-4fbe-456c-a1fe-599a6ef7764c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:11.669048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327d1e2-4fbe-456c-a1fe-599a6ef7764c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:11.669476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327d1e2-4fbe-456c-a1fe-599a6ef7764c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:11.669611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327d1e2-4fbe-456c-a1fe-599a6ef7764c admin admin] PATH_INFO: `/v3/users/e202f23abb3c4489a239360957e18d1d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:11.674851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327d1e2-4fbe-456c-a1fe-599a6ef7764c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e202f23abb3c4489a239360957e18d1d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:11.678738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327d1e2-4fbe-456c-a1fe-599a6ef7764c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:11.755347 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3686/7376] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:11.755347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364b83c-48f5-4f43-9ba8-fe9ed096b743 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:11.755347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364b83c-48f5-4f43-9ba8-fe9ed096b743 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:11.755347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364b83c-48f5-4f43-9ba8-fe9ed096b743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:11.778328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a364b83c-48f5-4f43-9ba8-fe9ed096b743 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:11.779933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a364b83c-48f5-4f43-9ba8-fe9ed096b743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:11.809049 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3687/7377] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:11.810612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364b83c-48f5-4f43-9ba8-fe9ed096b743 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:11.833303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364b83c-48f5-4f43-9ba8-fe9ed096b743 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:11.850011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54032970-31e3-4b29-81c9-bc88e1c00384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:11.850845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54032970-31e3-4b29-81c9-bc88e1c00384 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:11.851970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54032970-31e3-4b29-81c9-bc88e1c00384 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:11.851970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54032970-31e3-4b29-81c9-bc88e1c00384 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:11.852769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54032970-31e3-4b29-81c9-bc88e1c00384 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:55:11.853191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54032970-31e3-4b29-81c9-bc88e1c00384 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:11.855201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54032970-31e3-4b29-81c9-bc88e1c00384 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:11.879584 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3688/7378] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:55:11.885416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54032970-31e3-4b29-81c9-bc88e1c00384 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:11.898908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54032970-31e3-4b29-81c9-bc88e1c00384 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:11.908286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a0d79-6dda-4ddf-9333-2ed5c0d0a29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:11.909085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a0d79-6dda-4ddf-9333-2ed5c0d0a29a admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:11.910066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a0d79-6dda-4ddf-9333-2ed5c0d0a29a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:11.910487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a0d79-6dda-4ddf-9333-2ed5c0d0a29a admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:11.911307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a0d79-6dda-4ddf-9333-2ed5c0d0a29a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:11.913705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a0d79-6dda-4ddf-9333-2ed5c0d0a29a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:12.114880 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3689/7379] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:55:11 2022] POST /identity/v3/projects => generated 365 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:55:12.116487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a0d79-6dda-4ddf-9333-2ed5c0d0a29a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:12.237064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1327d1e2-4fbe-456c-a1fe-599a6ef7764c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e202f23abb3c4489a239360957e18d1d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:12.243091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1327d1e2-4fbe-456c-a1fe-599a6ef7764c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e202f23abb3c4489a239360957e18d1d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:12.276810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1327d1e2-4fbe-456c-a1fe-599a6ef7764c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e202f23abb3c4489a239360957e18d1d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:12.322181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1327d1e2-4fbe-456c-a1fe-599a6ef7764c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e202f23abb3c4489a239360957e18d1d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:12.356694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a0d79-6dda-4ddf-9333-2ed5c0d0a29a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:12.371537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8d285-0efa-4352-9624-ef8eec89251d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:12.372459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8d285-0efa-4352-9624-ef8eec89251d admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:12.372909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8d285-0efa-4352-9624-ef8eec89251d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:12.373297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8d285-0efa-4352-9624-ef8eec89251d admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:12.374145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8d285-0efa-4352-9624-ef8eec89251d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:12.381332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8d285-0efa-4352-9624-ef8eec89251d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:12.412377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1327d1e2-4fbe-456c-a1fe-599a6ef7764c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e202f23abb3c4489a239360957e18d1d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:12.420885 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3691/7380] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:55:11 2022] DELETE /identity/v3/users/e202f23abb3c4489a239360957e18d1d => generated 0 bytes in 883 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:12.422638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327d1e2-4fbe-456c-a1fe-599a6ef7764c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:12.424364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1327d1e2-4fbe-456c-a1fe-599a6ef7764c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:12.546427 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3690/7381] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:55:12 2022] POST /identity/v3/users => generated 283 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:55:12.546427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4cae6-56c9-4a15-9d1f-1d9d996d29a0 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:12.546427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4cae6-56c9-4a15-9d1f-1d9d996d29a0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:12.547638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4cae6-56c9-4a15-9d1f-1d9d996d29a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:12.595265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c1e4cae6-56c9-4a15-9d1f-1d9d996d29a0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:12.595265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c1e4cae6-56c9-4a15-9d1f-1d9d996d29a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:12.641882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327d1e2-4fbe-456c-a1fe-599a6ef7764c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:12.648225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda611f-88ac-4521-be5e-d742d95a2fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:12.648720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda611f-88ac-4521-be5e-d742d95a2fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:12.649069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda611f-88ac-4521-be5e-d742d95a2fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:12.649411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda611f-88ac-4521-be5e-d742d95a2fd8 admin admin] PATH_INFO: `/v3/projects/cdd647fa7f924b8aa08a5cd8418bc0f8` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:12.664134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda611f-88ac-4521-be5e-d742d95a2fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdd647fa7f924b8aa08a5cd8418bc0f8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:12.667959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda611f-88ac-4521-be5e-d742d95a2fd8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:12.737749 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3691/7382] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:12.739303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4cae6-56c9-4a15-9d1f-1d9d996d29a0 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:12.744139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c1e4cae6-56c9-4a15-9d1f-1d9d996d29a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:12.762256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4cae6-56c9-4a15-9d1f-1d9d996d29a0 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:12.769141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfc78a-c9d5-4b9f-9871-01166eabebff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:12.770242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfc78a-c9d5-4b9f-9871-01166eabebff admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:12.771023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfc78a-c9d5-4b9f-9871-01166eabebff admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:12.771527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfc78a-c9d5-4b9f-9871-01166eabebff admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:12.772861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfc78a-c9d5-4b9f-9871-01166eabebff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:12.775572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfc78a-c9d5-4b9f-9871-01166eabebff admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:12.791930 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3692/7383] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:55:12.793529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfc78a-c9d5-4b9f-9871-01166eabebff admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:12.797408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e4bfc78a-c9d5-4b9f-9871-01166eabebff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:12.866878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:12.870444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5bda611f-88ac-4521-be5e-d742d95a2fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdd647fa7f924b8aa08a5cd8418bc0f8', 'request_id': 'req-5bda611f-88ac-4521-be5e-d742d95a2fd8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:12.949601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfc78a-c9d5-4b9f-9871-01166eabebff admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:12.984716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5bda611f-88ac-4521-be5e-d742d95a2fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdd647fa7f924b8aa08a5cd8418bc0f8', 'request_id': 'req-5bda611f-88ac-4521-be5e-d742d95a2fd8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:12.993832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5bda611f-88ac-4521-be5e-d742d95a2fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdd647fa7f924b8aa08a5cd8418bc0f8', 'request_id': 'req-5bda611f-88ac-4521-be5e-d742d95a2fd8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:13.029581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b711184-7d15-45fc-8b4c-b6d301594b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:13.030404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b711184-7d15-45fc-8b4c-b6d301594b32 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:13.030814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b711184-7d15-45fc-8b4c-b6d301594b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:13.031739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b711184-7d15-45fc-8b4c-b6d301594b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:13.048437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5bda611f-88ac-4521-be5e-d742d95a2fd8 admin admin] The token cache is being invalidate because project cdd647fa7f924b8aa08a5cd8418bc0f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:55:13.048661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5bda611f-88ac-4521-be5e-d742d95a2fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:13.051561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5bda611f-88ac-4521-be5e-d742d95a2fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:13.054683 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3692/7384] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:55:12 2022] DELETE /identity/v3/projects/cdd647fa7f924b8aa08a5cd8418bc0f8 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:13.057472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:13.058963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda611f-88ac-4521-be5e-d742d95a2fd8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:13.066921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5bda611f-88ac-4521-be5e-d742d95a2fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:13.147144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b711184-7d15-45fc-8b4c-b6d301594b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:13.150477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b711184-7d15-45fc-8b4c-b6d301594b32 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:13.183161 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3693/7385] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:55:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:55:13.187877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b711184-7d15-45fc-8b4c-b6d301594b32 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:13.212865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b711184-7d15-45fc-8b4c-b6d301594b32 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:13.219342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e0632-49f4-462c-94ca-45c5b256d852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:13.220123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e0632-49f4-462c-94ca-45c5b256d852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:13.220418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e0632-49f4-462c-94ca-45c5b256d852 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:13.221273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e0632-49f4-462c-94ca-45c5b256d852 admin admin] PATH_INFO: `/v3/users/aab3abe7abbd4fe28d63c022c402a3c8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:13.221920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e0632-49f4-462c-94ca-45c5b256d852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aab3abe7abbd4fe28d63c022c402a3c8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:13.243639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e0632-49f4-462c-94ca-45c5b256d852 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:13.289451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda611f-88ac-4521-be5e-d742d95a2fd8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:13.300041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08223455-d421-4b39-b622-6873d42a15c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:13.300608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08223455-d421-4b39-b622-6873d42a15c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:13.300890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08223455-d421-4b39-b622-6873d42a15c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:13.301167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08223455-d421-4b39-b622-6873d42a15c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:13.301833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08223455-d421-4b39-b622-6873d42a15c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:13.307987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08223455-d421-4b39-b622-6873d42a15c4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:13.334776 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3693/7386] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:55:13.338622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08223455-d421-4b39-b622-6873d42a15c4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:13.358310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08223455-d421-4b39-b622-6873d42a15c4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:13.372626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32caa921-6cb4-4f75-9886-701486978a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:13.373323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32caa921-6cb4-4f75-9886-701486978a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:13.374114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32caa921-6cb4-4f75-9886-701486978a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:13.374114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32caa921-6cb4-4f75-9886-701486978a03 admin admin] PATH_INFO: `/v3/projects/d66531c965a94c34be0b2abdd9ae71fb/users/a4dcd71f6bb74da08c93017ecfdda6cc/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:13.427157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32caa921-6cb4-4f75-9886-701486978a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d66531c965a94c34be0b2abdd9ae71fb, user_id=a4dcd71f6bb74da08c93017ecfdda6cc, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:13.433444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32caa921-6cb4-4f75-9886-701486978a03 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:13.511628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1b3e0632-49f4-462c-94ca-45c5b256d852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aab3abe7abbd4fe28d63c022c402a3c8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:13.512392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1b3e0632-49f4-462c-94ca-45c5b256d852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aab3abe7abbd4fe28d63c022c402a3c8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:13.526724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1b3e0632-49f4-462c-94ca-45c5b256d852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aab3abe7abbd4fe28d63c022c402a3c8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:13.565189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1b3e0632-49f4-462c-94ca-45c5b256d852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aab3abe7abbd4fe28d63c022c402a3c8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:13.569464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1b3e0632-49f4-462c-94ca-45c5b256d852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aab3abe7abbd4fe28d63c022c402a3c8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:13.596082 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3694/7387] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:55:13 2022] PUT /identity/v3/projects/d66531c965a94c34be0b2abdd9ae71fb/users/a4dcd71f6bb74da08c93017ecfdda6cc/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:55:13.597486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1576b-24bd-4988-b3f5-42e56040ffe5 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:13.597782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1576b-24bd-4988-b3f5-42e56040ffe5 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:13.598074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1576b-24bd-4988-b3f5-42e56040ffe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:13.638899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-40f1576b-24bd-4988-b3f5-42e56040ffe5 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:13.641578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-40f1576b-24bd-4988-b3f5-42e56040ffe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:13.709732 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3694/7388] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:55:13 2022] DELETE /identity/v3/users/aab3abe7abbd4fe28d63c022c402a3c8 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:13.758146 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3695/7389] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:13.773016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e0632-49f4-462c-94ca-45c5b256d852 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:13.774783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1b3e0632-49f4-462c-94ca-45c5b256d852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:13.973788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e0632-49f4-462c-94ca-45c5b256d852 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:13.989222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1821f15-ecfc-42af-b002-3cbbf5f80178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:13.991672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1821f15-ecfc-42af-b002-3cbbf5f80178 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:13.992796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1821f15-ecfc-42af-b002-3cbbf5f80178 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:13.995432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1821f15-ecfc-42af-b002-3cbbf5f80178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:14.157353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1576b-24bd-4988-b3f5-42e56040ffe5 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:14.159310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-40f1576b-24bd-4988-b3f5-42e56040ffe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:14.166974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1821f15-ecfc-42af-b002-3cbbf5f80178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:14.169295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1821f15-ecfc-42af-b002-3cbbf5f80178 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:14.180716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1576b-24bd-4988-b3f5-42e56040ffe5 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:14.186048 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3695/7390] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:55:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:55:14.201514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e79a7-cf82-4899-aa15-0143ec7edf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:14.202229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e79a7-cf82-4899-aa15-0143ec7edf8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:14.202571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e79a7-cf82-4899-aa15-0143ec7edf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:14.205711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e79a7-cf82-4899-aa15-0143ec7edf8b admin admin] PATH_INFO: `/v3/projects/3c2a3e4f2abb492d96086efdb160fec9` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:14.207003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e79a7-cf82-4899-aa15-0143ec7edf8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c2a3e4f2abb492d96086efdb160fec9)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:14.214683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e79a7-cf82-4899-aa15-0143ec7edf8b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:14.351303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:14.475254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-352e79a7-cf82-4899-aa15-0143ec7edf8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c2a3e4f2abb492d96086efdb160fec9', 'request_id': 'req-352e79a7-cf82-4899-aa15-0143ec7edf8b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:14.613240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-352e79a7-cf82-4899-aa15-0143ec7edf8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c2a3e4f2abb492d96086efdb160fec9', 'request_id': 'req-352e79a7-cf82-4899-aa15-0143ec7edf8b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:14.647978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:14.647978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-352e79a7-cf82-4899-aa15-0143ec7edf8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c2a3e4f2abb492d96086efdb160fec9', 'request_id': 'req-352e79a7-cf82-4899-aa15-0143ec7edf8b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:14.674800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-352e79a7-cf82-4899-aa15-0143ec7edf8b admin admin] The token cache is being invalidate because project 3c2a3e4f2abb492d96086efdb160fec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:55:14.675448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-352e79a7-cf82-4899-aa15-0143ec7edf8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:14.679281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-352e79a7-cf82-4899-aa15-0143ec7edf8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:14.681235 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3696/7391] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:55:14 2022] DELETE /identity/v3/projects/3c2a3e4f2abb492d96086efdb160fec9 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:14.684999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1821f15-ecfc-42af-b002-3cbbf5f80178 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:14.713699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1821f15-ecfc-42af-b002-3cbbf5f80178 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:14.902355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec15cf-6913-4789-8e35-e2895a84b8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:14.902355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec15cf-6913-4789-8e35-e2895a84b8de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:14.902590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec15cf-6913-4789-8e35-e2895a84b8de admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:14.902968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec15cf-6913-4789-8e35-e2895a84b8de admin admin] PATH_INFO: `/v3/users/e41d5db4094242d6a8e5c0b3dd467af4` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:14.904977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec15cf-6913-4789-8e35-e2895a84b8de admin admin] RBAC: Authorizing `identity:delete_user(user_id=e41d5db4094242d6a8e5c0b3dd467af4)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:14.909103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec15cf-6913-4789-8e35-e2895a84b8de admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:15.128806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e79a7-cf82-4899-aa15-0143ec7edf8b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:15.131412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-352e79a7-cf82-4899-aa15-0143ec7edf8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:15.155967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e79a7-cf82-4899-aa15-0143ec7edf8b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:15.188444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fbf19-b9e0-4b66-b3ee-bf0370920c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:15.189831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fbf19-b9e0-4b66-b3ee-bf0370920c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:15.189831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fbf19-b9e0-4b66-b3ee-bf0370920c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:15.189831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fbf19-b9e0-4b66-b3ee-bf0370920c07 admin admin] PATH_INFO: `/v3/projects/70b21a0d219f448fa2ca3bc8574a8c86` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:15.191360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fbf19-b9e0-4b66-b3ee-bf0370920c07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70b21a0d219f448fa2ca3bc8574a8c86)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:15.193312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fbf19-b9e0-4b66-b3ee-bf0370920c07 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:15.235677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7fec15cf-6913-4789-8e35-e2895a84b8de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e41d5db4094242d6a8e5c0b3dd467af4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:15.238105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7fec15cf-6913-4789-8e35-e2895a84b8de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e41d5db4094242d6a8e5c0b3dd467af4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:15.256377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7fec15cf-6913-4789-8e35-e2895a84b8de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e41d5db4094242d6a8e5c0b3dd467af4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:15.282289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7fec15cf-6913-4789-8e35-e2895a84b8de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e41d5db4094242d6a8e5c0b3dd467af4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:15.283117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7fec15cf-6913-4789-8e35-e2895a84b8de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e41d5db4094242d6a8e5c0b3dd467af4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:15.455445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9d2fbf19-b9e0-4b66-b3ee-bf0370920c07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70b21a0d219f448fa2ca3bc8574a8c86', 'request_id': 'req-9d2fbf19-b9e0-4b66-b3ee-bf0370920c07'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:15.466966 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3696/7392] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:55:14 2022] DELETE /identity/v3/users/e41d5db4094242d6a8e5c0b3dd467af4 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:15.522905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:15.549254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9d2fbf19-b9e0-4b66-b3ee-bf0370920c07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70b21a0d219f448fa2ca3bc8574a8c86', 'request_id': 'req-9d2fbf19-b9e0-4b66-b3ee-bf0370920c07'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:15.558222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9d2fbf19-b9e0-4b66-b3ee-bf0370920c07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70b21a0d219f448fa2ca3bc8574a8c86', 'request_id': 'req-9d2fbf19-b9e0-4b66-b3ee-bf0370920c07'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:15.590994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9d2fbf19-b9e0-4b66-b3ee-bf0370920c07 admin admin] The token cache is being invalidate because project 70b21a0d219f448fa2ca3bc8574a8c86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:55:15.590994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9d2fbf19-b9e0-4b66-b3ee-bf0370920c07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:15.590994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9d2fbf19-b9e0-4b66-b3ee-bf0370920c07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:15.591904 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3697/7393] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:55:15 2022] DELETE /identity/v3/projects/70b21a0d219f448fa2ca3bc8574a8c86 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:15.598277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ca934-33ac-47ce-b14c-3dc5a6c7425d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:15.599198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ca934-33ac-47ce-b14c-3dc5a6c7425d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:15.599707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ca934-33ac-47ce-b14c-3dc5a6c7425d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:15.649594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b87ca934-33ac-47ce-b14c-3dc5a6c7425d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:15.659542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b87ca934-33ac-47ce-b14c-3dc5a6c7425d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:15.952894 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3697/7394] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:55:15.953687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f7553-d1fb-4bc3-ae04-ee75e0b82294 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:15.954283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f7553-d1fb-4bc3-ae04-ee75e0b82294 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:15.954856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f7553-d1fb-4bc3-ae04-ee75e0b82294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:16.013773 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-986f7553-d1fb-4bc3-ae04-ee75e0b82294 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:16.015089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-986f7553-d1fb-4bc3-ae04-ee75e0b82294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:16.044750 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3698/7395] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:55:16.050303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ca934-33ac-47ce-b14c-3dc5a6c7425d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:16.070626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ca934-33ac-47ce-b14c-3dc5a6c7425d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:16.084821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14ca55-c3ac-4bc3-972b-1c2ac3661618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:16.085726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14ca55-c3ac-4bc3-972b-1c2ac3661618 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:16.086212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14ca55-c3ac-4bc3-972b-1c2ac3661618 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:16.087188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14ca55-c3ac-4bc3-972b-1c2ac3661618 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:16.088340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14ca55-c3ac-4bc3-972b-1c2ac3661618 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:55:16.088814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14ca55-c3ac-4bc3-972b-1c2ac3661618 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:16.096824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14ca55-c3ac-4bc3-972b-1c2ac3661618 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:16.132870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f7553-d1fb-4bc3-ae04-ee75e0b82294 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:16.137689 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3698/7396] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:55:16.143124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f7553-d1fb-4bc3-ae04-ee75e0b82294 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:16.157046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598ddbd-d90d-454d-a1e8-02c4491ef5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:16.157949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598ddbd-d90d-454d-a1e8-02c4491ef5ae admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:16.158433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598ddbd-d90d-454d-a1e8-02c4491ef5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:16.158879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598ddbd-d90d-454d-a1e8-02c4491ef5ae admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:16.159835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598ddbd-d90d-454d-a1e8-02c4491ef5ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:16.163993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598ddbd-d90d-454d-a1e8-02c4491ef5ae admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:16.469598 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3699/7397] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:55:16 2022] POST /identity/v3/projects => generated 363 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:55:16.473744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14ca55-c3ac-4bc3-972b-1c2ac3661618 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:16.493580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14ca55-c3ac-4bc3-972b-1c2ac3661618 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:16.664778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83cd47-5cfe-4456-af75-b9c8b4df7cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:16.664778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83cd47-5cfe-4456-af75-b9c8b4df7cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:16.664778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83cd47-5cfe-4456-af75-b9c8b4df7cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:16.664778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83cd47-5cfe-4456-af75-b9c8b4df7cb4 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:16.665544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83cd47-5cfe-4456-af75-b9c8b4df7cb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:16.665544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83cd47-5cfe-4456-af75-b9c8b4df7cb4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:16.752483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598ddbd-d90d-454d-a1e8-02c4491ef5ae admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:16.754481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a598ddbd-d90d-454d-a1e8-02c4491ef5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:16.793324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598ddbd-d90d-454d-a1e8-02c4491ef5ae admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:16.818354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597f43e-040f-441b-a16a-817867e0984e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:16.819923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597f43e-040f-441b-a16a-817867e0984e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:16.819923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597f43e-040f-441b-a16a-817867e0984e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:16.820145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597f43e-040f-441b-a16a-817867e0984e admin admin] PATH_INFO: `/v3/projects/e3f5002b97164951ba7d6fc4d48a9735` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:16.821269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597f43e-040f-441b-a16a-817867e0984e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3f5002b97164951ba7d6fc4d48a9735)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:16.829374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597f43e-040f-441b-a16a-817867e0984e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:16.831573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:16.833071 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3699/7398] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:55:16 2022] POST /identity/v3/users => generated 282 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:55:16.850923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83cd47-5cfe-4456-af75-b9c8b4df7cb4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:16.851701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:16.911943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83cd47-5cfe-4456-af75-b9c8b4df7cb4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:16.927211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89b0e2-646c-4133-acee-92f49994ee5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:16.928577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89b0e2-646c-4133-acee-92f49994ee5d admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:16.929044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89b0e2-646c-4133-acee-92f49994ee5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:16.929481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89b0e2-646c-4133-acee-92f49994ee5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:16.930516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89b0e2-646c-4133-acee-92f49994ee5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:16.932322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89b0e2-646c-4133-acee-92f49994ee5d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:16.977142 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3700/7399] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:55:16.982550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89b0e2-646c-4133-acee-92f49994ee5d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:17.022158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89b0e2-646c-4133-acee-92f49994ee5d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:17.050565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7597f43e-040f-441b-a16a-817867e0984e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3f5002b97164951ba7d6fc4d48a9735', 'request_id': 'req-7597f43e-040f-441b-a16a-817867e0984e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:17.166343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7597f43e-040f-441b-a16a-817867e0984e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3f5002b97164951ba7d6fc4d48a9735', 'request_id': 'req-7597f43e-040f-441b-a16a-817867e0984e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:17.179202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7597f43e-040f-441b-a16a-817867e0984e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3f5002b97164951ba7d6fc4d48a9735', 'request_id': 'req-7597f43e-040f-441b-a16a-817867e0984e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:17.190138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fe054-9ee2-4fdb-bf48-f153eb4da205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:17.190655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fe054-9ee2-4fdb-bf48-f153eb4da205 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:17.193617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fe054-9ee2-4fdb-bf48-f153eb4da205 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:17.193951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fe054-9ee2-4fdb-bf48-f153eb4da205 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:17.196804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fe054-9ee2-4fdb-bf48-f153eb4da205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:17.208928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fe054-9ee2-4fdb-bf48-f153eb4da205 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:17.224983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7597f43e-040f-441b-a16a-817867e0984e admin admin] The token cache is being invalidate because project e3f5002b97164951ba7d6fc4d48a9735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:55:17.225276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7597f43e-040f-441b-a16a-817867e0984e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:17.231897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7597f43e-040f-441b-a16a-817867e0984e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:17.238332 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3700/7400] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:55:16 2022] DELETE /identity/v3/projects/e3f5002b97164951ba7d6fc4d48a9735 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:17.243695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dff96-38e0-483d-8e45-bfc9a6cbb8ba None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:17.244197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dff96-38e0-483d-8e45-bfc9a6cbb8ba None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:17.246605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dff96-38e0-483d-8e45-bfc9a6cbb8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:17.252180 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3701/7401] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:55:17.253581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fe054-9ee2-4fdb-bf48-f153eb4da205 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:17.258527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-643fe054-9ee2-4fdb-bf48-f153eb4da205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:17.292515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fe054-9ee2-4fdb-bf48-f153eb4da205 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:17.300561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-fb9dff96-38e0-483d-8e45-bfc9a6cbb8ba None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:17.307724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fb9dff96-38e0-483d-8e45-bfc9a6cbb8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:17.307890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544f8a6-5623-4050-b78d-2bdac05fea3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:17.308292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544f8a6-5623-4050-b78d-2bdac05fea3d admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:17.308745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544f8a6-5623-4050-b78d-2bdac05fea3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:17.309205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544f8a6-5623-4050-b78d-2bdac05fea3d admin admin] PATH_INFO: `/v3/projects/ab756040cec04e998730d81759e19aaf/users/8fb728e226a54aeead486770f920594c/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:17.327252 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3701/7402] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:17.334753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a2190-934c-402d-9257-51c61c051052 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:17.335283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a2190-934c-402d-9257-51c61c051052 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:17.336723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a2190-934c-402d-9257-51c61c051052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:17.344782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544f8a6-5623-4050-b78d-2bdac05fea3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab756040cec04e998730d81759e19aaf, user_id=8fb728e226a54aeead486770f920594c, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:17.361177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544f8a6-5623-4050-b78d-2bdac05fea3d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:17.390194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-034a2190-934c-402d-9257-51c61c051052 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:17.392614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-034a2190-934c-402d-9257-51c61c051052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:17.403556 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3702/7403] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:17.404800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a2190-934c-402d-9257-51c61c051052 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:17.408213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-034a2190-934c-402d-9257-51c61c051052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:17.475559 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3702/7404] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:55:17 2022] PUT /identity/v3/projects/ab756040cec04e998730d81759e19aaf/users/8fb728e226a54aeead486770f920594c/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:17.476657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544f8a6-5623-4050-b78d-2bdac05fea3d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:17.557799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a2190-934c-402d-9257-51c61c051052 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:17.606550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544f8a6-5623-4050-b78d-2bdac05fea3d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:17.613881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb60e76-6409-49e7-8687-9d8bbab9e50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:17.614507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb60e76-6409-49e7-8687-9d8bbab9e50d admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:17.614955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb60e76-6409-49e7-8687-9d8bbab9e50d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:17.616130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb60e76-6409-49e7-8687-9d8bbab9e50d admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:17.617623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb60e76-6409-49e7-8687-9d8bbab9e50d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:55:17.618159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb60e76-6409-49e7-8687-9d8bbab9e50d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:17.620846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb60e76-6409-49e7-8687-9d8bbab9e50d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:17.670408 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3703/7405] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:55:17.674827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fc324-1470-4055-8686-f846264d03ad None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:17.677098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fc324-1470-4055-8686-f846264d03ad None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:17.677098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fc324-1470-4055-8686-f846264d03ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:17.697015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06414ee5-d574-4e5a-89a0-22ac8ec849bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:17.697690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06414ee5-d574-4e5a-89a0-22ac8ec849bb service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:17.697971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06414ee5-d574-4e5a-89a0-22ac8ec849bb service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:17.698278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06414ee5-d574-4e5a-89a0-22ac8ec849bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:17.703782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-06414ee5-d574-4e5a-89a0-22ac8ec849bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:17.731214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06414ee5-d574-4e5a-89a0-22ac8ec849bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:17.732805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06414ee5-d574-4e5a-89a0-22ac8ec849bb service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:17.762183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e12fc324-1470-4055-8686-f846264d03ad None None] MFA Rules not processed for user `8fb728e226a54aeead486770f920594c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:17.764036 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3703/7406] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:55:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:55:17.764745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06414ee5-d574-4e5a-89a0-22ac8ec849bb service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:17.765911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e12fc324-1470-4055-8686-f846264d03ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:17.786582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06414ee5-d574-4e5a-89a0-22ac8ec849bb service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:17.801249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ca731-8546-4c9a-98f5-e46201e9444f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:17.801981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ca731-8546-4c9a-98f5-e46201e9444f admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:17.802309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ca731-8546-4c9a-98f5-e46201e9444f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:17.802631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ca731-8546-4c9a-98f5-e46201e9444f admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:17.803776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ca731-8546-4c9a-98f5-e46201e9444f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:17.809196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ca731-8546-4c9a-98f5-e46201e9444f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:17.959527 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3704/7407] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:55:17 2022] POST /identity/v3/projects => generated 365 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:55:17.972348 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3704/7408] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:17.976218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ca731-8546-4c9a-98f5-e46201e9444f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:17.976914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12fc324-1470-4055-8686-f846264d03ad None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:18.000725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12fc324-1470-4055-8686-f846264d03ad None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:18.119058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ca731-8546-4c9a-98f5-e46201e9444f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:18.135221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f6a87-393d-450d-9c0b-cd78dca4329d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:18.135848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f6a87-393d-450d-9c0b-cd78dca4329d admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:18.136129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f6a87-393d-450d-9c0b-cd78dca4329d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:18.136399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f6a87-393d-450d-9c0b-cd78dca4329d admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:18.137068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f6a87-393d-450d-9c0b-cd78dca4329d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:18.139082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f6a87-393d-450d-9c0b-cd78dca4329d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:18.202518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a6cc7-9220-4f5e-8141-a0ea71f277a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:18.203498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a6cc7-9220-4f5e-8141-a0ea71f277a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:18.203955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a6cc7-9220-4f5e-8141-a0ea71f277a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:18.204759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a6cc7-9220-4f5e-8141-a0ea71f277a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:18.205736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a6cc7-9220-4f5e-8141-a0ea71f277a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:18.208176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a6cc7-9220-4f5e-8141-a0ea71f277a2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:18.276985 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3705/7409] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:55:17 2022] POST /identity/v3/users => generated 283 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:55:18.282707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f6a87-393d-450d-9c0b-cd78dca4329d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:18.297862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f6a87-393d-450d-9c0b-cd78dca4329d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:18.304921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6706bb-3e6c-4c31-bb68-31a192f41a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:18.305360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6706bb-3e6c-4c31-bb68-31a192f41a02 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:18.305747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6706bb-3e6c-4c31-bb68-31a192f41a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:18.306282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6706bb-3e6c-4c31-bb68-31a192f41a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:18.307112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6706bb-3e6c-4c31-bb68-31a192f41a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:18.308899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6706bb-3e6c-4c31-bb68-31a192f41a02 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:18.322942 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3706/7410] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:55:18.327093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6706bb-3e6c-4c31-bb68-31a192f41a02 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:18.330356 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3705/7411] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:55:17 2022] POST /identity/v3/projects => generated 365 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:55:18.334744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a6cc7-9220-4f5e-8141-a0ea71f277a2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:18.347685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6706bb-3e6c-4c31-bb68-31a192f41a02 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:18.503522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a6cc7-9220-4f5e-8141-a0ea71f277a2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:18.516893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbedae-0f3d-4bac-90a5-39f0142c7470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:18.517535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbedae-0f3d-4bac-90a5-39f0142c7470 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:18.517817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbedae-0f3d-4bac-90a5-39f0142c7470 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:18.518360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbedae-0f3d-4bac-90a5-39f0142c7470 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:18.519116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffbedae-0f3d-4bac-90a5-39f0142c7470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:18.521298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffbedae-0f3d-4bac-90a5-39f0142c7470 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:18.526698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108bd1f-91ea-4bcb-a84d-2f7b7d21c429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:18.527728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108bd1f-91ea-4bcb-a84d-2f7b7d21c429 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:18.528227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108bd1f-91ea-4bcb-a84d-2f7b7d21c429 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:18.528693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108bd1f-91ea-4bcb-a84d-2f7b7d21c429 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:18.530524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108bd1f-91ea-4bcb-a84d-2f7b7d21c429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:18.535509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108bd1f-91ea-4bcb-a84d-2f7b7d21c429 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:18.545112 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3707/7412] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:55:18.546357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbedae-0f3d-4bac-90a5-39f0142c7470 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:18.573325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbedae-0f3d-4bac-90a5-39f0142c7470 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:18.582943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813d810-08e0-408b-b9b7-7444f4784d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:18.583641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813d810-08e0-408b-b9b7-7444f4784d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:18.583927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813d810-08e0-408b-b9b7-7444f4784d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:18.584200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813d810-08e0-408b-b9b7-7444f4784d45 admin admin] PATH_INFO: `/v3/projects/bb723f191b0e4ada83bb5207501dff99/users/85a8a619ae49458ba439d4e86367bfb3/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:18.604749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813d810-08e0-408b-b9b7-7444f4784d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb723f191b0e4ada83bb5207501dff99, user_id=85a8a619ae49458ba439d4e86367bfb3, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:18.607541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813d810-08e0-408b-b9b7-7444f4784d45 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:18.709740 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3706/7413] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:55:18 2022] POST /identity/v3/users => generated 289 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:55:18.713140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108bd1f-91ea-4bcb-a84d-2f7b7d21c429 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:18.740649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108bd1f-91ea-4bcb-a84d-2f7b7d21c429 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:18.754607 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3708/7414] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:55:18 2022] PUT /identity/v3/projects/bb723f191b0e4ada83bb5207501dff99/users/85a8a619ae49458ba439d4e86367bfb3/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:18.764314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e37d5e-f865-4ecf-a063-1785e583a79d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:18.764951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e37d5e-f865-4ecf-a063-1785e583a79d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:18.764951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e37d5e-f865-4ecf-a063-1785e583a79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:18.768461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fa437-b15a-4857-b846-b186546c9b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:18.769094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fa437-b15a-4857-b846-b186546c9b03 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:18.769377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fa437-b15a-4857-b846-b186546c9b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:18.769643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fa437-b15a-4857-b846-b186546c9b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:18.770345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31fa437-b15a-4857-b846-b186546c9b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:18.772225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31fa437-b15a-4857-b846-b186546c9b03 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:18.793183 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3707/7415] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:55:18.799024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fa437-b15a-4857-b846-b186546c9b03 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:18.819781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c2e37d5e-f865-4ecf-a063-1785e583a79d None None] MFA Rules not processed for user `85a8a619ae49458ba439d4e86367bfb3`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:18.822242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c2e37d5e-f865-4ecf-a063-1785e583a79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:18.824401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fa437-b15a-4857-b846-b186546c9b03 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:18.946621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:18.978222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:19.005102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc9c14-14da-4f25-9322-84581f75cd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:19.005812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc9c14-14da-4f25-9322-84581f75cd28 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:19.006099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc9c14-14da-4f25-9322-84581f75cd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:19.006772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc9c14-14da-4f25-9322-84581f75cd28 admin admin] PATH_INFO: `/v3/projects/0da8c38d61464b24b8e93b46b9943eac/users/c895006c31b542f5a15acad26d85a065/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:19.034733 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3709/7416] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:19.038370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e37d5e-f865-4ecf-a063-1785e583a79d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:19.052696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc9c14-14da-4f25-9322-84581f75cd28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0da8c38d61464b24b8e93b46b9943eac, user_id=c895006c31b542f5a15acad26d85a065, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:19.056170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc9c14-14da-4f25-9322-84581f75cd28 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:19.068236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e37d5e-f865-4ecf-a063-1785e583a79d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:19.076609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a490ec4-e506-421a-bd8d-4fc3f2477fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:19.077998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a490ec4-e506-421a-bd8d-4fc3f2477fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:19.078634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a490ec4-e506-421a-bd8d-4fc3f2477fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:19.079004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a490ec4-e506-421a-bd8d-4fc3f2477fa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:19.080051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a490ec4-e506-421a-bd8d-4fc3f2477fa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:19.083086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a490ec4-e506-421a-bd8d-4fc3f2477fa6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:19.153393 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3708/7417] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:55:18 2022] PUT /identity/v3/projects/0da8c38d61464b24b8e93b46b9943eac/users/c895006c31b542f5a15acad26d85a065/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:19.157900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc9c14-14da-4f25-9322-84581f75cd28 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:19.271062 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3710/7418] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:55:19 2022] POST /identity/v3/projects => generated 365 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:55:19.275963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a490ec4-e506-421a-bd8d-4fc3f2477fa6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:19.425472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc9c14-14da-4f25-9322-84581f75cd28 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:19.467843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a490ec4-e506-421a-bd8d-4fc3f2477fa6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:19.482399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f4dd3-6701-4f3b-be87-74c489e340b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:19.483442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f4dd3-6701-4f3b-be87-74c489e340b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:19.485169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f4dd3-6701-4f3b-be87-74c489e340b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:19.488431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f4dd3-6701-4f3b-be87-74c489e340b0 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:19.489563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f4dd3-6701-4f3b-be87-74c489e340b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:19.499527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f4dd3-6701-4f3b-be87-74c489e340b0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:19.589275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e44db-83d6-47c8-a2d7-4e766e69f3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:19.589953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e44db-83d6-47c8-a2d7-4e766e69f3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:19.590286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e44db-83d6-47c8-a2d7-4e766e69f3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:19.590571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e44db-83d6-47c8-a2d7-4e766e69f3d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:19.591249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e44db-83d6-47c8-a2d7-4e766e69f3d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:19.593092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e44db-83d6-47c8-a2d7-4e766e69f3d0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:19.617003 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3709/7419] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:55:19.620912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e44db-83d6-47c8-a2d7-4e766e69f3d0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:19.636438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e44db-83d6-47c8-a2d7-4e766e69f3d0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:19.645345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a904d-49d1-4557-ae79-88bd932de29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:19.647770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a904d-49d1-4557-ae79-88bd932de29e admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:19.648062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a904d-49d1-4557-ae79-88bd932de29e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:19.648340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a904d-49d1-4557-ae79-88bd932de29e admin admin] PATH_INFO: `/v3/projects/0da8c38d61464b24b8e93b46b9943eac/users/c895006c31b542f5a15acad26d85a065/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:19.659277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a904d-49d1-4557-ae79-88bd932de29e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0da8c38d61464b24b8e93b46b9943eac, user_id=c895006c31b542f5a15acad26d85a065, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:19.666202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a904d-49d1-4557-ae79-88bd932de29e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:19.670134 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3711/7420] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:55:19 2022] POST /identity/v3/users => generated 289 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:55:19.674059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f4dd3-6701-4f3b-be87-74c489e340b0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:19.716275 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3710/7421] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:55:19 2022] PUT /identity/v3/projects/0da8c38d61464b24b8e93b46b9943eac/users/c895006c31b542f5a15acad26d85a065/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:55:19.719569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e764e-aba9-437e-b137-ba4fa4ecbf47 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:19.719882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e764e-aba9-437e-b137-ba4fa4ecbf47 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:19.720138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e764e-aba9-437e-b137-ba4fa4ecbf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:19.754147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f4dd3-6701-4f3b-be87-74c489e340b0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:19.794631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ba3e764e-aba9-437e-b137-ba4fa4ecbf47 None None] MFA Rules not processed for user `c895006c31b542f5a15acad26d85a065`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:19.796448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ba3e764e-aba9-437e-b137-ba4fa4ecbf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:19.921557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb96c0b-7824-44f4-95d3-710df80b0c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:19.922886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb96c0b-7824-44f4-95d3-710df80b0c8c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:19.923339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb96c0b-7824-44f4-95d3-710df80b0c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:19.923795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb96c0b-7824-44f4-95d3-710df80b0c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:19.924760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb96c0b-7824-44f4-95d3-710df80b0c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:19.928776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb96c0b-7824-44f4-95d3-710df80b0c8c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:19.958699 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3712/7422] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:55:19.962986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb96c0b-7824-44f4-95d3-710df80b0c8c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:19.981447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:19.982794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb96c0b-7824-44f4-95d3-710df80b0c8c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:20.010439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7824fcb-f833-4c59-947e-56bec6a54160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:20.011146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7824fcb-f833-4c59-947e-56bec6a54160 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:20.011432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7824fcb-f833-4c59-947e-56bec6a54160 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:20.011761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7824fcb-f833-4c59-947e-56bec6a54160 admin admin] PATH_INFO: `/v3/projects/f35414e83bdb488199e8b7e1309f43b7/users/730261e10eb04422bbefca8542617caa/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:20.035225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7824fcb-f833-4c59-947e-56bec6a54160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f35414e83bdb488199e8b7e1309f43b7, user_id=730261e10eb04422bbefca8542617caa, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:20.055562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7824fcb-f833-4c59-947e-56bec6a54160 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:20.124699 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3711/7423] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:20.147331 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3713/7424] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:55:19 2022] PUT /identity/v3/projects/f35414e83bdb488199e8b7e1309f43b7/users/730261e10eb04422bbefca8542617caa/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:55:20.152317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e764e-aba9-437e-b137-ba4fa4ecbf47 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:20.173325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e764e-aba9-437e-b137-ba4fa4ecbf47 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:20.233638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7824fcb-f833-4c59-947e-56bec6a54160 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:20.236060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c7824fcb-f833-4c59-947e-56bec6a54160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:20.247026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:20.472939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2def0-d1ed-409f-9f54-cd65623ce6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:20.478642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2def0-d1ed-409f-9f54-cd65623ce6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:20.479038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2def0-d1ed-409f-9f54-cd65623ce6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:20.479321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2def0-d1ed-409f-9f54-cd65623ce6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:20.481439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2def0-d1ed-409f-9f54-cd65623ce6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:20.495831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2def0-d1ed-409f-9f54-cd65623ce6b5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:20.522173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7824fcb-f833-4c59-947e-56bec6a54160 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:20.557822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6d6ab-2b0a-436c-8e2f-b46536ddbd36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:20.560925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6d6ab-2b0a-436c-8e2f-b46536ddbd36 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:20.562916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6d6ab-2b0a-436c-8e2f-b46536ddbd36 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:20.566294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6d6ab-2b0a-436c-8e2f-b46536ddbd36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:20.569349 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3712/7425] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:55:20.572649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2def0-d1ed-409f-9f54-cd65623ce6b5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:20.609294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2def0-d1ed-409f-9f54-cd65623ce6b5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:20.624457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d34d44-f6a2-409f-8c50-b2b96910b34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:20.633366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d34d44-f6a2-409f-8c50-b2b96910b34e admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:20.633366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d34d44-f6a2-409f-8c50-b2b96910b34e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:20.633366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d34d44-f6a2-409f-8c50-b2b96910b34e admin admin] PATH_INFO: `/v3/projects/f35414e83bdb488199e8b7e1309f43b7/users/730261e10eb04422bbefca8542617caa/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:20.637373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d34d44-f6a2-409f-8c50-b2b96910b34e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f35414e83bdb488199e8b7e1309f43b7, user_id=730261e10eb04422bbefca8542617caa, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:20.649157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d34d44-f6a2-409f-8c50-b2b96910b34e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:20.719644 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3713/7426] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:55:20 2022] PUT /identity/v3/projects/f35414e83bdb488199e8b7e1309f43b7/users/730261e10eb04422bbefca8542617caa/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:20.721444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a1417-3718-44ce-befc-1bb85d55d837 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:20.722382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a1417-3718-44ce-befc-1bb85d55d837 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:20.722776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a1417-3718-44ce-befc-1bb85d55d837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:20.786756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-448a1417-3718-44ce-befc-1bb85d55d837 None None] MFA Rules not processed for user `730261e10eb04422bbefca8542617caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:20.790095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-448a1417-3718-44ce-befc-1bb85d55d837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:20.821872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6d6ab-2b0a-436c-8e2f-b46536ddbd36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:20.829486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6d6ab-2b0a-436c-8e2f-b46536ddbd36 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:20.875503 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3714/7427] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:55:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:55:21.013232 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3714/7428] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:21.021437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6d6ab-2b0a-436c-8e2f-b46536ddbd36 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:21.023208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-57a6d6ab-2b0a-436c-8e2f-b46536ddbd36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:21.088585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:21.157625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6d6ab-2b0a-436c-8e2f-b46536ddbd36 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:21.232103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90095aac-e567-46b6-a0b0-29c03d756f91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:21.233096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90095aac-e567-46b6-a0b0-29c03d756f91 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:21.233561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90095aac-e567-46b6-a0b0-29c03d756f91 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:21.234634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90095aac-e567-46b6-a0b0-29c03d756f91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:21.249090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90095aac-e567-46b6-a0b0-29c03d756f91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:21.258241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90095aac-e567-46b6-a0b0-29c03d756f91 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:21.277164 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3715/7429] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:55:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:55:21.362330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:21.555791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a1417-3718-44ce-befc-1bb85d55d837 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:21.582346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a1417-3718-44ce-befc-1bb85d55d837 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:21.594817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120a66b-93c8-400d-9ff1-de1bee73c7f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:21.595517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120a66b-93c8-400d-9ff1-de1bee73c7f2 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:21.595803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120a66b-93c8-400d-9ff1-de1bee73c7f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:21.596094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120a66b-93c8-400d-9ff1-de1bee73c7f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:21.731397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120a66b-93c8-400d-9ff1-de1bee73c7f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:21.733103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120a66b-93c8-400d-9ff1-de1bee73c7f2 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:21.763451 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3715/7430] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:55:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:55:21.957751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:26.355633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90095aac-e567-46b6-a0b0-29c03d756f91 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:26.403521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:26.580787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90095aac-e567-46b6-a0b0-29c03d756f91 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:26.591176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83cdae7-7397-49d0-882a-08a302edb2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:26.591997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cdae7-7397-49d0-882a-08a302edb2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:26.592384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cdae7-7397-49d0-882a-08a302edb2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:26.592767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cdae7-7397-49d0-882a-08a302edb2ce admin admin] PATH_INFO: `/v3/users/85a8a619ae49458ba439d4e86367bfb3` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:26.600122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83cdae7-7397-49d0-882a-08a302edb2ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=85a8a619ae49458ba439d4e86367bfb3)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:26.602506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83cdae7-7397-49d0-882a-08a302edb2ce admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:26.922550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a83cdae7-7397-49d0-882a-08a302edb2ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85a8a619ae49458ba439d4e86367bfb3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:26.925918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a83cdae7-7397-49d0-882a-08a302edb2ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85a8a619ae49458ba439d4e86367bfb3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:26.951269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a83cdae7-7397-49d0-882a-08a302edb2ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85a8a619ae49458ba439d4e86367bfb3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:26.988755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a83cdae7-7397-49d0-882a-08a302edb2ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85a8a619ae49458ba439d4e86367bfb3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:27.076200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a83cdae7-7397-49d0-882a-08a302edb2ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85a8a619ae49458ba439d4e86367bfb3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:27.090005 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3716/7431] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:55:26 2022] DELETE /identity/v3/users/85a8a619ae49458ba439d4e86367bfb3 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:27.091890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4113a-9d80-41ac-a90d-0925bdac24ca None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:27.092688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4113a-9d80-41ac-a90d-0925bdac24ca None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:27.093206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4113a-9d80-41ac-a90d-0925bdac24ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:27.131580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a9f4113a-9d80-41ac-a90d-0925bdac24ca None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:27.133125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a9f4113a-9d80-41ac-a90d-0925bdac24ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:27.278549 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3716/7432] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:27.312589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83cdae7-7397-49d0-882a-08a302edb2ce admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:27.314285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a83cdae7-7397-49d0-882a-08a302edb2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:27.492941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83cdae7-7397-49d0-882a-08a302edb2ce admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:27.497039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66eb887-5e2f-40ff-bd29-98869772d51f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:27.498160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eb887-5e2f-40ff-bd29-98869772d51f service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:27.503339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eb887-5e2f-40ff-bd29-98869772d51f service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:27.503339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eb887-5e2f-40ff-bd29-98869772d51f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:27.521959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66eb887-5e2f-40ff-bd29-98869772d51f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:27.523961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66eb887-5e2f-40ff-bd29-98869772d51f service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:27.548383 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3717/7433] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:55:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:55:28.922373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4113a-9d80-41ac-a90d-0925bdac24ca None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:28.924699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a9f4113a-9d80-41ac-a90d-0925bdac24ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:28.948089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4113a-9d80-41ac-a90d-0925bdac24ca None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:28.953439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8084f-ccbe-4777-a07c-7d428a8ca825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:28.954375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8084f-ccbe-4777-a07c-7d428a8ca825 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:28.954838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8084f-ccbe-4777-a07c-7d428a8ca825 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:28.955337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8084f-ccbe-4777-a07c-7d428a8ca825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:28.958229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e4d8084f-ccbe-4777-a07c-7d428a8ca825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:28.980069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66eb887-5e2f-40ff-bd29-98869772d51f service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:28.981822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f66eb887-5e2f-40ff-bd29-98869772d51f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:29.005375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66eb887-5e2f-40ff-bd29-98869772d51f service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:29.019384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040ae9a-28c0-4245-93b5-ea0fa371ff24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:29.021779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040ae9a-28c0-4245-93b5-ea0fa371ff24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:29.023578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040ae9a-28c0-4245-93b5-ea0fa371ff24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:29.026351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040ae9a-28c0-4245-93b5-ea0fa371ff24 admin admin] PATH_INFO: `/v3/projects/bb723f191b0e4ada83bb5207501dff99` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:29.030465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040ae9a-28c0-4245-93b5-ea0fa371ff24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb723f191b0e4ada83bb5207501dff99)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:29.034060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040ae9a-28c0-4245-93b5-ea0fa371ff24 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:29.125480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8084f-ccbe-4777-a07c-7d428a8ca825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:29.129520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8084f-ccbe-4777-a07c-7d428a8ca825 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:29.156947 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3717/7434] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:55:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:55:29.249204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:29.272805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f040ae9a-28c0-4245-93b5-ea0fa371ff24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb723f191b0e4ada83bb5207501dff99', 'request_id': 'req-f040ae9a-28c0-4245-93b5-ea0fa371ff24'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:29.356440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f040ae9a-28c0-4245-93b5-ea0fa371ff24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb723f191b0e4ada83bb5207501dff99', 'request_id': 'req-f040ae9a-28c0-4245-93b5-ea0fa371ff24'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:29.377513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f040ae9a-28c0-4245-93b5-ea0fa371ff24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb723f191b0e4ada83bb5207501dff99', 'request_id': 'req-f040ae9a-28c0-4245-93b5-ea0fa371ff24'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:29.407147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f040ae9a-28c0-4245-93b5-ea0fa371ff24 admin admin] The token cache is being invalidate because project bb723f191b0e4ada83bb5207501dff99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:55:29.407376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f040ae9a-28c0-4245-93b5-ea0fa371ff24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:29.410374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f040ae9a-28c0-4245-93b5-ea0fa371ff24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:29.425407 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3718/7435] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:55:28 2022] DELETE /identity/v3/projects/bb723f191b0e4ada83bb5207501dff99 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:29.429196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8084f-ccbe-4777-a07c-7d428a8ca825 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:29.461026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8084f-ccbe-4777-a07c-7d428a8ca825 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:29.618136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:29.717537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69015b-2650-4b13-b4d2-d7374497aaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:29.718808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69015b-2650-4b13-b4d2-d7374497aaea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:29.719089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69015b-2650-4b13-b4d2-d7374497aaea admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:29.719362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69015b-2650-4b13-b4d2-d7374497aaea admin admin] PATH_INFO: `/v3/users/730261e10eb04422bbefca8542617caa` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:29.722382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69015b-2650-4b13-b4d2-d7374497aaea admin admin] RBAC: Authorizing `identity:delete_user(user_id=730261e10eb04422bbefca8542617caa)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:29.724334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69015b-2650-4b13-b4d2-d7374497aaea admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:30.032266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4b69015b-2650-4b13-b4d2-d7374497aaea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '730261e10eb04422bbefca8542617caa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:30.033007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4b69015b-2650-4b13-b4d2-d7374497aaea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '730261e10eb04422bbefca8542617caa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:30.057316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4b69015b-2650-4b13-b4d2-d7374497aaea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '730261e10eb04422bbefca8542617caa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:30.086429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4b69015b-2650-4b13-b4d2-d7374497aaea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '730261e10eb04422bbefca8542617caa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:30.087474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4b69015b-2650-4b13-b4d2-d7374497aaea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '730261e10eb04422bbefca8542617caa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:30.197616 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3718/7436] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:55:29 2022] DELETE /identity/v3/users/730261e10eb04422bbefca8542617caa => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:32.272606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040ae9a-28c0-4245-93b5-ea0fa371ff24 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:32.274287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f040ae9a-28c0-4245-93b5-ea0fa371ff24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:32.307044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040ae9a-28c0-4245-93b5-ea0fa371ff24 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:32.509704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42578655-6ecd-41a9-a495-9881719132b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:32.510397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42578655-6ecd-41a9-a495-9881719132b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:32.510696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42578655-6ecd-41a9-a495-9881719132b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:32.510966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42578655-6ecd-41a9-a495-9881719132b7 admin admin] PATH_INFO: `/v3/users/8fb728e226a54aeead486770f920594c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:32.512917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42578655-6ecd-41a9-a495-9881719132b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fb728e226a54aeead486770f920594c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:32.515494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42578655-6ecd-41a9-a495-9881719132b7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:32.853627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42578655-6ecd-41a9-a495-9881719132b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fb728e226a54aeead486770f920594c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:32.854713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42578655-6ecd-41a9-a495-9881719132b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fb728e226a54aeead486770f920594c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:32.875205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42578655-6ecd-41a9-a495-9881719132b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fb728e226a54aeead486770f920594c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:32.919629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42578655-6ecd-41a9-a495-9881719132b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fb728e226a54aeead486770f920594c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:33.009831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42578655-6ecd-41a9-a495-9881719132b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fb728e226a54aeead486770f920594c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:33.033465 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3719/7437] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:55:32 2022] DELETE /identity/v3/users/8fb728e226a54aeead486770f920594c => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:33.039536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0384002-a59a-4d19-859b-3551b697f131 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:33.045421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0384002-a59a-4d19-859b-3551b697f131 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:33.045421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0384002-a59a-4d19-859b-3551b697f131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:33.122668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e0384002-a59a-4d19-859b-3551b697f131 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:33.124050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e0384002-a59a-4d19-859b-3551b697f131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:33.327228 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3719/7438] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:33.354622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42578655-6ecd-41a9-a495-9881719132b7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:33.356392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-42578655-6ecd-41a9-a495-9881719132b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:33.420781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0384002-a59a-4d19-859b-3551b697f131 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:33.422596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e0384002-a59a-4d19-859b-3551b697f131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:33.460597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0384002-a59a-4d19-859b-3551b697f131 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:33.478231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4dfb6-ac5e-4877-a975-b0ba0425f3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:33.482814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4dfb6-ac5e-4877-a975-b0ba0425f3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:33.483330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4dfb6-ac5e-4877-a975-b0ba0425f3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:33.485691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4dfb6-ac5e-4877-a975-b0ba0425f3d1 admin admin] PATH_INFO: `/v3/projects/f35414e83bdb488199e8b7e1309f43b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:33.490622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4dfb6-ac5e-4877-a975-b0ba0425f3d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f35414e83bdb488199e8b7e1309f43b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:33.496850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:33.500972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4dfb6-ac5e-4877-a975-b0ba0425f3d1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:33.566147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42578655-6ecd-41a9-a495-9881719132b7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:33.576652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bd6c3-98e7-48a0-a715-530eea52e548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:33.577160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bd6c3-98e7-48a0-a715-530eea52e548 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:33.583050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bd6c3-98e7-48a0-a715-530eea52e548 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:33.583392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bd6c3-98e7-48a0-a715-530eea52e548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:33.624954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bd6c3-98e7-48a0-a715-530eea52e548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:33.626722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bd6c3-98e7-48a0-a715-530eea52e548 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:33.641965 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3720/7439] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:55:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:55:33.693543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:33.694901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-48c4dfb6-ac5e-4877-a975-b0ba0425f3d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f35414e83bdb488199e8b7e1309f43b7', 'request_id': 'req-48c4dfb6-ac5e-4877-a975-b0ba0425f3d1'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:33.709665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-48c4dfb6-ac5e-4877-a975-b0ba0425f3d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f35414e83bdb488199e8b7e1309f43b7', 'request_id': 'req-48c4dfb6-ac5e-4877-a975-b0ba0425f3d1'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:33.742819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041415f5-9998-48e3-9731-800949b4fcec None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:33.742819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041415f5-9998-48e3-9731-800949b4fcec None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:33.742819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041415f5-9998-48e3-9731-800949b4fcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:33.751122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-48c4dfb6-ac5e-4877-a975-b0ba0425f3d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f35414e83bdb488199e8b7e1309f43b7', 'request_id': 'req-48c4dfb6-ac5e-4877-a975-b0ba0425f3d1'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:33.805741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-041415f5-9998-48e3-9731-800949b4fcec None None] MFA Rules not processed for user `a4dcd71f6bb74da08c93017ecfdda6cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:33.805741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-041415f5-9998-48e3-9731-800949b4fcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:33.871560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-48c4dfb6-ac5e-4877-a975-b0ba0425f3d1 admin admin] The token cache is being invalidate because project f35414e83bdb488199e8b7e1309f43b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:55:33.872045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-48c4dfb6-ac5e-4877-a975-b0ba0425f3d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:33.874964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-48c4dfb6-ac5e-4877-a975-b0ba0425f3d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:33.878129 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3720/7440] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:55:33 2022] DELETE /identity/v3/projects/f35414e83bdb488199e8b7e1309f43b7 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:33.885442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751309d-04a8-4a0f-a7d1-93facddf0156 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:33.885972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751309d-04a8-4a0f-a7d1-93facddf0156 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:33.895341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751309d-04a8-4a0f-a7d1-93facddf0156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:33.915548 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3721/7441] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:33.937823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041415f5-9998-48e3-9731-800949b4fcec None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:33.939983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-041415f5-9998-48e3-9731-800949b4fcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:33.947031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6751309d-04a8-4a0f-a7d1-93facddf0156 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:33.950022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6751309d-04a8-4a0f-a7d1-93facddf0156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:34.153377 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3721/7442] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:34.203181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2ff95-e86d-414a-9a84-1295715fa68b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:34.203366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2ff95-e86d-414a-9a84-1295715fa68b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:34.207147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2ff95-e86d-414a-9a84-1295715fa68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:34.218482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041415f5-9998-48e3-9731-800949b4fcec None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:34.245520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654a0f4-eef0-4f20-84c2-88ac407ab21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:34.246193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654a0f4-eef0-4f20-84c2-88ac407ab21a admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:34.246485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654a0f4-eef0-4f20-84c2-88ac407ab21a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:34.246765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654a0f4-eef0-4f20-84c2-88ac407ab21a admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:34.247433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654a0f4-eef0-4f20-84c2-88ac407ab21a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:34.248787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-13e2ff95-e86d-414a-9a84-1295715fa68b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:34.251977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-13e2ff95-e86d-414a-9a84-1295715fa68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:34.256020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654a0f4-eef0-4f20-84c2-88ac407ab21a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:34.262782 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3722/7443] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:34.267259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2ff95-e86d-414a-9a84-1295715fa68b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:34.279025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2ff95-e86d-414a-9a84-1295715fa68b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:34.287883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a396c-6da8-45d4-9b9e-119587a987db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:34.288760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a396c-6da8-45d4-9b9e-119587a987db admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:34.289210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a396c-6da8-45d4-9b9e-119587a987db admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:34.291451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a396c-6da8-45d4-9b9e-119587a987db admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:34.292341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a396c-6da8-45d4-9b9e-119587a987db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:55:34.292853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a396c-6da8-45d4-9b9e-119587a987db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:34.296273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a396c-6da8-45d4-9b9e-119587a987db admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:34.347162 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3723/7444] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:55:34.351111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a396c-6da8-45d4-9b9e-119587a987db admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:34.378291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a396c-6da8-45d4-9b9e-119587a987db admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:34.407011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0aec9-9d25-4e7b-8a9c-86f5c5db64e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:34.407944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0aec9-9d25-4e7b-8a9c-86f5c5db64e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:34.408391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0aec9-9d25-4e7b-8a9c-86f5c5db64e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:34.408826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0aec9-9d25-4e7b-8a9c-86f5c5db64e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:34.409643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0aec9-9d25-4e7b-8a9c-86f5c5db64e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:34.411858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0aec9-9d25-4e7b-8a9c-86f5c5db64e9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:34.421374 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3722/7445] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:55:33 2022] POST /identity/v3/users => generated 288 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:55:34.423309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654a0f4-eef0-4f20-84c2-88ac407ab21a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:34.454250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654a0f4-eef0-4f20-84c2-88ac407ab21a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:34.471002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc60fa8-4cb8-404c-912b-9988b0448234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:34.472784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc60fa8-4cb8-404c-912b-9988b0448234 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:34.473071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc60fa8-4cb8-404c-912b-9988b0448234 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:34.473352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc60fa8-4cb8-404c-912b-9988b0448234 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:34.476241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc60fa8-4cb8-404c-912b-9988b0448234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:34.481194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc60fa8-4cb8-404c-912b-9988b0448234 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:34.521146 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3723/7446] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:55:34.533414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc60fa8-4cb8-404c-912b-9988b0448234 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:34.545832 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3724/7447] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:55:34 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:55:34.555823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0aec9-9d25-4e7b-8a9c-86f5c5db64e9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:34.589441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc60fa8-4cb8-404c-912b-9988b0448234 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:34.721615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0aec9-9d25-4e7b-8a9c-86f5c5db64e9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:34.752189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fba6d1-7b39-4f6b-bbf8-03abfa003e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:34.753296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fba6d1-7b39-4f6b-bbf8-03abfa003e4a admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:34.753967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fba6d1-7b39-4f6b-bbf8-03abfa003e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:34.754505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fba6d1-7b39-4f6b-bbf8-03abfa003e4a admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:34.757959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fba6d1-7b39-4f6b-bbf8-03abfa003e4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:34.763631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fba6d1-7b39-4f6b-bbf8-03abfa003e4a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:34.812396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ffc26-024f-4d83-9b5b-d2c7b7abeff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:34.813254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ffc26-024f-4d83-9b5b-d2c7b7abeff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:34.813551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ffc26-024f-4d83-9b5b-d2c7b7abeff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:34.816360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ffc26-024f-4d83-9b5b-d2c7b7abeff3 admin admin] PATH_INFO: `/v3/system/users/eeb7fe680706494b8b0b9b5477b08afd/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:34.865748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ffc26-024f-4d83-9b5b-d2c7b7abeff3 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=eeb7fe680706494b8b0b9b5477b08afd, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:34.866918 n-d-862769-1 devstack@keystone.service[82179]: WARNING py.warnings [None req-160ffc26-024f-4d83-9b5b-d2c7b7abeff3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 03:55:34.866918 n-d-862769-1 devstack@keystone.service[82179]: warnings.warn(msg) Oct 27 03:55:34.866918 n-d-862769-1 devstack@keystone.service[82179]: Oct 27 03:55:34.867857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ffc26-024f-4d83-9b5b-d2c7b7abeff3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:34.886056 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3725/7448] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:55:34 2022] POST /identity/v3/users => generated 292 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:55:34.887179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fba6d1-7b39-4f6b-bbf8-03abfa003e4a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:34.891654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-24fba6d1-7b39-4f6b-bbf8-03abfa003e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:34.919365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fba6d1-7b39-4f6b-bbf8-03abfa003e4a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:34.933243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff36bc-5623-4687-83c4-4d1734de94bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:34.933935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff36bc-5623-4687-83c4-4d1734de94bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:34.934234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff36bc-5623-4687-83c4-4d1734de94bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:34.934601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff36bc-5623-4687-83c4-4d1734de94bd admin admin] PATH_INFO: `/v3/projects/ab756040cec04e998730d81759e19aaf` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:34.937216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff36bc-5623-4687-83c4-4d1734de94bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab756040cec04e998730d81759e19aaf)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:34.939294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff36bc-5623-4687-83c4-4d1734de94bd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:34.983461 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3724/7449] 10.222.0.20 () {60 vars in 1378 bytes} [Thu Oct 27 03:55:34 2022] PUT /identity/v3/system/users/eeb7fe680706494b8b0b9b5477b08afd/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:34.984607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ffc26-024f-4d83-9b5b-d2c7b7abeff3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:35.003862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ffc26-024f-4d83-9b5b-d2c7b7abeff3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:35.017953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a2280-07b5-4632-9678-f59387d3c524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:35.018655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a2280-07b5-4632-9678-f59387d3c524 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:35.018944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a2280-07b5-4632-9678-f59387d3c524 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:35.019231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a2280-07b5-4632-9678-f59387d3c524 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:35.019898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a2280-07b5-4632-9678-f59387d3c524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:35.023968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a2280-07b5-4632-9678-f59387d3c524 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:35.051260 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3725/7450] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:55:35.055412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6b2d7-9bad-4845-bff2-1b9edc2fb696 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:35.055412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6b2d7-9bad-4845-bff2-1b9edc2fb696 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:35.055825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6b2d7-9bad-4845-bff2-1b9edc2fb696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:35.127458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-51c6b2d7-9bad-4845-bff2-1b9edc2fb696 None None] MFA Rules not processed for user `eeb7fe680706494b8b0b9b5477b08afd`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:35.131121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-51c6b2d7-9bad-4845-bff2-1b9edc2fb696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:35.157669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5cff36bc-5623-4687-83c4-4d1734de94bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab756040cec04e998730d81759e19aaf', 'request_id': 'req-5cff36bc-5623-4687-83c4-4d1734de94bd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:35.165241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5cff36bc-5623-4687-83c4-4d1734de94bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab756040cec04e998730d81759e19aaf', 'request_id': 'req-5cff36bc-5623-4687-83c4-4d1734de94bd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:35.213183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5cff36bc-5623-4687-83c4-4d1734de94bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab756040cec04e998730d81759e19aaf', 'request_id': 'req-5cff36bc-5623-4687-83c4-4d1734de94bd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:35.272661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:35.308038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5cff36bc-5623-4687-83c4-4d1734de94bd admin admin] The token cache is being invalidate because project ab756040cec04e998730d81759e19aaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:55:35.308340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5cff36bc-5623-4687-83c4-4d1734de94bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:35.309727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5cff36bc-5623-4687-83c4-4d1734de94bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:35.315875 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3726/7451] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:55:34 2022] DELETE /identity/v3/projects/ab756040cec04e998730d81759e19aaf => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:35.316957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff36bc-5623-4687-83c4-4d1734de94bd admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:35.321255 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3726/7452] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:35 2022] POST /identity/v3/auth/tokens => generated 2415 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 03:55:35.321255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6b2d7-9bad-4845-bff2-1b9edc2fb696 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:35.326278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5cff36bc-5623-4687-83c4-4d1734de94bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:35.338429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:35.504450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff36bc-5623-4687-83c4-4d1734de94bd admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:35.524876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf3f51-5942-461b-92a9-67283b3a8940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:35.525549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf3f51-5942-461b-92a9-67283b3a8940 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:35.525831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf3f51-5942-461b-92a9-67283b3a8940 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:35.528861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf3f51-5942-461b-92a9-67283b3a8940 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:35.535013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf3f51-5942-461b-92a9-67283b3a8940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:35.535013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf3f51-5942-461b-92a9-67283b3a8940 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:35.541669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6b2d7-9bad-4845-bff2-1b9edc2fb696 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:35.553092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36093d8f-da0a-45cf-b1a4-4f056311e1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:35.554370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36093d8f-da0a-45cf-b1a4-4f056311e1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:35.555378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36093d8f-da0a-45cf-b1a4-4f056311e1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:35.555378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36093d8f-da0a-45cf-b1a4-4f056311e1b8 admin admin] PATH_INFO: `/v3/users/c895006c31b542f5a15acad26d85a065` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:35.560132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36093d8f-da0a-45cf-b1a4-4f056311e1b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c895006c31b542f5a15acad26d85a065)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:35.563346 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3727/7453] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:55:35.564358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf3f51-5942-461b-92a9-67283b3a8940 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:35.565129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36093d8f-da0a-45cf-b1a4-4f056311e1b8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:35.568336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0fdf3f51-5942-461b-92a9-67283b3a8940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:35.921914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-36093d8f-da0a-45cf-b1a4-4f056311e1b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c895006c31b542f5a15acad26d85a065'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:35.924958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-36093d8f-da0a-45cf-b1a4-4f056311e1b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c895006c31b542f5a15acad26d85a065'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:35.944553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-36093d8f-da0a-45cf-b1a4-4f056311e1b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c895006c31b542f5a15acad26d85a065'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:35.973665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-36093d8f-da0a-45cf-b1a4-4f056311e1b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c895006c31b542f5a15acad26d85a065'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:35.982743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf3f51-5942-461b-92a9-67283b3a8940 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:36.035331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63dba2-80d0-46f4-a5ce-d2f4ebc22d2a None tempest-ImageQuotaTest-1393071730-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb7fe680706494b8b0b9b5477b08afd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:36.037520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63dba2-80d0-46f4-a5ce-d2f4ebc22d2a None tempest-ImageQuotaTest-1393071730-system-admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:36.039340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63dba2-80d0-46f4-a5ce-d2f4ebc22d2a None tempest-ImageQuotaTest-1393071730-system-admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:36.039763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63dba2-80d0-46f4-a5ce-d2f4ebc22d2a None tempest-ImageQuotaTest-1393071730-system-admin] PATH_INFO: `/v3/services` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:36.040618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63dba2-80d0-46f4-a5ce-d2f4ebc22d2a None tempest-ImageQuotaTest-1393071730-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:36.044033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63dba2-80d0-46f4-a5ce-d2f4ebc22d2a None tempest-ImageQuotaTest-1393071730-system-admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:36.059753 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3728/7454] 10.222.0.20 () {58 vars in 1110 bytes} [Thu Oct 27 03:55:35 2022] GET /identity/v3/services => generated 2191 bytes in 496 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:55:36.060925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63dba2-80d0-46f4-a5ce-d2f4ebc22d2a None tempest-ImageQuotaTest-1393071730-system-admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:36.065329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5b63dba2-80d0-46f4-a5ce-d2f4ebc22d2a None tempest-ImageQuotaTest-1393071730-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:36.070405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-36093d8f-da0a-45cf-b1a4-4f056311e1b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c895006c31b542f5a15acad26d85a065'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:36.077432 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3727/7455] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:55:35 2022] DELETE /identity/v3/users/c895006c31b542f5a15acad26d85a065 => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:36.081217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36093d8f-da0a-45cf-b1a4-4f056311e1b8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:36.084157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-36093d8f-da0a-45cf-b1a4-4f056311e1b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:36.118967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63dba2-80d0-46f4-a5ce-d2f4ebc22d2a None tempest-ImageQuotaTest-1393071730-system-admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:36.352144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c39508-557b-4888-8dca-1f4e91331033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:36.375392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c39508-557b-4888-8dca-1f4e91331033 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:36.375959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c39508-557b-4888-8dca-1f4e91331033 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:36.376404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c39508-557b-4888-8dca-1f4e91331033 admin admin] PATH_INFO: `/v3/projects/2d7741de3c02497eab44ed0e182a3504/users/2575a74b596f4c368ec565b11a2cd1f7/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:36.432991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c39508-557b-4888-8dca-1f4e91331033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7741de3c02497eab44ed0e182a3504, user_id=2575a74b596f4c368ec565b11a2cd1f7, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:36.441872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c39508-557b-4888-8dca-1f4e91331033 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:36.459350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:36.559462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36093d8f-da0a-45cf-b1a4-4f056311e1b8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:36.610674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df0e71-6547-488f-85cf-d6de1627df73 None tempest-ImageQuotaTest-1393071730-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb7fe680706494b8b0b9b5477b08afd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:36.611410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df0e71-6547-488f-85cf-d6de1627df73 None tempest-ImageQuotaTest-1393071730-system-admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:36.611690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df0e71-6547-488f-85cf-d6de1627df73 None tempest-ImageQuotaTest-1393071730-system-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:36.611972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df0e71-6547-488f-85cf-d6de1627df73 None tempest-ImageQuotaTest-1393071730-system-admin] PATH_INFO: `/v3/limits` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:36.612657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df0e71-6547-488f-85cf-d6de1627df73 None tempest-ImageQuotaTest-1393071730-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:36.615208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df0e71-6547-488f-85cf-d6de1627df73 None tempest-ImageQuotaTest-1393071730-system-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:36.642498 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3729/7456] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:55:36 2022] PUT /identity/v3/projects/2d7741de3c02497eab44ed0e182a3504/users/2575a74b596f4c368ec565b11a2cd1f7/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:36.657397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3c3ff-11d7-4be2-803e-13b7b9ecb954 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:36.661816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3c3ff-11d7-4be2-803e-13b7b9ecb954 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:36.661816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3c3ff-11d7-4be2-803e-13b7b9ecb954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:36.733268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a8f3c3ff-11d7-4be2-803e-13b7b9ecb954 None None] MFA Rules not processed for user `2575a74b596f4c368ec565b11a2cd1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:36.735958 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application [None req-17df0e71-6547-488f-85cf-d6de1627df73 None tempest-ImageQuotaTest-1393071730-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 27 03:55:36.735958 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 03:55:36.735958 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 03:55:36.735958 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 03:55:36.735958 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 03:55:36.735958 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 03:55:36.735958 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 03:55:36.735958 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 03:55:36.735958 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 03:55:36.735958 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 03:55:36.735958 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 03:55:36.735958 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 03:55:36.735958 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Oct 27 03:55:36.735958 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Oct 27 03:55:36.737100 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 03:55:36.737100 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 03:55:36.737100 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Oct 27 03:55:36.737100 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Oct 27 03:55:36.737100 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 27 03:55:36.737100 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 27 03:55:36.737100 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Oct 27 03:55:36.737100 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Oct 27 03:55:36.737100 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Oct 27 03:55:36.737100 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application raise exception.NoLimitReference Oct 27 03:55:36.737100 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 27 03:55:36.737100 n-d-862769-1 devstack@keystone.service[82179]: ERROR keystone.server.flask.application Oct 27 03:55:36.737962 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3728/7457] 10.222.0.20 () {60 vars in 1126 bytes} [Thu Oct 27 03:55:36 2022] POST /identity/v3/limits => generated 124 bytes in 660 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 27 03:55:36.739452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a8f3c3ff-11d7-4be2-803e-13b7b9ecb954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:36.743723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df0e71-6547-488f-85cf-d6de1627df73 None tempest-ImageQuotaTest-1393071730-system-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:36.883518 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3730/7458] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:36.892009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3c3ff-11d7-4be2-803e-13b7b9ecb954 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:36.992288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df0e71-6547-488f-85cf-d6de1627df73 None tempest-ImageQuotaTest-1393071730-system-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:37.068467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3c3ff-11d7-4be2-803e-13b7b9ecb954 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:37.079032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a02520-7eb9-4291-bfbb-ab047c8bda0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:37.079794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a02520-7eb9-4291-bfbb-ab047c8bda0c admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:37.080148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a02520-7eb9-4291-bfbb-ab047c8bda0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:37.080493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a02520-7eb9-4291-bfbb-ab047c8bda0c admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:37.081193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a02520-7eb9-4291-bfbb-ab047c8bda0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:37.083219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a02520-7eb9-4291-bfbb-ab047c8bda0c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:37.091722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04d6c7-33ba-4275-8f9f-6b15279aacb4 None tempest-ImageQuotaTest-1393071730-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb7fe680706494b8b0b9b5477b08afd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:37.092563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04d6c7-33ba-4275-8f9f-6b15279aacb4 None tempest-ImageQuotaTest-1393071730-system-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:37.093443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04d6c7-33ba-4275-8f9f-6b15279aacb4 None tempest-ImageQuotaTest-1393071730-system-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:37.093689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04d6c7-33ba-4275-8f9f-6b15279aacb4 None tempest-ImageQuotaTest-1393071730-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:37.094357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04d6c7-33ba-4275-8f9f-6b15279aacb4 None tempest-ImageQuotaTest-1393071730-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:37.095657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04d6c7-33ba-4275-8f9f-6b15279aacb4 None tempest-ImageQuotaTest-1393071730-system-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:37.135909 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3729/7459] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:55:36 2022] GET /identity/v3/registered_limits => generated 129 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:55:37.141699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04d6c7-33ba-4275-8f9f-6b15279aacb4 None tempest-ImageQuotaTest-1393071730-system-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:37.212110 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3731/7460] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:55:36 2022] POST /identity/v3/projects => generated 379 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:55:37.221043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a02520-7eb9-4291-bfbb-ab047c8bda0c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:37.321054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a02520-7eb9-4291-bfbb-ab047c8bda0c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:37.328048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82747931-ac12-467d-8c18-ca18240bdc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:37.329116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82747931-ac12-467d-8c18-ca18240bdc82 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:37.329576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82747931-ac12-467d-8c18-ca18240bdc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:37.330018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82747931-ac12-467d-8c18-ca18240bdc82 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:37.330921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82747931-ac12-467d-8c18-ca18240bdc82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:37.334112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82747931-ac12-467d-8c18-ca18240bdc82 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:37.443404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:37.454664 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3732/7461] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:55:37 2022] POST /identity/v3/users => generated 296 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:55:37.455886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04d6c7-33ba-4275-8f9f-6b15279aacb4 None tempest-ImageQuotaTest-1393071730-system-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:37.459121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82747931-ac12-467d-8c18-ca18240bdc82 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:37.541699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82747931-ac12-467d-8c18-ca18240bdc82 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:37.545033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c3f83-1c68-4020-bd77-c5a2e397ec6f None tempest-ImageQuotaTest-1393071730-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb7fe680706494b8b0b9b5477b08afd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:37.546801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c3f83-1c68-4020-bd77-c5a2e397ec6f None tempest-ImageQuotaTest-1393071730-system-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:37.557668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c3f83-1c68-4020-bd77-c5a2e397ec6f None tempest-ImageQuotaTest-1393071730-system-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:37.557668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c3f83-1c68-4020-bd77-c5a2e397ec6f None tempest-ImageQuotaTest-1393071730-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:37.557668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c3f83-1c68-4020-bd77-c5a2e397ec6f None tempest-ImageQuotaTest-1393071730-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:37.557668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c3f83-1c68-4020-bd77-c5a2e397ec6f None tempest-ImageQuotaTest-1393071730-system-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:37.558435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad302d-e7dd-4630-a4d9-664d20ecfc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:37.558435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad302d-e7dd-4630-a4d9-664d20ecfc97 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:37.558435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad302d-e7dd-4630-a4d9-664d20ecfc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:37.559208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad302d-e7dd-4630-a4d9-664d20ecfc97 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:37.560325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad302d-e7dd-4630-a4d9-664d20ecfc97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:37.562162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad302d-e7dd-4630-a4d9-664d20ecfc97 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:37.563737 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3730/7462] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:55:37 2022] GET /identity/v3/registered_limits => generated 129 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:55:37.635249 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3733/7463] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:55:37.639444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c3f83-1c68-4020-bd77-c5a2e397ec6f None tempest-ImageQuotaTest-1393071730-system-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:37.680705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad302d-e7dd-4630-a4d9-664d20ecfc97 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:37.682732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8dad302d-e7dd-4630-a4d9-664d20ecfc97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:37.683146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c3f83-1c68-4020-bd77-c5a2e397ec6f None tempest-ImageQuotaTest-1393071730-system-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:37.700589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f78ab-0248-45d1-9255-bea3ff618cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:37.701292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f78ab-0248-45d1-9255-bea3ff618cbf admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:37.701581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f78ab-0248-45d1-9255-bea3ff618cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:37.701862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f78ab-0248-45d1-9255-bea3ff618cbf admin admin] PATH_INFO: `/v3/projects/03c890496d974f97893d6e9752db2dff/users/9ebc82e120a14b899f18b4d24a93cd90/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:37.714585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad302d-e7dd-4630-a4d9-664d20ecfc97 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:37.731327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52dc0ae-73f7-4502-a75b-814fdc25a592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:37.755680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dc0ae-73f7-4502-a75b-814fdc25a592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:37.756051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dc0ae-73f7-4502-a75b-814fdc25a592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:37.756441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dc0ae-73f7-4502-a75b-814fdc25a592 admin admin] PATH_INFO: `/v3/projects/0da8c38d61464b24b8e93b46b9943eac` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:37.761169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f78ab-0248-45d1-9255-bea3ff618cbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=03c890496d974f97893d6e9752db2dff, user_id=9ebc82e120a14b899f18b4d24a93cd90, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:37.777424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52dc0ae-73f7-4502-a75b-814fdc25a592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0da8c38d61464b24b8e93b46b9943eac)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:37.777424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52dc0ae-73f7-4502-a75b-814fdc25a592 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:37.786935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f78ab-0248-45d1-9255-bea3ff618cbf admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:37.910679 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3731/7464] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:55:37 2022] PUT /identity/v3/projects/03c890496d974f97893d6e9752db2dff/users/9ebc82e120a14b899f18b4d24a93cd90/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:37.911681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f78ab-0248-45d1-9255-bea3ff618cbf admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:37.977762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a52dc0ae-73f7-4502-a75b-814fdc25a592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0da8c38d61464b24b8e93b46b9943eac', 'request_id': 'req-a52dc0ae-73f7-4502-a75b-814fdc25a592'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:37.998614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a52dc0ae-73f7-4502-a75b-814fdc25a592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0da8c38d61464b24b8e93b46b9943eac', 'request_id': 'req-a52dc0ae-73f7-4502-a75b-814fdc25a592'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:38.018814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a52dc0ae-73f7-4502-a75b-814fdc25a592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0da8c38d61464b24b8e93b46b9943eac', 'request_id': 'req-a52dc0ae-73f7-4502-a75b-814fdc25a592'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:38.115316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a52dc0ae-73f7-4502-a75b-814fdc25a592 admin admin] The token cache is being invalidate because project 0da8c38d61464b24b8e93b46b9943eac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:55:38.115316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a52dc0ae-73f7-4502-a75b-814fdc25a592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:38.116194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a52dc0ae-73f7-4502-a75b-814fdc25a592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:38.116594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f78ab-0248-45d1-9255-bea3ff618cbf admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:38.119385 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3734/7465] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:55:37 2022] DELETE /identity/v3/projects/0da8c38d61464b24b8e93b46b9943eac => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:38.124033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ca39a-9bd3-420f-8ab0-4e0fa3f7b292 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:38.125141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ca39a-9bd3-420f-8ab0-4e0fa3f7b292 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:38.125584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ca39a-9bd3-420f-8ab0-4e0fa3f7b292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:38.185282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a04ca39a-9bd3-420f-8ab0-4e0fa3f7b292 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:38.188602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a04ca39a-9bd3-420f-8ab0-4e0fa3f7b292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:38.288021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c512ab0-35dd-4911-a379-7fb1291d1747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:38.288963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c512ab0-35dd-4911-a379-7fb1291d1747 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:38.289413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c512ab0-35dd-4911-a379-7fb1291d1747 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:38.290700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c512ab0-35dd-4911-a379-7fb1291d1747 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:38.291600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c512ab0-35dd-4911-a379-7fb1291d1747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:38.294272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c512ab0-35dd-4911-a379-7fb1291d1747 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:38.313929 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3732/7466] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:55:38.318519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c512ab0-35dd-4911-a379-7fb1291d1747 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:38.322697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9c512ab0-35dd-4911-a379-7fb1291d1747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:38.344727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c512ab0-35dd-4911-a379-7fb1291d1747 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:38.358418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8c369-c4a8-47e1-babf-65dbdfbb868a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:38.361116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8c369-c4a8-47e1-babf-65dbdfbb868a admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:38.361406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8c369-c4a8-47e1-babf-65dbdfbb868a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:38.361719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8c369-c4a8-47e1-babf-65dbdfbb868a admin admin] PATH_INFO: `/v3/projects/03c890496d974f97893d6e9752db2dff/users/9ebc82e120a14b899f18b4d24a93cd90/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:38.364136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8c369-c4a8-47e1-babf-65dbdfbb868a admin admin] RBAC: Authorizing `identity:create_grant(project_id=03c890496d974f97893d6e9752db2dff, user_id=9ebc82e120a14b899f18b4d24a93cd90, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:38.367170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8c369-c4a8-47e1-babf-65dbdfbb868a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:38.381372 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3733/7467] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:55:38 2022] PUT /identity/v3/projects/03c890496d974f97893d6e9752db2dff/users/9ebc82e120a14b899f18b4d24a93cd90/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:38.391786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a747359-e5b9-4412-9fc7-201b57f574ee None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:38.391978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a747359-e5b9-4412-9fc7-201b57f574ee None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:38.392262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a747359-e5b9-4412-9fc7-201b57f574ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:38.413226 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3735/7468] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:38.417510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b41b00-c4b7-41a4-8e61-22900ef1a380 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:38.421552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b41b00-c4b7-41a4-8e61-22900ef1a380 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:38.421928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b41b00-c4b7-41a4-8e61-22900ef1a380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:38.464674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e8b41b00-c4b7-41a4-8e61-22900ef1a380 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:38.466304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-2a747359-e5b9-4412-9fc7-201b57f574ee None None] MFA Rules not processed for user `9ebc82e120a14b899f18b4d24a93cd90`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:38.467547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2a747359-e5b9-4412-9fc7-201b57f574ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:38.470177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e8b41b00-c4b7-41a4-8e61-22900ef1a380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:38.471867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:38.596084 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3736/7469] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:38.600292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b41b00-c4b7-41a4-8e61-22900ef1a380 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:38.617757 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3734/7470] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:38.621061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b41b00-c4b7-41a4-8e61-22900ef1a380 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:38.628406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a747359-e5b9-4412-9fc7-201b57f574ee None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:38.630715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8431c6-193b-4b1d-b38d-89c53653dea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:38.632168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8431c6-193b-4b1d-b38d-89c53653dea9 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:38.632286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2a747359-e5b9-4412-9fc7-201b57f574ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:38.632382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8431c6-193b-4b1d-b38d-89c53653dea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:38.632382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8431c6-193b-4b1d-b38d-89c53653dea9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:38.632640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8431c6-193b-4b1d-b38d-89c53653dea9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:55:38.634199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8431c6-193b-4b1d-b38d-89c53653dea9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:38.635917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8431c6-193b-4b1d-b38d-89c53653dea9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:38.670679 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3737/7471] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:55:38.672361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8431c6-193b-4b1d-b38d-89c53653dea9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:38.688648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8431c6-193b-4b1d-b38d-89c53653dea9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:38.703557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b37938-a7db-468c-b574-e4a49a5e6c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:38.707746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b37938-a7db-468c-b574-e4a49a5e6c15 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:38.707746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b37938-a7db-468c-b574-e4a49a5e6c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:38.707746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b37938-a7db-468c-b574-e4a49a5e6c15 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:38.707746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b37938-a7db-468c-b574-e4a49a5e6c15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:38.707746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b37938-a7db-468c-b574-e4a49a5e6c15 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:38.778574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a747359-e5b9-4412-9fc7-201b57f574ee None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:38.792530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98da3a8-ec88-4521-8176-fcc0f63e15d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:38.793169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98da3a8-ec88-4521-8176-fcc0f63e15d4 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:38.793728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98da3a8-ec88-4521-8176-fcc0f63e15d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:38.798739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98da3a8-ec88-4521-8176-fcc0f63e15d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:38.800870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d98da3a8-ec88-4521-8176-fcc0f63e15d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:38.831979 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3738/7472] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:55:38 2022] POST /identity/v3/projects => generated 391 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:55:38.832874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b37938-a7db-468c-b574-e4a49a5e6c15 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:39.023891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98da3a8-ec88-4521-8176-fcc0f63e15d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:39.026691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98da3a8-ec88-4521-8176-fcc0f63e15d4 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:39.072542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b37938-a7db-468c-b574-e4a49a5e6c15 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:39.087457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506211b-9037-4860-9bc9-bb0ad76ba1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:39.088215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506211b-9037-4860-9bc9-bb0ad76ba1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:39.088612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506211b-9037-4860-9bc9-bb0ad76ba1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:39.089000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506211b-9037-4860-9bc9-bb0ad76ba1c2 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:39.089532 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3735/7473] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:55:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:55:39.089961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506211b-9037-4860-9bc9-bb0ad76ba1c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:39.096758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506211b-9037-4860-9bc9-bb0ad76ba1c2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:39.237299 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3739/7474] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:55:38 2022] POST /identity/v3/users => generated 296 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:55:39.252677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98da3a8-ec88-4521-8176-fcc0f63e15d4 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:39.279741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98da3a8-ec88-4521-8176-fcc0f63e15d4 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:39.289032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909fa4e-a38b-4fb4-8da2-d1f0c8652b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:39.289825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909fa4e-a38b-4fb4-8da2-d1f0c8652b70 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:39.297099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909fa4e-a38b-4fb4-8da2-d1f0c8652b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:39.297789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909fa4e-a38b-4fb4-8da2-d1f0c8652b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:39.299532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909fa4e-a38b-4fb4-8da2-d1f0c8652b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:39.302888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909fa4e-a38b-4fb4-8da2-d1f0c8652b70 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:39.318085 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3736/7475] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:55:39.321685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506211b-9037-4860-9bc9-bb0ad76ba1c2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:39.351801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506211b-9037-4860-9bc9-bb0ad76ba1c2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:39.357931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f423ec-4a67-482c-84a1-9a7ebd09d98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:39.359539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f423ec-4a67-482c-84a1-9a7ebd09d98d admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:39.360183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f423ec-4a67-482c-84a1-9a7ebd09d98d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:39.360670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f423ec-4a67-482c-84a1-9a7ebd09d98d admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:39.361547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f423ec-4a67-482c-84a1-9a7ebd09d98d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:39.364232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f423ec-4a67-482c-84a1-9a7ebd09d98d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:39.378339 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3740/7476] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:55:39.382558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909fa4e-a38b-4fb4-8da2-d1f0c8652b70 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:39.397387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909fa4e-a38b-4fb4-8da2-d1f0c8652b70 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:39.403805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcf77b-8bdb-4197-85c7-2a79028f0e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:39.408072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcf77b-8bdb-4197-85c7-2a79028f0e79 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:39.409808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcf77b-8bdb-4197-85c7-2a79028f0e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:39.410485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcf77b-8bdb-4197-85c7-2a79028f0e79 admin admin] PATH_INFO: `/v3/projects/81d3e85652304417aae40d26ee595f38/users/07676435ef374a09922c97dbb875bfc3/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:39.434127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbcf77b-8bdb-4197-85c7-2a79028f0e79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d3e85652304417aae40d26ee595f38, user_id=07676435ef374a09922c97dbb875bfc3, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:39.442192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbcf77b-8bdb-4197-85c7-2a79028f0e79 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:39.471388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:39.571600 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3737/7477] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:55:39 2022] PUT /identity/v3/projects/81d3e85652304417aae40d26ee595f38/users/07676435ef374a09922c97dbb875bfc3/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:39.582459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24963952-c699-4d8e-a335-8bb3561aa24b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:39.582782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24963952-c699-4d8e-a335-8bb3561aa24b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:39.583299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24963952-c699-4d8e-a335-8bb3561aa24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:39.634027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-24963952-c699-4d8e-a335-8bb3561aa24b None None] MFA Rules not processed for user `07676435ef374a09922c97dbb875bfc3`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:39.635327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-24963952-c699-4d8e-a335-8bb3561aa24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:39.773795 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3741/7478] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:39.786461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcf77b-8bdb-4197-85c7-2a79028f0e79 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:39.788849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-adbcf77b-8bdb-4197-85c7-2a79028f0e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:39.881853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:39.973569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcf77b-8bdb-4197-85c7-2a79028f0e79 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:39.986978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ef536-7f34-45b6-9d01-15d6497ebfdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:39.987686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ef536-7f34-45b6-9d01-15d6497ebfdd service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:39.987972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ef536-7f34-45b6-9d01-15d6497ebfdd service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:39.988265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ef536-7f34-45b6-9d01-15d6497ebfdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:40.017680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ef536-7f34-45b6-9d01-15d6497ebfdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:40.019227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ef536-7f34-45b6-9d01-15d6497ebfdd service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:40.038064 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3738/7479] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:55:39 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:55:40.179707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:40.492454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:41.333604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:41.761997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:43.327748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd25d4-1012-4636-8de0-6836be14d4b5 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:43.327748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd25d4-1012-4636-8de0-6836be14d4b5 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:43.327748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd25d4-1012-4636-8de0-6836be14d4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:43.375502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-82bd25d4-1012-4636-8de0-6836be14d4b5 None None] MFA Rules not processed for user `a2ea55b400c24827a28e816ea2a225aa`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:43.377326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-82bd25d4-1012-4636-8de0-6836be14d4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:43.468929 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3742/7480] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:48.834897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ef536-7f34-45b6-9d01-15d6497ebfdd service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:48.834897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-567ef536-7f34-45b6-9d01-15d6497ebfdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:49.083911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ef536-7f34-45b6-9d01-15d6497ebfdd service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:49.094801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2775c0-7f60-41e8-a5a1-d6a79da5e5e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:49.095596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2775c0-7f60-41e8-a5a1-d6a79da5e5e9 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:49.096911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2775c0-7f60-41e8-a5a1-d6a79da5e5e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:49.098175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2775c0-7f60-41e8-a5a1-d6a79da5e5e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:49.280731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2775c0-7f60-41e8-a5a1-d6a79da5e5e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:49.282117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2775c0-7f60-41e8-a5a1-d6a79da5e5e9 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:49.344871 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3739/7481] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:55:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:55:50.085081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd25d4-1012-4636-8de0-6836be14d4b5 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:50.086603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-82bd25d4-1012-4636-8de0-6836be14d4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:50.294506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:50.409758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd25d4-1012-4636-8de0-6836be14d4b5 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:50.426200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b662c-a196-486d-950a-c64bc5e4a334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:50.429540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b662c-a196-486d-950a-c64bc5e4a334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:50.429882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b662c-a196-486d-950a-c64bc5e4a334 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:50.430791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b662c-a196-486d-950a-c64bc5e4a334 admin admin] PATH_INFO: `/v3/users/a4dcd71f6bb74da08c93017ecfdda6cc` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:50.434781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b662c-a196-486d-950a-c64bc5e4a334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4dcd71f6bb74da08c93017ecfdda6cc)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:50.437431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b662c-a196-486d-950a-c64bc5e4a334 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:50.677713 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-845b662c-a196-486d-950a-c64bc5e4a334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4dcd71f6bb74da08c93017ecfdda6cc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:50.678500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-845b662c-a196-486d-950a-c64bc5e4a334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4dcd71f6bb74da08c93017ecfdda6cc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:50.724002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-845b662c-a196-486d-950a-c64bc5e4a334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4dcd71f6bb74da08c93017ecfdda6cc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:50.772251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-845b662c-a196-486d-950a-c64bc5e4a334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4dcd71f6bb74da08c93017ecfdda6cc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:50.773171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-845b662c-a196-486d-950a-c64bc5e4a334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4dcd71f6bb74da08c93017ecfdda6cc'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:50.834903 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3743/7482] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:55:50 2022] DELETE /identity/v3/users/a4dcd71f6bb74da08c93017ecfdda6cc => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:50.994325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2775c0-7f60-41e8-a5a1-d6a79da5e5e9 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:51.000192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3a2775c0-7f60-41e8-a5a1-d6a79da5e5e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:51.029861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:51.077238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2775c0-7f60-41e8-a5a1-d6a79da5e5e9 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:51.379617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5bad8-9d0b-4928-96a1-ff99ca142616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:51.380888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5bad8-9d0b-4928-96a1-ff99ca142616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:51.380888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5bad8-9d0b-4928-96a1-ff99ca142616 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:51.381140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5bad8-9d0b-4928-96a1-ff99ca142616 admin admin] PATH_INFO: `/v3/users/d96c445a930244d69e219fa9c3b7a022` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:51.387261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5bad8-9d0b-4928-96a1-ff99ca142616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d96c445a930244d69e219fa9c3b7a022)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:51.394109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5bad8-9d0b-4928-96a1-ff99ca142616 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:51.524778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b662c-a196-486d-950a-c64bc5e4a334 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:51.527266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-845b662c-a196-486d-950a-c64bc5e4a334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:51.578808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b662c-a196-486d-950a-c64bc5e4a334 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:51.600718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ea434-273d-4bd2-8709-f7e10ecb0cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:51.601788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ea434-273d-4bd2-8709-f7e10ecb0cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:51.603718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ea434-273d-4bd2-8709-f7e10ecb0cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:51.604230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ea434-273d-4bd2-8709-f7e10ecb0cf9 admin admin] PATH_INFO: `/v3/projects/d66531c965a94c34be0b2abdd9ae71fb` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:51.606839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ea434-273d-4bd2-8709-f7e10ecb0cf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d66531c965a94c34be0b2abdd9ae71fb)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:51.618278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ea434-273d-4bd2-8709-f7e10ecb0cf9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:51.781912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0cb5bad8-9d0b-4928-96a1-ff99ca142616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd96c445a930244d69e219fa9c3b7a022'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:51.784530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0cb5bad8-9d0b-4928-96a1-ff99ca142616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd96c445a930244d69e219fa9c3b7a022'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:51.805904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0cb5bad8-9d0b-4928-96a1-ff99ca142616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd96c445a930244d69e219fa9c3b7a022'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:51.841241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0cb5bad8-9d0b-4928-96a1-ff99ca142616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd96c445a930244d69e219fa9c3b7a022'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:51.882189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5a2ea434-273d-4bd2-8709-f7e10ecb0cf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd66531c965a94c34be0b2abdd9ae71fb', 'request_id': 'req-5a2ea434-273d-4bd2-8709-f7e10ecb0cf9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:51.898727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5a2ea434-273d-4bd2-8709-f7e10ecb0cf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd66531c965a94c34be0b2abdd9ae71fb', 'request_id': 'req-5a2ea434-273d-4bd2-8709-f7e10ecb0cf9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:51.919145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5a2ea434-273d-4bd2-8709-f7e10ecb0cf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd66531c965a94c34be0b2abdd9ae71fb', 'request_id': 'req-5a2ea434-273d-4bd2-8709-f7e10ecb0cf9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:51.951358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0cb5bad8-9d0b-4928-96a1-ff99ca142616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd96c445a930244d69e219fa9c3b7a022'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:51.979275 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3740/7483] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:55:50 2022] DELETE /identity/v3/users/d96c445a930244d69e219fa9c3b7a022 => generated 0 bytes in 983 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:51.981973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38655a-08c0-4dac-bf6f-4cd00b716809 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:51.985873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38655a-08c0-4dac-bf6f-4cd00b716809 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:51.986530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38655a-08c0-4dac-bf6f-4cd00b716809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:52.048392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5a2ea434-273d-4bd2-8709-f7e10ecb0cf9 admin admin] The token cache is being invalidate because project d66531c965a94c34be0b2abdd9ae71fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:55:52.048866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5a2ea434-273d-4bd2-8709-f7e10ecb0cf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:52.049445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5a2ea434-273d-4bd2-8709-f7e10ecb0cf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:52.056126 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3744/7484] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:55:51 2022] DELETE /identity/v3/projects/d66531c965a94c34be0b2abdd9ae71fb => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:55:52.057493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ea434-273d-4bd2-8709-f7e10ecb0cf9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:52.068183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5a2ea434-273d-4bd2-8709-f7e10ecb0cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:52.104380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-dd38655a-08c0-4dac-bf6f-4cd00b716809 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:52.105670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dd38655a-08c0-4dac-bf6f-4cd00b716809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:52.300541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:52.319275 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3741/7485] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:52.346973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38655a-08c0-4dac-bf6f-4cd00b716809 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:52.349324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dd38655a-08c0-4dac-bf6f-4cd00b716809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:52.395286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:52.490567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ea434-273d-4bd2-8709-f7e10ecb0cf9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:52.517520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cffa4-0f76-4550-9b15-967b3411631d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:52.519277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cffa4-0f76-4550-9b15-967b3411631d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:52.520039 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cffa4-0f76-4550-9b15-967b3411631d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:52.523290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cffa4-0f76-4550-9b15-967b3411631d admin admin] PATH_INFO: `/v3/users/eeb7fe680706494b8b0b9b5477b08afd` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:52.529297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cffa4-0f76-4550-9b15-967b3411631d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeb7fe680706494b8b0b9b5477b08afd)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:52.533176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cffa4-0f76-4550-9b15-967b3411631d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:52.598066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38655a-08c0-4dac-bf6f-4cd00b716809 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:52.621474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f1128-b91b-4ad7-822c-95f8471028f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:52.624675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f1128-b91b-4ad7-822c-95f8471028f3 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:52.628898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f1128-b91b-4ad7-822c-95f8471028f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:52.628898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f1128-b91b-4ad7-822c-95f8471028f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:52.665827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f1128-b91b-4ad7-822c-95f8471028f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:52.674253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f1128-b91b-4ad7-822c-95f8471028f3 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:52.716067 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3742/7486] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:55:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:55:52.901989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-029cffa4-0f76-4550-9b15-967b3411631d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeb7fe680706494b8b0b9b5477b08afd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:52.902705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-029cffa4-0f76-4550-9b15-967b3411631d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeb7fe680706494b8b0b9b5477b08afd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:52.939400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-029cffa4-0f76-4550-9b15-967b3411631d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeb7fe680706494b8b0b9b5477b08afd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:53.011061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-029cffa4-0f76-4550-9b15-967b3411631d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeb7fe680706494b8b0b9b5477b08afd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:53.011852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-029cffa4-0f76-4550-9b15-967b3411631d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeb7fe680706494b8b0b9b5477b08afd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:53.116332 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3745/7487] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:55:52 2022] DELETE /identity/v3/users/eeb7fe680706494b8b0b9b5477b08afd => generated 0 bytes in 1059 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:54.672770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f1128-b91b-4ad7-822c-95f8471028f3 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:54.672770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5f5f1128-b91b-4ad7-822c-95f8471028f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:54.695676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f1128-b91b-4ad7-822c-95f8471028f3 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:54.849287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d5a4a-3c46-4a91-84f6-83ce35763cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:54.850555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d5a4a-3c46-4a91-84f6-83ce35763cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:54.850555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d5a4a-3c46-4a91-84f6-83ce35763cce admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:54.850555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d5a4a-3c46-4a91-84f6-83ce35763cce admin admin] PATH_INFO: `/v3/projects/7679bfe752984192ba5b629fd4ed5696` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:54.854370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d5a4a-3c46-4a91-84f6-83ce35763cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=7679bfe752984192ba5b629fd4ed5696)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:54.857276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d5a4a-3c46-4a91-84f6-83ce35763cce admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:55.118912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f80d5a4a-3c46-4a91-84f6-83ce35763cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7679bfe752984192ba5b629fd4ed5696', 'request_id': 'req-f80d5a4a-3c46-4a91-84f6-83ce35763cce'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:55.240802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f80d5a4a-3c46-4a91-84f6-83ce35763cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7679bfe752984192ba5b629fd4ed5696', 'request_id': 'req-f80d5a4a-3c46-4a91-84f6-83ce35763cce'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:55.270164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f80d5a4a-3c46-4a91-84f6-83ce35763cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7679bfe752984192ba5b629fd4ed5696', 'request_id': 'req-f80d5a4a-3c46-4a91-84f6-83ce35763cce'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:55.320499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f80d5a4a-3c46-4a91-84f6-83ce35763cce admin admin] The token cache is being invalidate because project 7679bfe752984192ba5b629fd4ed5696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:55:55.320813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f80d5a4a-3c46-4a91-84f6-83ce35763cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:55.330850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f80d5a4a-3c46-4a91-84f6-83ce35763cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:55.340283 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3743/7488] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:55:54 2022] DELETE /identity/v3/projects/7679bfe752984192ba5b629fd4ed5696 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:55.340433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cffa4-0f76-4550-9b15-967b3411631d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:55.342131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-029cffa4-0f76-4550-9b15-967b3411631d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:55.364791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cffa4-0f76-4550-9b15-967b3411631d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:55.518637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975889ff-fe07-43e0-a174-bd6ece2c5c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:55.519568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975889ff-fe07-43e0-a174-bd6ece2c5c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:55.520216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975889ff-fe07-43e0-a174-bd6ece2c5c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:55.520700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975889ff-fe07-43e0-a174-bd6ece2c5c11 admin admin] PATH_INFO: `/v3/users/c636b691e52d4deeb27f9b6eb0ad33d9` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:55.525193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975889ff-fe07-43e0-a174-bd6ece2c5c11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c636b691e52d4deeb27f9b6eb0ad33d9)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:55.533714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975889ff-fe07-43e0-a174-bd6ece2c5c11 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:55.797936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:55.822289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-975889ff-fe07-43e0-a174-bd6ece2c5c11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c636b691e52d4deeb27f9b6eb0ad33d9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:55.823087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-975889ff-fe07-43e0-a174-bd6ece2c5c11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c636b691e52d4deeb27f9b6eb0ad33d9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:55.848011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-975889ff-fe07-43e0-a174-bd6ece2c5c11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c636b691e52d4deeb27f9b6eb0ad33d9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:55.882024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-975889ff-fe07-43e0-a174-bd6ece2c5c11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c636b691e52d4deeb27f9b6eb0ad33d9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:55.883250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-975889ff-fe07-43e0-a174-bd6ece2c5c11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c636b691e52d4deeb27f9b6eb0ad33d9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:55.967754 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3746/7489] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:55:55 2022] DELETE /identity/v3/users/c636b691e52d4deeb27f9b6eb0ad33d9 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:57.757712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d5a4a-3c46-4a91-84f6-83ce35763cce admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:57.759851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f80d5a4a-3c46-4a91-84f6-83ce35763cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:57.797714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d5a4a-3c46-4a91-84f6-83ce35763cce admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:57.897544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:57.970338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc979bc1-3a94-42b2-92d2-326a144cc623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:57.973633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc979bc1-3a94-42b2-92d2-326a144cc623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:57.974203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc979bc1-3a94-42b2-92d2-326a144cc623 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:57.977996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc979bc1-3a94-42b2-92d2-326a144cc623 admin admin] PATH_INFO: `/v3/projects/efd5f6476aec416eaba63e8b84a81ba1` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:57.977996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc979bc1-3a94-42b2-92d2-326a144cc623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efd5f6476aec416eaba63e8b84a81ba1)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:57.989635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc979bc1-3a94-42b2-92d2-326a144cc623 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:58.200356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bc979bc1-3a94-42b2-92d2-326a144cc623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efd5f6476aec416eaba63e8b84a81ba1', 'request_id': 'req-bc979bc1-3a94-42b2-92d2-326a144cc623'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:58.298765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bc979bc1-3a94-42b2-92d2-326a144cc623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efd5f6476aec416eaba63e8b84a81ba1', 'request_id': 'req-bc979bc1-3a94-42b2-92d2-326a144cc623'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:58.310462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bc979bc1-3a94-42b2-92d2-326a144cc623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efd5f6476aec416eaba63e8b84a81ba1', 'request_id': 'req-bc979bc1-3a94-42b2-92d2-326a144cc623'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:58.343025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bc979bc1-3a94-42b2-92d2-326a144cc623 admin admin] The token cache is being invalidate because project efd5f6476aec416eaba63e8b84a81ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:55:58.343322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bc979bc1-3a94-42b2-92d2-326a144cc623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:58.345588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bc979bc1-3a94-42b2-92d2-326a144cc623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:55:58.352345 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3744/7490] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:55:57 2022] DELETE /identity/v3/projects/efd5f6476aec416eaba63e8b84a81ba1 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:58.358259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c651d-f541-48c7-84fe-7703274579ed None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:58.359172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c651d-f541-48c7-84fe-7703274579ed None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:58.359613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c651d-f541-48c7-84fe-7703274579ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:58.386859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d88c651d-f541-48c7-84fe-7703274579ed None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:58.389142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d88c651d-f541-48c7-84fe-7703274579ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:58.494893 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3747/7491] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:58.501904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c347d35-f653-45a6-9967-8885e140ad12 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:58.502514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c347d35-f653-45a6-9967-8885e140ad12 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:58.503487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c347d35-f653-45a6-9967-8885e140ad12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:58.535298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1c347d35-f653-45a6-9967-8885e140ad12 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:58.536863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1c347d35-f653-45a6-9967-8885e140ad12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:58.569100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c651d-f541-48c7-84fe-7703274579ed None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:58.569985 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3745/7492] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:58.582155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c651d-f541-48c7-84fe-7703274579ed None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:58.595559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17c934-9c4e-4c8e-b793-8cd4e7843e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:58.598177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17c934-9c4e-4c8e-b793-8cd4e7843e8c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:58.598633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17c934-9c4e-4c8e-b793-8cd4e7843e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:58.598927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17c934-9c4e-4c8e-b793-8cd4e7843e8c admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:58.599608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17c934-9c4e-4c8e-b793-8cd4e7843e8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:55:58.599928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17c934-9c4e-4c8e-b793-8cd4e7843e8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:58.603352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17c934-9c4e-4c8e-b793-8cd4e7843e8c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:58.635488 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3748/7493] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:55:58.640734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c347d35-f653-45a6-9967-8885e140ad12 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:58.657988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c347d35-f653-45a6-9967-8885e140ad12 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:58.982162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4557bea-adbe-400f-8746-553ef2bd13b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:58.982162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4557bea-adbe-400f-8746-553ef2bd13b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:58.982162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4557bea-adbe-400f-8746-553ef2bd13b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:58.982162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4557bea-adbe-400f-8746-553ef2bd13b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:58.987436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4557bea-adbe-400f-8746-553ef2bd13b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:58.987436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4557bea-adbe-400f-8746-553ef2bd13b7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:58.987436 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3746/7494] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:55:58 2022] POST /identity/v3/projects => generated 373 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:55:58.988527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17c934-9c4e-4c8e-b793-8cd4e7843e8c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:58.988527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17c934-9c4e-4c8e-b793-8cd4e7843e8c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:59.015106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49ec93-2cb6-459a-aa27-473f396148e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:59.016042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49ec93-2cb6-459a-aa27-473f396148e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:59.016479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49ec93-2cb6-459a-aa27-473f396148e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:59.018304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49ec93-2cb6-459a-aa27-473f396148e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:59.021254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49ec93-2cb6-459a-aa27-473f396148e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:59.023558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49ec93-2cb6-459a-aa27-473f396148e8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:59.210080 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3749/7495] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:55:58 2022] POST /identity/v3/users => generated 287 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:55:59.214467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4557bea-adbe-400f-8746-553ef2bd13b7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:59.235907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4557bea-adbe-400f-8746-553ef2bd13b7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:59.266826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4856b9-6212-4737-8539-d2236daa8605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:59.267544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4856b9-6212-4737-8539-d2236daa8605 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:59.267761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4856b9-6212-4737-8539-d2236daa8605 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:59.268035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4856b9-6212-4737-8539-d2236daa8605 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:59.268712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4856b9-6212-4737-8539-d2236daa8605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:59.270634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4856b9-6212-4737-8539-d2236daa8605 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:59.299049 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3747/7496] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:55:59.300960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49ec93-2cb6-459a-aa27-473f396148e8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:59.315535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49ec93-2cb6-459a-aa27-473f396148e8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:59.335970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62982094-fd57-45d7-a23d-1587204ff8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:59.347099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62982094-fd57-45d7-a23d-1587204ff8bf admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:59.347391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62982094-fd57-45d7-a23d-1587204ff8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:59.347679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62982094-fd57-45d7-a23d-1587204ff8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:59.348434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62982094-fd57-45d7-a23d-1587204ff8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:59.350170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62982094-fd57-45d7-a23d-1587204ff8bf admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:59.410739 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3750/7497] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:55:59.411883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4856b9-6212-4737-8539-d2236daa8605 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:59.432217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4856b9-6212-4737-8539-d2236daa8605 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:59.457858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcfe75-3a00-4040-a7dc-492d65a8f4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:59.459835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcfe75-3a00-4040-a7dc-492d65a8f4cc admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:59.461414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcfe75-3a00-4040-a7dc-492d65a8f4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:59.466411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcfe75-3a00-4040-a7dc-492d65a8f4cc admin admin] PATH_INFO: `/v3/projects/b15a61bdf65b44799cc901860d74e838/users/c8197b5a40264a1e9ee022915d6447bb/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:59.512213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fcfe75-3a00-4040-a7dc-492d65a8f4cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b15a61bdf65b44799cc901860d74e838, user_id=c8197b5a40264a1e9ee022915d6447bb, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:59.520856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fcfe75-3a00-4040-a7dc-492d65a8f4cc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:59.602979 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3748/7498] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:55:59 2022] PUT /identity/v3/projects/b15a61bdf65b44799cc901860d74e838/users/c8197b5a40264a1e9ee022915d6447bb/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:55:59.603684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4035c-e1b1-411e-a5a5-aa411c7e8dce None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:59.603974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4035c-e1b1-411e-a5a5-aa411c7e8dce None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:59.604252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4035c-e1b1-411e-a5a5-aa411c7e8dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:59.677262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7bd4035c-e1b1-411e-a5a5-aa411c7e8dce None None] MFA Rules not processed for user `c8197b5a40264a1e9ee022915d6447bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:55:59.678421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7bd4035c-e1b1-411e-a5a5-aa411c7e8dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:59.704504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:59.756368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcfe75-3a00-4040-a7dc-492d65a8f4cc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:59.758532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-56fcfe75-3a00-4040-a7dc-492d65a8f4cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:55:59.853657 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3751/7499] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:55:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:55:59.855109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4035c-e1b1-411e-a5a5-aa411c7e8dce None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:55:59.948069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcfe75-3a00-4040-a7dc-492d65a8f4cc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:55:59.964159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47c648-a3c8-4a67-ac04-75ddbe72ae8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:55:59.964833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47c648-a3c8-4a67-ac04-75ddbe72ae8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:55:59.965111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47c648-a3c8-4a67-ac04-75ddbe72ae8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:55:59.965534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47c648-a3c8-4a67-ac04-75ddbe72ae8b admin admin] PATH_INFO: `/v3/users/07676435ef374a09922c97dbb875bfc3` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:55:59.968781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47c648-a3c8-4a67-ac04-75ddbe72ae8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=07676435ef374a09922c97dbb875bfc3)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:55:59.972224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47c648-a3c8-4a67-ac04-75ddbe72ae8b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:55:59.974284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:59.998459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4035c-e1b1-411e-a5a5-aa411c7e8dce None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:00.012824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86dee2b-f202-4cfe-ac3c-7ea9dd3a712f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:00.013475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dee2b-f202-4cfe-ac3c-7ea9dd3a712f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:00.013761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dee2b-f202-4cfe-ac3c-7ea9dd3a712f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:00.014617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dee2b-f202-4cfe-ac3c-7ea9dd3a712f admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:00.015534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86dee2b-f202-4cfe-ac3c-7ea9dd3a712f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:00.018261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86dee2b-f202-4cfe-ac3c-7ea9dd3a712f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:00.139509 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3752/7500] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:55:59 2022] POST /identity/v3/projects => generated 371 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:00.142325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86dee2b-f202-4cfe-ac3c-7ea9dd3a712f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:00.231474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86dee2b-f202-4cfe-ac3c-7ea9dd3a712f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:00.237527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8045dd-10b4-49ac-b5db-80b5f6d12d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:00.238179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8045dd-10b4-49ac-b5db-80b5f6d12d0f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:00.238467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8045dd-10b4-49ac-b5db-80b5f6d12d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:00.238748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8045dd-10b4-49ac-b5db-80b5f6d12d0f admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:00.252049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8045dd-10b4-49ac-b5db-80b5f6d12d0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:00.252731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8045dd-10b4-49ac-b5db-80b5f6d12d0f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:00.276795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bd47c648-a3c8-4a67-ac04-75ddbe72ae8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07676435ef374a09922c97dbb875bfc3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:00.277809 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bd47c648-a3c8-4a67-ac04-75ddbe72ae8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07676435ef374a09922c97dbb875bfc3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:00.289114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bd47c648-a3c8-4a67-ac04-75ddbe72ae8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07676435ef374a09922c97dbb875bfc3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:00.335762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bd47c648-a3c8-4a67-ac04-75ddbe72ae8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07676435ef374a09922c97dbb875bfc3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:00.408556 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3753/7501] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:56:00 2022] POST /identity/v3/users => generated 292 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:00.412645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8045dd-10b4-49ac-b5db-80b5f6d12d0f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:00.416615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-dc8045dd-10b4-49ac-b5db-80b5f6d12d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:00.440789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8045dd-10b4-49ac-b5db-80b5f6d12d0f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:00.447873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5172d1-d5c7-4b83-bf6b-893582ea50bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:00.448715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5172d1-d5c7-4b83-bf6b-893582ea50bf admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:00.452216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5172d1-d5c7-4b83-bf6b-893582ea50bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:00.452216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5172d1-d5c7-4b83-bf6b-893582ea50bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:00.452216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5172d1-d5c7-4b83-bf6b-893582ea50bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:00.453513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5172d1-d5c7-4b83-bf6b-893582ea50bf admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:00.466684 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3754/7502] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:00.470464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5172d1-d5c7-4b83-bf6b-893582ea50bf admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:00.483097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-bd47c648-a3c8-4a67-ac04-75ddbe72ae8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07676435ef374a09922c97dbb875bfc3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:00.494073 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3749/7503] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:55:59 2022] DELETE /identity/v3/users/07676435ef374a09922c97dbb875bfc3 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:56:00.495681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0e773-ee12-47c1-b801-710052d1570e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:00.498876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0e773-ee12-47c1-b801-710052d1570e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:00.499264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0e773-ee12-47c1-b801-710052d1570e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:00.501264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5172d1-d5c7-4b83-bf6b-893582ea50bf admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:00.523715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:00.543364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c8f0e773-ee12-47c1-b801-710052d1570e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:00.544062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c8f0e773-ee12-47c1-b801-710052d1570e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:00.641683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d54730-09fe-42ba-8254-cf7686b490e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:00.643717 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3750/7504] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:00.643960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d54730-09fe-42ba-8254-cf7686b490e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:00.644535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d54730-09fe-42ba-8254-cf7686b490e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:00.644828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d54730-09fe-42ba-8254-cf7686b490e1 admin admin] PATH_INFO: `/v3/projects/6903a467ab444ba89d7e7de1586d2896/users/6b634ce0f8fa40d3bc9fff01546bc114/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:00.655603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0e773-ee12-47c1-b801-710052d1570e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:00.658516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c8f0e773-ee12-47c1-b801-710052d1570e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:00.691173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d54730-09fe-42ba-8254-cf7686b490e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6903a467ab444ba89d7e7de1586d2896, user_id=6b634ce0f8fa40d3bc9fff01546bc114, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:00.696348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d54730-09fe-42ba-8254-cf7686b490e1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:00.751636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0e773-ee12-47c1-b801-710052d1570e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:00.756796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa43fe-8c41-4c8f-b745-dea27f2c815f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:00.757842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa43fe-8c41-4c8f-b745-dea27f2c815f service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:00.758177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa43fe-8c41-4c8f-b745-dea27f2c815f service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:00.758456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa43fe-8c41-4c8f-b745-dea27f2c815f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:00.773546 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3755/7505] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:00 2022] PUT /identity/v3/projects/6903a467ab444ba89d7e7de1586d2896/users/6b634ce0f8fa40d3bc9fff01546bc114/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:00.777490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d54730-09fe-42ba-8254-cf7686b490e1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:00.788347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa43fe-8c41-4c8f-b745-dea27f2c815f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:00.790123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa43fe-8c41-4c8f-b745-dea27f2c815f service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:00.806484 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3751/7506] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:56:00.911469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d54730-09fe-42ba-8254-cf7686b490e1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:00.917870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c5fa5-f78c-40b1-9e0c-87a0cc179c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:00.918928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c5fa5-f78c-40b1-9e0c-87a0cc179c67 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:00.919271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c5fa5-f78c-40b1-9e0c-87a0cc179c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:00.919786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c5fa5-f78c-40b1-9e0c-87a0cc179c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:00.921708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c5fa5-f78c-40b1-9e0c-87a0cc179c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:00.926280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c5fa5-f78c-40b1-9e0c-87a0cc179c67 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:00.944064 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3756/7507] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:56:00.944760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa43fe-8c41-4c8f-b745-dea27f2c815f service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:00.959804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa43fe-8c41-4c8f-b745-dea27f2c815f service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:00.969395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d399b8-29b9-44ec-8a86-af89cd45eee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:00.970197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d399b8-29b9-44ec-8a86-af89cd45eee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:00.970681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d399b8-29b9-44ec-8a86-af89cd45eee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:00.971184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d399b8-29b9-44ec-8a86-af89cd45eee4 admin admin] PATH_INFO: `/v3/projects/6903a467ab444ba89d7e7de1586d2896/users/6b634ce0f8fa40d3bc9fff01546bc114/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:00.973437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d399b8-29b9-44ec-8a86-af89cd45eee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6903a467ab444ba89d7e7de1586d2896, user_id=6b634ce0f8fa40d3bc9fff01546bc114, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:00.976836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d399b8-29b9-44ec-8a86-af89cd45eee4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:00.989831 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3752/7508] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:00 2022] PUT /identity/v3/projects/6903a467ab444ba89d7e7de1586d2896/users/6b634ce0f8fa40d3bc9fff01546bc114/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:56:01.096313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb587bd-53b3-4900-a2ca-cba31fe0e2bf None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:01.096650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb587bd-53b3-4900-a2ca-cba31fe0e2bf None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:01.096937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb587bd-53b3-4900-a2ca-cba31fe0e2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:01.101100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d399b8-29b9-44ec-8a86-af89cd45eee4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:01.103616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-73d399b8-29b9-44ec-8a86-af89cd45eee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:01.137491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:01.189874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8eb587bd-53b3-4900-a2ca-cba31fe0e2bf None None] MFA Rules not processed for user `6b634ce0f8fa40d3bc9fff01546bc114`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:01.191262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8eb587bd-53b3-4900-a2ca-cba31fe0e2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:01.273133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d399b8-29b9-44ec-8a86-af89cd45eee4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:01.283388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add3ed4-5946-4ba4-8ca9-9d8d6ad752c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:01.284353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add3ed4-5946-4ba4-8ca9-9d8d6ad752c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:01.284756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add3ed4-5946-4ba4-8ca9-9d8d6ad752c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:01.285075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add3ed4-5946-4ba4-8ca9-9d8d6ad752c7 admin admin] PATH_INFO: `/v3/projects/81d3e85652304417aae40d26ee595f38` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:01.286570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add3ed4-5946-4ba4-8ca9-9d8d6ad752c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81d3e85652304417aae40d26ee595f38)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:01.288719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add3ed4-5946-4ba4-8ca9-9d8d6ad752c7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:01.330582 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3757/7509] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:01.340529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb587bd-53b3-4900-a2ca-cba31fe0e2bf None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:01.342532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8eb587bd-53b3-4900-a2ca-cba31fe0e2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:01.366864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:01.439182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb587bd-53b3-4900-a2ca-cba31fe0e2bf None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:01.453766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3add3ed4-5946-4ba4-8ca9-9d8d6ad752c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81d3e85652304417aae40d26ee595f38', 'request_id': 'req-3add3ed4-5946-4ba4-8ca9-9d8d6ad752c7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:01.503495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182e291-d559-4386-888b-7c43e81cd278 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:01.504049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182e291-d559-4386-888b-7c43e81cd278 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:01.504336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182e291-d559-4386-888b-7c43e81cd278 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:01.504741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182e291-d559-4386-888b-7c43e81cd278 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:01.521391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3add3ed4-5946-4ba4-8ca9-9d8d6ad752c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81d3e85652304417aae40d26ee595f38', 'request_id': 'req-3add3ed4-5946-4ba4-8ca9-9d8d6ad752c7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:01.533148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3add3ed4-5946-4ba4-8ca9-9d8d6ad752c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81d3e85652304417aae40d26ee595f38', 'request_id': 'req-3add3ed4-5946-4ba4-8ca9-9d8d6ad752c7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:01.552359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3add3ed4-5946-4ba4-8ca9-9d8d6ad752c7 admin admin] The token cache is being invalidate because project 81d3e85652304417aae40d26ee595f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:56:01.552838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3add3ed4-5946-4ba4-8ca9-9d8d6ad752c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:01.553797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3add3ed4-5946-4ba4-8ca9-9d8d6ad752c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:01.556395 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3753/7510] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:56:01 2022] DELETE /identity/v3/projects/81d3e85652304417aae40d26ee595f38 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:01.561698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794209b4-7968-4917-be18-faba3184a06d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:01.561984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794209b4-7968-4917-be18-faba3184a06d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:01.562401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794209b4-7968-4917-be18-faba3184a06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:01.587332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-794209b4-7968-4917-be18-faba3184a06d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:01.593056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182e291-d559-4386-888b-7c43e81cd278 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:01.594819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182e291-d559-4386-888b-7c43e81cd278 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:01.598964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-794209b4-7968-4917-be18-faba3184a06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:01.607116 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3758/7511] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:56:01.698198 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3754/7512] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:56:01.703714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e97fe-9ef1-4f56-a4a2-1035f0da4d08 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:01.704367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e97fe-9ef1-4f56-a4a2-1035f0da4d08 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:01.704710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e97fe-9ef1-4f56-a4a2-1035f0da4d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:01.730476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-176e97fe-9ef1-4f56-a4a2-1035f0da4d08 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:01.731941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-176e97fe-9ef1-4f56-a4a2-1035f0da4d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:01.747175 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3759/7513] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:01.756121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794209b4-7968-4917-be18-faba3184a06d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:01.767315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794209b4-7968-4917-be18-faba3184a06d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:01.772376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8065582-acd6-404b-8460-93de034a3a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:01.773002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8065582-acd6-404b-8460-93de034a3a8e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:01.773301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8065582-acd6-404b-8460-93de034a3a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:01.773575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8065582-acd6-404b-8460-93de034a3a8e admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:01.775895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8065582-acd6-404b-8460-93de034a3a8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:56:01.775895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8065582-acd6-404b-8460-93de034a3a8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:01.776347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8065582-acd6-404b-8460-93de034a3a8e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:01.791309 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3755/7514] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:56:01.795760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e97fe-9ef1-4f56-a4a2-1035f0da4d08 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:01.806568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e97fe-9ef1-4f56-a4a2-1035f0da4d08 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:01.812767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1d913-5493-4cd4-aa3c-396e8bc04d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:01.814112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1d913-5493-4cd4-aa3c-396e8bc04d6b admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:01.814112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1d913-5493-4cd4-aa3c-396e8bc04d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:01.814112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1d913-5493-4cd4-aa3c-396e8bc04d6b admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:01.814635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1d913-5493-4cd4-aa3c-396e8bc04d6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:01.816576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1d913-5493-4cd4-aa3c-396e8bc04d6b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:01.925700 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3760/7515] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:56:01 2022] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:56:01.929405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8065582-acd6-404b-8460-93de034a3a8e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:01.940272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8065582-acd6-404b-8460-93de034a3a8e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:01.968054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:02.046516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a289487-992c-4ec2-99e9-b89555606927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:02.046516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a289487-992c-4ec2-99e9-b89555606927 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:02.046516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a289487-992c-4ec2-99e9-b89555606927 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:02.046845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a289487-992c-4ec2-99e9-b89555606927 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:02.047479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a289487-992c-4ec2-99e9-b89555606927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:02.050006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a289487-992c-4ec2-99e9-b89555606927 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:02.185304 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3756/7516] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:56:01 2022] POST /identity/v3/users => generated 285 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:02.188878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1d913-5493-4cd4-aa3c-396e8bc04d6b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:02.209054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1d913-5493-4cd4-aa3c-396e8bc04d6b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:02.215615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504b09e-cf89-4007-9107-04e7fa8c5e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:02.216376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504b09e-cf89-4007-9107-04e7fa8c5e0b admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:02.216799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504b09e-cf89-4007-9107-04e7fa8c5e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:02.217701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504b09e-cf89-4007-9107-04e7fa8c5e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:02.218988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504b09e-cf89-4007-9107-04e7fa8c5e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:02.220801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504b09e-cf89-4007-9107-04e7fa8c5e0b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:02.238070 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3761/7517] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:02.239279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a289487-992c-4ec2-99e9-b89555606927 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:02.254752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a289487-992c-4ec2-99e9-b89555606927 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:02.263970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729e29b-c924-4b7e-888a-fc3756f801bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:02.264630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729e29b-c924-4b7e-888a-fc3756f801bc admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:02.264914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729e29b-c924-4b7e-888a-fc3756f801bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:02.265188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729e29b-c924-4b7e-888a-fc3756f801bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:02.265877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729e29b-c924-4b7e-888a-fc3756f801bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:02.267725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729e29b-c924-4b7e-888a-fc3756f801bc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:02.299239 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3757/7518] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:02.300829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504b09e-cf89-4007-9107-04e7fa8c5e0b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:02.314455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504b09e-cf89-4007-9107-04e7fa8c5e0b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:02.321690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc03b41-7221-499c-aa73-b7eff413762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:02.321690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc03b41-7221-499c-aa73-b7eff413762e admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:02.321690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc03b41-7221-499c-aa73-b7eff413762e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:02.321690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc03b41-7221-499c-aa73-b7eff413762e admin admin] PATH_INFO: `/v3/projects/ff720e3f73e249d1beafa092eb8be061/users/2d5b94e8457347c7b2a57a3146093a94/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:02.366292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc03b41-7221-499c-aa73-b7eff413762e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff720e3f73e249d1beafa092eb8be061, user_id=2d5b94e8457347c7b2a57a3146093a94, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:02.374367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc03b41-7221-499c-aa73-b7eff413762e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:02.493786 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3762/7519] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:02 2022] PUT /identity/v3/projects/ff720e3f73e249d1beafa092eb8be061/users/2d5b94e8457347c7b2a57a3146093a94/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:02.507970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05b900-f0ec-4956-921b-bc9d09075102 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:02.508314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05b900-f0ec-4956-921b-bc9d09075102 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:02.508608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05b900-f0ec-4956-921b-bc9d09075102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:02.584711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8b05b900-f0ec-4956-921b-bc9d09075102 None None] MFA Rules not processed for user `2d5b94e8457347c7b2a57a3146093a94`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:02.586294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8b05b900-f0ec-4956-921b-bc9d09075102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:02.671694 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3758/7520] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:56:02.681123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc03b41-7221-499c-aa73-b7eff413762e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:02.684334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4dc03b41-7221-499c-aa73-b7eff413762e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:02.714774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:02.763077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc03b41-7221-499c-aa73-b7eff413762e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:02.768578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b44bcf-680a-4918-a374-eccd9573dfcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:02.769207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b44bcf-680a-4918-a374-eccd9573dfcf service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:02.769478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b44bcf-680a-4918-a374-eccd9573dfcf service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:02.769749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b44bcf-680a-4918-a374-eccd9573dfcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:02.778723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b44bcf-680a-4918-a374-eccd9573dfcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:02.780693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b44bcf-680a-4918-a374-eccd9573dfcf service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:02.790435 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3763/7521] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:56:02.882082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05b900-f0ec-4956-921b-bc9d09075102 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:02.886477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8b05b900-f0ec-4956-921b-bc9d09075102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:03.086418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05b900-f0ec-4956-921b-bc9d09075102 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:03.098074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9771c-d24a-45dc-b4f2-77aa065aed5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:03.098779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9771c-d24a-45dc-b4f2-77aa065aed5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:03.099064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9771c-d24a-45dc-b4f2-77aa065aed5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:03.099337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9771c-d24a-45dc-b4f2-77aa065aed5c admin admin] PATH_INFO: `/v3/users/c8197b5a40264a1e9ee022915d6447bb` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:03.100529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9771c-d24a-45dc-b4f2-77aa065aed5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8197b5a40264a1e9ee022915d6447bb)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:03.102647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9771c-d24a-45dc-b4f2-77aa065aed5c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:03.145154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:03.434706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-91f9771c-d24a-45dc-b4f2-77aa065aed5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8197b5a40264a1e9ee022915d6447bb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:03.436667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-91f9771c-d24a-45dc-b4f2-77aa065aed5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8197b5a40264a1e9ee022915d6447bb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:03.454084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-91f9771c-d24a-45dc-b4f2-77aa065aed5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8197b5a40264a1e9ee022915d6447bb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:03.482252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-91f9771c-d24a-45dc-b4f2-77aa065aed5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8197b5a40264a1e9ee022915d6447bb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:03.591080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-91f9771c-d24a-45dc-b4f2-77aa065aed5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8197b5a40264a1e9ee022915d6447bb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:03.625012 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3759/7522] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:56:02 2022] DELETE /identity/v3/users/c8197b5a40264a1e9ee022915d6447bb => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:03.631141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5ece1-97ca-419a-a45a-9b136ecbafdb None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:03.631640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5ece1-97ca-419a-a45a-9b136ecbafdb None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:03.631938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5ece1-97ca-419a-a45a-9b136ecbafdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:03.687827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-38c5ece1-97ca-419a-a45a-9b136ecbafdb None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:03.695098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-38c5ece1-97ca-419a-a45a-9b136ecbafdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:03.901118 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3764/7523] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:03.950913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9771c-d24a-45dc-b4f2-77aa065aed5c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:03.953450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-91f9771c-d24a-45dc-b4f2-77aa065aed5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:04.101545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9771c-d24a-45dc-b4f2-77aa065aed5c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:04.114284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf0e45-69ff-4e1b-a575-a9bbfc3ac1d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:04.114744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf0e45-69ff-4e1b-a575-a9bbfc3ac1d1 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:04.115030 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf0e45-69ff-4e1b-a575-a9bbfc3ac1d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:04.115310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf0e45-69ff-4e1b-a575-a9bbfc3ac1d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:04.138136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf0e45-69ff-4e1b-a575-a9bbfc3ac1d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:04.139967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf0e45-69ff-4e1b-a575-a9bbfc3ac1d1 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:04.168368 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3760/7524] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:56:05.236290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5ece1-97ca-419a-a45a-9b136ecbafdb None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:05.238766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-38c5ece1-97ca-419a-a45a-9b136ecbafdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:05.257479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5ece1-97ca-419a-a45a-9b136ecbafdb None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:05.264386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ccbe4-22a5-4e03-b100-093829e0162a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:05.266126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ccbe4-22a5-4e03-b100-093829e0162a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:05.268557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ccbe4-22a5-4e03-b100-093829e0162a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:05.268557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ccbe4-22a5-4e03-b100-093829e0162a admin admin] PATH_INFO: `/v3/projects/b15a61bdf65b44799cc901860d74e838` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:05.268557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ccbe4-22a5-4e03-b100-093829e0162a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b15a61bdf65b44799cc901860d74e838)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:05.270111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ccbe4-22a5-4e03-b100-093829e0162a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:05.454439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-506ccbe4-22a5-4e03-b100-093829e0162a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b15a61bdf65b44799cc901860d74e838', 'request_id': 'req-506ccbe4-22a5-4e03-b100-093829e0162a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:05.473169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-506ccbe4-22a5-4e03-b100-093829e0162a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b15a61bdf65b44799cc901860d74e838', 'request_id': 'req-506ccbe4-22a5-4e03-b100-093829e0162a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:05.496542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-506ccbe4-22a5-4e03-b100-093829e0162a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b15a61bdf65b44799cc901860d74e838', 'request_id': 'req-506ccbe4-22a5-4e03-b100-093829e0162a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:05.568507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf0e45-69ff-4e1b-a575-a9bbfc3ac1d1 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:05.571433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3daf0e45-69ff-4e1b-a575-a9bbfc3ac1d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:05.624048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-506ccbe4-22a5-4e03-b100-093829e0162a admin admin] The token cache is being invalidate because project b15a61bdf65b44799cc901860d74e838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:56:05.624048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-506ccbe4-22a5-4e03-b100-093829e0162a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:05.624048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-506ccbe4-22a5-4e03-b100-093829e0162a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:05.630532 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3765/7525] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:56:05 2022] DELETE /identity/v3/projects/b15a61bdf65b44799cc901860d74e838 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:05.631667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ccbe4-22a5-4e03-b100-093829e0162a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:05.633103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-506ccbe4-22a5-4e03-b100-093829e0162a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:05.694779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf0e45-69ff-4e1b-a575-a9bbfc3ac1d1 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:05.749671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:05.789383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d15177-f375-4fbc-a5e3-34c829863ec2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:05.790271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d15177-f375-4fbc-a5e3-34c829863ec2 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:05.790659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d15177-f375-4fbc-a5e3-34c829863ec2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:05.791050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d15177-f375-4fbc-a5e3-34c829863ec2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:05.794912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ccbe4-22a5-4e03-b100-093829e0162a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:05.796865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a9d15177-f375-4fbc-a5e3-34c829863ec2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:05.801122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebc2b5-6da2-4a2c-be55-a2ac49c1a7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:05.801857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebc2b5-6da2-4a2c-be55-a2ac49c1a7ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:05.802327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebc2b5-6da2-4a2c-be55-a2ac49c1a7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:05.802683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebc2b5-6da2-4a2c-be55-a2ac49c1a7ca admin admin] PATH_INFO: `/v3/users/6b634ce0f8fa40d3bc9fff01546bc114` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:05.804349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebc2b5-6da2-4a2c-be55-a2ac49c1a7ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b634ce0f8fa40d3bc9fff01546bc114)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:05.804805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:05.806811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebc2b5-6da2-4a2c-be55-a2ac49c1a7ca admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:05.871217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d15177-f375-4fbc-a5e3-34c829863ec2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:05.875138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d15177-f375-4fbc-a5e3-34c829863ec2 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:05.883682 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3761/7526] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:56:06.078963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-50ebc2b5-6da2-4a2c-be55-a2ac49c1a7ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b634ce0f8fa40d3bc9fff01546bc114'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:06.080228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-50ebc2b5-6da2-4a2c-be55-a2ac49c1a7ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b634ce0f8fa40d3bc9fff01546bc114'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:06.100984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-50ebc2b5-6da2-4a2c-be55-a2ac49c1a7ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b634ce0f8fa40d3bc9fff01546bc114'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:06.128760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-50ebc2b5-6da2-4a2c-be55-a2ac49c1a7ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b634ce0f8fa40d3bc9fff01546bc114'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:06.129492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-50ebc2b5-6da2-4a2c-be55-a2ac49c1a7ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b634ce0f8fa40d3bc9fff01546bc114'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:06.258324 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3766/7527] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:56:05 2022] DELETE /identity/v3/users/6b634ce0f8fa40d3bc9fff01546bc114 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:06.580207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d15177-f375-4fbc-a5e3-34c829863ec2 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:06.583172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a9d15177-f375-4fbc-a5e3-34c829863ec2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:06.611363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d15177-f375-4fbc-a5e3-34c829863ec2 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:06.756892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d451c2-1503-4f38-a17c-87005aaabb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:06.757803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d451c2-1503-4f38-a17c-87005aaabb38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:06.758298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d451c2-1503-4f38-a17c-87005aaabb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:06.758951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d451c2-1503-4f38-a17c-87005aaabb38 admin admin] PATH_INFO: `/v3/users/2575a74b596f4c368ec565b11a2cd1f7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:06.760771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d451c2-1503-4f38-a17c-87005aaabb38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2575a74b596f4c368ec565b11a2cd1f7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:06.763560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d451c2-1503-4f38-a17c-87005aaabb38 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:06.943347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebc2b5-6da2-4a2c-be55-a2ac49c1a7ca admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:06.944800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-50ebc2b5-6da2-4a2c-be55-a2ac49c1a7ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:06.981359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebc2b5-6da2-4a2c-be55-a2ac49c1a7ca admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:06.993292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b4dbd-3583-4701-9e8d-f7040b50f0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:06.993883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b4dbd-3583-4701-9e8d-f7040b50f0da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:06.994247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b4dbd-3583-4701-9e8d-f7040b50f0da admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:06.994527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b4dbd-3583-4701-9e8d-f7040b50f0da admin admin] PATH_INFO: `/v3/projects/6903a467ab444ba89d7e7de1586d2896` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:06.996369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b4dbd-3583-4701-9e8d-f7040b50f0da admin admin] RBAC: Authorizing `identity:delete_project(project_id=6903a467ab444ba89d7e7de1586d2896)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:07.003141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b4dbd-3583-4701-9e8d-f7040b50f0da admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:07.085634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f4d451c2-1503-4f38-a17c-87005aaabb38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2575a74b596f4c368ec565b11a2cd1f7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:07.086440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f4d451c2-1503-4f38-a17c-87005aaabb38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2575a74b596f4c368ec565b11a2cd1f7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:07.098673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f4d451c2-1503-4f38-a17c-87005aaabb38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2575a74b596f4c368ec565b11a2cd1f7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:07.115887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f4d451c2-1503-4f38-a17c-87005aaabb38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2575a74b596f4c368ec565b11a2cd1f7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:07.200528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f4d451c2-1503-4f38-a17c-87005aaabb38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2575a74b596f4c368ec565b11a2cd1f7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:07.208080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-441b4dbd-3583-4701-9e8d-f7040b50f0da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6903a467ab444ba89d7e7de1586d2896', 'request_id': 'req-441b4dbd-3583-4701-9e8d-f7040b50f0da'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:07.216114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-441b4dbd-3583-4701-9e8d-f7040b50f0da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6903a467ab444ba89d7e7de1586d2896', 'request_id': 'req-441b4dbd-3583-4701-9e8d-f7040b50f0da'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:07.218081 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3762/7528] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:56:06 2022] DELETE /identity/v3/users/2575a74b596f4c368ec565b11a2cd1f7 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:07.221195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341749fb-4575-4e19-a273-4c34176ef376 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:07.221489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341749fb-4575-4e19-a273-4c34176ef376 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:07.221806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341749fb-4575-4e19-a273-4c34176ef376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:07.231543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-441b4dbd-3583-4701-9e8d-f7040b50f0da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6903a467ab444ba89d7e7de1586d2896', 'request_id': 'req-441b4dbd-3583-4701-9e8d-f7040b50f0da'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:07.272955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-341749fb-4575-4e19-a273-4c34176ef376 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:07.274842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-341749fb-4575-4e19-a273-4c34176ef376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:07.287187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:07.355086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-441b4dbd-3583-4701-9e8d-f7040b50f0da admin admin] The token cache is being invalidate because project 6903a467ab444ba89d7e7de1586d2896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:56:07.358980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-441b4dbd-3583-4701-9e8d-f7040b50f0da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:07.358980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-441b4dbd-3583-4701-9e8d-f7040b50f0da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:07.359155 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3763/7529] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:07.363157 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3767/7530] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:56:06 2022] DELETE /identity/v3/projects/6903a467ab444ba89d7e7de1586d2896 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:56:07.367110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e072cfd-2eda-4576-9e26-c1d6ae410dfa None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:07.367408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e072cfd-2eda-4576-9e26-c1d6ae410dfa None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:07.367691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e072cfd-2eda-4576-9e26-c1d6ae410dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:07.372742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b4dbd-3583-4701-9e8d-f7040b50f0da admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:07.378696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-441b4dbd-3583-4701-9e8d-f7040b50f0da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:07.453076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-3e072cfd-2eda-4576-9e26-c1d6ae410dfa None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:07.455549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3e072cfd-2eda-4576-9e26-c1d6ae410dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:07.478221 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3764/7531] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:07.480339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6800dcd-325b-45cf-bd90-3bd03e3d743f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:07.485124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6800dcd-325b-45cf-bd90-3bd03e3d743f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:07.485124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6800dcd-325b-45cf-bd90-3bd03e3d743f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:07.508171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f6800dcd-325b-45cf-bd90-3bd03e3d743f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:07.508171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f6800dcd-325b-45cf-bd90-3bd03e3d743f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:07.511878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:07.521056 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3765/7532] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:07.522343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6800dcd-325b-45cf-bd90-3bd03e3d743f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:07.531790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6800dcd-325b-45cf-bd90-3bd03e3d743f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:07.534336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b4dbd-3583-4701-9e8d-f7040b50f0da admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:07.536972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a238d-f31e-4d58-9c96-4e55298feab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:07.537589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a238d-f31e-4d58-9c96-4e55298feab0 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:07.537861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a238d-f31e-4d58-9c96-4e55298feab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:07.538165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a238d-f31e-4d58-9c96-4e55298feab0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:07.538826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a238d-f31e-4d58-9c96-4e55298feab0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:56:07.539139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a238d-f31e-4d58-9c96-4e55298feab0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:07.541508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a238d-f31e-4d58-9c96-4e55298feab0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:07.558781 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3766/7533] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:56:07.560115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a238d-f31e-4d58-9c96-4e55298feab0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:07.572162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a238d-f31e-4d58-9c96-4e55298feab0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:07.579629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6584b71-352e-48b0-86fa-2fc64bf79d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:07.580539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6584b71-352e-48b0-86fa-2fc64bf79d46 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:07.581086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6584b71-352e-48b0-86fa-2fc64bf79d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:07.581274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6584b71-352e-48b0-86fa-2fc64bf79d46 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:07.582027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6584b71-352e-48b0-86fa-2fc64bf79d46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:07.584674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6584b71-352e-48b0-86fa-2fc64bf79d46 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:07.604735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b0a63-20c8-4926-8509-188924c0972e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:07.605556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b0a63-20c8-4926-8509-188924c0972e service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:07.605914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b0a63-20c8-4926-8509-188924c0972e service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:07.606291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b0a63-20c8-4926-8509-188924c0972e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:07.609078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-da5b0a63-20c8-4926-8509-188924c0972e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:07.630195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b0a63-20c8-4926-8509-188924c0972e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:07.631479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b0a63-20c8-4926-8509-188924c0972e service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:07.642192 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3768/7534] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:56:07.709086 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3767/7535] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:56:07 2022] POST /identity/v3/projects => generated 387 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:07.710812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b0a63-20c8-4926-8509-188924c0972e service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:07.724708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b0a63-20c8-4926-8509-188924c0972e service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:07.812253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffb644-4df7-4d2c-b405-c04f0410482f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:07.813187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffb644-4df7-4d2c-b405-c04f0410482f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:07.813603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffb644-4df7-4d2c-b405-c04f0410482f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:07.814213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffb644-4df7-4d2c-b405-c04f0410482f admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:07.815775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ffb644-4df7-4d2c-b405-c04f0410482f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:07.818445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ffb644-4df7-4d2c-b405-c04f0410482f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:07.935331 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3769/7536] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:56:07 2022] POST /identity/v3/users => generated 294 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:07.942182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6584b71-352e-48b0-86fa-2fc64bf79d46 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:07.971045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6584b71-352e-48b0-86fa-2fc64bf79d46 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:07.980202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a652785-4ae7-4401-b9b9-0adc0dc1aad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:07.980911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a652785-4ae7-4401-b9b9-0adc0dc1aad0 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:07.981644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a652785-4ae7-4401-b9b9-0adc0dc1aad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:07.981858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a652785-4ae7-4401-b9b9-0adc0dc1aad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:07.982640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a652785-4ae7-4401-b9b9-0adc0dc1aad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:07.984417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a652785-4ae7-4401-b9b9-0adc0dc1aad0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:07.996561 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3768/7537] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:56:08.001394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffb644-4df7-4d2c-b405-c04f0410482f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:08.013169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffb644-4df7-4d2c-b405-c04f0410482f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:08.019635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f889a62-7f4d-4c24-b41a-ec71ee5c4b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:08.020259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f889a62-7f4d-4c24-b41a-ec71ee5c4b70 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:08.020544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f889a62-7f4d-4c24-b41a-ec71ee5c4b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:08.020817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f889a62-7f4d-4c24-b41a-ec71ee5c4b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:08.021471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f889a62-7f4d-4c24-b41a-ec71ee5c4b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:08.023434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f889a62-7f4d-4c24-b41a-ec71ee5c4b70 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:08.037125 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3770/7538] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:08.041479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a652785-4ae7-4401-b9b9-0adc0dc1aad0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:08.053013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a652785-4ae7-4401-b9b9-0adc0dc1aad0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:08.058793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed99437-7639-4ee8-8b21-49f812c73b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:08.060093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed99437-7639-4ee8-8b21-49f812c73b4f admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:08.060426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed99437-7639-4ee8-8b21-49f812c73b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:08.061058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed99437-7639-4ee8-8b21-49f812c73b4f admin admin] PATH_INFO: `/v3/projects/2e3fba2d15e8468692eda68fb751d57d/users/4454e55f61994aa18d25510f98cd5aa3/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:08.085094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed99437-7639-4ee8-8b21-49f812c73b4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e3fba2d15e8468692eda68fb751d57d, user_id=4454e55f61994aa18d25510f98cd5aa3, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:08.087988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed99437-7639-4ee8-8b21-49f812c73b4f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:08.168827 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3769/7539] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:08 2022] PUT /identity/v3/projects/2e3fba2d15e8468692eda68fb751d57d/users/4454e55f61994aa18d25510f98cd5aa3/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:08.181524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78e0d0-9cef-4275-a8f4-49b8332169a4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:08.183605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78e0d0-9cef-4275-a8f4-49b8332169a4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:08.184023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78e0d0-9cef-4275-a8f4-49b8332169a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:08.286444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9a78e0d0-9cef-4275-a8f4-49b8332169a4 None None] MFA Rules not processed for user `4454e55f61994aa18d25510f98cd5aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:08.288001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9a78e0d0-9cef-4275-a8f4-49b8332169a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:08.402339 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3771/7540] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:08.405206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed99437-7639-4ee8-8b21-49f812c73b4f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:08.478808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78e0d0-9cef-4275-a8f4-49b8332169a4 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:08.480827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9a78e0d0-9cef-4275-a8f4-49b8332169a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:08.501725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed99437-7639-4ee8-8b21-49f812c73b4f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:08.503546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78e0d0-9cef-4275-a8f4-49b8332169a4 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:08.510702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137de830-1ca1-4040-91da-cb2cbb88d6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:08.510987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137de830-1ca1-4040-91da-cb2cbb88d6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:08.511280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137de830-1ca1-4040-91da-cb2cbb88d6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:08.518451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137de830-1ca1-4040-91da-cb2cbb88d6b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:08.518451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137de830-1ca1-4040-91da-cb2cbb88d6b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:08.518719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669169b-2b40-43c8-bc63-cb39594ab662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:08.518719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669169b-2b40-43c8-bc63-cb39594ab662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:08.518719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669169b-2b40-43c8-bc63-cb39594ab662 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:08.518719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669169b-2b40-43c8-bc63-cb39594ab662 admin admin] PATH_INFO: `/v3/projects/2d7741de3c02497eab44ed0e182a3504` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:08.524458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669169b-2b40-43c8-bc63-cb39594ab662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7741de3c02497eab44ed0e182a3504)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:08.527243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137de830-1ca1-4040-91da-cb2cbb88d6b3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:08.527429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669169b-2b40-43c8-bc63-cb39594ab662 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:08.638945 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3770/7541] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:56:08 2022] POST /identity/v3/projects => generated 387 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:08.645784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137de830-1ca1-4040-91da-cb2cbb88d6b3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:08.671861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:08.698467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8669169b-2b40-43c8-bc63-cb39594ab662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7741de3c02497eab44ed0e182a3504', 'request_id': 'req-8669169b-2b40-43c8-bc63-cb39594ab662'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:08.717243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8669169b-2b40-43c8-bc63-cb39594ab662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7741de3c02497eab44ed0e182a3504', 'request_id': 'req-8669169b-2b40-43c8-bc63-cb39594ab662'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:08.725681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8669169b-2b40-43c8-bc63-cb39594ab662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7741de3c02497eab44ed0e182a3504', 'request_id': 'req-8669169b-2b40-43c8-bc63-cb39594ab662'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:08.764734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137de830-1ca1-4040-91da-cb2cbb88d6b3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:08.869796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a1643-4195-4779-81f7-f02f98aca31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:08.870853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a1643-4195-4779-81f7-f02f98aca31f admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:08.871298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a1643-4195-4779-81f7-f02f98aca31f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:08.871780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a1643-4195-4779-81f7-f02f98aca31f admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:08.876349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a1643-4195-4779-81f7-f02f98aca31f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:08.876349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a1643-4195-4779-81f7-f02f98aca31f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:08.943503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8669169b-2b40-43c8-bc63-cb39594ab662 admin admin] The token cache is being invalidate because project 2d7741de3c02497eab44ed0e182a3504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:56:08.944027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8669169b-2b40-43c8-bc63-cb39594ab662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:08.945164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8669169b-2b40-43c8-bc63-cb39594ab662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:08.946596 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3772/7542] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:56:08 2022] DELETE /identity/v3/projects/2d7741de3c02497eab44ed0e182a3504 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:56:08.952182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669169b-2b40-43c8-bc63-cb39594ab662 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:08.954483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8669169b-2b40-43c8-bc63-cb39594ab662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:08.975888 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3771/7543] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:56:08 2022] POST /identity/v3/users => generated 300 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:56:08.982912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a1643-4195-4779-81f7-f02f98aca31f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:08.987520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4b3a1643-4195-4779-81f7-f02f98aca31f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:08.990845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669169b-2b40-43c8-bc63-cb39594ab662 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:09.003021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c10e2-9f1e-4d0a-9692-785993cd0f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:09.003344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c10e2-9f1e-4d0a-9692-785993cd0f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:09.004817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c10e2-9f1e-4d0a-9692-785993cd0f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:09.004817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c10e2-9f1e-4d0a-9692-785993cd0f8d admin admin] PATH_INFO: `/v3/users/9ebc82e120a14b899f18b4d24a93cd90` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:09.007793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c10e2-9f1e-4d0a-9692-785993cd0f8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ebc82e120a14b899f18b4d24a93cd90)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:09.015192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c10e2-9f1e-4d0a-9692-785993cd0f8d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:09.030233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a1643-4195-4779-81f7-f02f98aca31f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:09.053817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450197c0-e41b-4f4e-814a-cff662740d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:09.054626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450197c0-e41b-4f4e-814a-cff662740d69 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:09.054911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450197c0-e41b-4f4e-814a-cff662740d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:09.055190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450197c0-e41b-4f4e-814a-cff662740d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:09.055855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450197c0-e41b-4f4e-814a-cff662740d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:09.066084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450197c0-e41b-4f4e-814a-cff662740d69 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:09.089755 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3772/7544] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:09.095293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450197c0-e41b-4f4e-814a-cff662740d69 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:09.113615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450197c0-e41b-4f4e-814a-cff662740d69 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:09.129320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c84635-00ff-49bb-b7d8-306cd33c7a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:09.130358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c84635-00ff-49bb-b7d8-306cd33c7a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:09.131039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c84635-00ff-49bb-b7d8-306cd33c7a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:09.132149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c84635-00ff-49bb-b7d8-306cd33c7a1a admin admin] PATH_INFO: `/v3/projects/094c462cad6b497280580faed9f9f974/users/30dc3bba6f1544b09b16817c4e7a0602/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:09.153921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c84635-00ff-49bb-b7d8-306cd33c7a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=094c462cad6b497280580faed9f9f974, user_id=30dc3bba6f1544b09b16817c4e7a0602, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:09.161142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c84635-00ff-49bb-b7d8-306cd33c7a1a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:09.169419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:09.298737 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3773/7545] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:09 2022] PUT /identity/v3/projects/094c462cad6b497280580faed9f9f974/users/30dc3bba6f1544b09b16817c4e7a0602/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:09.303430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d19c10e2-9f1e-4d0a-9692-785993cd0f8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ebc82e120a14b899f18b4d24a93cd90'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:09.303964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c84635-00ff-49bb-b7d8-306cd33c7a1a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:09.305696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d19c10e2-9f1e-4d0a-9692-785993cd0f8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ebc82e120a14b899f18b4d24a93cd90'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:09.306099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-90c84635-00ff-49bb-b7d8-306cd33c7a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:09.323792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d19c10e2-9f1e-4d0a-9692-785993cd0f8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ebc82e120a14b899f18b4d24a93cd90'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:09.354014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d19c10e2-9f1e-4d0a-9692-785993cd0f8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ebc82e120a14b899f18b4d24a93cd90'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:09.356495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d19c10e2-9f1e-4d0a-9692-785993cd0f8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ebc82e120a14b899f18b4d24a93cd90'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:09.464107 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3773/7546] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:56:08 2022] DELETE /identity/v3/users/9ebc82e120a14b899f18b4d24a93cd90 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:09.475000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c84635-00ff-49bb-b7d8-306cd33c7a1a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:09.570779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f28fa-e01e-495e-aac0-c119e73ee3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:09.571655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f28fa-e01e-495e-aac0-c119e73ee3ef admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:09.571999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f28fa-e01e-495e-aac0-c119e73ee3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:09.572247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f28fa-e01e-495e-aac0-c119e73ee3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:09.573868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f28fa-e01e-495e-aac0-c119e73ee3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:09.575582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f28fa-e01e-495e-aac0-c119e73ee3ef admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:09.590278 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3774/7547] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:09.595066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c10e2-9f1e-4d0a-9692-785993cd0f8d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:09.610727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c10e2-9f1e-4d0a-9692-785993cd0f8d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:09.623647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539350b-2c58-4c45-ae5b-3f84ddee90f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:09.624691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539350b-2c58-4c45-ae5b-3f84ddee90f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:09.625405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539350b-2c58-4c45-ae5b-3f84ddee90f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:09.625854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539350b-2c58-4c45-ae5b-3f84ddee90f7 admin admin] PATH_INFO: `/v3/projects/094c462cad6b497280580faed9f9f974/users/30dc3bba6f1544b09b16817c4e7a0602/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:09.628163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539350b-2c58-4c45-ae5b-3f84ddee90f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=094c462cad6b497280580faed9f9f974, user_id=30dc3bba6f1544b09b16817c4e7a0602, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:09.631483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539350b-2c58-4c45-ae5b-3f84ddee90f7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:09.648743 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3774/7548] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:09 2022] PUT /identity/v3/projects/094c462cad6b497280580faed9f9f974/users/30dc3bba6f1544b09b16817c4e7a0602/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:09.662413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09755d4-c0a0-40e9-ab9e-13b24a208e63 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:09.662923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09755d4-c0a0-40e9-ab9e-13b24a208e63 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:09.663450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09755d4-c0a0-40e9-ab9e-13b24a208e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:09.732440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e09755d4-c0a0-40e9-ab9e-13b24a208e63 None None] MFA Rules not processed for user `30dc3bba6f1544b09b16817c4e7a0602`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:09.736086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e09755d4-c0a0-40e9-ab9e-13b24a208e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:09.806158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:09.875376 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3775/7549] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:09.897522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539350b-2c58-4c45-ae5b-3f84ddee90f7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:09.899400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3539350b-2c58-4c45-ae5b-3f84ddee90f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:10.013564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539350b-2c58-4c45-ae5b-3f84ddee90f7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:10.022142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16840ab8-d2d4-46d1-b7fa-f57090975bca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:10.022966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16840ab8-d2d4-46d1-b7fa-f57090975bca service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:10.023323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16840ab8-d2d4-46d1-b7fa-f57090975bca service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:10.023609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16840ab8-d2d4-46d1-b7fa-f57090975bca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:10.046499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16840ab8-d2d4-46d1-b7fa-f57090975bca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:10.048069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16840ab8-d2d4-46d1-b7fa-f57090975bca service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:10.071567 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3775/7550] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:56:10.087166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:10.190633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09755d4-c0a0-40e9-ab9e-13b24a208e63 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:10.266837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16840ab8-d2d4-46d1-b7fa-f57090975bca service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:10.268649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-16840ab8-d2d4-46d1-b7fa-f57090975bca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:10.293288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09755d4-c0a0-40e9-ab9e-13b24a208e63 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:10.307110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16840ab8-d2d4-46d1-b7fa-f57090975bca service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:10.307249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f370c6-992e-4176-9a7d-8a46cf7d65e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:10.307249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f370c6-992e-4176-9a7d-8a46cf7d65e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:10.307249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f370c6-992e-4176-9a7d-8a46cf7d65e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:10.307249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f370c6-992e-4176-9a7d-8a46cf7d65e4 admin admin] PATH_INFO: `/v3/users/4454e55f61994aa18d25510f98cd5aa3` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:10.307547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f370c6-992e-4176-9a7d-8a46cf7d65e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4454e55f61994aa18d25510f98cd5aa3)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:10.307620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f3650-1893-444a-aa3a-b592db55f4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:10.307769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f370c6-992e-4176-9a7d-8a46cf7d65e4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:10.308383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f3650-1893-444a-aa3a-b592db55f4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:10.308726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f3650-1893-444a-aa3a-b592db55f4db admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:10.309096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f3650-1893-444a-aa3a-b592db55f4db admin admin] PATH_INFO: `/v3/projects/03c890496d974f97893d6e9752db2dff` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:10.310492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f3650-1893-444a-aa3a-b592db55f4db admin admin] RBAC: Authorizing `identity:delete_project(project_id=03c890496d974f97893d6e9752db2dff)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:10.312581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f3650-1893-444a-aa3a-b592db55f4db admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:10.549979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:10.585762 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-60f370c6-992e-4176-9a7d-8a46cf7d65e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4454e55f61994aa18d25510f98cd5aa3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:10.586523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-60f370c6-992e-4176-9a7d-8a46cf7d65e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4454e55f61994aa18d25510f98cd5aa3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:10.592990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e31f3650-1893-444a-aa3a-b592db55f4db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03c890496d974f97893d6e9752db2dff', 'request_id': 'req-e31f3650-1893-444a-aa3a-b592db55f4db'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:10.596733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-60f370c6-992e-4176-9a7d-8a46cf7d65e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4454e55f61994aa18d25510f98cd5aa3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:10.600341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e31f3650-1893-444a-aa3a-b592db55f4db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03c890496d974f97893d6e9752db2dff', 'request_id': 'req-e31f3650-1893-444a-aa3a-b592db55f4db'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:10.606584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e31f3650-1893-444a-aa3a-b592db55f4db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03c890496d974f97893d6e9752db2dff', 'request_id': 'req-e31f3650-1893-444a-aa3a-b592db55f4db'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:10.612054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-60f370c6-992e-4176-9a7d-8a46cf7d65e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4454e55f61994aa18d25510f98cd5aa3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:10.736085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e31f3650-1893-444a-aa3a-b592db55f4db admin admin] The token cache is being invalidate because project 03c890496d974f97893d6e9752db2dff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:56:10.736670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e31f3650-1893-444a-aa3a-b592db55f4db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:10.737829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e31f3650-1893-444a-aa3a-b592db55f4db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:10.739627 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3776/7551] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:56:10 2022] DELETE /identity/v3/projects/03c890496d974f97893d6e9752db2dff => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:10.744137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa30129-80d6-4d3a-88a6-cfbe2fbdba38 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:10.744601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa30129-80d6-4d3a-88a6-cfbe2fbdba38 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:10.747037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa30129-80d6-4d3a-88a6-cfbe2fbdba38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:10.768099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-eaa30129-80d6-4d3a-88a6-cfbe2fbdba38 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:10.769348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-eaa30129-80d6-4d3a-88a6-cfbe2fbdba38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:10.821771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-60f370c6-992e-4176-9a7d-8a46cf7d65e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4454e55f61994aa18d25510f98cd5aa3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:10.831414 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3776/7552] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:56:10 2022] DELETE /identity/v3/users/4454e55f61994aa18d25510f98cd5aa3 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:10.837826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08313d7c-8973-4e08-8e72-c1a5e4a2b8eb None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:10.838410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08313d7c-8973-4e08-8e72-c1a5e4a2b8eb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:10.838715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08313d7c-8973-4e08-8e72-c1a5e4a2b8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:10.854647 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3777/7553] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:56:10.858490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0998f07-28f0-4986-8128-80478bdc4237 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:10.858812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0998f07-28f0-4986-8128-80478bdc4237 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:10.859091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0998f07-28f0-4986-8128-80478bdc4237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:10.862610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-08313d7c-8973-4e08-8e72-c1a5e4a2b8eb None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:10.863926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-08313d7c-8973-4e08-8e72-c1a5e4a2b8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:10.882087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c0998f07-28f0-4986-8128-80478bdc4237 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:10.883344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c0998f07-28f0-4986-8128-80478bdc4237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:10.939446 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3777/7554] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:10.946421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08313d7c-8973-4e08-8e72-c1a5e4a2b8eb None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:10.949557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-08313d7c-8973-4e08-8e72-c1a5e4a2b8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:10.964394 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3778/7555] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:10.975159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0998f07-28f0-4986-8128-80478bdc4237 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:10.985787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0998f07-28f0-4986-8128-80478bdc4237 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:10.989955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5ad74-b399-4759-878e-4a0eeb9f0f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:10.990607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5ad74-b399-4759-878e-4a0eeb9f0f07 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:10.990890 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5ad74-b399-4759-878e-4a0eeb9f0f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:10.991167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5ad74-b399-4759-878e-4a0eeb9f0f07 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:10.991830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5ad74-b399-4759-878e-4a0eeb9f0f07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:56:10.992187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5ad74-b399-4759-878e-4a0eeb9f0f07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:10.994304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5ad74-b399-4759-878e-4a0eeb9f0f07 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:11.016921 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3779/7556] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:56:11.021155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5ad74-b399-4759-878e-4a0eeb9f0f07 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:11.027279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08313d7c-8973-4e08-8e72-c1a5e4a2b8eb None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:11.032444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa60d9f-f14e-4db1-9411-d1662f1310ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:11.033282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa60d9f-f14e-4db1-9411-d1662f1310ca service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:11.033577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa60d9f-f14e-4db1-9411-d1662f1310ca service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:11.033856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa60d9f-f14e-4db1-9411-d1662f1310ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:11.040810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5ad74-b399-4759-878e-4a0eeb9f0f07 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:11.045025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa60d9f-f14e-4db1-9411-d1662f1310ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:11.047299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa60d9f-f14e-4db1-9411-d1662f1310ca service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:11.047443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cbff2-995f-4155-9852-832552a3e74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:11.048086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cbff2-995f-4155-9852-832552a3e74c admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:11.048452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cbff2-995f-4155-9852-832552a3e74c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:11.049248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cbff2-995f-4155-9852-832552a3e74c admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:11.050165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cbff2-995f-4155-9852-832552a3e74c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:11.052883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cbff2-995f-4155-9852-832552a3e74c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:11.058381 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3778/7557] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:56:11.142069 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3780/7558] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:56:11 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:56:11.147239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa60d9f-f14e-4db1-9411-d1662f1310ca service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:11.168658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:11.177836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa60d9f-f14e-4db1-9411-d1662f1310ca service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:11.254708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e5062-ba7b-4ea8-a293-24a93797d52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:11.255414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e5062-ba7b-4ea8-a293-24a93797d52c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:11.255919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e5062-ba7b-4ea8-a293-24a93797d52c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:11.256297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e5062-ba7b-4ea8-a293-24a93797d52c admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:11.257027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e5062-ba7b-4ea8-a293-24a93797d52c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:11.259088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e5062-ba7b-4ea8-a293-24a93797d52c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:11.354863 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3779/7559] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:56:11 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:11.357001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:11.357527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cbff2-995f-4155-9852-832552a3e74c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:11.370096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cbff2-995f-4155-9852-832552a3e74c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:11.375762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9046d89-da2b-4df4-9010-045fabe71b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:11.376612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9046d89-da2b-4df4-9010-045fabe71b66 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:11.376943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9046d89-da2b-4df4-9010-045fabe71b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:11.377389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9046d89-da2b-4df4-9010-045fabe71b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:11.378113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9046d89-da2b-4df4-9010-045fabe71b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:11.379979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9046d89-da2b-4df4-9010-045fabe71b66 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:11.392255 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3781/7560] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:11.396458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e5062-ba7b-4ea8-a293-24a93797d52c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:11.408185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e5062-ba7b-4ea8-a293-24a93797d52c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:11.413331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955d465-ae9f-4da8-b225-5dfaf81458bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:11.414907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955d465-ae9f-4da8-b225-5dfaf81458bc admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:11.414907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955d465-ae9f-4da8-b225-5dfaf81458bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:11.414907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955d465-ae9f-4da8-b225-5dfaf81458bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:11.415278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955d465-ae9f-4da8-b225-5dfaf81458bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:11.416933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955d465-ae9f-4da8-b225-5dfaf81458bc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:11.430339 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3780/7561] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:11.434848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9046d89-da2b-4df4-9010-045fabe71b66 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:11.446704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9046d89-da2b-4df4-9010-045fabe71b66 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:11.452608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a5163-8354-44f0-a266-534cd91e4042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:11.453447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a5163-8354-44f0-a266-534cd91e4042 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:11.453809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a5163-8354-44f0-a266-534cd91e4042 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:11.454233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a5163-8354-44f0-a266-534cd91e4042 admin admin] PATH_INFO: `/v3/projects/38d9ec8ec4864d67a2bcc475f2ddb6c1/users/f14cc02b164749a9aff63a7492e9c8a5/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:11.472294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a5163-8354-44f0-a266-534cd91e4042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d9ec8ec4864d67a2bcc475f2ddb6c1, user_id=f14cc02b164749a9aff63a7492e9c8a5, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:11.475669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a5163-8354-44f0-a266-534cd91e4042 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:11.550168 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3782/7562] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:11 2022] PUT /identity/v3/projects/38d9ec8ec4864d67a2bcc475f2ddb6c1/users/f14cc02b164749a9aff63a7492e9c8a5/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:56:11.561550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02679598-4d64-479b-aeb8-122b86e700c3 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:11.561844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02679598-4d64-479b-aeb8-122b86e700c3 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:11.562156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02679598-4d64-479b-aeb8-122b86e700c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:11.628442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-02679598-4d64-479b-aeb8-122b86e700c3 None None] MFA Rules not processed for user `f14cc02b164749a9aff63a7492e9c8a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:11.633574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-02679598-4d64-479b-aeb8-122b86e700c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:11.752486 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3781/7563] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:11.760674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a5163-8354-44f0-a266-534cd91e4042 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:11.763131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c25a5163-8354-44f0-a266-534cd91e4042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:11.857381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a5163-8354-44f0-a266-534cd91e4042 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:11.862186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e3e76-4652-4fba-a7a4-2d21fb1ae13c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:11.864367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e3e76-4652-4fba-a7a4-2d21fb1ae13c service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:11.864367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e3e76-4652-4fba-a7a4-2d21fb1ae13c service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:11.864367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e3e76-4652-4fba-a7a4-2d21fb1ae13c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:11.876567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e3e76-4652-4fba-a7a4-2d21fb1ae13c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:11.878071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e3e76-4652-4fba-a7a4-2d21fb1ae13c service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:11.902340 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3783/7564] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:56:11.917338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02679598-4d64-479b-aeb8-122b86e700c3 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:11.919064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-02679598-4d64-479b-aeb8-122b86e700c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:12.037585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02679598-4d64-479b-aeb8-122b86e700c3 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:12.043543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545cf91-46cc-4dee-b559-a42f4028abe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:12.044330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545cf91-46cc-4dee-b559-a42f4028abe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:12.044665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545cf91-46cc-4dee-b559-a42f4028abe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:12.045590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545cf91-46cc-4dee-b559-a42f4028abe5 admin admin] PATH_INFO: `/v3/projects/2e3fba2d15e8468692eda68fb751d57d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:12.047141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545cf91-46cc-4dee-b559-a42f4028abe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e3fba2d15e8468692eda68fb751d57d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:12.050163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545cf91-46cc-4dee-b559-a42f4028abe5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:12.199373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3545cf91-46cc-4dee-b559-a42f4028abe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e3fba2d15e8468692eda68fb751d57d', 'request_id': 'req-3545cf91-46cc-4dee-b559-a42f4028abe5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:12.330780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3545cf91-46cc-4dee-b559-a42f4028abe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e3fba2d15e8468692eda68fb751d57d', 'request_id': 'req-3545cf91-46cc-4dee-b559-a42f4028abe5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:12.340091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3545cf91-46cc-4dee-b559-a42f4028abe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e3fba2d15e8468692eda68fb751d57d', 'request_id': 'req-3545cf91-46cc-4dee-b559-a42f4028abe5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:12.356309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3545cf91-46cc-4dee-b559-a42f4028abe5 admin admin] The token cache is being invalidate because project 2e3fba2d15e8468692eda68fb751d57d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:56:12.356509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3545cf91-46cc-4dee-b559-a42f4028abe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:12.357732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3545cf91-46cc-4dee-b559-a42f4028abe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:12.360048 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3782/7565] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:56:11 2022] DELETE /identity/v3/projects/2e3fba2d15e8468692eda68fb751d57d => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:12.364233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e3e76-4652-4fba-a7a4-2d21fb1ae13c service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:12.377406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e3e76-4652-4fba-a7a4-2d21fb1ae13c service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:12.441660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b5ff0-8ac9-4ce0-948a-70b3c87cf79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:12.442503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b5ff0-8ac9-4ce0-948a-70b3c87cf79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:12.443040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b5ff0-8ac9-4ce0-948a-70b3c87cf79f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:12.443680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b5ff0-8ac9-4ce0-948a-70b3c87cf79f admin admin] PATH_INFO: `/v3/users/30dc3bba6f1544b09b16817c4e7a0602` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:12.445123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b5ff0-8ac9-4ce0-948a-70b3c87cf79f admin admin] RBAC: Authorizing `identity:delete_user(user_id=30dc3bba6f1544b09b16817c4e7a0602)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:12.447244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b5ff0-8ac9-4ce0-948a-70b3c87cf79f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:12.691773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-de1b5ff0-8ac9-4ce0-948a-70b3c87cf79f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30dc3bba6f1544b09b16817c4e7a0602'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:12.692895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-de1b5ff0-8ac9-4ce0-948a-70b3c87cf79f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30dc3bba6f1544b09b16817c4e7a0602'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:12.695873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:12.703444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-de1b5ff0-8ac9-4ce0-948a-70b3c87cf79f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30dc3bba6f1544b09b16817c4e7a0602'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:12.718276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-de1b5ff0-8ac9-4ce0-948a-70b3c87cf79f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30dc3bba6f1544b09b16817c4e7a0602'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:12.719324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-de1b5ff0-8ac9-4ce0-948a-70b3c87cf79f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30dc3bba6f1544b09b16817c4e7a0602'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:12.873659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:12.896325 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3784/7566] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:56:12 2022] DELETE /identity/v3/users/30dc3bba6f1544b09b16817c4e7a0602 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:14.077903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545cf91-46cc-4dee-b559-a42f4028abe5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:14.080073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3545cf91-46cc-4dee-b559-a42f4028abe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:14.109757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545cf91-46cc-4dee-b559-a42f4028abe5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:14.294803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0067c0c-98b2-49ea-8775-ef3a5d629474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:14.301237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0067c0c-98b2-49ea-8775-ef3a5d629474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:14.306519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0067c0c-98b2-49ea-8775-ef3a5d629474 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:14.306519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0067c0c-98b2-49ea-8775-ef3a5d629474 admin admin] PATH_INFO: `/v3/projects/094c462cad6b497280580faed9f9f974` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:14.307928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0067c0c-98b2-49ea-8775-ef3a5d629474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=094c462cad6b497280580faed9f9f974)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:14.316779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0067c0c-98b2-49ea-8775-ef3a5d629474 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:14.507418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d0067c0c-98b2-49ea-8775-ef3a5d629474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '094c462cad6b497280580faed9f9f974', 'request_id': 'req-d0067c0c-98b2-49ea-8775-ef3a5d629474'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:14.580171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d0067c0c-98b2-49ea-8775-ef3a5d629474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '094c462cad6b497280580faed9f9f974', 'request_id': 'req-d0067c0c-98b2-49ea-8775-ef3a5d629474'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:14.590534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d0067c0c-98b2-49ea-8775-ef3a5d629474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '094c462cad6b497280580faed9f9f974', 'request_id': 'req-d0067c0c-98b2-49ea-8775-ef3a5d629474'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:14.621189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d0067c0c-98b2-49ea-8775-ef3a5d629474 admin admin] The token cache is being invalidate because project 094c462cad6b497280580faed9f9f974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:56:14.621676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d0067c0c-98b2-49ea-8775-ef3a5d629474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:14.625447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d0067c0c-98b2-49ea-8775-ef3a5d629474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:14.627779 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3783/7567] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:56:14 2022] DELETE /identity/v3/projects/094c462cad6b497280580faed9f9f974 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:14.632720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac0bd2-7583-4453-87d0-b5682a9fb886 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:14.633196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac0bd2-7583-4453-87d0-b5682a9fb886 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:14.633282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac0bd2-7583-4453-87d0-b5682a9fb886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:14.667562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-77ac0bd2-7583-4453-87d0-b5682a9fb886 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:14.673002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-77ac0bd2-7583-4453-87d0-b5682a9fb886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:14.835724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140da9ad-f5f7-466b-892a-2ab2ff45580d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:14.836070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140da9ad-f5f7-466b-892a-2ab2ff45580d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:14.836352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140da9ad-f5f7-466b-892a-2ab2ff45580d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:14.838009 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3785/7568] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:14.890452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-140da9ad-f5f7-466b-892a-2ab2ff45580d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:14.891716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-140da9ad-f5f7-466b-892a-2ab2ff45580d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:14.920328 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3784/7569] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:56:14.926852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac0bd2-7583-4453-87d0-b5682a9fb886 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:14.940468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac0bd2-7583-4453-87d0-b5682a9fb886 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:14.950874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adddbfd-c6f2-4c3d-ab5f-7a151af65afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:14.952383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adddbfd-c6f2-4c3d-ab5f-7a151af65afe admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:14.952863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adddbfd-c6f2-4c3d-ab5f-7a151af65afe admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:14.953484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adddbfd-c6f2-4c3d-ab5f-7a151af65afe admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:14.954517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adddbfd-c6f2-4c3d-ab5f-7a151af65afe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:56:14.955037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adddbfd-c6f2-4c3d-ab5f-7a151af65afe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:14.957541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adddbfd-c6f2-4c3d-ab5f-7a151af65afe admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:14.994844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140da9ad-f5f7-466b-892a-2ab2ff45580d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:14.995693 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3786/7570] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:56:15.007578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140da9ad-f5f7-466b-892a-2ab2ff45580d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:15.025615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06252ec4-0e40-4d01-91f2-711213f804e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:15.026331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06252ec4-0e40-4d01-91f2-711213f804e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:15.026626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06252ec4-0e40-4d01-91f2-711213f804e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:15.026885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06252ec4-0e40-4d01-91f2-711213f804e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:15.027541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06252ec4-0e40-4d01-91f2-711213f804e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:15.031708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06252ec4-0e40-4d01-91f2-711213f804e7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:15.135407 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3785/7571] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:56:14 2022] POST /identity/v3/projects => generated 391 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:15.140527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adddbfd-c6f2-4c3d-ab5f-7a151af65afe admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:15.152434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adddbfd-c6f2-4c3d-ab5f-7a151af65afe admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:15.246373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b35ce-5a93-41ac-a71b-b70665631b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:15.247218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b35ce-5a93-41ac-a71b-b70665631b43 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:15.247778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b35ce-5a93-41ac-a71b-b70665631b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:15.248743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b35ce-5a93-41ac-a71b-b70665631b43 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:15.249838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b35ce-5a93-41ac-a71b-b70665631b43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:15.252144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b35ce-5a93-41ac-a71b-b70665631b43 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:15.357222 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3787/7572] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:56:15 2022] POST /identity/v3/users => generated 296 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:15.362783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06252ec4-0e40-4d01-91f2-711213f804e7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:15.380991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06252ec4-0e40-4d01-91f2-711213f804e7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:15.392943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb05ff-1682-4020-8d65-68909d8b4530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:15.394121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb05ff-1682-4020-8d65-68909d8b4530 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:15.394509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb05ff-1682-4020-8d65-68909d8b4530 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:15.394886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb05ff-1682-4020-8d65-68909d8b4530 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:15.395643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb05ff-1682-4020-8d65-68909d8b4530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:15.397397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb05ff-1682-4020-8d65-68909d8b4530 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:15.413314 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3786/7573] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:15.414783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b35ce-5a93-41ac-a71b-b70665631b43 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:15.427599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b35ce-5a93-41ac-a71b-b70665631b43 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:15.433137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37d6c9-992d-49ac-84e0-e62e7954a775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:15.434240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37d6c9-992d-49ac-84e0-e62e7954a775 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:15.434583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37d6c9-992d-49ac-84e0-e62e7954a775 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:15.435072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37d6c9-992d-49ac-84e0-e62e7954a775 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:15.436533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37d6c9-992d-49ac-84e0-e62e7954a775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:15.438520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37d6c9-992d-49ac-84e0-e62e7954a775 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:15.459248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb05ff-1682-4020-8d65-68909d8b4530 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:15.470842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb05ff-1682-4020-8d65-68909d8b4530 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:15.471631 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3788/7574] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:56:15.476849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a711cf8-8d9d-420b-b5fb-f8cdc6a67280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:15.477678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a711cf8-8d9d-420b-b5fb-f8cdc6a67280 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:15.478134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a711cf8-8d9d-420b-b5fb-f8cdc6a67280 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:15.478680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a711cf8-8d9d-420b-b5fb-f8cdc6a67280 admin admin] PATH_INFO: `/v3/projects/a6e2eebb96594dedaaeafed7bbc6c439/users/ca566a8e41714f68ad2ea6cbab9968d6/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:15.503278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a711cf8-8d9d-420b-b5fb-f8cdc6a67280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e2eebb96594dedaaeafed7bbc6c439, user_id=ca566a8e41714f68ad2ea6cbab9968d6, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:15.507604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a711cf8-8d9d-420b-b5fb-f8cdc6a67280 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:15.632433 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3787/7575] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:15 2022] PUT /identity/v3/projects/a6e2eebb96594dedaaeafed7bbc6c439/users/ca566a8e41714f68ad2ea6cbab9968d6/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:15.633137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc855e2-4ffc-475d-bff5-45ad3d9ffdcf None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:15.633566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc855e2-4ffc-475d-bff5-45ad3d9ffdcf None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:15.633566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc855e2-4ffc-475d-bff5-45ad3d9ffdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:15.680376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2fc855e2-4ffc-475d-bff5-45ad3d9ffdcf None None] MFA Rules not processed for user `ca566a8e41714f68ad2ea6cbab9968d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:15.681910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2fc855e2-4ffc-475d-bff5-45ad3d9ffdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:15.721588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:15.822562 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3789/7576] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:15.822728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a711cf8-8d9d-420b-b5fb-f8cdc6a67280 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:15.829063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:15.962290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a711cf8-8d9d-420b-b5fb-f8cdc6a67280 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:15.977523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f3c96-9381-426f-a84f-fe8d8f9f7ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:15.978238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f3c96-9381-426f-a84f-fe8d8f9f7ebe admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:15.978524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f3c96-9381-426f-a84f-fe8d8f9f7ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:15.978860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f3c96-9381-426f-a84f-fe8d8f9f7ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:15.979939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f3c96-9381-426f-a84f-fe8d8f9f7ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:15.981949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f3c96-9381-426f-a84f-fe8d8f9f7ebe admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:16.148095 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3788/7577] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:56:15 2022] POST /identity/v3/projects => generated 393 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:16.151897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc855e2-4ffc-475d-bff5-45ad3d9ffdcf None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:16.179124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc855e2-4ffc-475d-bff5-45ad3d9ffdcf None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:16.425231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b130b07-9649-4b99-b739-73ea1ceca3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:16.425826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b130b07-9649-4b99-b739-73ea1ceca3e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:16.426142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b130b07-9649-4b99-b739-73ea1ceca3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:16.426422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b130b07-9649-4b99-b739-73ea1ceca3e9 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:16.427702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b130b07-9649-4b99-b739-73ea1ceca3e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:16.429693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b130b07-9649-4b99-b739-73ea1ceca3e9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:16.521230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f3c96-9381-426f-a84f-fe8d8f9f7ebe admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:16.530807 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3790/7578] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:56:16 2022] POST /identity/v3/users => generated 303 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:16.538743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f3c96-9381-426f-a84f-fe8d8f9f7ebe admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:16.554302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3501a25-b410-4ddb-9385-d49001a1b085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:16.556528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3501a25-b410-4ddb-9385-d49001a1b085 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:16.558435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3501a25-b410-4ddb-9385-d49001a1b085 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:16.559009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3501a25-b410-4ddb-9385-d49001a1b085 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:16.560877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3501a25-b410-4ddb-9385-d49001a1b085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:16.565541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3501a25-b410-4ddb-9385-d49001a1b085 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:16.603182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b130b07-9649-4b99-b739-73ea1ceca3e9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:16.604289 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3789/7579] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:16.619568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b130b07-9649-4b99-b739-73ea1ceca3e9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:16.635364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22b27c-4201-4588-96fb-3e66e1d7d609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:16.639220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22b27c-4201-4588-96fb-3e66e1d7d609 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:16.639220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22b27c-4201-4588-96fb-3e66e1d7d609 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:16.639220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22b27c-4201-4588-96fb-3e66e1d7d609 admin admin] PATH_INFO: `/v3/projects/846406583484442284d17b5b839cb507/users/51ffdedf09634c98a65a83fb13c71e20/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:16.666801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22b27c-4201-4588-96fb-3e66e1d7d609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=846406583484442284d17b5b839cb507, user_id=51ffdedf09634c98a65a83fb13c71e20, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:16.671479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22b27c-4201-4588-96fb-3e66e1d7d609 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:16.775712 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3791/7580] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:16 2022] PUT /identity/v3/projects/846406583484442284d17b5b839cb507/users/51ffdedf09634c98a65a83fb13c71e20/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:16.780144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3501a25-b410-4ddb-9385-d49001a1b085 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:16.795971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3501a25-b410-4ddb-9385-d49001a1b085 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:16.993777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75384d46-46b7-49de-9f4f-cf1bb5cf4d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:16.997491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75384d46-46b7-49de-9f4f-cf1bb5cf4d09 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:16.997811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75384d46-46b7-49de-9f4f-cf1bb5cf4d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:17.001985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75384d46-46b7-49de-9f4f-cf1bb5cf4d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:17.006297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75384d46-46b7-49de-9f4f-cf1bb5cf4d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:17.013066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75384d46-46b7-49de-9f4f-cf1bb5cf4d09 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:17.052247 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3790/7581] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:17.057552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22b27c-4201-4588-96fb-3e66e1d7d609 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:17.082114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22b27c-4201-4588-96fb-3e66e1d7d609 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:17.097597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a72084-cf73-44b4-b6ad-0473a859259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:17.098709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a72084-cf73-44b4-b6ad-0473a859259a admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:17.099107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a72084-cf73-44b4-b6ad-0473a859259a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:17.099459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a72084-cf73-44b4-b6ad-0473a859259a admin admin] PATH_INFO: `/v3/projects/846406583484442284d17b5b839cb507/users/51ffdedf09634c98a65a83fb13c71e20/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:17.104117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a72084-cf73-44b4-b6ad-0473a859259a admin admin] RBAC: Authorizing `identity:create_grant(project_id=846406583484442284d17b5b839cb507, user_id=51ffdedf09634c98a65a83fb13c71e20, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:17.115586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a72084-cf73-44b4-b6ad-0473a859259a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:17.141438 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3792/7582] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:17 2022] PUT /identity/v3/projects/846406583484442284d17b5b839cb507/users/51ffdedf09634c98a65a83fb13c71e20/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:17.161156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82b9b6-f7a8-48a5-bd02-337e2d510e4c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:17.161622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82b9b6-f7a8-48a5-bd02-337e2d510e4c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:17.161708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82b9b6-f7a8-48a5-bd02-337e2d510e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:17.224734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9d82b9b6-f7a8-48a5-bd02-337e2d510e4c None None] MFA Rules not processed for user `51ffdedf09634c98a65a83fb13c71e20`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:17.229315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9d82b9b6-f7a8-48a5-bd02-337e2d510e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:17.429959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:17.438986 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3791/7583] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:17 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:17.460924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a72084-cf73-44b4-b6ad-0473a859259a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:17.465181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-91a72084-cf73-44b4-b6ad-0473a859259a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:17.634546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a72084-cf73-44b4-b6ad-0473a859259a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:17.645095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669e910-66a5-4498-84e2-e701bacaf63c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:17.645873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669e910-66a5-4498-84e2-e701bacaf63c service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:17.646192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669e910-66a5-4498-84e2-e701bacaf63c service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:17.646474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669e910-66a5-4498-84e2-e701bacaf63c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:17.665106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669e910-66a5-4498-84e2-e701bacaf63c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:17.669766 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669e910-66a5-4498-84e2-e701bacaf63c service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:17.700248 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3793/7584] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:17 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:56:17.793946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82b9b6-f7a8-48a5-bd02-337e2d510e4c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:17.796593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9d82b9b6-f7a8-48a5-bd02-337e2d510e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:17.836962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82b9b6-f7a8-48a5-bd02-337e2d510e4c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:17.847584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a4459-24f6-45e1-8a18-3f8cb142b67d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:17.848798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a4459-24f6-45e1-8a18-3f8cb142b67d service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:17.849287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a4459-24f6-45e1-8a18-3f8cb142b67d service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:17.849846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a4459-24f6-45e1-8a18-3f8cb142b67d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:18.078024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a4459-24f6-45e1-8a18-3f8cb142b67d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:18.081063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a4459-24f6-45e1-8a18-3f8cb142b67d service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:18.119933 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3792/7585] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:17 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:56:24.226446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669e910-66a5-4498-84e2-e701bacaf63c service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:24.227940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b669e910-66a5-4498-84e2-e701bacaf63c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:24.271576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:24.388976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669e910-66a5-4498-84e2-e701bacaf63c service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:24.394764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed370f-492b-43bb-ac57-05e61a676462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:24.395433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed370f-492b-43bb-ac57-05e61a676462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:24.395721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed370f-492b-43bb-ac57-05e61a676462 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:24.396152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed370f-492b-43bb-ac57-05e61a676462 admin admin] PATH_INFO: `/v3/users/e45eb7db4e1c49339e58401fe8935f59` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:24.398934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed370f-492b-43bb-ac57-05e61a676462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e45eb7db4e1c49339e58401fe8935f59)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:24.402440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed370f-492b-43bb-ac57-05e61a676462 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:24.665615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-caed370f-492b-43bb-ac57-05e61a676462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e45eb7db4e1c49339e58401fe8935f59'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:24.666523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-caed370f-492b-43bb-ac57-05e61a676462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e45eb7db4e1c49339e58401fe8935f59'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:24.677262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-caed370f-492b-43bb-ac57-05e61a676462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e45eb7db4e1c49339e58401fe8935f59'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:24.694606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-caed370f-492b-43bb-ac57-05e61a676462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e45eb7db4e1c49339e58401fe8935f59'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:24.695793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-caed370f-492b-43bb-ac57-05e61a676462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e45eb7db4e1c49339e58401fe8935f59'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:24.828158 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3794/7586] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:56:24 2022] DELETE /identity/v3/users/e45eb7db4e1c49339e58401fe8935f59 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:24.832422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a6f4a-1243-4b05-807b-2416f15ce635 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:24.833694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a6f4a-1243-4b05-807b-2416f15ce635 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:24.834257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a6f4a-1243-4b05-807b-2416f15ce635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:24.858176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-747a6f4a-1243-4b05-807b-2416f15ce635 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:24.859769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-747a6f4a-1243-4b05-807b-2416f15ce635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:24.981829 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3793/7587] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:56:24.991139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed370f-492b-43bb-ac57-05e61a676462 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:25.004297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-caed370f-492b-43bb-ac57-05e61a676462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:25.179617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed370f-492b-43bb-ac57-05e61a676462 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:25.184598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473b8d6-56e0-42e1-9a2f-6abbd7964d10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:25.186550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473b8d6-56e0-42e1-9a2f-6abbd7964d10 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:25.187047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473b8d6-56e0-42e1-9a2f-6abbd7964d10 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:25.187527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473b8d6-56e0-42e1-9a2f-6abbd7964d10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:25.210382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473b8d6-56e0-42e1-9a2f-6abbd7964d10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:25.213498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473b8d6-56e0-42e1-9a2f-6abbd7964d10 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:25.234594 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3795/7588] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:56:25.723580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a6f4a-1243-4b05-807b-2416f15ce635 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:25.725958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-747a6f4a-1243-4b05-807b-2416f15ce635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:25.765489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a6f4a-1243-4b05-807b-2416f15ce635 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:25.790700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faed21f-7af8-4bae-987c-04b2a5f7a90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:25.793504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faed21f-7af8-4bae-987c-04b2a5f7a90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:25.793504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faed21f-7af8-4bae-987c-04b2a5f7a90f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:25.793504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faed21f-7af8-4bae-987c-04b2a5f7a90f admin admin] PATH_INFO: `/v3/projects/412efc174a98498fb4e4f250eed77bd3` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:25.799467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faed21f-7af8-4bae-987c-04b2a5f7a90f admin admin] RBAC: Authorizing `identity:delete_project(project_id=412efc174a98498fb4e4f250eed77bd3)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:25.809341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faed21f-7af8-4bae-987c-04b2a5f7a90f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:26.032515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8faed21f-7af8-4bae-987c-04b2a5f7a90f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '412efc174a98498fb4e4f250eed77bd3', 'request_id': 'req-8faed21f-7af8-4bae-987c-04b2a5f7a90f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:26.129677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8faed21f-7af8-4bae-987c-04b2a5f7a90f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '412efc174a98498fb4e4f250eed77bd3', 'request_id': 'req-8faed21f-7af8-4bae-987c-04b2a5f7a90f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:26.142450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8faed21f-7af8-4bae-987c-04b2a5f7a90f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '412efc174a98498fb4e4f250eed77bd3', 'request_id': 'req-8faed21f-7af8-4bae-987c-04b2a5f7a90f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:26.176422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8faed21f-7af8-4bae-987c-04b2a5f7a90f admin admin] The token cache is being invalidate because project 412efc174a98498fb4e4f250eed77bd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:56:26.176738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8faed21f-7af8-4bae-987c-04b2a5f7a90f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:26.186312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8faed21f-7af8-4bae-987c-04b2a5f7a90f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:26.195559 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3794/7589] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:56:25 2022] DELETE /identity/v3/projects/412efc174a98498fb4e4f250eed77bd3 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:26.203093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0491e9-b6e0-4e0d-8b2f-741ffbe6535a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:26.207619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0491e9-b6e0-4e0d-8b2f-741ffbe6535a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:26.207965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0491e9-b6e0-4e0d-8b2f-741ffbe6535a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:26.252737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ae0491e9-b6e0-4e0d-8b2f-741ffbe6535a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:26.255424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ae0491e9-b6e0-4e0d-8b2f-741ffbe6535a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:26.366237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:26.467176 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3796/7590] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:26.485813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d84eb-a54c-4470-b58a-973fdb40c47b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:26.485813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d84eb-a54c-4470-b58a-973fdb40c47b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:26.485813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d84eb-a54c-4470-b58a-973fdb40c47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:26.573786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c02d84eb-a54c-4470-b58a-973fdb40c47b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:26.575161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c02d84eb-a54c-4470-b58a-973fdb40c47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:26.596075 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3795/7591] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:26.603329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0491e9-b6e0-4e0d-8b2f-741ffbe6535a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:26.615783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0491e9-b6e0-4e0d-8b2f-741ffbe6535a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:26.624695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50ff9e-36ad-4379-a88a-632461296ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:26.625408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50ff9e-36ad-4379-a88a-632461296ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:26.625768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50ff9e-36ad-4379-a88a-632461296ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:26.626935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50ff9e-36ad-4379-a88a-632461296ac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:26.628377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50ff9e-36ad-4379-a88a-632461296ac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:56:26.628796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50ff9e-36ad-4379-a88a-632461296ac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:26.631014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50ff9e-36ad-4379-a88a-632461296ac3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:26.660043 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3797/7592] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:56:26.664413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d84eb-a54c-4470-b58a-973fdb40c47b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:26.676434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d84eb-a54c-4470-b58a-973fdb40c47b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:26.691159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42084e-6900-44d8-9e53-73619b734fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:26.691874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42084e-6900-44d8-9e53-73619b734fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:26.692227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42084e-6900-44d8-9e53-73619b734fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:26.692736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42084e-6900-44d8-9e53-73619b734fd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:26.693440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42084e-6900-44d8-9e53-73619b734fd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:26.697341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42084e-6900-44d8-9e53-73619b734fd5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:26.720235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:26.874960 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3796/7593] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:56:26 2022] POST /identity/v3/projects => generated 353 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:56:26.879398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50ff9e-36ad-4379-a88a-632461296ac3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:26.894774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50ff9e-36ad-4379-a88a-632461296ac3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:27.006721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051e383-8336-4e87-8f4d-381b481c5353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:27.007735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051e383-8336-4e87-8f4d-381b481c5353 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:27.008225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051e383-8336-4e87-8f4d-381b481c5353 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:27.008692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051e383-8336-4e87-8f4d-381b481c5353 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:27.009549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051e383-8336-4e87-8f4d-381b481c5353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:27.012710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051e383-8336-4e87-8f4d-381b481c5353 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:27.162532 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3798/7594] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:56:26 2022] POST /identity/v3/users => generated 277 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:27.164334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42084e-6900-44d8-9e53-73619b734fd5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:27.181949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42084e-6900-44d8-9e53-73619b734fd5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:27.189358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de5641-b662-49f4-873d-5a9f3c2388e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:27.190374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de5641-b662-49f4-873d-5a9f3c2388e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:27.190847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de5641-b662-49f4-873d-5a9f3c2388e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:27.196554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de5641-b662-49f4-873d-5a9f3c2388e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:27.196554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de5641-b662-49f4-873d-5a9f3c2388e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:27.196554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de5641-b662-49f4-873d-5a9f3c2388e1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:27.209896 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3797/7595] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:56:27.214089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051e383-8336-4e87-8f4d-381b481c5353 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:27.228236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051e383-8336-4e87-8f4d-381b481c5353 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:27.233294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a1008-c381-4b4f-86a9-4768b410c606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:27.233990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a1008-c381-4b4f-86a9-4768b410c606 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:27.234326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a1008-c381-4b4f-86a9-4768b410c606 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:27.234607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a1008-c381-4b4f-86a9-4768b410c606 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:27.235279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a1008-c381-4b4f-86a9-4768b410c606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:27.237079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a1008-c381-4b4f-86a9-4768b410c606 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:27.253796 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3799/7596] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:27.265634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de5641-b662-49f4-873d-5a9f3c2388e1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:27.276135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de5641-b662-49f4-873d-5a9f3c2388e1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:27.282433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4d9cd-a33d-4df1-99c4-f22a347e4be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:27.283118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4d9cd-a33d-4df1-99c4-f22a347e4be2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:27.283399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4d9cd-a33d-4df1-99c4-f22a347e4be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:27.283961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4d9cd-a33d-4df1-99c4-f22a347e4be2 admin admin] PATH_INFO: `/v3/projects/1de8c9368fd54b169d8e2b92c3e47201/users/e48c9cd568254d5d95d172f9b04f5e5d/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:27.306329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4d9cd-a33d-4df1-99c4-f22a347e4be2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1de8c9368fd54b169d8e2b92c3e47201, user_id=e48c9cd568254d5d95d172f9b04f5e5d, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:27.314538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4d9cd-a33d-4df1-99c4-f22a347e4be2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:27.442632 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3798/7597] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:27 2022] PUT /identity/v3/projects/1de8c9368fd54b169d8e2b92c3e47201/users/e48c9cd568254d5d95d172f9b04f5e5d/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:27.452662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c983d-ffbb-476a-9371-12f238798218 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:27.453148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c983d-ffbb-476a-9371-12f238798218 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:27.454433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c983d-ffbb-476a-9371-12f238798218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:27.505545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7f9c983d-ffbb-476a-9371-12f238798218 None None] MFA Rules not processed for user `e48c9cd568254d5d95d172f9b04f5e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:27.507064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7f9c983d-ffbb-476a-9371-12f238798218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:27.683608 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3800/7598] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:27 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:27.690791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4d9cd-a33d-4df1-99c4-f22a347e4be2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:27.694388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e9b4d9cd-a33d-4df1-99c4-f22a347e4be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:27.853592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4d9cd-a33d-4df1-99c4-f22a347e4be2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:27.867298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed19963-7a80-495e-8fdb-c29ac936e6fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:27.867941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed19963-7a80-495e-8fdb-c29ac936e6fb service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:27.868222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed19963-7a80-495e-8fdb-c29ac936e6fb service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:27.868663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed19963-7a80-495e-8fdb-c29ac936e6fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:27.896866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed19963-7a80-495e-8fdb-c29ac936e6fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:27.901451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed19963-7a80-495e-8fdb-c29ac936e6fb service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:27.932595 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3799/7599] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:27 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:56:28.578168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c983d-ffbb-476a-9371-12f238798218 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:28.580215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7f9c983d-ffbb-476a-9371-12f238798218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:28.651351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:28.711867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c983d-ffbb-476a-9371-12f238798218 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:28.717927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36512d1b-0c7e-4b19-bd49-6f82f983e71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:28.718883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36512d1b-0c7e-4b19-bd49-6f82f983e71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:28.719320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36512d1b-0c7e-4b19-bd49-6f82f983e71f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:28.719788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36512d1b-0c7e-4b19-bd49-6f82f983e71f admin admin] PATH_INFO: `/v3/users/ca566a8e41714f68ad2ea6cbab9968d6` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:28.721187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36512d1b-0c7e-4b19-bd49-6f82f983e71f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca566a8e41714f68ad2ea6cbab9968d6)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:28.724347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36512d1b-0c7e-4b19-bd49-6f82f983e71f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:29.166571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-36512d1b-0c7e-4b19-bd49-6f82f983e71f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca566a8e41714f68ad2ea6cbab9968d6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:29.166571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-36512d1b-0c7e-4b19-bd49-6f82f983e71f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca566a8e41714f68ad2ea6cbab9968d6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:29.174228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-36512d1b-0c7e-4b19-bd49-6f82f983e71f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca566a8e41714f68ad2ea6cbab9968d6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:29.215132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-36512d1b-0c7e-4b19-bd49-6f82f983e71f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca566a8e41714f68ad2ea6cbab9968d6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:29.215913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-36512d1b-0c7e-4b19-bd49-6f82f983e71f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca566a8e41714f68ad2ea6cbab9968d6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:29.421118 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3801/7600] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:56:28 2022] DELETE /identity/v3/users/ca566a8e41714f68ad2ea6cbab9968d6 => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:56:29.423450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6152c-69f5-41c3-ab88-f37d266fc0a5 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:29.424293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6152c-69f5-41c3-ab88-f37d266fc0a5 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:29.424575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6152c-69f5-41c3-ab88-f37d266fc0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:29.445200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d2f6152c-69f5-41c3-ab88-f37d266fc0a5 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:29.446414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d2f6152c-69f5-41c3-ab88-f37d266fc0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:29.522739 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3800/7601] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:29.537674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36512d1b-0c7e-4b19-bd49-6f82f983e71f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:29.539211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-36512d1b-0c7e-4b19-bd49-6f82f983e71f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:29.635848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36512d1b-0c7e-4b19-bd49-6f82f983e71f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:29.643177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cabaf4-ffe5-47bc-a533-d9ab44a8b700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:29.644321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cabaf4-ffe5-47bc-a533-d9ab44a8b700 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:29.644664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cabaf4-ffe5-47bc-a533-d9ab44a8b700 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:29.645148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cabaf4-ffe5-47bc-a533-d9ab44a8b700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:29.660864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cabaf4-ffe5-47bc-a533-d9ab44a8b700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:29.663535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cabaf4-ffe5-47bc-a533-d9ab44a8b700 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:29.698160 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3802/7602] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:56:30.234150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6152c-69f5-41c3-ab88-f37d266fc0a5 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:30.235613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d2f6152c-69f5-41c3-ab88-f37d266fc0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:30.258771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6152c-69f5-41c3-ab88-f37d266fc0a5 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:30.267873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2093e4c-7b32-404c-b684-28f1b3bf65d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:30.268941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2093e4c-7b32-404c-b684-28f1b3bf65d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:30.269477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2093e4c-7b32-404c-b684-28f1b3bf65d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:30.269963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2093e4c-7b32-404c-b684-28f1b3bf65d3 admin admin] PATH_INFO: `/v3/projects/a6e2eebb96594dedaaeafed7bbc6c439` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:30.272172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2093e4c-7b32-404c-b684-28f1b3bf65d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6e2eebb96594dedaaeafed7bbc6c439)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:30.274834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2093e4c-7b32-404c-b684-28f1b3bf65d3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:30.445886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d2093e4c-7b32-404c-b684-28f1b3bf65d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6e2eebb96594dedaaeafed7bbc6c439', 'request_id': 'req-d2093e4c-7b32-404c-b684-28f1b3bf65d3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:30.454316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:30.527215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d2093e4c-7b32-404c-b684-28f1b3bf65d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6e2eebb96594dedaaeafed7bbc6c439', 'request_id': 'req-d2093e4c-7b32-404c-b684-28f1b3bf65d3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:30.542724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d2093e4c-7b32-404c-b684-28f1b3bf65d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6e2eebb96594dedaaeafed7bbc6c439', 'request_id': 'req-d2093e4c-7b32-404c-b684-28f1b3bf65d3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:30.563833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d2093e4c-7b32-404c-b684-28f1b3bf65d3 admin admin] The token cache is being invalidate because project a6e2eebb96594dedaaeafed7bbc6c439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:56:30.564367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d2093e4c-7b32-404c-b684-28f1b3bf65d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:30.565630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d2093e4c-7b32-404c-b684-28f1b3bf65d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:30.568259 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3801/7603] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:56:30 2022] DELETE /identity/v3/projects/a6e2eebb96594dedaaeafed7bbc6c439 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:30.572029 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cabaf4-ffe5-47bc-a533-d9ab44a8b700 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:30.582780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cabaf4-ffe5-47bc-a533-d9ab44a8b700 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:30.657269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:30.673237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39092fb-63f5-48ea-9eef-a1492c411fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:30.677280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39092fb-63f5-48ea-9eef-a1492c411fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:30.677280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39092fb-63f5-48ea-9eef-a1492c411fce admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:30.677280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39092fb-63f5-48ea-9eef-a1492c411fce admin admin] PATH_INFO: `/v3/users/51ffdedf09634c98a65a83fb13c71e20` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:30.677280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39092fb-63f5-48ea-9eef-a1492c411fce admin admin] RBAC: Authorizing `identity:delete_user(user_id=51ffdedf09634c98a65a83fb13c71e20)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:30.679072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39092fb-63f5-48ea-9eef-a1492c411fce admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:30.930341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d39092fb-63f5-48ea-9eef-a1492c411fce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51ffdedf09634c98a65a83fb13c71e20'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:30.931288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d39092fb-63f5-48ea-9eef-a1492c411fce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51ffdedf09634c98a65a83fb13c71e20'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:30.941219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d39092fb-63f5-48ea-9eef-a1492c411fce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51ffdedf09634c98a65a83fb13c71e20'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:30.955885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d39092fb-63f5-48ea-9eef-a1492c411fce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51ffdedf09634c98a65a83fb13c71e20'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:30.956835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d39092fb-63f5-48ea-9eef-a1492c411fce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51ffdedf09634c98a65a83fb13c71e20'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:31.048483 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3803/7604] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:56:30 2022] DELETE /identity/v3/users/51ffdedf09634c98a65a83fb13c71e20 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:32.109839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2093e4c-7b32-404c-b684-28f1b3bf65d3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:32.111628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d2093e4c-7b32-404c-b684-28f1b3bf65d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:32.130687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2093e4c-7b32-404c-b684-28f1b3bf65d3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:32.237070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917e4f8-3b25-4b3f-857d-2d22386701a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:32.237697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917e4f8-3b25-4b3f-857d-2d22386701a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:32.238144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917e4f8-3b25-4b3f-857d-2d22386701a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:32.238431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917e4f8-3b25-4b3f-857d-2d22386701a7 admin admin] PATH_INFO: `/v3/users/e48c9cd568254d5d95d172f9b04f5e5d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:32.239696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917e4f8-3b25-4b3f-857d-2d22386701a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e48c9cd568254d5d95d172f9b04f5e5d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:32.241696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917e4f8-3b25-4b3f-857d-2d22386701a7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:32.253162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39092fb-63f5-48ea-9eef-a1492c411fce admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:32.255012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d39092fb-63f5-48ea-9eef-a1492c411fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:32.269574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39092fb-63f5-48ea-9eef-a1492c411fce admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:32.280570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a82da0-86bf-4945-a43f-982126fcd68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:32.281537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a82da0-86bf-4945-a43f-982126fcd68b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:32.281980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a82da0-86bf-4945-a43f-982126fcd68b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:32.282583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a82da0-86bf-4945-a43f-982126fcd68b admin admin] PATH_INFO: `/v3/projects/846406583484442284d17b5b839cb507` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:32.284006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a82da0-86bf-4945-a43f-982126fcd68b admin admin] RBAC: Authorizing `identity:delete_project(project_id=846406583484442284d17b5b839cb507)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:32.286457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a82da0-86bf-4945-a43f-982126fcd68b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:32.499713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5917e4f8-3b25-4b3f-857d-2d22386701a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e48c9cd568254d5d95d172f9b04f5e5d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:32.500554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5917e4f8-3b25-4b3f-857d-2d22386701a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e48c9cd568254d5d95d172f9b04f5e5d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:32.509677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5917e4f8-3b25-4b3f-857d-2d22386701a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e48c9cd568254d5d95d172f9b04f5e5d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:32.514179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-55a82da0-86bf-4945-a43f-982126fcd68b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '846406583484442284d17b5b839cb507', 'request_id': 'req-55a82da0-86bf-4945-a43f-982126fcd68b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:32.525010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5917e4f8-3b25-4b3f-857d-2d22386701a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e48c9cd568254d5d95d172f9b04f5e5d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:32.529667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-55a82da0-86bf-4945-a43f-982126fcd68b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '846406583484442284d17b5b839cb507', 'request_id': 'req-55a82da0-86bf-4945-a43f-982126fcd68b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:32.540383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-55a82da0-86bf-4945-a43f-982126fcd68b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '846406583484442284d17b5b839cb507', 'request_id': 'req-55a82da0-86bf-4945-a43f-982126fcd68b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:32.663144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5917e4f8-3b25-4b3f-857d-2d22386701a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e48c9cd568254d5d95d172f9b04f5e5d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:32.670753 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3802/7605] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:56:32 2022] DELETE /identity/v3/users/e48c9cd568254d5d95d172f9b04f5e5d => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:32.675871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842b8a8-c3d5-46a5-a607-65f9c8d6e5ae None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:32.676257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842b8a8-c3d5-46a5-a607-65f9c8d6e5ae None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:32.676606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842b8a8-c3d5-46a5-a607-65f9c8d6e5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:32.696383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-3842b8a8-c3d5-46a5-a607-65f9c8d6e5ae None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:32.697622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3842b8a8-c3d5-46a5-a607-65f9c8d6e5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:32.780895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-55a82da0-86bf-4945-a43f-982126fcd68b admin admin] The token cache is being invalidate because project 846406583484442284d17b5b839cb507 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:56:32.781206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-55a82da0-86bf-4945-a43f-982126fcd68b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:32.782476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-55a82da0-86bf-4945-a43f-982126fcd68b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:32.784795 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3804/7606] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:56:32 2022] DELETE /identity/v3/projects/846406583484442284d17b5b839cb507 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:32.789383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f13bc-e6af-4875-9988-54e479954483 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:32.789740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f13bc-e6af-4875-9988-54e479954483 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:32.790115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f13bc-e6af-4875-9988-54e479954483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:32.801774 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3803/7607] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:56:32.816179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842b8a8-c3d5-46a5-a607-65f9c8d6e5ae None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:32.818081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3842b8a8-c3d5-46a5-a607-65f9c8d6e5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:32.824570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:32.834222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-298f13bc-e6af-4875-9988-54e479954483 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:32.836271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-298f13bc-e6af-4875-9988-54e479954483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:32.846702 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3805/7608] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:32.854737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63910e48-810c-417b-a50d-2a2687e14c89 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:32.855109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63910e48-810c-417b-a50d-2a2687e14c89 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:32.855459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63910e48-810c-417b-a50d-2a2687e14c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:32.877250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-63910e48-810c-417b-a50d-2a2687e14c89 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:32.879227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-63910e48-810c-417b-a50d-2a2687e14c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:32.898944 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3806/7609] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:56:32.903240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63910e48-810c-417b-a50d-2a2687e14c89 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:32.921055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842b8a8-c3d5-46a5-a607-65f9c8d6e5ae None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:32.921519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63910e48-810c-417b-a50d-2a2687e14c89 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:32.926333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773aaa1-017f-4aa2-bbe4-3ad52379b4fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:32.928321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773aaa1-017f-4aa2-bbe4-3ad52379b4fa service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:32.928321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773aaa1-017f-4aa2-bbe4-3ad52379b4fa service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:32.928551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773aaa1-017f-4aa2-bbe4-3ad52379b4fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:32.930944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1590ce-7195-4b39-867d-286439424c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:32.931770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1590ce-7195-4b39-867d-286439424c86 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:32.932201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1590ce-7195-4b39-867d-286439424c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:32.932627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1590ce-7195-4b39-867d-286439424c86 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:32.933546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1590ce-7195-4b39-867d-286439424c86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:56:32.933989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1590ce-7195-4b39-867d-286439424c86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:32.936190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1590ce-7195-4b39-867d-286439424c86 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:32.940463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773aaa1-017f-4aa2-bbe4-3ad52379b4fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:32.943252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773aaa1-017f-4aa2-bbe4-3ad52379b4fa service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:32.955588 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3807/7610] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:56:32.957030 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3804/7611] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:56:32.965496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1590ce-7195-4b39-867d-286439424c86 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:32.993629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1590ce-7195-4b39-867d-286439424c86 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:33.010307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed7e3b-99e5-4831-98a3-cab8befa5481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:33.010944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed7e3b-99e5-4831-98a3-cab8befa5481 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:33.011226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed7e3b-99e5-4831-98a3-cab8befa5481 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:33.011497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed7e3b-99e5-4831-98a3-cab8befa5481 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:33.012134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed7e3b-99e5-4831-98a3-cab8befa5481 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:33.014456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed7e3b-99e5-4831-98a3-cab8befa5481 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:33.178919 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3808/7612] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:56:32 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:33.182218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773aaa1-017f-4aa2-bbe4-3ad52379b4fa service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:33.195315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773aaa1-017f-4aa2-bbe4-3ad52379b4fa service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:33.269293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f69fb-4609-4e0e-b3ac-f8cdf8756c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:33.270267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f69fb-4609-4e0e-b3ac-f8cdf8756c5b admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:33.270584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f69fb-4609-4e0e-b3ac-f8cdf8756c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:33.270861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f69fb-4609-4e0e-b3ac-f8cdf8756c5b admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:33.271518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f69fb-4609-4e0e-b3ac-f8cdf8756c5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:33.273530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f69fb-4609-4e0e-b3ac-f8cdf8756c5b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:33.326701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed7e3b-99e5-4831-98a3-cab8befa5481 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:33.328726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-82ed7e3b-99e5-4831-98a3-cab8befa5481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:33.367737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed7e3b-99e5-4831-98a3-cab8befa5481 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:33.397193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62183d0a-af3d-4d01-bea4-042a6362cb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:33.398086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62183d0a-af3d-4d01-bea4-042a6362cb93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:33.398504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62183d0a-af3d-4d01-bea4-042a6362cb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:33.399217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62183d0a-af3d-4d01-bea4-042a6362cb93 admin admin] PATH_INFO: `/v3/projects/1de8c9368fd54b169d8e2b92c3e47201` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:33.399899 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3805/7613] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:56:33 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:56:33.401488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f69fb-4609-4e0e-b3ac-f8cdf8756c5b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:33.403371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62183d0a-af3d-4d01-bea4-042a6362cb93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1de8c9368fd54b169d8e2b92c3e47201)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:33.406815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62183d0a-af3d-4d01-bea4-042a6362cb93 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:33.415395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:33.439432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f69fb-4609-4e0e-b3ac-f8cdf8756c5b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:33.447122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ac28b-b17c-43f4-88d6-89cc4a4663c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:33.453542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ac28b-b17c-43f4-88d6-89cc4a4663c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:33.453542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ac28b-b17c-43f4-88d6-89cc4a4663c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:33.453542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ac28b-b17c-43f4-88d6-89cc4a4663c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:33.453542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ac28b-b17c-43f4-88d6-89cc4a4663c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:33.453542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ac28b-b17c-43f4-88d6-89cc4a4663c8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:33.464762 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3806/7614] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:33.468681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ac28b-b17c-43f4-88d6-89cc4a4663c8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:33.479480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ac28b-b17c-43f4-88d6-89cc4a4663c8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:33.484983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f4536-320e-4ce6-85da-b124d4b461b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:33.486746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f4536-320e-4ce6-85da-b124d4b461b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:33.486746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f4536-320e-4ce6-85da-b124d4b461b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:33.486746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f4536-320e-4ce6-85da-b124d4b461b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:33.487616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f4536-320e-4ce6-85da-b124d4b461b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:33.489712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f4536-320e-4ce6-85da-b124d4b461b9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:33.517962 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3807/7615] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:56:33.519044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f4536-320e-4ce6-85da-b124d4b461b9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:33.530979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f4536-320e-4ce6-85da-b124d4b461b9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:33.538096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7fe1a-2488-4eaf-a3b0-9c5901189c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:33.538902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7fe1a-2488-4eaf-a3b0-9c5901189c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:33.541847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7fe1a-2488-4eaf-a3b0-9c5901189c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:33.541847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7fe1a-2488-4eaf-a3b0-9c5901189c03 admin admin] PATH_INFO: `/v3/projects/b048245588e04afb9e1e2f1dc9a21679/users/986a4cb677f94670ac4fd23cbf52f8ea/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:33.561600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7fe1a-2488-4eaf-a3b0-9c5901189c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b048245588e04afb9e1e2f1dc9a21679, user_id=986a4cb677f94670ac4fd23cbf52f8ea, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:33.567752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7fe1a-2488-4eaf-a3b0-9c5901189c03 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:33.668386 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3808/7616] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:33 2022] PUT /identity/v3/projects/b048245588e04afb9e1e2f1dc9a21679/users/986a4cb677f94670ac4fd23cbf52f8ea/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:33.682699 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-62183d0a-af3d-4d01-bea4-042a6362cb93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1de8c9368fd54b169d8e2b92c3e47201', 'request_id': 'req-62183d0a-af3d-4d01-bea4-042a6362cb93'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:33.688506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06586c3f-5579-4fc1-a98a-4fe99ce64ec4 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:33.688506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06586c3f-5579-4fc1-a98a-4fe99ce64ec4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:33.688506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06586c3f-5579-4fc1-a98a-4fe99ce64ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:33.699608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-62183d0a-af3d-4d01-bea4-042a6362cb93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1de8c9368fd54b169d8e2b92c3e47201', 'request_id': 'req-62183d0a-af3d-4d01-bea4-042a6362cb93'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:33.708987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-62183d0a-af3d-4d01-bea4-042a6362cb93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1de8c9368fd54b169d8e2b92c3e47201', 'request_id': 'req-62183d0a-af3d-4d01-bea4-042a6362cb93'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:33.725673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-06586c3f-5579-4fc1-a98a-4fe99ce64ec4 None None] MFA Rules not processed for user `986a4cb677f94670ac4fd23cbf52f8ea`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:33.727046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-06586c3f-5579-4fc1-a98a-4fe99ce64ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:33.775522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:33.797381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-62183d0a-af3d-4d01-bea4-042a6362cb93 admin admin] The token cache is being invalidate because project 1de8c9368fd54b169d8e2b92c3e47201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:56:33.797761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-62183d0a-af3d-4d01-bea4-042a6362cb93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:33.798520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-62183d0a-af3d-4d01-bea4-042a6362cb93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:33.804032 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3809/7617] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:56:33 2022] DELETE /identity/v3/projects/1de8c9368fd54b169d8e2b92c3e47201 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:56:33.805720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456bf8c-a1e1-446d-ae28-770447a16358 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:33.806011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456bf8c-a1e1-446d-ae28-770447a16358 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:33.806312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456bf8c-a1e1-446d-ae28-770447a16358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:33.823140 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3809/7618] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:33.826768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06586c3f-5579-4fc1-a98a-4fe99ce64ec4 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:33.829442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e456bf8c-a1e1-446d-ae28-770447a16358 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:33.830898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e456bf8c-a1e1-446d-ae28-770447a16358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:33.918477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06586c3f-5579-4fc1-a98a-4fe99ce64ec4 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:33.921654 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3810/7619] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:33.930811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4257273-5081-40ce-aa37-4ea15b865ccc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:33.931096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4257273-5081-40ce-aa37-4ea15b865ccc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:33.931372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4257273-5081-40ce-aa37-4ea15b865ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:33.938820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6e6fb-cd63-4c66-a1a1-a8af3561f57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:33.939749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6e6fb-cd63-4c66-a1a1-a8af3561f57a admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:33.940033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6e6fb-cd63-4c66-a1a1-a8af3561f57a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:33.940305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6e6fb-cd63-4c66-a1a1-a8af3561f57a admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:33.940951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6e6fb-cd63-4c66-a1a1-a8af3561f57a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:33.944399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6e6fb-cd63-4c66-a1a1-a8af3561f57a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:33.984134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b4257273-5081-40ce-aa37-4ea15b865ccc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:33.985397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b4257273-5081-40ce-aa37-4ea15b865ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:34.013019 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3811/7620] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:34.014317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4257273-5081-40ce-aa37-4ea15b865ccc None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:34.033636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4257273-5081-40ce-aa37-4ea15b865ccc None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:34.039729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fafafb-ca50-4e37-90c9-45d4f507e370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:34.040638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fafafb-ca50-4e37-90c9-45d4f507e370 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:34.041371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fafafb-ca50-4e37-90c9-45d4f507e370 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:34.042605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fafafb-ca50-4e37-90c9-45d4f507e370 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:34.043581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fafafb-ca50-4e37-90c9-45d4f507e370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:56:34.044241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fafafb-ca50-4e37-90c9-45d4f507e370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:34.047464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fafafb-ca50-4e37-90c9-45d4f507e370 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:34.066491 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3812/7621] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:56:34.070088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fafafb-ca50-4e37-90c9-45d4f507e370 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:34.085631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fafafb-ca50-4e37-90c9-45d4f507e370 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:34.090856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8e01d-1d71-492e-8716-6a8fe519ef63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:34.091578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8e01d-1d71-492e-8716-6a8fe519ef63 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:34.092561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8e01d-1d71-492e-8716-6a8fe519ef63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:34.093200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8e01d-1d71-492e-8716-6a8fe519ef63 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:34.094229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8e01d-1d71-492e-8716-6a8fe519ef63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:34.099757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8e01d-1d71-492e-8716-6a8fe519ef63 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:34.138783 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3810/7622] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:56:33 2022] POST /identity/v3/projects => generated 387 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:34.140208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6e6fb-cd63-4c66-a1a1-a8af3561f57a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:34.155053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1eb6e6fb-cd63-4c66-a1a1-a8af3561f57a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:34.235824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6e6fb-cd63-4c66-a1a1-a8af3561f57a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:34.239025 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3813/7623] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:56:34 2022] POST /identity/v3/projects => generated 403 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:34.241250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba9360-b54c-442e-988b-5f64758aa10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:34.242170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba9360-b54c-442e-988b-5f64758aa10b admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:34.242659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba9360-b54c-442e-988b-5f64758aa10b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:34.243011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba9360-b54c-442e-988b-5f64758aa10b admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:34.243549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8e01d-1d71-492e-8716-6a8fe519ef63 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:34.243680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba9360-b54c-442e-988b-5f64758aa10b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:34.245761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba9360-b54c-442e-988b-5f64758aa10b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:34.334825 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3811/7624] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:56:34 2022] POST /identity/v3/users => generated 300 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:34.335930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba9360-b54c-442e-988b-5f64758aa10b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:34.359177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba9360-b54c-442e-988b-5f64758aa10b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:34.361330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8e01d-1d71-492e-8716-6a8fe519ef63 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:34.373001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbca7b5-ae99-48d9-9b5f-6a632d19b4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:34.374169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d217550-2e6c-421b-be7c-100528ad9a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:34.374309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbca7b5-ae99-48d9-9b5f-6a632d19b4bb admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:34.374493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbca7b5-ae99-48d9-9b5f-6a632d19b4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:34.374722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbca7b5-ae99-48d9-9b5f-6a632d19b4bb admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:34.374819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d217550-2e6c-421b-be7c-100528ad9a8f admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:34.375075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d217550-2e6c-421b-be7c-100528ad9a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:34.375353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d217550-2e6c-421b-be7c-100528ad9a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:34.375472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbca7b5-ae99-48d9-9b5f-6a632d19b4bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:34.376015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d217550-2e6c-421b-be7c-100528ad9a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:34.377676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d217550-2e6c-421b-be7c-100528ad9a8f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:34.379808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbca7b5-ae99-48d9-9b5f-6a632d19b4bb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:34.406228 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3812/7625] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:56:34.406856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d217550-2e6c-421b-be7c-100528ad9a8f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:34.424945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d217550-2e6c-421b-be7c-100528ad9a8f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:34.430229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11caef-132c-45a7-ace7-84500ccca930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:34.430987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11caef-132c-45a7-ace7-84500ccca930 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:34.431277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11caef-132c-45a7-ace7-84500ccca930 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:34.431959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11caef-132c-45a7-ace7-84500ccca930 admin admin] PATH_INFO: `/v3/projects/1b26da352ae641ceae032152623ed523/users/1fedb31457fe4531b933d0f3c341ddc8/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:34.455747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11caef-132c-45a7-ace7-84500ccca930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b26da352ae641ceae032152623ed523, user_id=1fedb31457fe4531b933d0f3c341ddc8, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:34.466281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11caef-132c-45a7-ace7-84500ccca930 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:34.505039 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3814/7626] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:56:34 2022] POST /identity/v3/users => generated 302 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:56:34.508952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbca7b5-ae99-48d9-9b5f-6a632d19b4bb admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:34.519357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbca7b5-ae99-48d9-9b5f-6a632d19b4bb admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:34.524123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff232b5-e4ec-4491-86f0-df92c3be3dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:34.524714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff232b5-e4ec-4491-86f0-df92c3be3dea admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:34.525000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff232b5-e4ec-4491-86f0-df92c3be3dea admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:34.525278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff232b5-e4ec-4491-86f0-df92c3be3dea admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:34.526060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff232b5-e4ec-4491-86f0-df92c3be3dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:34.527703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff232b5-e4ec-4491-86f0-df92c3be3dea admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:34.541632 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3815/7627] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:56:34.543099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff232b5-e4ec-4491-86f0-df92c3be3dea admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:34.554303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff232b5-e4ec-4491-86f0-df92c3be3dea admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:34.559729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca69999-157a-4481-9b9b-24330c931610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:34.562865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca69999-157a-4481-9b9b-24330c931610 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:34.562865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca69999-157a-4481-9b9b-24330c931610 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:34.562865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca69999-157a-4481-9b9b-24330c931610 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:34.562865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca69999-157a-4481-9b9b-24330c931610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:34.563160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca69999-157a-4481-9b9b-24330c931610 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:34.574578 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3816/7628] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:34.579116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca69999-157a-4481-9b9b-24330c931610 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:34.592799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca69999-157a-4481-9b9b-24330c931610 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:34.593357 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3813/7629] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:34 2022] PUT /identity/v3/projects/1b26da352ae641ceae032152623ed523/users/1fedb31457fe4531b933d0f3c341ddc8/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:56:34.597422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11caef-132c-45a7-ace7-84500ccca930 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:34.626462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:34.648094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:34.676827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2dd013-28f3-4309-8a6a-2dbb1eed72dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:34.677851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dd013-28f3-4309-8a6a-2dbb1eed72dd admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:34.678354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dd013-28f3-4309-8a6a-2dbb1eed72dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:34.678816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dd013-28f3-4309-8a6a-2dbb1eed72dd admin admin] PATH_INFO: `/v3/projects/3af8376c0e954907968c0fcbfeafa00d/users/e081e7ec2a49468095ec20b04441a5d8/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:34.698195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2dd013-28f3-4309-8a6a-2dbb1eed72dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af8376c0e954907968c0fcbfeafa00d, user_id=e081e7ec2a49468095ec20b04441a5d8, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:34.700084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11caef-132c-45a7-ace7-84500ccca930 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:34.701926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2dd013-28f3-4309-8a6a-2dbb1eed72dd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:34.708600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc7ece-dcc3-4feb-ad9f-cc3b9e4e83f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:34.709228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc7ece-dcc3-4feb-ad9f-cc3b9e4e83f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:34.709641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc7ece-dcc3-4feb-ad9f-cc3b9e4e83f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:34.709928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc7ece-dcc3-4feb-ad9f-cc3b9e4e83f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:34.710649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc7ece-dcc3-4feb-ad9f-cc3b9e4e83f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:34.712309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc7ece-dcc3-4feb-ad9f-cc3b9e4e83f6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:34.723771 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3814/7630] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:56:34.727919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc7ece-dcc3-4feb-ad9f-cc3b9e4e83f6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:34.742690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc7ece-dcc3-4feb-ad9f-cc3b9e4e83f6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:34.751140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5626f-6c22-44c4-a843-b012556b0e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:34.751969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5626f-6c22-44c4-a843-b012556b0e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:34.752508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5626f-6c22-44c4-a843-b012556b0e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:34.753062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5626f-6c22-44c4-a843-b012556b0e49 admin admin] PATH_INFO: `/v3/projects/1b26da352ae641ceae032152623ed523/users/1fedb31457fe4531b933d0f3c341ddc8/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:34.755420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5626f-6c22-44c4-a843-b012556b0e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b26da352ae641ceae032152623ed523, user_id=1fedb31457fe4531b933d0f3c341ddc8, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:34.759458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5626f-6c22-44c4-a843-b012556b0e49 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:34.784960 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3815/7631] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:34 2022] PUT /identity/v3/projects/1b26da352ae641ceae032152623ed523/users/1fedb31457fe4531b933d0f3c341ddc8/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:56:34.784960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b320082-bd91-44b1-a98f-aae64b5a58f0 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:34.784960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b320082-bd91-44b1-a98f-aae64b5a58f0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:34.784960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b320082-bd91-44b1-a98f-aae64b5a58f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:34.815758 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3817/7632] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:34 2022] PUT /identity/v3/projects/3af8376c0e954907968c0fcbfeafa00d/users/e081e7ec2a49468095ec20b04441a5d8/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:56:34.826902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8476c3-03e6-4090-add4-3930fd4c32f7 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:34.827307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8476c3-03e6-4090-add4-3930fd4c32f7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:34.827978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8476c3-03e6-4090-add4-3930fd4c32f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:34.837262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5b320082-bd91-44b1-a98f-aae64b5a58f0 None None] MFA Rules not processed for user `1fedb31457fe4531b933d0f3c341ddc8`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:34.838894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5b320082-bd91-44b1-a98f-aae64b5a58f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:34.889356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2c8476c3-03e6-4090-add4-3930fd4c32f7 None None] MFA Rules not processed for user `e081e7ec2a49468095ec20b04441a5d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:34.889356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2c8476c3-03e6-4090-add4-3930fd4c32f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:34.947586 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3816/7633] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:34 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:34.970431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b320082-bd91-44b1-a98f-aae64b5a58f0 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:34.981012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5b320082-bd91-44b1-a98f-aae64b5a58f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:35.005574 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3818/7634] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:34 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:35.010734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8476c3-03e6-4090-add4-3930fd4c32f7 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:35.113770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b320082-bd91-44b1-a98f-aae64b5a58f0 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:35.126077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a220c-f791-4993-a408-a48a8642fff5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:35.127593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a220c-f791-4993-a408-a48a8642fff5 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:35.129534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a220c-f791-4993-a408-a48a8642fff5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:35.130075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a220c-f791-4993-a408-a48a8642fff5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:35.155097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a220c-f791-4993-a408-a48a8642fff5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:35.158202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a220c-f791-4993-a408-a48a8642fff5 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:35.173828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8476c3-03e6-4090-add4-3930fd4c32f7 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:35.183985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:35.190723 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3817/7635] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:56:35.201121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e8e1c-3e8e-4496-9d2b-379f576820a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:35.201777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e8e1c-3e8e-4496-9d2b-379f576820a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:35.202250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e8e1c-3e8e-4496-9d2b-379f576820a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:35.202370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e8e1c-3e8e-4496-9d2b-379f576820a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:35.203094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e8e1c-3e8e-4496-9d2b-379f576820a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:35.210391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e8e1c-3e8e-4496-9d2b-379f576820a5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:35.377091 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3819/7636] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:56:35 2022] POST /identity/v3/projects => generated 403 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:35.381041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a220c-f791-4993-a408-a48a8642fff5 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:35.402250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a220c-f791-4993-a408-a48a8642fff5 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:35.464506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:35.510885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4356e-7f26-4ab6-abfd-7435ddc9d15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:35.511594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4356e-7f26-4ab6-abfd-7435ddc9d15d admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:35.511966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4356e-7f26-4ab6-abfd-7435ddc9d15d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:35.512488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4356e-7f26-4ab6-abfd-7435ddc9d15d admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:35.513232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4356e-7f26-4ab6-abfd-7435ddc9d15d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:35.516500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4356e-7f26-4ab6-abfd-7435ddc9d15d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:35.671774 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3818/7637] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:56:35 2022] POST /identity/v3/users => generated 308 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:56:35.678155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e8e1c-3e8e-4496-9d2b-379f576820a5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:35.723085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e8e1c-3e8e-4496-9d2b-379f576820a5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:35.770785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae9660-fc6a-4ab5-95f9-4e2dd68d381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:35.771508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae9660-fc6a-4ab5-95f9-4e2dd68d381b admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:35.772197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae9660-fc6a-4ab5-95f9-4e2dd68d381b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:35.772197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae9660-fc6a-4ab5-95f9-4e2dd68d381b admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:35.772933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae9660-fc6a-4ab5-95f9-4e2dd68d381b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:35.774667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae9660-fc6a-4ab5-95f9-4e2dd68d381b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:35.790290 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3820/7638] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:35.792160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4356e-7f26-4ab6-abfd-7435ddc9d15d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:35.805797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4356e-7f26-4ab6-abfd-7435ddc9d15d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:35.811991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01a99c-d8c7-4519-bd19-e434f8e6f405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:35.812689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01a99c-d8c7-4519-bd19-e434f8e6f405 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:35.813263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01a99c-d8c7-4519-bd19-e434f8e6f405 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:35.813546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01a99c-d8c7-4519-bd19-e434f8e6f405 admin admin] PATH_INFO: `/v3/projects/99a26413fdf24e908cd1bcee64f197f6/users/25fb45f9463e40199ada108797a50655/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:35.841032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01a99c-d8c7-4519-bd19-e434f8e6f405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99a26413fdf24e908cd1bcee64f197f6, user_id=25fb45f9463e40199ada108797a50655, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:35.845254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01a99c-d8c7-4519-bd19-e434f8e6f405 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:35.974474 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3819/7639] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:35 2022] PUT /identity/v3/projects/99a26413fdf24e908cd1bcee64f197f6/users/25fb45f9463e40199ada108797a50655/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:35.975764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae9660-fc6a-4ab5-95f9-4e2dd68d381b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:35.986960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae9660-fc6a-4ab5-95f9-4e2dd68d381b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:36.049030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e5c82-5c6d-45d7-9df3-707697031514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:36.049837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e5c82-5c6d-45d7-9df3-707697031514 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:36.050120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e5c82-5c6d-45d7-9df3-707697031514 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:36.058204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e5c82-5c6d-45d7-9df3-707697031514 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:36.066132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e5c82-5c6d-45d7-9df3-707697031514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:36.066132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e5c82-5c6d-45d7-9df3-707697031514 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:36.074353 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3821/7640] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:56:36.078533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01a99c-d8c7-4519-bd19-e434f8e6f405 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:36.089281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01a99c-d8c7-4519-bd19-e434f8e6f405 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:36.094066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e6974-624e-43f0-b5f8-275a064dbfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:36.094778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e6974-624e-43f0-b5f8-275a064dbfe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:36.095115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e6974-624e-43f0-b5f8-275a064dbfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:36.095734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e6974-624e-43f0-b5f8-275a064dbfe0 admin admin] PATH_INFO: `/v3/projects/99a26413fdf24e908cd1bcee64f197f6/users/25fb45f9463e40199ada108797a50655/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:36.097528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e6974-624e-43f0-b5f8-275a064dbfe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99a26413fdf24e908cd1bcee64f197f6, user_id=25fb45f9463e40199ada108797a50655, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:36.100351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e6974-624e-43f0-b5f8-275a064dbfe0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:36.120709 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3820/7641] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:36 2022] PUT /identity/v3/projects/99a26413fdf24e908cd1bcee64f197f6/users/25fb45f9463e40199ada108797a50655/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:36.146587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda8244-b1b8-411e-898f-35e1fd8a4395 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:36.146895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda8244-b1b8-411e-898f-35e1fd8a4395 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:36.147310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda8244-b1b8-411e-898f-35e1fd8a4395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:36.179319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4bda8244-b1b8-411e-898f-35e1fd8a4395 None None] MFA Rules not processed for user `25fb45f9463e40199ada108797a50655`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:36.180134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4bda8244-b1b8-411e-898f-35e1fd8a4395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:36.277401 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3822/7642] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:36 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:56:36.294728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e6974-624e-43f0-b5f8-275a064dbfe0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:36.412386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e6974-624e-43f0-b5f8-275a064dbfe0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:36.417720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9af07-53f6-48ee-b81a-36eed3b314e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:36.418773 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9af07-53f6-48ee-b81a-36eed3b314e0 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:36.419324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9af07-53f6-48ee-b81a-36eed3b314e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:36.419828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9af07-53f6-48ee-b81a-36eed3b314e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:36.445410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9af07-53f6-48ee-b81a-36eed3b314e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:36.447221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9af07-53f6-48ee-b81a-36eed3b314e0 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:36.460639 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3821/7643] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:36 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:56:36.882756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda8244-b1b8-411e-898f-35e1fd8a4395 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:36.912616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9af07-53f6-48ee-b81a-36eed3b314e0 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:36.939619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:37.008897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda8244-b1b8-411e-898f-35e1fd8a4395 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:37.016072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1830ea9-2daf-480c-b220-a87ecfeaafab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:37.016992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1830ea9-2daf-480c-b220-a87ecfeaafab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:37.017382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1830ea9-2daf-480c-b220-a87ecfeaafab admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:37.017729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1830ea9-2daf-480c-b220-a87ecfeaafab admin admin] PATH_INFO: `/v3/users/e081e7ec2a49468095ec20b04441a5d8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:37.019326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1830ea9-2daf-480c-b220-a87ecfeaafab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e081e7ec2a49468095ec20b04441a5d8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:37.028925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1830ea9-2daf-480c-b220-a87ecfeaafab admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:37.112153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9af07-53f6-48ee-b81a-36eed3b314e0 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:37.136439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24238b96-fc1f-413c-ab5a-d10ffd39551b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:37.136964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24238b96-fc1f-413c-ab5a-d10ffd39551b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:37.137328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24238b96-fc1f-413c-ab5a-d10ffd39551b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:37.137730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24238b96-fc1f-413c-ab5a-d10ffd39551b admin admin] PATH_INFO: `/v3/users/986a4cb677f94670ac4fd23cbf52f8ea` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:37.139121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24238b96-fc1f-413c-ab5a-d10ffd39551b admin admin] RBAC: Authorizing `identity:delete_user(user_id=986a4cb677f94670ac4fd23cbf52f8ea)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:37.141283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24238b96-fc1f-413c-ab5a-d10ffd39551b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:37.249885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:37.413349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-24238b96-fc1f-413c-ab5a-d10ffd39551b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '986a4cb677f94670ac4fd23cbf52f8ea'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:37.414550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f1830ea9-2daf-480c-b220-a87ecfeaafab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e081e7ec2a49468095ec20b04441a5d8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:37.415138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-24238b96-fc1f-413c-ab5a-d10ffd39551b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '986a4cb677f94670ac4fd23cbf52f8ea'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:37.415884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f1830ea9-2daf-480c-b220-a87ecfeaafab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e081e7ec2a49468095ec20b04441a5d8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:37.426402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-24238b96-fc1f-413c-ab5a-d10ffd39551b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '986a4cb677f94670ac4fd23cbf52f8ea'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:37.429852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f1830ea9-2daf-480c-b220-a87ecfeaafab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e081e7ec2a49468095ec20b04441a5d8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:37.445207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-24238b96-fc1f-413c-ab5a-d10ffd39551b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '986a4cb677f94670ac4fd23cbf52f8ea'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:37.451243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f1830ea9-2daf-480c-b220-a87ecfeaafab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e081e7ec2a49468095ec20b04441a5d8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:37.453211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f1830ea9-2daf-480c-b220-a87ecfeaafab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e081e7ec2a49468095ec20b04441a5d8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:37.555172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-24238b96-fc1f-413c-ab5a-d10ffd39551b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '986a4cb677f94670ac4fd23cbf52f8ea'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:37.567309 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3822/7644] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:56:36 2022] DELETE /identity/v3/users/986a4cb677f94670ac4fd23cbf52f8ea => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:37.569456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2981253-fcfd-4441-a951-cad3b84bbde5 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:37.569794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2981253-fcfd-4441-a951-cad3b84bbde5 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:37.570134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2981253-fcfd-4441-a951-cad3b84bbde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:37.596320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c2981253-fcfd-4441-a951-cad3b84bbde5 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:37.597652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c2981253-fcfd-4441-a951-cad3b84bbde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:37.692913 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3823/7645] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:56:36 2022] DELETE /identity/v3/users/e081e7ec2a49468095ec20b04441a5d8 => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:37.694591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fe930-be75-4007-bfce-f97000dbe369 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:37.695068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fe930-be75-4007-bfce-f97000dbe369 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:37.695460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fe930-be75-4007-bfce-f97000dbe369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:37.731988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-337fe930-be75-4007-bfce-f97000dbe369 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:37.732371 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3823/7646] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:37.733395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-337fe930-be75-4007-bfce-f97000dbe369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:37.738117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2981253-fcfd-4441-a951-cad3b84bbde5 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:37.739499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c2981253-fcfd-4441-a951-cad3b84bbde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:37.863961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2981253-fcfd-4441-a951-cad3b84bbde5 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:37.887560 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3824/7647] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:37.903063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fe930-be75-4007-bfce-f97000dbe369 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:38.003963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430ace9-82d1-451a-9f1e-5e7d3b83d10a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:38.004820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430ace9-82d1-451a-9f1e-5e7d3b83d10a service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:38.005255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430ace9-82d1-451a-9f1e-5e7d3b83d10a service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:38.005694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430ace9-82d1-451a-9f1e-5e7d3b83d10a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:38.010182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:38.028038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fe930-be75-4007-bfce-f97000dbe369 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:38.034824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430ace9-82d1-451a-9f1e-5e7d3b83d10a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:38.036469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430ace9-82d1-451a-9f1e-5e7d3b83d10a service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:38.038659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140b153-b966-4fef-843b-26d8f66863f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:38.039385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140b153-b966-4fef-843b-26d8f66863f7 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:38.042469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140b153-b966-4fef-843b-26d8f66863f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:38.042854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140b153-b966-4fef-843b-26d8f66863f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:38.067648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140b153-b966-4fef-843b-26d8f66863f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:38.071794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140b153-b966-4fef-843b-26d8f66863f7 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:38.078118 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3824/7648] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:56:38.103804 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3825/7649] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:56:39.019206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430ace9-82d1-451a-9f1e-5e7d3b83d10a service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:39.021406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7430ace9-82d1-451a-9f1e-5e7d3b83d10a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:39.035668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:39.042067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430ace9-82d1-451a-9f1e-5e7d3b83d10a service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:39.047926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c23be8-9866-4d63-aece-1e58c88f43ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:39.048592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c23be8-9866-4d63-aece-1e58c88f43ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:39.048873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c23be8-9866-4d63-aece-1e58c88f43ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:39.049176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c23be8-9866-4d63-aece-1e58c88f43ee admin admin] PATH_INFO: `/v3/projects/3af8376c0e954907968c0fcbfeafa00d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:39.050869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c23be8-9866-4d63-aece-1e58c88f43ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=3af8376c0e954907968c0fcbfeafa00d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:39.052900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c23be8-9866-4d63-aece-1e58c88f43ee admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:39.186580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140b153-b966-4fef-843b-26d8f66863f7 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:39.193399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e140b153-b966-4fef-843b-26d8f66863f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:39.240688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140b153-b966-4fef-843b-26d8f66863f7 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:39.254982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411f96a-058a-46c6-8fbd-0102d64bcd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:39.256761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411f96a-058a-46c6-8fbd-0102d64bcd7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:39.259299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411f96a-058a-46c6-8fbd-0102d64bcd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:39.259299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411f96a-058a-46c6-8fbd-0102d64bcd7c admin admin] PATH_INFO: `/v3/projects/b048245588e04afb9e1e2f1dc9a21679` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:39.259299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411f96a-058a-46c6-8fbd-0102d64bcd7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b048245588e04afb9e1e2f1dc9a21679)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:39.263833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411f96a-058a-46c6-8fbd-0102d64bcd7c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:39.370933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-51c23be8-9866-4d63-aece-1e58c88f43ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3af8376c0e954907968c0fcbfeafa00d', 'request_id': 'req-51c23be8-9866-4d63-aece-1e58c88f43ee'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:39.458639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-51c23be8-9866-4d63-aece-1e58c88f43ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3af8376c0e954907968c0fcbfeafa00d', 'request_id': 'req-51c23be8-9866-4d63-aece-1e58c88f43ee'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:39.467981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-51c23be8-9866-4d63-aece-1e58c88f43ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3af8376c0e954907968c0fcbfeafa00d', 'request_id': 'req-51c23be8-9866-4d63-aece-1e58c88f43ee'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:39.472985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4411f96a-058a-46c6-8fbd-0102d64bcd7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b048245588e04afb9e1e2f1dc9a21679', 'request_id': 'req-4411f96a-058a-46c6-8fbd-0102d64bcd7c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:39.483731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4411f96a-058a-46c6-8fbd-0102d64bcd7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b048245588e04afb9e1e2f1dc9a21679', 'request_id': 'req-4411f96a-058a-46c6-8fbd-0102d64bcd7c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:39.487051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-51c23be8-9866-4d63-aece-1e58c88f43ee admin admin] The token cache is being invalidate because project 3af8376c0e954907968c0fcbfeafa00d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:56:39.488055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-51c23be8-9866-4d63-aece-1e58c88f43ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:39.488735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-51c23be8-9866-4d63-aece-1e58c88f43ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:39.490342 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3825/7650] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:56:39 2022] DELETE /identity/v3/projects/3af8376c0e954907968c0fcbfeafa00d => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:39.491064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4411f96a-058a-46c6-8fbd-0102d64bcd7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b048245588e04afb9e1e2f1dc9a21679', 'request_id': 'req-4411f96a-058a-46c6-8fbd-0102d64bcd7c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:39.494758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c23be8-9866-4d63-aece-1e58c88f43ee admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:39.497269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-51c23be8-9866-4d63-aece-1e58c88f43ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:39.597188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c23be8-9866-4d63-aece-1e58c88f43ee admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:39.683409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e9e47-e4ae-4cde-bbf6-3f439bdbbdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:39.684545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e9e47-e4ae-4cde-bbf6-3f439bdbbdcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:39.684545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e9e47-e4ae-4cde-bbf6-3f439bdbbdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:39.684859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e9e47-e4ae-4cde-bbf6-3f439bdbbdcb admin admin] PATH_INFO: `/v3/users/25fb45f9463e40199ada108797a50655` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:39.686953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e9e47-e4ae-4cde-bbf6-3f439bdbbdcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=25fb45f9463e40199ada108797a50655)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:39.689287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e9e47-e4ae-4cde-bbf6-3f439bdbbdcb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:39.704648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4411f96a-058a-46c6-8fbd-0102d64bcd7c admin admin] The token cache is being invalidate because project b048245588e04afb9e1e2f1dc9a21679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:56:39.705990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4411f96a-058a-46c6-8fbd-0102d64bcd7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:39.705990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4411f96a-058a-46c6-8fbd-0102d64bcd7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:39.707466 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3826/7651] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:56:39 2022] DELETE /identity/v3/projects/b048245588e04afb9e1e2f1dc9a21679 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:39.732729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411f96a-058a-46c6-8fbd-0102d64bcd7c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:39.732729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4411f96a-058a-46c6-8fbd-0102d64bcd7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:39.745541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411f96a-058a-46c6-8fbd-0102d64bcd7c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:39.751048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e8245-4b26-4aa5-ab5d-ab4b5b34be94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:39.751710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e8245-4b26-4aa5-ab5d-ab4b5b34be94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:39.752024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e8245-4b26-4aa5-ab5d-ab4b5b34be94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:39.752420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e8245-4b26-4aa5-ab5d-ab4b5b34be94 admin admin] PATH_INFO: `/v3/users/1fedb31457fe4531b933d0f3c341ddc8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:39.753933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e8245-4b26-4aa5-ab5d-ab4b5b34be94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fedb31457fe4531b933d0f3c341ddc8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:39.756099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e8245-4b26-4aa5-ab5d-ab4b5b34be94 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:39.963376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-999e9e47-e4ae-4cde-bbf6-3f439bdbbdcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25fb45f9463e40199ada108797a50655'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:39.964432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-999e9e47-e4ae-4cde-bbf6-3f439bdbbdcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25fb45f9463e40199ada108797a50655'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:39.973802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-999e9e47-e4ae-4cde-bbf6-3f439bdbbdcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25fb45f9463e40199ada108797a50655'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:39.989371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-999e9e47-e4ae-4cde-bbf6-3f439bdbbdcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25fb45f9463e40199ada108797a50655'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:40.056794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-777e8245-4b26-4aa5-ab5d-ab4b5b34be94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fedb31457fe4531b933d0f3c341ddc8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:40.057946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-777e8245-4b26-4aa5-ab5d-ab4b5b34be94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fedb31457fe4531b933d0f3c341ddc8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:40.077849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-777e8245-4b26-4aa5-ab5d-ab4b5b34be94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fedb31457fe4531b933d0f3c341ddc8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:40.120218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-777e8245-4b26-4aa5-ab5d-ab4b5b34be94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fedb31457fe4531b933d0f3c341ddc8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:40.121762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-777e8245-4b26-4aa5-ab5d-ab4b5b34be94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fedb31457fe4531b933d0f3c341ddc8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:40.138709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-999e9e47-e4ae-4cde-bbf6-3f439bdbbdcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25fb45f9463e40199ada108797a50655'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:40.145888 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3826/7652] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:56:39 2022] DELETE /identity/v3/users/25fb45f9463e40199ada108797a50655 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:40.267471 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3827/7653] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:56:39 2022] DELETE /identity/v3/users/1fedb31457fe4531b933d0f3c341ddc8 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:40.520983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:40.907146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e9e47-e4ae-4cde-bbf6-3f439bdbbdcb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:40.908630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-999e9e47-e4ae-4cde-bbf6-3f439bdbbdcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:41.024939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e9e47-e4ae-4cde-bbf6-3f439bdbbdcb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:41.077063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e8245-4b26-4aa5-ab5d-ab4b5b34be94 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:41.078994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-777e8245-4b26-4aa5-ab5d-ab4b5b34be94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:41.136647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae152f2b-09ad-4317-8fbc-bd9bbe68a035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:41.137432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae152f2b-09ad-4317-8fbc-bd9bbe68a035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:41.137725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae152f2b-09ad-4317-8fbc-bd9bbe68a035 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:41.138010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae152f2b-09ad-4317-8fbc-bd9bbe68a035 admin admin] PATH_INFO: `/v3/projects/99a26413fdf24e908cd1bcee64f197f6` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:41.141078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae152f2b-09ad-4317-8fbc-bd9bbe68a035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99a26413fdf24e908cd1bcee64f197f6)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:41.150057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae152f2b-09ad-4317-8fbc-bd9bbe68a035 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:41.205575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:41.269371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e8245-4b26-4aa5-ab5d-ab4b5b34be94 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:41.275824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ea780-3518-44bf-bec8-7f217c642b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:41.277305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ea780-3518-44bf-bec8-7f217c642b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:41.277552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ea780-3518-44bf-bec8-7f217c642b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:41.278023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ea780-3518-44bf-bec8-7f217c642b8b admin admin] PATH_INFO: `/v3/projects/1b26da352ae641ceae032152623ed523` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:41.280449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ea780-3518-44bf-bec8-7f217c642b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b26da352ae641ceae032152623ed523)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:41.287016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ea780-3518-44bf-bec8-7f217c642b8b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:41.470740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ae152f2b-09ad-4317-8fbc-bd9bbe68a035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99a26413fdf24e908cd1bcee64f197f6', 'request_id': 'req-ae152f2b-09ad-4317-8fbc-bd9bbe68a035'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:41.490938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-160ea780-3518-44bf-bec8-7f217c642b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b26da352ae641ceae032152623ed523', 'request_id': 'req-160ea780-3518-44bf-bec8-7f217c642b8b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:41.498181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-160ea780-3518-44bf-bec8-7f217c642b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b26da352ae641ceae032152623ed523', 'request_id': 'req-160ea780-3518-44bf-bec8-7f217c642b8b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:41.505364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-160ea780-3518-44bf-bec8-7f217c642b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b26da352ae641ceae032152623ed523', 'request_id': 'req-160ea780-3518-44bf-bec8-7f217c642b8b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:41.675947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ae152f2b-09ad-4317-8fbc-bd9bbe68a035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99a26413fdf24e908cd1bcee64f197f6', 'request_id': 'req-ae152f2b-09ad-4317-8fbc-bd9bbe68a035'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:41.694764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ae152f2b-09ad-4317-8fbc-bd9bbe68a035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99a26413fdf24e908cd1bcee64f197f6', 'request_id': 'req-ae152f2b-09ad-4317-8fbc-bd9bbe68a035'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:41.724015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ae152f2b-09ad-4317-8fbc-bd9bbe68a035 admin admin] The token cache is being invalidate because project 99a26413fdf24e908cd1bcee64f197f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:56:41.724547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ae152f2b-09ad-4317-8fbc-bd9bbe68a035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:41.729734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ae152f2b-09ad-4317-8fbc-bd9bbe68a035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:41.732380 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3827/7654] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:56:40 2022] DELETE /identity/v3/projects/99a26413fdf24e908cd1bcee64f197f6 => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:41.738024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8676898-3845-4f53-8304-3e4f36552915 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:41.746256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8676898-3845-4f53-8304-3e4f36552915 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:41.746256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8676898-3845-4f53-8304-3e4f36552915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:41.766177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c8676898-3845-4f53-8304-3e4f36552915 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:41.772612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c8676898-3845-4f53-8304-3e4f36552915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:41.850637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-160ea780-3518-44bf-bec8-7f217c642b8b admin admin] The token cache is being invalidate because project 1b26da352ae641ceae032152623ed523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:56:41.851340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-160ea780-3518-44bf-bec8-7f217c642b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:41.852169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-160ea780-3518-44bf-bec8-7f217c642b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:41.855056 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3828/7655] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:56:41 2022] DELETE /identity/v3/projects/1b26da352ae641ceae032152623ed523 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:56:41.861040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67674965-3184-4751-adb8-35790925d439 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:41.861040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67674965-3184-4751-adb8-35790925d439 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:41.861235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67674965-3184-4751-adb8-35790925d439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:41.880605 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3828/7656] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:41.882743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b630c4-218f-4d72-b007-9edc915e3d81 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:41.889451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b630c4-218f-4d72-b007-9edc915e3d81 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:41.889451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b630c4-218f-4d72-b007-9edc915e3d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:41.901486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-67674965-3184-4751-adb8-35790925d439 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:41.905838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-67674965-3184-4751-adb8-35790925d439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:41.940807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-77b630c4-218f-4d72-b007-9edc915e3d81 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:41.942163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-77b630c4-218f-4d72-b007-9edc915e3d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:41.944998 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3829/7657] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:41.954071 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3829/7658] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:41.955680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0cf26-4ea2-4963-a4d7-c3c3e07f7a8c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:41.955970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0cf26-4ea2-4963-a4d7-c3c3e07f7a8c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:41.956247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0cf26-4ea2-4963-a4d7-c3c3e07f7a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:41.961310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b630c4-218f-4d72-b007-9edc915e3d81 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:41.974479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b630c4-218f-4d72-b007-9edc915e3d81 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:41.986992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64afcb-4126-42a2-96a9-20016ce39bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:41.987789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64afcb-4126-42a2-96a9-20016ce39bcd admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:41.988256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64afcb-4126-42a2-96a9-20016ce39bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:41.988666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64afcb-4126-42a2-96a9-20016ce39bcd admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:41.989414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64afcb-4126-42a2-96a9-20016ce39bcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:56:41.989799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64afcb-4126-42a2-96a9-20016ce39bcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:41.991681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64afcb-4126-42a2-96a9-20016ce39bcd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:41.992103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b9a0cf26-4ea2-4963-a4d7-c3c3e07f7a8c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:41.994670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b9a0cf26-4ea2-4963-a4d7-c3c3e07f7a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:42.017380 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3830/7659] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:42.021255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0cf26-4ea2-4963-a4d7-c3c3e07f7a8c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:42.037959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0cf26-4ea2-4963-a4d7-c3c3e07f7a8c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:42.042163 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3830/7660] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:56:42.045790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64afcb-4126-42a2-96a9-20016ce39bcd admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:42.054837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8e30f-e145-4492-8efe-8db21a925e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:42.055487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8e30f-e145-4492-8efe-8db21a925e2d admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:42.055773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8e30f-e145-4492-8efe-8db21a925e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:42.056269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8e30f-e145-4492-8efe-8db21a925e2d admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:42.056717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8e30f-e145-4492-8efe-8db21a925e2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:56:42.057026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8e30f-e145-4492-8efe-8db21a925e2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:42.059727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8e30f-e145-4492-8efe-8db21a925e2d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:42.070735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64afcb-4126-42a2-96a9-20016ce39bcd admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:42.080326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbf04d-9b12-4b40-9836-ee696f28e11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:42.080886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbf04d-9b12-4b40-9836-ee696f28e11e admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:42.081191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbf04d-9b12-4b40-9836-ee696f28e11e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:42.081455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbf04d-9b12-4b40-9836-ee696f28e11e admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:42.082375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbf04d-9b12-4b40-9836-ee696f28e11e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:42.087052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbf04d-9b12-4b40-9836-ee696f28e11e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:42.088946 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3831/7661] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:56:42.097525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8e30f-e145-4492-8efe-8db21a925e2d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:42.108933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8e30f-e145-4492-8efe-8db21a925e2d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:42.120527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3e46c-032d-4afd-8112-96c77f55fe8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:42.121161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3e46c-032d-4afd-8112-96c77f55fe8f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:42.121450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3e46c-032d-4afd-8112-96c77f55fe8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:42.121782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3e46c-032d-4afd-8112-96c77f55fe8f admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:42.122453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3e46c-032d-4afd-8112-96c77f55fe8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:42.124427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3e46c-032d-4afd-8112-96c77f55fe8f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:42.237617 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3831/7662] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:56:42 2022] POST /identity/v3/projects => generated 369 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:42.238147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbf04d-9b12-4b40-9836-ee696f28e11e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:42.269997 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3832/7663] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:56:42 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:42.274153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3e46c-032d-4afd-8112-96c77f55fe8f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:42.402485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbf04d-9b12-4b40-9836-ee696f28e11e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:42.476528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3e46c-032d-4afd-8112-96c77f55fe8f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:42.487418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d935af-9334-4b51-bc63-f887e4bbb2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:42.488237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d935af-9334-4b51-bc63-f887e4bbb2bf admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:42.488777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d935af-9334-4b51-bc63-f887e4bbb2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:42.495138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d935af-9334-4b51-bc63-f887e4bbb2bf admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:42.496102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d935af-9334-4b51-bc63-f887e4bbb2bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:42.503342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d935af-9334-4b51-bc63-f887e4bbb2bf admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:42.524438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c4398-6b55-4c69-be79-7a3f75e9e7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:42.525209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c4398-6b55-4c69-be79-7a3f75e9e7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:42.527399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c4398-6b55-4c69-be79-7a3f75e9e7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:42.527399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c4398-6b55-4c69-be79-7a3f75e9e7b0 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:42.527399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c4398-6b55-4c69-be79-7a3f75e9e7b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:42.539547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c4398-6b55-4c69-be79-7a3f75e9e7b0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:42.697185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:42.700998 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3833/7664] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:56:42 2022] POST /identity/v3/users => generated 287 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:42.705275 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3832/7665] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:56:42 2022] POST /identity/v3/users => generated 285 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:42.708714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d935af-9334-4b51-bc63-f887e4bbb2bf admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:42.709431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c4398-6b55-4c69-be79-7a3f75e9e7b0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:42.726129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c4398-6b55-4c69-be79-7a3f75e9e7b0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:42.731505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601b94c-543b-4130-a3f0-a0852fa2f29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:42.732132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601b94c-543b-4130-a3f0-a0852fa2f29e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:42.732418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601b94c-543b-4130-a3f0-a0852fa2f29e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:42.733231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601b94c-543b-4130-a3f0-a0852fa2f29e admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:42.733894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601b94c-543b-4130-a3f0-a0852fa2f29e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:42.735604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601b94c-543b-4130-a3f0-a0852fa2f29e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:42.741260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d935af-9334-4b51-bc63-f887e4bbb2bf admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:42.748835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df1a4d-06b4-4c51-8aed-91cae8a7f29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:42.751497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df1a4d-06b4-4c51-8aed-91cae8a7f29f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:42.751497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df1a4d-06b4-4c51-8aed-91cae8a7f29f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:42.751497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df1a4d-06b4-4c51-8aed-91cae8a7f29f admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:42.751784 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3833/7666] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:42.754732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df1a4d-06b4-4c51-8aed-91cae8a7f29f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:42.755000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601b94c-543b-4130-a3f0-a0852fa2f29e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:42.756798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df1a4d-06b4-4c51-8aed-91cae8a7f29f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:42.765465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601b94c-543b-4130-a3f0-a0852fa2f29e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:42.770132 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3834/7667] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:42.772300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df1a4d-06b4-4c51-8aed-91cae8a7f29f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:42.774276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5c87e-7c2a-421e-be9f-4108caa803a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:42.775782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5c87e-7c2a-421e-be9f-4108caa803a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:42.775782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5c87e-7c2a-421e-be9f-4108caa803a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:42.775782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5c87e-7c2a-421e-be9f-4108caa803a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:42.776602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5c87e-7c2a-421e-be9f-4108caa803a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:42.778374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5c87e-7c2a-421e-be9f-4108caa803a3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:42.782750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df1a4d-06b4-4c51-8aed-91cae8a7f29f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:42.788830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e69a92-f152-40c8-b066-dde9115e70f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:42.789388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e69a92-f152-40c8-b066-dde9115e70f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:42.789539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e69a92-f152-40c8-b066-dde9115e70f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:42.789820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e69a92-f152-40c8-b066-dde9115e70f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:42.790599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e69a92-f152-40c8-b066-dde9115e70f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:42.791046 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3834/7668] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:56:42.795712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5c87e-7c2a-421e-be9f-4108caa803a3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:42.806708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e69a92-f152-40c8-b066-dde9115e70f0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:42.808598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5c87e-7c2a-421e-be9f-4108caa803a3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:42.815707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95126509-4bba-461a-8085-51c9fc4dee5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:42.816655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95126509-4bba-461a-8085-51c9fc4dee5a admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:42.817088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95126509-4bba-461a-8085-51c9fc4dee5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:42.817797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95126509-4bba-461a-8085-51c9fc4dee5a admin admin] PATH_INFO: `/v3/projects/719a2628bfc7427bb2acbfc2276d8bcc/users/a1d50e256e37425c9010b6e8c8d62a87/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:42.822756 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3835/7669] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:42.825108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e69a92-f152-40c8-b066-dde9115e70f0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:42.837500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e69a92-f152-40c8-b066-dde9115e70f0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:42.838501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95126509-4bba-461a-8085-51c9fc4dee5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=719a2628bfc7427bb2acbfc2276d8bcc, user_id=a1d50e256e37425c9010b6e8c8d62a87, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:42.841579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95126509-4bba-461a-8085-51c9fc4dee5a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:42.844114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ae613-3609-4eee-bffb-4f3f9dd648fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:42.844986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ae613-3609-4eee-bffb-4f3f9dd648fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:42.846944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ae613-3609-4eee-bffb-4f3f9dd648fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:42.846944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ae613-3609-4eee-bffb-4f3f9dd648fc admin admin] PATH_INFO: `/v3/projects/4f2348420e184649abcd3b2cf05c5fff/users/bd550aaeb0454a95a29b0bb575092d85/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:42.871489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ae613-3609-4eee-bffb-4f3f9dd648fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2348420e184649abcd3b2cf05c5fff, user_id=bd550aaeb0454a95a29b0bb575092d85, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:42.874701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ae613-3609-4eee-bffb-4f3f9dd648fc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:42.958849 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3835/7670] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:42 2022] PUT /identity/v3/projects/719a2628bfc7427bb2acbfc2276d8bcc/users/a1d50e256e37425c9010b6e8c8d62a87/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:42.971216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b72311-b21e-4570-961a-de3478c6df4e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:42.971553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b72311-b21e-4570-961a-de3478c6df4e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:42.971780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b72311-b21e-4570-961a-de3478c6df4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:43.027355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b8b72311-b21e-4570-961a-de3478c6df4e None None] MFA Rules not processed for user `a1d50e256e37425c9010b6e8c8d62a87`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:43.028684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b8b72311-b21e-4570-961a-de3478c6df4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:43.031256 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3836/7671] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:42 2022] PUT /identity/v3/projects/4f2348420e184649abcd3b2cf05c5fff/users/bd550aaeb0454a95a29b0bb575092d85/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:43.042793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cfa56-c155-499c-b3ba-c3c7b1cfff0d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:43.042941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cfa56-c155-499c-b3ba-c3c7b1cfff0d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:43.043155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cfa56-c155-499c-b3ba-c3c7b1cfff0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:43.089485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-616cfa56-c155-499c-b3ba-c3c7b1cfff0d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:43.090398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-616cfa56-c155-499c-b3ba-c3c7b1cfff0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:43.149877 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3836/7672] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:43.151259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b72311-b21e-4570-961a-de3478c6df4e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:43.197157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:43.206882 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3837/7673] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:43.229577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616cfa56-c155-499c-b3ba-c3c7b1cfff0d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:43.231260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-616cfa56-c155-499c-b3ba-c3c7b1cfff0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:43.267491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b72311-b21e-4570-961a-de3478c6df4e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:43.275070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d03326-29eb-410d-b462-bf11228d0359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:43.275766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d03326-29eb-410d-b462-bf11228d0359 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:43.276053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d03326-29eb-410d-b462-bf11228d0359 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:43.276334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d03326-29eb-410d-b462-bf11228d0359 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:43.276980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d03326-29eb-410d-b462-bf11228d0359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:43.280825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d03326-29eb-410d-b462-bf11228d0359 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:43.347596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616cfa56-c155-499c-b3ba-c3c7b1cfff0d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:43.351850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5640af-73f2-4c6b-84e0-ce774367d80f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:43.352800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5640af-73f2-4c6b-84e0-ce774367d80f service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:43.353164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5640af-73f2-4c6b-84e0-ce774367d80f service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:43.353670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5640af-73f2-4c6b-84e0-ce774367d80f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:43.367270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5640af-73f2-4c6b-84e0-ce774367d80f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:43.368852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5640af-73f2-4c6b-84e0-ce774367d80f service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:43.381890 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3838/7674] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:56:43.468057 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3837/7675] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:56:43 2022] POST /identity/v3/projects => generated 367 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:43.472907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5640af-73f2-4c6b-84e0-ce774367d80f service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:43.489800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5640af-73f2-4c6b-84e0-ce774367d80f service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:43.628486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30ae62-43b3-48e9-a479-086cea0c69e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:43.629027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30ae62-43b3-48e9-a479-086cea0c69e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:43.629314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30ae62-43b3-48e9-a479-086cea0c69e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:43.629593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30ae62-43b3-48e9-a479-086cea0c69e3 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:43.630258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30ae62-43b3-48e9-a479-086cea0c69e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:43.632220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30ae62-43b3-48e9-a479-086cea0c69e3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:43.749966 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3839/7676] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:56:43 2022] POST /identity/v3/users => generated 290 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:43.755886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d03326-29eb-410d-b462-bf11228d0359 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:43.771647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d03326-29eb-410d-b462-bf11228d0359 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:43.777697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab64259-456c-4d05-9957-432f4dbf1298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:43.780268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab64259-456c-4d05-9957-432f4dbf1298 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:43.780268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab64259-456c-4d05-9957-432f4dbf1298 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:43.780268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab64259-456c-4d05-9957-432f4dbf1298 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:43.780268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab64259-456c-4d05-9957-432f4dbf1298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:43.782343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab64259-456c-4d05-9957-432f4dbf1298 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:43.805314 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3838/7677] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:43.809510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30ae62-43b3-48e9-a479-086cea0c69e3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:43.821920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30ae62-43b3-48e9-a479-086cea0c69e3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:43.827677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f3d92-33e7-446d-a445-8d2b4362f6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:43.828344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f3d92-33e7-446d-a445-8d2b4362f6a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:43.828626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f3d92-33e7-446d-a445-8d2b4362f6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:43.828905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f3d92-33e7-446d-a445-8d2b4362f6a9 admin admin] PATH_INFO: `/v3/projects/6bbb59887a9e461ebaf9fd334040b91a/users/d4580e819a87465d9f62ea3d54ece23b/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:43.848325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f3d92-33e7-446d-a445-8d2b4362f6a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bbb59887a9e461ebaf9fd334040b91a, user_id=d4580e819a87465d9f62ea3d54ece23b, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:43.851843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f3d92-33e7-446d-a445-8d2b4362f6a9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:43.857424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:43.922123 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3840/7678] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:43 2022] PUT /identity/v3/projects/6bbb59887a9e461ebaf9fd334040b91a/users/d4580e819a87465d9f62ea3d54ece23b/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:43.927081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab64259-456c-4d05-9957-432f4dbf1298 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:43.938709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab64259-456c-4d05-9957-432f4dbf1298 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:44.080107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bc27f-ae72-48ac-9cd7-bd9ec98331d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:44.080107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bc27f-ae72-48ac-9cd7-bd9ec98331d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:44.080107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bc27f-ae72-48ac-9cd7-bd9ec98331d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:44.080107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bc27f-ae72-48ac-9cd7-bd9ec98331d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:44.080582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bc27f-ae72-48ac-9cd7-bd9ec98331d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:44.081029 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bc27f-ae72-48ac-9cd7-bd9ec98331d6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:44.100026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f3d92-33e7-446d-a445-8d2b4362f6a9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:44.107093 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3839/7679] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:44.113548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f3d92-33e7-446d-a445-8d2b4362f6a9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:44.118782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775efa2-06e4-4372-8a19-5567453bd1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:44.119617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775efa2-06e4-4372-8a19-5567453bd1ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:44.120049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775efa2-06e4-4372-8a19-5567453bd1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:44.120347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775efa2-06e4-4372-8a19-5567453bd1ec admin admin] PATH_INFO: `/v3/projects/6bbb59887a9e461ebaf9fd334040b91a/users/d4580e819a87465d9f62ea3d54ece23b/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:44.122377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775efa2-06e4-4372-8a19-5567453bd1ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bbb59887a9e461ebaf9fd334040b91a, user_id=d4580e819a87465d9f62ea3d54ece23b, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:44.125331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775efa2-06e4-4372-8a19-5567453bd1ec admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:44.149300 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3841/7680] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:44 2022] PUT /identity/v3/projects/6bbb59887a9e461ebaf9fd334040b91a/users/d4580e819a87465d9f62ea3d54ece23b/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:56:44.162135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fa67f-8b4c-450c-a205-8ee82efe33af None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:44.162561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fa67f-8b4c-450c-a205-8ee82efe33af None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:44.162912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fa67f-8b4c-450c-a205-8ee82efe33af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:44.213814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c66fa67f-8b4c-450c-a205-8ee82efe33af None None] MFA Rules not processed for user `d4580e819a87465d9f62ea3d54ece23b`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:44.215193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c66fa67f-8b4c-450c-a205-8ee82efe33af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:44.263798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:44.303292 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3840/7681] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:44 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:44.312419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775efa2-06e4-4372-8a19-5567453bd1ec admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:44.314696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1775efa2-06e4-4372-8a19-5567453bd1ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:44.410126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775efa2-06e4-4372-8a19-5567453bd1ec admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:44.416028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b3f8a-6023-4532-870a-5297898bb714 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:44.417279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b3f8a-6023-4532-870a-5297898bb714 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:44.417889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b3f8a-6023-4532-870a-5297898bb714 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:44.423138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b3f8a-6023-4532-870a-5297898bb714 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:44.433307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b3f8a-6023-4532-870a-5297898bb714 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:44.436761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b3f8a-6023-4532-870a-5297898bb714 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:44.441429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:44.464381 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3842/7682] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:56:46.148858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a6adc-9d64-4e8b-85c9-c965d872a25a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:46.149421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a6adc-9d64-4e8b-85c9-c965d872a25a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:46.149421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a6adc-9d64-4e8b-85c9-c965d872a25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:46.194774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-cb6a6adc-9d64-4e8b-85c9-c965d872a25a None None] MFA Rules not processed for user `bd550aaeb0454a95a29b0bb575092d85`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:46.197480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cb6a6adc-9d64-4e8b-85c9-c965d872a25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:46.329518 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3841/7683] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:46.333191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b3f8a-6023-4532-870a-5297898bb714 service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:46.449317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b3f8a-6023-4532-870a-5297898bb714 service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:46.459780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6757fc-85a4-4546-b031-8504be532c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:46.460493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6757fc-85a4-4546-b031-8504be532c21 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:46.460850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6757fc-85a4-4546-b031-8504be532c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:46.461201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6757fc-85a4-4546-b031-8504be532c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:46.461940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6757fc-85a4-4546-b031-8504be532c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:46.464621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6757fc-85a4-4546-b031-8504be532c21 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:46.632436 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3843/7684] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:56:46 2022] POST /identity/v3/projects => generated 371 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:46.636155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a6adc-9d64-4e8b-85c9-c965d872a25a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:46.652653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a6adc-9d64-4e8b-85c9-c965d872a25a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:46.664374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:46.716955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3f461-7b11-488f-8f19-e40543e3a0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:46.718232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3f461-7b11-488f-8f19-e40543e3a0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:46.718396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3f461-7b11-488f-8f19-e40543e3a0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:46.718629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3f461-7b11-488f-8f19-e40543e3a0c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:46.719296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3f461-7b11-488f-8f19-e40543e3a0c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:46.721233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3f461-7b11-488f-8f19-e40543e3a0c0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:46.870803 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3842/7685] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:56:46 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:46.874916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6757fc-85a4-4546-b031-8504be532c21 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:46.895345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6757fc-85a4-4546-b031-8504be532c21 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:46.903538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8395f95-a27b-4dc0-ae57-29b99a0df17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:46.925987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8395f95-a27b-4dc0-ae57-29b99a0df17e admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:46.926762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8395f95-a27b-4dc0-ae57-29b99a0df17e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:46.927645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8395f95-a27b-4dc0-ae57-29b99a0df17e admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:46.928945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8395f95-a27b-4dc0-ae57-29b99a0df17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:46.934001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8395f95-a27b-4dc0-ae57-29b99a0df17e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:46.965320 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3844/7686] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:46.970249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3f461-7b11-488f-8f19-e40543e3a0c0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:46.999123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3f461-7b11-488f-8f19-e40543e3a0c0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:47.010746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf07f8-4124-4ed7-a627-1daf4ab550d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:47.012386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf07f8-4124-4ed7-a627-1daf4ab550d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:47.012842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf07f8-4124-4ed7-a627-1daf4ab550d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:47.013257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf07f8-4124-4ed7-a627-1daf4ab550d5 admin admin] PATH_INFO: `/v3/projects/6e1cc72c797d4296af0666ad091f1957/users/6ebb8a741ef34d469a5f3db8a8317f6d/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:47.050302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf07f8-4124-4ed7-a627-1daf4ab550d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e1cc72c797d4296af0666ad091f1957, user_id=6ebb8a741ef34d469a5f3db8a8317f6d, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:47.063576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf07f8-4124-4ed7-a627-1daf4ab550d5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:47.200230 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3843/7687] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:46 2022] PUT /identity/v3/projects/6e1cc72c797d4296af0666ad091f1957/users/6ebb8a741ef34d469a5f3db8a8317f6d/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:47.204553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8395f95-a27b-4dc0-ae57-29b99a0df17e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:47.218738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8395f95-a27b-4dc0-ae57-29b99a0df17e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:47.302642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:47.330169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7bf76-e9b9-4935-8f83-13ce2b21a882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:47.330169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7bf76-e9b9-4935-8f83-13ce2b21a882 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:47.330169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7bf76-e9b9-4935-8f83-13ce2b21a882 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:47.330169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7bf76-e9b9-4935-8f83-13ce2b21a882 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:47.331457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7bf76-e9b9-4935-8f83-13ce2b21a882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:47.334997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7bf76-e9b9-4935-8f83-13ce2b21a882 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:47.354172 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3845/7688] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:47.355610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf07f8-4124-4ed7-a627-1daf4ab550d5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:47.374572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf07f8-4124-4ed7-a627-1daf4ab550d5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:47.383685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd7714-8604-4731-bf2d-3e160aac5218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:47.385372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd7714-8604-4731-bf2d-3e160aac5218 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:47.385372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd7714-8604-4731-bf2d-3e160aac5218 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:47.385372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd7714-8604-4731-bf2d-3e160aac5218 admin admin] PATH_INFO: `/v3/projects/6e1cc72c797d4296af0666ad091f1957/users/6ebb8a741ef34d469a5f3db8a8317f6d/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:47.387353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd7714-8604-4731-bf2d-3e160aac5218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e1cc72c797d4296af0666ad091f1957, user_id=6ebb8a741ef34d469a5f3db8a8317f6d, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:47.393926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd7714-8604-4731-bf2d-3e160aac5218 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:47.409156 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3844/7689] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:47 2022] PUT /identity/v3/projects/6e1cc72c797d4296af0666ad091f1957/users/6ebb8a741ef34d469a5f3db8a8317f6d/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:47.531646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7bf76-e9b9-4935-8f83-13ce2b21a882 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:47.533441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b5c7bf76-e9b9-4935-8f83-13ce2b21a882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:47.699941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7bf76-e9b9-4935-8f83-13ce2b21a882 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:47.863600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd5652-8eeb-4da2-a115-365dbc9b8f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:47.863600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd5652-8eeb-4da2-a115-365dbc9b8f59 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:47.863600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd5652-8eeb-4da2-a115-365dbc9b8f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:47.863600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd5652-8eeb-4da2-a115-365dbc9b8f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:47.865581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-acfd5652-8eeb-4da2-a115-365dbc9b8f59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:48.032390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd5652-8eeb-4da2-a115-365dbc9b8f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:48.034285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd5652-8eeb-4da2-a115-365dbc9b8f59 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:48.054493 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3846/7690] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:56:48.794410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd7714-8604-4731-bf2d-3e160aac5218 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:48.943311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd7714-8604-4731-bf2d-3e160aac5218 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:48.973397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8e8e7-a775-4c6d-87d3-8426d3454ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:48.975255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8e8e7-a775-4c6d-87d3-8426d3454ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:48.976077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8e8e7-a775-4c6d-87d3-8426d3454ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:48.976580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8e8e7-a775-4c6d-87d3-8426d3454ff7 admin admin] PATH_INFO: `/v3/users/a1d50e256e37425c9010b6e8c8d62a87` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:48.979936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8e8e7-a775-4c6d-87d3-8426d3454ff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1d50e256e37425c9010b6e8c8d62a87)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:48.984591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8e8e7-a775-4c6d-87d3-8426d3454ff7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:49.304970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3bd8e8e7-a775-4c6d-87d3-8426d3454ff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1d50e256e37425c9010b6e8c8d62a87'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:49.306855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3bd8e8e7-a775-4c6d-87d3-8426d3454ff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1d50e256e37425c9010b6e8c8d62a87'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:49.323468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3bd8e8e7-a775-4c6d-87d3-8426d3454ff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1d50e256e37425c9010b6e8c8d62a87'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:49.353299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:49.366829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3bd8e8e7-a775-4c6d-87d3-8426d3454ff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1d50e256e37425c9010b6e8c8d62a87'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:49.459685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3bd8e8e7-a775-4c6d-87d3-8426d3454ff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1d50e256e37425c9010b6e8c8d62a87'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:49.467214 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3845/7691] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:56:48 2022] DELETE /identity/v3/users/a1d50e256e37425c9010b6e8c8d62a87 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:49.475001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b835d1-4c09-4e47-b2be-e2f11d3c976d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:49.476360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b835d1-4c09-4e47-b2be-e2f11d3c976d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:49.476555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b835d1-4c09-4e47-b2be-e2f11d3c976d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:49.518773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b1b835d1-4c09-4e47-b2be-e2f11d3c976d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:49.523762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b1b835d1-4c09-4e47-b2be-e2f11d3c976d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:49.580588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:49.636493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8e8e7-a775-4c6d-87d3-8426d3454ff7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:49.638751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3bd8e8e7-a775-4c6d-87d3-8426d3454ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:49.656917 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3847/7692] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:49.672249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b835d1-4c09-4e47-b2be-e2f11d3c976d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:49.674181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b1b835d1-4c09-4e47-b2be-e2f11d3c976d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:49.832720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8e8e7-a775-4c6d-87d3-8426d3454ff7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:49.836658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b835d1-4c09-4e47-b2be-e2f11d3c976d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:49.843414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8093205-ce67-4e40-91bb-d50af7e68e2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:49.844546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8093205-ce67-4e40-91bb-d50af7e68e2f service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:49.844834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8093205-ce67-4e40-91bb-d50af7e68e2f service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:49.845196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8093205-ce67-4e40-91bb-d50af7e68e2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:49.849155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763a484-ce27-4015-80aa-2c2d3dcd3878 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:49.851281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763a484-ce27-4015-80aa-2c2d3dcd3878 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:49.851946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763a484-ce27-4015-80aa-2c2d3dcd3878 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:49.852433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763a484-ce27-4015-80aa-2c2d3dcd3878 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:49.857514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b763a484-ce27-4015-80aa-2c2d3dcd3878 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:49.868201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8093205-ce67-4e40-91bb-d50af7e68e2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:49.872671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8093205-ce67-4e40-91bb-d50af7e68e2f service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:49.886573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763a484-ce27-4015-80aa-2c2d3dcd3878 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:49.888969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763a484-ce27-4015-80aa-2c2d3dcd3878 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:49.892789 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3848/7693] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:56:49.910626 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3846/7694] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:56:50.749335 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8093205-ce67-4e40-91bb-d50af7e68e2f service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:50.751419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c8093205-ce67-4e40-91bb-d50af7e68e2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:50.761701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd1fa3-27b8-4a34-9f56-210a18a03304 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:50.761993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd1fa3-27b8-4a34-9f56-210a18a03304 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:50.762294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd1fa3-27b8-4a34-9f56-210a18a03304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:50.814384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8093205-ce67-4e40-91bb-d50af7e68e2f service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:50.843639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150e7ef-3d4d-418a-815b-d70f88e335fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:50.845939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150e7ef-3d4d-418a-815b-d70f88e335fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:50.846220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150e7ef-3d4d-418a-815b-d70f88e335fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:50.846487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150e7ef-3d4d-418a-815b-d70f88e335fa admin admin] PATH_INFO: `/v3/projects/719a2628bfc7427bb2acbfc2276d8bcc` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:50.863641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150e7ef-3d4d-418a-815b-d70f88e335fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=719a2628bfc7427bb2acbfc2276d8bcc)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:50.868880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150e7ef-3d4d-418a-815b-d70f88e335fa admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:50.890344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4cfd1fa3-27b8-4a34-9f56-210a18a03304 None None] MFA Rules not processed for user `6ebb8a741ef34d469a5f3db8a8317f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:50.893275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4cfd1fa3-27b8-4a34-9f56-210a18a03304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:51.048563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7150e7ef-3d4d-418a-815b-d70f88e335fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '719a2628bfc7427bb2acbfc2276d8bcc', 'request_id': 'req-7150e7ef-3d4d-418a-815b-d70f88e335fa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:51.067619 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3847/7695] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:51.074076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7150e7ef-3d4d-418a-815b-d70f88e335fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '719a2628bfc7427bb2acbfc2276d8bcc', 'request_id': 'req-7150e7ef-3d4d-418a-815b-d70f88e335fa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:51.081134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7150e7ef-3d4d-418a-815b-d70f88e335fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '719a2628bfc7427bb2acbfc2276d8bcc', 'request_id': 'req-7150e7ef-3d4d-418a-815b-d70f88e335fa'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:51.085466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47da86b-3755-4d63-b11e-53abb53ef047 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:51.086725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47da86b-3755-4d63-b11e-53abb53ef047 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:51.089209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47da86b-3755-4d63-b11e-53abb53ef047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:51.132119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e47da86b-3755-4d63-b11e-53abb53ef047 None None] MFA Rules not processed for user `bd550aaeb0454a95a29b0bb575092d85`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:51.133658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e47da86b-3755-4d63-b11e-53abb53ef047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:51.189662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7150e7ef-3d4d-418a-815b-d70f88e335fa admin admin] The token cache is being invalidate because project 719a2628bfc7427bb2acbfc2276d8bcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:56:51.191044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7150e7ef-3d4d-418a-815b-d70f88e335fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:51.193732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7150e7ef-3d4d-418a-815b-d70f88e335fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:51.200373 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3849/7696] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:56:50 2022] DELETE /identity/v3/projects/719a2628bfc7427bb2acbfc2276d8bcc => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:51.205096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150e7ef-3d4d-418a-815b-d70f88e335fa admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:51.209651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7150e7ef-3d4d-418a-815b-d70f88e335fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:51.250953 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3848/7697] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:56:51.261541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47da86b-3755-4d63-b11e-53abb53ef047 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:51.263246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e47da86b-3755-4d63-b11e-53abb53ef047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:51.271667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:51.412845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150e7ef-3d4d-418a-815b-d70f88e335fa admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:51.421256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ed2a0-d349-420e-8981-bca49c7103ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:51.421870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ed2a0-d349-420e-8981-bca49c7103ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:51.422213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ed2a0-d349-420e-8981-bca49c7103ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:51.422761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ed2a0-d349-420e-8981-bca49c7103ed admin admin] PATH_INFO: `/v3/users/d4580e819a87465d9f62ea3d54ece23b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:51.425178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ed2a0-d349-420e-8981-bca49c7103ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4580e819a87465d9f62ea3d54ece23b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:51.427062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ed2a0-d349-420e-8981-bca49c7103ed admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:51.434788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:51.467003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47da86b-3755-4d63-b11e-53abb53ef047 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:51.475798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bb7ec-32ea-4220-9dff-e4707a8b54c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:51.476426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bb7ec-32ea-4220-9dff-e4707a8b54c9 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:51.476699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bb7ec-32ea-4220-9dff-e4707a8b54c9 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:51.476983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bb7ec-32ea-4220-9dff-e4707a8b54c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:51.479034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8b3bb7ec-32ea-4220-9dff-e4707a8b54c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:51.494591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bb7ec-32ea-4220-9dff-e4707a8b54c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:51.497662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bb7ec-32ea-4220-9dff-e4707a8b54c9 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:51.515620 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3849/7698] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:56:51.746329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6d0ed2a0-d349-420e-8981-bca49c7103ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4580e819a87465d9f62ea3d54ece23b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:51.747437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6d0ed2a0-d349-420e-8981-bca49c7103ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4580e819a87465d9f62ea3d54ece23b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:51.778022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6d0ed2a0-d349-420e-8981-bca49c7103ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4580e819a87465d9f62ea3d54ece23b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:51.812102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6d0ed2a0-d349-420e-8981-bca49c7103ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4580e819a87465d9f62ea3d54ece23b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:51.812102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6d0ed2a0-d349-420e-8981-bca49c7103ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4580e819a87465d9f62ea3d54ece23b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:51.911453 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3850/7699] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:56:51 2022] DELETE /identity/v3/users/d4580e819a87465d9f62ea3d54ece23b => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:56:52.578398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bb7ec-32ea-4220-9dff-e4707a8b54c9 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:52.581053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8b3bb7ec-32ea-4220-9dff-e4707a8b54c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:52.755736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bb7ec-32ea-4220-9dff-e4707a8b54c9 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:53.021323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc3592-1276-4db5-a95f-4101b9d85e96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:53.022613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc3592-1276-4db5-a95f-4101b9d85e96 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:53.023051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc3592-1276-4db5-a95f-4101b9d85e96 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:53.023338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc3592-1276-4db5-a95f-4101b9d85e96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:53.025389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b2cc3592-1276-4db5-a95f-4101b9d85e96 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:53.088414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:53.138940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc3592-1276-4db5-a95f-4101b9d85e96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:53.141545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc3592-1276-4db5-a95f-4101b9d85e96 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:53.160625 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3850/7700] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:56:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 734 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:56:55.032622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ed2a0-d349-420e-8981-bca49c7103ed admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:55.035447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6d0ed2a0-d349-420e-8981-bca49c7103ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:55.236536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ed2a0-d349-420e-8981-bca49c7103ed admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:55.256005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fac136-a0b3-4c7f-9d32-5aa4cef333bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:55.256816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fac136-a0b3-4c7f-9d32-5aa4cef333bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:55.257163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fac136-a0b3-4c7f-9d32-5aa4cef333bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:55.258205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fac136-a0b3-4c7f-9d32-5aa4cef333bb admin admin] PATH_INFO: `/v3/projects/6bbb59887a9e461ebaf9fd334040b91a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:55.260742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fac136-a0b3-4c7f-9d32-5aa4cef333bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bbb59887a9e461ebaf9fd334040b91a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:55.264528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fac136-a0b3-4c7f-9d32-5aa4cef333bb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:55.504733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e0fac136-a0b3-4c7f-9d32-5aa4cef333bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bbb59887a9e461ebaf9fd334040b91a', 'request_id': 'req-e0fac136-a0b3-4c7f-9d32-5aa4cef333bb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:55.542251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e0fac136-a0b3-4c7f-9d32-5aa4cef333bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bbb59887a9e461ebaf9fd334040b91a', 'request_id': 'req-e0fac136-a0b3-4c7f-9d32-5aa4cef333bb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:55.571429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e0fac136-a0b3-4c7f-9d32-5aa4cef333bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bbb59887a9e461ebaf9fd334040b91a', 'request_id': 'req-e0fac136-a0b3-4c7f-9d32-5aa4cef333bb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:55.748339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e0fac136-a0b3-4c7f-9d32-5aa4cef333bb admin admin] The token cache is being invalidate because project 6bbb59887a9e461ebaf9fd334040b91a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:56:55.748339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e0fac136-a0b3-4c7f-9d32-5aa4cef333bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:55.753358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e0fac136-a0b3-4c7f-9d32-5aa4cef333bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:56:55.758948 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3851/7701] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:56:55 2022] DELETE /identity/v3/projects/6bbb59887a9e461ebaf9fd334040b91a => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:55.769640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5a230-0a56-4b90-9f3a-c7c82f85d7ec None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:55.769640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5a230-0a56-4b90-9f3a-c7c82f85d7ec None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:55.769640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5a230-0a56-4b90-9f3a-c7c82f85d7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:55.810915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8de5a230-0a56-4b90-9f3a-c7c82f85d7ec None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:55.812754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8de5a230-0a56-4b90-9f3a-c7c82f85d7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:55.976469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea41ea4-aa7f-4a35-b9c8-867c181cb9eb None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:55.976907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea41ea4-aa7f-4a35-b9c8-867c181cb9eb None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:55.977312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea41ea4-aa7f-4a35-b9c8-867c181cb9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:55.978392 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3851/7702] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:56.019257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-dea41ea4-aa7f-4a35-b9c8-867c181cb9eb None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:56.022978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-dea41ea4-aa7f-4a35-b9c8-867c181cb9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:56.042116 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3852/7703] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:56.046570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5a230-0a56-4b90-9f3a-c7c82f85d7ec None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:56.071090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5a230-0a56-4b90-9f3a-c7c82f85d7ec None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:56.088838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2b359-3898-4749-8d1e-4f22135347aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:56.088838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2b359-3898-4749-8d1e-4f22135347aa admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:56.088838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2b359-3898-4749-8d1e-4f22135347aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:56.088838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2b359-3898-4749-8d1e-4f22135347aa admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:56.089153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2b359-3898-4749-8d1e-4f22135347aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:56:56.089153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2b359-3898-4749-8d1e-4f22135347aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:56.089153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2b359-3898-4749-8d1e-4f22135347aa admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:56.101657 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3852/7704] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:56:56.105872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea41ea4-aa7f-4a35-b9c8-867c181cb9eb None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:56.113567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:56.119556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea41ea4-aa7f-4a35-b9c8-867c181cb9eb None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:56.126852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84151c1-5fef-4c86-a566-23b43f4fa7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:56.127529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84151c1-5fef-4c86-a566-23b43f4fa7fd admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:56.127820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84151c1-5fef-4c86-a566-23b43f4fa7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:56.128100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84151c1-5fef-4c86-a566-23b43f4fa7fd admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:56.129115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84151c1-5fef-4c86-a566-23b43f4fa7fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:56.132932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84151c1-5fef-4c86-a566-23b43f4fa7fd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:56.286568 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3853/7705] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:56:56 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:56:56.291316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2b359-3898-4749-8d1e-4f22135347aa admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:56.291923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84151c1-5fef-4c86-a566-23b43f4fa7fd admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:56.293729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d84151c1-5fef-4c86-a566-23b43f4fa7fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:56.306061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2b359-3898-4749-8d1e-4f22135347aa admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:56.444074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84151c1-5fef-4c86-a566-23b43f4fa7fd admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:56.452323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14945a2a-57f4-445a-85d1-49b7ad52e939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:56.453205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14945a2a-57f4-445a-85d1-49b7ad52e939 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:56.453671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14945a2a-57f4-445a-85d1-49b7ad52e939 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:56.454251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14945a2a-57f4-445a-85d1-49b7ad52e939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:56.454677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329def0c-5d70-4c41-894b-b8483e7c37fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:56.456089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329def0c-5d70-4c41-894b-b8483e7c37fa admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:56.456387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329def0c-5d70-4c41-894b-b8483e7c37fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:56.456667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329def0c-5d70-4c41-894b-b8483e7c37fa admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:56.457405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329def0c-5d70-4c41-894b-b8483e7c37fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:56.458347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-14945a2a-57f4-445a-85d1-49b7ad52e939 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:56.461293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329def0c-5d70-4c41-894b-b8483e7c37fa admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:56.556789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14945a2a-57f4-445a-85d1-49b7ad52e939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:56.558346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14945a2a-57f4-445a-85d1-49b7ad52e939 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:56.574117 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3854/7706] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:56:56.628209 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3853/7707] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:56:56 2022] POST /identity/v3/users => generated 289 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:56.629217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14945a2a-57f4-445a-85d1-49b7ad52e939 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:56.641520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14945a2a-57f4-445a-85d1-49b7ad52e939 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:56.646700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086861e-f5ab-4d02-8d74-095ccd963beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:56.647543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086861e-f5ab-4d02-8d74-095ccd963beb admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:56.647693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086861e-f5ab-4d02-8d74-095ccd963beb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:56.648101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086861e-f5ab-4d02-8d74-095ccd963beb admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:56.648761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086861e-f5ab-4d02-8d74-095ccd963beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:56.650672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086861e-f5ab-4d02-8d74-095ccd963beb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:56.662471 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3855/7708] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:56.666453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329def0c-5d70-4c41-894b-b8483e7c37fa admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:56.676869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329def0c-5d70-4c41-894b-b8483e7c37fa admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:56.681488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24908a7b-de76-4ab5-bdb9-ed72b1bfddf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:56.682048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24908a7b-de76-4ab5-bdb9-ed72b1bfddf6 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:56.682339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24908a7b-de76-4ab5-bdb9-ed72b1bfddf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:56.682608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24908a7b-de76-4ab5-bdb9-ed72b1bfddf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:56.683265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24908a7b-de76-4ab5-bdb9-ed72b1bfddf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:56.684859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24908a7b-de76-4ab5-bdb9-ed72b1bfddf6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:56.699924 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3854/7709] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:56.705263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086861e-f5ab-4d02-8d74-095ccd963beb admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:56.716043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086861e-f5ab-4d02-8d74-095ccd963beb admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:56.721113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5287c5b-db6a-4df5-bab9-0c93d9e39dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:56.721790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5287c5b-db6a-4df5-bab9-0c93d9e39dbd admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:56.722089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5287c5b-db6a-4df5-bab9-0c93d9e39dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:56.722368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5287c5b-db6a-4df5-bab9-0c93d9e39dbd admin admin] PATH_INFO: `/v3/projects/c3dd4848e430472784938d3df26522c5/users/e048f6141cec454a80825ffff2326b20/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:56.743305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5287c5b-db6a-4df5-bab9-0c93d9e39dbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3dd4848e430472784938d3df26522c5, user_id=e048f6141cec454a80825ffff2326b20, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:56.746745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5287c5b-db6a-4df5-bab9-0c93d9e39dbd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:56.893038 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3856/7710] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:56 2022] PUT /identity/v3/projects/c3dd4848e430472784938d3df26522c5/users/e048f6141cec454a80825ffff2326b20/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:56.904212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3f05d-e895-4545-a61e-1bde1b71c401 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:56.904816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3f05d-e895-4545-a61e-1bde1b71c401 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:56.904816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3f05d-e895-4545-a61e-1bde1b71c401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:57.003235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9bc3f05d-e895-4545-a61e-1bde1b71c401 None None] MFA Rules not processed for user `e048f6141cec454a80825ffff2326b20`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:57.007711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9bc3f05d-e895-4545-a61e-1bde1b71c401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:57.084720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:57.166470 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3855/7711] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:57.171185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5287c5b-db6a-4df5-bab9-0c93d9e39dbd admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:57.246207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:57.267540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5287c5b-db6a-4df5-bab9-0c93d9e39dbd admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:57.273532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac08f9-442b-407f-a333-5e9db60a034a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:57.274275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac08f9-442b-407f-a333-5e9db60a034a admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:57.274949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac08f9-442b-407f-a333-5e9db60a034a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:57.275074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac08f9-442b-407f-a333-5e9db60a034a admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:57.275770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac08f9-442b-407f-a333-5e9db60a034a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:57.277968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac08f9-442b-407f-a333-5e9db60a034a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:57.439441 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3857/7712] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:56:57 2022] POST /identity/v3/projects => generated 377 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:56:57.442580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3f05d-e895-4545-a61e-1bde1b71c401 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:57.459139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3f05d-e895-4545-a61e-1bde1b71c401 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:57.543187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303e458-2add-47a7-9be9-3c3bff1517ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:57.543829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303e458-2add-47a7-9be9-3c3bff1517ac admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:57.544114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303e458-2add-47a7-9be9-3c3bff1517ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:57.544401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303e458-2add-47a7-9be9-3c3bff1517ac admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:57.545037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303e458-2add-47a7-9be9-3c3bff1517ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:57.547059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303e458-2add-47a7-9be9-3c3bff1517ac admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:57.719587 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3856/7713] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:56:57 2022] POST /identity/v3/users => generated 295 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:56:57.723690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac08f9-442b-407f-a333-5e9db60a034a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:57.741258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac08f9-442b-407f-a333-5e9db60a034a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:57.760444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e31f3f-ad65-4083-8875-63f4d224c3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:57.760444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e31f3f-ad65-4083-8875-63f4d224c3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:57.760444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e31f3f-ad65-4083-8875-63f4d224c3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:57.766103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e31f3f-ad65-4083-8875-63f4d224c3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:57.767299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e31f3f-ad65-4083-8875-63f4d224c3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:57.769440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e31f3f-ad65-4083-8875-63f4d224c3e3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:57.784114 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3858/7714] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:57.787944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303e458-2add-47a7-9be9-3c3bff1517ac admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:57.801160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303e458-2add-47a7-9be9-3c3bff1517ac admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:57.812951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a95a6-4d56-447a-ad08-6ccf9e8681e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:57.813831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a95a6-4d56-447a-ad08-6ccf9e8681e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:57.814289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a95a6-4d56-447a-ad08-6ccf9e8681e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:57.814702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a95a6-4d56-447a-ad08-6ccf9e8681e8 admin admin] PATH_INFO: `/v3/projects/7aef7304a702474cbceb00d59c119dc9/users/202258701aee482c9e92fc2af1639062/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:57.843701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a95a6-4d56-447a-ad08-6ccf9e8681e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aef7304a702474cbceb00d59c119dc9, user_id=202258701aee482c9e92fc2af1639062, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:57.849967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a95a6-4d56-447a-ad08-6ccf9e8681e8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:57.958517 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3857/7715] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:57 2022] PUT /identity/v3/projects/7aef7304a702474cbceb00d59c119dc9/users/202258701aee482c9e92fc2af1639062/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:56:57.962613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e31f3f-ad65-4083-8875-63f4d224c3e3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:57.975703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e31f3f-ad65-4083-8875-63f4d224c3e3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:58.049396 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24793491-8e97-4d69-bacf-b5961d503b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:58.050492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24793491-8e97-4d69-bacf-b5961d503b33 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:58.051087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24793491-8e97-4d69-bacf-b5961d503b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:58.051512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24793491-8e97-4d69-bacf-b5961d503b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:58.052299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24793491-8e97-4d69-bacf-b5961d503b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:58.054312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24793491-8e97-4d69-bacf-b5961d503b33 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:58.073820 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3859/7716] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:56:58.079704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a95a6-4d56-447a-ad08-6ccf9e8681e8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:58.099459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a95a6-4d56-447a-ad08-6ccf9e8681e8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:58.136434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed67b0-dd2f-4032-95f1-0c46f6661aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:58.137495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed67b0-dd2f-4032-95f1-0c46f6661aec admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:58.139975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed67b0-dd2f-4032-95f1-0c46f6661aec admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:58.140510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed67b0-dd2f-4032-95f1-0c46f6661aec admin admin] PATH_INFO: `/v3/projects/7aef7304a702474cbceb00d59c119dc9/users/202258701aee482c9e92fc2af1639062/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:58.148730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed67b0-dd2f-4032-95f1-0c46f6661aec admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aef7304a702474cbceb00d59c119dc9, user_id=202258701aee482c9e92fc2af1639062, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:58.157448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed67b0-dd2f-4032-95f1-0c46f6661aec admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:58.213163 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3858/7717] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:56:58 2022] PUT /identity/v3/projects/7aef7304a702474cbceb00d59c119dc9/users/202258701aee482c9e92fc2af1639062/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:56:58.225076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193ec30-b3fa-4817-8ac1-13003e5b8108 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:58.225599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193ec30-b3fa-4817-8ac1-13003e5b8108 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:58.225960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193ec30-b3fa-4817-8ac1-13003e5b8108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:58.275043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7193ec30-b3fa-4817-8ac1-13003e5b8108 None None] MFA Rules not processed for user `202258701aee482c9e92fc2af1639062`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:56:58.276430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7193ec30-b3fa-4817-8ac1-13003e5b8108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:58.418212 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3860/7718] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:56:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:56:58.432656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed67b0-dd2f-4032-95f1-0c46f6661aec admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:56:58.434460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-afed67b0-dd2f-4032-95f1-0c46f6661aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:56:58.549671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed67b0-dd2f-4032-95f1-0c46f6661aec admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:56:58.555265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63439ea5-f3de-4b8e-8da7-93efb26e06af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:56:58.555895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63439ea5-f3de-4b8e-8da7-93efb26e06af service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:56:58.556275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63439ea5-f3de-4b8e-8da7-93efb26e06af service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:56:58.556455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63439ea5-f3de-4b8e-8da7-93efb26e06af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:56:58.604012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:58.659621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63439ea5-f3de-4b8e-8da7-93efb26e06af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:56:58.661303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63439ea5-f3de-4b8e-8da7-93efb26e06af service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:56:58.673367 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3859/7719] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:56:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:57:05.578125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193ec30-b3fa-4817-8ac1-13003e5b8108 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:05.592646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193ec30-b3fa-4817-8ac1-13003e5b8108 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:05.597263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33465efd-dc14-491b-a1e3-500965e939b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:05.600072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33465efd-dc14-491b-a1e3-500965e939b9 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:05.600072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33465efd-dc14-491b-a1e3-500965e939b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:05.600072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33465efd-dc14-491b-a1e3-500965e939b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:05.611768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33465efd-dc14-491b-a1e3-500965e939b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:05.613220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33465efd-dc14-491b-a1e3-500965e939b9 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:05.646631 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3861/7720] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:57:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:57:07.841281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63439ea5-f3de-4b8e-8da7-93efb26e06af service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:07.842753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-63439ea5-f3de-4b8e-8da7-93efb26e06af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:08.010930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63439ea5-f3de-4b8e-8da7-93efb26e06af service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:08.020039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2474a3-ae98-4164-9c97-a0723e40aecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:08.022067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2474a3-ae98-4164-9c97-a0723e40aecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:08.022600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2474a3-ae98-4164-9c97-a0723e40aecd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:08.023299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2474a3-ae98-4164-9c97-a0723e40aecd admin admin] PATH_INFO: `/v3/users/f14cc02b164749a9aff63a7492e9c8a5` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:08.025409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2474a3-ae98-4164-9c97-a0723e40aecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f14cc02b164749a9aff63a7492e9c8a5)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:08.029612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2474a3-ae98-4164-9c97-a0723e40aecd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:08.281487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dd2474a3-ae98-4164-9c97-a0723e40aecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f14cc02b164749a9aff63a7492e9c8a5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:08.282431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dd2474a3-ae98-4164-9c97-a0723e40aecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f14cc02b164749a9aff63a7492e9c8a5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:08.320718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dd2474a3-ae98-4164-9c97-a0723e40aecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f14cc02b164749a9aff63a7492e9c8a5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:08.350520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dd2474a3-ae98-4164-9c97-a0723e40aecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f14cc02b164749a9aff63a7492e9c8a5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:08.413578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-dd2474a3-ae98-4164-9c97-a0723e40aecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f14cc02b164749a9aff63a7492e9c8a5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:08.429277 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3860/7721] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:57:07 2022] DELETE /identity/v3/users/f14cc02b164749a9aff63a7492e9c8a5 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:57:08.435298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f579693-9422-4406-8462-e57f523b50cf None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:08.436097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f579693-9422-4406-8462-e57f523b50cf None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:08.436515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f579693-9422-4406-8462-e57f523b50cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:08.471419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4f579693-9422-4406-8462-e57f523b50cf None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:57:08.473221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4f579693-9422-4406-8462-e57f523b50cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:08.507206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:08.560784 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3862/7722] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:57:08.574102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2474a3-ae98-4164-9c97-a0723e40aecd admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:08.575846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-dd2474a3-ae98-4164-9c97-a0723e40aecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:08.775902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2474a3-ae98-4164-9c97-a0723e40aecd admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:08.788923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4961ea-255d-4d52-8245-8fe04cb7c26d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:08.789564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4961ea-255d-4d52-8245-8fe04cb7c26d service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:08.789901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4961ea-255d-4d52-8245-8fe04cb7c26d service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:08.790209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4961ea-255d-4d52-8245-8fe04cb7c26d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:08.797476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:08.802055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4961ea-255d-4d52-8245-8fe04cb7c26d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:08.803558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4961ea-255d-4d52-8245-8fe04cb7c26d service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:08.815991 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3861/7723] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:57:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:57:09.852904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f579693-9422-4406-8462-e57f523b50cf None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:09.855437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4f579693-9422-4406-8462-e57f523b50cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:09.886884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f579693-9422-4406-8462-e57f523b50cf None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:09.909607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eab50a-dfae-478e-8209-4951eb92ee8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:09.910997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eab50a-dfae-478e-8209-4951eb92ee8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:09.911358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eab50a-dfae-478e-8209-4951eb92ee8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:09.911707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eab50a-dfae-478e-8209-4951eb92ee8d admin admin] PATH_INFO: `/v3/projects/38d9ec8ec4864d67a2bcc475f2ddb6c1` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:09.913119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eab50a-dfae-478e-8209-4951eb92ee8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=38d9ec8ec4864d67a2bcc475f2ddb6c1)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:09.926577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eab50a-dfae-478e-8209-4951eb92ee8d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:10.106673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f1eab50a-dfae-478e-8209-4951eb92ee8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38d9ec8ec4864d67a2bcc475f2ddb6c1', 'request_id': 'req-f1eab50a-dfae-478e-8209-4951eb92ee8d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:10.117212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f1eab50a-dfae-478e-8209-4951eb92ee8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38d9ec8ec4864d67a2bcc475f2ddb6c1', 'request_id': 'req-f1eab50a-dfae-478e-8209-4951eb92ee8d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:10.133009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f1eab50a-dfae-478e-8209-4951eb92ee8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38d9ec8ec4864d67a2bcc475f2ddb6c1', 'request_id': 'req-f1eab50a-dfae-478e-8209-4951eb92ee8d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:10.233402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f1eab50a-dfae-478e-8209-4951eb92ee8d admin admin] The token cache is being invalidate because project 38d9ec8ec4864d67a2bcc475f2ddb6c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:57:10.233739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f1eab50a-dfae-478e-8209-4951eb92ee8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:10.234582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f1eab50a-dfae-478e-8209-4951eb92ee8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:10.236134 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3863/7724] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:57:09 2022] DELETE /identity/v3/projects/38d9ec8ec4864d67a2bcc475f2ddb6c1 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:57:10.241812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e402e-ef74-47b3-ba81-cd53fa113240 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:10.242322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e402e-ef74-47b3-ba81-cd53fa113240 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:10.242397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e402e-ef74-47b3-ba81-cd53fa113240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:10.288736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0a8e402e-ef74-47b3-ba81-cd53fa113240 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:57:10.289989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0a8e402e-ef74-47b3-ba81-cd53fa113240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:10.433463 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3862/7725] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:57:10.442429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6722c0-b4cb-4c83-b418-45feaed55c37 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:10.442529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6722c0-b4cb-4c83-b418-45feaed55c37 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:10.442803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6722c0-b4cb-4c83-b418-45feaed55c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:10.485639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-fd6722c0-b4cb-4c83-b418-45feaed55c37 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:57:10.485639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fd6722c0-b4cb-4c83-b418-45feaed55c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:10.521833 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3864/7726] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:57:10.579176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e402e-ef74-47b3-ba81-cd53fa113240 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:10.590245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e402e-ef74-47b3-ba81-cd53fa113240 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:10.605110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e7295-e970-4331-bfbe-a27e2a17a3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:10.605755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e7295-e970-4331-bfbe-a27e2a17a3ac admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:10.606241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e7295-e970-4331-bfbe-a27e2a17a3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:10.606522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e7295-e970-4331-bfbe-a27e2a17a3ac admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:10.607247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e7295-e970-4331-bfbe-a27e2a17a3ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:57:10.607553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e7295-e970-4331-bfbe-a27e2a17a3ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:10.609628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e7295-e970-4331-bfbe-a27e2a17a3ac admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:10.629641 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3863/7727] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:57:10.632923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6722c0-b4cb-4c83-b418-45feaed55c37 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:10.659882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6722c0-b4cb-4c83-b418-45feaed55c37 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:10.666106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4886f1-ca70-49f2-b944-1b914f1f38bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:10.666750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4886f1-ca70-49f2-b944-1b914f1f38bb admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:10.667034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4886f1-ca70-49f2-b944-1b914f1f38bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:10.667303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4886f1-ca70-49f2-b944-1b914f1f38bb admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:10.667951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4886f1-ca70-49f2-b944-1b914f1f38bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:10.670050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4886f1-ca70-49f2-b944-1b914f1f38bb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:10.823202 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3865/7728] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:57:10 2022] POST /identity/v3/projects => generated 379 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:57:10.828731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e7295-e970-4331-bfbe-a27e2a17a3ac admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:10.849565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e7295-e970-4331-bfbe-a27e2a17a3ac admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:10.933746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaebd88-6bf2-4fcd-b429-1ee0de7b4262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:10.934442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaebd88-6bf2-4fcd-b429-1ee0de7b4262 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:10.935376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaebd88-6bf2-4fcd-b429-1ee0de7b4262 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:10.935655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaebd88-6bf2-4fcd-b429-1ee0de7b4262 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:10.936432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaebd88-6bf2-4fcd-b429-1ee0de7b4262 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:10.941628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaebd88-6bf2-4fcd-b429-1ee0de7b4262 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:11.074123 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3864/7729] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:57:10 2022] POST /identity/v3/users => generated 290 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:57:11.076548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4886f1-ca70-49f2-b944-1b914f1f38bb admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:11.095135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4886f1-ca70-49f2-b944-1b914f1f38bb admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:11.104524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2018c-3bba-4527-b46c-43bbe3d39e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:11.105641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2018c-3bba-4527-b46c-43bbe3d39e7c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:11.106305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2018c-3bba-4527-b46c-43bbe3d39e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:11.108213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2018c-3bba-4527-b46c-43bbe3d39e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:11.110076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2018c-3bba-4527-b46c-43bbe3d39e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:11.112593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2018c-3bba-4527-b46c-43bbe3d39e7c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:11.156749 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3866/7730] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:57:11.157209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaebd88-6bf2-4fcd-b429-1ee0de7b4262 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:11.169705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaebd88-6bf2-4fcd-b429-1ee0de7b4262 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:11.191021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a5a26-83b9-4378-bb13-01ade0c5fd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:11.191845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a5a26-83b9-4378-bb13-01ade0c5fd51 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:11.192396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a5a26-83b9-4378-bb13-01ade0c5fd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:11.192840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a5a26-83b9-4378-bb13-01ade0c5fd51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:11.193552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a5a26-83b9-4378-bb13-01ade0c5fd51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:11.210830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a5a26-83b9-4378-bb13-01ade0c5fd51 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:11.224823 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3865/7731] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:57:11.228761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2018c-3bba-4527-b46c-43bbe3d39e7c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:11.250945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2018c-3bba-4527-b46c-43bbe3d39e7c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:11.259550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b32f2c-e4dc-4634-9be5-a6e0dc0376a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:11.260250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b32f2c-e4dc-4634-9be5-a6e0dc0376a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:11.260534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b32f2c-e4dc-4634-9be5-a6e0dc0376a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:11.260825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b32f2c-e4dc-4634-9be5-a6e0dc0376a0 admin admin] PATH_INFO: `/v3/projects/57b587e152514b0f99c5e14e842d6ffc/users/323c30f244f24b0897ec0631a33d91e0/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:11.292931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b32f2c-e4dc-4634-9be5-a6e0dc0376a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b587e152514b0f99c5e14e842d6ffc, user_id=323c30f244f24b0897ec0631a33d91e0, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:11.298534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b32f2c-e4dc-4634-9be5-a6e0dc0376a0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:11.386819 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3867/7732] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:57:11 2022] PUT /identity/v3/projects/57b587e152514b0f99c5e14e842d6ffc/users/323c30f244f24b0897ec0631a33d91e0/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:57:11.388779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9b476-be49-437c-a581-77a52fd46669 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:11.389235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9b476-be49-437c-a581-77a52fd46669 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:11.389318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9b476-be49-437c-a581-77a52fd46669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:11.431548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b9f9b476-be49-437c-a581-77a52fd46669 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:57:11.440406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b9f9b476-be49-437c-a581-77a52fd46669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:11.524003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:11.549082 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3866/7733] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:57:11.549859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b32f2c-e4dc-4634-9be5-a6e0dc0376a0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:11.551691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-71b32f2c-e4dc-4634-9be5-a6e0dc0376a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:11.695762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b32f2c-e4dc-4634-9be5-a6e0dc0376a0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:11.706340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ab478-94fa-4fe7-a358-09f31f26c27d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:11.708129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ab478-94fa-4fe7-a358-09f31f26c27d service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:11.708973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ab478-94fa-4fe7-a358-09f31f26c27d service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:11.710409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ab478-94fa-4fe7-a358-09f31f26c27d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:11.726769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:11.742224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ab478-94fa-4fe7-a358-09f31f26c27d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:11.746358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ab478-94fa-4fe7-a358-09f31f26c27d service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:11.781480 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3868/7734] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:57:14.167524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad7751-7ef3-4ae7-a9c4-15213d011187 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:14.167524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad7751-7ef3-4ae7-a9c4-15213d011187 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:14.167524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad7751-7ef3-4ae7-a9c4-15213d011187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:14.238223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-40ad7751-7ef3-4ae7-a9c4-15213d011187 None None] MFA Rules not processed for user `323c30f244f24b0897ec0631a33d91e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:57:14.241564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-40ad7751-7ef3-4ae7-a9c4-15213d011187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:14.403064 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3867/7735] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:57:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:57:14.407309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ab478-94fa-4fe7-a358-09f31f26c27d service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:14.426048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ab478-94fa-4fe7-a358-09f31f26c27d service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:14.442506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede537c-b51b-4e47-b108-d9dfbe9106e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:14.443065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede537c-b51b-4e47-b108-d9dfbe9106e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:14.443352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede537c-b51b-4e47-b108-d9dfbe9106e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:14.443683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede537c-b51b-4e47-b108-d9dfbe9106e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:14.444327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede537c-b51b-4e47-b108-d9dfbe9106e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:14.453913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede537c-b51b-4e47-b108-d9dfbe9106e3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:14.562877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad7751-7ef3-4ae7-a9c4-15213d011187 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:14.565323 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3869/7736] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:57:14 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:57:14.582920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad7751-7ef3-4ae7-a9c4-15213d011187 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:14.783480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabfe9c-9f41-4e84-8345-fe1076f794b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:14.784389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabfe9c-9f41-4e84-8345-fe1076f794b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:14.784886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabfe9c-9f41-4e84-8345-fe1076f794b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:14.785376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabfe9c-9f41-4e84-8345-fe1076f794b0 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:14.786811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabfe9c-9f41-4e84-8345-fe1076f794b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:14.789236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabfe9c-9f41-4e84-8345-fe1076f794b0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:14.915338 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3868/7737] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:57:14 2022] POST /identity/v3/users => generated 296 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:57:14.916731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede537c-b51b-4e47-b108-d9dfbe9106e3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:14.931192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede537c-b51b-4e47-b108-d9dfbe9106e3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:14.944899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8541a2-1b51-48bb-b8a1-b59c517fd671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:14.948129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8541a2-1b51-48bb-b8a1-b59c517fd671 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:14.948602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8541a2-1b51-48bb-b8a1-b59c517fd671 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:14.949035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8541a2-1b51-48bb-b8a1-b59c517fd671 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:14.953624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8541a2-1b51-48bb-b8a1-b59c517fd671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:14.955560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8541a2-1b51-48bb-b8a1-b59c517fd671 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:14.998777 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3870/7738] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:57:14.999875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabfe9c-9f41-4e84-8345-fe1076f794b0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:15.015816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabfe9c-9f41-4e84-8345-fe1076f794b0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:15.031681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385be92a-9dad-4bac-970d-ff2312ad7db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:15.032564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385be92a-9dad-4bac-970d-ff2312ad7db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:15.032948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385be92a-9dad-4bac-970d-ff2312ad7db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:15.038395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385be92a-9dad-4bac-970d-ff2312ad7db0 admin admin] PATH_INFO: `/v3/projects/3fad3f9fb09b4c06a2af2ec35b31cd7a/users/0e8254a6994140eab28675f5cf48d181/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:15.069294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385be92a-9dad-4bac-970d-ff2312ad7db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fad3f9fb09b4c06a2af2ec35b31cd7a, user_id=0e8254a6994140eab28675f5cf48d181, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:15.081343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385be92a-9dad-4bac-970d-ff2312ad7db0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:15.199056 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3869/7739] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:57:14 2022] PUT /identity/v3/projects/3fad3f9fb09b4c06a2af2ec35b31cd7a/users/0e8254a6994140eab28675f5cf48d181/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:57:15.205167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8541a2-1b51-48bb-b8a1-b59c517fd671 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:15.225978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8541a2-1b51-48bb-b8a1-b59c517fd671 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:15.302271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33b76a-a6a7-40f2-be55-8537edcfcfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:15.303276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33b76a-a6a7-40f2-be55-8537edcfcfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:15.303761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33b76a-a6a7-40f2-be55-8537edcfcfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:15.304258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33b76a-a6a7-40f2-be55-8537edcfcfa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:15.305281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33b76a-a6a7-40f2-be55-8537edcfcfa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:15.307253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33b76a-a6a7-40f2-be55-8537edcfcfa9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:15.320744 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3871/7740] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:57:15.325173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385be92a-9dad-4bac-970d-ff2312ad7db0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:15.337277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385be92a-9dad-4bac-970d-ff2312ad7db0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:15.353963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b64750-038a-4d69-aa16-1df8150352e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:15.355459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b64750-038a-4d69-aa16-1df8150352e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:15.355898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b64750-038a-4d69-aa16-1df8150352e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:15.356330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b64750-038a-4d69-aa16-1df8150352e0 admin admin] PATH_INFO: `/v3/projects/3fad3f9fb09b4c06a2af2ec35b31cd7a/users/0e8254a6994140eab28675f5cf48d181/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:15.360944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b64750-038a-4d69-aa16-1df8150352e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fad3f9fb09b4c06a2af2ec35b31cd7a, user_id=0e8254a6994140eab28675f5cf48d181, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:15.367522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b64750-038a-4d69-aa16-1df8150352e0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:15.397260 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3870/7741] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:57:15 2022] PUT /identity/v3/projects/3fad3f9fb09b4c06a2af2ec35b31cd7a/users/0e8254a6994140eab28675f5cf48d181/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:57:15.931698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33b76a-a6a7-40f2-be55-8537edcfcfa9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:15.934201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3b33b76a-a6a7-40f2-be55-8537edcfcfa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:16.064257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33b76a-a6a7-40f2-be55-8537edcfcfa9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:16.160452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2bb79-10c0-4391-a46d-81467864efa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:16.163743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2bb79-10c0-4391-a46d-81467864efa7 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:16.164256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2bb79-10c0-4391-a46d-81467864efa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:16.164840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2bb79-10c0-4391-a46d-81467864efa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:16.169437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e4f2bb79-10c0-4391-a46d-81467864efa7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:16.242201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:16.327134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2bb79-10c0-4391-a46d-81467864efa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:16.328752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2bb79-10c0-4391-a46d-81467864efa7 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:16.351984 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3872/7742] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:57:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:57:17.995119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69866b4-5aa3-4590-9b45-a0041e7a9590 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:17.995600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69866b4-5aa3-4590-9b45-a0041e7a9590 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:17.995930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69866b4-5aa3-4590-9b45-a0041e7a9590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:18.060598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e69866b4-5aa3-4590-9b45-a0041e7a9590 None None] MFA Rules not processed for user `0e8254a6994140eab28675f5cf48d181`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:57:18.061837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e69866b4-5aa3-4590-9b45-a0041e7a9590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:18.121561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:18.210009 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3871/7743] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:57:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:57:18.225204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d0594-7a96-4fbc-afad-5a83ffc6e553 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:18.225680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d0594-7a96-4fbc-afad-5a83ffc6e553 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:18.226188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d0594-7a96-4fbc-afad-5a83ffc6e553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:18.258838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-221d0594-7a96-4fbc-afad-5a83ffc6e553 None None] MFA Rules not processed for user `323c30f244f24b0897ec0631a33d91e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:57:18.260245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-221d0594-7a96-4fbc-afad-5a83ffc6e553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:18.369958 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3873/7744] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:57:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:57:18.383331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69866b4-5aa3-4590-9b45-a0041e7a9590 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:18.385129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e69866b4-5aa3-4590-9b45-a0041e7a9590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:18.535566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69866b4-5aa3-4590-9b45-a0041e7a9590 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:18.543088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27778fae-6842-4693-85d1-c3c116a2d169 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:18.543929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27778fae-6842-4693-85d1-c3c116a2d169 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:18.544196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27778fae-6842-4693-85d1-c3c116a2d169 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:18.544603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27778fae-6842-4693-85d1-c3c116a2d169 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:18.557492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27778fae-6842-4693-85d1-c3c116a2d169 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:18.559222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27778fae-6842-4693-85d1-c3c116a2d169 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:18.582844 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3872/7745] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:57:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:57:19.213858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d0594-7a96-4fbc-afad-5a83ffc6e553 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:19.318078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d0594-7a96-4fbc-afad-5a83ffc6e553 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:19.339095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b82809-34d2-48b0-a62d-ed6aa956d8e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:19.340705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b82809-34d2-48b0-a62d-ed6aa956d8e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:19.342358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b82809-34d2-48b0-a62d-ed6aa956d8e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:19.343090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b82809-34d2-48b0-a62d-ed6aa956d8e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:19.373610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a2b82809-34d2-48b0-a62d-ed6aa956d8e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:19.410949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b82809-34d2-48b0-a62d-ed6aa956d8e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:19.412638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b82809-34d2-48b0-a62d-ed6aa956d8e9 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:19.434482 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3874/7746] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:57:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:57:20.272987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27778fae-6842-4693-85d1-c3c116a2d169 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:20.276705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-27778fae-6842-4693-85d1-c3c116a2d169 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:20.418941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27778fae-6842-4693-85d1-c3c116a2d169 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:20.434626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c8ddc-0f16-4d57-813a-4edd1bdb4481 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:20.435557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c8ddc-0f16-4d57-813a-4edd1bdb4481 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:20.436576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c8ddc-0f16-4d57-813a-4edd1bdb4481 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:20.437092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c8ddc-0f16-4d57-813a-4edd1bdb4481 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:20.439688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b64c8ddc-0f16-4d57-813a-4edd1bdb4481 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:20.461164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c8ddc-0f16-4d57-813a-4edd1bdb4481 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:20.476180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c8ddc-0f16-4d57-813a-4edd1bdb4481 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:20.501156 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3873/7747] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:57:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:57:22.654400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b82809-34d2-48b0-a62d-ed6aa956d8e9 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:22.657247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a2b82809-34d2-48b0-a62d-ed6aa956d8e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:22.686753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b82809-34d2-48b0-a62d-ed6aa956d8e9 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:22.695198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe3e7e-71b4-4023-98d6-e58e450172e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:22.696141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe3e7e-71b4-4023-98d6-e58e450172e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:22.696608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe3e7e-71b4-4023-98d6-e58e450172e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:22.697354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe3e7e-71b4-4023-98d6-e58e450172e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:22.708852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cdfe3e7e-71b4-4023-98d6-e58e450172e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:22.745968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe3e7e-71b4-4023-98d6-e58e450172e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:22.746190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe3e7e-71b4-4023-98d6-e58e450172e2 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:22.771439 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3875/7748] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:57:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:57:28.824581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c8ddc-0f16-4d57-813a-4edd1bdb4481 service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:28.826223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b64c8ddc-0f16-4d57-813a-4edd1bdb4481 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:28.852721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c8ddc-0f16-4d57-813a-4edd1bdb4481 service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:28.876964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82a2dd-9736-4c16-b567-ff6387fd636d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:28.878740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82a2dd-9736-4c16-b567-ff6387fd636d service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:28.881045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82a2dd-9736-4c16-b567-ff6387fd636d service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:28.885145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82a2dd-9736-4c16-b567-ff6387fd636d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:28.885145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3b82a2dd-9736-4c16-b567-ff6387fd636d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:28.905037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82a2dd-9736-4c16-b567-ff6387fd636d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:28.911692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82a2dd-9736-4c16-b567-ff6387fd636d service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:28.923502 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3874/7749] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:57:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:57:32.754274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=74 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:38.004147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe3e7e-71b4-4023-98d6-e58e450172e2 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:38.035261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe3e7e-71b4-4023-98d6-e58e450172e2 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:38.045326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b7745-ad4c-4dbf-afcb-116dbb4ccfb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:38.046897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b7745-ad4c-4dbf-afcb-116dbb4ccfb0 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:38.047898 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b7745-ad4c-4dbf-afcb-116dbb4ccfb0 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:38.048486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b7745-ad4c-4dbf-afcb-116dbb4ccfb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:38.054138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-523b7745-ad4c-4dbf-afcb-116dbb4ccfb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:38.073943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b7745-ad4c-4dbf-afcb-116dbb4ccfb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:38.079113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b7745-ad4c-4dbf-afcb-116dbb4ccfb0 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:38.093654 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3876/7750] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:57:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:57:38.915260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:45.069682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82a2dd-9736-4c16-b567-ff6387fd636d service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:45.082471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3b82a2dd-9736-4c16-b567-ff6387fd636d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:45.176850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82a2dd-9736-4c16-b567-ff6387fd636d service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:45.186118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b799864-c550-4f58-baa3-0d6f9eca3351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:45.186118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b799864-c550-4f58-baa3-0d6f9eca3351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:45.186118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b799864-c550-4f58-baa3-0d6f9eca3351 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:45.186118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b799864-c550-4f58-baa3-0d6f9eca3351 admin admin] PATH_INFO: `/v3/users/e048f6141cec454a80825ffff2326b20` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:45.186535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b799864-c550-4f58-baa3-0d6f9eca3351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e048f6141cec454a80825ffff2326b20)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:45.188857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b799864-c550-4f58-baa3-0d6f9eca3351 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:45.440355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0b799864-c550-4f58-baa3-0d6f9eca3351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e048f6141cec454a80825ffff2326b20'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:45.442586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0b799864-c550-4f58-baa3-0d6f9eca3351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e048f6141cec454a80825ffff2326b20'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:45.463187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0b799864-c550-4f58-baa3-0d6f9eca3351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e048f6141cec454a80825ffff2326b20'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:45.514073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0b799864-c550-4f58-baa3-0d6f9eca3351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e048f6141cec454a80825ffff2326b20'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:45.614268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0b799864-c550-4f58-baa3-0d6f9eca3351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e048f6141cec454a80825ffff2326b20'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:45.625633 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3875/7751] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:57:45 2022] DELETE /identity/v3/users/e048f6141cec454a80825ffff2326b20 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:57:45.630424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05083124-9af1-4b9b-91ac-fa77c90e2489 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:45.630860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05083124-9af1-4b9b-91ac-fa77c90e2489 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:45.630964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05083124-9af1-4b9b-91ac-fa77c90e2489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:45.671352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-05083124-9af1-4b9b-91ac-fa77c90e2489 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:57:45.673191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-05083124-9af1-4b9b-91ac-fa77c90e2489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:45.816511 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3877/7752] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:57:45.825131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b799864-c550-4f58-baa3-0d6f9eca3351 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:45.826664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0b799864-c550-4f58-baa3-0d6f9eca3351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:46.030357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b799864-c550-4f58-baa3-0d6f9eca3351 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:46.034678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb6513-c8ee-4746-8bfc-cbd63a92d997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:46.034678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb6513-c8ee-4746-8bfc-cbd63a92d997 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:46.034678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb6513-c8ee-4746-8bfc-cbd63a92d997 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:46.040761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb6513-c8ee-4746-8bfc-cbd63a92d997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:46.051711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb6513-c8ee-4746-8bfc-cbd63a92d997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:46.054678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb6513-c8ee-4746-8bfc-cbd63a92d997 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:46.080802 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3876/7753] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:57:47.178482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05083124-9af1-4b9b-91ac-fa77c90e2489 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:47.191123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-05083124-9af1-4b9b-91ac-fa77c90e2489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:47.214374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05083124-9af1-4b9b-91ac-fa77c90e2489 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:47.221988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c9e48-f36f-44a2-a4f1-588713e894dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:47.223086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c9e48-f36f-44a2-a4f1-588713e894dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:47.223517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c9e48-f36f-44a2-a4f1-588713e894dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:47.223993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c9e48-f36f-44a2-a4f1-588713e894dd admin admin] PATH_INFO: `/v3/projects/c3dd4848e430472784938d3df26522c5` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:47.225298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c9e48-f36f-44a2-a4f1-588713e894dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3dd4848e430472784938d3df26522c5)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:47.228918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c9e48-f36f-44a2-a4f1-588713e894dd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:47.397471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-439c9e48-f36f-44a2-a4f1-588713e894dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3dd4848e430472784938d3df26522c5', 'request_id': 'req-439c9e48-f36f-44a2-a4f1-588713e894dd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:47.405025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-439c9e48-f36f-44a2-a4f1-588713e894dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3dd4848e430472784938d3df26522c5', 'request_id': 'req-439c9e48-f36f-44a2-a4f1-588713e894dd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:47.413957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-439c9e48-f36f-44a2-a4f1-588713e894dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3dd4848e430472784938d3df26522c5', 'request_id': 'req-439c9e48-f36f-44a2-a4f1-588713e894dd'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:47.505667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-439c9e48-f36f-44a2-a4f1-588713e894dd admin admin] The token cache is being invalidate because project c3dd4848e430472784938d3df26522c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:57:47.505985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-439c9e48-f36f-44a2-a4f1-588713e894dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:47.506703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-439c9e48-f36f-44a2-a4f1-588713e894dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:47.508257 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3878/7754] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:57:47 2022] DELETE /identity/v3/projects/c3dd4848e430472784938d3df26522c5 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:57:47.512534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb6513-c8ee-4746-8bfc-cbd63a92d997 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:47.527313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb6513-c8ee-4746-8bfc-cbd63a92d997 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:47.569030 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:47.617487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae4612-4225-440f-9f7d-d9ba896c5fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:47.632719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae4612-4225-440f-9f7d-d9ba896c5fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:47.633362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae4612-4225-440f-9f7d-d9ba896c5fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:47.633801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae4612-4225-440f-9f7d-d9ba896c5fb5 admin admin] PATH_INFO: `/v3/users/202258701aee482c9e92fc2af1639062` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:47.635704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae4612-4225-440f-9f7d-d9ba896c5fb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=202258701aee482c9e92fc2af1639062)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:47.637866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae4612-4225-440f-9f7d-d9ba896c5fb5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:47.886298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-71ae4612-4225-440f-9f7d-d9ba896c5fb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '202258701aee482c9e92fc2af1639062'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:47.886998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-71ae4612-4225-440f-9f7d-d9ba896c5fb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '202258701aee482c9e92fc2af1639062'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:47.896208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-71ae4612-4225-440f-9f7d-d9ba896c5fb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '202258701aee482c9e92fc2af1639062'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:47.910025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-71ae4612-4225-440f-9f7d-d9ba896c5fb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '202258701aee482c9e92fc2af1639062'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:47.934198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c9e48-f36f-44a2-a4f1-588713e894dd admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:47.936459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-439c9e48-f36f-44a2-a4f1-588713e894dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:47.961372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c9e48-f36f-44a2-a4f1-588713e894dd admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:47.966015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a17839-c75a-4d34-adf9-3e9ed618ef21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:47.966677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a17839-c75a-4d34-adf9-3e9ed618ef21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:47.967004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a17839-c75a-4d34-adf9-3e9ed618ef21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:47.970872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a17839-c75a-4d34-adf9-3e9ed618ef21 admin admin] PATH_INFO: `/v3/users/2d5b94e8457347c7b2a57a3146093a94` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:47.970872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a17839-c75a-4d34-adf9-3e9ed618ef21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d5b94e8457347c7b2a57a3146093a94)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:47.971416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a17839-c75a-4d34-adf9-3e9ed618ef21 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:47.986518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-71ae4612-4225-440f-9f7d-d9ba896c5fb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '202258701aee482c9e92fc2af1639062'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:47.999559 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3877/7755] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:57:47 2022] DELETE /identity/v3/users/202258701aee482c9e92fc2af1639062 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:57:48.204018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a2a17839-c75a-4d34-adf9-3e9ed618ef21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d5b94e8457347c7b2a57a3146093a94'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:48.204579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a2a17839-c75a-4d34-adf9-3e9ed618ef21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d5b94e8457347c7b2a57a3146093a94'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:48.215256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a2a17839-c75a-4d34-adf9-3e9ed618ef21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d5b94e8457347c7b2a57a3146093a94'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:48.222928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:48.228305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a2a17839-c75a-4d34-adf9-3e9ed618ef21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d5b94e8457347c7b2a57a3146093a94'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:48.229027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a2a17839-c75a-4d34-adf9-3e9ed618ef21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d5b94e8457347c7b2a57a3146093a94'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:48.323822 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3879/7756] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:57:47 2022] DELETE /identity/v3/users/2d5b94e8457347c7b2a57a3146093a94 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:57:48.328080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23401bc-a5b3-4090-a253-925134e73150 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:48.328372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23401bc-a5b3-4090-a253-925134e73150 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:48.328651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23401bc-a5b3-4090-a253-925134e73150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:48.353148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b23401bc-a5b3-4090-a253-925134e73150 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:57:48.354611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b23401bc-a5b3-4090-a253-925134e73150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:48.435413 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3878/7757] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:57:48.446675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a17839-c75a-4d34-adf9-3e9ed618ef21 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:48.448906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a2a17839-c75a-4d34-adf9-3e9ed618ef21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:48.504470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23401bc-a5b3-4090-a253-925134e73150 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:48.505923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b23401bc-a5b3-4090-a253-925134e73150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:48.523423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a17839-c75a-4d34-adf9-3e9ed618ef21 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:48.528325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa94351-de9c-42ef-a17d-7838d9cac186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:48.528836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23401bc-a5b3-4090-a253-925134e73150 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:48.529297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa94351-de9c-42ef-a17d-7838d9cac186 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:48.529657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa94351-de9c-42ef-a17d-7838d9cac186 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:48.530331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa94351-de9c-42ef-a17d-7838d9cac186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:48.535725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d69f03-6ca6-4144-9659-f6218a9f25dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:48.536593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d69f03-6ca6-4144-9659-f6218a9f25dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:48.537187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d69f03-6ca6-4144-9659-f6218a9f25dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:48.537605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d69f03-6ca6-4144-9659-f6218a9f25dc admin admin] PATH_INFO: `/v3/projects/7aef7304a702474cbceb00d59c119dc9` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:48.540112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d69f03-6ca6-4144-9659-f6218a9f25dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aef7304a702474cbceb00d59c119dc9)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:48.542822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d69f03-6ca6-4144-9659-f6218a9f25dc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:48.556580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa94351-de9c-42ef-a17d-7838d9cac186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:48.558333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa94351-de9c-42ef-a17d-7838d9cac186 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:48.570693 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3880/7758] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:57:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:57:48.674983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:48.686707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-95d69f03-6ca6-4144-9659-f6218a9f25dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aef7304a702474cbceb00d59c119dc9', 'request_id': 'req-95d69f03-6ca6-4144-9659-f6218a9f25dc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:48.762486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-95d69f03-6ca6-4144-9659-f6218a9f25dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aef7304a702474cbceb00d59c119dc9', 'request_id': 'req-95d69f03-6ca6-4144-9659-f6218a9f25dc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:48.776413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-95d69f03-6ca6-4144-9659-f6218a9f25dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aef7304a702474cbceb00d59c119dc9', 'request_id': 'req-95d69f03-6ca6-4144-9659-f6218a9f25dc'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:48.800887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-95d69f03-6ca6-4144-9659-f6218a9f25dc admin admin] The token cache is being invalidate because project 7aef7304a702474cbceb00d59c119dc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:57:48.801378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-95d69f03-6ca6-4144-9659-f6218a9f25dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:48.802527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-95d69f03-6ca6-4144-9659-f6218a9f25dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:48.804726 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3879/7759] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:57:48 2022] DELETE /identity/v3/projects/7aef7304a702474cbceb00d59c119dc9 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:57:48.809665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e573a-8d21-421c-84ee-e155c50f6e8b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:48.809960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e573a-8d21-421c-84ee-e155c50f6e8b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:48.810275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e573a-8d21-421c-84ee-e155c50f6e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:48.831630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ed7e573a-8d21-421c-84ee-e155c50f6e8b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:57:48.832864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ed7e573a-8d21-421c-84ee-e155c50f6e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:48.895438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d69f03-6ca6-4144-9659-f6218a9f25dc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:48.897061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-95d69f03-6ca6-4144-9659-f6218a9f25dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:48.901464 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3881/7760] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:57:48.909972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593665e-56ce-4e5a-8943-aeadbd768db4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:48.910503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593665e-56ce-4e5a-8943-aeadbd768db4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:48.910763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593665e-56ce-4e5a-8943-aeadbd768db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:48.914442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d69f03-6ca6-4144-9659-f6218a9f25dc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:48.921503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea6eb8-93c1-4c1b-80a0-55c85833c07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:48.923353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea6eb8-93c1-4c1b-80a0-55c85833c07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:48.923642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea6eb8-93c1-4c1b-80a0-55c85833c07a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:48.924521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea6eb8-93c1-4c1b-80a0-55c85833c07a admin admin] PATH_INFO: `/v3/projects/ff720e3f73e249d1beafa092eb8be061` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:48.938464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea6eb8-93c1-4c1b-80a0-55c85833c07a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff720e3f73e249d1beafa092eb8be061)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:48.939567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea6eb8-93c1-4c1b-80a0-55c85833c07a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:48.955811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3593665e-56ce-4e5a-8943-aeadbd768db4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:57:48.957026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3593665e-56ce-4e5a-8943-aeadbd768db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:48.966906 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3882/7761] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:57:48.971541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593665e-56ce-4e5a-8943-aeadbd768db4 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:48.985858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593665e-56ce-4e5a-8943-aeadbd768db4 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:48.990982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bb878-dbf4-4815-af18-8ae00f0f4bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:48.992086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bb878-dbf4-4815-af18-8ae00f0f4bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:48.992587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bb878-dbf4-4815-af18-8ae00f0f4bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:48.993399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bb878-dbf4-4815-af18-8ae00f0f4bf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:48.995973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bb878-dbf4-4815-af18-8ae00f0f4bf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:57:48.996301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bb878-dbf4-4815-af18-8ae00f0f4bf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:48.997989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bb878-dbf4-4815-af18-8ae00f0f4bf0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:49.022087 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3883/7762] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:57:49.025300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bb878-dbf4-4815-af18-8ae00f0f4bf0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:49.037215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bb878-dbf4-4815-af18-8ae00f0f4bf0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:49.044173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb5bd4-7e2c-4dc6-ad14-561e454b8908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:49.044173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb5bd4-7e2c-4dc6-ad14-561e454b8908 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:49.044173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb5bd4-7e2c-4dc6-ad14-561e454b8908 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:49.044451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb5bd4-7e2c-4dc6-ad14-561e454b8908 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:49.045252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb5bd4-7e2c-4dc6-ad14-561e454b8908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:49.048783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb5bd4-7e2c-4dc6-ad14-561e454b8908 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:49.091089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-33ea6eb8-93c1-4c1b-80a0-55c85833c07a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff720e3f73e249d1beafa092eb8be061', 'request_id': 'req-33ea6eb8-93c1-4c1b-80a0-55c85833c07a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:49.146553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-33ea6eb8-93c1-4c1b-80a0-55c85833c07a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff720e3f73e249d1beafa092eb8be061', 'request_id': 'req-33ea6eb8-93c1-4c1b-80a0-55c85833c07a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:49.155964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-33ea6eb8-93c1-4c1b-80a0-55c85833c07a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff720e3f73e249d1beafa092eb8be061', 'request_id': 'req-33ea6eb8-93c1-4c1b-80a0-55c85833c07a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:49.170516 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3884/7763] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:57:49 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:57:49.174864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb5bd4-7e2c-4dc6-ad14-561e454b8908 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:49.175181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-33ea6eb8-93c1-4c1b-80a0-55c85833c07a admin admin] The token cache is being invalidate because project ff720e3f73e249d1beafa092eb8be061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:57:49.175181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-33ea6eb8-93c1-4c1b-80a0-55c85833c07a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:49.175366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-33ea6eb8-93c1-4c1b-80a0-55c85833c07a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:49.181753 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3880/7764] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:57:48 2022] DELETE /identity/v3/projects/ff720e3f73e249d1beafa092eb8be061 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:57:49.183779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9dec4-35a2-4d0e-aeb9-e933a30d6148 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:49.184281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9dec4-35a2-4d0e-aeb9-e933a30d6148 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:49.185259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9dec4-35a2-4d0e-aeb9-e933a30d6148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:49.224614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4ce9dec4-35a2-4d0e-aeb9-e933a30d6148 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:57:49.227379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4ce9dec4-35a2-4d0e-aeb9-e933a30d6148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:49.317226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:49.349516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb5bd4-7e2c-4dc6-ad14-561e454b8908 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:49.362922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862678e-e96d-4289-860e-1d824637db8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:49.368785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862678e-e96d-4289-860e-1d824637db8f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:49.368785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862678e-e96d-4289-860e-1d824637db8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:49.368785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862678e-e96d-4289-860e-1d824637db8f admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:49.368785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862678e-e96d-4289-860e-1d824637db8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:49.370772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862678e-e96d-4289-860e-1d824637db8f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:49.373192 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3881/7765] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:57:49.382841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f14b9-677e-4c28-95cc-ba3d466a8214 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:49.383193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f14b9-677e-4c28-95cc-ba3d466a8214 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:49.383538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f14b9-677e-4c28-95cc-ba3d466a8214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:49.421493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ab1f14b9-677e-4c28-95cc-ba3d466a8214 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:57:49.423464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ab1f14b9-677e-4c28-95cc-ba3d466a8214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:49.434101 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3882/7766] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:57:49.436540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f14b9-677e-4c28-95cc-ba3d466a8214 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:49.449120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f14b9-677e-4c28-95cc-ba3d466a8214 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:49.454354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4c3f2-3c4f-4cf8-aaae-b7ed9ec6dd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:49.454981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4c3f2-3c4f-4cf8-aaae-b7ed9ec6dd38 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:49.455264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4c3f2-3c4f-4cf8-aaae-b7ed9ec6dd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:49.455542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4c3f2-3c4f-4cf8-aaae-b7ed9ec6dd38 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:49.456208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4c3f2-3c4f-4cf8-aaae-b7ed9ec6dd38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:57:49.456514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4c3f2-3c4f-4cf8-aaae-b7ed9ec6dd38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:49.460686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4c3f2-3c4f-4cf8-aaae-b7ed9ec6dd38 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:49.477226 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3883/7767] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:57:49.478134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4c3f2-3c4f-4cf8-aaae-b7ed9ec6dd38 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:49.491026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4c3f2-3c4f-4cf8-aaae-b7ed9ec6dd38 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:49.497838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e31457-afdd-4917-bd10-93e52e6999c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:49.497838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e31457-afdd-4917-bd10-93e52e6999c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:49.497838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e31457-afdd-4917-bd10-93e52e6999c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:49.497838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e31457-afdd-4917-bd10-93e52e6999c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:49.498216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e31457-afdd-4917-bd10-93e52e6999c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:49.499431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e31457-afdd-4917-bd10-93e52e6999c6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:49.523997 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3885/7768] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:57:49 2022] POST /identity/v3/users => generated 292 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:57:49.528130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862678e-e96d-4289-860e-1d824637db8f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:49.529922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e862678e-e96d-4289-860e-1d824637db8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:49.544252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862678e-e96d-4289-860e-1d824637db8f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:49.559316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af84be-27c9-4870-b780-1242d891ea34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:49.560096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af84be-27c9-4870-b780-1242d891ea34 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:49.560454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af84be-27c9-4870-b780-1242d891ea34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:49.560803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af84be-27c9-4870-b780-1242d891ea34 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:49.561558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af84be-27c9-4870-b780-1242d891ea34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:49.563945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af84be-27c9-4870-b780-1242d891ea34 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:49.579914 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3886/7769] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:57:49.583937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af84be-27c9-4870-b780-1242d891ea34 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:49.601472 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3884/7770] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:57:49 2022] POST /identity/v3/projects => generated 363 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:57:49.602343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af84be-27c9-4870-b780-1242d891ea34 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:49.616186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e31457-afdd-4917-bd10-93e52e6999c6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:49.632403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:49.695113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482057f-82fb-4e97-b592-e0740501a699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:49.696629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482057f-82fb-4e97-b592-e0740501a699 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:49.696992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482057f-82fb-4e97-b592-e0740501a699 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:49.697337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482057f-82fb-4e97-b592-e0740501a699 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:49.698765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482057f-82fb-4e97-b592-e0740501a699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:49.700753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482057f-82fb-4e97-b592-e0740501a699 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:49.716347 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3887/7771] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:57:49.720528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482057f-82fb-4e97-b592-e0740501a699 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:49.733296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482057f-82fb-4e97-b592-e0740501a699 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:49.738959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44199f37-7950-4b87-b5b6-9431fae62362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:49.740142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44199f37-7950-4b87-b5b6-9431fae62362 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:49.740583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44199f37-7950-4b87-b5b6-9431fae62362 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:49.741013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44199f37-7950-4b87-b5b6-9431fae62362 admin admin] PATH_INFO: `/v3/projects/59958b4caacc41d89d846512c56dffe3/users/678bf336be0c435387a28c26d813d3f8/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:49.764321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44199f37-7950-4b87-b5b6-9431fae62362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59958b4caacc41d89d846512c56dffe3, user_id=678bf336be0c435387a28c26d813d3f8, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:49.768344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44199f37-7950-4b87-b5b6-9431fae62362 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:49.780959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e31457-afdd-4917-bd10-93e52e6999c6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:49.792475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333c91d-cf71-44d2-af1f-f08d4b0c0fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:49.793191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333c91d-cf71-44d2-af1f-f08d4b0c0fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:49.793475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333c91d-cf71-44d2-af1f-f08d4b0c0fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:49.793817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333c91d-cf71-44d2-af1f-f08d4b0c0fb2 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:49.794503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333c91d-cf71-44d2-af1f-f08d4b0c0fb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:49.798079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333c91d-cf71-44d2-af1f-f08d4b0c0fb2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:49.851735 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3888/7772] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:57:49 2022] PUT /identity/v3/projects/59958b4caacc41d89d846512c56dffe3/users/678bf336be0c435387a28c26d813d3f8/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:57:49.863408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6b881-96a3-4c17-9f05-4b6c372d03a9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:49.863781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6b881-96a3-4c17-9f05-4b6c372d03a9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:49.864276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6b881-96a3-4c17-9f05-4b6c372d03a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:49.879048 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3885/7773] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:57:49 2022] POST /identity/v3/users => generated 282 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:57:49.883653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333c91d-cf71-44d2-af1f-f08d4b0c0fb2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:49.909495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-34c6b881-96a3-4c17-9f05-4b6c372d03a9 None None] MFA Rules not processed for user `678bf336be0c435387a28c26d813d3f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:57:49.909889 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333c91d-cf71-44d2-af1f-f08d4b0c0fb2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:49.911460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-34c6b881-96a3-4c17-9f05-4b6c372d03a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:49.984452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eac2b6-2af8-443f-985a-d8609b491d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:49.986231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eac2b6-2af8-443f-985a-d8609b491d01 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:49.986711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eac2b6-2af8-443f-985a-d8609b491d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:49.987055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eac2b6-2af8-443f-985a-d8609b491d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:49.988045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eac2b6-2af8-443f-985a-d8609b491d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:49.990312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eac2b6-2af8-443f-985a-d8609b491d01 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:49.993370 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3889/7774] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:57:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:57:49.998228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6b881-96a3-4c17-9f05-4b6c372d03a9 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:50.011630 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3886/7775] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:57:50.014364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6b881-96a3-4c17-9f05-4b6c372d03a9 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:50.017070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eac2b6-2af8-443f-985a-d8609b491d01 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:50.020689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c76e18-a39d-4bd5-bea4-b671f5503134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:50.021340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c76e18-a39d-4bd5-bea4-b671f5503134 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:50.021627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c76e18-a39d-4bd5-bea4-b671f5503134 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:50.021905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c76e18-a39d-4bd5-bea4-b671f5503134 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:50.022599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c76e18-a39d-4bd5-bea4-b671f5503134 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:50.024557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c76e18-a39d-4bd5-bea4-b671f5503134 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:50.043365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eac2b6-2af8-443f-985a-d8609b491d01 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:50.053488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46dd34-6829-4f22-af9d-c5e71d669223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:50.054279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46dd34-6829-4f22-af9d-c5e71d669223 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:50.054633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46dd34-6829-4f22-af9d-c5e71d669223 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:50.055195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46dd34-6829-4f22-af9d-c5e71d669223 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:50.055868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46dd34-6829-4f22-af9d-c5e71d669223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:50.057498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46dd34-6829-4f22-af9d-c5e71d669223 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:50.073240 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3887/7776] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:57:50.076036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46dd34-6829-4f22-af9d-c5e71d669223 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:50.090179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46dd34-6829-4f22-af9d-c5e71d669223 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:50.097640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239f80d-6f71-4e97-a6bf-209026195a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:50.098455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239f80d-6f71-4e97-a6bf-209026195a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:50.098803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239f80d-6f71-4e97-a6bf-209026195a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:50.099163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239f80d-6f71-4e97-a6bf-209026195a48 admin admin] PATH_INFO: `/v3/projects/95314166fe5f49e583b72cc99f79c9d0/users/6dcaedfc64874c1480b2573073897460/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:50.115847 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3890/7777] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:57:49 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:57:50.120316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c76e18-a39d-4bd5-bea4-b671f5503134 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:50.124366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239f80d-6f71-4e97-a6bf-209026195a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95314166fe5f49e583b72cc99f79c9d0, user_id=6dcaedfc64874c1480b2573073897460, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:50.127376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239f80d-6f71-4e97-a6bf-209026195a48 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:50.129046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:50.187572 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3888/7778] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:57:50 2022] PUT /identity/v3/projects/95314166fe5f49e583b72cc99f79c9d0/users/6dcaedfc64874c1480b2573073897460/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:57:50.201368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20855d87-fbd7-4700-bb97-91b304e7ddba None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:50.202074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20855d87-fbd7-4700-bb97-91b304e7ddba None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:50.202533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20855d87-fbd7-4700-bb97-91b304e7ddba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:50.278815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c76e18-a39d-4bd5-bea4-b671f5503134 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:50.285322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-20855d87-fbd7-4700-bb97-91b304e7ddba None None] MFA Rules not processed for user `6dcaedfc64874c1480b2573073897460`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:57:50.287516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-20855d87-fbd7-4700-bb97-91b304e7ddba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:50.356929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:50.365906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01c403-1f27-4942-89e1-a6f7e042756c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:50.368990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01c403-1f27-4942-89e1-a6f7e042756c admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:50.368990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01c403-1f27-4942-89e1-a6f7e042756c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:50.368990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01c403-1f27-4942-89e1-a6f7e042756c admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:50.368990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01c403-1f27-4942-89e1-a6f7e042756c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:50.371386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01c403-1f27-4942-89e1-a6f7e042756c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:50.382207 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3889/7779] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:57:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:57:50.395184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20855d87-fbd7-4700-bb97-91b304e7ddba None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:50.397958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-20855d87-fbd7-4700-bb97-91b304e7ddba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:50.466086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20855d87-fbd7-4700-bb97-91b304e7ddba None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:50.470980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79742d7f-34d3-42e3-8081-b17038ca1a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:50.471610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79742d7f-34d3-42e3-8081-b17038ca1a47 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:50.471900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79742d7f-34d3-42e3-8081-b17038ca1a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:50.472173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79742d7f-34d3-42e3-8081-b17038ca1a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:50.477842 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3891/7780] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:57:50 2022] POST /identity/v3/users => generated 298 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:57:50.478895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01c403-1f27-4942-89e1-a6f7e042756c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:50.482810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79742d7f-34d3-42e3-8081-b17038ca1a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:50.484964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79742d7f-34d3-42e3-8081-b17038ca1a47 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:50.491501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01c403-1f27-4942-89e1-a6f7e042756c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:50.496137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2cb04-d391-4b1e-9055-c7ad12154db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:50.496748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2cb04-d391-4b1e-9055-c7ad12154db4 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:50.497832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2cb04-d391-4b1e-9055-c7ad12154db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:50.498359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2cb04-d391-4b1e-9055-c7ad12154db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:50.499018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2cb04-d391-4b1e-9055-c7ad12154db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:50.501484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2cb04-d391-4b1e-9055-c7ad12154db4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:50.512684 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3890/7781] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:57:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:57:50.516989 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3892/7782] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:57:50.517979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79742d7f-34d3-42e3-8081-b17038ca1a47 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:50.530388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79742d7f-34d3-42e3-8081-b17038ca1a47 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:50.536548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223c17d-2bd6-401a-abb2-489b03f6efa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:50.538852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223c17d-2bd6-401a-abb2-489b03f6efa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:50.539236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223c17d-2bd6-401a-abb2-489b03f6efa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:50.539585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223c17d-2bd6-401a-abb2-489b03f6efa5 admin admin] PATH_INFO: `/v3/projects/f97f3f27032442a69226e22024db43bf/users/ddb9b47a1aaf4b2f8b09f3f66d756698/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:50.556680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223c17d-2bd6-401a-abb2-489b03f6efa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f97f3f27032442a69226e22024db43bf, user_id=ddb9b47a1aaf4b2f8b09f3f66d756698, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:50.559509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223c17d-2bd6-401a-abb2-489b03f6efa5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:50.626239 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3891/7783] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:57:50 2022] PUT /identity/v3/projects/f97f3f27032442a69226e22024db43bf/users/ddb9b47a1aaf4b2f8b09f3f66d756698/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:57:50.629594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2cb04-d391-4b1e-9055-c7ad12154db4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:50.661304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2cb04-d391-4b1e-9055-c7ad12154db4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:50.731680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361397b-d64b-4089-b7cd-9987801a26af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:50.732628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361397b-d64b-4089-b7cd-9987801a26af admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:50.732914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361397b-d64b-4089-b7cd-9987801a26af admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:50.733193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361397b-d64b-4089-b7cd-9987801a26af admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:50.733878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361397b-d64b-4089-b7cd-9987801a26af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:50.736176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361397b-d64b-4089-b7cd-9987801a26af admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:50.760319 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3893/7784] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:57:50.761029 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223c17d-2bd6-401a-abb2-489b03f6efa5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:50.769421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223c17d-2bd6-401a-abb2-489b03f6efa5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:50.782919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde65e48-ed1f-407c-abe0-97154ac63c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:50.783645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde65e48-ed1f-407c-abe0-97154ac63c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:50.783983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde65e48-ed1f-407c-abe0-97154ac63c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:50.784261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde65e48-ed1f-407c-abe0-97154ac63c04 admin admin] PATH_INFO: `/v3/projects/f97f3f27032442a69226e22024db43bf/users/ddb9b47a1aaf4b2f8b09f3f66d756698/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:50.794248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde65e48-ed1f-407c-abe0-97154ac63c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f97f3f27032442a69226e22024db43bf, user_id=ddb9b47a1aaf4b2f8b09f3f66d756698, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:50.796039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde65e48-ed1f-407c-abe0-97154ac63c04 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:50.867167 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3892/7785] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:57:50 2022] PUT /identity/v3/projects/f97f3f27032442a69226e22024db43bf/users/ddb9b47a1aaf4b2f8b09f3f66d756698/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:57:50.869863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c694d-895d-4c0e-8148-8a3367ba58e0 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:50.870454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c694d-895d-4c0e-8148-8a3367ba58e0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:50.870953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c694d-895d-4c0e-8148-8a3367ba58e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:50.925769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ff4c694d-895d-4c0e-8148-8a3367ba58e0 None None] MFA Rules not processed for user `ddb9b47a1aaf4b2f8b09f3f66d756698`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:57:50.927639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ff4c694d-895d-4c0e-8148-8a3367ba58e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:50.940756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:51.032522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde65e48-ed1f-407c-abe0-97154ac63c04 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:51.033038 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3894/7786] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:57:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:57:51.035375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fde65e48-ed1f-407c-abe0-97154ac63c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:51.153932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde65e48-ed1f-407c-abe0-97154ac63c04 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:51.158812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59511118-61ef-4142-be8a-df417b1d07da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:51.159455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59511118-61ef-4142-be8a-df417b1d07da service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:51.159738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59511118-61ef-4142-be8a-df417b1d07da service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:51.160014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59511118-61ef-4142-be8a-df417b1d07da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:51.186654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59511118-61ef-4142-be8a-df417b1d07da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:51.188908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59511118-61ef-4142-be8a-df417b1d07da service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:51.213311 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3893/7787] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:57:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:57:51.427809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c694d-895d-4c0e-8148-8a3367ba58e0 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:51.441752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c694d-895d-4c0e-8148-8a3367ba58e0 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:51.445802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7f7cf-ffc9-4e4d-a28a-f350cd9a3cd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:51.449542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7f7cf-ffc9-4e4d-a28a-f350cd9a3cd7 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:51.449542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7f7cf-ffc9-4e4d-a28a-f350cd9a3cd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:51.449542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7f7cf-ffc9-4e4d-a28a-f350cd9a3cd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:51.526101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7f7cf-ffc9-4e4d-a28a-f350cd9a3cd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:51.527557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7f7cf-ffc9-4e4d-a28a-f350cd9a3cd7 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:51.537452 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3895/7788] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:57:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:57:52.044107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59511118-61ef-4142-be8a-df417b1d07da service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:52.139366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:52.143836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59511118-61ef-4142-be8a-df417b1d07da service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:52.149707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f57bcf-f7f7-4df3-8e64-78bdcd121edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:52.150397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f57bcf-f7f7-4df3-8e64-78bdcd121edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:52.150684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f57bcf-f7f7-4df3-8e64-78bdcd121edf admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:52.150965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f57bcf-f7f7-4df3-8e64-78bdcd121edf admin admin] PATH_INFO: `/v3/users/678bf336be0c435387a28c26d813d3f8` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:52.161909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f57bcf-f7f7-4df3-8e64-78bdcd121edf admin admin] RBAC: Authorizing `identity:delete_user(user_id=678bf336be0c435387a28c26d813d3f8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:52.168233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f57bcf-f7f7-4df3-8e64-78bdcd121edf admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:52.407696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-44f57bcf-f7f7-4df3-8e64-78bdcd121edf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '678bf336be0c435387a28c26d813d3f8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:52.409918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-44f57bcf-f7f7-4df3-8e64-78bdcd121edf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '678bf336be0c435387a28c26d813d3f8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:52.424622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-44f57bcf-f7f7-4df3-8e64-78bdcd121edf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '678bf336be0c435387a28c26d813d3f8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:52.451691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-44f57bcf-f7f7-4df3-8e64-78bdcd121edf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '678bf336be0c435387a28c26d813d3f8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:52.565328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-44f57bcf-f7f7-4df3-8e64-78bdcd121edf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '678bf336be0c435387a28c26d813d3f8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:52.594933 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3894/7789] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:57:52 2022] DELETE /identity/v3/users/678bf336be0c435387a28c26d813d3f8 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:57:52.598140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346b2a0-b877-4659-bff1-d760553b0f85 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:52.598140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346b2a0-b877-4659-bff1-d760553b0f85 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:52.598140 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346b2a0-b877-4659-bff1-d760553b0f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:52.634784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c346b2a0-b877-4659-bff1-d760553b0f85 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:57:52.636771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c346b2a0-b877-4659-bff1-d760553b0f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:52.741247 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3896/7790] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:57:52.752942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f57bcf-f7f7-4df3-8e64-78bdcd121edf admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:52.755869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-44f57bcf-f7f7-4df3-8e64-78bdcd121edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:52.888364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f57bcf-f7f7-4df3-8e64-78bdcd121edf admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:52.888364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927fe64-e879-4dfc-81bc-b8b15857f677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:52.888364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927fe64-e879-4dfc-81bc-b8b15857f677 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:52.888364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927fe64-e879-4dfc-81bc-b8b15857f677 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:52.888911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927fe64-e879-4dfc-81bc-b8b15857f677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:52.894462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927fe64-e879-4dfc-81bc-b8b15857f677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:52.895941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927fe64-e879-4dfc-81bc-b8b15857f677 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:52.911910 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3895/7791] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:57:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:57:53.598990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346b2a0-b877-4659-bff1-d760553b0f85 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:53.600619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c346b2a0-b877-4659-bff1-d760553b0f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:53.618491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346b2a0-b877-4659-bff1-d760553b0f85 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:53.647696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8dccb4-c1d9-4a80-8b74-a05b86a4cfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:53.649009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dccb4-c1d9-4a80-8b74-a05b86a4cfb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:53.649312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dccb4-c1d9-4a80-8b74-a05b86a4cfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:53.649595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dccb4-c1d9-4a80-8b74-a05b86a4cfb4 admin admin] PATH_INFO: `/v3/projects/59958b4caacc41d89d846512c56dffe3` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:53.658930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8dccb4-c1d9-4a80-8b74-a05b86a4cfb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59958b4caacc41d89d846512c56dffe3)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:53.668157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8dccb4-c1d9-4a80-8b74-a05b86a4cfb4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:53.808156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:53.812200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ce8dccb4-c1d9-4a80-8b74-a05b86a4cfb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59958b4caacc41d89d846512c56dffe3', 'request_id': 'req-ce8dccb4-c1d9-4a80-8b74-a05b86a4cfb4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:53.819683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ce8dccb4-c1d9-4a80-8b74-a05b86a4cfb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59958b4caacc41d89d846512c56dffe3', 'request_id': 'req-ce8dccb4-c1d9-4a80-8b74-a05b86a4cfb4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:53.825577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ce8dccb4-c1d9-4a80-8b74-a05b86a4cfb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59958b4caacc41d89d846512c56dffe3', 'request_id': 'req-ce8dccb4-c1d9-4a80-8b74-a05b86a4cfb4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:53.902795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ce8dccb4-c1d9-4a80-8b74-a05b86a4cfb4 admin admin] The token cache is being invalidate because project 59958b4caacc41d89d846512c56dffe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:57:53.903170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ce8dccb4-c1d9-4a80-8b74-a05b86a4cfb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:53.903803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ce8dccb4-c1d9-4a80-8b74-a05b86a4cfb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:53.905396 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3897/7792] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:57:53 2022] DELETE /identity/v3/projects/59958b4caacc41d89d846512c56dffe3 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:57:53.911254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927fe64-e879-4dfc-81bc-b8b15857f677 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:53.922259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927fe64-e879-4dfc-81bc-b8b15857f677 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:54.010817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab66f0-5b9d-4cf8-a988-c28cb4809846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:54.011777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab66f0-5b9d-4cf8-a988-c28cb4809846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:54.012237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab66f0-5b9d-4cf8-a988-c28cb4809846 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:54.012725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab66f0-5b9d-4cf8-a988-c28cb4809846 admin admin] PATH_INFO: `/v3/users/ddb9b47a1aaf4b2f8b09f3f66d756698` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:54.014421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab66f0-5b9d-4cf8-a988-c28cb4809846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddb9b47a1aaf4b2f8b09f3f66d756698)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:54.019150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab66f0-5b9d-4cf8-a988-c28cb4809846 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:54.045261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:54.217301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-91ab66f0-5b9d-4cf8-a988-c28cb4809846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddb9b47a1aaf4b2f8b09f3f66d756698'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:54.218509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-91ab66f0-5b9d-4cf8-a988-c28cb4809846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddb9b47a1aaf4b2f8b09f3f66d756698'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:54.228720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-91ab66f0-5b9d-4cf8-a988-c28cb4809846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddb9b47a1aaf4b2f8b09f3f66d756698'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:54.246066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-91ab66f0-5b9d-4cf8-a988-c28cb4809846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddb9b47a1aaf4b2f8b09f3f66d756698'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:54.318069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-91ab66f0-5b9d-4cf8-a988-c28cb4809846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddb9b47a1aaf4b2f8b09f3f66d756698'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:54.328805 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3896/7793] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:57:53 2022] DELETE /identity/v3/users/ddb9b47a1aaf4b2f8b09f3f66d756698 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:57:55.285085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8dccb4-c1d9-4a80-8b74-a05b86a4cfb4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:55.287550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ce8dccb4-c1d9-4a80-8b74-a05b86a4cfb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:55.327771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8dccb4-c1d9-4a80-8b74-a05b86a4cfb4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:55.422003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6d1cd-2a49-4246-bea9-b41bb57a0c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:55.422868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6d1cd-2a49-4246-bea9-b41bb57a0c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:55.423228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6d1cd-2a49-4246-bea9-b41bb57a0c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:55.423579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6d1cd-2a49-4246-bea9-b41bb57a0c02 admin admin] PATH_INFO: `/v3/projects/f97f3f27032442a69226e22024db43bf` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:55.424817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6d1cd-2a49-4246-bea9-b41bb57a0c02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f97f3f27032442a69226e22024db43bf)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:55.426883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6d1cd-2a49-4246-bea9-b41bb57a0c02 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:55.638881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0cc6d1cd-2a49-4246-bea9-b41bb57a0c02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f97f3f27032442a69226e22024db43bf', 'request_id': 'req-0cc6d1cd-2a49-4246-bea9-b41bb57a0c02'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:55.638881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0cc6d1cd-2a49-4246-bea9-b41bb57a0c02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f97f3f27032442a69226e22024db43bf', 'request_id': 'req-0cc6d1cd-2a49-4246-bea9-b41bb57a0c02'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:55.654130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0cc6d1cd-2a49-4246-bea9-b41bb57a0c02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f97f3f27032442a69226e22024db43bf', 'request_id': 'req-0cc6d1cd-2a49-4246-bea9-b41bb57a0c02'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:55.765987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0cc6d1cd-2a49-4246-bea9-b41bb57a0c02 admin admin] The token cache is being invalidate because project f97f3f27032442a69226e22024db43bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:57:55.767464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0cc6d1cd-2a49-4246-bea9-b41bb57a0c02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:55.768352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0cc6d1cd-2a49-4246-bea9-b41bb57a0c02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:55.770245 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3898/7794] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:57:55 2022] DELETE /identity/v3/projects/f97f3f27032442a69226e22024db43bf => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:57:55.775630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a81b5-4622-46d2-9090-036421253d9f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:55.776148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a81b5-4622-46d2-9090-036421253d9f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:55.776416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a81b5-4622-46d2-9090-036421253d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:55.798478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d48a81b5-4622-46d2-9090-036421253d9f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:57:55.799930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d48a81b5-4622-46d2-9090-036421253d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:55.872591 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3897/7795] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:57:55.882016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cba9a-b3d1-4816-94bd-9d7382f954dc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:55.883823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cba9a-b3d1-4816-94bd-9d7382f954dc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:55.883823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cba9a-b3d1-4816-94bd-9d7382f954dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:55.909684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a81b5-4622-46d2-9090-036421253d9f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:55.911443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d48a81b5-4622-46d2-9090-036421253d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:55.946681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b47cba9a-b3d1-4816-94bd-9d7382f954dc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:57:55.946681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b47cba9a-b3d1-4816-94bd-9d7382f954dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:55.972500 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3899/7796] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:57:55.986170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cba9a-b3d1-4816-94bd-9d7382f954dc None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:56.004037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cba9a-b3d1-4816-94bd-9d7382f954dc None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:56.012609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c476907-c22f-49a5-9bfa-48c44b59075c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:56.013845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c476907-c22f-49a5-9bfa-48c44b59075c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:56.014305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c476907-c22f-49a5-9bfa-48c44b59075c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:56.015966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c476907-c22f-49a5-9bfa-48c44b59075c admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:56.017595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c476907-c22f-49a5-9bfa-48c44b59075c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:57:56.018205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c476907-c22f-49a5-9bfa-48c44b59075c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:56.020747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c476907-c22f-49a5-9bfa-48c44b59075c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:56.042251 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3900/7797] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:57:56.044002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c476907-c22f-49a5-9bfa-48c44b59075c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:56.045234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a81b5-4622-46d2-9090-036421253d9f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:56.052260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d725623-e9fb-482f-b5f7-a495cb3cdd84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:56.053257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d725623-e9fb-482f-b5f7-a495cb3cdd84 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:56.053590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d725623-e9fb-482f-b5f7-a495cb3cdd84 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:56.053872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d725623-e9fb-482f-b5f7-a495cb3cdd84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:56.056145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8d725623-e9fb-482f-b5f7-a495cb3cdd84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:56.065965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c476907-c22f-49a5-9bfa-48c44b59075c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:56.071548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e0d73-2e08-44b7-a196-c067c3cfcfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:56.072613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e0d73-2e08-44b7-a196-c067c3cfcfae admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:56.073113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e0d73-2e08-44b7-a196-c067c3cfcfae admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:56.073584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e0d73-2e08-44b7-a196-c067c3cfcfae admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:56.074439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e0d73-2e08-44b7-a196-c067c3cfcfae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:56.076571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e0d73-2e08-44b7-a196-c067c3cfcfae admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:56.113944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d725623-e9fb-482f-b5f7-a495cb3cdd84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:56.116059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d725623-e9fb-482f-b5f7-a495cb3cdd84 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:56.130863 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3898/7798] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:57:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:57:56.216093 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3901/7799] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:57:56 2022] POST /identity/v3/projects => generated 361 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:57:56.220858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d725623-e9fb-482f-b5f7-a495cb3cdd84 service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:56.232067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d725623-e9fb-482f-b5f7-a495cb3cdd84 service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:56.260009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:56.358440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c00c3-216f-4c38-ae4b-869926133783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:56.359383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c00c3-216f-4c38-ae4b-869926133783 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:56.361000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c00c3-216f-4c38-ae4b-869926133783 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:56.367898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c00c3-216f-4c38-ae4b-869926133783 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:56.368580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c00c3-216f-4c38-ae4b-869926133783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:56.375483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c00c3-216f-4c38-ae4b-869926133783 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:56.492302 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3899/7800] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:57:56 2022] POST /identity/v3/users => generated 281 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:57:56.495869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e0d73-2e08-44b7-a196-c067c3cfcfae admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:56.508196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e0d73-2e08-44b7-a196-c067c3cfcfae admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:56.513417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0aa60-adbc-41f8-8ef0-ca4d35eb2f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:56.514025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0aa60-adbc-41f8-8ef0-ca4d35eb2f57 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:56.514650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0aa60-adbc-41f8-8ef0-ca4d35eb2f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:56.515636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0aa60-adbc-41f8-8ef0-ca4d35eb2f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:56.515786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0aa60-adbc-41f8-8ef0-ca4d35eb2f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:56.517564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0aa60-adbc-41f8-8ef0-ca4d35eb2f57 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:56.530800 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3902/7801] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:57:56.540212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c00c3-216f-4c38-ae4b-869926133783 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:56.553441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c00c3-216f-4c38-ae4b-869926133783 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:56.558597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37df4b-7ce2-448a-bc86-b3e65a6cd72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:56.559249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37df4b-7ce2-448a-bc86-b3e65a6cd72a admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:56.559546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37df4b-7ce2-448a-bc86-b3e65a6cd72a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:56.559815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37df4b-7ce2-448a-bc86-b3e65a6cd72a admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:56.560535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37df4b-7ce2-448a-bc86-b3e65a6cd72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:56.562143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37df4b-7ce2-448a-bc86-b3e65a6cd72a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:56.573078 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3900/7802] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:57:56.577319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0aa60-adbc-41f8-8ef0-ca4d35eb2f57 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:56.588061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0aa60-adbc-41f8-8ef0-ca4d35eb2f57 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:56.593199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48698d7-e8b3-4880-9495-b7a0406e9256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:56.593918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48698d7-e8b3-4880-9495-b7a0406e9256 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:56.594785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48698d7-e8b3-4880-9495-b7a0406e9256 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:56.595042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48698d7-e8b3-4880-9495-b7a0406e9256 admin admin] PATH_INFO: `/v3/projects/fad4ae9c99a0434092937084962e8b9a/users/00a9a5ff23f44cd29fffed3c3d54d7d8/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:56.598910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:56.613051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48698d7-e8b3-4880-9495-b7a0406e9256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad4ae9c99a0434092937084962e8b9a, user_id=00a9a5ff23f44cd29fffed3c3d54d7d8, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:56.615998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48698d7-e8b3-4880-9495-b7a0406e9256 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:56.693348 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3903/7803] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:57:56 2022] PUT /identity/v3/projects/fad4ae9c99a0434092937084962e8b9a/users/00a9a5ff23f44cd29fffed3c3d54d7d8/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:57:56.695575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd784b3-0c8c-4c55-8005-8218e4edf570 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:56.695863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd784b3-0c8c-4c55-8005-8218e4edf570 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:56.696865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd784b3-0c8c-4c55-8005-8218e4edf570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:56.769286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-acd784b3-0c8c-4c55-8005-8218e4edf570 None None] MFA Rules not processed for user `00a9a5ff23f44cd29fffed3c3d54d7d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:57:56.770624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-acd784b3-0c8c-4c55-8005-8218e4edf570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:56.857931 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3901/7804] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:57:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:57:56.894310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48698d7-e8b3-4880-9495-b7a0406e9256 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:56.895998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d48698d7-e8b3-4880-9495-b7a0406e9256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:56.979969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48698d7-e8b3-4880-9495-b7a0406e9256 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:56.986583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195285d1-7b46-4971-868d-ce45ee3322be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:56.987222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195285d1-7b46-4971-868d-ce45ee3322be service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:56.987791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195285d1-7b46-4971-868d-ce45ee3322be service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:56.990921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195285d1-7b46-4971-868d-ce45ee3322be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:57.001015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195285d1-7b46-4971-868d-ce45ee3322be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:57.002566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195285d1-7b46-4971-868d-ce45ee3322be service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:57.017337 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3904/7805] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:57:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:57:57.034340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd784b3-0c8c-4c55-8005-8218e4edf570 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:57.139920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd784b3-0c8c-4c55-8005-8218e4edf570 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:57.146511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109d935-8cd9-43e0-897a-18ba304d608f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:57.151324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109d935-8cd9-43e0-897a-18ba304d608f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:57.151324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109d935-8cd9-43e0-897a-18ba304d608f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:57.151324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109d935-8cd9-43e0-897a-18ba304d608f admin admin] PATH_INFO: `/v3/users/00a9a5ff23f44cd29fffed3c3d54d7d8` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:57.151324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109d935-8cd9-43e0-897a-18ba304d608f admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a9a5ff23f44cd29fffed3c3d54d7d8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:57.152590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109d935-8cd9-43e0-897a-18ba304d608f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:57.335735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:57.345453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0109d935-8cd9-43e0-897a-18ba304d608f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a9a5ff23f44cd29fffed3c3d54d7d8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:57.346095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0109d935-8cd9-43e0-897a-18ba304d608f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a9a5ff23f44cd29fffed3c3d54d7d8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:57.353807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0109d935-8cd9-43e0-897a-18ba304d608f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a9a5ff23f44cd29fffed3c3d54d7d8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:57.368552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0109d935-8cd9-43e0-897a-18ba304d608f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a9a5ff23f44cd29fffed3c3d54d7d8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:57.444259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0109d935-8cd9-43e0-897a-18ba304d608f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a9a5ff23f44cd29fffed3c3d54d7d8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:57.482908 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3902/7806] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:57:57 2022] DELETE /identity/v3/users/00a9a5ff23f44cd29fffed3c3d54d7d8 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:57:57.488562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbdcc3-a8f8-4ea0-9da9-1f022be5ba45 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:57.488851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbdcc3-a8f8-4ea0-9da9-1f022be5ba45 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:57.490507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbdcc3-a8f8-4ea0-9da9-1f022be5ba45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:57.517843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-16fbdcc3-a8f8-4ea0-9da9-1f022be5ba45 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:57:57.519349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-16fbdcc3-a8f8-4ea0-9da9-1f022be5ba45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:57.599919 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3905/7807] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:57:57.612383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109d935-8cd9-43e0-897a-18ba304d608f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:57.614456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0109d935-8cd9-43e0-897a-18ba304d608f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:57.720531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109d935-8cd9-43e0-897a-18ba304d608f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:57.726515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121d80c-6757-47cf-a670-940ba4906c54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:57.727611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121d80c-6757-47cf-a670-940ba4906c54 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:57.728190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121d80c-6757-47cf-a670-940ba4906c54 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:57.728478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121d80c-6757-47cf-a670-940ba4906c54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:57.750353 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121d80c-6757-47cf-a670-940ba4906c54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:57.752543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121d80c-6757-47cf-a670-940ba4906c54 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:57.774885 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3903/7808] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:57:57.989283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbdcc3-a8f8-4ea0-9da9-1f022be5ba45 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:57.990896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-16fbdcc3-a8f8-4ea0-9da9-1f022be5ba45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:58.163424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbdcc3-a8f8-4ea0-9da9-1f022be5ba45 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:58.171631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699d002-f32b-4a42-be23-32fad18665fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:58.173113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699d002-f32b-4a42-be23-32fad18665fd service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:58.173499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699d002-f32b-4a42-be23-32fad18665fd service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:58.174631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699d002-f32b-4a42-be23-32fad18665fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:58.177592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c699d002-f32b-4a42-be23-32fad18665fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:58.232797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:58.286288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699d002-f32b-4a42-be23-32fad18665fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:58.288348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699d002-f32b-4a42-be23-32fad18665fd service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:58.301790 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3906/7809] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:57:57 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:57:58.338764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121d80c-6757-47cf-a670-940ba4906c54 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:58.340302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4121d80c-6757-47cf-a670-940ba4906c54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:58.357614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121d80c-6757-47cf-a670-940ba4906c54 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:58.376261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7649ef-0c48-424a-9569-895f608f6909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:58.377153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7649ef-0c48-424a-9569-895f608f6909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:58.377512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7649ef-0c48-424a-9569-895f608f6909 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:58.377866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7649ef-0c48-424a-9569-895f608f6909 admin admin] PATH_INFO: `/v3/projects/fad4ae9c99a0434092937084962e8b9a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:58.379465 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7649ef-0c48-424a-9569-895f608f6909 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad4ae9c99a0434092937084962e8b9a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:58.381541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7649ef-0c48-424a-9569-895f608f6909 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:58.565153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7d7649ef-0c48-424a-9569-895f608f6909 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad4ae9c99a0434092937084962e8b9a', 'request_id': 'req-7d7649ef-0c48-424a-9569-895f608f6909'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:58.637456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7d7649ef-0c48-424a-9569-895f608f6909 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad4ae9c99a0434092937084962e8b9a', 'request_id': 'req-7d7649ef-0c48-424a-9569-895f608f6909'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:58.647130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7d7649ef-0c48-424a-9569-895f608f6909 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad4ae9c99a0434092937084962e8b9a', 'request_id': 'req-7d7649ef-0c48-424a-9569-895f608f6909'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:58.668107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7d7649ef-0c48-424a-9569-895f608f6909 admin admin] The token cache is being invalidate because project fad4ae9c99a0434092937084962e8b9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:57:58.670197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7d7649ef-0c48-424a-9569-895f608f6909 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:58.673328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7d7649ef-0c48-424a-9569-895f608f6909 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:57:58.675454 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3904/7810] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:57:58 2022] DELETE /identity/v3/projects/fad4ae9c99a0434092937084962e8b9a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:57:58.681279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7a202-e941-409e-b06f-a348fb3924a1 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:58.682947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7a202-e941-409e-b06f-a348fb3924a1 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:58.683374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7a202-e941-409e-b06f-a348fb3924a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:58.726506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-31a7a202-e941-409e-b06f-a348fb3924a1 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:57:58.728428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-31a7a202-e941-409e-b06f-a348fb3924a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:58.850399 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3907/7811] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:57:58.864652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b9786-2473-4e1d-a939-b88cb1c109c8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:58.864652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b9786-2473-4e1d-a939-b88cb1c109c8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:58.864804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b9786-2473-4e1d-a939-b88cb1c109c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:58.899688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-930b9786-2473-4e1d-a939-b88cb1c109c8 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:57:58.914181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-930b9786-2473-4e1d-a939-b88cb1c109c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:58.924999 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3905/7812] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:57:58.929958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7a202-e941-409e-b06f-a348fb3924a1 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:58.951569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7a202-e941-409e-b06f-a348fb3924a1 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:58.965840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eeca15-c27b-4381-be75-a05e9c040e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:58.967270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eeca15-c27b-4381-be75-a05e9c040e68 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:58.967545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eeca15-c27b-4381-be75-a05e9c040e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:58.967824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eeca15-c27b-4381-be75-a05e9c040e68 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:58.968531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eeca15-c27b-4381-be75-a05e9c040e68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:57:58.969767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eeca15-c27b-4381-be75-a05e9c040e68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:58.971799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eeca15-c27b-4381-be75-a05e9c040e68 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:58.993109 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3908/7813] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:57:58.996993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b9786-2473-4e1d-a939-b88cb1c109c8 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:59.022151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b9786-2473-4e1d-a939-b88cb1c109c8 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:59.030080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c197ec-180c-4dbc-9b67-38859253b208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:59.030080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c197ec-180c-4dbc-9b67-38859253b208 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:59.030080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c197ec-180c-4dbc-9b67-38859253b208 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:59.030080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c197ec-180c-4dbc-9b67-38859253b208 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:59.030548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c197ec-180c-4dbc-9b67-38859253b208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:59.030548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c197ec-180c-4dbc-9b67-38859253b208 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:59.206954 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3906/7814] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:57:58 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:57:59.211281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eeca15-c27b-4381-be75-a05e9c040e68 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:59.239503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eeca15-c27b-4381-be75-a05e9c040e68 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:59.335266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b198c2-2f53-4858-a8a9-19bc3a8c71dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:59.336102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b198c2-2f53-4858-a8a9-19bc3a8c71dc admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:59.336391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b198c2-2f53-4858-a8a9-19bc3a8c71dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:59.336668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b198c2-2f53-4858-a8a9-19bc3a8c71dc admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:59.337631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b198c2-2f53-4858-a8a9-19bc3a8c71dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:59.340107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b198c2-2f53-4858-a8a9-19bc3a8c71dc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:59.431155 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3909/7815] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:57:59 2022] POST /identity/v3/users => generated 292 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:57:59.436172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c197ec-180c-4dbc-9b67-38859253b208 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:59.458614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c197ec-180c-4dbc-9b67-38859253b208 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:59.469143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70378a-5740-4049-adf4-d2c26993add4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:59.469903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70378a-5740-4049-adf4-d2c26993add4 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:59.470433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70378a-5740-4049-adf4-d2c26993add4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:59.471438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70378a-5740-4049-adf4-d2c26993add4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:59.472299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70378a-5740-4049-adf4-d2c26993add4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:59.474166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70378a-5740-4049-adf4-d2c26993add4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:59.487239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:59.493965 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3907/7816] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:57:59.497592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b198c2-2f53-4858-a8a9-19bc3a8c71dc admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:59.508790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b198c2-2f53-4858-a8a9-19bc3a8c71dc admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:59.514327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a325624-c20a-4646-b251-822550d78e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:59.514945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a325624-c20a-4646-b251-822550d78e2b admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:59.515233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a325624-c20a-4646-b251-822550d78e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:59.515575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a325624-c20a-4646-b251-822550d78e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:59.516799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a325624-c20a-4646-b251-822550d78e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:59.518005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a325624-c20a-4646-b251-822550d78e2b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:59.531626 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3910/7817] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:57:59.536087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70378a-5740-4049-adf4-d2c26993add4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:57:59.549730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70378a-5740-4049-adf4-d2c26993add4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:57:59.555279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9212c-668d-484c-91a1-fb281eee55c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:57:59.555965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9212c-668d-484c-91a1-fb281eee55c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:59.556248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9212c-668d-484c-91a1-fb281eee55c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:59.556526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9212c-668d-484c-91a1-fb281eee55c4 admin admin] PATH_INFO: `/v3/projects/377c90e6b6b6440a9ebef8fa9768d5ee/users/6b6d8d516c5f475dad6000fa710a0d1e/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:59.573396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9212c-668d-484c-91a1-fb281eee55c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=377c90e6b6b6440a9ebef8fa9768d5ee, user_id=6b6d8d516c5f475dad6000fa710a0d1e, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:57:59.576137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9212c-668d-484c-91a1-fb281eee55c4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:57:59.657700 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3908/7818] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:57:59 2022] PUT /identity/v3/projects/377c90e6b6b6440a9ebef8fa9768d5ee/users/6b6d8d516c5f475dad6000fa710a0d1e/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:57:59.669344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55430626-ec69-4796-a274-28d4c52b39b2 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:57:59.670435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55430626-ec69-4796-a274-28d4c52b39b2 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:57:59.671163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55430626-ec69-4796-a274-28d4c52b39b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:57:59.760990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-55430626-ec69-4796-a274-28d4c52b39b2 None None] MFA Rules not processed for user `6b6d8d516c5f475dad6000fa710a0d1e`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:57:59.763599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-55430626-ec69-4796-a274-28d4c52b39b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:57:59.817568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:00.017716 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3911/7819] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:57:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:00.026212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9212c-668d-484c-91a1-fb281eee55c4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:00.031336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-85e9212c-668d-484c-91a1-fb281eee55c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:00.174057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9212c-668d-484c-91a1-fb281eee55c4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:00.179448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca983441-bc1c-43a4-a2c2-bb076f7bcd4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:00.180096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca983441-bc1c-43a4-a2c2-bb076f7bcd4e service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:00.180385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca983441-bc1c-43a4-a2c2-bb076f7bcd4e service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:00.180669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca983441-bc1c-43a4-a2c2-bb076f7bcd4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:00.192003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca983441-bc1c-43a4-a2c2-bb076f7bcd4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:00.194092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca983441-bc1c-43a4-a2c2-bb076f7bcd4e service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:00.207138 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3909/7820] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:58:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:58:01.045367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55430626-ec69-4796-a274-28d4c52b39b2 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:01.048061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-55430626-ec69-4796-a274-28d4c52b39b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:01.226089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55430626-ec69-4796-a274-28d4c52b39b2 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:01.247521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc2da0-2d24-4b2c-ab0f-1988d94d1220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:01.248589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc2da0-2d24-4b2c-ab0f-1988d94d1220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:01.252226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc2da0-2d24-4b2c-ab0f-1988d94d1220 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:01.254231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc2da0-2d24-4b2c-ab0f-1988d94d1220 admin admin] PATH_INFO: `/v3/users/323c30f244f24b0897ec0631a33d91e0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:01.255577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc2da0-2d24-4b2c-ab0f-1988d94d1220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=323c30f244f24b0897ec0631a33d91e0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:01.259719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc2da0-2d24-4b2c-ab0f-1988d94d1220 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:01.524621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9fcc2da0-2d24-4b2c-ab0f-1988d94d1220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '323c30f244f24b0897ec0631a33d91e0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:01.525368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9fcc2da0-2d24-4b2c-ab0f-1988d94d1220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '323c30f244f24b0897ec0631a33d91e0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:01.539172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9fcc2da0-2d24-4b2c-ab0f-1988d94d1220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '323c30f244f24b0897ec0631a33d91e0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:01.570902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9fcc2da0-2d24-4b2c-ab0f-1988d94d1220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '323c30f244f24b0897ec0631a33d91e0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:01.571714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9fcc2da0-2d24-4b2c-ab0f-1988d94d1220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '323c30f244f24b0897ec0631a33d91e0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:01.669622 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3912/7821] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:58:01 2022] DELETE /identity/v3/users/323c30f244f24b0897ec0631a33d91e0 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:58:02.184662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca983441-bc1c-43a4-a2c2-bb076f7bcd4e service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:02.215893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca983441-bc1c-43a4-a2c2-bb076f7bcd4e service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:02.417981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd718e5-17b9-4fe5-8f17-fa228984df23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:02.418691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd718e5-17b9-4fe5-8f17-fa228984df23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:02.418976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd718e5-17b9-4fe5-8f17-fa228984df23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:02.419255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd718e5-17b9-4fe5-8f17-fa228984df23 admin admin] PATH_INFO: `/v3/projects/57b587e152514b0f99c5e14e842d6ffc` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:02.430856 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd718e5-17b9-4fe5-8f17-fa228984df23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57b587e152514b0f99c5e14e842d6ffc)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:02.432754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd718e5-17b9-4fe5-8f17-fa228984df23 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:02.586148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1bd718e5-17b9-4fe5-8f17-fa228984df23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57b587e152514b0f99c5e14e842d6ffc', 'request_id': 'req-1bd718e5-17b9-4fe5-8f17-fa228984df23'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:02.637200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1bd718e5-17b9-4fe5-8f17-fa228984df23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57b587e152514b0f99c5e14e842d6ffc', 'request_id': 'req-1bd718e5-17b9-4fe5-8f17-fa228984df23'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:02.646177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1bd718e5-17b9-4fe5-8f17-fa228984df23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57b587e152514b0f99c5e14e842d6ffc', 'request_id': 'req-1bd718e5-17b9-4fe5-8f17-fa228984df23'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:02.664336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1bd718e5-17b9-4fe5-8f17-fa228984df23 admin admin] The token cache is being invalidate because project 57b587e152514b0f99c5e14e842d6ffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:58:02.665264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1bd718e5-17b9-4fe5-8f17-fa228984df23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:02.666152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1bd718e5-17b9-4fe5-8f17-fa228984df23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:02.667847 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3910/7822] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:58:02 2022] DELETE /identity/v3/projects/57b587e152514b0f99c5e14e842d6ffc => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:58:02.672306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc2da0-2d24-4b2c-ab0f-1988d94d1220 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:02.674967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9fcc2da0-2d24-4b2c-ab0f-1988d94d1220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:02.692788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc2da0-2d24-4b2c-ab0f-1988d94d1220 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:02.741723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:02.768911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe7456-8d59-4ab3-b6e7-e236159c1729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:02.770211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe7456-8d59-4ab3-b6e7-e236159c1729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:02.770673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe7456-8d59-4ab3-b6e7-e236159c1729 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:02.771005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe7456-8d59-4ab3-b6e7-e236159c1729 admin admin] PATH_INFO: `/v3/users/0e8254a6994140eab28675f5cf48d181` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:02.772230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe7456-8d59-4ab3-b6e7-e236159c1729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e8254a6994140eab28675f5cf48d181)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:02.775192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe7456-8d59-4ab3-b6e7-e236159c1729 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:03.027276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-aefe7456-8d59-4ab3-b6e7-e236159c1729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e8254a6994140eab28675f5cf48d181'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:03.027276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-aefe7456-8d59-4ab3-b6e7-e236159c1729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e8254a6994140eab28675f5cf48d181'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:03.035440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-aefe7456-8d59-4ab3-b6e7-e236159c1729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e8254a6994140eab28675f5cf48d181'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:03.051906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-aefe7456-8d59-4ab3-b6e7-e236159c1729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e8254a6994140eab28675f5cf48d181'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:03.053054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-aefe7456-8d59-4ab3-b6e7-e236159c1729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e8254a6994140eab28675f5cf48d181'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:03.135243 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3913/7823] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:58:02 2022] DELETE /identity/v3/users/0e8254a6994140eab28675f5cf48d181 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:58:03.379405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd718e5-17b9-4fe5-8f17-fa228984df23 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:03.381792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1bd718e5-17b9-4fe5-8f17-fa228984df23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:03.407448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd718e5-17b9-4fe5-8f17-fa228984df23 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:03.413873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:03.538523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd6e48-9a55-411e-b9a1-4ccbf48387d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:03.542352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd6e48-9a55-411e-b9a1-4ccbf48387d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:03.543195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd6e48-9a55-411e-b9a1-4ccbf48387d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:03.543690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd6e48-9a55-411e-b9a1-4ccbf48387d9 admin admin] PATH_INFO: `/v3/projects/3fad3f9fb09b4c06a2af2ec35b31cd7a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:03.545963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd6e48-9a55-411e-b9a1-4ccbf48387d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fad3f9fb09b4c06a2af2ec35b31cd7a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:03.549057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd6e48-9a55-411e-b9a1-4ccbf48387d9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:03.720468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2cdd6e48-9a55-411e-b9a1-4ccbf48387d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fad3f9fb09b4c06a2af2ec35b31cd7a', 'request_id': 'req-2cdd6e48-9a55-411e-b9a1-4ccbf48387d9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:03.794806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2cdd6e48-9a55-411e-b9a1-4ccbf48387d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fad3f9fb09b4c06a2af2ec35b31cd7a', 'request_id': 'req-2cdd6e48-9a55-411e-b9a1-4ccbf48387d9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:03.834948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2cdd6e48-9a55-411e-b9a1-4ccbf48387d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fad3f9fb09b4c06a2af2ec35b31cd7a', 'request_id': 'req-2cdd6e48-9a55-411e-b9a1-4ccbf48387d9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:03.881564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2cdd6e48-9a55-411e-b9a1-4ccbf48387d9 admin admin] The token cache is being invalidate because project 3fad3f9fb09b4c06a2af2ec35b31cd7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:58:03.881877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2cdd6e48-9a55-411e-b9a1-4ccbf48387d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:03.886504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2cdd6e48-9a55-411e-b9a1-4ccbf48387d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:03.886504 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3911/7824] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:58:03 2022] DELETE /identity/v3/projects/3fad3f9fb09b4c06a2af2ec35b31cd7a => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:58:03.889583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c04a0f-b767-4aeb-b168-5579c6394fca None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:03.890060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c04a0f-b767-4aeb-b168-5579c6394fca None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:03.890172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c04a0f-b767-4aeb-b168-5579c6394fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:03.920626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-05c04a0f-b767-4aeb-b168-5579c6394fca None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:03.923845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-05c04a0f-b767-4aeb-b168-5579c6394fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:04.066468 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3914/7825] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:04.069260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bcb78-6e38-4919-9f4d-3bc8d47be612 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:04.069832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bcb78-6e38-4919-9f4d-3bc8d47be612 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:04.070408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bcb78-6e38-4919-9f4d-3bc8d47be612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:04.095243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-621bcb78-6e38-4919-9f4d-3bc8d47be612 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:04.098108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-621bcb78-6e38-4919-9f4d-3bc8d47be612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:04.114647 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3912/7826] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:04.115010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c04a0f-b767-4aeb-b168-5579c6394fca None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:04.129925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c04a0f-b767-4aeb-b168-5579c6394fca None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:04.134856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7544a2-49c2-4ea8-8778-8d15b3c758ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:04.135391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7544a2-49c2-4ea8-8778-8d15b3c758ba admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:04.135705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7544a2-49c2-4ea8-8778-8d15b3c758ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:04.135986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7544a2-49c2-4ea8-8778-8d15b3c758ba admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:04.136714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7544a2-49c2-4ea8-8778-8d15b3c758ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:58:04.137025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7544a2-49c2-4ea8-8778-8d15b3c758ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:04.138678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7544a2-49c2-4ea8-8778-8d15b3c758ba admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:04.152573 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3915/7827] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:58:04.157918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bcb78-6e38-4919-9f4d-3bc8d47be612 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:04.168355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bcb78-6e38-4919-9f4d-3bc8d47be612 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:04.175746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394da37-cb5a-4009-8ab0-e1a488e48054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:04.176383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394da37-cb5a-4009-8ab0-e1a488e48054 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:04.176821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394da37-cb5a-4009-8ab0-e1a488e48054 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:04.177214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394da37-cb5a-4009-8ab0-e1a488e48054 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:04.178324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394da37-cb5a-4009-8ab0-e1a488e48054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:04.201078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394da37-cb5a-4009-8ab0-e1a488e48054 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:04.374712 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3913/7828] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:58:04 2022] POST /identity/v3/projects => generated 373 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:58:04.376437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7544a2-49c2-4ea8-8778-8d15b3c758ba admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:04.390208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7544a2-49c2-4ea8-8778-8d15b3c758ba admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:04.446146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:04.465974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab847f4e-7c4c-4eba-b115-64cf0db1cafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:04.467554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab847f4e-7c4c-4eba-b115-64cf0db1cafe admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:04.468179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab847f4e-7c4c-4eba-b115-64cf0db1cafe admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:04.468899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab847f4e-7c4c-4eba-b115-64cf0db1cafe admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:04.470531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab847f4e-7c4c-4eba-b115-64cf0db1cafe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:04.472959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab847f4e-7c4c-4eba-b115-64cf0db1cafe admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:04.573558 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3916/7829] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:58:04 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:58:04.574053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394da37-cb5a-4009-8ab0-e1a488e48054 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:04.598783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394da37-cb5a-4009-8ab0-e1a488e48054 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:04.614573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35a2f7-f102-46cd-a8bc-9e1a328f21ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:04.615123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35a2f7-f102-46cd-a8bc-9e1a328f21ca admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:04.615412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35a2f7-f102-46cd-a8bc-9e1a328f21ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:04.617007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35a2f7-f102-46cd-a8bc-9e1a328f21ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:04.617718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35a2f7-f102-46cd-a8bc-9e1a328f21ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:04.619477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35a2f7-f102-46cd-a8bc-9e1a328f21ca admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:04.640687 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3914/7830] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:58:04.645971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab847f4e-7c4c-4eba-b115-64cf0db1cafe admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:04.656830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab847f4e-7c4c-4eba-b115-64cf0db1cafe admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:04.663305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacaef5-e7cb-4794-bb13-bdda9d9a40fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:04.664015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacaef5-e7cb-4794-bb13-bdda9d9a40fa admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:04.664346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacaef5-e7cb-4794-bb13-bdda9d9a40fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:04.664582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacaef5-e7cb-4794-bb13-bdda9d9a40fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:04.665272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacaef5-e7cb-4794-bb13-bdda9d9a40fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:04.668076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacaef5-e7cb-4794-bb13-bdda9d9a40fa admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:04.685349 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3917/7831] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:58:04.686663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35a2f7-f102-46cd-a8bc-9e1a328f21ca admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:04.703696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35a2f7-f102-46cd-a8bc-9e1a328f21ca admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:04.723543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f168b7-eba7-40a3-8cc3-f2873de0f2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:04.726673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f168b7-eba7-40a3-8cc3-f2873de0f2e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:04.727174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f168b7-eba7-40a3-8cc3-f2873de0f2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:04.727633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f168b7-eba7-40a3-8cc3-f2873de0f2e7 admin admin] PATH_INFO: `/v3/projects/7d6b688b57fe47029ad9fae09ae8212e/users/52677263789a4ca8a64657b82f4a9fb5/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:04.759600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f168b7-eba7-40a3-8cc3-f2873de0f2e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d6b688b57fe47029ad9fae09ae8212e, user_id=52677263789a4ca8a64657b82f4a9fb5, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:04.762798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f168b7-eba7-40a3-8cc3-f2873de0f2e7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:04.856369 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3915/7832] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:58:04 2022] PUT /identity/v3/projects/7d6b688b57fe47029ad9fae09ae8212e/users/52677263789a4ca8a64657b82f4a9fb5/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:58:04.863118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ee23b-5e4c-45e9-946d-649da0fdf4e0 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:04.863419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ee23b-5e4c-45e9-946d-649da0fdf4e0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:04.863702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ee23b-5e4c-45e9-946d-649da0fdf4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:04.906657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f168b7-eba7-40a3-8cc3-f2873de0f2e7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:04.909346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f6f168b7-eba7-40a3-8cc3-f2873de0f2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:04.917294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b76ee23b-5e4c-45e9-946d-649da0fdf4e0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:04.920114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b76ee23b-5e4c-45e9-946d-649da0fdf4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:05.014878 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3918/7833] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:05.032547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:05.042573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ee23b-5e4c-45e9-946d-649da0fdf4e0 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:05.043762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b76ee23b-5e4c-45e9-946d-649da0fdf4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:05.114175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f168b7-eba7-40a3-8cc3-f2873de0f2e7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:05.129513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca29c6-98ee-4865-8c23-431847a9d1f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:05.130463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca29c6-98ee-4865-8c23-431847a9d1f2 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:05.130894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca29c6-98ee-4865-8c23-431847a9d1f2 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:05.131476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca29c6-98ee-4865-8c23-431847a9d1f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:05.133564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-60ca29c6-98ee-4865-8c23-431847a9d1f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:05.234368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ee23b-5e4c-45e9-946d-649da0fdf4e0 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:05.249032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b4585-8b0d-4012-8dac-92d5dc5cbd13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:05.249679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b4585-8b0d-4012-8dac-92d5dc5cbd13 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:05.250085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b4585-8b0d-4012-8dac-92d5dc5cbd13 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:05.250379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b4585-8b0d-4012-8dac-92d5dc5cbd13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:05.272955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b4585-8b0d-4012-8dac-92d5dc5cbd13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:05.274556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b4585-8b0d-4012-8dac-92d5dc5cbd13 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:05.301275 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3919/7834] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:58:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:58:05.305583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca29c6-98ee-4865-8c23-431847a9d1f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:05.307543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca29c6-98ee-4865-8c23-431847a9d1f2 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:05.323238 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3916/7835] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:58:04 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:58:08.389358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b4585-8b0d-4012-8dac-92d5dc5cbd13 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:08.390900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9a0b4585-8b0d-4012-8dac-92d5dc5cbd13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:08.417207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b4585-8b0d-4012-8dac-92d5dc5cbd13 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:08.431328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae54358-c54a-4f7e-96dd-04db50a1f622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:08.432557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae54358-c54a-4f7e-96dd-04db50a1f622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:08.432842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae54358-c54a-4f7e-96dd-04db50a1f622 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:08.433278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae54358-c54a-4f7e-96dd-04db50a1f622 admin admin] PATH_INFO: `/v3/users/6b6d8d516c5f475dad6000fa710a0d1e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:08.435860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae54358-c54a-4f7e-96dd-04db50a1f622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6d8d516c5f475dad6000fa710a0d1e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:08.437884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae54358-c54a-4f7e-96dd-04db50a1f622 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:08.638676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ae54358-c54a-4f7e-96dd-04db50a1f622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6d8d516c5f475dad6000fa710a0d1e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:08.642640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ae54358-c54a-4f7e-96dd-04db50a1f622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6d8d516c5f475dad6000fa710a0d1e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:08.659475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ae54358-c54a-4f7e-96dd-04db50a1f622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6d8d516c5f475dad6000fa710a0d1e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:08.672486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:08.688044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ae54358-c54a-4f7e-96dd-04db50a1f622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6d8d516c5f475dad6000fa710a0d1e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:08.690571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7ae54358-c54a-4f7e-96dd-04db50a1f622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6d8d516c5f475dad6000fa710a0d1e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:08.827050 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3920/7836] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:58:08 2022] DELETE /identity/v3/users/6b6d8d516c5f475dad6000fa710a0d1e => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:58:08.828529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd9b6c-be80-4f40-9289-b7e1e743d1cf None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:08.829025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd9b6c-be80-4f40-9289-b7e1e743d1cf None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:08.829871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd9b6c-be80-4f40-9289-b7e1e743d1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:08.870538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-89bd9b6c-be80-4f40-9289-b7e1e743d1cf None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:08.872164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-89bd9b6c-be80-4f40-9289-b7e1e743d1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:09.059888 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3917/7837] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:09.069376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae54358-c54a-4f7e-96dd-04db50a1f622 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:09.071342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7ae54358-c54a-4f7e-96dd-04db50a1f622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:09.093313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae54358-c54a-4f7e-96dd-04db50a1f622 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:09.110958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08ad35-8272-4067-bd55-6ce5b3dde0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:09.111496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08ad35-8272-4067-bd55-6ce5b3dde0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:09.111879 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08ad35-8272-4067-bd55-6ce5b3dde0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:09.112800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08ad35-8272-4067-bd55-6ce5b3dde0ce admin admin] PATH_INFO: `/v3/users/bd550aaeb0454a95a29b0bb575092d85` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:09.122654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08ad35-8272-4067-bd55-6ce5b3dde0ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd550aaeb0454a95a29b0bb575092d85)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:09.125040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08ad35-8272-4067-bd55-6ce5b3dde0ce admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:09.159428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd9b6c-be80-4f40-9289-b7e1e743d1cf None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:09.162113 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-89bd9b6c-be80-4f40-9289-b7e1e743d1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:09.370774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd9b6c-be80-4f40-9289-b7e1e743d1cf None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:09.379543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1795f42-a07a-4db7-a059-df69be903a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:09.387770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1795f42-a07a-4db7-a059-df69be903a77 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:09.387770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1795f42-a07a-4db7-a059-df69be903a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:09.387770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1795f42-a07a-4db7-a059-df69be903a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:09.404152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1795f42-a07a-4db7-a059-df69be903a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:09.425080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1795f42-a07a-4db7-a059-df69be903a77 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:09.451065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9e08ad35-8272-4067-bd55-6ce5b3dde0ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd550aaeb0454a95a29b0bb575092d85'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:09.453685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9e08ad35-8272-4067-bd55-6ce5b3dde0ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd550aaeb0454a95a29b0bb575092d85'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:09.474664 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3918/7838] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:58:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:58:09.484755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9e08ad35-8272-4067-bd55-6ce5b3dde0ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd550aaeb0454a95a29b0bb575092d85'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:09.523394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9e08ad35-8272-4067-bd55-6ce5b3dde0ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd550aaeb0454a95a29b0bb575092d85'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:09.530211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9e08ad35-8272-4067-bd55-6ce5b3dde0ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd550aaeb0454a95a29b0bb575092d85'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:09.645177 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3921/7839] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:58:09 2022] DELETE /identity/v3/users/bd550aaeb0454a95a29b0bb575092d85 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:58:10.619278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1795f42-a07a-4db7-a059-df69be903a77 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:10.621520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e1795f42-a07a-4db7-a059-df69be903a77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:10.649773 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1795f42-a07a-4db7-a059-df69be903a77 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:10.681135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:10.806633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2fd87-8c11-49ad-85fc-b662584d62da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:10.807365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2fd87-8c11-49ad-85fc-b662584d62da service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:10.807737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2fd87-8c11-49ad-85fc-b662584d62da service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:10.808126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2fd87-8c11-49ad-85fc-b662584d62da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:10.812371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7fc2fd87-8c11-49ad-85fc-b662584d62da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:10.843092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2fd87-8c11-49ad-85fc-b662584d62da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:10.844751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2fd87-8c11-49ad-85fc-b662584d62da service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:10.884062 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3919/7840] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:58:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:58:11.172908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08ad35-8272-4067-bd55-6ce5b3dde0ce admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:11.174883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9e08ad35-8272-4067-bd55-6ce5b3dde0ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:11.380917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08ad35-8272-4067-bd55-6ce5b3dde0ce admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:11.391352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c434e5-1d42-4ba7-ae8b-10836958284f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:11.392451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c434e5-1d42-4ba7-ae8b-10836958284f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:11.392908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c434e5-1d42-4ba7-ae8b-10836958284f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:11.394885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c434e5-1d42-4ba7-ae8b-10836958284f admin admin] PATH_INFO: `/v3/projects/4f2348420e184649abcd3b2cf05c5fff` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:11.396383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c434e5-1d42-4ba7-ae8b-10836958284f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f2348420e184649abcd3b2cf05c5fff)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:11.399570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c434e5-1d42-4ba7-ae8b-10836958284f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:11.535504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2fd87-8c11-49ad-85fc-b662584d62da service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:11.537630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7fc2fd87-8c11-49ad-85fc-b662584d62da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:11.560483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2fd87-8c11-49ad-85fc-b662584d62da service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:11.573832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec07dea-31f4-411e-a551-48c0490652b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:11.574739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec07dea-31f4-411e-a551-48c0490652b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:11.575173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec07dea-31f4-411e-a551-48c0490652b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:11.575646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec07dea-31f4-411e-a551-48c0490652b2 admin admin] PATH_INFO: `/v3/projects/377c90e6b6b6440a9ebef8fa9768d5ee` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:11.577120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec07dea-31f4-411e-a551-48c0490652b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=377c90e6b6b6440a9ebef8fa9768d5ee)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:11.580486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec07dea-31f4-411e-a551-48c0490652b2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:11.665843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-36c434e5-1d42-4ba7-ae8b-10836958284f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f2348420e184649abcd3b2cf05c5fff', 'request_id': 'req-36c434e5-1d42-4ba7-ae8b-10836958284f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:11.683682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-36c434e5-1d42-4ba7-ae8b-10836958284f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f2348420e184649abcd3b2cf05c5fff', 'request_id': 'req-36c434e5-1d42-4ba7-ae8b-10836958284f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:11.686142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:11.726127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-36c434e5-1d42-4ba7-ae8b-10836958284f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f2348420e184649abcd3b2cf05c5fff', 'request_id': 'req-36c434e5-1d42-4ba7-ae8b-10836958284f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:11.767519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5ec07dea-31f4-411e-a551-48c0490652b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '377c90e6b6b6440a9ebef8fa9768d5ee', 'request_id': 'req-5ec07dea-31f4-411e-a551-48c0490652b2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:11.840318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-36c434e5-1d42-4ba7-ae8b-10836958284f admin admin] The token cache is being invalidate because project 4f2348420e184649abcd3b2cf05c5fff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:58:11.840964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-36c434e5-1d42-4ba7-ae8b-10836958284f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:11.841771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-36c434e5-1d42-4ba7-ae8b-10836958284f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:11.847515 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3922/7841] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:58:11 2022] DELETE /identity/v3/projects/4f2348420e184649abcd3b2cf05c5fff => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:58:11.853282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c434e5-1d42-4ba7-ae8b-10836958284f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:11.855595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-36c434e5-1d42-4ba7-ae8b-10836958284f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:11.914631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5ec07dea-31f4-411e-a551-48c0490652b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '377c90e6b6b6440a9ebef8fa9768d5ee', 'request_id': 'req-5ec07dea-31f4-411e-a551-48c0490652b2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:11.927851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5ec07dea-31f4-411e-a551-48c0490652b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '377c90e6b6b6440a9ebef8fa9768d5ee', 'request_id': 'req-5ec07dea-31f4-411e-a551-48c0490652b2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:11.953283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5ec07dea-31f4-411e-a551-48c0490652b2 admin admin] The token cache is being invalidate because project 377c90e6b6b6440a9ebef8fa9768d5ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:58:11.956251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5ec07dea-31f4-411e-a551-48c0490652b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:11.957314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5ec07dea-31f4-411e-a551-48c0490652b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:11.963045 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3920/7842] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:58:11 2022] DELETE /identity/v3/projects/377c90e6b6b6440a9ebef8fa9768d5ee => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:58:11.968189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca8450-dc66-4f88-b98c-f5a6a3a6ce87 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:11.969425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca8450-dc66-4f88-b98c-f5a6a3a6ce87 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:11.969897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca8450-dc66-4f88-b98c-f5a6a3a6ce87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:12.006015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c434e5-1d42-4ba7-ae8b-10836958284f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:12.016438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-76ca8450-dc66-4f88-b98c-f5a6a3a6ce87 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:12.018294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-76ca8450-dc66-4f88-b98c-f5a6a3a6ce87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:12.118365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b46fc-1fb8-4493-bedf-487d7f1c676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:12.119540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b46fc-1fb8-4493-bedf-487d7f1c676d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:12.119540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b46fc-1fb8-4493-bedf-487d7f1c676d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:12.119756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b46fc-1fb8-4493-bedf-487d7f1c676d admin admin] PATH_INFO: `/v3/users/6ebb8a741ef34d469a5f3db8a8317f6d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:12.121562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b46fc-1fb8-4493-bedf-487d7f1c676d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ebb8a741ef34d469a5f3db8a8317f6d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:12.124120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b46fc-1fb8-4493-bedf-487d7f1c676d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:12.146341 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3921/7843] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:12.148870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28de0a-3f3f-4843-8444-081a3f480389 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:12.149844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28de0a-3f3f-4843-8444-081a3f480389 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:12.150348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28de0a-3f3f-4843-8444-081a3f480389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:12.185175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-7b28de0a-3f3f-4843-8444-081a3f480389 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:12.194791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7b28de0a-3f3f-4843-8444-081a3f480389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:12.206071 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3922/7844] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:12.211730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28de0a-3f3f-4843-8444-081a3f480389 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:12.225684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28de0a-3f3f-4843-8444-081a3f480389 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:12.232548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c14dba-5260-4db4-a9de-6d5e1a40e160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:12.232724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c14dba-5260-4db4-a9de-6d5e1a40e160 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:12.232986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c14dba-5260-4db4-a9de-6d5e1a40e160 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:12.233265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c14dba-5260-4db4-a9de-6d5e1a40e160 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:12.233927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c14dba-5260-4db4-a9de-6d5e1a40e160 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:58:12.234256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c14dba-5260-4db4-a9de-6d5e1a40e160 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:12.236449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c14dba-5260-4db4-a9de-6d5e1a40e160 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:12.254022 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3923/7845] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:58:12.254968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c14dba-5260-4db4-a9de-6d5e1a40e160 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:12.265824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c14dba-5260-4db4-a9de-6d5e1a40e160 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:12.270618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db306e-e4e7-4df0-87c0-2e204e2bed4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:12.271231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db306e-e4e7-4df0-87c0-2e204e2bed4b admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:12.276530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db306e-e4e7-4df0-87c0-2e204e2bed4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:12.276530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db306e-e4e7-4df0-87c0-2e204e2bed4b admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:12.276530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db306e-e4e7-4df0-87c0-2e204e2bed4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:12.276530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db306e-e4e7-4df0-87c0-2e204e2bed4b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:12.297091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:12.406060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a46b46fc-1fb8-4493-bedf-487d7f1c676d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ebb8a741ef34d469a5f3db8a8317f6d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:12.407959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a46b46fc-1fb8-4493-bedf-487d7f1c676d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ebb8a741ef34d469a5f3db8a8317f6d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:12.411267 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3924/7846] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:58:12 2022] POST /identity/v3/projects => generated 391 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:58:12.412056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db306e-e4e7-4df0-87c0-2e204e2bed4b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:12.415287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-94db306e-e4e7-4df0-87c0-2e204e2bed4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:12.422857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a46b46fc-1fb8-4493-bedf-487d7f1c676d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ebb8a741ef34d469a5f3db8a8317f6d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:12.442860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a46b46fc-1fb8-4493-bedf-487d7f1c676d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ebb8a741ef34d469a5f3db8a8317f6d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:12.443894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a46b46fc-1fb8-4493-bedf-487d7f1c676d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ebb8a741ef34d469a5f3db8a8317f6d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:12.545226 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3923/7847] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:58:11 2022] DELETE /identity/v3/users/6ebb8a741ef34d469a5f3db8a8317f6d => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:58:12.546425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db306e-e4e7-4df0-87c0-2e204e2bed4b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:12.633248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3f616-5828-4074-b72a-ec6e36c57f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:12.634490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3f616-5828-4074-b72a-ec6e36c57f8b admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:12.634887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3f616-5828-4074-b72a-ec6e36c57f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:12.635543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3f616-5828-4074-b72a-ec6e36c57f8b admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:12.637322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3f616-5828-4074-b72a-ec6e36c57f8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:12.639914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3f616-5828-4074-b72a-ec6e36c57f8b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:13.050906 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3925/7848] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:58:12 2022] POST /identity/v3/users => generated 296 bytes in 639 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:58:13.055376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b46fc-1fb8-4493-bedf-487d7f1c676d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:13.068432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b46fc-1fb8-4493-bedf-487d7f1c676d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:13.078548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a533d-2520-4f34-b157-da5dab76a6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:13.079259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a533d-2520-4f34-b157-da5dab76a6cd admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:13.079547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a533d-2520-4f34-b157-da5dab76a6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:13.079958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a533d-2520-4f34-b157-da5dab76a6cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:13.080768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a533d-2520-4f34-b157-da5dab76a6cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:13.083456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a533d-2520-4f34-b157-da5dab76a6cd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:13.085869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:13.101583 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3924/7849] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:58:13.109272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3f616-5828-4074-b72a-ec6e36c57f8b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:13.122115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3f616-5828-4074-b72a-ec6e36c57f8b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:13.127985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85c235-39ea-4547-9ff4-56f0ce99eaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:13.128722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85c235-39ea-4547-9ff4-56f0ce99eaac admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:13.129114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85c235-39ea-4547-9ff4-56f0ce99eaac admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:13.129488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85c235-39ea-4547-9ff4-56f0ce99eaac admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:13.130409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85c235-39ea-4547-9ff4-56f0ce99eaac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:13.132218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85c235-39ea-4547-9ff4-56f0ce99eaac admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:13.143754 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3926/7850] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:58:13.151566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a533d-2520-4f34-b157-da5dab76a6cd admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:13.158337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85c235-39ea-4547-9ff4-56f0ce99eaac admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:13.161750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cf85c235-39ea-4547-9ff4-56f0ce99eaac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:13.204841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a533d-2520-4f34-b157-da5dab76a6cd admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:13.217972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85c235-39ea-4547-9ff4-56f0ce99eaac admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:13.221000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2460adb-d553-473f-a99a-fc36d6b50a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:13.222595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2460adb-d553-473f-a99a-fc36d6b50a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:13.227068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2460adb-d553-473f-a99a-fc36d6b50a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:13.227068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2460adb-d553-473f-a99a-fc36d6b50a63 admin admin] PATH_INFO: `/v3/projects/b89e20ea2e6e4681ae14f4dbafd5a8b8/users/6829d42e8bac4df0bc8756f3128d9301/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:13.231447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42933674-32f6-4d42-bdd5-75ec3891f791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:13.232164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42933674-32f6-4d42-bdd5-75ec3891f791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:13.232456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42933674-32f6-4d42-bdd5-75ec3891f791 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:13.232833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42933674-32f6-4d42-bdd5-75ec3891f791 admin admin] PATH_INFO: `/v3/projects/6e1cc72c797d4296af0666ad091f1957` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:13.234261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42933674-32f6-4d42-bdd5-75ec3891f791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e1cc72c797d4296af0666ad091f1957)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:13.237237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42933674-32f6-4d42-bdd5-75ec3891f791 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:13.244618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2460adb-d553-473f-a99a-fc36d6b50a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b89e20ea2e6e4681ae14f4dbafd5a8b8, user_id=6829d42e8bac4df0bc8756f3128d9301, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:13.247648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2460adb-d553-473f-a99a-fc36d6b50a63 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:13.318872 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3925/7851] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:58:13 2022] PUT /identity/v3/projects/b89e20ea2e6e4681ae14f4dbafd5a8b8/users/6829d42e8bac4df0bc8756f3128d9301/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:58:13.336506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71825797-2e58-46ac-98fc-a9d6f07a3e10 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:13.336847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71825797-2e58-46ac-98fc-a9d6f07a3e10 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:13.337102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71825797-2e58-46ac-98fc-a9d6f07a3e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:13.409186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-71825797-2e58-46ac-98fc-a9d6f07a3e10 None None] MFA Rules not processed for user `6829d42e8bac4df0bc8756f3128d9301`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:13.411486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42933674-32f6-4d42-bdd5-75ec3891f791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e1cc72c797d4296af0666ad091f1957', 'request_id': 'req-42933674-32f6-4d42-bdd5-75ec3891f791'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:13.413037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-71825797-2e58-46ac-98fc-a9d6f07a3e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:13.495077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42933674-32f6-4d42-bdd5-75ec3891f791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e1cc72c797d4296af0666ad091f1957', 'request_id': 'req-42933674-32f6-4d42-bdd5-75ec3891f791'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:13.505287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42933674-32f6-4d42-bdd5-75ec3891f791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e1cc72c797d4296af0666ad091f1957', 'request_id': 'req-42933674-32f6-4d42-bdd5-75ec3891f791'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:13.521510 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3926/7852] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:13.532984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42933674-32f6-4d42-bdd5-75ec3891f791 admin admin] The token cache is being invalidate because project 6e1cc72c797d4296af0666ad091f1957 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:58:13.535464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42933674-32f6-4d42-bdd5-75ec3891f791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:13.535624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71825797-2e58-46ac-98fc-a9d6f07a3e10 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:13.537079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-71825797-2e58-46ac-98fc-a9d6f07a3e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:13.538184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42933674-32f6-4d42-bdd5-75ec3891f791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:13.541050 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3927/7853] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:58:13 2022] DELETE /identity/v3/projects/6e1cc72c797d4296af0666ad091f1957 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:58:13.559999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e08be-4cc8-4684-9eea-58230b4f2917 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:13.565813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e08be-4cc8-4684-9eea-58230b4f2917 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:13.566399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e08be-4cc8-4684-9eea-58230b4f2917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:13.624440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-666e08be-4cc8-4684-9eea-58230b4f2917 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:13.628435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-666e08be-4cc8-4684-9eea-58230b4f2917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:13.647566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:13.731323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71825797-2e58-46ac-98fc-a9d6f07a3e10 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:13.745995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20552d75-5690-4f15-ba2e-46da0901a097 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:13.745995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20552d75-5690-4f15-ba2e-46da0901a097 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:13.745995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20552d75-5690-4f15-ba2e-46da0901a097 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:13.745995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20552d75-5690-4f15-ba2e-46da0901a097 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:13.747764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-20552d75-5690-4f15-ba2e-46da0901a097 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:13.783818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20552d75-5690-4f15-ba2e-46da0901a097 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:13.786793 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3928/7854] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:13.787328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20552d75-5690-4f15-ba2e-46da0901a097 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:13.808705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d505d1-6be4-4749-a5d1-3165530a84e9 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:13.808995 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3927/7855] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:58:13 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:58:13.810780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d505d1-6be4-4749-a5d1-3165530a84e9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:13.811257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d505d1-6be4-4749-a5d1-3165530a84e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:13.845981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b5d505d1-6be4-4749-a5d1-3165530a84e9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:13.849573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b5d505d1-6be4-4749-a5d1-3165530a84e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:13.856377 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3929/7856] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:13.861835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20552d75-5690-4f15-ba2e-46da0901a097 service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:13.877505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20552d75-5690-4f15-ba2e-46da0901a097 service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:13.893081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ded084-a2df-4116-b92a-4f015b1ef443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:13.894004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ded084-a2df-4116-b92a-4f015b1ef443 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:13.896115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ded084-a2df-4116-b92a-4f015b1ef443 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:13.896115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ded084-a2df-4116-b92a-4f015b1ef443 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:13.897859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ded084-a2df-4116-b92a-4f015b1ef443 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:58:13.898213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ded084-a2df-4116-b92a-4f015b1ef443 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:13.902781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ded084-a2df-4116-b92a-4f015b1ef443 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:13.937304 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3928/7857] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:58:13.939621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d505d1-6be4-4749-a5d1-3165530a84e9 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:13.960778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d505d1-6be4-4749-a5d1-3165530a84e9 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:13.973094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e511d0-0d24-4802-863e-74eaf0e18f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:13.974386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e511d0-0d24-4802-863e-74eaf0e18f4e admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:13.974960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e511d0-0d24-4802-863e-74eaf0e18f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:13.976478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e511d0-0d24-4802-863e-74eaf0e18f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:13.978106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e511d0-0d24-4802-863e-74eaf0e18f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:13.981553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e511d0-0d24-4802-863e-74eaf0e18f4e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:14.156744 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3930/7858] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:58:13 2022] POST /identity/v3/projects => generated 383 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:58:14.159810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ded084-a2df-4116-b92a-4f015b1ef443 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:14.179375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ded084-a2df-4116-b92a-4f015b1ef443 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:14.296673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31fe90-519c-4437-890b-52004391601c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:14.299308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31fe90-519c-4437-890b-52004391601c admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:14.300861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31fe90-519c-4437-890b-52004391601c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:14.301508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31fe90-519c-4437-890b-52004391601c admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:14.304511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31fe90-519c-4437-890b-52004391601c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:14.310135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31fe90-519c-4437-890b-52004391601c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:14.387410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:14.451106 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3929/7859] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:58:14 2022] POST /identity/v3/users => generated 292 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:58:14.454805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e511d0-0d24-4802-863e-74eaf0e18f4e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:14.468699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e511d0-0d24-4802-863e-74eaf0e18f4e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:14.482374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716f6e3-31c1-4d4a-b586-6a56be8718c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:14.483106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716f6e3-31c1-4d4a-b586-6a56be8718c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:14.483463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716f6e3-31c1-4d4a-b586-6a56be8718c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:14.483823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716f6e3-31c1-4d4a-b586-6a56be8718c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:14.484577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716f6e3-31c1-4d4a-b586-6a56be8718c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:14.486854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716f6e3-31c1-4d4a-b586-6a56be8718c3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:14.515719 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3931/7860] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:58:14.516651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31fe90-519c-4437-890b-52004391601c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:14.542003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31fe90-519c-4437-890b-52004391601c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:14.557789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494283c6-9726-4958-abb7-1ede5b8d1f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:14.558202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494283c6-9726-4958-abb7-1ede5b8d1f32 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:14.558341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494283c6-9726-4958-abb7-1ede5b8d1f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:14.558605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494283c6-9726-4958-abb7-1ede5b8d1f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:14.559265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494283c6-9726-4958-abb7-1ede5b8d1f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:14.572919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494283c6-9726-4958-abb7-1ede5b8d1f32 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:14.592123 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3930/7861] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:58:14.595993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716f6e3-31c1-4d4a-b586-6a56be8718c3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:14.611461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716f6e3-31c1-4d4a-b586-6a56be8718c3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:14.623562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c906acc-0e6f-40ea-8645-e0f54ebb6a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:14.624257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c906acc-0e6f-40ea-8645-e0f54ebb6a68 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:14.624539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c906acc-0e6f-40ea-8645-e0f54ebb6a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:14.625044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c906acc-0e6f-40ea-8645-e0f54ebb6a68 admin admin] PATH_INFO: `/v3/projects/4ff33731a6fb4572bafc86c4ce72502f/users/5b238021bdb04baca1fbbb12c11e495f/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:14.678848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c906acc-0e6f-40ea-8645-e0f54ebb6a68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ff33731a6fb4572bafc86c4ce72502f, user_id=5b238021bdb04baca1fbbb12c11e495f, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:14.681724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c906acc-0e6f-40ea-8645-e0f54ebb6a68 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:14.833982 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3932/7862] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:58:14 2022] PUT /identity/v3/projects/4ff33731a6fb4572bafc86c4ce72502f/users/5b238021bdb04baca1fbbb12c11e495f/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:58:14.846547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7560ce1-6d47-42d8-b9b4-5b5d4d799111 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:14.846861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7560ce1-6d47-42d8-b9b4-5b5d4d799111 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:14.847137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7560ce1-6d47-42d8-b9b4-5b5d4d799111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:14.885185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a7560ce1-6d47-42d8-b9b4-5b5d4d799111 None None] MFA Rules not processed for user `5b238021bdb04baca1fbbb12c11e495f`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:14.886465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a7560ce1-6d47-42d8-b9b4-5b5d4d799111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:14.979887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c906acc-0e6f-40ea-8645-e0f54ebb6a68 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:14.984972 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3931/7863] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:15.150610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c906acc-0e6f-40ea-8645-e0f54ebb6a68 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:15.156899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb1e8e-7b2b-4084-bbea-c7d30ccc319d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:15.158451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb1e8e-7b2b-4084-bbea-c7d30ccc319d admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:15.158734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb1e8e-7b2b-4084-bbea-c7d30ccc319d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:15.159010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb1e8e-7b2b-4084-bbea-c7d30ccc319d admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:15.159701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb1e8e-7b2b-4084-bbea-c7d30ccc319d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:15.162948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb1e8e-7b2b-4084-bbea-c7d30ccc319d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:15.305865 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3933/7864] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:58:14 2022] POST /identity/v3/projects => generated 385 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:58:15.311575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7560ce1-6d47-42d8-b9b4-5b5d4d799111 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:15.333368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7560ce1-6d47-42d8-b9b4-5b5d4d799111 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:15.590790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0805b-679e-4494-89ee-989db6e166fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:15.591451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0805b-679e-4494-89ee-989db6e166fe admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:15.591733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0805b-679e-4494-89ee-989db6e166fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:15.592013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0805b-679e-4494-89ee-989db6e166fe admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:15.594899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0805b-679e-4494-89ee-989db6e166fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:15.605359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0805b-679e-4494-89ee-989db6e166fe admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:15.770870 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3932/7865] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:58:15 2022] POST /identity/v3/users => generated 299 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:58:15.771012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb1e8e-7b2b-4084-bbea-c7d30ccc319d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:15.782732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb1e8e-7b2b-4084-bbea-c7d30ccc319d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:15.807115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210b067-345c-42ba-b23d-eaeaa1170493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:15.807756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210b067-345c-42ba-b23d-eaeaa1170493 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:15.808052 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210b067-345c-42ba-b23d-eaeaa1170493 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:15.808324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210b067-345c-42ba-b23d-eaeaa1170493 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:15.808991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7210b067-345c-42ba-b23d-eaeaa1170493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:15.810744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7210b067-345c-42ba-b23d-eaeaa1170493 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:15.838111 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3934/7866] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:58:15.851026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0805b-679e-4494-89ee-989db6e166fe admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:15.872631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0805b-679e-4494-89ee-989db6e166fe admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:15.887821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6daa3-6727-48c3-8c3a-19dcd911fbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:15.887821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6daa3-6727-48c3-8c3a-19dcd911fbeb admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:15.888028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6daa3-6727-48c3-8c3a-19dcd911fbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:15.888397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6daa3-6727-48c3-8c3a-19dcd911fbeb admin admin] PATH_INFO: `/v3/projects/4e44c542969e4954b0c266d0f32db8c2/users/eb30fa2832194662b9bb3d5ad9ca5119/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:15.930786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd6daa3-6727-48c3-8c3a-19dcd911fbeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e44c542969e4954b0c266d0f32db8c2, user_id=eb30fa2832194662b9bb3d5ad9ca5119, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:15.933900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd6daa3-6727-48c3-8c3a-19dcd911fbeb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:16.041912 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3933/7867] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:58:15 2022] PUT /identity/v3/projects/4e44c542969e4954b0c266d0f32db8c2/users/eb30fa2832194662b9bb3d5ad9ca5119/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:58:16.044659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210b067-345c-42ba-b23d-eaeaa1170493 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:16.062967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210b067-345c-42ba-b23d-eaeaa1170493 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:16.098510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:16.218457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01df29-2dcb-46c0-bbed-a0d87ffa2ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:16.219861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01df29-2dcb-46c0-bbed-a0d87ffa2ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:16.220362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01df29-2dcb-46c0-bbed-a0d87ffa2ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:16.220843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01df29-2dcb-46c0-bbed-a0d87ffa2ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:16.222484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01df29-2dcb-46c0-bbed-a0d87ffa2ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:16.224360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01df29-2dcb-46c0-bbed-a0d87ffa2ae5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:16.241045 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3935/7868] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:58:16.242508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6daa3-6727-48c3-8c3a-19dcd911fbeb admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:16.256086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6daa3-6727-48c3-8c3a-19dcd911fbeb admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:16.273101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa4674-2a2c-43a7-9697-96d581007dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:16.274724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa4674-2a2c-43a7-9697-96d581007dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:16.277837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa4674-2a2c-43a7-9697-96d581007dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:16.278255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa4674-2a2c-43a7-9697-96d581007dbc admin admin] PATH_INFO: `/v3/projects/4e44c542969e4954b0c266d0f32db8c2/users/eb30fa2832194662b9bb3d5ad9ca5119/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:16.280990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa4674-2a2c-43a7-9697-96d581007dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e44c542969e4954b0c266d0f32db8c2, user_id=eb30fa2832194662b9bb3d5ad9ca5119, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:16.295596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa4674-2a2c-43a7-9697-96d581007dbc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:16.325552 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3934/7869] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:58:16 2022] PUT /identity/v3/projects/4e44c542969e4954b0c266d0f32db8c2/users/eb30fa2832194662b9bb3d5ad9ca5119/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:58:16.336649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba818a-0b7c-487d-b494-44268587d128 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:16.342319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba818a-0b7c-487d-b494-44268587d128 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:16.342319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba818a-0b7c-487d-b494-44268587d128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:16.372373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-65ba818a-0b7c-487d-b494-44268587d128 None None] MFA Rules not processed for user `eb30fa2832194662b9bb3d5ad9ca5119`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:16.373748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-65ba818a-0b7c-487d-b494-44268587d128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:16.555583 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3936/7870] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:16.560852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa4674-2a2c-43a7-9697-96d581007dbc admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:16.562741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-95fa4674-2a2c-43a7-9697-96d581007dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:16.612667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:16.758908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa4674-2a2c-43a7-9697-96d581007dbc admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:16.787416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee739d1-5078-4406-a84a-f47a3abeb379 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:16.789767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee739d1-5078-4406-a84a-f47a3abeb379 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:16.790340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee739d1-5078-4406-a84a-f47a3abeb379 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:16.790821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee739d1-5078-4406-a84a-f47a3abeb379 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:16.976463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee739d1-5078-4406-a84a-f47a3abeb379 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:16.979624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee739d1-5078-4406-a84a-f47a3abeb379 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:17.020722 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3935/7871] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:58:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:58:17.592637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab68b5-6ba7-47eb-9ed5-9e67e93bb79c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:17.593109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab68b5-6ba7-47eb-9ed5-9e67e93bb79c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:17.593191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab68b5-6ba7-47eb-9ed5-9e67e93bb79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:17.644123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-20ab68b5-6ba7-47eb-9ed5-9e67e93bb79c None None] MFA Rules not processed for user `52677263789a4ca8a64657b82f4a9fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:17.645397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-20ab68b5-6ba7-47eb-9ed5-9e67e93bb79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:17.910836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee739d1-5078-4406-a84a-f47a3abeb379 service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:17.914567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6ee739d1-5078-4406-a84a-f47a3abeb379 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:17.924921 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3937/7872] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:18.040487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee739d1-5078-4406-a84a-f47a3abeb379 service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:18.065269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b05f0-078a-4010-8290-e8ee2d7c9c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:18.066289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b05f0-078a-4010-8290-e8ee2d7c9c75 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:18.066723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b05f0-078a-4010-8290-e8ee2d7c9c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:18.067257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b05f0-078a-4010-8290-e8ee2d7c9c75 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:18.068166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b05f0-078a-4010-8290-e8ee2d7c9c75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:18.071460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b05f0-078a-4010-8290-e8ee2d7c9c75 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:18.236320 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3936/7873] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:58:17 2022] POST /identity/v3/projects => generated 375 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:58:18.247375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab68b5-6ba7-47eb-9ed5-9e67e93bb79c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:18.269717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab68b5-6ba7-47eb-9ed5-9e67e93bb79c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:18.353917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:18.503472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22094fe-45d3-4924-a93c-87de5653f032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:18.504916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22094fe-45d3-4924-a93c-87de5653f032 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:18.512334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22094fe-45d3-4924-a93c-87de5653f032 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:18.512334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22094fe-45d3-4924-a93c-87de5653f032 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:18.512334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22094fe-45d3-4924-a93c-87de5653f032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:18.514186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22094fe-45d3-4924-a93c-87de5653f032 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:18.629265 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3938/7874] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:58:18 2022] POST /identity/v3/users => generated 294 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:58:18.633639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b05f0-078a-4010-8290-e8ee2d7c9c75 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:18.653051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b05f0-078a-4010-8290-e8ee2d7c9c75 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:18.691424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf93a0-f633-456e-95ed-61c5082e69fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:18.692080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf93a0-f633-456e-95ed-61c5082e69fa admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:18.692368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf93a0-f633-456e-95ed-61c5082e69fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:18.692652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf93a0-f633-456e-95ed-61c5082e69fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:18.693326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf93a0-f633-456e-95ed-61c5082e69fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:18.695096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf93a0-f633-456e-95ed-61c5082e69fa admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:18.764527 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3937/7875] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:58:18.772771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22094fe-45d3-4924-a93c-87de5653f032 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:18.787869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22094fe-45d3-4924-a93c-87de5653f032 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:18.804498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfdb45-c34d-4200-ad0a-ea1a8bc180e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:18.814274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfdb45-c34d-4200-ad0a-ea1a8bc180e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:18.815189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfdb45-c34d-4200-ad0a-ea1a8bc180e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:18.815671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfdb45-c34d-4200-ad0a-ea1a8bc180e9 admin admin] PATH_INFO: `/v3/projects/57742c85c58c458495524da0b5f78f93/users/a1552fd790d342e29fa8deef441fbfc8/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:18.870499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfdb45-c34d-4200-ad0a-ea1a8bc180e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57742c85c58c458495524da0b5f78f93, user_id=a1552fd790d342e29fa8deef441fbfc8, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:18.880895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfdb45-c34d-4200-ad0a-ea1a8bc180e9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:19.023497 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3939/7876] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:58:18 2022] PUT /identity/v3/projects/57742c85c58c458495524da0b5f78f93/users/a1552fd790d342e29fa8deef441fbfc8/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:58:19.027020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf93a0-f633-456e-95ed-61c5082e69fa admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:19.043997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf93a0-f633-456e-95ed-61c5082e69fa admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:19.164212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:19.212850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3f8ec-59ed-4649-8223-d6c38458a451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:19.213612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3f8ec-59ed-4649-8223-d6c38458a451 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:19.213988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3f8ec-59ed-4649-8223-d6c38458a451 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:19.214285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3f8ec-59ed-4649-8223-d6c38458a451 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:19.216116 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3f8ec-59ed-4649-8223-d6c38458a451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:19.250175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3f8ec-59ed-4649-8223-d6c38458a451 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:19.312185 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3938/7877] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:58:19.312305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfdb45-c34d-4200-ad0a-ea1a8bc180e9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:19.337574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfdb45-c34d-4200-ad0a-ea1a8bc180e9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:19.347073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbc440-8935-41bf-9cc1-8a51eab42513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:19.347903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbc440-8935-41bf-9cc1-8a51eab42513 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:19.348265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbc440-8935-41bf-9cc1-8a51eab42513 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:19.348621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbc440-8935-41bf-9cc1-8a51eab42513 admin admin] PATH_INFO: `/v3/projects/57742c85c58c458495524da0b5f78f93/users/a1552fd790d342e29fa8deef441fbfc8/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:19.352380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbc440-8935-41bf-9cc1-8a51eab42513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57742c85c58c458495524da0b5f78f93, user_id=a1552fd790d342e29fa8deef441fbfc8, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:19.356743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbc440-8935-41bf-9cc1-8a51eab42513 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:19.379306 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3940/7878] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:58:19 2022] PUT /identity/v3/projects/57742c85c58c458495524da0b5f78f93/users/a1552fd790d342e29fa8deef441fbfc8/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:58:27.175962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3f8ec-59ed-4649-8223-d6c38458a451 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:27.182163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-71d3f8ec-59ed-4649-8223-d6c38458a451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:27.343509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3f8ec-59ed-4649-8223-d6c38458a451 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:27.433675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9b126-2e5c-40a8-85b5-eb985c8a0462 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:27.436685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9b126-2e5c-40a8-85b5-eb985c8a0462 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:27.437735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9b126-2e5c-40a8-85b5-eb985c8a0462 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:27.439989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9b126-2e5c-40a8-85b5-eb985c8a0462 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:27.653500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9b126-2e5c-40a8-85b5-eb985c8a0462 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:27.655404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9b126-2e5c-40a8-85b5-eb985c8a0462 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:27.683206 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3939/7879] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:58:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:58:29.380890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=32,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:30.791981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cb6c0-7815-4c11-83a0-4dbd547d3d10 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:30.792530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cb6c0-7815-4c11-83a0-4dbd547d3d10 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:30.792530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cb6c0-7815-4c11-83a0-4dbd547d3d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:30.877891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-239cb6c0-7815-4c11-83a0-4dbd547d3d10 None None] MFA Rules not processed for user `a1552fd790d342e29fa8deef441fbfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:30.883032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-239cb6c0-7815-4c11-83a0-4dbd547d3d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:31.085666 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3941/7880] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:58:31.097349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9b126-2e5c-40a8-85b5-eb985c8a0462 service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:31.098910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-aff9b126-2e5c-40a8-85b5-eb985c8a0462 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:31.218401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:31.316718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9b126-2e5c-40a8-85b5-eb985c8a0462 service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:31.340772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74043080-348d-438f-8b4f-6f481df4c26a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:31.343114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74043080-348d-438f-8b4f-6f481df4c26a service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:31.343763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74043080-348d-438f-8b4f-6f481df4c26a service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:31.344294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74043080-348d-438f-8b4f-6f481df4c26a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:31.473756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74043080-348d-438f-8b4f-6f481df4c26a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:31.483397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74043080-348d-438f-8b4f-6f481df4c26a service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:31.524786 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3940/7881] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:58:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:58:31.616607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a55a08-fb30-4d5d-a435-c11ccb2b4668 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:31.616607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a55a08-fb30-4d5d-a435-c11ccb2b4668 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:31.616607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a55a08-fb30-4d5d-a435-c11ccb2b4668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:31.677802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-47a55a08-fb30-4d5d-a435-c11ccb2b4668 None None] MFA Rules not processed for user `52677263789a4ca8a64657b82f4a9fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:31.683214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-47a55a08-fb30-4d5d-a435-c11ccb2b4668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:31.800704 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3942/7882] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:41.508295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=14 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:41.785196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=59 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:47.592294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727f311-f986-4843-aadd-4104ed08f6e4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:47.592801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727f311-f986-4843-aadd-4104ed08f6e4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:47.592905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727f311-f986-4843-aadd-4104ed08f6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:47.651127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4727f311-f986-4843-aadd-4104ed08f6e4 None None] MFA Rules not processed for user `a2ea55b400c24827a28e816ea2a225aa`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:47.658812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4727f311-f986-4843-aadd-4104ed08f6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:47.934698 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3941/7883] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:49.274971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a55a08-fb30-4d5d-a435-c11ccb2b4668 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:49.510573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727f311-f986-4843-aadd-4104ed08f6e4 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:49.512067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4727f311-f986-4843-aadd-4104ed08f6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:49.547402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a55a08-fb30-4d5d-a435-c11ccb2b4668 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:49.564345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86eab3-ab30-42af-863f-02b37c2a6b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:49.570525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86eab3-ab30-42af-863f-02b37c2a6b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:49.570943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86eab3-ab30-42af-863f-02b37c2a6b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:49.571525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86eab3-ab30-42af-863f-02b37c2a6b54 admin admin] PATH_INFO: `/v3/users/5b238021bdb04baca1fbbb12c11e495f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:49.576207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb86eab3-ab30-42af-863f-02b37c2a6b54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b238021bdb04baca1fbbb12c11e495f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:49.578328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb86eab3-ab30-42af-863f-02b37c2a6b54 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:49.771328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727f311-f986-4843-aadd-4104ed08f6e4 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:49.782002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faef2c-4322-48ce-b584-565c04923442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:49.786918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faef2c-4322-48ce-b584-565c04923442 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:49.792138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faef2c-4322-48ce-b584-565c04923442 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:49.792138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faef2c-4322-48ce-b584-565c04923442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:49.807437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-44faef2c-4322-48ce-b584-565c04923442 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:49.842087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44faef2c-4322-48ce-b584-565c04923442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:49.843592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44faef2c-4322-48ce-b584-565c04923442 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:49.871794 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3942/7884] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:58:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:58:49.884921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fb86eab3-ab30-42af-863f-02b37c2a6b54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b238021bdb04baca1fbbb12c11e495f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:49.889379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fb86eab3-ab30-42af-863f-02b37c2a6b54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b238021bdb04baca1fbbb12c11e495f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:49.928702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fb86eab3-ab30-42af-863f-02b37c2a6b54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b238021bdb04baca1fbbb12c11e495f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:49.995438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fb86eab3-ab30-42af-863f-02b37c2a6b54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b238021bdb04baca1fbbb12c11e495f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:50.090722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fb86eab3-ab30-42af-863f-02b37c2a6b54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b238021bdb04baca1fbbb12c11e495f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:50.099045 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3943/7885] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:58:49 2022] DELETE /identity/v3/users/5b238021bdb04baca1fbbb12c11e495f => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:58:50.103826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aeea8-d697-4f40-97e0-5932ccd2e89c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:50.106100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aeea8-d697-4f40-97e0-5932ccd2e89c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:50.106412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aeea8-d697-4f40-97e0-5932ccd2e89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:50.207667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-796aeea8-d697-4f40-97e0-5932ccd2e89c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:50.221240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-796aeea8-d697-4f40-97e0-5932ccd2e89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:50.488824 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3943/7886] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:50.496096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86eab3-ab30-42af-863f-02b37c2a6b54 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:50.497782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fb86eab3-ab30-42af-863f-02b37c2a6b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:50.669743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86eab3-ab30-42af-863f-02b37c2a6b54 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:50.674754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b8bdf-55fb-4ffd-93d6-e7446f416a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:50.675403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b8bdf-55fb-4ffd-93d6-e7446f416a52 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:50.675693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b8bdf-55fb-4ffd-93d6-e7446f416a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:50.675975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b8bdf-55fb-4ffd-93d6-e7446f416a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:50.693883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b8bdf-55fb-4ffd-93d6-e7446f416a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:50.695505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b8bdf-55fb-4ffd-93d6-e7446f416a52 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:50.709310 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3944/7887] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:58:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:58:51.833088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796aeea8-d697-4f40-97e0-5932ccd2e89c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:51.834319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-796aeea8-d697-4f40-97e0-5932ccd2e89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:51.872132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796aeea8-d697-4f40-97e0-5932ccd2e89c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:51.890535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeae0fa-c23a-48ef-a8ac-8d6e87e48ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:51.891205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeae0fa-c23a-48ef-a8ac-8d6e87e48ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:51.891491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeae0fa-c23a-48ef-a8ac-8d6e87e48ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:51.891771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeae0fa-c23a-48ef-a8ac-8d6e87e48ac5 admin admin] PATH_INFO: `/v3/projects/4ff33731a6fb4572bafc86c4ce72502f` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:51.894203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeae0fa-c23a-48ef-a8ac-8d6e87e48ac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ff33731a6fb4572bafc86c4ce72502f)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:51.896134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeae0fa-c23a-48ef-a8ac-8d6e87e48ac5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:52.114434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:52.126675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffeae0fa-c23a-48ef-a8ac-8d6e87e48ac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ff33731a6fb4572bafc86c4ce72502f', 'request_id': 'req-ffeae0fa-c23a-48ef-a8ac-8d6e87e48ac5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:52.159137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffeae0fa-c23a-48ef-a8ac-8d6e87e48ac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ff33731a6fb4572bafc86c4ce72502f', 'request_id': 'req-ffeae0fa-c23a-48ef-a8ac-8d6e87e48ac5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:52.179792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffeae0fa-c23a-48ef-a8ac-8d6e87e48ac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ff33731a6fb4572bafc86c4ce72502f', 'request_id': 'req-ffeae0fa-c23a-48ef-a8ac-8d6e87e48ac5'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:52.286673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffeae0fa-c23a-48ef-a8ac-8d6e87e48ac5 admin admin] The token cache is being invalidate because project 4ff33731a6fb4572bafc86c4ce72502f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:58:52.291948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffeae0fa-c23a-48ef-a8ac-8d6e87e48ac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:52.291948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffeae0fa-c23a-48ef-a8ac-8d6e87e48ac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:52.294936 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3944/7888] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:58:51 2022] DELETE /identity/v3/projects/4ff33731a6fb4572bafc86c4ce72502f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:58:52.296178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b8bdf-55fb-4ffd-93d6-e7446f416a52 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:52.310716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b8bdf-55fb-4ffd-93d6-e7446f416a52 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:52.364764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:52.517837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ab794-8d56-468d-9338-191266f6808d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:52.522189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ab794-8d56-468d-9338-191266f6808d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:52.522636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ab794-8d56-468d-9338-191266f6808d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:52.523086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ab794-8d56-468d-9338-191266f6808d admin admin] PATH_INFO: `/v3/users/eb30fa2832194662b9bb3d5ad9ca5119` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:52.524768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ab794-8d56-468d-9338-191266f6808d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb30fa2832194662b9bb3d5ad9ca5119)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:52.527716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ab794-8d56-468d-9338-191266f6808d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:52.834792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d26ab794-8d56-468d-9338-191266f6808d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb30fa2832194662b9bb3d5ad9ca5119'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:52.837310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d26ab794-8d56-468d-9338-191266f6808d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb30fa2832194662b9bb3d5ad9ca5119'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:52.855575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d26ab794-8d56-468d-9338-191266f6808d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb30fa2832194662b9bb3d5ad9ca5119'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:52.881795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d26ab794-8d56-468d-9338-191266f6808d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb30fa2832194662b9bb3d5ad9ca5119'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:52.953975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d26ab794-8d56-468d-9338-191266f6808d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb30fa2832194662b9bb3d5ad9ca5119'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:52.963230 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3945/7889] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:58:52 2022] DELETE /identity/v3/users/eb30fa2832194662b9bb3d5ad9ca5119 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:58:53.686978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeae0fa-c23a-48ef-a8ac-8d6e87e48ac5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:53.686978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ffeae0fa-c23a-48ef-a8ac-8d6e87e48ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:53.722985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeae0fa-c23a-48ef-a8ac-8d6e87e48ac5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:53.838524 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6dae62-fe15-4c20-8824-ff2e2f33aa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:53.839273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dae62-fe15-4c20-8824-ff2e2f33aa67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:53.839786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dae62-fe15-4c20-8824-ff2e2f33aa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:53.840121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dae62-fe15-4c20-8824-ff2e2f33aa67 admin admin] PATH_INFO: `/v3/projects/4e44c542969e4954b0c266d0f32db8c2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:53.841609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6dae62-fe15-4c20-8824-ff2e2f33aa67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e44c542969e4954b0c266d0f32db8c2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:53.847135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6dae62-fe15-4c20-8824-ff2e2f33aa67 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:54.018377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8b6dae62-fe15-4c20-8824-ff2e2f33aa67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e44c542969e4954b0c266d0f32db8c2', 'request_id': 'req-8b6dae62-fe15-4c20-8824-ff2e2f33aa67'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:54.042882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8b6dae62-fe15-4c20-8824-ff2e2f33aa67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e44c542969e4954b0c266d0f32db8c2', 'request_id': 'req-8b6dae62-fe15-4c20-8824-ff2e2f33aa67'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:54.058216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8b6dae62-fe15-4c20-8824-ff2e2f33aa67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e44c542969e4954b0c266d0f32db8c2', 'request_id': 'req-8b6dae62-fe15-4c20-8824-ff2e2f33aa67'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:54.171326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8b6dae62-fe15-4c20-8824-ff2e2f33aa67 admin admin] The token cache is being invalidate because project 4e44c542969e4954b0c266d0f32db8c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:58:54.171645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8b6dae62-fe15-4c20-8824-ff2e2f33aa67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:54.183141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8b6dae62-fe15-4c20-8824-ff2e2f33aa67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:54.183141 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3945/7890] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:58:53 2022] DELETE /identity/v3/projects/4e44c542969e4954b0c266d0f32db8c2 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:58:54.188233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae6f08-2c95-490e-acd9-7d0e0707f176 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:54.188799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae6f08-2c95-490e-acd9-7d0e0707f176 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:54.188799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae6f08-2c95-490e-acd9-7d0e0707f176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:54.247479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1eae6f08-2c95-490e-acd9-7d0e0707f176 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:54.249468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1eae6f08-2c95-490e-acd9-7d0e0707f176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:54.310770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6dae62-fe15-4c20-8824-ff2e2f33aa67 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:54.313176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8b6dae62-fe15-4c20-8824-ff2e2f33aa67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:54.435291 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3946/7891] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:54.446158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb2505-2c6e-4af8-87e1-95cd8cd7d896 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:54.446486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb2505-2c6e-4af8-87e1-95cd8cd7d896 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:54.447012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb2505-2c6e-4af8-87e1-95cd8cd7d896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:54.488717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8acb2505-2c6e-4af8-87e1-95cd8cd7d896 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:54.497779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8acb2505-2c6e-4af8-87e1-95cd8cd7d896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:54.515937 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3947/7892] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:54.520995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb2505-2c6e-4af8-87e1-95cd8cd7d896 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:54.540069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb2505-2c6e-4af8-87e1-95cd8cd7d896 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:54.556434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cc217-80d0-4d94-b413-fa883b21e198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:54.557926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cc217-80d0-4d94-b413-fa883b21e198 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:54.560441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6dae62-fe15-4c20-8824-ff2e2f33aa67 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:54.561000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cc217-80d0-4d94-b413-fa883b21e198 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:54.561524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cc217-80d0-4d94-b413-fa883b21e198 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:54.562538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cc217-80d0-4d94-b413-fa883b21e198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:58:54.563067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cc217-80d0-4d94-b413-fa883b21e198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:54.565450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cc217-80d0-4d94-b413-fa883b21e198 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:54.574373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c04be-4f66-4b5e-9481-0881b73a8b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:54.578480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c04be-4f66-4b5e-9481-0881b73a8b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:54.579001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c04be-4f66-4b5e-9481-0881b73a8b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:54.579480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c04be-4f66-4b5e-9481-0881b73a8b55 admin admin] PATH_INFO: `/v3/users/6829d42e8bac4df0bc8756f3128d9301` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:54.583962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c04be-4f66-4b5e-9481-0881b73a8b55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6829d42e8bac4df0bc8756f3128d9301)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:54.586231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c04be-4f66-4b5e-9481-0881b73a8b55 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:54.596313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:54.597137 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3948/7893] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:58:54.600001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cc217-80d0-4d94-b413-fa883b21e198 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:54.627903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cc217-80d0-4d94-b413-fa883b21e198 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:54.637792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601afd6-beed-47c6-a5f4-e96e26dc7293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:54.640983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601afd6-beed-47c6-a5f4-e96e26dc7293 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:54.641610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601afd6-beed-47c6-a5f4-e96e26dc7293 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:54.642633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601afd6-beed-47c6-a5f4-e96e26dc7293 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:54.644933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601afd6-beed-47c6-a5f4-e96e26dc7293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:54.647273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601afd6-beed-47c6-a5f4-e96e26dc7293 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:54.796033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:54.807004 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3949/7894] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:58:54 2022] POST /identity/v3/projects => generated 375 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:58:54.808300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601afd6-beed-47c6-a5f4-e96e26dc7293 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:54.910119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601afd6-beed-47c6-a5f4-e96e26dc7293 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:54.920100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba5324-2bb8-4ae1-8ab7-db475ab3fb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:54.921906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba5324-2bb8-4ae1-8ab7-db475ab3fb7b admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:54.921906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba5324-2bb8-4ae1-8ab7-db475ab3fb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:54.921906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba5324-2bb8-4ae1-8ab7-db475ab3fb7b admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:54.938802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-976c04be-4f66-4b5e-9481-0881b73a8b55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6829d42e8bac4df0bc8756f3128d9301'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:54.944101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba5324-2bb8-4ae1-8ab7-db475ab3fb7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:54.958528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba5324-2bb8-4ae1-8ab7-db475ab3fb7b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:54.966709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-976c04be-4f66-4b5e-9481-0881b73a8b55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6829d42e8bac4df0bc8756f3128d9301'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:54.990763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-976c04be-4f66-4b5e-9481-0881b73a8b55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6829d42e8bac4df0bc8756f3128d9301'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:55.025730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-976c04be-4f66-4b5e-9481-0881b73a8b55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6829d42e8bac4df0bc8756f3128d9301'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:55.028790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-976c04be-4f66-4b5e-9481-0881b73a8b55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6829d42e8bac4df0bc8756f3128d9301'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:55.086862 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3950/7895] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:58:54 2022] POST /identity/v3/users => generated 288 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:58:55.091386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba5324-2bb8-4ae1-8ab7-db475ab3fb7b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:55.093763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c4ba5324-2bb8-4ae1-8ab7-db475ab3fb7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:55.108474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba5324-2bb8-4ae1-8ab7-db475ab3fb7b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:55.114371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044d0e6-f2e3-4222-ae0c-61e9e4a2493b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:55.115001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044d0e6-f2e3-4222-ae0c-61e9e4a2493b admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:55.115289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044d0e6-f2e3-4222-ae0c-61e9e4a2493b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:55.115565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044d0e6-f2e3-4222-ae0c-61e9e4a2493b admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:55.116220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044d0e6-f2e3-4222-ae0c-61e9e4a2493b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:55.118058 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044d0e6-f2e3-4222-ae0c-61e9e4a2493b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:55.129172 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3951/7896] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:58:55.133848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044d0e6-f2e3-4222-ae0c-61e9e4a2493b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:55.152855 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3946/7897] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:58:54 2022] DELETE /identity/v3/users/6829d42e8bac4df0bc8756f3128d9301 => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:58:55.166789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210d69f-936a-41c1-b128-3375774a8b7f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:55.166789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210d69f-936a-41c1-b128-3375774a8b7f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:55.166789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210d69f-936a-41c1-b128-3375774a8b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:55.172352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044d0e6-f2e3-4222-ae0c-61e9e4a2493b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:55.206784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a210d69f-936a-41c1-b128-3375774a8b7f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:55.208160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a210d69f-936a-41c1-b128-3375774a8b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:55.265799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868794a5-50d0-44d5-b69f-cf1b3f43b24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:55.267207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868794a5-50d0-44d5-b69f-cf1b3f43b24d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:55.268182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868794a5-50d0-44d5-b69f-cf1b3f43b24d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:55.268788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868794a5-50d0-44d5-b69f-cf1b3f43b24d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:55.269913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868794a5-50d0-44d5-b69f-cf1b3f43b24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:55.274773 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868794a5-50d0-44d5-b69f-cf1b3f43b24d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:55.300759 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3952/7898] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:58:55.305078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868794a5-50d0-44d5-b69f-cf1b3f43b24d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:55.323615 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3947/7899] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:55.329218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868794a5-50d0-44d5-b69f-cf1b3f43b24d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:55.334581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210d69f-936a-41c1-b128-3375774a8b7f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:55.336973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0df246-69a6-4b8a-85bb-8b5895c4f604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:55.337826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0df246-69a6-4b8a-85bb-8b5895c4f604 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:55.338302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0df246-69a6-4b8a-85bb-8b5895c4f604 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:55.341370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a210d69f-936a-41c1-b128-3375774a8b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:55.341515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0df246-69a6-4b8a-85bb-8b5895c4f604 admin admin] PATH_INFO: `/v3/projects/8dbfda9d894a49e68981501d2632e27a/users/eeff42d500524a94ab13a9f85c646f73/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:55.357438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0df246-69a6-4b8a-85bb-8b5895c4f604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dbfda9d894a49e68981501d2632e27a, user_id=eeff42d500524a94ab13a9f85c646f73, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:55.360572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0df246-69a6-4b8a-85bb-8b5895c4f604 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:55.449132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210d69f-936a-41c1-b128-3375774a8b7f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:55.454366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29176f0-bb81-4a24-89cc-a24ae8994d5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:55.455540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29176f0-bb81-4a24-89cc-a24ae8994d5f service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:55.456358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29176f0-bb81-4a24-89cc-a24ae8994d5f service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:55.456799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29176f0-bb81-4a24-89cc-a24ae8994d5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:55.470207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29176f0-bb81-4a24-89cc-a24ae8994d5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:55.472816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29176f0-bb81-4a24-89cc-a24ae8994d5f service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:55.474516 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3953/7900] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:58:55 2022] PUT /identity/v3/projects/8dbfda9d894a49e68981501d2632e27a/users/eeff42d500524a94ab13a9f85c646f73/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:58:55.488213 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3948/7901] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:58:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:58:55.489572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f165de2-c8aa-4c0f-8fec-2b78b17374ee None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:55.489854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f165de2-c8aa-4c0f-8fec-2b78b17374ee None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:55.490355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f165de2-c8aa-4c0f-8fec-2b78b17374ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:55.562190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4f165de2-c8aa-4c0f-8fec-2b78b17374ee None None] MFA Rules not processed for user `eeff42d500524a94ab13a9f85c646f73`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:55.563634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4f165de2-c8aa-4c0f-8fec-2b78b17374ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:55.665364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:55.746671 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3954/7902] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:58:55.755130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29176f0-bb81-4a24-89cc-a24ae8994d5f service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:55.757792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c29176f0-bb81-4a24-89cc-a24ae8994d5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:55.804886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:55.847312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29176f0-bb81-4a24-89cc-a24ae8994d5f service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:55.908773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262baa9b-34d4-47ac-a6b2-8cdc8e7bfdeb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:55.909823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262baa9b-34d4-47ac-a6b2-8cdc8e7bfdeb service glance] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:55.909823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262baa9b-34d4-47ac-a6b2-8cdc8e7bfdeb service glance] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:55.910158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262baa9b-34d4-47ac-a6b2-8cdc8e7bfdeb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:55.919181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262baa9b-34d4-47ac-a6b2-8cdc8e7bfdeb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:55.920653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262baa9b-34d4-47ac-a6b2-8cdc8e7bfdeb service glance] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:55.930763 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3949/7903] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:58:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:58:56.104873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f165de2-c8aa-4c0f-8fec-2b78b17374ee None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:56.106568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4f165de2-c8aa-4c0f-8fec-2b78b17374ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:56.228447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f165de2-c8aa-4c0f-8fec-2b78b17374ee None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:56.236441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6981e20-af37-4aa7-95ad-319164804971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:56.237933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6981e20-af37-4aa7-95ad-319164804971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:56.238866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6981e20-af37-4aa7-95ad-319164804971 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:56.239056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6981e20-af37-4aa7-95ad-319164804971 admin admin] PATH_INFO: `/v3/users/7b72c879647e4a4db86fe70d5594470d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:56.257069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6981e20-af37-4aa7-95ad-319164804971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b72c879647e4a4db86fe70d5594470d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:56.265089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6981e20-af37-4aa7-95ad-319164804971 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:56.476025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262baa9b-34d4-47ac-a6b2-8cdc8e7bfdeb service glance] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:56.479096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-262baa9b-34d4-47ac-a6b2-8cdc8e7bfdeb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:56.516465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262baa9b-34d4-47ac-a6b2-8cdc8e7bfdeb service glance] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:56.543235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931d49d-3e0a-492a-8250-f547ff7e60df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:56.544122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931d49d-3e0a-492a-8250-f547ff7e60df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:56.544569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931d49d-3e0a-492a-8250-f547ff7e60df admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:56.544847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931d49d-3e0a-492a-8250-f547ff7e60df admin admin] PATH_INFO: `/v3/projects/b89e20ea2e6e4681ae14f4dbafd5a8b8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:56.546731 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931d49d-3e0a-492a-8250-f547ff7e60df admin admin] RBAC: Authorizing `identity:delete_project(project_id=b89e20ea2e6e4681ae14f4dbafd5a8b8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:56.549544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931d49d-3e0a-492a-8250-f547ff7e60df admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:56.573470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b6981e20-af37-4aa7-95ad-319164804971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b72c879647e4a4db86fe70d5594470d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:56.574229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b6981e20-af37-4aa7-95ad-319164804971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b72c879647e4a4db86fe70d5594470d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:56.599242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b6981e20-af37-4aa7-95ad-319164804971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b72c879647e4a4db86fe70d5594470d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:56.635607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b6981e20-af37-4aa7-95ad-319164804971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b72c879647e4a4db86fe70d5594470d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:56.735475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b6981e20-af37-4aa7-95ad-319164804971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b72c879647e4a4db86fe70d5594470d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:56.750173 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3955/7904] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:58:56 2022] DELETE /identity/v3/users/7b72c879647e4a4db86fe70d5594470d => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:58:56.752817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd2959-669e-45a1-b482-7eaa08f7df1e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:56.753119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd2959-669e-45a1-b482-7eaa08f7df1e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:56.753399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd2959-669e-45a1-b482-7eaa08f7df1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:56.761228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0931d49d-3e0a-492a-8250-f547ff7e60df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b89e20ea2e6e4681ae14f4dbafd5a8b8', 'request_id': 'req-0931d49d-3e0a-492a-8250-f547ff7e60df'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:56.780938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0931d49d-3e0a-492a-8250-f547ff7e60df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b89e20ea2e6e4681ae14f4dbafd5a8b8', 'request_id': 'req-0931d49d-3e0a-492a-8250-f547ff7e60df'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:56.796647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0931d49d-3e0a-492a-8250-f547ff7e60df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b89e20ea2e6e4681ae14f4dbafd5a8b8', 'request_id': 'req-0931d49d-3e0a-492a-8250-f547ff7e60df'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:56.800597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-43cd2959-669e-45a1-b482-7eaa08f7df1e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:56.801840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-43cd2959-669e-45a1-b482-7eaa08f7df1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:56.882935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0931d49d-3e0a-492a-8250-f547ff7e60df admin admin] The token cache is being invalidate because project b89e20ea2e6e4681ae14f4dbafd5a8b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:58:56.883608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0931d49d-3e0a-492a-8250-f547ff7e60df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:56.884627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:56.885084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0931d49d-3e0a-492a-8250-f547ff7e60df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:56.887325 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3950/7905] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:58:56 2022] DELETE /identity/v3/projects/b89e20ea2e6e4681ae14f4dbafd5a8b8 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:58:56.893545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88114396-60ff-49a0-a6bb-efd5453f22e9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:56.894955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88114396-60ff-49a0-a6bb-efd5453f22e9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:56.897401 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88114396-60ff-49a0-a6bb-efd5453f22e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:56.907059 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3956/7906] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:56.909312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdd1ff-c13d-49ea-99f9-c81412618e53 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:56.909854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdd1ff-c13d-49ea-99f9-c81412618e53 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:56.910428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdd1ff-c13d-49ea-99f9-c81412618e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:56.938787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6bcdd1ff-c13d-49ea-99f9-c81412618e53 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:56.941217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6bcdd1ff-c13d-49ea-99f9-c81412618e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:56.964963 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3957/7907] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:56.965846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdd1ff-c13d-49ea-99f9-c81412618e53 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:56.967400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6bcdd1ff-c13d-49ea-99f9-c81412618e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:56.969014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-88114396-60ff-49a0-a6bb-efd5453f22e9 None None] MFA Rules not processed for user `52677263789a4ca8a64657b82f4a9fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:56.970500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-88114396-60ff-49a0-a6bb-efd5453f22e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:57.084397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdd1ff-c13d-49ea-99f9-c81412618e53 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:57.085887 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3951/7908] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:57.087475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce130c-9d7c-4ee6-ab93-9361beb7c95a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:57.087978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce130c-9d7c-4ee6-ab93-9361beb7c95a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:57.088272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce130c-9d7c-4ee6-ab93-9361beb7c95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:57.094065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab8078-7299-44dd-bf93-79c41cbed8d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:57.095455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab8078-7299-44dd-bf93-79c41cbed8d3 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:57.096645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab8078-7299-44dd-bf93-79c41cbed8d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:57.097150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab8078-7299-44dd-bf93-79c41cbed8d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:57.110479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab8078-7299-44dd-bf93-79c41cbed8d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:57.112813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab8078-7299-44dd-bf93-79c41cbed8d3 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:57.166938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-cbce130c-9d7c-4ee6-ab93-9361beb7c95a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:57.168445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cbce130c-9d7c-4ee6-ab93-9361beb7c95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:57.175233 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3958/7909] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:58:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:58:57.205781 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3952/7910] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:57.208628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab8078-7299-44dd-bf93-79c41cbed8d3 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:57.220224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab8078-7299-44dd-bf93-79c41cbed8d3 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:57.236897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615f0d1-01c6-40bc-a723-3edce408a8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:57.237671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615f0d1-01c6-40bc-a723-3edce408a8ff admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:57.238625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615f0d1-01c6-40bc-a723-3edce408a8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:57.238926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615f0d1-01c6-40bc-a723-3edce408a8ff admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:57.239609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615f0d1-01c6-40bc-a723-3edce408a8ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:58:57.239898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615f0d1-01c6-40bc-a723-3edce408a8ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:57.241530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615f0d1-01c6-40bc-a723-3edce408a8ff admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:57.275065 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3959/7911] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:58:57.285702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce130c-9d7c-4ee6-ab93-9361beb7c95a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:57.292485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:57.301662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce130c-9d7c-4ee6-ab93-9361beb7c95a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:57.314908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ba67c-4bec-4e22-ab31-88d6bc265e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:57.315591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ba67c-4bec-4e22-ab31-88d6bc265e10 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:57.315970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ba67c-4bec-4e22-ab31-88d6bc265e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:57.316310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ba67c-4bec-4e22-ab31-88d6bc265e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:57.317015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ba67c-4bec-4e22-ab31-88d6bc265e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:57.321182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ba67c-4bec-4e22-ab31-88d6bc265e10 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:57.485180 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3953/7912] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:58:57 2022] POST /identity/v3/projects => generated 387 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:58:57.489980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615f0d1-01c6-40bc-a723-3edce408a8ff admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:57.505354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615f0d1-01c6-40bc-a723-3edce408a8ff admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:57.623229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d6040-5985-4779-acf9-86c7cbd63cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:57.623916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d6040-5985-4779-acf9-86c7cbd63cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:57.624876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d6040-5985-4779-acf9-86c7cbd63cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:57.624876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d6040-5985-4779-acf9-86c7cbd63cd2 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:57.625073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d6040-5985-4779-acf9-86c7cbd63cd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:57.627734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d6040-5985-4779-acf9-86c7cbd63cd2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:57.739018 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3960/7913] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:58:57 2022] POST /identity/v3/users => generated 294 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:58:57.740547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ba67c-4bec-4e22-ab31-88d6bc265e10 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:57.755032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ba67c-4bec-4e22-ab31-88d6bc265e10 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:57.772481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6d067-15a5-411d-94fc-87dbba98a2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:57.773389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6d067-15a5-411d-94fc-87dbba98a2bf admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:57.773983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6d067-15a5-411d-94fc-87dbba98a2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:57.774498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6d067-15a5-411d-94fc-87dbba98a2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:57.775357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6d067-15a5-411d-94fc-87dbba98a2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:57.788161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6d067-15a5-411d-94fc-87dbba98a2bf admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:57.824597 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3954/7914] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:58:57.827273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d6040-5985-4779-acf9-86c7cbd63cd2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:57.840579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d6040-5985-4779-acf9-86c7cbd63cd2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:57.857581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618a169-3005-4839-a7e1-251b5f3127e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:57.859007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618a169-3005-4839-a7e1-251b5f3127e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:57.859346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618a169-3005-4839-a7e1-251b5f3127e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:57.859629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618a169-3005-4839-a7e1-251b5f3127e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:57.860376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618a169-3005-4839-a7e1-251b5f3127e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:57.862958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618a169-3005-4839-a7e1-251b5f3127e4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:57.890442 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3961/7915] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:58:57.891580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6d067-15a5-411d-94fc-87dbba98a2bf admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:57.913326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6d067-15a5-411d-94fc-87dbba98a2bf admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:57.927775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e64981-a914-4981-bc05-24d198c7ffa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:57.928451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e64981-a914-4981-bc05-24d198c7ffa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:57.928894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e64981-a914-4981-bc05-24d198c7ffa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:57.929597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e64981-a914-4981-bc05-24d198c7ffa8 admin admin] PATH_INFO: `/v3/projects/038d0cade5d540d399e5d237ed07419f/users/3e7ffbb437004d379258425747bf1521/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:57.964438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e64981-a914-4981-bc05-24d198c7ffa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=038d0cade5d540d399e5d237ed07419f, user_id=3e7ffbb437004d379258425747bf1521, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:57.967246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e64981-a914-4981-bc05-24d198c7ffa8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:58.126605 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3955/7916] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:58:57 2022] PUT /identity/v3/projects/038d0cade5d540d399e5d237ed07419f/users/3e7ffbb437004d379258425747bf1521/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:58:58.139704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed9334-6c79-4815-8392-457486bfdc44 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:58.139994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed9334-6c79-4815-8392-457486bfdc44 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:58.140272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed9334-6c79-4815-8392-457486bfdc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:58.214362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0bed9334-6c79-4815-8392-457486bfdc44 None None] MFA Rules not processed for user `3e7ffbb437004d379258425747bf1521`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:58.223442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0bed9334-6c79-4815-8392-457486bfdc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:58.328294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:58.398555 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e64981-a914-4981-bc05-24d198c7ffa8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:58.411601 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3962/7917] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:58.579815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e64981-a914-4981-bc05-24d198c7ffa8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:58.586332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee0e25-5c81-42f0-98b1-6c3478b8b45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:58.587789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee0e25-5c81-42f0-98b1-6c3478b8b45a admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:58.588151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee0e25-5c81-42f0-98b1-6c3478b8b45a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:58.588609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee0e25-5c81-42f0-98b1-6c3478b8b45a admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:58.589551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee0e25-5c81-42f0-98b1-6c3478b8b45a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:58.591830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee0e25-5c81-42f0-98b1-6c3478b8b45a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:58.740832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed9334-6c79-4815-8392-457486bfdc44 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:58.742461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0bed9334-6c79-4815-8392-457486bfdc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:58.759651 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3956/7918] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:58:58 2022] POST /identity/v3/projects => generated 389 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:58:58.773269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee0e25-5c81-42f0-98b1-6c3478b8b45a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:58.809431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed9334-6c79-4815-8392-457486bfdc44 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:58.917103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee0e25-5c81-42f0-98b1-6c3478b8b45a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:58.933070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214f345-a0ed-4887-9237-1e06fa6944d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:58.933932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214f345-a0ed-4887-9237-1e06fa6944d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:58.934426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214f345-a0ed-4887-9237-1e06fa6944d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:58.934854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214f345-a0ed-4887-9237-1e06fa6944d3 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:58.935675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214f345-a0ed-4887-9237-1e06fa6944d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:58.938020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214f345-a0ed-4887-9237-1e06fa6944d3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:58.947498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae01ff-3714-4728-9d5e-c24a5d1ae139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:58.947498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae01ff-3714-4728-9d5e-c24a5d1ae139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:58.947498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae01ff-3714-4728-9d5e-c24a5d1ae139 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:58.947498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae01ff-3714-4728-9d5e-c24a5d1ae139 admin admin] PATH_INFO: `/v3/projects/eb9a8b3536fd4dd5945d3f2a69b0ecf2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:58.947995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae01ff-3714-4728-9d5e-c24a5d1ae139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb9a8b3536fd4dd5945d3f2a69b0ecf2)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:58.949804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae01ff-3714-4728-9d5e-c24a5d1ae139 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:59.078479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5eae01ff-3714-4728-9d5e-c24a5d1ae139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb9a8b3536fd4dd5945d3f2a69b0ecf2', 'request_id': 'req-5eae01ff-3714-4728-9d5e-c24a5d1ae139'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:59.119867 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3957/7919] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:58:58 2022] POST /identity/v3/users => generated 295 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:58:59.132789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214f345-a0ed-4887-9237-1e06fa6944d3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:59.161071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214f345-a0ed-4887-9237-1e06fa6944d3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:59.165627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5eae01ff-3714-4728-9d5e-c24a5d1ae139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb9a8b3536fd4dd5945d3f2a69b0ecf2', 'request_id': 'req-5eae01ff-3714-4728-9d5e-c24a5d1ae139'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:59.175239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5eae01ff-3714-4728-9d5e-c24a5d1ae139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb9a8b3536fd4dd5945d3f2a69b0ecf2', 'request_id': 'req-5eae01ff-3714-4728-9d5e-c24a5d1ae139'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:59.195265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5eae01ff-3714-4728-9d5e-c24a5d1ae139 admin admin] The token cache is being invalidate because project eb9a8b3536fd4dd5945d3f2a69b0ecf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:58:59.198448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5eae01ff-3714-4728-9d5e-c24a5d1ae139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:59.199270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5eae01ff-3714-4728-9d5e-c24a5d1ae139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:59.204826 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3963/7920] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:58:58 2022] DELETE /identity/v3/projects/eb9a8b3536fd4dd5945d3f2a69b0ecf2 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:58:59.207822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae01ff-3714-4728-9d5e-c24a5d1ae139 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:59.210437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5eae01ff-3714-4728-9d5e-c24a5d1ae139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:59.232384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:59.312808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e304402-9c34-48b2-8415-e45557de8fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:59.313542 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e304402-9c34-48b2-8415-e45557de8fdf admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:59.313940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e304402-9c34-48b2-8415-e45557de8fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:59.314342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e304402-9c34-48b2-8415-e45557de8fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:59.315301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e304402-9c34-48b2-8415-e45557de8fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:59.322464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e304402-9c34-48b2-8415-e45557de8fdf admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:59.347575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae01ff-3714-4728-9d5e-c24a5d1ae139 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:59.352254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb2145-2a30-422c-b159-450b34bf7a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:59.353062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb2145-2a30-422c-b159-450b34bf7a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:59.353355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb2145-2a30-422c-b159-450b34bf7a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:59.353636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb2145-2a30-422c-b159-450b34bf7a6a admin admin] PATH_INFO: `/v3/users/da6a7857fd4a4ab7be99ff2ed8554fb4` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:59.362137 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3958/7921] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:58:59.362799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb2145-2a30-422c-b159-450b34bf7a6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=da6a7857fd4a4ab7be99ff2ed8554fb4)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:59.363364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e304402-9c34-48b2-8415-e45557de8fdf admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:59.387631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2e304402-9c34-48b2-8415-e45557de8fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:59.392474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb2145-2a30-422c-b159-450b34bf7a6a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:59.423740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e304402-9c34-48b2-8415-e45557de8fdf admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:59.436520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d98062-9260-41b1-993b-3688e851d446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:59.443885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d98062-9260-41b1-993b-3688e851d446 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:59.450117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d98062-9260-41b1-993b-3688e851d446 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:59.450117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d98062-9260-41b1-993b-3688e851d446 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:59.450117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d98062-9260-41b1-993b-3688e851d446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:59.450117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d98062-9260-41b1-993b-3688e851d446 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:59.463764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:59.490288 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3959/7922] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:58:59.490288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d98062-9260-41b1-993b-3688e851d446 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:59.515654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d98062-9260-41b1-993b-3688e851d446 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:59.533795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548181ce-30df-436e-9e3d-19e33d42cedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:59.535710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548181ce-30df-436e-9e3d-19e33d42cedc admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:59.537433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548181ce-30df-436e-9e3d-19e33d42cedc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:59.537726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548181ce-30df-436e-9e3d-19e33d42cedc admin admin] PATH_INFO: `/v3/projects/7012c9031d05477d99fde24bd2d44f48/users/57e54220934042f9a69ffd2b02b1b96c/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:59.576690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548181ce-30df-436e-9e3d-19e33d42cedc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7012c9031d05477d99fde24bd2d44f48, user_id=57e54220934042f9a69ffd2b02b1b96c, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:59.584930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548181ce-30df-436e-9e3d-19e33d42cedc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:58:59.665298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-68fb2145-2a30-422c-b159-450b34bf7a6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da6a7857fd4a4ab7be99ff2ed8554fb4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:59.668550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-68fb2145-2a30-422c-b159-450b34bf7a6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da6a7857fd4a4ab7be99ff2ed8554fb4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:59.682009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-68fb2145-2a30-422c-b159-450b34bf7a6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da6a7857fd4a4ab7be99ff2ed8554fb4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:59.704779 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3960/7923] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:58:59 2022] PUT /identity/v3/projects/7012c9031d05477d99fde24bd2d44f48/users/57e54220934042f9a69ffd2b02b1b96c/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:58:59.719139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2181e66-f65b-47df-a68b-8bbe7b4c092c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:59.719531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2181e66-f65b-47df-a68b-8bbe7b4c092c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:59.719853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2181e66-f65b-47df-a68b-8bbe7b4c092c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:59.727206 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-68fb2145-2a30-422c-b159-450b34bf7a6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da6a7857fd4a4ab7be99ff2ed8554fb4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:59.768363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b2181e66-f65b-47df-a68b-8bbe7b4c092c None None] MFA Rules not processed for user `57e54220934042f9a69ffd2b02b1b96c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:58:59.769710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b2181e66-f65b-47df-a68b-8bbe7b4c092c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:59.851516 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3961/7924] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:58:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:58:59.855963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2181e66-f65b-47df-a68b-8bbe7b4c092c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:58:59.857435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b2181e66-f65b-47df-a68b-8bbe7b4c092c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:58:59.921608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-68fb2145-2a30-422c-b159-450b34bf7a6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da6a7857fd4a4ab7be99ff2ed8554fb4'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:58:59.925987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2181e66-f65b-47df-a68b-8bbe7b4c092c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:58:59.931143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4f4d5-c881-42d6-80aa-d1bed0457362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:58:59.931773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4f4d5-c881-42d6-80aa-d1bed0457362 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:58:59.932063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4f4d5-c881-42d6-80aa-d1bed0457362 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:58:59.932343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4f4d5-c881-42d6-80aa-d1bed0457362 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:58:59.935718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4f4d5-c881-42d6-80aa-d1bed0457362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:58:59.935876 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3964/7925] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:58:59 2022] DELETE /identity/v3/users/da6a7857fd4a4ab7be99ff2ed8554fb4 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:58:59.935978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4f4d5-c881-42d6-80aa-d1bed0457362 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:00.087635 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3962/7926] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:58:59 2022] POST /identity/v3/projects => generated 387 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:59:00.091315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb2145-2a30-422c-b159-450b34bf7a6a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:00.185020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb2145-2a30-422c-b159-450b34bf7a6a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:00.217086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:00.261638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6c813-f766-4dcd-8261-6e5d339e52b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:00.263903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6c813-f766-4dcd-8261-6e5d339e52b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:00.264209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6c813-f766-4dcd-8261-6e5d339e52b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:00.264513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6c813-f766-4dcd-8261-6e5d339e52b6 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:00.265172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6c813-f766-4dcd-8261-6e5d339e52b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:00.267589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6c813-f766-4dcd-8261-6e5d339e52b6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:00.370079 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3965/7927] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:59:00 2022] POST /identity/v3/users => generated 300 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:59:00.374242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4f4d5-c881-42d6-80aa-d1bed0457362 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:00.389356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4f4d5-c881-42d6-80aa-d1bed0457362 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:00.395089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5113e78-a391-4ddf-841a-0aeb316733f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:00.398073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5113e78-a391-4ddf-841a-0aeb316733f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:00.398073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5113e78-a391-4ddf-841a-0aeb316733f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:00.398073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5113e78-a391-4ddf-841a-0aeb316733f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:00.398073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5113e78-a391-4ddf-841a-0aeb316733f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:00.399572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5113e78-a391-4ddf-841a-0aeb316733f5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:00.416624 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3963/7928] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:59:00.420483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6c813-f766-4dcd-8261-6e5d339e52b6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:00.435560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6c813-f766-4dcd-8261-6e5d339e52b6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:00.444597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098abba1-095a-4ea0-82c3-48cbcc9dd900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:00.449273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098abba1-095a-4ea0-82c3-48cbcc9dd900 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:00.449273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098abba1-095a-4ea0-82c3-48cbcc9dd900 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:00.449273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098abba1-095a-4ea0-82c3-48cbcc9dd900 admin admin] PATH_INFO: `/v3/projects/115adeda6afe44e8b390488de73dcdc2/users/fe77aa1c8d5b4a90a15275af5edb9225/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:00.478862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098abba1-095a-4ea0-82c3-48cbcc9dd900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=115adeda6afe44e8b390488de73dcdc2, user_id=fe77aa1c8d5b4a90a15275af5edb9225, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:00.482424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098abba1-095a-4ea0-82c3-48cbcc9dd900 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:00.564269 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3966/7929] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:59:00 2022] PUT /identity/v3/projects/115adeda6afe44e8b390488de73dcdc2/users/fe77aa1c8d5b4a90a15275af5edb9225/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:59:00.570113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5113e78-a391-4ddf-841a-0aeb316733f5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:00.588079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5113e78-a391-4ddf-841a-0aeb316733f5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:00.715136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098abba1-095a-4ea0-82c3-48cbcc9dd900 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:00.717725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93fac7-699a-477d-8f4d-a9a8bb08640a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:00.718083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-098abba1-095a-4ea0-82c3-48cbcc9dd900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:00.718800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93fac7-699a-477d-8f4d-a9a8bb08640a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:00.718800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93fac7-699a-477d-8f4d-a9a8bb08640a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:00.719040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93fac7-699a-477d-8f4d-a9a8bb08640a admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:00.719823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93fac7-699a-477d-8f4d-a9a8bb08640a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:00.721567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93fac7-699a-477d-8f4d-a9a8bb08640a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:00.741034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098abba1-095a-4ea0-82c3-48cbcc9dd900 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:00.746405 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3964/7930] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:59:00.750978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93fac7-699a-477d-8f4d-a9a8bb08640a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:00.751921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7281a8b-3029-4f6a-b20d-3e842d0c9fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:00.753145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7281a8b-3029-4f6a-b20d-3e842d0c9fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:00.753430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7281a8b-3029-4f6a-b20d-3e842d0c9fef admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:00.755382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7281a8b-3029-4f6a-b20d-3e842d0c9fef admin admin] PATH_INFO: `/v3/projects/df4d0acde2624b9f80729d4f00fb260e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:00.756838 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7281a8b-3029-4f6a-b20d-3e842d0c9fef admin admin] RBAC: Authorizing `identity:delete_project(project_id=df4d0acde2624b9f80729d4f00fb260e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:00.768115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7281a8b-3029-4f6a-b20d-3e842d0c9fef admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:00.773246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93fac7-699a-477d-8f4d-a9a8bb08640a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:00.788985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236970f7-746a-4470-a9a4-f7a04523e1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:00.790045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236970f7-746a-4470-a9a4-f7a04523e1da admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:00.790421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236970f7-746a-4470-a9a4-f7a04523e1da admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:00.790785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236970f7-746a-4470-a9a4-f7a04523e1da admin admin] PATH_INFO: `/v3/projects/115adeda6afe44e8b390488de73dcdc2/users/fe77aa1c8d5b4a90a15275af5edb9225/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:00.796503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:00.797761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236970f7-746a-4470-a9a4-f7a04523e1da admin admin] RBAC: Authorizing `identity:create_grant(project_id=115adeda6afe44e8b390488de73dcdc2, user_id=fe77aa1c8d5b4a90a15275af5edb9225, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:00.807565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236970f7-746a-4470-a9a4-f7a04523e1da admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:00.837879 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3965/7931] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:59:00 2022] PUT /identity/v3/projects/115adeda6afe44e8b390488de73dcdc2/users/fe77aa1c8d5b4a90a15275af5edb9225/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:59:00.848514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88516f91-2a8e-4d38-aa9c-c0125b45c146 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:00.848751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88516f91-2a8e-4d38-aa9c-c0125b45c146 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:00.848939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88516f91-2a8e-4d38-aa9c-c0125b45c146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:00.906649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-88516f91-2a8e-4d38-aa9c-c0125b45c146 None None] MFA Rules not processed for user `fe77aa1c8d5b4a90a15275af5edb9225`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:00.906649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-88516f91-2a8e-4d38-aa9c-c0125b45c146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:01.066388 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3966/7932] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:59:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:59:01.078798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88516f91-2a8e-4d38-aa9c-c0125b45c146 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:01.080743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-88516f91-2a8e-4d38-aa9c-c0125b45c146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:01.100650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c7281a8b-3029-4f6a-b20d-3e842d0c9fef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df4d0acde2624b9f80729d4f00fb260e', 'request_id': 'req-c7281a8b-3029-4f6a-b20d-3e842d0c9fef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:01.176572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c7281a8b-3029-4f6a-b20d-3e842d0c9fef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df4d0acde2624b9f80729d4f00fb260e', 'request_id': 'req-c7281a8b-3029-4f6a-b20d-3e842d0c9fef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:01.184988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c7281a8b-3029-4f6a-b20d-3e842d0c9fef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df4d0acde2624b9f80729d4f00fb260e', 'request_id': 'req-c7281a8b-3029-4f6a-b20d-3e842d0c9fef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:01.223551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c7281a8b-3029-4f6a-b20d-3e842d0c9fef admin admin] The token cache is being invalidate because project df4d0acde2624b9f80729d4f00fb260e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:59:01.223864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c7281a8b-3029-4f6a-b20d-3e842d0c9fef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:01.226686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c7281a8b-3029-4f6a-b20d-3e842d0c9fef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:01.229482 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3967/7933] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:59:00 2022] DELETE /identity/v3/projects/df4d0acde2624b9f80729d4f00fb260e => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:59:01.234873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb8038-5d02-4ce9-aad3-c6a44d6845f3 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:01.237834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb8038-5d02-4ce9-aad3-c6a44d6845f3 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:01.237834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb8038-5d02-4ce9-aad3-c6a44d6845f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:01.273048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:01.313259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5abb8038-5d02-4ce9-aad3-c6a44d6845f3 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:01.315953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5abb8038-5d02-4ce9-aad3-c6a44d6845f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:01.338377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88516f91-2a8e-4d38-aa9c-c0125b45c146 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:01.520375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed07c6d-4f66-4cca-8904-414c3ca66d43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:01.521014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed07c6d-4f66-4cca-8904-414c3ca66d43 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:01.521301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed07c6d-4f66-4cca-8904-414c3ca66d43 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:01.521582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed07c6d-4f66-4cca-8904-414c3ca66d43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:01.522945 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3968/7934] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:01.530577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-eed07c6d-4f66-4cca-8904-414c3ca66d43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:01.539196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260a6ed-e257-47b8-a695-1ad052a70975 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:01.544179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260a6ed-e257-47b8-a695-1ad052a70975 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:01.544921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260a6ed-e257-47b8-a695-1ad052a70975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:01.597596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f260a6ed-e257-47b8-a695-1ad052a70975 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:01.604048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f260a6ed-e257-47b8-a695-1ad052a70975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:01.627813 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3969/7935] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:01.639334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260a6ed-e257-47b8-a695-1ad052a70975 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:01.663109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260a6ed-e257-47b8-a695-1ad052a70975 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:01.683083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76def5-0e00-4671-8a21-78d1cc405bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:01.683725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76def5-0e00-4671-8a21-78d1cc405bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:01.684013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76def5-0e00-4671-8a21-78d1cc405bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:01.684289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76def5-0e00-4671-8a21-78d1cc405bc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:01.684974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76def5-0e00-4671-8a21-78d1cc405bc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:59:01.685281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76def5-0e00-4671-8a21-78d1cc405bc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:01.686989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76def5-0e00-4671-8a21-78d1cc405bc6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:01.719558 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3970/7936] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:59:01.722993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed07c6d-4f66-4cca-8904-414c3ca66d43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:01.725360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76def5-0e00-4671-8a21-78d1cc405bc6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:01.731687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed07c6d-4f66-4cca-8904-414c3ca66d43 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:01.747778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76def5-0e00-4671-8a21-78d1cc405bc6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:01.762810 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3967/7937] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:59:01 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 03:59:01.779128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955a501-222c-474c-b510-6c5330418127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:01.779326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955a501-222c-474c-b510-6c5330418127 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:01.779542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955a501-222c-474c-b510-6c5330418127 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:01.779821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955a501-222c-474c-b510-6c5330418127 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:01.780471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955a501-222c-474c-b510-6c5330418127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:01.782644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955a501-222c-474c-b510-6c5330418127 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:01.914709 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3971/7938] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:59:01 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:59:01.916377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed07c6d-4f66-4cca-8904-414c3ca66d43 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:01.936967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed07c6d-4f66-4cca-8904-414c3ca66d43 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:02.118893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6906ef8-5518-49b4-9c8d-6fde72244e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:02.119556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6906ef8-5518-49b4-9c8d-6fde72244e3c admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:02.119840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6906ef8-5518-49b4-9c8d-6fde72244e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:02.120223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6906ef8-5518-49b4-9c8d-6fde72244e3c admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:02.120891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6906ef8-5518-49b4-9c8d-6fde72244e3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:02.124800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6906ef8-5518-49b4-9c8d-6fde72244e3c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:02.232746 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3968/7939] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:59:01 2022] POST /identity/v3/users => generated 287 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:59:02.235098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955a501-222c-474c-b510-6c5330418127 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:02.251147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955a501-222c-474c-b510-6c5330418127 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:02.267804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a4986-2860-426d-9496-02d0e6c34f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:02.267804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a4986-2860-426d-9496-02d0e6c34f20 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:02.267804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a4986-2860-426d-9496-02d0e6c34f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:02.269538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a4986-2860-426d-9496-02d0e6c34f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:02.270275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a4986-2860-426d-9496-02d0e6c34f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:02.272256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a4986-2860-426d-9496-02d0e6c34f20 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:02.299802 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3972/7940] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:59:02.301880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6906ef8-5518-49b4-9c8d-6fde72244e3c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:02.318269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6906ef8-5518-49b4-9c8d-6fde72244e3c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:02.331294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27dc64-3d75-4f5a-abcd-9e100458547f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:02.334849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27dc64-3d75-4f5a-abcd-9e100458547f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:02.335243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27dc64-3d75-4f5a-abcd-9e100458547f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:02.335533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27dc64-3d75-4f5a-abcd-9e100458547f admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:02.336709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27dc64-3d75-4f5a-abcd-9e100458547f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:02.338387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27dc64-3d75-4f5a-abcd-9e100458547f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:02.356483 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3969/7941] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:59:02.360451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a4986-2860-426d-9496-02d0e6c34f20 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:02.382224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a4986-2860-426d-9496-02d0e6c34f20 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:02.396806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ae573-7015-4b27-854f-791004ddc1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:02.399110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ae573-7015-4b27-854f-791004ddc1fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:02.399397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ae573-7015-4b27-854f-791004ddc1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:02.399678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ae573-7015-4b27-854f-791004ddc1fd admin admin] PATH_INFO: `/v3/projects/151ba13c56c247d687ff96c7fd512785/users/b0068dbfef7d4f3ea13be3c2a9410bb0/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:02.437153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ae573-7015-4b27-854f-791004ddc1fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=151ba13c56c247d687ff96c7fd512785, user_id=b0068dbfef7d4f3ea13be3c2a9410bb0, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:02.439461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ae573-7015-4b27-854f-791004ddc1fd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:02.550962 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3973/7942] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:59:02 2022] PUT /identity/v3/projects/151ba13c56c247d687ff96c7fd512785/users/b0068dbfef7d4f3ea13be3c2a9410bb0/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:59:02.563759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d00e6-1312-4dd3-92c8-4b30169ead3e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:02.564055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d00e6-1312-4dd3-92c8-4b30169ead3e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:02.564335 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d00e6-1312-4dd3-92c8-4b30169ead3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:02.609932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:02.626866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d21d00e6-1312-4dd3-92c8-4b30169ead3e None None] MFA Rules not processed for user `b0068dbfef7d4f3ea13be3c2a9410bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:02.629638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d21d00e6-1312-4dd3-92c8-4b30169ead3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:02.847914 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3970/7943] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:59:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:02.852823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ae573-7015-4b27-854f-791004ddc1fd admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:02.881642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:02.951471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ae573-7015-4b27-854f-791004ddc1fd admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:02.960333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c0199-10c3-498c-a0e8-b39f86fde6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:02.961106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c0199-10c3-498c-a0e8-b39f86fde6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:02.961493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c0199-10c3-498c-a0e8-b39f86fde6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:02.961839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c0199-10c3-498c-a0e8-b39f86fde6c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:02.962825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c0199-10c3-498c-a0e8-b39f86fde6c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:02.965586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c0199-10c3-498c-a0e8-b39f86fde6c2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:03.101345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d00e6-1312-4dd3-92c8-4b30169ead3e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:03.103477 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3974/7944] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:59:02 2022] POST /identity/v3/projects => generated 373 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:59:03.120900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d00e6-1312-4dd3-92c8-4b30169ead3e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:03.259514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ffd01-c2bc-4798-a882-cb5248d4b0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:03.260155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ffd01-c2bc-4798-a882-cb5248d4b0e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:03.260437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ffd01-c2bc-4798-a882-cb5248d4b0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:03.260807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ffd01-c2bc-4798-a882-cb5248d4b0e6 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:03.261735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ffd01-c2bc-4798-a882-cb5248d4b0e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:03.272929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ffd01-c2bc-4798-a882-cb5248d4b0e6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:03.379292 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3971/7945] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:59:03 2022] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:59:03.383517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c0199-10c3-498c-a0e8-b39f86fde6c2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:03.400787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c0199-10c3-498c-a0e8-b39f86fde6c2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:03.407579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8232a-b863-4182-b60b-79eb332574d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:03.408578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8232a-b863-4182-b60b-79eb332574d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:03.409115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8232a-b863-4182-b60b-79eb332574d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:03.410324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8232a-b863-4182-b60b-79eb332574d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:03.411181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8232a-b863-4182-b60b-79eb332574d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:03.413169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8232a-b863-4182-b60b-79eb332574d8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:03.441016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ffd01-c2bc-4798-a882-cb5248d4b0e6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:03.441528 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3975/7946] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:59:03.454539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ffd01-c2bc-4798-a882-cb5248d4b0e6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:03.461300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e605b8b-5213-4840-b5bf-ebafa0f8d308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:03.462620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e605b8b-5213-4840-b5bf-ebafa0f8d308 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:03.463482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e605b8b-5213-4840-b5bf-ebafa0f8d308 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:03.463482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e605b8b-5213-4840-b5bf-ebafa0f8d308 admin admin] PATH_INFO: `/v3/projects/fb5b58d7a40048a0b57f744c1c1b4c62/users/19d6c4c8a276451d8db25a9063b3762e/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:03.487908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e605b8b-5213-4840-b5bf-ebafa0f8d308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb5b58d7a40048a0b57f744c1c1b4c62, user_id=19d6c4c8a276451d8db25a9063b3762e, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:03.491630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e605b8b-5213-4840-b5bf-ebafa0f8d308 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:03.607850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8232a-b863-4182-b60b-79eb332574d8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:03.612286 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3972/7947] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:59:03 2022] PUT /identity/v3/projects/fb5b58d7a40048a0b57f744c1c1b4c62/users/19d6c4c8a276451d8db25a9063b3762e/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:59:03.623571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8232a-b863-4182-b60b-79eb332574d8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:03.831378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c71db-e960-425a-98c3-16477aca4514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:03.833988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c71db-e960-425a-98c3-16477aca4514 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:03.834305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c71db-e960-425a-98c3-16477aca4514 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:03.834581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c71db-e960-425a-98c3-16477aca4514 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:03.848091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c71db-e960-425a-98c3-16477aca4514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:03.853461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c71db-e960-425a-98c3-16477aca4514 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:03.902877 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3976/7948] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:59:03.907399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e605b8b-5213-4840-b5bf-ebafa0f8d308 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:03.932361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e605b8b-5213-4840-b5bf-ebafa0f8d308 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:03.951630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c261e-b667-4c6c-a8aa-35e120a639d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:03.953250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c261e-b667-4c6c-a8aa-35e120a639d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:03.953250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c261e-b667-4c6c-a8aa-35e120a639d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:03.953550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c261e-b667-4c6c-a8aa-35e120a639d4 admin admin] PATH_INFO: `/v3/projects/fb5b58d7a40048a0b57f744c1c1b4c62/users/19d6c4c8a276451d8db25a9063b3762e/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:03.961332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c261e-b667-4c6c-a8aa-35e120a639d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb5b58d7a40048a0b57f744c1c1b4c62, user_id=19d6c4c8a276451d8db25a9063b3762e, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:03.967413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c261e-b667-4c6c-a8aa-35e120a639d4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:04.010142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6342c55-0e51-451d-8257-429af87a3c19 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:04.010142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6342c55-0e51-451d-8257-429af87a3c19 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:04.010142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6342c55-0e51-451d-8257-429af87a3c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:04.014196 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3973/7949] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:59:03 2022] PUT /identity/v3/projects/fb5b58d7a40048a0b57f744c1c1b4c62/users/19d6c4c8a276451d8db25a9063b3762e/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:59:04.073173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e6342c55-0e51-451d-8257-429af87a3c19 None None] MFA Rules not processed for user `19d6c4c8a276451d8db25a9063b3762e`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:04.073173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e6342c55-0e51-451d-8257-429af87a3c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:04.222136 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3977/7950] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:59:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:04.237230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c261e-b667-4c6c-a8aa-35e120a639d4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:04.239207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b49c261e-b667-4c6c-a8aa-35e120a639d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:04.332687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c261e-b667-4c6c-a8aa-35e120a639d4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:04.337222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429f44b-0483-47d1-b72c-c795c37ece6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:04.337853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429f44b-0483-47d1-b72c-c795c37ece6f service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:04.338965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429f44b-0483-47d1-b72c-c795c37ece6f service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:04.339257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429f44b-0483-47d1-b72c-c795c37ece6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:04.346996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:04.419424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429f44b-0483-47d1-b72c-c795c37ece6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:04.420488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429f44b-0483-47d1-b72c-c795c37ece6f service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:04.444018 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3974/7951] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:59:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:59:07.944409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6342c55-0e51-451d-8257-429af87a3c19 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:07.946070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e6342c55-0e51-451d-8257-429af87a3c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:07.972295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:08.054598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6342c55-0e51-451d-8257-429af87a3c19 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:08.061281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350403a0-3253-42a1-bcaf-e548633ecbed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:08.062420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350403a0-3253-42a1-bcaf-e548633ecbed service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:08.062711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350403a0-3253-42a1-bcaf-e548633ecbed service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:08.063062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350403a0-3253-42a1-bcaf-e548633ecbed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:08.066464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-350403a0-3253-42a1-bcaf-e548633ecbed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:08.165311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350403a0-3253-42a1-bcaf-e548633ecbed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:08.167082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350403a0-3253-42a1-bcaf-e548633ecbed service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:08.186366 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3978/7952] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:59:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:59:12.467600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429f44b-0483-47d1-b72c-c795c37ece6f service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:12.694547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429f44b-0483-47d1-b72c-c795c37ece6f service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:12.713176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b404daf-9051-49c9-81fa-d7e2142b17d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:12.714469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b404daf-9051-49c9-81fa-d7e2142b17d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:12.721458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b404daf-9051-49c9-81fa-d7e2142b17d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:12.722340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b404daf-9051-49c9-81fa-d7e2142b17d1 admin admin] PATH_INFO: `/v3/users/b0068dbfef7d4f3ea13be3c2a9410bb0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:12.725487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b404daf-9051-49c9-81fa-d7e2142b17d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0068dbfef7d4f3ea13be3c2a9410bb0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:12.730535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b404daf-9051-49c9-81fa-d7e2142b17d1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:13.081994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3b404daf-9051-49c9-81fa-d7e2142b17d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0068dbfef7d4f3ea13be3c2a9410bb0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:13.083379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3b404daf-9051-49c9-81fa-d7e2142b17d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0068dbfef7d4f3ea13be3c2a9410bb0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:13.112618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3b404daf-9051-49c9-81fa-d7e2142b17d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0068dbfef7d4f3ea13be3c2a9410bb0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:13.143690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3b404daf-9051-49c9-81fa-d7e2142b17d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0068dbfef7d4f3ea13be3c2a9410bb0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:13.143690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-3b404daf-9051-49c9-81fa-d7e2142b17d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0068dbfef7d4f3ea13be3c2a9410bb0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:13.222416 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3975/7953] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:59:12 2022] DELETE /identity/v3/users/b0068dbfef7d4f3ea13be3c2a9410bb0 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:59:13.226978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179575e-28c4-4b29-b318-4d5188036799 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:13.233683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179575e-28c4-4b29-b318-4d5188036799 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:13.233683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179575e-28c4-4b29-b318-4d5188036799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:13.295834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1179575e-28c4-4b29-b318-4d5188036799 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:13.303913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1179575e-28c4-4b29-b318-4d5188036799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:13.455732 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3979/7954] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:13.576197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b404daf-9051-49c9-81fa-d7e2142b17d1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:13.579664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3b404daf-9051-49c9-81fa-d7e2142b17d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:13.658973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:13.792011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b404daf-9051-49c9-81fa-d7e2142b17d1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:13.812940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdbcc1-0a71-43f6-9726-0280edbcb8d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:13.814667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdbcc1-0a71-43f6-9726-0280edbcb8d2 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:13.817389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdbcc1-0a71-43f6-9726-0280edbcb8d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:13.819051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdbcc1-0a71-43f6-9726-0280edbcb8d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:13.863845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdbcc1-0a71-43f6-9726-0280edbcb8d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:13.863845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdbcc1-0a71-43f6-9726-0280edbcb8d2 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:13.896297 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3976/7955] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:59:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:59:15.591193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179575e-28c4-4b29-b318-4d5188036799 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:15.594302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1179575e-28c4-4b29-b318-4d5188036799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:15.621851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179575e-28c4-4b29-b318-4d5188036799 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:15.630210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925d862-7237-4f2b-ad5b-d217e85da1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:15.631445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925d862-7237-4f2b-ad5b-d217e85da1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:15.631881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925d862-7237-4f2b-ad5b-d217e85da1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:15.632375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925d862-7237-4f2b-ad5b-d217e85da1ff admin admin] PATH_INFO: `/v3/projects/151ba13c56c247d687ff96c7fd512785` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:15.634282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925d862-7237-4f2b-ad5b-d217e85da1ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=151ba13c56c247d687ff96c7fd512785)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:15.636540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925d862-7237-4f2b-ad5b-d217e85da1ff admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:15.858869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f925d862-7237-4f2b-ad5b-d217e85da1ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '151ba13c56c247d687ff96c7fd512785', 'request_id': 'req-f925d862-7237-4f2b-ad5b-d217e85da1ff'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:15.960284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f925d862-7237-4f2b-ad5b-d217e85da1ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '151ba13c56c247d687ff96c7fd512785', 'request_id': 'req-f925d862-7237-4f2b-ad5b-d217e85da1ff'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:15.969244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f925d862-7237-4f2b-ad5b-d217e85da1ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '151ba13c56c247d687ff96c7fd512785', 'request_id': 'req-f925d862-7237-4f2b-ad5b-d217e85da1ff'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:15.970904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:16.003095 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f925d862-7237-4f2b-ad5b-d217e85da1ff admin admin] The token cache is being invalidate because project 151ba13c56c247d687ff96c7fd512785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:59:16.006160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f925d862-7237-4f2b-ad5b-d217e85da1ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:16.010445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f925d862-7237-4f2b-ad5b-d217e85da1ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:16.012060 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3980/7956] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:59:15 2022] DELETE /identity/v3/projects/151ba13c56c247d687ff96c7fd512785 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:59:16.016254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdbcc1-0a71-43f6-9726-0280edbcb8d2 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:16.034222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdbcc1-0a71-43f6-9726-0280edbcb8d2 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:16.265409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b674c-8821-4956-b96a-d8f0dd8336c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:16.266178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b674c-8821-4956-b96a-d8f0dd8336c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:16.268495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b674c-8821-4956-b96a-d8f0dd8336c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:16.268495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b674c-8821-4956-b96a-d8f0dd8336c1 admin admin] PATH_INFO: `/v3/users/19d6c4c8a276451d8db25a9063b3762e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:16.268495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b674c-8821-4956-b96a-d8f0dd8336c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19d6c4c8a276451d8db25a9063b3762e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:16.292470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b674c-8821-4956-b96a-d8f0dd8336c1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:16.571996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-169b674c-8821-4956-b96a-d8f0dd8336c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19d6c4c8a276451d8db25a9063b3762e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:16.572884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-169b674c-8821-4956-b96a-d8f0dd8336c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19d6c4c8a276451d8db25a9063b3762e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:16.595112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-169b674c-8821-4956-b96a-d8f0dd8336c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19d6c4c8a276451d8db25a9063b3762e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:16.619460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-169b674c-8821-4956-b96a-d8f0dd8336c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19d6c4c8a276451d8db25a9063b3762e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:16.620534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-169b674c-8821-4956-b96a-d8f0dd8336c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19d6c4c8a276451d8db25a9063b3762e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:16.687358 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3977/7957] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:59:16 2022] DELETE /identity/v3/users/19d6c4c8a276451d8db25a9063b3762e => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:59:17.465792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925d862-7237-4f2b-ad5b-d217e85da1ff admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:17.467772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f925d862-7237-4f2b-ad5b-d217e85da1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:17.493745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925d862-7237-4f2b-ad5b-d217e85da1ff admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:17.573022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7d494-3c9b-4d28-8492-4e368f7a48fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:17.573687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7d494-3c9b-4d28-8492-4e368f7a48fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:17.573973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7d494-3c9b-4d28-8492-4e368f7a48fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:17.574283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7d494-3c9b-4d28-8492-4e368f7a48fb admin admin] PATH_INFO: `/v3/projects/fb5b58d7a40048a0b57f744c1c1b4c62` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:17.575454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7d494-3c9b-4d28-8492-4e368f7a48fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb5b58d7a40048a0b57f744c1c1b4c62)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:17.577428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7d494-3c9b-4d28-8492-4e368f7a48fb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:17.743957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c5a7d494-3c9b-4d28-8492-4e368f7a48fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb5b58d7a40048a0b57f744c1c1b4c62', 'request_id': 'req-c5a7d494-3c9b-4d28-8492-4e368f7a48fb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:17.817232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c5a7d494-3c9b-4d28-8492-4e368f7a48fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb5b58d7a40048a0b57f744c1c1b4c62', 'request_id': 'req-c5a7d494-3c9b-4d28-8492-4e368f7a48fb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:17.824861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c5a7d494-3c9b-4d28-8492-4e368f7a48fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb5b58d7a40048a0b57f744c1c1b4c62', 'request_id': 'req-c5a7d494-3c9b-4d28-8492-4e368f7a48fb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:17.836982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c5a7d494-3c9b-4d28-8492-4e368f7a48fb admin admin] The token cache is being invalidate because project fb5b58d7a40048a0b57f744c1c1b4c62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:59:17.836982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c5a7d494-3c9b-4d28-8492-4e368f7a48fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:17.839135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c5a7d494-3c9b-4d28-8492-4e368f7a48fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:17.845741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a82a7-f66a-4ad2-9186-90641820d0f6 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:17.846312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a82a7-f66a-4ad2-9186-90641820d0f6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:17.846419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a82a7-f66a-4ad2-9186-90641820d0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:17.846513 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3981/7958] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:59:17 2022] DELETE /identity/v3/projects/fb5b58d7a40048a0b57f744c1c1b4c62 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:59:17.885510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-648a82a7-f66a-4ad2-9186-90641820d0f6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:17.887329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-648a82a7-f66a-4ad2-9186-90641820d0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:17.954275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:17.985593 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3978/7959] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:17.991190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1359f-c1c8-4579-9ba7-3a5568da07dc None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:17.994186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1359f-c1c8-4579-9ba7-3a5568da07dc None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:17.994633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1359f-c1c8-4579-9ba7-3a5568da07dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:18.032577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e4d1359f-c1c8-4579-9ba7-3a5568da07dc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:18.033861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e4d1359f-c1c8-4579-9ba7-3a5568da07dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:18.056357 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3982/7960] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:18.057331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a82a7-f66a-4ad2-9186-90641820d0f6 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:18.070500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a82a7-f66a-4ad2-9186-90641820d0f6 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:18.079362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e3f01-aa98-4303-bd40-8c160be35764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:18.081196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e3f01-aa98-4303-bd40-8c160be35764 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:18.081587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e3f01-aa98-4303-bd40-8c160be35764 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:18.082014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e3f01-aa98-4303-bd40-8c160be35764 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:18.083054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e3f01-aa98-4303-bd40-8c160be35764 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:59:18.083528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e3f01-aa98-4303-bd40-8c160be35764 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:18.085914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e3f01-aa98-4303-bd40-8c160be35764 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:18.105996 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3979/7961] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:59:18.111426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1359f-c1c8-4579-9ba7-3a5568da07dc None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:18.128562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1359f-c1c8-4579-9ba7-3a5568da07dc None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:18.144138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e497852-26d8-4fe0-ac26-6ea29c9ee3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:18.144929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e497852-26d8-4fe0-ac26-6ea29c9ee3fd admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:18.145312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e497852-26d8-4fe0-ac26-6ea29c9ee3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:18.149800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e497852-26d8-4fe0-ac26-6ea29c9ee3fd admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:18.150927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e497852-26d8-4fe0-ac26-6ea29c9ee3fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:18.155348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e497852-26d8-4fe0-ac26-6ea29c9ee3fd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:18.286237 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3983/7962] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:59:18 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:59:18.287445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e3f01-aa98-4303-bd40-8c160be35764 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:18.304589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e3f01-aa98-4303-bd40-8c160be35764 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:18.455170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45b7c0-4b07-4bc2-8bed-a48265725e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:18.455859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45b7c0-4b07-4bc2-8bed-a48265725e18 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:18.456151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45b7c0-4b07-4bc2-8bed-a48265725e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:18.456437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45b7c0-4b07-4bc2-8bed-a48265725e18 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:18.457105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45b7c0-4b07-4bc2-8bed-a48265725e18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:18.459670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45b7c0-4b07-4bc2-8bed-a48265725e18 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:19.411480 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3980/7963] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:59:18 2022] POST /identity/v3/users => generated 287 bytes in 1124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:59:19.414436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e497852-26d8-4fe0-ac26-6ea29c9ee3fd admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:19.434294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e497852-26d8-4fe0-ac26-6ea29c9ee3fd admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:19.440878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dd0a0-91f2-427c-8895-3167a8ec55d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:19.441750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dd0a0-91f2-427c-8895-3167a8ec55d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:19.442172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dd0a0-91f2-427c-8895-3167a8ec55d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:19.442611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dd0a0-91f2-427c-8895-3167a8ec55d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:19.443466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5dd0a0-91f2-427c-8895-3167a8ec55d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:19.446279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5dd0a0-91f2-427c-8895-3167a8ec55d3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:19.463682 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3984/7964] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:59:19.466845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45b7c0-4b07-4bc2-8bed-a48265725e18 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:19.481878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45b7c0-4b07-4bc2-8bed-a48265725e18 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:19.487721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c61c1-562d-49ad-9d25-6b4e3f53e300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:19.489393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c61c1-562d-49ad-9d25-6b4e3f53e300 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:19.490188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c61c1-562d-49ad-9d25-6b4e3f53e300 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:19.491034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c61c1-562d-49ad-9d25-6b4e3f53e300 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:19.492307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c61c1-562d-49ad-9d25-6b4e3f53e300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:19.494562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c61c1-562d-49ad-9d25-6b4e3f53e300 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:19.513089 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3981/7965] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:59:19.517888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dd0a0-91f2-427c-8895-3167a8ec55d3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:19.555072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dd0a0-91f2-427c-8895-3167a8ec55d3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:19.581786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e9bd4-7f96-47bd-b323-1a838d129d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:19.582684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e9bd4-7f96-47bd-b323-1a838d129d0f admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:19.583328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e9bd4-7f96-47bd-b323-1a838d129d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:19.583861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e9bd4-7f96-47bd-b323-1a838d129d0f admin admin] PATH_INFO: `/v3/projects/73fd07c6375c4fca9465d351eb2ba7f6/users/32640280c29e408fbf5579d7f12a5a6b/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:19.639212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e9bd4-7f96-47bd-b323-1a838d129d0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=73fd07c6375c4fca9465d351eb2ba7f6, user_id=32640280c29e408fbf5579d7f12a5a6b, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:19.642412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e9bd4-7f96-47bd-b323-1a838d129d0f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:19.771387 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3985/7966] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:59:19 2022] PUT /identity/v3/projects/73fd07c6375c4fca9465d351eb2ba7f6/users/32640280c29e408fbf5579d7f12a5a6b/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:59:19.777532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cdae3-3eed-420c-9a66-fca902dd99e6 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:19.782715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cdae3-3eed-420c-9a66-fca902dd99e6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:19.783137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cdae3-3eed-420c-9a66-fca902dd99e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:19.835514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c61cdae3-3eed-420c-9a66-fca902dd99e6 None None] MFA Rules not processed for user `32640280c29e408fbf5579d7f12a5a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:19.836759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c61cdae3-3eed-420c-9a66-fca902dd99e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:19.963914 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3982/7967] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:59:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:19.982543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e9bd4-7f96-47bd-b323-1a838d129d0f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:19.984505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-be3e9bd4-7f96-47bd-b323-1a838d129d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:20.020186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:20.140016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e9bd4-7f96-47bd-b323-1a838d129d0f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:20.152818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edb2dd-d2df-4c8d-8fb7-a7bfd368c2e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:20.153564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edb2dd-d2df-4c8d-8fb7-a7bfd368c2e6 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:20.153929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edb2dd-d2df-4c8d-8fb7-a7bfd368c2e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:20.154294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edb2dd-d2df-4c8d-8fb7-a7bfd368c2e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:20.181111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edb2dd-d2df-4c8d-8fb7-a7bfd368c2e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:20.183071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edb2dd-d2df-4c8d-8fb7-a7bfd368c2e6 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:20.200113 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3986/7968] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:59:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:59:20.487706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436ff1f-65fa-4793-89f6-ef8b8f3a350c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:20.488815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436ff1f-65fa-4793-89f6-ef8b8f3a350c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:20.489355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436ff1f-65fa-4793-89f6-ef8b8f3a350c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:20.531347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6436ff1f-65fa-4793-89f6-ef8b8f3a350c None None] MFA Rules not processed for user `3e7ffbb437004d379258425747bf1521`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:20.533207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6436ff1f-65fa-4793-89f6-ef8b8f3a350c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:20.585811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:20.613303 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3983/7969] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:59:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:23.381255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a424b-4d8c-4e1c-b4a9-128ad852c434 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:23.381255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a424b-4d8c-4e1c-b4a9-128ad852c434 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:23.381255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a424b-4d8c-4e1c-b4a9-128ad852c434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:23.428765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-bd4a424b-4d8c-4e1c-b4a9-128ad852c434 None None] MFA Rules not processed for user `32640280c29e408fbf5579d7f12a5a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:23.430545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bd4a424b-4d8c-4e1c-b4a9-128ad852c434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:23.453052 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3987/7970] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:59:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:26.667833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436ff1f-65fa-4793-89f6-ef8b8f3a350c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:26.669920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6436ff1f-65fa-4793-89f6-ef8b8f3a350c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:26.767345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436ff1f-65fa-4793-89f6-ef8b8f3a350c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:26.774495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754452d1-cce6-40e1-bc0e-9c57a1d02f6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:26.775143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754452d1-cce6-40e1-bc0e-9c57a1d02f6b service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:26.775434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754452d1-cce6-40e1-bc0e-9c57a1d02f6b service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:26.776067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754452d1-cce6-40e1-bc0e-9c57a1d02f6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:26.777788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-754452d1-cce6-40e1-bc0e-9c57a1d02f6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:26.793134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754452d1-cce6-40e1-bc0e-9c57a1d02f6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:26.794855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754452d1-cce6-40e1-bc0e-9c57a1d02f6b service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:26.811974 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3984/7971] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:59:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:59:33.401182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=22 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:36.802008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=43 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:42.356719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a424b-4d8c-4e1c-b4a9-128ad852c434 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:42.360691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bd4a424b-4d8c-4e1c-b4a9-128ad852c434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:42.464160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a424b-4d8c-4e1c-b4a9-128ad852c434 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:42.469331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf171099-d003-46e9-9972-08aaf00399f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:42.470261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf171099-d003-46e9-9972-08aaf00399f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:42.470615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf171099-d003-46e9-9972-08aaf00399f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:42.470969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf171099-d003-46e9-9972-08aaf00399f0 admin admin] PATH_INFO: `/v3/users/52677263789a4ca8a64657b82f4a9fb5` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:42.472747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf171099-d003-46e9-9972-08aaf00399f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52677263789a4ca8a64657b82f4a9fb5)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:42.475229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf171099-d003-46e9-9972-08aaf00399f0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:42.727565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cf171099-d003-46e9-9972-08aaf00399f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52677263789a4ca8a64657b82f4a9fb5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:42.728421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cf171099-d003-46e9-9972-08aaf00399f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52677263789a4ca8a64657b82f4a9fb5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:42.738247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cf171099-d003-46e9-9972-08aaf00399f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52677263789a4ca8a64657b82f4a9fb5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:42.762188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cf171099-d003-46e9-9972-08aaf00399f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52677263789a4ca8a64657b82f4a9fb5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:42.875415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cf171099-d003-46e9-9972-08aaf00399f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52677263789a4ca8a64657b82f4a9fb5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:42.877636 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3988/7972] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:59:42 2022] DELETE /identity/v3/users/52677263789a4ca8a64657b82f4a9fb5 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:59:43.474763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754452d1-cce6-40e1-bc0e-9c57a1d02f6b service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:43.489228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754452d1-cce6-40e1-bc0e-9c57a1d02f6b service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:43.623237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d5268-480c-4457-b603-a7e0fa22406b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:43.626603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d5268-480c-4457-b603-a7e0fa22406b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:43.626603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d5268-480c-4457-b603-a7e0fa22406b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:43.626603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d5268-480c-4457-b603-a7e0fa22406b admin admin] PATH_INFO: `/v3/projects/7d6b688b57fe47029ad9fae09ae8212e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:43.626603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d5268-480c-4457-b603-a7e0fa22406b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d6b688b57fe47029ad9fae09ae8212e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:43.629498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d5268-480c-4457-b603-a7e0fa22406b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:44.011003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-987d5268-480c-4457-b603-a7e0fa22406b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d6b688b57fe47029ad9fae09ae8212e', 'request_id': 'req-987d5268-480c-4457-b603-a7e0fa22406b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:44.020381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-987d5268-480c-4457-b603-a7e0fa22406b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d6b688b57fe47029ad9fae09ae8212e', 'request_id': 'req-987d5268-480c-4457-b603-a7e0fa22406b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:44.027533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-987d5268-480c-4457-b603-a7e0fa22406b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d6b688b57fe47029ad9fae09ae8212e', 'request_id': 'req-987d5268-480c-4457-b603-a7e0fa22406b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:44.110302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-987d5268-480c-4457-b603-a7e0fa22406b admin admin] The token cache is being invalidate because project 7d6b688b57fe47029ad9fae09ae8212e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:59:44.110794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-987d5268-480c-4457-b603-a7e0fa22406b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:44.113133 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-987d5268-480c-4457-b603-a7e0fa22406b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:44.115563 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3985/7973] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:59:43 2022] DELETE /identity/v3/projects/7d6b688b57fe47029ad9fae09ae8212e => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:59:44.119409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf171099-d003-46e9-9972-08aaf00399f0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:44.121495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cf171099-d003-46e9-9972-08aaf00399f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:44.154308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf171099-d003-46e9-9972-08aaf00399f0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:44.306106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ba2dc-2499-4a76-8dac-b3a8fed8d67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:44.306722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ba2dc-2499-4a76-8dac-b3a8fed8d67c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:44.307012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ba2dc-2499-4a76-8dac-b3a8fed8d67c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:44.307294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ba2dc-2499-4a76-8dac-b3a8fed8d67c admin admin] PATH_INFO: `/v3/users/a1552fd790d342e29fa8deef441fbfc8` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:44.310293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ba2dc-2499-4a76-8dac-b3a8fed8d67c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1552fd790d342e29fa8deef441fbfc8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:44.312332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ba2dc-2499-4a76-8dac-b3a8fed8d67c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:44.342602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:44.416676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d5268-480c-4457-b603-a7e0fa22406b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:44.419047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-987d5268-480c-4457-b603-a7e0fa22406b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:44.436842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d5268-480c-4457-b603-a7e0fa22406b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:44.442674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99d88f-59ce-4be3-9608-9b82f79c0209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:44.443343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99d88f-59ce-4be3-9608-9b82f79c0209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:44.443634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99d88f-59ce-4be3-9608-9b82f79c0209 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:44.443952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99d88f-59ce-4be3-9608-9b82f79c0209 admin admin] PATH_INFO: `/v3/users/eeff42d500524a94ab13a9f85c646f73` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:44.445206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99d88f-59ce-4be3-9608-9b82f79c0209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeff42d500524a94ab13a9f85c646f73)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:44.447193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99d88f-59ce-4be3-9608-9b82f79c0209 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:44.545800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-418ba2dc-2499-4a76-8dac-b3a8fed8d67c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1552fd790d342e29fa8deef441fbfc8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:44.547057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-418ba2dc-2499-4a76-8dac-b3a8fed8d67c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1552fd790d342e29fa8deef441fbfc8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:44.560636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-418ba2dc-2499-4a76-8dac-b3a8fed8d67c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1552fd790d342e29fa8deef441fbfc8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:44.574936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-418ba2dc-2499-4a76-8dac-b3a8fed8d67c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1552fd790d342e29fa8deef441fbfc8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:44.845608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1f99d88f-59ce-4be3-9608-9b82f79c0209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeff42d500524a94ab13a9f85c646f73'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:44.847316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1f99d88f-59ce-4be3-9608-9b82f79c0209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeff42d500524a94ab13a9f85c646f73'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:44.854955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1f99d88f-59ce-4be3-9608-9b82f79c0209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeff42d500524a94ab13a9f85c646f73'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:44.864487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-418ba2dc-2499-4a76-8dac-b3a8fed8d67c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1552fd790d342e29fa8deef441fbfc8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:44.869760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1f99d88f-59ce-4be3-9608-9b82f79c0209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeff42d500524a94ab13a9f85c646f73'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:44.870953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1f99d88f-59ce-4be3-9608-9b82f79c0209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeff42d500524a94ab13a9f85c646f73'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:44.874435 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3989/7974] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:59:44 2022] DELETE /identity/v3/users/a1552fd790d342e29fa8deef441fbfc8 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:59:44.997366 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3986/7975] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:59:44 2022] DELETE /identity/v3/users/eeff42d500524a94ab13a9f85c646f73 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:59:45.003644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03d5b6-b4b1-4a10-9ed2-6b9c9346a70b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:45.004134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03d5b6-b4b1-4a10-9ed2-6b9c9346a70b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:45.004569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03d5b6-b4b1-4a10-9ed2-6b9c9346a70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:45.040898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8e03d5b6-b4b1-4a10-9ed2-6b9c9346a70b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:45.042736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8e03d5b6-b4b1-4a10-9ed2-6b9c9346a70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:45.165606 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3990/7976] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:45.176434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99d88f-59ce-4be3-9608-9b82f79c0209 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:45.177916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1f99d88f-59ce-4be3-9608-9b82f79c0209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:45.199242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:45.270287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03d5b6-b4b1-4a10-9ed2-6b9c9346a70b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:45.272094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8e03d5b6-b4b1-4a10-9ed2-6b9c9346a70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:45.309105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03d5b6-b4b1-4a10-9ed2-6b9c9346a70b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:45.313696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99d88f-59ce-4be3-9608-9b82f79c0209 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:45.322129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67422b-187b-48cb-9f22-9fba543996ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:45.322793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67422b-187b-48cb-9f22-9fba543996ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:45.323076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67422b-187b-48cb-9f22-9fba543996ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:45.323238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77388680-e83d-43ef-ae8d-2658f4fa57ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:45.324358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77388680-e83d-43ef-ae8d-2658f4fa57ce service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:45.325017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77388680-e83d-43ef-ae8d-2658f4fa57ce service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:45.325444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77388680-e83d-43ef-ae8d-2658f4fa57ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:45.325604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67422b-187b-48cb-9f22-9fba543996ef admin admin] PATH_INFO: `/v3/projects/57742c85c58c458495524da0b5f78f93` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:45.334179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67422b-187b-48cb-9f22-9fba543996ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=57742c85c58c458495524da0b5f78f93)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:45.336503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67422b-187b-48cb-9f22-9fba543996ef admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:45.357207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77388680-e83d-43ef-ae8d-2658f4fa57ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:45.357207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77388680-e83d-43ef-ae8d-2658f4fa57ce service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:45.377513 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3987/7977] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:59:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:59:45.537610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ad67422b-187b-48cb-9f22-9fba543996ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57742c85c58c458495524da0b5f78f93', 'request_id': 'req-ad67422b-187b-48cb-9f22-9fba543996ef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:45.616359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ad67422b-187b-48cb-9f22-9fba543996ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57742c85c58c458495524da0b5f78f93', 'request_id': 'req-ad67422b-187b-48cb-9f22-9fba543996ef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:45.623758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ad67422b-187b-48cb-9f22-9fba543996ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57742c85c58c458495524da0b5f78f93', 'request_id': 'req-ad67422b-187b-48cb-9f22-9fba543996ef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:45.637931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ad67422b-187b-48cb-9f22-9fba543996ef admin admin] The token cache is being invalidate because project 57742c85c58c458495524da0b5f78f93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:59:45.638527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ad67422b-187b-48cb-9f22-9fba543996ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:45.639498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ad67422b-187b-48cb-9f22-9fba543996ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:45.641295 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3991/7978] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:59:45 2022] DELETE /identity/v3/projects/57742c85c58c458495524da0b5f78f93 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:59:45.687933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cbf91-a2b2-4c36-aa6e-883dd234a34c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:45.688219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cbf91-a2b2-4c36-aa6e-883dd234a34c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:45.688679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cbf91-a2b2-4c36-aa6e-883dd234a34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:45.851083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a39cbf91-a2b2-4c36-aa6e-883dd234a34c None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:45.855088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a39cbf91-a2b2-4c36-aa6e-883dd234a34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:45.960336 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3988/7979] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:59:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:46.218812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67422b-187b-48cb-9f22-9fba543996ef admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:46.220503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ad67422b-187b-48cb-9f22-9fba543996ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:46.238094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cbf91-a2b2-4c36-aa6e-883dd234a34c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:46.239548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a39cbf91-a2b2-4c36-aa6e-883dd234a34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:46.289328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:46.352111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cbf91-a2b2-4c36-aa6e-883dd234a34c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:46.356291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a12855-78eb-48e2-8402-a0a8be70f8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:46.357034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a12855-78eb-48e2-8402-a0a8be70f8ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:46.357409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a12855-78eb-48e2-8402-a0a8be70f8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:46.357891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a12855-78eb-48e2-8402-a0a8be70f8ea admin admin] PATH_INFO: `/v3/projects/8dbfda9d894a49e68981501d2632e27a` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:46.359324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a12855-78eb-48e2-8402-a0a8be70f8ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dbfda9d894a49e68981501d2632e27a)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:46.361257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a12855-78eb-48e2-8402-a0a8be70f8ea admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:46.365364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:46.381006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67422b-187b-48cb-9f22-9fba543996ef admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:46.391367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf4da5-efc6-484c-b245-87163f2126ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:46.392615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf4da5-efc6-484c-b245-87163f2126ea service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:46.392904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf4da5-efc6-484c-b245-87163f2126ea service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:46.393179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf4da5-efc6-484c-b245-87163f2126ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:46.412210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf4da5-efc6-484c-b245-87163f2126ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:46.414576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf4da5-efc6-484c-b245-87163f2126ea service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:46.423005 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3992/7980] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:59:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:59:46.492042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e7a12855-78eb-48e2-8402-a0a8be70f8ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dbfda9d894a49e68981501d2632e27a', 'request_id': 'req-e7a12855-78eb-48e2-8402-a0a8be70f8ea'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:46.501068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e7a12855-78eb-48e2-8402-a0a8be70f8ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dbfda9d894a49e68981501d2632e27a', 'request_id': 'req-e7a12855-78eb-48e2-8402-a0a8be70f8ea'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:46.513728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e7a12855-78eb-48e2-8402-a0a8be70f8ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dbfda9d894a49e68981501d2632e27a', 'request_id': 'req-e7a12855-78eb-48e2-8402-a0a8be70f8ea'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:46.529783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf4da5-efc6-484c-b245-87163f2126ea service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:46.529783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fdaf4da5-efc6-484c-b245-87163f2126ea service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:46.634659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e7a12855-78eb-48e2-8402-a0a8be70f8ea admin admin] The token cache is being invalidate because project 8dbfda9d894a49e68981501d2632e27a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:59:46.635217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e7a12855-78eb-48e2-8402-a0a8be70f8ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:46.636227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e7a12855-78eb-48e2-8402-a0a8be70f8ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:46.647580 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3989/7981] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:59:46 2022] DELETE /identity/v3/projects/8dbfda9d894a49e68981501d2632e27a => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:59:46.655966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801db3a3-383b-45cf-9833-a297064079f9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:46.656717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801db3a3-383b-45cf-9833-a297064079f9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:46.657198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801db3a3-383b-45cf-9833-a297064079f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:46.676449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf4da5-efc6-484c-b245-87163f2126ea service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:46.713115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-801db3a3-383b-45cf-9833-a297064079f9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:46.715957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-801db3a3-383b-45cf-9833-a297064079f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:46.831439 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3990/7982] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:46.841627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a549a-4148-4035-a8f5-7ea1dcd66431 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:46.841937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a549a-4148-4035-a8f5-7ea1dcd66431 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:46.842223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a549a-4148-4035-a8f5-7ea1dcd66431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:46.853051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e94bb-4d65-4113-a8ba-19f20db2d2ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:46.860849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e94bb-4d65-4113-a8ba-19f20db2d2ef service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:46.860849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e94bb-4d65-4113-a8ba-19f20db2d2ef service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:46.860849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e94bb-4d65-4113-a8ba-19f20db2d2ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:46.860849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c44e94bb-4d65-4113-a8ba-19f20db2d2ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:46.878936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e94bb-4d65-4113-a8ba-19f20db2d2ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:46.882082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e94bb-4d65-4113-a8ba-19f20db2d2ef service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:46.885483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ce9a549a-4148-4035-a8f5-7ea1dcd66431 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:46.886764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ce9a549a-4148-4035-a8f5-7ea1dcd66431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:46.905036 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3991/7983] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:46.908335 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a549a-4148-4035-a8f5-7ea1dcd66431 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:46.908461 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3993/7984] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:59:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:59:46.931028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a549a-4148-4035-a8f5-7ea1dcd66431 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:46.934351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd872a4-26e4-4756-ae36-be3f6780869a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:46.935318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd872a4-26e4-4756-ae36-be3f6780869a admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:46.935606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd872a4-26e4-4756-ae36-be3f6780869a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:46.936061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd872a4-26e4-4756-ae36-be3f6780869a admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:46.937082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd872a4-26e4-4756-ae36-be3f6780869a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:59:46.937458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd872a4-26e4-4756-ae36-be3f6780869a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:46.939118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd872a4-26e4-4756-ae36-be3f6780869a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:46.963938 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3992/7985] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:59:46.968583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e94bb-4d65-4113-a8ba-19f20db2d2ef service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:46.999701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e94bb-4d65-4113-a8ba-19f20db2d2ef service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:47.027088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8380e8-27fe-4a50-a9c3-e4eaa4af9d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:47.027723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8380e8-27fe-4a50-a9c3-e4eaa4af9d59 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:47.030242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8380e8-27fe-4a50-a9c3-e4eaa4af9d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:47.030444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8380e8-27fe-4a50-a9c3-e4eaa4af9d59 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:47.031251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8380e8-27fe-4a50-a9c3-e4eaa4af9d59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:47.038327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8380e8-27fe-4a50-a9c3-e4eaa4af9d59 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:47.174251 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3994/7986] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:59:46 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:59:47.176202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd872a4-26e4-4756-ae36-be3f6780869a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:47.186884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd872a4-26e4-4756-ae36-be3f6780869a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:47.299531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe22da-c91e-4e14-b2e9-56d26faaf1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:47.299531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe22da-c91e-4e14-b2e9-56d26faaf1ca admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:47.299531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe22da-c91e-4e14-b2e9-56d26faaf1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:47.299531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe22da-c91e-4e14-b2e9-56d26faaf1ca admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:47.300457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe22da-c91e-4e14-b2e9-56d26faaf1ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:47.301343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe22da-c91e-4e14-b2e9-56d26faaf1ca admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:47.356557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8380e8-27fe-4a50-a9c3-e4eaa4af9d59 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:47.358553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-af8380e8-27fe-4a50-a9c3-e4eaa4af9d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:47.398094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:47.420625 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3993/7987] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:59:47 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:59:47.425564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe22da-c91e-4e14-b2e9-56d26faaf1ca admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:47.436290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:47.447270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe22da-c91e-4e14-b2e9-56d26faaf1ca admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:47.460225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf42bc-6c51-4d00-b359-2ced3a368918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:47.460860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf42bc-6c51-4d00-b359-2ced3a368918 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:47.461146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf42bc-6c51-4d00-b359-2ced3a368918 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:47.461432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf42bc-6c51-4d00-b359-2ced3a368918 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:47.462103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf42bc-6c51-4d00-b359-2ced3a368918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:47.465439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf42bc-6c51-4d00-b359-2ced3a368918 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:47.469919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8380e8-27fe-4a50-a9c3-e4eaa4af9d59 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:47.473917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4e842-1400-4212-9ac0-54cc77fc8f89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:47.475245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4e842-1400-4212-9ac0-54cc77fc8f89 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:47.475536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4e842-1400-4212-9ac0-54cc77fc8f89 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:47.475817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4e842-1400-4212-9ac0-54cc77fc8f89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:47.477849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d1c4e842-1400-4212-9ac0-54cc77fc8f89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:47.490398 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3994/7988] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:59:47.492951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf42bc-6c51-4d00-b359-2ced3a368918 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:47.500705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4e842-1400-4212-9ac0-54cc77fc8f89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:47.504937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4e842-1400-4212-9ac0-54cc77fc8f89 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:47.514901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf42bc-6c51-4d00-b359-2ced3a368918 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:47.517287 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3995/7989] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:59:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:59:47.537877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ec981-07a3-46c0-9aa2-0d8d4b6e20df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:47.542534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ec981-07a3-46c0-9aa2-0d8d4b6e20df admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:47.542534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ec981-07a3-46c0-9aa2-0d8d4b6e20df admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:47.542534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ec981-07a3-46c0-9aa2-0d8d4b6e20df admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:47.544365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ec981-07a3-46c0-9aa2-0d8d4b6e20df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:47.546006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ec981-07a3-46c0-9aa2-0d8d4b6e20df admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:47.607343 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3995/7990] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:59:47.607963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4e842-1400-4212-9ac0-54cc77fc8f89 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:47.627459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4e842-1400-4212-9ac0-54cc77fc8f89 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:47.634835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf21096-b1c4-46ae-8d95-c2581b1ad926 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:47.635574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf21096-b1c4-46ae-8d95-c2581b1ad926 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:47.636058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf21096-b1c4-46ae-8d95-c2581b1ad926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:47.654122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5fd22-016c-4507-be7c-b4a2c79570e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:47.654819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5fd22-016c-4507-be7c-b4a2c79570e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:47.658555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5fd22-016c-4507-be7c-b4a2c79570e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:47.661143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5fd22-016c-4507-be7c-b4a2c79570e2 admin admin] PATH_INFO: `/v3/projects/1e8f4fc6030b431ead45ee3887231941/users/1ec5d932c25f4093a3a3a7873ba9cd60/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:47.687286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-baf21096-b1c4-46ae-8d95-c2581b1ad926 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:47.691472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-baf21096-b1c4-46ae-8d95-c2581b1ad926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:47.713136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5fd22-016c-4507-be7c-b4a2c79570e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e8f4fc6030b431ead45ee3887231941, user_id=1ec5d932c25f4093a3a3a7873ba9cd60, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:47.717369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5fd22-016c-4507-be7c-b4a2c79570e2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:47.793000 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3996/7991] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:59:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:47.794925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf21096-b1c4-46ae-8d95-c2581b1ad926 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:47.821902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf21096-b1c4-46ae-8d95-c2581b1ad926 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:47.827315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b51214-a499-48fe-b235-44b35ea5c4d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:47.828111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b51214-a499-48fe-b235-44b35ea5c4d3 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:47.828407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b51214-a499-48fe-b235-44b35ea5c4d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:47.828683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b51214-a499-48fe-b235-44b35ea5c4d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:47.830593 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-18b51214-a499-48fe-b235-44b35ea5c4d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:47.850166 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3996/7992] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:59:47 2022] PUT /identity/v3/projects/1e8f4fc6030b431ead45ee3887231941/users/1ec5d932c25f4093a3a3a7873ba9cd60/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:59:47.851701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5fd22-016c-4507-be7c-b4a2c79570e2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:47.853550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5ea5fd22-016c-4507-be7c-b4a2c79570e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:47.997222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5fd22-016c-4507-be7c-b4a2c79570e2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:48.007335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b202d-6d18-48a6-b55f-9e135c7d6004 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:48.008302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b202d-6d18-48a6-b55f-9e135c7d6004 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:48.008587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b202d-6d18-48a6-b55f-9e135c7d6004 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:48.009056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b202d-6d18-48a6-b55f-9e135c7d6004 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:48.037595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b51214-a499-48fe-b235-44b35ea5c4d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:48.039238 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b51214-a499-48fe-b235-44b35ea5c4d3 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:48.067445 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3997/7993] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:59:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:59:48.068845 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123532ad-fc0b-46ac-922d-fdb560db1678 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:48.069213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123532ad-fc0b-46ac-922d-fdb560db1678 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:48.069609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123532ad-fc0b-46ac-922d-fdb560db1678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:48.090017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b202d-6d18-48a6-b55f-9e135c7d6004 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:48.092066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b202d-6d18-48a6-b55f-9e135c7d6004 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:48.104778 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3997/7994] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:59:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:59:48.125200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-123532ad-fc0b-46ac-922d-fdb560db1678 None None] MFA Rules not processed for user `1ec5d932c25f4093a3a3a7873ba9cd60`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:48.127733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-123532ad-fc0b-46ac-922d-fdb560db1678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:48.203128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:48.228791 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3998/7995] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:59:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:48.250490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b202d-6d18-48a6-b55f-9e135c7d6004 service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:48.252316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e62b202d-6d18-48a6-b55f-9e135c7d6004 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:48.328407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:48.384633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b202d-6d18-48a6-b55f-9e135c7d6004 service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:48.392662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfa35a-25b5-452c-92b4-fbd3aca47036 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:48.392662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfa35a-25b5-452c-92b4-fbd3aca47036 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:48.392662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfa35a-25b5-452c-92b4-fbd3aca47036 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:48.392662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfa35a-25b5-452c-92b4-fbd3aca47036 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:48.437124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfa35a-25b5-452c-92b4-fbd3aca47036 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:48.437124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfa35a-25b5-452c-92b4-fbd3aca47036 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:48.444136 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3998/7996] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:59:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:59:49.147204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d06bb5-8206-4da9-8912-35958545a602 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:49.147772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d06bb5-8206-4da9-8912-35958545a602 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:49.147772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d06bb5-8206-4da9-8912-35958545a602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:49.174158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-75d06bb5-8206-4da9-8912-35958545a602 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:49.176473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-75d06bb5-8206-4da9-8912-35958545a602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:49.184683 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 3999/7997] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 03:59:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:49.200840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfa35a-25b5-452c-92b4-fbd3aca47036 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:49.215390 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfa35a-25b5-452c-92b4-fbd3aca47036 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:49.225851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce068f3-fe48-4ec9-9f4a-a46adb6ae179 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:49.225851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce068f3-fe48-4ec9-9f4a-a46adb6ae179 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:49.225851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce068f3-fe48-4ec9-9f4a-a46adb6ae179 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:49.225851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce068f3-fe48-4ec9-9f4a-a46adb6ae179 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:49.231360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce068f3-fe48-4ec9-9f4a-a46adb6ae179 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:49.232973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce068f3-fe48-4ec9-9f4a-a46adb6ae179 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:49.242431 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 3999/7998] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:59:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:59:49.605338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d06bb5-8206-4da9-8912-35958545a602 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:49.606829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-75d06bb5-8206-4da9-8912-35958545a602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:49.747642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d06bb5-8206-4da9-8912-35958545a602 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:49.757058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c106831-ecd5-459b-be9d-3d749cfd2722 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:49.758092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c106831-ecd5-459b-be9d-3d749cfd2722 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:49.762630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c106831-ecd5-459b-be9d-3d749cfd2722 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:49.762630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c106831-ecd5-459b-be9d-3d749cfd2722 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:49.762630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3c106831-ecd5-459b-be9d-3d749cfd2722 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:49.780164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c106831-ecd5-459b-be9d-3d749cfd2722 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:49.781877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c106831-ecd5-459b-be9d-3d749cfd2722 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:49.795818 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4000/7999] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:59:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:59:49.887551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce068f3-fe48-4ec9-9f4a-a46adb6ae179 service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:49.889126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4ce068f3-fe48-4ec9-9f4a-a46adb6ae179 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:49.988202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce068f3-fe48-4ec9-9f4a-a46adb6ae179 service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:49.995340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d601d-2a01-422f-affb-a25f614dd302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:49.996208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d601d-2a01-422f-affb-a25f614dd302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:50.004698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d601d-2a01-422f-affb-a25f614dd302 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:50.005698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d601d-2a01-422f-affb-a25f614dd302 admin admin] PATH_INFO: `/v3/users/6dcaedfc64874c1480b2573073897460` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:50.011244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d601d-2a01-422f-affb-a25f614dd302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dcaedfc64874c1480b2573073897460)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:50.011244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d601d-2a01-422f-affb-a25f614dd302 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:50.189623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350f2b7-c800-4d1b-9564-ec8b52e070f6 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:50.189623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350f2b7-c800-4d1b-9564-ec8b52e070f6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:50.189623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350f2b7-c800-4d1b-9564-ec8b52e070f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:50.221012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4350f2b7-c800-4d1b-9564-ec8b52e070f6 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:50.221666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7b4d601d-2a01-422f-affb-a25f614dd302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dcaedfc64874c1480b2573073897460'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:50.222487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7b4d601d-2a01-422f-affb-a25f614dd302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dcaedfc64874c1480b2573073897460'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:50.222980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4350f2b7-c800-4d1b-9564-ec8b52e070f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:50.231844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7b4d601d-2a01-422f-affb-a25f614dd302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dcaedfc64874c1480b2573073897460'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:50.238628 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4001/8000] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 03:59:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:50.250608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7b4d601d-2a01-422f-affb-a25f614dd302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dcaedfc64874c1480b2573073897460'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:50.252634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350f2b7-c800-4d1b-9564-ec8b52e070f6 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:50.255043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4350f2b7-c800-4d1b-9564-ec8b52e070f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:50.275672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350f2b7-c800-4d1b-9564-ec8b52e070f6 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:50.280934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8226f-e80c-4bb5-8d98-e71c50f0ee72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:50.281551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8226f-e80c-4bb5-8d98-e71c50f0ee72 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:50.281834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8226f-e80c-4bb5-8d98-e71c50f0ee72 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:50.282147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8226f-e80c-4bb5-8d98-e71c50f0ee72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:50.290835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8226f-e80c-4bb5-8d98-e71c50f0ee72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:50.296957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8226f-e80c-4bb5-8d98-e71c50f0ee72 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:50.316134 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4002/8001] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 03:59:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 03:59:50.335941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7b4d601d-2a01-422f-affb-a25f614dd302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dcaedfc64874c1480b2573073897460'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:50.342212 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4000/8002] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:59:49 2022] DELETE /identity/v3/users/6dcaedfc64874c1480b2573073897460 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:59:50.348724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efca33-4637-45b1-99f8-4bc7dc0520d1 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:50.349129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efca33-4637-45b1-99f8-4bc7dc0520d1 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:50.349530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efca33-4637-45b1-99f8-4bc7dc0520d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:50.374260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-82efca33-4637-45b1-99f8-4bc7dc0520d1 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:50.375978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-82efca33-4637-45b1-99f8-4bc7dc0520d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:50.487514 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4003/8003] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:50.497185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d601d-2a01-422f-affb-a25f614dd302 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:50.498938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7b4d601d-2a01-422f-affb-a25f614dd302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:50.575409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d601d-2a01-422f-affb-a25f614dd302 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:50.579150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112036f-91aa-4b86-992a-30246801dedc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:50.579788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112036f-91aa-4b86-992a-30246801dedc service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:50.580070 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112036f-91aa-4b86-992a-30246801dedc service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:50.580344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112036f-91aa-4b86-992a-30246801dedc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:50.587823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:50.599028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112036f-91aa-4b86-992a-30246801dedc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:50.599028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112036f-91aa-4b86-992a-30246801dedc service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:50.606469 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4001/8004] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:59:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:59:50.905950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efca33-4637-45b1-99f8-4bc7dc0520d1 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:50.908886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-82efca33-4637-45b1-99f8-4bc7dc0520d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:50.923970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efca33-4637-45b1-99f8-4bc7dc0520d1 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:50.938752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01f76b-5b60-465f-b025-976d29863c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:50.938752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01f76b-5b60-465f-b025-976d29863c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:50.939150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01f76b-5b60-465f-b025-976d29863c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:50.939546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01f76b-5b60-465f-b025-976d29863c21 admin admin] PATH_INFO: `/v3/projects/95314166fe5f49e583b72cc99f79c9d0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:50.946564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01f76b-5b60-465f-b025-976d29863c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95314166fe5f49e583b72cc99f79c9d0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:50.946564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01f76b-5b60-465f-b025-976d29863c21 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:51.057137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:51.058819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fb01f76b-5b60-465f-b025-976d29863c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95314166fe5f49e583b72cc99f79c9d0', 'request_id': 'req-fb01f76b-5b60-465f-b025-976d29863c21'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:51.067875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fb01f76b-5b60-465f-b025-976d29863c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95314166fe5f49e583b72cc99f79c9d0', 'request_id': 'req-fb01f76b-5b60-465f-b025-976d29863c21'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:51.074538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fb01f76b-5b60-465f-b025-976d29863c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95314166fe5f49e583b72cc99f79c9d0', 'request_id': 'req-fb01f76b-5b60-465f-b025-976d29863c21'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:51.169966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fb01f76b-5b60-465f-b025-976d29863c21 admin admin] The token cache is being invalidate because project 95314166fe5f49e583b72cc99f79c9d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:59:51.169966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fb01f76b-5b60-465f-b025-976d29863c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:51.170192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fb01f76b-5b60-465f-b025-976d29863c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:51.171802 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4004/8005] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:59:50 2022] DELETE /identity/v3/projects/95314166fe5f49e583b72cc99f79c9d0 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:59:51.177154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465ae4c-ad7e-4da2-a36a-2ce5bcca89ca None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:51.178006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465ae4c-ad7e-4da2-a36a-2ce5bcca89ca None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:51.178397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465ae4c-ad7e-4da2-a36a-2ce5bcca89ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:51.212112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e465ae4c-ad7e-4da2-a36a-2ce5bcca89ca None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:51.213348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e465ae4c-ad7e-4da2-a36a-2ce5bcca89ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:51.290647 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4002/8006] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:51.301635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031df68-2ec5-459b-9619-e73d2656ebb0 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:51.302183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031df68-2ec5-459b-9619-e73d2656ebb0 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:51.302319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031df68-2ec5-459b-9619-e73d2656ebb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:51.323285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1031df68-2ec5-459b-9619-e73d2656ebb0 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:51.324646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1031df68-2ec5-459b-9619-e73d2656ebb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:51.333021 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4005/8007] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:51.337662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465ae4c-ad7e-4da2-a36a-2ce5bcca89ca None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:51.352513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465ae4c-ad7e-4da2-a36a-2ce5bcca89ca None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:51.357665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef7eaf-91c3-46fa-984a-1555bb682876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:51.358401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef7eaf-91c3-46fa-984a-1555bb682876 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:51.358746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef7eaf-91c3-46fa-984a-1555bb682876 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:51.362207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef7eaf-91c3-46fa-984a-1555bb682876 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:51.362207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef7eaf-91c3-46fa-984a-1555bb682876 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:59:51.362207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef7eaf-91c3-46fa-984a-1555bb682876 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:51.362207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef7eaf-91c3-46fa-984a-1555bb682876 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:51.378088 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4003/8008] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 03:59:51.379365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031df68-2ec5-459b-9619-e73d2656ebb0 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:51.388660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031df68-2ec5-459b-9619-e73d2656ebb0 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:51.393663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78f9bf-4a2e-411e-9d43-334c1afb277c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:51.394432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78f9bf-4a2e-411e-9d43-334c1afb277c admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:51.394786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78f9bf-4a2e-411e-9d43-334c1afb277c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:51.395128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78f9bf-4a2e-411e-9d43-334c1afb277c admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:51.395854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78f9bf-4a2e-411e-9d43-334c1afb277c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:51.397820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78f9bf-4a2e-411e-9d43-334c1afb277c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:51.532586 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4006/8009] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:59:51 2022] POST /identity/v3/projects => generated 367 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:59:51.536045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef7eaf-91c3-46fa-984a-1555bb682876 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:51.555382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef7eaf-91c3-46fa-984a-1555bb682876 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:51.624354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53373d-6936-4d10-8256-69a4d1bd530c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:51.624966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53373d-6936-4d10-8256-69a4d1bd530c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:51.627280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53373d-6936-4d10-8256-69a4d1bd530c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:51.627280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53373d-6936-4d10-8256-69a4d1bd530c admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:51.627280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53373d-6936-4d10-8256-69a4d1bd530c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:51.628736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53373d-6936-4d10-8256-69a4d1bd530c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:51.710760 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4004/8010] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:59:51 2022] POST /identity/v3/users => generated 284 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:59:51.720378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78f9bf-4a2e-411e-9d43-334c1afb277c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:51.743547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78f9bf-4a2e-411e-9d43-334c1afb277c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:51.751851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80b9f6-fd91-419d-8a90-e2785a706c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:51.752865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80b9f6-fd91-419d-8a90-e2785a706c35 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:51.753923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80b9f6-fd91-419d-8a90-e2785a706c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:51.754120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80b9f6-fd91-419d-8a90-e2785a706c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:51.755382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80b9f6-fd91-419d-8a90-e2785a706c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:51.758018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80b9f6-fd91-419d-8a90-e2785a706c35 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:51.778428 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4007/8011] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:59:51.797514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53373d-6936-4d10-8256-69a4d1bd530c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:51.809097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53373d-6936-4d10-8256-69a4d1bd530c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:51.826876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf932e4f-e412-4e69-ac5e-2bd8d5e61eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:51.827552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf932e4f-e412-4e69-ac5e-2bd8d5e61eac admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:51.828167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf932e4f-e412-4e69-ac5e-2bd8d5e61eac admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:51.828447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf932e4f-e412-4e69-ac5e-2bd8d5e61eac admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:51.829111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf932e4f-e412-4e69-ac5e-2bd8d5e61eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:51.832492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf932e4f-e412-4e69-ac5e-2bd8d5e61eac admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:51.858079 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4005/8012] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:59:51.859734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80b9f6-fd91-419d-8a90-e2785a706c35 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:51.874740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80b9f6-fd91-419d-8a90-e2785a706c35 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:51.881374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ad77d-1a45-4ab3-89f3-f9b6d181386a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:51.882192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ad77d-1a45-4ab3-89f3-f9b6d181386a admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:51.882573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ad77d-1a45-4ab3-89f3-f9b6d181386a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:51.882949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ad77d-1a45-4ab3-89f3-f9b6d181386a admin admin] PATH_INFO: `/v3/projects/da9ab3a9f44843289cc2b3e89ca19da7/users/50c3203b7fe7497b951bf2a62cfa2bef/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:51.902297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ad77d-1a45-4ab3-89f3-f9b6d181386a admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9ab3a9f44843289cc2b3e89ca19da7, user_id=50c3203b7fe7497b951bf2a62cfa2bef, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:51.911987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ad77d-1a45-4ab3-89f3-f9b6d181386a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:52.006265 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4008/8013] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:59:51 2022] PUT /identity/v3/projects/da9ab3a9f44843289cc2b3e89ca19da7/users/50c3203b7fe7497b951bf2a62cfa2bef/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 03:59:52.013745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18776b19-d17e-4569-8ebb-eae17c837403 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:52.014306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18776b19-d17e-4569-8ebb-eae17c837403 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:52.014727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18776b19-d17e-4569-8ebb-eae17c837403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:52.049592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-18776b19-d17e-4569-8ebb-eae17c837403 None None] MFA Rules not processed for user `50c3203b7fe7497b951bf2a62cfa2bef`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:52.051401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-18776b19-d17e-4569-8ebb-eae17c837403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:52.108676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:52.137708 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4006/8014] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:59:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 03:59:52.145299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ad77d-1a45-4ab3-89f3-f9b6d181386a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:52.148654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ca3ad77d-1a45-4ab3-89f3-f9b6d181386a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:52.217867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ad77d-1a45-4ab3-89f3-f9b6d181386a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:52.222947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcaa1e-d79a-44d4-970c-04bdf6c366bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:52.223442 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcaa1e-d79a-44d4-970c-04bdf6c366bb service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:52.223630 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcaa1e-d79a-44d4-970c-04bdf6c366bb service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:52.223895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcaa1e-d79a-44d4-970c-04bdf6c366bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:52.234394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcaa1e-d79a-44d4-970c-04bdf6c366bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:52.235825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcaa1e-d79a-44d4-970c-04bdf6c366bb service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:52.252944 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4009/8015] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:59:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:59:55.622855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18776b19-d17e-4569-8ebb-eae17c837403 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:55.626771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-18776b19-d17e-4569-8ebb-eae17c837403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:55.768325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18776b19-d17e-4569-8ebb-eae17c837403 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:55.781149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c34e2-44fa-47f6-8e20-285527dd5c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:55.781742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c34e2-44fa-47f6-8e20-285527dd5c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:55.782202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c34e2-44fa-47f6-8e20-285527dd5c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:55.782492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c34e2-44fa-47f6-8e20-285527dd5c07 admin admin] PATH_INFO: `/v3/users/32640280c29e408fbf5579d7f12a5a6b` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:55.783668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c34e2-44fa-47f6-8e20-285527dd5c07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32640280c29e408fbf5579d7f12a5a6b)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:55.787133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c34e2-44fa-47f6-8e20-285527dd5c07 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:56.111083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fa3c34e2-44fa-47f6-8e20-285527dd5c07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32640280c29e408fbf5579d7f12a5a6b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:56.111887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fa3c34e2-44fa-47f6-8e20-285527dd5c07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32640280c29e408fbf5579d7f12a5a6b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:56.131581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fa3c34e2-44fa-47f6-8e20-285527dd5c07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32640280c29e408fbf5579d7f12a5a6b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:56.143107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fa3c34e2-44fa-47f6-8e20-285527dd5c07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32640280c29e408fbf5579d7f12a5a6b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:56.245321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fa3c34e2-44fa-47f6-8e20-285527dd5c07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32640280c29e408fbf5579d7f12a5a6b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:56.255497 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4007/8016] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:59:55 2022] DELETE /identity/v3/users/32640280c29e408fbf5579d7f12a5a6b => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:59:56.262548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86244045-eaf4-4e5d-94a1-b80882ba3d55 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:56.262548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86244045-eaf4-4e5d-94a1-b80882ba3d55 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:56.262548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86244045-eaf4-4e5d-94a1-b80882ba3d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:56.314337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-86244045-eaf4-4e5d-94a1-b80882ba3d55 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:56.315644 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-86244045-eaf4-4e5d-94a1-b80882ba3d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:56.459069 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4010/8017] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:56.466153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c34e2-44fa-47f6-8e20-285527dd5c07 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:56.469505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fa3c34e2-44fa-47f6-8e20-285527dd5c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:56.603783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c34e2-44fa-47f6-8e20-285527dd5c07 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:56.611682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a075de-7657-4734-b349-3effa6f6de6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:56.612368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a075de-7657-4734-b349-3effa6f6de6a service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:56.613184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a075de-7657-4734-b349-3effa6f6de6a service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:56.613461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a075de-7657-4734-b349-3effa6f6de6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:56.636919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a075de-7657-4734-b349-3effa6f6de6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:56.638459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a075de-7657-4734-b349-3effa6f6de6a service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:56.658403 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4008/8018] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 03:59:57.068447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86244045-eaf4-4e5d-94a1-b80882ba3d55 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:57.070796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-86244045-eaf4-4e5d-94a1-b80882ba3d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:57.092662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86244045-eaf4-4e5d-94a1-b80882ba3d55 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:57.115338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74b0db-7510-4e6f-bdbf-a23095ac3aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:57.115338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74b0db-7510-4e6f-bdbf-a23095ac3aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:57.115338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74b0db-7510-4e6f-bdbf-a23095ac3aba admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:57.115338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74b0db-7510-4e6f-bdbf-a23095ac3aba admin admin] PATH_INFO: `/v3/projects/73fd07c6375c4fca9465d351eb2ba7f6` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:57.115650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74b0db-7510-4e6f-bdbf-a23095ac3aba admin admin] RBAC: Authorizing `identity:delete_project(project_id=73fd07c6375c4fca9465d351eb2ba7f6)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:57.115650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74b0db-7510-4e6f-bdbf-a23095ac3aba admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:57.137530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:57.343876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8a74b0db-7510-4e6f-bdbf-a23095ac3aba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73fd07c6375c4fca9465d351eb2ba7f6', 'request_id': 'req-8a74b0db-7510-4e6f-bdbf-a23095ac3aba'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:57.357877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8a74b0db-7510-4e6f-bdbf-a23095ac3aba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73fd07c6375c4fca9465d351eb2ba7f6', 'request_id': 'req-8a74b0db-7510-4e6f-bdbf-a23095ac3aba'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:57.366667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8a74b0db-7510-4e6f-bdbf-a23095ac3aba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73fd07c6375c4fca9465d351eb2ba7f6', 'request_id': 'req-8a74b0db-7510-4e6f-bdbf-a23095ac3aba'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:57.467091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8a74b0db-7510-4e6f-bdbf-a23095ac3aba admin admin] The token cache is being invalidate because project 73fd07c6375c4fca9465d351eb2ba7f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 03:59:57.467500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8a74b0db-7510-4e6f-bdbf-a23095ac3aba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:57.468494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-8a74b0db-7510-4e6f-bdbf-a23095ac3aba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 03:59:57.471542 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4011/8019] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:59:57 2022] DELETE /identity/v3/projects/73fd07c6375c4fca9465d351eb2ba7f6 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:59:57.476895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca749cd-fcd7-49c1-b848-9f83319b2e2a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:57.477305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca749cd-fcd7-49c1-b848-9f83319b2e2a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:57.477591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca749cd-fcd7-49c1-b848-9f83319b2e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:57.500782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5ca749cd-fcd7-49c1-b848-9f83319b2e2a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:57.501945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5ca749cd-fcd7-49c1-b848-9f83319b2e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:57.508029 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:57.633873 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4009/8020] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:57.641481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8c1da-b382-4190-a5b9-4d2d3ee8dad6 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:57.641777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8c1da-b382-4190-a5b9-4d2d3ee8dad6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:57.642142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8c1da-b382-4190-a5b9-4d2d3ee8dad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:57.683129 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3fc8c1da-b382-4190-a5b9-4d2d3ee8dad6 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:57.684651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3fc8c1da-b382-4190-a5b9-4d2d3ee8dad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:57.711940 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4012/8021] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:57.718145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca749cd-fcd7-49c1-b848-9f83319b2e2a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:57.742997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca749cd-fcd7-49c1-b848-9f83319b2e2a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:57.756694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30dd032-fe2e-4832-9bc6-a085740e3763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:57.757334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dd032-fe2e-4832-9bc6-a085740e3763 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:57.757615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dd032-fe2e-4832-9bc6-a085740e3763 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:57.757891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dd032-fe2e-4832-9bc6-a085740e3763 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:57.759039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30dd032-fe2e-4832-9bc6-a085740e3763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 03:59:57.759039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30dd032-fe2e-4832-9bc6-a085740e3763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:57.760865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30dd032-fe2e-4832-9bc6-a085740e3763 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:57.801835 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4010/8022] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 03:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 03:59:57.802826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8c1da-b382-4190-a5b9-4d2d3ee8dad6 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:57.814764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8c1da-b382-4190-a5b9-4d2d3ee8dad6 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:57.821565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd68020-4a87-456c-bc93-9ed0d4c97b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:57.823195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd68020-4a87-456c-bc93-9ed0d4c97b3d admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:57.823195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd68020-4a87-456c-bc93-9ed0d4c97b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:57.823195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd68020-4a87-456c-bc93-9ed0d4c97b3d admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:57.823619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd68020-4a87-456c-bc93-9ed0d4c97b3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:57.825691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd68020-4a87-456c-bc93-9ed0d4c97b3d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:57.957021 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4013/8023] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 03:59:57 2022] POST /identity/v3/projects => generated 397 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 03:59:57.962839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30dd032-fe2e-4832-9bc6-a085740e3763 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:58.002851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30dd032-fe2e-4832-9bc6-a085740e3763 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:58.208455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d146d1-8aa2-4b09-8434-00b4bbafe63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:58.210926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d146d1-8aa2-4b09-8434-00b4bbafe63a admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:58.211371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d146d1-8aa2-4b09-8434-00b4bbafe63a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:58.211839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d146d1-8aa2-4b09-8434-00b4bbafe63a admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:58.212686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d146d1-8aa2-4b09-8434-00b4bbafe63a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:58.216130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d146d1-8aa2-4b09-8434-00b4bbafe63a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:58.312288 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4011/8024] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 03:59:57 2022] POST /identity/v3/users => generated 299 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 03:59:58.317525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd68020-4a87-456c-bc93-9ed0d4c97b3d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:58.341220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd68020-4a87-456c-bc93-9ed0d4c97b3d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:58.368579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63357440-550a-47db-8682-3afca4199642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:58.368579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63357440-550a-47db-8682-3afca4199642 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:58.368579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63357440-550a-47db-8682-3afca4199642 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:58.368579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63357440-550a-47db-8682-3afca4199642 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:58.369664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63357440-550a-47db-8682-3afca4199642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:58.369664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63357440-550a-47db-8682-3afca4199642 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:58.392650 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4014/8025] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 03:59:58.397069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d146d1-8aa2-4b09-8434-00b4bbafe63a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:58.408077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d146d1-8aa2-4b09-8434-00b4bbafe63a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:58.413699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2a122-a8d8-4d39-b94e-0b0d13aab13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:58.415200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2a122-a8d8-4d39-b94e-0b0d13aab13d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:58.415650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2a122-a8d8-4d39-b94e-0b0d13aab13d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:58.416118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2a122-a8d8-4d39-b94e-0b0d13aab13d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:58.416877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2a122-a8d8-4d39-b94e-0b0d13aab13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:58.418891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2a122-a8d8-4d39-b94e-0b0d13aab13d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:58.435632 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4012/8026] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 03:59:58.439923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63357440-550a-47db-8682-3afca4199642 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:58.454407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63357440-550a-47db-8682-3afca4199642 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:58.469021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf1681-887a-412b-93c2-59efc1135532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:58.471467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf1681-887a-412b-93c2-59efc1135532 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:58.471895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf1681-887a-412b-93c2-59efc1135532 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:58.472674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf1681-887a-412b-93c2-59efc1135532 admin admin] PATH_INFO: `/v3/projects/041514c441b548828a11f4b748a5dcd3/users/fc4fb81841a340bf8e53bd3b34232d5b/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:58.505385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf1681-887a-412b-93c2-59efc1135532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=041514c441b548828a11f4b748a5dcd3, user_id=fc4fb81841a340bf8e53bd3b34232d5b, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:58.508508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf1681-887a-412b-93c2-59efc1135532 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:58.608243 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4015/8027] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 03:59:58 2022] PUT /identity/v3/projects/041514c441b548828a11f4b748a5dcd3/users/fc4fb81841a340bf8e53bd3b34232d5b/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 03:59:58.622629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb288d-4ff2-4145-9987-fb2149290299 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:58.622971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb288d-4ff2-4145-9987-fb2149290299 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:58.623265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb288d-4ff2-4145-9987-fb2149290299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:58.662727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-2dbb288d-4ff2-4145-9987-fb2149290299 None None] MFA Rules not processed for user `fc4fb81841a340bf8e53bd3b34232d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 03:59:58.664199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2dbb288d-4ff2-4145-9987-fb2149290299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:58.770874 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4013/8028] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 03:59:58 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 03:59:58.782198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf1681-887a-412b-93c2-59efc1135532 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 03:59:58.788520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1ddf1681-887a-412b-93c2-59efc1135532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 03:59:58.881369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf1681-887a-412b-93c2-59efc1135532 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 03:59:58.895001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d723425-534e-47fd-915d-2aeca8022970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 03:59:58.899415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d723425-534e-47fd-915d-2aeca8022970 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 03:59:58.899753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d723425-534e-47fd-915d-2aeca8022970 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 03:59:58.900039 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d723425-534e-47fd-915d-2aeca8022970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 03:59:58.923193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d723425-534e-47fd-915d-2aeca8022970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 03:59:58.924660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d723425-534e-47fd-915d-2aeca8022970 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 03:59:58.938351 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4016/8029] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 03:59:58 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:00:02.957419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb288d-4ff2-4145-9987-fb2149290299 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:02.959229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2dbb288d-4ff2-4145-9987-fb2149290299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:02.970608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:03.046859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb288d-4ff2-4145-9987-fb2149290299 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:03.052777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ed672-cf09-42ec-9d35-af51e42e2b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:03.053029 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ed672-cf09-42ec-9d35-af51e42e2b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:03.053217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ed672-cf09-42ec-9d35-af51e42e2b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:03.053498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ed672-cf09-42ec-9d35-af51e42e2b7b admin admin] PATH_INFO: `/v3/users/1ec5d932c25f4093a3a3a7873ba9cd60` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:03.055405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ed672-cf09-42ec-9d35-af51e42e2b7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ec5d932c25f4093a3a3a7873ba9cd60)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:03.057486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ed672-cf09-42ec-9d35-af51e42e2b7b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:03.298862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-463ed672-cf09-42ec-9d35-af51e42e2b7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ec5d932c25f4093a3a3a7873ba9cd60'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:03.300238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-463ed672-cf09-42ec-9d35-af51e42e2b7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ec5d932c25f4093a3a3a7873ba9cd60'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:03.309803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-463ed672-cf09-42ec-9d35-af51e42e2b7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ec5d932c25f4093a3a3a7873ba9cd60'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:03.329547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-463ed672-cf09-42ec-9d35-af51e42e2b7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ec5d932c25f4093a3a3a7873ba9cd60'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:03.452665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-463ed672-cf09-42ec-9d35-af51e42e2b7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ec5d932c25f4093a3a3a7873ba9cd60'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:03.474386 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4014/8030] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:00:02 2022] DELETE /identity/v3/users/1ec5d932c25f4093a3a3a7873ba9cd60 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:00:03.478598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f276a-4368-4412-b5d6-43b8a7a61d89 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:03.479135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f276a-4368-4412-b5d6-43b8a7a61d89 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:03.479135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f276a-4368-4412-b5d6-43b8a7a61d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:03.516622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8e3f276a-4368-4412-b5d6-43b8a7a61d89 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:00:03.517661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8e3f276a-4368-4412-b5d6-43b8a7a61d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:03.601262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:03.653865 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4017/8031] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:00:03.666900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ed672-cf09-42ec-9d35-af51e42e2b7b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:03.668331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-463ed672-cf09-42ec-9d35-af51e42e2b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:03.734805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ed672-cf09-42ec-9d35-af51e42e2b7b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:03.739007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b012e-d9b4-48ae-9e6e-5dd91c3538cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:03.739664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b012e-d9b4-48ae-9e6e-5dd91c3538cd service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:03.739953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b012e-d9b4-48ae-9e6e-5dd91c3538cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:03.740233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b012e-d9b4-48ae-9e6e-5dd91c3538cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:03.751122 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b012e-d9b4-48ae-9e6e-5dd91c3538cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:03.752647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b012e-d9b4-48ae-9e6e-5dd91c3538cd service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:03.764057 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4015/8032] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:00:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:00:04.478672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f276a-4368-4412-b5d6-43b8a7a61d89 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:04.481145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8e3f276a-4368-4412-b5d6-43b8a7a61d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:04.505861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f276a-4368-4412-b5d6-43b8a7a61d89 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:04.519700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09d8b6-55e1-4fd8-a188-d4ec06dab599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:04.519700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09d8b6-55e1-4fd8-a188-d4ec06dab599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:04.519700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09d8b6-55e1-4fd8-a188-d4ec06dab599 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:04.520117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09d8b6-55e1-4fd8-a188-d4ec06dab599 admin admin] PATH_INFO: `/v3/projects/1e8f4fc6030b431ead45ee3887231941` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:04.522282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09d8b6-55e1-4fd8-a188-d4ec06dab599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e8f4fc6030b431ead45ee3887231941)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:04.524665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09d8b6-55e1-4fd8-a188-d4ec06dab599 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:04.719824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4f09d8b6-55e1-4fd8-a188-d4ec06dab599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e8f4fc6030b431ead45ee3887231941', 'request_id': 'req-4f09d8b6-55e1-4fd8-a188-d4ec06dab599'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:04.744034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4f09d8b6-55e1-4fd8-a188-d4ec06dab599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e8f4fc6030b431ead45ee3887231941', 'request_id': 'req-4f09d8b6-55e1-4fd8-a188-d4ec06dab599'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:04.760048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4f09d8b6-55e1-4fd8-a188-d4ec06dab599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e8f4fc6030b431ead45ee3887231941', 'request_id': 'req-4f09d8b6-55e1-4fd8-a188-d4ec06dab599'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:04.915469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4f09d8b6-55e1-4fd8-a188-d4ec06dab599 admin admin] The token cache is being invalidate because project 1e8f4fc6030b431ead45ee3887231941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:00:04.916031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4f09d8b6-55e1-4fd8-a188-d4ec06dab599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:04.916986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4f09d8b6-55e1-4fd8-a188-d4ec06dab599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:04.923214 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4018/8033] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:00:04 2022] DELETE /identity/v3/projects/1e8f4fc6030b431ead45ee3887231941 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:00:04.929968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5406373-fbba-488d-8bef-6a498d8c123d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:04.930517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5406373-fbba-488d-8bef-6a498d8c123d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:04.930625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5406373-fbba-488d-8bef-6a498d8c123d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:04.968039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a5406373-fbba-488d-8bef-6a498d8c123d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:00:04.969950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a5406373-fbba-488d-8bef-6a498d8c123d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:05.008016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:05.050732 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4016/8034] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:00:05.058119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d118eb-ac27-43b6-8c7b-9f2e3972d001 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:05.058410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d118eb-ac27-43b6-8c7b-9f2e3972d001 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:05.058689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d118eb-ac27-43b6-8c7b-9f2e3972d001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:05.081156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f6d118eb-ac27-43b6-8c7b-9f2e3972d001 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:00:05.083177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f6d118eb-ac27-43b6-8c7b-9f2e3972d001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:05.092060 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4019/8035] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 04:00:05.097653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5406373-fbba-488d-8bef-6a498d8c123d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:05.109133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5406373-fbba-488d-8bef-6a498d8c123d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:05.116055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b647e81-6ac7-416c-ad6d-67d558b96d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:05.116688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b647e81-6ac7-416c-ad6d-67d558b96d54 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:05.116978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b647e81-6ac7-416c-ad6d-67d558b96d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:05.117264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b647e81-6ac7-416c-ad6d-67d558b96d54 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:05.117934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b647e81-6ac7-416c-ad6d-67d558b96d54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:00:05.118284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b647e81-6ac7-416c-ad6d-67d558b96d54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:05.119979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b647e81-6ac7-416c-ad6d-67d558b96d54 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:05.138990 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4017/8036] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:00:05.139187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d118eb-ac27-43b6-8c7b-9f2e3972d001 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:05.153096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d118eb-ac27-43b6-8c7b-9f2e3972d001 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:05.159117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8d309-fd3e-4198-9c34-3477cb9f27f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:05.159858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8d309-fd3e-4198-9c34-3477cb9f27f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:05.160211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8d309-fd3e-4198-9c34-3477cb9f27f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:05.160578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8d309-fd3e-4198-9c34-3477cb9f27f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:05.161280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8d309-fd3e-4198-9c34-3477cb9f27f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:05.163341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8d309-fd3e-4198-9c34-3477cb9f27f3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:05.299814 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4020/8037] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:00:05 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 04:00:05.304800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b647e81-6ac7-416c-ad6d-67d558b96d54 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:05.316486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b647e81-6ac7-416c-ad6d-67d558b96d54 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:05.374742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1be007-14ca-4ee0-832a-714d8f51c51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:05.375368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1be007-14ca-4ee0-832a-714d8f51c51c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:05.375649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1be007-14ca-4ee0-832a-714d8f51c51c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:05.375923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1be007-14ca-4ee0-832a-714d8f51c51c admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:05.376619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1be007-14ca-4ee0-832a-714d8f51c51c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:05.379020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1be007-14ca-4ee0-832a-714d8f51c51c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:05.457606 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4018/8038] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:00:05 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 04:00:05.461860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8d309-fd3e-4198-9c34-3477cb9f27f3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:05.473387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8d309-fd3e-4198-9c34-3477cb9f27f3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:05.478706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e45f58-3855-47ab-91c1-cd091a89821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:05.479395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e45f58-3855-47ab-91c1-cd091a89821f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:05.479511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e45f58-3855-47ab-91c1-cd091a89821f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:05.479783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e45f58-3855-47ab-91c1-cd091a89821f admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:05.480426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e45f58-3855-47ab-91c1-cd091a89821f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:05.482027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e45f58-3855-47ab-91c1-cd091a89821f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:05.492186 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4021/8039] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:00:05.496183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1be007-14ca-4ee0-832a-714d8f51c51c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:05.506731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1be007-14ca-4ee0-832a-714d8f51c51c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:05.511408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551d52b-b39b-40b9-b217-cfedd76ec526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:05.514599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551d52b-b39b-40b9-b217-cfedd76ec526 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:05.514599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551d52b-b39b-40b9-b217-cfedd76ec526 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:05.514599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551d52b-b39b-40b9-b217-cfedd76ec526 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:05.514599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551d52b-b39b-40b9-b217-cfedd76ec526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:05.514923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551d52b-b39b-40b9-b217-cfedd76ec526 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:05.525356 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4019/8040] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:00:05.529288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e45f58-3855-47ab-91c1-cd091a89821f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:05.539813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e45f58-3855-47ab-91c1-cd091a89821f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:05.544526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7e31a-df7c-42f2-982f-0690f5088224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:05.545219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7e31a-df7c-42f2-982f-0690f5088224 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:05.545499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7e31a-df7c-42f2-982f-0690f5088224 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:05.545774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7e31a-df7c-42f2-982f-0690f5088224 admin admin] PATH_INFO: `/v3/projects/b3a6a53e4e5b4a0da61698196214442d/users/59ed31e31a6a4eb19dd343120ab8d19f/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:05.561774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7e31a-df7c-42f2-982f-0690f5088224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a6a53e4e5b4a0da61698196214442d, user_id=59ed31e31a6a4eb19dd343120ab8d19f, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:05.564981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7e31a-df7c-42f2-982f-0690f5088224 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:05.631033 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4022/8041] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:00:05 2022] PUT /identity/v3/projects/b3a6a53e4e5b4a0da61698196214442d/users/59ed31e31a6a4eb19dd343120ab8d19f/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:00:05.642493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a81ed-7f3b-48fc-bc38-5b74c2795216 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:05.643345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a81ed-7f3b-48fc-bc38-5b74c2795216 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:05.643754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a81ed-7f3b-48fc-bc38-5b74c2795216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:05.677269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-6d6a81ed-7f3b-48fc-bc38-5b74c2795216 None None] MFA Rules not processed for user `59ed31e31a6a4eb19dd343120ab8d19f`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:00:05.677888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6d6a81ed-7f3b-48fc-bc38-5b74c2795216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:05.758072 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4020/8042] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:00:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:00:05.773649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7e31a-df7c-42f2-982f-0690f5088224 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:05.846562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:05.851047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7e31a-df7c-42f2-982f-0690f5088224 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:05.856692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f68137-c11c-4a67-bd98-b47864cfa70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:05.856692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f68137-c11c-4a67-bd98-b47864cfa70f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:05.856984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f68137-c11c-4a67-bd98-b47864cfa70f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:05.857386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f68137-c11c-4a67-bd98-b47864cfa70f admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:05.858120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f68137-c11c-4a67-bd98-b47864cfa70f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:05.860431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f68137-c11c-4a67-bd98-b47864cfa70f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:06.014513 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4023/8043] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:00:05 2022] POST /identity/v3/projects => generated 383 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:00:06.018761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a81ed-7f3b-48fc-bc38-5b74c2795216 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:06.035573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a81ed-7f3b-48fc-bc38-5b74c2795216 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:06.083192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:06.138748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce31142-78be-4d49-a604-cc266bf613c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:06.141527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce31142-78be-4d49-a604-cc266bf613c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:06.141527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce31142-78be-4d49-a604-cc266bf613c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:06.141527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce31142-78be-4d49-a604-cc266bf613c5 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:06.141527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce31142-78be-4d49-a604-cc266bf613c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:06.142803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce31142-78be-4d49-a604-cc266bf613c5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:06.294855 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4021/8044] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:00:06 2022] POST /identity/v3/users => generated 292 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:00:06.299889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f68137-c11c-4a67-bd98-b47864cfa70f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:06.311565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f68137-c11c-4a67-bd98-b47864cfa70f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:06.344012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c4650-28cf-4d5f-b99a-a4bca7a77b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:06.345010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c4650-28cf-4d5f-b99a-a4bca7a77b7e admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:06.345501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c4650-28cf-4d5f-b99a-a4bca7a77b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:06.346198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c4650-28cf-4d5f-b99a-a4bca7a77b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:06.351258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c4650-28cf-4d5f-b99a-a4bca7a77b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:06.353050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c4650-28cf-4d5f-b99a-a4bca7a77b7e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:06.376918 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4024/8045] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:00:06.381272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce31142-78be-4d49-a604-cc266bf613c5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:06.393381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce31142-78be-4d49-a604-cc266bf613c5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:06.402388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1eaa5-ea13-456e-81b3-a4f172189feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:06.405216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1eaa5-ea13-456e-81b3-a4f172189feb admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:06.405216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1eaa5-ea13-456e-81b3-a4f172189feb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:06.405216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1eaa5-ea13-456e-81b3-a4f172189feb admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:06.405216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c1eaa5-ea13-456e-81b3-a4f172189feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:06.406296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c1eaa5-ea13-456e-81b3-a4f172189feb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:06.428577 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4022/8046] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:00:06.429447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c4650-28cf-4d5f-b99a-a4bca7a77b7e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:06.444050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c4650-28cf-4d5f-b99a-a4bca7a77b7e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:06.453635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0faae4-d99c-4c85-8dff-f2e5979417ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:06.454073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0faae4-d99c-4c85-8dff-f2e5979417ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:06.455299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0faae4-d99c-4c85-8dff-f2e5979417ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:06.455813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0faae4-d99c-4c85-8dff-f2e5979417ad admin admin] PATH_INFO: `/v3/projects/cd4be9d8d79444c080054d1cb3bf59f2/users/102773c12716406ea0cb9da5904ede05/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:06.482286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0faae4-d99c-4c85-8dff-f2e5979417ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4be9d8d79444c080054d1cb3bf59f2, user_id=102773c12716406ea0cb9da5904ede05, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:06.491075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0faae4-d99c-4c85-8dff-f2e5979417ad admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:06.576845 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4025/8047] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:00:06 2022] PUT /identity/v3/projects/cd4be9d8d79444c080054d1cb3bf59f2/users/102773c12716406ea0cb9da5904ede05/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:00:06.587597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241f820-8ed8-4fe2-915c-4cf7c33ba7ea None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:06.588478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241f820-8ed8-4fe2-915c-4cf7c33ba7ea None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:06.588843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241f820-8ed8-4fe2-915c-4cf7c33ba7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:06.641733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f241f820-8ed8-4fe2-915c-4cf7c33ba7ea None None] MFA Rules not processed for user `102773c12716406ea0cb9da5904ede05`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:00:06.643040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f241f820-8ed8-4fe2-915c-4cf7c33ba7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:06.738322 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4023/8048] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:00:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:00:06.742652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0faae4-d99c-4c85-8dff-f2e5979417ad admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:06.845840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0faae4-d99c-4c85-8dff-f2e5979417ad admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:06.858959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e841f-ea1d-4048-b793-37272a52cc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:06.859599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e841f-ea1d-4048-b793-37272a52cc5a admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:06.861260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e841f-ea1d-4048-b793-37272a52cc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:06.861260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e841f-ea1d-4048-b793-37272a52cc5a admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:06.861260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e841f-ea1d-4048-b793-37272a52cc5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:06.863951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e841f-ea1d-4048-b793-37272a52cc5a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:07.018909 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4026/8049] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:00:06 2022] POST /identity/v3/projects => generated 383 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:00:07.023133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241f820-8ed8-4fe2-915c-4cf7c33ba7ea None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:07.042145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241f820-8ed8-4fe2-915c-4cf7c33ba7ea None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:07.186950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091acc8c-6673-4fd4-8fde-d5a69c422aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:07.187742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091acc8c-6673-4fd4-8fde-d5a69c422aeb admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:07.188130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091acc8c-6673-4fd4-8fde-d5a69c422aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:07.188563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091acc8c-6673-4fd4-8fde-d5a69c422aeb admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:07.189308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091acc8c-6673-4fd4-8fde-d5a69c422aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:07.192108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091acc8c-6673-4fd4-8fde-d5a69c422aeb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:07.330168 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4024/8050] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:00:07 2022] POST /identity/v3/users => generated 298 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:00:07.334082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e841f-ea1d-4048-b793-37272a52cc5a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:07.350283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e841f-ea1d-4048-b793-37272a52cc5a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:07.356269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e2db6-8c3d-4c83-810f-c2ed6fc9b519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:07.359834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e2db6-8c3d-4c83-810f-c2ed6fc9b519 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:07.359834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e2db6-8c3d-4c83-810f-c2ed6fc9b519 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:07.359834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e2db6-8c3d-4c83-810f-c2ed6fc9b519 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:07.359834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e2db6-8c3d-4c83-810f-c2ed6fc9b519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:07.360367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e2db6-8c3d-4c83-810f-c2ed6fc9b519 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:07.377293 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4027/8051] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:00:07.377803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091acc8c-6673-4fd4-8fde-d5a69c422aeb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:07.397757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091acc8c-6673-4fd4-8fde-d5a69c422aeb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:07.417181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c96dc-e0c2-4cd3-b5bf-0c5aa9543ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:07.417875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c96dc-e0c2-4cd3-b5bf-0c5aa9543ebc admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:07.418188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c96dc-e0c2-4cd3-b5bf-0c5aa9543ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:07.418470 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c96dc-e0c2-4cd3-b5bf-0c5aa9543ebc admin admin] PATH_INFO: `/v3/projects/9129e566087742a4ba1c3e0d8effad63/users/ff5e71477c594c32b18fbb13636274c0/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:07.476731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c96dc-e0c2-4cd3-b5bf-0c5aa9543ebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9129e566087742a4ba1c3e0d8effad63, user_id=ff5e71477c594c32b18fbb13636274c0, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:07.479498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c96dc-e0c2-4cd3-b5bf-0c5aa9543ebc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:07.592102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e2db6-8c3d-4c83-810f-c2ed6fc9b519 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:07.594003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e24e2db6-8c3d-4c83-810f-c2ed6fc9b519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:07.602337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:07.618182 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4025/8052] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:00:07 2022] PUT /identity/v3/projects/9129e566087742a4ba1c3e0d8effad63/users/ff5e71477c594c32b18fbb13636274c0/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:00:07.621796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c96dc-e0c2-4cd3-b5bf-0c5aa9543ebc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:07.799509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e2db6-8c3d-4c83-810f-c2ed6fc9b519 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:07.803520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c96dc-e0c2-4cd3-b5bf-0c5aa9543ebc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:07.809535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bbe72-66c2-455f-82b5-2e3d678138b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:07.810207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bbe72-66c2-455f-82b5-2e3d678138b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:07.810498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bbe72-66c2-455f-82b5-2e3d678138b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:07.810777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bbe72-66c2-455f-82b5-2e3d678138b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:07.811574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bbe72-66c2-455f-82b5-2e3d678138b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:07.814141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bbe72-66c2-455f-82b5-2e3d678138b0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:07.834454 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4026/8053] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 04:00:07.838766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bbe72-66c2-455f-82b5-2e3d678138b0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:07.843709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:07.868340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bbe72-66c2-455f-82b5-2e3d678138b0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:07.884447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ffb6b0-2763-4055-a865-40fce846eea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:07.885504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffb6b0-2763-4055-a865-40fce846eea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:07.885504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffb6b0-2763-4055-a865-40fce846eea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:07.885791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffb6b0-2763-4055-a865-40fce846eea1 admin admin] PATH_INFO: `/v3/projects/9129e566087742a4ba1c3e0d8effad63/users/ff5e71477c594c32b18fbb13636274c0/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:07.888351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ffb6b0-2763-4055-a865-40fce846eea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9129e566087742a4ba1c3e0d8effad63, user_id=ff5e71477c594c32b18fbb13636274c0, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:07.891816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ffb6b0-2763-4055-a865-40fce846eea1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:07.913221 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4027/8054] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:00:07 2022] PUT /identity/v3/projects/9129e566087742a4ba1c3e0d8effad63/users/ff5e71477c594c32b18fbb13636274c0/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 04:00:07.924442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535897a-8966-4535-bf2e-fe14b740ee0f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:07.924793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535897a-8966-4535-bf2e-fe14b740ee0f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:07.925687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535897a-8966-4535-bf2e-fe14b740ee0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:07.961247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235987b5-fdad-495d-8df3-9a5f9d790cd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:07.964037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235987b5-fdad-495d-8df3-9a5f9d790cd4 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:07.975499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235987b5-fdad-495d-8df3-9a5f9d790cd4 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:07.978696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235987b5-fdad-495d-8df3-9a5f9d790cd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:07.982293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-235987b5-fdad-495d-8df3-9a5f9d790cd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:07.986025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0535897a-8966-4535-bf2e-fe14b740ee0f None None] MFA Rules not processed for user `ff5e71477c594c32b18fbb13636274c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:00:07.987354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0535897a-8966-4535-bf2e-fe14b740ee0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:08.027785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235987b5-fdad-495d-8df3-9a5f9d790cd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:08.032751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235987b5-fdad-495d-8df3-9a5f9d790cd4 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:08.068109 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4028/8055] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:00:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:00:08.147704 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4028/8056] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:00:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 04:00:08.149829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235987b5-fdad-495d-8df3-9a5f9d790cd4 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:08.151598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-235987b5-fdad-495d-8df3-9a5f9d790cd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:08.266698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235987b5-fdad-495d-8df3-9a5f9d790cd4 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:08.340973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1d052-54fc-4409-9791-f5530f90d7ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:08.341770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1d052-54fc-4409-9791-f5530f90d7ba service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:08.342272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1d052-54fc-4409-9791-f5530f90d7ba service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:08.344635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1d052-54fc-4409-9791-f5530f90d7ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:08.411689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1d052-54fc-4409-9791-f5530f90d7ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:08.413590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1d052-54fc-4409-9791-f5530f90d7ba service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:08.425565 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4029/8057] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:00:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:00:11.800796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535897a-8966-4535-bf2e-fe14b740ee0f None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:11.820558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535897a-8966-4535-bf2e-fe14b740ee0f None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:11.825351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6c4cf-9600-4107-bb52-2ee3eb37b464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:11.826254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6c4cf-9600-4107-bb52-2ee3eb37b464 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:11.826639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6c4cf-9600-4107-bb52-2ee3eb37b464 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:11.827139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6c4cf-9600-4107-bb52-2ee3eb37b464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:11.906956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6c4cf-9600-4107-bb52-2ee3eb37b464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:11.908596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6c4cf-9600-4107-bb52-2ee3eb37b464 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:11.938636 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4029/8058] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:00:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:00:12.021745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1d052-54fc-4409-9791-f5530f90d7ba service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:12.023305 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e4d1d052-54fc-4409-9791-f5530f90d7ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:12.066981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:12.191026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1d052-54fc-4409-9791-f5530f90d7ba service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:12.204403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf555021-cef8-4f69-bfff-0c4b17fc67e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:12.205329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf555021-cef8-4f69-bfff-0c4b17fc67e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:12.205329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf555021-cef8-4f69-bfff-0c4b17fc67e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:12.205607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf555021-cef8-4f69-bfff-0c4b17fc67e1 admin admin] PATH_INFO: `/v3/users/fc4fb81841a340bf8e53bd3b34232d5b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:12.209087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf555021-cef8-4f69-bfff-0c4b17fc67e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc4fb81841a340bf8e53bd3b34232d5b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:12.214933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf555021-cef8-4f69-bfff-0c4b17fc67e1 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:12.447183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bf555021-cef8-4f69-bfff-0c4b17fc67e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc4fb81841a340bf8e53bd3b34232d5b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:12.448819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bf555021-cef8-4f69-bfff-0c4b17fc67e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc4fb81841a340bf8e53bd3b34232d5b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:12.461941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bf555021-cef8-4f69-bfff-0c4b17fc67e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc4fb81841a340bf8e53bd3b34232d5b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:12.482088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bf555021-cef8-4f69-bfff-0c4b17fc67e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc4fb81841a340bf8e53bd3b34232d5b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:12.483008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-bf555021-cef8-4f69-bfff-0c4b17fc67e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc4fb81841a340bf8e53bd3b34232d5b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:12.551111 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4030/8059] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:00:12 2022] DELETE /identity/v3/users/fc4fb81841a340bf8e53bd3b34232d5b => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:00:12.557277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c2081-27b1-49c4-924f-c3bfa4d77f51 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:12.557277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c2081-27b1-49c4-924f-c3bfa4d77f51 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:12.558588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c2081-27b1-49c4-924f-c3bfa4d77f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:12.569312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:12.593919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-fd0c2081-27b1-49c4-924f-c3bfa4d77f51 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:00:12.597053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fd0c2081-27b1-49c4-924f-c3bfa4d77f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:12.690650 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4030/8060] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:00:12.707124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf555021-cef8-4f69-bfff-0c4b17fc67e1 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:12.710352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bf555021-cef8-4f69-bfff-0c4b17fc67e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:12.797547 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf555021-cef8-4f69-bfff-0c4b17fc67e1 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:12.809578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13286c79-f542-4545-84ac-2a21bd7569b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:12.810358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13286c79-f542-4545-84ac-2a21bd7569b6 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:12.810720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13286c79-f542-4545-84ac-2a21bd7569b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:12.811069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13286c79-f542-4545-84ac-2a21bd7569b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:12.825464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13286c79-f542-4545-84ac-2a21bd7569b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:12.827428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13286c79-f542-4545-84ac-2a21bd7569b6 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:12.840859 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4031/8061] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:00:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:00:13.776439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c2081-27b1-49c4-924f-c3bfa4d77f51 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:13.779633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fd0c2081-27b1-49c4-924f-c3bfa4d77f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:13.819709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c2081-27b1-49c4-924f-c3bfa4d77f51 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:13.827434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada8364-25b8-4263-983d-f2b390d544b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:13.831454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada8364-25b8-4263-983d-f2b390d544b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:13.832243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada8364-25b8-4263-983d-f2b390d544b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:13.832590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada8364-25b8-4263-983d-f2b390d544b7 admin admin] PATH_INFO: `/v3/projects/041514c441b548828a11f4b748a5dcd3` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:13.835688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada8364-25b8-4263-983d-f2b390d544b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=041514c441b548828a11f4b748a5dcd3)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:13.837657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada8364-25b8-4263-983d-f2b390d544b7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:13.984738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13286c79-f542-4545-84ac-2a21bd7569b6 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:13.987627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-13286c79-f542-4545-84ac-2a21bd7569b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:14.007264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1ada8364-25b8-4263-983d-f2b390d544b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '041514c441b548828a11f4b748a5dcd3', 'request_id': 'req-1ada8364-25b8-4263-983d-f2b390d544b7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:14.048980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:14.073608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13286c79-f542-4545-84ac-2a21bd7569b6 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:14.115715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1ada8364-25b8-4263-983d-f2b390d544b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '041514c441b548828a11f4b748a5dcd3', 'request_id': 'req-1ada8364-25b8-4263-983d-f2b390d544b7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:14.124136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1ada8364-25b8-4263-983d-f2b390d544b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '041514c441b548828a11f4b748a5dcd3', 'request_id': 'req-1ada8364-25b8-4263-983d-f2b390d544b7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:14.150793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1ada8364-25b8-4263-983d-f2b390d544b7 admin admin] The token cache is being invalidate because project 041514c441b548828a11f4b748a5dcd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:00:14.151579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1ada8364-25b8-4263-983d-f2b390d544b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:14.152398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1ada8364-25b8-4263-983d-f2b390d544b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:14.154100 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4031/8062] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:00:13 2022] DELETE /identity/v3/projects/041514c441b548828a11f4b748a5dcd3 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:00:14.201927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b0cf5-667f-4847-a2b1-7aed7a3d48c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:14.202603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b0cf5-667f-4847-a2b1-7aed7a3d48c3 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:14.202927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b0cf5-667f-4847-a2b1-7aed7a3d48c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:14.203171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b0cf5-667f-4847-a2b1-7aed7a3d48c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:14.210646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c54b0cf5-667f-4847-a2b1-7aed7a3d48c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:14.423389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b0cf5-667f-4847-a2b1-7aed7a3d48c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:14.426528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b0cf5-667f-4847-a2b1-7aed7a3d48c3 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:14.451753 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4032/8063] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:00:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:00:24.151519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:25.013841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=53 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:25.165303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada8364-25b8-4263-983d-f2b390d544b7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:25.167461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1ada8364-25b8-4263-983d-f2b390d544b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:25.228763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0706eae-d48b-4b74-bb7f-4edd331ebaf3 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:25.229296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0706eae-d48b-4b74-bb7f-4edd331ebaf3 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:25.229794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0706eae-d48b-4b74-bb7f-4edd331ebaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:25.263170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a0706eae-d48b-4b74-bb7f-4edd331ebaf3 None None] MFA Rules not processed for user `3e7ffbb437004d379258425747bf1521`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:00:25.265415 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a0706eae-d48b-4b74-bb7f-4edd331ebaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:25.350548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada8364-25b8-4263-983d-f2b390d544b7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:25.354334 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4033/8064] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:00:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:00:25.361688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0de7f9-8ece-40c3-8624-65ac663f2fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:25.362696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0de7f9-8ece-40c3-8624-65ac663f2fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:25.364100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0de7f9-8ece-40c3-8624-65ac663f2fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:25.364841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0de7f9-8ece-40c3-8624-65ac663f2fa3 admin admin] PATH_INFO: `/v3/users/59ed31e31a6a4eb19dd343120ab8d19f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:25.370967 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0de7f9-8ece-40c3-8624-65ac663f2fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59ed31e31a6a4eb19dd343120ab8d19f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:25.372956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0de7f9-8ece-40c3-8624-65ac663f2fa3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:25.665923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e0de7f9-8ece-40c3-8624-65ac663f2fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59ed31e31a6a4eb19dd343120ab8d19f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:25.673761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e0de7f9-8ece-40c3-8624-65ac663f2fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59ed31e31a6a4eb19dd343120ab8d19f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:25.713137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e0de7f9-8ece-40c3-8624-65ac663f2fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59ed31e31a6a4eb19dd343120ab8d19f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:25.750724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e0de7f9-8ece-40c3-8624-65ac663f2fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59ed31e31a6a4eb19dd343120ab8d19f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:25.825576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-1e0de7f9-8ece-40c3-8624-65ac663f2fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59ed31e31a6a4eb19dd343120ab8d19f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:25.837537 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4032/8065] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:00:25 2022] DELETE /identity/v3/users/59ed31e31a6a4eb19dd343120ab8d19f => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:00:25.842605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240fa6b-7379-44c4-bd3a-abf8db591359 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:25.843931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240fa6b-7379-44c4-bd3a-abf8db591359 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:25.844358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240fa6b-7379-44c4-bd3a-abf8db591359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:25.898445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6240fa6b-7379-44c4-bd3a-abf8db591359 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:00:25.900788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6240fa6b-7379-44c4-bd3a-abf8db591359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:26.013042 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4034/8066] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:00:26.034924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0de7f9-8ece-40c3-8624-65ac663f2fa3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:26.035663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1e0de7f9-8ece-40c3-8624-65ac663f2fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:26.226021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0de7f9-8ece-40c3-8624-65ac663f2fa3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:26.228755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e92c70-847c-40d4-b3b4-29cb4cdbdd71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:26.228755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e92c70-847c-40d4-b3b4-29cb4cdbdd71 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:26.229239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e92c70-847c-40d4-b3b4-29cb4cdbdd71 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:26.229640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e92c70-847c-40d4-b3b4-29cb4cdbdd71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:26.257125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e92c70-847c-40d4-b3b4-29cb4cdbdd71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:26.260242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e92c70-847c-40d4-b3b4-29cb4cdbdd71 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:26.302101 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4033/8067] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:00:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:00:27.194559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240fa6b-7379-44c4-bd3a-abf8db591359 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:27.196121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6240fa6b-7379-44c4-bd3a-abf8db591359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:27.219866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240fa6b-7379-44c4-bd3a-abf8db591359 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:27.229135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667eb548-4154-4758-8172-abe25bd23905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:27.233614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667eb548-4154-4758-8172-abe25bd23905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:27.233614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667eb548-4154-4758-8172-abe25bd23905 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:27.233614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667eb548-4154-4758-8172-abe25bd23905 admin admin] PATH_INFO: `/v3/projects/b3a6a53e4e5b4a0da61698196214442d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:27.233614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667eb548-4154-4758-8172-abe25bd23905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3a6a53e4e5b4a0da61698196214442d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:27.234012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667eb548-4154-4758-8172-abe25bd23905 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:27.424423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-667eb548-4154-4758-8172-abe25bd23905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3a6a53e4e5b4a0da61698196214442d', 'request_id': 'req-667eb548-4154-4758-8172-abe25bd23905'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:27.434558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-667eb548-4154-4758-8172-abe25bd23905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3a6a53e4e5b4a0da61698196214442d', 'request_id': 'req-667eb548-4154-4758-8172-abe25bd23905'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:27.461514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-667eb548-4154-4758-8172-abe25bd23905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3a6a53e4e5b4a0da61698196214442d', 'request_id': 'req-667eb548-4154-4758-8172-abe25bd23905'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:27.569136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-667eb548-4154-4758-8172-abe25bd23905 admin admin] The token cache is being invalidate because project b3a6a53e4e5b4a0da61698196214442d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:00:27.570148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-667eb548-4154-4758-8172-abe25bd23905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:27.578760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-667eb548-4154-4758-8172-abe25bd23905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:27.583805 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4035/8068] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:00:27 2022] DELETE /identity/v3/projects/b3a6a53e4e5b4a0da61698196214442d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:00:27.587796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e92c70-847c-40d4-b3b4-29cb4cdbdd71 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:27.599256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:27.604545 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e92c70-847c-40d4-b3b4-29cb4cdbdd71 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:27.732038 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c24867-0628-4d75-bd66-63d70f2c130c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:27.733029 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c24867-0628-4d75-bd66-63d70f2c130c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:27.735477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c24867-0628-4d75-bd66-63d70f2c130c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:27.735964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c24867-0628-4d75-bd66-63d70f2c130c admin admin] PATH_INFO: `/v3/users/102773c12716406ea0cb9da5904ede05` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:27.739425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c24867-0628-4d75-bd66-63d70f2c130c admin admin] RBAC: Authorizing `identity:delete_user(user_id=102773c12716406ea0cb9da5904ede05)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:27.747687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c24867-0628-4d75-bd66-63d70f2c130c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:28.019185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-37c24867-0628-4d75-bd66-63d70f2c130c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '102773c12716406ea0cb9da5904ede05'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:28.021894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-37c24867-0628-4d75-bd66-63d70f2c130c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '102773c12716406ea0cb9da5904ede05'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:28.033493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-37c24867-0628-4d75-bd66-63d70f2c130c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '102773c12716406ea0cb9da5904ede05'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:28.061664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-37c24867-0628-4d75-bd66-63d70f2c130c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '102773c12716406ea0cb9da5904ede05'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:28.151771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-37c24867-0628-4d75-bd66-63d70f2c130c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '102773c12716406ea0cb9da5904ede05'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:28.163676 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4034/8069] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:00:27 2022] DELETE /identity/v3/users/102773c12716406ea0cb9da5904ede05 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:00:28.356389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667eb548-4154-4758-8172-abe25bd23905 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:28.357109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-667eb548-4154-4758-8172-abe25bd23905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:28.461648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:28.529477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667eb548-4154-4758-8172-abe25bd23905 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:28.670533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b05d33-2deb-4c0f-9877-f5819cbd5069 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:28.672424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b05d33-2deb-4c0f-9877-f5819cbd5069 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:28.673656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b05d33-2deb-4c0f-9877-f5819cbd5069 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:28.674382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b05d33-2deb-4c0f-9877-f5819cbd5069 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:28.679050 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b5b05d33-2deb-4c0f-9877-f5819cbd5069 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:28.712481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b05d33-2deb-4c0f-9877-f5819cbd5069 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:28.714332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b05d33-2deb-4c0f-9877-f5819cbd5069 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:28.735215 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4036/8070] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:00:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:00:28.818894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c24867-0628-4d75-bd66-63d70f2c130c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:28.820746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-37c24867-0628-4d75-bd66-63d70f2c130c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:28.970852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c24867-0628-4d75-bd66-63d70f2c130c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:28.985401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d43303-a380-4c6d-a688-0ff0eecc308b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:28.986755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d43303-a380-4c6d-a688-0ff0eecc308b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:28.987054 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d43303-a380-4c6d-a688-0ff0eecc308b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:28.987333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d43303-a380-4c6d-a688-0ff0eecc308b admin admin] PATH_INFO: `/v3/projects/cd4be9d8d79444c080054d1cb3bf59f2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:28.989100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d43303-a380-4c6d-a688-0ff0eecc308b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd4be9d8d79444c080054d1cb3bf59f2)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:29.001651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d43303-a380-4c6d-a688-0ff0eecc308b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:29.140475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:29.236617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-07d43303-a380-4c6d-a688-0ff0eecc308b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd4be9d8d79444c080054d1cb3bf59f2', 'request_id': 'req-07d43303-a380-4c6d-a688-0ff0eecc308b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:29.314526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-07d43303-a380-4c6d-a688-0ff0eecc308b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd4be9d8d79444c080054d1cb3bf59f2', 'request_id': 'req-07d43303-a380-4c6d-a688-0ff0eecc308b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:29.331131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-07d43303-a380-4c6d-a688-0ff0eecc308b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd4be9d8d79444c080054d1cb3bf59f2', 'request_id': 'req-07d43303-a380-4c6d-a688-0ff0eecc308b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:29.346924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-07d43303-a380-4c6d-a688-0ff0eecc308b admin admin] The token cache is being invalidate because project cd4be9d8d79444c080054d1cb3bf59f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:00:29.347289 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-07d43303-a380-4c6d-a688-0ff0eecc308b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:29.358325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-07d43303-a380-4c6d-a688-0ff0eecc308b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:29.360035 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4035/8071] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:00:28 2022] DELETE /identity/v3/projects/cd4be9d8d79444c080054d1cb3bf59f2 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:00:29.364719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b05d33-2deb-4c0f-9877-f5819cbd5069 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:29.383706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b05d33-2deb-4c0f-9877-f5819cbd5069 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:29.498774 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc094f-d576-44ee-946d-b46bfa921372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:29.500719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc094f-d576-44ee-946d-b46bfa921372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:29.501208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc094f-d576-44ee-946d-b46bfa921372 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:29.501658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc094f-d576-44ee-946d-b46bfa921372 admin admin] PATH_INFO: `/v3/users/ff5e71477c594c32b18fbb13636274c0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:29.504293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc094f-d576-44ee-946d-b46bfa921372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff5e71477c594c32b18fbb13636274c0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:29.507169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc094f-d576-44ee-946d-b46bfa921372 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:29.774204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-80fc094f-d576-44ee-946d-b46bfa921372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff5e71477c594c32b18fbb13636274c0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:29.775043 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-80fc094f-d576-44ee-946d-b46bfa921372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff5e71477c594c32b18fbb13636274c0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:29.797468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-80fc094f-d576-44ee-946d-b46bfa921372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff5e71477c594c32b18fbb13636274c0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:29.823137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-80fc094f-d576-44ee-946d-b46bfa921372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff5e71477c594c32b18fbb13636274c0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:29.827395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-80fc094f-d576-44ee-946d-b46bfa921372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff5e71477c594c32b18fbb13636274c0'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:29.956636 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4037/8072] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:00:29 2022] DELETE /identity/v3/users/ff5e71477c594c32b18fbb13636274c0 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:00:30.186420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:30.851977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d43303-a380-4c6d-a688-0ff0eecc308b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:30.854715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-07d43303-a380-4c6d-a688-0ff0eecc308b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:30.879021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d43303-a380-4c6d-a688-0ff0eecc308b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:30.998405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce3fed-5300-41db-a560-dcfa33be87e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:30.998405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce3fed-5300-41db-a560-dcfa33be87e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:30.998405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce3fed-5300-41db-a560-dcfa33be87e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:30.998405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce3fed-5300-41db-a560-dcfa33be87e2 admin admin] PATH_INFO: `/v3/projects/9129e566087742a4ba1c3e0d8effad63` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:30.998725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce3fed-5300-41db-a560-dcfa33be87e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9129e566087742a4ba1c3e0d8effad63)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:30.998725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce3fed-5300-41db-a560-dcfa33be87e2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:31.184004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f1ce3fed-5300-41db-a560-dcfa33be87e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9129e566087742a4ba1c3e0d8effad63', 'request_id': 'req-f1ce3fed-5300-41db-a560-dcfa33be87e2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:31.282236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f1ce3fed-5300-41db-a560-dcfa33be87e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9129e566087742a4ba1c3e0d8effad63', 'request_id': 'req-f1ce3fed-5300-41db-a560-dcfa33be87e2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:31.295798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f1ce3fed-5300-41db-a560-dcfa33be87e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9129e566087742a4ba1c3e0d8effad63', 'request_id': 'req-f1ce3fed-5300-41db-a560-dcfa33be87e2'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:31.318160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f1ce3fed-5300-41db-a560-dcfa33be87e2 admin admin] The token cache is being invalidate because project 9129e566087742a4ba1c3e0d8effad63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:00:31.318489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f1ce3fed-5300-41db-a560-dcfa33be87e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:31.319128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f1ce3fed-5300-41db-a560-dcfa33be87e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:31.330337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bcabb-d713-4668-ac49-3e591e71a55c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:31.330831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bcabb-d713-4668-ac49-3e591e71a55c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:31.330918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bcabb-d713-4668-ac49-3e591e71a55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:31.334105 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4036/8073] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:00:30 2022] DELETE /identity/v3/projects/9129e566087742a4ba1c3e0d8effad63 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:00:31.367987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-542bcabb-d713-4668-ac49-3e591e71a55c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:00:31.369274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-542bcabb-d713-4668-ac49-3e591e71a55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:31.485966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e1b60-6526-454a-9d96-bcaf4f7b34ca None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:31.486899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e1b60-6526-454a-9d96-bcaf4f7b34ca None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:31.487543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e1b60-6526-454a-9d96-bcaf4f7b34ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:31.492043 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4038/8074] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:00:31.528402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-430e1b60-6526-454a-9d96-bcaf4f7b34ca None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:00:31.529495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-430e1b60-6526-454a-9d96-bcaf4f7b34ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:31.547311 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4037/8075] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:00:31.552772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bcabb-d713-4668-ac49-3e591e71a55c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:31.590077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bcabb-d713-4668-ac49-3e591e71a55c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:31.598525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f97940-9e3f-4676-ae63-359aac10e114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:31.599526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f97940-9e3f-4676-ae63-359aac10e114 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:31.600637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f97940-9e3f-4676-ae63-359aac10e114 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:31.601077 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f97940-9e3f-4676-ae63-359aac10e114 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:31.601911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f97940-9e3f-4676-ae63-359aac10e114 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:00:31.605355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f97940-9e3f-4676-ae63-359aac10e114 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:31.610283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f97940-9e3f-4676-ae63-359aac10e114 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:31.639034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e1b60-6526-454a-9d96-bcaf4f7b34ca None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:31.639571 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4039/8076] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:00:31.650665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e1b60-6526-454a-9d96-bcaf4f7b34ca None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:31.656277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773db3f-763e-415a-b286-acb3393036fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:31.657371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773db3f-763e-415a-b286-acb3393036fc admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:31.657667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773db3f-763e-415a-b286-acb3393036fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:31.657947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773db3f-763e-415a-b286-acb3393036fc admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:31.659068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773db3f-763e-415a-b286-acb3393036fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:31.661654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773db3f-763e-415a-b286-acb3393036fc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:31.782825 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4038/8077] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:00:31 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 04:00:31.787469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f97940-9e3f-4676-ae63-359aac10e114 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:31.804250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f97940-9e3f-4676-ae63-359aac10e114 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:31.947189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae68a1-6df9-4f87-ad3d-981abbc3b1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:31.947863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae68a1-6df9-4f87-ad3d-981abbc3b1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:31.948150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae68a1-6df9-4f87-ad3d-981abbc3b1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:31.948431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae68a1-6df9-4f87-ad3d-981abbc3b1f5 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:31.949130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae68a1-6df9-4f87-ad3d-981abbc3b1f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:31.951795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae68a1-6df9-4f87-ad3d-981abbc3b1f5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:32.086840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773db3f-763e-415a-b286-acb3393036fc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:32.090222 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4040/8078] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:00:31 2022] POST /identity/v3/users => generated 292 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:00:32.104064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773db3f-763e-415a-b286-acb3393036fc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:32.109701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc336b-28d4-449d-9303-696dd4756cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:32.110464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc336b-28d4-449d-9303-696dd4756cab admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:32.110636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc336b-28d4-449d-9303-696dd4756cab admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:32.111073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc336b-28d4-449d-9303-696dd4756cab admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:32.111739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc336b-28d4-449d-9303-696dd4756cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:32.114551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc336b-28d4-449d-9303-696dd4756cab admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:32.130202 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4039/8079] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 04:00:32.131520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae68a1-6df9-4f87-ad3d-981abbc3b1f5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:32.154787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae68a1-6df9-4f87-ad3d-981abbc3b1f5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:32.185067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69cdf3-54f4-4b01-a4f5-f56985c7ab9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:32.185067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69cdf3-54f4-4b01-a4f5-f56985c7ab9f admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:32.185067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69cdf3-54f4-4b01-a4f5-f56985c7ab9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:32.185067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69cdf3-54f4-4b01-a4f5-f56985c7ab9f admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:32.185985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69cdf3-54f4-4b01-a4f5-f56985c7ab9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:32.190312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69cdf3-54f4-4b01-a4f5-f56985c7ab9f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:32.226462 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4041/8080] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:00:32.227697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc336b-28d4-449d-9303-696dd4756cab admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:32.234492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:32.243630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc336b-28d4-449d-9303-696dd4756cab admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:32.262574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb815325-b27d-422f-845d-49bae16e14a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:32.263199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb815325-b27d-422f-845d-49bae16e14a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:32.263512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb815325-b27d-422f-845d-49bae16e14a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:32.263794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb815325-b27d-422f-845d-49bae16e14a7 admin admin] PATH_INFO: `/v3/projects/e7c1184fdd8b4d169424a183d558343e/users/17e5ee2ba00040eaa196c44ee4c346eb/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:32.316905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb815325-b27d-422f-845d-49bae16e14a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c1184fdd8b4d169424a183d558343e, user_id=17e5ee2ba00040eaa196c44ee4c346eb, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:32.326993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb815325-b27d-422f-845d-49bae16e14a7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:32.425291 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4040/8081] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:00:32 2022] PUT /identity/v3/projects/e7c1184fdd8b4d169424a183d558343e/users/17e5ee2ba00040eaa196c44ee4c346eb/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 04:00:32.432461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f5697-4052-4ec8-9abf-95aa25303321 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:32.433323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f5697-4052-4ec8-9abf-95aa25303321 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:32.433783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f5697-4052-4ec8-9abf-95aa25303321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:32.485596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c02f5697-4052-4ec8-9abf-95aa25303321 None None] MFA Rules not processed for user `17e5ee2ba00040eaa196c44ee4c346eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:00:32.486914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c02f5697-4052-4ec8-9abf-95aa25303321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:32.551500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:32.612775 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4042/8082] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:00:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:00:32.617592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb815325-b27d-422f-845d-49bae16e14a7 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:32.737904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb815325-b27d-422f-845d-49bae16e14a7 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:32.745229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a11491-1764-4c05-bb9d-0a52e402e552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:32.747182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a11491-1764-4c05-bb9d-0a52e402e552 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:32.747572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a11491-1764-4c05-bb9d-0a52e402e552 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:32.748708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a11491-1764-4c05-bb9d-0a52e402e552 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:32.751272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a11491-1764-4c05-bb9d-0a52e402e552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:32.756538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a11491-1764-4c05-bb9d-0a52e402e552 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:32.959622 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4041/8083] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:00:32 2022] POST /identity/v3/projects => generated 385 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:00:32.964822 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f5697-4052-4ec8-9abf-95aa25303321 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:32.995311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f5697-4052-4ec8-9abf-95aa25303321 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:33.127426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6cc7d-ce61-4193-a5fb-ac902c3a6eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:33.128224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6cc7d-ce61-4193-a5fb-ac902c3a6eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:33.129201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6cc7d-ce61-4193-a5fb-ac902c3a6eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:33.129201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6cc7d-ce61-4193-a5fb-ac902c3a6eb8 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:33.129458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6cc7d-ce61-4193-a5fb-ac902c3a6eb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:33.134204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6cc7d-ce61-4193-a5fb-ac902c3a6eb8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:33.284620 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4043/8084] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:00:32 2022] POST /identity/v3/users => generated 293 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:00:33.288516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a11491-1764-4c05-bb9d-0a52e402e552 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:33.305954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a11491-1764-4c05-bb9d-0a52e402e552 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:33.325338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5138efb-73ef-4277-8e5f-7aeedda2f645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:33.326562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5138efb-73ef-4277-8e5f-7aeedda2f645 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:33.326902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5138efb-73ef-4277-8e5f-7aeedda2f645 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:33.327185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5138efb-73ef-4277-8e5f-7aeedda2f645 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:33.328046 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5138efb-73ef-4277-8e5f-7aeedda2f645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:33.331169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5138efb-73ef-4277-8e5f-7aeedda2f645 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:33.359616 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4042/8085] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:00:33.362691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6cc7d-ce61-4193-a5fb-ac902c3a6eb8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:33.378882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6cc7d-ce61-4193-a5fb-ac902c3a6eb8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:33.391095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012643f5-9d11-4a17-964a-456c25a2fa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:33.391738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012643f5-9d11-4a17-964a-456c25a2fa95 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:33.392022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012643f5-9d11-4a17-964a-456c25a2fa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:33.392293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012643f5-9d11-4a17-964a-456c25a2fa95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:33.392956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012643f5-9d11-4a17-964a-456c25a2fa95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:33.395201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012643f5-9d11-4a17-964a-456c25a2fa95 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:33.413203 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4044/8086] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:00:33.417617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5138efb-73ef-4277-8e5f-7aeedda2f645 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:33.429250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5138efb-73ef-4277-8e5f-7aeedda2f645 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:33.439630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779c45f-df57-4d51-ab60-574041864bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:33.440570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779c45f-df57-4d51-ab60-574041864bee admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:33.441083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779c45f-df57-4d51-ab60-574041864bee admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:33.441746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779c45f-df57-4d51-ab60-574041864bee admin admin] PATH_INFO: `/v3/projects/caf005b942b44e7c88e0b579c9f83409/users/5e7d05e4e35a4f05ae9fc7c19c974d16/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:33.464348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779c45f-df57-4d51-ab60-574041864bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf005b942b44e7c88e0b579c9f83409, user_id=5e7d05e4e35a4f05ae9fc7c19c974d16, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:33.474699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779c45f-df57-4d51-ab60-574041864bee admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:33.558386 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4043/8087] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:00:33 2022] PUT /identity/v3/projects/caf005b942b44e7c88e0b579c9f83409/users/5e7d05e4e35a4f05ae9fc7c19c974d16/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 04:00:33.690485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cbd7e-8028-41b6-90b9-3758c1bc3e02 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:33.690485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cbd7e-8028-41b6-90b9-3758c1bc3e02 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:33.690485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cbd7e-8028-41b6-90b9-3758c1bc3e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:33.741271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-180cbd7e-8028-41b6-90b9-3758c1bc3e02 None None] MFA Rules not processed for user `5e7d05e4e35a4f05ae9fc7c19c974d16`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:00:33.743156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-180cbd7e-8028-41b6-90b9-3758c1bc3e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:33.868358 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4045/8088] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:00:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:00:33.872938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779c45f-df57-4d51-ab60-574041864bee admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:33.960144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779c45f-df57-4d51-ab60-574041864bee admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:33.966391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c1b2c-686e-4da9-a5ee-8f59aa3eef2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:33.967457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c1b2c-686e-4da9-a5ee-8f59aa3eef2f admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:33.967924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c1b2c-686e-4da9-a5ee-8f59aa3eef2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:33.968507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c1b2c-686e-4da9-a5ee-8f59aa3eef2f admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:33.969639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c1b2c-686e-4da9-a5ee-8f59aa3eef2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:33.974261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c1b2c-686e-4da9-a5ee-8f59aa3eef2f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:34.104842 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4044/8089] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:00:33 2022] POST /identity/v3/projects => generated 381 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:00:34.108749 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cbd7e-8028-41b6-90b9-3758c1bc3e02 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:34.122206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cbd7e-8028-41b6-90b9-3758c1bc3e02 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:34.246998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:34.264598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d833a6e-074a-4da7-8248-83b0a6e75c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:34.265700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d833a6e-074a-4da7-8248-83b0a6e75c9b admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:34.265921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d833a6e-074a-4da7-8248-83b0a6e75c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:34.266330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d833a6e-074a-4da7-8248-83b0a6e75c9b admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:34.267075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d833a6e-074a-4da7-8248-83b0a6e75c9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:34.269120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d833a6e-074a-4da7-8248-83b0a6e75c9b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:34.423651 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4046/8090] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:00:34 2022] POST /identity/v3/users => generated 297 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:00:34.425223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c1b2c-686e-4da9-a5ee-8f59aa3eef2f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:34.439945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c1b2c-686e-4da9-a5ee-8f59aa3eef2f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:34.449989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b941f9-5c57-4857-8f96-27979a1daa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:34.450777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b941f9-5c57-4857-8f96-27979a1daa1d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:34.455419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b941f9-5c57-4857-8f96-27979a1daa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:34.455419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b941f9-5c57-4857-8f96-27979a1daa1d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:34.455419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b941f9-5c57-4857-8f96-27979a1daa1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:34.455419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b941f9-5c57-4857-8f96-27979a1daa1d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:34.474405 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4045/8091] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:00:34.478452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d833a6e-074a-4da7-8248-83b0a6e75c9b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:34.500925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d833a6e-074a-4da7-8248-83b0a6e75c9b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:34.521970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d882f0c-c1be-404c-8fd4-a761cae28a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:34.522716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d882f0c-c1be-404c-8fd4-a761cae28a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:34.523044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d882f0c-c1be-404c-8fd4-a761cae28a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:34.523298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d882f0c-c1be-404c-8fd4-a761cae28a5d admin admin] PATH_INFO: `/v3/projects/e85288884c1348f6bb9a5df18bd0452c/users/62ea545571b540a19374a50c1c7db3d2/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:34.564947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d882f0c-c1be-404c-8fd4-a761cae28a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85288884c1348f6bb9a5df18bd0452c, user_id=62ea545571b540a19374a50c1c7db3d2, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:34.569387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d882f0c-c1be-404c-8fd4-a761cae28a5d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:34.669411 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4047/8092] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:00:34 2022] PUT /identity/v3/projects/e85288884c1348f6bb9a5df18bd0452c/users/62ea545571b540a19374a50c1c7db3d2/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:00:34.670564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b941f9-5c57-4857-8f96-27979a1daa1d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:34.680005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:34.685624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b941f9-5c57-4857-8f96-27979a1daa1d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:34.828713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bb908-868e-4928-966d-49151439ec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:34.829563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bb908-868e-4928-966d-49151439ec67 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:34.829950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bb908-868e-4928-966d-49151439ec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:34.830378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bb908-868e-4928-966d-49151439ec67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:34.832449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bb908-868e-4928-966d-49151439ec67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:34.834769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bb908-868e-4928-966d-49151439ec67 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:34.855253 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4046/8093] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:00:34.859424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d882f0c-c1be-404c-8fd4-a761cae28a5d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:34.880945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d882f0c-c1be-404c-8fd4-a761cae28a5d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:34.893340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2301b-b70a-4a5c-8313-1800ed38a1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:34.895128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2301b-b70a-4a5c-8313-1800ed38a1ab admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:34.895763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2301b-b70a-4a5c-8313-1800ed38a1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:34.896226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2301b-b70a-4a5c-8313-1800ed38a1ab admin admin] PATH_INFO: `/v3/projects/e85288884c1348f6bb9a5df18bd0452c/users/62ea545571b540a19374a50c1c7db3d2/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:34.898635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2301b-b70a-4a5c-8313-1800ed38a1ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85288884c1348f6bb9a5df18bd0452c, user_id=62ea545571b540a19374a50c1c7db3d2, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:34.901562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2301b-b70a-4a5c-8313-1800ed38a1ab admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:34.920913 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4048/8094] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:00:34 2022] PUT /identity/v3/projects/e85288884c1348f6bb9a5df18bd0452c/users/62ea545571b540a19374a50c1c7db3d2/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:00:34.931457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee1bdd-f178-486b-9de0-1a6f8a515c6a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:34.931810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee1bdd-f178-486b-9de0-1a6f8a515c6a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:34.932030 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee1bdd-f178-486b-9de0-1a6f8a515c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:34.983875 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-18ee1bdd-f178-486b-9de0-1a6f8a515c6a None None] MFA Rules not processed for user `62ea545571b540a19374a50c1c7db3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:00:34.985649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-18ee1bdd-f178-486b-9de0-1a6f8a515c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:35.101035 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4047/8095] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:00:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:00:35.111269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2301b-b70a-4a5c-8313-1800ed38a1ab admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:35.113691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8bf2301b-b70a-4a5c-8313-1800ed38a1ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:35.193906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2301b-b70a-4a5c-8313-1800ed38a1ab admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:35.212807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308e8b3-97da-4f4c-9e48-1c642d4cc561 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:35.213525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308e8b3-97da-4f4c-9e48-1c642d4cc561 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:35.214483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308e8b3-97da-4f4c-9e48-1c642d4cc561 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:35.214838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308e8b3-97da-4f4c-9e48-1c642d4cc561 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:35.307049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308e8b3-97da-4f4c-9e48-1c642d4cc561 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:35.308795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308e8b3-97da-4f4c-9e48-1c642d4cc561 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:35.349525 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4049/8096] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:00:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:00:35.538025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71320503-5e94-4978-9345-0377cab73a2d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:35.538664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71320503-5e94-4978-9345-0377cab73a2d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:35.538664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71320503-5e94-4978-9345-0377cab73a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:35.581034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-71320503-5e94-4978-9345-0377cab73a2d None None] MFA Rules not processed for user `a2ea55b400c24827a28e816ea2a225aa`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:00:35.582586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-71320503-5e94-4978-9345-0377cab73a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:35.695240 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4048/8097] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:00:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:00:38.753597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308e8b3-97da-4f4c-9e48-1c642d4cc561 service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:38.767187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308e8b3-97da-4f4c-9e48-1c642d4cc561 service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:38.784708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38895a2-be97-4ac1-b668-bfeb61b7aa99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:38.784708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38895a2-be97-4ac1-b668-bfeb61b7aa99 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:38.784708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38895a2-be97-4ac1-b668-bfeb61b7aa99 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:38.784708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38895a2-be97-4ac1-b668-bfeb61b7aa99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:38.852279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:38.864853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38895a2-be97-4ac1-b668-bfeb61b7aa99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:38.866445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38895a2-be97-4ac1-b668-bfeb61b7aa99 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:38.880431 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4050/8098] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:00:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:00:40.473275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71320503-5e94-4978-9345-0377cab73a2d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:40.493741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71320503-5e94-4978-9345-0377cab73a2d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:40.499872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809ba13-8274-430f-8bc0-0d3eed7ec6ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:40.503505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809ba13-8274-430f-8bc0-0d3eed7ec6ab service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:40.508767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809ba13-8274-430f-8bc0-0d3eed7ec6ab service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:40.509258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809ba13-8274-430f-8bc0-0d3eed7ec6ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:40.549623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809ba13-8274-430f-8bc0-0d3eed7ec6ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:40.558175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809ba13-8274-430f-8bc0-0d3eed7ec6ab service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:40.588029 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4049/8099] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:00:40 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:00:49.651580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:50.573710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:51.073788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38895a2-be97-4ac1-b668-bfeb61b7aa99 service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:51.153051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38895a2-be97-4ac1-b668-bfeb61b7aa99 service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:51.158479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af0b9c-4f77-418b-8ff5-5b11b76e8792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:51.159490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af0b9c-4f77-418b-8ff5-5b11b76e8792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:51.159797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af0b9c-4f77-418b-8ff5-5b11b76e8792 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:51.160112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af0b9c-4f77-418b-8ff5-5b11b76e8792 admin admin] PATH_INFO: `/v3/users/17e5ee2ba00040eaa196c44ee4c346eb` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:51.161853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af0b9c-4f77-418b-8ff5-5b11b76e8792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17e5ee2ba00040eaa196c44ee4c346eb)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:51.165245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af0b9c-4f77-418b-8ff5-5b11b76e8792 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:51.425318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a0af0b9c-4f77-418b-8ff5-5b11b76e8792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17e5ee2ba00040eaa196c44ee4c346eb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:51.428002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a0af0b9c-4f77-418b-8ff5-5b11b76e8792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17e5ee2ba00040eaa196c44ee4c346eb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:51.440756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a0af0b9c-4f77-418b-8ff5-5b11b76e8792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17e5ee2ba00040eaa196c44ee4c346eb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:51.463295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a0af0b9c-4f77-418b-8ff5-5b11b76e8792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17e5ee2ba00040eaa196c44ee4c346eb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:51.465714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a0af0b9c-4f77-418b-8ff5-5b11b76e8792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17e5ee2ba00040eaa196c44ee4c346eb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:51.555962 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4051/8100] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:00:51 2022] DELETE /identity/v3/users/17e5ee2ba00040eaa196c44ee4c346eb => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:00:51.558421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b9151-c15d-4d19-bc33-44df8225ae14 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:51.558715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b9151-c15d-4d19-bc33-44df8225ae14 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:51.558985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b9151-c15d-4d19-bc33-44df8225ae14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:51.598439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d27b9151-c15d-4d19-bc33-44df8225ae14 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:00:51.599680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d27b9151-c15d-4d19-bc33-44df8225ae14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:51.712409 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4050/8101] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 04:00:51.734745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af0b9c-4f77-418b-8ff5-5b11b76e8792 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:51.736208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a0af0b9c-4f77-418b-8ff5-5b11b76e8792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:51.814712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af0b9c-4f77-418b-8ff5-5b11b76e8792 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:51.820767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791cbac-3287-455b-8a56-836e5d35cd4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:51.822018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791cbac-3287-455b-8a56-836e5d35cd4a service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:51.822552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791cbac-3287-455b-8a56-836e5d35cd4a service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:51.823053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791cbac-3287-455b-8a56-836e5d35cd4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:51.835782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791cbac-3287-455b-8a56-836e5d35cd4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:51.842897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791cbac-3287-455b-8a56-836e5d35cd4a service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:51.858587 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4052/8102] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:00:52.933277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b9151-c15d-4d19-bc33-44df8225ae14 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:52.934808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d27b9151-c15d-4d19-bc33-44df8225ae14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:52.949794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b9151-c15d-4d19-bc33-44df8225ae14 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:52.955473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff76e3-e6c1-4521-8caf-286d91f7192c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:52.957692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff76e3-e6c1-4521-8caf-286d91f7192c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:52.957978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff76e3-e6c1-4521-8caf-286d91f7192c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:52.958588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff76e3-e6c1-4521-8caf-286d91f7192c admin admin] PATH_INFO: `/v3/projects/e7c1184fdd8b4d169424a183d558343e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:52.960464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff76e3-e6c1-4521-8caf-286d91f7192c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7c1184fdd8b4d169424a183d558343e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:52.962625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff76e3-e6c1-4521-8caf-286d91f7192c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:53.114873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-99ff76e3-e6c1-4521-8caf-286d91f7192c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7c1184fdd8b4d169424a183d558343e', 'request_id': 'req-99ff76e3-e6c1-4521-8caf-286d91f7192c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:53.168832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-99ff76e3-e6c1-4521-8caf-286d91f7192c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7c1184fdd8b4d169424a183d558343e', 'request_id': 'req-99ff76e3-e6c1-4521-8caf-286d91f7192c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:53.179578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-99ff76e3-e6c1-4521-8caf-286d91f7192c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7c1184fdd8b4d169424a183d558343e', 'request_id': 'req-99ff76e3-e6c1-4521-8caf-286d91f7192c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:53.199497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-99ff76e3-e6c1-4521-8caf-286d91f7192c admin admin] The token cache is being invalidate because project e7c1184fdd8b4d169424a183d558343e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:00:53.200229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-99ff76e3-e6c1-4521-8caf-286d91f7192c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:53.201729 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-99ff76e3-e6c1-4521-8caf-286d91f7192c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:53.203902 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4051/8103] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:00:52 2022] DELETE /identity/v3/projects/e7c1184fdd8b4d169424a183d558343e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:00:53.207818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791cbac-3287-455b-8a56-836e5d35cd4a service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:53.218173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791cbac-3287-455b-8a56-836e5d35cd4a service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:53.245963 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:53.295642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08627b68-a23a-4076-ae11-5c60afdcdc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:53.298187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08627b68-a23a-4076-ae11-5c60afdcdc09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:53.298187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08627b68-a23a-4076-ae11-5c60afdcdc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:53.298187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08627b68-a23a-4076-ae11-5c60afdcdc09 admin admin] PATH_INFO: `/v3/users/5e7d05e4e35a4f05ae9fc7c19c974d16` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:53.298187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08627b68-a23a-4076-ae11-5c60afdcdc09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e7d05e4e35a4f05ae9fc7c19c974d16)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:53.300226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08627b68-a23a-4076-ae11-5c60afdcdc09 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:53.534312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-08627b68-a23a-4076-ae11-5c60afdcdc09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e7d05e4e35a4f05ae9fc7c19c974d16'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:53.536580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-08627b68-a23a-4076-ae11-5c60afdcdc09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e7d05e4e35a4f05ae9fc7c19c974d16'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:53.549506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-08627b68-a23a-4076-ae11-5c60afdcdc09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e7d05e4e35a4f05ae9fc7c19c974d16'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:53.565306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-08627b68-a23a-4076-ae11-5c60afdcdc09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e7d05e4e35a4f05ae9fc7c19c974d16'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:53.566061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-08627b68-a23a-4076-ae11-5c60afdcdc09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e7d05e4e35a4f05ae9fc7c19c974d16'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:53.649400 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4053/8104] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:00:53 2022] DELETE /identity/v3/users/5e7d05e4e35a4f05ae9fc7c19c974d16 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:00:55.322176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff76e3-e6c1-4521-8caf-286d91f7192c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:55.324173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-99ff76e3-e6c1-4521-8caf-286d91f7192c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:55.344767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff76e3-e6c1-4521-8caf-286d91f7192c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:55.473877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4eff3b-cf34-42a0-bd9c-e103c7666907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:55.475014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eff3b-cf34-42a0-bd9c-e103c7666907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:55.475583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eff3b-cf34-42a0-bd9c-e103c7666907 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:55.476846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eff3b-cf34-42a0-bd9c-e103c7666907 admin admin] PATH_INFO: `/v3/projects/caf005b942b44e7c88e0b579c9f83409` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:55.478823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4eff3b-cf34-42a0-bd9c-e103c7666907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caf005b942b44e7c88e0b579c9f83409)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:55.481705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4eff3b-cf34-42a0-bd9c-e103c7666907 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:55.619655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:55.636517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5e4eff3b-cf34-42a0-bd9c-e103c7666907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caf005b942b44e7c88e0b579c9f83409', 'request_id': 'req-5e4eff3b-cf34-42a0-bd9c-e103c7666907'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:55.764453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5e4eff3b-cf34-42a0-bd9c-e103c7666907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caf005b942b44e7c88e0b579c9f83409', 'request_id': 'req-5e4eff3b-cf34-42a0-bd9c-e103c7666907'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:55.776658 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5e4eff3b-cf34-42a0-bd9c-e103c7666907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caf005b942b44e7c88e0b579c9f83409', 'request_id': 'req-5e4eff3b-cf34-42a0-bd9c-e103c7666907'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:55.794976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5e4eff3b-cf34-42a0-bd9c-e103c7666907 admin admin] The token cache is being invalidate because project caf005b942b44e7c88e0b579c9f83409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:00:55.795279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5e4eff3b-cf34-42a0-bd9c-e103c7666907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:55.796013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-5e4eff3b-cf34-42a0-bd9c-e103c7666907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:55.799144 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4052/8105] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:00:55 2022] DELETE /identity/v3/projects/caf005b942b44e7c88e0b579c9f83409 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:00:55.802575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08627b68-a23a-4076-ae11-5c60afdcdc09 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:55.804223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-08627b68-a23a-4076-ae11-5c60afdcdc09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:55.820554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08627b68-a23a-4076-ae11-5c60afdcdc09 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:55.899421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d23d0-dde4-470d-b4d1-0ea7ee567c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:55.900476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d23d0-dde4-470d-b4d1-0ea7ee567c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:55.900867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d23d0-dde4-470d-b4d1-0ea7ee567c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:55.901241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d23d0-dde4-470d-b4d1-0ea7ee567c22 admin admin] PATH_INFO: `/v3/users/62ea545571b540a19374a50c1c7db3d2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:55.902578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d23d0-dde4-470d-b4d1-0ea7ee567c22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62ea545571b540a19374a50c1c7db3d2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:55.905003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d23d0-dde4-470d-b4d1-0ea7ee567c22 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:56.143455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:56.151326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-515d23d0-dde4-470d-b4d1-0ea7ee567c22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62ea545571b540a19374a50c1c7db3d2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:56.152030 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-515d23d0-dde4-470d-b4d1-0ea7ee567c22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62ea545571b540a19374a50c1c7db3d2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:56.160291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-515d23d0-dde4-470d-b4d1-0ea7ee567c22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62ea545571b540a19374a50c1c7db3d2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:56.173437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-515d23d0-dde4-470d-b4d1-0ea7ee567c22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62ea545571b540a19374a50c1c7db3d2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:56.174327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-515d23d0-dde4-470d-b4d1-0ea7ee567c22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62ea545571b540a19374a50c1c7db3d2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:56.300190 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4054/8106] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:00:55 2022] DELETE /identity/v3/users/62ea545571b540a19374a50c1c7db3d2 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:00:57.734004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4eff3b-cf34-42a0-bd9c-e103c7666907 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:57.736973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5e4eff3b-cf34-42a0-bd9c-e103c7666907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:57.759565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4eff3b-cf34-42a0-bd9c-e103c7666907 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:57.885970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a7762-369f-406d-89cf-3f34ec512d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:57.886803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a7762-369f-406d-89cf-3f34ec512d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:57.887241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a7762-369f-406d-89cf-3f34ec512d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:57.887644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a7762-369f-406d-89cf-3f34ec512d11 admin admin] PATH_INFO: `/v3/projects/e85288884c1348f6bb9a5df18bd0452c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:57.889360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a7762-369f-406d-89cf-3f34ec512d11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85288884c1348f6bb9a5df18bd0452c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:57.891472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a7762-369f-406d-89cf-3f34ec512d11 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:58.117021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8f0a7762-369f-406d-89cf-3f34ec512d11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85288884c1348f6bb9a5df18bd0452c', 'request_id': 'req-8f0a7762-369f-406d-89cf-3f34ec512d11'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:58.212333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8f0a7762-369f-406d-89cf-3f34ec512d11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85288884c1348f6bb9a5df18bd0452c', 'request_id': 'req-8f0a7762-369f-406d-89cf-3f34ec512d11'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:58.221090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8f0a7762-369f-406d-89cf-3f34ec512d11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85288884c1348f6bb9a5df18bd0452c', 'request_id': 'req-8f0a7762-369f-406d-89cf-3f34ec512d11'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:58.243732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8f0a7762-369f-406d-89cf-3f34ec512d11 admin admin] The token cache is being invalidate because project e85288884c1348f6bb9a5df18bd0452c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:00:58.246912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8f0a7762-369f-406d-89cf-3f34ec512d11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:58.246912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-8f0a7762-369f-406d-89cf-3f34ec512d11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:00:58.250787 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4053/8107] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:00:57 2022] DELETE /identity/v3/projects/e85288884c1348f6bb9a5df18bd0452c => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:00:58.252335 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263c17f-6344-4312-8641-751f058e4f18 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:58.252835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263c17f-6344-4312-8641-751f058e4f18 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:58.252835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263c17f-6344-4312-8641-751f058e4f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:58.290778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8263c17f-6344-4312-8641-751f058e4f18 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:00:58.293929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8263c17f-6344-4312-8641-751f058e4f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:58.403346 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4055/8108] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 04:00:58.413866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc69b3-309e-4948-8455-54dbdaf9b31a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:58.414593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc69b3-309e-4948-8455-54dbdaf9b31a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:58.414593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc69b3-309e-4948-8455-54dbdaf9b31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:58.443268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-89bc69b3-309e-4948-8455-54dbdaf9b31a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:00:58.444693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-89bc69b3-309e-4948-8455-54dbdaf9b31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:58.457821 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4054/8109] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:00:58.458800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263c17f-6344-4312-8641-751f058e4f18 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:58.473155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263c17f-6344-4312-8641-751f058e4f18 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:58.489616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71decb85-6368-4aaf-bc9e-b043e6c937d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:58.490488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71decb85-6368-4aaf-bc9e-b043e6c937d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:58.490871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71decb85-6368-4aaf-bc9e-b043e6c937d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:58.491241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71decb85-6368-4aaf-bc9e-b043e6c937d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:58.492009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71decb85-6368-4aaf-bc9e-b043e6c937d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:00:58.492621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71decb85-6368-4aaf-bc9e-b043e6c937d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:58.497070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71decb85-6368-4aaf-bc9e-b043e6c937d7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:58.537745 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4056/8110] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:00:58.539105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc69b3-309e-4948-8455-54dbdaf9b31a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:58.554930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc69b3-309e-4948-8455-54dbdaf9b31a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:58.561260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72b69b-a4d3-4c1a-b37a-1607e920b37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:58.563566 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72b69b-a4d3-4c1a-b37a-1607e920b37c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:58.563869 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72b69b-a4d3-4c1a-b37a-1607e920b37c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:58.565299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72b69b-a4d3-4c1a-b37a-1607e920b37c admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:58.565299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72b69b-a4d3-4c1a-b37a-1607e920b37c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:58.567259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72b69b-a4d3-4c1a-b37a-1607e920b37c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:58.674701 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4055/8111] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:00:58 2022] POST /identity/v3/projects => generated 367 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:00:58.679741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71decb85-6368-4aaf-bc9e-b043e6c937d7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:58.702256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71decb85-6368-4aaf-bc9e-b043e6c937d7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:58.883299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fab38-0b13-4dd8-947e-037bc0304466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:58.886571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fab38-0b13-4dd8-947e-037bc0304466 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:58.888091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fab38-0b13-4dd8-947e-037bc0304466 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:58.888510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fab38-0b13-4dd8-947e-037bc0304466 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:58.889281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2fab38-0b13-4dd8-947e-037bc0304466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:58.893049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2fab38-0b13-4dd8-947e-037bc0304466 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:59.151806 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4057/8112] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:00:58 2022] POST /identity/v3/users => generated 284 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:00:59.154911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72b69b-a4d3-4c1a-b37a-1607e920b37c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:59.175624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72b69b-a4d3-4c1a-b37a-1607e920b37c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:59.192977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff0a44-8ea8-4f0d-86b1-c92db85511c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:59.193895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff0a44-8ea8-4f0d-86b1-c92db85511c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:59.194450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff0a44-8ea8-4f0d-86b1-c92db85511c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:59.194908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff0a44-8ea8-4f0d-86b1-c92db85511c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:59.195732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff0a44-8ea8-4f0d-86b1-c92db85511c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:59.198601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff0a44-8ea8-4f0d-86b1-c92db85511c8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:59.217272 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4056/8113] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:00:59.223867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fab38-0b13-4dd8-947e-037bc0304466 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:59.236937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fab38-0b13-4dd8-947e-037bc0304466 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:59.246988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed01f08-2456-4af0-9b46-5997a4d03f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:59.248353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed01f08-2456-4af0-9b46-5997a4d03f24 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:59.248649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed01f08-2456-4af0-9b46-5997a4d03f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:59.248927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed01f08-2456-4af0-9b46-5997a4d03f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:59.249603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed01f08-2456-4af0-9b46-5997a4d03f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:59.251292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed01f08-2456-4af0-9b46-5997a4d03f24 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:59.292247 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4058/8114] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:00:59.297045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff0a44-8ea8-4f0d-86b1-c92db85511c8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:59.307710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:59.317131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff0a44-8ea8-4f0d-86b1-c92db85511c8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:59.332984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727411b-737e-47b1-9558-a468031f7a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:59.334105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727411b-737e-47b1-9558-a468031f7a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:59.334605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727411b-737e-47b1-9558-a468031f7a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:59.335104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727411b-737e-47b1-9558-a468031f7a73 admin admin] PATH_INFO: `/v3/projects/a9953ed984194ea3b6d8b7119c034730/users/845214c60b5843ccafa0bc10c63911b8/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:59.378103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727411b-737e-47b1-9558-a468031f7a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9953ed984194ea3b6d8b7119c034730, user_id=845214c60b5843ccafa0bc10c63911b8, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:59.378784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727411b-737e-47b1-9558-a468031f7a73 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:59.456917 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4057/8115] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:00:59 2022] PUT /identity/v3/projects/a9953ed984194ea3b6d8b7119c034730/users/845214c60b5843ccafa0bc10c63911b8/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:00:59.468157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308494fa-2737-49d4-aa6c-ea019fccee5d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:59.470354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308494fa-2737-49d4-aa6c-ea019fccee5d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:59.470652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308494fa-2737-49d4-aa6c-ea019fccee5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:59.550773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-308494fa-2737-49d4-aa6c-ea019fccee5d None None] MFA Rules not processed for user `845214c60b5843ccafa0bc10c63911b8`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:00:59.555734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-308494fa-2737-49d4-aa6c-ea019fccee5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:59.607747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:59.719468 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4059/8116] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:00:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:00:59.734703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727411b-737e-47b1-9558-a468031f7a73 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:00:59.737246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4727411b-737e-47b1-9558-a468031f7a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:00:59.877597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727411b-737e-47b1-9558-a468031f7a73 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:00:59.881846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590cb63-18b2-435f-a467-1de6ee0a7b49 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:00:59.882518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590cb63-18b2-435f-a467-1de6ee0a7b49 service glance] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:00:59.882808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590cb63-18b2-435f-a467-1de6ee0a7b49 service glance] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:00:59.883094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590cb63-18b2-435f-a467-1de6ee0a7b49 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:00:59.902511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590cb63-18b2-435f-a467-1de6ee0a7b49 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:00:59.904348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590cb63-18b2-435f-a467-1de6ee0a7b49 service glance] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:00:59.915063 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4058/8117] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:00:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:01:09.910119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:10.031840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=20 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:11.788605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308494fa-2737-49d4-aa6c-ea019fccee5d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:11.792326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-308494fa-2737-49d4-aa6c-ea019fccee5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:11.900798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308494fa-2737-49d4-aa6c-ea019fccee5d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:11.906439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf1e4d-176b-473b-8e0e-3ef1b499f77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:11.906682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf1e4d-176b-473b-8e0e-3ef1b499f77c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:11.906967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf1e4d-176b-473b-8e0e-3ef1b499f77c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:11.907244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf1e4d-176b-473b-8e0e-3ef1b499f77c admin admin] PATH_INFO: `/v3/users/3e7ffbb437004d379258425747bf1521` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:11.908435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf1e4d-176b-473b-8e0e-3ef1b499f77c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e7ffbb437004d379258425747bf1521)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:11.910528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf1e4d-176b-473b-8e0e-3ef1b499f77c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:12.205763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-95bf1e4d-176b-473b-8e0e-3ef1b499f77c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e7ffbb437004d379258425747bf1521'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:12.206834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-95bf1e4d-176b-473b-8e0e-3ef1b499f77c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e7ffbb437004d379258425747bf1521'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:12.227918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-95bf1e4d-176b-473b-8e0e-3ef1b499f77c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e7ffbb437004d379258425747bf1521'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:12.258851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-95bf1e4d-176b-473b-8e0e-3ef1b499f77c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e7ffbb437004d379258425747bf1521'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:12.259617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-95bf1e4d-176b-473b-8e0e-3ef1b499f77c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e7ffbb437004d379258425747bf1521'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:12.347532 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4060/8118] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:01:11 2022] DELETE /identity/v3/users/3e7ffbb437004d379258425747bf1521 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:01:12.352644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c36396-58dd-4a3c-94e0-fec63101fc48 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:12.353167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c36396-58dd-4a3c-94e0-fec63101fc48 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:12.354661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c36396-58dd-4a3c-94e0-fec63101fc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:12.387556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-60c36396-58dd-4a3c-94e0-fec63101fc48 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:01:12.392131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-60c36396-58dd-4a3c-94e0-fec63101fc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:12.534603 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4059/8119] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:01:12.546380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf1e4d-176b-473b-8e0e-3ef1b499f77c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:12.549563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-95bf1e4d-176b-473b-8e0e-3ef1b499f77c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:12.672131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf1e4d-176b-473b-8e0e-3ef1b499f77c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:12.678363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9071a-667f-4682-80e6-18fa9b2f65e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:12.679157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9071a-667f-4682-80e6-18fa9b2f65e6 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:12.679799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9071a-667f-4682-80e6-18fa9b2f65e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:12.680691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9071a-667f-4682-80e6-18fa9b2f65e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:12.696103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9071a-667f-4682-80e6-18fa9b2f65e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:12.697656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9071a-667f-4682-80e6-18fa9b2f65e6 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:12.713934 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4061/8120] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:01:13.033204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c36396-58dd-4a3c-94e0-fec63101fc48 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:13.037221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-60c36396-58dd-4a3c-94e0-fec63101fc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:13.074735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c36396-58dd-4a3c-94e0-fec63101fc48 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:13.086436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b938d0-8a43-4895-91f9-d0c154947bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:13.087514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b938d0-8a43-4895-91f9-d0c154947bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:13.089392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b938d0-8a43-4895-91f9-d0c154947bed admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:13.089747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b938d0-8a43-4895-91f9-d0c154947bed admin admin] PATH_INFO: `/v3/projects/038d0cade5d540d399e5d237ed07419f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:13.107651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b938d0-8a43-4895-91f9-d0c154947bed admin admin] RBAC: Authorizing `identity:delete_project(project_id=038d0cade5d540d399e5d237ed07419f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:13.121323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b938d0-8a43-4895-91f9-d0c154947bed admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:13.309936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a8b938d0-8a43-4895-91f9-d0c154947bed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '038d0cade5d540d399e5d237ed07419f', 'request_id': 'req-a8b938d0-8a43-4895-91f9-d0c154947bed'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:13.380225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a8b938d0-8a43-4895-91f9-d0c154947bed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '038d0cade5d540d399e5d237ed07419f', 'request_id': 'req-a8b938d0-8a43-4895-91f9-d0c154947bed'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:13.392904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a8b938d0-8a43-4895-91f9-d0c154947bed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '038d0cade5d540d399e5d237ed07419f', 'request_id': 'req-a8b938d0-8a43-4895-91f9-d0c154947bed'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:13.411935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a8b938d0-8a43-4895-91f9-d0c154947bed admin admin] The token cache is being invalidate because project 038d0cade5d540d399e5d237ed07419f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:01:13.412225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a8b938d0-8a43-4895-91f9-d0c154947bed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:13.413492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a8b938d0-8a43-4895-91f9-d0c154947bed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:13.417572 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4060/8121] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:01:13 2022] DELETE /identity/v3/projects/038d0cade5d540d399e5d237ed07419f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:01:13.421623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9071a-667f-4682-80e6-18fa9b2f65e6 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:13.433862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9071a-667f-4682-80e6-18fa9b2f65e6 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:13.465707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:13.525910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21ccc2-8739-4724-9286-f83bbf3a486b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:13.526655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21ccc2-8739-4724-9286-f83bbf3a486b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:13.527470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21ccc2-8739-4724-9286-f83bbf3a486b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:13.529293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21ccc2-8739-4724-9286-f83bbf3a486b admin admin] PATH_INFO: `/v3/users/57e54220934042f9a69ffd2b02b1b96c` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:13.530905 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21ccc2-8739-4724-9286-f83bbf3a486b admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e54220934042f9a69ffd2b02b1b96c)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:13.533204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21ccc2-8739-4724-9286-f83bbf3a486b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:13.784073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5f21ccc2-8739-4724-9286-f83bbf3a486b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e54220934042f9a69ffd2b02b1b96c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:13.784750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5f21ccc2-8739-4724-9286-f83bbf3a486b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e54220934042f9a69ffd2b02b1b96c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:13.796872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5f21ccc2-8739-4724-9286-f83bbf3a486b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e54220934042f9a69ffd2b02b1b96c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:13.813786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5f21ccc2-8739-4724-9286-f83bbf3a486b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e54220934042f9a69ffd2b02b1b96c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:13.815275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-5f21ccc2-8739-4724-9286-f83bbf3a486b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e54220934042f9a69ffd2b02b1b96c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:13.919237 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4062/8122] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:01:13 2022] DELETE /identity/v3/users/57e54220934042f9a69ffd2b02b1b96c => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:01:14.568199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b938d0-8a43-4895-91f9-d0c154947bed admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:14.570450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a8b938d0-8a43-4895-91f9-d0c154947bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:14.607962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b938d0-8a43-4895-91f9-d0c154947bed admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:14.747687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de900af-6c62-4818-9c93-46ba7847b96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:14.748436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de900af-6c62-4818-9c93-46ba7847b96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:14.749392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de900af-6c62-4818-9c93-46ba7847b96b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:14.749816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de900af-6c62-4818-9c93-46ba7847b96b admin admin] PATH_INFO: `/v3/projects/7012c9031d05477d99fde24bd2d44f48` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:14.764560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de900af-6c62-4818-9c93-46ba7847b96b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7012c9031d05477d99fde24bd2d44f48)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:14.769322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de900af-6c62-4818-9c93-46ba7847b96b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:15.402076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:15.479151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6de900af-6c62-4818-9c93-46ba7847b96b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7012c9031d05477d99fde24bd2d44f48', 'request_id': 'req-6de900af-6c62-4818-9c93-46ba7847b96b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:15.585629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6de900af-6c62-4818-9c93-46ba7847b96b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7012c9031d05477d99fde24bd2d44f48', 'request_id': 'req-6de900af-6c62-4818-9c93-46ba7847b96b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:15.597397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6de900af-6c62-4818-9c93-46ba7847b96b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7012c9031d05477d99fde24bd2d44f48', 'request_id': 'req-6de900af-6c62-4818-9c93-46ba7847b96b'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:15.621777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6de900af-6c62-4818-9c93-46ba7847b96b admin admin] The token cache is being invalidate because project 7012c9031d05477d99fde24bd2d44f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:01:15.622109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6de900af-6c62-4818-9c93-46ba7847b96b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:15.624691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6de900af-6c62-4818-9c93-46ba7847b96b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:15.629171 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4061/8123] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:01:14 2022] DELETE /identity/v3/projects/7012c9031d05477d99fde24bd2d44f48 => generated 0 bytes in 1063 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 04:01:15.639042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21ccc2-8739-4724-9286-f83bbf3a486b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:15.641802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5f21ccc2-8739-4724-9286-f83bbf3a486b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:15.658544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21ccc2-8739-4724-9286-f83bbf3a486b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:15.765347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e92703-2dd2-4a52-8759-0377847e132b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:15.774575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e92703-2dd2-4a52-8759-0377847e132b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:15.779502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e92703-2dd2-4a52-8759-0377847e132b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:15.779502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e92703-2dd2-4a52-8759-0377847e132b admin admin] PATH_INFO: `/v3/users/fe77aa1c8d5b4a90a15275af5edb9225` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:15.779502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e92703-2dd2-4a52-8759-0377847e132b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe77aa1c8d5b4a90a15275af5edb9225)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:15.779502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e92703-2dd2-4a52-8759-0377847e132b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:16.011970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:16.016721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c1e92703-2dd2-4a52-8759-0377847e132b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe77aa1c8d5b4a90a15275af5edb9225'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:16.018169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c1e92703-2dd2-4a52-8759-0377847e132b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe77aa1c8d5b4a90a15275af5edb9225'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:16.027730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c1e92703-2dd2-4a52-8759-0377847e132b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe77aa1c8d5b4a90a15275af5edb9225'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:16.050705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c1e92703-2dd2-4a52-8759-0377847e132b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe77aa1c8d5b4a90a15275af5edb9225'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:16.051494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c1e92703-2dd2-4a52-8759-0377847e132b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe77aa1c8d5b4a90a15275af5edb9225'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:16.140852 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4063/8124] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:01:15 2022] DELETE /identity/v3/users/fe77aa1c8d5b4a90a15275af5edb9225 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:01:16.541506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de900af-6c62-4818-9c93-46ba7847b96b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:16.543460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6de900af-6c62-4818-9c93-46ba7847b96b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:16.578076 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de900af-6c62-4818-9c93-46ba7847b96b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:16.685959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e58ab9-3212-4f7e-aad1-fec822ac85c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:16.686646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e58ab9-3212-4f7e-aad1-fec822ac85c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:16.686934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e58ab9-3212-4f7e-aad1-fec822ac85c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:16.687477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e58ab9-3212-4f7e-aad1-fec822ac85c3 admin admin] PATH_INFO: `/v3/projects/115adeda6afe44e8b390488de73dcdc2` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:16.688715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e58ab9-3212-4f7e-aad1-fec822ac85c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=115adeda6afe44e8b390488de73dcdc2)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:16.696488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e58ab9-3212-4f7e-aad1-fec822ac85c3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:16.860472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-51e58ab9-3212-4f7e-aad1-fec822ac85c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '115adeda6afe44e8b390488de73dcdc2', 'request_id': 'req-51e58ab9-3212-4f7e-aad1-fec822ac85c3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:16.938230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-51e58ab9-3212-4f7e-aad1-fec822ac85c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '115adeda6afe44e8b390488de73dcdc2', 'request_id': 'req-51e58ab9-3212-4f7e-aad1-fec822ac85c3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:16.946783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-51e58ab9-3212-4f7e-aad1-fec822ac85c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '115adeda6afe44e8b390488de73dcdc2', 'request_id': 'req-51e58ab9-3212-4f7e-aad1-fec822ac85c3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:16.961867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-51e58ab9-3212-4f7e-aad1-fec822ac85c3 admin admin] The token cache is being invalidate because project 115adeda6afe44e8b390488de73dcdc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:01:16.962211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-51e58ab9-3212-4f7e-aad1-fec822ac85c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:16.962892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-51e58ab9-3212-4f7e-aad1-fec822ac85c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:16.964629 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4062/8125] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:01:16 2022] DELETE /identity/v3/projects/115adeda6afe44e8b390488de73dcdc2 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:01:16.970160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfbae6-d5e8-4b9c-b5c9-69505984286c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:16.971285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfbae6-d5e8-4b9c-b5c9-69505984286c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:16.971925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfbae6-d5e8-4b9c-b5c9-69505984286c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:17.012622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7fcfbae6-d5e8-4b9c-b5c9-69505984286c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:01:17.013938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7fcfbae6-d5e8-4b9c-b5c9-69505984286c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:17.111375 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4064/8126] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:01:17.122382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f4156-1762-4b90-839c-ea5762a91d42 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:17.122673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f4156-1762-4b90-839c-ea5762a91d42 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:17.122952 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f4156-1762-4b90-839c-ea5762a91d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:17.169196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d87f4156-1762-4b90-839c-ea5762a91d42 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:01:17.174222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d87f4156-1762-4b90-839c-ea5762a91d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:17.219153 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4063/8127] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:01:17.330470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfbae6-d5e8-4b9c-b5c9-69505984286c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:17.346660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfbae6-d5e8-4b9c-b5c9-69505984286c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:17.357673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feeafdd-c703-4165-b5e6-b822cb6f06af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:17.359974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeafdd-c703-4165-b5e6-b822cb6f06af admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:17.360263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeafdd-c703-4165-b5e6-b822cb6f06af admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:17.360546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeafdd-c703-4165-b5e6-b822cb6f06af admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:17.361249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feeafdd-c703-4165-b5e6-b822cb6f06af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:01:17.361545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feeafdd-c703-4165-b5e6-b822cb6f06af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:17.363226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feeafdd-c703-4165-b5e6-b822cb6f06af admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:17.393981 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4065/8128] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:01:17.397066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f4156-1762-4b90-839c-ea5762a91d42 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:17.409445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f4156-1762-4b90-839c-ea5762a91d42 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:17.415483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efae7e7-1800-45d0-b89f-1476a5986d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:17.417243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efae7e7-1800-45d0-b89f-1476a5986d5b admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:17.417243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efae7e7-1800-45d0-b89f-1476a5986d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:17.417243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efae7e7-1800-45d0-b89f-1476a5986d5b admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:17.417753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efae7e7-1800-45d0-b89f-1476a5986d5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:17.419908 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efae7e7-1800-45d0-b89f-1476a5986d5b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:17.517406 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4064/8129] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:01:17 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:01:17.521935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feeafdd-c703-4165-b5e6-b822cb6f06af admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:17.539089 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feeafdd-c703-4165-b5e6-b822cb6f06af admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:17.631418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342a6af-0f1d-4098-898e-8a3d23caf701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:17.632061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342a6af-0f1d-4098-898e-8a3d23caf701 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:17.632398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342a6af-0f1d-4098-898e-8a3d23caf701 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:17.632608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342a6af-0f1d-4098-898e-8a3d23caf701 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:17.633241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342a6af-0f1d-4098-898e-8a3d23caf701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:17.635313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342a6af-0f1d-4098-898e-8a3d23caf701 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:17.755820 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4066/8130] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:01:17 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:01:17.756515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efae7e7-1800-45d0-b89f-1476a5986d5b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:17.768668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efae7e7-1800-45d0-b89f-1476a5986d5b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:17.775956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875cfb44-7dad-4305-967f-213b776c5c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:17.777040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cfb44-7dad-4305-967f-213b776c5c25 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:17.777040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cfb44-7dad-4305-967f-213b776c5c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:17.778432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cfb44-7dad-4305-967f-213b776c5c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:17.779240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875cfb44-7dad-4305-967f-213b776c5c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:17.781048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875cfb44-7dad-4305-967f-213b776c5c25 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:17.799346 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4065/8131] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 04:01:17.803758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342a6af-0f1d-4098-898e-8a3d23caf701 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:17.815212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342a6af-0f1d-4098-898e-8a3d23caf701 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:17.820897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cfa19-19e3-432a-adfd-0656df478296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:17.821687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cfa19-19e3-432a-adfd-0656df478296 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:17.822022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cfa19-19e3-432a-adfd-0656df478296 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:17.822293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cfa19-19e3-432a-adfd-0656df478296 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:17.823100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19cfa19-19e3-432a-adfd-0656df478296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:17.826246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19cfa19-19e3-432a-adfd-0656df478296 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:17.837534 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4067/8132] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 04:01:17.844207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875cfb44-7dad-4305-967f-213b776c5c25 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:17.854327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:17.860558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875cfb44-7dad-4305-967f-213b776c5c25 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:17.867166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c839ad-3bd4-499b-b335-caf6bc87e40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:17.867166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c839ad-3bd4-499b-b335-caf6bc87e40d admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:17.867166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c839ad-3bd4-499b-b335-caf6bc87e40d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:17.867166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c839ad-3bd4-499b-b335-caf6bc87e40d admin admin] PATH_INFO: `/v3/projects/586d194e60ee461197b124db7501f8be/users/25ee3a8fd93c4ad8b83c7e4ef94f4c8a/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:17.919962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c839ad-3bd4-499b-b335-caf6bc87e40d admin admin] RBAC: Authorizing `identity:create_grant(project_id=586d194e60ee461197b124db7501f8be, user_id=25ee3a8fd93c4ad8b83c7e4ef94f4c8a, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:17.925471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c839ad-3bd4-499b-b335-caf6bc87e40d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:18.016786 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4066/8133] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:01:17 2022] PUT /identity/v3/projects/586d194e60ee461197b124db7501f8be/users/25ee3a8fd93c4ad8b83c7e4ef94f4c8a/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:01:18.022192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fa1b0-064f-421c-8d07-7f61491c9b43 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:18.022745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fa1b0-064f-421c-8d07-7f61491c9b43 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:18.023924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fa1b0-064f-421c-8d07-7f61491c9b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:18.061216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b88fa1b0-064f-421c-8d07-7f61491c9b43 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:01:18.069208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b88fa1b0-064f-421c-8d07-7f61491c9b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:18.132076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:18.235595 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4068/8134] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:01:18.245415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c839ad-3bd4-499b-b335-caf6bc87e40d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:18.247230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-75c839ad-3bd4-499b-b335-caf6bc87e40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:18.413147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c839ad-3bd4-499b-b335-caf6bc87e40d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:18.418241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de2173-a3cd-4202-8c66-a73c3893cdb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:18.418906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de2173-a3cd-4202-8c66-a73c3893cdb9 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:18.419181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de2173-a3cd-4202-8c66-a73c3893cdb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:18.419493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de2173-a3cd-4202-8c66-a73c3893cdb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:18.444410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de2173-a3cd-4202-8c66-a73c3893cdb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:18.448285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de2173-a3cd-4202-8c66-a73c3893cdb9 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:18.465167 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4067/8135] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:01:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:01:27.975843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4a8d6-540a-4e42-a547-eb9e0fe79a20 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:27.976759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4a8d6-540a-4e42-a547-eb9e0fe79a20 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:27.977291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4a8d6-540a-4e42-a547-eb9e0fe79a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:28.049329 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1fd4a8d6-540a-4e42-a547-eb9e0fe79a20 None None] MFA Rules not processed for user `25ee3a8fd93c4ad8b83c7e4ef94f4c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:01:28.053576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1fd4a8d6-540a-4e42-a547-eb9e0fe79a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:28.255070 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4069/8136] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:01:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:01:28.259437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de2173-a3cd-4202-8c66-a73c3893cdb9 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:28.277050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de2173-a3cd-4202-8c66-a73c3893cdb9 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:28.310688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ee7dc-98f2-4e66-993c-7f9ca92d1815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:28.310688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ee7dc-98f2-4e66-993c-7f9ca92d1815 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:28.310688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ee7dc-98f2-4e66-993c-7f9ca92d1815 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:28.310688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ee7dc-98f2-4e66-993c-7f9ca92d1815 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:28.311352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ee7dc-98f2-4e66-993c-7f9ca92d1815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:28.311352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ee7dc-98f2-4e66-993c-7f9ca92d1815 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:28.448024 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4068/8137] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:01:28 2022] POST /identity/v3/projects => generated 371 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:01:28.448281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4a8d6-540a-4e42-a547-eb9e0fe79a20 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:28.462021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4a8d6-540a-4e42-a547-eb9e0fe79a20 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:28.546702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d6f56-3e79-40e4-bd90-ffe5a4c287e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:28.547351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d6f56-3e79-40e4-bd90-ffe5a4c287e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:28.547638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d6f56-3e79-40e4-bd90-ffe5a4c287e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:28.547914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d6f56-3e79-40e4-bd90-ffe5a4c287e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:28.548558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d6f56-3e79-40e4-bd90-ffe5a4c287e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:28.550614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d6f56-3e79-40e4-bd90-ffe5a4c287e2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:28.682994 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4070/8138] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:01:28 2022] POST /identity/v3/users => generated 292 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 04:01:28.684335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ee7dc-98f2-4e66-993c-7f9ca92d1815 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:28.699565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ee7dc-98f2-4e66-993c-7f9ca92d1815 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:28.707458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ffa5a-455e-40f4-b83d-44059411256a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:28.708411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ffa5a-455e-40f4-b83d-44059411256a admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:28.708880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ffa5a-455e-40f4-b83d-44059411256a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:28.709379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ffa5a-455e-40f4-b83d-44059411256a admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:28.710265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ffa5a-455e-40f4-b83d-44059411256a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:28.712155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ffa5a-455e-40f4-b83d-44059411256a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:28.725104 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4069/8139] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:01:28.729492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d6f56-3e79-40e4-bd90-ffe5a4c287e2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:28.742917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d6f56-3e79-40e4-bd90-ffe5a4c287e2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:28.748529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144ff86-231d-46a4-ad7b-65582f1d2469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:28.749227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144ff86-231d-46a4-ad7b-65582f1d2469 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:28.749675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144ff86-231d-46a4-ad7b-65582f1d2469 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:28.749959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144ff86-231d-46a4-ad7b-65582f1d2469 admin admin] PATH_INFO: `/v3/projects/446d0c74e9ee4030882e4f3f675fdc2f/users/07ef57355bce4ed0947082bee47d2695/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:28.771063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144ff86-231d-46a4-ad7b-65582f1d2469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=446d0c74e9ee4030882e4f3f675fdc2f, user_id=07ef57355bce4ed0947082bee47d2695, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:28.778786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144ff86-231d-46a4-ad7b-65582f1d2469 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:28.887508 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4071/8140] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:01:28 2022] PUT /identity/v3/projects/446d0c74e9ee4030882e4f3f675fdc2f/users/07ef57355bce4ed0947082bee47d2695/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:01:28.891540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ffa5a-455e-40f4-b83d-44059411256a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:28.902324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ffa5a-455e-40f4-b83d-44059411256a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:28.994282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ba837-9954-485d-8961-c2f34bab2f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:28.995242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ba837-9954-485d-8961-c2f34bab2f1f admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:28.995752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ba837-9954-485d-8961-c2f34bab2f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:28.996249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ba837-9954-485d-8961-c2f34bab2f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:28.997169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ba837-9954-485d-8961-c2f34bab2f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:28.999277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ba837-9954-485d-8961-c2f34bab2f1f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:29.015770 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4070/8141] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:01:29.020614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144ff86-231d-46a4-ad7b-65582f1d2469 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:29.031770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144ff86-231d-46a4-ad7b-65582f1d2469 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:29.043924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2b46a-da28-4437-9910-93b2d79bf2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:29.044833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2b46a-da28-4437-9910-93b2d79bf2ab admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:29.044955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2b46a-da28-4437-9910-93b2d79bf2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:29.045152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2b46a-da28-4437-9910-93b2d79bf2ab admin admin] PATH_INFO: `/v3/projects/446d0c74e9ee4030882e4f3f675fdc2f/users/07ef57355bce4ed0947082bee47d2695/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:29.047489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2b46a-da28-4437-9910-93b2d79bf2ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=446d0c74e9ee4030882e4f3f675fdc2f, user_id=07ef57355bce4ed0947082bee47d2695, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:29.050532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2b46a-da28-4437-9910-93b2d79bf2ab admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:29.064083 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4072/8142] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:01:29 2022] PUT /identity/v3/projects/446d0c74e9ee4030882e4f3f675fdc2f/users/07ef57355bce4ed0947082bee47d2695/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 04:01:36.587739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ba837-9954-485d-8961-c2f34bab2f1f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:36.589632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-228ba837-9954-485d-8961-c2f34bab2f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:36.603552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ba837-9954-485d-8961-c2f34bab2f1f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:36.658983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:36.688649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee63860-d5c8-4335-aa0b-42e587c09586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:36.689587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee63860-d5c8-4335-aa0b-42e587c09586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:36.690064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee63860-d5c8-4335-aa0b-42e587c09586 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:36.690629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee63860-d5c8-4335-aa0b-42e587c09586 admin admin] PATH_INFO: `/v3/users/50c3203b7fe7497b951bf2a62cfa2bef` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:36.692703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee63860-d5c8-4335-aa0b-42e587c09586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c3203b7fe7497b951bf2a62cfa2bef)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:36.695088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee63860-d5c8-4335-aa0b-42e587c09586 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:36.930012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cee63860-d5c8-4335-aa0b-42e587c09586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c3203b7fe7497b951bf2a62cfa2bef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:36.930830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cee63860-d5c8-4335-aa0b-42e587c09586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c3203b7fe7497b951bf2a62cfa2bef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:36.949649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cee63860-d5c8-4335-aa0b-42e587c09586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c3203b7fe7497b951bf2a62cfa2bef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:36.967026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cee63860-d5c8-4335-aa0b-42e587c09586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c3203b7fe7497b951bf2a62cfa2bef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:37.060640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-cee63860-d5c8-4335-aa0b-42e587c09586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c3203b7fe7497b951bf2a62cfa2bef'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:37.070163 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4071/8143] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:01:36 2022] DELETE /identity/v3/users/50c3203b7fe7497b951bf2a62cfa2bef => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:01:37.074871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120cef3-66ae-479f-9ba4-8448ea202698 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:37.075375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120cef3-66ae-479f-9ba4-8448ea202698 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:37.075618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120cef3-66ae-479f-9ba4-8448ea202698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:37.112473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a120cef3-66ae-479f-9ba4-8448ea202698 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:01:37.112473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a120cef3-66ae-479f-9ba4-8448ea202698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:37.120084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:37.303224 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4073/8144] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:01:37.314806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee63860-d5c8-4335-aa0b-42e587c09586 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:37.317638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cee63860-d5c8-4335-aa0b-42e587c09586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:37.438358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee63860-d5c8-4335-aa0b-42e587c09586 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:37.443535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c233770-5de2-4377-b435-5f9f1dd0e264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:37.444370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c233770-5de2-4377-b435-5f9f1dd0e264 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:37.444738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c233770-5de2-4377-b435-5f9f1dd0e264 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:37.445274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c233770-5de2-4377-b435-5f9f1dd0e264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:37.459239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c233770-5de2-4377-b435-5f9f1dd0e264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:37.463550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c233770-5de2-4377-b435-5f9f1dd0e264 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:37.494073 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4072/8145] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:01:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:01:37.804196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120cef3-66ae-479f-9ba4-8448ea202698 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:37.806173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a120cef3-66ae-479f-9ba4-8448ea202698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:37.826463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120cef3-66ae-479f-9ba4-8448ea202698 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:37.832075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e33161-485a-4fe3-a586-b719fb779650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:37.833972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e33161-485a-4fe3-a586-b719fb779650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:37.834505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e33161-485a-4fe3-a586-b719fb779650 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:37.834991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e33161-485a-4fe3-a586-b719fb779650 admin admin] PATH_INFO: `/v3/projects/da9ab3a9f44843289cc2b3e89ca19da7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:37.836646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e33161-485a-4fe3-a586-b719fb779650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da9ab3a9f44843289cc2b3e89ca19da7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:37.839084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e33161-485a-4fe3-a586-b719fb779650 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:37.965120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-08e33161-485a-4fe3-a586-b719fb779650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da9ab3a9f44843289cc2b3e89ca19da7', 'request_id': 'req-08e33161-485a-4fe3-a586-b719fb779650'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:37.973793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-08e33161-485a-4fe3-a586-b719fb779650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da9ab3a9f44843289cc2b3e89ca19da7', 'request_id': 'req-08e33161-485a-4fe3-a586-b719fb779650'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:37.982057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-08e33161-485a-4fe3-a586-b719fb779650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da9ab3a9f44843289cc2b3e89ca19da7', 'request_id': 'req-08e33161-485a-4fe3-a586-b719fb779650'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:38.101691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-08e33161-485a-4fe3-a586-b719fb779650 admin admin] The token cache is being invalidate because project da9ab3a9f44843289cc2b3e89ca19da7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:01:38.104493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-08e33161-485a-4fe3-a586-b719fb779650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:38.109645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-08e33161-485a-4fe3-a586-b719fb779650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:01:38.113406 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4074/8146] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:01:37 2022] DELETE /identity/v3/projects/da9ab3a9f44843289cc2b3e89ca19da7 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:01:38.118732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2b50e-6337-4372-b2a4-45a63f0dd3f5 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:38.119229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2b50e-6337-4372-b2a4-45a63f0dd3f5 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:38.119312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2b50e-6337-4372-b2a4-45a63f0dd3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:38.167598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-12e2b50e-6337-4372-b2a4-45a63f0dd3f5 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:01:38.195763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-12e2b50e-6337-4372-b2a4-45a63f0dd3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:38.342589 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4073/8147] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:01:38.354414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98494e98-30b6-4606-a5c1-30415b4a59e8 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:38.354798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98494e98-30b6-4606-a5c1-30415b4a59e8 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:38.354972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98494e98-30b6-4606-a5c1-30415b4a59e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:38.405722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-98494e98-30b6-4606-a5c1-30415b4a59e8 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:01:38.411174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-98494e98-30b6-4606-a5c1-30415b4a59e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:38.421903 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4075/8148] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:01:38.427108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2b50e-6337-4372-b2a4-45a63f0dd3f5 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:38.450043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2b50e-6337-4372-b2a4-45a63f0dd3f5 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:38.464313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b519c-b1af-453b-977f-9a65f7117efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:38.465774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b519c-b1af-453b-977f-9a65f7117efa admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:38.465774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b519c-b1af-453b-977f-9a65f7117efa admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:38.466329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b519c-b1af-453b-977f-9a65f7117efa admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:38.467117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b519c-b1af-453b-977f-9a65f7117efa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:01:38.467570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b519c-b1af-453b-977f-9a65f7117efa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:38.471818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b519c-b1af-453b-977f-9a65f7117efa admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:38.475988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:38.490596 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4074/8149] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:01:38.495739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaedc97-2a48-4cf8-98a5-47ebd5ccf361 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:38.495739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaedc97-2a48-4cf8-98a5-47ebd5ccf361 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:38.495739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaedc97-2a48-4cf8-98a5-47ebd5ccf361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:38.499248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b519c-b1af-453b-977f-9a65f7117efa admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:38.525781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1eaedc97-2a48-4cf8-98a5-47ebd5ccf361 None None] MFA Rules not processed for user `07ef57355bce4ed0947082bee47d2695`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:01:38.527581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1eaedc97-2a48-4cf8-98a5-47ebd5ccf361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:38.528556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b519c-b1af-453b-977f-9a65f7117efa admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:38.538320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08312b3a-8d30-4916-88aa-bc459b7cc783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:38.539167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08312b3a-8d30-4916-88aa-bc459b7cc783 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:38.539299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08312b3a-8d30-4916-88aa-bc459b7cc783 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:38.539591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08312b3a-8d30-4916-88aa-bc459b7cc783 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:38.540250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08312b3a-8d30-4916-88aa-bc459b7cc783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:38.545959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08312b3a-8d30-4916-88aa-bc459b7cc783 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:38.632740 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4076/8150] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:01:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:01:38.656399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaedc97-2a48-4cf8-98a5-47ebd5ccf361 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:38.660751 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4075/8151] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:01:38 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:01:38.668559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1eaedc97-2a48-4cf8-98a5-47ebd5ccf361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:38.669713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08312b3a-8d30-4916-88aa-bc459b7cc783 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:38.700483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:38.800913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08312b3a-8d30-4916-88aa-bc459b7cc783 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:38.816171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd47f3-ad62-4f8d-8aa8-9c9f6899c9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:38.819419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd47f3-ad62-4f8d-8aa8-9c9f6899c9c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:38.819419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd47f3-ad62-4f8d-8aa8-9c9f6899c9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:38.819419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd47f3-ad62-4f8d-8aa8-9c9f6899c9c1 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:38.819419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd47f3-ad62-4f8d-8aa8-9c9f6899c9c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:38.825022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd47f3-ad62-4f8d-8aa8-9c9f6899c9c1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:38.839558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaedc97-2a48-4cf8-98a5-47ebd5ccf361 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:38.945132 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4076/8152] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:01:38 2022] POST /identity/v3/users => generated 292 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 04:01:38.948099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dca4d-a7fd-4ef0-b69a-bcaa7865a10c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:38.948891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dca4d-a7fd-4ef0-b69a-bcaa7865a10c service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:38.949883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd47f3-ad62-4f8d-8aa8-9c9f6899c9c1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:38.950203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dca4d-a7fd-4ef0-b69a-bcaa7865a10c service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:38.950447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dca4d-a7fd-4ef0-b69a-bcaa7865a10c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:38.952431 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-430dca4d-a7fd-4ef0-b69a-bcaa7865a10c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:38.983477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd47f3-ad62-4f8d-8aa8-9c9f6899c9c1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:38.996866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b2deb-06df-4561-a3dd-08701e09e6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:38.998499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b2deb-06df-4561-a3dd-08701e09e6ab admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:38.998790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b2deb-06df-4561-a3dd-08701e09e6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:39.012192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b2deb-06df-4561-a3dd-08701e09e6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:39.012192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b2deb-06df-4561-a3dd-08701e09e6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:39.012192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b2deb-06df-4561-a3dd-08701e09e6ab admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:39.031746 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4077/8153] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:01:39.034608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b2deb-06df-4561-a3dd-08701e09e6ab admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:39.050623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b2deb-06df-4561-a3dd-08701e09e6ab admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:39.052566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430dca4d-a7fd-4ef0-b69a-bcaa7865a10c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:39.055782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430dca4d-a7fd-4ef0-b69a-bcaa7865a10c service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:39.059366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37452c70-b0dd-43d8-a0b3-9b6f2aacee84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:39.059366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37452c70-b0dd-43d8-a0b3-9b6f2aacee84 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:39.059366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37452c70-b0dd-43d8-a0b3-9b6f2aacee84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:39.059366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37452c70-b0dd-43d8-a0b3-9b6f2aacee84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:39.059785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37452c70-b0dd-43d8-a0b3-9b6f2aacee84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:39.060419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37452c70-b0dd-43d8-a0b3-9b6f2aacee84 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:39.067786 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4077/8154] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:01:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:01:39.073550 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4078/8155] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:01:39.077788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dca4d-a7fd-4ef0-b69a-bcaa7865a10c service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:39.090477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dca4d-a7fd-4ef0-b69a-bcaa7865a10c service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:39.096155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b4165-e90b-4597-b34c-d43ca20fe9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:39.096900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b4165-e90b-4597-b34c-d43ca20fe9c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:39.097284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b4165-e90b-4597-b34c-d43ca20fe9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:39.097636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b4165-e90b-4597-b34c-d43ca20fe9c0 admin admin] PATH_INFO: `/v3/projects/5a38830a995b4459933a880157f80ede/users/1bf60dd56e2e41a3ba193fc982daa6c8/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:39.115232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b4165-e90b-4597-b34c-d43ca20fe9c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a38830a995b4459933a880157f80ede, user_id=1bf60dd56e2e41a3ba193fc982daa6c8, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:39.117946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b4165-e90b-4597-b34c-d43ca20fe9c0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:39.187293 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4078/8156] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:01:39 2022] PUT /identity/v3/projects/5a38830a995b4459933a880157f80ede/users/1bf60dd56e2e41a3ba193fc982daa6c8/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 04:01:39.198712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a24c5e-e53f-46f8-976f-26e9e748e665 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:39.199240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a24c5e-e53f-46f8-976f-26e9e748e665 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:39.199337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a24c5e-e53f-46f8-976f-26e9e748e665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:39.232601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-89a24c5e-e53f-46f8-976f-26e9e748e665 None None] MFA Rules not processed for user `1bf60dd56e2e41a3ba193fc982daa6c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:01:39.234012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-89a24c5e-e53f-46f8-976f-26e9e748e665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:39.326446 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4079/8157] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:01:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:01:39.326539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b4165-e90b-4597-b34c-d43ca20fe9c0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:39.327346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-273b4165-e90b-4597-b34c-d43ca20fe9c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:39.370487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:39.407698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b4165-e90b-4597-b34c-d43ca20fe9c0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:39.413121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be220217-10fd-4093-bd60-719f9f76cc0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:39.416042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be220217-10fd-4093-bd60-719f9f76cc0c service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:39.416042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be220217-10fd-4093-bd60-719f9f76cc0c service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:39.416042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be220217-10fd-4093-bd60-719f9f76cc0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:39.424384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be220217-10fd-4093-bd60-719f9f76cc0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:39.425982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be220217-10fd-4093-bd60-719f9f76cc0c service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:39.435808 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4079/8158] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:01:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:01:42.542011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e860f78-3022-4691-b14c-20e2530eef2a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:42.542534 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e860f78-3022-4691-b14c-20e2530eef2a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:42.542650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e860f78-3022-4691-b14c-20e2530eef2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:42.582216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9e860f78-3022-4691-b14c-20e2530eef2a None None] MFA Rules not processed for user `25ee3a8fd93c4ad8b83c7e4ef94f4c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:01:42.583808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9e860f78-3022-4691-b14c-20e2530eef2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:42.640179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:42.687295 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4080/8159] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:01:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:01:47.245008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be220217-10fd-4093-bd60-719f9f76cc0c service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:47.246700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-be220217-10fd-4093-bd60-719f9f76cc0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:47.262759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be220217-10fd-4093-bd60-719f9f76cc0c service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:47.267911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac96e2-f27d-4864-8b5b-8fc2efb7f7ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:47.268508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac96e2-f27d-4864-8b5b-8fc2efb7f7ce service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:47.268861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac96e2-f27d-4864-8b5b-8fc2efb7f7ce service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:47.269342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac96e2-f27d-4864-8b5b-8fc2efb7f7ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:47.272506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-58ac96e2-f27d-4864-8b5b-8fc2efb7f7ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:47.384444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac96e2-f27d-4864-8b5b-8fc2efb7f7ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:47.385969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac96e2-f27d-4864-8b5b-8fc2efb7f7ce service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:47.424466 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4080/8160] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:01:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:01:53.583880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=11 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:56.405481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e860f78-3022-4691-b14c-20e2530eef2a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:56.418511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e860f78-3022-4691-b14c-20e2530eef2a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:56.422145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff9de4-9765-4359-8404-fdce121b9c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:56.422759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff9de4-9765-4359-8404-fdce121b9c04 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:56.423044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff9de4-9765-4359-8404-fdce121b9c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:56.423318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff9de4-9765-4359-8404-fdce121b9c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:56.425079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-82ff9de4-9765-4359-8404-fdce121b9c04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:01:56.441810 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff9de4-9765-4359-8404-fdce121b9c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:56.443285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff9de4-9765-4359-8404-fdce121b9c04 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:56.457263 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4081/8161] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:01:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:01:57.420360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=54 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:58.396567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac96e2-f27d-4864-8b5b-8fc2efb7f7ce service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:01:58.414229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac96e2-f27d-4864-8b5b-8fc2efb7f7ce service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:01:58.418360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8944e5-07bc-4c9e-a8a4-730881219601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:01:58.419626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8944e5-07bc-4c9e-a8a4-730881219601 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:01:58.419626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8944e5-07bc-4c9e-a8a4-730881219601 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:01:58.419626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8944e5-07bc-4c9e-a8a4-730881219601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:01:58.486336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8944e5-07bc-4c9e-a8a4-730881219601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:01:58.487819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8944e5-07bc-4c9e-a8a4-730881219601 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:01:58.497925 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4081/8162] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:01:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:02:02.444112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff9de4-9765-4359-8404-fdce121b9c04 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:02.529972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff9de4-9765-4359-8404-fdce121b9c04 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:02.534952 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a7b1c-ee1b-483d-a09e-d8e65a14541a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:02.536467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a7b1c-ee1b-483d-a09e-d8e65a14541a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:02.536759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a7b1c-ee1b-483d-a09e-d8e65a14541a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:02.537035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a7b1c-ee1b-483d-a09e-d8e65a14541a admin admin] PATH_INFO: `/v3/users/1bf60dd56e2e41a3ba193fc982daa6c8` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:02.538233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a7b1c-ee1b-483d-a09e-d8e65a14541a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bf60dd56e2e41a3ba193fc982daa6c8)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:02.540240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a7b1c-ee1b-483d-a09e-d8e65a14541a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:02.735559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-273a7b1c-ee1b-483d-a09e-d8e65a14541a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bf60dd56e2e41a3ba193fc982daa6c8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:02.736228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-273a7b1c-ee1b-483d-a09e-d8e65a14541a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bf60dd56e2e41a3ba193fc982daa6c8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:02.743884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-273a7b1c-ee1b-483d-a09e-d8e65a14541a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bf60dd56e2e41a3ba193fc982daa6c8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:02.758083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-273a7b1c-ee1b-483d-a09e-d8e65a14541a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bf60dd56e2e41a3ba193fc982daa6c8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:02.846769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-273a7b1c-ee1b-483d-a09e-d8e65a14541a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bf60dd56e2e41a3ba193fc982daa6c8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:02.854383 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4082/8163] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:02:02 2022] DELETE /identity/v3/users/1bf60dd56e2e41a3ba193fc982daa6c8 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:02.859173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fe29f-e99a-4f17-8882-dbe92e19d862 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:02.859721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fe29f-e99a-4f17-8882-dbe92e19d862 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:02.859721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fe29f-e99a-4f17-8882-dbe92e19d862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:02.881144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f19fe29f-e99a-4f17-8882-dbe92e19d862 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:02.882517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f19fe29f-e99a-4f17-8882-dbe92e19d862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:02.948198 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4082/8164] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 04:02:02.959932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a7b1c-ee1b-483d-a09e-d8e65a14541a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:02.961405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-273a7b1c-ee1b-483d-a09e-d8e65a14541a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:03.026738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a7b1c-ee1b-483d-a09e-d8e65a14541a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:03.030600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38df841-6b7f-405e-8447-411948006d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:03.031283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38df841-6b7f-405e-8447-411948006d93 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:03.031861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38df841-6b7f-405e-8447-411948006d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:03.031985 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38df841-6b7f-405e-8447-411948006d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:03.043293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38df841-6b7f-405e-8447-411948006d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:03.045718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38df841-6b7f-405e-8447-411948006d93 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:03.060374 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4083/8165] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:02:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:02:03.331554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19fe29f-e99a-4f17-8882-dbe92e19d862 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:03.332681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f19fe29f-e99a-4f17-8882-dbe92e19d862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:03.351868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19fe29f-e99a-4f17-8882-dbe92e19d862 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:03.351868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da570497-2a83-43dd-be03-9f6d30633dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:03.351868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da570497-2a83-43dd-be03-9f6d30633dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:03.352208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da570497-2a83-43dd-be03-9f6d30633dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:03.352485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da570497-2a83-43dd-be03-9f6d30633dd9 admin admin] PATH_INFO: `/v3/projects/5a38830a995b4459933a880157f80ede` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:03.353632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da570497-2a83-43dd-be03-9f6d30633dd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a38830a995b4459933a880157f80ede)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:03.355578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da570497-2a83-43dd-be03-9f6d30633dd9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:03.466611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-da570497-2a83-43dd-be03-9f6d30633dd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a38830a995b4459933a880157f80ede', 'request_id': 'req-da570497-2a83-43dd-be03-9f6d30633dd9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:03.476002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-da570497-2a83-43dd-be03-9f6d30633dd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a38830a995b4459933a880157f80ede', 'request_id': 'req-da570497-2a83-43dd-be03-9f6d30633dd9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:03.482618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-da570497-2a83-43dd-be03-9f6d30633dd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a38830a995b4459933a880157f80ede', 'request_id': 'req-da570497-2a83-43dd-be03-9f6d30633dd9'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:03.561094 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-da570497-2a83-43dd-be03-9f6d30633dd9 admin admin] The token cache is being invalidate because project 5a38830a995b4459933a880157f80ede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:02:03.561508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-da570497-2a83-43dd-be03-9f6d30633dd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:03.562240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-da570497-2a83-43dd-be03-9f6d30633dd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:03.565329 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4083/8166] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:02:03 2022] DELETE /identity/v3/projects/5a38830a995b4459933a880157f80ede => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 04:02:03.570526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03796c14-548f-4c8b-be0a-9ccd716d2bb9 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:03.571000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03796c14-548f-4c8b-be0a-9ccd716d2bb9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:03.571299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03796c14-548f-4c8b-be0a-9ccd716d2bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:03.591957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-03796c14-548f-4c8b-be0a-9ccd716d2bb9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:03.593170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-03796c14-548f-4c8b-be0a-9ccd716d2bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:03.597592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:03.654682 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4084/8167] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:03.662664 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b373dc-d743-4359-9c10-13e9f4346e19 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:03.662955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b373dc-d743-4359-9c10-13e9f4346e19 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:03.663231 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b373dc-d743-4359-9c10-13e9f4346e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:03.686123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-c3b373dc-d743-4359-9c10-13e9f4346e19 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:03.687379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c3b373dc-d743-4359-9c10-13e9f4346e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:03.697988 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4084/8168] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:03.702287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03796c14-548f-4c8b-be0a-9ccd716d2bb9 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:03.712097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03796c14-548f-4c8b-be0a-9ccd716d2bb9 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:03.717145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb0e6d-8bc9-482c-9878-4fd7c65cefdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:03.717709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb0e6d-8bc9-482c-9878-4fd7c65cefdf admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:03.717991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb0e6d-8bc9-482c-9878-4fd7c65cefdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:03.718365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb0e6d-8bc9-482c-9878-4fd7c65cefdf admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:03.719033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb0e6d-8bc9-482c-9878-4fd7c65cefdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:02:03.719339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb0e6d-8bc9-482c-9878-4fd7c65cefdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:03.721009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb0e6d-8bc9-482c-9878-4fd7c65cefdf admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:03.734496 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4085/8169] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:02:03.739609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b373dc-d743-4359-9c10-13e9f4346e19 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:03.749308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b373dc-d743-4359-9c10-13e9f4346e19 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:03.754173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ddd9a-2ce3-4ceb-b64b-2f48434b33a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:03.755433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ddd9a-2ce3-4ceb-b64b-2f48434b33a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:03.756857 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ddd9a-2ce3-4ceb-b64b-2f48434b33a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:03.757147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ddd9a-2ce3-4ceb-b64b-2f48434b33a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:03.757881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ddd9a-2ce3-4ceb-b64b-2f48434b33a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:03.759903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ddd9a-2ce3-4ceb-b64b-2f48434b33a3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:03.770560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:03.886006 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4085/8170] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:02:03 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 04:02:03.890148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb0e6d-8bc9-482c-9878-4fd7c65cefdf admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:03.901013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb0e6d-8bc9-482c-9878-4fd7c65cefdf admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:03.958340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127ce83-1334-4aca-8d1b-cf1dc0c809d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:03.958945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127ce83-1334-4aca-8d1b-cf1dc0c809d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:03.959230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127ce83-1334-4aca-8d1b-cf1dc0c809d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:03.959575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127ce83-1334-4aca-8d1b-cf1dc0c809d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:03.960215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127ce83-1334-4aca-8d1b-cf1dc0c809d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:03.962164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127ce83-1334-4aca-8d1b-cf1dc0c809d6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:04.046538 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4086/8171] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:02:03 2022] POST /identity/v3/users => generated 283 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:02:04.050641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ddd9a-2ce3-4ceb-b64b-2f48434b33a3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:04.061955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ddd9a-2ce3-4ceb-b64b-2f48434b33a3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:04.067495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71875daa-c01e-46f8-8306-9c1560026cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:04.068118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71875daa-c01e-46f8-8306-9c1560026cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:04.068405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71875daa-c01e-46f8-8306-9c1560026cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:04.068690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71875daa-c01e-46f8-8306-9c1560026cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:04.069663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71875daa-c01e-46f8-8306-9c1560026cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:04.070989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71875daa-c01e-46f8-8306-9c1560026cb0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:04.081415 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4086/8172] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 04:02:04.087056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127ce83-1334-4aca-8d1b-cf1dc0c809d6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:04.097764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127ce83-1334-4aca-8d1b-cf1dc0c809d6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:04.102922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab7ff4-1ff3-4d57-ab34-ca6e331b19d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:04.103531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab7ff4-1ff3-4d57-ab34-ca6e331b19d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:04.103812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab7ff4-1ff3-4d57-ab34-ca6e331b19d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:04.104112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab7ff4-1ff3-4d57-ab34-ca6e331b19d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:04.104756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab7ff4-1ff3-4d57-ab34-ca6e331b19d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:04.106374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab7ff4-1ff3-4d57-ab34-ca6e331b19d0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:04.118025 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4087/8173] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:02:04.122330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71875daa-c01e-46f8-8306-9c1560026cb0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:04.133279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71875daa-c01e-46f8-8306-9c1560026cb0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:04.137987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4e41d-300a-4b9e-a321-74c4de7b3feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:04.138671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4e41d-300a-4b9e-a321-74c4de7b3feb admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:04.138953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4e41d-300a-4b9e-a321-74c4de7b3feb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:04.139230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4e41d-300a-4b9e-a321-74c4de7b3feb admin admin] PATH_INFO: `/v3/projects/307ed651f53944b687c2db52674a011c/users/c2fa308e92a146ebb60df5e676ff13f5/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:04.155085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4e41d-300a-4b9e-a321-74c4de7b3feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=307ed651f53944b687c2db52674a011c, user_id=c2fa308e92a146ebb60df5e676ff13f5, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:04.157741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4e41d-300a-4b9e-a321-74c4de7b3feb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:04.261493 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4087/8174] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:02:04 2022] PUT /identity/v3/projects/307ed651f53944b687c2db52674a011c/users/c2fa308e92a146ebb60df5e676ff13f5/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:04.276366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb4795-ba12-4c7a-8ace-19e1275bc678 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:04.276657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb4795-ba12-4c7a-8ace-19e1275bc678 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:04.276940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb4795-ba12-4c7a-8ace-19e1275bc678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:04.308199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-73cb4795-ba12-4c7a-8ace-19e1275bc678 None None] MFA Rules not processed for user `c2fa308e92a146ebb60df5e676ff13f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:04.309549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-73cb4795-ba12-4c7a-8ace-19e1275bc678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:04.375480 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4088/8175] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:04.379872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4e41d-300a-4b9e-a321-74c4de7b3feb admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:04.442710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4e41d-300a-4b9e-a321-74c4de7b3feb admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:04.447466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ba558-60e4-41fd-81ae-9ebad12b3db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:04.448068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ba558-60e4-41fd-81ae-9ebad12b3db5 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:04.448350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ba558-60e4-41fd-81ae-9ebad12b3db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:04.448623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ba558-60e4-41fd-81ae-9ebad12b3db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:04.449245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ba558-60e4-41fd-81ae-9ebad12b3db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:04.451276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ba558-60e4-41fd-81ae-9ebad12b3db5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:04.550636 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4088/8176] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:02:04 2022] POST /identity/v3/projects => generated 365 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:02:04.555069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb4795-ba12-4c7a-8ace-19e1275bc678 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:04.561757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:04.566399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb4795-ba12-4c7a-8ace-19e1275bc678 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:04.622592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fce60-e6cc-44cc-82b2-aad3f09b220c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:04.623546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fce60-e6cc-44cc-82b2-aad3f09b220c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:04.624009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fce60-e6cc-44cc-82b2-aad3f09b220c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:04.624643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fce60-e6cc-44cc-82b2-aad3f09b220c admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:04.625340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fce60-e6cc-44cc-82b2-aad3f09b220c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:04.627347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fce60-e6cc-44cc-82b2-aad3f09b220c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:04.730502 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4089/8177] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:02:04 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:02:04.735612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ba558-60e4-41fd-81ae-9ebad12b3db5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:04.745943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ba558-60e4-41fd-81ae-9ebad12b3db5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:04.750717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c49ea5-6add-4462-82a3-b84c75d64693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:04.755974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c49ea5-6add-4462-82a3-b84c75d64693 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:04.755974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c49ea5-6add-4462-82a3-b84c75d64693 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:04.755974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c49ea5-6add-4462-82a3-b84c75d64693 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:04.755974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c49ea5-6add-4462-82a3-b84c75d64693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:04.755974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c49ea5-6add-4462-82a3-b84c75d64693 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:04.766565 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4089/8178] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:02:04.771212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fce60-e6cc-44cc-82b2-aad3f09b220c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:04.781917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fce60-e6cc-44cc-82b2-aad3f09b220c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:04.786825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fee881-d2da-4194-a1a1-1a019d6e3c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:04.787483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fee881-d2da-4194-a1a1-1a019d6e3c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:04.787763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fee881-d2da-4194-a1a1-1a019d6e3c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:04.788042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fee881-d2da-4194-a1a1-1a019d6e3c23 admin admin] PATH_INFO: `/v3/projects/7f25ca46930d488bb98dd009b479fb71/users/618c0303399a4912991b358f929abf81/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:04.807599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fee881-d2da-4194-a1a1-1a019d6e3c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f25ca46930d488bb98dd009b479fb71, user_id=618c0303399a4912991b358f929abf81, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:04.807599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fee881-d2da-4194-a1a1-1a019d6e3c23 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:04.904570 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4090/8179] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:02:04 2022] PUT /identity/v3/projects/7f25ca46930d488bb98dd009b479fb71/users/618c0303399a4912991b358f929abf81/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:04.908583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c49ea5-6add-4462-82a3-b84c75d64693 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:04.919497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c49ea5-6add-4462-82a3-b84c75d64693 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:04.982735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5774b-27bc-4b46-9511-e30a19646484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:04.983338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5774b-27bc-4b46-9511-e30a19646484 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:04.983620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5774b-27bc-4b46-9511-e30a19646484 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:04.983896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5774b-27bc-4b46-9511-e30a19646484 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:04.984539 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5774b-27bc-4b46-9511-e30a19646484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:04.986216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5774b-27bc-4b46-9511-e30a19646484 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:04.996627 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4090/8180] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:02:05.000846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fee881-d2da-4194-a1a1-1a019d6e3c23 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:05.011757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fee881-d2da-4194-a1a1-1a019d6e3c23 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:05.016742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb43b77-d2ad-4f5b-a455-9167d632e1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:05.017430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb43b77-d2ad-4f5b-a455-9167d632e1ab admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:05.017711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb43b77-d2ad-4f5b-a455-9167d632e1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:05.017987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb43b77-d2ad-4f5b-a455-9167d632e1ab admin admin] PATH_INFO: `/v3/projects/7f25ca46930d488bb98dd009b479fb71/users/618c0303399a4912991b358f929abf81/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:05.019962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb43b77-d2ad-4f5b-a455-9167d632e1ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f25ca46930d488bb98dd009b479fb71, user_id=618c0303399a4912991b358f929abf81, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:05.022830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb43b77-d2ad-4f5b-a455-9167d632e1ab admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:05.033607 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4091/8181] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:02:04 2022] PUT /identity/v3/projects/7f25ca46930d488bb98dd009b479fb71/users/618c0303399a4912991b358f929abf81/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:05.141984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881cff9-eb00-4a52-b837-f91d2a11fb58 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:05.142312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881cff9-eb00-4a52-b837-f91d2a11fb58 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:05.142592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881cff9-eb00-4a52-b837-f91d2a11fb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:05.171501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7881cff9-eb00-4a52-b837-f91d2a11fb58 None None] MFA Rules not processed for user `618c0303399a4912991b358f929abf81`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:05.172709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7881cff9-eb00-4a52-b837-f91d2a11fb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:05.193895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:05.252290 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4091/8182] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:05.264666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb43b77-d2ad-4f5b-a455-9167d632e1ab admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:05.266360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1bb43b77-d2ad-4f5b-a455-9167d632e1ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:05.338133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb43b77-d2ad-4f5b-a455-9167d632e1ab admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:05.341670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb99ca-201a-4d34-9740-04e91bae7101 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:05.342307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb99ca-201a-4d34-9740-04e91bae7101 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:05.342591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb99ca-201a-4d34-9740-04e91bae7101 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:05.342865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb99ca-201a-4d34-9740-04e91bae7101 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:05.351686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb99ca-201a-4d34-9740-04e91bae7101 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:05.353118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb99ca-201a-4d34-9740-04e91bae7101 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:05.362515 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4092/8183] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:02:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:02:05.556652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881cff9-eb00-4a52-b837-f91d2a11fb58 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:05.569587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881cff9-eb00-4a52-b837-f91d2a11fb58 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:05.573241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c39f0-cd32-48ed-9bc2-5eb431800f99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:05.573865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c39f0-cd32-48ed-9bc2-5eb431800f99 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:05.574177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c39f0-cd32-48ed-9bc2-5eb431800f99 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:05.574452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c39f0-cd32-48ed-9bc2-5eb431800f99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:05.631294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c39f0-cd32-48ed-9bc2-5eb431800f99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:05.632654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c39f0-cd32-48ed-9bc2-5eb431800f99 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:05.641720 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4092/8184] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:02:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:02:15.358355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=72,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:15.637580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=51 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:23.411525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb99ca-201a-4d34-9740-04e91bae7101 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:23.413002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d9bb99ca-201a-4d34-9740-04e91bae7101 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:23.488013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb99ca-201a-4d34-9740-04e91bae7101 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:23.493346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11eff2f-59fd-46cb-acc8-c57d981ef355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:23.493988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11eff2f-59fd-46cb-acc8-c57d981ef355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:23.494298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11eff2f-59fd-46cb-acc8-c57d981ef355 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:23.494576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11eff2f-59fd-46cb-acc8-c57d981ef355 admin admin] PATH_INFO: `/v3/users/a2ea55b400c24827a28e816ea2a225aa` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:23.495710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11eff2f-59fd-46cb-acc8-c57d981ef355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2ea55b400c24827a28e816ea2a225aa)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:23.497689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11eff2f-59fd-46cb-acc8-c57d981ef355 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:23.689380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f11eff2f-59fd-46cb-acc8-c57d981ef355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2ea55b400c24827a28e816ea2a225aa'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:23.692708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f11eff2f-59fd-46cb-acc8-c57d981ef355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2ea55b400c24827a28e816ea2a225aa'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:23.698948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f11eff2f-59fd-46cb-acc8-c57d981ef355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2ea55b400c24827a28e816ea2a225aa'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:23.716175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f11eff2f-59fd-46cb-acc8-c57d981ef355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2ea55b400c24827a28e816ea2a225aa'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:23.789701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f11eff2f-59fd-46cb-acc8-c57d981ef355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2ea55b400c24827a28e816ea2a225aa'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:23.796659 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4093/8185] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:02:23 2022] DELETE /identity/v3/users/a2ea55b400c24827a28e816ea2a225aa => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:23.801496 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7773e5-a116-4326-8810-3082cd1e9152 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:23.801999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7773e5-a116-4326-8810-3082cd1e9152 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:23.802262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7773e5-a116-4326-8810-3082cd1e9152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:23.824123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1c7773e5-a116-4326-8810-3082cd1e9152 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:23.825414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1c7773e5-a116-4326-8810-3082cd1e9152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:23.887840 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4093/8186] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:23.899196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11eff2f-59fd-46cb-acc8-c57d981ef355 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:23.903678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f11eff2f-59fd-46cb-acc8-c57d981ef355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:24.034513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11eff2f-59fd-46cb-acc8-c57d981ef355 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:24.040036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fcfbe-bcc9-4c05-aa3c-52fa73be4aac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:24.040781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fcfbe-bcc9-4c05-aa3c-52fa73be4aac service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:24.041349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fcfbe-bcc9-4c05-aa3c-52fa73be4aac service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:24.041873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fcfbe-bcc9-4c05-aa3c-52fa73be4aac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:24.055021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fcfbe-bcc9-4c05-aa3c-52fa73be4aac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:24.056703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fcfbe-bcc9-4c05-aa3c-52fa73be4aac service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:24.069138 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4094/8187] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:02:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:02:24.358494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7773e5-a116-4326-8810-3082cd1e9152 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:24.359944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1c7773e5-a116-4326-8810-3082cd1e9152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:24.373660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7773e5-a116-4326-8810-3082cd1e9152 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:24.392275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c241d9-981f-468f-ab5d-4056a2ca65f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:24.393358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c241d9-981f-468f-ab5d-4056a2ca65f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:24.394611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c241d9-981f-468f-ab5d-4056a2ca65f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:24.395220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c241d9-981f-468f-ab5d-4056a2ca65f3 admin admin] PATH_INFO: `/v3/projects/a432dda4903145278d79210121b3f77d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:24.396570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c241d9-981f-468f-ab5d-4056a2ca65f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a432dda4903145278d79210121b3f77d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:24.399376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c241d9-981f-468f-ab5d-4056a2ca65f3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:24.521355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30c241d9-981f-468f-ab5d-4056a2ca65f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a432dda4903145278d79210121b3f77d', 'request_id': 'req-30c241d9-981f-468f-ab5d-4056a2ca65f3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:24.530563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30c241d9-981f-468f-ab5d-4056a2ca65f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a432dda4903145278d79210121b3f77d', 'request_id': 'req-30c241d9-981f-468f-ab5d-4056a2ca65f3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:24.537331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30c241d9-981f-468f-ab5d-4056a2ca65f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a432dda4903145278d79210121b3f77d', 'request_id': 'req-30c241d9-981f-468f-ab5d-4056a2ca65f3'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:24.619762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30c241d9-981f-468f-ab5d-4056a2ca65f3 admin admin] The token cache is being invalidate because project a432dda4903145278d79210121b3f77d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:02:24.620211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30c241d9-981f-468f-ab5d-4056a2ca65f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:24.620815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-30c241d9-981f-468f-ab5d-4056a2ca65f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:24.626666 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4094/8188] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:02:24 2022] DELETE /identity/v3/projects/a432dda4903145278d79210121b3f77d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:24.627854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fcfbe-bcc9-4c05-aa3c-52fa73be4aac service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:24.639748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fcfbe-bcc9-4c05-aa3c-52fa73be4aac service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:24.664055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:24.711234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf6695-1e20-45e3-8fc9-af45fa09d3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:24.712256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf6695-1e20-45e3-8fc9-af45fa09d3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:24.712772 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf6695-1e20-45e3-8fc9-af45fa09d3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:24.713305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf6695-1e20-45e3-8fc9-af45fa09d3f2 admin admin] PATH_INFO: `/v3/users/b4c62e547884403f8f5f4820a845c757` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:24.714750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf6695-1e20-45e3-8fc9-af45fa09d3f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4c62e547884403f8f5f4820a845c757)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:24.717224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf6695-1e20-45e3-8fc9-af45fa09d3f2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:24.922904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-16cf6695-1e20-45e3-8fc9-af45fa09d3f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4c62e547884403f8f5f4820a845c757'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:24.923801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-16cf6695-1e20-45e3-8fc9-af45fa09d3f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4c62e547884403f8f5f4820a845c757'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:24.932765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-16cf6695-1e20-45e3-8fc9-af45fa09d3f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4c62e547884403f8f5f4820a845c757'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:24.945825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-16cf6695-1e20-45e3-8fc9-af45fa09d3f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4c62e547884403f8f5f4820a845c757'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:25.032966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-16cf6695-1e20-45e3-8fc9-af45fa09d3f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4c62e547884403f8f5f4820a845c757'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:25.048113 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4095/8189] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:02:24 2022] DELETE /identity/v3/users/b4c62e547884403f8f5f4820a845c757 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:25.322209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c241d9-981f-468f-ab5d-4056a2ca65f3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:25.323676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-30c241d9-981f-468f-ab5d-4056a2ca65f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:25.352939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c241d9-981f-468f-ab5d-4056a2ca65f3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:25.423224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c532902-6b56-4e67-8030-55752441919d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:25.423793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c532902-6b56-4e67-8030-55752441919d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:25.424080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c532902-6b56-4e67-8030-55752441919d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:25.424456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c532902-6b56-4e67-8030-55752441919d admin admin] PATH_INFO: `/v3/projects/ae9151e0cac8482384bd1629d6227841` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:25.425597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c532902-6b56-4e67-8030-55752441919d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae9151e0cac8482384bd1629d6227841)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:25.427640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c532902-6b56-4e67-8030-55752441919d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:25.511503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:25.529028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c532902-6b56-4e67-8030-55752441919d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae9151e0cac8482384bd1629d6227841', 'request_id': 'req-4c532902-6b56-4e67-8030-55752441919d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:25.536515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c532902-6b56-4e67-8030-55752441919d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae9151e0cac8482384bd1629d6227841', 'request_id': 'req-4c532902-6b56-4e67-8030-55752441919d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:25.542317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c532902-6b56-4e67-8030-55752441919d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae9151e0cac8482384bd1629d6227841', 'request_id': 'req-4c532902-6b56-4e67-8030-55752441919d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:25.621811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c532902-6b56-4e67-8030-55752441919d admin admin] The token cache is being invalidate because project ae9151e0cac8482384bd1629d6227841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:02:25.622158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c532902-6b56-4e67-8030-55752441919d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:25.622869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c532902-6b56-4e67-8030-55752441919d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:25.624477 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4095/8190] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:02:25 2022] DELETE /identity/v3/projects/ae9151e0cac8482384bd1629d6227841 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:25.630608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94337bac-575a-474b-aa7f-a719ce6b448c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:25.631713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94337bac-575a-474b-aa7f-a719ce6b448c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:25.632349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94337bac-575a-474b-aa7f-a719ce6b448c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:25.657782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-94337bac-575a-474b-aa7f-a719ce6b448c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:25.659493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-94337bac-575a-474b-aa7f-a719ce6b448c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:25.731847 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4096/8191] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:25.739965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea38d8b-aca8-4048-bb7e-57cb7c6c5299 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:25.740323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea38d8b-aca8-4048-bb7e-57cb7c6c5299 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:25.740674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea38d8b-aca8-4048-bb7e-57cb7c6c5299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:25.763046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6ea38d8b-aca8-4048-bb7e-57cb7c6c5299 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:25.764681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6ea38d8b-aca8-4048-bb7e-57cb7c6c5299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:25.774384 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4096/8192] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:25.778173 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94337bac-575a-474b-aa7f-a719ce6b448c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:25.789490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94337bac-575a-474b-aa7f-a719ce6b448c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:25.798189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31e5ff-a0c7-4efb-890a-f7f1b05e9c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:25.798386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31e5ff-a0c7-4efb-890a-f7f1b05e9c88 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:25.805141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31e5ff-a0c7-4efb-890a-f7f1b05e9c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:25.805141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31e5ff-a0c7-4efb-890a-f7f1b05e9c88 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:25.805141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc31e5ff-a0c7-4efb-890a-f7f1b05e9c88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:02:25.805141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc31e5ff-a0c7-4efb-890a-f7f1b05e9c88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:25.805141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc31e5ff-a0c7-4efb-890a-f7f1b05e9c88 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:25.814778 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4097/8193] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 04:02:25.819939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea38d8b-aca8-4048-bb7e-57cb7c6c5299 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:25.830357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea38d8b-aca8-4048-bb7e-57cb7c6c5299 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:25.836105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8422ad-190b-4bca-9d6d-645eb3c311e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:25.840397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8422ad-190b-4bca-9d6d-645eb3c311e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:25.840397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8422ad-190b-4bca-9d6d-645eb3c311e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:25.840397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8422ad-190b-4bca-9d6d-645eb3c311e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:25.840397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8422ad-190b-4bca-9d6d-645eb3c311e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:25.840397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8422ad-190b-4bca-9d6d-645eb3c311e7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:25.922969 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4097/8194] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:02:25 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 04:02:25.927527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31e5ff-a0c7-4efb-890a-f7f1b05e9c88 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:25.940648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31e5ff-a0c7-4efb-890a-f7f1b05e9c88 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:25.975923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:26.015136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22a19a-55a1-4afb-a301-9afe78fa0ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:26.016045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22a19a-55a1-4afb-a301-9afe78fa0ced admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:26.016328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22a19a-55a1-4afb-a301-9afe78fa0ced admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:26.016596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22a19a-55a1-4afb-a301-9afe78fa0ced admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:26.017226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22a19a-55a1-4afb-a301-9afe78fa0ced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:26.019813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22a19a-55a1-4afb-a301-9afe78fa0ced admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:26.132369 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4098/8195] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:02:25 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:02:26.136381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8422ad-190b-4bca-9d6d-645eb3c311e7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:26.148479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8422ad-190b-4bca-9d6d-645eb3c311e7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:26.153611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87335b-22b6-45d9-b81a-3884a6f591ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:26.154297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87335b-22b6-45d9-b81a-3884a6f591ee admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:26.154581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87335b-22b6-45d9-b81a-3884a6f591ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:26.154858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87335b-22b6-45d9-b81a-3884a6f591ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:26.155520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87335b-22b6-45d9-b81a-3884a6f591ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:26.157221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87335b-22b6-45d9-b81a-3884a6f591ee admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:26.173597 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4098/8196] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 04:02:26.174881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22a19a-55a1-4afb-a301-9afe78fa0ced admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:26.192475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22a19a-55a1-4afb-a301-9afe78fa0ced admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:26.202882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93bb68-e83e-47d7-a1a2-7f940c51f334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:26.203666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93bb68-e83e-47d7-a1a2-7f940c51f334 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:26.206246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93bb68-e83e-47d7-a1a2-7f940c51f334 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:26.206246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93bb68-e83e-47d7-a1a2-7f940c51f334 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:26.206246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93bb68-e83e-47d7-a1a2-7f940c51f334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:26.207112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93bb68-e83e-47d7-a1a2-7f940c51f334 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:26.219866 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4099/8197] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:02:26.224695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87335b-22b6-45d9-b81a-3884a6f591ee admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:26.235619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87335b-22b6-45d9-b81a-3884a6f591ee admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:26.241344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cf205-d597-437b-83e0-946b9b3d6ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:26.242106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cf205-d597-437b-83e0-946b9b3d6ced admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:26.242395 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cf205-d597-437b-83e0-946b9b3d6ced admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:26.242672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cf205-d597-437b-83e0-946b9b3d6ced admin admin] PATH_INFO: `/v3/projects/ed478a90b637419e8a1ec46a5ec15414/users/aac6c0276fa842738263e8aed290bf19/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:26.257867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416cf205-d597-437b-83e0-946b9b3d6ced admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed478a90b637419e8a1ec46a5ec15414, user_id=aac6c0276fa842738263e8aed290bf19, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:26.260648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416cf205-d597-437b-83e0-946b9b3d6ced admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:26.336828 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4099/8198] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:02:26 2022] PUT /identity/v3/projects/ed478a90b637419e8a1ec46a5ec15414/users/aac6c0276fa842738263e8aed290bf19/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 04:02:26.342192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13113d19-eedc-4c06-8566-ad27efd88254 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:26.342567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13113d19-eedc-4c06-8566-ad27efd88254 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:26.342849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13113d19-eedc-4c06-8566-ad27efd88254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:26.363956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-13113d19-eedc-4c06-8566-ad27efd88254 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:26.365214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-13113d19-eedc-4c06-8566-ad27efd88254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:26.444295 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4100/8199] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 04:02:26.456923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cf205-d597-437b-83e0-946b9b3d6ced admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:26.459152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-416cf205-d597-437b-83e0-946b9b3d6ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:26.523833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cf205-d597-437b-83e0-946b9b3d6ced admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:26.527886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74ec52-6717-4f0e-a731-a708b2686ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:26.528562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74ec52-6717-4f0e-a731-a708b2686ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:26.528858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74ec52-6717-4f0e-a731-a708b2686ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:26.529161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74ec52-6717-4f0e-a731-a708b2686ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:26.539033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74ec52-6717-4f0e-a731-a708b2686ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:26.541024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74ec52-6717-4f0e-a731-a708b2686ee7 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:26.550909 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4100/8200] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:02:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:02:31.675797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13113d19-eedc-4c06-8566-ad27efd88254 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:31.678073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-13113d19-eedc-4c06-8566-ad27efd88254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:31.697160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13113d19-eedc-4c06-8566-ad27efd88254 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:31.720486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42853628-a2ab-42ce-b8aa-ed53a85f7591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:31.721259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42853628-a2ab-42ce-b8aa-ed53a85f7591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:31.721554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42853628-a2ab-42ce-b8aa-ed53a85f7591 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:31.721828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42853628-a2ab-42ce-b8aa-ed53a85f7591 admin admin] PATH_INFO: `/v3/users/c2fa308e92a146ebb60df5e676ff13f5` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:31.727672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42853628-a2ab-42ce-b8aa-ed53a85f7591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2fa308e92a146ebb60df5e676ff13f5)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:31.729704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42853628-a2ab-42ce-b8aa-ed53a85f7591 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:32.017951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42853628-a2ab-42ce-b8aa-ed53a85f7591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2fa308e92a146ebb60df5e676ff13f5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:32.019121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42853628-a2ab-42ce-b8aa-ed53a85f7591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2fa308e92a146ebb60df5e676ff13f5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:32.040021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42853628-a2ab-42ce-b8aa-ed53a85f7591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2fa308e92a146ebb60df5e676ff13f5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:32.059969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42853628-a2ab-42ce-b8aa-ed53a85f7591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2fa308e92a146ebb60df5e676ff13f5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:32.149616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-42853628-a2ab-42ce-b8aa-ed53a85f7591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2fa308e92a146ebb60df5e676ff13f5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:32.158276 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4101/8201] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:02:31 2022] DELETE /identity/v3/users/c2fa308e92a146ebb60df5e676ff13f5 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:32.163561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5a122-05a9-402c-b4aa-6628e3f26df9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:32.164080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5a122-05a9-402c-b4aa-6628e3f26df9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:32.164080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5a122-05a9-402c-b4aa-6628e3f26df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:32.203399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1ba5a122-05a9-402c-b4aa-6628e3f26df9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:32.207849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1ba5a122-05a9-402c-b4aa-6628e3f26df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:32.355168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:32.405440 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4101/8202] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:32.427214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42853628-a2ab-42ce-b8aa-ed53a85f7591 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:32.431104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-42853628-a2ab-42ce-b8aa-ed53a85f7591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:32.496194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:32.598904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42853628-a2ab-42ce-b8aa-ed53a85f7591 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:32.607892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e0feb-709f-49be-8743-e328a0519f82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:32.608535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e0feb-709f-49be-8743-e328a0519f82 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:32.608828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e0feb-709f-49be-8743-e328a0519f82 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:32.609102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e0feb-709f-49be-8743-e328a0519f82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:32.626980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e0feb-709f-49be-8743-e328a0519f82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:32.628665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e0feb-709f-49be-8743-e328a0519f82 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:32.641302 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4102/8203] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:02:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:02:33.327902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5a122-05a9-402c-b4aa-6628e3f26df9 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:33.330726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1ba5a122-05a9-402c-b4aa-6628e3f26df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:33.358709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5a122-05a9-402c-b4aa-6628e3f26df9 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:33.363376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbae58-ff53-45b0-9d37-d4adfee03f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:33.370375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbae58-ff53-45b0-9d37-d4adfee03f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:33.371015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbae58-ff53-45b0-9d37-d4adfee03f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:33.371561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbae58-ff53-45b0-9d37-d4adfee03f9d admin admin] PATH_INFO: `/v3/projects/307ed651f53944b687c2db52674a011c` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:33.374819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbae58-ff53-45b0-9d37-d4adfee03f9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=307ed651f53944b687c2db52674a011c)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:33.378075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbae58-ff53-45b0-9d37-d4adfee03f9d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:33.538627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffdbae58-ff53-45b0-9d37-d4adfee03f9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '307ed651f53944b687c2db52674a011c', 'request_id': 'req-ffdbae58-ff53-45b0-9d37-d4adfee03f9d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:33.546590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffdbae58-ff53-45b0-9d37-d4adfee03f9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '307ed651f53944b687c2db52674a011c', 'request_id': 'req-ffdbae58-ff53-45b0-9d37-d4adfee03f9d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:33.556008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffdbae58-ff53-45b0-9d37-d4adfee03f9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '307ed651f53944b687c2db52674a011c', 'request_id': 'req-ffdbae58-ff53-45b0-9d37-d4adfee03f9d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:33.659957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffdbae58-ff53-45b0-9d37-d4adfee03f9d admin admin] The token cache is being invalidate because project 307ed651f53944b687c2db52674a011c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:02:33.661800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffdbae58-ff53-45b0-9d37-d4adfee03f9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:33.665920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ffdbae58-ff53-45b0-9d37-d4adfee03f9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:33.667833 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4102/8204] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:02:33 2022] DELETE /identity/v3/projects/307ed651f53944b687c2db52674a011c => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:33.671660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e0feb-709f-49be-8743-e328a0519f82 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:33.684528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e0feb-709f-49be-8743-e328a0519f82 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:33.740484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fe7d4-3353-4433-baa6-e1e04c8c2105 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:33.740871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fe7d4-3353-4433-baa6-e1e04c8c2105 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:33.741037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fe7d4-3353-4433-baa6-e1e04c8c2105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:33.787634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-984fe7d4-3353-4433-baa6-e1e04c8c2105 None None] MFA Rules not processed for user `aac6c0276fa842738263e8aed290bf19`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:33.788914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-984fe7d4-3353-4433-baa6-e1e04c8c2105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:33.821712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d802d-31a7-4e44-a914-4501871487da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:33.822395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d802d-31a7-4e44-a914-4501871487da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:33.822694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d802d-31a7-4e44-a914-4501871487da admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:33.822958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d802d-31a7-4e44-a914-4501871487da admin admin] PATH_INFO: `/v3/users/618c0303399a4912991b358f929abf81` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:33.824274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d802d-31a7-4e44-a914-4501871487da admin admin] RBAC: Authorizing `identity:delete_user(user_id=618c0303399a4912991b358f929abf81)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:33.826488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d802d-31a7-4e44-a914-4501871487da admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:33.889041 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4103/8205] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:33.889970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fe7d4-3353-4433-baa6-e1e04c8c2105 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:33.891379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-984fe7d4-3353-4433-baa6-e1e04c8c2105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:33.910988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fe7d4-3353-4433-baa6-e1e04c8c2105 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:33.914923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6a772-3a59-4acc-860c-dfc4a4ad3033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:33.915564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6a772-3a59-4acc-860c-dfc4a4ad3033 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:33.915868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6a772-3a59-4acc-860c-dfc4a4ad3033 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:33.916148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6a772-3a59-4acc-860c-dfc4a4ad3033 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:33.918156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6a772-3a59-4acc-860c-dfc4a4ad3033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:33.919225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6a772-3a59-4acc-860c-dfc4a4ad3033 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:34.074126 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4104/8206] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:02:33 2022] POST /identity/v3/projects => generated 383 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:02:34.078051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6a772-3a59-4acc-860c-dfc4a4ad3033 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:34.132032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:34.149758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6a772-3a59-4acc-860c-dfc4a4ad3033 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:34.156296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdc934-b8e7-4ff8-8ecb-fbb4189709d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:34.157038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdc934-b8e7-4ff8-8ecb-fbb4189709d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:34.157384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdc934-b8e7-4ff8-8ecb-fbb4189709d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:34.157767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdc934-b8e7-4ff8-8ecb-fbb4189709d4 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:34.158894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bdc934-b8e7-4ff8-8ecb-fbb4189709d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:34.161446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bdc934-b8e7-4ff8-8ecb-fbb4189709d4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:34.172336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d41d802d-31a7-4e44-a914-4501871487da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '618c0303399a4912991b358f929abf81'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:34.173124 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d41d802d-31a7-4e44-a914-4501871487da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '618c0303399a4912991b358f929abf81'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:34.187118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d41d802d-31a7-4e44-a914-4501871487da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '618c0303399a4912991b358f929abf81'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:34.206464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d41d802d-31a7-4e44-a914-4501871487da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '618c0303399a4912991b358f929abf81'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:34.288320 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4105/8207] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:02:34 2022] POST /identity/v3/users => generated 298 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:02:34.292169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdc934-b8e7-4ff8-8ecb-fbb4189709d4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:34.293955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-53bdc934-b8e7-4ff8-8ecb-fbb4189709d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:34.306812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdc934-b8e7-4ff8-8ecb-fbb4189709d4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:34.309665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d41d802d-31a7-4e44-a914-4501871487da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '618c0303399a4912991b358f929abf81'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:34.312287 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8abc46-6694-43bd-b465-cbd7e5113638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:34.312922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8abc46-6694-43bd-b465-cbd7e5113638 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:34.313277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8abc46-6694-43bd-b465-cbd7e5113638 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:34.313626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8abc46-6694-43bd-b465-cbd7e5113638 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:34.314380 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8abc46-6694-43bd-b465-cbd7e5113638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:34.316283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8abc46-6694-43bd-b465-cbd7e5113638 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:34.318048 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4103/8208] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:02:33 2022] DELETE /identity/v3/users/618c0303399a4912991b358f929abf81 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:34.329497 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4106/8209] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:02:34.333887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d802d-31a7-4e44-a914-4501871487da admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:34.383041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:34.400892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d802d-31a7-4e44-a914-4501871487da admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:34.405590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefa281-6662-4bab-92cb-8f77c8610605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:34.406279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefa281-6662-4bab-92cb-8f77c8610605 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:34.406564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefa281-6662-4bab-92cb-8f77c8610605 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:34.406842 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefa281-6662-4bab-92cb-8f77c8610605 admin admin] PATH_INFO: `/v3/projects/5d2942e84d964f44934c612bd72400a3/users/fe2d538942114551b541edfddc77ccee/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:34.422382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefa281-6662-4bab-92cb-8f77c8610605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d2942e84d964f44934c612bd72400a3, user_id=fe2d538942114551b541edfddc77ccee, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:34.425186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefa281-6662-4bab-92cb-8f77c8610605 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:34.490162 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4104/8210] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:02:34 2022] PUT /identity/v3/projects/5d2942e84d964f44934c612bd72400a3/users/fe2d538942114551b541edfddc77ccee/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:34.495906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8abc46-6694-43bd-b465-cbd7e5113638 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:34.508665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8abc46-6694-43bd-b465-cbd7e5113638 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:34.590283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26de9d-480e-4218-9dd4-66bccc58e751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:34.591016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26de9d-480e-4218-9dd4-66bccc58e751 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:34.591618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26de9d-480e-4218-9dd4-66bccc58e751 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:34.591618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26de9d-480e-4218-9dd4-66bccc58e751 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:34.592405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26de9d-480e-4218-9dd4-66bccc58e751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:34.594111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26de9d-480e-4218-9dd4-66bccc58e751 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:34.607133 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4107/8211] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 04:02:34.613635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefa281-6662-4bab-92cb-8f77c8610605 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:34.635844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefa281-6662-4bab-92cb-8f77c8610605 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:34.648407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed4aa1-8cec-4896-89d2-cfe9b037dfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:34.649092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed4aa1-8cec-4896-89d2-cfe9b037dfd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:34.649378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed4aa1-8cec-4896-89d2-cfe9b037dfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:34.650017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed4aa1-8cec-4896-89d2-cfe9b037dfd8 admin admin] PATH_INFO: `/v3/projects/5d2942e84d964f44934c612bd72400a3/users/fe2d538942114551b541edfddc77ccee/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:34.652042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed4aa1-8cec-4896-89d2-cfe9b037dfd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d2942e84d964f44934c612bd72400a3, user_id=fe2d538942114551b541edfddc77ccee, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:34.655196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed4aa1-8cec-4896-89d2-cfe9b037dfd8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:34.659081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26de9d-480e-4218-9dd4-66bccc58e751 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:34.665605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fc26de9d-480e-4218-9dd4-66bccc58e751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:34.679350 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4105/8212] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:02:34 2022] PUT /identity/v3/projects/5d2942e84d964f44934c612bd72400a3/users/fe2d538942114551b541edfddc77ccee/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:34.697529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26de9d-480e-4218-9dd4-66bccc58e751 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:34.756609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed4aa1-8cec-4896-89d2-cfe9b037dfd8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:34.759822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c8ed4aa1-8cec-4896-89d2-cfe9b037dfd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:34.785648 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a3e5a-9e3a-4743-8ee8-1b75ba5c4103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:34.789432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a3e5a-9e3a-4743-8ee8-1b75ba5c4103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:34.789719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a3e5a-9e3a-4743-8ee8-1b75ba5c4103 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:34.790000 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a3e5a-9e3a-4743-8ee8-1b75ba5c4103 admin admin] PATH_INFO: `/v3/users/845214c60b5843ccafa0bc10c63911b8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:34.793471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a3e5a-9e3a-4743-8ee8-1b75ba5c4103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=845214c60b5843ccafa0bc10c63911b8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:34.795969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a3e5a-9e3a-4743-8ee8-1b75ba5c4103 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:34.874878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed4aa1-8cec-4896-89d2-cfe9b037dfd8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:34.881106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0750590-4834-486c-a7c7-60d8fa7469cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:34.889291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0750590-4834-486c-a7c7-60d8fa7469cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:34.889291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0750590-4834-486c-a7c7-60d8fa7469cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:34.889291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0750590-4834-486c-a7c7-60d8fa7469cb admin admin] PATH_INFO: `/v3/projects/7f25ca46930d488bb98dd009b479fb71` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:34.889291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0750590-4834-486c-a7c7-60d8fa7469cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f25ca46930d488bb98dd009b479fb71)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:34.889291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0750590-4834-486c-a7c7-60d8fa7469cb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:35.065096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a26a3e5a-9e3a-4743-8ee8-1b75ba5c4103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '845214c60b5843ccafa0bc10c63911b8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:35.066558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a0750590-4834-486c-a7c7-60d8fa7469cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f25ca46930d488bb98dd009b479fb71', 'request_id': 'req-a0750590-4834-486c-a7c7-60d8fa7469cb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:35.074573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a26a3e5a-9e3a-4743-8ee8-1b75ba5c4103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '845214c60b5843ccafa0bc10c63911b8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:35.090146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a26a3e5a-9e3a-4743-8ee8-1b75ba5c4103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '845214c60b5843ccafa0bc10c63911b8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:35.113012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:35.133067 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a26a3e5a-9e3a-4743-8ee8-1b75ba5c4103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '845214c60b5843ccafa0bc10c63911b8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:35.134411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-a26a3e5a-9e3a-4743-8ee8-1b75ba5c4103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '845214c60b5843ccafa0bc10c63911b8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:35.159517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a0750590-4834-486c-a7c7-60d8fa7469cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f25ca46930d488bb98dd009b479fb71', 'request_id': 'req-a0750590-4834-486c-a7c7-60d8fa7469cb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:35.169421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a0750590-4834-486c-a7c7-60d8fa7469cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f25ca46930d488bb98dd009b479fb71', 'request_id': 'req-a0750590-4834-486c-a7c7-60d8fa7469cb'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:35.185197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a0750590-4834-486c-a7c7-60d8fa7469cb admin admin] The token cache is being invalidate because project 7f25ca46930d488bb98dd009b479fb71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:02:35.187164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a0750590-4834-486c-a7c7-60d8fa7469cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:35.188209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a0750590-4834-486c-a7c7-60d8fa7469cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:35.195994 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4106/8213] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:02:34 2022] DELETE /identity/v3/projects/7f25ca46930d488bb98dd009b479fb71 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:35.197636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dd9dc-c121-46af-a99e-b8e2872412a8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:35.197990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dd9dc-c121-46af-a99e-b8e2872412a8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:35.198296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dd9dc-c121-46af-a99e-b8e2872412a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:35.221571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b85dd9dc-c121-46af-a99e-b8e2872412a8 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:35.224209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b85dd9dc-c121-46af-a99e-b8e2872412a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:35.256474 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4108/8214] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:02:34 2022] DELETE /identity/v3/users/845214c60b5843ccafa0bc10c63911b8 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 04:02:35.260871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487f7c6-99c1-425a-a358-19d5fe897873 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:35.261162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487f7c6-99c1-425a-a358-19d5fe897873 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:35.261439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487f7c6-99c1-425a-a358-19d5fe897873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:35.285191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e487f7c6-99c1-425a-a358-19d5fe897873 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:35.287885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e487f7c6-99c1-425a-a358-19d5fe897873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:35.298866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:35.346101 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4107/8215] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:35.355307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31910b-ca93-47ec-aff4-92ea63ba2549 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:35.355964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31910b-ca93-47ec-aff4-92ea63ba2549 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:35.357719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31910b-ca93-47ec-aff4-92ea63ba2549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:35.380850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-da31910b-ca93-47ec-aff4-92ea63ba2549 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:35.382245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-da31910b-ca93-47ec-aff4-92ea63ba2549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:35.397740 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4109/8216] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:35.409465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487f7c6-99c1-425a-a358-19d5fe897873 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:35.411725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e487f7c6-99c1-425a-a358-19d5fe897873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:35.491857 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4108/8217] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:35.492829 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31910b-ca93-47ec-aff4-92ea63ba2549 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:35.506302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487f7c6-99c1-425a-a358-19d5fe897873 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:35.507785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31910b-ca93-47ec-aff4-92ea63ba2549 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:35.511532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75462f-4546-45e6-841b-47905bec056a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:35.512348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75462f-4546-45e6-841b-47905bec056a service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:35.512636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75462f-4546-45e6-841b-47905bec056a service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:35.512915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75462f-4546-45e6-841b-47905bec056a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:35.514422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db658776-713c-4e49-b4e9-cc87b1838cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:35.515849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db658776-713c-4e49-b4e9-cc87b1838cab admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:35.516343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db658776-713c-4e49-b4e9-cc87b1838cab admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:35.516775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db658776-713c-4e49-b4e9-cc87b1838cab admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:35.517916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db658776-713c-4e49-b4e9-cc87b1838cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:02:35.518434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db658776-713c-4e49-b4e9-cc87b1838cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:35.521214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db658776-713c-4e49-b4e9-cc87b1838cab admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:35.527487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75462f-4546-45e6-841b-47905bec056a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:35.530413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75462f-4546-45e6-841b-47905bec056a service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:35.542066 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4110/8218] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:02:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:02:35.572277 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4109/8219] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:02:35.574522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75462f-4546-45e6-841b-47905bec056a service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:35.591374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75462f-4546-45e6-841b-47905bec056a service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:35.610213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7a571-1f34-4869-8f9e-45563fde9f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:35.610213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7a571-1f34-4869-8f9e-45563fde9f6a admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:35.610213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7a571-1f34-4869-8f9e-45563fde9f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:35.610213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7a571-1f34-4869-8f9e-45563fde9f6a admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:35.610703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7a571-1f34-4869-8f9e-45563fde9f6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:35.616032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7a571-1f34-4869-8f9e-45563fde9f6a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:35.766391 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4111/8220] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:02:35 2022] POST /identity/v3/projects => generated 389 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:02:35.766907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db658776-713c-4e49-b4e9-cc87b1838cab admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:35.778442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db658776-713c-4e49-b4e9-cc87b1838cab admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:35.876814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161f34d-ee65-4df3-8497-bd048869f1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:35.878338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161f34d-ee65-4df3-8497-bd048869f1a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:35.878724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161f34d-ee65-4df3-8497-bd048869f1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:35.879008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161f34d-ee65-4df3-8497-bd048869f1a1 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:35.879687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161f34d-ee65-4df3-8497-bd048869f1a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:35.882824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161f34d-ee65-4df3-8497-bd048869f1a1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:35.994115 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4110/8221] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:02:35 2022] POST /identity/v3/users => generated 295 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:02:35.999088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7a571-1f34-4869-8f9e-45563fde9f6a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:36.012486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7a571-1f34-4869-8f9e-45563fde9f6a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:36.025896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b558fba-3b8b-4351-9d71-d5233ebbf6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:36.025896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b558fba-3b8b-4351-9d71-d5233ebbf6fc admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:36.025896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b558fba-3b8b-4351-9d71-d5233ebbf6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:36.025896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b558fba-3b8b-4351-9d71-d5233ebbf6fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:36.026468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b558fba-3b8b-4351-9d71-d5233ebbf6fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:36.026468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b558fba-3b8b-4351-9d71-d5233ebbf6fc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:36.044688 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4112/8222] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:02:36.045067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161f34d-ee65-4df3-8497-bd048869f1a1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:36.058586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161f34d-ee65-4df3-8497-bd048869f1a1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:36.060341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b558fba-3b8b-4351-9d71-d5233ebbf6fc admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:36.062346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4b558fba-3b8b-4351-9d71-d5233ebbf6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:36.064131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2aa9b0-370d-4251-89af-9c4d170c7fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:36.065119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aa9b0-370d-4251-89af-9c4d170c7fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:36.066005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aa9b0-370d-4251-89af-9c4d170c7fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:36.066599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aa9b0-370d-4251-89af-9c4d170c7fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:36.068163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2aa9b0-370d-4251-89af-9c4d170c7fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:36.071272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2aa9b0-370d-4251-89af-9c4d170c7fd0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:36.094937 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4111/8223] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:02:36.102852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2aa9b0-370d-4251-89af-9c4d170c7fd0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:36.111137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2aa9b0-370d-4251-89af-9c4d170c7fd0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:36.117452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9759b-7b0e-4434-905f-68d9bc6cd47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:36.118234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9759b-7b0e-4434-905f-68d9bc6cd47f admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:36.118522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9759b-7b0e-4434-905f-68d9bc6cd47f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:36.118981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9759b-7b0e-4434-905f-68d9bc6cd47f admin admin] PATH_INFO: `/v3/projects/27788f97f275480a9e4b0bb8431115bd/users/358247b2428241a4a071fe08a719408e/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:36.145482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9759b-7b0e-4434-905f-68d9bc6cd47f admin admin] RBAC: Authorizing `identity:create_grant(project_id=27788f97f275480a9e4b0bb8431115bd, user_id=358247b2428241a4a071fe08a719408e, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:36.149637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9759b-7b0e-4434-905f-68d9bc6cd47f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:36.161735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:36.168633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b558fba-3b8b-4351-9d71-d5233ebbf6fc admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:36.173062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a315eef-973a-4cbd-b06e-fe0d5b988ded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:36.175475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a315eef-973a-4cbd-b06e-fe0d5b988ded service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:36.175475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a315eef-973a-4cbd-b06e-fe0d5b988ded service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:36.175475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a315eef-973a-4cbd-b06e-fe0d5b988ded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:36.177248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9a315eef-973a-4cbd-b06e-fe0d5b988ded service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:36.192841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a315eef-973a-4cbd-b06e-fe0d5b988ded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:36.200301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a315eef-973a-4cbd-b06e-fe0d5b988ded service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:36.206086 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4113/8224] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:02:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:02:36.222787 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4112/8225] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:02:36 2022] PUT /identity/v3/projects/27788f97f275480a9e4b0bb8431115bd/users/358247b2428241a4a071fe08a719408e/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 04:02:36.234925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316636a8-dc29-4278-aac7-ca019ade993e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:36.235222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316636a8-dc29-4278-aac7-ca019ade993e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:36.236736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316636a8-dc29-4278-aac7-ca019ade993e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:36.273689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-316636a8-dc29-4278-aac7-ca019ade993e None None] MFA Rules not processed for user `358247b2428241a4a071fe08a719408e`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:36.273878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-316636a8-dc29-4278-aac7-ca019ade993e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:36.303181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9759b-7b0e-4434-905f-68d9bc6cd47f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:36.306137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a9a9759b-7b0e-4434-905f-68d9bc6cd47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:36.359572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:36.379372 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4114/8226] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:36.383568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316636a8-dc29-4278-aac7-ca019ade993e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:36.419101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9759b-7b0e-4434-905f-68d9bc6cd47f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:36.427751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0568a-8065-4b97-bf97-5a835ac752d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:36.428718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0568a-8065-4b97-bf97-5a835ac752d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:36.429106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0568a-8065-4b97-bf97-5a835ac752d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:36.430178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0568a-8065-4b97-bf97-5a835ac752d3 admin admin] PATH_INFO: `/v3/projects/a9953ed984194ea3b6d8b7119c034730` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:36.431593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0568a-8065-4b97-bf97-5a835ac752d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9953ed984194ea3b6d8b7119c034730)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:36.433790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0568a-8065-4b97-bf97-5a835ac752d3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:36.465482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316636a8-dc29-4278-aac7-ca019ade993e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:36.472150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024393a2-a021-41a8-8d35-c5415592c1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:36.472790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024393a2-a021-41a8-8d35-c5415592c1c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:36.473073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024393a2-a021-41a8-8d35-c5415592c1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:36.473370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024393a2-a021-41a8-8d35-c5415592c1c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:36.474009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024393a2-a021-41a8-8d35-c5415592c1c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:36.476004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024393a2-a021-41a8-8d35-c5415592c1c8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:36.544066 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4115/8227] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:02:36 2022] POST /identity/v3/projects => generated 389 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:02:36.545376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024393a2-a021-41a8-8d35-c5415592c1c8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:36.546313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d5d0568a-8065-4b97-bf97-5a835ac752d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9953ed984194ea3b6d8b7119c034730', 'request_id': 'req-d5d0568a-8065-4b97-bf97-5a835ac752d3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:36.616192 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024393a2-a021-41a8-8d35-c5415592c1c8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:36.621017 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8c792-1cf6-4bcc-a13f-63e19095b0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:36.621629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8c792-1cf6-4bcc-a13f-63e19095b0cf admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:36.621911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8c792-1cf6-4bcc-a13f-63e19095b0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:36.622218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8c792-1cf6-4bcc-a13f-63e19095b0cf admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:36.622846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8c792-1cf6-4bcc-a13f-63e19095b0cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:36.624788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8c792-1cf6-4bcc-a13f-63e19095b0cf admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:36.639883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d5d0568a-8065-4b97-bf97-5a835ac752d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9953ed984194ea3b6d8b7119c034730', 'request_id': 'req-d5d0568a-8065-4b97-bf97-5a835ac752d3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:36.650475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d5d0568a-8065-4b97-bf97-5a835ac752d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9953ed984194ea3b6d8b7119c034730', 'request_id': 'req-d5d0568a-8065-4b97-bf97-5a835ac752d3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:36.665665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d5d0568a-8065-4b97-bf97-5a835ac752d3 admin admin] The token cache is being invalidate because project a9953ed984194ea3b6d8b7119c034730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:02:36.666003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d5d0568a-8065-4b97-bf97-5a835ac752d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:36.666698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d5d0568a-8065-4b97-bf97-5a835ac752d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:36.671639 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4113/8228] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:02:36 2022] DELETE /identity/v3/projects/a9953ed984194ea3b6d8b7119c034730 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:36.681044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbe697-a91a-41e6-9c0d-e1116875ea7d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:36.681339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbe697-a91a-41e6-9c0d-e1116875ea7d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:36.681621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbe697-a91a-41e6-9c0d-e1116875ea7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:36.707805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c0cbe697-a91a-41e6-9c0d-e1116875ea7d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:36.709252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c0cbe697-a91a-41e6-9c0d-e1116875ea7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:36.720534 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4114/8229] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 04:02:36.728193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ce0ed-0047-44a0-821d-c4f2ed049ddf None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:36.728623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ce0ed-0047-44a0-821d-c4f2ed049ddf None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:36.728998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ce0ed-0047-44a0-821d-c4f2ed049ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:36.752608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5a2ce0ed-0047-44a0-821d-c4f2ed049ddf None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:36.754242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5a2ce0ed-0047-44a0-821d-c4f2ed049ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:36.769222 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4115/8230] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:36.772248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ce0ed-0047-44a0-821d-c4f2ed049ddf None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:36.773319 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4116/8231] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:02:36 2022] POST /identity/v3/users => generated 301 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:02:36.777806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8c792-1cf6-4bcc-a13f-63e19095b0cf admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:36.779690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7df8c792-1cf6-4bcc-a13f-63e19095b0cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:36.786366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ce0ed-0047-44a0-821d-c4f2ed049ddf None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:36.793250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8c792-1cf6-4bcc-a13f-63e19095b0cf admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:36.793956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d2bb4-07ec-4362-9af5-ce44cafe303f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:36.794876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d2bb4-07ec-4362-9af5-ce44cafe303f admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:36.795251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d2bb4-07ec-4362-9af5-ce44cafe303f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:36.795630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d2bb4-07ec-4362-9af5-ce44cafe303f admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:36.796409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d2bb4-07ec-4362-9af5-ce44cafe303f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:02:36.796806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d2bb4-07ec-4362-9af5-ce44cafe303f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:36.799102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d2bb4-07ec-4362-9af5-ce44cafe303f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:36.803765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4861e-b025-4f0f-8981-e2b3d1825b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:36.803765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4861e-b025-4f0f-8981-e2b3d1825b3e admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:36.803765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4861e-b025-4f0f-8981-e2b3d1825b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:36.803765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4861e-b025-4f0f-8981-e2b3d1825b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:36.804399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4861e-b025-4f0f-8981-e2b3d1825b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:36.804399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4861e-b025-4f0f-8981-e2b3d1825b3e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:36.822543 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4117/8232] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:02:36.825467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4861e-b025-4f0f-8981-e2b3d1825b3e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:36.831606 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4116/8233] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 04:02:36.832817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d2bb4-07ec-4362-9af5-ce44cafe303f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:36.839640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4861e-b025-4f0f-8981-e2b3d1825b3e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:36.844667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d2bb4-07ec-4362-9af5-ce44cafe303f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:36.847649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cddecf9-f104-4d8e-9294-0314fce163e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:36.848721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddecf9-f104-4d8e-9294-0314fce163e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:36.849191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddecf9-f104-4d8e-9294-0314fce163e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:36.849550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddecf9-f104-4d8e-9294-0314fce163e8 admin admin] PATH_INFO: `/v3/projects/da74760305624ace911bfe4bef69cf3f/users/1c7a73d7569447609eca5483df2177ca/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:36.850672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155653e-faaf-4872-b055-d1b0ab340649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:36.851526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155653e-faaf-4872-b055-d1b0ab340649 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:36.851883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155653e-faaf-4872-b055-d1b0ab340649 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:36.852232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155653e-faaf-4872-b055-d1b0ab340649 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:36.852954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155653e-faaf-4872-b055-d1b0ab340649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:36.855138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155653e-faaf-4872-b055-d1b0ab340649 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:36.878861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cddecf9-f104-4d8e-9294-0314fce163e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da74760305624ace911bfe4bef69cf3f, user_id=1c7a73d7569447609eca5483df2177ca, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:36.883246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cddecf9-f104-4d8e-9294-0314fce163e8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:36.945600 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4117/8234] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:02:36 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:02:36.949672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155653e-faaf-4872-b055-d1b0ab340649 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:37.002590 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4118/8235] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:02:36 2022] PUT /identity/v3/projects/da74760305624ace911bfe4bef69cf3f/users/1c7a73d7569447609eca5483df2177ca/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 04:02:37.007426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cddecf9-f104-4d8e-9294-0314fce163e8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:37.040224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155653e-faaf-4872-b055-d1b0ab340649 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:37.090331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cddecf9-f104-4d8e-9294-0314fce163e8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:37.099421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8533aa-53a1-44f5-a9a2-b88a34f941ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:37.100606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8533aa-53a1-44f5-a9a2-b88a34f941ac admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:37.101132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8533aa-53a1-44f5-a9a2-b88a34f941ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:37.102409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8533aa-53a1-44f5-a9a2-b88a34f941ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:37.103917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8533aa-53a1-44f5-a9a2-b88a34f941ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:37.107521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8533aa-53a1-44f5-a9a2-b88a34f941ac admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:37.124607 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4119/8236] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:02:37.128332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9364d07-c446-4e11-b71f-e902603051cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:37.128960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9364d07-c446-4e11-b71f-e902603051cc admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:37.129107 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8533aa-53a1-44f5-a9a2-b88a34f941ac admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:37.129378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9364d07-c446-4e11-b71f-e902603051cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:37.130302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9364d07-c446-4e11-b71f-e902603051cc admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:37.131101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9364d07-c446-4e11-b71f-e902603051cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:37.136594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9364d07-c446-4e11-b71f-e902603051cc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:37.144836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8533aa-53a1-44f5-a9a2-b88a34f941ac admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:37.152278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d9ba1-47c2-44e7-bba0-8d2c3f46dafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:37.153466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d9ba1-47c2-44e7-bba0-8d2c3f46dafc admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:37.153820 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d9ba1-47c2-44e7-bba0-8d2c3f46dafc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:37.154575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d9ba1-47c2-44e7-bba0-8d2c3f46dafc admin admin] PATH_INFO: `/v3/projects/da74760305624ace911bfe4bef69cf3f/users/1c7a73d7569447609eca5483df2177ca/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:37.156708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d9ba1-47c2-44e7-bba0-8d2c3f46dafc admin admin] RBAC: Authorizing `identity:create_grant(project_id=da74760305624ace911bfe4bef69cf3f, user_id=1c7a73d7569447609eca5483df2177ca, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:37.159522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d9ba1-47c2-44e7-bba0-8d2c3f46dafc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:37.180285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:37.182792 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4120/8237] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:02:37 2022] PUT /identity/v3/projects/da74760305624ace911bfe4bef69cf3f/users/1c7a73d7569447609eca5483df2177ca/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:37.184310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c04aa-ee0a-49d5-a13d-97d4e22c4aa6 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:37.184603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c04aa-ee0a-49d5-a13d-97d4e22c4aa6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:37.184884 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c04aa-ee0a-49d5-a13d-97d4e22c4aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:37.224583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-247c04aa-ee0a-49d5-a13d-97d4e22c4aa6 None None] MFA Rules not processed for user `1c7a73d7569447609eca5483df2177ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:37.226066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-247c04aa-ee0a-49d5-a13d-97d4e22c4aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:37.242213 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4118/8238] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:02:36 2022] POST /identity/v3/users => generated 288 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 04:02:37.247026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9364d07-c446-4e11-b71f-e902603051cc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:37.267120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9364d07-c446-4e11-b71f-e902603051cc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:37.346590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf69a9-ab5a-4e4d-a789-60e92b0aac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:37.347221 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf69a9-ab5a-4e4d-a789-60e92b0aac9c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:37.347506 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf69a9-ab5a-4e4d-a789-60e92b0aac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:37.347784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf69a9-ab5a-4e4d-a789-60e92b0aac9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:37.348222 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4121/8239] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:37 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:37.350994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf69a9-ab5a-4e4d-a789-60e92b0aac9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:37.353303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf69a9-ab5a-4e4d-a789-60e92b0aac9c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:37.361259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c04aa-ee0a-49d5-a13d-97d4e22c4aa6 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:37.363106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-247c04aa-ee0a-49d5-a13d-97d4e22c4aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:37.373323 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4119/8240] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:02:37.377546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf69a9-ab5a-4e4d-a789-60e92b0aac9c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:37.391563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf69a9-ab5a-4e4d-a789-60e92b0aac9c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:37.397954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cbf02-9edb-4c0f-9a73-8f1cc19207a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:37.398946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cbf02-9edb-4c0f-9a73-8f1cc19207a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:37.399755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cbf02-9edb-4c0f-9a73-8f1cc19207a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:37.400278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cbf02-9edb-4c0f-9a73-8f1cc19207a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:37.401965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804cbf02-9edb-4c0f-9a73-8f1cc19207a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:37.403001 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:37.404407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804cbf02-9edb-4c0f-9a73-8f1cc19207a2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:37.419615 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4120/8241] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:02:37.425346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cbf02-9edb-4c0f-9a73-8f1cc19207a2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:37.449977 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cbf02-9edb-4c0f-9a73-8f1cc19207a2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:37.458695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ba8c0-6efb-40dd-9e25-9e07b742224d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:37.459282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ba8c0-6efb-40dd-9e25-9e07b742224d admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:37.459694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ba8c0-6efb-40dd-9e25-9e07b742224d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:37.460170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ba8c0-6efb-40dd-9e25-9e07b742224d admin admin] PATH_INFO: `/v3/projects/9c921299382141f99cd9c4b6b11927a4/users/98bf808aeff6462794e5d6c653c72ae2/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:37.477900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c04aa-ee0a-49d5-a13d-97d4e22c4aa6 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:37.482396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ba8c0-6efb-40dd-9e25-9e07b742224d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c921299382141f99cd9c4b6b11927a4, user_id=98bf808aeff6462794e5d6c653c72ae2, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:37.482981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a41f4b-d9f5-4efd-ba53-d5d147678f0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:37.483838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a41f4b-d9f5-4efd-ba53-d5d147678f0f service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:37.483971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a41f4b-d9f5-4efd-ba53-d5d147678f0f service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:37.484223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a41f4b-d9f5-4efd-ba53-d5d147678f0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:37.486492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ba8c0-6efb-40dd-9e25-9e07b742224d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:37.496105 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a41f4b-d9f5-4efd-ba53-d5d147678f0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:37.498009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a41f4b-d9f5-4efd-ba53-d5d147678f0f service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:37.510458 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4122/8242] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:02:37 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:02:37.614132 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4121/8243] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:02:37 2022] PUT /identity/v3/projects/9c921299382141f99cd9c4b6b11927a4/users/98bf808aeff6462794e5d6c653c72ae2/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:37.624087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded18f1-3e4a-4f35-ad75-23a2f67a0c60 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:37.624385 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded18f1-3e4a-4f35-ad75-23a2f67a0c60 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:37.624659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded18f1-3e4a-4f35-ad75-23a2f67a0c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:37.672483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0ded18f1-3e4a-4f35-ad75-23a2f67a0c60 None None] MFA Rules not processed for user `98bf808aeff6462794e5d6c653c72ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:37.673796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0ded18f1-3e4a-4f35-ad75-23a2f67a0c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:37.737736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ba8c0-6efb-40dd-9e25-9e07b742224d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:37.837155 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4123/8244] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:37.840515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ba8c0-6efb-40dd-9e25-9e07b742224d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:37.841906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded18f1-3e4a-4f35-ad75-23a2f67a0c60 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:37.847726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdae36-78a6-4c8c-ae07-2b692e820ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:37.849133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdae36-78a6-4c8c-ae07-2b692e820ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:37.857414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdae36-78a6-4c8c-ae07-2b692e820ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:37.857414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdae36-78a6-4c8c-ae07-2b692e820ae7 admin admin] PATH_INFO: `/v3/users/358247b2428241a4a071fe08a719408e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:37.857414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdae36-78a6-4c8c-ae07-2b692e820ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=358247b2428241a4a071fe08a719408e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:37.857779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded18f1-3e4a-4f35-ad75-23a2f67a0c60 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:37.858606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdae36-78a6-4c8c-ae07-2b692e820ae7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:37.862061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966dc6d5-f8c4-4fc6-864c-5367e2edbfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:37.862566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966dc6d5-f8c4-4fc6-864c-5367e2edbfb7 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:37.862756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966dc6d5-f8c4-4fc6-864c-5367e2edbfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:37.862991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966dc6d5-f8c4-4fc6-864c-5367e2edbfb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:37.863645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966dc6d5-f8c4-4fc6-864c-5367e2edbfb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:37.888462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966dc6d5-f8c4-4fc6-864c-5367e2edbfb7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:38.023978 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4124/8245] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:02:37 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:02:38.027939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966dc6d5-f8c4-4fc6-864c-5367e2edbfb7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:38.111398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-36cdae36-78a6-4c8c-ae07-2b692e820ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '358247b2428241a4a071fe08a719408e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:38.113448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-36cdae36-78a6-4c8c-ae07-2b692e820ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '358247b2428241a4a071fe08a719408e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:38.135661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-36cdae36-78a6-4c8c-ae07-2b692e820ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '358247b2428241a4a071fe08a719408e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:38.139467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966dc6d5-f8c4-4fc6-864c-5367e2edbfb7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:38.149199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5caaa-2a6c-43c4-bd8c-2f9d9611ef3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:38.149918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5caaa-2a6c-43c4-bd8c-2f9d9611ef3f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:38.150355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5caaa-2a6c-43c4-bd8c-2f9d9611ef3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:38.150707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5caaa-2a6c-43c4-bd8c-2f9d9611ef3f admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:38.151359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5caaa-2a6c-43c4-bd8c-2f9d9611ef3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:38.153372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5caaa-2a6c-43c4-bd8c-2f9d9611ef3f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:38.172135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-36cdae36-78a6-4c8c-ae07-2b692e820ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '358247b2428241a4a071fe08a719408e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:38.267150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-36cdae36-78a6-4c8c-ae07-2b692e820ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '358247b2428241a4a071fe08a719408e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:38.275132 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4122/8246] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:02:37 2022] DELETE /identity/v3/users/358247b2428241a4a071fe08a719408e => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:38.279045 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4125/8247] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:02:38 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:02:38.311297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5caaa-2a6c-43c4-bd8c-2f9d9611ef3f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:38.313378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-80c5caaa-2a6c-43c4-bd8c-2f9d9611ef3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:38.325165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade98e1f-095d-4bd3-9e9a-f54e63ba65ed None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:38.326376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade98e1f-095d-4bd3-9e9a-f54e63ba65ed None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:38.328885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade98e1f-095d-4bd3-9e9a-f54e63ba65ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:38.331163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5caaa-2a6c-43c4-bd8c-2f9d9611ef3f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:38.363910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ade98e1f-095d-4bd3-9e9a-f54e63ba65ed None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:38.365594 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ade98e1f-095d-4bd3-9e9a-f54e63ba65ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:38.420093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:38.505581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90529268-1b52-44fc-8468-9cad97238545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:38.506487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90529268-1b52-44fc-8468-9cad97238545 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:38.507136 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4123/8248] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:38.507357 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90529268-1b52-44fc-8468-9cad97238545 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:38.507871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90529268-1b52-44fc-8468-9cad97238545 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:38.508652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90529268-1b52-44fc-8468-9cad97238545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:38.510574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90529268-1b52-44fc-8468-9cad97238545 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:38.517338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade98e1f-095d-4bd3-9e9a-f54e63ba65ed None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:38.519171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ade98e1f-095d-4bd3-9e9a-f54e63ba65ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:38.524018 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4126/8249] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:02:38.528284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90529268-1b52-44fc-8468-9cad97238545 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:38.548886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90529268-1b52-44fc-8468-9cad97238545 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:38.556462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f707d-7536-4809-909d-1f0c5c530e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:38.557751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f707d-7536-4809-909d-1f0c5c530e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:38.557895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f707d-7536-4809-909d-1f0c5c530e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:38.558378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f707d-7536-4809-909d-1f0c5c530e29 admin admin] PATH_INFO: `/v3/projects/39f652af44514be68d0f5099c49d4665/users/673c26c30479431ea9eb491ca6e012e8/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:38.586957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f707d-7536-4809-909d-1f0c5c530e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f652af44514be68d0f5099c49d4665, user_id=673c26c30479431ea9eb491ca6e012e8, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:38.590913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f707d-7536-4809-909d-1f0c5c530e29 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:38.603752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:38.609997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade98e1f-095d-4bd3-9e9a-f54e63ba65ed None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:38.615062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97e160-95eb-4eea-80b8-1ed5177e70e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:38.615793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97e160-95eb-4eea-80b8-1ed5177e70e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:38.616195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97e160-95eb-4eea-80b8-1ed5177e70e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:38.616575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97e160-95eb-4eea-80b8-1ed5177e70e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:38.627163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97e160-95eb-4eea-80b8-1ed5177e70e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:38.628750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97e160-95eb-4eea-80b8-1ed5177e70e2 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:38.642554 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4124/8250] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:02:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:02:38.706229 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4127/8251] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:02:38 2022] PUT /identity/v3/projects/39f652af44514be68d0f5099c49d4665/users/673c26c30479431ea9eb491ca6e012e8/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:38.711162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97e160-95eb-4eea-80b8-1ed5177e70e2 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:38.723919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97e160-95eb-4eea-80b8-1ed5177e70e2 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:38.830502 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db253b-69ee-4133-be38-7e864e03e3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:38.831129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db253b-69ee-4133-be38-7e864e03e3af admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:38.831403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db253b-69ee-4133-be38-7e864e03e3af admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:38.831892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db253b-69ee-4133-be38-7e864e03e3af admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:38.832558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db253b-69ee-4133-be38-7e864e03e3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:38.834539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db253b-69ee-4133-be38-7e864e03e3af admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:38.851709 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4125/8252] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:02:38.855655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f707d-7536-4809-909d-1f0c5c530e29 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:38.868791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f707d-7536-4809-909d-1f0c5c530e29 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:38.878420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894d8e7-865b-486a-a7b1-8a9cbc71779d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:38.879212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894d8e7-865b-486a-a7b1-8a9cbc71779d admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:38.879512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894d8e7-865b-486a-a7b1-8a9cbc71779d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:38.879813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894d8e7-865b-486a-a7b1-8a9cbc71779d admin admin] PATH_INFO: `/v3/projects/39f652af44514be68d0f5099c49d4665/users/673c26c30479431ea9eb491ca6e012e8/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:38.881926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894d8e7-865b-486a-a7b1-8a9cbc71779d admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f652af44514be68d0f5099c49d4665, user_id=673c26c30479431ea9eb491ca6e012e8, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:38.884639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894d8e7-865b-486a-a7b1-8a9cbc71779d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:38.916230 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4128/8253] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:02:38 2022] PUT /identity/v3/projects/39f652af44514be68d0f5099c49d4665/users/673c26c30479431ea9eb491ca6e012e8/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:38.929425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbe1bd-918b-46c7-8cb8-e92052344939 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:38.930250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbe1bd-918b-46c7-8cb8-e92052344939 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:38.930681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbe1bd-918b-46c7-8cb8-e92052344939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:38.982394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-1afbe1bd-918b-46c7-8cb8-e92052344939 None None] MFA Rules not processed for user `673c26c30479431ea9eb491ca6e012e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:38.989060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1afbe1bd-918b-46c7-8cb8-e92052344939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:39.081379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:39.094085 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4126/8254] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:39.116308 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894d8e7-865b-486a-a7b1-8a9cbc71779d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:39.149813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:39.231121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894d8e7-865b-486a-a7b1-8a9cbc71779d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:39.236178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c291d-4ea2-434c-a4e5-cb0566358eab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:39.236901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c291d-4ea2-434c-a4e5-cb0566358eab service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:39.237313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c291d-4ea2-434c-a4e5-cb0566358eab service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:39.237592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c291d-4ea2-434c-a4e5-cb0566358eab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:39.240488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-434c291d-4ea2-434c-a4e5-cb0566358eab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:39.316853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbe1bd-918b-46c7-8cb8-e92052344939 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:39.316853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1afbe1bd-918b-46c7-8cb8-e92052344939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:39.340936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c291d-4ea2-434c-a4e5-cb0566358eab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:39.342688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c291d-4ea2-434c-a4e5-cb0566358eab service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:39.367009 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4129/8255] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:02:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:02:39.391558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbe1bd-918b-46c7-8cb8-e92052344939 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:39.400373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fae6b-3d64-4a75-9218-385341e7a1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:39.401045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fae6b-3d64-4a75-9218-385341e7a1a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:39.401329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fae6b-3d64-4a75-9218-385341e7a1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:39.401604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fae6b-3d64-4a75-9218-385341e7a1a9 admin admin] PATH_INFO: `/v3/projects/27788f97f275480a9e4b0bb8431115bd` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:39.402901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fae6b-3d64-4a75-9218-385341e7a1a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27788f97f275480a9e4b0bb8431115bd)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:39.404814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fae6b-3d64-4a75-9218-385341e7a1a9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:39.548239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f76fae6b-3d64-4a75-9218-385341e7a1a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27788f97f275480a9e4b0bb8431115bd', 'request_id': 'req-f76fae6b-3d64-4a75-9218-385341e7a1a9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:39.651827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f76fae6b-3d64-4a75-9218-385341e7a1a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27788f97f275480a9e4b0bb8431115bd', 'request_id': 'req-f76fae6b-3d64-4a75-9218-385341e7a1a9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:39.661603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f76fae6b-3d64-4a75-9218-385341e7a1a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27788f97f275480a9e4b0bb8431115bd', 'request_id': 'req-f76fae6b-3d64-4a75-9218-385341e7a1a9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:39.674469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f76fae6b-3d64-4a75-9218-385341e7a1a9 admin admin] The token cache is being invalidate because project 27788f97f275480a9e4b0bb8431115bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:02:39.674840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f76fae6b-3d64-4a75-9218-385341e7a1a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:39.675531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f76fae6b-3d64-4a75-9218-385341e7a1a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:39.677878 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4127/8256] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:02:39 2022] DELETE /identity/v3/projects/27788f97f275480a9e4b0bb8431115bd => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 04:02:39.682971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c291d-4ea2-434c-a4e5-cb0566358eab service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:39.697458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c291d-4ea2-434c-a4e5-cb0566358eab service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:39.819815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:39.860179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269ee8a-8667-4d33-ac54-7310268dede8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:39.860910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269ee8a-8667-4d33-ac54-7310268dede8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:39.866341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269ee8a-8667-4d33-ac54-7310268dede8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:39.866341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269ee8a-8667-4d33-ac54-7310268dede8 admin admin] PATH_INFO: `/v3/users/1c7a73d7569447609eca5483df2177ca` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:39.866341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269ee8a-8667-4d33-ac54-7310268dede8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c7a73d7569447609eca5483df2177ca)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:39.866341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269ee8a-8667-4d33-ac54-7310268dede8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:40.018767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:40.173064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1269ee8a-8667-4d33-ac54-7310268dede8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c7a73d7569447609eca5483df2177ca'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:40.174251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1269ee8a-8667-4d33-ac54-7310268dede8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c7a73d7569447609eca5483df2177ca'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:40.199249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1269ee8a-8667-4d33-ac54-7310268dede8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c7a73d7569447609eca5483df2177ca'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:40.220032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1269ee8a-8667-4d33-ac54-7310268dede8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c7a73d7569447609eca5483df2177ca'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:40.221331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-1269ee8a-8667-4d33-ac54-7310268dede8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c7a73d7569447609eca5483df2177ca'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:40.311205 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4130/8257] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:02:39 2022] DELETE /identity/v3/users/1c7a73d7569447609eca5483df2177ca => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:41.328998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fae6b-3d64-4a75-9218-385341e7a1a9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:41.330695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f76fae6b-3d64-4a75-9218-385341e7a1a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:41.355720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fae6b-3d64-4a75-9218-385341e7a1a9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:41.474222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e157a-40a4-44ce-a2e0-0ff4599cca60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:41.474222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e157a-40a4-44ce-a2e0-0ff4599cca60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:41.474901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e157a-40a4-44ce-a2e0-0ff4599cca60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:41.475531 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e157a-40a4-44ce-a2e0-0ff4599cca60 admin admin] PATH_INFO: `/v3/projects/da74760305624ace911bfe4bef69cf3f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:41.476748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e157a-40a4-44ce-a2e0-0ff4599cca60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da74760305624ace911bfe4bef69cf3f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:41.478942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e157a-40a4-44ce-a2e0-0ff4599cca60 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:41.639873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c55e157a-40a4-44ce-a2e0-0ff4599cca60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da74760305624ace911bfe4bef69cf3f', 'request_id': 'req-c55e157a-40a4-44ce-a2e0-0ff4599cca60'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:41.756024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c55e157a-40a4-44ce-a2e0-0ff4599cca60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da74760305624ace911bfe4bef69cf3f', 'request_id': 'req-c55e157a-40a4-44ce-a2e0-0ff4599cca60'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:41.768164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c55e157a-40a4-44ce-a2e0-0ff4599cca60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da74760305624ace911bfe4bef69cf3f', 'request_id': 'req-c55e157a-40a4-44ce-a2e0-0ff4599cca60'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:41.785096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c55e157a-40a4-44ce-a2e0-0ff4599cca60 admin admin] The token cache is being invalidate because project da74760305624ace911bfe4bef69cf3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:02:41.785401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c55e157a-40a4-44ce-a2e0-0ff4599cca60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:41.786739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c55e157a-40a4-44ce-a2e0-0ff4599cca60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:41.789664 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4128/8258] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:02:41 2022] DELETE /identity/v3/projects/da74760305624ace911bfe4bef69cf3f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:41.794669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ba7e4-c286-42aa-9b79-4ba8e124d77d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:41.795215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ba7e4-c286-42aa-9b79-4ba8e124d77d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:41.795215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ba7e4-c286-42aa-9b79-4ba8e124d77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:41.828299 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-122ba7e4-c286-42aa-9b79-4ba8e124d77d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:41.829551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-122ba7e4-c286-42aa-9b79-4ba8e124d77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:41.991048 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4131/8259] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:42.007791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e4660-b96b-4888-8636-4d64fb4df5f2 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:42.008807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e4660-b96b-4888-8636-4d64fb4df5f2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:42.009779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e4660-b96b-4888-8636-4d64fb4df5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:42.076834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b78e4660-b96b-4888-8636-4d64fb4df5f2 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:42.078139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b78e4660-b96b-4888-8636-4d64fb4df5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:42.103001 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4129/8260] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:42.110161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ba7e4-c286-42aa-9b79-4ba8e124d77d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:42.122394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ba7e4-c286-42aa-9b79-4ba8e124d77d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:42.136098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea6a11-fbd4-41e4-9400-8fe979d9ec52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:42.136738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea6a11-fbd4-41e4-9400-8fe979d9ec52 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:42.137022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea6a11-fbd4-41e4-9400-8fe979d9ec52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:42.137835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea6a11-fbd4-41e4-9400-8fe979d9ec52 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:42.138611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea6a11-fbd4-41e4-9400-8fe979d9ec52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:02:42.138923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea6a11-fbd4-41e4-9400-8fe979d9ec52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:42.140665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea6a11-fbd4-41e4-9400-8fe979d9ec52 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:42.171309 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4132/8261] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:02:42.172621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e4660-b96b-4888-8636-4d64fb4df5f2 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:42.198638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e4660-b96b-4888-8636-4d64fb4df5f2 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:42.213558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379802c-1610-4f77-b16b-4f0cbd369a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:42.214219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379802c-1610-4f77-b16b-4f0cbd369a3d admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:42.214508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379802c-1610-4f77-b16b-4f0cbd369a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:42.214787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379802c-1610-4f77-b16b-4f0cbd369a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:42.215439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379802c-1610-4f77-b16b-4f0cbd369a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:42.217386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379802c-1610-4f77-b16b-4f0cbd369a3d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:42.270470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e1cea-0430-4bb3-b0e2-cf584a42ade8 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:42.270763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e1cea-0430-4bb3-b0e2-cf584a42ade8 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:42.271045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e1cea-0430-4bb3-b0e2-cf584a42ade8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:42.312168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a92e1cea-0430-4bb3-b0e2-cf584a42ade8 None None] MFA Rules not processed for user `fe2d538942114551b541edfddc77ccee`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:42.313918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a92e1cea-0430-4bb3-b0e2-cf584a42ade8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:42.354457 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4130/8262] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:02:42 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:02:42.354457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379802c-1610-4f77-b16b-4f0cbd369a3d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:42.376436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:42.406887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:42.424579 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4133/8263] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:42.431730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379802c-1610-4f77-b16b-4f0cbd369a3d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:42.433454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e1cea-0430-4bb3-b0e2-cf584a42ade8 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:42.435682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a92e1cea-0430-4bb3-b0e2-cf584a42ade8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:42.443774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd0505-a53f-45c4-a6cf-40e6850c1616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:42.444406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd0505-a53f-45c4-a6cf-40e6850c1616 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:42.444688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd0505-a53f-45c4-a6cf-40e6850c1616 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:42.444982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd0505-a53f-45c4-a6cf-40e6850c1616 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:42.452399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd0505-a53f-45c4-a6cf-40e6850c1616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:42.463904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd0505-a53f-45c4-a6cf-40e6850c1616 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:42.518746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e1cea-0430-4bb3-b0e2-cf584a42ade8 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:42.564499 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4131/8264] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:02:42 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 04:02:42.569480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd0505-a53f-45c4-a6cf-40e6850c1616 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:42.572843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ddf98-6de1-40f3-a0d7-4300bb1ff161 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:42.573469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ddf98-6de1-40f3-a0d7-4300bb1ff161 service glance] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:42.573755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ddf98-6de1-40f3-a0d7-4300bb1ff161 service glance] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:42.574054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ddf98-6de1-40f3-a0d7-4300bb1ff161 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:42.575985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-338ddf98-6de1-40f3-a0d7-4300bb1ff161 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:42.586891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd0505-a53f-45c4-a6cf-40e6850c1616 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:42.597286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8380652-71e3-4e0f-a45b-200f499047cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:42.600134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8380652-71e3-4e0f-a45b-200f499047cd admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:42.600523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8380652-71e3-4e0f-a45b-200f499047cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:42.600916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8380652-71e3-4e0f-a45b-200f499047cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:42.603788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8380652-71e3-4e0f-a45b-200f499047cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:42.606023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8380652-71e3-4e0f-a45b-200f499047cd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:42.622081 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4132/8265] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:02:42.625079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8380652-71e3-4e0f-a45b-200f499047cd admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:42.638196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8380652-71e3-4e0f-a45b-200f499047cd admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:42.644854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab602f-a83f-490c-bbc4-cbef8d7d93ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:42.648947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab602f-a83f-490c-bbc4-cbef8d7d93ff admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:42.648947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab602f-a83f-490c-bbc4-cbef8d7d93ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:42.648947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab602f-a83f-490c-bbc4-cbef8d7d93ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:42.648947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab602f-a83f-490c-bbc4-cbef8d7d93ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:42.649743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab602f-a83f-490c-bbc4-cbef8d7d93ff admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:42.652770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ddf98-6de1-40f3-a0d7-4300bb1ff161 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:42.654307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ddf98-6de1-40f3-a0d7-4300bb1ff161 service glance] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:42.666266 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4133/8266] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 04:02:42.666266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab602f-a83f-490c-bbc4-cbef8d7d93ff admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:42.666266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7fab602f-a83f-490c-bbc4-cbef8d7d93ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:42.674333 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4134/8267] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:02:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:02:42.675565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ddf98-6de1-40f3-a0d7-4300bb1ff161 service glance] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:42.688221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ddf98-6de1-40f3-a0d7-4300bb1ff161 service glance] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:42.697777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50169b7-3ebd-436a-915a-8ba149bee59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:42.698510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50169b7-3ebd-436a-915a-8ba149bee59d admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:42.698795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50169b7-3ebd-436a-915a-8ba149bee59d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:42.699132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50169b7-3ebd-436a-915a-8ba149bee59d admin admin] PATH_INFO: `/v3/projects/7abac9ec1edc496f969d9b387cc0bbc7/users/59a2fe10d1404d7fbdb11d7f4a2ada41/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:42.719557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50169b7-3ebd-436a-915a-8ba149bee59d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7abac9ec1edc496f969d9b387cc0bbc7, user_id=59a2fe10d1404d7fbdb11d7f4a2ada41, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:42.723962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50169b7-3ebd-436a-915a-8ba149bee59d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:42.749404 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab602f-a83f-490c-bbc4-cbef8d7d93ff admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:42.753537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c764f71-cd1f-4e86-a5be-aba82678e669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:42.755359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c764f71-cd1f-4e86-a5be-aba82678e669 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:42.755723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c764f71-cd1f-4e86-a5be-aba82678e669 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:42.756192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c764f71-cd1f-4e86-a5be-aba82678e669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:42.759619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2c764f71-cd1f-4e86-a5be-aba82678e669 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:42.798573 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4135/8268] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:02:42 2022] PUT /identity/v3/projects/7abac9ec1edc496f969d9b387cc0bbc7/users/59a2fe10d1404d7fbdb11d7f4a2ada41/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:42.810486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46e274-3123-477c-8fb5-2b795d1c5faa None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:42.810966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46e274-3123-477c-8fb5-2b795d1c5faa None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:42.811566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46e274-3123-477c-8fb5-2b795d1c5faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:42.850584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:42.864463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2f46e274-3123-477c-8fb5-2b795d1c5faa None None] MFA Rules not processed for user `59a2fe10d1404d7fbdb11d7f4a2ada41`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:42.866852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2f46e274-3123-477c-8fb5-2b795d1c5faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:42.873360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c764f71-cd1f-4e86-a5be-aba82678e669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:42.876878 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c764f71-cd1f-4e86-a5be-aba82678e669 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:42.890221 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4134/8269] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:02:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:02:42.975522 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4136/8270] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:42.979935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c764f71-cd1f-4e86-a5be-aba82678e669 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:42.991691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c764f71-cd1f-4e86-a5be-aba82678e669 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:43.069677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:43.079543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a4451-a3b2-4fa9-b6ff-edb0089d4c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:43.080328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a4451-a3b2-4fa9-b6ff-edb0089d4c61 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:43.081165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a4451-a3b2-4fa9-b6ff-edb0089d4c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:43.081687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a4451-a3b2-4fa9-b6ff-edb0089d4c61 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:43.082606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a4451-a3b2-4fa9-b6ff-edb0089d4c61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:43.085034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a4451-a3b2-4fa9-b6ff-edb0089d4c61 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:43.216034 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4135/8271] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:02:42 2022] POST /identity/v3/projects => generated 381 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:02:43.220356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46e274-3123-477c-8fb5-2b795d1c5faa None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:43.232322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46e274-3123-477c-8fb5-2b795d1c5faa None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:43.295819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bcbd1-8495-4494-aab0-7c5625b0507a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:43.296870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bcbd1-8495-4494-aab0-7c5625b0507a admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:43.297414 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bcbd1-8495-4494-aab0-7c5625b0507a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:43.297909 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bcbd1-8495-4494-aab0-7c5625b0507a admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:43.299136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bcbd1-8495-4494-aab0-7c5625b0507a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:43.303458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bcbd1-8495-4494-aab0-7c5625b0507a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:43.398580 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4137/8272] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:02:43 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:02:43.399486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a4451-a3b2-4fa9-b6ff-edb0089d4c61 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:43.412330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a4451-a3b2-4fa9-b6ff-edb0089d4c61 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:43.418233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251bd270-6a84-4b2b-ba8c-5b8981c92039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:43.418863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bd270-6a84-4b2b-ba8c-5b8981c92039 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:43.419379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bd270-6a84-4b2b-ba8c-5b8981c92039 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:43.419543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bd270-6a84-4b2b-ba8c-5b8981c92039 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:43.420217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251bd270-6a84-4b2b-ba8c-5b8981c92039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:43.421853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251bd270-6a84-4b2b-ba8c-5b8981c92039 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:43.438796 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4136/8273] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:02:43.445429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bcbd1-8495-4494-aab0-7c5625b0507a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:43.457388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bcbd1-8495-4494-aab0-7c5625b0507a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:43.463302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189008a6-6aed-4052-ab68-69de6dee51bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:43.474375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189008a6-6aed-4052-ab68-69de6dee51bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:43.474375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189008a6-6aed-4052-ab68-69de6dee51bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:43.474375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189008a6-6aed-4052-ab68-69de6dee51bc admin admin] PATH_INFO: `/v3/projects/ae1ca3579b0a4b2bb0c837eb93803d5d/users/93f5fde6bc5640c19d9b8d0d5cb2cf83/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:43.482620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189008a6-6aed-4052-ab68-69de6dee51bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae1ca3579b0a4b2bb0c837eb93803d5d, user_id=93f5fde6bc5640c19d9b8d0d5cb2cf83, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:43.488750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189008a6-6aed-4052-ab68-69de6dee51bc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:43.582535 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4138/8274] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:02:43 2022] PUT /identity/v3/projects/ae1ca3579b0a4b2bb0c837eb93803d5d/users/93f5fde6bc5640c19d9b8d0d5cb2cf83/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:43.585603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251bd270-6a84-4b2b-ba8c-5b8981c92039 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:43.596717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251bd270-6a84-4b2b-ba8c-5b8981c92039 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:43.702687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46080fe5-623b-43e0-a28c-21aef136f85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:43.703435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46080fe5-623b-43e0-a28c-21aef136f85d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:43.703788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46080fe5-623b-43e0-a28c-21aef136f85d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:43.704132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46080fe5-623b-43e0-a28c-21aef136f85d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:43.704868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46080fe5-623b-43e0-a28c-21aef136f85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:43.709001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46080fe5-623b-43e0-a28c-21aef136f85d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:43.737014 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4137/8275] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:02:43.743570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189008a6-6aed-4052-ab68-69de6dee51bc admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:43.755994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189008a6-6aed-4052-ab68-69de6dee51bc admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:43.762747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3d1f4-106e-4618-b40f-7e2b602f719e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:43.763572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3d1f4-106e-4618-b40f-7e2b602f719e admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:43.763945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3d1f4-106e-4618-b40f-7e2b602f719e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:43.764325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3d1f4-106e-4618-b40f-7e2b602f719e admin admin] PATH_INFO: `/v3/projects/ae1ca3579b0a4b2bb0c837eb93803d5d/users/93f5fde6bc5640c19d9b8d0d5cb2cf83/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:43.766601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3d1f4-106e-4618-b40f-7e2b602f719e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae1ca3579b0a4b2bb0c837eb93803d5d, user_id=93f5fde6bc5640c19d9b8d0d5cb2cf83, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:43.769420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3d1f4-106e-4618-b40f-7e2b602f719e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:43.783297 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4139/8276] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:02:43 2022] PUT /identity/v3/projects/ae1ca3579b0a4b2bb0c837eb93803d5d/users/93f5fde6bc5640c19d9b8d0d5cb2cf83/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:43.795286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb39d31-f967-4dc0-a574-a7c1d9bc3f17 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:43.796482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb39d31-f967-4dc0-a574-a7c1d9bc3f17 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:43.796874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb39d31-f967-4dc0-a574-a7c1d9bc3f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:43.832200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-fbb39d31-f967-4dc0-a574-a7c1d9bc3f17 None None] MFA Rules not processed for user `93f5fde6bc5640c19d9b8d0d5cb2cf83`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:43.834292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fbb39d31-f967-4dc0-a574-a7c1d9bc3f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:43.941814 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4138/8277] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:43.958722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3d1f4-106e-4618-b40f-7e2b602f719e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:43.960540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-95d3d1f4-106e-4618-b40f-7e2b602f719e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:44.057161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3d1f4-106e-4618-b40f-7e2b602f719e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:44.061225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05812a-83ce-4162-9afd-f5da3041cabc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:44.061993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05812a-83ce-4162-9afd-f5da3041cabc service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:44.062446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05812a-83ce-4162-9afd-f5da3041cabc service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:44.062827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05812a-83ce-4162-9afd-f5da3041cabc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:44.074765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:44.080689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05812a-83ce-4162-9afd-f5da3041cabc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:44.084250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05812a-83ce-4162-9afd-f5da3041cabc service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:44.120827 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4140/8278] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:02:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:02:44.881807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb39d31-f967-4dc0-a574-a7c1d9bc3f17 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:44.991092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:45.010942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb39d31-f967-4dc0-a574-a7c1d9bc3f17 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:45.016549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e66c7-469a-499a-8f27-2c046974d458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:45.018252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e66c7-469a-499a-8f27-2c046974d458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:45.018835 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e66c7-469a-499a-8f27-2c046974d458 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:45.019441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e66c7-469a-499a-8f27-2c046974d458 admin admin] PATH_INFO: `/v3/users/59a2fe10d1404d7fbdb11d7f4a2ada41` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:45.021300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e66c7-469a-499a-8f27-2c046974d458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59a2fe10d1404d7fbdb11d7f4a2ada41)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:45.023819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e66c7-469a-499a-8f27-2c046974d458 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:45.271892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f54e66c7-469a-499a-8f27-2c046974d458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59a2fe10d1404d7fbdb11d7f4a2ada41'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:45.272672 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f54e66c7-469a-499a-8f27-2c046974d458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59a2fe10d1404d7fbdb11d7f4a2ada41'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:45.288601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f54e66c7-469a-499a-8f27-2c046974d458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59a2fe10d1404d7fbdb11d7f4a2ada41'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:45.326474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f54e66c7-469a-499a-8f27-2c046974d458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59a2fe10d1404d7fbdb11d7f4a2ada41'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:45.439796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-f54e66c7-469a-499a-8f27-2c046974d458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59a2fe10d1404d7fbdb11d7f4a2ada41'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:45.447841 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4139/8279] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:02:44 2022] DELETE /identity/v3/users/59a2fe10d1404d7fbdb11d7f4a2ada41 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:45.452171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e445b-ced5-4839-947b-febd044ba1c3 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:45.453398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e445b-ced5-4839-947b-febd044ba1c3 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:45.453876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e445b-ced5-4839-947b-febd044ba1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:45.490508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-cf1e445b-ced5-4839-947b-febd044ba1c3 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:45.495247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cf1e445b-ced5-4839-947b-febd044ba1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:45.627223 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4141/8280] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 04:02:45.639593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e66c7-469a-499a-8f27-2c046974d458 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:45.641721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f54e66c7-469a-499a-8f27-2c046974d458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:45.756486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e66c7-469a-499a-8f27-2c046974d458 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:45.767641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f128de-cfe3-44d1-b28a-e07398cbce80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:45.768862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f128de-cfe3-44d1-b28a-e07398cbce80 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:45.769256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f128de-cfe3-44d1-b28a-e07398cbce80 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:45.769638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f128de-cfe3-44d1-b28a-e07398cbce80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:45.793988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f128de-cfe3-44d1-b28a-e07398cbce80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:45.799831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f128de-cfe3-44d1-b28a-e07398cbce80 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:45.815336 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4140/8281] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:02:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:02:46.678725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e445b-ced5-4839-947b-febd044ba1c3 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:46.686794 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cf1e445b-ced5-4839-947b-febd044ba1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:46.700622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e445b-ced5-4839-947b-febd044ba1c3 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:46.710413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32006051-8680-40af-9807-f78a48b83150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:46.711291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32006051-8680-40af-9807-f78a48b83150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:46.711720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32006051-8680-40af-9807-f78a48b83150 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:46.712133 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32006051-8680-40af-9807-f78a48b83150 admin admin] PATH_INFO: `/v3/projects/7abac9ec1edc496f969d9b387cc0bbc7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:46.713479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32006051-8680-40af-9807-f78a48b83150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7abac9ec1edc496f969d9b387cc0bbc7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:46.715595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32006051-8680-40af-9807-f78a48b83150 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:46.884274 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-32006051-8680-40af-9807-f78a48b83150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7abac9ec1edc496f969d9b387cc0bbc7', 'request_id': 'req-32006051-8680-40af-9807-f78a48b83150'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:46.891939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-32006051-8680-40af-9807-f78a48b83150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7abac9ec1edc496f969d9b387cc0bbc7', 'request_id': 'req-32006051-8680-40af-9807-f78a48b83150'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:46.899283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-32006051-8680-40af-9807-f78a48b83150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7abac9ec1edc496f969d9b387cc0bbc7', 'request_id': 'req-32006051-8680-40af-9807-f78a48b83150'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:47.013644 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-32006051-8680-40af-9807-f78a48b83150 admin admin] The token cache is being invalidate because project 7abac9ec1edc496f969d9b387cc0bbc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:02:47.017236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-32006051-8680-40af-9807-f78a48b83150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:47.017236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-32006051-8680-40af-9807-f78a48b83150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:47.017599 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4142/8282] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:02:46 2022] DELETE /identity/v3/projects/7abac9ec1edc496f969d9b387cc0bbc7 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:47.024765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f128de-cfe3-44d1-b28a-e07398cbce80 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:47.038963 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f128de-cfe3-44d1-b28a-e07398cbce80 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:47.119069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d453efb-08d4-467f-88f3-6b84208a00fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:47.119069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d453efb-08d4-467f-88f3-6b84208a00fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:47.119069 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d453efb-08d4-467f-88f3-6b84208a00fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:47.119554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d453efb-08d4-467f-88f3-6b84208a00fa admin admin] PATH_INFO: `/v3/users/93f5fde6bc5640c19d9b8d0d5cb2cf83` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:47.120684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d453efb-08d4-467f-88f3-6b84208a00fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=93f5fde6bc5640c19d9b8d0d5cb2cf83)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:47.123367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d453efb-08d4-467f-88f3-6b84208a00fa admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:47.155586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:47.358681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9d453efb-08d4-467f-88f3-6b84208a00fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93f5fde6bc5640c19d9b8d0d5cb2cf83'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:47.359423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9d453efb-08d4-467f-88f3-6b84208a00fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93f5fde6bc5640c19d9b8d0d5cb2cf83'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:47.370016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9d453efb-08d4-467f-88f3-6b84208a00fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93f5fde6bc5640c19d9b8d0d5cb2cf83'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:47.385437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9d453efb-08d4-467f-88f3-6b84208a00fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93f5fde6bc5640c19d9b8d0d5cb2cf83'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:47.453039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-9d453efb-08d4-467f-88f3-6b84208a00fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93f5fde6bc5640c19d9b8d0d5cb2cf83'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:47.464103 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4141/8283] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:02:47 2022] DELETE /identity/v3/users/93f5fde6bc5640c19d9b8d0d5cb2cf83 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:48.784497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32006051-8680-40af-9807-f78a48b83150 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:48.789265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-32006051-8680-40af-9807-f78a48b83150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:48.799660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32006051-8680-40af-9807-f78a48b83150 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:48.876339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77a6cd-531e-42e4-bd07-69eb606d91ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:48.878010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77a6cd-531e-42e4-bd07-69eb606d91ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:48.878498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77a6cd-531e-42e4-bd07-69eb606d91ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:48.878948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77a6cd-531e-42e4-bd07-69eb606d91ac admin admin] PATH_INFO: `/v3/projects/ae1ca3579b0a4b2bb0c837eb93803d5d` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:48.881230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77a6cd-531e-42e4-bd07-69eb606d91ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae1ca3579b0a4b2bb0c837eb93803d5d)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:48.884412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77a6cd-531e-42e4-bd07-69eb606d91ac admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:48.927621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:49.021388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0b77a6cd-531e-42e4-bd07-69eb606d91ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae1ca3579b0a4b2bb0c837eb93803d5d', 'request_id': 'req-0b77a6cd-531e-42e4-bd07-69eb606d91ac'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:49.030400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0b77a6cd-531e-42e4-bd07-69eb606d91ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae1ca3579b0a4b2bb0c837eb93803d5d', 'request_id': 'req-0b77a6cd-531e-42e4-bd07-69eb606d91ac'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:49.037294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0b77a6cd-531e-42e4-bd07-69eb606d91ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae1ca3579b0a4b2bb0c837eb93803d5d', 'request_id': 'req-0b77a6cd-531e-42e4-bd07-69eb606d91ac'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:49.161412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0b77a6cd-531e-42e4-bd07-69eb606d91ac admin admin] The token cache is being invalidate because project ae1ca3579b0a4b2bb0c837eb93803d5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:02:49.161814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0b77a6cd-531e-42e4-bd07-69eb606d91ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:49.163413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0b77a6cd-531e-42e4-bd07-69eb606d91ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:49.165779 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4143/8284] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:02:48 2022] DELETE /identity/v3/projects/ae1ca3579b0a4b2bb0c837eb93803d5d => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:49.170589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4f674-49c1-4303-b73c-b07012b3601c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:49.171172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4f674-49c1-4303-b73c-b07012b3601c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:49.171172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4f674-49c1-4303-b73c-b07012b3601c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:49.208241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c0e4f674-49c1-4303-b73c-b07012b3601c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:49.209845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c0e4f674-49c1-4303-b73c-b07012b3601c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:49.318504 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4142/8285] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:49.327176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7e0e4-20a8-466f-90c4-7552a36297c9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:49.328315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7e0e4-20a8-466f-90c4-7552a36297c9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:49.328315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7e0e4-20a8-466f-90c4-7552a36297c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:49.351379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-fce7e0e4-20a8-466f-90c4-7552a36297c9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:49.353021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fce7e0e4-20a8-466f-90c4-7552a36297c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:49.362364 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4144/8286] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:49.367568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4f674-49c1-4303-b73c-b07012b3601c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:49.381544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4f674-49c1-4303-b73c-b07012b3601c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:49.386903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640da799-1bcf-4d18-985a-08196bb756e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:49.387547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640da799-1bcf-4d18-985a-08196bb756e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:49.388051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640da799-1bcf-4d18-985a-08196bb756e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:49.388338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640da799-1bcf-4d18-985a-08196bb756e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:49.389004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640da799-1bcf-4d18-985a-08196bb756e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:02:49.389315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640da799-1bcf-4d18-985a-08196bb756e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:49.391172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640da799-1bcf-4d18-985a-08196bb756e5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:49.408620 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4143/8287] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:02:49.410123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7e0e4-20a8-466f-90c4-7552a36297c9 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:49.422889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7e0e4-20a8-466f-90c4-7552a36297c9 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:49.432139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31d3b4-cb8d-440c-b434-dff609a54619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:49.437208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31d3b4-cb8d-440c-b434-dff609a54619 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:49.437208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31d3b4-cb8d-440c-b434-dff609a54619 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:49.437208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31d3b4-cb8d-440c-b434-dff609a54619 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:49.437208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31d3b4-cb8d-440c-b434-dff609a54619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:49.439201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31d3b4-cb8d-440c-b434-dff609a54619 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:49.562080 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4145/8288] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:02:49 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:02:49.565032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640da799-1bcf-4d18-985a-08196bb756e5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:49.579958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640da799-1bcf-4d18-985a-08196bb756e5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:49.654101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6000f11-c9fe-4f1f-bf7a-86c809a9e8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:49.655001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6000f11-c9fe-4f1f-bf7a-86c809a9e8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:49.655286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6000f11-c9fe-4f1f-bf7a-86c809a9e8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:49.655564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6000f11-c9fe-4f1f-bf7a-86c809a9e8e1 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:49.656329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6000f11-c9fe-4f1f-bf7a-86c809a9e8e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:49.658537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6000f11-c9fe-4f1f-bf7a-86c809a9e8e1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:49.763739 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4144/8289] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:02:49 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:02:49.767966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31d3b4-cb8d-440c-b434-dff609a54619 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:49.779936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31d3b4-cb8d-440c-b434-dff609a54619 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:49.789491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6fb1c-8a6f-44bb-a5cb-4710436cf2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:49.797758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6fb1c-8a6f-44bb-a5cb-4710436cf2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:49.797758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6fb1c-8a6f-44bb-a5cb-4710436cf2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:49.797758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6fb1c-8a6f-44bb-a5cb-4710436cf2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:49.797758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e6fb1c-8a6f-44bb-a5cb-4710436cf2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:49.797758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e6fb1c-8a6f-44bb-a5cb-4710436cf2e4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:49.807602 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4146/8290] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 04:02:49.812089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6000f11-c9fe-4f1f-bf7a-86c809a9e8e1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:49.828687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6000f11-c9fe-4f1f-bf7a-86c809a9e8e1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:49.834598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae9e4c-f3b6-466d-b730-b1f20dff0f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:49.835690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae9e4c-f3b6-466d-b730-b1f20dff0f1c admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:49.835690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae9e4c-f3b6-466d-b730-b1f20dff0f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:49.836190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae9e4c-f3b6-466d-b730-b1f20dff0f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:49.836681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae9e4c-f3b6-466d-b730-b1f20dff0f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:49.842485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae9e4c-f3b6-466d-b730-b1f20dff0f1c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:49.854558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:49.863475 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4145/8291] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:02:49.868677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6fb1c-8a6f-44bb-a5cb-4710436cf2e4 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:49.882440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6fb1c-8a6f-44bb-a5cb-4710436cf2e4 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:49.891154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971344f2-5a7d-4548-a7a3-7b1e69c8ce9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:49.891972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971344f2-5a7d-4548-a7a3-7b1e69c8ce9e admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:49.892324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971344f2-5a7d-4548-a7a3-7b1e69c8ce9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:49.892670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971344f2-5a7d-4548-a7a3-7b1e69c8ce9e admin admin] PATH_INFO: `/v3/projects/8c2fbffc2f8d4d08a4f93120f49b7849/users/4b59f50482b6449b91d18bea90d08d46/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:49.911636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971344f2-5a7d-4548-a7a3-7b1e69c8ce9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c2fbffc2f8d4d08a4f93120f49b7849, user_id=4b59f50482b6449b91d18bea90d08d46, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:49.918723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971344f2-5a7d-4548-a7a3-7b1e69c8ce9e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:49.989940 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4147/8292] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:02:49 2022] PUT /identity/v3/projects/8c2fbffc2f8d4d08a4f93120f49b7849/users/4b59f50482b6449b91d18bea90d08d46/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:50.000188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbf2ba-3296-4a65-b88c-adb5d4fc5191 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:50.000477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbf2ba-3296-4a65-b88c-adb5d4fc5191 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:50.000754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbf2ba-3296-4a65-b88c-adb5d4fc5191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:50.056922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b1fbf2ba-3296-4a65-b88c-adb5d4fc5191 None None] MFA Rules not processed for user `4b59f50482b6449b91d18bea90d08d46`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:50.061036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b1fbf2ba-3296-4a65-b88c-adb5d4fc5191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:50.143021 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4146/8293] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:50.159095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971344f2-5a7d-4548-a7a3-7b1e69c8ce9e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:50.159095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-971344f2-5a7d-4548-a7a3-7b1e69c8ce9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:50.234540 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971344f2-5a7d-4548-a7a3-7b1e69c8ce9e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:50.240679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f151549-5349-4283-9969-6e2522928f09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:50.241510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f151549-5349-4283-9969-6e2522928f09 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:50.242262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f151549-5349-4283-9969-6e2522928f09 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:50.242262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f151549-5349-4283-9969-6e2522928f09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:50.255212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f151549-5349-4283-9969-6e2522928f09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:50.256701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f151549-5349-4283-9969-6e2522928f09 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:50.270181 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4148/8294] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:02:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:02:50.289990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbf2ba-3296-4a65-b88c-adb5d4fc5191 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:50.372726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbf2ba-3296-4a65-b88c-adb5d4fc5191 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:50.378511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155dd07-9d2a-4f08-83c7-7b61f7a4fd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:50.379174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155dd07-9d2a-4f08-83c7-7b61f7a4fd85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:50.379464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155dd07-9d2a-4f08-83c7-7b61f7a4fd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:50.379764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155dd07-9d2a-4f08-83c7-7b61f7a4fd85 admin admin] PATH_INFO: `/v3/users/4b59f50482b6449b91d18bea90d08d46` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:50.381014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155dd07-9d2a-4f08-83c7-7b61f7a4fd85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b59f50482b6449b91d18bea90d08d46)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:50.383044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155dd07-9d2a-4f08-83c7-7b61f7a4fd85 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:50.584503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0155dd07-9d2a-4f08-83c7-7b61f7a4fd85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b59f50482b6449b91d18bea90d08d46'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:50.585265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0155dd07-9d2a-4f08-83c7-7b61f7a4fd85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b59f50482b6449b91d18bea90d08d46'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:50.595989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0155dd07-9d2a-4f08-83c7-7b61f7a4fd85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b59f50482b6449b91d18bea90d08d46'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:50.611184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0155dd07-9d2a-4f08-83c7-7b61f7a4fd85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b59f50482b6449b91d18bea90d08d46'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:50.719065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0155dd07-9d2a-4f08-83c7-7b61f7a4fd85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b59f50482b6449b91d18bea90d08d46'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:50.727176 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4147/8295] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:02:50 2022] DELETE /identity/v3/users/4b59f50482b6449b91d18bea90d08d46 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:50.731561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6cb90-57b7-4578-8ef3-52c073fbc624 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:50.732250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6cb90-57b7-4578-8ef3-52c073fbc624 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:50.732734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6cb90-57b7-4578-8ef3-52c073fbc624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:50.772541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b6d6cb90-57b7-4578-8ef3-52c073fbc624 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:50.773844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b6d6cb90-57b7-4578-8ef3-52c073fbc624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:50.829244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:50.853284 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4149/8296] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:50.864581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155dd07-9d2a-4f08-83c7-7b61f7a4fd85 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:50.866215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0155dd07-9d2a-4f08-83c7-7b61f7a4fd85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:50.884179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:50.949927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155dd07-9d2a-4f08-83c7-7b61f7a4fd85 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:50.954616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222aa848-c314-4a70-a025-8331adad2a43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:50.955572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222aa848-c314-4a70-a025-8331adad2a43 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:50.955706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222aa848-c314-4a70-a025-8331adad2a43 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:50.956625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222aa848-c314-4a70-a025-8331adad2a43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:50.974411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222aa848-c314-4a70-a025-8331adad2a43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:50.976027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222aa848-c314-4a70-a025-8331adad2a43 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:50.992121 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4148/8297] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:02:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:02:51.640564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6cb90-57b7-4578-8ef3-52c073fbc624 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:51.642198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b6d6cb90-57b7-4578-8ef3-52c073fbc624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:51.686897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6cb90-57b7-4578-8ef3-52c073fbc624 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:51.692234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e07a0d-ccb0-4fb9-94f8-9058162bc77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:51.698255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e07a0d-ccb0-4fb9-94f8-9058162bc77a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:51.698255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e07a0d-ccb0-4fb9-94f8-9058162bc77a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:51.698255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e07a0d-ccb0-4fb9-94f8-9058162bc77a admin admin] PATH_INFO: `/v3/projects/8c2fbffc2f8d4d08a4f93120f49b7849` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:51.698255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e07a0d-ccb0-4fb9-94f8-9058162bc77a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c2fbffc2f8d4d08a4f93120f49b7849)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:51.698255 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e07a0d-ccb0-4fb9-94f8-9058162bc77a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:51.850512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-17e07a0d-ccb0-4fb9-94f8-9058162bc77a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c2fbffc2f8d4d08a4f93120f49b7849', 'request_id': 'req-17e07a0d-ccb0-4fb9-94f8-9058162bc77a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:51.858704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-17e07a0d-ccb0-4fb9-94f8-9058162bc77a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c2fbffc2f8d4d08a4f93120f49b7849', 'request_id': 'req-17e07a0d-ccb0-4fb9-94f8-9058162bc77a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:51.867128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-17e07a0d-ccb0-4fb9-94f8-9058162bc77a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c2fbffc2f8d4d08a4f93120f49b7849', 'request_id': 'req-17e07a0d-ccb0-4fb9-94f8-9058162bc77a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:51.988390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-17e07a0d-ccb0-4fb9-94f8-9058162bc77a admin admin] The token cache is being invalidate because project 8c2fbffc2f8d4d08a4f93120f49b7849 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:02:51.988683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-17e07a0d-ccb0-4fb9-94f8-9058162bc77a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:51.989371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-17e07a0d-ccb0-4fb9-94f8-9058162bc77a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:02:51.991379 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4150/8298] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:02:51 2022] DELETE /identity/v3/projects/8c2fbffc2f8d4d08a4f93120f49b7849 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:02:51.996376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5515ddc-8288-47f8-bb89-406a41edaeab None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:51.996863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5515ddc-8288-47f8-bb89-406a41edaeab None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:51.996964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5515ddc-8288-47f8-bb89-406a41edaeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:52.020023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f5515ddc-8288-47f8-bb89-406a41edaeab None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:52.022322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f5515ddc-8288-47f8-bb89-406a41edaeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:52.055594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38976f0-9b5a-4389-833a-52f81eeca63b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:52.056202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38976f0-9b5a-4389-833a-52f81eeca63b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:52.056671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38976f0-9b5a-4389-833a-52f81eeca63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:52.086548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d38976f0-9b5a-4389-833a-52f81eeca63b None None] MFA Rules not processed for user `98bf808aeff6462794e5d6c653c72ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:52.088234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d38976f0-9b5a-4389-833a-52f81eeca63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:52.114696 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4149/8299] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:52.122936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2335e4-f174-434f-a9b7-89d5756d9755 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:52.123547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2335e4-f174-434f-a9b7-89d5756d9755 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:52.124042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2335e4-f174-434f-a9b7-89d5756d9755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:52.150339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8a2335e4-f174-434f-a9b7-89d5756d9755 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:52.152068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8a2335e4-f174-434f-a9b7-89d5756d9755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:52.160958 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4150/8300] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 04:02:52.166171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2335e4-f174-434f-a9b7-89d5756d9755 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:52.174966 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2335e4-f174-434f-a9b7-89d5756d9755 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:52.178833 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4151/8301] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 04:02:52.188431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92352da-ec5d-4b8d-afec-fd779a6a1e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:52.188431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92352da-ec5d-4b8d-afec-fd779a6a1e4b admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:52.188431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92352da-ec5d-4b8d-afec-fd779a6a1e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:52.188431 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92352da-ec5d-4b8d-afec-fd779a6a1e4b admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:52.188920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92352da-ec5d-4b8d-afec-fd779a6a1e4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:02:52.188920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92352da-ec5d-4b8d-afec-fd779a6a1e4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:52.188920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92352da-ec5d-4b8d-afec-fd779a6a1e4b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:52.206584 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4151/8302] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 04:02:52.211871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38976f0-9b5a-4389-833a-52f81eeca63b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:52.224157 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38976f0-9b5a-4389-833a-52f81eeca63b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:52.229785 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b6882-9c2f-4043-9e37-a3fa15b825c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:52.230728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b6882-9c2f-4043-9e37-a3fa15b825c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:52.231224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b6882-9c2f-4043-9e37-a3fa15b825c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:52.231880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b6882-9c2f-4043-9e37-a3fa15b825c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:52.232745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b6882-9c2f-4043-9e37-a3fa15b825c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:52.236452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b6882-9c2f-4043-9e37-a3fa15b825c5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:52.332888 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4152/8303] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:02:52 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 04:02:52.337075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92352da-ec5d-4b8d-afec-fd779a6a1e4b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:52.349575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92352da-ec5d-4b8d-afec-fd779a6a1e4b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:52.418121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e7b36-4fec-4a40-8c61-5efcc09ad20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:52.418699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e7b36-4fec-4a40-8c61-5efcc09ad20c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:52.418991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e7b36-4fec-4a40-8c61-5efcc09ad20c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:52.419419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e7b36-4fec-4a40-8c61-5efcc09ad20c admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:52.420330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e7b36-4fec-4a40-8c61-5efcc09ad20c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:52.422849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e7b36-4fec-4a40-8c61-5efcc09ad20c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:52.533929 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4152/8304] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:02:52 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:02:52.538543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b6882-9c2f-4043-9e37-a3fa15b825c5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:52.549728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b6882-9c2f-4043-9e37-a3fa15b825c5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:52.553165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e7b36-4fec-4a40-8c61-5efcc09ad20c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:52.555293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-af7e7b36-4fec-4a40-8c61-5efcc09ad20c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:52.563694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4534b2-acf4-4b11-8bef-58602a355c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:52.563694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4534b2-acf4-4b11-8bef-58602a355c1e admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:52.563694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4534b2-acf4-4b11-8bef-58602a355c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:52.563694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4534b2-acf4-4b11-8bef-58602a355c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:52.564142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4534b2-acf4-4b11-8bef-58602a355c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:52.564142 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4534b2-acf4-4b11-8bef-58602a355c1e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:52.572872 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4153/8305] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:02:52.577230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4534b2-acf4-4b11-8bef-58602a355c1e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:52.587604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:52.589816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4534b2-acf4-4b11-8bef-58602a355c1e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:52.595412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd61a8-ec92-466e-b05d-de05655fb898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:52.599515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd61a8-ec92-466e-b05d-de05655fb898 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:52.599515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd61a8-ec92-466e-b05d-de05655fb898 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:52.599515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd61a8-ec92-466e-b05d-de05655fb898 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:52.599515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd61a8-ec92-466e-b05d-de05655fb898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:52.599948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd61a8-ec92-466e-b05d-de05655fb898 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:52.611186 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4154/8306] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 04:02:52.615799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd61a8-ec92-466e-b05d-de05655fb898 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:52.625714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e7b36-4fec-4a40-8c61-5efcc09ad20c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:52.628373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd61a8-ec92-466e-b05d-de05655fb898 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:52.629738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f80e3-c34b-4df0-8f7c-c50a8f01e773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:52.630958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f80e3-c34b-4df0-8f7c-c50a8f01e773 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:52.631337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f80e3-c34b-4df0-8f7c-c50a8f01e773 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:52.631644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f80e3-c34b-4df0-8f7c-c50a8f01e773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:52.633490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b20f80e3-c34b-4df0-8f7c-c50a8f01e773 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:52.634296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edd00a-bd39-4d7e-b2bd-1d9a989cf08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:52.634961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edd00a-bd39-4d7e-b2bd-1d9a989cf08f admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:52.635243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edd00a-bd39-4d7e-b2bd-1d9a989cf08f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:52.635520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edd00a-bd39-4d7e-b2bd-1d9a989cf08f admin admin] PATH_INFO: `/v3/projects/7839538936e24003bfb69cf2efabc29f/users/53ab6fd880a3424693ce9c71f77ff40c/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:52.646825 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f80e3-c34b-4df0-8f7c-c50a8f01e773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:52.648524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f80e3-c34b-4df0-8f7c-c50a8f01e773 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:52.653184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edd00a-bd39-4d7e-b2bd-1d9a989cf08f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7839538936e24003bfb69cf2efabc29f, user_id=53ab6fd880a3424693ce9c71f77ff40c, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:52.656215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edd00a-bd39-4d7e-b2bd-1d9a989cf08f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:52.659826 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4153/8307] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:02:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:02:52.783191 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4155/8308] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:02:52 2022] PUT /identity/v3/projects/7839538936e24003bfb69cf2efabc29f/users/53ab6fd880a3424693ce9c71f77ff40c/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 04:02:52.784846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2979bca-dba8-4d2e-b7ab-c2904d30cc26 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:52.785141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2979bca-dba8-4d2e-b7ab-c2904d30cc26 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:52.785417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2979bca-dba8-4d2e-b7ab-c2904d30cc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:52.807864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d2979bca-dba8-4d2e-b7ab-c2904d30cc26 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:52.810483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d2979bca-dba8-4d2e-b7ab-c2904d30cc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:52.905334 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4154/8309] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:52.913877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edd00a-bd39-4d7e-b2bd-1d9a989cf08f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:52.925985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:52.996560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edd00a-bd39-4d7e-b2bd-1d9a989cf08f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:53.000717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2994b9-2935-48ab-887b-d5b7ccd3a5ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:53.005470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2994b9-2935-48ab-887b-d5b7ccd3a5ee service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:53.005470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2994b9-2935-48ab-887b-d5b7ccd3a5ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:53.005470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2994b9-2935-48ab-887b-d5b7ccd3a5ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:53.013429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2994b9-2935-48ab-887b-d5b7ccd3a5ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:53.014922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2994b9-2935-48ab-887b-d5b7ccd3a5ee service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:53.026177 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4156/8310] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:02:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:02:53.109477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2979bca-dba8-4d2e-b7ab-c2904d30cc26 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:53.111064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d2979bca-dba8-4d2e-b7ab-c2904d30cc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:53.244912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2979bca-dba8-4d2e-b7ab-c2904d30cc26 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:53.251486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd0c54-20c6-4b06-a82a-432725f2940e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:53.252260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd0c54-20c6-4b06-a82a-432725f2940e service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:53.252616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd0c54-20c6-4b06-a82a-432725f2940e service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:53.255048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd0c54-20c6-4b06-a82a-432725f2940e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:53.259627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-34bd0c54-20c6-4b06-a82a-432725f2940e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:53.279154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd0c54-20c6-4b06-a82a-432725f2940e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:53.280921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd0c54-20c6-4b06-a82a-432725f2940e service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:53.297416 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4155/8311] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:02:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:02:54.510768 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d73dd-5306-488f-9904-5cae91d6f51c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:54.516398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d73dd-5306-488f-9904-5cae91d6f51c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:54.516398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d73dd-5306-488f-9904-5cae91d6f51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:54.552317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4b3d73dd-5306-488f-9904-5cae91d6f51c None None] MFA Rules not processed for user `53ab6fd880a3424693ce9c71f77ff40c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:54.552317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4b3d73dd-5306-488f-9904-5cae91d6f51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:54.640478 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4157/8312] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:54.652023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd0c54-20c6-4b06-a82a-432725f2940e service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:54.653874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-34bd0c54-20c6-4b06-a82a-432725f2940e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:54.712931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=100 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:54.720783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd0c54-20c6-4b06-a82a-432725f2940e service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:54.725168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ae5e7-a6d3-4673-807c-3233bcaf8418 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:54.725882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ae5e7-a6d3-4673-807c-3233bcaf8418 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:54.726263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ae5e7-a6d3-4673-807c-3233bcaf8418 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:54.726605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ae5e7-a6d3-4673-807c-3233bcaf8418 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:54.735565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ae5e7-a6d3-4673-807c-3233bcaf8418 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:54.737143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ae5e7-a6d3-4673-807c-3233bcaf8418 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:54.749182 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4156/8313] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:02:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:02:57.233227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d73dd-5306-488f-9904-5cae91d6f51c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:57.247134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d73dd-5306-488f-9904-5cae91d6f51c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:57.251059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96eb96-871d-4cb2-bc63-822b49541f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:57.251687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96eb96-871d-4cb2-bc63-822b49541f15 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:57.251973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96eb96-871d-4cb2-bc63-822b49541f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:57.252254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96eb96-871d-4cb2-bc63-822b49541f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:57.254169 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9c96eb96-871d-4cb2-bc63-822b49541f15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:57.269675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96eb96-871d-4cb2-bc63-822b49541f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:57.272680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96eb96-871d-4cb2-bc63-822b49541f15 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:57.288934 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4158/8314] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:02:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:02:57.617229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a84fa2-b06c-480e-b81b-8327e0b0a2dc None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:57.617760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a84fa2-b06c-480e-b81b-8327e0b0a2dc None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:57.617760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a84fa2-b06c-480e-b81b-8327e0b0a2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:57.644074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c0a84fa2-b06c-480e-b81b-8327e0b0a2dc None None] MFA Rules not processed for user `53ab6fd880a3424693ce9c71f77ff40c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:02:57.646403 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c0a84fa2-b06c-480e-b81b-8327e0b0a2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:57.662442 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4157/8315] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:02:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:02:58.709663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96eb96-871d-4cb2-bc63-822b49541f15 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:02:58.711737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9c96eb96-871d-4cb2-bc63-822b49541f15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:58.844927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96eb96-871d-4cb2-bc63-822b49541f15 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:02:58.860779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed6d10-3dfd-4d49-8f6c-249b727e6268 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:02:58.861417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed6d10-3dfd-4d49-8f6c-249b727e6268 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:02:58.861700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed6d10-3dfd-4d49-8f6c-249b727e6268 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:02:58.861980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed6d10-3dfd-4d49-8f6c-249b727e6268 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:02:58.865386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-aeed6d10-3dfd-4d49-8f6c-249b727e6268 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:02:58.896410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed6d10-3dfd-4d49-8f6c-249b727e6268 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:02:58.898041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed6d10-3dfd-4d49-8f6c-249b727e6268 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:02:58.924510 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4159/8316] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:02:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:03:05.487630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a84fa2-b06c-480e-b81b-8327e0b0a2dc None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:03:05.494229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c0a84fa2-b06c-480e-b81b-8327e0b0a2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:03:05.510979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a84fa2-b06c-480e-b81b-8327e0b0a2dc None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:03:05.517538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb92e2a-2f3a-403e-b28e-bd67ade9bd9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:03:05.518386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb92e2a-2f3a-403e-b28e-bd67ade9bd9b service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:03:05.518796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb92e2a-2f3a-403e-b28e-bd67ade9bd9b service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:03:05.519200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb92e2a-2f3a-403e-b28e-bd67ade9bd9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:03:05.521234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2fb92e2a-2f3a-403e-b28e-bd67ade9bd9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:03:05.537861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb92e2a-2f3a-403e-b28e-bd67ade9bd9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:03:05.545128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb92e2a-2f3a-403e-b28e-bd67ade9bd9b service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:03:05.553979 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4158/8317] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:03:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:03:08.912183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:03:09.799370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed6d10-3dfd-4d49-8f6c-249b727e6268 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:03:09.812302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed6d10-3dfd-4d49-8f6c-249b727e6268 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:03:09.821615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f7d36-ba15-4f67-bf8b-383b80de53b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:03:09.823262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f7d36-ba15-4f67-bf8b-383b80de53b7 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:03:09.823747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f7d36-ba15-4f67-bf8b-383b80de53b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:03:09.824197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f7d36-ba15-4f67-bf8b-383b80de53b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:03:09.826265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-716f7d36-ba15-4f67-bf8b-383b80de53b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:03:09.840120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f7d36-ba15-4f67-bf8b-383b80de53b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:03:09.841678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f7d36-ba15-4f67-bf8b-383b80de53b7 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:03:09.854064 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4160/8318] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:03:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:03:15.547989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=14 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:03:17.072018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2548fce-53c8-460e-a0bd-993289a4a98e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:03:17.072619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2548fce-53c8-460e-a0bd-993289a4a98e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:03:17.072619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2548fce-53c8-460e-a0bd-993289a4a98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:03:17.091789 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a2548fce-53c8-460e-a0bd-993289a4a98e None None] MFA Rules not processed for user `53ab6fd880a3424693ce9c71f77ff40c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:03:17.093006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a2548fce-53c8-460e-a0bd-993289a4a98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:03:17.100812 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4159/8319] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:03:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:03:19.848871 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:03:24.371525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f7d36-ba15-4f67-bf8b-383b80de53b7 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:03:24.373144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-716f7d36-ba15-4f67-bf8b-383b80de53b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:03:24.448333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f7d36-ba15-4f67-bf8b-383b80de53b7 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:03:24.453671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d13ff7-af14-4b46-ada1-af4eda058738 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:03:24.454317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d13ff7-af14-4b46-ada1-af4eda058738 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:03:24.454602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d13ff7-af14-4b46-ada1-af4eda058738 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:03:24.454881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d13ff7-af14-4b46-ada1-af4eda058738 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:03:24.456998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-63d13ff7-af14-4b46-ada1-af4eda058738 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:03:24.521743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d13ff7-af14-4b46-ada1-af4eda058738 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:03:24.523374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d13ff7-af14-4b46-ada1-af4eda058738 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:03:24.531758 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4161/8320] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 04:03:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 04:03:27.086911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:03:34.528232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=54 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:03:37.298980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d95fc-af23-413a-8da3-4beed9335535 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:03:37.299472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d95fc-af23-413a-8da3-4beed9335535 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:03:37.299643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d95fc-af23-413a-8da3-4beed9335535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:03:37.337763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ae3d95fc-af23-413a-8da3-4beed9335535 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:03:37.339035 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ae3d95fc-af23-413a-8da3-4beed9335535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:03:37.399819 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4160/8321] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 04:03:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:03:37.532462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d13ff7-af14-4b46-ada1-af4eda058738 service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:03:37.546331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d13ff7-af14-4b46-ada1-af4eda058738 service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:03:37.551481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ffbf2-c707-4c3f-a512-9c4deb528ab2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:03:37.552090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ffbf2-c707-4c3f-a512-9c4deb528ab2 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:03:37.552379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ffbf2-c707-4c3f-a512-9c4deb528ab2 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:03:37.552659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ffbf2-c707-4c3f-a512-9c4deb528ab2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:03:37.560900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ffbf2-c707-4c3f-a512-9c4deb528ab2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:03:37.562514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ffbf2-c707-4c3f-a512-9c4deb528ab2 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:03:37.571443 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4162/8322] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 04:03:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 04:03:47.390579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=25 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:03:47.567292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:03:50.098736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30476a71-7bb1-498a-a518-37206483b39b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:03:50.100448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30476a71-7bb1-498a-a518-37206483b39b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:03:50.101863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30476a71-7bb1-498a-a518-37206483b39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:03:50.142777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-30476a71-7bb1-498a-a518-37206483b39b None None] MFA Rules not processed for user `98bf808aeff6462794e5d6c653c72ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:03:50.144077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-30476a71-7bb1-498a-a518-37206483b39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:03:50.247538 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4161/8323] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:03:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:03:50.699291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ffbf2-c707-4c3f-a512-9c4deb528ab2 service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:03:50.701267 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6c3ffbf2-c707-4c3f-a512-9c4deb528ab2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:03:50.724399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ffbf2-c707-4c3f-a512-9c4deb528ab2 service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:03:50.733529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cc4a4-666c-454e-931b-fbfdd98736e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:03:50.734204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cc4a4-666c-454e-931b-fbfdd98736e3 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:03:50.734506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cc4a4-666c-454e-931b-fbfdd98736e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:03:50.737836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cc4a4-666c-454e-931b-fbfdd98736e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:03:50.742572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d04cc4a4-666c-454e-931b-fbfdd98736e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:03:50.774719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cc4a4-666c-454e-931b-fbfdd98736e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:03:50.776968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cc4a4-666c-454e-931b-fbfdd98736e3 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:03:50.801405 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4163/8324] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:03:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:04:00.233071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=25 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:04:00.519139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333367ee-daa8-4d9b-a761-bdf848fb0efc None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:04:00.519508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333367ee-daa8-4d9b-a761-bdf848fb0efc None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:04:00.519925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333367ee-daa8-4d9b-a761-bdf848fb0efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:04:00.543794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-333367ee-daa8-4d9b-a761-bdf848fb0efc None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:04:00.545014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-333367ee-daa8-4d9b-a761-bdf848fb0efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:04:00.552343 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4162/8325] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 04:04:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:04:00.565628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cc4a4-666c-454e-931b-fbfdd98736e3 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:04:00.581237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cc4a4-666c-454e-931b-fbfdd98736e3 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:04:00.586434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c515e72-485c-4cac-86e7-125288cbeb92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:04:00.587035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c515e72-485c-4cac-86e7-125288cbeb92 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:04:00.587316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c515e72-485c-4cac-86e7-125288cbeb92 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:04:00.587589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c515e72-485c-4cac-86e7-125288cbeb92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:04:00.595841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c515e72-485c-4cac-86e7-125288cbeb92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:04:00.597598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c515e72-485c-4cac-86e7-125288cbeb92 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:04:00.606840 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4164/8326] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 04:04:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 04:04:05.898890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333367ee-daa8-4d9b-a761-bdf848fb0efc None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:04:05.915034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333367ee-daa8-4d9b-a761-bdf848fb0efc None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:04:05.921207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3ba05-d2f2-4ad8-b17d-6f515f3ade8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:04:05.921971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3ba05-d2f2-4ad8-b17d-6f515f3ade8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:04:05.922521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3ba05-d2f2-4ad8-b17d-6f515f3ade8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:04:05.923813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3ba05-d2f2-4ad8-b17d-6f515f3ade8e admin admin] PATH_INFO: `/v3/users/53ab6fd880a3424693ce9c71f77ff40c` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:04:05.925432 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3ba05-d2f2-4ad8-b17d-6f515f3ade8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=53ab6fd880a3424693ce9c71f77ff40c)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:04:05.928596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3ba05-d2f2-4ad8-b17d-6f515f3ade8e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:04:06.153752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-16f3ba05-d2f2-4ad8-b17d-6f515f3ade8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53ab6fd880a3424693ce9c71f77ff40c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:04:06.154539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-16f3ba05-d2f2-4ad8-b17d-6f515f3ade8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53ab6fd880a3424693ce9c71f77ff40c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:04:06.163104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-16f3ba05-d2f2-4ad8-b17d-6f515f3ade8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53ab6fd880a3424693ce9c71f77ff40c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:04:06.181009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-16f3ba05-d2f2-4ad8-b17d-6f515f3ade8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53ab6fd880a3424693ce9c71f77ff40c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:04:06.259914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-16f3ba05-d2f2-4ad8-b17d-6f515f3ade8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53ab6fd880a3424693ce9c71f77ff40c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:04:06.273048 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4163/8327] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:04:05 2022] DELETE /identity/v3/users/53ab6fd880a3424693ce9c71f77ff40c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 04:04:06.501102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c515e72-485c-4cac-86e7-125288cbeb92 service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:04:06.521400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c515e72-485c-4cac-86e7-125288cbeb92 service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:04:06.592700 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea304689-fa77-429f-a770-eab59778abef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:04:06.593375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea304689-fa77-429f-a770-eab59778abef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:04:06.593847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea304689-fa77-429f-a770-eab59778abef admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:04:06.594462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea304689-fa77-429f-a770-eab59778abef admin admin] PATH_INFO: `/v3/projects/7839538936e24003bfb69cf2efabc29f` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:04:06.596080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea304689-fa77-429f-a770-eab59778abef admin admin] RBAC: Authorizing `identity:delete_project(project_id=7839538936e24003bfb69cf2efabc29f)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:04:06.598242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea304689-fa77-429f-a770-eab59778abef admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:04:06.689933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ea304689-fa77-429f-a770-eab59778abef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7839538936e24003bfb69cf2efabc29f', 'request_id': 'req-ea304689-fa77-429f-a770-eab59778abef'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:04:06.697161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ea304689-fa77-429f-a770-eab59778abef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7839538936e24003bfb69cf2efabc29f', 'request_id': 'req-ea304689-fa77-429f-a770-eab59778abef'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:04:06.704076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ea304689-fa77-429f-a770-eab59778abef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7839538936e24003bfb69cf2efabc29f', 'request_id': 'req-ea304689-fa77-429f-a770-eab59778abef'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:04:06.766048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ea304689-fa77-429f-a770-eab59778abef admin admin] The token cache is being invalidate because project 7839538936e24003bfb69cf2efabc29f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:04:06.766361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ea304689-fa77-429f-a770-eab59778abef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:04:06.782224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-ea304689-fa77-429f-a770-eab59778abef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:04:06.784578 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4165/8328] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:04:06 2022] DELETE /identity/v3/projects/7839538936e24003bfb69cf2efabc29f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:04:06.790435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bebce-4f74-4b59-800f-9078eb904a19 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:04:06.790841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bebce-4f74-4b59-800f-9078eb904a19 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:04:06.791226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bebce-4f74-4b59-800f-9078eb904a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:04:06.813519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f79bebce-4f74-4b59-800f-9078eb904a19 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:04:06.815235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f79bebce-4f74-4b59-800f-9078eb904a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:04:06.902446 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4164/8329] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:04:06.910966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785e21c-3b5f-42e3-8abc-66dd3a059878 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:04:06.911346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785e21c-3b5f-42e3-8abc-66dd3a059878 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:04:06.915995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785e21c-3b5f-42e3-8abc-66dd3a059878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:04:06.937377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8785e21c-3b5f-42e3-8abc-66dd3a059878 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:04:06.938773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8785e21c-3b5f-42e3-8abc-66dd3a059878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:04:06.952733 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4166/8330] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 04:04:06.954307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bebce-4f74-4b59-800f-9078eb904a19 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:04:06.964591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bebce-4f74-4b59-800f-9078eb904a19 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:04:06.969621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5095055-67b9-405b-989d-e60d72d39fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:04:06.970383 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5095055-67b9-405b-989d-e60d72d39fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:04:06.970739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5095055-67b9-405b-989d-e60d72d39fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:04:06.971022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5095055-67b9-405b-989d-e60d72d39fe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:04:06.971693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5095055-67b9-405b-989d-e60d72d39fe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:04:06.971995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5095055-67b9-405b-989d-e60d72d39fe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:04:06.973693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5095055-67b9-405b-989d-e60d72d39fe4 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:04:06.987696 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4165/8331] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:04:06.993127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785e21c-3b5f-42e3-8abc-66dd3a059878 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:04:07.003607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785e21c-3b5f-42e3-8abc-66dd3a059878 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:04:07.009054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cb3a4-539c-4c44-9d18-46bd68d73e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:04:07.009757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cb3a4-539c-4c44-9d18-46bd68d73e2b admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:04:07.010193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cb3a4-539c-4c44-9d18-46bd68d73e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:04:07.010560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cb3a4-539c-4c44-9d18-46bd68d73e2b admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:04:07.011724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6cb3a4-539c-4c44-9d18-46bd68d73e2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:04:07.026280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6cb3a4-539c-4c44-9d18-46bd68d73e2b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:04:07.124560 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4167/8332] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:04:06 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:04:07.131297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5095055-67b9-405b-989d-e60d72d39fe4 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:04:07.142873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5095055-67b9-405b-989d-e60d72d39fe4 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:04:07.216744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:04:07.229115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074a62f-86fa-42ef-b553-def98421fa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:04:07.229792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074a62f-86fa-42ef-b553-def98421fa7c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:04:07.230116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074a62f-86fa-42ef-b553-def98421fa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:04:07.230401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074a62f-86fa-42ef-b553-def98421fa7c admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:04:07.231041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074a62f-86fa-42ef-b553-def98421fa7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:04:07.233323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074a62f-86fa-42ef-b553-def98421fa7c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:04:07.317575 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4166/8333] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:04:07 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:04:07.322755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cb3a4-539c-4c44-9d18-46bd68d73e2b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:04:07.334492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cb3a4-539c-4c44-9d18-46bd68d73e2b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:04:07.339996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691557b-c9de-4896-b190-59feeb6832b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:04:07.340704 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691557b-c9de-4896-b190-59feeb6832b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:04:07.341090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691557b-c9de-4896-b190-59feeb6832b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:04:07.341461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691557b-c9de-4896-b190-59feeb6832b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:04:07.342730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691557b-c9de-4896-b190-59feeb6832b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:04:07.343954 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691557b-c9de-4896-b190-59feeb6832b6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:04:07.357794 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4168/8334] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:04:07.359714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074a62f-86fa-42ef-b553-def98421fa7c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:04:07.369794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074a62f-86fa-42ef-b553-def98421fa7c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:04:07.374597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa06de-95fe-43d3-b194-129125d08ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:04:07.375207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa06de-95fe-43d3-b194-129125d08ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:04:07.375497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa06de-95fe-43d3-b194-129125d08ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:04:07.375780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa06de-95fe-43d3-b194-129125d08ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:04:07.376974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa06de-95fe-43d3-b194-129125d08ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:04:07.379503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa06de-95fe-43d3-b194-129125d08ad6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:04:07.392330 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4167/8335] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:04:07.396250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691557b-c9de-4896-b190-59feeb6832b6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:04:07.406805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691557b-c9de-4896-b190-59feeb6832b6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:04:07.411856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e67f2-3d5b-4ab8-a29f-3be10b206dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:04:07.412518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e67f2-3d5b-4ab8-a29f-3be10b206dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:04:07.412805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e67f2-3d5b-4ab8-a29f-3be10b206dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:04:07.413086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e67f2-3d5b-4ab8-a29f-3be10b206dcd admin admin] PATH_INFO: `/v3/projects/38158a663ff04f19afebd7054ed4b2c4/users/d5f2bbf4fa7a4768ba0d395217b3397e/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:04:07.429424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e67f2-3d5b-4ab8-a29f-3be10b206dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=38158a663ff04f19afebd7054ed4b2c4, user_id=d5f2bbf4fa7a4768ba0d395217b3397e, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:04:07.432122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e67f2-3d5b-4ab8-a29f-3be10b206dcd admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:04:07.488440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:04:07.493520 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4169/8336] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:04:07 2022] PUT /identity/v3/projects/38158a663ff04f19afebd7054ed4b2c4/users/d5f2bbf4fa7a4768ba0d395217b3397e/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:04:07.504253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ec0b4-a42c-49a0-aa96-feb43a668867 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:04:07.504546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ec0b4-a42c-49a0-aa96-feb43a668867 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:04:07.504844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ec0b4-a42c-49a0-aa96-feb43a668867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:04:07.536826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ac4ec0b4-a42c-49a0-aa96-feb43a668867 None None] MFA Rules not processed for user `d5f2bbf4fa7a4768ba0d395217b3397e`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:04:07.538716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ac4ec0b4-a42c-49a0-aa96-feb43a668867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:04:07.630395 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4168/8337] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:04:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:04:07.639237 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e67f2-3d5b-4ab8-a29f-3be10b206dcd admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:04:07.641191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3c2e67f2-3d5b-4ab8-a29f-3be10b206dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:04:07.730562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e67f2-3d5b-4ab8-a29f-3be10b206dcd admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:04:07.734834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c802106-4f3e-473c-b3dc-e851fa1af1c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:04:07.735534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c802106-4f3e-473c-b3dc-e851fa1af1c3 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:04:07.735906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c802106-4f3e-473c-b3dc-e851fa1af1c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:04:07.736248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c802106-4f3e-473c-b3dc-e851fa1af1c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:04:07.750205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c802106-4f3e-473c-b3dc-e851fa1af1c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:04:07.752143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c802106-4f3e-473c-b3dc-e851fa1af1c3 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:04:07.768362 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4170/8338] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:04:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:04:10.639500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a930fc0-8ff7-49c3-b9c7-74dc711fbdca None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:04:10.639990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a930fc0-8ff7-49c3-b9c7-74dc711fbdca None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:04:10.640212 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a930fc0-8ff7-49c3-b9c7-74dc711fbdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:04:10.659376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5a930fc0-8ff7-49c3-b9c7-74dc711fbdca None None] MFA Rules not processed for user `d5f2bbf4fa7a4768ba0d395217b3397e`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:04:10.660659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5a930fc0-8ff7-49c3-b9c7-74dc711fbdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:04:10.668021 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4169/8339] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:04:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:04:17.764841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=31 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:04:20.653910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:04:35.613937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c802106-4f3e-473c-b3dc-e851fa1af1c3 service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:04:35.615746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8c802106-4f3e-473c-b3dc-e851fa1af1c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:04:35.694529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c802106-4f3e-473c-b3dc-e851fa1af1c3 service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:04:35.700697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497ca46-1524-4d44-818a-2de260bbf7d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:04:35.701381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497ca46-1524-4d44-818a-2de260bbf7d7 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:04:35.701733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497ca46-1524-4d44-818a-2de260bbf7d7 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:04:35.702097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497ca46-1524-4d44-818a-2de260bbf7d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:04:35.704162 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1497ca46-1524-4d44-818a-2de260bbf7d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:04:35.719121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497ca46-1524-4d44-818a-2de260bbf7d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:04:35.720690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497ca46-1524-4d44-818a-2de260bbf7d7 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:04:35.734597 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4171/8340] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:04:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:04:45.728425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=32 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:04:47.963993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a930fc0-8ff7-49c3-b9c7-74dc711fbdca None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:04:47.963993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5a930fc0-8ff7-49c3-b9c7-74dc711fbdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:04:47.976302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a930fc0-8ff7-49c3-b9c7-74dc711fbdca None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:04:47.981780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeebf7dc-3713-4057-b56a-fb3fdc2fe6ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:04:47.982557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebf7dc-3713-4057-b56a-fb3fdc2fe6ec service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:04:47.982917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebf7dc-3713-4057-b56a-fb3fdc2fe6ec service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:04:47.983845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebf7dc-3713-4057-b56a-fb3fdc2fe6ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:04:47.986112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-eeebf7dc-3713-4057-b56a-fb3fdc2fe6ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:04:48.001208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeebf7dc-3713-4057-b56a-fb3fdc2fe6ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:04:48.002911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeebf7dc-3713-4057-b56a-fb3fdc2fe6ec service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:04:48.016613 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4170/8341] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:04:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:04:58.014496 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:04:59.429104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a9f18-1232-4a8c-9f0e-bb845c3dceaa None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:04:59.431612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a9f18-1232-4a8c-9f0e-bb845c3dceaa None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:04:59.431612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a9f18-1232-4a8c-9f0e-bb845c3dceaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:04:59.450755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-716a9f18-1232-4a8c-9f0e-bb845c3dceaa None None] MFA Rules not processed for user `98bf808aeff6462794e5d6c653c72ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:04:59.452112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-716a9f18-1232-4a8c-9f0e-bb845c3dceaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:04:59.518202 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4172/8342] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:04:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:05:09.507530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=25 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:05:09.995718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeebf7dc-3713-4057-b56a-fb3fdc2fe6ec service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:05:09.997261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-eeebf7dc-3713-4057-b56a-fb3fdc2fe6ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:05:10.112726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeebf7dc-3713-4057-b56a-fb3fdc2fe6ec service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:05:10.118227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e08ddd-3007-43dd-b16b-7ba335d02f40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:05:10.118874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e08ddd-3007-43dd-b16b-7ba335d02f40 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:05:10.119131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e08ddd-3007-43dd-b16b-7ba335d02f40 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:05:10.119409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e08ddd-3007-43dd-b16b-7ba335d02f40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:05:10.128098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e08ddd-3007-43dd-b16b-7ba335d02f40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:05:10.129907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e08ddd-3007-43dd-b16b-7ba335d02f40 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:05:10.138813 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4171/8343] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 04:05:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 04:05:20.135343 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=41 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:05:25.384638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4fb6b-045a-4566-8109-cf040880291c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:05:25.385193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4fb6b-045a-4566-8109-cf040880291c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:05:25.385317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4fb6b-045a-4566-8109-cf040880291c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:05:25.405752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b9a4fb6b-045a-4566-8109-cf040880291c None None] MFA Rules not processed for user `aac6c0276fa842738263e8aed290bf19`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:05:25.407016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b9a4fb6b-045a-4566-8109-cf040880291c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:05:25.462550 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4173/8344] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:05:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 04:05:30.630959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e08ddd-3007-43dd-b16b-7ba335d02f40 service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:05:30.633270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-75e08ddd-3007-43dd-b16b-7ba335d02f40 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:05:30.732402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e08ddd-3007-43dd-b16b-7ba335d02f40 service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:05:30.738012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57059b3e-60c7-4afc-8640-6c79cc1e1327 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:05:30.738649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57059b3e-60c7-4afc-8640-6c79cc1e1327 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:05:30.738935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57059b3e-60c7-4afc-8640-6c79cc1e1327 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:05:30.739213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57059b3e-60c7-4afc-8640-6c79cc1e1327 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:05:30.740938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-57059b3e-60c7-4afc-8640-6c79cc1e1327 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:05:30.757348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57059b3e-60c7-4afc-8640-6c79cc1e1327 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:05:30.759110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57059b3e-60c7-4afc-8640-6c79cc1e1327 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:05:30.774388 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4172/8345] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:05:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:05:34.365710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4fb6b-045a-4566-8109-cf040880291c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:05:34.393179 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4fb6b-045a-4566-8109-cf040880291c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:05:34.399220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1df50f-9cde-4328-a8ad-e34b8b808654 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:05:34.400645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1df50f-9cde-4328-a8ad-e34b8b808654 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:05:34.400645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1df50f-9cde-4328-a8ad-e34b8b808654 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:05:34.400645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1df50f-9cde-4328-a8ad-e34b8b808654 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:05:34.402208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8c1df50f-9cde-4328-a8ad-e34b8b808654 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:05:34.417006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1df50f-9cde-4328-a8ad-e34b8b808654 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:05:34.418793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1df50f-9cde-4328-a8ad-e34b8b808654 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:05:34.431784 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4174/8346] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:05:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:05:40.766350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=34 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:05:44.425248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=31 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:05:48.224737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57059b3e-60c7-4afc-8640-6c79cc1e1327 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:05:48.226282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-57059b3e-60c7-4afc-8640-6c79cc1e1327 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:05:48.285436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57059b3e-60c7-4afc-8640-6c79cc1e1327 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:05:48.289167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16276f9-4fb5-4edd-bb3e-6763a9f6bea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:05:48.289775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16276f9-4fb5-4edd-bb3e-6763a9f6bea5 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:05:48.290084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16276f9-4fb5-4edd-bb3e-6763a9f6bea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:05:48.290364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16276f9-4fb5-4edd-bb3e-6763a9f6bea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:05:48.292127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d16276f9-4fb5-4edd-bb3e-6763a9f6bea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:05:48.356282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16276f9-4fb5-4edd-bb3e-6763a9f6bea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:05:48.357733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16276f9-4fb5-4edd-bb3e-6763a9f6bea5 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:05:48.368749 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4173/8347] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:05:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:05:58.363115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=50 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:06:01.854825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1df50f-9cde-4328-a8ad-e34b8b808654 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:01.856834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8c1df50f-9cde-4328-a8ad-e34b8b808654 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:06:01.965952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1df50f-9cde-4328-a8ad-e34b8b808654 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:01.970942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa7f0c-a7a3-4dd7-bf6a-57fa24add661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:01.971579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa7f0c-a7a3-4dd7-bf6a-57fa24add661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:01.971867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa7f0c-a7a3-4dd7-bf6a-57fa24add661 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:01.972141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa7f0c-a7a3-4dd7-bf6a-57fa24add661 admin admin] PATH_INFO: `/v3/users/98bf808aeff6462794e5d6c653c72ae2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:01.973310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa7f0c-a7a3-4dd7-bf6a-57fa24add661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98bf808aeff6462794e5d6c653c72ae2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:01.975281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa7f0c-a7a3-4dd7-bf6a-57fa24add661 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:02.113973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-88aa7f0c-a7a3-4dd7-bf6a-57fa24add661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98bf808aeff6462794e5d6c653c72ae2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:02.114955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-88aa7f0c-a7a3-4dd7-bf6a-57fa24add661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98bf808aeff6462794e5d6c653c72ae2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:02.124072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-88aa7f0c-a7a3-4dd7-bf6a-57fa24add661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98bf808aeff6462794e5d6c653c72ae2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:02.139580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-88aa7f0c-a7a3-4dd7-bf6a-57fa24add661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98bf808aeff6462794e5d6c653c72ae2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:02.140389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-88aa7f0c-a7a3-4dd7-bf6a-57fa24add661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98bf808aeff6462794e5d6c653c72ae2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:02.191637 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4175/8348] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:06:01 2022] DELETE /identity/v3/users/98bf808aeff6462794e5d6c653c72ae2 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:06:02.214157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8d4b2-d9b0-4bef-9fec-14bcaa6cc8b3 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:02.214157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8d4b2-d9b0-4bef-9fec-14bcaa6cc8b3 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:02.214157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8d4b2-d9b0-4bef-9fec-14bcaa6cc8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:02.242590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-edc8d4b2-d9b0-4bef-9fec-14bcaa6cc8b3 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:06:02.243798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-edc8d4b2-d9b0-4bef-9fec-14bcaa6cc8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:06:02.304803 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4174/8349] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:06:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:06:02.314585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa7f0c-a7a3-4dd7-bf6a-57fa24add661 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:02.316061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-88aa7f0c-a7a3-4dd7-bf6a-57fa24add661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:06:02.371338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:06:02.396663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa7f0c-a7a3-4dd7-bf6a-57fa24add661 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:02.405282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495bdc5-d2ed-4d14-a3ce-246d98c1df89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:02.405282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495bdc5-d2ed-4d14-a3ce-246d98c1df89 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:02.405282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495bdc5-d2ed-4d14-a3ce-246d98c1df89 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:02.405282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495bdc5-d2ed-4d14-a3ce-246d98c1df89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:02.413128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495bdc5-d2ed-4d14-a3ce-246d98c1df89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:02.414649 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495bdc5-d2ed-4d14-a3ce-246d98c1df89 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:02.425340 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4176/8350] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:06:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:06:02.638730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8d4b2-d9b0-4bef-9fec-14bcaa6cc8b3 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:02.641258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-edc8d4b2-d9b0-4bef-9fec-14bcaa6cc8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:06:02.657468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8d4b2-d9b0-4bef-9fec-14bcaa6cc8b3 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:02.663528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7acd3b-1ecb-49f7-a3d7-9252302ef7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:02.665784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7acd3b-1ecb-49f7-a3d7-9252302ef7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:02.665784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7acd3b-1ecb-49f7-a3d7-9252302ef7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:02.665784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7acd3b-1ecb-49f7-a3d7-9252302ef7f9 admin admin] PATH_INFO: `/v3/projects/9c921299382141f99cd9c4b6b11927a4` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:02.667209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7acd3b-1ecb-49f7-a3d7-9252302ef7f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c921299382141f99cd9c4b6b11927a4)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:02.670476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7acd3b-1ecb-49f7-a3d7-9252302ef7f9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:02.786642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-eb7acd3b-1ecb-49f7-a3d7-9252302ef7f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c921299382141f99cd9c4b6b11927a4', 'request_id': 'req-eb7acd3b-1ecb-49f7-a3d7-9252302ef7f9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:02.851930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-eb7acd3b-1ecb-49f7-a3d7-9252302ef7f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c921299382141f99cd9c4b6b11927a4', 'request_id': 'req-eb7acd3b-1ecb-49f7-a3d7-9252302ef7f9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:02.859659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-eb7acd3b-1ecb-49f7-a3d7-9252302ef7f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c921299382141f99cd9c4b6b11927a4', 'request_id': 'req-eb7acd3b-1ecb-49f7-a3d7-9252302ef7f9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:02.871074 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-eb7acd3b-1ecb-49f7-a3d7-9252302ef7f9 admin admin] The token cache is being invalidate because project 9c921299382141f99cd9c4b6b11927a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:06:02.871369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-eb7acd3b-1ecb-49f7-a3d7-9252302ef7f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:02.872084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-eb7acd3b-1ecb-49f7-a3d7-9252302ef7f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:02.874521 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4175/8351] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:06:02 2022] DELETE /identity/v3/projects/9c921299382141f99cd9c4b6b11927a4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:06:02.878583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495bdc5-d2ed-4d14-a3ce-246d98c1df89 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:02.888456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495bdc5-d2ed-4d14-a3ce-246d98c1df89 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:02.947757 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555f390-ec39-449a-b90d-dc5a8cb2bf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:02.948287 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555f390-ec39-449a-b90d-dc5a8cb2bf60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:02.948573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555f390-ec39-449a-b90d-dc5a8cb2bf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:02.948847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555f390-ec39-449a-b90d-dc5a8cb2bf60 admin admin] PATH_INFO: `/v3/users/673c26c30479431ea9eb491ca6e012e8` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:02.949966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555f390-ec39-449a-b90d-dc5a8cb2bf60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=673c26c30479431ea9eb491ca6e012e8)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:02.952436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555f390-ec39-449a-b90d-dc5a8cb2bf60 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:03.088883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e555f390-ec39-449a-b90d-dc5a8cb2bf60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '673c26c30479431ea9eb491ca6e012e8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:03.089549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e555f390-ec39-449a-b90d-dc5a8cb2bf60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '673c26c30479431ea9eb491ca6e012e8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:03.097614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e555f390-ec39-449a-b90d-dc5a8cb2bf60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '673c26c30479431ea9eb491ca6e012e8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:03.110886 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e555f390-ec39-449a-b90d-dc5a8cb2bf60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '673c26c30479431ea9eb491ca6e012e8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:03.111637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e555f390-ec39-449a-b90d-dc5a8cb2bf60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '673c26c30479431ea9eb491ca6e012e8'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:03.155395 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4177/8352] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:06:02 2022] DELETE /identity/v3/users/673c26c30479431ea9eb491ca6e012e8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:06:03.551020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7acd3b-1ecb-49f7-a3d7-9252302ef7f9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:03.561270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-eb7acd3b-1ecb-49f7-a3d7-9252302ef7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:06:03.570357 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7acd3b-1ecb-49f7-a3d7-9252302ef7f9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:03.629321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03b477-2647-4b9a-b8e0-ad2c9edbf082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:03.630151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03b477-2647-4b9a-b8e0-ad2c9edbf082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:03.630433 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03b477-2647-4b9a-b8e0-ad2c9edbf082 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:03.630706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03b477-2647-4b9a-b8e0-ad2c9edbf082 admin admin] PATH_INFO: `/v3/projects/39f652af44514be68d0f5099c49d4665` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:03.631933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03b477-2647-4b9a-b8e0-ad2c9edbf082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39f652af44514be68d0f5099c49d4665)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:03.633870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03b477-2647-4b9a-b8e0-ad2c9edbf082 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:03.641377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:06:03.732860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ef03b477-2647-4b9a-b8e0-ad2c9edbf082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39f652af44514be68d0f5099c49d4665', 'request_id': 'req-ef03b477-2647-4b9a-b8e0-ad2c9edbf082'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:03.789213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ef03b477-2647-4b9a-b8e0-ad2c9edbf082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39f652af44514be68d0f5099c49d4665', 'request_id': 'req-ef03b477-2647-4b9a-b8e0-ad2c9edbf082'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:03.796529 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ef03b477-2647-4b9a-b8e0-ad2c9edbf082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39f652af44514be68d0f5099c49d4665', 'request_id': 'req-ef03b477-2647-4b9a-b8e0-ad2c9edbf082'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:03.810382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ef03b477-2647-4b9a-b8e0-ad2c9edbf082 admin admin] The token cache is being invalidate because project 39f652af44514be68d0f5099c49d4665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:06:03.810730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ef03b477-2647-4b9a-b8e0-ad2c9edbf082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:03.811366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-ef03b477-2647-4b9a-b8e0-ad2c9edbf082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:03.812861 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4176/8353] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:06:03 2022] DELETE /identity/v3/projects/39f652af44514be68d0f5099c49d4665 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:06:03.819232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73121f70-45fc-4432-98b0-1caa5ca44fe9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:03.819612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73121f70-45fc-4432-98b0-1caa5ca44fe9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:03.819920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73121f70-45fc-4432-98b0-1caa5ca44fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:03.841333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-73121f70-45fc-4432-98b0-1caa5ca44fe9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:06:03.843323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-73121f70-45fc-4432-98b0-1caa5ca44fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:06:03.893249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:06:03.905296 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4178/8354] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:06:03.913841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b84ce-b7cf-46ba-ab18-cf2d94bfb8f7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:03.914175 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b84ce-b7cf-46ba-ab18-cf2d94bfb8f7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:03.914474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b84ce-b7cf-46ba-ab18-cf2d94bfb8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:03.934844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-bd8b84ce-b7cf-46ba-ab18-cf2d94bfb8f7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:06:03.936686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bd8b84ce-b7cf-46ba-ab18-cf2d94bfb8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:06:03.944843 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4177/8355] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:06:03.949579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73121f70-45fc-4432-98b0-1caa5ca44fe9 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:03.959966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73121f70-45fc-4432-98b0-1caa5ca44fe9 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:03.965505 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f31b37-8e34-415d-93b8-cbbbcaa46a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:03.965899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f31b37-8e34-415d-93b8-cbbbcaa46a97 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:03.966168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f31b37-8e34-415d-93b8-cbbbcaa46a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:03.966432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f31b37-8e34-415d-93b8-cbbbcaa46a97 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:03.967132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f31b37-8e34-415d-93b8-cbbbcaa46a97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:06:03.967536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f31b37-8e34-415d-93b8-cbbbcaa46a97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:03.969046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f31b37-8e34-415d-93b8-cbbbcaa46a97 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:03.984833 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4179/8356] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:06:03.985928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b84ce-b7cf-46ba-ab18-cf2d94bfb8f7 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:03.996744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b84ce-b7cf-46ba-ab18-cf2d94bfb8f7 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:04.002307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cd0da-363e-44ba-a18d-6791ab413ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:04.002956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cd0da-363e-44ba-a18d-6791ab413ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:04.008639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cd0da-363e-44ba-a18d-6791ab413ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:04.008639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cd0da-363e-44ba-a18d-6791ab413ce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:04.008639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cd0da-363e-44ba-a18d-6791ab413ce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:04.008639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cd0da-363e-44ba-a18d-6791ab413ce2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:04.110900 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4178/8357] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:06:03 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:06:04.115304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f31b37-8e34-415d-93b8-cbbbcaa46a97 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:04.130154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f31b37-8e34-415d-93b8-cbbbcaa46a97 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:04.185206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e491e56-b5c8-4db5-ac96-ed7199469d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:04.186377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e491e56-b5c8-4db5-ac96-ed7199469d50 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:04.186663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e491e56-b5c8-4db5-ac96-ed7199469d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:04.186939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e491e56-b5c8-4db5-ac96-ed7199469d50 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:04.187576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e491e56-b5c8-4db5-ac96-ed7199469d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:04.189978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e491e56-b5c8-4db5-ac96-ed7199469d50 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:04.258725 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4180/8358] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:06:04 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:06:04.262719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cd0da-363e-44ba-a18d-6791ab413ce2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:04.275138 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cd0da-363e-44ba-a18d-6791ab413ce2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:04.280257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965ca8f-3454-45db-bcb9-0681727555da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:04.280962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965ca8f-3454-45db-bcb9-0681727555da admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:04.281351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965ca8f-3454-45db-bcb9-0681727555da admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:04.281620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965ca8f-3454-45db-bcb9-0681727555da admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:04.282318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965ca8f-3454-45db-bcb9-0681727555da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:04.283945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965ca8f-3454-45db-bcb9-0681727555da admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:04.294431 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4179/8359] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:06:04.299081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e491e56-b5c8-4db5-ac96-ed7199469d50 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:04.309300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e491e56-b5c8-4db5-ac96-ed7199469d50 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:04.314476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985fe93-f7d7-4a99-a10d-a890c29bfd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:04.315068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985fe93-f7d7-4a99-a10d-a890c29bfd6b admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:04.315353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985fe93-f7d7-4a99-a10d-a890c29bfd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:04.315627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985fe93-f7d7-4a99-a10d-a890c29bfd6b admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:04.316293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985fe93-f7d7-4a99-a10d-a890c29bfd6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:04.317881 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985fe93-f7d7-4a99-a10d-a890c29bfd6b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:04.330177 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4181/8360] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:06:04.334104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965ca8f-3454-45db-bcb9-0681727555da admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:04.345000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965ca8f-3454-45db-bcb9-0681727555da admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:04.349719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae51537-7c63-473b-a273-13421ecebfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:04.350411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae51537-7c63-473b-a273-13421ecebfe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:04.351142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae51537-7c63-473b-a273-13421ecebfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:04.351142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae51537-7c63-473b-a273-13421ecebfe1 admin admin] PATH_INFO: `/v3/projects/6a6a4f0161c94dc19682d70af00ba684/users/b7f5c179e8844542bca46d76042a6897/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:04.366615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae51537-7c63-473b-a273-13421ecebfe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a6a4f0161c94dc19682d70af00ba684, user_id=b7f5c179e8844542bca46d76042a6897, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:04.369418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae51537-7c63-473b-a273-13421ecebfe1 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:04.418773 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4180/8361] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:06:04 2022] PUT /identity/v3/projects/6a6a4f0161c94dc19682d70af00ba684/users/b7f5c179e8844542bca46d76042a6897/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:06:04.424772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d0d26-846c-40a2-a2bb-8e45f6f6545d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:04.425165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d0d26-846c-40a2-a2bb-8e45f6f6545d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:04.425445 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d0d26-846c-40a2-a2bb-8e45f6f6545d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:04.446008 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0a9d0d26-846c-40a2-a2bb-8e45f6f6545d None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:06:04.447552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0a9d0d26-846c-40a2-a2bb-8e45f6f6545d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:06:04.513029 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4182/8362] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:06:04.523549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae51537-7c63-473b-a273-13421ecebfe1 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:04.525733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bae51537-7c63-473b-a273-13421ecebfe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:06:04.587928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae51537-7c63-473b-a273-13421ecebfe1 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:04.592674 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f2003-a6cf-4ef0-af57-934694f1977a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:04.593218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f2003-a6cf-4ef0-af57-934694f1977a service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:04.593508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f2003-a6cf-4ef0-af57-934694f1977a service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:04.593788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f2003-a6cf-4ef0-af57-934694f1977a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:04.603976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f2003-a6cf-4ef0-af57-934694f1977a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:04.605515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f2003-a6cf-4ef0-af57-934694f1977a service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:04.616301 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4181/8363] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:06:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:06:10.489228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0f484-e1b9-4a86-b11f-8068f583fcb9 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:10.489758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0f484-e1b9-4a86-b11f-8068f583fcb9 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:10.490108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0f484-e1b9-4a86-b11f-8068f583fcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:10.533430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-40f0f484-e1b9-4a86-b11f-8068f583fcb9 None None] MFA Rules not processed for user `b7f5c179e8844542bca46d76042a6897`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:06:10.544887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-40f0f484-e1b9-4a86-b11f-8068f583fcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:06:10.627532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:06:10.649713 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4183/8364] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:06:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:06:10.654328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f2003-a6cf-4ef0-af57-934694f1977a service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:10.668379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f2003-a6cf-4ef0-af57-934694f1977a service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:10.675304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb770c6-8670-4231-9102-d77fa47853df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:10.676081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb770c6-8670-4231-9102-d77fa47853df admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:10.676370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb770c6-8670-4231-9102-d77fa47853df admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:10.676703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb770c6-8670-4231-9102-d77fa47853df admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:10.677599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb770c6-8670-4231-9102-d77fa47853df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:10.679876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb770c6-8670-4231-9102-d77fa47853df admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:10.787656 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4182/8365] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:06:10 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:06:10.791849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0f484-e1b9-4a86-b11f-8068f583fcb9 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:10.804367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0f484-e1b9-4a86-b11f-8068f583fcb9 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:10.869576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69744b91-6292-40ba-b05f-37d048eefbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:10.870275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69744b91-6292-40ba-b05f-37d048eefbd5 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:10.870567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69744b91-6292-40ba-b05f-37d048eefbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:10.870850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69744b91-6292-40ba-b05f-37d048eefbd5 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:10.871493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69744b91-6292-40ba-b05f-37d048eefbd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:10.874368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69744b91-6292-40ba-b05f-37d048eefbd5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:10.974075 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4184/8366] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:06:10 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:06:10.978520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb770c6-8670-4231-9102-d77fa47853df admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:10.985329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:06:10.991679 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb770c6-8670-4231-9102-d77fa47853df admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:10.999210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d07a8-5a18-4a6c-90cb-e1bd7b1b2ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:11.000222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d07a8-5a18-4a6c-90cb-e1bd7b1b2ebc admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:11.005382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d07a8-5a18-4a6c-90cb-e1bd7b1b2ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:11.005382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d07a8-5a18-4a6c-90cb-e1bd7b1b2ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:11.005382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d07a8-5a18-4a6c-90cb-e1bd7b1b2ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:11.005382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d07a8-5a18-4a6c-90cb-e1bd7b1b2ebc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:11.018853 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4183/8367] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:06:11.023370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69744b91-6292-40ba-b05f-37d048eefbd5 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:11.035468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69744b91-6292-40ba-b05f-37d048eefbd5 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:11.042970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f1f94-c64b-4675-a28f-0ffdc7ccc34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:11.043698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f1f94-c64b-4675-a28f-0ffdc7ccc34b admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:11.044048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f1f94-c64b-4675-a28f-0ffdc7ccc34b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:11.044381 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f1f94-c64b-4675-a28f-0ffdc7ccc34b admin admin] PATH_INFO: `/v3/projects/548e43ec95994363bbb8b5414163fdf5/users/22572738a0be4134b770efc0568ac6c1/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:11.067303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f1f94-c64b-4675-a28f-0ffdc7ccc34b admin admin] RBAC: Authorizing `identity:create_grant(project_id=548e43ec95994363bbb8b5414163fdf5, user_id=22572738a0be4134b770efc0568ac6c1, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:11.070235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f1f94-c64b-4675-a28f-0ffdc7ccc34b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:11.168627 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4185/8368] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:06:11 2022] PUT /identity/v3/projects/548e43ec95994363bbb8b5414163fdf5/users/22572738a0be4134b770efc0568ac6c1/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:06:11.173177 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d07a8-5a18-4a6c-90cb-e1bd7b1b2ebc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:11.185142 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d07a8-5a18-4a6c-90cb-e1bd7b1b2ebc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:11.246188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c16c2-c2b1-4863-93da-daa8bcfb7e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:11.246742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c16c2-c2b1-4863-93da-daa8bcfb7e0b admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:11.247094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c16c2-c2b1-4863-93da-daa8bcfb7e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:11.247290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c16c2-c2b1-4863-93da-daa8bcfb7e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:11.247948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c16c2-c2b1-4863-93da-daa8bcfb7e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:11.250250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c16c2-c2b1-4863-93da-daa8bcfb7e0b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:11.260476 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4184/8369] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:06:11.264725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f1f94-c64b-4675-a28f-0ffdc7ccc34b admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:11.277117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f1f94-c64b-4675-a28f-0ffdc7ccc34b admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:11.282569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246c27a-33a8-4663-8367-ed1671dc3c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:11.283254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246c27a-33a8-4663-8367-ed1671dc3c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:11.283538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246c27a-33a8-4663-8367-ed1671dc3c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:11.283810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246c27a-33a8-4663-8367-ed1671dc3c80 admin admin] PATH_INFO: `/v3/projects/548e43ec95994363bbb8b5414163fdf5/users/22572738a0be4134b770efc0568ac6c1/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:11.285832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246c27a-33a8-4663-8367-ed1671dc3c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=548e43ec95994363bbb8b5414163fdf5, user_id=22572738a0be4134b770efc0568ac6c1, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:11.288754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246c27a-33a8-4663-8367-ed1671dc3c80 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:11.301506 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4186/8370] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:06:11 2022] PUT /identity/v3/projects/548e43ec95994363bbb8b5414163fdf5/users/22572738a0be4134b770efc0568ac6c1/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:06:17.689286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1c9df-c88f-4cb2-ab3f-fbab32465062 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:17.689816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1c9df-c88f-4cb2-ab3f-fbab32465062 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:17.690085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1c9df-c88f-4cb2-ab3f-fbab32465062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:17.729145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-47a1c9df-c88f-4cb2-ab3f-fbab32465062 None None] MFA Rules not processed for user `22572738a0be4134b770efc0568ac6c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:06:17.731271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-47a1c9df-c88f-4cb2-ab3f-fbab32465062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:06:17.824541 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4185/8371] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:06:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:06:17.838156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246c27a-33a8-4663-8367-ed1671dc3c80 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:17.839943 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7246c27a-33a8-4663-8367-ed1671dc3c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:06:17.917521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246c27a-33a8-4663-8367-ed1671dc3c80 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:17.923870 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a99a74-718e-4535-b62d-7ce0e81de4e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:17.924601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a99a74-718e-4535-b62d-7ce0e81de4e5 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:17.925612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a99a74-718e-4535-b62d-7ce0e81de4e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:17.925612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a99a74-718e-4535-b62d-7ce0e81de4e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:17.937322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a99a74-718e-4535-b62d-7ce0e81de4e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:17.939019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a99a74-718e-4535-b62d-7ce0e81de4e5 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:17.950125 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4187/8372] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:06:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:06:18.256203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1c9df-c88f-4cb2-ab3f-fbab32465062 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:18.269735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1c9df-c88f-4cb2-ab3f-fbab32465062 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:18.273475 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1075dda-938d-4e0c-8b7d-e5fe6e5afab2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:18.274150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1075dda-938d-4e0c-8b7d-e5fe6e5afab2 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:18.274436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1075dda-938d-4e0c-8b7d-e5fe6e5afab2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:18.274714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1075dda-938d-4e0c-8b7d-e5fe6e5afab2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:18.339736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1075dda-938d-4e0c-8b7d-e5fe6e5afab2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:18.341296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1075dda-938d-4e0c-8b7d-e5fe6e5afab2 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:18.352639 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4186/8373] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:06:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:06:21.368128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d61b86-d3f1-45c8-987a-ced65ba01e9f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:21.368711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d61b86-d3f1-45c8-987a-ced65ba01e9f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:21.368711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d61b86-d3f1-45c8-987a-ced65ba01e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:21.389655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-84d61b86-d3f1-45c8-987a-ced65ba01e9f None None] MFA Rules not processed for user `b7f5c179e8844542bca46d76042a6897`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:06:21.390939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-84d61b86-d3f1-45c8-987a-ced65ba01e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:06:21.400574 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4188/8374] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:06:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:06:28.347898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:06:31.384095 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=78,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:06:41.591253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1075dda-938d-4e0c-8b7d-e5fe6e5afab2 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:41.592597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c1075dda-938d-4e0c-8b7d-e5fe6e5afab2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:06:41.669018 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1075dda-938d-4e0c-8b7d-e5fe6e5afab2 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:41.675048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c30571-df7e-4fa4-a92f-3d6d3085a8b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:41.675717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c30571-df7e-4fa4-a92f-3d6d3085a8b2 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:41.676003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c30571-df7e-4fa4-a92f-3d6d3085a8b2 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:41.676281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c30571-df7e-4fa4-a92f-3d6d3085a8b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:41.678026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-63c30571-df7e-4fa4-a92f-3d6d3085a8b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:06:41.744170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c30571-df7e-4fa4-a92f-3d6d3085a8b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:41.746004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c30571-df7e-4fa4-a92f-3d6d3085a8b2 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:41.759668 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4187/8375] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:06:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:06:47.912919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d61b86-d3f1-45c8-987a-ced65ba01e9f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:47.915208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-84d61b86-d3f1-45c8-987a-ced65ba01e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:06:47.990589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d61b86-d3f1-45c8-987a-ced65ba01e9f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:47.994210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de088fa-d847-487a-b12d-7e153caad994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:47.994830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de088fa-d847-487a-b12d-7e153caad994 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:47.995131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de088fa-d847-487a-b12d-7e153caad994 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:47.995440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de088fa-d847-487a-b12d-7e153caad994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:47.997175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4de088fa-d847-487a-b12d-7e153caad994 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:06:48.062271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de088fa-d847-487a-b12d-7e153caad994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:48.063754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de088fa-d847-487a-b12d-7e153caad994 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:48.074752 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4189/8376] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:06:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:06:51.498935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c30571-df7e-4fa4-a92f-3d6d3085a8b2 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:51.513720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c30571-df7e-4fa4-a92f-3d6d3085a8b2 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:51.517849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7cc95-d498-4fd4-9f5f-5affbebc7785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:51.518569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7cc95-d498-4fd4-9f5f-5affbebc7785 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:51.518851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7cc95-d498-4fd4-9f5f-5affbebc7785 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:51.519193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7cc95-d498-4fd4-9f5f-5affbebc7785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:51.521192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-71e7cc95-d498-4fd4-9f5f-5affbebc7785 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:06:51.539605 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7cc95-d498-4fd4-9f5f-5affbebc7785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:51.541302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7cc95-d498-4fd4-9f5f-5affbebc7785 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:51.560993 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4188/8377] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:06:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:06:52.776035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de088fa-d847-487a-b12d-7e153caad994 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:52.781271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4de088fa-d847-487a-b12d-7e153caad994 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:06:52.876572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de088fa-d847-487a-b12d-7e153caad994 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:52.884996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c24ca9-38cf-40fe-80f2-cdf7487152a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:52.885718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c24ca9-38cf-40fe-80f2-cdf7487152a4 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:52.886127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c24ca9-38cf-40fe-80f2-cdf7487152a4 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:52.886549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c24ca9-38cf-40fe-80f2-cdf7487152a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:52.889045 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d8c24ca9-38cf-40fe-80f2-cdf7487152a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:06:52.906211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c24ca9-38cf-40fe-80f2-cdf7487152a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:52.908358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c24ca9-38cf-40fe-80f2-cdf7487152a4 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:52.926483 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4190/8378] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:06:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:06:57.540426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7cc95-d498-4fd4-9f5f-5affbebc7785 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:57.542539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-71e7cc95-d498-4fd4-9f5f-5affbebc7785 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:06:57.561890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7cc95-d498-4fd4-9f5f-5affbebc7785 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:57.567950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08415947-cfcf-4f4d-bebe-cba92e75afbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:57.568828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08415947-cfcf-4f4d-bebe-cba92e75afbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:57.569274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08415947-cfcf-4f4d-bebe-cba92e75afbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:57.569720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08415947-cfcf-4f4d-bebe-cba92e75afbd admin admin] PATH_INFO: `/v3/users/25ee3a8fd93c4ad8b83c7e4ef94f4c8a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:57.571108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08415947-cfcf-4f4d-bebe-cba92e75afbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=25ee3a8fd93c4ad8b83c7e4ef94f4c8a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:57.573205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08415947-cfcf-4f4d-bebe-cba92e75afbd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:57.774332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-08415947-cfcf-4f4d-bebe-cba92e75afbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25ee3a8fd93c4ad8b83c7e4ef94f4c8a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:57.775162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-08415947-cfcf-4f4d-bebe-cba92e75afbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25ee3a8fd93c4ad8b83c7e4ef94f4c8a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:57.783821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-08415947-cfcf-4f4d-bebe-cba92e75afbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25ee3a8fd93c4ad8b83c7e4ef94f4c8a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:57.796587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-08415947-cfcf-4f4d-bebe-cba92e75afbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25ee3a8fd93c4ad8b83c7e4ef94f4c8a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:57.800880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:06:57.881984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-08415947-cfcf-4f4d-bebe-cba92e75afbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25ee3a8fd93c4ad8b83c7e4ef94f4c8a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:57.895319 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4189/8379] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:06:57 2022] DELETE /identity/v3/users/25ee3a8fd93c4ad8b83c7e4ef94f4c8a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:06:58.221497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c24ca9-38cf-40fe-80f2-cdf7487152a4 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:58.236042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c24ca9-38cf-40fe-80f2-cdf7487152a4 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:58.291243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:06:58.338728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f981f4-b10a-424f-80a0-535c89c0b9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:58.339386 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f981f4-b10a-424f-80a0-535c89c0b9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:58.339843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f981f4-b10a-424f-80a0-535c89c0b9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:58.340195 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f981f4-b10a-424f-80a0-535c89c0b9bf admin admin] PATH_INFO: `/v3/projects/586d194e60ee461197b124db7501f8be` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:58.341473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f981f4-b10a-424f-80a0-535c89c0b9bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=586d194e60ee461197b124db7501f8be)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:58.343829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f981f4-b10a-424f-80a0-535c89c0b9bf admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:58.505417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d7f981f4-b10a-424f-80a0-535c89c0b9bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '586d194e60ee461197b124db7501f8be', 'request_id': 'req-d7f981f4-b10a-424f-80a0-535c89c0b9bf'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:58.513137 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d7f981f4-b10a-424f-80a0-535c89c0b9bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '586d194e60ee461197b124db7501f8be', 'request_id': 'req-d7f981f4-b10a-424f-80a0-535c89c0b9bf'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:58.521244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d7f981f4-b10a-424f-80a0-535c89c0b9bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '586d194e60ee461197b124db7501f8be', 'request_id': 'req-d7f981f4-b10a-424f-80a0-535c89c0b9bf'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:58.693417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d7f981f4-b10a-424f-80a0-535c89c0b9bf admin admin] The token cache is being invalidate because project 586d194e60ee461197b124db7501f8be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:06:58.694082 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d7f981f4-b10a-424f-80a0-535c89c0b9bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:58.694978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d7f981f4-b10a-424f-80a0-535c89c0b9bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:58.700389 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4191/8380] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:06:58 2022] DELETE /identity/v3/projects/586d194e60ee461197b124db7501f8be => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:06:58.701448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08415947-cfcf-4f4d-bebe-cba92e75afbd admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:58.703768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-08415947-cfcf-4f4d-bebe-cba92e75afbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:06:58.720387 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08415947-cfcf-4f4d-bebe-cba92e75afbd admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:58.802627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642edc1-0386-4e67-8289-ca45ff0527dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:58.805272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642edc1-0386-4e67-8289-ca45ff0527dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:58.805272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642edc1-0386-4e67-8289-ca45ff0527dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:58.805272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642edc1-0386-4e67-8289-ca45ff0527dc admin admin] PATH_INFO: `/v3/users/07ef57355bce4ed0947082bee47d2695` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:58.806136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642edc1-0386-4e67-8289-ca45ff0527dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=07ef57355bce4ed0947082bee47d2695)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:58.808580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642edc1-0386-4e67-8289-ca45ff0527dc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:59.024190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e642edc1-0386-4e67-8289-ca45ff0527dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07ef57355bce4ed0947082bee47d2695'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:59.031091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e642edc1-0386-4e67-8289-ca45ff0527dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07ef57355bce4ed0947082bee47d2695'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:59.036582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e642edc1-0386-4e67-8289-ca45ff0527dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07ef57355bce4ed0947082bee47d2695'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:59.074726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e642edc1-0386-4e67-8289-ca45ff0527dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07ef57355bce4ed0947082bee47d2695'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:59.198473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e642edc1-0386-4e67-8289-ca45ff0527dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07ef57355bce4ed0947082bee47d2695'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:59.210109 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4190/8381] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:06:58 2022] DELETE /identity/v3/users/07ef57355bce4ed0947082bee47d2695 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:06:59.666882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f981f4-b10a-424f-80a0-535c89c0b9bf admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:06:59.668494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d7f981f4-b10a-424f-80a0-535c89c0b9bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:06:59.683459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f981f4-b10a-424f-80a0-535c89c0b9bf admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:06:59.778770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17888ce-45b0-4076-b117-11e84a933d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:06:59.779601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17888ce-45b0-4076-b117-11e84a933d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:06:59.780860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17888ce-45b0-4076-b117-11e84a933d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:06:59.781265 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17888ce-45b0-4076-b117-11e84a933d8b admin admin] PATH_INFO: `/v3/projects/446d0c74e9ee4030882e4f3f675fdc2f` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:06:59.782937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17888ce-45b0-4076-b117-11e84a933d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=446d0c74e9ee4030882e4f3f675fdc2f)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:06:59.789960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17888ce-45b0-4076-b117-11e84a933d8b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:06:59.910485 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d17888ce-45b0-4076-b117-11e84a933d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '446d0c74e9ee4030882e4f3f675fdc2f', 'request_id': 'req-d17888ce-45b0-4076-b117-11e84a933d8b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:59.921679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d17888ce-45b0-4076-b117-11e84a933d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '446d0c74e9ee4030882e4f3f675fdc2f', 'request_id': 'req-d17888ce-45b0-4076-b117-11e84a933d8b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:59.928470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:06:59.932145 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d17888ce-45b0-4076-b117-11e84a933d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '446d0c74e9ee4030882e4f3f675fdc2f', 'request_id': 'req-d17888ce-45b0-4076-b117-11e84a933d8b'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:59.996510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d17888ce-45b0-4076-b117-11e84a933d8b admin admin] The token cache is being invalidate because project 446d0c74e9ee4030882e4f3f675fdc2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:06:59.996811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d17888ce-45b0-4076-b117-11e84a933d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:59.997750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-d17888ce-45b0-4076-b117-11e84a933d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:06:59.999323 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4192/8382] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:06:59 2022] DELETE /identity/v3/projects/446d0c74e9ee4030882e4f3f675fdc2f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:07:00.579096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642edc1-0386-4e67-8289-ca45ff0527dc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:07:00.581854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e642edc1-0386-4e67-8289-ca45ff0527dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:07:00.682500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642edc1-0386-4e67-8289-ca45ff0527dc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:07:00.720861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:07:00.748149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f6714-0e18-4c93-b6d2-90ddd48b5c9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:07:00.748755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f6714-0e18-4c93-b6d2-90ddd48b5c9e service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:07:00.749088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f6714-0e18-4c93-b6d2-90ddd48b5c9e service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:07:00.749409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f6714-0e18-4c93-b6d2-90ddd48b5c9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:07:00.751454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c73f6714-0e18-4c93-b6d2-90ddd48b5c9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:07:00.861335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f6714-0e18-4c93-b6d2-90ddd48b5c9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:07:00.864498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f6714-0e18-4c93-b6d2-90ddd48b5c9e service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:07:00.882297 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4191/8383] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:07:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:07:04.103631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a77e0c-b6b0-4026-8754-db96712d871c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:07:04.104164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a77e0c-b6b0-4026-8754-db96712d871c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:07:04.104293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a77e0c-b6b0-4026-8754-db96712d871c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:07:04.125135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f1a77e0c-b6b0-4026-8754-db96712d871c None None] MFA Rules not processed for user `b7f5c179e8844542bca46d76042a6897`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:07:04.126365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f1a77e0c-b6b0-4026-8754-db96712d871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:07:04.193560 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4193/8384] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:07:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:07:11.209279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=40 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:07:14.177619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=28,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:07:24.566513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f6714-0e18-4c93-b6d2-90ddd48b5c9e service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:07:24.568799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c73f6714-0e18-4c93-b6d2-90ddd48b5c9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:07:24.650386 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f6714-0e18-4c93-b6d2-90ddd48b5c9e service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:07:24.655233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754d7dc-082c-4c40-9489-cf667751b2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:07:24.656057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754d7dc-082c-4c40-9489-cf667751b2c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:07:24.656341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754d7dc-082c-4c40-9489-cf667751b2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:07:24.656818 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754d7dc-082c-4c40-9489-cf667751b2c3 admin admin] PATH_INFO: `/v3/users/aac6c0276fa842738263e8aed290bf19` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:07:24.657954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754d7dc-082c-4c40-9489-cf667751b2c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aac6c0276fa842738263e8aed290bf19)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:07:24.660218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754d7dc-082c-4c40-9489-cf667751b2c3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:07:24.896402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d754d7dc-082c-4c40-9489-cf667751b2c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aac6c0276fa842738263e8aed290bf19'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:07:24.896954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d754d7dc-082c-4c40-9489-cf667751b2c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aac6c0276fa842738263e8aed290bf19'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:07:24.904590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d754d7dc-082c-4c40-9489-cf667751b2c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aac6c0276fa842738263e8aed290bf19'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:07:24.918204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d754d7dc-082c-4c40-9489-cf667751b2c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aac6c0276fa842738263e8aed290bf19'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:07:24.978969 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-d754d7dc-082c-4c40-9489-cf667751b2c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aac6c0276fa842738263e8aed290bf19'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:07:24.989705 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4192/8385] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:07:24 2022] DELETE /identity/v3/users/aac6c0276fa842738263e8aed290bf19 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:07:25.282438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a77e0c-b6b0-4026-8754-db96712d871c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:07:25.295101 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a77e0c-b6b0-4026-8754-db96712d871c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:07:25.359999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398a11d-90fd-4a95-9f05-42c84abee34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:07:25.360683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398a11d-90fd-4a95-9f05-42c84abee34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:07:25.360971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398a11d-90fd-4a95-9f05-42c84abee34e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:07:25.361250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398a11d-90fd-4a95-9f05-42c84abee34e admin admin] PATH_INFO: `/v3/projects/ed478a90b637419e8a1ec46a5ec15414` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:07:25.362502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398a11d-90fd-4a95-9f05-42c84abee34e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed478a90b637419e8a1ec46a5ec15414)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:07:25.364459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398a11d-90fd-4a95-9f05-42c84abee34e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:07:25.491331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f398a11d-90fd-4a95-9f05-42c84abee34e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed478a90b637419e8a1ec46a5ec15414', 'request_id': 'req-f398a11d-90fd-4a95-9f05-42c84abee34e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:07:25.497638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f398a11d-90fd-4a95-9f05-42c84abee34e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed478a90b637419e8a1ec46a5ec15414', 'request_id': 'req-f398a11d-90fd-4a95-9f05-42c84abee34e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:07:25.504615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f398a11d-90fd-4a95-9f05-42c84abee34e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed478a90b637419e8a1ec46a5ec15414', 'request_id': 'req-f398a11d-90fd-4a95-9f05-42c84abee34e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:07:25.577603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f398a11d-90fd-4a95-9f05-42c84abee34e admin admin] The token cache is being invalidate because project ed478a90b637419e8a1ec46a5ec15414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:07:25.577959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f398a11d-90fd-4a95-9f05-42c84abee34e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:07:25.578672 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-f398a11d-90fd-4a95-9f05-42c84abee34e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:07:25.580434 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4194/8386] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:07:25 2022] DELETE /identity/v3/projects/ed478a90b637419e8a1ec46a5ec15414 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:07:25.585012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754d7dc-082c-4c40-9489-cf667751b2c3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:07:25.586530 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d754d7dc-082c-4c40-9489-cf667751b2c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:07:25.600428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754d7dc-082c-4c40-9489-cf667751b2c3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:07:25.659520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db359e1-e36c-42bb-b290-1593d5740bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:07:25.660146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db359e1-e36c-42bb-b290-1593d5740bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:07:25.660427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db359e1-e36c-42bb-b290-1593d5740bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:07:25.660705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db359e1-e36c-42bb-b290-1593d5740bf5 admin admin] PATH_INFO: `/v3/users/fe2d538942114551b541edfddc77ccee` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:07:25.661828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db359e1-e36c-42bb-b290-1593d5740bf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe2d538942114551b541edfddc77ccee)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:07:25.663786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db359e1-e36c-42bb-b290-1593d5740bf5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:07:25.687726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:07:25.814775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3db359e1-e36c-42bb-b290-1593d5740bf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe2d538942114551b541edfddc77ccee'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:07:25.815864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3db359e1-e36c-42bb-b290-1593d5740bf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe2d538942114551b541edfddc77ccee'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:07:25.823323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3db359e1-e36c-42bb-b290-1593d5740bf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe2d538942114551b541edfddc77ccee'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:07:25.837640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3db359e1-e36c-42bb-b290-1593d5740bf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe2d538942114551b541edfddc77ccee'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:07:25.915230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3db359e1-e36c-42bb-b290-1593d5740bf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe2d538942114551b541edfddc77ccee'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:07:25.921568 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4193/8387] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:07:25 2022] DELETE /identity/v3/users/fe2d538942114551b541edfddc77ccee => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:07:26.196432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398a11d-90fd-4a95-9f05-42c84abee34e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:07:26.199226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f398a11d-90fd-4a95-9f05-42c84abee34e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:07:26.214044 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398a11d-90fd-4a95-9f05-42c84abee34e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:07:26.286175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d46cd9-2439-451f-9bec-4a2250e65d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:07:26.287066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d46cd9-2439-451f-9bec-4a2250e65d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:07:26.287424 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d46cd9-2439-451f-9bec-4a2250e65d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:07:26.287776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d46cd9-2439-451f-9bec-4a2250e65d73 admin admin] PATH_INFO: `/v3/projects/5d2942e84d964f44934c612bd72400a3` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:07:26.289058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d46cd9-2439-451f-9bec-4a2250e65d73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d2942e84d964f44934c612bd72400a3)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:07:26.291097 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d46cd9-2439-451f-9bec-4a2250e65d73 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:07:26.418629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:07:26.430773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c5d46cd9-2439-451f-9bec-4a2250e65d73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d2942e84d964f44934c612bd72400a3', 'request_id': 'req-c5d46cd9-2439-451f-9bec-4a2250e65d73'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:07:26.436946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c5d46cd9-2439-451f-9bec-4a2250e65d73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d2942e84d964f44934c612bd72400a3', 'request_id': 'req-c5d46cd9-2439-451f-9bec-4a2250e65d73'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:07:26.442679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c5d46cd9-2439-451f-9bec-4a2250e65d73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d2942e84d964f44934c612bd72400a3', 'request_id': 'req-c5d46cd9-2439-451f-9bec-4a2250e65d73'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:07:26.527693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c5d46cd9-2439-451f-9bec-4a2250e65d73 admin admin] The token cache is being invalidate because project 5d2942e84d964f44934c612bd72400a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:07:26.528020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c5d46cd9-2439-451f-9bec-4a2250e65d73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:07:26.528795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c5d46cd9-2439-451f-9bec-4a2250e65d73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:07:26.530355 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4195/8388] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:07:26 2022] DELETE /identity/v3/projects/5d2942e84d964f44934c612bd72400a3 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:07:35.917804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:07:36.693353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:08:09.023161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcea99a-0cfc-4c64-abd9-d9bf619d3a5a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:08:09.023669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcea99a-0cfc-4c64-abd9-d9bf619d3a5a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:08:09.023669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcea99a-0cfc-4c64-abd9-d9bf619d3a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:08:09.049195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-efcea99a-0cfc-4c64-abd9-d9bf619d3a5a None None] MFA Rules not processed for user `b7f5c179e8844542bca46d76042a6897`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:08:09.050441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-efcea99a-0cfc-4c64-abd9-d9bf619d3a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:08:09.112167 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4194/8389] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:08:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:08:09.805199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d46cd9-2439-451f-9bec-4a2250e65d73 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:08:09.807021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c5d46cd9-2439-451f-9bec-4a2250e65d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:08:09.889806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d46cd9-2439-451f-9bec-4a2250e65d73 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:08:09.894896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabbceb-6725-4ecc-99db-0a30c0341768 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:08:09.895528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabbceb-6725-4ecc-99db-0a30c0341768 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:08:09.895786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabbceb-6725-4ecc-99db-0a30c0341768 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:08:09.896057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabbceb-6725-4ecc-99db-0a30c0341768 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:08:09.897778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8aabbceb-6725-4ecc-99db-0a30c0341768 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:08:09.912958 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aabbceb-6725-4ecc-99db-0a30c0341768 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:08:09.914574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aabbceb-6725-4ecc-99db-0a30c0341768 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:08:09.928075 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4196/8390] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:08:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:08:13.031845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcea99a-0cfc-4c64-abd9-d9bf619d3a5a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:08:13.033307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-efcea99a-0cfc-4c64-abd9-d9bf619d3a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:08:13.104516 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcea99a-0cfc-4c64-abd9-d9bf619d3a5a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:08:13.108348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1420c-ef57-4d2e-bf1d-c3d3e3562fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:08:13.108902 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1420c-ef57-4d2e-bf1d-c3d3e3562fbd service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:08:13.109183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1420c-ef57-4d2e-bf1d-c3d3e3562fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:08:13.109580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1420c-ef57-4d2e-bf1d-c3d3e3562fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:08:13.111535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1ad1420c-ef57-4d2e-bf1d-c3d3e3562fbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:08:13.140709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1420c-ef57-4d2e-bf1d-c3d3e3562fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:08:13.143040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1420c-ef57-4d2e-bf1d-c3d3e3562fbd service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:08:13.163250 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4195/8391] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:08:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:08:19.920420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=32 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:08:23.152879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=51 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:08:53.048633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabbceb-6725-4ecc-99db-0a30c0341768 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:08:53.050180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8aabbceb-6725-4ecc-99db-0a30c0341768 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:08:53.132141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabbceb-6725-4ecc-99db-0a30c0341768 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:08:53.138840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fc2f7-1bd3-45a9-bf0b-96b063ca188d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:08:53.139518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fc2f7-1bd3-45a9-bf0b-96b063ca188d service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:08:53.139809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fc2f7-1bd3-45a9-bf0b-96b063ca188d service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:08:53.149620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fc2f7-1bd3-45a9-bf0b-96b063ca188d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:08:53.149620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cb8fc2f7-1bd3-45a9-bf0b-96b063ca188d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:08:53.157541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fc2f7-1bd3-45a9-bf0b-96b063ca188d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:08:53.159191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fc2f7-1bd3-45a9-bf0b-96b063ca188d service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:08:53.173274 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4197/8392] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:08:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:09:03.166119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=34 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:09:08.042348 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1420c-ef57-4d2e-bf1d-c3d3e3562fbd service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:09:08.043943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1ad1420c-ef57-4d2e-bf1d-c3d3e3562fbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:09:08.111645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1420c-ef57-4d2e-bf1d-c3d3e3562fbd service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:09:08.115593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3975a-d4ba-488a-942d-d2fbd66039c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:09:08.116244 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3975a-d4ba-488a-942d-d2fbd66039c7 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:09:08.116532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3975a-d4ba-488a-942d-d2fbd66039c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:09:08.116857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3975a-d4ba-488a-942d-d2fbd66039c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:09:08.119579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fdf3975a-d4ba-488a-942d-d2fbd66039c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:09:08.196310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3975a-d4ba-488a-942d-d2fbd66039c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:09:08.197806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3975a-d4ba-488a-942d-d2fbd66039c7 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:09:08.208556 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4196/8393] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:09:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:09:18.203756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=48 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:09:39.622155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fc2f7-1bd3-45a9-bf0b-96b063ca188d service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:09:39.637041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fc2f7-1bd3-45a9-bf0b-96b063ca188d service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:09:39.642061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2057e-4c0a-45c5-a105-7666fd40fb7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:09:39.642686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2057e-4c0a-45c5-a105-7666fd40fb7e service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:09:39.642971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2057e-4c0a-45c5-a105-7666fd40fb7e service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:09:39.643246 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2057e-4c0a-45c5-a105-7666fd40fb7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:09:39.644973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-82c2057e-4c0a-45c5-a105-7666fd40fb7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:09:39.674213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2057e-4c0a-45c5-a105-7666fd40fb7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:09:39.675808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2057e-4c0a-45c5-a105-7666fd40fb7e service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:09:39.688508 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4198/8394] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:09:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:09:41.361972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bd633-42ff-4339-84aa-a147faa03478 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:09:41.362505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bd633-42ff-4339-84aa-a147faa03478 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:09:41.362607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bd633-42ff-4339-84aa-a147faa03478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:09:41.382474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-cd4bd633-42ff-4339-84aa-a147faa03478 None None] MFA Rules not processed for user `b7f5c179e8844542bca46d76042a6897`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:09:41.383719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-cd4bd633-42ff-4339-84aa-a147faa03478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:09:41.391022 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4197/8395] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:09:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:09:41.661629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0f4a7-b1f7-4ea1-84f6-6a435367fa56 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:09:41.662188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0f4a7-b1f7-4ea1-84f6-6a435367fa56 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:09:41.662188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0f4a7-b1f7-4ea1-84f6-6a435367fa56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:09:41.710740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-46d0f4a7-b1f7-4ea1-84f6-6a435367fa56 None None] MFA Rules not processed for user `9b359391fbc34c259d987e42e8826c86`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:09:41.712507 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-46d0f4a7-b1f7-4ea1-84f6-6a435367fa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:09:41.722349 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4199/8396] 10.222.0.20 () {58 vars in 1062 bytes} [Thu Oct 27 04:09:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:09:41.729105 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bd633-42ff-4339-84aa-a147faa03478 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:09:41.738580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bd633-42ff-4339-84aa-a147faa03478 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:09:41.742276 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972b103-a4e6-4f42-aa9e-d10742bf3e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:09:41.742922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972b103-a4e6-4f42-aa9e-d10742bf3e68 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:09:41.743211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972b103-a4e6-4f42-aa9e-d10742bf3e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:09:41.743211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972b103-a4e6-4f42-aa9e-d10742bf3e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:09:41.745363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7972b103-a4e6-4f42-aa9e-d10742bf3e68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:09:41.759625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972b103-a4e6-4f42-aa9e-d10742bf3e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:09:41.761103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972b103-a4e6-4f42-aa9e-d10742bf3e68 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:09:41.772154 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4198/8397] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:09:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:09:42.485252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc2b26-88f3-4367-b684-068b73ad066b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:09:42.485544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc2b26-88f3-4367-b684-068b73ad066b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:09:42.485827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc2b26-88f3-4367-b684-068b73ad066b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:09:42.529330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3dbc2b26-88f3-4367-b684-068b73ad066b None None] MFA Rules not processed for user `1a395d2414cd4da085a77ddc9b1f1caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:09:42.530687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3dbc2b26-88f3-4367-b684-068b73ad066b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:09:42.543464 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4200/8398] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 04:09:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:09:42.566796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972b103-a4e6-4f42-aa9e-d10742bf3e68 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:09:42.583737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972b103-a4e6-4f42-aa9e-d10742bf3e68 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:09:42.588900 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7903b-0eb5-47a9-83b0-7669b0fe3b5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:09:42.589512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7903b-0eb5-47a9-83b0-7669b0fe3b5c service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:09:42.589796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7903b-0eb5-47a9-83b0-7669b0fe3b5c service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:09:42.590106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7903b-0eb5-47a9-83b0-7669b0fe3b5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:09:42.599153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7903b-0eb5-47a9-83b0-7669b0fe3b5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:09:42.600779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7903b-0eb5-47a9-83b0-7669b0fe3b5c service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:09:42.611461 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4199/8399] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:09:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:09:52.524994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=33 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:09:52.607291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=15 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:10:05.280356 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a7f8d-6c45-4f8a-8ea8-6b27d89519a2 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:10:05.280883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a7f8d-6c45-4f8a-8ea8-6b27d89519a2 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:10:05.280966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a7f8d-6c45-4f8a-8ea8-6b27d89519a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:10:05.350426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-cf9a7f8d-6c45-4f8a-8ea8-6b27d89519a2 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:10:05.351880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cf9a7f8d-6c45-4f8a-8ea8-6b27d89519a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:10:05.426100 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4201/8400] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 04:10:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:10:05.599546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7903b-0eb5-47a9-83b0-7669b0fe3b5c service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:10:05.600873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fca7903b-0eb5-47a9-83b0-7669b0fe3b5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:10:05.675921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7903b-0eb5-47a9-83b0-7669b0fe3b5c service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:10:05.681260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915329d-12ef-49ed-bfbd-4d6d25975335 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:10:05.681983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915329d-12ef-49ed-bfbd-4d6d25975335 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:10:05.682327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915329d-12ef-49ed-bfbd-4d6d25975335 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:10:05.682673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915329d-12ef-49ed-bfbd-4d6d25975335 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:10:05.694024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915329d-12ef-49ed-bfbd-4d6d25975335 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:10:05.695745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915329d-12ef-49ed-bfbd-4d6d25975335 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:10:05.704601 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4200/8401] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 04:10:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 04:10:07.122625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38484ea9-efbd-48a1-8d3d-9cab589609d7 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:10:07.123173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38484ea9-efbd-48a1-8d3d-9cab589609d7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:10:07.123173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38484ea9-efbd-48a1-8d3d-9cab589609d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:10:07.142206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-38484ea9-efbd-48a1-8d3d-9cab589609d7 None None] MFA Rules not processed for user `b7f5c179e8844542bca46d76042a6897`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:10:07.143416 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-38484ea9-efbd-48a1-8d3d-9cab589609d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:10:07.150559 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4202/8402] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:10:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:10:07.839820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08152e81-6bca-4e1f-a38e-f0762a901cd4 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:10:07.840324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08152e81-6bca-4e1f-a38e-f0762a901cd4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:10:07.841315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08152e81-6bca-4e1f-a38e-f0762a901cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:10:07.867726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-08152e81-6bca-4e1f-a38e-f0762a901cd4 None None] MFA Rules not processed for user `1a395d2414cd4da085a77ddc9b1f1caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:10:07.867726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-08152e81-6bca-4e1f-a38e-f0762a901cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:10:07.872507 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4201/8403] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 04:10:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:10:07.883786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38484ea9-efbd-48a1-8d3d-9cab589609d7 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:10:07.901400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38484ea9-efbd-48a1-8d3d-9cab589609d7 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:10:07.906989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc36808-b6ea-4afd-96b3-c3879e71dc55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:10:07.907708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc36808-b6ea-4afd-96b3-c3879e71dc55 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:10:07.908036 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc36808-b6ea-4afd-96b3-c3879e71dc55 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:10:07.908340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc36808-b6ea-4afd-96b3-c3879e71dc55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:10:07.917330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc36808-b6ea-4afd-96b3-c3879e71dc55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:10:07.919038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc36808-b6ea-4afd-96b3-c3879e71dc55 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:10:07.928852 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4203/8404] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:10:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:10:09.928231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49377ec1-26ad-4542-97be-a6057704b630 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:10:09.929442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49377ec1-26ad-4542-97be-a6057704b630 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:10:09.929720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49377ec1-26ad-4542-97be-a6057704b630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:10:09.971581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-49377ec1-26ad-4542-97be-a6057704b630 None None] MFA Rules not processed for user `fe7800497c6e460f9a2a0bd259e6d236`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:10:09.972735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-49377ec1-26ad-4542-97be-a6057704b630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:10:09.982224 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4202/8405] 10.222.0.20 () {58 vars in 1040 bytes} [Thu Oct 27 04:10:09 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:10:09.988266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc36808-b6ea-4afd-96b3-c3879e71dc55 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:10:10.000471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc36808-b6ea-4afd-96b3-c3879e71dc55 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:10:10.005567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ac2bd-4f76-44ac-a80c-541c59ff1f05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:10:10.006214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ac2bd-4f76-44ac-a80c-541c59ff1f05 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:10:10.006499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ac2bd-4f76-44ac-a80c-541c59ff1f05 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:10:10.006769 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ac2bd-4f76-44ac-a80c-541c59ff1f05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:10:10.015793 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ac2bd-4f76-44ac-a80c-541c59ff1f05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:10:10.017620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ac2bd-4f76-44ac-a80c-541c59ff1f05 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:10:10.028580 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4204/8406] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 04:10:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 04:10:11.195009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49377ec1-26ad-4542-97be-a6057704b630 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:10:11.218928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49377ec1-26ad-4542-97be-a6057704b630 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:10:11.235695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a9ce5-bcf3-4bfc-ad9b-8eb1c4cb508b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:10:11.236346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a9ce5-bcf3-4bfc-ad9b-8eb1c4cb508b service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:10:11.236691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a9ce5-bcf3-4bfc-ad9b-8eb1c4cb508b service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:10:11.236972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a9ce5-bcf3-4bfc-ad9b-8eb1c4cb508b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:10:11.240831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3e8a9ce5-bcf3-4bfc-ad9b-8eb1c4cb508b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:10:11.263953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a9ce5-bcf3-4bfc-ad9b-8eb1c4cb508b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:10:11.265756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a9ce5-bcf3-4bfc-ad9b-8eb1c4cb508b service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:10:11.291197 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4203/8407] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:10:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:10:20.025663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=62 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:10:21.271400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=50 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:10:37.331287 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ac2bd-4f76-44ac-a80c-541c59ff1f05 service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:10:37.348346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ac2bd-4f76-44ac-a80c-541c59ff1f05 service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:10:37.353526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24691f97-645f-44b4-a200-9aa162cda038 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:10:37.354850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24691f97-645f-44b4-a200-9aa162cda038 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:10:37.355367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24691f97-645f-44b4-a200-9aa162cda038 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:10:37.355803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24691f97-645f-44b4-a200-9aa162cda038 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:10:37.357712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-24691f97-645f-44b4-a200-9aa162cda038 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:10:37.373060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24691f97-645f-44b4-a200-9aa162cda038 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:10:37.375182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24691f97-645f-44b4-a200-9aa162cda038 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:10:37.389010 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4205/8408] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:10:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:10:47.381275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:11:08.863761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a9ce5-bcf3-4bfc-ad9b-8eb1c4cb508b service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:08.865371 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3e8a9ce5-bcf3-4bfc-ad9b-8eb1c4cb508b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:08.914065 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a9ce5-bcf3-4bfc-ad9b-8eb1c4cb508b service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:08.921227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a4c86-b003-4be5-8088-fb778dc3b27e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:08.921859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a4c86-b003-4be5-8088-fb778dc3b27e service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:08.922184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a4c86-b003-4be5-8088-fb778dc3b27e service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:08.922511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a4c86-b003-4be5-8088-fb778dc3b27e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:08.925021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-568a4c86-b003-4be5-8088-fb778dc3b27e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:08.956083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a4c86-b003-4be5-8088-fb778dc3b27e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:08.958258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a4c86-b003-4be5-8088-fb778dc3b27e service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:08.980150 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4204/8409] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:11:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:11:11.903293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24691f97-645f-44b4-a200-9aa162cda038 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:11.904725 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-24691f97-645f-44b4-a200-9aa162cda038 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:11.987106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24691f97-645f-44b4-a200-9aa162cda038 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:11.992203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd576f3-1044-48fd-889d-fd5f200dae85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:11.993012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd576f3-1044-48fd-889d-fd5f200dae85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:11.993464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd576f3-1044-48fd-889d-fd5f200dae85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:11.993858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd576f3-1044-48fd-889d-fd5f200dae85 admin admin] PATH_INFO: `/v3/users/d5f2bbf4fa7a4768ba0d395217b3397e` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:11.995110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd576f3-1044-48fd-889d-fd5f200dae85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5f2bbf4fa7a4768ba0d395217b3397e)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:11.997430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd576f3-1044-48fd-889d-fd5f200dae85 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:12.220440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dcd576f3-1044-48fd-889d-fd5f200dae85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5f2bbf4fa7a4768ba0d395217b3397e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:12.221293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dcd576f3-1044-48fd-889d-fd5f200dae85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5f2bbf4fa7a4768ba0d395217b3397e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:12.230482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dcd576f3-1044-48fd-889d-fd5f200dae85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5f2bbf4fa7a4768ba0d395217b3397e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:12.264321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dcd576f3-1044-48fd-889d-fd5f200dae85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5f2bbf4fa7a4768ba0d395217b3397e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:12.265079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dcd576f3-1044-48fd-889d-fd5f200dae85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5f2bbf4fa7a4768ba0d395217b3397e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:12.338821 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4206/8410] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:11:11 2022] DELETE /identity/v3/users/d5f2bbf4fa7a4768ba0d395217b3397e => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:11:12.343613 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90827b-a7d4-4c91-9aad-31275360861e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:12.344086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90827b-a7d4-4c91-9aad-31275360861e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:12.345026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90827b-a7d4-4c91-9aad-31275360861e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:12.373621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9a90827b-a7d4-4c91-9aad-31275360861e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:11:12.374827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9a90827b-a7d4-4c91-9aad-31275360861e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:12.439737 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4205/8411] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:11:12.449770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd576f3-1044-48fd-889d-fd5f200dae85 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:12.451379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-dcd576f3-1044-48fd-889d-fd5f200dae85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:12.524183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd576f3-1044-48fd-889d-fd5f200dae85 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:12.528337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4d800-c859-475f-ae1f-4a228a6cd4c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:12.529247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4d800-c859-475f-ae1f-4a228a6cd4c0 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:12.529532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4d800-c859-475f-ae1f-4a228a6cd4c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:12.529807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4d800-c859-475f-ae1f-4a228a6cd4c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:12.540844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4d800-c859-475f-ae1f-4a228a6cd4c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:12.542372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4d800-c859-475f-ae1f-4a228a6cd4c0 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:12.566133 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4207/8412] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:11:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:11:12.842987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90827b-a7d4-4c91-9aad-31275360861e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:12.844464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9a90827b-a7d4-4c91-9aad-31275360861e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:12.856928 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90827b-a7d4-4c91-9aad-31275360861e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:12.862933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60be620-30c2-43ff-ae07-5bccc41366c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:12.863794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60be620-30c2-43ff-ae07-5bccc41366c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:12.864026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60be620-30c2-43ff-ae07-5bccc41366c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:12.864300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60be620-30c2-43ff-ae07-5bccc41366c7 admin admin] PATH_INFO: `/v3/projects/38158a663ff04f19afebd7054ed4b2c4` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:12.865544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60be620-30c2-43ff-ae07-5bccc41366c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38158a663ff04f19afebd7054ed4b2c4)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:12.867719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60be620-30c2-43ff-ae07-5bccc41366c7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:13.040063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e60be620-30c2-43ff-ae07-5bccc41366c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38158a663ff04f19afebd7054ed4b2c4', 'request_id': 'req-e60be620-30c2-43ff-ae07-5bccc41366c7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:13.128134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e60be620-30c2-43ff-ae07-5bccc41366c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38158a663ff04f19afebd7054ed4b2c4', 'request_id': 'req-e60be620-30c2-43ff-ae07-5bccc41366c7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:13.135603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e60be620-30c2-43ff-ae07-5bccc41366c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38158a663ff04f19afebd7054ed4b2c4', 'request_id': 'req-e60be620-30c2-43ff-ae07-5bccc41366c7'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:13.147042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e60be620-30c2-43ff-ae07-5bccc41366c7 admin admin] The token cache is being invalidate because project 38158a663ff04f19afebd7054ed4b2c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:11:13.147270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e60be620-30c2-43ff-ae07-5bccc41366c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:13.147940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-e60be620-30c2-43ff-ae07-5bccc41366c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:13.149517 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4206/8413] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:11:12 2022] DELETE /identity/v3/projects/38158a663ff04f19afebd7054ed4b2c4 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:11:13.154723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49748f86-9ac7-4761-ba3e-576f65ca939c None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:13.155227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49748f86-9ac7-4761-ba3e-576f65ca939c None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:13.155323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49748f86-9ac7-4761-ba3e-576f65ca939c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:13.162276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:11:13.205153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-49748f86-9ac7-4761-ba3e-576f65ca939c None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:11:13.206628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-49748f86-9ac7-4761-ba3e-576f65ca939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:13.273708 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4208/8414] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:11:13.281558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb702bd-4fab-47e7-b9b6-8b8cfa9c39bb None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:13.282480 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb702bd-4fab-47e7-b9b6-8b8cfa9c39bb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:13.282765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb702bd-4fab-47e7-b9b6-8b8cfa9c39bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:13.304662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-0bb702bd-4fab-47e7-b9b6-8b8cfa9c39bb None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:11:13.305877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0bb702bd-4fab-47e7-b9b6-8b8cfa9c39bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:13.314202 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4207/8415] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:11:13.318483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49748f86-9ac7-4761-ba3e-576f65ca939c None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:13.328706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49748f86-9ac7-4761-ba3e-576f65ca939c None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:13.333809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f62674-a3a2-4d27-8af9-cfdacf04b313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:13.334530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f62674-a3a2-4d27-8af9-cfdacf04b313 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:13.334813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f62674-a3a2-4d27-8af9-cfdacf04b313 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:13.336763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f62674-a3a2-4d27-8af9-cfdacf04b313 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:13.336763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f62674-a3a2-4d27-8af9-cfdacf04b313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:11:13.336763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f62674-a3a2-4d27-8af9-cfdacf04b313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:13.337783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f62674-a3a2-4d27-8af9-cfdacf04b313 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:13.353383 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4209/8416] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:11:13.354547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb702bd-4fab-47e7-b9b6-8b8cfa9c39bb None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:13.364831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb702bd-4fab-47e7-b9b6-8b8cfa9c39bb None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:13.369671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02172ccf-ded0-406c-8a63-90ab194745f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:13.370307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02172ccf-ded0-406c-8a63-90ab194745f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:13.370600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02172ccf-ded0-406c-8a63-90ab194745f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:13.370862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02172ccf-ded0-406c-8a63-90ab194745f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:13.371607 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02172ccf-ded0-406c-8a63-90ab194745f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:13.373521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02172ccf-ded0-406c-8a63-90ab194745f2 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:13.458609 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4208/8417] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:11:13 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 04:11:13.461912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f62674-a3a2-4d27-8af9-cfdacf04b313 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:13.473428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f62674-a3a2-4d27-8af9-cfdacf04b313 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:13.532628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658719e2-2476-4a74-bf80-965b2989f990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:13.533183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658719e2-2476-4a74-bf80-965b2989f990 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:13.533493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658719e2-2476-4a74-bf80-965b2989f990 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:13.533762 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658719e2-2476-4a74-bf80-965b2989f990 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:13.534434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658719e2-2476-4a74-bf80-965b2989f990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:13.536379 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658719e2-2476-4a74-bf80-965b2989f990 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:13.645266 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4210/8418] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:11:13 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:11:13.646711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02172ccf-ded0-406c-8a63-90ab194745f2 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:13.657877 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02172ccf-ded0-406c-8a63-90ab194745f2 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:13.662544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425405b-5b50-4e12-9147-92437de58933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:13.663153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425405b-5b50-4e12-9147-92437de58933 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:13.663435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425405b-5b50-4e12-9147-92437de58933 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:13.663710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425405b-5b50-4e12-9147-92437de58933 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:13.664369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425405b-5b50-4e12-9147-92437de58933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:13.666008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425405b-5b50-4e12-9147-92437de58933 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:13.676474 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4209/8419] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:11:13.680712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658719e2-2476-4a74-bf80-965b2989f990 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:13.691309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658719e2-2476-4a74-bf80-965b2989f990 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:13.696229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1df543-2bc2-46ef-b6f4-25715b550941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:13.696835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1df543-2bc2-46ef-b6f4-25715b550941 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:13.697119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1df543-2bc2-46ef-b6f4-25715b550941 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:13.697399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1df543-2bc2-46ef-b6f4-25715b550941 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:13.698063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1df543-2bc2-46ef-b6f4-25715b550941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:13.699746 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1df543-2bc2-46ef-b6f4-25715b550941 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:13.711417 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4211/8420] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:11:13.715832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425405b-5b50-4e12-9147-92437de58933 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:13.726918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425405b-5b50-4e12-9147-92437de58933 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:13.731946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c0a75-636a-4687-bc4c-42e74dc6dc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:13.732657 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c0a75-636a-4687-bc4c-42e74dc6dc1b admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:13.732940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c0a75-636a-4687-bc4c-42e74dc6dc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:13.735739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c0a75-636a-4687-bc4c-42e74dc6dc1b admin admin] PATH_INFO: `/v3/projects/cbc3dcaa896143288cb90f4105f738a9/users/2e8f306f54d5417d9a3ca518d030e6ab/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:13.746084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:11:13.751687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c0a75-636a-4687-bc4c-42e74dc6dc1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc3dcaa896143288cb90f4105f738a9, user_id=2e8f306f54d5417d9a3ca518d030e6ab, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:13.754765 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c0a75-636a-4687-bc4c-42e74dc6dc1b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:13.836705 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4210/8421] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:11:13 2022] PUT /identity/v3/projects/cbc3dcaa896143288cb90f4105f738a9/users/2e8f306f54d5417d9a3ca518d030e6ab/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:11:13.849343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e4743-74db-40a2-b948-7eb095d1f6f5 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:13.849635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e4743-74db-40a2-b948-7eb095d1f6f5 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:13.849914 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e4743-74db-40a2-b948-7eb095d1f6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:13.879732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-280e4743-74db-40a2-b948-7eb095d1f6f5 None None] MFA Rules not processed for user `2e8f306f54d5417d9a3ca518d030e6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:11:13.880962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-280e4743-74db-40a2-b948-7eb095d1f6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:13.924222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:11:13.945849 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4212/8422] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:11:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:11:13.960918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849862c-896f-4d28-a9c2-dc0596a158ff None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:13.960918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849862c-896f-4d28-a9c2-dc0596a158ff None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:13.960918 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849862c-896f-4d28-a9c2-dc0596a158ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:13.996077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9849862c-896f-4d28-a9c2-dc0596a158ff None None] MFA Rules not processed for user `5ec1d24520c447a38ed321f62d4f9e98`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:11:13.997344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9849862c-896f-4d28-a9c2-dc0596a158ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:14.049843 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4211/8423] 10.222.0.20 () {58 vars in 1060 bytes} [Thu Oct 27 04:11:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:11:14.055902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e4743-74db-40a2-b948-7eb095d1f6f5 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:14.065848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e4743-74db-40a2-b948-7eb095d1f6f5 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:14.069688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83435c29-4e36-4840-9be4-3b9e77a5d8ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:14.070590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83435c29-4e36-4840-9be4-3b9e77a5d8ac service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:14.070880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83435c29-4e36-4840-9be4-3b9e77a5d8ac service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:14.071158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83435c29-4e36-4840-9be4-3b9e77a5d8ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:14.080712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83435c29-4e36-4840-9be4-3b9e77a5d8ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:14.082226 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83435c29-4e36-4840-9be4-3b9e77a5d8ac service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:14.091303 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4213/8424] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:11:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:11:14.116709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849862c-896f-4d28-a9c2-dc0596a158ff None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:14.190186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849862c-896f-4d28-a9c2-dc0596a158ff None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:14.195887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f75270-2dda-4473-b9de-3951e73fa970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:14.196730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f75270-2dda-4473-b9de-3951e73fa970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:14.197262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f75270-2dda-4473-b9de-3951e73fa970 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:14.197262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f75270-2dda-4473-b9de-3951e73fa970 admin admin] PATH_INFO: `/v3/users/2e8f306f54d5417d9a3ca518d030e6ab` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:14.198520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f75270-2dda-4473-b9de-3951e73fa970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e8f306f54d5417d9a3ca518d030e6ab)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:14.201163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f75270-2dda-4473-b9de-3951e73fa970 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:14.445215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-43f75270-2dda-4473-b9de-3951e73fa970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e8f306f54d5417d9a3ca518d030e6ab'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:14.445946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-43f75270-2dda-4473-b9de-3951e73fa970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e8f306f54d5417d9a3ca518d030e6ab'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:14.454698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-43f75270-2dda-4473-b9de-3951e73fa970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e8f306f54d5417d9a3ca518d030e6ab'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:14.470132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-43f75270-2dda-4473-b9de-3951e73fa970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e8f306f54d5417d9a3ca518d030e6ab'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:14.551865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-43f75270-2dda-4473-b9de-3951e73fa970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e8f306f54d5417d9a3ca518d030e6ab'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:14.559067 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4212/8425] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:11:14 2022] DELETE /identity/v3/users/2e8f306f54d5417d9a3ca518d030e6ab => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:11:14.564051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc071168-ac20-4bb1-931b-a4aaa2d876c4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:14.564560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc071168-ac20-4bb1-931b-a4aaa2d876c4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:14.564642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc071168-ac20-4bb1-931b-a4aaa2d876c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:14.585447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-dc071168-ac20-4bb1-931b-a4aaa2d876c4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:11:14.590120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-dc071168-ac20-4bb1-931b-a4aaa2d876c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:14.653292 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4214/8426] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:11:14.662962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d3aca-72cb-4fce-a3e6-c0e986f997c1 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:14.663489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d3aca-72cb-4fce-a3e6-c0e986f997c1 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:14.663767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d3aca-72cb-4fce-a3e6-c0e986f997c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:14.674978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:11:14.686358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-029d3aca-72cb-4fce-a3e6-c0e986f997c1 None None] MFA Rules not processed for user `9b359391fbc34c259d987e42e8826c86`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:11:14.689241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-029d3aca-72cb-4fce-a3e6-c0e986f997c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:14.742588 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4213/8427] 10.222.0.20 () {58 vars in 1062 bytes} [Thu Oct 27 04:11:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 04:11:14.749873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc071168-ac20-4bb1-931b-a4aaa2d876c4 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:14.760469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc071168-ac20-4bb1-931b-a4aaa2d876c4 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:14.764474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083442fa-69ae-4ec6-8efd-a7af0dd3964c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:14.765221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083442fa-69ae-4ec6-8efd-a7af0dd3964c service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:14.765498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083442fa-69ae-4ec6-8efd-a7af0dd3964c service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:14.765777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083442fa-69ae-4ec6-8efd-a7af0dd3964c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:14.777469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083442fa-69ae-4ec6-8efd-a7af0dd3964c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:14.778959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083442fa-69ae-4ec6-8efd-a7af0dd3964c service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:14.791657 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4215/8428] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:11:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:11:15.380931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d3aca-72cb-4fce-a3e6-c0e986f997c1 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:15.382603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-029d3aca-72cb-4fce-a3e6-c0e986f997c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:15.403791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d3aca-72cb-4fce-a3e6-c0e986f997c1 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:15.418525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213803d-87b0-42a3-a1c9-2069a7e95757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:15.419248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213803d-87b0-42a3-a1c9-2069a7e95757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:15.419570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213803d-87b0-42a3-a1c9-2069a7e95757 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:15.419853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213803d-87b0-42a3-a1c9-2069a7e95757 admin admin] PATH_INFO: `/v3/projects/cbc3dcaa896143288cb90f4105f738a9` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:15.421189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213803d-87b0-42a3-a1c9-2069a7e95757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc3dcaa896143288cb90f4105f738a9)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:15.423222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213803d-87b0-42a3-a1c9-2069a7e95757 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:15.558737 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b213803d-87b0-42a3-a1c9-2069a7e95757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc3dcaa896143288cb90f4105f738a9', 'request_id': 'req-b213803d-87b0-42a3-a1c9-2069a7e95757'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:15.620075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b213803d-87b0-42a3-a1c9-2069a7e95757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc3dcaa896143288cb90f4105f738a9', 'request_id': 'req-b213803d-87b0-42a3-a1c9-2069a7e95757'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:15.627527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b213803d-87b0-42a3-a1c9-2069a7e95757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc3dcaa896143288cb90f4105f738a9', 'request_id': 'req-b213803d-87b0-42a3-a1c9-2069a7e95757'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:15.638569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b213803d-87b0-42a3-a1c9-2069a7e95757 admin admin] The token cache is being invalidate because project cbc3dcaa896143288cb90f4105f738a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:11:15.638864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b213803d-87b0-42a3-a1c9-2069a7e95757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:15.639511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-b213803d-87b0-42a3-a1c9-2069a7e95757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:15.641080 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4214/8429] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:11:15 2022] DELETE /identity/v3/projects/cbc3dcaa896143288cb90f4105f738a9 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:11:15.646651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be4a36-4aa1-40e0-a74c-254e793850ab None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:15.647215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be4a36-4aa1-40e0-a74c-254e793850ab None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:15.647346 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be4a36-4aa1-40e0-a74c-254e793850ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:15.667521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d2be4a36-4aa1-40e0-a74c-254e793850ab None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:11:15.673198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d2be4a36-4aa1-40e0-a74c-254e793850ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:15.730072 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4216/8430] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:11:15.738334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409354b-afe8-4ecd-a044-6c34e23b25a3 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:15.738668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409354b-afe8-4ecd-a044-6c34e23b25a3 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:15.738976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409354b-afe8-4ecd-a044-6c34e23b25a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:15.760001 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4409354b-afe8-4ecd-a044-6c34e23b25a3 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:11:15.761213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4409354b-afe8-4ecd-a044-6c34e23b25a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:15.769220 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4215/8431] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:11:15.774894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be4a36-4aa1-40e0-a74c-254e793850ab None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:15.784828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be4a36-4aa1-40e0-a74c-254e793850ab None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:15.789538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44f228-89cf-4456-9500-e036b1080ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:15.790229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44f228-89cf-4456-9500-e036b1080ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:15.790513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44f228-89cf-4456-9500-e036b1080ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:15.790784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44f228-89cf-4456-9500-e036b1080ed3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:15.791449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44f228-89cf-4456-9500-e036b1080ed3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:11:15.791758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44f228-89cf-4456-9500-e036b1080ed3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:15.793389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44f228-89cf-4456-9500-e036b1080ed3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:15.811522 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4217/8432] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:11:15.812780 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409354b-afe8-4ecd-a044-6c34e23b25a3 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:15.824574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409354b-afe8-4ecd-a044-6c34e23b25a3 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:15.829965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf1863-bc64-456d-8fd8-69cfc781b675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:15.830793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf1863-bc64-456d-8fd8-69cfc781b675 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:15.831077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf1863-bc64-456d-8fd8-69cfc781b675 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:15.831351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf1863-bc64-456d-8fd8-69cfc781b675 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:15.831986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf1863-bc64-456d-8fd8-69cfc781b675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:15.834477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf1863-bc64-456d-8fd8-69cfc781b675 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:16.325081 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4216/8433] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:11:15 2022] POST /identity/v3/projects => generated 381 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 04:11:16.329759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44f228-89cf-4456-9500-e036b1080ed3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:16.340378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44f228-89cf-4456-9500-e036b1080ed3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:16.384644 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:11:16.397188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de3395-3e9e-4eb8-bfcf-92658e8dbbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:16.397797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de3395-3e9e-4eb8-bfcf-92658e8dbbd2 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:16.398110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de3395-3e9e-4eb8-bfcf-92658e8dbbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:16.398393 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de3395-3e9e-4eb8-bfcf-92658e8dbbd2 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:16.399031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de3395-3e9e-4eb8-bfcf-92658e8dbbd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:16.400989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de3395-3e9e-4eb8-bfcf-92658e8dbbd2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:16.490665 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4218/8434] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:11:16 2022] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:11:16.494395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf1863-bc64-456d-8fd8-69cfc781b675 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:16.505163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf1863-bc64-456d-8fd8-69cfc781b675 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:16.510548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244d2f9-2ae6-4a2c-97fd-410337f41dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:16.511231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244d2f9-2ae6-4a2c-97fd-410337f41dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:16.511518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244d2f9-2ae6-4a2c-97fd-410337f41dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:16.511798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244d2f9-2ae6-4a2c-97fd-410337f41dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:16.512457 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244d2f9-2ae6-4a2c-97fd-410337f41dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:16.514193 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244d2f9-2ae6-4a2c-97fd-410337f41dd8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:16.525259 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4217/8435] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 04:11:16.529377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de3395-3e9e-4eb8-bfcf-92658e8dbbd2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:16.540295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de3395-3e9e-4eb8-bfcf-92658e8dbbd2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:16.545084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0ad85-a371-453c-a3ca-f0adf99cb7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:16.545695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0ad85-a371-453c-a3ca-f0adf99cb7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:16.545979 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0ad85-a371-453c-a3ca-f0adf99cb7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:16.554928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0ad85-a371-453c-a3ca-f0adf99cb7e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:16.554928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0ad85-a371-453c-a3ca-f0adf99cb7e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:16.554928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0ad85-a371-453c-a3ca-f0adf99cb7e7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:16.560719 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4219/8436] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:11:16.564951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244d2f9-2ae6-4a2c-97fd-410337f41dd8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:16.575557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244d2f9-2ae6-4a2c-97fd-410337f41dd8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:16.581614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe96133-8374-4506-86cc-a06214c6fd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:16.583824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe96133-8374-4506-86cc-a06214c6fd7a admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:16.583824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe96133-8374-4506-86cc-a06214c6fd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:16.583824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe96133-8374-4506-86cc-a06214c6fd7a admin admin] PATH_INFO: `/v3/projects/dd18b4c20dfc4a7a95052c0fa5a2b296/users/c08e27179f8a482893c59d8c2c62b9d5/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:16.600202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe96133-8374-4506-86cc-a06214c6fd7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd18b4c20dfc4a7a95052c0fa5a2b296, user_id=c08e27179f8a482893c59d8c2c62b9d5, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:16.602986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe96133-8374-4506-86cc-a06214c6fd7a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:16.683704 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4218/8437] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:11:16 2022] PUT /identity/v3/projects/dd18b4c20dfc4a7a95052c0fa5a2b296/users/c08e27179f8a482893c59d8c2c62b9d5/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 04:11:16.688514 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa63747-55ad-416d-8a47-b21023d78556 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:16.689037 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa63747-55ad-416d-8a47-b21023d78556 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:16.689138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa63747-55ad-416d-8a47-b21023d78556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:16.709924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-afa63747-55ad-416d-8a47-b21023d78556 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:11:16.712173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-afa63747-55ad-416d-8a47-b21023d78556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:16.771357 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4220/8438] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:11:16.781322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe96133-8374-4506-86cc-a06214c6fd7a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:16.783668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5fe96133-8374-4506-86cc-a06214c6fd7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:16.821203 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:11:16.845266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe96133-8374-4506-86cc-a06214c6fd7a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:16.852544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232fb3e-f7d2-4562-a36a-260c1106a8f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:16.853339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232fb3e-f7d2-4562-a36a-260c1106a8f0 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:16.853628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232fb3e-f7d2-4562-a36a-260c1106a8f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:16.854415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232fb3e-f7d2-4562-a36a-260c1106a8f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:16.864099 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232fb3e-f7d2-4562-a36a-260c1106a8f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:16.865660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232fb3e-f7d2-4562-a36a-260c1106a8f0 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:16.876261 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4219/8439] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:11:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:11:18.272411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa63747-55ad-416d-8a47-b21023d78556 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:18.274006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-afa63747-55ad-416d-8a47-b21023d78556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:18.361658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa63747-55ad-416d-8a47-b21023d78556 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:18.366714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3656d6-f02f-4fb0-a84e-b77ea2d864c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:18.367412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3656d6-f02f-4fb0-a84e-b77ea2d864c8 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:18.367702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3656d6-f02f-4fb0-a84e-b77ea2d864c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:18.367982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3656d6-f02f-4fb0-a84e-b77ea2d864c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:18.369873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2d3656d6-f02f-4fb0-a84e-b77ea2d864c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:18.443848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3656d6-f02f-4fb0-a84e-b77ea2d864c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:18.445533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3656d6-f02f-4fb0-a84e-b77ea2d864c8 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:18.456648 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4221/8440] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:11:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:11:22.844358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e22831-e8c1-4d41-8daa-f53c00b1f726 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:22.844870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e22831-e8c1-4d41-8daa-f53c00b1f726 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:22.844870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e22831-e8c1-4d41-8daa-f53c00b1f726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:22.892791 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-31e22831-e8c1-4d41-8daa-f53c00b1f726 None None] MFA Rules not processed for user `c08e27179f8a482893c59d8c2c62b9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:11:22.894161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-31e22831-e8c1-4d41-8daa-f53c00b1f726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:22.967195 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4220/8441] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:11:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:11:22.972387 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3656d6-f02f-4fb0-a84e-b77ea2d864c8 service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:22.986247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3656d6-f02f-4fb0-a84e-b77ea2d864c8 service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:22.991670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4917f-aa66-46e3-b87a-98b7f229c102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:22.992290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4917f-aa66-46e3-b87a-98b7f229c102 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:22.992573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4917f-aa66-46e3-b87a-98b7f229c102 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:22.992851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4917f-aa66-46e3-b87a-98b7f229c102 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:22.993500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4917f-aa66-46e3-b87a-98b7f229c102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:22.995587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4917f-aa66-46e3-b87a-98b7f229c102 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:23.106443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:11:23.119556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e22831-e8c1-4d41-8daa-f53c00b1f726 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:23.127457 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4222/8442] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:11:22 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:11:23.132213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e22831-e8c1-4d41-8daa-f53c00b1f726 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:23.199165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a9bdb-2785-471d-860a-1365ac20932e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:23.200188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a9bdb-2785-471d-860a-1365ac20932e admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:23.200471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a9bdb-2785-471d-860a-1365ac20932e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:23.200744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a9bdb-2785-471d-860a-1365ac20932e admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:23.201377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a9bdb-2785-471d-860a-1365ac20932e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:23.203354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a9bdb-2785-471d-860a-1365ac20932e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:23.304962 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4221/8443] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:11:23 2022] POST /identity/v3/users => generated 296 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:11:23.309010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4917f-aa66-46e3-b87a-98b7f229c102 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:23.320478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4917f-aa66-46e3-b87a-98b7f229c102 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:23.325484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec001e-1872-423d-abec-41d2ee19496c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:23.326128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec001e-1872-423d-abec-41d2ee19496c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:23.326418 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec001e-1872-423d-abec-41d2ee19496c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:23.326695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec001e-1872-423d-abec-41d2ee19496c admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:23.327342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec001e-1872-423d-abec-41d2ee19496c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:23.329754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec001e-1872-423d-abec-41d2ee19496c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:23.341149 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4223/8444] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 04:11:23.346189 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a9bdb-2785-471d-860a-1365ac20932e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:23.357541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a9bdb-2785-471d-860a-1365ac20932e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:23.362435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7f6fe-2513-4a94-8d66-7c32b75219df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:23.363100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7f6fe-2513-4a94-8d66-7c32b75219df admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:23.363381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7f6fe-2513-4a94-8d66-7c32b75219df admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:23.363656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7f6fe-2513-4a94-8d66-7c32b75219df admin admin] PATH_INFO: `/v3/projects/4a399cbbf8d04f68b1a9b4795fee9592/users/eb9e98d46c6a4ea7ae98af1617999012/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:23.381204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7f6fe-2513-4a94-8d66-7c32b75219df admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a399cbbf8d04f68b1a9b4795fee9592, user_id=eb9e98d46c6a4ea7ae98af1617999012, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:23.383686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7f6fe-2513-4a94-8d66-7c32b75219df admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:23.489852 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4222/8445] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:11:23 2022] PUT /identity/v3/projects/4a399cbbf8d04f68b1a9b4795fee9592/users/eb9e98d46c6a4ea7ae98af1617999012/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:11:23.498867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec001e-1872-423d-abec-41d2ee19496c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:23.504567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec001e-1872-423d-abec-41d2ee19496c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:23.564163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817ea51-0b9b-4193-87d2-ff0cc71235c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:23.564779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817ea51-0b9b-4193-87d2-ff0cc71235c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:23.565090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817ea51-0b9b-4193-87d2-ff0cc71235c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:23.565372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817ea51-0b9b-4193-87d2-ff0cc71235c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:23.566025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817ea51-0b9b-4193-87d2-ff0cc71235c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:23.567703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817ea51-0b9b-4193-87d2-ff0cc71235c8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:23.578008 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4224/8446] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:11:23.583050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7f6fe-2513-4a94-8d66-7c32b75219df admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:23.601140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7f6fe-2513-4a94-8d66-7c32b75219df admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:23.606391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc023d-409f-477a-9842-5dffd514858d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:23.607068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc023d-409f-477a-9842-5dffd514858d admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:23.607352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc023d-409f-477a-9842-5dffd514858d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:23.607629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc023d-409f-477a-9842-5dffd514858d admin admin] PATH_INFO: `/v3/projects/4a399cbbf8d04f68b1a9b4795fee9592/users/eb9e98d46c6a4ea7ae98af1617999012/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:23.609618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc023d-409f-477a-9842-5dffd514858d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a399cbbf8d04f68b1a9b4795fee9592, user_id=eb9e98d46c6a4ea7ae98af1617999012, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:23.612555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc023d-409f-477a-9842-5dffd514858d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:23.623497 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4223/8447] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:11:23 2022] PUT /identity/v3/projects/4a399cbbf8d04f68b1a9b4795fee9592/users/eb9e98d46c6a4ea7ae98af1617999012/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:11:29.738365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b5d1e-6b4c-4a29-87b0-6f237c024819 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:29.738867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b5d1e-6b4c-4a29-87b0-6f237c024819 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:29.738945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b5d1e-6b4c-4a29-87b0-6f237c024819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:29.770293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ce8b5d1e-6b4c-4a29-87b0-6f237c024819 None None] MFA Rules not processed for user `eb9e98d46c6a4ea7ae98af1617999012`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:11:29.771538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ce8b5d1e-6b4c-4a29-87b0-6f237c024819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:29.877356 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4225/8448] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:11:29 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:11:29.892220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc023d-409f-477a-9842-5dffd514858d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:29.894147 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-efdc023d-409f-477a-9842-5dffd514858d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:29.918617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:11:29.992812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc023d-409f-477a-9842-5dffd514858d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:29.998635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978eacd9-6668-4901-a25f-0cd913fdf6bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:29.999263 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978eacd9-6668-4901-a25f-0cd913fdf6bf service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:29.999544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978eacd9-6668-4901-a25f-0cd913fdf6bf service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:29.999820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978eacd9-6668-4901-a25f-0cd913fdf6bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:30.010084 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978eacd9-6668-4901-a25f-0cd913fdf6bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:30.011719 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978eacd9-6668-4901-a25f-0cd913fdf6bf service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:30.025587 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4224/8449] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:11:29 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:11:31.426934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b5d1e-6b4c-4a29-87b0-6f237c024819 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:31.428426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ce8b5d1e-6b4c-4a29-87b0-6f237c024819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:31.507036 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b5d1e-6b4c-4a29-87b0-6f237c024819 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:31.512304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d9151-5cbe-4452-bbc3-c09e8faf7af3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:31.513009 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d9151-5cbe-4452-bbc3-c09e8faf7af3 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:31.513360 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d9151-5cbe-4452-bbc3-c09e8faf7af3 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:31.513711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d9151-5cbe-4452-bbc3-c09e8faf7af3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:31.515519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-aa7d9151-5cbe-4452-bbc3-c09e8faf7af3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:31.529621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d9151-5cbe-4452-bbc3-c09e8faf7af3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:31.531178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d9151-5cbe-4452-bbc3-c09e8faf7af3 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:31.535590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:11:31.544436 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4226/8450] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:11:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:11:32.133630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978eacd9-6668-4901-a25f-0cd913fdf6bf service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:32.135107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-978eacd9-6668-4901-a25f-0cd913fdf6bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:32.152359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978eacd9-6668-4901-a25f-0cd913fdf6bf service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:32.158523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e2b90-f10e-4317-b4c8-bbb4ed28179e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:32.159135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e2b90-f10e-4317-b4c8-bbb4ed28179e service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:32.159427 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e2b90-f10e-4317-b4c8-bbb4ed28179e service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:32.159707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e2b90-f10e-4317-b4c8-bbb4ed28179e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:32.161488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-250e2b90-f10e-4317-b4c8-bbb4ed28179e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:32.176436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e2b90-f10e-4317-b4c8-bbb4ed28179e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:32.178101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e2b90-f10e-4317-b4c8-bbb4ed28179e service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:32.191904 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4225/8451] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:11:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:11:32.940783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24789b98-462a-4d2b-812a-e5c67695e3fd None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:32.941354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24789b98-462a-4d2b-812a-e5c67695e3fd None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:32.941626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24789b98-462a-4d2b-812a-e5c67695e3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:32.964545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-24789b98-462a-4d2b-812a-e5c67695e3fd None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:11:32.965941 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-24789b98-462a-4d2b-812a-e5c67695e3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:33.032336 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4227/8452] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 04:11:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:11:33.212340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e2b90-f10e-4317-b4c8-bbb4ed28179e service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:33.213807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-250e2b90-f10e-4317-b4c8-bbb4ed28179e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:33.305700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e2b90-f10e-4317-b4c8-bbb4ed28179e service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:33.312391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b6916-2780-4d2b-8ac9-e57baebcc5a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:33.313805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b6916-2780-4d2b-8ac9-e57baebcc5a9 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:33.314498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b6916-2780-4d2b-8ac9-e57baebcc5a9 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:33.314921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b6916-2780-4d2b-8ac9-e57baebcc5a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:33.326595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b6916-2780-4d2b-8ac9-e57baebcc5a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:33.328922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b6916-2780-4d2b-8ac9-e57baebcc5a9 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:33.340192 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4226/8453] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 04:11:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 04:11:36.916544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24789b98-462a-4d2b-812a-e5c67695e3fd None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:36.935559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24789b98-462a-4d2b-812a-e5c67695e3fd None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:36.940777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ed4f4-d34f-4ee8-b689-b1450e970d5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:36.941602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ed4f4-d34f-4ee8-b689-b1450e970d5e service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:36.942091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ed4f4-d34f-4ee8-b689-b1450e970d5e service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:36.942515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ed4f4-d34f-4ee8-b689-b1450e970d5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:36.944689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a65ed4f4-d34f-4ee8-b689-b1450e970d5e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:36.964046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ed4f4-d34f-4ee8-b689-b1450e970d5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:36.965994 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ed4f4-d34f-4ee8-b689-b1450e970d5e service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:36.980653 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4228/8454] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:11:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:11:40.913542 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b6916-2780-4d2b-8ac9-e57baebcc5a9 service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:40.986814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b6916-2780-4d2b-8ac9-e57baebcc5a9 service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:40.991447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55252072-526d-47c3-bcd1-744412660016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:40.992089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55252072-526d-47c3-bcd1-744412660016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:40.992375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55252072-526d-47c3-bcd1-744412660016 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:40.992664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55252072-526d-47c3-bcd1-744412660016 admin admin] PATH_INFO: `/v3/users/c08e27179f8a482893c59d8c2c62b9d5` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:40.994472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55252072-526d-47c3-bcd1-744412660016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c08e27179f8a482893c59d8c2c62b9d5)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:40.996419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55252072-526d-47c3-bcd1-744412660016 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:41.025405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:11:41.174876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-55252072-526d-47c3-bcd1-744412660016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c08e27179f8a482893c59d8c2c62b9d5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:41.174876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-55252072-526d-47c3-bcd1-744412660016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c08e27179f8a482893c59d8c2c62b9d5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:41.179169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-55252072-526d-47c3-bcd1-744412660016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c08e27179f8a482893c59d8c2c62b9d5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:41.197123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-55252072-526d-47c3-bcd1-744412660016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c08e27179f8a482893c59d8c2c62b9d5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:41.259698 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-55252072-526d-47c3-bcd1-744412660016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c08e27179f8a482893c59d8c2c62b9d5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:41.266967 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4227/8455] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:11:40 2022] DELETE /identity/v3/users/c08e27179f8a482893c59d8c2c62b9d5 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:11:41.843546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ed4f4-d34f-4ee8-b689-b1450e970d5e service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:41.858339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ed4f4-d34f-4ee8-b689-b1450e970d5e service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:41.921654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bd9a5-081e-44ce-8137-8c5380b596e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:41.922398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bd9a5-081e-44ce-8137-8c5380b596e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:41.926406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bd9a5-081e-44ce-8137-8c5380b596e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:41.926406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bd9a5-081e-44ce-8137-8c5380b596e2 admin admin] PATH_INFO: `/v3/projects/dd18b4c20dfc4a7a95052c0fa5a2b296` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:41.926406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69bd9a5-081e-44ce-8137-8c5380b596e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd18b4c20dfc4a7a95052c0fa5a2b296)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:41.926406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69bd9a5-081e-44ce-8137-8c5380b596e2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:42.044584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e69bd9a5-081e-44ce-8137-8c5380b596e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd18b4c20dfc4a7a95052c0fa5a2b296', 'request_id': 'req-e69bd9a5-081e-44ce-8137-8c5380b596e2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:42.051406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e69bd9a5-081e-44ce-8137-8c5380b596e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd18b4c20dfc4a7a95052c0fa5a2b296', 'request_id': 'req-e69bd9a5-081e-44ce-8137-8c5380b596e2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:42.056977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e69bd9a5-081e-44ce-8137-8c5380b596e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd18b4c20dfc4a7a95052c0fa5a2b296', 'request_id': 'req-e69bd9a5-081e-44ce-8137-8c5380b596e2'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:42.133586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e69bd9a5-081e-44ce-8137-8c5380b596e2 admin admin] The token cache is being invalidate because project dd18b4c20dfc4a7a95052c0fa5a2b296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:11:42.133796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e69bd9a5-081e-44ce-8137-8c5380b596e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:42.134455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-e69bd9a5-081e-44ce-8137-8c5380b596e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:42.136067 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4229/8456] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:11:41 2022] DELETE /identity/v3/projects/dd18b4c20dfc4a7a95052c0fa5a2b296 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:11:42.140261 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55252072-526d-47c3-bcd1-744412660016 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:42.141705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-55252072-526d-47c3-bcd1-744412660016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:42.155139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55252072-526d-47c3-bcd1-744412660016 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:42.224930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d557cf7-8cab-404f-85f5-b77070425ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:42.225577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d557cf7-8cab-404f-85f5-b77070425ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:42.225868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d557cf7-8cab-404f-85f5-b77070425ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:42.226254 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d557cf7-8cab-404f-85f5-b77070425ef7 admin admin] PATH_INFO: `/v3/users/eb9e98d46c6a4ea7ae98af1617999012` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:42.230375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d557cf7-8cab-404f-85f5-b77070425ef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb9e98d46c6a4ea7ae98af1617999012)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:42.230375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d557cf7-8cab-404f-85f5-b77070425ef7 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:42.434649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3d557cf7-8cab-404f-85f5-b77070425ef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb9e98d46c6a4ea7ae98af1617999012'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:42.435282 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3d557cf7-8cab-404f-85f5-b77070425ef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb9e98d46c6a4ea7ae98af1617999012'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:42.442469 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3d557cf7-8cab-404f-85f5-b77070425ef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb9e98d46c6a4ea7ae98af1617999012'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:42.455109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3d557cf7-8cab-404f-85f5-b77070425ef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb9e98d46c6a4ea7ae98af1617999012'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:42.528461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3d557cf7-8cab-404f-85f5-b77070425ef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb9e98d46c6a4ea7ae98af1617999012'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:42.535503 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4228/8457] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:11:42 2022] DELETE /identity/v3/users/eb9e98d46c6a4ea7ae98af1617999012 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 04:11:42.792924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bd9a5-081e-44ce-8137-8c5380b596e2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:42.794622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e69bd9a5-081e-44ce-8137-8c5380b596e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:42.808795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bd9a5-081e-44ce-8137-8c5380b596e2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:42.830944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:11:42.877974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd6ae2-af1f-40c9-9ace-0b98e21cbcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:42.878682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd6ae2-af1f-40c9-9ace-0b98e21cbcae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:42.878924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd6ae2-af1f-40c9-9ace-0b98e21cbcae admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:42.879206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd6ae2-af1f-40c9-9ace-0b98e21cbcae admin admin] PATH_INFO: `/v3/projects/4a399cbbf8d04f68b1a9b4795fee9592` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:42.880355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd6ae2-af1f-40c9-9ace-0b98e21cbcae admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a399cbbf8d04f68b1a9b4795fee9592)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:42.882319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd6ae2-af1f-40c9-9ace-0b98e21cbcae admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:43.003222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4dfd6ae2-af1f-40c9-9ace-0b98e21cbcae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a399cbbf8d04f68b1a9b4795fee9592', 'request_id': 'req-4dfd6ae2-af1f-40c9-9ace-0b98e21cbcae'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:43.009654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4dfd6ae2-af1f-40c9-9ace-0b98e21cbcae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a399cbbf8d04f68b1a9b4795fee9592', 'request_id': 'req-4dfd6ae2-af1f-40c9-9ace-0b98e21cbcae'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:43.015410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4dfd6ae2-af1f-40c9-9ace-0b98e21cbcae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a399cbbf8d04f68b1a9b4795fee9592', 'request_id': 'req-4dfd6ae2-af1f-40c9-9ace-0b98e21cbcae'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:43.094720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4dfd6ae2-af1f-40c9-9ace-0b98e21cbcae admin admin] The token cache is being invalidate because project 4a399cbbf8d04f68b1a9b4795fee9592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:11:43.095074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4dfd6ae2-af1f-40c9-9ace-0b98e21cbcae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:43.095596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4dfd6ae2-af1f-40c9-9ace-0b98e21cbcae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:43.097204 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4230/8458] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:11:42 2022] DELETE /identity/v3/projects/4a399cbbf8d04f68b1a9b4795fee9592 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:11:43.102350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54936fea-3b4a-46ca-9b19-ca850d3e4c91 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:43.102642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54936fea-3b4a-46ca-9b19-ca850d3e4c91 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:43.102956 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54936fea-3b4a-46ca-9b19-ca850d3e4c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:43.124031 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-54936fea-3b4a-46ca-9b19-ca850d3e4c91 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:11:43.125803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-54936fea-3b4a-46ca-9b19-ca850d3e4c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:43.138567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:11:43.190167 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4229/8459] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:11:43.197743 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017ccfd-6647-4276-b71b-26ca318562fc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:43.198060 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017ccfd-6647-4276-b71b-26ca318562fc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:43.198342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017ccfd-6647-4276-b71b-26ca318562fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:43.221797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f017ccfd-6647-4276-b71b-26ca318562fc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:11:43.223075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f017ccfd-6647-4276-b71b-26ca318562fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:43.231430 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4231/8460] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:11:43.235664 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54936fea-3b4a-46ca-9b19-ca850d3e4c91 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:43.246932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54936fea-3b4a-46ca-9b19-ca850d3e4c91 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:43.253139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84381f1-49cd-44fd-8681-03039a584aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:43.253768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84381f1-49cd-44fd-8681-03039a584aba admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:43.254087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84381f1-49cd-44fd-8681-03039a584aba admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:43.254372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84381f1-49cd-44fd-8681-03039a584aba admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:43.255128 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84381f1-49cd-44fd-8681-03039a584aba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:11:43.255447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84381f1-49cd-44fd-8681-03039a584aba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:43.257337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84381f1-49cd-44fd-8681-03039a584aba admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:43.271429 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4230/8461] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 04:11:43.275482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017ccfd-6647-4276-b71b-26ca318562fc None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:43.285763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017ccfd-6647-4276-b71b-26ca318562fc None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:43.294290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8345b6-1a8c-4eb8-8ac3-93cf38bbde5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:43.295187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8345b6-1a8c-4eb8-8ac3-93cf38bbde5f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:43.295732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8345b6-1a8c-4eb8-8ac3-93cf38bbde5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:43.296013 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8345b6-1a8c-4eb8-8ac3-93cf38bbde5f admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:43.296901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8345b6-1a8c-4eb8-8ac3-93cf38bbde5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:43.299616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8345b6-1a8c-4eb8-8ac3-93cf38bbde5f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:43.374430 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4232/8462] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:11:43 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:11:43.379062 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84381f1-49cd-44fd-8681-03039a584aba admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:43.389930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84381f1-49cd-44fd-8681-03039a584aba admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:43.448726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a11fe-caa1-4d14-ba9b-84b9f7995caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:43.449345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a11fe-caa1-4d14-ba9b-84b9f7995caf admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:43.449660 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a11fe-caa1-4d14-ba9b-84b9f7995caf admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:43.449943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a11fe-caa1-4d14-ba9b-84b9f7995caf admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:43.450681 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a11fe-caa1-4d14-ba9b-84b9f7995caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:43.452840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a11fe-caa1-4d14-ba9b-84b9f7995caf admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:43.546116 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4231/8463] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:11:43 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 04:11:43.550347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8345b6-1a8c-4eb8-8ac3-93cf38bbde5f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:43.560783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8345b6-1a8c-4eb8-8ac3-93cf38bbde5f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:43.566106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfc753-f0a0-41ca-ad8a-edfac616ae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:43.566715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfc753-f0a0-41ca-ad8a-edfac616ae87 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:43.566997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfc753-f0a0-41ca-ad8a-edfac616ae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:43.567272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfc753-f0a0-41ca-ad8a-edfac616ae87 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:43.572990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfc753-f0a0-41ca-ad8a-edfac616ae87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:43.572990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfc753-f0a0-41ca-ad8a-edfac616ae87 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:43.583792 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4233/8464] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:11:43.585064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a11fe-caa1-4d14-ba9b-84b9f7995caf admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:43.595573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a11fe-caa1-4d14-ba9b-84b9f7995caf admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:43.600603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d2d25-f350-4691-ae0a-78bffea5c6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:43.601251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d2d25-f350-4691-ae0a-78bffea5c6fb admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:43.601533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d2d25-f350-4691-ae0a-78bffea5c6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:43.601815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d2d25-f350-4691-ae0a-78bffea5c6fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:43.602527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d2d25-f350-4691-ae0a-78bffea5c6fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:43.604199 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d2d25-f350-4691-ae0a-78bffea5c6fb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:43.619134 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4232/8465] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:11:43.621986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfc753-f0a0-41ca-ad8a-edfac616ae87 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:43.631355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfc753-f0a0-41ca-ad8a-edfac616ae87 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:43.635982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06327b5c-780b-416d-8cdf-a0faabfffe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:43.636646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06327b5c-780b-416d-8cdf-a0faabfffe89 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:43.636928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06327b5c-780b-416d-8cdf-a0faabfffe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:43.637204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06327b5c-780b-416d-8cdf-a0faabfffe89 admin admin] PATH_INFO: `/v3/projects/8989d67034a84b35938b18028cc047c7/users/ee1f80f4a10b4f07b0a55afdd170eb99/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:43.652174 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06327b5c-780b-416d-8cdf-a0faabfffe89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8989d67034a84b35938b18028cc047c7, user_id=ee1f80f4a10b4f07b0a55afdd170eb99, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:43.654887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06327b5c-780b-416d-8cdf-a0faabfffe89 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:43.723077 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4234/8466] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:11:43 2022] PUT /identity/v3/projects/8989d67034a84b35938b18028cc047c7/users/ee1f80f4a10b4f07b0a55afdd170eb99/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:11:43.734382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c72812-c2e2-4db6-aad6-2802d63ee6cd None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:43.735183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c72812-c2e2-4db6-aad6-2802d63ee6cd None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:43.735462 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c72812-c2e2-4db6-aad6-2802d63ee6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:43.764682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-51c72812-c2e2-4db6-aad6-2802d63ee6cd None None] MFA Rules not processed for user `ee1f80f4a10b4f07b0a55afdd170eb99`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:11:43.765921 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-51c72812-c2e2-4db6-aad6-2802d63ee6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:43.836396 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4233/8467] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:11:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:11:43.840974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06327b5c-780b-416d-8cdf-a0faabfffe89 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:43.892213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:11:43.907268 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06327b5c-780b-416d-8cdf-a0faabfffe89 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:43.911992 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9401b-2b39-48c6-83b0-f75b24bbef9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:43.912613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9401b-2b39-48c6-83b0-f75b24bbef9c admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:43.912910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9401b-2b39-48c6-83b0-f75b24bbef9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:43.913189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9401b-2b39-48c6-83b0-f75b24bbef9c admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:43.913839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9401b-2b39-48c6-83b0-f75b24bbef9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:43.915795 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9401b-2b39-48c6-83b0-f75b24bbef9c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:43.997212 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4235/8468] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:11:43 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:11:44.001451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c72812-c2e2-4db6-aad6-2802d63ee6cd None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:44.012655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c72812-c2e2-4db6-aad6-2802d63ee6cd None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:44.022779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:11:44.074306 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd73866-a3f9-4482-a6ad-7903fb6d3579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:44.074931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd73866-a3f9-4482-a6ad-7903fb6d3579 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:44.075217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd73866-a3f9-4482-a6ad-7903fb6d3579 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:44.075495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd73866-a3f9-4482-a6ad-7903fb6d3579 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:44.076130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd73866-a3f9-4482-a6ad-7903fb6d3579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:44.080400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd73866-a3f9-4482-a6ad-7903fb6d3579 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:44.168595 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4234/8469] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:11:44 2022] POST /identity/v3/users => generated 301 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 04:11:44.173261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9401b-2b39-48c6-83b0-f75b24bbef9c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:44.186351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9401b-2b39-48c6-83b0-f75b24bbef9c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:44.191361 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921b72a-4c0d-47e0-ad13-abc006f90819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:44.194423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921b72a-4c0d-47e0-ad13-abc006f90819 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:44.194827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921b72a-4c0d-47e0-ad13-abc006f90819 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:44.195208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921b72a-4c0d-47e0-ad13-abc006f90819 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:44.196194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921b72a-4c0d-47e0-ad13-abc006f90819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:44.197817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921b72a-4c0d-47e0-ad13-abc006f90819 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:44.210560 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4236/8470] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:11:44.214410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd73866-a3f9-4482-a6ad-7903fb6d3579 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:44.225580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd73866-a3f9-4482-a6ad-7903fb6d3579 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:44.230375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6cd50-0421-44f8-9b47-8da4d243bf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:44.231226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6cd50-0421-44f8-9b47-8da4d243bf24 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:44.231521 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6cd50-0421-44f8-9b47-8da4d243bf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:44.231802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6cd50-0421-44f8-9b47-8da4d243bf24 admin admin] PATH_INFO: `/v3/projects/0ed18b24fcef49d38981db0e582063ce/users/726864c0a48f421299ba0637ac72ce28/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:44.248779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6cd50-0421-44f8-9b47-8da4d243bf24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ed18b24fcef49d38981db0e582063ce, user_id=726864c0a48f421299ba0637ac72ce28, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:44.251600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6cd50-0421-44f8-9b47-8da4d243bf24 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:44.316153 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4235/8471] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:11:44 2022] PUT /identity/v3/projects/0ed18b24fcef49d38981db0e582063ce/users/726864c0a48f421299ba0637ac72ce28/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:11:44.326549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc84a73-16b7-4d01-9968-f6a7727f783e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:44.326846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc84a73-16b7-4d01-9968-f6a7727f783e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:44.327128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc84a73-16b7-4d01-9968-f6a7727f783e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:44.361023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2dc84a73-16b7-4d01-9968-f6a7727f783e None None] MFA Rules not processed for user `726864c0a48f421299ba0637ac72ce28`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:11:44.362821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2dc84a73-16b7-4d01-9968-f6a7727f783e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:44.446940 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4237/8472] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:11:44 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:11:44.476286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6cd50-0421-44f8-9b47-8da4d243bf24 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:44.478155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-82b6cd50-0421-44f8-9b47-8da4d243bf24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:44.553558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6cd50-0421-44f8-9b47-8da4d243bf24 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:44.559034 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89edf0f-9b3c-4f1d-853a-9363a9813b24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:44.559714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89edf0f-9b3c-4f1d-853a-9363a9813b24 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:44.559997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89edf0f-9b3c-4f1d-853a-9363a9813b24 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:44.560271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89edf0f-9b3c-4f1d-853a-9363a9813b24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:44.568627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89edf0f-9b3c-4f1d-853a-9363a9813b24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:44.570287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89edf0f-9b3c-4f1d-853a-9363a9813b24 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:44.580103 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4236/8473] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 04:11:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 04:11:47.709591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc84a73-16b7-4d01-9968-f6a7727f783e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:47.776312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc84a73-16b7-4d01-9968-f6a7727f783e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:47.781111 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc68f48-e9d7-4b45-a74a-b74dad7a810f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:47.782549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc68f48-e9d7-4b45-a74a-b74dad7a810f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:47.782834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc68f48-e9d7-4b45-a74a-b74dad7a810f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:47.783112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc68f48-e9d7-4b45-a74a-b74dad7a810f admin admin] PATH_INFO: `/v3/users/ee1f80f4a10b4f07b0a55afdd170eb99` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:47.784233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc68f48-e9d7-4b45-a74a-b74dad7a810f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee1f80f4a10b4f07b0a55afdd170eb99)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:47.786191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc68f48-e9d7-4b45-a74a-b74dad7a810f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:48.000816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-acc68f48-e9d7-4b45-a74a-b74dad7a810f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee1f80f4a10b4f07b0a55afdd170eb99'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:48.001487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-acc68f48-e9d7-4b45-a74a-b74dad7a810f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee1f80f4a10b4f07b0a55afdd170eb99'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:48.006333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:11:48.011330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-acc68f48-e9d7-4b45-a74a-b74dad7a810f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee1f80f4a10b4f07b0a55afdd170eb99'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:48.022070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-acc68f48-e9d7-4b45-a74a-b74dad7a810f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee1f80f4a10b4f07b0a55afdd170eb99'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:48.022812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-acc68f48-e9d7-4b45-a74a-b74dad7a810f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee1f80f4a10b4f07b0a55afdd170eb99'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:48.111077 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4238/8474] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:11:47 2022] DELETE /identity/v3/users/ee1f80f4a10b4f07b0a55afdd170eb99 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:11:48.115608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e56b7-89cb-449a-9e68-71e25e15814a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:48.116090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e56b7-89cb-449a-9e68-71e25e15814a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:48.116190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e56b7-89cb-449a-9e68-71e25e15814a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:48.136219 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a02e56b7-89cb-449a-9e68-71e25e15814a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:11:48.137436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a02e56b7-89cb-449a-9e68-71e25e15814a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:48.205334 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4237/8475] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:11:48.215729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc68f48-e9d7-4b45-a74a-b74dad7a810f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:48.217251 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-acc68f48-e9d7-4b45-a74a-b74dad7a810f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:48.282885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc68f48-e9d7-4b45-a74a-b74dad7a810f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:48.286727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a235ddf-ed65-480c-8234-a751fb077731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:48.287343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a235ddf-ed65-480c-8234-a751fb077731 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:48.287622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a235ddf-ed65-480c-8234-a751fb077731 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:48.287892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a235ddf-ed65-480c-8234-a751fb077731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:48.297286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a235ddf-ed65-480c-8234-a751fb077731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:48.298846 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a235ddf-ed65-480c-8234-a751fb077731 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:48.310862 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4239/8476] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:11:48.733787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e56b7-89cb-449a-9e68-71e25e15814a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:48.733787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a02e56b7-89cb-449a-9e68-71e25e15814a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:48.754295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e56b7-89cb-449a-9e68-71e25e15814a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:48.759126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1544d-7e46-4fc7-a6cb-3c58bab6468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:48.759758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1544d-7e46-4fc7-a6cb-3c58bab6468c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:48.760045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1544d-7e46-4fc7-a6cb-3c58bab6468c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:48.760422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1544d-7e46-4fc7-a6cb-3c58bab6468c admin admin] PATH_INFO: `/v3/projects/8989d67034a84b35938b18028cc047c7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:48.761873 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1544d-7e46-4fc7-a6cb-3c58bab6468c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8989d67034a84b35938b18028cc047c7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:48.764098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1544d-7e46-4fc7-a6cb-3c58bab6468c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:48.766855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:11:48.890434 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-21d1544d-7e46-4fc7-a6cb-3c58bab6468c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8989d67034a84b35938b18028cc047c7', 'request_id': 'req-21d1544d-7e46-4fc7-a6cb-3c58bab6468c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:48.968182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-21d1544d-7e46-4fc7-a6cb-3c58bab6468c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8989d67034a84b35938b18028cc047c7', 'request_id': 'req-21d1544d-7e46-4fc7-a6cb-3c58bab6468c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:48.983208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-21d1544d-7e46-4fc7-a6cb-3c58bab6468c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8989d67034a84b35938b18028cc047c7', 'request_id': 'req-21d1544d-7e46-4fc7-a6cb-3c58bab6468c'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:48.988715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-21d1544d-7e46-4fc7-a6cb-3c58bab6468c admin admin] The token cache is being invalidate because project 8989d67034a84b35938b18028cc047c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:11:48.989012 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-21d1544d-7e46-4fc7-a6cb-3c58bab6468c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:48.989691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-21d1544d-7e46-4fc7-a6cb-3c58bab6468c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:48.991286 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4238/8477] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:11:48 2022] DELETE /identity/v3/projects/8989d67034a84b35938b18028cc047c7 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:11:48.995205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a235ddf-ed65-480c-8234-a751fb077731 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:49.006187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a235ddf-ed65-480c-8234-a751fb077731 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:49.067068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa685f-9d9c-4722-a81b-4a17e19d4f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:49.067984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa685f-9d9c-4722-a81b-4a17e19d4f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:49.068277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa685f-9d9c-4722-a81b-4a17e19d4f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:49.068554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa685f-9d9c-4722-a81b-4a17e19d4f22 admin admin] PATH_INFO: `/v3/users/726864c0a48f421299ba0637ac72ce28` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:49.069728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa685f-9d9c-4722-a81b-4a17e19d4f22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=726864c0a48f421299ba0637ac72ce28)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:49.071744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa685f-9d9c-4722-a81b-4a17e19d4f22 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:49.228591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-00fa685f-9d9c-4722-a81b-4a17e19d4f22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '726864c0a48f421299ba0637ac72ce28'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:49.229250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-00fa685f-9d9c-4722-a81b-4a17e19d4f22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '726864c0a48f421299ba0637ac72ce28'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:49.237319 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-00fa685f-9d9c-4722-a81b-4a17e19d4f22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '726864c0a48f421299ba0637ac72ce28'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:49.250748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-00fa685f-9d9c-4722-a81b-4a17e19d4f22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '726864c0a48f421299ba0637ac72ce28'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:49.251800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-00fa685f-9d9c-4722-a81b-4a17e19d4f22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '726864c0a48f421299ba0637ac72ce28'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:49.253455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:11:49.397621 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4240/8478] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:11:48 2022] DELETE /identity/v3/users/726864c0a48f421299ba0637ac72ce28 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 04:11:50.317424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1544d-7e46-4fc7-a6cb-3c58bab6468c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:11:50.319037 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-21d1544d-7e46-4fc7-a6cb-3c58bab6468c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:11:50.334015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1544d-7e46-4fc7-a6cb-3c58bab6468c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:11:50.393484 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e846c8-dce0-4943-a0c6-8afea4d9afe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:11:50.394804 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e846c8-dce0-4943-a0c6-8afea4d9afe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:11:50.395102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e846c8-dce0-4943-a0c6-8afea4d9afe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:11:50.395378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e846c8-dce0-4943-a0c6-8afea4d9afe8 admin admin] PATH_INFO: `/v3/projects/0ed18b24fcef49d38981db0e582063ce` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:11:50.396494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e846c8-dce0-4943-a0c6-8afea4d9afe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ed18b24fcef49d38981db0e582063ce)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:11:50.398454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e846c8-dce0-4943-a0c6-8afea4d9afe8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:11:50.507458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-85e846c8-dce0-4943-a0c6-8afea4d9afe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ed18b24fcef49d38981db0e582063ce', 'request_id': 'req-85e846c8-dce0-4943-a0c6-8afea4d9afe8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:50.556463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-85e846c8-dce0-4943-a0c6-8afea4d9afe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ed18b24fcef49d38981db0e582063ce', 'request_id': 'req-85e846c8-dce0-4943-a0c6-8afea4d9afe8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:50.563270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-85e846c8-dce0-4943-a0c6-8afea4d9afe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ed18b24fcef49d38981db0e582063ce', 'request_id': 'req-85e846c8-dce0-4943-a0c6-8afea4d9afe8'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:50.574364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-85e846c8-dce0-4943-a0c6-8afea4d9afe8 admin admin] The token cache is being invalidate because project 0ed18b24fcef49d38981db0e582063ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:11:50.574654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-85e846c8-dce0-4943-a0c6-8afea4d9afe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:50.575292 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-85e846c8-dce0-4943-a0c6-8afea4d9afe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:11:50.576778 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4239/8479] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:11:50 2022] DELETE /identity/v3/projects/0ed18b24fcef49d38981db0e582063ce => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:11:59.585354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:12:00.571378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=74,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:12:02.403126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2fd5c-a8cb-4d74-87c3-d0c1d0d64557 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:12:02.403633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2fd5c-a8cb-4d74-87c3-d0c1d0d64557 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:12:02.403728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2fd5c-a8cb-4d74-87c3-d0c1d0d64557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:12:02.424297 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ece2fd5c-a8cb-4d74-87c3-d0c1d0d64557 None None] MFA Rules not processed for user `b7f5c179e8844542bca46d76042a6897`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:12:02.425506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ece2fd5c-a8cb-4d74-87c3-d0c1d0d64557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:12:02.485674 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4241/8480] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:12:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:12:02.526103 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e846c8-dce0-4943-a0c6-8afea4d9afe8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:12:02.527532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-85e846c8-dce0-4943-a0c6-8afea4d9afe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:12:02.583449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e846c8-dce0-4943-a0c6-8afea4d9afe8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:12:02.587665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451948b-a340-44bd-a8b3-d2e841d2a530 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:12:02.588273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451948b-a340-44bd-a8b3-d2e841d2a530 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:12:02.588558 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451948b-a340-44bd-a8b3-d2e841d2a530 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:12:02.588834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451948b-a340-44bd-a8b3-d2e841d2a530 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:12:02.590601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c451948b-a340-44bd-a8b3-d2e841d2a530 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:12:02.668865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451948b-a340-44bd-a8b3-d2e841d2a530 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:12:02.670478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451948b-a340-44bd-a8b3-d2e841d2a530 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:12:02.693680 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4240/8481] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:12:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:12:03.717509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2fd5c-a8cb-4d74-87c3-d0c1d0d64557 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:12:03.718925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ece2fd5c-a8cb-4d74-87c3-d0c1d0d64557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:12:03.776078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2fd5c-a8cb-4d74-87c3-d0c1d0d64557 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:12:03.779759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751434fd-d724-4d7e-b7f4-475bbf9d19e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:12:03.780370 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751434fd-d724-4d7e-b7f4-475bbf9d19e4 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:12:03.780654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751434fd-d724-4d7e-b7f4-475bbf9d19e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:12:03.780925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751434fd-d724-4d7e-b7f4-475bbf9d19e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:12:03.782633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-751434fd-d724-4d7e-b7f4-475bbf9d19e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:12:03.799031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751434fd-d724-4d7e-b7f4-475bbf9d19e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:12:03.800810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751434fd-d724-4d7e-b7f4-475bbf9d19e4 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:12:03.814307 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4242/8482] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:12:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:12:12.690958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=58 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:12:13.806932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=51 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:12:28.387210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451948b-a340-44bd-a8b3-d2e841d2a530 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:12:28.396590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451948b-a340-44bd-a8b3-d2e841d2a530 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:12:28.400382 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7474ad-3d94-41a9-85e5-837a435d088a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:12:28.400983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7474ad-3d94-41a9-85e5-837a435d088a service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:12:28.401293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7474ad-3d94-41a9-85e5-837a435d088a service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:12:28.401569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7474ad-3d94-41a9-85e5-837a435d088a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:12:28.403391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1d7474ad-3d94-41a9-85e5-837a435d088a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:12:28.467939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7474ad-3d94-41a9-85e5-837a435d088a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:12:28.469392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7474ad-3d94-41a9-85e5-837a435d088a service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:12:28.479243 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4241/8483] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:12:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:12:30.306915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751434fd-d724-4d7e-b7f4-475bbf9d19e4 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:12:30.308531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-751434fd-d724-4d7e-b7f4-475bbf9d19e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:12:30.325532 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751434fd-d724-4d7e-b7f4-475bbf9d19e4 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:12:30.331421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16267058-3194-4bfa-853d-708bb456b640 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:12:30.332075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16267058-3194-4bfa-853d-708bb456b640 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:12:30.332354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16267058-3194-4bfa-853d-708bb456b640 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:12:30.332628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16267058-3194-4bfa-853d-708bb456b640 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:12:30.334465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-16267058-3194-4bfa-853d-708bb456b640 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:12:30.350832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16267058-3194-4bfa-853d-708bb456b640 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:12:30.352483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16267058-3194-4bfa-853d-708bb456b640 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:12:30.366743 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4243/8484] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:12:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:12:38.474691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=30 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:12:40.359170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:13:37.323051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7474ad-3d94-41a9-85e5-837a435d088a service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:13:37.324524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1d7474ad-3d94-41a9-85e5-837a435d088a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:13:37.335763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7474ad-3d94-41a9-85e5-837a435d088a service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:13:37.339392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93380f9b-2006-458d-8453-490590a7b141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:13:37.339994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93380f9b-2006-458d-8453-490590a7b141 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:13:37.340279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93380f9b-2006-458d-8453-490590a7b141 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:13:37.340555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93380f9b-2006-458d-8453-490590a7b141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:13:37.342232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-93380f9b-2006-458d-8453-490590a7b141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:13:37.354505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93380f9b-2006-458d-8453-490590a7b141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:13:37.355945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93380f9b-2006-458d-8453-490590a7b141 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:13:37.367171 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4242/8485] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:13:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:13:47.360277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:14:43.663458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16267058-3194-4bfa-853d-708bb456b640 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:14:43.664908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-16267058-3194-4bfa-853d-708bb456b640 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:14:43.745686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16267058-3194-4bfa-853d-708bb456b640 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:14:43.750849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467d8c3-3841-41ad-a090-3317708a7cf1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:14:43.751453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467d8c3-3841-41ad-a090-3317708a7cf1 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:14:43.751734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467d8c3-3841-41ad-a090-3317708a7cf1 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:14:43.752015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467d8c3-3841-41ad-a090-3317708a7cf1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:14:43.753726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d467d8c3-3841-41ad-a090-3317708a7cf1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:14:43.767340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467d8c3-3841-41ad-a090-3317708a7cf1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:14:43.768907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467d8c3-3841-41ad-a090-3317708a7cf1 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:14:43.781083 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4244/8486] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:14:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:14:53.774443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=36 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:15:05.372508 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26de47a-3cd3-448c-958d-eb03fdb682f9 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:15:05.375247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26de47a-3cd3-448c-958d-eb03fdb682f9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:15:05.375247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26de47a-3cd3-448c-958d-eb03fdb682f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:15:05.392726 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f26de47a-3cd3-448c-958d-eb03fdb682f9 None None] MFA Rules not processed for user `b7f5c179e8844542bca46d76042a6897`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:15:05.393922 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f26de47a-3cd3-448c-958d-eb03fdb682f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:15:05.401380 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4243/8487] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:15:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:15:05.712997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467d8c3-3841-41ad-a090-3317708a7cf1 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:15:05.722695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467d8c3-3841-41ad-a090-3317708a7cf1 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:15:05.726472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167fe53-7f06-4d11-ac30-d58b48173ca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:15:05.727071 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167fe53-7f06-4d11-ac30-d58b48173ca4 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:15:05.727363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167fe53-7f06-4d11-ac30-d58b48173ca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:15:05.727639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167fe53-7f06-4d11-ac30-d58b48173ca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:15:05.729429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6167fe53-7f06-4d11-ac30-d58b48173ca4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:15:05.741328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167fe53-7f06-4d11-ac30-d58b48173ca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:15:05.742804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167fe53-7f06-4d11-ac30-d58b48173ca4 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:15:05.753578 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4245/8488] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:15:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:15:08.618699 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26de47a-3cd3-448c-958d-eb03fdb682f9 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:15:08.620079 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f26de47a-3cd3-448c-958d-eb03fdb682f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:15:08.637840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26de47a-3cd3-448c-958d-eb03fdb682f9 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:15:08.642851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08dcbd-360c-4e20-ac19-14529bba3c32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:15:08.643458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08dcbd-360c-4e20-ac19-14529bba3c32 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:15:08.643738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08dcbd-360c-4e20-ac19-14529bba3c32 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:15:08.644011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08dcbd-360c-4e20-ac19-14529bba3c32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:15:08.645744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9c08dcbd-360c-4e20-ac19-14529bba3c32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:15:08.658167 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08dcbd-360c-4e20-ac19-14529bba3c32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:15:08.659995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08dcbd-360c-4e20-ac19-14529bba3c32 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:15:08.670574 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4244/8489] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:15:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:15:13.177842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167fe53-7f06-4d11-ac30-d58b48173ca4 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:15:13.193344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167fe53-7f06-4d11-ac30-d58b48173ca4 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:15:13.205536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f4eab-47cd-4447-9c38-3c8c705f4062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:15:13.206767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f4eab-47cd-4447-9c38-3c8c705f4062 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:15:13.207495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f4eab-47cd-4447-9c38-3c8c705f4062 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:15:13.207827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f4eab-47cd-4447-9c38-3c8c705f4062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:15:13.209893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-331f4eab-47cd-4447-9c38-3c8c705f4062 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:15:13.226488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f4eab-47cd-4447-9c38-3c8c705f4062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:15:13.228028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f4eab-47cd-4447-9c38-3c8c705f4062 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:15:13.246819 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4246/8490] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:15:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:15:18.665667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=9 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:15:23.232791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=12 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:15:26.862727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08dcbd-360c-4e20-ac19-14529bba3c32 service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:15:26.864246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9c08dcbd-360c-4e20-ac19-14529bba3c32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:15:26.881979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08dcbd-360c-4e20-ac19-14529bba3c32 service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:15:26.887588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688ce1f-ae7a-465f-bd5b-a14f273d345f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:15:26.888190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688ce1f-ae7a-465f-bd5b-a14f273d345f service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:15:26.888472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688ce1f-ae7a-465f-bd5b-a14f273d345f service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:15:26.888749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688ce1f-ae7a-465f-bd5b-a14f273d345f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:15:26.890517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7688ce1f-ae7a-465f-bd5b-a14f273d345f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:15:26.905494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688ce1f-ae7a-465f-bd5b-a14f273d345f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:15:26.907182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688ce1f-ae7a-465f-bd5b-a14f273d345f service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:15:26.921603 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4245/8491] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:15:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:15:36.913374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:15:42.353131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f4eab-47cd-4447-9c38-3c8c705f4062 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:15:42.367935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f4eab-47cd-4447-9c38-3c8c705f4062 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:15:42.373666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f405b5-f921-4509-9119-d4d1d4215fe6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:15:42.374303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f405b5-f921-4509-9119-d4d1d4215fe6 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:15:42.374584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f405b5-f921-4509-9119-d4d1d4215fe6 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:15:42.374858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f405b5-f921-4509-9119-d4d1d4215fe6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:15:42.376571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-99f405b5-f921-4509-9119-d4d1d4215fe6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:15:42.390629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f405b5-f921-4509-9119-d4d1d4215fe6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:15:42.392193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f405b5-f921-4509-9119-d4d1d4215fe6 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:15:42.404899 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4247/8492] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:15:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:15:52.397740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:17:29.839796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6ede8-d419-426f-bc8a-02716d8fd721 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:17:29.840239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6ede8-d419-426f-bc8a-02716d8fd721 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:17:29.840385 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6ede8-d419-426f-bc8a-02716d8fd721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:17:29.880867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-68f6ede8-d419-426f-bc8a-02716d8fd721 None None] MFA Rules not processed for user `5ec1d24520c447a38ed321f62d4f9e98`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:17:29.882115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-68f6ede8-d419-426f-bc8a-02716d8fd721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:17:29.917742 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4246/8493] 10.222.0.20 () {58 vars in 1060 bytes} [Thu Oct 27 04:17:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:17:29.923831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f405b5-f921-4509-9119-d4d1d4215fe6 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:17:29.942438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f405b5-f921-4509-9119-d4d1d4215fe6 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:17:29.946178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03024c0e-3000-4f32-93ba-52831fe1dbab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:17:29.949533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03024c0e-3000-4f32-93ba-52831fe1dbab service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:17:29.949533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03024c0e-3000-4f32-93ba-52831fe1dbab service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:17:29.949533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03024c0e-3000-4f32-93ba-52831fe1dbab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:17:29.949533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-03024c0e-3000-4f32-93ba-52831fe1dbab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:17:29.996829 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03024c0e-3000-4f32-93ba-52831fe1dbab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:17:29.998358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03024c0e-3000-4f32-93ba-52831fe1dbab service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:17:30.017595 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4248/8494] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:17:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:17:39.914988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=25 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:17:40.014885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=30 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:17:43.318017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4ee04-130f-408e-8b01-ed63e720c47c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:17:43.318591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4ee04-130f-408e-8b01-ed63e720c47c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:17:43.318854 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4ee04-130f-408e-8b01-ed63e720c47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:17:43.342068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-69c4ee04-130f-408e-8b01-ed63e720c47c None None] MFA Rules not processed for user `1a395d2414cd4da085a77ddc9b1f1caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:17:43.343291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-69c4ee04-130f-408e-8b01-ed63e720c47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:17:43.365200 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4247/8495] 10.222.0.44 () {58 vars in 1015 bytes} [Thu Oct 27 04:17:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 04:17:43.377057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3e977-5425-48c9-9ea2-dacf622c73ea None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:17:43.377470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3e977-5425-48c9-9ea2-dacf622c73ea None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:17:43.377608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3e977-5425-48c9-9ea2-dacf622c73ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:17:43.398187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6df3e977-5425-48c9-9ea2-dacf622c73ea None None] MFA Rules not processed for user `1a395d2414cd4da085a77ddc9b1f1caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:17:43.399473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6df3e977-5425-48c9-9ea2-dacf622c73ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:17:43.408180 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4249/8496] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Oct 27 04:17:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:17:43.415092 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4ee04-130f-408e-8b01-ed63e720c47c None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:17:43.425616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4ee04-130f-408e-8b01-ed63e720c47c None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:17:43.431368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5badd-9851-4193-82b9-37dc0143f2bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:17:43.432025 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5badd-9851-4193-82b9-37dc0143f2bb service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:17:43.432309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5badd-9851-4193-82b9-37dc0143f2bb service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:17:43.432695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5badd-9851-4193-82b9-37dc0143f2bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:17:43.441400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5badd-9851-4193-82b9-37dc0143f2bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:17:43.443078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5badd-9851-4193-82b9-37dc0143f2bb service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:17:43.452848 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4248/8497] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:17:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:17:45.595052 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12207c62-3ab7-4ae9-9a3e-5852343b3b9e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:17:45.595608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12207c62-3ab7-4ae9-9a3e-5852343b3b9e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:17:45.595608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12207c62-3ab7-4ae9-9a3e-5852343b3b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:17:45.619440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-12207c62-3ab7-4ae9-9a3e-5852343b3b9e None None] MFA Rules not processed for user `1a395d2414cd4da085a77ddc9b1f1caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:17:45.620643 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-12207c62-3ab7-4ae9-9a3e-5852343b3b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:17:45.629199 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4250/8498] 10.222.0.18 () {58 vars in 1015 bytes} [Thu Oct 27 04:17:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:17:45.644852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3959ee6-04e1-42c0-acbb-8d3ba8165fb4 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:17:45.645326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3959ee6-04e1-42c0-acbb-8d3ba8165fb4 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:17:45.645473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3959ee6-04e1-42c0-acbb-8d3ba8165fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:17:45.667202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b3959ee6-04e1-42c0-acbb-8d3ba8165fb4 None None] MFA Rules not processed for user `1a395d2414cd4da085a77ddc9b1f1caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:17:45.668518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b3959ee6-04e1-42c0-acbb-8d3ba8165fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:17:45.677838 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4249/8499] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Oct 27 04:17:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:17:45.684262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12207c62-3ab7-4ae9-9a3e-5852343b3b9e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:17:45.697843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12207c62-3ab7-4ae9-9a3e-5852343b3b9e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:17:45.702962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafd362-f923-4cae-9130-6f957eda9360 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:17:45.703566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafd362-f923-4cae-9130-6f957eda9360 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:17:45.703848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafd362-f923-4cae-9130-6f957eda9360 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:17:45.704122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafd362-f923-4cae-9130-6f957eda9360 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:17:45.712991 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bafd362-f923-4cae-9130-6f957eda9360 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:17:45.714609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bafd362-f923-4cae-9130-6f957eda9360 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:17:45.728351 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4251/8500] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:17:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:17:55.663404 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=15 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:17:55.722534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=12 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:17:56.448769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02374c37-7993-4852-be52-3cffcf425101 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:17:56.453986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02374c37-7993-4852-be52-3cffcf425101 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:17:56.453986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02374c37-7993-4852-be52-3cffcf425101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:17:56.478075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-02374c37-7993-4852-be52-3cffcf425101 None None] MFA Rules not processed for user `b7f5c179e8844542bca46d76042a6897`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:17:56.479299 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-02374c37-7993-4852-be52-3cffcf425101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:17:56.486141 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4250/8501] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:17:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:17:56.532698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafd362-f923-4cae-9130-6f957eda9360 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:17:56.542552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafd362-f923-4cae-9130-6f957eda9360 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:17:56.546207 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ae744-a080-4b54-b767-ecd4ebf31e26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:17:56.546805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ae744-a080-4b54-b767-ecd4ebf31e26 service cinder] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:17:56.547093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ae744-a080-4b54-b767-ecd4ebf31e26 service cinder] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:17:56.547368 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ae744-a080-4b54-b767-ecd4ebf31e26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:17:56.560263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ae744-a080-4b54-b767-ecd4ebf31e26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:17:56.561750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ae744-a080-4b54-b767-ecd4ebf31e26 service cinder] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:17:56.575728 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4252/8502] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:17:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:17:56.868077 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02374c37-7993-4852-be52-3cffcf425101 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:17:56.877668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02374c37-7993-4852-be52-3cffcf425101 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:17:56.881278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986de68-fd8d-4209-bc8f-f9e3fb25055f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:17:56.882461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986de68-fd8d-4209-bc8f-f9e3fb25055f service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:17:56.882746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986de68-fd8d-4209-bc8f-f9e3fb25055f service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:17:56.883027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986de68-fd8d-4209-bc8f-f9e3fb25055f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:17:56.884768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4986de68-fd8d-4209-bc8f-f9e3fb25055f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:17:56.911271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986de68-fd8d-4209-bc8f-f9e3fb25055f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:17:56.912767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986de68-fd8d-4209-bc8f-f9e3fb25055f service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:17:56.923437 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4251/8503] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:17:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:17:58.666472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ae744-a080-4b54-b767-ecd4ebf31e26 service cinder] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:17:58.677736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ae744-a080-4b54-b767-ecd4ebf31e26 service cinder] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:17:58.682816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4418b7-46b7-4ee5-8eff-ca028c92f5b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:17:58.683413 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4418b7-46b7-4ee5-8eff-ca028c92f5b6 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:17:58.683696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4418b7-46b7-4ee5-8eff-ca028c92f5b6 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:17:58.683968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4418b7-46b7-4ee5-8eff-ca028c92f5b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:17:58.685684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-dd4418b7-46b7-4ee5-8eff-ca028c92f5b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:17:58.692715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986de68-fd8d-4209-bc8f-f9e3fb25055f service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:17:58.698518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4418b7-46b7-4ee5-8eff-ca028c92f5b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:17:58.701976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4418b7-46b7-4ee5-8eff-ca028c92f5b6 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:17:58.702201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986de68-fd8d-4209-bc8f-f9e3fb25055f service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:17:58.705068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f89e66-845d-4bcb-978d-f9f5cb5e6edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:17:58.705675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f89e66-845d-4bcb-978d-f9f5cb5e6edc service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:17:58.705959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f89e66-845d-4bcb-978d-f9f5cb5e6edc service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:17:58.706356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f89e66-845d-4bcb-978d-f9f5cb5e6edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:17:58.711329 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4253/8504] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:17:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:17:58.720579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f89e66-845d-4bcb-978d-f9f5cb5e6edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:17:58.722016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f89e66-845d-4bcb-978d-f9f5cb5e6edc service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:17:58.736324 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4252/8505] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:17:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:18:02.799970 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4418b7-46b7-4ee5-8eff-ca028c92f5b6 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:18:02.816518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4418b7-46b7-4ee5-8eff-ca028c92f5b6 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:18:02.823358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed219e-8457-406c-9c41-438bb3218527 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:18:02.828399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed219e-8457-406c-9c41-438bb3218527 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:18:02.828399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed219e-8457-406c-9c41-438bb3218527 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:18:02.828399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed219e-8457-406c-9c41-438bb3218527 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:18:02.828399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1fed219e-8457-406c-9c41-438bb3218527 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:18:02.843560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed219e-8457-406c-9c41-438bb3218527 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:18:02.845613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed219e-8457-406c-9c41-438bb3218527 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:18:02.860113 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4254/8506] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:18:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:18:08.728727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=23 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:18:12.852596 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=18 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:18:20.432344 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f89e66-845d-4bcb-978d-f9f5cb5e6edc service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:18:20.440872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f89e66-845d-4bcb-978d-f9f5cb5e6edc service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:18:20.444563 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3390e7-1969-45eb-83d4-d29f7b502382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:18:20.445149 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3390e7-1969-45eb-83d4-d29f7b502382 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:18:20.445428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3390e7-1969-45eb-83d4-d29f7b502382 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:18:20.445700 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3390e7-1969-45eb-83d4-d29f7b502382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:18:20.454691 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3390e7-1969-45eb-83d4-d29f7b502382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:18:20.456125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3390e7-1969-45eb-83d4-d29f7b502382 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:18:20.484859 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4253/8507] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:18:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:18:30.482067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=13 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:18:44.385534 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed219e-8457-406c-9c41-438bb3218527 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:18:44.395428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed219e-8457-406c-9c41-438bb3218527 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:18:44.399198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e7265-b8ef-4cf1-9b9c-199399b408f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:18:44.399800 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e7265-b8ef-4cf1-9b9c-199399b408f5 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:18:44.400087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e7265-b8ef-4cf1-9b9c-199399b408f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:18:44.400365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e7265-b8ef-4cf1-9b9c-199399b408f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:18:44.411483 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e7265-b8ef-4cf1-9b9c-199399b408f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:18:44.412949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e7265-b8ef-4cf1-9b9c-199399b408f5 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:18:44.423641 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4255/8508] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:18:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:18:54.417443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:19:38.087245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cf59c-28f8-4b36-8c1e-c8913ae9985a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:19:38.087801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cf59c-28f8-4b36-8c1e-c8913ae9985a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:19:38.087801 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cf59c-28f8-4b36-8c1e-c8913ae9985a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:19:38.109278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-772cf59c-28f8-4b36-8c1e-c8913ae9985a None None] MFA Rules not processed for user `9b359391fbc34c259d987e42e8826c86`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:19:38.110532 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-772cf59c-28f8-4b36-8c1e-c8913ae9985a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:19:38.117266 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4254/8509] 10.222.0.44 () {58 vars in 1015 bytes} [Thu Oct 27 04:19:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:19:38.129032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e7265-b8ef-4cf1-9b9c-199399b408f5 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:19:38.138261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e7265-b8ef-4cf1-9b9c-199399b408f5 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:19:38.141973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5107c-730d-4782-8e56-2b8a883d8e1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:19:38.142599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5107c-730d-4782-8e56-2b8a883d8e1e service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:19:38.142885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5107c-730d-4782-8e56-2b8a883d8e1e service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:19:38.143161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5107c-730d-4782-8e56-2b8a883d8e1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:19:38.150149 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5107c-730d-4782-8e56-2b8a883d8e1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:19:38.151584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5107c-730d-4782-8e56-2b8a883d8e1e service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:19:38.159943 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4256/8510] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:19:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:19:45.315920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a33e91-4fb4-46b7-983e-77004d087b5e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:19:45.316486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a33e91-4fb4-46b7-983e-77004d087b5e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:19:45.316486 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a33e91-4fb4-46b7-983e-77004d087b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:19:45.365067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d4a33e91-4fb4-46b7-983e-77004d087b5e None None] MFA Rules not processed for user `9b359391fbc34c259d987e42e8826c86`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:19:45.366349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d4a33e91-4fb4-46b7-983e-77004d087b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:19:45.372920 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4255/8511] 10.222.0.18 () {58 vars in 1015 bytes} [Thu Oct 27 04:19:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:19:45.388923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5107c-730d-4782-8e56-2b8a883d8e1e service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:19:45.397959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5107c-730d-4782-8e56-2b8a883d8e1e service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:19:45.401601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b62bf-5490-4419-8966-049cbcfedbc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:19:45.402241 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b62bf-5490-4419-8966-049cbcfedbc4 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:19:45.402526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b62bf-5490-4419-8966-049cbcfedbc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:19:45.402802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b62bf-5490-4419-8966-049cbcfedbc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:19:45.410408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b62bf-5490-4419-8966-049cbcfedbc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:19:45.411854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b62bf-5490-4419-8966-049cbcfedbc4 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:19:45.419635 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4257/8512] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:19:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:19:55.362659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=16 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:19:55.416114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=12 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:20:26.038904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45525a5f-45dd-489d-a0fa-763aa7166705 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:20:26.039819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45525a5f-45dd-489d-a0fa-763aa7166705 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:20:26.040376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45525a5f-45dd-489d-a0fa-763aa7166705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:20:26.101598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-45525a5f-45dd-489d-a0fa-763aa7166705 None None] MFA Rules not processed for user `c20881251f2241a3a5ec2e5cf99db149`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:20:26.103140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-45525a5f-45dd-489d-a0fa-763aa7166705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:20:26.122780 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4256/8513] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 04:20:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:20:26.141775 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efd3f8-1e96-4016-a74c-81b35e7e9a83 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:20:26.146567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efd3f8-1e96-4016-a74c-81b35e7e9a83 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:20:26.146567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efd3f8-1e96-4016-a74c-81b35e7e9a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:20:26.162443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-23efd3f8-1e96-4016-a74c-81b35e7e9a83 None None] MFA Rules not processed for user `c20881251f2241a3a5ec2e5cf99db149`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:20:26.163669 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-23efd3f8-1e96-4016-a74c-81b35e7e9a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:20:26.173434 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4258/8514] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Oct 27 04:20:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:20:26.181045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45525a5f-45dd-489d-a0fa-763aa7166705 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:20:26.199906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45525a5f-45dd-489d-a0fa-763aa7166705 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:20:26.205620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe239386-94d6-46f1-b2ac-da28c1897c17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:20:26.206278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe239386-94d6-46f1-b2ac-da28c1897c17 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:20:26.206595 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe239386-94d6-46f1-b2ac-da28c1897c17 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:20:26.206871 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe239386-94d6-46f1-b2ac-da28c1897c17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:20:26.217295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe239386-94d6-46f1-b2ac-da28c1897c17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:20:26.222564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe239386-94d6-46f1-b2ac-da28c1897c17 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:20:26.231536 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4257/8515] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:20:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:20:26.484515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb03da8-1cb4-4b5d-b55c-7bcd67e70957 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:20:26.485004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb03da8-1cb4-4b5d-b55c-7bcd67e70957 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:20:26.485392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb03da8-1cb4-4b5d-b55c-7bcd67e70957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:20:26.508131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-deb03da8-1cb4-4b5d-b55c-7bcd67e70957 None None] MFA Rules not processed for user `c20881251f2241a3a5ec2e5cf99db149`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:20:26.509741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-deb03da8-1cb4-4b5d-b55c-7bcd67e70957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:20:26.520172 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4259/8516] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 04:20:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 04:20:26.532286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe239386-94d6-46f1-b2ac-da28c1897c17 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:20:26.542945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe239386-94d6-46f1-b2ac-da28c1897c17 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:20:26.546946 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f50537-5255-4a76-ad0c-673bcbc60b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:20:26.547638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f50537-5255-4a76-ad0c-673bcbc60b7b service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:20:26.548013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f50537-5255-4a76-ad0c-673bcbc60b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:20:26.548298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f50537-5255-4a76-ad0c-673bcbc60b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:20:26.559281 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f50537-5255-4a76-ad0c-673bcbc60b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:20:26.560887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f50537-5255-4a76-ad0c-673bcbc60b7b service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:20:26.572526 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4258/8517] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:20:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:20:27.766582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc44f60-b70b-4850-8dcf-573bfea6580f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:20:27.767099 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc44f60-b70b-4850-8dcf-573bfea6580f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:20:27.767194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc44f60-b70b-4850-8dcf-573bfea6580f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:20:27.786888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-5dc44f60-b70b-4850-8dcf-573bfea6580f None None] MFA Rules not processed for user `c20881251f2241a3a5ec2e5cf99db149`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:20:27.788112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5dc44f60-b70b-4850-8dcf-573bfea6580f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:20:27.797128 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4260/8518] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Oct 27 04:20:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:20:27.803322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223eb5ed-b274-4a93-bbc1-da1ee6a9f200 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:20:27.803775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223eb5ed-b274-4a93-bbc1-da1ee6a9f200 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:20:27.803909 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223eb5ed-b274-4a93-bbc1-da1ee6a9f200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:20:27.823612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-223eb5ed-b274-4a93-bbc1-da1ee6a9f200 None None] MFA Rules not processed for user `c20881251f2241a3a5ec2e5cf99db149`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:20:27.824880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-223eb5ed-b274-4a93-bbc1-da1ee6a9f200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:20:27.835206 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4259/8519] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 04:20:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:20:27.862693 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc44f60-b70b-4850-8dcf-573bfea6580f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:20:27.872100 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc44f60-b70b-4850-8dcf-573bfea6580f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:20:27.875786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8ae1f-7c91-477a-a5c3-17d10ed2d7e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:20:27.876403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8ae1f-7c91-477a-a5c3-17d10ed2d7e7 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:20:27.876688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8ae1f-7c91-477a-a5c3-17d10ed2d7e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:20:27.876965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8ae1f-7c91-477a-a5c3-17d10ed2d7e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:20:27.887461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8ae1f-7c91-477a-a5c3-17d10ed2d7e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:20:27.889668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8ae1f-7c91-477a-a5c3-17d10ed2d7e7 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:20:27.900776 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4261/8520] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:20:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:20:28.760397 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae88db4-b74b-455c-b7dd-ac041fb46dfe None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:20:28.760690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae88db4-b74b-455c-b7dd-ac041fb46dfe None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:20:28.760976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae88db4-b74b-455c-b7dd-ac041fb46dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:20:28.780384 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-3ae88db4-b74b-455c-b7dd-ac041fb46dfe None None] MFA Rules not processed for user `c20881251f2241a3a5ec2e5cf99db149`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:20:28.781600 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3ae88db4-b74b-455c-b7dd-ac041fb46dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:20:28.790859 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4260/8521] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 04:20:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:20:28.806184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8ae1f-7c91-477a-a5c3-17d10ed2d7e7 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:20:28.825224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8ae1f-7c91-477a-a5c3-17d10ed2d7e7 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:20:28.831206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8f6ea-2f64-4d37-bda3-afcf5e94100e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:20:28.832041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8f6ea-2f64-4d37-bda3-afcf5e94100e service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:20:28.832204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8f6ea-2f64-4d37-bda3-afcf5e94100e service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:20:28.832498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8f6ea-2f64-4d37-bda3-afcf5e94100e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:20:28.842203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8f6ea-2f64-4d37-bda3-afcf5e94100e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:20:28.843950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8f6ea-2f64-4d37-bda3-afcf5e94100e service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:20:28.854645 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4262/8522] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:20:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:20:38.775096 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=34 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:20:38.850374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=21 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:20:52.803813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae88db4-b74b-455c-b7dd-ac041fb46dfe None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:20:52.813284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae88db4-b74b-455c-b7dd-ac041fb46dfe None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:20:52.817578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed53655-0fe5-4a2d-8304-13b30d4ac3a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:20:52.818216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed53655-0fe5-4a2d-8304-13b30d4ac3a2 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:20:52.818497 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed53655-0fe5-4a2d-8304-13b30d4ac3a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:20:52.818769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed53655-0fe5-4a2d-8304-13b30d4ac3a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:20:52.820459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3ed53655-0fe5-4a2d-8304-13b30d4ac3a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:20:52.905639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed53655-0fe5-4a2d-8304-13b30d4ac3a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:20:52.907225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed53655-0fe5-4a2d-8304-13b30d4ac3a2 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:20:52.918679 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4261/8523] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:20:56.542088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8f6ea-2f64-4d37-bda3-afcf5e94100e service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:20:56.566814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8f6ea-2f64-4d37-bda3-afcf5e94100e service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:20:56.574721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a605da0-19e7-46c6-805c-98847889380e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:20:56.575711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a605da0-19e7-46c6-805c-98847889380e service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:20:56.576134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a605da0-19e7-46c6-805c-98847889380e service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:20:56.576580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a605da0-19e7-46c6-805c-98847889380e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:20:56.579946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9a605da0-19e7-46c6-805c-98847889380e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:20:56.628511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a605da0-19e7-46c6-805c-98847889380e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:20:56.630438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a605da0-19e7-46c6-805c-98847889380e service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:20:56.645986 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4263/8524] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:20:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:20:59.936970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed53655-0fe5-4a2d-8304-13b30d4ac3a2 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:20:59.949181 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed53655-0fe5-4a2d-8304-13b30d4ac3a2 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:20:59.954670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58065c11-2394-40a5-9bad-c22d4c83d338 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:20:59.955334 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58065c11-2394-40a5-9bad-c22d4c83d338 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:20:59.955662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58065c11-2394-40a5-9bad-c22d4c83d338 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:20:59.955941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58065c11-2394-40a5-9bad-c22d4c83d338 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:20:59.958426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-58065c11-2394-40a5-9bad-c22d4c83d338 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:20:59.973389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58065c11-2394-40a5-9bad-c22d4c83d338 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:20:59.975033 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58065c11-2394-40a5-9bad-c22d4c83d338 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:20:59.987678 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4262/8525] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:20:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:21:00.044073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a605da0-19e7-46c6-805c-98847889380e service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:00.045546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9a605da0-19e7-46c6-805c-98847889380e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:00.060675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a605da0-19e7-46c6-805c-98847889380e service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:00.065511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e606138-4873-4cc0-b74d-e5d96d4fb04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:00.066180 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e606138-4873-4cc0-b74d-e5d96d4fb04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:00.067039 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e606138-4873-4cc0-b74d-e5d96d4fb04d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:00.067323 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e606138-4873-4cc0-b74d-e5d96d4fb04d admin admin] PATH_INFO: `/v3/users/b7f5c179e8844542bca46d76042a6897` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:00.068458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e606138-4873-4cc0-b74d-e5d96d4fb04d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7f5c179e8844542bca46d76042a6897)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:00.070421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e606138-4873-4cc0-b74d-e5d96d4fb04d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:00.205339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9e606138-4873-4cc0-b74d-e5d96d4fb04d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7f5c179e8844542bca46d76042a6897'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:00.206011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9e606138-4873-4cc0-b74d-e5d96d4fb04d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7f5c179e8844542bca46d76042a6897'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:00.213513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9e606138-4873-4cc0-b74d-e5d96d4fb04d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7f5c179e8844542bca46d76042a6897'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:00.225429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9e606138-4873-4cc0-b74d-e5d96d4fb04d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7f5c179e8844542bca46d76042a6897'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:00.226792 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9e606138-4873-4cc0-b74d-e5d96d4fb04d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7f5c179e8844542bca46d76042a6897'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:00.397250 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4264/8526] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:21:00 2022] DELETE /identity/v3/users/b7f5c179e8844542bca46d76042a6897 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:21:00.662075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58065c11-2394-40a5-9bad-c22d4c83d338 service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:00.674544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58065c11-2394-40a5-9bad-c22d4c83d338 service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:00.733770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e0b27-c315-4248-8294-e497d185dd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:00.734458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e0b27-c315-4248-8294-e497d185dd87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:00.734743 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e0b27-c315-4248-8294-e497d185dd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:00.735023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e0b27-c315-4248-8294-e497d185dd87 admin admin] PATH_INFO: `/v3/projects/6a6a4f0161c94dc19682d70af00ba684` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:00.736146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e0b27-c315-4248-8294-e497d185dd87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a6a4f0161c94dc19682d70af00ba684)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:00.738107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e0b27-c315-4248-8294-e497d185dd87 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:00.819865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c18e0b27-c315-4248-8294-e497d185dd87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a6a4f0161c94dc19682d70af00ba684', 'request_id': 'req-c18e0b27-c315-4248-8294-e497d185dd87'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:00.865417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c18e0b27-c315-4248-8294-e497d185dd87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a6a4f0161c94dc19682d70af00ba684', 'request_id': 'req-c18e0b27-c315-4248-8294-e497d185dd87'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:00.871713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c18e0b27-c315-4248-8294-e497d185dd87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a6a4f0161c94dc19682d70af00ba684', 'request_id': 'req-c18e0b27-c315-4248-8294-e497d185dd87'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:00.873692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:00.882372 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c18e0b27-c315-4248-8294-e497d185dd87 admin admin] The token cache is being invalidate because project 6a6a4f0161c94dc19682d70af00ba684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:21:00.882650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c18e0b27-c315-4248-8294-e497d185dd87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:00.883290 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-c18e0b27-c315-4248-8294-e497d185dd87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:00.884773 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4263/8527] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:21:00 2022] DELETE /identity/v3/projects/6a6a4f0161c94dc19682d70af00ba684 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:21:00.888740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e606138-4873-4cc0-b74d-e5d96d4fb04d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:00.890276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9e606138-4873-4cc0-b74d-e5d96d4fb04d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:00.907258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e606138-4873-4cc0-b74d-e5d96d4fb04d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:00.964608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c114fbe-6d61-4dfc-8a9c-191d0da35c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:00.965275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c114fbe-6d61-4dfc-8a9c-191d0da35c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:00.965561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c114fbe-6d61-4dfc-8a9c-191d0da35c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:00.965839 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c114fbe-6d61-4dfc-8a9c-191d0da35c41 admin admin] PATH_INFO: `/v3/users/22572738a0be4134b770efc0568ac6c1` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:00.979499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c114fbe-6d61-4dfc-8a9c-191d0da35c41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22572738a0be4134b770efc0568ac6c1)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:00.981490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c114fbe-6d61-4dfc-8a9c-191d0da35c41 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:01.125165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:01.130816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c114fbe-6d61-4dfc-8a9c-191d0da35c41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22572738a0be4134b770efc0568ac6c1'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:01.131470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c114fbe-6d61-4dfc-8a9c-191d0da35c41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22572738a0be4134b770efc0568ac6c1'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:01.138277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c114fbe-6d61-4dfc-8a9c-191d0da35c41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22572738a0be4134b770efc0568ac6c1'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:01.150163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c114fbe-6d61-4dfc-8a9c-191d0da35c41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22572738a0be4134b770efc0568ac6c1'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:01.150726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-4c114fbe-6d61-4dfc-8a9c-191d0da35c41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22572738a0be4134b770efc0568ac6c1'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:01.220028 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4265/8528] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:21:00 2022] DELETE /identity/v3/users/22572738a0be4134b770efc0568ac6c1 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:21:01.455741 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e0b27-c315-4248-8294-e497d185dd87 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:01.456865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c18e0b27-c315-4248-8294-e497d185dd87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:01.472370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e0b27-c315-4248-8294-e497d185dd87 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:01.529954 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62914e-53dc-428d-8e17-3854a00ffba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:01.535828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62914e-53dc-428d-8e17-3854a00ffba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:01.535828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62914e-53dc-428d-8e17-3854a00ffba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:01.535828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62914e-53dc-428d-8e17-3854a00ffba5 admin admin] PATH_INFO: `/v3/projects/548e43ec95994363bbb8b5414163fdf5` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:01.535828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62914e-53dc-428d-8e17-3854a00ffba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=548e43ec95994363bbb8b5414163fdf5)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:01.535828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62914e-53dc-428d-8e17-3854a00ffba5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:01.620373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3b62914e-53dc-428d-8e17-3854a00ffba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '548e43ec95994363bbb8b5414163fdf5', 'request_id': 'req-3b62914e-53dc-428d-8e17-3854a00ffba5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:01.677347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3b62914e-53dc-428d-8e17-3854a00ffba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '548e43ec95994363bbb8b5414163fdf5', 'request_id': 'req-3b62914e-53dc-428d-8e17-3854a00ffba5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:01.683879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3b62914e-53dc-428d-8e17-3854a00ffba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '548e43ec95994363bbb8b5414163fdf5', 'request_id': 'req-3b62914e-53dc-428d-8e17-3854a00ffba5'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:01.694974 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3b62914e-53dc-428d-8e17-3854a00ffba5 admin admin] The token cache is being invalidate because project 548e43ec95994363bbb8b5414163fdf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:21:01.695211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3b62914e-53dc-428d-8e17-3854a00ffba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:01.695861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-3b62914e-53dc-428d-8e17-3854a00ffba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:01.697353 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4264/8529] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:21:01 2022] DELETE /identity/v3/projects/548e43ec95994363bbb8b5414163fdf5 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:21:11.203850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddccb42-1086-4067-b31b-8595e606bb61 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:11.204362 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddccb42-1086-4067-b31b-8595e606bb61 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:11.204469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddccb42-1086-4067-b31b-8595e606bb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:11.224614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-5ddccb42-1086-4067-b31b-8595e606bb61 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:21:11.225865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5ddccb42-1086-4067-b31b-8595e606bb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:11.283860 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4266/8530] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:21:11.294885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98d132-71d6-4828-9fa7-87c10caa02f3 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:11.295378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98d132-71d6-4828-9fa7-87c10caa02f3 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:11.295494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98d132-71d6-4828-9fa7-87c10caa02f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:11.315498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4e98d132-71d6-4828-9fa7-87c10caa02f3 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:21:11.316708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4e98d132-71d6-4828-9fa7-87c10caa02f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:11.325251 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4265/8531] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:21:11.329897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddccb42-1086-4067-b31b-8595e606bb61 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:11.339853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddccb42-1086-4067-b31b-8595e606bb61 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:11.344444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9615a05-5a50-44aa-8174-8f6da038fd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:11.345034 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9615a05-5a50-44aa-8174-8f6da038fd2e admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:11.345312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9615a05-5a50-44aa-8174-8f6da038fd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:11.345584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9615a05-5a50-44aa-8174-8f6da038fd2e admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:11.346334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9615a05-5a50-44aa-8174-8f6da038fd2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:21:11.346639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9615a05-5a50-44aa-8174-8f6da038fd2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:11.348232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9615a05-5a50-44aa-8174-8f6da038fd2e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:11.359585 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4267/8532] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:21:11.372904 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98d132-71d6-4828-9fa7-87c10caa02f3 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:11.382913 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98d132-71d6-4828-9fa7-87c10caa02f3 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:11.387537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b430d74-41bf-43d8-af55-ba9d66988101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:11.388136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b430d74-41bf-43d8-af55-ba9d66988101 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:11.388420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b430d74-41bf-43d8-af55-ba9d66988101 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:11.388697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b430d74-41bf-43d8-af55-ba9d66988101 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:11.389318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b430d74-41bf-43d8-af55-ba9d66988101 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:11.391266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b430d74-41bf-43d8-af55-ba9d66988101 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:11.518378 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4266/8533] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:21:11 2022] POST /identity/v3/projects => generated 393 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:21:11.522802 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9615a05-5a50-44aa-8174-8f6da038fd2e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:11.532818 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9615a05-5a50-44aa-8174-8f6da038fd2e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:11.589750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea048556-2bd6-4d0b-bd69-0e9ac1caa28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:11.590384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea048556-2bd6-4d0b-bd69-0e9ac1caa28e admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:11.590665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea048556-2bd6-4d0b-bd69-0e9ac1caa28e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:11.590940 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea048556-2bd6-4d0b-bd69-0e9ac1caa28e admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:11.591565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea048556-2bd6-4d0b-bd69-0e9ac1caa28e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:11.593476 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea048556-2bd6-4d0b-bd69-0e9ac1caa28e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:11.653427 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4268/8534] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:21:11 2022] POST /identity/v3/users => generated 297 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 04:21:11.657715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b430d74-41bf-43d8-af55-ba9d66988101 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:11.668939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b430d74-41bf-43d8-af55-ba9d66988101 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:11.673666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ee489-8d0e-43e1-8fcb-6b971cc4f635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:11.674291 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ee489-8d0e-43e1-8fcb-6b971cc4f635 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:11.674601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ee489-8d0e-43e1-8fcb-6b971cc4f635 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:11.674872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ee489-8d0e-43e1-8fcb-6b971cc4f635 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:11.675513 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ee489-8d0e-43e1-8fcb-6b971cc4f635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:11.677191 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ee489-8d0e-43e1-8fcb-6b971cc4f635 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:11.687828 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4267/8535] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:21:11.691691 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea048556-2bd6-4d0b-bd69-0e9ac1caa28e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:11.701646 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea048556-2bd6-4d0b-bd69-0e9ac1caa28e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:11.706486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe247d-225a-4f56-8f14-144e80c07383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:11.707032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe247d-225a-4f56-8f14-144e80c07383 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:11.707316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe247d-225a-4f56-8f14-144e80c07383 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:11.707592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe247d-225a-4f56-8f14-144e80c07383 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:11.708232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe247d-225a-4f56-8f14-144e80c07383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:11.709817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe247d-225a-4f56-8f14-144e80c07383 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:11.720730 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4269/8536] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:21:11.724389 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ee489-8d0e-43e1-8fcb-6b971cc4f635 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:11.734846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ee489-8d0e-43e1-8fcb-6b971cc4f635 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:11.739442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee49dbf-74ac-4b2c-b18e-9aecc7f6ee9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:11.740081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee49dbf-74ac-4b2c-b18e-9aecc7f6ee9a admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:11.740358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee49dbf-74ac-4b2c-b18e-9aecc7f6ee9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:11.740636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee49dbf-74ac-4b2c-b18e-9aecc7f6ee9a admin admin] PATH_INFO: `/v3/projects/14ade4cece8a49829db34346fbf571bf/users/187cfa2c744f44b18764022a8304b108/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:11.755614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee49dbf-74ac-4b2c-b18e-9aecc7f6ee9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ade4cece8a49829db34346fbf571bf, user_id=187cfa2c744f44b18764022a8304b108, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:11.758396 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee49dbf-74ac-4b2c-b18e-9aecc7f6ee9a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:11.831353 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4268/8537] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:21:11 2022] PUT /identity/v3/projects/14ade4cece8a49829db34346fbf571bf/users/187cfa2c744f44b18764022a8304b108/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:21:11.843023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2196fc6-3b55-473e-b5d7-f8a41d6d3b2b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:11.843311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2196fc6-3b55-473e-b5d7-f8a41d6d3b2b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:11.843588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2196fc6-3b55-473e-b5d7-f8a41d6d3b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:11.871915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f2196fc6-3b55-473e-b5d7-f8a41d6d3b2b None None] MFA Rules not processed for user `187cfa2c744f44b18764022a8304b108`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:21:11.873117 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f2196fc6-3b55-473e-b5d7-f8a41d6d3b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:11.882057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:11.945657 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4270/8538] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:21:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:21:11.950412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee49dbf-74ac-4b2c-b18e-9aecc7f6ee9a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:11.960330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:12.022354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee49dbf-74ac-4b2c-b18e-9aecc7f6ee9a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:12.027548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0bc7e-b04a-443b-89ac-b36c50eb42b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:12.028155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0bc7e-b04a-443b-89ac-b36c50eb42b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:12.028435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0bc7e-b04a-443b-89ac-b36c50eb42b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:12.028708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0bc7e-b04a-443b-89ac-b36c50eb42b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:12.029325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0bc7e-b04a-443b-89ac-b36c50eb42b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:12.031288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0bc7e-b04a-443b-89ac-b36c50eb42b0 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:12.089837 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4269/8539] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:21:11 2022] POST /identity/v3/projects => generated 393 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:21:12.094150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2196fc6-3b55-473e-b5d7-f8a41d6d3b2b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:12.105574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2196fc6-3b55-473e-b5d7-f8a41d6d3b2b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:12.160837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d6e6b-e991-4adc-a36e-3e00a98f9ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:12.161449 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d6e6b-e991-4adc-a36e-3e00a98f9ded admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:12.161740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d6e6b-e991-4adc-a36e-3e00a98f9ded admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:12.162014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d6e6b-e991-4adc-a36e-3e00a98f9ded admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:12.162666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d6e6b-e991-4adc-a36e-3e00a98f9ded admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:12.164618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d6e6b-e991-4adc-a36e-3e00a98f9ded admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:12.249695 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4271/8540] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:21:12 2022] POST /identity/v3/users => generated 303 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:21:12.252565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0bc7e-b04a-443b-89ac-b36c50eb42b0 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:12.263537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0bc7e-b04a-443b-89ac-b36c50eb42b0 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:12.268107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9403f64-1d75-4cc4-81ab-b5f70c71c083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:12.268701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9403f64-1d75-4cc4-81ab-b5f70c71c083 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:12.268980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9403f64-1d75-4cc4-81ab-b5f70c71c083 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:12.269253 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9403f64-1d75-4cc4-81ab-b5f70c71c083 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:12.269962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9403f64-1d75-4cc4-81ab-b5f70c71c083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:12.271591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9403f64-1d75-4cc4-81ab-b5f70c71c083 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:12.282703 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4270/8541] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:21:12.286949 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d6e6b-e991-4adc-a36e-3e00a98f9ded admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:12.296772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d6e6b-e991-4adc-a36e-3e00a98f9ded admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:12.301291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93dd8e-edb5-435f-ac56-61110907da0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:12.301936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93dd8e-edb5-435f-ac56-61110907da0f admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:12.302252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93dd8e-edb5-435f-ac56-61110907da0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:12.302529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93dd8e-edb5-435f-ac56-61110907da0f admin admin] PATH_INFO: `/v3/projects/d1df8199dcb24c33a7ac1cbba71b00ba/users/64590733e1b2419d95449277bc595587/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:12.316929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93dd8e-edb5-435f-ac56-61110907da0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1df8199dcb24c33a7ac1cbba71b00ba, user_id=64590733e1b2419d95449277bc595587, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:12.319751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93dd8e-edb5-435f-ac56-61110907da0f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:12.402817 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4272/8542] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:21:12 2022] PUT /identity/v3/projects/d1df8199dcb24c33a7ac1cbba71b00ba/users/64590733e1b2419d95449277bc595587/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:21:12.406820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9403f64-1d75-4cc4-81ab-b5f70c71c083 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:12.416931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9403f64-1d75-4cc4-81ab-b5f70c71c083 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:12.472511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b22cf-5f54-4670-a36c-1e054e1b6724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:12.473111 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b22cf-5f54-4670-a36c-1e054e1b6724 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:12.473393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b22cf-5f54-4670-a36c-1e054e1b6724 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:12.473663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b22cf-5f54-4670-a36c-1e054e1b6724 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:12.474322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b22cf-5f54-4670-a36c-1e054e1b6724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:12.475917 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b22cf-5f54-4670-a36c-1e054e1b6724 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:12.485640 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4271/8543] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:21:12.489730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93dd8e-edb5-435f-ac56-61110907da0f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:12.499915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93dd8e-edb5-435f-ac56-61110907da0f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:12.504465 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44e185-69ce-4e6e-9fad-eb1411f1326e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:12.505109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44e185-69ce-4e6e-9fad-eb1411f1326e admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:12.505392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44e185-69ce-4e6e-9fad-eb1411f1326e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:12.505679 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44e185-69ce-4e6e-9fad-eb1411f1326e admin admin] PATH_INFO: `/v3/projects/d1df8199dcb24c33a7ac1cbba71b00ba/users/64590733e1b2419d95449277bc595587/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:12.507610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44e185-69ce-4e6e-9fad-eb1411f1326e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1df8199dcb24c33a7ac1cbba71b00ba, user_id=64590733e1b2419d95449277bc595587, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:12.510832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44e185-69ce-4e6e-9fad-eb1411f1326e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:12.520857 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4273/8544] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:21:12 2022] PUT /identity/v3/projects/d1df8199dcb24c33a7ac1cbba71b00ba/users/64590733e1b2419d95449277bc595587/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:21:12.531914 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f251a-3eb1-4bf5-9f08-a0fcdac8e4cb None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:12.532235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f251a-3eb1-4bf5-9f08-a0fcdac8e4cb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:12.532519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f251a-3eb1-4bf5-9f08-a0fcdac8e4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:12.559890 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ae8f251a-3eb1-4bf5-9f08-a0fcdac8e4cb None None] MFA Rules not processed for user `64590733e1b2419d95449277bc595587`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:21:12.561118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ae8f251a-3eb1-4bf5-9f08-a0fcdac8e4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:12.620318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:12.629069 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4272/8545] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:21:12 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:21:12.642813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b7b07-317d-43f4-8456-8d43a0aa8036 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:12.643106 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b7b07-317d-43f4-8456-8d43a0aa8036 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:12.643382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b7b07-317d-43f4-8456-8d43a0aa8036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:12.663437 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-169b7b07-317d-43f4-8456-8d43a0aa8036 None None] MFA Rules not processed for user `187cfa2c744f44b18764022a8304b108`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:21:12.664647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-169b7b07-317d-43f4-8456-8d43a0aa8036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:12.721047 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4274/8546] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:21:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:21:12.734392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f251a-3eb1-4bf5-9f08-a0fcdac8e4cb None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:12.735813 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ae8f251a-3eb1-4bf5-9f08-a0fcdac8e4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:12.821948 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f251a-3eb1-4bf5-9f08-a0fcdac8e4cb None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:12.827980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e48a91-826e-4be8-ac47-24e4f95d7a7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:12.828596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e48a91-826e-4be8-ac47-24e4f95d7a7f service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:12.828879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e48a91-826e-4be8-ac47-24e4f95d7a7f service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:12.829157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e48a91-826e-4be8-ac47-24e4f95d7a7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:12.837350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e48a91-826e-4be8-ac47-24e4f95d7a7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:12.842151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e48a91-826e-4be8-ac47-24e4f95d7a7f service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:12.848124 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4273/8547] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:21:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:21:14.427337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b7b07-317d-43f4-8456-8d43a0aa8036 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:14.428830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-169b7b07-317d-43f4-8456-8d43a0aa8036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:14.446948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:14.516502 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b7b07-317d-43f4-8456-8d43a0aa8036 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:14.521738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8cf99-af72-4fb3-81fb-9bada7a48e34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:14.522392 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8cf99-af72-4fb3-81fb-9bada7a48e34 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:14.522678 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8cf99-af72-4fb3-81fb-9bada7a48e34 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:14.522953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8cf99-af72-4fb3-81fb-9bada7a48e34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:14.524701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fed8cf99-af72-4fb3-81fb-9bada7a48e34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:14.537012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8cf99-af72-4fb3-81fb-9bada7a48e34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:14.538735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8cf99-af72-4fb3-81fb-9bada7a48e34 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:14.549541 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4275/8548] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:21:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:21:22.844101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=41 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:24.453327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f14af-59bc-4101-b703-cf136ccaf4e3 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:24.453915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f14af-59bc-4101-b703-cf136ccaf4e3 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:24.453915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f14af-59bc-4101-b703-cf136ccaf4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:24.474652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e23f14af-59bc-4101-b703-cf136ccaf4e3 None None] MFA Rules not processed for user `c20881251f2241a3a5ec2e5cf99db149`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:21:24.475984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e23f14af-59bc-4101-b703-cf136ccaf4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:24.486525 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4274/8549] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 04:21:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:21:24.500554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8cf99-af72-4fb3-81fb-9bada7a48e34 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:24.502102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fed8cf99-af72-4fb3-81fb-9bada7a48e34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:24.518191 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8cf99-af72-4fb3-81fb-9bada7a48e34 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:24.523673 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcda1d-3da4-4183-aaaa-97b0df4c3e26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:24.524311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcda1d-3da4-4183-aaaa-97b0df4c3e26 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:24.525588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcda1d-3da4-4183-aaaa-97b0df4c3e26 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:24.525900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcda1d-3da4-4183-aaaa-97b0df4c3e26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:24.534955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcda1d-3da4-4183-aaaa-97b0df4c3e26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:24.536662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcda1d-3da4-4183-aaaa-97b0df4c3e26 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:24.548158 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4276/8550] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:21:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:21:27.330094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f14af-59bc-4101-b703-cf136ccaf4e3 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:27.341973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f14af-59bc-4101-b703-cf136ccaf4e3 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:27.347471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478999f-8135-4e88-8fdc-75701917bb3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:27.348071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478999f-8135-4e88-8fdc-75701917bb3f service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:27.348355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478999f-8135-4e88-8fdc-75701917bb3f service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:27.348633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478999f-8135-4e88-8fdc-75701917bb3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:27.356683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478999f-8135-4e88-8fdc-75701917bb3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:27.358312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478999f-8135-4e88-8fdc-75701917bb3f service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:27.367572 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4275/8551] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:21:27 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:21:27.382463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a1d78-538e-49a8-83e0-d828e5b57629 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:27.382907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a1d78-538e-49a8-83e0-d828e5b57629 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:27.383014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a1d78-538e-49a8-83e0-d828e5b57629 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:27.384864 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4277/8552] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 04:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 04:21:27.389341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478999f-8135-4e88-8fdc-75701917bb3f service nova] Authenticating service token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 04:21:27.400693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478999f-8135-4e88-8fdc-75701917bb3f service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:27.409007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478999f-8135-4e88-8fdc-75701917bb3f service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:27.413541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4f35b-8cd6-473a-9853-145bf5d2dfe6 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64590733e1b2419d95449277bc595587', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1df8199dcb24c33a7ac1cbba71b00ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:27.414196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4f35b-8cd6-473a-9853-145bf5d2dfe6 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:27.414488 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4f35b-8cd6-473a-9853-145bf5d2dfe6 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:27.414769 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4f35b-8cd6-473a-9853-145bf5d2dfe6 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] PATH_INFO: `/v3/projects/d1df8199dcb24c33a7ac1cbba71b00ba` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:27.415925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4f35b-8cd6-473a-9853-145bf5d2dfe6 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] RBAC: Authorizing `identity:get_project(project_id=d1df8199dcb24c33a7ac1cbba71b00ba)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:27.417686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4f35b-8cd6-473a-9853-145bf5d2dfe6 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:27.419326 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4276/8553] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 04:21:27 2022] GET /identity/v3/projects/d1df8199dcb24c33a7ac1cbba71b00ba => generated 393 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:21:27.628024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a92604-98f4-412e-868e-5de88ad64296 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:27.628312 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a92604-98f4-412e-868e-5de88ad64296 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:27.628621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a92604-98f4-412e-868e-5de88ad64296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:27.648459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d8a92604-98f4-412e-868e-5de88ad64296 None None] MFA Rules not processed for user `9b359391fbc34c259d987e42e8826c86`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:21:27.649670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d8a92604-98f4-412e-868e-5de88ad64296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:27.710423 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4278/8554] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 04:21:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:21:27.722308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4f35b-8cd6-473a-9853-145bf5d2dfe6 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:27.723978 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-63a4f35b-8cd6-473a-9853-145bf5d2dfe6 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:27.735933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4f35b-8cd6-473a-9853-145bf5d2dfe6 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:27.739494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59664296-61a1-4a3c-809c-6b37a852f8f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:27.740082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664296-61a1-4a3c-809c-6b37a852f8f0 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:27.740366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664296-61a1-4a3c-809c-6b37a852f8f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:27.740640 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664296-61a1-4a3c-809c-6b37a852f8f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:27.748120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59664296-61a1-4a3c-809c-6b37a852f8f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:27.749554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59664296-61a1-4a3c-809c-6b37a852f8f0 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:27.757217 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4277/8555] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:21:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:21:27.972172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06805bc-f352-4a68-9862-4a5f553ebf28 None None] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:27.972487 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06805bc-f352-4a68-9862-4a5f553ebf28 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:27.972773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06805bc-f352-4a68-9862-4a5f553ebf28 None None] PATH_INFO: `/` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:27.974199 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4279/8556] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 27 04:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 04:21:27.979450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59664296-61a1-4a3c-809c-6b37a852f8f0 service neutron] Authenticating service token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 27 04:21:27.992360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59664296-61a1-4a3c-809c-6b37a852f8f0 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:28.002269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59664296-61a1-4a3c-809c-6b37a852f8f0 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:28.007271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e35888-ff02-47db-bed5-51d2f759ad20 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64590733e1b2419d95449277bc595587', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1df8199dcb24c33a7ac1cbba71b00ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:28.007898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e35888-ff02-47db-bed5-51d2f759ad20 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:28.008180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e35888-ff02-47db-bed5-51d2f759ad20 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:28.008458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e35888-ff02-47db-bed5-51d2f759ad20 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] PATH_INFO: `/v3/projects/d1df8199dcb24c33a7ac1cbba71b00ba` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:28.010250 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e35888-ff02-47db-bed5-51d2f759ad20 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] RBAC: Authorizing `identity:get_project(project_id=d1df8199dcb24c33a7ac1cbba71b00ba)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:28.012028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e35888-ff02-47db-bed5-51d2f759ad20 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:28.013657 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4278/8557] 10.222.0.20 () {58 vars in 1443 bytes} [Thu Oct 27 04:21:27 2022] GET /identity/v3/projects/d1df8199dcb24c33a7ac1cbba71b00ba => generated 393 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:21:28.235801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ea7ec-3f43-4454-88d5-16d46bf21bcb None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:28.236015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ea7ec-3f43-4454-88d5-16d46bf21bcb None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:28.236294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ea7ec-3f43-4454-88d5-16d46bf21bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:28.256286 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-593ea7ec-3f43-4454-88d5-16d46bf21bcb None None] MFA Rules not processed for user `9b359391fbc34c259d987e42e8826c86`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:21:28.257501 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-593ea7ec-3f43-4454-88d5-16d46bf21bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:28.263894 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4280/8558] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 04:21:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:21:28.275239 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e35888-ff02-47db-bed5-51d2f759ad20 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:28.276910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-49e35888-ff02-47db-bed5-51d2f759ad20 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:28.288955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e35888-ff02-47db-bed5-51d2f759ad20 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:28.293083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d878e49-9ab8-44ab-94b8-3b334cb9e368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:28.293677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d878e49-9ab8-44ab-94b8-3b334cb9e368 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:28.293961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d878e49-9ab8-44ab-94b8-3b334cb9e368 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:28.294268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d878e49-9ab8-44ab-94b8-3b334cb9e368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:28.301136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d878e49-9ab8-44ab-94b8-3b334cb9e368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:28.302622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d878e49-9ab8-44ab-94b8-3b334cb9e368 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:28.310980 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4279/8559] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:21:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:21:32.255944 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ea7ec-3f43-4454-88d5-16d46bf21bcb None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:32.318150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ea7ec-3f43-4454-88d5-16d46bf21bcb None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:32.322765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc46ef-ac6d-4b83-a931-be5d1a06ec61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:32.323420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc46ef-ac6d-4b83-a931-be5d1a06ec61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:32.323705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc46ef-ac6d-4b83-a931-be5d1a06ec61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:32.323985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc46ef-ac6d-4b83-a931-be5d1a06ec61 admin admin] PATH_INFO: `/v3/users/187cfa2c744f44b18764022a8304b108` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:32.325120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc46ef-ac6d-4b83-a931-be5d1a06ec61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=187cfa2c744f44b18764022a8304b108)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:32.327124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc46ef-ac6d-4b83-a931-be5d1a06ec61 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:32.348868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:32.484173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-93dc46ef-ac6d-4b83-a931-be5d1a06ec61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '187cfa2c744f44b18764022a8304b108'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:32.484828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-93dc46ef-ac6d-4b83-a931-be5d1a06ec61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '187cfa2c744f44b18764022a8304b108'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:32.492471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-93dc46ef-ac6d-4b83-a931-be5d1a06ec61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '187cfa2c744f44b18764022a8304b108'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:32.504687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-93dc46ef-ac6d-4b83-a931-be5d1a06ec61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '187cfa2c744f44b18764022a8304b108'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:32.505351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-93dc46ef-ac6d-4b83-a931-be5d1a06ec61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '187cfa2c744f44b18764022a8304b108'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:32.556647 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4281/8560] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:21:32 2022] DELETE /identity/v3/users/187cfa2c744f44b18764022a8304b108 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:21:32.561179 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9905bb-0679-4408-a967-ee967ae6fd82 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:32.561642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9905bb-0679-4408-a967-ee967ae6fd82 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:32.561753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9905bb-0679-4408-a967-ee967ae6fd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:32.588845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-3e9905bb-0679-4408-a967-ee967ae6fd82 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:21:32.590083 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3e9905bb-0679-4408-a967-ee967ae6fd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:32.652201 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4280/8561] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:21:32.662235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc46ef-ac6d-4b83-a931-be5d1a06ec61 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:32.663694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-93dc46ef-ac6d-4b83-a931-be5d1a06ec61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:32.722336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc46ef-ac6d-4b83-a931-be5d1a06ec61 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:32.726159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a176ebb-bba1-4a8e-ab8b-ac76a40aee4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:32.726835 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a176ebb-bba1-4a8e-ab8b-ac76a40aee4f service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:32.727124 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a176ebb-bba1-4a8e-ab8b-ac76a40aee4f service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:32.727402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a176ebb-bba1-4a8e-ab8b-ac76a40aee4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:32.737376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a176ebb-bba1-4a8e-ab8b-ac76a40aee4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:32.738789 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a176ebb-bba1-4a8e-ab8b-ac76a40aee4f service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:32.749285 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4282/8562] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:21:32.964836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9905bb-0679-4408-a967-ee967ae6fd82 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:32.966400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3e9905bb-0679-4408-a967-ee967ae6fd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:32.981683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9905bb-0679-4408-a967-ee967ae6fd82 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:32.987106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79688a12-3377-424c-95da-93db77018689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:32.987785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79688a12-3377-424c-95da-93db77018689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:32.988023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79688a12-3377-424c-95da-93db77018689 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:32.988302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79688a12-3377-424c-95da-93db77018689 admin admin] PATH_INFO: `/v3/projects/14ade4cece8a49829db34346fbf571bf` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:32.989466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79688a12-3377-424c-95da-93db77018689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14ade4cece8a49829db34346fbf571bf)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:32.991436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79688a12-3377-424c-95da-93db77018689 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:33.221091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-79688a12-3377-424c-95da-93db77018689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14ade4cece8a49829db34346fbf571bf', 'request_id': 'req-79688a12-3377-424c-95da-93db77018689'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:33.299565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-79688a12-3377-424c-95da-93db77018689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14ade4cece8a49829db34346fbf571bf', 'request_id': 'req-79688a12-3377-424c-95da-93db77018689'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:33.306328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-79688a12-3377-424c-95da-93db77018689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14ade4cece8a49829db34346fbf571bf', 'request_id': 'req-79688a12-3377-424c-95da-93db77018689'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:33.316837 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-79688a12-3377-424c-95da-93db77018689 admin admin] The token cache is being invalidate because project 14ade4cece8a49829db34346fbf571bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:21:33.317132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-79688a12-3377-424c-95da-93db77018689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:33.317763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-79688a12-3377-424c-95da-93db77018689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:33.319260 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4281/8563] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:21:32 2022] DELETE /identity/v3/projects/14ade4cece8a49829db34346fbf571bf => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:21:33.323837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a176ebb-bba1-4a8e-ab8b-ac76a40aee4f service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:33.333611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a176ebb-bba1-4a8e-ab8b-ac76a40aee4f service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:33.389469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a57ae0-8293-45ce-9212-8993d0258ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:33.390115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a57ae0-8293-45ce-9212-8993d0258ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:33.390400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a57ae0-8293-45ce-9212-8993d0258ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:33.390675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a57ae0-8293-45ce-9212-8993d0258ad9 admin admin] PATH_INFO: `/v3/users/64590733e1b2419d95449277bc595587` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:33.391784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a57ae0-8293-45ce-9212-8993d0258ad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64590733e1b2419d95449277bc595587)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:33.393707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a57ae0-8293-45ce-9212-8993d0258ad9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:33.544778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:33.547342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-60a57ae0-8293-45ce-9212-8993d0258ad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64590733e1b2419d95449277bc595587'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:33.548005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-60a57ae0-8293-45ce-9212-8993d0258ad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64590733e1b2419d95449277bc595587'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:33.555510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-60a57ae0-8293-45ce-9212-8993d0258ad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64590733e1b2419d95449277bc595587'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:33.566695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-60a57ae0-8293-45ce-9212-8993d0258ad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64590733e1b2419d95449277bc595587'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:33.567422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-60a57ae0-8293-45ce-9212-8993d0258ad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64590733e1b2419d95449277bc595587'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:33.619490 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4283/8564] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:21:33 2022] DELETE /identity/v3/users/64590733e1b2419d95449277bc595587 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:21:34.032793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79688a12-3377-424c-95da-93db77018689 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:34.034412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-79688a12-3377-424c-95da-93db77018689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:34.048187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79688a12-3377-424c-95da-93db77018689 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:34.057990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:34.106564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caacab4-3c8e-4d2b-9ac3-2af8a18d568a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:34.107194 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caacab4-3c8e-4d2b-9ac3-2af8a18d568a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:34.107473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caacab4-3c8e-4d2b-9ac3-2af8a18d568a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:34.107745 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caacab4-3c8e-4d2b-9ac3-2af8a18d568a admin admin] PATH_INFO: `/v3/projects/d1df8199dcb24c33a7ac1cbba71b00ba` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:34.108883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caacab4-3c8e-4d2b-9ac3-2af8a18d568a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1df8199dcb24c33a7ac1cbba71b00ba)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:34.110808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caacab4-3c8e-4d2b-9ac3-2af8a18d568a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:34.219971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2caacab4-3c8e-4d2b-9ac3-2af8a18d568a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1df8199dcb24c33a7ac1cbba71b00ba', 'request_id': 'req-2caacab4-3c8e-4d2b-9ac3-2af8a18d568a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:34.287794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2caacab4-3c8e-4d2b-9ac3-2af8a18d568a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1df8199dcb24c33a7ac1cbba71b00ba', 'request_id': 'req-2caacab4-3c8e-4d2b-9ac3-2af8a18d568a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:34.294648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2caacab4-3c8e-4d2b-9ac3-2af8a18d568a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1df8199dcb24c33a7ac1cbba71b00ba', 'request_id': 'req-2caacab4-3c8e-4d2b-9ac3-2af8a18d568a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:34.305347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2caacab4-3c8e-4d2b-9ac3-2af8a18d568a admin admin] The token cache is being invalidate because project d1df8199dcb24c33a7ac1cbba71b00ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:21:34.305633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2caacab4-3c8e-4d2b-9ac3-2af8a18d568a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:34.306310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-2caacab4-3c8e-4d2b-9ac3-2af8a18d568a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:21:34.307836 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4282/8565] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:21:34 2022] DELETE /identity/v3/projects/d1df8199dcb24c33a7ac1cbba71b00ba => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:21:34.313882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eb1fc-2239-44ad-af01-6f116b865266 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:34.314202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eb1fc-2239-44ad-af01-6f116b865266 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:34.314504 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eb1fc-2239-44ad-af01-6f116b865266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:34.353916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-e76eb1fc-2239-44ad-af01-6f116b865266 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:21:34.355219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e76eb1fc-2239-44ad-af01-6f116b865266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:34.413513 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4284/8566] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 04:21:34.421995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08c093-2dc4-40bd-ba7f-b22ff258748b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:34.422318 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08c093-2dc4-40bd-ba7f-b22ff258748b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:34.422598 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08c093-2dc4-40bd-ba7f-b22ff258748b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:34.443016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ee08c093-2dc4-40bd-ba7f-b22ff258748b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:21:34.444232 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ee08c093-2dc4-40bd-ba7f-b22ff258748b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:34.452978 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4283/8567] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:21:34.457243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76eb1fc-2239-44ad-af01-6f116b865266 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:34.467376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76eb1fc-2239-44ad-af01-6f116b865266 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:34.471989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5704bb-197b-4bd0-8b70-a896c2ed579c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:34.472590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5704bb-197b-4bd0-8b70-a896c2ed579c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:34.472872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5704bb-197b-4bd0-8b70-a896c2ed579c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:34.473146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5704bb-197b-4bd0-8b70-a896c2ed579c admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:34.473888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5704bb-197b-4bd0-8b70-a896c2ed579c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:21:34.474235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5704bb-197b-4bd0-8b70-a896c2ed579c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:34.475876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5704bb-197b-4bd0-8b70-a896c2ed579c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:34.487486 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4285/8568] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:21:34.491630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08c093-2dc4-40bd-ba7f-b22ff258748b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:34.501487 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08c093-2dc4-40bd-ba7f-b22ff258748b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:34.506172 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7367a-9725-4645-8a41-907349790378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:34.506773 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7367a-9725-4645-8a41-907349790378 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:34.507055 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7367a-9725-4645-8a41-907349790378 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:34.507329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7367a-9725-4645-8a41-907349790378 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:34.507959 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7367a-9725-4645-8a41-907349790378 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:34.510572 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7367a-9725-4645-8a41-907349790378 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:34.597767 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4284/8569] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:21:34 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 04:21:34.602015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5704bb-197b-4bd0-8b70-a896c2ed579c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:34.612112 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5704bb-197b-4bd0-8b70-a896c2ed579c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:34.669127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293338d-648b-4656-906e-db6ed88aa8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:34.669728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293338d-648b-4656-906e-db6ed88aa8a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:34.670010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293338d-648b-4656-906e-db6ed88aa8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:34.670316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293338d-648b-4656-906e-db6ed88aa8a6 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:34.670974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293338d-648b-4656-906e-db6ed88aa8a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:34.672899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293338d-648b-4656-906e-db6ed88aa8a6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:34.754512 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4286/8570] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:21:34 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 04:21:34.755697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7367a-9725-4645-8a41-907349790378 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:34.767002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7367a-9725-4645-8a41-907349790378 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:34.772673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01099fa7-2c42-4bf8-924d-1da58c8c9942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:34.773309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01099fa7-2c42-4bf8-924d-1da58c8c9942 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:34.773593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01099fa7-2c42-4bf8-924d-1da58c8c9942 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:34.773868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01099fa7-2c42-4bf8-924d-1da58c8c9942 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:34.774557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01099fa7-2c42-4bf8-924d-1da58c8c9942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:34.776161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01099fa7-2c42-4bf8-924d-1da58c8c9942 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:34.786264 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4285/8571] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:21:34.790962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293338d-648b-4656-906e-db6ed88aa8a6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:34.801049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293338d-648b-4656-906e-db6ed88aa8a6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:34.805824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccb74b-00c2-40b5-9bc6-c4aa87e0410c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:34.811481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccb74b-00c2-40b5-9bc6-c4aa87e0410c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:34.811481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccb74b-00c2-40b5-9bc6-c4aa87e0410c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:34.811481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccb74b-00c2-40b5-9bc6-c4aa87e0410c admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:34.811481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ccb74b-00c2-40b5-9bc6-c4aa87e0410c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:34.811481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ccb74b-00c2-40b5-9bc6-c4aa87e0410c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:34.822941 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4287/8572] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:21:34.825207 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01099fa7-2c42-4bf8-924d-1da58c8c9942 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:34.835237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01099fa7-2c42-4bf8-924d-1da58c8c9942 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:34.840933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4495c2-a44b-4ffd-a072-879f1f98624f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:34.841629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4495c2-a44b-4ffd-a072-879f1f98624f admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:34.841911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4495c2-a44b-4ffd-a072-879f1f98624f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:34.842229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4495c2-a44b-4ffd-a072-879f1f98624f admin admin] PATH_INFO: `/v3/projects/337d221cc6554437899bdcd6d509a655/users/80c7bf9767d0461f9556f74ff9a8a4f3/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:34.857669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4495c2-a44b-4ffd-a072-879f1f98624f admin admin] RBAC: Authorizing `identity:create_grant(project_id=337d221cc6554437899bdcd6d509a655, user_id=80c7bf9767d0461f9556f74ff9a8a4f3, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:34.860351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4495c2-a44b-4ffd-a072-879f1f98624f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:34.939147 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4286/8573] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:21:34 2022] PUT /identity/v3/projects/337d221cc6554437899bdcd6d509a655/users/80c7bf9767d0461f9556f74ff9a8a4f3/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:21:34.944244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962a6b9-9285-4f65-8bab-240baae5ea09 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:34.947735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962a6b9-9285-4f65-8bab-240baae5ea09 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:34.947735 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962a6b9-9285-4f65-8bab-240baae5ea09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:34.964122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-b962a6b9-9285-4f65-8bab-240baae5ea09 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:21:34.965351 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b962a6b9-9285-4f65-8bab-240baae5ea09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:34.970398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:35.023893 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4288/8574] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:21:35.033370 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4495c2-a44b-4ffd-a072-879f1f98624f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:35.035251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-da4495c2-a44b-4ffd-a072-879f1f98624f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:35.078020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:35.091278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4495c2-a44b-4ffd-a072-879f1f98624f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:35.097121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d6491-7547-4d50-ab7a-bfa653a3dd6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:35.097121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d6491-7547-4d50-ab7a-bfa653a3dd6c service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:35.097121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d6491-7547-4d50-ab7a-bfa653a3dd6c service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:35.097121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d6491-7547-4d50-ab7a-bfa653a3dd6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:35.105523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d6491-7547-4d50-ab7a-bfa653a3dd6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:35.107004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d6491-7547-4d50-ab7a-bfa653a3dd6c service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:35.116618 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4287/8575] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:21:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:21:40.304085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c71700-4a1d-44b9-822e-71f7ac566a1e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:40.304607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c71700-4a1d-44b9-822e-71f7ac566a1e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:40.304703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c71700-4a1d-44b9-822e-71f7ac566a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:40.336753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-13c71700-4a1d-44b9-822e-71f7ac566a1e None None] MFA Rules not processed for user `80c7bf9767d0461f9556f74ff9a8a4f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:21:40.338962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-13c71700-4a1d-44b9-822e-71f7ac566a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:40.408877 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4289/8576] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:21:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:21:40.420456 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a91048-91cd-4bee-96c9-620c48255efc None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:40.421017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a91048-91cd-4bee-96c9-620c48255efc None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:40.421017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a91048-91cd-4bee-96c9-620c48255efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:40.441202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-89a91048-91cd-4bee-96c9-620c48255efc None None] MFA Rules not processed for user `80c7bf9767d0461f9556f74ff9a8a4f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:21:40.442471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-89a91048-91cd-4bee-96c9-620c48255efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:40.450770 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4288/8577] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:21:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:21:40.465756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c71700-4a1d-44b9-822e-71f7ac566a1e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:40.467250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-13c71700-4a1d-44b9-822e-71f7ac566a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:40.553537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c71700-4a1d-44b9-822e-71f7ac566a1e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:40.560235 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773483e-bd7b-4e85-9a38-2c0b3be4aff1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:40.561273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773483e-bd7b-4e85-9a38-2c0b3be4aff1 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:40.561498 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773483e-bd7b-4e85-9a38-2c0b3be4aff1 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:40.561808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773483e-bd7b-4e85-9a38-2c0b3be4aff1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:40.572190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773483e-bd7b-4e85-9a38-2c0b3be4aff1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:40.573862 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773483e-bd7b-4e85-9a38-2c0b3be4aff1 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:40.584699 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4290/8578] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:21:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:21:50.437828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=11 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:50.579552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=88 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:55.611020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286c95b-ff9e-4531-b5f2-a64bcd54332d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:55.611556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286c95b-ff9e-4531-b5f2-a64bcd54332d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:55.611675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286c95b-ff9e-4531-b5f2-a64bcd54332d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:55.631200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f286c95b-ff9e-4531-b5f2-a64bcd54332d None None] MFA Rules not processed for user `9b359391fbc34c259d987e42e8826c86`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:21:55.632482 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f286c95b-ff9e-4531-b5f2-a64bcd54332d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:55.639055 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4289/8579] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 04:21:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:21:55.651508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773483e-bd7b-4e85-9a38-2c0b3be4aff1 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:55.652947 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3773483e-bd7b-4e85-9a38-2c0b3be4aff1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:55.664797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773483e-bd7b-4e85-9a38-2c0b3be4aff1 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:55.669160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca5cc5-74eb-491f-b945-f99b42821312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:55.669758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca5cc5-74eb-491f-b945-f99b42821312 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:55.670052 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca5cc5-74eb-491f-b945-f99b42821312 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:55.670355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca5cc5-74eb-491f-b945-f99b42821312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:55.677451 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca5cc5-74eb-491f-b945-f99b42821312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:55.678938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca5cc5-74eb-491f-b945-f99b42821312 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:55.686776 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4291/8580] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:21:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:21:55.811272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4c0a6-a658-4e27-80da-a850cdc53bdb None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:55.811609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4c0a6-a658-4e27-80da-a850cdc53bdb None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:55.811898 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4c0a6-a658-4e27-80da-a850cdc53bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:55.850844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-f4e4c0a6-a658-4e27-80da-a850cdc53bdb None None] MFA Rules not processed for user `1a395d2414cd4da085a77ddc9b1f1caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:21:55.852060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f4e4c0a6-a658-4e27-80da-a850cdc53bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:55.913347 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4290/8581] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 04:21:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:21:55.925083 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca5cc5-74eb-491f-b945-f99b42821312 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:55.926599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-71ca5cc5-74eb-491f-b945-f99b42821312 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:55.942005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca5cc5-74eb-491f-b945-f99b42821312 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:55.948025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918204e4-f702-4b54-9ddd-b9814b4f4188 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:55.948641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918204e4-f702-4b54-9ddd-b9814b4f4188 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:55.948926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918204e4-f702-4b54-9ddd-b9814b4f4188 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:55.949264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918204e4-f702-4b54-9ddd-b9814b4f4188 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:55.958478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918204e4-f702-4b54-9ddd-b9814b4f4188 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:55.960109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918204e4-f702-4b54-9ddd-b9814b4f4188 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:55.971181 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4292/8582] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:21:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:21:56.234608 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9cc7f-b916-4a91-bce5-2e177621fdb8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:56.234897 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9cc7f-b916-4a91-bce5-2e177621fdb8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:56.235196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9cc7f-b916-4a91-bce5-2e177621fdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:56.255255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ebd9cc7f-b916-4a91-bce5-2e177621fdb8 None None] MFA Rules not processed for user `c20881251f2241a3a5ec2e5cf99db149`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:21:56.256391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ebd9cc7f-b916-4a91-bce5-2e177621fdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:21:56.266063 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4291/8583] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 04:21:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:21:56.276816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918204e4-f702-4b54-9ddd-b9814b4f4188 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:21:56.286171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918204e4-f702-4b54-9ddd-b9814b4f4188 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:21:56.289853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6b1f0-14f9-41c5-88df-f7e90b5180f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:21:56.290490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6b1f0-14f9-41c5-88df-f7e90b5180f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:21:56.290799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6b1f0-14f9-41c5-88df-f7e90b5180f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:21:56.291076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6b1f0-14f9-41c5-88df-f7e90b5180f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:21:56.301240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6b1f0-14f9-41c5-88df-f7e90b5180f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:21:56.306333 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6b1f0-14f9-41c5-88df-f7e90b5180f8 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:21:56.313961 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4293/8584] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:21:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:22:06.249771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=41 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:22:06.309219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=18 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:22:40.121473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9cc7f-b916-4a91-bce5-2e177621fdb8 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:22:40.133098 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9cc7f-b916-4a91-bce5-2e177621fdb8 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:22:40.138453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56a481-5c3b-479e-8e43-0f6d4d969036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:22:40.139190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56a481-5c3b-479e-8e43-0f6d4d969036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:22:40.139368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56a481-5c3b-479e-8e43-0f6d4d969036 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:22:40.139642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56a481-5c3b-479e-8e43-0f6d4d969036 admin admin] PATH_INFO: `/v3/users/80c7bf9767d0461f9556f74ff9a8a4f3` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:22:40.140770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56a481-5c3b-479e-8e43-0f6d4d969036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80c7bf9767d0461f9556f74ff9a8a4f3)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:22:40.142784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56a481-5c3b-479e-8e43-0f6d4d969036 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:22:40.324109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7a56a481-5c3b-479e-8e43-0f6d4d969036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80c7bf9767d0461f9556f74ff9a8a4f3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:22:40.324771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7a56a481-5c3b-479e-8e43-0f6d4d969036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80c7bf9767d0461f9556f74ff9a8a4f3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:22:40.331778 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7a56a481-5c3b-479e-8e43-0f6d4d969036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80c7bf9767d0461f9556f74ff9a8a4f3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:22:40.344639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7a56a481-5c3b-479e-8e43-0f6d4d969036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80c7bf9767d0461f9556f74ff9a8a4f3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:22:40.419002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7a56a481-5c3b-479e-8e43-0f6d4d969036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80c7bf9767d0461f9556f74ff9a8a4f3'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:22:40.425280 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4292/8585] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:22:40 2022] DELETE /identity/v3/users/80c7bf9767d0461f9556f74ff9a8a4f3 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:22:40.666641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6b1f0-14f9-41c5-88df-f7e90b5180f8 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:22:40.677497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6b1f0-14f9-41c5-88df-f7e90b5180f8 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:22:40.738007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fede99-3f52-4f1f-9678-656fd83d6714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:22:40.738605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fede99-3f52-4f1f-9678-656fd83d6714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:22:40.738892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fede99-3f52-4f1f-9678-656fd83d6714 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:22:40.739170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fede99-3f52-4f1f-9678-656fd83d6714 admin admin] PATH_INFO: `/v3/projects/337d221cc6554437899bdcd6d509a655` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:22:40.740292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fede99-3f52-4f1f-9678-656fd83d6714 admin admin] RBAC: Authorizing `identity:delete_project(project_id=337d221cc6554437899bdcd6d509a655)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:22:40.742280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fede99-3f52-4f1f-9678-656fd83d6714 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:22:40.840840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-60fede99-3f52-4f1f-9678-656fd83d6714 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '337d221cc6554437899bdcd6d509a655', 'request_id': 'req-60fede99-3f52-4f1f-9678-656fd83d6714'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:22:40.847053 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-60fede99-3f52-4f1f-9678-656fd83d6714 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '337d221cc6554437899bdcd6d509a655', 'request_id': 'req-60fede99-3f52-4f1f-9678-656fd83d6714'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:22:40.853594 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-60fede99-3f52-4f1f-9678-656fd83d6714 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '337d221cc6554437899bdcd6d509a655', 'request_id': 'req-60fede99-3f52-4f1f-9678-656fd83d6714'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:22:40.938058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-60fede99-3f52-4f1f-9678-656fd83d6714 admin admin] The token cache is being invalidate because project 337d221cc6554437899bdcd6d509a655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:22:40.938369 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-60fede99-3f52-4f1f-9678-656fd83d6714 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:22:40.939027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-60fede99-3f52-4f1f-9678-656fd83d6714 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:22:40.940537 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4294/8586] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:22:40 2022] DELETE /identity/v3/projects/337d221cc6554437899bdcd6d509a655 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 04:22:40.945910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a979c-f58f-474d-a8c3-47c480f4c5d1 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:22:40.946230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a979c-f58f-474d-a8c3-47c480f4c5d1 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:22:40.946540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a979c-f58f-474d-a8c3-47c480f4c5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:22:40.967217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-be6a979c-f58f-474d-a8c3-47c480f4c5d1 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:22:40.968421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-be6a979c-f58f-474d-a8c3-47c480f4c5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:22:41.026545 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4293/8587] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:22:41.035026 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7baab-16c2-490b-a4d4-822de0792e48 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:22:41.035311 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7baab-16c2-490b-a4d4-822de0792e48 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:22:41.035587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7baab-16c2-490b-a4d4-822de0792e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:22:41.054908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-04e7baab-16c2-490b-a4d4-822de0792e48 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:22:41.056102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-04e7baab-16c2-490b-a4d4-822de0792e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:22:41.063816 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4295/8588] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:22:41.067999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a979c-f58f-474d-a8c3-47c480f4c5d1 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:22:41.077983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a979c-f58f-474d-a8c3-47c480f4c5d1 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:22:41.082540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f8558-c32d-4cc2-b8af-ba293dbbd29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:22:41.083131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f8558-c32d-4cc2-b8af-ba293dbbd29b admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:22:41.083410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f8558-c32d-4cc2-b8af-ba293dbbd29b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:22:41.083680 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f8558-c32d-4cc2-b8af-ba293dbbd29b admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:22:41.084324 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f8558-c32d-4cc2-b8af-ba293dbbd29b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:22:41.084624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f8558-c32d-4cc2-b8af-ba293dbbd29b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:22:41.086259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f8558-c32d-4cc2-b8af-ba293dbbd29b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:22:41.098308 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4294/8589] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:22:41.102495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7baab-16c2-490b-a4d4-822de0792e48 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:22:41.111595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7baab-16c2-490b-a4d4-822de0792e48 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:22:41.116189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e26c3f-eb8d-4d71-bd06-393fc7e32517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:22:41.116779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e26c3f-eb8d-4d71-bd06-393fc7e32517 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:22:41.117057 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e26c3f-eb8d-4d71-bd06-393fc7e32517 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:22:41.117328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e26c3f-eb8d-4d71-bd06-393fc7e32517 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:22:41.117955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e26c3f-eb8d-4d71-bd06-393fc7e32517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:22:41.120427 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e26c3f-eb8d-4d71-bd06-393fc7e32517 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:22:41.204537 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4296/8590] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:22:41 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:22:41.208763 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f8558-c32d-4cc2-b8af-ba293dbbd29b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:22:41.219143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f8558-c32d-4cc2-b8af-ba293dbbd29b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:22:41.273879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf49bf-3baf-4353-aec2-f39c69ca0152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:22:41.274509 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf49bf-3baf-4353-aec2-f39c69ca0152 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:22:41.274821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf49bf-3baf-4353-aec2-f39c69ca0152 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:22:41.275093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf49bf-3baf-4353-aec2-f39c69ca0152 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:22:41.275721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf49bf-3baf-4353-aec2-f39c69ca0152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:22:41.277710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf49bf-3baf-4353-aec2-f39c69ca0152 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:22:41.285518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:22:41.365914 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4295/8591] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:22:41 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:22:41.374684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e26c3f-eb8d-4d71-bd06-393fc7e32517 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:22:41.385897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e26c3f-eb8d-4d71-bd06-393fc7e32517 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:22:41.390582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f576494-a1aa-4ff7-b9db-70635734e576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:22:41.391184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f576494-a1aa-4ff7-b9db-70635734e576 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:22:41.391464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f576494-a1aa-4ff7-b9db-70635734e576 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:22:41.391739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f576494-a1aa-4ff7-b9db-70635734e576 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:22:41.392408 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f576494-a1aa-4ff7-b9db-70635734e576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:22:41.393993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f576494-a1aa-4ff7-b9db-70635734e576 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:22:41.404049 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4297/8592] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 04:22:41.407744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf49bf-3baf-4353-aec2-f39c69ca0152 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:22:41.417537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf49bf-3baf-4353-aec2-f39c69ca0152 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:22:41.422742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76256312-d4e5-4eb1-816d-cb8182c6d55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:22:41.423330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76256312-d4e5-4eb1-816d-cb8182c6d55d admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:22:41.423612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76256312-d4e5-4eb1-816d-cb8182c6d55d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:22:41.423885 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76256312-d4e5-4eb1-816d-cb8182c6d55d admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:22:41.424522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76256312-d4e5-4eb1-816d-cb8182c6d55d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:22:41.426133 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76256312-d4e5-4eb1-816d-cb8182c6d55d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:22:41.437268 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4296/8593] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:22:41.441342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f576494-a1aa-4ff7-b9db-70635734e576 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:22:41.452160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f576494-a1aa-4ff7-b9db-70635734e576 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:22:41.457005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350eafbd-c2c6-4245-8708-3230250d2318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:22:41.457680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350eafbd-c2c6-4245-8708-3230250d2318 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:22:41.457962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350eafbd-c2c6-4245-8708-3230250d2318 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:22:41.458269 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350eafbd-c2c6-4245-8708-3230250d2318 admin admin] PATH_INFO: `/v3/projects/8f53f549cce04ce78df9a4b68ec35177/users/0482d6b66ea34d34bed74fac32f55068/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:22:41.472950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350eafbd-c2c6-4245-8708-3230250d2318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f53f549cce04ce78df9a4b68ec35177, user_id=0482d6b66ea34d34bed74fac32f55068, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:22:41.475613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350eafbd-c2c6-4245-8708-3230250d2318 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:22:41.584447 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4298/8594] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:22:41 2022] PUT /identity/v3/projects/8f53f549cce04ce78df9a4b68ec35177/users/0482d6b66ea34d34bed74fac32f55068/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:22:41.589962 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcabaf-dfe9-41f0-b481-730099ce8ce9 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:22:41.590304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcabaf-dfe9-41f0-b481-730099ce8ce9 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:22:41.590562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcabaf-dfe9-41f0-b481-730099ce8ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:22:41.609755 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-72dcabaf-dfe9-41f0-b481-730099ce8ce9 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:22:41.610995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-72dcabaf-dfe9-41f0-b481-730099ce8ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:22:41.669428 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4297/8595] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 04:22:41.679173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350eafbd-c2c6-4245-8708-3230250d2318 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:22:41.680868 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-350eafbd-c2c6-4245-8708-3230250d2318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:22:41.712557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:22:41.738706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350eafbd-c2c6-4245-8708-3230250d2318 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:22:41.742371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bd37b-ba77-479f-ad52-0eb696cda025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:22:41.743002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bd37b-ba77-479f-ad52-0eb696cda025 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:22:41.743272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bd37b-ba77-479f-ad52-0eb696cda025 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:22:41.744349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bd37b-ba77-479f-ad52-0eb696cda025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:22:41.753677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bd37b-ba77-479f-ad52-0eb696cda025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:22:41.755143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bd37b-ba77-479f-ad52-0eb696cda025 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:22:41.764490 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4299/8596] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:22:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:22:47.125768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5afca-c03e-4cd6-81d6-b714ad9d5126 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:22:47.126286 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5afca-c03e-4cd6-81d6-b714ad9d5126 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:22:47.126377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5afca-c03e-4cd6-81d6-b714ad9d5126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:22:47.159255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e0e5afca-c03e-4cd6-81d6-b714ad9d5126 None None] MFA Rules not processed for user `0482d6b66ea34d34bed74fac32f55068`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:22:47.160477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e0e5afca-c03e-4cd6-81d6-b714ad9d5126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:22:47.231864 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4298/8597] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:22:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:22:47.242859 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3ea7d-8abb-451a-899a-74cec616f732 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:22:47.243461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3ea7d-8abb-451a-899a-74cec616f732 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:22:47.243615 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3ea7d-8abb-451a-899a-74cec616f732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:22:47.264236 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-14c3ea7d-8abb-451a-899a-74cec616f732 None None] MFA Rules not processed for user `0482d6b66ea34d34bed74fac32f55068`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:22:47.265513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-14c3ea7d-8abb-451a-899a-74cec616f732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:22:47.272724 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4300/8598] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:22:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:22:47.287186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5afca-c03e-4cd6-81d6-b714ad9d5126 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:22:47.288868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e0e5afca-c03e-4cd6-81d6-b714ad9d5126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:22:47.374160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:22:47.383467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5afca-c03e-4cd6-81d6-b714ad9d5126 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:22:47.389129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ac6c8-192c-49e8-b01b-6fdaf4d5c7ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:22:47.389750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ac6c8-192c-49e8-b01b-6fdaf4d5c7ae service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:22:47.390027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ac6c8-192c-49e8-b01b-6fdaf4d5c7ae service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:22:47.390336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ac6c8-192c-49e8-b01b-6fdaf4d5c7ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:22:47.398895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ac6c8-192c-49e8-b01b-6fdaf4d5c7ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:22:47.401078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ac6c8-192c-49e8-b01b-6fdaf4d5c7ae service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:22:47.410922 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4299/8599] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:22:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:22:49.514588 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3ea7d-8abb-451a-899a-74cec616f732 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:22:49.515981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-14c3ea7d-8abb-451a-899a-74cec616f732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:22:49.586819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3ea7d-8abb-451a-899a-74cec616f732 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:22:49.592214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929edb5-8417-4d75-bc5a-9418a7c8dcde service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:22:49.592815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929edb5-8417-4d75-bc5a-9418a7c8dcde service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:22:49.593098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929edb5-8417-4d75-bc5a-9418a7c8dcde service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:22:49.593402 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929edb5-8417-4d75-bc5a-9418a7c8dcde service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:22:49.595171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a929edb5-8417-4d75-bc5a-9418a7c8dcde service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:22:49.607048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929edb5-8417-4d75-bc5a-9418a7c8dcde service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:22:49.608652 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929edb5-8417-4d75-bc5a-9418a7c8dcde service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:22:49.621357 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4301/8600] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:22:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:22:49.641444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ac6c8-192c-49e8-b01b-6fdaf4d5c7ae service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:22:49.643242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c86ac6c8-192c-49e8-b01b-6fdaf4d5c7ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:22:49.660004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ac6c8-192c-49e8-b01b-6fdaf4d5c7ae service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:22:49.665650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7eb0a2-6b8c-423f-b180-027e94e2f48d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:22:49.666425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7eb0a2-6b8c-423f-b180-027e94e2f48d service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:22:49.666767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7eb0a2-6b8c-423f-b180-027e94e2f48d service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:22:49.670301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7eb0a2-6b8c-423f-b180-027e94e2f48d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:22:49.670301 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9b7eb0a2-6b8c-423f-b180-027e94e2f48d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:22:49.681872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7eb0a2-6b8c-423f-b180-027e94e2f48d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:22:49.683491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7eb0a2-6b8c-423f-b180-027e94e2f48d service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:22:49.693669 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4300/8601] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:22:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:22:59.615626 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=49 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:22:59.689843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=13 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:23:46.674284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1b6b7-c524-48b4-95c6-fbcff7396a72 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:23:46.674893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1b6b7-c524-48b4-95c6-fbcff7396a72 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:23:46.674893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1b6b7-c524-48b4-95c6-fbcff7396a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:23:46.695218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-3cd1b6b7-c524-48b4-95c6-fbcff7396a72 None None] MFA Rules not processed for user `0482d6b66ea34d34bed74fac32f55068`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:23:46.696447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3cd1b6b7-c524-48b4-95c6-fbcff7396a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:23:46.703543 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4302/8602] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:23:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 04:23:47.359968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7eb0a2-6b8c-423f-b180-027e94e2f48d service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:23:47.370584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7eb0a2-6b8c-423f-b180-027e94e2f48d service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:23:47.376581 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08882d2-d65c-4726-9538-d136d5c77efa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:23:47.377201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08882d2-d65c-4726-9538-d136d5c77efa service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:23:47.377512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08882d2-d65c-4726-9538-d136d5c77efa service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:23:47.377790 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08882d2-d65c-4726-9538-d136d5c77efa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:23:47.379573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b08882d2-d65c-4726-9538-d136d5c77efa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:23:47.391376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08882d2-d65c-4726-9538-d136d5c77efa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:23:47.393040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08882d2-d65c-4726-9538-d136d5c77efa service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:23:47.403433 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4301/8603] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:23:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:23:56.690113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:23:57.399087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:24:44.494310 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f5ad6-ee1b-4c3a-8fed-e6b7a8f283f6 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:24:44.494875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f5ad6-ee1b-4c3a-8fed-e6b7a8f283f6 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:24:44.495031 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f5ad6-ee1b-4c3a-8fed-e6b7a8f283f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:24:44.515091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-bf8f5ad6-ee1b-4c3a-8fed-e6b7a8f283f6 None None] MFA Rules not processed for user `1a395d2414cd4da085a77ddc9b1f1caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:24:44.516325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-bf8f5ad6-ee1b-4c3a-8fed-e6b7a8f283f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:24:44.535450 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4303/8604] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 04:24:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 04:24:44.547135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08882d2-d65c-4726-9538-d136d5c77efa service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:24:44.567676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08882d2-d65c-4726-9538-d136d5c77efa service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:24:44.572799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781a1df-a2e4-4bb5-9558-2763a7bb2b6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:24:44.573419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781a1df-a2e4-4bb5-9558-2763a7bb2b6e service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:24:44.573697 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781a1df-a2e4-4bb5-9558-2763a7bb2b6e service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:24:44.573968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781a1df-a2e4-4bb5-9558-2763a7bb2b6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:24:44.582060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781a1df-a2e4-4bb5-9558-2763a7bb2b6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:24:44.583738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781a1df-a2e4-4bb5-9558-2763a7bb2b6e service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:24:44.608925 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4302/8605] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:24:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:24:44.611353 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f5ad6-ee1b-4c3a-8fed-e6b7a8f283f6 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:24:44.623808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f5ad6-ee1b-4c3a-8fed-e6b7a8f283f6 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:24:44.630234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc07ea0-25a5-463c-99e8-eca8e229613b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:24:44.631121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc07ea0-25a5-463c-99e8-eca8e229613b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:24:44.635926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc07ea0-25a5-463c-99e8-eca8e229613b admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:24:44.635926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc07ea0-25a5-463c-99e8-eca8e229613b admin admin] PATH_INFO: `/v3/users/0482d6b66ea34d34bed74fac32f55068` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:24:44.635926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc07ea0-25a5-463c-99e8-eca8e229613b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0482d6b66ea34d34bed74fac32f55068)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:24:44.637292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc07ea0-25a5-463c-99e8-eca8e229613b admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:24:44.812279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dbc07ea0-25a5-463c-99e8-eca8e229613b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0482d6b66ea34d34bed74fac32f55068'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:24:44.812952 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dbc07ea0-25a5-463c-99e8-eca8e229613b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0482d6b66ea34d34bed74fac32f55068'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:24:44.819819 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dbc07ea0-25a5-463c-99e8-eca8e229613b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0482d6b66ea34d34bed74fac32f55068'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:24:44.832010 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dbc07ea0-25a5-463c-99e8-eca8e229613b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0482d6b66ea34d34bed74fac32f55068'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:24:44.837049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-dbc07ea0-25a5-463c-99e8-eca8e229613b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0482d6b66ea34d34bed74fac32f55068'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:24:44.909135 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4304/8606] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:24:44 2022] DELETE /identity/v3/users/0482d6b66ea34d34bed74fac32f55068 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:24:45.179196 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781a1df-a2e4-4bb5-9558-2763a7bb2b6e service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:24:45.193155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781a1df-a2e4-4bb5-9558-2763a7bb2b6e service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:24:45.250612 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b42b2-e2d7-4985-80cc-2fa4e8be12ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:24:45.251748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b42b2-e2d7-4985-80cc-2fa4e8be12ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:24:45.252026 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b42b2-e2d7-4985-80cc-2fa4e8be12ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:24:45.252296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b42b2-e2d7-4985-80cc-2fa4e8be12ea admin admin] PATH_INFO: `/v3/projects/8f53f549cce04ce78df9a4b68ec35177` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:24:45.253401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b42b2-e2d7-4985-80cc-2fa4e8be12ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f53f549cce04ce78df9a4b68ec35177)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:24:45.255355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b42b2-e2d7-4985-80cc-2fa4e8be12ea admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:24:45.361597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-957b42b2-e2d7-4985-80cc-2fa4e8be12ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f53f549cce04ce78df9a4b68ec35177', 'request_id': 'req-957b42b2-e2d7-4985-80cc-2fa4e8be12ea'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:24:45.457453 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-957b42b2-e2d7-4985-80cc-2fa4e8be12ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f53f549cce04ce78df9a4b68ec35177', 'request_id': 'req-957b42b2-e2d7-4985-80cc-2fa4e8be12ea'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:24:45.464858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-957b42b2-e2d7-4985-80cc-2fa4e8be12ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f53f549cce04ce78df9a4b68ec35177', 'request_id': 'req-957b42b2-e2d7-4985-80cc-2fa4e8be12ea'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:24:45.477517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-957b42b2-e2d7-4985-80cc-2fa4e8be12ea admin admin] The token cache is being invalidate because project 8f53f549cce04ce78df9a4b68ec35177 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:24:45.477927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-957b42b2-e2d7-4985-80cc-2fa4e8be12ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:24:45.478847 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-957b42b2-e2d7-4985-80cc-2fa4e8be12ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:24:45.480448 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4303/8607] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:24:45 2022] DELETE /identity/v3/projects/8f53f549cce04ce78df9a4b68ec35177 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:24:45.486222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca246ad-06c3-4464-8128-a96dc42adcbb None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:24:45.486585 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca246ad-06c3-4464-8128-a96dc42adcbb None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:24:45.486872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca246ad-06c3-4464-8128-a96dc42adcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:24:45.506919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2ca246ad-06c3-4464-8128-a96dc42adcbb None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:24:45.508127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2ca246ad-06c3-4464-8128-a96dc42adcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:24:45.569296 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4305/8608] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:24:45.577332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c3082-5962-48ab-9605-a147f1c22817 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:24:45.578214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c3082-5962-48ab-9605-a147f1c22817 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:24:45.578492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c3082-5962-48ab-9605-a147f1c22817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:24:45.598997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a07c3082-5962-48ab-9605-a147f1c22817 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:24:45.600214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a07c3082-5962-48ab-9605-a147f1c22817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:24:45.608126 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4304/8609] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:24:45.612919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca246ad-06c3-4464-8128-a96dc42adcbb None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:24:45.622604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca246ad-06c3-4464-8128-a96dc42adcbb None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:24:45.627786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f9a9a-b831-4fce-9354-fdbe95b67e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:24:45.628432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f9a9a-b831-4fce-9354-fdbe95b67e89 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:24:45.628695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f9a9a-b831-4fce-9354-fdbe95b67e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:24:45.628969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f9a9a-b831-4fce-9354-fdbe95b67e89 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:24:45.629613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f9a9a-b831-4fce-9354-fdbe95b67e89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:24:45.629913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f9a9a-b831-4fce-9354-fdbe95b67e89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:24:45.631530 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f9a9a-b831-4fce-9354-fdbe95b67e89 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:24:45.642953 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4306/8610] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:24:45.647198 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c3082-5962-48ab-9605-a147f1c22817 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:24:45.656442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c3082-5962-48ab-9605-a147f1c22817 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:24:45.661197 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f91dd-6492-428a-b2e0-69734efa3553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:24:45.661798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f91dd-6492-428a-b2e0-69734efa3553 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:24:45.662109 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f91dd-6492-428a-b2e0-69734efa3553 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:24:45.669356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f91dd-6492-428a-b2e0-69734efa3553 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:24:45.669356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f91dd-6492-428a-b2e0-69734efa3553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:24:45.669356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f91dd-6492-428a-b2e0-69734efa3553 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:24:45.747685 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4305/8611] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:24:45 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:24:45.752508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f9a9a-b831-4fce-9354-fdbe95b67e89 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:24:45.762627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f9a9a-b831-4fce-9354-fdbe95b67e89 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:24:45.803657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:24:45.817889 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a51b2f-0b94-42d4-a079-29c2af95b1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:24:45.818525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a51b2f-0b94-42d4-a079-29c2af95b1dc admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:24:45.818813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a51b2f-0b94-42d4-a079-29c2af95b1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:24:45.819092 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a51b2f-0b94-42d4-a079-29c2af95b1dc admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:24:45.819753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a51b2f-0b94-42d4-a079-29c2af95b1dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:24:45.821718 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a51b2f-0b94-42d4-a079-29c2af95b1dc admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:24:45.923847 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4307/8612] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:24:45 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:24:45.927938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f91dd-6492-428a-b2e0-69734efa3553 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:24:45.938668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f91dd-6492-428a-b2e0-69734efa3553 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:24:45.943422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba216f6-1b5d-4027-9f65-37054c436107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:24:45.944045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba216f6-1b5d-4027-9f65-37054c436107 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:24:45.944388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba216f6-1b5d-4027-9f65-37054c436107 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:24:45.944665 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba216f6-1b5d-4027-9f65-37054c436107 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:24:45.945315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba216f6-1b5d-4027-9f65-37054c436107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:24:45.946988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba216f6-1b5d-4027-9f65-37054c436107 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:24:45.956865 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4306/8613] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:24:45.960811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a51b2f-0b94-42d4-a079-29c2af95b1dc admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:24:45.971778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a51b2f-0b94-42d4-a079-29c2af95b1dc admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:24:45.976478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572dbfd0-fdd3-4f3c-8e00-a34a5d5b227c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:24:45.977078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dbfd0-fdd3-4f3c-8e00-a34a5d5b227c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:24:45.977358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dbfd0-fdd3-4f3c-8e00-a34a5d5b227c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:24:45.977634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dbfd0-fdd3-4f3c-8e00-a34a5d5b227c admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:24:45.978727 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572dbfd0-fdd3-4f3c-8e00-a34a5d5b227c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:24:45.980277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572dbfd0-fdd3-4f3c-8e00-a34a5d5b227c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:24:45.993064 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4308/8614] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 04:24:45.996104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba216f6-1b5d-4027-9f65-37054c436107 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:24:46.006302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba216f6-1b5d-4027-9f65-37054c436107 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:24:46.010886 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f406204-75b9-43b9-beae-060485b176e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:24:46.013265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f406204-75b9-43b9-beae-060485b176e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:24:46.013265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f406204-75b9-43b9-beae-060485b176e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:24:46.013265 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f406204-75b9-43b9-beae-060485b176e8 admin admin] PATH_INFO: `/v3/projects/529ab4a5a66947aebb3f09a9842e5c9f/users/197669776fde4a6480f6cab6e5c8552f/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:24:46.026260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f406204-75b9-43b9-beae-060485b176e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=529ab4a5a66947aebb3f09a9842e5c9f, user_id=197669776fde4a6480f6cab6e5c8552f, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:24:46.028920 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f406204-75b9-43b9-beae-060485b176e8 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:24:46.132221 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4307/8615] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:24:45 2022] PUT /identity/v3/projects/529ab4a5a66947aebb3f09a9842e5c9f/users/197669776fde4a6480f6cab6e5c8552f/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:24:46.137318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daea579-ac42-4b29-ba58-9c7f1ad2bc73 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:24:46.137624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daea579-ac42-4b29-ba58-9c7f1ad2bc73 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:24:46.137932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daea579-ac42-4b29-ba58-9c7f1ad2bc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:24:46.157204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-9daea579-ac42-4b29-ba58-9c7f1ad2bc73 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:24:46.159079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9daea579-ac42-4b29-ba58-9c7f1ad2bc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:24:46.223826 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4309/8616] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:24:46.230547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f406204-75b9-43b9-beae-060485b176e8 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:24:46.232436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4f406204-75b9-43b9-beae-060485b176e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:24:46.239645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:24:46.289369 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f406204-75b9-43b9-beae-060485b176e8 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:24:46.293408 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6776300-b96a-4816-a5de-d08cd65bd3bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:24:46.294007 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6776300-b96a-4816-a5de-d08cd65bd3bf service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:24:46.294322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6776300-b96a-4816-a5de-d08cd65bd3bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:24:46.294591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6776300-b96a-4816-a5de-d08cd65bd3bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:24:46.304006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6776300-b96a-4816-a5de-d08cd65bd3bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:24:46.306242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6776300-b96a-4816-a5de-d08cd65bd3bf service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:24:46.314891 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4308/8617] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:24:51.550055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262b564-7d5e-4400-9216-1aef56e88ace None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:24:51.550640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262b564-7d5e-4400-9216-1aef56e88ace None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:24:51.550842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262b564-7d5e-4400-9216-1aef56e88ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:24:51.612619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2262b564-7d5e-4400-9216-1aef56e88ace None None] MFA Rules not processed for user `197669776fde4a6480f6cab6e5c8552f`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:24:51.613916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2262b564-7d5e-4400-9216-1aef56e88ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:24:51.697900 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4310/8618] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:24:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:24:51.714676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6776300-b96a-4816-a5de-d08cd65bd3bf service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:24:51.716439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d6776300-b96a-4816-a5de-d08cd65bd3bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:24:51.800088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6776300-b96a-4816-a5de-d08cd65bd3bf service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:24:51.805861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a16f2a-6966-4066-8ad9-fe7eb70c9c3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:24:51.806533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a16f2a-6966-4066-8ad9-fe7eb70c9c3a service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:24:51.806817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a16f2a-6966-4066-8ad9-fe7eb70c9c3a service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:24:51.807090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a16f2a-6966-4066-8ad9-fe7eb70c9c3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:24:51.816919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a16f2a-6966-4066-8ad9-fe7eb70c9c3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:24:51.818663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a16f2a-6966-4066-8ad9-fe7eb70c9c3a service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:24:51.830584 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4309/8619] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:24:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:24:54.145942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf91e4e-24d7-4650-af8f-a940d96eb55d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:24:54.146520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf91e4e-24d7-4650-af8f-a940d96eb55d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:24:54.146520 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf91e4e-24d7-4650-af8f-a940d96eb55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:24:54.167419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6cf91e4e-24d7-4650-af8f-a940d96eb55d None None] MFA Rules not processed for user `197669776fde4a6480f6cab6e5c8552f`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:24:54.168654 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6cf91e4e-24d7-4650-af8f-a940d96eb55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:24:54.176831 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4311/8620] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:24:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:24:58.201097 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a16f2a-6966-4066-8ad9-fe7eb70c9c3a service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:24:58.202597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-20a16f2a-6966-4066-8ad9-fe7eb70c9c3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:24:58.215794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a16f2a-6966-4066-8ad9-fe7eb70c9c3a service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:24:58.219651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ccee3-9d66-43e7-ac9f-af8f0670c1bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:24:58.220285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ccee3-9d66-43e7-ac9f-af8f0670c1bc service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:24:58.220564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ccee3-9d66-43e7-ac9f-af8f0670c1bc service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:24:58.220859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ccee3-9d66-43e7-ac9f-af8f0670c1bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:24:58.222629 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bd5ccee3-9d66-43e7-ac9f-af8f0670c1bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:24:58.232519 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ccee3-9d66-43e7-ac9f-af8f0670c1bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:24:58.233935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ccee3-9d66-43e7-ac9f-af8f0670c1bc service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:24:58.242727 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4310/8621] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:24:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:25:04.161328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=76,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:25:08.239029 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=64 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:25:45.068586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf91e4e-24d7-4650-af8f-a940d96eb55d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:25:45.078655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf91e4e-24d7-4650-af8f-a940d96eb55d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:25:45.082430 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd046afb-a1f0-4b86-99a8-31a253098486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:25:45.083046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd046afb-a1f0-4b86-99a8-31a253098486 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:25:45.083335 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd046afb-a1f0-4b86-99a8-31a253098486 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:25:45.083616 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd046afb-a1f0-4b86-99a8-31a253098486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:25:45.085405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fd046afb-a1f0-4b86-99a8-31a253098486 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:25:45.099701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd046afb-a1f0-4b86-99a8-31a253098486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:25:45.101131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd046afb-a1f0-4b86-99a8-31a253098486 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:25:45.112195 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4312/8622] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:25:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:25:45.297160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ccee3-9d66-43e7-ac9f-af8f0670c1bc service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:25:45.305792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ccee3-9d66-43e7-ac9f-af8f0670c1bc service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:25:45.309547 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69323086-8b74-4e5d-b3da-c99cad5602d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:25:45.310183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69323086-8b74-4e5d-b3da-c99cad5602d9 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:25:45.310498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69323086-8b74-4e5d-b3da-c99cad5602d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:25:45.310756 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69323086-8b74-4e5d-b3da-c99cad5602d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:25:45.312535 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-69323086-8b74-4e5d-b3da-c99cad5602d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:25:45.325599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69323086-8b74-4e5d-b3da-c99cad5602d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:25:45.328841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69323086-8b74-4e5d-b3da-c99cad5602d9 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:25:45.338294 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4311/8623] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:25:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:25:55.107398 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:25:55.333570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:26:06.634316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd046afb-a1f0-4b86-99a8-31a253098486 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:26:06.642872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd046afb-a1f0-4b86-99a8-31a253098486 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:26:06.646703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5f2bb-a27d-4a06-b4a6-e4e029b50aa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:26:06.647306 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5f2bb-a27d-4a06-b4a6-e4e029b50aa4 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:26:06.647589 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5f2bb-a27d-4a06-b4a6-e4e029b50aa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:26:06.647891 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5f2bb-a27d-4a06-b4a6-e4e029b50aa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:26:06.649758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-97b5f2bb-a27d-4a06-b4a6-e4e029b50aa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:26:06.659495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5f2bb-a27d-4a06-b4a6-e4e029b50aa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:26:06.661499 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5f2bb-a27d-4a06-b4a6-e4e029b50aa4 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:26:06.669324 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4313/8624] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:26:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:26:07.086876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69323086-8b74-4e5d-b3da-c99cad5602d9 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:26:07.099319 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69323086-8b74-4e5d-b3da-c99cad5602d9 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:26:07.104960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf3f6d-bf83-4212-8c18-4d752ae02312 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:26:07.105561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf3f6d-bf83-4212-8c18-4d752ae02312 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:26:07.105841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf3f6d-bf83-4212-8c18-4d752ae02312 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:26:07.106159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf3f6d-bf83-4212-8c18-4d752ae02312 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:26:07.107881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-11bf3f6d-bf83-4212-8c18-4d752ae02312 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:26:07.119682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf3f6d-bf83-4212-8c18-4d752ae02312 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:26:07.121294 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf3f6d-bf83-4212-8c18-4d752ae02312 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:26:07.132590 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4312/8625] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:26:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:26:16.665853 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:26:17.127264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:26:18.221690 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50e4cd-f6bf-4d90-8c4c-5a465d5efdb7 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:26:18.222694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50e4cd-f6bf-4d90-8c4c-5a465d5efdb7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:26:18.222828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50e4cd-f6bf-4d90-8c4c-5a465d5efdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:26:18.242491 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4a50e4cd-f6bf-4d90-8c4c-5a465d5efdb7 None None] MFA Rules not processed for user `197669776fde4a6480f6cab6e5c8552f`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:26:18.243709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4a50e4cd-f6bf-4d90-8c4c-5a465d5efdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:26:18.250603 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4314/8626] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:26:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:26:28.236997 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:26:30.065620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf3f6d-bf83-4212-8c18-4d752ae02312 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:26:30.076696 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf3f6d-bf83-4212-8c18-4d752ae02312 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:26:30.082218 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310fdd3b-4712-4eae-9aea-98f217438b87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:26:30.082839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fdd3b-4712-4eae-9aea-98f217438b87 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:26:30.083121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fdd3b-4712-4eae-9aea-98f217438b87 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:26:30.083394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fdd3b-4712-4eae-9aea-98f217438b87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:26:30.085205 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-310fdd3b-4712-4eae-9aea-98f217438b87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:26:30.098269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310fdd3b-4712-4eae-9aea-98f217438b87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:26:30.099845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310fdd3b-4712-4eae-9aea-98f217438b87 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:26:30.109976 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4313/8627] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:26:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:26:33.229227 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50e4cd-f6bf-4d90-8c4c-5a465d5efdb7 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:26:33.242578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50e4cd-f6bf-4d90-8c4c-5a465d5efdb7 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:26:33.248382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820ab83-40b0-4ad9-aa33-3e3fe3b15dd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:26:33.249134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820ab83-40b0-4ad9-aa33-3e3fe3b15dd2 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:26:33.249419 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820ab83-40b0-4ad9-aa33-3e3fe3b15dd2 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:26:33.249694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820ab83-40b0-4ad9-aa33-3e3fe3b15dd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:26:33.251569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6820ab83-40b0-4ad9-aa33-3e3fe3b15dd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:26:33.264602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820ab83-40b0-4ad9-aa33-3e3fe3b15dd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:26:33.266211 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820ab83-40b0-4ad9-aa33-3e3fe3b15dd2 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:26:33.276911 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4315/8628] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:26:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:26:40.105812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:26:43.272461 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:27:17.419322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310fdd3b-4712-4eae-9aea-98f217438b87 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:27:17.429638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310fdd3b-4712-4eae-9aea-98f217438b87 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:27:17.433388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159455a5-4336-48b8-b0e6-591520a933c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:27:17.434000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159455a5-4336-48b8-b0e6-591520a933c0 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:27:17.434321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159455a5-4336-48b8-b0e6-591520a933c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:27:17.434603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159455a5-4336-48b8-b0e6-591520a933c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:27:17.436349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-159455a5-4336-48b8-b0e6-591520a933c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:27:17.446378 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159455a5-4336-48b8-b0e6-591520a933c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:27:17.447822 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159455a5-4336-48b8-b0e6-591520a933c0 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:27:17.455649 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4314/8629] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:27:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:27:17.604747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820ab83-40b0-4ad9-aa33-3e3fe3b15dd2 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:27:17.606298 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6820ab83-40b0-4ad9-aa33-3e3fe3b15dd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:27:17.674446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820ab83-40b0-4ad9-aa33-3e3fe3b15dd2 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:27:17.679432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21957f-44d1-4522-b7ce-adb41586843a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:27:17.680038 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21957f-44d1-4522-b7ce-adb41586843a service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:27:17.680372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21957f-44d1-4522-b7ce-adb41586843a service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:27:17.680651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21957f-44d1-4522-b7ce-adb41586843a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:27:17.682403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2b21957f-44d1-4522-b7ce-adb41586843a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:27:17.693756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21957f-44d1-4522-b7ce-adb41586843a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:27:17.695294 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21957f-44d1-4522-b7ce-adb41586843a service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:27:17.704990 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4316/8630] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:27:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:27:17.968309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159455a5-4336-48b8-b0e6-591520a933c0 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:27:17.977550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159455a5-4336-48b8-b0e6-591520a933c0 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:27:17.981243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d291e3-a7e3-4943-9694-692d22647f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:27:17.981840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d291e3-a7e3-4943-9694-692d22647f49 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:27:17.982164 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d291e3-a7e3-4943-9694-692d22647f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:27:17.982442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d291e3-a7e3-4943-9694-692d22647f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:27:17.984188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-42d291e3-a7e3-4943-9694-692d22647f49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:27:17.997934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d291e3-a7e3-4943-9694-692d22647f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:27:17.999473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d291e3-a7e3-4943-9694-692d22647f49 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:27:18.010383 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4315/8631] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:27:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:27:18.071132 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21957f-44d1-4522-b7ce-adb41586843a service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:27:18.081571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21957f-44d1-4522-b7ce-adb41586843a service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:27:18.086629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8b8ce-6297-464c-9e90-37839b4103d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:27:18.087225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8b8ce-6297-464c-9e90-37839b4103d1 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:27:18.087508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8b8ce-6297-464c-9e90-37839b4103d1 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:27:18.087780 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8b8ce-6297-464c-9e90-37839b4103d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:27:18.089458 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c0c8b8ce-6297-464c-9e90-37839b4103d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:27:18.101911 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8b8ce-6297-464c-9e90-37839b4103d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:27:18.103516 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8b8ce-6297-464c-9e90-37839b4103d1 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:27:18.113758 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4317/8632] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:27:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:27:28.005550 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=12 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:27:28.109109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=38 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:27:36.902927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb643978-0b7c-46cc-85c4-7f70f1242797 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:27:36.903439 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb643978-0b7c-46cc-85c4-7f70f1242797 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:27:36.903538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb643978-0b7c-46cc-85c4-7f70f1242797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:27:36.932747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-eb643978-0b7c-46cc-85c4-7f70f1242797 None None] MFA Rules not processed for user `197669776fde4a6480f6cab6e5c8552f`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:27:36.933939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-eb643978-0b7c-46cc-85c4-7f70f1242797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:27:36.957036 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4316/8633] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:27:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:27:37.562989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8b8ce-6297-464c-9e90-37839b4103d1 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:27:37.583799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8b8ce-6297-464c-9e90-37839b4103d1 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:27:37.587577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121c402-852d-43f2-a51d-2211172d3266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:27:37.588185 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121c402-852d-43f2-a51d-2211172d3266 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:27:37.588472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121c402-852d-43f2-a51d-2211172d3266 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:27:37.588754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121c402-852d-43f2-a51d-2211172d3266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:27:37.590506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9121c402-852d-43f2-a51d-2211172d3266 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:27:37.610232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121c402-852d-43f2-a51d-2211172d3266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:27:37.611659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121c402-852d-43f2-a51d-2211172d3266 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:27:37.619676 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4318/8634] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:27:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:27:46.954799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=15 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:27:47.616126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=15 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:27:53.308924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb643978-0b7c-46cc-85c4-7f70f1242797 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:27:53.327764 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb643978-0b7c-46cc-85c4-7f70f1242797 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:27:53.333375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593d939-150d-451c-8463-fa559528947f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:27:53.333982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593d939-150d-451c-8463-fa559528947f service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:27:53.334300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593d939-150d-451c-8463-fa559528947f service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:27:53.334576 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593d939-150d-451c-8463-fa559528947f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:27:53.336274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e593d939-150d-451c-8463-fa559528947f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:27:53.347575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593d939-150d-451c-8463-fa559528947f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:27:53.349153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593d939-150d-451c-8463-fa559528947f service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:27:53.358695 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4317/8635] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:27:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:27:54.636261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121c402-852d-43f2-a51d-2211172d3266 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:27:54.637675 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9121c402-852d-43f2-a51d-2211172d3266 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:27:54.652971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121c402-852d-43f2-a51d-2211172d3266 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:27:54.657951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b415d-4e4e-4b4c-9ffc-1728913682c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:27:54.658580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b415d-4e4e-4b4c-9ffc-1728913682c6 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:27:54.658867 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b415d-4e4e-4b4c-9ffc-1728913682c6 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:27:54.659215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b415d-4e4e-4b4c-9ffc-1728913682c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:27:54.660875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-260b415d-4e4e-4b4c-9ffc-1728913682c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:27:54.671866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b415d-4e4e-4b4c-9ffc-1728913682c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:27:54.673440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b415d-4e4e-4b4c-9ffc-1728913682c6 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:27:54.683287 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4319/8636] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:27:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:28:03.354775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=9 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:28:04.679046 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:29:02.744619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d758309-295d-4723-8ad9-edf5ca9520e0 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:29:02.744619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d758309-295d-4723-8ad9-edf5ca9520e0 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:29:02.744619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d758309-295d-4723-8ad9-edf5ca9520e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:29:02.762553 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-2d758309-295d-4723-8ad9-edf5ca9520e0 None None] MFA Rules not processed for user `197669776fde4a6480f6cab6e5c8552f`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:29:02.763924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2d758309-295d-4723-8ad9-edf5ca9520e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:29:02.771427 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4318/8637] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:29:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:29:03.451629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b415d-4e4e-4b4c-9ffc-1728913682c6 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:29:03.463076 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b415d-4e4e-4b4c-9ffc-1728913682c6 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:29:03.468721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db695a86-8dfc-4427-9bd9-58a53b1de87e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:29:03.469426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db695a86-8dfc-4427-9bd9-58a53b1de87e service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:29:03.469772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db695a86-8dfc-4427-9bd9-58a53b1de87e service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:29:03.470151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db695a86-8dfc-4427-9bd9-58a53b1de87e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:29:03.472609 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-db695a86-8dfc-4427-9bd9-58a53b1de87e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:29:03.484957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db695a86-8dfc-4427-9bd9-58a53b1de87e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:29:03.486313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db695a86-8dfc-4427-9bd9-58a53b1de87e service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:29:03.498658 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4320/8638] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:29:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:29:12.756259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:29:13.494521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:29:52.042591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d758309-295d-4723-8ad9-edf5ca9520e0 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:29:52.044008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2d758309-295d-4723-8ad9-edf5ca9520e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:29:52.122980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d758309-295d-4723-8ad9-edf5ca9520e0 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:29:52.126884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed17f2-8924-45ba-bc13-3414bf992dc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:29:52.127518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed17f2-8924-45ba-bc13-3414bf992dc1 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:29:52.127802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed17f2-8924-45ba-bc13-3414bf992dc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:29:52.128080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed17f2-8924-45ba-bc13-3414bf992dc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:29:52.141593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed17f2-8924-45ba-bc13-3414bf992dc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:29:52.143277 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed17f2-8924-45ba-bc13-3414bf992dc1 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:29:52.153266 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4319/8639] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:29:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:30:02.149455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=35 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:30:09.495989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db695a86-8dfc-4427-9bd9-58a53b1de87e service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:30:09.505350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db695a86-8dfc-4427-9bd9-58a53b1de87e service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:30:09.508935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd68f7-69d5-4ff3-8533-2d267fdd0b62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:30:09.509528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd68f7-69d5-4ff3-8533-2d267fdd0b62 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:30:09.509810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd68f7-69d5-4ff3-8533-2d267fdd0b62 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:30:09.510110 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd68f7-69d5-4ff3-8533-2d267fdd0b62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:30:09.517018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd68f7-69d5-4ff3-8533-2d267fdd0b62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:30:09.518471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd68f7-69d5-4ff3-8533-2d267fdd0b62 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:30:09.526827 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4321/8640] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:30:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:30:19.523337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:30:45.152430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed17f2-8924-45ba-bc13-3414bf992dc1 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:30:45.161637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed17f2-8924-45ba-bc13-3414bf992dc1 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:30:45.165891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d5ffd-e7f0-4a32-896c-cd68981a251a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:30:45.166548 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d5ffd-e7f0-4a32-896c-cd68981a251a service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:30:45.166833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d5ffd-e7f0-4a32-896c-cd68981a251a service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:30:45.167106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d5ffd-e7f0-4a32-896c-cd68981a251a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:30:45.184492 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d5ffd-e7f0-4a32-896c-cd68981a251a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:30:45.185931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d5ffd-e7f0-4a32-896c-cd68981a251a service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:30:45.196845 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4320/8641] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:30:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:30:47.067389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd68f7-69d5-4ff3-8533-2d267fdd0b62 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:30:47.076741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd68f7-69d5-4ff3-8533-2d267fdd0b62 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:30:47.080352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f03fc0-2ce2-4a45-9d28-a576d0ede78b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:30:47.081292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f03fc0-2ce2-4a45-9d28-a576d0ede78b service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:30:47.081292 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f03fc0-2ce2-4a45-9d28-a576d0ede78b service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:30:47.081508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f03fc0-2ce2-4a45-9d28-a576d0ede78b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:30:47.091521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f03fc0-2ce2-4a45-9d28-a576d0ede78b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:30:47.093019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f03fc0-2ce2-4a45-9d28-a576d0ede78b service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:30:47.103987 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4322/8642] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:30:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:30:55.192075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=9 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:30:57.099287 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:31:21.031395 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d5ffd-e7f0-4a32-896c-cd68981a251a service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:31:21.040611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d5ffd-e7f0-4a32-896c-cd68981a251a service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:31:21.044374 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c252f2-ff48-4f5f-824a-8525b4170a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:31:21.044986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c252f2-ff48-4f5f-824a-8525b4170a45 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:31:21.045273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c252f2-ff48-4f5f-824a-8525b4170a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:31:21.045552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c252f2-ff48-4f5f-824a-8525b4170a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:31:21.054616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c252f2-ff48-4f5f-824a-8525b4170a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:31:21.055990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c252f2-ff48-4f5f-824a-8525b4170a45 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:31:21.083378 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4321/8643] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:31:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:31:24.411177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f03fc0-2ce2-4a45-9d28-a576d0ede78b service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:31:24.423200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f03fc0-2ce2-4a45-9d28-a576d0ede78b service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:31:24.428459 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35734294-0a9a-41f3-885a-87d115f5bc89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:31:24.429688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35734294-0a9a-41f3-885a-87d115f5bc89 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:31:24.429973 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35734294-0a9a-41f3-885a-87d115f5bc89 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:31:24.430295 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35734294-0a9a-41f3-885a-87d115f5bc89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:31:24.432618 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-35734294-0a9a-41f3-885a-87d115f5bc89 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:31:24.457873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35734294-0a9a-41f3-885a-87d115f5bc89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:31:24.459497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35734294-0a9a-41f3-885a-87d115f5bc89 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:31:24.470018 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4323/8644] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:31:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:31:24.540753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c252f2-ff48-4f5f-824a-8525b4170a45 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:31:24.550817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c252f2-ff48-4f5f-824a-8525b4170a45 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:31:24.555708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe7424-df12-4772-a72f-de24cb3065fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:31:24.556350 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe7424-df12-4772-a72f-de24cb3065fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:31:24.556634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe7424-df12-4772-a72f-de24cb3065fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:31:24.556912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe7424-df12-4772-a72f-de24cb3065fd admin admin] PATH_INFO: `/v3/users/197669776fde4a6480f6cab6e5c8552f` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:31:24.558047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe7424-df12-4772-a72f-de24cb3065fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=197669776fde4a6480f6cab6e5c8552f)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:31:24.560002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe7424-df12-4772-a72f-de24cb3065fd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:31:24.740119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0fbe7424-df12-4772-a72f-de24cb3065fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '197669776fde4a6480f6cab6e5c8552f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:31:24.741130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0fbe7424-df12-4772-a72f-de24cb3065fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '197669776fde4a6480f6cab6e5c8552f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:31:24.749015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0fbe7424-df12-4772-a72f-de24cb3065fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '197669776fde4a6480f6cab6e5c8552f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:31:24.761002 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0fbe7424-df12-4772-a72f-de24cb3065fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '197669776fde4a6480f6cab6e5c8552f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:31:24.851155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0fbe7424-df12-4772-a72f-de24cb3065fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '197669776fde4a6480f6cab6e5c8552f'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:31:24.859556 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4322/8645] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:31:24 2022] DELETE /identity/v3/users/197669776fde4a6480f6cab6e5c8552f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:31:25.115280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35734294-0a9a-41f3-885a-87d115f5bc89 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:31:25.126240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35734294-0a9a-41f3-885a-87d115f5bc89 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:31:25.191412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547bf17-66dc-4782-ad1e-6bc281df5cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:31:25.192069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547bf17-66dc-4782-ad1e-6bc281df5cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:31:25.192336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547bf17-66dc-4782-ad1e-6bc281df5cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:31:25.192607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547bf17-66dc-4782-ad1e-6bc281df5cf7 admin admin] PATH_INFO: `/v3/projects/529ab4a5a66947aebb3f09a9842e5c9f` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:31:25.193719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547bf17-66dc-4782-ad1e-6bc281df5cf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=529ab4a5a66947aebb3f09a9842e5c9f)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:31:25.196290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547bf17-66dc-4782-ad1e-6bc281df5cf7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:31:25.287781 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0547bf17-66dc-4782-ad1e-6bc281df5cf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '529ab4a5a66947aebb3f09a9842e5c9f', 'request_id': 'req-0547bf17-66dc-4782-ad1e-6bc281df5cf7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:31:25.293988 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0547bf17-66dc-4782-ad1e-6bc281df5cf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '529ab4a5a66947aebb3f09a9842e5c9f', 'request_id': 'req-0547bf17-66dc-4782-ad1e-6bc281df5cf7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:31:25.299670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0547bf17-66dc-4782-ad1e-6bc281df5cf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '529ab4a5a66947aebb3f09a9842e5c9f', 'request_id': 'req-0547bf17-66dc-4782-ad1e-6bc281df5cf7'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:31:25.379397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0547bf17-66dc-4782-ad1e-6bc281df5cf7 admin admin] The token cache is being invalidate because project 529ab4a5a66947aebb3f09a9842e5c9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:31:25.379622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0547bf17-66dc-4782-ad1e-6bc281df5cf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:31:25.380245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-0547bf17-66dc-4782-ad1e-6bc281df5cf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:31:25.382433 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4324/8646] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:31:25 2022] DELETE /identity/v3/projects/529ab4a5a66947aebb3f09a9842e5c9f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:31:25.387361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca094b90-1271-4f0a-8886-b25a44136dcd None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:31:25.387653 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca094b90-1271-4f0a-8886-b25a44136dcd None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:31:25.387932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca094b90-1271-4f0a-8886-b25a44136dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:31:25.416444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ca094b90-1271-4f0a-8886-b25a44136dcd None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:31:25.417650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ca094b90-1271-4f0a-8886-b25a44136dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:31:25.475971 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4323/8647] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:31:25.483721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ef133-c0af-4492-9eb3-295225f44a3f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:31:25.484220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ef133-c0af-4492-9eb3-295225f44a3f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:31:25.484335 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ef133-c0af-4492-9eb3-295225f44a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:31:25.503948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-8a9ef133-c0af-4492-9eb3-295225f44a3f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:31:25.505153 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8a9ef133-c0af-4492-9eb3-295225f44a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:31:25.513573 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4325/8648] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:31:25.517540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca094b90-1271-4f0a-8886-b25a44136dcd None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:31:25.527044 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca094b90-1271-4f0a-8886-b25a44136dcd None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:31:25.531560 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0e307-4ed5-426d-8c00-19e7fa9ec6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:31:25.532159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0e307-4ed5-426d-8c00-19e7fa9ec6ac admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:31:25.532438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0e307-4ed5-426d-8c00-19e7fa9ec6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:31:25.532711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0e307-4ed5-426d-8c00-19e7fa9ec6ac admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:31:25.533355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0e307-4ed5-426d-8c00-19e7fa9ec6ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:31:25.533684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0e307-4ed5-426d-8c00-19e7fa9ec6ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:31:25.535307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0e307-4ed5-426d-8c00-19e7fa9ec6ac admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:31:25.547088 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4324/8649] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:31:25.551304 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ef133-c0af-4492-9eb3-295225f44a3f None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:31:25.561204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ef133-c0af-4492-9eb3-295225f44a3f None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:31:25.565888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df508f-2a78-438d-b736-d411940f80f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:31:25.566553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df508f-2a78-438d-b736-d411940f80f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:31:25.566838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df508f-2a78-438d-b736-d411940f80f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:31:25.567113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df508f-2a78-438d-b736-d411940f80f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:31:25.567742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df508f-2a78-438d-b736-d411940f80f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:31:25.569677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df508f-2a78-438d-b736-d411940f80f2 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:31:25.675317 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4326/8650] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:31:25 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 04:31:25.679450 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0e307-4ed5-426d-8c00-19e7fa9ec6ac admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:31:25.689720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0e307-4ed5-426d-8c00-19e7fa9ec6ac admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:31:25.708461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:31:25.744355 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224ea3e-f5d2-4f2d-a3c2-683776a6e4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:31:25.744949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224ea3e-f5d2-4f2d-a3c2-683776a6e4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:31:25.745227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224ea3e-f5d2-4f2d-a3c2-683776a6e4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:31:25.745495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224ea3e-f5d2-4f2d-a3c2-683776a6e4a6 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:31:25.746200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224ea3e-f5d2-4f2d-a3c2-683776a6e4a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:31:25.748117 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224ea3e-f5d2-4f2d-a3c2-683776a6e4a6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:31:25.864752 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4325/8651] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:31:25 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:31:25.869263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df508f-2a78-438d-b736-d411940f80f2 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:31:25.879622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df508f-2a78-438d-b736-d411940f80f2 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:31:25.885039 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1605d-483a-43ff-9234-d015743d71fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:31:25.885634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1605d-483a-43ff-9234-d015743d71fb admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:31:25.885918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1605d-483a-43ff-9234-d015743d71fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:31:25.886253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1605d-483a-43ff-9234-d015743d71fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:31:25.886920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1605d-483a-43ff-9234-d015743d71fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:31:25.888506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1605d-483a-43ff-9234-d015743d71fb admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:31:25.898912 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4327/8652] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:31:25.902839 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224ea3e-f5d2-4f2d-a3c2-683776a6e4a6 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:31:25.912844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224ea3e-f5d2-4f2d-a3c2-683776a6e4a6 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:31:25.917478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b58650-5445-4363-89b6-8fdbaeab8ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:31:25.918129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b58650-5445-4363-89b6-8fdbaeab8ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:31:25.918416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b58650-5445-4363-89b6-8fdbaeab8ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:31:25.918693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b58650-5445-4363-89b6-8fdbaeab8ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:31:25.919347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b58650-5445-4363-89b6-8fdbaeab8ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:31:25.920937 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b58650-5445-4363-89b6-8fdbaeab8ed6 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:31:25.931971 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4326/8653] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:31:25.936033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1605d-483a-43ff-9234-d015743d71fb admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:31:25.946605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1605d-483a-43ff-9234-d015743d71fb admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:31:25.951535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8faaed5-c287-4b20-a8ac-d4151c1c8bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:31:25.952189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faaed5-c287-4b20-a8ac-d4151c1c8bf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:31:25.952468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faaed5-c287-4b20-a8ac-d4151c1c8bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:31:25.952740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faaed5-c287-4b20-a8ac-d4151c1c8bf3 admin admin] PATH_INFO: `/v3/projects/eba1782ef9544e6d9fb7da0a1389ef48/users/2b507cef618e4b7ea712a96f014b0b91/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:31:25.955562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:31:25.969167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8faaed5-c287-4b20-a8ac-d4151c1c8bf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba1782ef9544e6d9fb7da0a1389ef48, user_id=2b507cef618e4b7ea712a96f014b0b91, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:31:25.972122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8faaed5-c287-4b20-a8ac-d4151c1c8bf3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:31:26.059557 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4328/8654] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:31:25 2022] PUT /identity/v3/projects/eba1782ef9544e6d9fb7da0a1389ef48/users/2b507cef618e4b7ea712a96f014b0b91/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:31:26.064716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62549499-7125-42f2-837f-905a952199b5 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:31:26.065090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62549499-7125-42f2-837f-905a952199b5 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:31:26.065464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62549499-7125-42f2-837f-905a952199b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:31:26.085435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-62549499-7125-42f2-837f-905a952199b5 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:31:26.086689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-62549499-7125-42f2-837f-905a952199b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:31:26.145575 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4327/8655] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:31:26.155391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8faaed5-c287-4b20-a8ac-d4151c1c8bf3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:31:26.157062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b8faaed5-c287-4b20-a8ac-d4151c1c8bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:31:26.225985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8faaed5-c287-4b20-a8ac-d4151c1c8bf3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:31:26.229707 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f92e1d-64bc-4976-95b4-a7385b5faf53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:31:26.230354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f92e1d-64bc-4976-95b4-a7385b5faf53 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:31:26.230642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f92e1d-64bc-4976-95b4-a7385b5faf53 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:31:26.230921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f92e1d-64bc-4976-95b4-a7385b5faf53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:31:26.239828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f92e1d-64bc-4976-95b4-a7385b5faf53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:31:26.241756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f92e1d-64bc-4976-95b4-a7385b5faf53 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:31:26.251436 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4329/8656] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:31:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:31:31.497526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f81c8-2870-4333-9a2f-b9c754181612 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:31:31.498120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f81c8-2870-4333-9a2f-b9c754181612 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:31:31.498120 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f81c8-2870-4333-9a2f-b9c754181612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:31:31.527460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-053f81c8-2870-4333-9a2f-b9c754181612 None None] MFA Rules not processed for user `2b507cef618e4b7ea712a96f014b0b91`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:31:31.528705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-053f81c8-2870-4333-9a2f-b9c754181612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:31:31.596099 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4328/8657] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:31:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:31:31.605927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818dc537-0d23-4fd7-a046-36eab3644f0d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:31:31.606521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818dc537-0d23-4fd7-a046-36eab3644f0d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:31:31.606521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818dc537-0d23-4fd7-a046-36eab3644f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:31:31.626896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-818dc537-0d23-4fd7-a046-36eab3644f0d None None] MFA Rules not processed for user `2b507cef618e4b7ea712a96f014b0b91`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:31:31.628122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-818dc537-0d23-4fd7-a046-36eab3644f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:31:31.635756 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4330/8658] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:31:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:31:31.650024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f81c8-2870-4333-9a2f-b9c754181612 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:31:31.651483 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-053f81c8-2870-4333-9a2f-b9c754181612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:31:31.688437 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:31:31.744184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f81c8-2870-4333-9a2f-b9c754181612 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:31:31.750683 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f43363-56e4-4eaf-855e-dd33cf7a4021 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:31:31.751368 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f43363-56e4-4eaf-855e-dd33cf7a4021 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:31:31.751647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f43363-56e4-4eaf-855e-dd33cf7a4021 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:31:31.752342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f43363-56e4-4eaf-855e-dd33cf7a4021 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:31:31.761831 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f43363-56e4-4eaf-855e-dd33cf7a4021 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:31:31.763546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f43363-56e4-4eaf-855e-dd33cf7a4021 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:31:31.773617 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4329/8659] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:31:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:31:36.458293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818dc537-0d23-4fd7-a046-36eab3644f0d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:31:36.460317 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-818dc537-0d23-4fd7-a046-36eab3644f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:31:36.479428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818dc537-0d23-4fd7-a046-36eab3644f0d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:31:36.484995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf30c8d-69e6-4447-9224-773e19e02964 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:31:36.485619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf30c8d-69e6-4447-9224-773e19e02964 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:31:36.485906 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf30c8d-69e6-4447-9224-773e19e02964 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:31:36.486212 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf30c8d-69e6-4447-9224-773e19e02964 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:31:36.487937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9cf30c8d-69e6-4447-9224-773e19e02964 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:31:36.500928 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf30c8d-69e6-4447-9224-773e19e02964 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:31:36.503271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf30c8d-69e6-4447-9224-773e19e02964 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:31:36.513909 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4331/8660] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:31:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:31:41.813494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=25 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:31:43.595192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f43363-56e4-4eaf-855e-dd33cf7a4021 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:31:43.607338 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f43363-56e4-4eaf-855e-dd33cf7a4021 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:31:43.612866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f519d19-4dc1-4267-8592-e9efc6ed9748 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:31:43.613460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f519d19-4dc1-4267-8592-e9efc6ed9748 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:31:43.613738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f519d19-4dc1-4267-8592-e9efc6ed9748 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:31:43.614011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f519d19-4dc1-4267-8592-e9efc6ed9748 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:31:43.615751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9f519d19-4dc1-4267-8592-e9efc6ed9748 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:31:43.628045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f519d19-4dc1-4267-8592-e9efc6ed9748 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:31:43.634701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f519d19-4dc1-4267-8592-e9efc6ed9748 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:31:43.640004 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4330/8661] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:31:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:31:45.375051 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a03d1-2b0b-47f6-8375-0a14644b0369 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:31:45.375554 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a03d1-2b0b-47f6-8375-0a14644b0369 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:31:45.375671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a03d1-2b0b-47f6-8375-0a14644b0369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:31:45.395372 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-510a03d1-2b0b-47f6-8375-0a14644b0369 None None] MFA Rules not processed for user `2b507cef618e4b7ea712a96f014b0b91`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:31:45.396601 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-510a03d1-2b0b-47f6-8375-0a14644b0369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:31:45.404133 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4332/8662] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:31:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:31:45.655715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f519d19-4dc1-4267-8592-e9efc6ed9748 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:31:45.674102 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f519d19-4dc1-4267-8592-e9efc6ed9748 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:31:45.677718 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8908917-c5fc-41e2-bd4b-a9a3a31f3c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:31:45.678373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8908917-c5fc-41e2-bd4b-a9a3a31f3c69 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:31:45.678655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8908917-c5fc-41e2-bd4b-a9a3a31f3c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:31:45.678929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8908917-c5fc-41e2-bd4b-a9a3a31f3c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:31:45.681140 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b8908917-c5fc-41e2-bd4b-a9a3a31f3c69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:31:45.690300 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8908917-c5fc-41e2-bd4b-a9a3a31f3c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:31:45.691761 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8908917-c5fc-41e2-bd4b-a9a3a31f3c69 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:31:45.700059 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4331/8663] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:31:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:31:48.855384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a03d1-2b0b-47f6-8375-0a14644b0369 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:31:48.866217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a03d1-2b0b-47f6-8375-0a14644b0369 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:31:48.870753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e513fd8-6786-4703-a13e-a9bc85e8a4a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:31:48.871374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e513fd8-6786-4703-a13e-a9bc85e8a4a5 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:31:48.871655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e513fd8-6786-4703-a13e-a9bc85e8a4a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:31:48.872074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e513fd8-6786-4703-a13e-a9bc85e8a4a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:31:48.873821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0e513fd8-6786-4703-a13e-a9bc85e8a4a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:31:48.884209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e513fd8-6786-4703-a13e-a9bc85e8a4a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:31:48.885650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e513fd8-6786-4703-a13e-a9bc85e8a4a5 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:31:48.894113 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4333/8664] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:31:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:31:49.737766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8908917-c5fc-41e2-bd4b-a9a3a31f3c69 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:31:49.751795 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8908917-c5fc-41e2-bd4b-a9a3a31f3c69 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:31:49.757280 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbd502-d15b-4fe3-8d35-4b191d5c91a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:31:49.757884 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbd502-d15b-4fe3-8d35-4b191d5c91a8 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:31:49.758231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbd502-d15b-4fe3-8d35-4b191d5c91a8 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:31:49.758507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbd502-d15b-4fe3-8d35-4b191d5c91a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:31:49.760214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d3fbd502-d15b-4fe3-8d35-4b191d5c91a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:31:49.772354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbd502-d15b-4fe3-8d35-4b191d5c91a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:31:49.774114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbd502-d15b-4fe3-8d35-4b191d5c91a8 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:31:49.785713 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4332/8665] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:31:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:31:58.890927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=56,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:31:59.780360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=22 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:32:09.988007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d60696-09d2-4bca-84a1-018f25bb10d3 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:09.988518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d60696-09d2-4bca-84a1-018f25bb10d3 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:09.988619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d60696-09d2-4bca-84a1-018f25bb10d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:10.037146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-41d60696-09d2-4bca-84a1-018f25bb10d3 None None] MFA Rules not processed for user `1a395d2414cd4da085a77ddc9b1f1caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:32:10.038406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-41d60696-09d2-4bca-84a1-018f25bb10d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:10.102325 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4334/8666] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 04:32:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:32:10.107442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbd502-d15b-4fe3-8d35-4b191d5c91a8 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:10.117665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d60696-09d2-4bca-84a1-018f25bb10d3 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:10.118418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbd502-d15b-4fe3-8d35-4b191d5c91a8 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:10.119645 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-41d60696-09d2-4bca-84a1-018f25bb10d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:10.123108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd62aa1-83c5-4e34-8069-05ef75adea5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:10.123746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd62aa1-83c5-4e34-8069-05ef75adea5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:10.124030 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd62aa1-83c5-4e34-8069-05ef75adea5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:10.124303 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd62aa1-83c5-4e34-8069-05ef75adea5b admin admin] PATH_INFO: `/v3/users/2b507cef618e4b7ea712a96f014b0b91` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:10.125712 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd62aa1-83c5-4e34-8069-05ef75adea5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b507cef618e4b7ea712a96f014b0b91)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:10.127742 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd62aa1-83c5-4e34-8069-05ef75adea5b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:10.136156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d60696-09d2-4bca-84a1-018f25bb10d3 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:10.141590 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fc250-59fc-43d6-ad9b-96006587d258 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:10.142184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fc250-59fc-43d6-ad9b-96006587d258 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:10.142492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fc250-59fc-43d6-ad9b-96006587d258 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:10.142797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fc250-59fc-43d6-ad9b-96006587d258 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:10.152500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fc250-59fc-43d6-ad9b-96006587d258 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:10.154428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fc250-59fc-43d6-ad9b-96006587d258 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:10.164947 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4335/8667] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:32:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:32:10.301436 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-acd62aa1-83c5-4e34-8069-05ef75adea5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b507cef618e4b7ea712a96f014b0b91'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:10.302136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-acd62aa1-83c5-4e34-8069-05ef75adea5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b507cef618e4b7ea712a96f014b0b91'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:10.309891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-acd62aa1-83c5-4e34-8069-05ef75adea5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b507cef618e4b7ea712a96f014b0b91'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:10.322627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-acd62aa1-83c5-4e34-8069-05ef75adea5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b507cef618e4b7ea712a96f014b0b91'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:10.398968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-acd62aa1-83c5-4e34-8069-05ef75adea5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b507cef618e4b7ea712a96f014b0b91'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:10.405028 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4333/8668] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:32:10 2022] DELETE /identity/v3/users/2b507cef618e4b7ea712a96f014b0b91 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:32:10.640767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fc250-59fc-43d6-ad9b-96006587d258 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:10.655565 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fc250-59fc-43d6-ad9b-96006587d258 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:10.715488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60945cb9-e4b6-449c-8690-42a1773ffbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:10.716121 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60945cb9-e4b6-449c-8690-42a1773ffbed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:10.716404 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60945cb9-e4b6-449c-8690-42a1773ffbed admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:10.716676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60945cb9-e4b6-449c-8690-42a1773ffbed admin admin] PATH_INFO: `/v3/projects/eba1782ef9544e6d9fb7da0a1389ef48` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:10.717821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60945cb9-e4b6-449c-8690-42a1773ffbed admin admin] RBAC: Authorizing `identity:delete_project(project_id=eba1782ef9544e6d9fb7da0a1389ef48)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:10.719761 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60945cb9-e4b6-449c-8690-42a1773ffbed admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:10.896978 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-60945cb9-e4b6-449c-8690-42a1773ffbed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eba1782ef9544e6d9fb7da0a1389ef48', 'request_id': 'req-60945cb9-e4b6-449c-8690-42a1773ffbed'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:10.904614 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-60945cb9-e4b6-449c-8690-42a1773ffbed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eba1782ef9544e6d9fb7da0a1389ef48', 'request_id': 'req-60945cb9-e4b6-449c-8690-42a1773ffbed'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:10.910375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-60945cb9-e4b6-449c-8690-42a1773ffbed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eba1782ef9544e6d9fb7da0a1389ef48', 'request_id': 'req-60945cb9-e4b6-449c-8690-42a1773ffbed'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:10.912242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:32:11.004423 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-60945cb9-e4b6-449c-8690-42a1773ffbed admin admin] The token cache is being invalidate because project eba1782ef9544e6d9fb7da0a1389ef48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:32:11.005033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-60945cb9-e4b6-449c-8690-42a1773ffbed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:11.005375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-60945cb9-e4b6-449c-8690-42a1773ffbed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:11.007018 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4336/8669] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:32:10 2022] DELETE /identity/v3/projects/eba1782ef9544e6d9fb7da0a1389ef48 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:32:11.011992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abc109-ffe0-4c7d-a9e8-2b5cfae5e314 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:11.012283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abc109-ffe0-4c7d-a9e8-2b5cfae5e314 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:11.012591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abc109-ffe0-4c7d-a9e8-2b5cfae5e314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:11.061331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-67abc109-ffe0-4c7d-a9e8-2b5cfae5e314 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:32:11.062584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-67abc109-ffe0-4c7d-a9e8-2b5cfae5e314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:11.120450 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4334/8670] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 04:32:11.128521 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9948f-e673-46d3-b7f0-c3d311d2ecc4 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:11.128809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9948f-e673-46d3-b7f0-c3d311d2ecc4 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:11.129086 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9948f-e673-46d3-b7f0-c3d311d2ecc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:11.148667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7da9948f-e673-46d3-b7f0-c3d311d2ecc4 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:32:11.150551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7da9948f-e673-46d3-b7f0-c3d311d2ecc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:11.158712 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4337/8671] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:32:11.162855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abc109-ffe0-4c7d-a9e8-2b5cfae5e314 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:11.173093 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abc109-ffe0-4c7d-a9e8-2b5cfae5e314 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:11.177715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c0611-b070-44a3-9818-8dd7d985340f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:11.178354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c0611-b070-44a3-9818-8dd7d985340f admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:11.178634 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c0611-b070-44a3-9818-8dd7d985340f admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:11.178906 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c0611-b070-44a3-9818-8dd7d985340f admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:11.179583 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c0611-b070-44a3-9818-8dd7d985340f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:32:11.179892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c0611-b070-44a3-9818-8dd7d985340f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:11.181567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c0611-b070-44a3-9818-8dd7d985340f admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:11.193281 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4335/8672] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:32:11.197592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9948f-e673-46d3-b7f0-c3d311d2ecc4 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:11.206854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9948f-e673-46d3-b7f0-c3d311d2ecc4 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:11.212066 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822acdb-0555-4c30-a0a5-a279d65dae95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:11.212663 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822acdb-0555-4c30-a0a5-a279d65dae95 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:11.212946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822acdb-0555-4c30-a0a5-a279d65dae95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:11.213222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822acdb-0555-4c30-a0a5-a279d65dae95 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:11.213847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1822acdb-0555-4c30-a0a5-a279d65dae95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:11.215801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1822acdb-0555-4c30-a0a5-a279d65dae95 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:11.291561 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4338/8673] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:32:11 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:32:11.295711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c0611-b070-44a3-9818-8dd7d985340f admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:11.305639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c0611-b070-44a3-9818-8dd7d985340f admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:11.338862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:32:11.361060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb8a95-2d93-4809-bfc2-ddb858bd8db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:11.361652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb8a95-2d93-4809-bfc2-ddb858bd8db3 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:11.361932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb8a95-2d93-4809-bfc2-ddb858bd8db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:11.362234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb8a95-2d93-4809-bfc2-ddb858bd8db3 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:11.362861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb8a95-2d93-4809-bfc2-ddb858bd8db3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:11.364757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb8a95-2d93-4809-bfc2-ddb858bd8db3 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:11.459067 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4336/8674] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:32:11 2022] POST /identity/v3/users => generated 283 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:32:11.464048 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822acdb-0555-4c30-a0a5-a279d65dae95 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:11.474812 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822acdb-0555-4c30-a0a5-a279d65dae95 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:11.480682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3a3c7-ee06-4733-8f20-064fd1cd88fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:11.480682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3a3c7-ee06-4733-8f20-064fd1cd88fa admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:11.480936 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3a3c7-ee06-4733-8f20-064fd1cd88fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:11.481040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3a3c7-ee06-4733-8f20-064fd1cd88fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:11.481689 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3a3c7-ee06-4733-8f20-064fd1cd88fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:11.483344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3a3c7-ee06-4733-8f20-064fd1cd88fa admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:11.493425 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4339/8675] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:32:11.497412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb8a95-2d93-4809-bfc2-ddb858bd8db3 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:11.507903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb8a95-2d93-4809-bfc2-ddb858bd8db3 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:11.513106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e80f66-0322-486f-83b8-c73cd7aae00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:11.513738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e80f66-0322-486f-83b8-c73cd7aae00a admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:11.514078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e80f66-0322-486f-83b8-c73cd7aae00a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:11.514362 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e80f66-0322-486f-83b8-c73cd7aae00a admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:11.515009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e80f66-0322-486f-83b8-c73cd7aae00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:11.516611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e80f66-0322-486f-83b8-c73cd7aae00a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:11.527836 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4337/8676] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:32:11.532056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3a3c7-ee06-4733-8f20-064fd1cd88fa admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:11.541915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3a3c7-ee06-4733-8f20-064fd1cd88fa admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:11.546552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc4af2-5471-4877-9627-9a6f6a6841c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:11.547198 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc4af2-5471-4877-9627-9a6f6a6841c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:11.547481 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc4af2-5471-4877-9627-9a6f6a6841c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:11.547758 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc4af2-5471-4877-9627-9a6f6a6841c7 admin admin] PATH_INFO: `/v3/projects/926e0c4c08c548778f38ce8493fbbfe2/users/4b03e5c6acdf43fd80388977276488fe/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:11.561972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc4af2-5471-4877-9627-9a6f6a6841c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=926e0c4c08c548778f38ce8493fbbfe2, user_id=4b03e5c6acdf43fd80388977276488fe, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:11.564657 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc4af2-5471-4877-9627-9a6f6a6841c7 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:11.625030 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4340/8677] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:32:11 2022] PUT /identity/v3/projects/926e0c4c08c548778f38ce8493fbbfe2/users/4b03e5c6acdf43fd80388977276488fe/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 04:32:11.638747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aca9fb-e40a-4211-a99d-de335b61bc20 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:11.639032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aca9fb-e40a-4211-a99d-de335b61bc20 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:11.639304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aca9fb-e40a-4211-a99d-de335b61bc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:11.666707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-23aca9fb-e40a-4211-a99d-de335b61bc20 None None] MFA Rules not processed for user `4b03e5c6acdf43fd80388977276488fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:32:11.667905 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-23aca9fb-e40a-4211-a99d-de335b61bc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:11.731091 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4338/8678] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:32:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:32:11.741511 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc4af2-5471-4877-9627-9a6f6a6841c7 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:11.743930 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b6fc4af2-5471-4877-9627-9a6f6a6841c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:11.799074 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc4af2-5471-4877-9627-9a6f6a6841c7 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:11.802797 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac26a23-d2bb-4350-b4b6-76ddb8ac53f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:11.803400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac26a23-d2bb-4350-b4b6-76ddb8ac53f4 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:11.803685 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac26a23-d2bb-4350-b4b6-76ddb8ac53f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:11.803960 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac26a23-d2bb-4350-b4b6-76ddb8ac53f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:11.812684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac26a23-d2bb-4350-b4b6-76ddb8ac53f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:11.814131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac26a23-d2bb-4350-b4b6-76ddb8ac53f4 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:11.823402 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4341/8679] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:32:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:32:21.728256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=49,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:32:21.818834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=55 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:32:30.541100 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aca9fb-e40a-4211-a99d-de335b61bc20 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:30.613826 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aca9fb-e40a-4211-a99d-de335b61bc20 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:30.618992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e9854-457c-410b-964b-5099c603bd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:30.619687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e9854-457c-410b-964b-5099c603bd9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:30.619968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e9854-457c-410b-964b-5099c603bd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:30.620269 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e9854-457c-410b-964b-5099c603bd9d admin admin] PATH_INFO: `/v3/users/4b03e5c6acdf43fd80388977276488fe` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:30.621394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e9854-457c-410b-964b-5099c603bd9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b03e5c6acdf43fd80388977276488fe)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:30.623411 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e9854-457c-410b-964b-5099c603bd9d admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:30.817204 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a62e9854-457c-410b-964b-5099c603bd9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b03e5c6acdf43fd80388977276488fe'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:30.817859 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a62e9854-457c-410b-964b-5099c603bd9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b03e5c6acdf43fd80388977276488fe'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:30.825419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a62e9854-457c-410b-964b-5099c603bd9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b03e5c6acdf43fd80388977276488fe'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:30.837342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a62e9854-457c-410b-964b-5099c603bd9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b03e5c6acdf43fd80388977276488fe'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:30.898916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-a62e9854-457c-410b-964b-5099c603bd9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b03e5c6acdf43fd80388977276488fe'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:30.905788 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4339/8680] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:32:30 2022] DELETE /identity/v3/users/4b03e5c6acdf43fd80388977276488fe => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 04:32:30.910344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac055623-cabe-4fcf-93e7-11434903d78b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:30.910826 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac055623-cabe-4fcf-93e7-11434903d78b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:30.910927 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac055623-cabe-4fcf-93e7-11434903d78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:30.932336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ac055623-cabe-4fcf-93e7-11434903d78b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:32:30.933600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ac055623-cabe-4fcf-93e7-11434903d78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:30.993911 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4342/8681] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:32:31.003713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e9854-457c-410b-964b-5099c603bd9d admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:31.005141 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a62e9854-457c-410b-964b-5099c603bd9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:31.062505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e9854-457c-410b-964b-5099c603bd9d admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:31.066174 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bf832-f1d1-41b8-8182-9c58ac2189c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:31.066770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bf832-f1d1-41b8-8182-9c58ac2189c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:31.067048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bf832-f1d1-41b8-8182-9c58ac2189c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:31.067373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bf832-f1d1-41b8-8182-9c58ac2189c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:31.076137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bf832-f1d1-41b8-8182-9c58ac2189c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:31.077559 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bf832-f1d1-41b8-8182-9c58ac2189c1 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:31.086947 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4340/8682] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:32:31.332144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac055623-cabe-4fcf-93e7-11434903d78b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:31.333629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ac055623-cabe-4fcf-93e7-11434903d78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:31.349327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac055623-cabe-4fcf-93e7-11434903d78b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:31.355706 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5496bb-f964-499c-b2fb-b48b44e56411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:31.356354 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5496bb-f964-499c-b2fb-b48b44e56411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:31.356641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5496bb-f964-499c-b2fb-b48b44e56411 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:31.356964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5496bb-f964-499c-b2fb-b48b44e56411 admin admin] PATH_INFO: `/v3/projects/926e0c4c08c548778f38ce8493fbbfe2` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:31.358232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5496bb-f964-499c-b2fb-b48b44e56411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=926e0c4c08c548778f38ce8493fbbfe2)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:31.360054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5496bb-f964-499c-b2fb-b48b44e56411 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:31.455777 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fb5496bb-f964-499c-b2fb-b48b44e56411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '926e0c4c08c548778f38ce8493fbbfe2', 'request_id': 'req-fb5496bb-f964-499c-b2fb-b48b44e56411'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:31.462484 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fb5496bb-f964-499c-b2fb-b48b44e56411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '926e0c4c08c548778f38ce8493fbbfe2', 'request_id': 'req-fb5496bb-f964-499c-b2fb-b48b44e56411'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:31.468155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fb5496bb-f964-499c-b2fb-b48b44e56411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '926e0c4c08c548778f38ce8493fbbfe2', 'request_id': 'req-fb5496bb-f964-499c-b2fb-b48b44e56411'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:31.540625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fb5496bb-f964-499c-b2fb-b48b44e56411 admin admin] The token cache is being invalidate because project 926e0c4c08c548778f38ce8493fbbfe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:32:31.540920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fb5496bb-f964-499c-b2fb-b48b44e56411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:31.541543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-fb5496bb-f964-499c-b2fb-b48b44e56411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:31.543208 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4343/8683] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:32:31 2022] DELETE /identity/v3/projects/926e0c4c08c548778f38ce8493fbbfe2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:32:31.548375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b73b7d-1eb0-4697-a627-db081e27799b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:31.548857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b73b7d-1eb0-4697-a627-db081e27799b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:31.548971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b73b7d-1eb0-4697-a627-db081e27799b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:31.568349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-35b73b7d-1eb0-4697-a627-db081e27799b None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:32:31.569574 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-35b73b7d-1eb0-4697-a627-db081e27799b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:31.587724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:32:31.628352 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4341/8684] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:32:31.636738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8e008-205e-4cf4-99d6-a57fe6d09742 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:31.637033 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8e008-205e-4cf4-99d6-a57fe6d09742 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:31.637314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8e008-205e-4cf4-99d6-a57fe6d09742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:31.657477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-38b8e008-205e-4cf4-99d6-a57fe6d09742 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:32:31.658724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-38b8e008-205e-4cf4-99d6-a57fe6d09742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:31.666749 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4344/8685] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:32:31.670903 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b73b7d-1eb0-4697-a627-db081e27799b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:31.680725 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b73b7d-1eb0-4697-a627-db081e27799b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:31.685336 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0fe537-d557-45a9-858a-41b51a667902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:31.685927 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fe537-d557-45a9-858a-41b51a667902 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:31.686237 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fe537-d557-45a9-858a-41b51a667902 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:31.686510 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fe537-d557-45a9-858a-41b51a667902 admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:31.687151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0fe537-d557-45a9-858a-41b51a667902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:32:31.687455 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0fe537-d557-45a9-858a-41b51a667902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:31.689032 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0fe537-d557-45a9-858a-41b51a667902 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:31.702248 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4342/8686] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 04:32:31.706489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8e008-205e-4cf4-99d6-a57fe6d09742 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:31.716728 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8e008-205e-4cf4-99d6-a57fe6d09742 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:31.721694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1675a-00f6-482b-b818-57f1b2583e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:31.722359 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1675a-00f6-482b-b818-57f1b2583e39 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:31.722638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1675a-00f6-482b-b818-57f1b2583e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:31.722910 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1675a-00f6-482b-b818-57f1b2583e39 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:31.723595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1675a-00f6-482b-b818-57f1b2583e39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:31.725572 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1675a-00f6-482b-b818-57f1b2583e39 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:31.814160 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4345/8687] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:32:31 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:32:31.818152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0fe537-d557-45a9-858a-41b51a667902 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:31.828771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0fe537-d557-45a9-858a-41b51a667902 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:31.884618 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce8f5f-9783-4a38-8d95-cb6554376a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:31.885161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce8f5f-9783-4a38-8d95-cb6554376a25 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:31.885476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce8f5f-9783-4a38-8d95-cb6554376a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:31.885758 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce8f5f-9783-4a38-8d95-cb6554376a25 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:31.886476 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce8f5f-9783-4a38-8d95-cb6554376a25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:31.888448 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce8f5f-9783-4a38-8d95-cb6554376a25 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:32.014388 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4343/8688] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:32:31 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 04:32:32.018510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1675a-00f6-482b-b818-57f1b2583e39 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:32.028737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1675a-00f6-482b-b818-57f1b2583e39 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:32.033266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3e986-35bf-40f8-9868-8a503c85bcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:32.033864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3e986-35bf-40f8-9868-8a503c85bcd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:32.034189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3e986-35bf-40f8-9868-8a503c85bcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:32.034469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3e986-35bf-40f8-9868-8a503c85bcd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:32.035109 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3e986-35bf-40f8-9868-8a503c85bcd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:32.036737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3e986-35bf-40f8-9868-8a503c85bcd6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:32.046427 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4346/8689] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:32:32.050325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce8f5f-9783-4a38-8d95-cb6554376a25 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:32.060798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce8f5f-9783-4a38-8d95-cb6554376a25 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:32.065425 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69073fc4-61fa-4f1f-a00e-aff6b25df647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:32.066014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69073fc4-61fa-4f1f-a00e-aff6b25df647 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:32.066340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69073fc4-61fa-4f1f-a00e-aff6b25df647 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:32.066616 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69073fc4-61fa-4f1f-a00e-aff6b25df647 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:32.067259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69073fc4-61fa-4f1f-a00e-aff6b25df647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:32.068843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69073fc4-61fa-4f1f-a00e-aff6b25df647 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:32.080997 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4344/8690] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:32:32.084974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3e986-35bf-40f8-9868-8a503c85bcd6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:32.094847 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3e986-35bf-40f8-9868-8a503c85bcd6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:32.099637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9558f-3050-4298-8077-4a1bdcfd7854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:32.100281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9558f-3050-4298-8077-4a1bdcfd7854 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:32.100566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9558f-3050-4298-8077-4a1bdcfd7854 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:32.100841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9558f-3050-4298-8077-4a1bdcfd7854 admin admin] PATH_INFO: `/v3/projects/cfd384f1d7914107b52e2744f1208c86/users/6a84c58c05ed457ea03484f90afbbd8a/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:32.115113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9558f-3050-4298-8077-4a1bdcfd7854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfd384f1d7914107b52e2744f1208c86, user_id=6a84c58c05ed457ea03484f90afbbd8a, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:32.118314 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9558f-3050-4298-8077-4a1bdcfd7854 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:32.173240 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4347/8691] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:32:32 2022] PUT /identity/v3/projects/cfd384f1d7914107b52e2744f1208c86/users/6a84c58c05ed457ea03484f90afbbd8a/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:32:32.184592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e8585-2e41-4102-8124-541079737bc2 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:32.184888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e8585-2e41-4102-8124-541079737bc2 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:32.185165 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e8585-2e41-4102-8124-541079737bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:32.213234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e13e8585-2e41-4102-8124-541079737bc2 None None] MFA Rules not processed for user `6a84c58c05ed457ea03484f90afbbd8a`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:32:32.214478 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e13e8585-2e41-4102-8124-541079737bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:32.277870 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4345/8692] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:32:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:32:32.287806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9558f-3050-4298-8077-4a1bdcfd7854 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:32.290130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7fe9558f-3050-4298-8077-4a1bdcfd7854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:32.312953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:32:32.347712 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9558f-3050-4298-8077-4a1bdcfd7854 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:32.351340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58304b8f-2868-4f47-8922-e925f96638b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:32.356200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58304b8f-2868-4f47-8922-e925f96638b0 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:32.356200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58304b8f-2868-4f47-8922-e925f96638b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:32.356200 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58304b8f-2868-4f47-8922-e925f96638b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:32.360986 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58304b8f-2868-4f47-8922-e925f96638b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:32.362436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58304b8f-2868-4f47-8922-e925f96638b0 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:32.371581 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4348/8693] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:32:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:32:38.625089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e8585-2e41-4102-8124-541079737bc2 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:38.644474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:32:38.689802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e8585-2e41-4102-8124-541079737bc2 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:38.694555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd7435-b1d8-4050-a55b-200476267aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:38.695192 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd7435-b1d8-4050-a55b-200476267aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:38.695473 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd7435-b1d8-4050-a55b-200476267aea admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:38.695744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd7435-b1d8-4050-a55b-200476267aea admin admin] PATH_INFO: `/v3/users/6a84c58c05ed457ea03484f90afbbd8a` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:38.696860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd7435-b1d8-4050-a55b-200476267aea admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a84c58c05ed457ea03484f90afbbd8a)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:38.699949 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd7435-b1d8-4050-a55b-200476267aea admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:38.868593 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-abfd7435-b1d8-4050-a55b-200476267aea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a84c58c05ed457ea03484f90afbbd8a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:38.869337 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-abfd7435-b1d8-4050-a55b-200476267aea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a84c58c05ed457ea03484f90afbbd8a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:38.876518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-abfd7435-b1d8-4050-a55b-200476267aea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a84c58c05ed457ea03484f90afbbd8a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:38.888388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-abfd7435-b1d8-4050-a55b-200476267aea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a84c58c05ed457ea03484f90afbbd8a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:38.950329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-abfd7435-b1d8-4050-a55b-200476267aea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a84c58c05ed457ea03484f90afbbd8a'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:38.957025 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4346/8694] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:32:38 2022] DELETE /identity/v3/users/6a84c58c05ed457ea03484f90afbbd8a => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:32:38.961567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d8a99-ffee-402d-9a7f-51337a2bc303 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:38.962022 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d8a99-ffee-402d-9a7f-51337a2bc303 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:38.962168 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d8a99-ffee-402d-9a7f-51337a2bc303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:38.981951 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-779d8a99-ffee-402d-9a7f-51337a2bc303 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:32:38.983172 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-779d8a99-ffee-402d-9a7f-51337a2bc303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:39.041391 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4349/8695] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:32:39.051162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd7435-b1d8-4050-a55b-200476267aea admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:39.052561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-abfd7435-b1d8-4050-a55b-200476267aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:39.109555 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd7435-b1d8-4050-a55b-200476267aea admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:39.113114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb31040-1594-4e03-baa4-663cecf28da0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:39.113714 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb31040-1594-4e03-baa4-663cecf28da0 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:39.113997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb31040-1594-4e03-baa4-663cecf28da0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:39.114304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb31040-1594-4e03-baa4-663cecf28da0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:39.123234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb31040-1594-4e03-baa4-663cecf28da0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:39.124663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb31040-1594-4e03-baa4-663cecf28da0 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:39.134198 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4347/8696] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:32:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:32:39.363291 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d8a99-ffee-402d-9a7f-51337a2bc303 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:39.364684 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-779d8a99-ffee-402d-9a7f-51337a2bc303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:39.378391 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d8a99-ffee-402d-9a7f-51337a2bc303 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:39.383489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558ab0e-9892-469c-8265-57b81e3f51e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:39.384156 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558ab0e-9892-469c-8265-57b81e3f51e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:39.385148 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558ab0e-9892-469c-8265-57b81e3f51e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:39.386128 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558ab0e-9892-469c-8265-57b81e3f51e6 admin admin] PATH_INFO: `/v3/projects/cfd384f1d7914107b52e2744f1208c86` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:39.387852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558ab0e-9892-469c-8265-57b81e3f51e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfd384f1d7914107b52e2744f1208c86)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:39.389773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558ab0e-9892-469c-8265-57b81e3f51e6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:39.504592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7558ab0e-9892-469c-8265-57b81e3f51e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfd384f1d7914107b52e2744f1208c86', 'request_id': 'req-7558ab0e-9892-469c-8265-57b81e3f51e6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:39.511692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7558ab0e-9892-469c-8265-57b81e3f51e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfd384f1d7914107b52e2744f1208c86', 'request_id': 'req-7558ab0e-9892-469c-8265-57b81e3f51e6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:39.517330 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7558ab0e-9892-469c-8265-57b81e3f51e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfd384f1d7914107b52e2744f1208c86', 'request_id': 'req-7558ab0e-9892-469c-8265-57b81e3f51e6'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:39.589335 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7558ab0e-9892-469c-8265-57b81e3f51e6 admin admin] The token cache is being invalidate because project cfd384f1d7914107b52e2744f1208c86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:32:39.589620 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7558ab0e-9892-469c-8265-57b81e3f51e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:39.590275 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-7558ab0e-9892-469c-8265-57b81e3f51e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:32:39.591750 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4350/8697] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:32:39 2022] DELETE /identity/v3/projects/cfd384f1d7914107b52e2744f1208c86 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 04:32:39.597126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d2ba6-6bb3-4ca7-9d75-37de3d09f654 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:39.597446 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d2ba6-6bb3-4ca7-9d75-37de3d09f654 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:39.597728 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d2ba6-6bb3-4ca7-9d75-37de3d09f654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:39.616915 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b66d2ba6-6bb3-4ca7-9d75-37de3d09f654 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:32:39.618090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b66d2ba6-6bb3-4ca7-9d75-37de3d09f654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:39.652590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:32:39.676998 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4348/8698] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:32:39.685328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b33ae9-bc8d-40a3-879f-7e8c7364d1fc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:39.685653 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b33ae9-bc8d-40a3-879f-7e8c7364d1fc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:39.685920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b33ae9-bc8d-40a3-879f-7e8c7364d1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:39.706159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-91b33ae9-bc8d-40a3-879f-7e8c7364d1fc None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:32:39.707384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-91b33ae9-bc8d-40a3-879f-7e8c7364d1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:39.715488 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4351/8699] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:32:39.719551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d2ba6-6bb3-4ca7-9d75-37de3d09f654 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:39.729836 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d2ba6-6bb3-4ca7-9d75-37de3d09f654 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:39.734438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd40d6d-099c-42ff-893f-2134adff810e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:39.735045 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd40d6d-099c-42ff-893f-2134adff810e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:39.735327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd40d6d-099c-42ff-893f-2134adff810e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:39.735604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd40d6d-099c-42ff-893f-2134adff810e admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:39.736307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd40d6d-099c-42ff-893f-2134adff810e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:32:39.736614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd40d6d-099c-42ff-893f-2134adff810e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:39.738284 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd40d6d-099c-42ff-893f-2134adff810e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:39.751302 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4349/8700] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:32:39.755249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b33ae9-bc8d-40a3-879f-7e8c7364d1fc None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:39.764363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b33ae9-bc8d-40a3-879f-7e8c7364d1fc None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:39.768971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adeedc-50e6-4101-a6ea-69aae9a90d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:39.769562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adeedc-50e6-4101-a6ea-69aae9a90d05 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:39.769837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adeedc-50e6-4101-a6ea-69aae9a90d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:39.770138 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adeedc-50e6-4101-a6ea-69aae9a90d05 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:39.770759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46adeedc-50e6-4101-a6ea-69aae9a90d05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:39.772638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46adeedc-50e6-4101-a6ea-69aae9a90d05 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:39.849083 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4352/8701] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:32:39 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:32:39.853676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd40d6d-099c-42ff-893f-2134adff810e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:39.863661 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd40d6d-099c-42ff-893f-2134adff810e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:39.921407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5a638-bbbf-423a-8011-a29e7b315573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:39.921944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5a638-bbbf-423a-8011-a29e7b315573 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:39.922332 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5a638-bbbf-423a-8011-a29e7b315573 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:39.922614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5a638-bbbf-423a-8011-a29e7b315573 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:39.923245 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5a638-bbbf-423a-8011-a29e7b315573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:39.925201 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5a638-bbbf-423a-8011-a29e7b315573 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:40.021981 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4350/8702] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:32:39 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:32:40.024073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adeedc-50e6-4101-a6ea-69aae9a90d05 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:40.035052 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adeedc-50e6-4101-a6ea-69aae9a90d05 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:40.039754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4b264-ead8-44be-ae79-4236a3cdcfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:40.040355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4b264-ead8-44be-ae79-4236a3cdcfea admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:40.041271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4b264-ead8-44be-ae79-4236a3cdcfea admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:40.041548 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4b264-ead8-44be-ae79-4236a3cdcfea admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:40.042228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4b264-ead8-44be-ae79-4236a3cdcfea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:40.043832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4b264-ead8-44be-ae79-4236a3cdcfea admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:40.053944 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4353/8703] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:32:40.058512 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5a638-bbbf-423a-8011-a29e7b315573 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:40.068571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5a638-bbbf-423a-8011-a29e7b315573 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:40.073157 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fafe9-07d8-4b25-a5ec-7586e262d85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:40.073751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fafe9-07d8-4b25-a5ec-7586e262d85e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:40.074056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fafe9-07d8-4b25-a5ec-7586e262d85e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:40.074349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fafe9-07d8-4b25-a5ec-7586e262d85e admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:40.075020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fafe9-07d8-4b25-a5ec-7586e262d85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:40.076614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fafe9-07d8-4b25-a5ec-7586e262d85e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:40.087218 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4351/8704] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:32:40.091885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4b264-ead8-44be-ae79-4236a3cdcfea admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:40.102525 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4b264-ead8-44be-ae79-4236a3cdcfea admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:40.107971 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fc9a7-7376-45d4-ba1f-6a0b06033921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:40.108686 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fc9a7-7376-45d4-ba1f-6a0b06033921 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:40.108967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fc9a7-7376-45d4-ba1f-6a0b06033921 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:40.109243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fc9a7-7376-45d4-ba1f-6a0b06033921 admin admin] PATH_INFO: `/v3/projects/c4a8b90797b04f59bb513f5b6f4f6ba0/users/aec3aa7aba49468e86caef89e306d01d/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:40.111513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:32:40.124155 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469fc9a7-7376-45d4-ba1f-6a0b06033921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a8b90797b04f59bb513f5b6f4f6ba0, user_id=aec3aa7aba49468e86caef89e306d01d, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:40.126855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469fc9a7-7376-45d4-ba1f-6a0b06033921 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:40.210561 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4354/8705] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:32:40 2022] PUT /identity/v3/projects/c4a8b90797b04f59bb513f5b6f4f6ba0/users/aec3aa7aba49468e86caef89e306d01d/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:32:40.221621 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bcceb-5333-4ff9-b092-e85b02f334cd None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:40.221911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bcceb-5333-4ff9-b092-e85b02f334cd None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:40.222215 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bcceb-5333-4ff9-b092-e85b02f334cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:40.242288 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-984bcceb-5333-4ff9-b092-e85b02f334cd None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:32:40.243498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-984bcceb-5333-4ff9-b092-e85b02f334cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:40.301562 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4352/8706] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:32:40.311262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fc9a7-7376-45d4-ba1f-6a0b06033921 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:40.312996 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-469fc9a7-7376-45d4-ba1f-6a0b06033921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:40.371350 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fc9a7-7376-45d4-ba1f-6a0b06033921 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:40.374959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e9b98-8cc4-46d3-83c4-15cfff333e12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:40.375559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e9b98-8cc4-46d3-83c4-15cfff333e12 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:40.375840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e9b98-8cc4-46d3-83c4-15cfff333e12 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:40.376113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e9b98-8cc4-46d3-83c4-15cfff333e12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:40.385188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e9b98-8cc4-46d3-83c4-15cfff333e12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:40.386659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e9b98-8cc4-46d3-83c4-15cfff333e12 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:40.396161 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4355/8707] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:32:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:32:45.694882 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3eba4-4233-41fb-a1e3-e74a81485a63 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:45.695340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3eba4-4233-41fb-a1e3-e74a81485a63 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:45.695435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3eba4-4233-41fb-a1e3-e74a81485a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:45.732073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b8b3eba4-4233-41fb-a1e3-e74a81485a63 None None] MFA Rules not processed for user `aec3aa7aba49468e86caef89e306d01d`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:32:45.733356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b8b3eba4-4233-41fb-a1e3-e74a81485a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:45.769418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:32:45.802773 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4353/8708] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:32:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:32:45.807840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e9b98-8cc4-46d3-83c4-15cfff333e12 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:45.818283 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e9b98-8cc4-46d3-83c4-15cfff333e12 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:45.823027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affc8e3-28ba-4483-ae33-d94692f7d39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:45.823619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affc8e3-28ba-4483-ae33-d94692f7d39a admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:45.823900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affc8e3-28ba-4483-ae33-d94692f7d39a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:45.824208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affc8e3-28ba-4483-ae33-d94692f7d39a admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:45.824855 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1affc8e3-28ba-4483-ae33-d94692f7d39a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:45.826863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1affc8e3-28ba-4483-ae33-d94692f7d39a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:45.912128 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4356/8709] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:32:45 2022] POST /identity/v3/projects => generated 389 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:32:45.913438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3eba4-4233-41fb-a1e3-e74a81485a63 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:45.925003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3eba4-4233-41fb-a1e3-e74a81485a63 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:45.990335 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e914d-b8c3-4a54-8f1f-d3478365661e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:45.991089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e914d-b8c3-4a54-8f1f-d3478365661e admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:45.991474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e914d-b8c3-4a54-8f1f-d3478365661e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:45.991965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e914d-b8c3-4a54-8f1f-d3478365661e admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:45.992771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e914d-b8c3-4a54-8f1f-d3478365661e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:45.995285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e914d-b8c3-4a54-8f1f-d3478365661e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:46.117003 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4354/8710] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:32:45 2022] POST /identity/v3/users => generated 301 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:32:46.121096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affc8e3-28ba-4483-ae33-d94692f7d39a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:46.131667 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affc8e3-28ba-4483-ae33-d94692f7d39a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:46.136577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fec3b6-c168-4c17-88dd-7665e3cdde84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:46.137197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fec3b6-c168-4c17-88dd-7665e3cdde84 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:46.137489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fec3b6-c168-4c17-88dd-7665e3cdde84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:46.137821 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fec3b6-c168-4c17-88dd-7665e3cdde84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:46.138429 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fec3b6-c168-4c17-88dd-7665e3cdde84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:46.140035 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fec3b6-c168-4c17-88dd-7665e3cdde84 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:46.152908 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4357/8711] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:32:46.156964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e914d-b8c3-4a54-8f1f-d3478365661e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:46.167965 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e914d-b8c3-4a54-8f1f-d3478365661e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:46.172638 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2f5fb-7e97-4e5b-bb2b-774c69522546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:46.173354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2f5fb-7e97-4e5b-bb2b-774c69522546 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:46.173582 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2f5fb-7e97-4e5b-bb2b-774c69522546 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:46.173850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2f5fb-7e97-4e5b-bb2b-774c69522546 admin admin] PATH_INFO: `/v3/projects/ecdffbf8ad61481382591340fd55739b/users/25abaed30acf4f0ea7a82c4bbd99cb3e/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:46.192153 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2f5fb-7e97-4e5b-bb2b-774c69522546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecdffbf8ad61481382591340fd55739b, user_id=25abaed30acf4f0ea7a82c4bbd99cb3e, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:46.195015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2f5fb-7e97-4e5b-bb2b-774c69522546 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:46.310973 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4355/8712] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:32:46 2022] PUT /identity/v3/projects/ecdffbf8ad61481382591340fd55739b/users/25abaed30acf4f0ea7a82c4bbd99cb3e/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:32:46.315056 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fec3b6-c168-4c17-88dd-7665e3cdde84 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:46.325175 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fec3b6-c168-4c17-88dd-7665e3cdde84 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:46.380982 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4dc888-59f0-4d58-b0e4-67e2a3023717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:46.381592 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4dc888-59f0-4d58-b0e4-67e2a3023717 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:46.381876 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4dc888-59f0-4d58-b0e4-67e2a3023717 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:46.382184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4dc888-59f0-4d58-b0e4-67e2a3023717 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:46.382850 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4dc888-59f0-4d58-b0e4-67e2a3023717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:46.385040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4dc888-59f0-4d58-b0e4-67e2a3023717 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:46.397871 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4358/8713] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:32:46.399080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2f5fb-7e97-4e5b-bb2b-774c69522546 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:46.409995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2f5fb-7e97-4e5b-bb2b-774c69522546 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:46.414711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3678a-d89f-4c68-8043-e4275cc012fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:46.416036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3678a-d89f-4c68-8043-e4275cc012fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:46.416316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3678a-d89f-4c68-8043-e4275cc012fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:46.416589 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3678a-d89f-4c68-8043-e4275cc012fc admin admin] PATH_INFO: `/v3/projects/ecdffbf8ad61481382591340fd55739b/users/25abaed30acf4f0ea7a82c4bbd99cb3e/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:46.418557 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3678a-d89f-4c68-8043-e4275cc012fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecdffbf8ad61481382591340fd55739b, user_id=25abaed30acf4f0ea7a82c4bbd99cb3e, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:46.421187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3678a-d89f-4c68-8043-e4275cc012fc admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:46.434949 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4356/8714] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:32:46 2022] PUT /identity/v3/projects/ecdffbf8ad61481382591340fd55739b/users/25abaed30acf4f0ea7a82c4bbd99cb3e/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:32:51.633324 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4810efe-723e-4863-8695-3c85a2f5fef7 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:51.633787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4810efe-723e-4863-8695-3c85a2f5fef7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:51.633897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4810efe-723e-4863-8695-3c85a2f5fef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:51.670426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f4810efe-723e-4863-8695-3c85a2f5fef7 None None] MFA Rules not processed for user `25abaed30acf4f0ea7a82c4bbd99cb3e`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:32:51.671660 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f4810efe-723e-4863-8695-3c85a2f5fef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:51.719096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:32:51.753477 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4359/8715] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:32:51 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 04:32:51.770256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3678a-d89f-4c68-8043-e4275cc012fc admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:51.771987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ebd3678a-d89f-4c68-8043-e4275cc012fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:51.874341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3678a-d89f-4c68-8043-e4275cc012fc admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:51.880622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c54562-3950-4ab3-88cb-f2d411fac77a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:51.881243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c54562-3950-4ab3-88cb-f2d411fac77a service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:51.881675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c54562-3950-4ab3-88cb-f2d411fac77a service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:51.881779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c54562-3950-4ab3-88cb-f2d411fac77a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:51.895701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:32:51.944328 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c54562-3950-4ab3-88cb-f2d411fac77a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:51.946075 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c54562-3950-4ab3-88cb-f2d411fac77a service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:51.956444 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4357/8716] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:32:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:32:52.115279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb379c-281d-41d1-a60c-b4e13c6cd747 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:52.115573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb379c-281d-41d1-a60c-b4e13c6cd747 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:52.115874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb379c-281d-41d1-a60c-b4e13c6cd747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:52.136687 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-ceeb379c-281d-41d1-a60c-b4e13c6cd747 None None] MFA Rules not processed for user `aec3aa7aba49468e86caef89e306d01d`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:32:52.137913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ceeb379c-281d-41d1-a60c-b4e13c6cd747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:52.145091 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4360/8717] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:32:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:32:54.172851 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c54562-3950-4ab3-88cb-f2d411fac77a service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:54.174463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d8c54562-3950-4ab3-88cb-f2d411fac77a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:54.247864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c54562-3950-4ab3-88cb-f2d411fac77a service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:54.252912 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e310d-1779-4096-9315-8465e1cafeba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:54.253517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e310d-1779-4096-9315-8465e1cafeba service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:54.253802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e310d-1779-4096-9315-8465e1cafeba service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:54.254121 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e310d-1779-4096-9315-8465e1cafeba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:54.255846 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-969e310d-1779-4096-9315-8465e1cafeba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:54.267056 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e310d-1779-4096-9315-8465e1cafeba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:54.268651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e310d-1779-4096-9315-8465e1cafeba service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:54.278558 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4358/8718] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:32:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:32:59.294411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb379c-281d-41d1-a60c-b4e13c6cd747 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:32:59.306084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb379c-281d-41d1-a60c-b4e13c6cd747 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:32:59.311040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f40ff-fdad-48fd-a519-7fa5a917c832 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:32:59.311641 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f40ff-fdad-48fd-a519-7fa5a917c832 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:32:59.311925 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f40ff-fdad-48fd-a519-7fa5a917c832 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:32:59.312199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f40ff-fdad-48fd-a519-7fa5a917c832 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:32:59.313895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0e7f40ff-fdad-48fd-a519-7fa5a917c832 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:32:59.325457 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f40ff-fdad-48fd-a519-7fa5a917c832 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:32:59.327072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f40ff-fdad-48fd-a519-7fa5a917c832 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:32:59.336738 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4361/8719] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:32:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:33:04.274278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=52 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:33:06.269392 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e310d-1779-4096-9315-8465e1cafeba service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:33:06.270941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-969e310d-1779-4096-9315-8465e1cafeba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:33:06.326746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e310d-1779-4096-9315-8465e1cafeba service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:33:06.330412 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10a62b-d2d0-4f82-ac68-2e60ac253018 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec1d24520c447a38ed321f62d4f9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:33:06.331016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10a62b-d2d0-4f82-ac68-2e60ac253018 service cinder] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:33:06.331295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10a62b-d2d0-4f82-ac68-2e60ac253018 service cinder] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:33:06.331577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10a62b-d2d0-4f82-ac68-2e60ac253018 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:33:06.341049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10a62b-d2d0-4f82-ac68-2e60ac253018 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:33:06.342568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10a62b-d2d0-4f82-ac68-2e60ac253018 service cinder] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:33:06.352222 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4359/8720] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:33:06 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:33:09.332558 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=21 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:33:16.348017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=26 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:33:35.109506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17cec1-9886-4231-ada6-709b8679b37a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:33:35.110098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17cec1-9886-4231-ada6-709b8679b37a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:33:35.110098 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17cec1-9886-4231-ada6-709b8679b37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:33:35.129443 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-2f17cec1-9886-4231-ada6-709b8679b37a None None] MFA Rules not processed for user `aec3aa7aba49468e86caef89e306d01d`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:33:35.130683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2f17cec1-9886-4231-ada6-709b8679b37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:33:35.138175 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4362/8721] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:33:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:33:35.394721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10a62b-d2d0-4f82-ac68-2e60ac253018 service cinder] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:33:35.396202 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-eb10a62b-d2d0-4f82-ac68-2e60ac253018 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:33:35.452108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10a62b-d2d0-4f82-ac68-2e60ac253018 service cinder] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:33:35.455754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1eac8-e891-42ea-b9f2-82f8c4a0cff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:33:35.456359 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1eac8-e891-42ea-b9f2-82f8c4a0cff9 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:33:35.456647 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1eac8-e891-42ea-b9f2-82f8c4a0cff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:33:35.456925 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1eac8-e891-42ea-b9f2-82f8c4a0cff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:33:35.458643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-96b1eac8-e891-42ea-b9f2-82f8c4a0cff9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:33:35.467786 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1eac8-e891-42ea-b9f2-82f8c4a0cff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:33:35.469228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1eac8-e891-42ea-b9f2-82f8c4a0cff9 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:33:35.477337 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4360/8722] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:33:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:33:35.852885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17cec1-9886-4231-ada6-709b8679b37a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:33:35.854488 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2f17cec1-9886-4231-ada6-709b8679b37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:33:35.870263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17cec1-9886-4231-ada6-709b8679b37a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:33:35.875239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7532c21-37c9-41da-b833-fffdfde4d512 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:33:35.875872 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7532c21-37c9-41da-b833-fffdfde4d512 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:33:35.876152 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7532c21-37c9-41da-b833-fffdfde4d512 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:33:35.876425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7532c21-37c9-41da-b833-fffdfde4d512 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:33:35.878577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c7532c21-37c9-41da-b833-fffdfde4d512 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:33:35.891301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7532c21-37c9-41da-b833-fffdfde4d512 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:33:35.892824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7532c21-37c9-41da-b833-fffdfde4d512 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:33:35.904785 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4363/8723] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:33:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:33:45.473828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=26 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:33:45.900603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=9 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:34:17.801611 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2e0b4-84cb-45f5-8433-ca020f247073 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:34:17.802187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2e0b4-84cb-45f5-8433-ca020f247073 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:34:17.802187 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2e0b4-84cb-45f5-8433-ca020f247073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:34:17.820982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-41a2e0b4-84cb-45f5-8433-ca020f247073 None None] MFA Rules not processed for user `aec3aa7aba49468e86caef89e306d01d`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:34:17.822222 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-41a2e0b4-84cb-45f5-8433-ca020f247073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:34:17.829076 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4361/8724] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:34:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:34:18.457816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7532c21-37c9-41da-b833-fffdfde4d512 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:34:18.468813 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7532c21-37c9-41da-b833-fffdfde4d512 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:34:18.474239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d82eca-d806-41b1-b8c2-9bdb3997a3f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:34:18.474860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d82eca-d806-41b1-b8c2-9bdb3997a3f8 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:34:18.475177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d82eca-d806-41b1-b8c2-9bdb3997a3f8 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:34:18.475456 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d82eca-d806-41b1-b8c2-9bdb3997a3f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:34:18.477512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d9d82eca-d806-41b1-b8c2-9bdb3997a3f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:34:18.489955 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d82eca-d806-41b1-b8c2-9bdb3997a3f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:34:18.491571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d82eca-d806-41b1-b8c2-9bdb3997a3f8 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:34:18.502275 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4364/8725] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:34:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:34:27.815541 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:34:28.497816 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:35:06.877561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2e0b4-84cb-45f5-8433-ca020f247073 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:35:06.953757 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2e0b4-84cb-45f5-8433-ca020f247073 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:35:06.958420 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67279e-eee7-483b-b43c-761c0535cdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:35:06.959061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67279e-eee7-483b-b43c-761c0535cdb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:06.959342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67279e-eee7-483b-b43c-761c0535cdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:06.959614 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67279e-eee7-483b-b43c-761c0535cdb5 admin admin] PATH_INFO: `/v3/users/aec3aa7aba49468e86caef89e306d01d` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:06.960752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67279e-eee7-483b-b43c-761c0535cdb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aec3aa7aba49468e86caef89e306d01d)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:35:06.962732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67279e-eee7-483b-b43c-761c0535cdb5 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:35:07.202933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0d67279e-eee7-483b-b43c-761c0535cdb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aec3aa7aba49468e86caef89e306d01d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:35:07.203619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0d67279e-eee7-483b-b43c-761c0535cdb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aec3aa7aba49468e86caef89e306d01d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:35:07.210858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0d67279e-eee7-483b-b43c-761c0535cdb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aec3aa7aba49468e86caef89e306d01d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:35:07.224414 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0d67279e-eee7-483b-b43c-761c0535cdb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aec3aa7aba49468e86caef89e306d01d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:35:07.288399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-0d67279e-eee7-483b-b43c-761c0535cdb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aec3aa7aba49468e86caef89e306d01d'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:35:07.295044 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4362/8726] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:35:06 2022] DELETE /identity/v3/users/aec3aa7aba49468e86caef89e306d01d => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:35:07.546339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d82eca-d806-41b1-b8c2-9bdb3997a3f8 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:35:07.556946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d82eca-d806-41b1-b8c2-9bdb3997a3f8 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:35:07.614023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea297f9-8c52-4caa-9a19-f23a2085d20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:35:07.614611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea297f9-8c52-4caa-9a19-f23a2085d20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:07.614895 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea297f9-8c52-4caa-9a19-f23a2085d20e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:07.615170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea297f9-8c52-4caa-9a19-f23a2085d20e admin admin] PATH_INFO: `/v3/projects/c4a8b90797b04f59bb513f5b6f4f6ba0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:07.616281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea297f9-8c52-4caa-9a19-f23a2085d20e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4a8b90797b04f59bb513f5b6f4f6ba0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:35:07.618250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea297f9-8c52-4caa-9a19-f23a2085d20e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:35:07.710950 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9ea297f9-8c52-4caa-9a19-f23a2085d20e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'request_id': 'req-9ea297f9-8c52-4caa-9a19-f23a2085d20e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:35:07.717134 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9ea297f9-8c52-4caa-9a19-f23a2085d20e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'request_id': 'req-9ea297f9-8c52-4caa-9a19-f23a2085d20e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:35:07.722688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9ea297f9-8c52-4caa-9a19-f23a2085d20e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'request_id': 'req-9ea297f9-8c52-4caa-9a19-f23a2085d20e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:35:07.772405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9ea297f9-8c52-4caa-9a19-f23a2085d20e admin admin] The token cache is being invalidate because project c4a8b90797b04f59bb513f5b6f4f6ba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:35:07.772698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9ea297f9-8c52-4caa-9a19-f23a2085d20e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:35:07.773328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-9ea297f9-8c52-4caa-9a19-f23a2085d20e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:35:07.774862 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4365/8727] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:35:07 2022] DELETE /identity/v3/projects/c4a8b90797b04f59bb513f5b6f4f6ba0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:35:07.778991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67279e-eee7-483b-b43c-761c0535cdb5 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:35:07.780481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0d67279e-eee7-483b-b43c-761c0535cdb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:35:07.793788 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67279e-eee7-483b-b43c-761c0535cdb5 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:35:07.849234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75db55-6c6d-4c88-824a-c331e21e3c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:35:07.849860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75db55-6c6d-4c88-824a-c331e21e3c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:07.850171 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75db55-6c6d-4c88-824a-c331e21e3c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:07.850447 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75db55-6c6d-4c88-824a-c331e21e3c80 admin admin] PATH_INFO: `/v3/users/25abaed30acf4f0ea7a82c4bbd99cb3e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:07.851573 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75db55-6c6d-4c88-824a-c331e21e3c80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25abaed30acf4f0ea7a82c4bbd99cb3e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:35:07.853500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75db55-6c6d-4c88-824a-c331e21e3c80 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:35:07.875442 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:35:08.054832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fc75db55-6c6d-4c88-824a-c331e21e3c80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25abaed30acf4f0ea7a82c4bbd99cb3e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:35:08.055498 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fc75db55-6c6d-4c88-824a-c331e21e3c80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25abaed30acf4f0ea7a82c4bbd99cb3e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:35:08.062443 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fc75db55-6c6d-4c88-824a-c331e21e3c80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25abaed30acf4f0ea7a82c4bbd99cb3e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:35:08.075234 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fc75db55-6c6d-4c88-824a-c331e21e3c80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25abaed30acf4f0ea7a82c4bbd99cb3e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:35:08.145388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fc75db55-6c6d-4c88-824a-c331e21e3c80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25abaed30acf4f0ea7a82c4bbd99cb3e'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:35:08.151883 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4363/8728] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:35:07 2022] DELETE /identity/v3/users/25abaed30acf4f0ea7a82c4bbd99cb3e => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:35:08.398999 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea297f9-8c52-4caa-9a19-f23a2085d20e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:35:08.400389 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9ea297f9-8c52-4caa-9a19-f23a2085d20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:35:08.413103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea297f9-8c52-4caa-9a19-f23a2085d20e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:35:08.469984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12402bb1-d628-4c13-930d-eeba74dab9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:35:08.470651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12402bb1-d628-4c13-930d-eeba74dab9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:08.470938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12402bb1-d628-4c13-930d-eeba74dab9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:08.471219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12402bb1-d628-4c13-930d-eeba74dab9d4 admin admin] PATH_INFO: `/v3/projects/ecdffbf8ad61481382591340fd55739b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:08.472526 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12402bb1-d628-4c13-930d-eeba74dab9d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecdffbf8ad61481382591340fd55739b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:35:08.474550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12402bb1-d628-4c13-930d-eeba74dab9d4 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:35:08.584710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:35:08.596257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-12402bb1-d628-4c13-930d-eeba74dab9d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecdffbf8ad61481382591340fd55739b', 'request_id': 'req-12402bb1-d628-4c13-930d-eeba74dab9d4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:35:08.602719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-12402bb1-d628-4c13-930d-eeba74dab9d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecdffbf8ad61481382591340fd55739b', 'request_id': 'req-12402bb1-d628-4c13-930d-eeba74dab9d4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:35:08.608915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-12402bb1-d628-4c13-930d-eeba74dab9d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecdffbf8ad61481382591340fd55739b', 'request_id': 'req-12402bb1-d628-4c13-930d-eeba74dab9d4'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:35:08.693854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-12402bb1-d628-4c13-930d-eeba74dab9d4 admin admin] The token cache is being invalidate because project ecdffbf8ad61481382591340fd55739b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:35:08.694114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-12402bb1-d628-4c13-930d-eeba74dab9d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:35:08.694773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-12402bb1-d628-4c13-930d-eeba74dab9d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:35:08.696308 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4366/8729] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:35:08 2022] DELETE /identity/v3/projects/ecdffbf8ad61481382591340fd55739b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:35:08.701310 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2fbc6-e24b-4b99-89d9-83841a97ad71 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:08.701601 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2fbc6-e24b-4b99-89d9-83841a97ad71 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:08.702554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2fbc6-e24b-4b99-89d9-83841a97ad71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:08.722793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-42a2fbc6-e24b-4b99-89d9-83841a97ad71 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:35:08.724262 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-42a2fbc6-e24b-4b99-89d9-83841a97ad71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:35:08.782883 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4364/8730] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:35:08.790640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea5d69-8464-44d9-be1e-34c9c1eb6c8e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:08.790959 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea5d69-8464-44d9-be1e-34c9c1eb6c8e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:08.791240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea5d69-8464-44d9-be1e-34c9c1eb6c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:08.810717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7dea5d69-8464-44d9-be1e-34c9c1eb6c8e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:35:08.812426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7dea5d69-8464-44d9-be1e-34c9c1eb6c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:35:08.820544 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4367/8731] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:35:08.824715 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2fbc6-e24b-4b99-89d9-83841a97ad71 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:35:08.835586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2fbc6-e24b-4b99-89d9-83841a97ad71 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:35:08.840229 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997a846-ff82-45a8-a09a-4793a502ee6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:35:08.840863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997a846-ff82-45a8-a09a-4793a502ee6e admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:08.841144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997a846-ff82-45a8-a09a-4793a502ee6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:08.841418 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997a846-ff82-45a8-a09a-4793a502ee6e admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:08.842166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997a846-ff82-45a8-a09a-4793a502ee6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:35:08.842468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997a846-ff82-45a8-a09a-4793a502ee6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:35:08.844064 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997a846-ff82-45a8-a09a-4793a502ee6e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:35:08.855927 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4365/8732] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:35:08.860336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea5d69-8464-44d9-be1e-34c9c1eb6c8e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:35:08.869581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea5d69-8464-44d9-be1e-34c9c1eb6c8e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:35:08.874825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c519b7-8410-46bc-b748-22f3a2c5f9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:35:08.875426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c519b7-8410-46bc-b748-22f3a2c5f9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:08.875709 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c519b7-8410-46bc-b748-22f3a2c5f9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:08.875987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c519b7-8410-46bc-b748-22f3a2c5f9e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:08.876611 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c519b7-8410-46bc-b748-22f3a2c5f9e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:35:08.878535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c519b7-8410-46bc-b748-22f3a2c5f9e6 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:35:08.987039 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4368/8733] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:35:08 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:35:08.991320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997a846-ff82-45a8-a09a-4793a502ee6e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:35:09.001365 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997a846-ff82-45a8-a09a-4793a502ee6e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:35:09.056685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a01ff8-29f6-48e7-81a3-6885c5593fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:35:09.057352 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a01ff8-29f6-48e7-81a3-6885c5593fbb admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:09.057556 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a01ff8-29f6-48e7-81a3-6885c5593fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:09.057830 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a01ff8-29f6-48e7-81a3-6885c5593fbb admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:09.058485 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a01ff8-29f6-48e7-81a3-6885c5593fbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:35:09.060409 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a01ff8-29f6-48e7-81a3-6885c5593fbb admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:35:09.145253 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4366/8734] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:35:08 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:35:09.149517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c519b7-8410-46bc-b748-22f3a2c5f9e6 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:35:09.160628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c519b7-8410-46bc-b748-22f3a2c5f9e6 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:35:09.165568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d310ad-3af1-46d4-aa6d-13464b74efa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:35:09.166240 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d310ad-3af1-46d4-aa6d-13464b74efa0 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:09.166567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d310ad-3af1-46d4-aa6d-13464b74efa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:09.166843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d310ad-3af1-46d4-aa6d-13464b74efa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:09.167492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d310ad-3af1-46d4-aa6d-13464b74efa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:35:09.169093 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d310ad-3af1-46d4-aa6d-13464b74efa0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:35:09.179745 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4369/8735] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:35:09.183740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a01ff8-29f6-48e7-81a3-6885c5593fbb admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:35:09.194160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a01ff8-29f6-48e7-81a3-6885c5593fbb admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:35:09.198844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b230438-2b15-47c9-baf4-f5a1ed047463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:35:09.199468 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b230438-2b15-47c9-baf4-f5a1ed047463 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:09.199749 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b230438-2b15-47c9-baf4-f5a1ed047463 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:09.200135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b230438-2b15-47c9-baf4-f5a1ed047463 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:09.200785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b230438-2b15-47c9-baf4-f5a1ed047463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:35:09.203006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b230438-2b15-47c9-baf4-f5a1ed047463 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:35:09.213657 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4367/8736] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 04:35:09.217755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d310ad-3af1-46d4-aa6d-13464b74efa0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:35:09.228422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d310ad-3af1-46d4-aa6d-13464b74efa0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:35:09.232964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089750c-bc85-42e2-a92c-5abe0512dd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:35:09.234216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089750c-bc85-42e2-a92c-5abe0512dd6c admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:09.234497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089750c-bc85-42e2-a92c-5abe0512dd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:09.234767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089750c-bc85-42e2-a92c-5abe0512dd6c admin admin] PATH_INFO: `/v3/projects/e577cf747d5b4a12ba0ee81e686b8534/users/81159cb7105b4f4e94527225ed45feeb/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:09.249656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089750c-bc85-42e2-a92c-5abe0512dd6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e577cf747d5b4a12ba0ee81e686b8534, user_id=81159cb7105b4f4e94527225ed45feeb, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:35:09.252264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089750c-bc85-42e2-a92c-5abe0512dd6c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:35:09.350311 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4370/8737] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:35:09 2022] PUT /identity/v3/projects/e577cf747d5b4a12ba0ee81e686b8534/users/81159cb7105b4f4e94527225ed45feeb/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:35:09.355440 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5beadd0-d2b6-4e94-8e7c-dd3b9a5c99b8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:09.355713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5beadd0-d2b6-4e94-8e7c-dd3b9a5c99b8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:09.356011 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5beadd0-d2b6-4e94-8e7c-dd3b9a5c99b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:09.364874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:35:09.376255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a5beadd0-d2b6-4e94-8e7c-dd3b9a5c99b8 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:35:09.377460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a5beadd0-d2b6-4e94-8e7c-dd3b9a5c99b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:35:09.433997 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4368/8738] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:35:09.444417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089750c-bc85-42e2-a92c-5abe0512dd6c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:35:09.446182 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1089750c-bc85-42e2-a92c-5abe0512dd6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:35:09.503574 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089750c-bc85-42e2-a92c-5abe0512dd6c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:35:09.507181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782f549-ef2c-492e-aeb3-7a32287ea355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:35:09.507786 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782f549-ef2c-492e-aeb3-7a32287ea355 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:09.508073 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782f549-ef2c-492e-aeb3-7a32287ea355 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:09.508695 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782f549-ef2c-492e-aeb3-7a32287ea355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:09.518349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782f549-ef2c-492e-aeb3-7a32287ea355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:35:09.519787 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782f549-ef2c-492e-aeb3-7a32287ea355 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:35:09.529558 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4371/8739] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:35:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:35:14.719322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b0dea-19a8-440f-a409-dbc17cc2b4a6 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:14.719853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b0dea-19a8-440f-a409-dbc17cc2b4a6 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:14.720176 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b0dea-19a8-440f-a409-dbc17cc2b4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:14.762983 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c76b0dea-19a8-440f-a409-dbc17cc2b4a6 None None] MFA Rules not processed for user `81159cb7105b4f4e94527225ed45feeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:35:14.768231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c76b0dea-19a8-440f-a409-dbc17cc2b4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:35:14.860101 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4369/8740] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:35:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:35:14.864840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782f549-ef2c-492e-aeb3-7a32287ea355 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:35:14.875734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782f549-ef2c-492e-aeb3-7a32287ea355 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:35:14.880763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0da6c-9a29-4d9a-958c-b7481d7ff24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:35:14.881720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0da6c-9a29-4d9a-958c-b7481d7ff24a admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:14.882164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0da6c-9a29-4d9a-958c-b7481d7ff24a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:14.882659 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0da6c-9a29-4d9a-958c-b7481d7ff24a admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:14.883377 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0da6c-9a29-4d9a-958c-b7481d7ff24a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:35:14.885946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0da6c-9a29-4d9a-958c-b7481d7ff24a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:35:14.982078 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4372/8741] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:35:14 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:35:14.986393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b0dea-19a8-440f-a409-dbc17cc2b4a6 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:35:14.999883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b0dea-19a8-440f-a409-dbc17cc2b4a6 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:35:15.084230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9022501-4099-42ab-97cc-271a9a367afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:35:15.085279 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9022501-4099-42ab-97cc-271a9a367afe admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:15.085730 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9022501-4099-42ab-97cc-271a9a367afe admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:15.086724 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9022501-4099-42ab-97cc-271a9a367afe admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:15.087526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9022501-4099-42ab-97cc-271a9a367afe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:35:15.089779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9022501-4099-42ab-97cc-271a9a367afe admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:35:15.232225 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4370/8742] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:35:14 2022] POST /identity/v3/users => generated 299 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:35:15.236557 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0da6c-9a29-4d9a-958c-b7481d7ff24a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:35:15.247899 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0da6c-9a29-4d9a-958c-b7481d7ff24a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:35:15.253924 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2864c-154e-43c1-8feb-375a83a584a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:35:15.254658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2864c-154e-43c1-8feb-375a83a584a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:15.255005 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2864c-154e-43c1-8feb-375a83a584a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:15.255348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2864c-154e-43c1-8feb-375a83a584a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:15.256136 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2864c-154e-43c1-8feb-375a83a584a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:35:15.257814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2864c-154e-43c1-8feb-375a83a584a8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:35:15.283973 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4373/8743] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:35:15.287738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9022501-4099-42ab-97cc-271a9a367afe admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:35:15.305305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9022501-4099-42ab-97cc-271a9a367afe admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:35:15.311224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cffd69-dfef-4454-aa2d-103b89410fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:35:15.312038 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cffd69-dfef-4454-aa2d-103b89410fff admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:15.312549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cffd69-dfef-4454-aa2d-103b89410fff admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:15.312972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cffd69-dfef-4454-aa2d-103b89410fff admin admin] PATH_INFO: `/v3/projects/c69dfef5caf84140a8f7fcc218f7201e/users/16e744690c96436293d776aa28786114/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:15.337249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cffd69-dfef-4454-aa2d-103b89410fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69dfef5caf84140a8f7fcc218f7201e, user_id=16e744690c96436293d776aa28786114, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:35:15.340132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cffd69-dfef-4454-aa2d-103b89410fff admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:35:15.415379 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:35:15.421287 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4371/8744] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:35:15 2022] PUT /identity/v3/projects/c69dfef5caf84140a8f7fcc218f7201e/users/16e744690c96436293d776aa28786114/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:35:15.425452 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2864c-154e-43c1-8feb-375a83a584a8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:35:15.435837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2864c-154e-43c1-8feb-375a83a584a8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:35:15.461119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:35:15.496278 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51ae76-fc3a-4fff-8f06-8571d3557ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:35:15.496915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51ae76-fc3a-4fff-8f06-8571d3557ebf admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:15.497376 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51ae76-fc3a-4fff-8f06-8571d3557ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:15.497661 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51ae76-fc3a-4fff-8f06-8571d3557ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:15.498417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51ae76-fc3a-4fff-8f06-8571d3557ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:35:15.501852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51ae76-fc3a-4fff-8f06-8571d3557ebf admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:35:15.516244 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4374/8745] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:35:15.519806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cffd69-dfef-4454-aa2d-103b89410fff admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:35:15.532514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cffd69-dfef-4454-aa2d-103b89410fff admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:35:15.537740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5876b-a435-49af-9263-3449103c7885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:35:15.538800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5876b-a435-49af-9263-3449103c7885 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:15.539085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5876b-a435-49af-9263-3449103c7885 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:15.539540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5876b-a435-49af-9263-3449103c7885 admin admin] PATH_INFO: `/v3/projects/c69dfef5caf84140a8f7fcc218f7201e/users/16e744690c96436293d776aa28786114/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:15.541602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5876b-a435-49af-9263-3449103c7885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69dfef5caf84140a8f7fcc218f7201e, user_id=16e744690c96436293d776aa28786114, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:35:15.544342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5876b-a435-49af-9263-3449103c7885 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:35:15.556356 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4372/8746] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:35:15 2022] PUT /identity/v3/projects/c69dfef5caf84140a8f7fcc218f7201e/users/16e744690c96436293d776aa28786114/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:35:21.356737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9c4c5-3c37-4108-8997-59ca07fe3156 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:21.356737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9c4c5-3c37-4108-8997-59ca07fe3156 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:21.356737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9c4c5-3c37-4108-8997-59ca07fe3156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:21.387701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-a8b9c4c5-3c37-4108-8997-59ca07fe3156 None None] MFA Rules not processed for user `16e744690c96436293d776aa28786114`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:35:21.390250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a8b9c4c5-3c37-4108-8997-59ca07fe3156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:35:21.472363 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4375/8747] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:35:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:35:21.507896 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17db013-4a76-4bba-8fe1-56a1654c7a6c None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:21.508413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17db013-4a76-4bba-8fe1-56a1654c7a6c None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:21.508413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17db013-4a76-4bba-8fe1-56a1654c7a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:21.562754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c17db013-4a76-4bba-8fe1-56a1654c7a6c None None] MFA Rules not processed for user `c2b7050fa8404001876dbfd40e392015`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:35:21.564003 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c17db013-4a76-4bba-8fe1-56a1654c7a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:35:21.628809 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4373/8748] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Oct 27 04:35:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:35:21.636932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9c4c5-3c37-4108-8997-59ca07fe3156 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:35:21.645598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9c4c5-3c37-4108-8997-59ca07fe3156 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:35:21.649272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec087445-1488-481e-936e-cd8824eab862 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:35:21.649888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec087445-1488-481e-936e-cd8824eab862 service glance] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:21.650209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec087445-1488-481e-936e-cd8824eab862 service glance] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:21.651123 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec087445-1488-481e-936e-cd8824eab862 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:21.713629 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec087445-1488-481e-936e-cd8824eab862 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:35:21.715115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec087445-1488-481e-936e-cd8824eab862 service glance] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:35:21.741006 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4376/8749] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:35:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:35:22.026088 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26eae2-695a-42c3-8be8-b78e560ffe68 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:22.026381 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26eae2-695a-42c3-8be8-b78e560ffe68 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:22.026686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26eae2-695a-42c3-8be8-b78e560ffe68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:22.081266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-9b26eae2-695a-42c3-8be8-b78e560ffe68 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:35:22.082669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-9b26eae2-695a-42c3-8be8-b78e560ffe68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:35:22.153244 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4374/8750] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 04:35:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:35:22.286164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec087445-1488-481e-936e-cd8824eab862 service glance] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:35:22.287720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ec087445-1488-481e-936e-cd8824eab862 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:35:22.343400 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=100 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:35:22.387042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec087445-1488-481e-936e-cd8824eab862 service glance] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:35:22.392833 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92361f1-5c5d-42f5-ac49-5b93b6e5bfbb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:35:22.393453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92361f1-5c5d-42f5-ac49-5b93b6e5bfbb service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:22.393738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92361f1-5c5d-42f5-ac49-5b93b6e5bfbb service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:22.394021 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92361f1-5c5d-42f5-ac49-5b93b6e5bfbb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:22.402257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92361f1-5c5d-42f5-ac49-5b93b6e5bfbb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:35:22.403842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92361f1-5c5d-42f5-ac49-5b93b6e5bfbb service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:35:22.412321 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4377/8751] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 04:35:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 04:35:32.149923 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=83,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:35:32.409085 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=20 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:35:32.530564 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a72841-729b-4d5d-a571-4f6d16a04553 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:32.530853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a72841-729b-4d5d-a571-4f6d16a04553 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:32.531115 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a72841-729b-4d5d-a571-4f6d16a04553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:32.550341 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-72a72841-729b-4d5d-a571-4f6d16a04553 None None] MFA Rules not processed for user `81159cb7105b4f4e94527225ed45feeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:35:32.551538 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-72a72841-729b-4d5d-a571-4f6d16a04553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:35:32.558419 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4375/8752] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:35:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:35:35.700367 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ff72f-6f73-4193-a7dd-4153790b4695 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:35.700885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ff72f-6f73-4193-a7dd-4153790b4695 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:35.701054 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ff72f-6f73-4193-a7dd-4153790b4695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:35.721470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-de1ff72f-6f73-4193-a7dd-4153790b4695 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:35:35.722842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-de1ff72f-6f73-4193-a7dd-4153790b4695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:35:35.731141 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4378/8753] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 04:35:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:35:35.744311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a72841-729b-4d5d-a571-4f6d16a04553 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:35:35.756817 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a72841-729b-4d5d-a571-4f6d16a04553 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:35:35.761852 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77198a10-56c0-450f-b331-a611f45d1baa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:35:35.766137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77198a10-56c0-450f-b331-a611f45d1baa service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:35.766137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77198a10-56c0-450f-b331-a611f45d1baa service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:35.766137 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77198a10-56c0-450f-b331-a611f45d1baa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:35.772195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77198a10-56c0-450f-b331-a611f45d1baa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:35:35.773947 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77198a10-56c0-450f-b331-a611f45d1baa service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:35:35.782637 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4376/8754] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 04:35:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 04:35:41.310639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ff72f-6f73-4193-a7dd-4153790b4695 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:35:41.372130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ff72f-6f73-4193-a7dd-4153790b4695 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:35:41.377165 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad96a0f-23d6-4a86-9001-f0c378513ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:35:41.377807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad96a0f-23d6-4a86-9001-f0c378513ccb service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:41.378119 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad96a0f-23d6-4a86-9001-f0c378513ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:41.378405 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad96a0f-23d6-4a86-9001-f0c378513ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:41.380257 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1ad96a0f-23d6-4a86-9001-f0c378513ccb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:35:41.391062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad96a0f-23d6-4a86-9001-f0c378513ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:35:41.392503 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad96a0f-23d6-4a86-9001-f0c378513ccb service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:35:41.401361 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4379/8755] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:35:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:35:45.779130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=9 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:35:46.203527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77198a10-56c0-450f-b331-a611f45d1baa service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:35:46.205039 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-77198a10-56c0-450f-b331-a611f45d1baa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:35:46.216811 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77198a10-56c0-450f-b331-a611f45d1baa service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:35:46.221119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93fe93-a805-4060-bb72-f063a417b205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:35:46.221722 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93fe93-a805-4060-bb72-f063a417b205 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:46.222008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93fe93-a805-4060-bb72-f063a417b205 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:46.222325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93fe93-a805-4060-bb72-f063a417b205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:46.223981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1e93fe93-a805-4060-bb72-f063a417b205 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:35:46.293994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93fe93-a805-4060-bb72-f063a417b205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:35:46.295471 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93fe93-a805-4060-bb72-f063a417b205 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:35:46.306132 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4377/8756] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:35:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:35:47.482027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad96a0f-23d6-4a86-9001-f0c378513ccb service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:35:47.491170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad96a0f-23d6-4a86-9001-f0c378513ccb service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:35:47.494832 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7dcd5d-daa5-42b9-b59c-c6ebb66a5d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:35:47.495428 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7dcd5d-daa5-42b9-b59c-c6ebb66a5d7b service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:35:47.495711 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7dcd5d-daa5-42b9-b59c-c6ebb66a5d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:35:47.495985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7dcd5d-daa5-42b9-b59c-c6ebb66a5d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:35:47.497666 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7a7dcd5d-daa5-42b9-b59c-c6ebb66a5d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:35:47.511313 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7dcd5d-daa5-42b9-b59c-c6ebb66a5d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:35:47.512726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7dcd5d-daa5-42b9-b59c-c6ebb66a5d7b service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:35:47.523295 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4380/8757] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:35:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:35:56.301424 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=34 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:35:57.518721 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=35 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:36:12.064160 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93fe93-a805-4060-bb72-f063a417b205 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:36:12.072850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93fe93-a805-4060-bb72-f063a417b205 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:36:12.076514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b276a7-6a69-4359-a7f5-302fb772d8c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:36:12.077114 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b276a7-6a69-4359-a7f5-302fb772d8c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:36:12.077398 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b276a7-6a69-4359-a7f5-302fb772d8c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:36:12.077678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b276a7-6a69-4359-a7f5-302fb772d8c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:36:12.086514 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b276a7-6a69-4359-a7f5-302fb772d8c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:36:12.087955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b276a7-6a69-4359-a7f5-302fb772d8c5 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:36:12.097831 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4378/8758] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:36:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:36:22.093228 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:38:02.306809 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7dcd5d-daa5-42b9-b59c-c6ebb66a5d7b service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:38:02.308223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7a7dcd5d-daa5-42b9-b59c-c6ebb66a5d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:38:02.432363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7dcd5d-daa5-42b9-b59c-c6ebb66a5d7b service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:38:02.437410 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc97b76-65fc-454b-a91f-797dca5892e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:38:02.438015 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc97b76-65fc-454b-a91f-797dca5892e0 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:38:02.438332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc97b76-65fc-454b-a91f-797dca5892e0 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:38:02.438607 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc97b76-65fc-454b-a91f-797dca5892e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:38:02.440975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2dc97b76-65fc-454b-a91f-797dca5892e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:38:02.451939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc97b76-65fc-454b-a91f-797dca5892e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:38:02.453510 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc97b76-65fc-454b-a91f-797dca5892e0 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:38:02.466591 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4381/8759] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:38:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:38:02.560394 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b276a7-6a69-4359-a7f5-302fb772d8c5 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:38:02.561796 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-52b276a7-6a69-4359-a7f5-302fb772d8c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:38:02.606823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b276a7-6a69-4359-a7f5-302fb772d8c5 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:38:02.614642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b567320-d7db-44f2-b749-34d7f924df7b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:38:02.615285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b567320-d7db-44f2-b749-34d7f924df7b service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:38:02.615571 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b567320-d7db-44f2-b749-34d7f924df7b service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:38:02.615845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b567320-d7db-44f2-b749-34d7f924df7b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:38:02.617650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4b567320-d7db-44f2-b749-34d7f924df7b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:38:02.630027 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b567320-d7db-44f2-b749-34d7f924df7b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:38:02.631667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b567320-d7db-44f2-b749-34d7f924df7b service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:38:02.641354 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4379/8760] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:38:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:38:12.461726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=58 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:38:12.637255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=20 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:39:10.412439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc97b76-65fc-454b-a91f-797dca5892e0 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:39:10.413894 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2dc97b76-65fc-454b-a91f-797dca5892e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:39:10.431799 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc97b76-65fc-454b-a91f-797dca5892e0 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:39:10.438656 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d08ea-b6de-4d51-ad51-b086ba0edc9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:39:10.439729 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d08ea-b6de-4d51-ad51-b086ba0edc9d service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:39:10.440248 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d08ea-b6de-4d51-ad51-b086ba0edc9d service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:39:10.440744 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d08ea-b6de-4d51-ad51-b086ba0edc9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:39:10.442866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6b1d08ea-b6de-4d51-ad51-b086ba0edc9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:39:10.459506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d08ea-b6de-4d51-ad51-b086ba0edc9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:39:10.461755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d08ea-b6de-4d51-ad51-b086ba0edc9d service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:39:10.475612 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4382/8761] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:39:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:39:11.604812 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b567320-d7db-44f2-b749-34d7f924df7b service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:39:11.606326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4b567320-d7db-44f2-b749-34d7f924df7b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:39:11.625955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b567320-d7db-44f2-b749-34d7f924df7b service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:39:11.631991 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d469ba5-3667-4180-9fa5-193cd12fe6a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:39:11.632732 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d469ba5-3667-4180-9fa5-193cd12fe6a4 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:39:11.633227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d469ba5-3667-4180-9fa5-193cd12fe6a4 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:39:11.635049 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d469ba5-3667-4180-9fa5-193cd12fe6a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:39:11.637358 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8d469ba5-3667-4180-9fa5-193cd12fe6a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:39:11.659224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d469ba5-3667-4180-9fa5-193cd12fe6a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:39:11.661939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d469ba5-3667-4180-9fa5-193cd12fe6a4 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:39:11.675869 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4380/8762] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:39:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:39:20.469873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:39:21.670832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:39:24.875421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a62b7-cd24-4a48-88e4-51c49e8b060f None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:39:24.875921 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a62b7-cd24-4a48-88e4-51c49e8b060f None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:39:24.876040 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a62b7-cd24-4a48-88e4-51c49e8b060f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:39:24.897551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-df7a62b7-cd24-4a48-88e4-51c49e8b060f None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:39:24.898831 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-df7a62b7-cd24-4a48-88e4-51c49e8b060f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:39:24.906414 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4383/8763] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 04:39:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:39:24.947936 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d469ba5-3667-4180-9fa5-193cd12fe6a4 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:39:24.960015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d469ba5-3667-4180-9fa5-193cd12fe6a4 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:39:24.965311 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9373b-4a07-43d9-ab7f-4968f7d20e35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:39:24.965907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9373b-4a07-43d9-ab7f-4968f7d20e35 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:39:24.966230 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9373b-4a07-43d9-ab7f-4968f7d20e35 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:39:24.966518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9373b-4a07-43d9-ab7f-4968f7d20e35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:39:24.974995 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9373b-4a07-43d9-ab7f-4968f7d20e35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:39:24.976533 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9373b-4a07-43d9-ab7f-4968f7d20e35 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:39:24.985055 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4381/8764] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 04:39:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 04:39:26.057087 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799dae45-bdb8-4feb-b895-e10e3a7fd4e7 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:39:26.057571 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799dae45-bdb8-4feb-b895-e10e3a7fd4e7 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:39:26.057696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799dae45-bdb8-4feb-b895-e10e3a7fd4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:39:26.077688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-799dae45-bdb8-4feb-b895-e10e3a7fd4e7 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:39:26.078946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-799dae45-bdb8-4feb-b895-e10e3a7fd4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:39:26.086759 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4384/8765] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 04:39:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:39:26.098984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9373b-4a07-43d9-ab7f-4968f7d20e35 service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:39:26.109981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9373b-4a07-43d9-ab7f-4968f7d20e35 service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:39:26.115163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ddeeb-208a-4742-a7f0-719c5ce270d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:39:26.115799 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ddeeb-208a-4742-a7f0-719c5ce270d8 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:39:26.116085 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ddeeb-208a-4742-a7f0-719c5ce270d8 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:39:26.116360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ddeeb-208a-4742-a7f0-719c5ce270d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:39:26.124833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ddeeb-208a-4742-a7f0-719c5ce270d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:39:26.126477 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ddeeb-208a-4742-a7f0-719c5ce270d8 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:39:26.134840 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4382/8766] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 04:39:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 04:39:35.884464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e1ba5-2911-4a02-b616-e02dcc410d57 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:39:35.884975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e1ba5-2911-4a02-b616-e02dcc410d57 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:39:35.885080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e1ba5-2911-4a02-b616-e02dcc410d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:39:35.904756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-878e1ba5-2911-4a02-b616-e02dcc410d57 None None] MFA Rules not processed for user `81159cb7105b4f4e94527225ed45feeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:39:35.905972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-878e1ba5-2911-4a02-b616-e02dcc410d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:39:35.913151 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4385/8767] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:39:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:39:36.135716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=12 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:39:36.174894 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ddeeb-208a-4742-a7f0-719c5ce270d8 service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:39:36.184901 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ddeeb-208a-4742-a7f0-719c5ce270d8 service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:39:36.188643 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7963d27-1f97-45bf-bedf-0171e488cbfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:39:36.189240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7963d27-1f97-45bf-bedf-0171e488cbfc service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:39:36.189690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7963d27-1f97-45bf-bedf-0171e488cbfc service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:39:36.190162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7963d27-1f97-45bf-bedf-0171e488cbfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:39:36.191879 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f7963d27-1f97-45bf-bedf-0171e488cbfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:39:36.202022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7963d27-1f97-45bf-bedf-0171e488cbfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:39:36.203467 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7963d27-1f97-45bf-bedf-0171e488cbfc service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:39:36.211083 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4383/8768] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:39:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:39:36.617230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e1ba5-2911-4a02-b616-e02dcc410d57 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:39:36.629266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e1ba5-2911-4a02-b616-e02dcc410d57 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:39:36.634332 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695de9ae-7a5d-4c8a-8269-61e95e7f606d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:39:36.634946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695de9ae-7a5d-4c8a-8269-61e95e7f606d service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:39:36.635229 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695de9ae-7a5d-4c8a-8269-61e95e7f606d service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:39:36.635509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695de9ae-7a5d-4c8a-8269-61e95e7f606d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:39:36.637250 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-695de9ae-7a5d-4c8a-8269-61e95e7f606d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:39:36.649536 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695de9ae-7a5d-4c8a-8269-61e95e7f606d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:39:36.651801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695de9ae-7a5d-4c8a-8269-61e95e7f606d service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:39:36.661371 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4386/8769] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:39:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:39:39.034880 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba361a53-19c1-4812-ac32-c95a1721c73b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:39:39.035367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba361a53-19c1-4812-ac32-c95a1721c73b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:39:39.035494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba361a53-19c1-4812-ac32-c95a1721c73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:39:39.055580 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-ba361a53-19c1-4812-ac32-c95a1721c73b None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:39:39.056793 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-ba361a53-19c1-4812-ac32-c95a1721c73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:39:39.065018 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4384/8770] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 04:39:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:39:39.077668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695de9ae-7a5d-4c8a-8269-61e95e7f606d service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:39:39.091597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695de9ae-7a5d-4c8a-8269-61e95e7f606d service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:39:39.096634 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0c37b-653b-4c71-bf51-69b14151104c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:39:39.097243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0c37b-653b-4c71-bf51-69b14151104c service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:39:39.097529 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0c37b-653b-4c71-bf51-69b14151104c service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:39:39.097806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0c37b-653b-4c71-bf51-69b14151104c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:39:39.106966 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0c37b-653b-4c71-bf51-69b14151104c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:39:39.110556 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0c37b-653b-4c71-bf51-69b14151104c service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:39:39.117758 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4387/8771] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 04:39:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 04:39:46.787339 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba361a53-19c1-4812-ac32-c95a1721c73b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:39:46.796760 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba361a53-19c1-4812-ac32-c95a1721c73b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:39:46.800360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b9ce4-66e5-4fd5-b191-3d9fb3b12922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:39:46.802258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b9ce4-66e5-4fd5-b191-3d9fb3b12922 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:39:46.802258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b9ce4-66e5-4fd5-b191-3d9fb3b12922 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:39:46.802258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b9ce4-66e5-4fd5-b191-3d9fb3b12922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:39:46.803307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-708b9ce4-66e5-4fd5-b191-3d9fb3b12922 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:39:46.812654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b9ce4-66e5-4fd5-b191-3d9fb3b12922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:39:46.814132 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b9ce4-66e5-4fd5-b191-3d9fb3b12922 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:39:46.822618 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4385/8772] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:39:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:39:49.113497 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=21 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:39:53.915263 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0c37b-653b-4c71-bf51-69b14151104c service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:39:53.926849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0c37b-653b-4c71-bf51-69b14151104c service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:39:53.932358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a9bb2-0341-444a-bba4-4fe069435048 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:39:53.932990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a9bb2-0341-444a-bba4-4fe069435048 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:39:53.933273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a9bb2-0341-444a-bba4-4fe069435048 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:39:53.933550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a9bb2-0341-444a-bba4-4fe069435048 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:39:53.935279 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-8c6a9bb2-0341-444a-bba4-4fe069435048 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:39:53.947225 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a9bb2-0341-444a-bba4-4fe069435048 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:39:53.948734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a9bb2-0341-444a-bba4-4fe069435048 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:39:53.959800 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4388/8773] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:39:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:39:56.818415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=15 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:40:03.954842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:40:31.402296 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b9ce4-66e5-4fd5-b191-3d9fb3b12922 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:40:31.415293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b9ce4-66e5-4fd5-b191-3d9fb3b12922 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:40:31.420850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cda9e4-f943-447d-9913-b8474bd7bc08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:40:31.421449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cda9e4-f943-447d-9913-b8474bd7bc08 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:40:31.421733 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cda9e4-f943-447d-9913-b8474bd7bc08 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:40:31.422009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cda9e4-f943-447d-9913-b8474bd7bc08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:40:31.430655 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cda9e4-f943-447d-9913-b8474bd7bc08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:40:31.432249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cda9e4-f943-447d-9913-b8474bd7bc08 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:40:31.441221 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4386/8774] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:40:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:40:41.437057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:40:46.021535 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a9bb2-0341-444a-bba4-4fe069435048 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:40:46.031806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a9bb2-0341-444a-bba4-4fe069435048 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:40:46.035435 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f109f-8365-4370-9a32-3f07836ce2e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:40:46.036052 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f109f-8365-4370-9a32-3f07836ce2e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:40:46.036336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f109f-8365-4370-9a32-3f07836ce2e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:40:46.036621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f109f-8365-4370-9a32-3f07836ce2e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:40:46.053655 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f109f-8365-4370-9a32-3f07836ce2e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:40:46.061569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f109f-8365-4370-9a32-3f07836ce2e2 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:40:46.065612 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4389/8775] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:40:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:40:47.261119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cda9e4-f943-447d-9913-b8474bd7bc08 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:40:47.270416 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cda9e4-f943-447d-9913-b8474bd7bc08 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:40:47.274585 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dae53f-4600-4904-9f9a-269607c8d1d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:40:47.275178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dae53f-4600-4904-9f9a-269607c8d1d6 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:40:47.275461 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dae53f-4600-4904-9f9a-269607c8d1d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:40:47.275738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dae53f-4600-4904-9f9a-269607c8d1d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:40:47.285740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dae53f-4600-4904-9f9a-269607c8d1d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:40:47.287208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dae53f-4600-4904-9f9a-269607c8d1d6 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:40:47.298491 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4387/8776] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:40:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:40:56.061018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=9 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:40:57.293785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:41:35.655880 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4b9a3-d072-4d0d-a4cb-5309c856e11d None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:35.656384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4b9a3-d072-4d0d-a4cb-5309c856e11d None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:35.656583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4b9a3-d072-4d0d-a4cb-5309c856e11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:35.676261 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-5ea4b9a3-d072-4d0d-a4cb-5309c856e11d None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:41:35.677537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5ea4b9a3-d072-4d0d-a4cb-5309c856e11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:41:35.685133 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4390/8777] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 04:41:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:41:35.724961 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dae53f-4600-4904-9f9a-269607c8d1d6 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:41:35.736500 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dae53f-4600-4904-9f9a-269607c8d1d6 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:41:35.742166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b29bf-db2c-4ff4-a719-f84f35060815 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:41:35.742770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b29bf-db2c-4ff4-a719-f84f35060815 service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:35.743051 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b29bf-db2c-4ff4-a719-f84f35060815 service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:35.743325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b29bf-db2c-4ff4-a719-f84f35060815 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:35.751308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b29bf-db2c-4ff4-a719-f84f35060815 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:41:35.752895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b29bf-db2c-4ff4-a719-f84f35060815 service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:41:35.760989 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4388/8778] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 04:41:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 04:41:36.590433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4b9a3-d072-4d0d-a4cb-5309c856e11d None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:41:36.600027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4b9a3-d072-4d0d-a4cb-5309c856e11d None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:41:36.603716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b588fce-4644-4843-a575-73d1b4c2c6d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:41:36.604600 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b588fce-4644-4843-a575-73d1b4c2c6d5 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:36.604863 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b588fce-4644-4843-a575-73d1b4c2c6d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:36.605139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b588fce-4644-4843-a575-73d1b4c2c6d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:36.676808 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b588fce-4644-4843-a575-73d1b4c2c6d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:41:36.678719 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b588fce-4644-4843-a575-73d1b4c2c6d5 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:41:36.698250 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4391/8779] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:41:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:41:40.321652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b29bf-db2c-4ff4-a719-f84f35060815 service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:41:40.346131 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b29bf-db2c-4ff4-a719-f84f35060815 service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:41:40.365430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9ff0e-ece1-437c-adfa-ae66ed41e6a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:41:40.366620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9ff0e-ece1-437c-adfa-ae66ed41e6a2 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:40.366968 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9ff0e-ece1-437c-adfa-ae66ed41e6a2 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:40.367307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9ff0e-ece1-437c-adfa-ae66ed41e6a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:40.369315 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-71b9ff0e-ece1-437c-adfa-ae66ed41e6a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:41:40.395919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9ff0e-ece1-437c-adfa-ae66ed41e6a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:41:40.397602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9ff0e-ece1-437c-adfa-ae66ed41e6a2 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:41:40.407498 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4389/8780] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:41:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:41:43.870635 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b588fce-4644-4843-a575-73d1b4c2c6d5 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:41:43.882154 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b588fce-4644-4843-a575-73d1b4c2c6d5 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:41:43.886993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f9d70-3f71-420e-add7-e2c00e836d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:41:43.887632 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f9d70-3f71-420e-add7-e2c00e836d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:43.887919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f9d70-3f71-420e-add7-e2c00e836d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:43.888204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f9d70-3f71-420e-add7-e2c00e836d4f admin admin] PATH_INFO: `/v3/users/81159cb7105b4f4e94527225ed45feeb` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:43.889338 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f9d70-3f71-420e-add7-e2c00e836d4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=81159cb7105b4f4e94527225ed45feeb)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:41:43.891334 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f9d70-3f71-420e-add7-e2c00e836d4f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:41:44.088244 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cb9f9d70-3f71-420e-add7-e2c00e836d4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81159cb7105b4f4e94527225ed45feeb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:41:44.088901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cb9f9d70-3f71-420e-add7-e2c00e836d4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81159cb7105b4f4e94527225ed45feeb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:41:44.095828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cb9f9d70-3f71-420e-add7-e2c00e836d4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81159cb7105b4f4e94527225ed45feeb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:41:44.108625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cb9f9d70-3f71-420e-add7-e2c00e836d4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81159cb7105b4f4e94527225ed45feeb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:41:44.109210 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cb9f9d70-3f71-420e-add7-e2c00e836d4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81159cb7105b4f4e94527225ed45feeb'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:41:44.175258 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4392/8781] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:41:43 2022] DELETE /identity/v3/users/81159cb7105b4f4e94527225ed45feeb => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:41:44.402684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9ff0e-ece1-437c-adfa-ae66ed41e6a2 service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:41:44.414257 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9ff0e-ece1-437c-adfa-ae66ed41e6a2 service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:41:44.471695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18ea54-ac9b-4ca5-8bec-6fc7d0cbdec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:41:44.472331 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18ea54-ac9b-4ca5-8bec-6fc7d0cbdec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:44.472615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18ea54-ac9b-4ca5-8bec-6fc7d0cbdec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:44.472892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18ea54-ac9b-4ca5-8bec-6fc7d0cbdec9 admin admin] PATH_INFO: `/v3/projects/e577cf747d5b4a12ba0ee81e686b8534` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:44.474008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18ea54-ac9b-4ca5-8bec-6fc7d0cbdec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e577cf747d5b4a12ba0ee81e686b8534)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:41:44.475971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18ea54-ac9b-4ca5-8bec-6fc7d0cbdec9 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:41:44.565587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7c18ea54-ac9b-4ca5-8bec-6fc7d0cbdec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e577cf747d5b4a12ba0ee81e686b8534', 'request_id': 'req-7c18ea54-ac9b-4ca5-8bec-6fc7d0cbdec9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:41:44.611507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7c18ea54-ac9b-4ca5-8bec-6fc7d0cbdec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e577cf747d5b4a12ba0ee81e686b8534', 'request_id': 'req-7c18ea54-ac9b-4ca5-8bec-6fc7d0cbdec9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:41:44.617775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7c18ea54-ac9b-4ca5-8bec-6fc7d0cbdec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e577cf747d5b4a12ba0ee81e686b8534', 'request_id': 'req-7c18ea54-ac9b-4ca5-8bec-6fc7d0cbdec9'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:41:44.640805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7c18ea54-ac9b-4ca5-8bec-6fc7d0cbdec9 admin admin] The token cache is being invalidate because project e577cf747d5b4a12ba0ee81e686b8534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:41:44.641094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7c18ea54-ac9b-4ca5-8bec-6fc7d0cbdec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:41:44.641720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7c18ea54-ac9b-4ca5-8bec-6fc7d0cbdec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:41:44.643210 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4390/8782] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:41:44 2022] DELETE /identity/v3/projects/e577cf747d5b4a12ba0ee81e686b8534 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:41:44.647907 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f9d70-3f71-420e-add7-e2c00e836d4f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:41:44.649280 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cb9f9d70-3f71-420e-add7-e2c00e836d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:41:44.662228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f9d70-3f71-420e-add7-e2c00e836d4f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:41:44.701810 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:41:44.718102 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f9e44-24b0-4402-8b49-885f86751bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:41:44.718739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f9e44-24b0-4402-8b49-885f86751bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:44.719065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f9e44-24b0-4402-8b49-885f86751bac admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:44.719345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f9e44-24b0-4402-8b49-885f86751bac admin admin] PATH_INFO: `/v3/users/16e744690c96436293d776aa28786114` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:44.720478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f9e44-24b0-4402-8b49-885f86751bac admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e744690c96436293d776aa28786114)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:41:44.722425 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f9e44-24b0-4402-8b49-885f86751bac admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:41:44.865782 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6a9f9e44-24b0-4402-8b49-885f86751bac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e744690c96436293d776aa28786114'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:41:44.866599 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6a9f9e44-24b0-4402-8b49-885f86751bac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e744690c96436293d776aa28786114'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:41:44.873523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6a9f9e44-24b0-4402-8b49-885f86751bac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e744690c96436293d776aa28786114'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:41:44.886342 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6a9f9e44-24b0-4402-8b49-885f86751bac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e744690c96436293d776aa28786114'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:41:44.887141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6a9f9e44-24b0-4402-8b49-885f86751bac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e744690c96436293d776aa28786114'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:41:44.949420 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4393/8783] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:41:44 2022] DELETE /identity/v3/users/16e744690c96436293d776aa28786114 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:41:45.185981 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18ea54-ac9b-4ca5-8bec-6fc7d0cbdec9 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:41:45.187495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7c18ea54-ac9b-4ca5-8bec-6fc7d0cbdec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:41:45.201023 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18ea54-ac9b-4ca5-8bec-6fc7d0cbdec9 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:41:45.245426 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:41:45.261066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cc0c4-57a1-4618-a4ad-c6c57b3e0c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:41:45.261721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cc0c4-57a1-4618-a4ad-c6c57b3e0c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:45.267042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cc0c4-57a1-4618-a4ad-c6c57b3e0c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:45.267042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cc0c4-57a1-4618-a4ad-c6c57b3e0c27 admin admin] PATH_INFO: `/v3/projects/c69dfef5caf84140a8f7fcc218f7201e` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:45.267042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cc0c4-57a1-4618-a4ad-c6c57b3e0c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c69dfef5caf84140a8f7fcc218f7201e)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:41:45.267042 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cc0c4-57a1-4618-a4ad-c6c57b3e0c27 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:41:45.410819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-de2cc0c4-57a1-4618-a4ad-c6c57b3e0c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c69dfef5caf84140a8f7fcc218f7201e', 'request_id': 'req-de2cc0c4-57a1-4618-a4ad-c6c57b3e0c27'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:41:45.478777 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-de2cc0c4-57a1-4618-a4ad-c6c57b3e0c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c69dfef5caf84140a8f7fcc218f7201e', 'request_id': 'req-de2cc0c4-57a1-4618-a4ad-c6c57b3e0c27'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:41:45.485633 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-de2cc0c4-57a1-4618-a4ad-c6c57b3e0c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c69dfef5caf84140a8f7fcc218f7201e', 'request_id': 'req-de2cc0c4-57a1-4618-a4ad-c6c57b3e0c27'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:41:45.496748 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-de2cc0c4-57a1-4618-a4ad-c6c57b3e0c27 admin admin] The token cache is being invalidate because project c69dfef5caf84140a8f7fcc218f7201e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:41:45.497036 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-de2cc0c4-57a1-4618-a4ad-c6c57b3e0c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:41:45.497662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-de2cc0c4-57a1-4618-a4ad-c6c57b3e0c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:41:45.499155 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4391/8784] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:41:45 2022] DELETE /identity/v3/projects/c69dfef5caf84140a8f7fcc218f7201e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:41:45.504271 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f683128-14ac-4161-8def-570b1fcb3e74 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:45.504564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f683128-14ac-4161-8def-570b1fcb3e74 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:45.504864 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f683128-14ac-4161-8def-570b1fcb3e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:45.533480 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-5f683128-14ac-4161-8def-570b1fcb3e74 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:41:45.534701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-5f683128-14ac-4161-8def-570b1fcb3e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:41:45.592388 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4394/8785] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:41:45.600703 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec0aec-f17b-4f59-ad9e-9b7b88c4628e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:45.600994 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec0aec-f17b-4f59-ad9e-9b7b88c4628e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:45.601271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec0aec-f17b-4f59-ad9e-9b7b88c4628e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:45.621351 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-e3ec0aec-f17b-4f59-ad9e-9b7b88c4628e None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:41:45.622597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e3ec0aec-f17b-4f59-ad9e-9b7b88c4628e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:41:45.630530 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4392/8786] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:41:45.634631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f683128-14ac-4161-8def-570b1fcb3e74 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:41:45.644223 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f683128-14ac-4161-8def-570b1fcb3e74 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:41:45.649349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858a5b9-e16e-4172-9d65-e23b62edba48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:41:45.649948 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858a5b9-e16e-4172-9d65-e23b62edba48 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:45.650270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858a5b9-e16e-4172-9d65-e23b62edba48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:45.650544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858a5b9-e16e-4172-9d65-e23b62edba48 admin admin] PATH_INFO: `/v3/domains` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:45.651187 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858a5b9-e16e-4172-9d65-e23b62edba48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:41:45.651493 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858a5b9-e16e-4172-9d65-e23b62edba48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:41:45.653079 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858a5b9-e16e-4172-9d65-e23b62edba48 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:41:45.665268 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4395/8787] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:41:45.669330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec0aec-f17b-4f59-ad9e-9b7b88c4628e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:41:45.679090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec0aec-f17b-4f59-ad9e-9b7b88c4628e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:41:45.683865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3f642-d129-4f93-82a9-efffe6898598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:41:45.684463 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3f642-d129-4f93-82a9-efffe6898598 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:45.684747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3f642-d129-4f93-82a9-efffe6898598 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:45.685024 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3f642-d129-4f93-82a9-efffe6898598 admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:45.685802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3f642-d129-4f93-82a9-efffe6898598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:41:45.687816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3f642-d129-4f93-82a9-efffe6898598 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:41:45.784816 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4393/8788] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:41:45 2022] POST /identity/v3/projects => generated 391 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:41:45.790194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858a5b9-e16e-4172-9d65-e23b62edba48 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:41:45.800595 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858a5b9-e16e-4172-9d65-e23b62edba48 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:41:45.838344 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:41:45.857619 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b3800-6a3e-4435-9e7a-c9143f8f226f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:41:45.858264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b3800-6a3e-4435-9e7a-c9143f8f226f admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:45.858549 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b3800-6a3e-4435-9e7a-c9143f8f226f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:45.858828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b3800-6a3e-4435-9e7a-c9143f8f226f admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:45.859462 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b3800-6a3e-4435-9e7a-c9143f8f226f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:41:45.861394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b3800-6a3e-4435-9e7a-c9143f8f226f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:41:45.915012 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4396/8789] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:41:45 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:41:45.919151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3f642-d129-4f93-82a9-efffe6898598 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:41:45.929577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3f642-d129-4f93-82a9-efffe6898598 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:41:45.934240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e707a-4337-4ad7-9edc-30028a593bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:41:45.934841 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e707a-4337-4ad7-9edc-30028a593bdd admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:45.935125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e707a-4337-4ad7-9edc-30028a593bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:45.935399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e707a-4337-4ad7-9edc-30028a593bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:45.936094 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e707a-4337-4ad7-9edc-30028a593bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:41:45.937687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e707a-4337-4ad7-9edc-30028a593bdd admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:41:45.948158 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4394/8790] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:41:45.952135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b3800-6a3e-4435-9e7a-c9143f8f226f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:41:45.962715 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b3800-6a3e-4435-9e7a-c9143f8f226f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:41:45.967411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d11b18-91a2-41ea-9760-4b67f1b12d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:41:45.968011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d11b18-91a2-41ea-9760-4b67f1b12d32 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:45.968296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d11b18-91a2-41ea-9760-4b67f1b12d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:45.968568 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d11b18-91a2-41ea-9760-4b67f1b12d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:45.969209 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d11b18-91a2-41ea-9760-4b67f1b12d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:41:45.970849 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d11b18-91a2-41ea-9760-4b67f1b12d32 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:41:45.980770 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4397/8791] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:41:45.984821 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e707a-4337-4ad7-9edc-30028a593bdd admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:41:45.994932 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e707a-4337-4ad7-9edc-30028a593bdd admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:41:45.999452 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437536ed-2739-44a5-944b-715a873b1475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:41:46.000090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437536ed-2739-44a5-944b-715a873b1475 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:46.000377 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437536ed-2739-44a5-944b-715a873b1475 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:46.000644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437536ed-2739-44a5-944b-715a873b1475 admin admin] PATH_INFO: `/v3/projects/67648db046c54ee3b314904c8338cd61/users/91e2c2dd9af848e5941d979683201c70/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:46.016005 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437536ed-2739-44a5-944b-715a873b1475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67648db046c54ee3b314904c8338cd61, user_id=91e2c2dd9af848e5941d979683201c70, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:41:46.018684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437536ed-2739-44a5-944b-715a873b1475 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:41:46.120642 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4395/8792] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:41:45 2022] PUT /identity/v3/projects/67648db046c54ee3b314904c8338cd61/users/91e2c2dd9af848e5941d979683201c70/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:41:46.131307 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42e3a4-dd3c-4c7a-8c29-261a14ad7ccc None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:46.131597 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42e3a4-dd3c-4c7a-8c29-261a14ad7ccc None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:46.135523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42e3a4-dd3c-4c7a-8c29-261a14ad7ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:46.159587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7a42e3a4-dd3c-4c7a-8c29-261a14ad7ccc None None] MFA Rules not processed for user `91e2c2dd9af848e5941d979683201c70`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:41:46.160790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7a42e3a4-dd3c-4c7a-8c29-261a14ad7ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:41:46.224638 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4398/8793] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:41:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:41:46.229129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437536ed-2739-44a5-944b-715a873b1475 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:41:46.289435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437536ed-2739-44a5-944b-715a873b1475 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:41:46.293944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff6d8e-a22f-41fa-9299-6cb3c0bcf8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:41:46.294569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff6d8e-a22f-41fa-9299-6cb3c0bcf8af admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:46.294849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff6d8e-a22f-41fa-9299-6cb3c0bcf8af admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:46.295126 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff6d8e-a22f-41fa-9299-6cb3c0bcf8af admin admin] PATH_INFO: `/v3/projects` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:46.295750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff6d8e-a22f-41fa-9299-6cb3c0bcf8af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:41:46.297646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff6d8e-a22f-41fa-9299-6cb3c0bcf8af admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:41:46.302493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:41:46.386806 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4396/8794] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:41:46 2022] POST /identity/v3/projects => generated 391 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:41:46.389561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42e3a4-dd3c-4c7a-8c29-261a14ad7ccc None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:41:46.400347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42e3a4-dd3c-4c7a-8c29-261a14ad7ccc None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:41:46.456075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160145f-ccaf-4367-b503-8ceb99ae3998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:41:46.456705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160145f-ccaf-4367-b503-8ceb99ae3998 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:46.456987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160145f-ccaf-4367-b503-8ceb99ae3998 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:46.457270 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160145f-ccaf-4367-b503-8ceb99ae3998 admin admin] PATH_INFO: `/v3/users` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:46.457897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160145f-ccaf-4367-b503-8ceb99ae3998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:41:46.459883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160145f-ccaf-4367-b503-8ceb99ae3998 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:41:46.538759 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4399/8795] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:41:46 2022] POST /identity/v3/users => generated 302 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:41:46.552907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff6d8e-a22f-41fa-9299-6cb3c0bcf8af admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:41:46.563517 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff6d8e-a22f-41fa-9299-6cb3c0bcf8af admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:41:46.568820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75187247-781d-4fe7-a1f2-34e69fa3582a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:41:46.569423 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75187247-781d-4fe7-a1f2-34e69fa3582a admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:46.569705 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75187247-781d-4fe7-a1f2-34e69fa3582a admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:46.569980 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75187247-781d-4fe7-a1f2-34e69fa3582a admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:46.570667 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75187247-781d-4fe7-a1f2-34e69fa3582a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:41:46.572266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75187247-781d-4fe7-a1f2-34e69fa3582a admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:41:46.582027 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4397/8796] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:41:46.586014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160145f-ccaf-4367-b503-8ceb99ae3998 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:41:46.595902 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160145f-ccaf-4367-b503-8ceb99ae3998 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:41:46.600582 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e3767-4212-4d15-8046-1a389a68ad23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:41:46.601242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e3767-4212-4d15-8046-1a389a68ad23 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:46.601553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e3767-4212-4d15-8046-1a389a68ad23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:46.601827 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e3767-4212-4d15-8046-1a389a68ad23 admin admin] PATH_INFO: `/v3/projects/59c510f6488b4665b2a6cf42194a3d03/users/bc8353b25b7d40c48e8ab8f16704f187/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:46.617467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e3767-4212-4d15-8046-1a389a68ad23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c510f6488b4665b2a6cf42194a3d03, user_id=bc8353b25b7d40c48e8ab8f16704f187, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:41:46.620143 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e3767-4212-4d15-8046-1a389a68ad23 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:41:46.668731 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4400/8797] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:41:46 2022] PUT /identity/v3/projects/59c510f6488b4665b2a6cf42194a3d03/users/bc8353b25b7d40c48e8ab8f16704f187/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:41:46.678872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75187247-781d-4fe7-a1f2-34e69fa3582a admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:41:46.688976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75187247-781d-4fe7-a1f2-34e69fa3582a admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:41:46.752329 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e49c09-2e08-4327-a860-31f0dc25df98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:41:46.752957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e49c09-2e08-4327-a860-31f0dc25df98 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:46.753242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e49c09-2e08-4327-a860-31f0dc25df98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:46.753735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e49c09-2e08-4327-a860-31f0dc25df98 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:46.754650 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e49c09-2e08-4327-a860-31f0dc25df98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:41:46.757101 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e49c09-2e08-4327-a860-31f0dc25df98 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:41:46.771697 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4398/8798] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:41:46.776290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e3767-4212-4d15-8046-1a389a68ad23 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:41:46.788918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e3767-4212-4d15-8046-1a389a68ad23 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:41:46.796293 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f852545-5552-40ec-8665-aab4533fb9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:41:46.797276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f852545-5552-40ec-8665-aab4533fb9d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:46.797579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f852545-5552-40ec-8665-aab4533fb9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:46.797866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f852545-5552-40ec-8665-aab4533fb9d0 admin admin] PATH_INFO: `/v3/projects/59c510f6488b4665b2a6cf42194a3d03/users/bc8353b25b7d40c48e8ab8f16704f187/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:46.800188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f852545-5552-40ec-8665-aab4533fb9d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c510f6488b4665b2a6cf42194a3d03, user_id=bc8353b25b7d40c48e8ab8f16704f187, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:41:46.804918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f852545-5552-40ec-8665-aab4533fb9d0 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:41:46.812605 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:41:46.817384 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4401/8799] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:41:46 2022] PUT /identity/v3/projects/59c510f6488b4665b2a6cf42194a3d03/users/bc8353b25b7d40c48e8ab8f16704f187/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:41:46.830113 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20b8ee-9832-4e7f-ba36-af795d55a71b None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:46.842130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20b8ee-9832-4e7f-ba36-af795d55a71b None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:46.842130 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20b8ee-9832-4e7f-ba36-af795d55a71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:46.860349 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-4e20b8ee-9832-4e7f-ba36-af795d55a71b None None] MFA Rules not processed for user `bc8353b25b7d40c48e8ab8f16704f187`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:41:46.861567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4e20b8ee-9832-4e7f-ba36-af795d55a71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:41:46.931565 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4399/8800] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:41:46 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:41:46.948091 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f852545-5552-40ec-8665-aab4533fb9d0 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:41:46.949926 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0f852545-5552-40ec-8665-aab4533fb9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:41:47.039698 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f852545-5552-40ec-8665-aab4533fb9d0 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:41:47.045331 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2d43f-8689-43a5-a741-8022c4f930c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:41:47.045937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2d43f-8689-43a5-a741-8022c4f930c0 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:47.046252 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2d43f-8689-43a5-a741-8022c4f930c0 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:47.046528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2d43f-8689-43a5-a741-8022c4f930c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:47.102559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2d43f-8689-43a5-a741-8022c4f930c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:41:47.104139 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2d43f-8689-43a5-a741-8022c4f930c0 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:41:47.114935 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4402/8801] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:41:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:41:51.932211 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20b8ee-9832-4e7f-ba36-af795d55a71b None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:41:51.933840 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4e20b8ee-9832-4e7f-ba36-af795d55a71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:41:51.995986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:41:52.015866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20b8ee-9832-4e7f-ba36-af795d55a71b None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:41:52.019721 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dede6e5-4683-40bc-a47c-6843b1c6386f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:41:52.020393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dede6e5-4683-40bc-a47c-6843b1c6386f service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:52.020720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dede6e5-4683-40bc-a47c-6843b1c6386f service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:52.020992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dede6e5-4683-40bc-a47c-6843b1c6386f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:52.030659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dede6e5-4683-40bc-a47c-6843b1c6386f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:41:52.032108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dede6e5-4683-40bc-a47c-6843b1c6386f service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:41:52.042725 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4400/8802] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:41:51 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:41:55.548908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972fac0-aab2-45d5-a010-f9a1f48cfd6e None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:55.549834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972fac0-aab2-45d5-a010-f9a1f48cfd6e None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:55.550366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972fac0-aab2-45d5-a010-f9a1f48cfd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:55.571388 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7972fac0-aab2-45d5-a010-f9a1f48cfd6e None None] MFA Rules not processed for user `91e2c2dd9af848e5941d979683201c70`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:41:55.572705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7972fac0-aab2-45d5-a010-f9a1f48cfd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:41:55.584749 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4403/8803] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:41:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:41:56.426993 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dede6e5-4683-40bc-a47c-6843b1c6386f service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:41:56.429013 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8dede6e5-4683-40bc-a47c-6843b1c6386f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:41:56.519970 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dede6e5-4683-40bc-a47c-6843b1c6386f service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:41:56.526010 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dffbbe-39c3-4bc5-88f4-447eaa0fb094 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:41:56.527934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dffbbe-39c3-4bc5-88f4-447eaa0fb094 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:56.528129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dffbbe-39c3-4bc5-88f4-447eaa0fb094 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:56.528410 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dffbbe-39c3-4bc5-88f4-447eaa0fb094 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:56.530417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-f2dffbbe-39c3-4bc5-88f4-447eaa0fb094 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:41:56.544942 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dffbbe-39c3-4bc5-88f4-447eaa0fb094 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:41:56.546717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dffbbe-39c3-4bc5-88f4-447eaa0fb094 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:41:56.557951 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4401/8804] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:41:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:41:59.939495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972fac0-aab2-45d5-a010-f9a1f48cfd6e None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:41:59.949382 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972fac0-aab2-45d5-a010-f9a1f48cfd6e None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:41:59.953075 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dce99-b990-4a2c-a747-54d2559b93ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:41:59.953682 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dce99-b990-4a2c-a747-54d2559b93ba service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:41:59.953967 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dce99-b990-4a2c-a747-54d2559b93ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:41:59.954290 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dce99-b990-4a2c-a747-54d2559b93ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:41:59.956078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9d9dce99-b990-4a2c-a747-54d2559b93ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:41:59.966144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9dce99-b990-4a2c-a747-54d2559b93ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:41:59.967564 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9dce99-b990-4a2c-a747-54d2559b93ba service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:41:59.975455 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4404/8805] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:41:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:42:06.554000 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=42 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:42:09.971888 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=70 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:43:04.298887 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dffbbe-39c3-4bc5-88f4-447eaa0fb094 service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:43:04.309853 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dffbbe-39c3-4bc5-88f4-447eaa0fb094 service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:43:04.315663 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc2f01-dcb1-4cd0-8347-5b92c84a9026 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:43:04.316298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc2f01-dcb1-4cd0-8347-5b92c84a9026 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:43:04.316586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc2f01-dcb1-4cd0-8347-5b92c84a9026 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:43:04.316867 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc2f01-dcb1-4cd0-8347-5b92c84a9026 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:43:04.318682 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-06bc2f01-dcb1-4cd0-8347-5b92c84a9026 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:43:04.335225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc2f01-dcb1-4cd0-8347-5b92c84a9026 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:43:04.335225 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc2f01-dcb1-4cd0-8347-5b92c84a9026 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:43:04.343781 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4402/8806] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:43:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:43:07.082219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f2022-f736-4f47-9b0d-02b64899c5f8 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:43:07.084228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f2022-f736-4f47-9b0d-02b64899c5f8 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:43:07.084228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f2022-f736-4f47-9b0d-02b64899c5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:43:07.110215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-fc1f2022-f736-4f47-9b0d-02b64899c5f8 None None] MFA Rules not processed for user `91e2c2dd9af848e5941d979683201c70`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:43:07.111448 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-fc1f2022-f736-4f47-9b0d-02b64899c5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:43:07.119377 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4405/8807] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:43:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:43:07.625740 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc2f01-dcb1-4cd0-8347-5b92c84a9026 service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:43:07.636587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc2f01-dcb1-4cd0-8347-5b92c84a9026 service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:43:07.642073 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c670b-74a0-4817-892c-54e014782a3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:43:07.642690 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c670b-74a0-4817-892c-54e014782a3f service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:43:07.642976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c670b-74a0-4817-892c-54e014782a3f service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:43:07.643251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c670b-74a0-4817-892c-54e014782a3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:43:07.644989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-708c670b-74a0-4817-892c-54e014782a3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:43:07.658816 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c670b-74a0-4817-892c-54e014782a3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:43:07.660507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c670b-74a0-4817-892c-54e014782a3f service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:43:07.671609 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4403/8808] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:43:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:43:17.103608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:43:17.666599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=12 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:44:42.753796 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f2022-f736-4f47-9b0d-02b64899c5f8 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:44:42.778613 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f2022-f736-4f47-9b0d-02b64899c5f8 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:44:42.785865 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d465855-a83e-437c-a7d0-701f73d70597 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:44:42.786650 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d465855-a83e-437c-a7d0-701f73d70597 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:44:42.787146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d465855-a83e-437c-a7d0-701f73d70597 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:44:42.787528 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d465855-a83e-437c-a7d0-701f73d70597 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:44:42.789603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9d465855-a83e-437c-a7d0-701f73d70597 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:44:42.804688 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d465855-a83e-437c-a7d0-701f73d70597 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:44:42.806468 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d465855-a83e-437c-a7d0-701f73d70597 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:44:42.821106 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4406/8809] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:44:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:44:52.813617 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=10 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:44:59.122168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229966c-263f-44aa-a376-192ecacd43a8 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:44:59.122806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229966c-263f-44aa-a376-192ecacd43a8 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:44:59.122806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229966c-263f-44aa-a376-192ecacd43a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:44:59.150233 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c229966c-263f-44aa-a376-192ecacd43a8 None None] MFA Rules not processed for user `91e2c2dd9af848e5941d979683201c70`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:44:59.151490 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c229966c-263f-44aa-a376-192ecacd43a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:44:59.162500 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4404/8810] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:44:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:44:59.574591 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d465855-a83e-437c-a7d0-701f73d70597 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:44:59.576506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-9d465855-a83e-437c-a7d0-701f73d70597 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:44:59.587976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d465855-a83e-437c-a7d0-701f73d70597 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:44:59.592113 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bed87e-710c-4bd6-a2df-4ee3fe34e736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:44:59.592724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bed87e-710c-4bd6-a2df-4ee3fe34e736 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:44:59.593249 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bed87e-710c-4bd6-a2df-4ee3fe34e736 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:44:59.593366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bed87e-710c-4bd6-a2df-4ee3fe34e736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:44:59.595064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b9bed87e-710c-4bd6-a2df-4ee3fe34e736 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:44:59.604640 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bed87e-710c-4bd6-a2df-4ee3fe34e736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:44:59.606088 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bed87e-710c-4bd6-a2df-4ee3fe34e736 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:44:59.618435 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4407/8811] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:44:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:45:02.871326 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229966c-263f-44aa-a376-192ecacd43a8 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:45:02.882283 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229966c-263f-44aa-a376-192ecacd43a8 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:45:02.886144 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28fbda-af26-4027-bccf-5a98c543b45a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:45:02.886759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28fbda-af26-4027-bccf-5a98c543b45a service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:45:02.887043 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28fbda-af26-4027-bccf-5a98c543b45a service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:45:02.887421 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28fbda-af26-4027-bccf-5a98c543b45a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:45:02.889249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2d28fbda-af26-4027-bccf-5a98c543b45a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:45:02.900125 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28fbda-af26-4027-bccf-5a98c543b45a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:45:02.901709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28fbda-af26-4027-bccf-5a98c543b45a service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:45:02.910780 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4405/8812] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:45:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:45:03.786166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bed87e-710c-4bd6-a2df-4ee3fe34e736 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:45:03.800126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bed87e-710c-4bd6-a2df-4ee3fe34e736 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:45:03.805701 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880476f-f4eb-4dfa-bb33-e6cb77766f52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:45:03.806337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880476f-f4eb-4dfa-bb33-e6cb77766f52 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:45:03.806622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880476f-f4eb-4dfa-bb33-e6cb77766f52 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:45:03.806897 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880476f-f4eb-4dfa-bb33-e6cb77766f52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:45:03.808738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1880476f-f4eb-4dfa-bb33-e6cb77766f52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:45:03.821509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880476f-f4eb-4dfa-bb33-e6cb77766f52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:45:03.823146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880476f-f4eb-4dfa-bb33-e6cb77766f52 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:45:03.837321 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4408/8813] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:45:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:45:09.281784 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28fbda-af26-4027-bccf-5a98c543b45a service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:45:09.283391 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2d28fbda-af26-4027-bccf-5a98c543b45a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:45:09.300602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28fbda-af26-4027-bccf-5a98c543b45a service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:45:09.306247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61652677-0dbf-4739-9b5d-b5862f290020 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:45:09.306857 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61652677-0dbf-4739-9b5d-b5862f290020 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:45:09.307143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61652677-0dbf-4739-9b5d-b5862f290020 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:45:09.307419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61652677-0dbf-4739-9b5d-b5862f290020 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:45:09.309118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-61652677-0dbf-4739-9b5d-b5862f290020 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:45:09.321767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61652677-0dbf-4739-9b5d-b5862f290020 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:45:09.323393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61652677-0dbf-4739-9b5d-b5862f290020 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:45:09.333955 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4406/8814] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:45:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:45:13.831544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=12 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:45:19.329543 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=15 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:45:43.043878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d4c8f-e216-4494-95a1-1a02863a7b5b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:45:43.044439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d4c8f-e216-4494-95a1-1a02863a7b5b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:45:43.044439 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d4c8f-e216-4494-95a1-1a02863a7b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:45:43.091264 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f05d4c8f-e216-4494-95a1-1a02863a7b5b None None] MFA Rules not processed for user `9b359391fbc34c259d987e42e8826c86`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:45:43.093081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f05d4c8f-e216-4494-95a1-1a02863a7b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:45:43.099702 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4409/8815] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 04:45:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:45:43.112528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61652677-0dbf-4739-9b5d-b5862f290020 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:45:43.122259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61652677-0dbf-4739-9b5d-b5862f290020 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:45:43.126438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28acbe7-5f0b-4794-a47c-83798387fb46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:45:43.127040 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28acbe7-5f0b-4794-a47c-83798387fb46 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:45:43.127323 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28acbe7-5f0b-4794-a47c-83798387fb46 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:45:43.127597 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28acbe7-5f0b-4794-a47c-83798387fb46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:45:43.134774 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28acbe7-5f0b-4794-a47c-83798387fb46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:45:43.139399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28acbe7-5f0b-4794-a47c-83798387fb46 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:45:43.144784 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4407/8816] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:45:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:45:43.287243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef640d2-be61-4cac-9b75-8bbace18f924 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:45:43.287527 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef640d2-be61-4cac-9b75-8bbace18f924 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:45:43.287803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef640d2-be61-4cac-9b75-8bbace18f924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:45:43.325840 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-0ef640d2-be61-4cac-9b75-8bbace18f924 None None] MFA Rules not processed for user `1a395d2414cd4da085a77ddc9b1f1caa`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:45:43.327764 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-0ef640d2-be61-4cac-9b75-8bbace18f924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:45:43.336382 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4410/8817] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 04:45:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:45:43.348588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28acbe7-5f0b-4794-a47c-83798387fb46 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:45:43.349997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a28acbe7-5f0b-4794-a47c-83798387fb46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:45:43.365190 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28acbe7-5f0b-4794-a47c-83798387fb46 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:45:43.370256 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440126c-a3ce-4e1f-a258-cb3e8b65ce59 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:45:43.370849 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440126c-a3ce-4e1f-a258-cb3e8b65ce59 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:45:43.371129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440126c-a3ce-4e1f-a258-cb3e8b65ce59 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:45:43.371400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440126c-a3ce-4e1f-a258-cb3e8b65ce59 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:45:43.380213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440126c-a3ce-4e1f-a258-cb3e8b65ce59 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:45:43.381736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440126c-a3ce-4e1f-a258-cb3e8b65ce59 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:45:43.392069 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4408/8818] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:45:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:45:43.679320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c2771-ccbe-4a10-b15b-40649892e1f5 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:45:43.679608 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c2771-ccbe-4a10-b15b-40649892e1f5 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:45:43.679938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c2771-ccbe-4a10-b15b-40649892e1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:45:43.718848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f92c2771-ccbe-4a10-b15b-40649892e1f5 None None] MFA Rules not processed for user `c20881251f2241a3a5ec2e5cf99db149`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:45:43.720061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f92c2771-ccbe-4a10-b15b-40649892e1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:45:43.729267 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4411/8819] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 04:45:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:45:43.740562 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440126c-a3ce-4e1f-a258-cb3e8b65ce59 service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:45:43.750066 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440126c-a3ce-4e1f-a258-cb3e8b65ce59 service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:45:43.753744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f63e72-73ca-41e8-bf76-9cf4561169f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:45:43.754375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f63e72-73ca-41e8-bf76-9cf4561169f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:45:43.754662 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f63e72-73ca-41e8-bf76-9cf4561169f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:45:43.754938 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f63e72-73ca-41e8-bf76-9cf4561169f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:45:43.765446 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f63e72-73ca-41e8-bf76-9cf4561169f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:45:43.770522 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f63e72-73ca-41e8-bf76-9cf4561169f8 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:45:43.777603 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4409/8820] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:45:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:45:43.841018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c2771-ccbe-4a10-b15b-40649892e1f5 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:45:43.852817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c2771-ccbe-4a10-b15b-40649892e1f5 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:45:43.858253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb82458-3766-4a21-80b6-b503fdf586b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:45:43.858854 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb82458-3766-4a21-80b6-b503fdf586b3 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:45:43.859130 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb82458-3766-4a21-80b6-b503fdf586b3 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:45:43.859399 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb82458-3766-4a21-80b6-b503fdf586b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:45:43.861063 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cbb82458-3766-4a21-80b6-b503fdf586b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:45:43.872158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb82458-3766-4a21-80b6-b503fdf586b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:45:43.874296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb82458-3766-4a21-80b6-b503fdf586b3 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:45:43.883899 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4412/8821] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:45:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:45:46.454226 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f63e72-73ca-41e8-bf76-9cf4561169f8 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:45:46.462803 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f63e72-73ca-41e8-bf76-9cf4561169f8 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:45:46.466515 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03680615-7542-48bc-b45d-d4ee53ac55a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:45:46.467107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03680615-7542-48bc-b45d-d4ee53ac55a0 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:45:46.467388 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03680615-7542-48bc-b45d-d4ee53ac55a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:45:46.467659 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03680615-7542-48bc-b45d-d4ee53ac55a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:45:46.469342 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-03680615-7542-48bc-b45d-d4ee53ac55a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:45:46.482670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03680615-7542-48bc-b45d-d4ee53ac55a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:45:46.484090 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03680615-7542-48bc-b45d-d4ee53ac55a0 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:45:46.494737 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4410/8822] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:45:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:45:47.675024 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb82458-3766-4a21-80b6-b503fdf586b3 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:45:47.684639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb82458-3766-4a21-80b6-b503fdf586b3 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:45:47.688806 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0870a1-af3a-40a4-86ed-03eb925df4a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:45:47.689432 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0870a1-af3a-40a4-86ed-03eb925df4a2 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:45:47.689736 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0870a1-af3a-40a4-86ed-03eb925df4a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:45:47.689993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0870a1-af3a-40a4-86ed-03eb925df4a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:45:47.691734 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cf0870a1-af3a-40a4-86ed-03eb925df4a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:45:47.705242 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0870a1-af3a-40a4-86ed-03eb925df4a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:45:47.706703 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0870a1-af3a-40a4-86ed-03eb925df4a2 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:45:47.717450 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4413/8823] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:45:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:45:56.490008 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=24 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:45:57.712662 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=43 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:46:42.125975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03680615-7542-48bc-b45d-d4ee53ac55a0 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:46:42.137805 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03680615-7542-48bc-b45d-d4ee53ac55a0 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:46:42.142960 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2fed0-bebb-4fd2-8327-3256b84a36fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:46:42.143567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2fed0-bebb-4fd2-8327-3256b84a36fe service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:46:42.144067 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2fed0-bebb-4fd2-8327-3256b84a36fe service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:46:42.144399 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2fed0-bebb-4fd2-8327-3256b84a36fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:46:42.146178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a2e2fed0-bebb-4fd2-8327-3256b84a36fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:46:42.162708 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2fed0-bebb-4fd2-8327-3256b84a36fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:46:42.164347 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2fed0-bebb-4fd2-8327-3256b84a36fe service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:46:42.175935 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4411/8824] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:46:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:46:47.369763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0870a1-af3a-40a4-86ed-03eb925df4a2 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:46:47.379218 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0870a1-af3a-40a4-86ed-03eb925df4a2 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:46:47.382866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9755c17-de86-423b-b793-c60e48cfcd4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:46:47.383466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9755c17-de86-423b-b793-c60e48cfcd4b service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:46:47.383747 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9755c17-de86-423b-b793-c60e48cfcd4b service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:46:47.384020 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9755c17-de86-423b-b793-c60e48cfcd4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:46:47.392587 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9755c17-de86-423b-b793-c60e48cfcd4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:46:47.393983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9755c17-de86-423b-b793-c60e48cfcd4b service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:46:47.402956 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4414/8825] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:46:47 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:46:50.784863 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53b80b-d6bd-49d6-90b0-19d27860c718 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:46:50.785428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53b80b-d6bd-49d6-90b0-19d27860c718 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:46:50.785428 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53b80b-d6bd-49d6-90b0-19d27860c718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:46:50.804781 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-fa53b80b-d6bd-49d6-90b0-19d27860c718 None None] MFA Rules not processed for user `91e2c2dd9af848e5941d979683201c70`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:46:50.806021 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fa53b80b-d6bd-49d6-90b0-19d27860c718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:46:50.814778 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4412/8826] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:46:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:46:51.177702 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9755c17-de86-423b-b793-c60e48cfcd4b service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:46:51.189814 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9755c17-de86-423b-b793-c60e48cfcd4b service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:46:51.194266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8db7f-421f-4b18-bdea-5256c72c5d15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:46:51.194904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8db7f-421f-4b18-bdea-5256c72c5d15 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:46:51.195190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8db7f-421f-4b18-bdea-5256c72c5d15 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:46:51.195470 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8db7f-421f-4b18-bdea-5256c72c5d15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:46:51.197277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c6f8db7f-421f-4b18-bdea-5256c72c5d15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:46:51.207720 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8db7f-421f-4b18-bdea-5256c72c5d15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:46:51.209176 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8db7f-421f-4b18-bdea-5256c72c5d15 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:46:51.218730 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4415/8827] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:46:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:47:00.799367 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=9 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:47:01.214081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=12 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:47:02.218405 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53b80b-d6bd-49d6-90b0-19d27860c718 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:47:02.232775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53b80b-d6bd-49d6-90b0-19d27860c718 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:47:02.237751 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf231f-38fe-48e7-bd55-d54aa61ab935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:47:02.238445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf231f-38fe-48e7-bd55-d54aa61ab935 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:47:02.238727 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf231f-38fe-48e7-bd55-d54aa61ab935 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:47:02.238999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf231f-38fe-48e7-bd55-d54aa61ab935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:47:02.247419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf231f-38fe-48e7-bd55-d54aa61ab935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:47:02.248870 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf231f-38fe-48e7-bd55-d54aa61ab935 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:47:02.258203 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4413/8828] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:47:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:47:04.845665 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8db7f-421f-4b18-bdea-5256c72c5d15 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:47:04.854363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8db7f-421f-4b18-bdea-5256c72c5d15 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:47:04.858065 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3102e-afef-40ff-bddc-1a6c3806be02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:47:04.858932 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3102e-afef-40ff-bddc-1a6c3806be02 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:47:04.859318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3102e-afef-40ff-bddc-1a6c3806be02 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:47:04.859603 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3102e-afef-40ff-bddc-1a6c3806be02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:47:04.868508 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3102e-afef-40ff-bddc-1a6c3806be02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:47:04.869922 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3102e-afef-40ff-bddc-1a6c3806be02 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:47:04.880333 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4416/8829] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:47:04 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:47:12.254168 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:47:14.875929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:48:07.275006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf231f-38fe-48e7-bd55-d54aa61ab935 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:48:07.339844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf231f-38fe-48e7-bd55-d54aa61ab935 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:48:07.345939 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140eb163-f9c7-4236-8c3f-aba41fe55aa6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:48:07.346575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eb163-f9c7-4236-8c3f-aba41fe55aa6 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:48:07.346858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eb163-f9c7-4236-8c3f-aba41fe55aa6 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:48:07.347136 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eb163-f9c7-4236-8c3f-aba41fe55aa6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:48:07.356502 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140eb163-f9c7-4236-8c3f-aba41fe55aa6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:48:07.358139 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140eb163-f9c7-4236-8c3f-aba41fe55aa6 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:48:07.369539 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4414/8830] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:48:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:48:17.364701 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=27 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:48:17.640579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3102e-afef-40ff-bddc-1a6c3806be02 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:48:17.681127 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3102e-afef-40ff-bddc-1a6c3806be02 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:48:17.686300 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d471c6d-4ad4-48bb-b94d-922e11bdffb0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:48:17.686904 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d471c6d-4ad4-48bb-b94d-922e11bdffb0 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:48:17.687190 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d471c6d-4ad4-48bb-b94d-922e11bdffb0 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:48:17.687472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d471c6d-4ad4-48bb-b94d-922e11bdffb0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:48:17.696203 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d471c6d-4ad4-48bb-b94d-922e11bdffb0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:48:17.697771 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d471c6d-4ad4-48bb-b94d-922e11bdffb0 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:48:17.707942 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4417/8831] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:48:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:48:27.703316 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=20 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:48:33.202413 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140eb163-f9c7-4236-8c3f-aba41fe55aa6 service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:48:33.210449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140eb163-f9c7-4236-8c3f-aba41fe55aa6 service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:48:33.215646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c05a3-9612-4184-ad32-c3a96b9927da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:48:33.216248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c05a3-9612-4184-ad32-c3a96b9927da service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:48:33.216526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c05a3-9612-4184-ad32-c3a96b9927da service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:48:33.216794 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c05a3-9612-4184-ad32-c3a96b9927da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:48:33.218525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-753c05a3-9612-4184-ad32-c3a96b9927da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:48:33.240047 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c05a3-9612-4184-ad32-c3a96b9927da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:48:33.241930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c05a3-9612-4184-ad32-c3a96b9927da service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:48:33.252442 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4415/8832] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:48:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:48:41.922384 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3baac-6e02-4cfd-a8d5-fe3516801ffb None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:48:41.922916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3baac-6e02-4cfd-a8d5-fe3516801ffb None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:48:41.923032 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3baac-6e02-4cfd-a8d5-fe3516801ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:48:41.944523 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-beb3baac-6e02-4cfd-a8d5-fe3516801ffb None None] MFA Rules not processed for user `91e2c2dd9af848e5941d979683201c70`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:48:41.945773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-beb3baac-6e02-4cfd-a8d5-fe3516801ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:48:41.953150 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4418/8833] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:48:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:48:43.247709 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=10 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:48:51.939681 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:49:44.500135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c05a3-9612-4184-ad32-c3a96b9927da service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:49:44.569567 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c05a3-9612-4184-ad32-c3a96b9927da service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:49:44.574182 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd7ac7-ba29-47bc-8e62-5c3dd97d5222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:49:44.574820 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd7ac7-ba29-47bc-8e62-5c3dd97d5222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:44.575104 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd7ac7-ba29-47bc-8e62-5c3dd97d5222 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:44.575380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd7ac7-ba29-47bc-8e62-5c3dd97d5222 admin admin] PATH_INFO: `/v3/users/91e2c2dd9af848e5941d979683201c70` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:44.576495 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd7ac7-ba29-47bc-8e62-5c3dd97d5222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e2c2dd9af848e5941d979683201c70)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:49:44.578460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd7ac7-ba29-47bc-8e62-5c3dd97d5222 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:49:44.768552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-89fd7ac7-ba29-47bc-8e62-5c3dd97d5222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e2c2dd9af848e5941d979683201c70'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:49:44.769186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-89fd7ac7-ba29-47bc-8e62-5c3dd97d5222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e2c2dd9af848e5941d979683201c70'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:49:44.776166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-89fd7ac7-ba29-47bc-8e62-5c3dd97d5222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e2c2dd9af848e5941d979683201c70'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:49:44.788029 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-89fd7ac7-ba29-47bc-8e62-5c3dd97d5222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e2c2dd9af848e5941d979683201c70'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:49:44.881445 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-89fd7ac7-ba29-47bc-8e62-5c3dd97d5222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e2c2dd9af848e5941d979683201c70'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:49:44.887565 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4416/8834] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:49:44 2022] DELETE /identity/v3/users/91e2c2dd9af848e5941d979683201c70 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:49:44.892147 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b260575-62de-413a-a84b-a36f010bd304 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:44.896760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b260575-62de-413a-a84b-a36f010bd304 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:44.896760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b260575-62de-413a-a84b-a36f010bd304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:44.920533 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-7b260575-62de-413a-a84b-a36f010bd304 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:49:44.921772 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7b260575-62de-413a-a84b-a36f010bd304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:49:44.981029 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4419/8835] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:49:44.991246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd7ac7-ba29-47bc-8e62-5c3dd97d5222 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:49:44.992676 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-89fd7ac7-ba29-47bc-8e62-5c3dd97d5222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:49:45.049430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd7ac7-ba29-47bc-8e62-5c3dd97d5222 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:49:45.052955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d524aff-ee1f-4790-871a-ad6185ad9463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:49:45.053554 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d524aff-ee1f-4790-871a-ad6185ad9463 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:45.053833 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d524aff-ee1f-4790-871a-ad6185ad9463 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:45.054151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d524aff-ee1f-4790-871a-ad6185ad9463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:45.062971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d524aff-ee1f-4790-871a-ad6185ad9463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:49:45.064407 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d524aff-ee1f-4790-871a-ad6185ad9463 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:49:45.073680 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4417/8836] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:49:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:49:45.329245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b260575-62de-413a-a84b-a36f010bd304 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:49:45.331466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-7b260575-62de-413a-a84b-a36f010bd304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:49:45.343956 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b260575-62de-413a-a84b-a36f010bd304 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:49:45.348824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e151f-65ab-4d42-ba47-aeafaa31ff83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:49:45.349260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e151f-65ab-4d42-ba47-aeafaa31ff83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:45.349551 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e151f-65ab-4d42-ba47-aeafaa31ff83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:45.349828 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e151f-65ab-4d42-ba47-aeafaa31ff83 admin admin] PATH_INFO: `/v3/projects/67648db046c54ee3b314904c8338cd61` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:45.351126 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e151f-65ab-4d42-ba47-aeafaa31ff83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67648db046c54ee3b314904c8338cd61)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:49:45.353049 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e151f-65ab-4d42-ba47-aeafaa31ff83 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:49:45.452866 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-457e151f-65ab-4d42-ba47-aeafaa31ff83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67648db046c54ee3b314904c8338cd61', 'request_id': 'req-457e151f-65ab-4d42-ba47-aeafaa31ff83'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:49:45.459683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-457e151f-65ab-4d42-ba47-aeafaa31ff83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67648db046c54ee3b314904c8338cd61', 'request_id': 'req-457e151f-65ab-4d42-ba47-aeafaa31ff83'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:49:45.465204 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-457e151f-65ab-4d42-ba47-aeafaa31ff83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67648db046c54ee3b314904c8338cd61', 'request_id': 'req-457e151f-65ab-4d42-ba47-aeafaa31ff83'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:49:45.543917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-457e151f-65ab-4d42-ba47-aeafaa31ff83 admin admin] The token cache is being invalidate because project 67648db046c54ee3b314904c8338cd61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:49:45.544216 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-457e151f-65ab-4d42-ba47-aeafaa31ff83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:49:45.544842 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-457e151f-65ab-4d42-ba47-aeafaa31ff83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:49:45.546393 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4420/8837] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:49:45 2022] DELETE /identity/v3/projects/67648db046c54ee3b314904c8338cd61 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:49:45.550971 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d524aff-ee1f-4790-871a-ad6185ad9463 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:49:45.561017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d524aff-ee1f-4790-871a-ad6185ad9463 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:49:45.579710 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:49:45.619313 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64918dc4-7c16-42c0-b727-ecdc887e170e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:49:45.619979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64918dc4-7c16-42c0-b727-ecdc887e170e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:45.620270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64918dc4-7c16-42c0-b727-ecdc887e170e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:45.620544 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64918dc4-7c16-42c0-b727-ecdc887e170e admin admin] PATH_INFO: `/v3/users/bc8353b25b7d40c48e8ab8f16704f187` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:45.621694 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64918dc4-7c16-42c0-b727-ecdc887e170e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc8353b25b7d40c48e8ab8f16704f187)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:49:45.623668 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64918dc4-7c16-42c0-b727-ecdc887e170e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:49:45.773527 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-64918dc4-7c16-42c0-b727-ecdc887e170e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc8353b25b7d40c48e8ab8f16704f187'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:49:45.774223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-64918dc4-7c16-42c0-b727-ecdc887e170e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc8353b25b7d40c48e8ab8f16704f187'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:49:45.781248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-64918dc4-7c16-42c0-b727-ecdc887e170e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc8353b25b7d40c48e8ab8f16704f187'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:49:45.793080 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-64918dc4-7c16-42c0-b727-ecdc887e170e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc8353b25b7d40c48e8ab8f16704f187'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:49:45.908919 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-64918dc4-7c16-42c0-b727-ecdc887e170e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc8353b25b7d40c48e8ab8f16704f187'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:49:45.914978 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4418/8838] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 04:49:45 2022] DELETE /identity/v3/users/bc8353b25b7d40c48e8ab8f16704f187 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:49:46.283365 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e151f-65ab-4d42-ba47-aeafaa31ff83 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:49:46.284841 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-457e151f-65ab-4d42-ba47-aeafaa31ff83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:49:46.298254 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e151f-65ab-4d42-ba47-aeafaa31ff83 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:49:46.356983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfdc82-a85f-473f-82a8-0445eccd864a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:49:46.357622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfdc82-a85f-473f-82a8-0445eccd864a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:46.357908 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfdc82-a85f-473f-82a8-0445eccd864a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:46.358217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfdc82-a85f-473f-82a8-0445eccd864a admin admin] PATH_INFO: `/v3/projects/59c510f6488b4665b2a6cf42194a3d03` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:46.359341 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfdc82-a85f-473f-82a8-0445eccd864a admin admin] RBAC: Authorizing `identity:delete_project(project_id=59c510f6488b4665b2a6cf42194a3d03)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:49:46.361570 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfdc82-a85f-473f-82a8-0445eccd864a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:49:46.381929 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:49:46.480957 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cddfdc82-a85f-473f-82a8-0445eccd864a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59c510f6488b4665b2a6cf42194a3d03', 'request_id': 'req-cddfdc82-a85f-473f-82a8-0445eccd864a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:49:46.487337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cddfdc82-a85f-473f-82a8-0445eccd864a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59c510f6488b4665b2a6cf42194a3d03', 'request_id': 'req-cddfdc82-a85f-473f-82a8-0445eccd864a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:49:46.492882 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cddfdc82-a85f-473f-82a8-0445eccd864a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59c510f6488b4665b2a6cf42194a3d03', 'request_id': 'req-cddfdc82-a85f-473f-82a8-0445eccd864a'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:49:46.576340 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cddfdc82-a85f-473f-82a8-0445eccd864a admin admin] The token cache is being invalidate because project 59c510f6488b4665b2a6cf42194a3d03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 04:49:46.576637 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cddfdc82-a85f-473f-82a8-0445eccd864a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:49:46.577277 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-cddfdc82-a85f-473f-82a8-0445eccd864a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 04:49:46.578829 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4421/8839] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 04:49:46 2022] DELETE /identity/v3/projects/59c510f6488b4665b2a6cf42194a3d03 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:49:46.584631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5bfb2-a968-4fae-ac75-cc11b442e069 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:46.585150 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5bfb2-a968-4fae-ac75-cc11b442e069 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:46.585258 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5bfb2-a968-4fae-ac75-cc11b442e069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:46.625617 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-c2b5bfb2-a968-4fae-ac75-cc11b442e069 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:49:46.626855 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c2b5bfb2-a968-4fae-ac75-cc11b442e069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:49:46.685040 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4419/8840] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:49:46.693692 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee6049-ed94-4374-a8cf-f085b2c44c29 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:46.693987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee6049-ed94-4374-a8cf-f085b2c44c29 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:46.694301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee6049-ed94-4374-a8cf-f085b2c44c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:46.714824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-dbee6049-ed94-4374-a8cf-f085b2c44c29 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:49:46.716041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-dbee6049-ed94-4374-a8cf-f085b2c44c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:49:46.724211 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4422/8841] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:49:46.728259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5bfb2-a968-4fae-ac75-cc11b442e069 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:49:46.738208 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5bfb2-a968-4fae-ac75-cc11b442e069 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:49:46.742819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d3e99-eca9-4742-b734-3431d774ed8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:49:46.743503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d3e99-eca9-4742-b734-3431d774ed8b admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:46.743782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d3e99-eca9-4742-b734-3431d774ed8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:46.744057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d3e99-eca9-4742-b734-3431d774ed8b admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:46.744707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d3e99-eca9-4742-b734-3431d774ed8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 04:49:46.745015 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d3e99-eca9-4742-b734-3431d774ed8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:49:46.746678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d3e99-eca9-4742-b734-3431d774ed8b admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:49:46.758737 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4420/8842] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 04:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 04:49:46.763173 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee6049-ed94-4374-a8cf-f085b2c44c29 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:49:46.773125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee6049-ed94-4374-a8cf-f085b2c44c29 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:49:46.777848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46756e2a-b30c-492c-b126-37cfaf9aef35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:49:46.781245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46756e2a-b30c-492c-b126-37cfaf9aef35 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:46.781245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46756e2a-b30c-492c-b126-37cfaf9aef35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:46.781245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46756e2a-b30c-492c-b126-37cfaf9aef35 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:46.781245 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46756e2a-b30c-492c-b126-37cfaf9aef35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:49:46.781668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46756e2a-b30c-492c-b126-37cfaf9aef35 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:49:46.900350 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4423/8843] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:49:46 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:49:46.904750 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d3e99-eca9-4742-b734-3431d774ed8b admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:49:46.915041 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d3e99-eca9-4742-b734-3431d774ed8b admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:49:46.923704 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:49:46.972325 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d56c5-b178-4b81-9b6c-5032f6733c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:49:46.973059 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d56c5-b178-4b81-9b6c-5032f6733c31 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:46.973814 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d56c5-b178-4b81-9b6c-5032f6733c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:46.973984 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d56c5-b178-4b81-9b6c-5032f6733c31 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:46.974736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d56c5-b178-4b81-9b6c-5032f6733c31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:49:46.976651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d56c5-b178-4b81-9b6c-5032f6733c31 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:49:47.087392 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4421/8844] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:49:46 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:49:47.091363 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46756e2a-b30c-492c-b126-37cfaf9aef35 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:49:47.102222 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46756e2a-b30c-492c-b126-37cfaf9aef35 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:49:47.107042 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623bbb8-4d02-45c1-a4fb-5537c020e5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:49:47.107651 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623bbb8-4d02-45c1-a4fb-5537c020e5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:47.107942 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623bbb8-4d02-45c1-a4fb-5537c020e5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:47.108220 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623bbb8-4d02-45c1-a4fb-5537c020e5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:47.108935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623bbb8-4d02-45c1-a4fb-5537c020e5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:49:47.110825 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623bbb8-4d02-45c1-a4fb-5537c020e5e9 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:49:47.125345 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4424/8845] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:49:47.130238 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d56c5-b178-4b81-9b6c-5032f6733c31 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:49:47.140316 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d56c5-b178-4b81-9b6c-5032f6733c31 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:49:47.144992 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a3506-0ee1-4579-ad4a-9cf0e71b0bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:49:47.145591 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a3506-0ee1-4579-ad4a-9cf0e71b0bbf admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:47.145874 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a3506-0ee1-4579-ad4a-9cf0e71b0bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:47.146183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a3506-0ee1-4579-ad4a-9cf0e71b0bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:47.146832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a3506-0ee1-4579-ad4a-9cf0e71b0bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:49:47.148430 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a3506-0ee1-4579-ad4a-9cf0e71b0bbf admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:49:47.159124 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4422/8846] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:49:47.163303 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623bbb8-4d02-45c1-a4fb-5537c020e5e9 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:49:47.174023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623bbb8-4d02-45c1-a4fb-5537c020e5e9 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:49:47.178737 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc809d2e-972b-47bc-a25b-5565de205733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:49:47.179420 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc809d2e-972b-47bc-a25b-5565de205733 admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:47.179708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc809d2e-972b-47bc-a25b-5565de205733 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:47.179987 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc809d2e-972b-47bc-a25b-5565de205733 admin admin] PATH_INFO: `/v3/projects/206d2ec543a34682a5ec39023ffa2c90/users/0801f524d46d447c9dc052189e964abf/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:47.196472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc809d2e-972b-47bc-a25b-5565de205733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=206d2ec543a34682a5ec39023ffa2c90, user_id=0801f524d46d447c9dc052189e964abf, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:49:47.199315 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc809d2e-972b-47bc-a25b-5565de205733 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:49:47.264230 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4425/8847] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:49:47 2022] PUT /identity/v3/projects/206d2ec543a34682a5ec39023ffa2c90/users/0801f524d46d447c9dc052189e964abf/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:49:47.269295 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efac43f-c6ab-47b3-9130-eceab10a19b7 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:47.269671 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efac43f-c6ab-47b3-9130-eceab10a19b7 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:47.269944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efac43f-c6ab-47b3-9130-eceab10a19b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:47.288686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-8efac43f-c6ab-47b3-9130-eceab10a19b7 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:49:47.289883 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-8efac43f-c6ab-47b3-9130-eceab10a19b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:49:47.347916 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4423/8848] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:49:47.357453 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc809d2e-972b-47bc-a25b-5565de205733 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:49:47.359213 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-dc809d2e-972b-47bc-a25b-5565de205733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:49:47.416767 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc809d2e-972b-47bc-a25b-5565de205733 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:49:47.420550 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f2a98-eae8-4bb1-add5-f90017de031d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:49:47.421163 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f2a98-eae8-4bb1-add5-f90017de031d service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:47.421450 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f2a98-eae8-4bb1-add5-f90017de031d service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:47.421730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f2a98-eae8-4bb1-add5-f90017de031d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:47.431494 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f2a98-eae8-4bb1-add5-f90017de031d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:49:47.432923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f2a98-eae8-4bb1-add5-f90017de031d service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:49:47.442618 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4426/8849] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:49:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:49:52.688135 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6299dc8-cc36-4c50-b0a3-0a549d8e5692 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:52.688670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6299dc8-cc36-4c50-b0a3-0a549d8e5692 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:52.688670 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6299dc8-cc36-4c50-b0a3-0a549d8e5692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:52.715736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-b6299dc8-cc36-4c50-b0a3-0a549d8e5692 None None] MFA Rules not processed for user `0801f524d46d447c9dc052189e964abf`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:49:52.716943 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b6299dc8-cc36-4c50-b0a3-0a549d8e5692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:49:52.781305 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4424/8850] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:49:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:49:52.786374 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f2a98-eae8-4bb1-add5-f90017de031d service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:49:52.796070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f2a98-eae8-4bb1-add5-f90017de031d service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:49:52.801318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9c109-a83d-4707-b5e2-07d83979fa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:49:52.801915 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9c109-a83d-4707-b5e2-07d83979fa8d admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:52.802239 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9c109-a83d-4707-b5e2-07d83979fa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:52.802519 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9c109-a83d-4707-b5e2-07d83979fa8d admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:52.803146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9c109-a83d-4707-b5e2-07d83979fa8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:49:52.805062 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9c109-a83d-4707-b5e2-07d83979fa8d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:49:52.882469 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4427/8851] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 04:49:52 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 04:49:52.886656 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6299dc8-cc36-4c50-b0a3-0a549d8e5692 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:49:52.897641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6299dc8-cc36-4c50-b0a3-0a549d8e5692 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:49:52.916997 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:49:52.957247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca1aec-1865-4413-8399-a3bc89bc53aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:49:52.958009 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca1aec-1865-4413-8399-a3bc89bc53aa admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:52.958435 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca1aec-1865-4413-8399-a3bc89bc53aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:52.958713 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca1aec-1865-4413-8399-a3bc89bc53aa admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:52.959356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca1aec-1865-4413-8399-a3bc89bc53aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:49:52.961321 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca1aec-1865-4413-8399-a3bc89bc53aa admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:49:53.041063 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4425/8852] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 04:49:52 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 04:49:53.045358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9c109-a83d-4707-b5e2-07d83979fa8d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:49:53.057489 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9c109-a83d-4707-b5e2-07d83979fa8d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:49:53.062347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c88919-dad4-446b-a83e-c582f0dec409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:49:53.063193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c88919-dad4-446b-a83e-c582f0dec409 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:53.063482 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c88919-dad4-446b-a83e-c582f0dec409 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:53.063770 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c88919-dad4-446b-a83e-c582f0dec409 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:53.064411 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c88919-dad4-446b-a83e-c582f0dec409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:49:53.066025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c88919-dad4-446b-a83e-c582f0dec409 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:49:53.078665 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4428/8853] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:49:53.083505 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca1aec-1865-4413-8399-a3bc89bc53aa admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:49:53.094628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca1aec-1865-4413-8399-a3bc89bc53aa admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:49:53.099933 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca97c45-54c1-45c0-a37a-5bd625d1df44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:49:53.100628 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca97c45-54c1-45c0-a37a-5bd625d1df44 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:53.100930 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca97c45-54c1-45c0-a37a-5bd625d1df44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:53.101188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca97c45-54c1-45c0-a37a-5bd625d1df44 admin admin] PATH_INFO: `/v3/projects/fe5a1bceaa0743e7b8b4e7a3717f1db0/users/74b83dae68e04592a283b3f849c1ba16/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:53.117561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca97c45-54c1-45c0-a37a-5bd625d1df44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe5a1bceaa0743e7b8b4e7a3717f1db0, user_id=74b83dae68e04592a283b3f849c1ba16, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:49:53.120298 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca97c45-54c1-45c0-a37a-5bd625d1df44 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:49:53.208306 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4426/8854] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:49:53 2022] PUT /identity/v3/projects/fe5a1bceaa0743e7b8b4e7a3717f1db0/users/74b83dae68e04592a283b3f849c1ba16/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:49:53.213625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c88919-dad4-446b-a83e-c582f0dec409 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:49:53.224522 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c88919-dad4-446b-a83e-c582f0dec409 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:49:53.233328 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:49:53.282055 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa2083-c346-4fc9-aa9f-97e290cfebe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:49:53.282824 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa2083-c346-4fc9-aa9f-97e290cfebe5 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:53.283742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa2083-c346-4fc9-aa9f-97e290cfebe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:53.284070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa2083-c346-4fc9-aa9f-97e290cfebe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:53.284754 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa2083-c346-4fc9-aa9f-97e290cfebe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:49:53.286579 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa2083-c346-4fc9-aa9f-97e290cfebe5 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:49:53.297922 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4429/8855] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 04:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 04:49:53.301972 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca97c45-54c1-45c0-a37a-5bd625d1df44 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:49:53.312536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca97c45-54c1-45c0-a37a-5bd625d1df44 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:49:53.317314 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3af02b-18de-40a3-9c4e-7ba52f0dde44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:49:53.317975 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3af02b-18de-40a3-9c4e-7ba52f0dde44 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:53.318340 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3af02b-18de-40a3-9c4e-7ba52f0dde44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:53.318622 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3af02b-18de-40a3-9c4e-7ba52f0dde44 admin admin] PATH_INFO: `/v3/projects/fe5a1bceaa0743e7b8b4e7a3717f1db0/users/74b83dae68e04592a283b3f849c1ba16/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:53.320654 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3af02b-18de-40a3-9c4e-7ba52f0dde44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe5a1bceaa0743e7b8b4e7a3717f1db0, user_id=74b83dae68e04592a283b3f849c1ba16, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:49:53.323320 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3af02b-18de-40a3-9c4e-7ba52f0dde44 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:49:53.334469 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4427/8856] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 04:49:53 2022] PUT /identity/v3/projects/fe5a1bceaa0743e7b8b4e7a3717f1db0/users/74b83dae68e04592a283b3f849c1ba16/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 04:49:58.715972 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed1f0e-05ec-487e-bbd6-d3ea914fe800 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:58.716434 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed1f0e-05ec-487e-bbd6-d3ea914fe800 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:58.716612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed1f0e-05ec-487e-bbd6-d3ea914fe800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:58.749817 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-d3ed1f0e-05ec-487e-bbd6-d3ea914fe800 None None] MFA Rules not processed for user `74b83dae68e04592a283b3f849c1ba16`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:49:58.754968 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-d3ed1f0e-05ec-487e-bbd6-d3ea914fe800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:49:58.831668 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4430/8857] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:49:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:49:58.851587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3af02b-18de-40a3-9c4e-7ba52f0dde44 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:49:58.853950 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3e3af02b-18de-40a3-9c4e-7ba52f0dde44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:49:58.939523 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3af02b-18de-40a3-9c4e-7ba52f0dde44 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:49:58.944361 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b055864-0656-4157-b155-220e62f5e719 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:49:58.944987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b055864-0656-4157-b155-220e62f5e719 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:49:58.945266 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b055864-0656-4157-b155-220e62f5e719 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:49:58.945536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b055864-0656-4157-b155-220e62f5e719 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:49:59.007275 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b055864-0656-4157-b155-220e62f5e719 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:49:59.010364 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b055864-0656-4157-b155-220e62f5e719 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:49:59.019107 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4428/8858] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:49:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:50:01.664545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e95a3-a9dd-41fe-ab9c-51ff1d7ce246 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:50:01.665178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e95a3-a9dd-41fe-ab9c-51ff1d7ce246 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:50:01.665178 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e95a3-a9dd-41fe-ab9c-51ff1d7ce246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:50:01.686980 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-973e95a3-a9dd-41fe-ab9c-51ff1d7ce246 None None] MFA Rules not processed for user `0801f524d46d447c9dc052189e964abf`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:50:01.689517 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-973e95a3-a9dd-41fe-ab9c-51ff1d7ce246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:50:01.695739 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4431/8859] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:50:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:50:02.026827 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b055864-0656-4157-b155-220e62f5e719 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:50:02.028990 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-2b055864-0656-4157-b155-220e62f5e719 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:50:02.042858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:50:02.085759 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b055864-0656-4157-b155-220e62f5e719 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:50:02.089327 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39541ec-3d64-47f5-84f0-79dafa9f1ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:50:02.089931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39541ec-3d64-47f5-84f0-79dafa9f1ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:50:02.090252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39541ec-3d64-47f5-84f0-79dafa9f1ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:50:02.090528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39541ec-3d64-47f5-84f0-79dafa9f1ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:50:02.092249 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c39541ec-3d64-47f5-84f0-79dafa9f1ee9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:50:02.102986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39541ec-3d64-47f5-84f0-79dafa9f1ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:50:02.104526 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39541ec-3d64-47f5-84f0-79dafa9f1ee9 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:50:02.112790 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4429/8860] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:50:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:50:02.513047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e95a3-a9dd-41fe-ab9c-51ff1d7ce246 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:50:02.514670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-973e95a3-a9dd-41fe-ab9c-51ff1d7ce246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:50:02.591580 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e95a3-a9dd-41fe-ab9c-51ff1d7ce246 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:50:02.596837 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29266360-04f1-43e8-8f4d-417af5175d01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:50:02.597455 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29266360-04f1-43e8-8f4d-417af5175d01 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:50:02.597739 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29266360-04f1-43e8-8f4d-417af5175d01 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:50:02.598188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29266360-04f1-43e8-8f4d-417af5175d01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:50:02.600068 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-29266360-04f1-43e8-8f4d-417af5175d01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:50:02.612072 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29266360-04f1-43e8-8f4d-417af5175d01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:50:02.613647 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29266360-04f1-43e8-8f4d-417af5175d01 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:50:02.634190 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4432/8861] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:50:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:50:06.441941 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39541ec-3d64-47f5-84f0-79dafa9f1ee9 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:50:06.455731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39541ec-3d64-47f5-84f0-79dafa9f1ee9 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:50:06.461240 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edd3ed-83ae-4d05-81e4-7393c6c460ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:50:06.461850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edd3ed-83ae-4d05-81e4-7393c6c460ea service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:50:06.462184 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edd3ed-83ae-4d05-81e4-7393c6c460ea service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:50:06.462458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edd3ed-83ae-4d05-81e4-7393c6c460ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:50:06.465016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-c1edd3ed-83ae-4d05-81e4-7393c6c460ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:50:06.477569 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edd3ed-83ae-4d05-81e4-7393c6c460ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:50:06.479214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edd3ed-83ae-4d05-81e4-7393c6c460ea service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:50:06.489933 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4430/8862] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:50:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:50:10.941937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29266360-04f1-43e8-8f4d-417af5175d01 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:50:10.943422 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-29266360-04f1-43e8-8f4d-417af5175d01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:50:10.958753 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29266360-04f1-43e8-8f4d-417af5175d01 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:50:10.964322 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302cabd-a12e-466b-b04f-6392fa84fbf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:50:10.964923 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302cabd-a12e-466b-b04f-6392fa84fbf7 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:50:10.965201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302cabd-a12e-466b-b04f-6392fa84fbf7 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:50:10.965472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302cabd-a12e-466b-b04f-6392fa84fbf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:50:10.967189 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-a302cabd-a12e-466b-b04f-6392fa84fbf7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:50:10.978885 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302cabd-a12e-466b-b04f-6392fa84fbf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:50:10.980444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302cabd-a12e-466b-b04f-6392fa84fbf7 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:50:10.991460 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4433/8863] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:50:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:50:13.240641 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edd3ed-83ae-4d05-81e4-7393c6c460ea service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:50:13.249866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edd3ed-83ae-4d05-81e4-7393c6c460ea service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:50:13.253503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978fa3a-61f1-4644-9507-7d569fa7cee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:50:13.254127 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978fa3a-61f1-4644-9507-7d569fa7cee5 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:50:13.254417 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978fa3a-61f1-4644-9507-7d569fa7cee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:50:13.254693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978fa3a-61f1-4644-9507-7d569fa7cee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:50:13.263429 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978fa3a-61f1-4644-9507-7d569fa7cee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:50:13.264861 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978fa3a-61f1-4644-9507-7d569fa7cee5 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:50:13.274726 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4431/8864] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:50:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:50:20.987122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:50:23.270592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=33 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:52:08.292016 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302cabd-a12e-466b-b04f-6392fa84fbf7 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:52:08.311901 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302cabd-a12e-466b-b04f-6392fa84fbf7 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:52:08.315670 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6d819-92b2-4afb-87d8-911829be6dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:52:08.323069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6d819-92b2-4afb-87d8-911829be6dda service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:52:08.323069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6d819-92b2-4afb-87d8-911829be6dda service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:52:08.323069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6d819-92b2-4afb-87d8-911829be6dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:52:08.323069 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-17b6d819-92b2-4afb-87d8-911829be6dda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:52:08.340513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6d819-92b2-4afb-87d8-911829be6dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:52:08.341939 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6d819-92b2-4afb-87d8-911829be6dda service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:52:08.349826 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4434/8865] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:52:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:52:12.041819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978fa3a-61f1-4644-9507-7d569fa7cee5 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:52:12.043293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-e978fa3a-61f1-4644-9507-7d569fa7cee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:52:12.122006 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978fa3a-61f1-4644-9507-7d569fa7cee5 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:52:12.125642 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c7651-0fac-406c-afdf-50615793247b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:52:12.126304 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c7651-0fac-406c-afdf-50615793247b service glance] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:52:12.126590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c7651-0fac-406c-afdf-50615793247b service glance] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:52:12.126866 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c7651-0fac-406c-afdf-50615793247b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:52:12.128584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-196c7651-0fac-406c-afdf-50615793247b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:52:12.160639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c7651-0fac-406c-afdf-50615793247b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:52:12.162116 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c7651-0fac-406c-afdf-50615793247b service glance] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:52:12.172942 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4432/8866] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:52:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:52:12.421677 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6d819-92b2-4afb-87d8-911829be6dda service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:52:12.430512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6d819-92b2-4afb-87d8-911829be6dda service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:52:12.435276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0e144-a0e2-42ce-bd4b-1c771fd2cce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:52:12.443486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0e144-a0e2-42ce-bd4b-1c771fd2cce9 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:52:12.443486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0e144-a0e2-42ce-bd4b-1c771fd2cce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:52:12.443486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0e144-a0e2-42ce-bd4b-1c771fd2cce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:52:12.443486 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-aff0e144-a0e2-42ce-bd4b-1c771fd2cce9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:52:12.453321 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0e144-a0e2-42ce-bd4b-1c771fd2cce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:52:12.454935 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0e144-a0e2-42ce-bd4b-1c771fd2cce9 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:52:12.466253 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4435/8867] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:52:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:52:22.168481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=43 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:52:22.461221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=21 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:52:25.142996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af0447-b38e-4426-88d3-71aa13b30208 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:52:25.143549 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af0447-b38e-4426-88d3-71aa13b30208 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:52:25.143688 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af0447-b38e-4426-88d3-71aa13b30208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:52:25.196060 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-28af0447-b38e-4426-88d3-71aa13b30208 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:52:25.197268 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-28af0447-b38e-4426-88d3-71aa13b30208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:52:25.260834 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4433/8868] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 04:52:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:52:25.386896 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0e144-a0e2-42ce-bd4b-1c771fd2cce9 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:52:25.389141 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-aff0e144-a0e2-42ce-bd4b-1c771fd2cce9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:52:25.499783 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0e144-a0e2-42ce-bd4b-1c771fd2cce9 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:52:25.506460 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce1a06-b253-4b6b-901d-8fc3da1fd881 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:52:25.507080 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce1a06-b253-4b6b-901d-8fc3da1fd881 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:52:25.507366 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce1a06-b253-4b6b-901d-8fc3da1fd881 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:52:25.507642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce1a06-b253-4b6b-901d-8fc3da1fd881 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:52:25.519115 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce1a06-b253-4b6b-901d-8fc3da1fd881 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:52:25.519495 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce1a06-b253-4b6b-901d-8fc3da1fd881 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:52:25.529136 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4436/8869] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 04:52:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 04:52:35.257996 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=40 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:52:35.524716 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=41 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:52:39.908159 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af0447-b38e-4426-88d3-71aa13b30208 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:52:39.917986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af0447-b38e-4426-88d3-71aa13b30208 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:52:39.921603 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26963d-1409-459c-bc20-a217328eb2f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:52:39.922248 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26963d-1409-459c-bc20-a217328eb2f5 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:52:39.922540 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26963d-1409-459c-bc20-a217328eb2f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:52:39.922819 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26963d-1409-459c-bc20-a217328eb2f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:52:39.924539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bf26963d-1409-459c-bc20-a217328eb2f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:52:39.934823 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26963d-1409-459c-bc20-a217328eb2f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:52:39.936272 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26963d-1409-459c-bc20-a217328eb2f5 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:52:39.944375 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4434/8870] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:52:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:52:40.358224 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310276a5-9262-46f7-9c9e-da25ff8a1529 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:52:40.358803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310276a5-9262-46f7-9c9e-da25ff8a1529 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:52:40.358803 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310276a5-9262-46f7-9c9e-da25ff8a1529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:52:40.389576 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-310276a5-9262-46f7-9c9e-da25ff8a1529 None None] MFA Rules not processed for user `c20881251f2241a3a5ec2e5cf99db149`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:52:40.390830 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-310276a5-9262-46f7-9c9e-da25ff8a1529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:52:40.400186 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4437/8871] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 27 04:52:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:52:40.412118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26963d-1409-459c-bc20-a217328eb2f5 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:52:40.422293 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26963d-1409-459c-bc20-a217328eb2f5 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:52:40.426061 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cce39a-c55b-4902-8a1d-c02ffc8562a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:52:40.427241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cce39a-c55b-4902-8a1d-c02ffc8562a7 service glance] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:52:40.427241 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cce39a-c55b-4902-8a1d-c02ffc8562a7 service glance] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:52:40.427525 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cce39a-c55b-4902-8a1d-c02ffc8562a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:52:40.439223 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cce39a-c55b-4902-8a1d-c02ffc8562a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:52:40.440619 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cce39a-c55b-4902-8a1d-c02ffc8562a7 service glance] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:52:40.451877 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4435/8872] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:52:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:52:40.596834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310276a5-9262-46f7-9c9e-da25ff8a1529 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:52:40.606804 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310276a5-9262-46f7-9c9e-da25ff8a1529 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:52:40.610575 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee14127-e4cd-4525-aadb-80d2c90b913d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:52:40.611078 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee14127-e4cd-4525-aadb-80d2c90b913d service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:52:40.611364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee14127-e4cd-4525-aadb-80d2c90b913d service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:52:40.611642 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee14127-e4cd-4525-aadb-80d2c90b913d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:52:40.613625 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3ee14127-e4cd-4525-aadb-80d2c90b913d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:52:40.623763 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee14127-e4cd-4525-aadb-80d2c90b913d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:52:40.625194 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee14127-e4cd-4525-aadb-80d2c90b913d service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:52:40.633204 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4438/8873] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:52:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:52:40.710236 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cce39a-c55b-4902-8a1d-c02ffc8562a7 service glance] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:52:40.720815 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cce39a-c55b-4902-8a1d-c02ffc8562a7 service glance] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:52:40.724524 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b09edd-247b-4c8a-b11b-c1809774c914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:52:40.725119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b09edd-247b-4c8a-b11b-c1809774c914 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:52:40.725406 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b09edd-247b-4c8a-b11b-c1809774c914 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:52:40.725684 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b09edd-247b-4c8a-b11b-c1809774c914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:52:40.727441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b1b09edd-247b-4c8a-b11b-c1809774c914 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:52:40.741604 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b09edd-247b-4c8a-b11b-c1809774c914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:52:40.743156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b09edd-247b-4c8a-b11b-c1809774c914 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:52:40.754190 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4436/8874] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:52:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:52:40.815490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee14127-e4cd-4525-aadb-80d2c90b913d service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:52:40.816917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-3ee14127-e4cd-4525-aadb-80d2c90b913d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:52:40.844337 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee14127-e4cd-4525-aadb-80d2c90b913d service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:52:40.849409 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1be58f-2b2e-4faf-a23a-6055e8f5e447 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:52:40.850006 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1be58f-2b2e-4faf-a23a-6055e8f5e447 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:52:40.850326 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1be58f-2b2e-4faf-a23a-6055e8f5e447 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:52:40.850604 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1be58f-2b2e-4faf-a23a-6055e8f5e447 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:52:40.852296 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2a1be58f-2b2e-4faf-a23a-6055e8f5e447 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:52:40.865622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1be58f-2b2e-4faf-a23a-6055e8f5e447 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:52:40.867214 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1be58f-2b2e-4faf-a23a-6055e8f5e447 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:52:40.876878 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4439/8875] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:52:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:52:42.105644 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b09edd-247b-4c8a-b11b-c1809774c914 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:52:42.114627 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b09edd-247b-4c8a-b11b-c1809774c914 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:52:42.118333 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de43b30-e23f-4b88-8488-962e15cfcd5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:52:42.118934 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de43b30-e23f-4b88-8488-962e15cfcd5e service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:52:42.119220 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de43b30-e23f-4b88-8488-962e15cfcd5e service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:52:42.119494 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de43b30-e23f-4b88-8488-962e15cfcd5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:52:42.121865 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7de43b30-e23f-4b88-8488-962e15cfcd5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:52:42.131166 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de43b30-e23f-4b88-8488-962e15cfcd5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:52:42.132602 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de43b30-e23f-4b88-8488-962e15cfcd5e service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:52:42.140413 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4437/8876] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:52:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:52:43.203874 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1be58f-2b2e-4faf-a23a-6055e8f5e447 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:52:43.216755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1be58f-2b2e-4faf-a23a-6055e8f5e447 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:52:43.223266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0fea0-3f60-4d16-9221-0d6806859568 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:52:43.223877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0fea0-3f60-4d16-9221-0d6806859568 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:52:43.224158 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0fea0-3f60-4d16-9221-0d6806859568 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:52:43.224436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0fea0-3f60-4d16-9221-0d6806859568 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:52:43.226230 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-cdd0fea0-3f60-4d16-9221-0d6806859568 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:52:43.239197 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0fea0-3f60-4d16-9221-0d6806859568 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:52:43.240852 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0fea0-3f60-4d16-9221-0d6806859568 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:52:43.252355 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4440/8877] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:52:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:52:43.907366 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878a948-e3da-435a-b817-f857ff91e479 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:52:43.907899 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878a948-e3da-435a-b817-f857ff91e479 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:52:43.908235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878a948-e3da-435a-b817-f857ff91e479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:52:43.929267 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-d878a948-e3da-435a-b817-f857ff91e479 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:52:43.930599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-d878a948-e3da-435a-b817-f857ff91e479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:52:43.938855 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4438/8878] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 04:52:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:52:43.951318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0fea0-3f60-4d16-9221-0d6806859568 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:52:43.962953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0fea0-3f60-4d16-9221-0d6806859568 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:52:43.972171 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c6284-c9d0-46d4-84bc-b80d8242988f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:52:43.973058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c6284-c9d0-46d4-84bc-b80d8242988f service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:52:43.973705 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c6284-c9d0-46d4-84bc-b80d8242988f service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:52:43.974266 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c6284-c9d0-46d4-84bc-b80d8242988f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:52:43.983779 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c6284-c9d0-46d4-84bc-b80d8242988f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:52:43.986406 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c6284-c9d0-46d4-84bc-b80d8242988f service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:52:43.995998 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4441/8879] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 04:52:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 04:52:53.924078 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=27 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:52:53.992378 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=36 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:52:58.794227 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf95f1c-50e1-4ae5-984a-237234fc48e1 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:52:58.794720 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf95f1c-50e1-4ae5-984a-237234fc48e1 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:52:58.794844 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf95f1c-50e1-4ae5-984a-237234fc48e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:52:58.814071 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-bbf95f1c-50e1-4ae5-984a-237234fc48e1 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:52:58.815278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-bbf95f1c-50e1-4ae5-984a-237234fc48e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:52:58.822861 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4439/8880] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 04:52:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:52:58.835509 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c6284-c9d0-46d4-84bc-b80d8242988f service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:52:58.846125 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c6284-c9d0-46d4-84bc-b80d8242988f service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:52:58.851336 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f98ca6-8a6d-44b4-9514-b9772c8730cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:52:58.851946 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f98ca6-8a6d-44b4-9514-b9772c8730cb service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:52:58.852320 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f98ca6-8a6d-44b4-9514-b9772c8730cb service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:52:58.852602 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f98ca6-8a6d-44b4-9514-b9772c8730cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:52:58.861003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f98ca6-8a6d-44b4-9514-b9772c8730cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:52:58.862900 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f98ca6-8a6d-44b4-9514-b9772c8730cb service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:52:58.871079 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4442/8881] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 04:52:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 04:53:08.808330 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:53:08.867697 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:53:16.294151 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf95f1c-50e1-4ae5-984a-237234fc48e1 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:53:16.306584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf95f1c-50e1-4ae5-984a-237234fc48e1 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:53:16.312113 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2942d-3178-4f1f-8274-93efae5be724 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:53:16.312734 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2942d-3178-4f1f-8274-93efae5be724 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:53:16.313014 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2942d-3178-4f1f-8274-93efae5be724 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:53:16.313285 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2942d-3178-4f1f-8274-93efae5be724 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:53:16.314999 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-b5d2942d-3178-4f1f-8274-93efae5be724 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:53:16.326536 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2942d-3178-4f1f-8274-93efae5be724 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:53:16.328345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2942d-3178-4f1f-8274-93efae5be724 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:53:16.337967 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4440/8882] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:53:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:53:19.606144 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f98ca6-8a6d-44b4-9514-b9772c8730cb service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:53:19.617478 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f98ca6-8a6d-44b4-9514-b9772c8730cb service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:53:19.622623 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd48c8b-c6be-4ecd-b870-34afa8bc4f3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:53:19.623221 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd48c8b-c6be-4ecd-b870-34afa8bc4f3d service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:53:19.624002 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd48c8b-c6be-4ecd-b870-34afa8bc4f3d service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:53:19.624273 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd48c8b-c6be-4ecd-b870-34afa8bc4f3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:53:19.625977 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-ccd48c8b-c6be-4ecd-b870-34afa8bc4f3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:53:19.637103 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd48c8b-c6be-4ecd-b870-34afa8bc4f3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:53:19.638708 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd48c8b-c6be-4ecd-b870-34afa8bc4f3d service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:53:19.649011 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4443/8883] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:53:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:53:26.333926 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:53:29.644776 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:54:19.531570 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc043e-cf61-4f23-bd66-f2993871ab8a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:54:19.532134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc043e-cf61-4f23-bd66-f2993871ab8a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:54:19.532134 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc043e-cf61-4f23-bd66-f2993871ab8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:54:19.550929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-21bc043e-cf61-4f23-bd66-f2993871ab8a None None] MFA Rules not processed for user `0801f524d46d447c9dc052189e964abf`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 04:54:19.552086 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-21bc043e-cf61-4f23-bd66-f2993871ab8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:54:19.559003 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4441/8884] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 04:54:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 04:54:29.545998 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:54:58.777058 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd48c8b-c6be-4ecd-b870-34afa8bc4f3d service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:54:58.798247 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd48c8b-c6be-4ecd-b870-34afa8bc4f3d service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:54:58.803733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b10e9-c3bb-4016-800f-584533ff1fef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:54:58.804325 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b10e9-c3bb-4016-800f-584533ff1fef service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:54:58.804606 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b10e9-c3bb-4016-800f-584533ff1fef service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:54:58.804878 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b10e9-c3bb-4016-800f-584533ff1fef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:54:58.812390 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b10e9-c3bb-4016-800f-584533ff1fef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:54:58.814512 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b10e9-c3bb-4016-800f-584533ff1fef service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:54:58.823216 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4444/8885] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:54:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:55:08.819219 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=10 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:57:14.284087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc043e-cf61-4f23-bd66-f2993871ab8a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:57:14.294649 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc043e-cf61-4f23-bd66-f2993871ab8a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:57:14.298689 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b268c-448b-429b-a272-5abfc0092a3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:57:14.299302 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b268c-448b-429b-a272-5abfc0092a3d service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:57:14.299584 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b268c-448b-429b-a272-5abfc0092a3d service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:57:14.299858 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b268c-448b-429b-a272-5abfc0092a3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:57:14.307771 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b268c-448b-429b-a272-5abfc0092a3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:57:14.309210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b268c-448b-429b-a272-5abfc0092a3d service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:57:14.317339 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4442/8886] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:57:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 04:57:24.313623 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:57:34.360740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b10e9-c3bb-4016-800f-584533ff1fef service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:57:34.360740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b10e9-c3bb-4016-800f-584533ff1fef service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:57:34.360740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139f9f1-2c41-436c-bf24-e4738b753cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:57:34.360740 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139f9f1-2c41-436c-bf24-e4738b753cdf service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:57:34.361998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139f9f1-2c41-436c-bf24-e4738b753cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:57:34.361998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139f9f1-2c41-436c-bf24-e4738b753cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:57:34.361998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139f9f1-2c41-436c-bf24-e4738b753cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:57:34.361998 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139f9f1-2c41-436c-bf24-e4738b753cdf service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:57:34.361998 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4445/8887] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:57:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:57:35.439255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b268c-448b-429b-a272-5abfc0092a3d service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:57:35.447935 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b268c-448b-429b-a272-5abfc0092a3d service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:57:35.451610 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96caeee-3cc8-4937-a9f0-70b6ef7f1d83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:57:35.452209 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96caeee-3cc8-4937-a9f0-70b6ef7f1d83 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:57:35.452493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96caeee-3cc8-4937-a9f0-70b6ef7f1d83 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:57:35.452770 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96caeee-3cc8-4937-a9f0-70b6ef7f1d83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:57:35.463264 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96caeee-3cc8-4937-a9f0-70b6ef7f1d83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:57:35.464707 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96caeee-3cc8-4937-a9f0-70b6ef7f1d83 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:57:35.475612 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4443/8888] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:57:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:57:44.233920 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:57:45.470702 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:57:48.862546 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139f9f1-2c41-436c-bf24-e4738b753cdf service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:57:48.874537 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139f9f1-2c41-436c-bf24-e4738b753cdf service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:57:48.880070 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe2b4c-1672-48c8-9c88-07bc3f2a77c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:57:48.885018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe2b4c-1672-48c8-9c88-07bc3f2a77c1 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:57:48.885018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe2b4c-1672-48c8-9c88-07bc3f2a77c1 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:57:48.885018 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe2b4c-1672-48c8-9c88-07bc3f2a77c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:57:48.889860 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe2b4c-1672-48c8-9c88-07bc3f2a77c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:57:48.891477 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe2b4c-1672-48c8-9c88-07bc3f2a77c1 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:57:48.902596 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4446/8889] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:57:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:57:50.098110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96caeee-3cc8-4937-a9f0-70b6ef7f1d83 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:57:50.107057 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96caeee-3cc8-4937-a9f0-70b6ef7f1d83 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:57:50.110860 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9083d-28fa-4623-8198-2e82ec0e3001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:57:50.111458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9083d-28fa-4623-8198-2e82ec0e3001 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:57:50.111736 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9083d-28fa-4623-8198-2e82ec0e3001 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:57:50.114458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9083d-28fa-4623-8198-2e82ec0e3001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:57:50.120273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9083d-28fa-4623-8198-2e82ec0e3001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:57:50.121753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9083d-28fa-4623-8198-2e82ec0e3001 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:57:50.130067 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4444/8890] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:57:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:57:50.237417 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe2b4c-1672-48c8-9c88-07bc3f2a77c1 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:57:50.247627 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe2b4c-1672-48c8-9c88-07bc3f2a77c1 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:57:50.251276 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb43576-4ccc-48bd-b73b-2bd22f5708b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:57:50.251875 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb43576-4ccc-48bd-b73b-2bd22f5708b6 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:57:50.252161 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb43576-4ccc-48bd-b73b-2bd22f5708b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:57:50.252438 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb43576-4ccc-48bd-b73b-2bd22f5708b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:57:50.262444 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb43576-4ccc-48bd-b73b-2bd22f5708b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:57:50.263815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb43576-4ccc-48bd-b73b-2bd22f5708b6 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:57:50.274473 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4447/8891] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:57:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:57:50.333552 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9083d-28fa-4623-8198-2e82ec0e3001 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:57:50.345577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9083d-28fa-4623-8198-2e82ec0e3001 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:57:50.350474 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440421f-4300-4f19-bc82-31679dc1574e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:57:50.351063 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440421f-4300-4f19-bc82-31679dc1574e service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:57:50.351345 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440421f-4300-4f19-bc82-31679dc1574e service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:57:50.351615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440421f-4300-4f19-bc82-31679dc1574e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:57:50.360307 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440421f-4300-4f19-bc82-31679dc1574e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:57:50.361881 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440421f-4300-4f19-bc82-31679dc1574e service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:57:50.372330 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4445/8892] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:57:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:58:00.269748 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=12 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:58:00.368123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=12 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:58:20.248260 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb43576-4ccc-48bd-b73b-2bd22f5708b6 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:58:20.308934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb43576-4ccc-48bd-b73b-2bd22f5708b6 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:58:20.314108 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b778a-cc2d-4712-a1c8-92d265717356 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:58:20.314717 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b778a-cc2d-4712-a1c8-92d265717356 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:58:20.315004 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b778a-cc2d-4712-a1c8-92d265717356 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:58:20.315282 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b778a-cc2d-4712-a1c8-92d265717356 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:58:20.324205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b778a-cc2d-4712-a1c8-92d265717356 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:58:20.325791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b778a-cc2d-4712-a1c8-92d265717356 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:58:20.335569 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4448/8893] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:58:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:58:25.583779 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440421f-4300-4f19-bc82-31679dc1574e service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:58:25.633767 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440421f-4300-4f19-bc82-31679dc1574e service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:58:25.639020 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824a401-f082-463c-9c4a-96a9395d8fda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:58:25.639624 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824a401-f082-463c-9c4a-96a9395d8fda service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:58:25.639911 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824a401-f082-463c-9c4a-96a9395d8fda service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:58:25.640186 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824a401-f082-463c-9c4a-96a9395d8fda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:58:25.648632 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824a401-f082-463c-9c4a-96a9395d8fda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:58:25.650259 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824a401-f082-463c-9c4a-96a9395d8fda service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:58:25.659846 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4446/8894] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:58:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:58:30.331559 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=27 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:58:35.655792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=24 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:59:45.983566 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b778a-cc2d-4712-a1c8-92d265717356 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:59:46.000730 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b778a-cc2d-4712-a1c8-92d265717356 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:59:46.007061 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884bd71-513f-4826-b9c0-30fcd00f1402 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:59:46.013262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884bd71-513f-4826-b9c0-30fcd00f1402 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:59:46.013262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884bd71-513f-4826-b9c0-30fcd00f1402 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:59:46.013262 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884bd71-513f-4826-b9c0-30fcd00f1402 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:59:46.018628 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884bd71-513f-4826-b9c0-30fcd00f1402 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:59:46.020217 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884bd71-513f-4826-b9c0-30fcd00f1402 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:59:46.032439 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4449/8895] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:59:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:59:48.590400 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824a401-f082-463c-9c4a-96a9395d8fda service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:59:48.602354 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824a401-f082-463c-9c4a-96a9395d8fda service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:59:48.607864 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93847b66-4352-406a-8ea6-3c729f77386a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:59:48.608460 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93847b66-4352-406a-8ea6-3c729f77386a service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:59:48.608744 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93847b66-4352-406a-8ea6-3c729f77386a service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:59:48.609019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93847b66-4352-406a-8ea6-3c729f77386a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:59:48.619170 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93847b66-4352-406a-8ea6-3c729f77386a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:59:48.620783 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93847b66-4352-406a-8ea6-3c729f77386a service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:59:48.631918 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4447/8896] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:59:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:59:54.585989 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884bd71-513f-4826-b9c0-30fcd00f1402 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:59:54.595791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884bd71-513f-4826-b9c0-30fcd00f1402 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:59:54.600475 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81847c3-4cbb-4055-a566-8eb3bbff2fbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:59:54.601164 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81847c3-4cbb-4055-a566-8eb3bbff2fbc service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:59:54.601518 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81847c3-4cbb-4055-a566-8eb3bbff2fbc service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:59:54.601858 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81847c3-4cbb-4055-a566-8eb3bbff2fbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:59:54.603791 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-b81847c3-4cbb-4055-a566-8eb3bbff2fbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:59:54.702962 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81847c3-4cbb-4055-a566-8eb3bbff2fbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:59:54.704407 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81847c3-4cbb-4055-a566-8eb3bbff2fbc service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:59:54.723888 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4450/8897] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:59:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 04:59:58.435158 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93847b66-4352-406a-8ea6-3c729f77386a service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 04:59:58.446940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93847b66-4352-406a-8ea6-3c729f77386a service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 04:59:58.452360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf05f7-0fa2-41af-80b7-4173d0ef6f5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 04:59:58.452973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf05f7-0fa2-41af-80b7-4173d0ef6f5d service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 04:59:58.453260 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf05f7-0fa2-41af-80b7-4173d0ef6f5d service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 04:59:58.453626 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf05f7-0fa2-41af-80b7-4173d0ef6f5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 04:59:58.455489 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-32bf05f7-0fa2-41af-80b7-4173d0ef6f5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 04:59:58.467528 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf05f7-0fa2-41af-80b7-4173d0ef6f5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 04:59:58.469162 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf05f7-0fa2-41af-80b7-4173d0ef6f5d service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 04:59:58.479385 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4448/8898] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 04:59:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 05:00:02.134454 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81847c3-4cbb-4055-a566-8eb3bbff2fbc service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:00:02.152696 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81847c3-4cbb-4055-a566-8eb3bbff2fbc service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:00:02.163364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c66a6-bd96-4814-9f25-fdea1452150b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:00:02.164394 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c66a6-bd96-4814-9f25-fdea1452150b service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:02.164790 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c66a6-bd96-4814-9f25-fdea1452150b service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:02.165208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c66a6-bd96-4814-9f25-fdea1452150b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:02.167253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-140c66a6-bd96-4814-9f25-fdea1452150b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:00:02.180160 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c66a6-bd96-4814-9f25-fdea1452150b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:00:02.182181 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c66a6-bd96-4814-9f25-fdea1452150b service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:00:02.196468 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4451/8899] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 05:00:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 05:00:02.248518 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf05f7-0fa2-41af-80b7-4173d0ef6f5d service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:00:02.250419 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-32bf05f7-0fa2-41af-80b7-4173d0ef6f5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:00:02.268112 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf05f7-0fa2-41af-80b7-4173d0ef6f5d service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:00:02.272775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352a0d9-cef0-4947-aee2-4acad473396e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:00:02.273402 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352a0d9-cef0-4947-aee2-4acad473396e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:02.273685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352a0d9-cef0-4947-aee2-4acad473396e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:02.273964 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352a0d9-cef0-4947-aee2-4acad473396e admin admin] PATH_INFO: `/v3/users/0801f524d46d447c9dc052189e964abf` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:02.287958 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352a0d9-cef0-4947-aee2-4acad473396e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0801f524d46d447c9dc052189e964abf)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:00:02.289940 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352a0d9-cef0-4947-aee2-4acad473396e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:00:02.464053 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7352a0d9-cef0-4947-aee2-4acad473396e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0801f524d46d447c9dc052189e964abf'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:00:02.464716 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7352a0d9-cef0-4947-aee2-4acad473396e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0801f524d46d447c9dc052189e964abf'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:00:02.471752 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7352a0d9-cef0-4947-aee2-4acad473396e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0801f524d46d447c9dc052189e964abf'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:00:02.484669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7352a0d9-cef0-4947-aee2-4acad473396e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0801f524d46d447c9dc052189e964abf'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:00:02.651082 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-7352a0d9-cef0-4947-aee2-4acad473396e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0801f524d46d447c9dc052189e964abf'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:00:02.657690 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4449/8900] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 05:00:02 2022] DELETE /identity/v3/users/0801f524d46d447c9dc052189e964abf => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 05:00:02.881133 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c66a6-bd96-4814-9f25-fdea1452150b service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:00:02.891843 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c66a6-bd96-4814-9f25-fdea1452150b service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:00:02.954969 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b6d51-0a12-46e5-8de0-01e6c434f45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:00:02.955674 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b6d51-0a12-46e5-8de0-01e6c434f45d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:02.955964 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b6d51-0a12-46e5-8de0-01e6c434f45d admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:02.956243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b6d51-0a12-46e5-8de0-01e6c434f45d admin admin] PATH_INFO: `/v3/projects/206d2ec543a34682a5ec39023ffa2c90` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:02.967577 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b6d51-0a12-46e5-8de0-01e6c434f45d admin admin] RBAC: Authorizing `identity:delete_project(project_id=206d2ec543a34682a5ec39023ffa2c90)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:00:02.969578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b6d51-0a12-46e5-8de0-01e6c434f45d admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:00:02.994658 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:00:03.062318 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-399b6d51-0a12-46e5-8de0-01e6c434f45d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '206d2ec543a34682a5ec39023ffa2c90', 'request_id': 'req-399b6d51-0a12-46e5-8de0-01e6c434f45d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:00:03.068861 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-399b6d51-0a12-46e5-8de0-01e6c434f45d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '206d2ec543a34682a5ec39023ffa2c90', 'request_id': 'req-399b6d51-0a12-46e5-8de0-01e6c434f45d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:00:03.074412 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-399b6d51-0a12-46e5-8de0-01e6c434f45d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '206d2ec543a34682a5ec39023ffa2c90', 'request_id': 'req-399b6d51-0a12-46e5-8de0-01e6c434f45d'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:00:03.147622 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-399b6d51-0a12-46e5-8de0-01e6c434f45d admin admin] The token cache is being invalidate because project 206d2ec543a34682a5ec39023ffa2c90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 05:00:03.148233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-399b6d51-0a12-46e5-8de0-01e6c434f45d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:00:03.148544 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-399b6d51-0a12-46e5-8de0-01e6c434f45d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:00:03.150072 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4452/8901] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 05:00:02 2022] DELETE /identity/v3/projects/206d2ec543a34682a5ec39023ffa2c90 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 05:00:03.154123 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352a0d9-cef0-4947-aee2-4acad473396e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:00:03.155637 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7352a0d9-cef0-4947-aee2-4acad473396e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:00:03.168685 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352a0d9-cef0-4947-aee2-4acad473396e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:00:03.226491 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77549987-db8d-46b4-bb8d-50a7439e4466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:00:03.227119 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77549987-db8d-46b4-bb8d-50a7439e4466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:03.227401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77549987-db8d-46b4-bb8d-50a7439e4466 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:03.227677 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77549987-db8d-46b4-bb8d-50a7439e4466 admin admin] PATH_INFO: `/v3/users/74b83dae68e04592a283b3f849c1ba16` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:03.240747 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77549987-db8d-46b4-bb8d-50a7439e4466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74b83dae68e04592a283b3f849c1ba16)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:00:03.242982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77549987-db8d-46b4-bb8d-50a7439e4466 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:00:03.320648 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:00:03.414169 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-77549987-db8d-46b4-bb8d-50a7439e4466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74b83dae68e04592a283b3f849c1ba16'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:00:03.414843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-77549987-db8d-46b4-bb8d-50a7439e4466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74b83dae68e04592a283b3f849c1ba16'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:00:03.421989 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-77549987-db8d-46b4-bb8d-50a7439e4466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74b83dae68e04592a283b3f849c1ba16'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:00:03.433895 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-77549987-db8d-46b4-bb8d-50a7439e4466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74b83dae68e04592a283b3f849c1ba16'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:00:03.502156 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-77549987-db8d-46b4-bb8d-50a7439e4466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74b83dae68e04592a283b3f849c1ba16'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:00:03.509256 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4450/8902] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 05:00:03 2022] DELETE /identity/v3/users/74b83dae68e04592a283b3f849c1ba16 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 05:00:03.750759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b6d51-0a12-46e5-8de0-01e6c434f45d admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:00:03.752184 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-399b6d51-0a12-46e5-8de0-01e6c434f45d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:00:03.765811 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b6d51-0a12-46e5-8de0-01e6c434f45d admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:00:03.821506 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c5ab3-1eb7-427d-b510-d3dbbb10787c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:00:03.822188 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c5ab3-1eb7-427d-b510-d3dbbb10787c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:03.822471 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c5ab3-1eb7-427d-b510-d3dbbb10787c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:03.822745 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c5ab3-1eb7-427d-b510-d3dbbb10787c admin admin] PATH_INFO: `/v3/projects/fe5a1bceaa0743e7b8b4e7a3717f1db0` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:03.832732 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c5ab3-1eb7-427d-b510-d3dbbb10787c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe5a1bceaa0743e7b8b4e7a3717f1db0)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:00:03.834723 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c5ab3-1eb7-427d-b510-d3dbbb10787c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:00:03.942500 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-122c5ab3-1eb7-427d-b510-d3dbbb10787c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe5a1bceaa0743e7b8b4e7a3717f1db0', 'request_id': 'req-122c5ab3-1eb7-427d-b510-d3dbbb10787c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:00:03.949436 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-122c5ab3-1eb7-427d-b510-d3dbbb10787c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe5a1bceaa0743e7b8b4e7a3717f1db0', 'request_id': 'req-122c5ab3-1eb7-427d-b510-d3dbbb10787c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:00:03.954993 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-122c5ab3-1eb7-427d-b510-d3dbbb10787c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe5a1bceaa0743e7b8b4e7a3717f1db0', 'request_id': 'req-122c5ab3-1eb7-427d-b510-d3dbbb10787c'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:00:04.044933 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-122c5ab3-1eb7-427d-b510-d3dbbb10787c admin admin] The token cache is being invalidate because project fe5a1bceaa0743e7b8b4e7a3717f1db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 05:00:04.055253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-122c5ab3-1eb7-427d-b510-d3dbbb10787c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:00:04.055253 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-122c5ab3-1eb7-427d-b510-d3dbbb10787c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:00:04.055253 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4453/8903] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 05:00:03 2022] DELETE /identity/v3/projects/fe5a1bceaa0743e7b8b4e7a3717f1db0 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 05:00:04.055539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356690a-8f6e-4d68-82db-3e566caa4a1a None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:04.055539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356690a-8f6e-4d68-82db-3e566caa4a1a None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:04.055539 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356690a-8f6e-4d68-82db-3e566caa4a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:04.102802 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-a356690a-8f6e-4d68-82db-3e566caa4a1a None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 05:00:04.104118 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-a356690a-8f6e-4d68-82db-3e566caa4a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:00:04.167187 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4451/8904] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 05:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 05:00:04.175397 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6eb98-9767-4be9-8f80-4cc143fe6202 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:04.175883 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6eb98-9767-4be9-8f80-4cc143fe6202 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:04.175965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6eb98-9767-4be9-8f80-4cc143fe6202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:04.201893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f9e6eb98-9767-4be9-8f80-4cc143fe6202 None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 05:00:04.201893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f9e6eb98-9767-4be9-8f80-4cc143fe6202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:00:04.207257 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4454/8905] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 05:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 05:00:04.212195 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356690a-8f6e-4d68-82db-3e566caa4a1a None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:00:04.222216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356690a-8f6e-4d68-82db-3e566caa4a1a None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:00:04.227242 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d13203-7d55-4491-94a8-92c3a2633caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:00:04.227944 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d13203-7d55-4491-94a8-92c3a2633caa admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:04.228274 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d13203-7d55-4491-94a8-92c3a2633caa admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:04.228503 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d13203-7d55-4491-94a8-92c3a2633caa admin admin] PATH_INFO: `/v3/domains` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:04.234828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d13203-7d55-4491-94a8-92c3a2633caa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 05:00:04.234828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d13203-7d55-4491-94a8-92c3a2633caa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:00:04.234828 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d13203-7d55-4491-94a8-92c3a2633caa admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:00:04.243493 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4452/8906] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 27 05:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 05:00:04.247848 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6eb98-9767-4be9-8f80-4cc143fe6202 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:00:04.257873 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6eb98-9767-4be9-8f80-4cc143fe6202 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:00:04.262633 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd61c5-d69a-465a-8786-8b026e5e92c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:00:04.263258 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd61c5-d69a-465a-8786-8b026e5e92c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:04.263538 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd61c5-d69a-465a-8786-8b026e5e92c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:04.263807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd61c5-d69a-465a-8786-8b026e5e92c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:04.264426 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd61c5-d69a-465a-8786-8b026e5e92c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:00:04.266343 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd61c5-d69a-465a-8786-8b026e5e92c8 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:00:04.291041 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:00:04.367818 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4455/8907] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 05:00:04 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 05:00:04.372022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d13203-7d55-4491-94a8-92c3a2633caa admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:00:04.382843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d13203-7d55-4491-94a8-92c3a2633caa admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:00:04.438692 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a2de6-1b03-425f-b23d-538b476a538c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:00:04.439380 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a2de6-1b03-425f-b23d-538b476a538c admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:04.439666 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a2de6-1b03-425f-b23d-538b476a538c admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:04.439945 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a2de6-1b03-425f-b23d-538b476a538c admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:04.440577 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a2de6-1b03-425f-b23d-538b476a538c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:00:04.442537 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a2de6-1b03-425f-b23d-538b476a538c admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:00:04.519782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:00:04.525488 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4453/8908] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 05:00:04 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 05:00:04.529760 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd61c5-d69a-465a-8786-8b026e5e92c8 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:00:04.540199 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd61c5-d69a-465a-8786-8b026e5e92c8 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:00:04.545090 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f5f3f-dd31-41e0-855c-46c4f886f3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:00:04.545724 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f5f3f-dd31-41e0-855c-46c4f886f3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:04.545983 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f5f3f-dd31-41e0-855c-46c4f886f3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:04.546302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f5f3f-dd31-41e0-855c-46c4f886f3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:04.546975 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f5f3f-dd31-41e0-855c-46c4f886f3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:00:04.548610 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f5f3f-dd31-41e0-855c-46c4f886f3e3 admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:00:04.559056 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4456/8909] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 05:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 05:00:04.562916 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a2de6-1b03-425f-b23d-538b476a538c admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:00:04.573481 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a2de6-1b03-425f-b23d-538b476a538c admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:00:04.578152 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc6b50-e820-42b4-b35c-8c967277be88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:00:04.578753 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc6b50-e820-42b4-b35c-8c967277be88 admin admin] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:04.579028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc6b50-e820-42b4-b35c-8c967277be88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:04.579305 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc6b50-e820-42b4-b35c-8c967277be88 admin admin] PATH_INFO: `/v3/roles` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:04.579951 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc6b50-e820-42b4-b35c-8c967277be88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:00:04.581609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc6b50-e820-42b4-b35c-8c967277be88 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:00:04.592689 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4454/8910] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 05:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 05:00:04.596750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f5f3f-dd31-41e0-855c-46c4f886f3e3 admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:00:04.606961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f5f3f-dd31-41e0-855c-46c4f886f3e3 admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:00:04.611834 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52af28c-5d8f-4bbe-85da-3fe4b384150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:00:04.612479 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52af28c-5d8f-4bbe-85da-3fe4b384150a admin admin] REQUEST_METHOD: `PUT` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:04.612807 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52af28c-5d8f-4bbe-85da-3fe4b384150a admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:04.613081 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52af28c-5d8f-4bbe-85da-3fe4b384150a admin admin] PATH_INFO: `/v3/projects/6c894a9560d54542a80219708a9a7d0b/users/bf29495c1c284b4c9689ce1effb1bfff/roles/17fff77450b94933a5d232fb3f3221b7` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:04.628961 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52af28c-5d8f-4bbe-85da-3fe4b384150a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c894a9560d54542a80219708a9a7d0b, user_id=bf29495c1c284b4c9689ce1effb1bfff, role_id=17fff77450b94933a5d232fb3f3221b7)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:00:04.632272 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52af28c-5d8f-4bbe-85da-3fe4b384150a admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:00:04.702200 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4457/8911] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 05:00:04 2022] PUT /identity/v3/projects/6c894a9560d54542a80219708a9a7d0b/users/bf29495c1c284b4c9689ce1effb1bfff/roles/17fff77450b94933a5d232fb3f3221b7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 05:00:04.707441 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae049c-3f58-4907-9b1b-ec8d88344a2f None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:04.707735 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae049c-3f58-4907-9b1b-ec8d88344a2f None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:04.709214 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae049c-3f58-4907-9b1b-ec8d88344a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:04.727678 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-acae049c-3f58-4907-9b1b-ec8d88344a2f None None] MFA Rules not processed for user `7c4a354216e64f78803accba54466d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 05:00:04.728872 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-acae049c-3f58-4907-9b1b-ec8d88344a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:00:04.788574 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4455/8912] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 05:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 05:00:04.798755 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52af28c-5d8f-4bbe-85da-3fe4b384150a admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:00:04.800515 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-e52af28c-5d8f-4bbe-85da-3fe4b384150a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:00:04.858118 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52af28c-5d8f-4bbe-85da-3fe4b384150a admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:00:04.861917 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fb3a5-b97d-4a50-9042-a08226b46442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:00:04.863801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fb3a5-b97d-4a50-9042-a08226b46442 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:04.863801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fb3a5-b97d-4a50-9042-a08226b46442 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:04.863801 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fb3a5-b97d-4a50-9042-a08226b46442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:04.873421 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300fb3a5-b97d-4a50-9042-a08226b46442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:00:04.874887 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300fb3a5-b97d-4a50-9042-a08226b46442 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:00:04.884426 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4458/8913] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 05:00:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 05:00:10.096161 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07f8ae-a5a8-40a1-895d-6fb8f72bff2e None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:10.096615 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07f8ae-a5a8-40a1-895d-6fb8f72bff2e None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:10.096711 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07f8ae-a5a8-40a1-895d-6fb8f72bff2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:10.132768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-df07f8ae-a5a8-40a1-895d-6fb8f72bff2e None None] MFA Rules not processed for user `bf29495c1c284b4c9689ce1effb1bfff`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 05:00:10.134231 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-df07f8ae-a5a8-40a1-895d-6fb8f72bff2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:00:10.206099 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4456/8914] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 05:00:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 05:00:10.207186 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fb3a5-b97d-4a50-9042-a08226b46442 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:00:10.217466 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fb3a5-b97d-4a50-9042-a08226b46442 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:00:10.222201 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2561b1a-0d33-4765-8abd-246a52cb4aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:00:10.222805 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2561b1a-0d33-4765-8abd-246a52cb4aed admin admin] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:10.223440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2561b1a-0d33-4765-8abd-246a52cb4aed admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:10.223440 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2561b1a-0d33-4765-8abd-246a52cb4aed admin admin] PATH_INFO: `/v3/projects` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:10.223981 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2561b1a-0d33-4765-8abd-246a52cb4aed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:00:10.225918 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2561b1a-0d33-4765-8abd-246a52cb4aed admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:00:10.327731 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4459/8915] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 27 05:00:10 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 05:00:10.332068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07f8ae-a5a8-40a1-895d-6fb8f72bff2e None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:00:10.343706 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07f8ae-a5a8-40a1-895d-6fb8f72bff2e None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:00:10.402695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0e6c2-2ef1-48cd-94c6-c1d94fe49528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:00:10.403309 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0e6c2-2ef1-48cd-94c6-c1d94fe49528 admin admin] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:10.403590 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0e6c2-2ef1-48cd-94c6-c1d94fe49528 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:10.403868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0e6c2-2ef1-48cd-94c6-c1d94fe49528 admin admin] PATH_INFO: `/v3/users` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:10.404493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0e6c2-2ef1-48cd-94c6-c1d94fe49528 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:00:10.406499 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0e6c2-2ef1-48cd-94c6-c1d94fe49528 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:00:10.484066 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4457/8916] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 27 05:00:10 2022] POST /identity/v3/users => generated 294 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 05:00:10.487995 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2561b1a-0d33-4765-8abd-246a52cb4aed admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:00:10.499177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2561b1a-0d33-4765-8abd-246a52cb4aed admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:00:10.503751 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff89ff-a001-493a-a378-a7bcc4f0815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:00:10.504347 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff89ff-a001-493a-a378-a7bcc4f0815c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:10.504636 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff89ff-a001-493a-a378-a7bcc4f0815c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:10.504913 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff89ff-a001-493a-a378-a7bcc4f0815c admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:10.505560 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff89ff-a001-493a-a378-a7bcc4f0815c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:00:10.507844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff89ff-a001-493a-a378-a7bcc4f0815c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:00:10.518496 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4460/8917] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 05:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 05:00:10.522625 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0e6c2-2ef1-48cd-94c6-c1d94fe49528 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:00:10.532565 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0e6c2-2ef1-48cd-94c6-c1d94fe49528 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:00:10.537449 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72d319-14fb-41ea-a3f5-98481bbab56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:00:10.538217 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72d319-14fb-41ea-a3f5-98481bbab56e admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:10.538501 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72d319-14fb-41ea-a3f5-98481bbab56e admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:10.538775 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72d319-14fb-41ea-a3f5-98481bbab56e admin admin] PATH_INFO: `/v3/projects/0a4b96ce8c564e2c823500ad9c9cdc73/users/92e7c33cc4e9435ea6251245e4702402/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:10.540979 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:00:10.556363 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72d319-14fb-41ea-a3f5-98481bbab56e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a4b96ce8c564e2c823500ad9c9cdc73, user_id=92e7c33cc4e9435ea6251245e4702402, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:00:10.559188 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72d319-14fb-41ea-a3f5-98481bbab56e admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:00:10.634653 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4458/8918] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 05:00:10 2022] PUT /identity/v3/projects/0a4b96ce8c564e2c823500ad9c9cdc73/users/92e7c33cc4e9435ea6251245e4702402/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 05:00:10.638741 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff89ff-a001-493a-a378-a7bcc4f0815c admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:00:10.648869 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff89ff-a001-493a-a378-a7bcc4f0815c admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:00:10.707919 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b403de-0ff0-483a-8710-55e8492f0a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:00:10.708733 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b403de-0ff0-483a-8710-55e8492f0a9c admin admin] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:10.709023 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b403de-0ff0-483a-8710-55e8492f0a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:10.709302 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b403de-0ff0-483a-8710-55e8492f0a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:10.710014 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b403de-0ff0-483a-8710-55e8492f0a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:00:10.711639 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b403de-0ff0-483a-8710-55e8492f0a9c admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:00:10.726273 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4461/8919] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 05:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 05:00:10.727048 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72d319-14fb-41ea-a3f5-98481bbab56e admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:00:10.737635 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72d319-14fb-41ea-a3f5-98481bbab56e admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:00:10.743107 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8d4ce-8b17-4937-9606-bd209b593458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:00:10.743754 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8d4ce-8b17-4937-9606-bd209b593458 admin admin] REQUEST_METHOD: `PUT` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:10.744050 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8d4ce-8b17-4937-9606-bd209b593458 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:10.744322 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8d4ce-8b17-4937-9606-bd209b593458 admin admin] PATH_INFO: `/v3/projects/0a4b96ce8c564e2c823500ad9c9cdc73/users/92e7c33cc4e9435ea6251245e4702402/roles/6e91e7a416ac452b86ec238a2b81bc07` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:10.746246 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8d4ce-8b17-4937-9606-bd209b593458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a4b96ce8c564e2c823500ad9c9cdc73, user_id=92e7c33cc4e9435ea6251245e4702402, role_id=6e91e7a416ac452b86ec238a2b81bc07)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:00:10.748876 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8d4ce-8b17-4937-9606-bd209b593458 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:00:10.758897 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4459/8920] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 27 05:00:10 2022] PUT /identity/v3/projects/0a4b96ce8c564e2c823500ad9c9cdc73/users/92e7c33cc4e9435ea6251245e4702402/roles/6e91e7a416ac452b86ec238a2b81bc07 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 05:00:16.276581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650705b-6e25-4927-8869-99b5602128c8 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:16.277096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650705b-6e25-4927-8869-99b5602128c8 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:16.277183 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650705b-6e25-4927-8869-99b5602128c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:16.309578 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-4650705b-6e25-4927-8869-99b5602128c8 None None] MFA Rules not processed for user `92e7c33cc4e9435ea6251245e4702402`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 05:00:16.311301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4650705b-6e25-4927-8869-99b5602128c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:00:16.326473 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:00:16.398997 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4462/8921] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 05:00:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 05:00:16.416493 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8d4ce-8b17-4937-9606-bd209b593458 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:00:16.418631 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-4fc8d4ce-8b17-4937-9606-bd209b593458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:00:16.515792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8d4ce-8b17-4937-9606-bd209b593458 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:00:16.521401 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136aefa-6846-4909-9545-8709de79a26d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:00:16.522089 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136aefa-6846-4909-9545-8709de79a26d service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:16.522376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136aefa-6846-4909-9545-8709de79a26d service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:16.522652 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136aefa-6846-4909-9545-8709de79a26d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:16.582782 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136aefa-6846-4909-9545-8709de79a26d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:00:16.584673 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136aefa-6846-4909-9545-8709de79a26d service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:00:16.594240 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4460/8922] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 05:00:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 05:00:19.169441 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6825b76-5539-4afc-a764-1c9e30c62b2a None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:19.169965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6825b76-5539-4afc-a764-1c9e30c62b2a None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:19.169965 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6825b76-5539-4afc-a764-1c9e30c62b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:19.192150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-f6825b76-5539-4afc-a764-1c9e30c62b2a None None] MFA Rules not processed for user `bf29495c1c284b4c9689ce1effb1bfff`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 05:00:19.193383 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f6825b76-5539-4afc-a764-1c9e30c62b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:00:19.201298 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4463/8923] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 05:00:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 05:00:19.526891 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136aefa-6846-4909-9545-8709de79a26d service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:00:19.581287 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136aefa-6846-4909-9545-8709de79a26d service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:00:19.584907 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b1b02-e5e4-4858-9400-0acfe058f7ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:00:19.585504 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b1b02-e5e4-4858-9400-0acfe058f7ff service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:19.585787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b1b02-e5e4-4858-9400-0acfe058f7ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:19.586091 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b1b02-e5e4-4858-9400-0acfe058f7ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:19.587824 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-979b1b02-e5e4-4858-9400-0acfe058f7ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:00:19.596986 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b1b02-e5e4-4858-9400-0acfe058f7ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:00:19.598458 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b1b02-e5e4-4858-9400-0acfe058f7ff service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:00:19.606774 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4461/8924] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 05:00:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 05:00:20.017232 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6825b76-5539-4afc-a764-1c9e30c62b2a None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:00:20.019371 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f6825b76-5539-4afc-a764-1c9e30c62b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:00:20.113151 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6825b76-5539-4afc-a764-1c9e30c62b2a None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:00:20.118738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854321e9-a4d2-4684-9120-fe8db32176bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:00:20.120586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854321e9-a4d2-4684-9120-fe8db32176bd service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:20.120586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854321e9-a4d2-4684-9120-fe8db32176bd service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:20.120586 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854321e9-a4d2-4684-9120-fe8db32176bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:20.122345 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-854321e9-a4d2-4684-9120-fe8db32176bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:00:20.135765 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854321e9-a4d2-4684-9120-fe8db32176bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:00:20.138167 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854321e9-a4d2-4684-9120-fe8db32176bd service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:00:20.149094 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4464/8925] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 05:00:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 05:00:29.603606 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=94,keystone:INSERT=2 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:00:30.143552 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=57 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:00:34.370004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b1b02-e5e4-4858-9400-0acfe058f7ff service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:00:34.373146 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-979b1b02-e5e4-4858-9400-0acfe058f7ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:00:34.384273 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b1b02-e5e4-4858-9400-0acfe058f7ff service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:00:34.387987 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12141185-fcfe-4fb5-aab6-6e2124ade793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:00:34.388586 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12141185-fcfe-4fb5-aab6-6e2124ade793 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:00:34.388868 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12141185-fcfe-4fb5-aab6-6e2124ade793 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:00:34.389148 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12141185-fcfe-4fb5-aab6-6e2124ade793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:00:34.398472 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12141185-fcfe-4fb5-aab6-6e2124ade793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:00:34.399910 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12141185-fcfe-4fb5-aab6-6e2124ade793 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:00:34.409323 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4462/8926] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 05:00:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 05:00:44.405106 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:02:21.273856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854321e9-a4d2-4684-9120-fe8db32176bd service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:02:21.295373 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854321e9-a4d2-4684-9120-fe8db32176bd service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:02:21.299028 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10527eee-43c4-4e55-b473-a6364571a485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:02:21.299631 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10527eee-43c4-4e55-b473-a6364571a485 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:02:21.299916 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10527eee-43c4-4e55-b473-a6364571a485 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:02:21.300193 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10527eee-43c4-4e55-b473-a6364571a485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:02:21.301892 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-10527eee-43c4-4e55-b473-a6364571a485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:02:21.324327 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10527eee-43c4-4e55-b473-a6364571a485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:02:21.325752 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10527eee-43c4-4e55-b473-a6364571a485 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:02:21.333929 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4465/8927] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 05:02:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 05:02:31.330301 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=15 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:02:37.426213 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce8506-2798-45be-9e36-63c1c45d54fe None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:02:37.427845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce8506-2798-45be-9e36-63c1c45d54fe None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:02:37.427845 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce8506-2798-45be-9e36-63c1c45d54fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:02:37.486578 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-08ce8506-2798-45be-9e36-63c1c45d54fe None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 05:02:37.487834 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-08ce8506-2798-45be-9e36-63c1c45d54fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:02:37.566003 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4463/8928] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 05:02:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 05:02:37.702104 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10527eee-43c4-4e55-b473-a6364571a485 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:02:37.703581 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-10527eee-43c4-4e55-b473-a6364571a485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:02:37.794756 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10527eee-43c4-4e55-b473-a6364571a485 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:02:37.800355 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c6e04-5c08-45ce-9e99-1980e1625a9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:02:37.800974 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c6e04-5c08-45ce-9e99-1980e1625a9b service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:02:37.801259 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c6e04-5c08-45ce-9e99-1980e1625a9b service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:02:37.801567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c6e04-5c08-45ce-9e99-1980e1625a9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:02:37.809938 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c6e04-5c08-45ce-9e99-1980e1625a9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:02:37.814202 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c6e04-5c08-45ce-9e99-1980e1625a9b service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:02:37.819823 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4466/8929] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 05:02:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 05:02:47.562988 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=47 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:02:47.817784 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=41 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:02:49.022768 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984aa4a5-3de7-4984-a185-927e48a54f76 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:02:49.026693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984aa4a5-3de7-4984-a185-927e48a54f76 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:02:49.026693 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984aa4a5-3de7-4984-a185-927e48a54f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:02:49.043068 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-984aa4a5-3de7-4984-a185-927e48a54f76 None None] MFA Rules not processed for user `bf29495c1c284b4c9689ce1effb1bfff`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 05:02:49.044278 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-984aa4a5-3de7-4984-a185-927e48a54f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:02:49.051133 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4464/8930] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 27 05:02:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 05:02:49.090569 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538a0cc-7289-44eb-99dc-c7c8800e359b None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:02:49.091039 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538a0cc-7289-44eb-99dc-c7c8800e359b None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:02:49.091135 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538a0cc-7289-44eb-99dc-c7c8800e359b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:02:49.152011 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-1538a0cc-7289-44eb-99dc-c7c8800e359b None None] MFA Rules not processed for user `c2b7050fa8404001876dbfd40e392015`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 05:02:49.153233 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1538a0cc-7289-44eb-99dc-c7c8800e359b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:02:49.224330 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4467/8931] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Oct 27 05:02:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 05:02:49.229255 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984aa4a5-3de7-4984-a185-927e48a54f76 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:02:49.239687 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984aa4a5-3de7-4984-a185-927e48a54f76 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:02:49.243252 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a3fff-e040-459b-8550-94c55ebd0fd3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b7050fa8404001876dbfd40e392015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:02:49.244143 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a3fff-e040-459b-8550-94c55ebd0fd3 service glance] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:02:49.244953 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a3fff-e040-459b-8550-94c55ebd0fd3 service glance] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:02:49.245251 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a3fff-e040-459b-8550-94c55ebd0fd3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:02:49.246982 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-222a3fff-e040-459b-8550-94c55ebd0fd3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:02:49.273216 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a3fff-e040-459b-8550-94c55ebd0fd3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:02:49.274636 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a3fff-e040-459b-8550-94c55ebd0fd3 service glance] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:02:49.285472 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4465/8932] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 05:02:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 05:02:50.962598 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538a0cc-7289-44eb-99dc-c7c8800e359b None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:02:50.964562 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1538a0cc-7289-44eb-99dc-c7c8800e359b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:02:50.972695 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a3fff-e040-459b-8550-94c55ebd0fd3 service glance] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:02:50.982183 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a3fff-e040-459b-8550-94c55ebd0fd3 service glance] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:02:50.985848 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071a3dc-96d7-42d7-a26f-a3820dbd1045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:02:50.986511 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071a3dc-96d7-42d7-a26f-a3820dbd1045 service neutron] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:02:50.986800 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071a3dc-96d7-42d7-a26f-a3820dbd1045 service neutron] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:02:50.987081 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071a3dc-96d7-42d7-a26f-a3820dbd1045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:02:50.988850 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-0071a3dc-96d7-42d7-a26f-a3820dbd1045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:02:50.993788 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538a0cc-7289-44eb-99dc-c7c8800e359b None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:02:50.999007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a723bf-f1ea-47b4-a912-c04ae518a8f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:02:50.999726 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a723bf-f1ea-47b4-a912-c04ae518a8f6 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:02:51.000012 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a723bf-f1ea-47b4-a912-c04ae518a8f6 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:02:51.000284 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a723bf-f1ea-47b4-a912-c04ae518a8f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:02:51.001976 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f0a723bf-f1ea-47b4-a912-c04ae518a8f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:02:51.003017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071a3dc-96d7-42d7-a26f-a3820dbd1045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:02:51.004464 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071a3dc-96d7-42d7-a26f-a3820dbd1045 service neutron] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:02:51.014120 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a723bf-f1ea-47b4-a912-c04ae518a8f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:02:51.015710 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a723bf-f1ea-47b4-a912-c04ae518a8f6 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:02:51.015909 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4466/8933] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 05:02:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 05:02:51.027010 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4468/8934] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 05:02:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 05:02:52.510892 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071a3dc-96d7-42d7-a26f-a3820dbd1045 service neutron] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:02:52.524312 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071a3dc-96d7-42d7-a26f-a3820dbd1045 service neutron] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:02:52.530651 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ab92a-8c0a-4eb0-b6c4-d0187b81f8f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:02:52.534798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ab92a-8c0a-4eb0-b6c4-d0187b81f8f5 service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:02:52.534798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ab92a-8c0a-4eb0-b6c4-d0187b81f8f5 service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:02:52.534798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ab92a-8c0a-4eb0-b6c4-d0187b81f8f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:02:52.534798 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-3d1ab92a-8c0a-4eb0-b6c4-d0187b81f8f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:02:52.546596 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ab92a-8c0a-4eb0-b6c4-d0187b81f8f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:02:52.548180 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ab92a-8c0a-4eb0-b6c4-d0187b81f8f5 service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:02:52.558609 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4467/8935] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 05:02:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 05:02:53.443472 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6db06f-f953-4d1d-af1b-f95d474614e1 None None] REQUEST_METHOD: `POST` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:02:53.443934 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6db06f-f953-4d1d-af1b-f95d474614e1 None None] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:02:53.444243 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6db06f-f953-4d1d-af1b-f95d474614e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:02:53.466396 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.auth.core [None req-6d6db06f-f953-4d1d-af1b-f95d474614e1 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 05:02:53.467624 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6d6db06f-f953-4d1d-af1b-f95d474614e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:02:53.475080 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4469/8936] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 05:02:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 05:02:53.487375 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ab92a-8c0a-4eb0-b6c4-d0187b81f8f5 service nova] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:02:53.499356 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ab92a-8c0a-4eb0-b6c4-d0187b81f8f5 service nova] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:02:53.504247 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe54eb6-0d09-4a25-a4e7-6a9d5a81301d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:02:53.504843 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe54eb6-0d09-4a25-a4e7-6a9d5a81301d service swift] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:02:53.505155 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe54eb6-0d09-4a25-a4e7-6a9d5a81301d service swift] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:02:53.505454 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe54eb6-0d09-4a25-a4e7-6a9d5a81301d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:02:53.513806 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe54eb6-0d09-4a25-a4e7-6a9d5a81301d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:02:53.515438 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe54eb6-0d09-4a25-a4e7-6a9d5a81301d service swift] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:02:53.529063 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4468/8937] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 05:02:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 05:03:01.783064 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6db06f-f953-4d1d-af1b-f95d474614e1 None None] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:03:01.793027 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6db06f-f953-4d1d-af1b-f95d474614e1 None None] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:03:01.796676 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d871856-4fb2-46b5-8ea5-bbe4f6c8747f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:03:01.797281 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d871856-4fb2-46b5-8ea5-bbe4f6c8747f service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:03:01.797563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d871856-4fb2-46b5-8ea5-bbe4f6c8747f service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:03:01.797836 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d871856-4fb2-46b5-8ea5-bbe4f6c8747f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:03:01.799583 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-2d871856-4fb2-46b5-8ea5-bbe4f6c8747f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:03:01.809446 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d871856-4fb2-46b5-8ea5-bbe4f6c8747f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:03:01.810903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d871856-4fb2-46b5-8ea5-bbe4f6c8747f service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:03:01.818684 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4470/8938] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 05:03:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 05:03:03.521129 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=32 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:03:11.815285 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=62 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:03:24.276599 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe54eb6-0d09-4a25-a4e7-6a9d5a81301d service swift] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:03:24.287766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe54eb6-0d09-4a25-a4e7-6a9d5a81301d service swift] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:03:24.292717 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a881f7d-1c56-48b0-97db-d045840bdcb5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:03:24.293308 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a881f7d-1c56-48b0-97db-d045840bdcb5 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:03:24.293588 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a881f7d-1c56-48b0-97db-d045840bdcb5 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:03:24.293862 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a881f7d-1c56-48b0-97db-d045840bdcb5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:03:24.295587 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-7a881f7d-1c56-48b0-97db-d045840bdcb5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:03:24.307072 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a881f7d-1c56-48b0-97db-d045840bdcb5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:03:24.308645 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a881f7d-1c56-48b0-97db-d045840bdcb5 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:03:24.318234 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4469/8939] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 05:03:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 05:03:31.620531 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d871856-4fb2-46b5-8ea5-bbe4f6c8747f service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:03:31.632467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d871856-4fb2-46b5-8ea5-bbe4f6c8747f service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:03:31.638159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00137d9-3702-4fe4-9f95-dd03368d285c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:03:31.638773 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00137d9-3702-4fe4-9f95-dd03368d285c service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:03:31.639059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00137d9-3702-4fe4-9f95-dd03368d285c service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:03:31.639339 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00137d9-3702-4fe4-9f95-dd03368d285c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:03:31.641358 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-f00137d9-3702-4fe4-9f95-dd03368d285c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:03:31.653567 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00137d9-3702-4fe4-9f95-dd03368d285c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:03:31.655206 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00137d9-3702-4fe4-9f95-dd03368d285c service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:03:31.665283 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4471/8940] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 05:03:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 05:03:34.314178 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:03:41.661170 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:04:37.086746 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ac234-c82e-46e5-98f1-ad64dd28f6da None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:04:37.087243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ac234-c82e-46e5-98f1-ad64dd28f6da None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:04:37.087444 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ac234-c82e-46e5-98f1-ad64dd28f6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:04:37.107346 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-210ac234-c82e-46e5-98f1-ad64dd28f6da None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 05:04:37.108551 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-210ac234-c82e-46e5-98f1-ad64dd28f6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:04:37.116000 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4470/8941] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 27 05:04:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 05:04:37.161838 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00137d9-3702-4fe4-9f95-dd03368d285c service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:04:37.175122 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00137d9-3702-4fe4-9f95-dd03368d285c service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:04:37.180856 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92ed3d-58c6-4592-9e37-2d9d30416277 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:04:37.186208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92ed3d-58c6-4592-9e37-2d9d30416277 service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:04:37.186208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92ed3d-58c6-4592-9e37-2d9d30416277 service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:04:37.186208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92ed3d-58c6-4592-9e37-2d9d30416277 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:04:37.193553 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92ed3d-58c6-4592-9e37-2d9d30416277 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:04:37.195208 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92ed3d-58c6-4592-9e37-2d9d30416277 service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:04:37.205110 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4472/8942] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 05:04:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 05:04:47.101973 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=3 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:04:47.203798 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=6 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:04:48.294686 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1e058-351d-46b9-9c36-4a55cee6c97d None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:04:48.295145 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1e058-351d-46b9-9c36-4a55cee6c97d None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:04:48.295243 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1e058-351d-46b9-9c36-4a55cee6c97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:04:48.315185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-02b1e058-351d-46b9-9c36-4a55cee6c97d None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 05:04:48.316373 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-02b1e058-351d-46b9-9c36-4a55cee6c97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:04:48.323459 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4471/8943] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 05:04:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 05:04:48.335984 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92ed3d-58c6-4592-9e37-2d9d30416277 service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:04:48.346492 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92ed3d-58c6-4592-9e37-2d9d30416277 service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:04:48.351463 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7cb00-6a52-4e1f-add4-65b5f85afbbe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:04:48.352059 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7cb00-6a52-4e1f-add4-65b5f85afbbe service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:04:48.352348 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7cb00-6a52-4e1f-add4-65b5f85afbbe service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:04:48.352644 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7cb00-6a52-4e1f-add4-65b5f85afbbe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:04:48.360612 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7cb00-6a52-4e1f-add4-65b5f85afbbe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:04:48.362228 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7cb00-6a52-4e1f-add4-65b5f85afbbe service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:04:48.371143 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4473/8944] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 05:04:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 05:04:50.118235 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1e058-351d-46b9-9c36-4a55cee6c97d None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:04:50.120609 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-02b1e058-351d-46b9-9c36-4a55cee6c97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:04:50.137376 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1e058-351d-46b9-9c36-4a55cee6c97d None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:04:50.146479 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7dd1f6-b986-4f59-8ba9-5db0e3c711bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:04:50.147113 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dd1f6-b986-4f59-8ba9-5db0e3c711bd service nova] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:04:50.147393 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dd1f6-b986-4f59-8ba9-5db0e3c711bd service nova] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:04:50.147669 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dd1f6-b986-4f59-8ba9-5db0e3c711bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:04:50.149575 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fe7dd1f6-b986-4f59-8ba9-5db0e3c711bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:04:50.163016 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7dd1f6-b986-4f59-8ba9-5db0e3c711bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:04:50.164620 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7dd1f6-b986-4f59-8ba9-5db0e3c711bd service nova] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:04:50.176377 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4472/8945] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 05:04:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 05:04:52.516215 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7cb00-6a52-4e1f-add4-65b5f85afbbe service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:04:52.527903 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7cb00-6a52-4e1f-add4-65b5f85afbbe service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:04:52.533288 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246247c-e5d8-4c83-bc29-a3bf0abf48c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20881251f2241a3a5ec2e5cf99db149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:04:52.535912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246247c-e5d8-4c83-bc29-a3bf0abf48c1 service nova] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:04:52.535912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246247c-e5d8-4c83-bc29-a3bf0abf48c1 service nova] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:04:52.535912 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246247c-e5d8-4c83-bc29-a3bf0abf48c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:04:52.536166 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-4246247c-e5d8-4c83-bc29-a3bf0abf48c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:04:52.547985 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246247c-e5d8-4c83-bc29-a3bf0abf48c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:04:52.549563 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246247c-e5d8-4c83-bc29-a3bf0abf48c1 service nova] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:04:52.560672 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4474/8946] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 05:04:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 05:04:54.096723 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741fcac-42a4-4769-80a5-c9bfe0b174e3 None None] REQUEST_METHOD: `POST` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:04:54.097224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741fcac-42a4-4769-80a5-c9bfe0b174e3 None None] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:04:54.097224 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741fcac-42a4-4769-80a5-c9bfe0b174e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:04:54.117022 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.auth.core [None req-5741fcac-42a4-4769-80a5-c9bfe0b174e3 None None] MFA Rules not processed for user `f0310313e99d4faebbaa952d20c6dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 05:04:54.118271 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-5741fcac-42a4-4769-80a5-c9bfe0b174e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:04:54.127216 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4473/8947] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 27 05:04:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 05:04:54.140196 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246247c-e5d8-4c83-bc29-a3bf0abf48c1 service nova] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:04:54.151474 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246247c-e5d8-4c83-bc29-a3bf0abf48c1 service nova] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:04:54.156490 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea0531-fa7e-463e-95fe-cb0328775bda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7800497c6e460f9a2a0bd259e6d236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:04:54.157084 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea0531-fa7e-463e-95fe-cb0328775bda service swift] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:04:54.157364 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea0531-fa7e-463e-95fe-cb0328775bda service swift] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:04:54.157638 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea0531-fa7e-463e-95fe-cb0328775bda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:04:54.165545 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea0531-fa7e-463e-95fe-cb0328775bda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:04:54.167146 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea0531-fa7e-463e-95fe-cb0328775bda service swift] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:04:54.175326 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4475/8948] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 27 05:04:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 05:05:04.112110 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=12 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:05:04.171877 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=18 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:05:04.172297 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741fcac-42a4-4769-80a5-c9bfe0b174e3 None None] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:05:04.186185 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741fcac-42a4-4769-80a5-c9bfe0b174e3 None None] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:05:04.191108 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38165ea6-0e54-440f-9ee8-71da1ff19f1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:05:04.195787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38165ea6-0e54-440f-9ee8-71da1ff19f1a service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:05:04.195787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38165ea6-0e54-440f-9ee8-71da1ff19f1a service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:05:04.195787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38165ea6-0e54-440f-9ee8-71da1ff19f1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:05:04.195787 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-38165ea6-0e54-440f-9ee8-71da1ff19f1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:05:04.208004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38165ea6-0e54-440f-9ee8-71da1ff19f1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:05:04.209646 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38165ea6-0e54-440f-9ee8-71da1ff19f1a service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:05:04.220644 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4474/8949] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 05:05:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 05:05:05.733683 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea0531-fa7e-463e-95fe-cb0328775bda service swift] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:05:05.743937 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea0531-fa7e-463e-95fe-cb0328775bda service swift] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:05:05.748742 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ebee8-89da-44e0-b1f0-66cd010a36d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b359391fbc34c259d987e42e8826c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:05:05.749375 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ebee8-89da-44e0-b1f0-66cd010a36d5 service neutron] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:05:05.749750 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ebee8-89da-44e0-b1f0-66cd010a36d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:05:05.750131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ebee8-89da-44e0-b1f0-66cd010a36d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:05:05.823433 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ebee8-89da-44e0-b1f0-66cd010a36d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:05:05.824931 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ebee8-89da-44e0-b1f0-66cd010a36d5 service neutron] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:05:05.836096 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4476/8950] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 05:05:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 05:05:07.850520 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38165ea6-0e54-440f-9ee8-71da1ff19f1a service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:05:07.862731 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38165ea6-0e54-440f-9ee8-71da1ff19f1a service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:05:07.867404 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f478ce9-ae9c-49e9-99bb-c9e2da1b4970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:05:07.870154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f478ce9-ae9c-49e9-99bb-c9e2da1b4970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:05:07.870154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f478ce9-ae9c-49e9-99bb-c9e2da1b4970 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:05:07.870154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f478ce9-ae9c-49e9-99bb-c9e2da1b4970 admin admin] PATH_INFO: `/v3/users/bf29495c1c284b4c9689ce1effb1bfff` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:05:07.870154 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f478ce9-ae9c-49e9-99bb-c9e2da1b4970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf29495c1c284b4c9689ce1effb1bfff)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:05:07.872592 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f478ce9-ae9c-49e9-99bb-c9e2da1b4970 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:05:08.108807 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6f478ce9-ae9c-49e9-99bb-c9e2da1b4970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf29495c1c284b4c9689ce1effb1bfff'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:05:08.109466 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6f478ce9-ae9c-49e9-99bb-c9e2da1b4970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf29495c1c284b4c9689ce1effb1bfff'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:05:08.116785 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6f478ce9-ae9c-49e9-99bb-c9e2da1b4970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf29495c1c284b4c9689ce1effb1bfff'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:05:08.129507 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6f478ce9-ae9c-49e9-99bb-c9e2da1b4970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf29495c1c284b4c9689ce1effb1bfff'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:05:08.202675 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-6f478ce9-ae9c-49e9-99bb-c9e2da1b4970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf29495c1c284b4c9689ce1effb1bfff'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:05:08.209359 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4475/8951] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 05:05:07 2022] DELETE /identity/v3/users/bf29495c1c284b4c9689ce1effb1bfff => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 05:05:08.473177 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ebee8-89da-44e0-b1f0-66cd010a36d5 service neutron] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:05:08.483047 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ebee8-89da-44e0-b1f0-66cd010a36d5 service neutron] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:05:08.543467 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a858f4a-60f2-40cb-ac2f-a20490aefe8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:05:08.544025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a858f4a-60f2-40cb-ac2f-a20490aefe8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:05:08.544309 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a858f4a-60f2-40cb-ac2f-a20490aefe8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:05:08.544584 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a858f4a-60f2-40cb-ac2f-a20490aefe8f admin admin] PATH_INFO: `/v3/projects/6c894a9560d54542a80219708a9a7d0b` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:05:08.545694 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a858f4a-60f2-40cb-ac2f-a20490aefe8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c894a9560d54542a80219708a9a7d0b)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:05:08.547668 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a858f4a-60f2-40cb-ac2f-a20490aefe8f admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:05:08.648714 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6a858f4a-60f2-40cb-ac2f-a20490aefe8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c894a9560d54542a80219708a9a7d0b', 'request_id': 'req-6a858f4a-60f2-40cb-ac2f-a20490aefe8f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:05:08.655464 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6a858f4a-60f2-40cb-ac2f-a20490aefe8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c894a9560d54542a80219708a9a7d0b', 'request_id': 'req-6a858f4a-60f2-40cb-ac2f-a20490aefe8f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:05:08.661025 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6a858f4a-60f2-40cb-ac2f-a20490aefe8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c894a9560d54542a80219708a9a7d0b', 'request_id': 'req-6a858f4a-60f2-40cb-ac2f-a20490aefe8f'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:05:08.745007 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6a858f4a-60f2-40cb-ac2f-a20490aefe8f admin admin] The token cache is being invalidate because project 6c894a9560d54542a80219708a9a7d0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 05:05:08.745541 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6a858f4a-60f2-40cb-ac2f-a20490aefe8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:05:08.746205 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-6a858f4a-60f2-40cb-ac2f-a20490aefe8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:05:08.747699 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4477/8952] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 05:05:08 2022] DELETE /identity/v3/projects/6c894a9560d54542a80219708a9a7d0b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 05:05:08.752004 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f478ce9-ae9c-49e9-99bb-c9e2da1b4970 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:05:08.753459 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-6f478ce9-ae9c-49e9-99bb-c9e2da1b4970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:05:08.766976 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f478ce9-ae9c-49e9-99bb-c9e2da1b4970 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:05:08.823017 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e2ab9-0653-4258-bc40-d4474c203a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:05:08.823579 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e2ab9-0653-4258-bc40-d4474c203a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:05:08.823888 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e2ab9-0653-4258-bc40-d4474c203a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:05:08.824163 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e2ab9-0653-4258-bc40-d4474c203a49 admin admin] PATH_INFO: `/v3/users/92e7c33cc4e9435ea6251245e4702402` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:05:08.825924 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e2ab9-0653-4258-bc40-d4474c203a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92e7c33cc4e9435ea6251245e4702402)` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:05:08.827931 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e2ab9-0653-4258-bc40-d4474c203a49 admin admin] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:05:09.028210 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fb1e2ab9-0653-4258-bc40-d4474c203a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92e7c33cc4e9435ea6251245e4702402'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:05:09.028893 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fb1e2ab9-0653-4258-bc40-d4474c203a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92e7c33cc4e9435ea6251245e4702402'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:05:09.035929 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fb1e2ab9-0653-4258-bc40-d4474c203a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92e7c33cc4e9435ea6251245e4702402'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:05:09.040360 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:05:09.048568 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fb1e2ab9-0653-4258-bc40-d4474c203a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92e7c33cc4e9435ea6251245e4702402'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:05:09.094561 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.notifications [None req-fb1e2ab9-0653-4258-bc40-d4474c203a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92e7c33cc4e9435ea6251245e4702402'} {{(pid=82179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:05:09.100711 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4476/8953] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 05:05:08 2022] DELETE /identity/v3/users/92e7c33cc4e9435ea6251245e4702402 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 05:05:09.331019 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a858f4a-60f2-40cb-ac2f-a20490aefe8f admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:05:09.332513 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-6a858f4a-60f2-40cb-ac2f-a20490aefe8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:05:09.346096 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a858f4a-60f2-40cb-ac2f-a20490aefe8f admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:05:09.367150 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:05:09.403621 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9a0c3-eeaf-4bcf-b868-a4351916868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c4a354216e64f78803accba54466d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8ac2ac85cf42df9e4584993def5b4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:05:09.404256 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9a0c3-eeaf-4bcf-b868-a4351916868e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:05:09.404543 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9a0c3-eeaf-4bcf-b868-a4351916868e admin admin] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:05:09.404823 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9a0c3-eeaf-4bcf-b868-a4351916868e admin admin] PATH_INFO: `/v3/projects/0a4b96ce8c564e2c823500ad9c9cdc73` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:05:09.405945 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9a0c3-eeaf-4bcf-b868-a4351916868e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a4b96ce8c564e2c823500ad9c9cdc73)` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:05:09.407893 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9a0c3-eeaf-4bcf-b868-a4351916868e admin admin] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:05:09.534990 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c4a9a0c3-eeaf-4bcf-b868-a4351916868e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a4b96ce8c564e2c823500ad9c9cdc73', 'request_id': 'req-c4a9a0c3-eeaf-4bcf-b868-a4351916868e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:05:09.541131 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c4a9a0c3-eeaf-4bcf-b868-a4351916868e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a4b96ce8c564e2c823500ad9c9cdc73', 'request_id': 'req-c4a9a0c3-eeaf-4bcf-b868-a4351916868e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:05:09.547159 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c4a9a0c3-eeaf-4bcf-b868-a4351916868e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a4b96ce8c564e2c823500ad9c9cdc73', 'request_id': 'req-c4a9a0c3-eeaf-4bcf-b868-a4351916868e'} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:05:09.626114 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c4a9a0c3-eeaf-4bcf-b868-a4351916868e admin admin] The token cache is being invalidate because project 0a4b96ce8c564e2c823500ad9c9cdc73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 05:05:09.626352 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c4a9a0c3-eeaf-4bcf-b868-a4351916868e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:05:09.627003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.notifications [None req-c4a9a0c3-eeaf-4bcf-b868-a4351916868e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 05:05:09.628527 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4478/8954] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 05:05:09 2022] DELETE /identity/v3/projects/0a4b96ce8c564e2c823500ad9c9cdc73 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 05:05:19.134957 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:DELETE=3,keystone:SELECT=6,keystone:INSERT=1 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:05:19.622844 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:08:32.269270 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e2ab9-0653-4258-bc40-d4474c203a49 admin admin] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:08:32.270738 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-fb1e2ab9-0653-4258-bc40-d4474c203a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:08:32.385546 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e2ab9-0653-4258-bc40-d4474c203a49 admin admin] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:08:32.444832 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deab66e-ba4e-45d8-aecd-058d1e222f72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:08:32.445451 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deab66e-ba4e-45d8-aecd-058d1e222f72 service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:08:32.445739 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deab66e-ba4e-45d8-aecd-058d1e222f72 service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:08:32.446019 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deab66e-ba4e-45d8-aecd-058d1e222f72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:08:32.447776 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.fernet_utils [None req-1deab66e-ba4e-45d8-aecd-058d1e222f72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:08:32.459422 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deab66e-ba4e-45d8-aecd-058d1e222f72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:08:32.461028 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deab66e-ba4e-45d8-aecd-058d1e222f72 service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:08:32.470778 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4477/8955] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 05:08:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 05:08:38.572234 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9a0c3-eeaf-4bcf-b868-a4351916868e admin admin] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:08:38.573671 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-c4a9a0c3-eeaf-4bcf-b868-a4351916868e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:08:38.612447 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9a0c3-eeaf-4bcf-b868-a4351916868e admin admin] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:08:38.617815 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b137e39-cc5f-4262-b4d4-9058eece0505 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:08:38.618469 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b137e39-cc5f-4262-b4d4-9058eece0505 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:08:38.618759 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b137e39-cc5f-4262-b4d4-9058eece0505 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:08:38.619039 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b137e39-cc5f-4262-b4d4-9058eece0505 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:08:38.620738 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.fernet_utils [None req-1b137e39-cc5f-4262-b4d4-9058eece0505 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 05:08:38.632349 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b137e39-cc5f-4262-b4d4-9058eece0505 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:08:38.633953 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b137e39-cc5f-4262-b4d4-9058eece0505 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:08:38.643614 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4479/8956] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 05:08:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 05:08:42.466630 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=80 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:08:48.640003 n-d-862769-1 devstack@keystone.service[82180]: DEBUG dbcounter [-] [82180] Writing DB stats keystone:SELECT=17 {{(pid=82180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:13:36.252766 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deab66e-ba4e-45d8-aecd-058d1e222f72 service placement] Authenticating user token {{(pid=82179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:13:36.264955 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deab66e-ba4e-45d8-aecd-058d1e222f72 service placement] Validating token access rules against request {{(pid=82179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:13:36.270200 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be1816-ebd6-4954-8aeb-61a7806edfcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:13:36.270808 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be1816-ebd6-4954-8aeb-61a7806edfcc service placement] REQUEST_METHOD: `GET` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:13:36.271797 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be1816-ebd6-4954-8aeb-61a7806edfcc service placement] SCRIPT_NAME: `/identity` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:13:36.272087 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be1816-ebd6-4954-8aeb-61a7806edfcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:13:36.280792 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be1816-ebd6-4954-8aeb-61a7806edfcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:13:36.282639 n-d-862769-1 devstack@keystone.service[82179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be1816-ebd6-4954-8aeb-61a7806edfcc service placement] RBAC: Authorization granted {{(pid=82179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:13:36.292674 n-d-862769-1 devstack@keystone.service[82179]: [pid: 82179|app: 0|req: 4478/8957] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 05:13:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 05:13:42.582778 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b137e39-cc5f-4262-b4d4-9058eece0505 service placement] Authenticating user token {{(pid=82180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 05:13:42.598561 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b137e39-cc5f-4262-b4d4-9058eece0505 service placement] Validating token access rules against request {{(pid=82180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 05:13:42.603680 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38dc6e4-c048-497a-bb7c-3cdfdb373968 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a395d2414cd4da085a77ddc9b1f1caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ae07f0abb504c298fc9893b1d8bb173', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 05:13:42.604289 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dc6e4-c048-497a-bb7c-3cdfdb373968 service placement] REQUEST_METHOD: `GET` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 05:13:42.604573 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dc6e4-c048-497a-bb7c-3cdfdb373968 service placement] SCRIPT_NAME: `/identity` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 05:13:42.604851 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dc6e4-c048-497a-bb7c-3cdfdb373968 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 05:13:42.613722 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38dc6e4-c048-497a-bb7c-3cdfdb373968 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 05:13:42.615403 n-d-862769-1 devstack@keystone.service[82180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38dc6e4-c048-497a-bb7c-3cdfdb373968 service placement] RBAC: Authorization granted {{(pid=82180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 05:13:42.625904 n-d-862769-1 devstack@keystone.service[82180]: [pid: 82180|app: 0|req: 4480/8958] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 27 05:13:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 05:13:46.288415 n-d-862769-1 devstack@keystone.service[82179]: DEBUG dbcounter [-] [82179] Writing DB stats keystone:SELECT=6 {{(pid=82179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}